I don't think there is any way to tell for absolutely certain that it is not in the walls unless you have a way of looking in their
However, if you completely and thoroughly clean it up everywhere where it is visible, and it doesn't ever come back I think it is safe to say it is probably not in the walls.
I lived in apartment with mold in the walls, I would clean up all visible mold, but it would eventually grow back