I also agree with you that Visualization is the key. Have you read much about Medieval and Ancient Greek Memory Palaces?
I run a site on learning about learning. There's a pretty good talk on there by Grandmaster of Memory Ed Cooke - who's just published a book via Penguin on these sorts of Memory Tricks.