My map site, www.adventurers-atlas.com is built on Wordpress. It uses a theme that I purpose-built for it, and I've figured out ways of implementing pretty much all the functionality I need from it. To be able to turn a Wordpress theme into soft putty that conforms to your imagination takes a fair bit of doing if you don't know CSS (for layout & styling) and PHP (for functionality).
Adventurer's Atlas doesn't run under the Wordpress.com server (we have our own hosting) so as a result I probably have access to more stuff to customize than you do on the server side, but I'd be happy to help you out with Wordpress development if you have any specific, technical questions.