Everyone in the replies here is sleeping on the raw emulation power of most people's phone, doubly so if you're willing to bt sync a controller to it. I've got a significant percentage of the SNES and PS1 libraries playable on mine.
i agree with you, figuring useful and fun UI using touch and swipes is a real challenge. but ive never seen someone whip out a bluetooth joypad for their phone in public.