From memory, you can't. You have to go past it then bear right, and do a loop back on yourself.....Does that make sense???!!! You're talking about going down the highway, right?
Above is correct, you can only come from Eastcheap/Great tower street onto Tower Hill/The Highway. Unless you sneak behind a bus and follow it through, but you may get screwed for doing this!