Eastern State Penitentiary Historic Site Eastern’s massive, medieval frontage stands in stark contrast to it’s church-like interior. Opened in 1829 and known for its grand architecture and strict discipline, this was the world's first true "penitentiary," a prison designed to enthuse penitence, or true regret, in the hearts of convicts. Once the most famous and expensive prison in the world stands today in ruin, a haunting world of crumbling cellblocks and empty guard towers. Its vaulted, sky-lit cells once held many of America's most notorious criminals, including bank robber "Slick Willie" Sutton and gangster Al Capone. A trip to Eastern State includes an audio tour narrated by Steve Buscemi, hands-on experience that allows visitors to unlock an escape-proof cell door, history exhibits in addition to other activities. In the fall, Eastern State also offers one of the scariest haunted houses in the country, Terror Behind the Walls.