At some point during my walk along the wall I saw a large construction nearby. It turned out to be a theatre. This is it.

If my reading of the guide is correct this was constructed (along with a gymnasium) by Pliny the Younger when he was governor of Bithynia as the area was then called. It was later destroyed by the Byzantines to strengthen the city walls, but a decent amount has been dug up.