A building that is – probably much - older than the stadion proper was probably a sacred place, where many gods were worshipped. Initially it extended all the way to the running track, but during repairs on the stadion it was diminished in size. During the Early Byzantine ages, babies’ skeletons were placed in amphoras and then in the niches to be left for the protection of the gods.
Source: Notice on site.