The Academy of Music at 141 Dutton St. was located on the second floor of the Merrimac House. The Merrimac House was built as a "grand hotel" on the corner of Merrimack and Dutton Streets across the street from the original Boston and Lowell Railroad depot in the early 1830s. It contained ten private Parlours and eighty lodging rooms. The New Music Hall was located in the building on the since before 1896 and according to Cahn's guide, in 1901, W.H. Emery was the proprietor and manager of the Music Hall and John Stiles the business manager. The theater was on the second floor, sat 1000 and had a stage that was 25' wide, 22' high and 33' deep. It became the Academy of Music in 1903 and in 1913 was operated by the United Motion Picture Company. It was then licensed to the Trimount Theatre Company in 1914, J. J. Lyons in 1915 and 1916 and Frank R. Cauley in 1918.
After the depot was destroyed in a fire, the Merrimac House gradually declined and finally closed in 1920. In 1922, the hotel reopened as the Mongeau Building but burned down on April 28, 1924. The Academy of Music is listed in the business directories until 1926. The building was quickly rebuilt but in 1955 was demolished.
Since the early 1960s, several different gas stations have occupied the site.