Ani is the main site to visit from Kars, and in Kars itself you should at least see the kale area and the buildings at its feet.

The museum is small but has some decent finds, here are some.