A town carved into the rockface, Vardzia resembles a human warren albeit it in stone.
My suggestion
Even if you're told to visit Vardzia from the neighbouring towns of Akhaltsikhe or Borjomi, I suggest you stay here - I for one felt that I didn't have enough time to fully explore the site.