Kandy is not the most pleasant place to be in Sri Lanka. Its very busy, the noise and traffic are insane and it can feel like everyone is out to get the most out of tourists.
But the Temple of the Sacred tooth, the botanical gardens and the incredible surrounding landscape make it a "must visit" even if you don't stay in the city itself