Kataragama does have religious significance for Sri Lankan people but for those visiting it is mainly used as the starting point for many Yala safaris.
Yala is insanely busy due to its high density of leopards and there is no time of year when there aren't armies of 4x4s in the park.
Stay here to be close to the entrance to start as early as you can