Ryoanji Temple Rock Garden in Kyoto is a famous Zen garden with fifteen stones arranged on white sand. The garden's design is open to interpretation, with theories ranging from islets in an ocean to tigers crossing a river. If you come here early it is definitely a place to find quite & experience the Zen garden, unfortunately when we were there is was quite busy, still absolutely stunning though.
As an alternative to find a more quiet temple we suggest Taizō-in.