A visit at the village of Mesochori is something that I definitely recommend.
It's a quaint village built right on the edge of the cliff, looking directly into the horizon and thus offering an insane sunset view. There is a really cute cafe at the cobble-stoned square, near the edge.
This village is very well taken care of by the locals, as well by the overseas communities of Karpathians, something that you will notice in almost all of the villages of Karpathos. It's common for families from the Dodecanese islands to have migrated to the US and Australia (but mainly the US).