I stopped off only at the small village of Letdar before reaching the base camps leading to the Throng La pass, the highest point of the trek. Although there isn't much of a difference in altitude between Manang and Letdar, walking does become a little more of a challenge. You will in fact need to give your body time to acclimatise: we're talking about somewhere more than 4,000 m above sea level!
However, given that I'd previously been to Lake Tilicho (5,000 m above sea level), I didn't find it all that difficult to reach the pass. The detour I'm talking about is magnificent, although it does extend the trek by a good two or three days. I'd definitely recommend it to anyone passing the Himalayas during their journey through Nepal.
But let's come back to our sheep. At this point in the trek, there are fewer villages and the lodges are very popular; don't expect to have a lot of choice here. Be that as it may, Letdar does offer some very pretty views, certainly better than those of Yak Kharka. I even regretted not having spent the night there!
I should add that I visited Nepal before the earthquake in 2015; it's possible that in the aftermath, these places have greatly changed.