I usually always retouch portraits, regardless of whether it's a man or a woman. But most often, of course, I retouch portraits of women. They always don't like something in their photos, and cosmetics don't always cover the shortcomings by 100%. You have to retouch pimples, wrinkles, and minor flaws.
On male portraits, sometimes you also have to use retouching (for example, some men themselves ask for a little retouching of a photo with their image. They also have skin problems, but they, unlike girls, don't use a layer of foundation and concealer with powder) :)
In this case, I don't see anything wrong with retouching.
If you are interested, I use Photo Blemish Remover.