Just because men are having less sex now than they were, say, a decade ago, it doesn’t mean it’s due to endocrine disruption. In fact it’s unlikely that 10 years would make that much of a difference in terms of diet, etc. What would make more of a difference is the advent of social media and the complexities it brings with it. Furthermore the whole ‘me too’ movement and the notion of requirement of ‘consent’ is likely to contribute to the decreased level of sexual activity men are involved in.
Alleged hormonal changes within the past decade in men seems to be quite an unlikely explanation for this effect.