Celibacy after midlife
Celibacy, or "Brahmacharya," is man's journey back to divinity and purity. It is immaterial regardless of one's age and gender. While the ill effects of uncontrolled sexuality no doubt take a big toll on the physical, mental, and karmic planes over time, there is no better cure and hope than celibacy. Celibacy alone is the cure on the path of undoing one's wrongs. You have taken the first right decision in showing interest in chastity.
There is no age bar for a man or woman genuinely interested in getting into a life of celibacy. While sooner is always better, it's better to be late than never. Scriptures recommend a starting age around 32-34 as the upper limit to achieve maximum benefits. This is due to the fact that the best sperm and vitality are within man up to this age. Beyond this age, the quality of the seed in a normal man deteriorates. By transmuting the best of his vitality available during this period with unbroken celibacy for 12 years, he can achieve the impossible. There are many instances of people in history who became celibates even beyond this age and yet achieved spectacular name, fame, and self-realization. An age of 35 is still close enough for notable growth. So, by all means, you should become a celibate at the earliest!