Testosterone levels in men naturally decline with age. After age 40, it may drop about 1 to 3 percent a year. Maintaining a ...