USPS will increase the price of a Forever stamp on July 12 after federal regulators approved a new round of mailing service price increases.