The married son of a powerful Virginia bowling billionaire had a sordid affair with the family’s one-time nanny, court papers claim.