Neville Neville, 63, is accused of sexually assaulting a 46-year-old woman in March, the Crown Prosecution Service said.
Nazir Afzal from the CPS said: "Greater Manchester Police has investigated an allegation of sexual assault by Neville Neville in March 2013.
"I have reviewed all the evidence that they have gathered and have authorised the police to charge him with one count of sexual assault by penetration against a 46-year-old woman."
He will appear at Bury and Rochdale Magistrates' Court on June 12.
Today Neville's lawyer, Solicitor-advocate Simon McKay, said: "I wish to state clearly that he strenuously denies the allegation.
"I am instructed to test the propriety of the decision to charge and Mr Neville intends to defend the allegation vehemently.
"Please respect the family's privacy at this difficult time."
As well as working as an agent for his sons, outgoing Everton captain Phil and former Manchester United captain, Gary - now an England coach and pundit, Neville Neville is a former director of League One side Bury FC.
He was also a sportsman in his own right, and played for Greenmount in the Bolton Cricket League in the 1980s.