The Ribble Valley MP made a personal statement to MPs after deciding to step aside after charges were announced.
Earlier, Commons Speaker John Bercow told MPs he was "warmly grateful" to Mr Evans for his three years service as a deputy.
Mr Evans said: "I hope you will bear with me while I make this statement, it's been a few years since I made a speech in this chamber and I'm sad to say this is the speech. As many of you will know following recent allegations, I was charged with alleged offences yesterday.
"I now have the opportunity to robustly defend my innocence and seek acquittal.
"I have therefore decided the best course of action is for me to return to the backbenches."
Mr Evans, 55, is accused of two offences of indecent assault, five counts of sexual assault and one rape charge.
Shortly after leaving Preston police station last night, he vowed to clear his name.
He said: "I am certain of two things: firstly, that I am innocent, and secondly, that my innocence will be demonstrated.
"Having informed my fellow deputy speakers, Lindsay Hoyle and Dawn Primarolo, my association chairman and my staff, I can confirm I will now resign as deputy speaker.
"However I will continue to work hard for the people of the Ribble Valley from the backbenches where I first started my political career in 1992."
Mr Evans will appear before magistrates in Preston on September 18.