Deputy Speaker of the House of Commons Nigel Evans will not resume chairing duties in the chamber while police investigations continue into allegations of rape and sexual assault, a Commons spokesman said.

Mr Evans, who was arrested on May 4, had said he would only be away from his duties for a few days during the Queen's Speech debates, which are due to conclude tomorrow.

But a House of Commons spokesman said yesterday: "The Speaker [John Bercow] and Mr Evans, First Deputy Chairman of Ways and Means, met on Tuesday, May 7 and agreed that while Mr Evans will remain Deputy Speaker, he will not resume chairing duties while police investigations are ongoing.

"The Chairman of Ways and Means [Lindsay Hoyle] and Second Deputy Chairman [Dawn Primarolo] also support this approach."

Speaking to reporters in Westminster on May 7, Mr Evans said he was having "just a few days off chair duty" but would continue having his regular meetings with Mr Bercow.

He said he had been overwhelmed by the reaction from MPs as well as the amount of sympathy he had received from the public.

In an earlier statement on May 5, Mr Evans denied the claims made against him.

The 55-year-old MP for Ribble Valley said he had been interviewed by police concerning two complaints "made by two people who are well known to each other and, until Saturday, I regarded as friends".

He added: "The complaints are completely false and I cannot understand why they have been made, especially as I have continued to socialise with one as recently as last week."

Lancashire Police said Mr Evans, who has represented the constituency since 1992, had been arrested on suspicion of raping one man and sexually assaulting another between July 2009 and March 2013.