JOHN Whittingdale, the Culture Secretary, is under increasing pressure to withdraw from decisions about press regulation after revealing that he had a relationship with a sex worker.

The 56-year-old Cabinet minister, who is single, said he had been unaware of the woman's occupation and had broken off the relationship when he discovered someone was trying to sell the story to the press.

Downing Street rallied to his support, saying that he was "a single man who is entitled to a private life" and that David Cameron had "full confidence in him".

But the Essex MP faced calls from campaigners to “recuse” ie withdraw himself from decisions about press regulation amid claims that the revelations had left him vulnerable because there was a perceived conflict of interest.

Read more: Tory minister John Whittingdale admits relationship with sex worker

Although the relationship occurred before he was made a minister following the 2015 General Election, he was chairman of the influential Commons Culture, Media and Sport Committee, which had held a series of high-profile hearings on the phone-hacking scandal.

Mr Whittingdale’s Conservative colleague, Liam Fox, the former Defence Secretary, hit back at Labour, tweeting: “Unbelievable hypocrisy from @labour on @JWhittingdale. The fact papers didn't run story in first place shows press regulation is working.”

It emerged overnight that four newspapers - The People, The Mail on Sunday, The Sun and The Independent - had investigated the claims at the time but concluded it was not a public interest story.

Mr Whittingdale insisted that events had no bearing on any decisions he had taken in office.

"This is an old story which was a bit embarrassing at the time,” he declared. “The events occurred long before I took up my present position and it has never had any influence on the decisions I have made as Culture Secretary."

But Maria Eagle, the shadow culture secretary, said it was essential that Mr Whittingdale acted to ensure there was no perception of "undue influence" in his dealings with the press.

"Everyone is entitled to a private life. However, these revelations raise serious questions about why the Secretary of State has reneged on the Government's promise to deliver the cross-party agreement on Leveson when this is something he was previously committed to as chair of the Culture, Media and Sport Select Committee," she said.

"In order for the public to have any confidence in the Government's approach to press regulation and to allay any concerns about perceptions of any undue influence, the Secretary of State must now recuse himself from any decision-making over this matter, just as Vince Cable was removed from deciding media policy in the last parliament."

Brian Cathcart, from the Hacked Off campaign group, said that since becoming Culture Secretary with responsibility for the media, Mr Whittingdale had taken a number of decisions which had been welcomed by the press.

"He is compromised,” he declared. “There is absolutely no doubt about it; he is compromised. He knew the press were on to him and he didn't tell the Prime Minister and we would like to know more about how much he knew.”

Mr Cathcart went on: "He knew that at least one newspaper had this story; was he approached by other newspapers? Did he ever wonder why they didn't run the story?"

The campaign chief said he thought the newspapers had "stocked up" the story for future use and as a way to possibly put "pressure on him".

But Bob Satchwell, the executive director of the Society of Editors, argued that it was a "preposterous conspiracy theory too far" to say newspapers and broadcasters "jointly decided not to publish" the story.

He said: "The idea that the newspapers and broadcasters could all get together and say 'we are not running the story' is just silly.

"Since the Leveson report and the establishment of a new and tougher press regulator, papers have become extremely careful about stories involving anyone in public life."

In a statement, Mr Whittingdale confirmed he had a six-month relationship with the woman who he met through a dating website. She has been described as a “dominatrix”.

The frontbencher went on: "Between August 2013 and February 2014, I had a relationship with someone who I first met through Match.com. She was a similar age and lived close to me.

"At no time did she give me any indication of her real occupation and I only discovered this when I was made aware that someone was trying to sell a story about me to tabloid newspapers. As soon as I discovered, I ended the relationship." Mr Whittingdale was chairman of the Culture committee for 10 years until May 2015.

The ministerial code of conduct for ministers says they “must ensure that no conflict arises or appears to arise between their public duties and their private interests”. It is the point about “perception” that Labour and campaigners are focusing on.