The PR guru told Southwark Crown Court he had never been sexually frustrated and had had several "loving relationships" with women, and never needed to pursue young girls.
Mr Clifford, 70, who is accused of 11 counts of indecent assault against seven girls and women, has previously branded his accusers "fantasists and opportunists" from the witness box.
As his cross-examination by prosecutor Rosina Cottage QC continued yesterday, the PR advisor was taken through some of his diaries from the late 1970s that included regular references to appointments with different women, including employees, some of whom he has admitted having affairs with.
He told the court: "I was never frustrated....I have been very lucky."
Mr Clifford said he had a "totally loving relationship" with his wife, as well as "loving relationships" with other long-standing mistresses but told the jury he had "no interest or attraction" to young girls.
"I was not sexually frustrated which was what you suggested," he told Ms Cottage.
"I was very happy with my sex life and I didn't need to impress young girls to achieve any kind of sexual satisfaction or interest or stimulation.
"It has never been me, that's not the person I ever was."
He said he was "greedy" in that he had a wife, as well as having affairs, adding: "But I was never frustrated and never interested in silly little girls".
Mr Clifford said there had been "various parts of nudity over 30 or 40 years" in his office, and described a prank where he and comedians Freddie Starr and Lennie Bennett arranged for several girls to be sat topless in his office as a producer for Morecambe and Wise visited.
He denied involvement with James Bond films, other than being PR agent for Suzanne Dando, who was in Octopussy.
The trial continues.