A friend and ex-colleague of the woman recalled how Mr Clifford's name came up in conversation about six years ago. The woman told the jury at Southwark Crown Court the alleged victim described how he indecently assaulted her when she was 14 after they met at a Wimpy burger bar in London.
It is claimed the incident took place in 1966, when Mr Clifford was in his early 20s.
Mr Clifford, 70, from Hersham, Surrey, who listened to the evidence through a hearing loop, is accused of a total of 11 counts of indecent assault against seven women and girls. He denies all the charges, and says he would not have gone to a Wimpy.
The friend of the alleged victim told the jury Mr Clifford appeared on television at their office and another colleague commented he was "such a lovely man".
The alleged victim, who cannot be named, then began to describe her incident with him, said her friend. "Her words to me were, 'He's not that bloody lovely, he's not that nice, he's a bloody pervert'."
Her friend said she went on to give her "a brief description of an incident" where Mr Clifford "tried it on" and "started touching" her.
The court heard claims on Monday that Mr Clifford drove her to an alleyway "and then he tried to force himself" on her before she escaped.
In the witness box yesterday the alleged victim's friend recalled that she said to her: "Well, it just shows these people aren't whiter than white. Her words were, 'He's just a dirty old b******'."
The court also heard from the alleged victim's daughter, who said her mother mentioned Mr Clifford several times when she saw him on television. She said: "She would make the odd comment, 'Well, I know something about him, I had an experience with him'."
The daughter went on: "She would say, 'Well, there's some skeletons in his closet'."
The trial continues.