The Dons fell four points behind Ross County in the Clydesdale Bank Premier League and saw their hopes of a top-six finish take a blow when they lost 1-0 to the Dingwall side at Pittodrie last night.
Aberdeen have only taken two points from six games against high-flying Highland sides Inverness and County, and Rae knows time is running out to prove themselves.
Rae told RedTV: "It's difficult - fans are always impatient and I can understand that because everyone wants to see their team doing well.
"I support the team as well, I have supported the club all my life.
"It's difficult seeing the club like this and not doing as well as we would like.
"I don't think it's that far away but you don't get that time in football to produce what you want to.
"We have got to make sure points come on a match day.
"We are probably not scoring enough goals apart from Niall (McGinn).
"There is a lot of quality and talent but it's about showing it in a game."
Rae was honoured to captain the team against County but he was hurting badly afterwards.
"All my family support the club through thick and thin and it's been difficult for the last few years," the former Scotland midfielder said.
"For me to get the opportunity to play for them, I want to do a lot better."
Aberdeen have four games to avoid a fourth consecutive bottom-six finish but have a difficult run against Motherwell, Celtic, Hearts and Dundee United.
Rae said: "It's frustrating we are in this position that we are scrapping it out.
"It's still tight but have got to take care of our own business and if we do that it will give us a chance."