And in another blow for equality, the poll showed women were even more wary of female pilots than men.
Overall, 51% of people admitted they were less likely to trust a woman pilot than a male one, the survey by travel agent Sunshine revealed.
In addition, 26% said the sex of the pilot did not matter, while 14% said they were less likely to trust a male pilot.
Of those less than keen to have a woman at the controls, 32% felt "male pilots were more skilled", while 28% reckoned female pilots would be no good under pressure.
A total of 10% said they would be less likely to trust a female pilot as their previous cockpit crews had been all-male and they did not know what to expect.
Of those not happy with a man flying the plane, 44% said they believed male pilots would be "too hot-headed in a crisis" while 23% thought male pilots might be "too easily distracted".
Sunshine managing director Chris Clarkson said: "To see that more than half would be less likely to trust a female pilot was absolutely astounding.
"Clearly, many Britons have stereotypes that they need to get rid of.
"If pilots become fully qualified and are given their licence, they are perfectly capable of flying a plane and getting you to your destination safely, regardless of whether they are male or female."
A total of 2,367 Britons (1,195 men and 1,172 women) were surveyed. All had been on a holiday abroad in the last 12 months which involved taking a flight.