There's this one library called big whoosh. Can't remember if that one is more over the top or not, so look for some samples to listen to first. It takes a bit more effort, but for more "tame" whooshes I've often had luck with arrow whiz bys and whooshes intended for fight sounds. Sometimes you want to pitch them down a touch and give them a little verb. You could find these sorts of recordings prbably in a general fx library, a mini library of medieval combat fx, or a la carte on a site like sound dogs. Just design a whole bunch ahead of time and keep them on hand.