The stats disagree with your feelings MAT. The road win % in college basketball is 34%. It is very real, and as far as I know no other sport comes close to that.
And your guess is actually right on. Statistically refs in all sports are biased towards the home team. The theory is that it happens because refs unconsciously get influenced by the emotion of the game and specifically the emotion of the crowd.
Referee bias is statistically the greatest in soccer and basketball - two sports where the referees have a huge influence over the outcome of the game. Also, naturally this influence is greater in college basketball than NBA basketball because the refs in college are not as skilled.