Outside of a drastic height difference, many coaches would disagree. If that's the case the taller teams would always win. Modern basketball is more about length (wingspan) than height.
Example: Kentucky's Anthony Davis wasn't the tallest player on the court last night (KU's Jeff Withey was the tallest and KU's Thomas Robinson was taller than UK's Terrence Jones, too, yet the Wildcats won) but had the biggest impact due to his length in terms of rebounds, blocks and altered shots.
And yes, having grown up in Kansas I'm aware of the name issue. Stems from the old Big 8 days (KU for Kansas, MU for Missouri, NU for Nebraska, OU for Oklahoma, etc.)