Imagine that, we agree! Or stand your arse up yourself and get into the game. Part of the allure of actually going to a game is to have an interactive experience. If you just want to passively watch, just watch at home.
I have asked people to keep moving in the aisle when they stop to watch the game. I have been to many sporting events, especially hockey, where movement from your seat is not allowed until there is a stoppage in play.