After two altercations in the past two games, Indiana Pacers forward Danny Granger vowed Saturday he won't back down from LeBron James in heated moments of their intense series against the Miami Heat.