Remi Ayodele denies saying the infamous quote from the Saints bounty scandal