Even diehard fans divided over paying for stadium