Keith Ellison dogged by his past