Northern Minnesota is under a new alert until Friday at 7 p.m.

MPR News helps you turn down the noise and build shared understanding. Turn up your support for this public resource and keep trusted journalism accessible to all. 

Turn Up Your Support

It's college-rankings season in America -- the time when when even the most patient college administrators roll their eyes.

rankings, the most influential of them all, is a climax of sorts to a business that makes money off ranking schools by any number of things: academic caliber, value for money -- even food.

Each year, the public eats those rankings up -- as well as lists and rankings from 

, and a number of other national and international sources.

And yet flaws in the rankings' philosophy and methodology mean students who shoot for only the highest-ranked school they can reach are bound to be disappointed, higher education officials warn. And college administrators are often left to answer questions about why their schools have inexplicably jumped or dropped in the lists -- even though nothing at their schools has really changed from one year to the next.

"Most college presidents I know would prefer that the rankings didn't exist," said MaryAnn Baenninger, president of the 

 and chair of the Board of the Minnesota Private College Council.

 rankings for undergraduate institutions, first published in 1983, collects data on 1,600 colleges and universities and then ranks them in various categories and by types of college. The magazine weighs as many as 16 factors such as academic reputation, faculty resources, graduation rates and student selectivity.

"I understand the attraction," Macalester College President Brian Rosenberg said. "You're taking a very complicated thing, and appear to make it much simpler. The notion that you can look at the list and see this school is better than that school, which can be very reassuring to people."

But for years, critics have attacked the idea of a "best" university, saying it's impossible to quantify something as intangible as educational excellence, or say that one school is best for all, or add up how much better one school is to another -- especially one considered a peer.

 director of data research, Robert Morse, acknowledges that the rankings are just a rough tool to help gauge what colleges are a good fit -- especially for students from cash-strapped high schools that don't have enough college counselors to offer much help.

"(We want) to stress that the rankings not be used as the sole basis to choose a college," Morse said. "

 is not saying that parents should draw a line in the sand and say, 'We should only go to schools above (rank) 10 or between 10 and 20."

Admissions consultant Todd Johnson, owner of College Admissions Partners, agrees.

Choosing a school based on a ranking "is where it becomes problematic," he said. "If you're looking at No. 2 vs. No. 50, yeah -- maybe there's a difference. But No. 2 vs. No. 5 -- that’s ridiculous. And between No. 2 and 20, probably not much difference, either."

The philosophy of ranking aside, many critics say the methodology itself is flawed. Among the problems:

Morse has said surveys of reputation are important because they provide the intangible elements of a school that raw data just can't show. And he told MPR that aggregated responses of college leaders is still a fairly accurate indication of a school's standing.

Large changes in a a school's ranking are more of a problem for smaller schools, he said, because changes in data aren't diluted as they are at large universities. That said, the actual data does change year to year, so the occasional drop or jump in the rankings is valid, he maintained. Ranking departments is a task too large and complicated for the magazine's resources, he said, and the role of money is not something one can wish away.

"Schools with limited resources aren’t producing the same level of academic programs or service or academic package that schools with resources are," he said.

 rankings affected schools after a quarter of a century or so?

They've produced some odd dynamics, Michigan's Bastedo explained in a recent article for Oberlin College's alumni magazine:

Morse said he hadn't seek Bastedo's research, but remained "skeptical" that his methods could come to that conclusion.

Ultimately, Bastedo told MPR, "The irony is that rankings are designed to serve those outside of education, (but) it just turns out that the people really interested are in higher education. We’re looking at ourselves."

The higher education sector's distaste for rankings has spawned numerous education journal articles with titles such as "Flawed rankings," "Fixed Rankings?" "Obsession with Rankings Goes Global," and even "The Madness of Rankings."

Several dozen college presidents signed a letter in 2007 pledging not to participate in 

 survey of their peers' reputations or use the rankings in marketing or other publicity.

But efforts to combat the ratings don't appear to have affected them much.

On his college's Web site, Macalester's Rosenberg wrote a piece called, "The Great Ratings Debate: Should Macalester join the boycott of 

"I am inclined to think that more information is better than less and that consumers should determine which forms are most useful and reliable," he wrote. "Attempts to suppress even the most baseless and scurrilous publications have rarely succeeded."

As a possible antidote, he pointed to the Annapolis Group, an organization of about 130 liberal arts colleges that announced in 2007 that it would start working on its own system for comparing colleges. Since then, though, the project appears to have gone inactive.

St. Benedict's Baenninger, who was involved in the project, said, "Over time it's better to leave (such work) to other more encompassing organizations," and mentioned that the National Association of Independent Colleges and Universities has produced its own set of online comparisons, called U-Can.

Meanwhile, college presidents continue to view rankings with mixed emotions.

“There’s the old cliche: Presidents love rankings when they’re good, and then they’re not, they think they don’t matter,” Hamline University President Linda Hanson told MPR last year.

Baenninger's bio page on St. Benedict's Website, for example, lists the college's place in the rankings, as well as its rise under Baenninger's tenure. And at another part of the site, St. Benedict's touts its appearance in several ratings and college guides -- but also includes some caveats about such listings.

The college doesn't send out a press release when the U.S. News rankings come out, and neither does Macalester anymore.

And would tooting their own horns help anyway?

Probably not too much, as Bastedo has said.

John Lawlor, founder of higher-education marketing firm The Lawlor Group in Eden Prairie, said students and families generally don't rely heavily on rankings, and use them them merely as a starting point in their search.

" of a college, he said. "They don't influence 

That said, Phil Trout, a college counselor at Minnetonka High School, said a few parents and students do give the rankings their complete trust, and come to his appointments with their ranked listings marked up and highlighted.

Like many in higher education, Trout tells them not to shoot for the most highly ranked college, but for the one that seems best matched to the student's personality and interests.

Rankings do provide a lot of backup material and data that show some of the personality of a campus, college officials say say. And different ranking systems use different criteria, so parents need to know what's important to the rankers to understand how they're skewed.

Minnetonka graduate Jennifer Friedlander, now a junior at Middlebury College in Vermont, wrote in an e-mail to MPR, "Overall, I think rankings matter if you are not an involved student. If you have a sport, activity, hobby that a school can really foster, that is where you go."

rankings did act as a red flag for Minnetonka High parent David Drueding, who said, "I'm worried if a school was poorly ranked. I'm worried if it's at the bottom."

He views ratings with a healthy dose of skepticism, but says, "I’m glad they’re there. I’d hate to go out into the world without something."

Alex Friedrich

Author

It’s college-rankings season in America — the time when when even the most patient college administrators roll their eyes. The release of the annual U.S. News & World Report Best Colleges rankings, the most influential of them all, is a climax of sorts to a business that makes money off ranking schools by any number…

College administrators: Rankings can be problematic

Go Deeper.

Like this?