U.S. News & World Report Best Colleges Ranking
The U.S. News & World Report Best Colleges Ranking is an annual set of rankings of American colleges and universities published by U.S. News & World Report beginning in 1983. They are the most widely quoted of their kind in the United States.
The rankings are split into four categories: National Universities, Liberal Arts Colleges, Regional Universities, and Regional Colleges, with the latter two categories further split into North, South, Midwest, and West. The rankings are based upon data that U.S. News & World Report collects from an annual survey sent to each school, as well as opinion surveys of faculty members and administrators from other schools. The publication's methodology was created by Robert Morse, who continues to oversee its application as chief data strategist.[1]
The rankings are popular with the general public (for their 2014 release, usnews.com garnered 2.6 million unique visitors and 18.9 million page views in one day[2]), and influence high school seniors' application patterns (a 2011 study found that a one-rank improvement leads to a 0.9% increase in number of applicants[3]). However, they have been widely denounced by many higher education experts. Detractors argue that they ignore individual fit by comparing institutions with widely diverging missions on the same scale,[4] imply a false precision by deriving an ordinal ranking from questionable data,[5] encourage gamesmanship by institutions looking to improve their rank,[6] and contribute to the admissions frenzy by unduly highlighting prestige.[7]
In addition to the rankings, U.S. News & World Report also publishes college guides in book form,[8] and ranks American graduate schools and academic programs in a number of specific disciplines, including business, law, engineering, nursing, and medicine.[9] In October 2014, the magazine began publishing a Best Global Universities ranking that focuses more on research and includes non-American schools.[10]
Methodology
The magazine U.S. News & World Report's rankings are based upon information they collect from educational institutions via an annual survey, government and third party data sources, and school websites. It also considers opinion surveys of university faculty and administrators outside the school.[11] Their college rankings were first published in 1983 and have been published in all years thereafter, except 1984.
The US News listings have gained such influence that some universities have made it a specific goal to reach a particular level in the US News rankings.[12] Belmont University president Bob Fisher stated in 2010, "Rising to the Top 5 in U.S. News represents a key element of Belmont's Vision 2015 plan."[13] Clemson University made it a public goal to rise to the Top 20 in the US News rankings, and made specific changes, including reducing class size and altering the presentation of teacher salaries, so as to perform better in the statistical analysis by US News.[14] At least one university, Arizona State, has actually tied the university president's pay to an increase in the school's placement in the US News rankings.[15]
The following are elements in the US News rankings as of the 2020 edition.
- Peer assessment: a survey of the institution's reputation among presidents, provosts, and admissions deans of other institutions (20%)
- Retention: six-year graduation rate and first-year student retention rate (22%)
- Social mobility: six-year graduation rates of students receiving Pell Grants—both as a standalone measure and compared to graduation rates of all other students at the school—adjusted significantly to give more credit to schools enrolling larger proportions of students receiving Pell Grants. (5%)
- Faculty resources: class sizes, faculty salary, faculty degree level, student-faculty ratio, and proportion of full-time faculty (20%)
- Student excellence: standardized test scores of admitted students and proportion of admitted students in upper percentiles of their high school class.
- Financial resources: per-student spending related to academics, student support and public service. (10%)
- Graduation rate performance: comparison between modeled expected and actual graduation rate (8%)
- Alumni giving rate (5%)
U.S. News determined the relative weights of these factors and changed them over time. The National Opinion Research Center reviewed the methodology and stated that the weights "lack any defensible empirical or theoretical basis". The first four of the listed factors account for the great majority of the U.S. News ranking (62.5%, according to U.S. News's 2017 methodology), and the "reputational measure" (which surveys high-level administrators at similar institutions about their perceived quality ranking of each college and university) is especially important to the final ranking (accounting by itself for 22.5% of the ranking according to the 2017 methodology).[16]
A New York Times article reported that, given the U.S. News weighting methodology, "it's easy to guess who's going to end up on top: the Big Three, Harvard, Yale and Princeton round out the first three essentially every year. When asked how he knew his system was sound, Mel Elfin, the rankings' founder, often answered that he knew it because those three schools always landed on top. When a new lead statistician, Amy Graham, changed the formula in 1999 to one she considered more statistically valid, the California Institute of Technology jumped to first place. Ms. Graham soon left, and a modified system pushed Princeton back to No. 1 the next year."[17]
A 2010 study by the University of Michigan found that university rankings in the United States significantly affect institutions' applications and admissions.[18] The research analyzed the effects of the U.S. News & World Report rankings, showing a lasting effect on college applications and admissions by students in the top 10% of their class.[18] In addition, they found that rankings influence survey assessments of reputation by college presidents at peer institutions, such that rankings and reputation are becoming much more similar over time.[19]
A 2014 study published in Research in Higher Education removed the mystique of the U.S. News ranking process by producing a ranking model that faithfully recreated U.S. News outcomes and quantified the inherent "noise" in the rankings for all nationally ranked universities. The model developed provided detailed insight into the U.S. News ranking process. It allowed the impact of changes to U.S. News subfactors to be studied when variation between universities and within subfactors was present. Numerous simulations were run using this model to understand the amount of change required for a university to improve its rank or move into the top 20. Results show that for a university ranked in the mid-30s it would take a significant amount of additional resources, directed in a very focused way, to become a top-ranked national university, and that rank changes of up to +/- 4 points should be considered "noise".[20]
Ranking results
Top 10 map
Criticism
During the 1990s, several educational institutions in the United States were involved in a movement to boycott the U.S. News & World Report college rankings survey. The first was Reed College, which stopped submitting the survey in 1995. The survey was also criticized by Alma College, Stanford University, and St. John's College during the late 1990s.[23] SAT scores play a role in The U.S. News & World Report college rankings even though U.S. News is not empowered with the ability to formally verify or recalculate the scores that are represented to them by schools. Since the mid-1990s there have been many instances documented by the popular press wherein schools lied about their SAT scores in order to obtain a higher ranking.[24] An exposé in the San Francisco Chronicle stated that the elements in the methodology of the U.S. News and World Report are redundant and can be reduced to one thing: money.[25]
On June 19, 2007, during the annual meeting of the Annapolis Group, members discussed the letter to college presidents asking them not to participate in the "reputation survey" section of the U.S. News & World Report survey (this section comprises 25% of the ranking). As a result, "a majority of the approximately 80 presidents at the meeting said that they did not intend to participate in the U.S. News reputational rankings in the future".[26] The statement also said that its members "have agreed to participate in the development of an alternative common format that presents information about their colleges for students and their families to use in the college search process".[27] This database will be web-based and developed in conjunction with higher-education organizations including the National Association of Independent Colleges and Universities and the Council of Independent Colleges. On June 22, 2007, U.S. News & World Report editor Robert Morse issued a response in which he argued, "in terms of the peer assessment survey, we at U.S. News firmly believe the survey has significant value because it allows us to measure the 'intangibles' of a college that we can't measure through statistical data. Plus, the reputation of a school can help get that all-important first job and plays a key part in which grad school someone will be able to get into. The peer survey is by nature subjective, but the technique of asking industry leaders to rate their competitors is a commonly accepted practice. The results from the peer survey also can act to level the playing field between private and public colleges".[28] In reference to the alternative database discussed by the Annapolis Group, Morse also argued, "It's important to point out that the Annapolis Group's stated goal of presenting college data in a common format has been tried before ... U.S. News has been supplying this exact college information for many years already. And it appears that NAICU will be doing it with significantly less comparability and functionality. U.S. News first collects all these data (using an agreed-upon set of definitions from the Common Data Set). Then we post the data on our website in easily accessible, comparable tables. In other words, the Annapolis Group and the others in the NAICU initiative actually are following the lead of U.S. News".[28]
Some higher education experts, such as Kevin Carey of Education Sector, have asserted that U.S. News and World Report's college rankings system is merely a list of criteria that mirrors the superficial characteristics of elite colleges and universities. According to Carey, the U.S. News ranking system is deeply flawed. Instead of focusing on the fundamental issues of how well colleges and universities educate their students and how well they prepare them to be successful after college, the magazine's rankings are almost entirely a function of three factors: fame, wealth, and exclusivity. He suggests that there are more important characteristics parents and students should research to select colleges, such as how well students are learning and how likely students are to earn a degree.[29]
The question of college rankings and their impact on admissions gained greater attention in March 2007, when Michele Tolela Myers (the former President of Sarah Lawrence College) shared in an op-ed[30] that the U.S. News & World Report, when not given SAT scores for a university, chooses to simply rank the college with an invented SAT score of approximately one standard deviation (roughly 200 SAT points) behind those of peer colleges, with the reasoning being that SAT-optional universities will, because of their test-optional nature, accept higher numbers of less academically capable students.
In a 2011 article regarding the Sarah Lawrence controversy, Peter Sacks of The Huffington Post criticized the U.S. News rankings' centering on test scores and denounced the magazine's "best colleges" list as a scam:[31]
In the U.S. News worldview of college quality, it matters not a bit what students actually learn on campus, or how a college actually contributes to the intellectual, ethical and personal growth of students while on campus, or how that institution contributes to the public good ... and then, when you consider that student SAT scores are profoundly correlated [to] parental income and education levels – the social class that a child is born into and grows up with – you begin to understand what a corrupt emperor 'America's Best Colleges' really is. The ranking amounts to little more than a pseudo-scientific and yet popularly legitimate tool for perpetuating inequality between educational haves and have nots – the rich families from the poor ones, and the well-endowed schools from the poorly endowed ones.
See also
- U.S. News & World Report Best Global University Ranking
- Fiske Guide to Colleges, the most popular non-ranking college guide in the U.S.
References
- Leiby, Richard (9 September 2014). "The U.S. News college rankings guru" – via washingtonpost.com.
- "U.S. News Pulls Social Levers to Break Records for 'Best Colleges' Package - min Online". 19 September 2013. Archived from the original on 23 January 2015.
- Luca, Michael; Smith, Jonathan (27 September 2011). "Salience in Quality Disclosure: Evidence from the U.S. News College Rankings". Leadership and Management. Archived from the original on 7 November 2013. Retrieved 29 September 2011.
- Gladwell, Malcolm (7 February 2011). "The Trouble with College Rankings". The New Yorker. Retrieved 30 July 2020.
- Strauss, Valerie. "Analysis | U.S. News changed the way it ranks colleges. It's still ridiculous". Washington Post. Retrieved 30 July 2020.
- Breslow, Samuel (26 September 2014). "The Case Against Being (Ranked) the Best". The Student Life. Archived from the original on 25 February 2017. Retrieved 30 July 2020.
- Jaschik, Scott (10 September 2018). "'U.S. News' says it has shifted rankings to focus on social mobility, but has it?". Inside Higher Ed. Retrieved 30 July 2020.
- "Amazon's listings of U.S. News "College Guides"". Retrieved 2015-01-17.
- "Graduate School Rankings". Archived from the original on 2017-02-23.
- "'U.S. News' to Issue New Global University Rankings". Inside Higher Ed.
- "America's Best Colleges". U.S. News and World Report. 2007.
- Time.com
- Bizjournals.com
- Insidehighered.com
- Insidehighered.com
- A review of US News ranking by NORC Archived 2011-06-05 at the Wayback Machine
- Thompson, Nicholas (2003): "The Best, The Top, The Most"; The New York Times, August 3, 2003, Education Life Supplement, p. 24
- Bowman, Nicholas and Michael Bastedo,"Getting on the Front Page: Organizational Reputation, Status Signals, and the Impact of U.S. News & World Report Rankings on Student Decisions." personal.umich.edu Retrieved June 29, 2010.
- Bastedo, Michael N. and Nicholas A. Bowman. "The U.S. News & World Report College Rankings: Modeling Institutional Effects on Organizational Reputation." personal.umich.edu Retrieved June 29, 2010.
- Gnolek, Shari L.; Falciano, Vincenzo T.; Kuncl, Ralph W. (2014). "Modeling Change and Variation in U.S. News & World Report College Rankings: What would it really take to be in the Top 20?". Research in Higher Education. 55 (8): 761–779. doi:10.1007/s11162-014-9336-9. S2CID 144016491.
- "National Universities". U.S. News & World Report. Retrieved 15 September 2020.
- "Liberal Arts Colleges". U.S. News & World Report. Retrieved 26 December 2020.
- Christopher B. Nelson, "Why you won't find St. John's College ranked in U.S.News & World Report Archived 2007-09-27 at the Wayback Machine", University Business: The Magazine for College and University Administrators.
- Diver, Colin. "Is There Life After Rankings". November 2005. The Atlantic. November 1, 2005.
- Rojstaczer, Stuart (September 3, 2001). "College Rankings are Mostly About Money". San Francisco Chronicle.
- Jaschik, Scott (20 June 2007). "More Momentum Against 'U.S.News'". Inside Higher Ed.
- "ANNAPOLIS GROUP STATEMENT ON RANKINGS AND RATINGS". Annapolis Group. 19 June 2007.
- Morse, Robert (22 June 2007). "About the Annapolis Group's Statement". U.S. News & World Report. Archived from the original on 2 July 2007.
- Carey, Kevin. "College Rankings Reformed" (PDF). educationsector.org. Archived from the original (PDF) on August 23, 2009. Retrieved July 28, 2009.
- Tolela Myers, Michele (11 March 2007). "The Cost of Bucking College Rankings". The Washington Post.
- Sacks, Peter (May 25, 2011). "America's Best College Scam". The Huffington Post. Retrieved April 26, 2016.