How School Rankings Are Misleading U.S. Home Buyers

There are many factors for parents to consider when buying a new home. At the top of this laundry list of criteria are the schools. When parents start researching schools, they will likely find a school rankings website, the largest of which is GreatSchools.com. But the established school rankings websites can mislead home buyers by steering them towards privileged areas, and discounting schools with socio-economic diversity.

As a result, parents with means are buying in the most expensive neighborhoods, with longer commutes, and very little diversity, all in the name of chasing the “best” schools. Similarly, lower income parents who cannot afford the real estate where the “best” schools are located feel forced to accept lower rated schools in areas they can afford. Or they move further away from the city core until they find a “good” school they can afford. But in reality, the best schools are not necessarily in the wealthiest areas, and lower income families do have many options to attend highly rated schools close to where they work.

School rankings websites are missing the mark, and SchoolSparrow believes it has found a better way to rank schools. 

The dominant school rankings systems out there are misleading parents. The US needs an equitable school ranking system. #schoolequity #schoolsparrow

Image: https://www.timeshighereducation.com/features/top-20-ways-to-improve-your-world-university-ranking/410392.article

The Source

U.S. Home Buyers often turn to websites such as Apartments.com, Zillow, Redfin or Realtor.com when looking for a property. These websites have a data feed from GreatSchools which assigns a ranking (1-10) to schools that serve a particular home. The criteria that GreatSchools uses to rank schools is found on their website:

“student access to advanced courses, student progress information, and equity data to help parents see whether or not all students are being served similarly”.

However, a closer look at their methodology reveals that a large percentage of the criteria they use to rank schools is test score data. GreatSchools uses the state average test score as the benchmark by which they interpret the test score data.

The Problem

Chalkbeat published a great article in late 2019 that describes the problem.

The major problem with GreatSchools and other similar school ranking systems is that research has shown that the biggest influencer of test scores at a school is parent income, not the quality of the school itself.  In fact, test scores at any given school are up to 80% determined by parent income and 20% other factors. So, without parent income as part of the equation, school rankings are simply comparing parent incomes at different schools.

This has a dual effect of:

 a) giving poor marks to schools with low parent income, even if a school is far exceeding expectations, and

 b) giving high marks for undeserving schools because the state average test score is too low a bar for schools in privileged areas

For example, the state average in Illinois is about 37% of kids meet or exceed the Reading/Language Arts portion of the Nation Assessment of Academic Progress (NAEP) standardized test. And the average income in Illinois is about $67,000 a year.  If a majority of families in a certain school make double that amount, is 37% an appropriate bar by which to measure school performance? Absolutely not, it should be higher.

Using data science, SchoolSparrow has developed a ranking system that normalizes for parent income. Our ranking system effectively raises the bar for privileged schools, and lowers the bar for schools in economically challenged areas. Schools are then ranked by extent to which they exceed or fall short of the bar. On our system, two different schools could have the exact same test scores, but if one is in a wealthy area and the other in a disadvantaged area, then the disadvantaged school will get a better grade. Other ranking systems are not doing this.

School Ranking Examples

Let’s take a look at some examples of school rankings that GreatSchools has assigned in order to illustrate this problem.

Haugan Elementary – an underrated Out-Performer

Consider Haugan Elementary in Chicago, with 97% of it’s student qualifying for free lunch. This school has an expected test score of 20.80 when adjusted for parent income. But the students at this school outperform expectations, scoring a 32.0 on the reading/language arts section of the NAEP testing. Parents of Haugan students make a below average income, yet the students are exceeding expectations by over 50%. 

On GreatSchools, this school scores a grade of a 5/10, and says “this school may still have achievement gaps”. The reality of this is that this school is significantly exceeding test score expectations based on parent income.

On SchoolSparrow, Haugan Elementary scores an A grade (equivalent to 10/10) because its students are far exceeding expectations.

Haugan Elementary. Image: https://www.classmates.com/places/school/Haugan-Elementary-School/17877261
William Mitchell Elementary – overrated?

Let’s take a look at a school that ranks 8/10 on GreatSchools. This school is William Mitchell Elementary School in Needham, MA, a high income suburb of Boston. This school has a student population that is 82% white, and only 1% of students receive free lunch. Mitchell has an expected test score of 75.72, but students are only achieving an average of 73.0 on their tests. This school gets a grade of C- (equivalent to a 5 out of 10 on Schoolsparrow). But because this school’s test scores are well above the state average, GreatSchools scores this school an 8/10.

This isn’t to say Mitchell is a bad school, but compared to schools in wealthier areas in Boston, this school has average test performance.

William Mitchell Elementary. Image: http://mitchell.needham.k12.ma.us/

GreatSchools ranking system is flawed, as it favors predominantly privileged schools with parents who bring in a higher income.

A “good school” is not just a school that achieves high test scores. At SchoolSparrow, we believe identifying the extent to which a school exceeds expectations at any given parent income level creates a more fair, equitable ranking system. A school is doing something right when students achieve test scores higher than expected; these are the schools that are doing a great job of educating students. 

How Does This Mislead Home Buyers

The problem with other ranking sites is that they inadvertently exacerbate the segregation of our nation’s schools. Schools that are 9’s and 10’s are often located in privileged, predominantly white neighborhoods with expensive homes that lower income families cannot afford. At the same time, families that are targeting high scoring schools are overlooking schools with socio-economic diversity, unaware that the lower scores at these schools may simply be a reflection of that diversity and vibrancy, not that the school is “bad”.

These other ranking sites typically do nothing to help educate parents on this fact. As a result, families with high incomes are being pushed to the most privileged areas with expensive real estate, often in the suburbs with long commutes, less time with their family, and little to no diversity, all in the name of chasing ‘the best’ schools. Similarly, families with lower incomes feel forced to either live extremely far away from work, or settle for a school with a low score. But in reality, there ARE good schools with affordable real estate located close to the urban core.

SchoolSparrow aims to educate parents on the impact of parent incomes. Our more equitable ranking system elevates schools with socio-economic diversity, and reveals to parents Out-Performers in more affordable neighborhoods. These schools are often located closer to the urban core with shorter commutes, more affordable homes, and more diversity.

Moving to Boston?

To illustrate an example of how GreatSchools ranking system is potentially misleading home buyers, imagine someone is looking for a home in Boston. If they were to go to GreatSchools, this is the map they would see.

Image: https://www.greatschools.org/massachusetts/boston/schools/?gradeLevels%5B%5D=e

In Boston’s city limits there are only 6 schools that rate above a 5. But given Boston’s lottery system, there is no guarantee your kids will get into one of these 6 “good” schools. As a result, homebuyers might eliminate the city of Boston as an option due to the schools. Hello Suburbs. Hello long commutes, expensive real estate, and very little diversity.

But in reality, when parent income is accounted for, Boston proper has many overachieving schools. 

An example of one of these schools is Joseph J. Hurley, which has a 5 rating on this map from GreatSchools. On SchoolSparrow, Hurley scores a B+ which indicates this school is outperforming expectations given the average parent income level at the school. Joseph J. Hurley has a diversity score of 15, and 56% of students get free lunch, indicating this school has both cultural and economic diversity. Based on parent income, Hurley’s expected test scores are 34.49. The actual average test score at the school is a 52.0, which is outstanding. On SchoolSparrow, Hurley is one of the best schools in the entire Boston region, including the suburbs, yet parents are overlooking Hurley because of a poor GreatSchools score.

Joseph J. Hurley School. Image: https://app.emaze.com/@AWORFWOL#1

This is a quality school that is in Boston proper with shorter commute times and more affordable homes, yet you would never know from looking at the rankings on GreatSchools. 

View our list of 5 Out-Performers in Boston proper, and our updated list of the Top 10 Out-Performers in Boston Proper.

At SchoolSparrow, we adjust for parent income, and this allows homebuyers to identify schools that they would otherwise overlook as possible candidates for their kids. 

Please help us

The dominant school rankings systems out there are misleading parents. The US needs an equitable school ranking system. #schoolequity #schoolsparrow

We are fighting to make equitable school rankings available to all parents in the US. We need your help, please sign up on our mailing list to learn how to help, or to keep updated on our progress.

Processing…
Success! You're on the list.
+ posts
You can take action right now to help put an end to discriminatory school rankings. Share this post!

18 Comments

Leave a Reply