LA Progressive

Smart Content for Smart People

  • Home
  • About Us
    • About Us / Copyright Info
    • Privacy Policy
  • Topics
    • Animal Rights
    • Climate Change
    • Economic Justice
    • Education Reform
    • Elections and Campaigns
    • Environment
    • Community Calendar
    • Healthcare Reform
    • Immigration Reform
    • Labor
    • Law and Justice
    • LGBTQ
    • Progressive Issues
    • Social Justice / Racism
    • The Media
    • The Middle East
    • War and Peace
  • Authors
    • All Authors
    • Steve Hochstadt
    • Charles D. Hayes
    • David A. Love
    • Diane Lefer
    • Dick Price
    • Jerry Drucker
    • John Peeler
    • Joseph Palermo
    • Tom Hall
    • Sharon Kyle
    • Sikivu Hutchinson
  • Events
    • Left Coast Forum
    • Event Calendar
  • Subscribe
  • Contact Us

Yelp! … But For Schools?!

School Performance FrameworkIs it a good idea to label schools with a really simple star-rating? 

Can we do for Education and schools what Yelp has done for eating and restaurants?

No!  Of course not.

And we all know it.  It’s not just that summarizing a complex ecosystem like a school via one, single number is simplistic. It’s not just that your child’s needs are different from my child’s even while both may be served perfectly well (even mutually beneficially) in adjacent seats. It’s not just that your opinion being different from mine might not reflect our legitimate, genuine differences.

It’s that an opinion aggregator like Yelp is fundamentally, technically different from the “School Performance Framework (SPF)” LAUSD resolved to develop for stakeholders in spring of 2018. On further reflection the school board will be reconsidering the summative framework (the wording of this resolution is here, at “tab 26”) at its BOE meetings next month.

Yelp works by taking a hard number, your assessment, and “averaging” that opinion with everyone else’s. Statistical theory shows that with enough of these assessments, they will fall out in a bell curve shape with the peak being the “best guess” of “most” folks’ opinion.

The School Performance Framework would cough up a single number just like Yelp does, but it’s derived completely differently.

The School Performance Framework would cough up a single number just like Yelp does, but it’s derived completely differently. The SPF depends on a guess, an estimate, instead of simply characterizing hard data. (The leap of faith in Yelp scores comes in your presuming the average will be like your opinion, but that’s another issue).

That’s what the much-vaunted “Growth score” is about. “Growth” depends on a bottom-line expectation, a prediction, an interpolation:  a guess.

On the basis of a statistical model that generates an “expectation” of performance, “growth” is defined as the difference between assessed and expected performance. And since “growth” constitutes most of the SPF score, SPF is therefore principally composed of a modeled estimate only. SPF essentially launders a prediction through a process so opaque that it comes out the other end looking like a hard assessment. But it isn’t; it’s still just a guess.

And everyone should know by now that “past performance is no guarantee of future results.” Today’s schools are still hurting from the budget cuts inflicted in 2008 following widespread, collective embrace of venture speculation.

To be sure, the desire to generate a best guess about “performance” is motivated by an urgent and understandable desire.  Parents (and guardians) today, everywhere, do feel impelled to do the best we possibly can for our charges, and that argues identifying, somehow, “the best”.

But as that other great truism suggests:  “you can’t always get what you want.” Just because for-profit real estate websites erroneously render schools’ performance into a single meaningless number, doesn’t mean the public entity overseeing schools should condone or contribute to specious data engineering.

There’s no shortage of information available for analyzing our schools. The trouble is appropriately using it to inform policy, whether public or personal. Parents may access the state’s “dashboard” of school indicators. It will take a little time to understand and hold multivariate factors, but that is our job as advocates and there is no shortcut for it. This matters to us as individuals and because our family’s experience and needs are unique, there is no way to assess individual’s needs globally.

As it happens, wrestling lots of different, and different kinds of, variables down into one single “answer” removes a parent’s prerogative – indeed responsibility – to evaluate the parts that matter most to us personally. But not incidentally, the complexity and nontransparency which marks the SPF index and its “growth” component, winds up just facilitating a route for bias and politicization. Far from being “denied” access to magical growth modeling, halting implementation restricts a system so rococo and esoteric as to camouflage statistical or modeling issues, whether intentional and inadvertent.

Tellingly, the “Performance Framework” is a way of thinking that hails not from education-policy, but instead filters from the world of business management. It arose through 1990s-era strategic management theory, and its establishment of “management processes and setting performance goals and objectives”. Which is to say that the process of setting performance goals and objectives is itself political and subjective. Driven by neoliberal public choice theory this framework champions private business in lieu of public service. And the procedure for deriving performance metrics though numeric, is all the same vulnerable to the ideological bias of its consultants and their overseers, neither statisticians nor even psychometricians, but promoters of this ulterior agenda.

There are other technical objections to the index, but in the end it is enough simply to respect one’s sense that a single rating like this is “too good to be true.” It is the market theorists, afterall, who point out there is “no such thing as a free lunch.” So it is hardly surprising that burying the SPF is not “hiding growth data”, as the charter lobbying front group SpeakUp insists, but protecting us from ideological and political manipulation.

Data is an important tool for understanding and influencing group dynamics. But its use in making individual decisions is another matter altogether. Read the excellent 2014 statement from the professional association of statisticians on precisely this matter (SPF uses a “Value-Added Assessment Model”). And support your school board member in protecting us from other people manipulating our decisions for us. Let them know you support their decision (find contacts here) to rely on the state’s dashboard rather than the SPF. Let them know you support their decision to limit unknown consultant’s filtering of data and instead let the public access education data directly.

Sara Roos
RedQueenInLA

Print Friendly, PDF & Email

By Sara Roos posted on September 28, 2019

DISCLAIMER: The opinions expressed here are those of the individual contributor(s) and do not necessarily reflect the views of the LA Progressive, its publisher, editor or any of its other contributors.

Comments

  1. Amy Evans says

    October 2, 2019 at 8:10 am

    One can only say that the things online that people think are wonderful, often have a much darker side, as does YELP.

    Google…Billion Dollar Bully. The movie is available.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Thank You For Supporting Independent Media. The LA Progressive cannot publish without your support. Please donate. Thanks....

This Weeks Featured Posts

Iranian American Relations

Iranians in the U.S. and Abroad Are Using Cultural Responses to Overcome Political Tensions 

michael bloomberg announces

Veritas Vigil: From Fox’s Media Buzz to Midway

Nunes Sues CNN

DIS-information Give Me…Memphis, DC

Watch NFL Football

Why I Still Watch NFL Football

Impeachment Trap

Trump’s Trap: How to Get Out





Holding Trump AccountableMatt Bevin DepartsDan BrotmanTrump the Anti-ConservativeMoral InjuryUnited WorldVietnam and MemphisTrump Impeachment TrialLiberals Love War



Sponsored

Best Wedding Photographer Surrey

The Best Wedding Photographer Surrey

Breaking Through the Glass Ceiling: Tips For Women Trying to Market Themselves Online to Potential Employers

More Posts from Sponsored

Book-A-Bus



Article Categories

Africa | Animal Rights | California
Climate Change | Defense | Economic Justice
Education Reform | Elections | Environment
Events | Foreign Policy | Gay Rights
Healthcare Reform | Immigration Reform
Juvenile Justice | Labor | Latin America
Law and Justice | Los Angeles | Prison Reform
Progressive Issues | Science & Religion
Sexism | Social Justice | Terminal Velocity | The Body Politic
| The Media | The Middle East | Veterans
War and Peace | Wellness

Los Angeles

Organizing in South LA

Rethinking 27 Years of Organizing in South LA

Elect Loraine Lundquist

Let’s Elect Loraine Lundquist, a Breath of Fresh Air for City Council 

More Posts from Los Angeles

The Middle East

If Americans Knew

The Most Enduring Media Cover Up

Trump and Netanyahu

Trump and Netanyahu: How the Far Right Subverts Democracy Globally

More Posts from The Middle East

Economic Issues

Race to the Bottom

“Booming” Economy Means More Bad Jobs and Faster Race to the Bottom

billionaires and capitalism

Why Billionaires Don’t Really Like Capitalism

More Posts from Economic Justice

Copyright © 2019 · Dick Price and Sharon Kyle · Log in