California’s math detracking initiative seems pretty misguided

California’s math detracking initiative seems pretty misguided

Copy the better-performing states, don’t make up new stuff

Matthew Yglesias

 Dec 13 

Comment

Share

California is considering adopting a new Mathematics Framework for its K-12 public schools. This has set off an incredible amount of controversy, including this open letter by a distinguished group of mathematicians, scientists, and technology leaders.

Pushback has been particularly strong from California’s influential tech community, and Rep. Ro Khanna (who represents Silicon Valley but is generally aligned with the left politically) has joined the backlash. The framework itself is incredibly long and includes a bunch of proposals, but at its core, the authors want to “detrack” California’s high school math classes — i.e., not separate students by math ability — and in order to accomplish this, they’re proposing delaying the introduction of algebra and possibly teaching statistics instead of calculus.

(Lea Suzuki/The San Francisco Chronicle via Getty Images)

In practice, the guidelines are not binding. San Francisco is essentially already doing what the new framework proposes and will presumably continue to do so whether or not the state adopts it. Other districts will be free to continue with their current practice even if the new framework is picked up. In other words, it’s unclear to me what the actual stakes are in this debate.

But one big problem with this idea, as Kareem Carr noted, is you can’t really teach statistics properly without calculus, which I think goes to underscore that this is not really a debate about the proper sequencing of math classes. It’s instead another manifestation of the dysfunctional tendency in some edu-left circles to stigmatize all efforts at measurement. If you sort kids into different math tracks based on their test scores, that might reveal that Black and Latino kids are doing worse than white and Asian ones. If you refuse to sort, you can pretend you’ve achieved equality. But will you provide useful education?

Read Joe Hong’s article on the consequences of detracking in San Francisco and you eventually get to Lizzy Hull Barnes, who is in charge of San Francisco math education, saying it’s invalid to look at test outcomes to see whether kids are doing better or worse:

But Barnes said the number of students enrolling in higher level math is a more effective measure and that test score data “is not the measure we would use to evaluate impact.

“In high school they take the test one time in 11th grade,” she said. “It’s difficult to use that as a measurement for success in all of mathematics.”

[Morgan] Polikoff said that although standardized tests aren’t a perfect measure, the district can’t simply dismiss them, especially because they test exactly what students should have learned under the district’s policy change.

I 100% understand that lots of perfectly normal parents and students got test fatigue in the heyday of No Child Left Behind and that there is such a thing as too much assessment.

But the authors of the proposed framework are trying to push the state’s schools in a strange new direction with almost no valid research they can cite to indicate that it’s likely to work. It’s particularly egregious because while California schools do exhibit a racial achievement gap, their results are sub-par across the board. They should be trying to imitate other, better-performing states, not inventing a whole new way of doing high school math.

And I say that despite considerable sympathy for some of the skepticism of heavy reliance on tracking.

Some areas where I sympathize with detrackers

I feel like the policy conversation around tracking has moved with dizzying speed. Just a few years ago, I would’ve said that tracking is overrated in American education circles. I used to hear from a lot of people that the problem in American education was we don’t track aggressively enough, but a good paper by Eric Hanushek and Ludger Woßmann finds that aggressive early tracking systems increase inequality of outcomes while doing nothing to improve average outcomes.

But note that in their paper, the United States counts as a non-tracking system — they are critical of systems that track much earlier and more aggressively than American schools do (note that Hanushek is opposed to the California framework). My read of the evidence is also that selective exam schools are not actually beneficial to the students who attend them, and the people who worry that messing with the admissions criteria will ruin these schools are making an error.

I further think that a lot of the rhetoric around tracking in American schools is harmful and counterproductive. There is no good reason to label a subset of kids “gifted.” It is almost certainly true that for any given group of 13-year-olds, some of them will be more “gifted” at math than others. But what is definitely true is that some of them will know more math than others (David Card and Laura Giuliano specifically studied tracking based on IQ and tracking based on prior school performance, and found that the latter works better). And really, all you need to say to explain why you are sending some kids to one classroom and others to another is that kids with different levels of knowledge need to be taught different things. The key thing here is that overemphasis on natural ability detracts from schools’ ability to serve their actual purpose, which is teaching everyone to be better.

Miles Kimball and Noah Smith did a great column in 2013 about the evidence that telling people they are bad at math causes them to work less hard and learn less math. And an experiment by Lisa Blackwell, Kali Trzesniewski, and Carol Sorich Dweck found that if you tell 7th graders that intelligence is highly malleable through hard work, they then work harder, learn more, and get better grades.

So we should not be stigmatizing students with below-average math scores or embracing rhetoric that implies high math scores are a matter of innate gifts. There are practical reasons to sort students to an extent based on their level of prior accomplishment and demonstrated interest in a subject, but it’s not “Gattaca” where we’re trying to separate the valids from the invalid.

Finally, some of this discourse exhibits a troubling scarcity mentality, like we are hoarding our high-quality educational opportunities for a privileged minority of students. If the topic of discussion was “we’re going to identify kids who are a standard deviation below average and give them tutors,” I don’t think the discourse would go in the direction of “oh no tracking is racist and evil.” People want to feel that their kids are getting a good education. So whatever people get slotted into should be good. Career and technical education programs should have really nice facilities with well-compensated teachers who are held to a high standard. So should programs for academic high-fliers. Scarcity inevitably generates inequality and nasty fights about who gets what. What we want is a big educational opportunity pie, and I can see how failure to provide that generates momentum for detracking.

California’s school performance is troublingly bad

The sane person’s diagnosis of California’s struggles with high school math is that their eighth-graders are way below average in math competency. Looking at eighth-grade math NAEP scores, the high schools are starting with underprepared kids. California’s eighth-graders are doing worse than those in South Carolina, Georgia, Florida, Texas, Tennessee, or North Carolina (among others), and it seems really unlikely that these red states delivered the goods by adopting a new social justice agenda.

Of course, these scores are also influenced by the different demographic compositions of different states. So I always like to check out this interactive from Matt Chingos and Kristin Blagg that offers demographically adjusted NAEP scores. The adjustments make California look a bit better, but it’s still worse than the six southern states I named. Meanwhile, the leaders by far are two liberal states — New Jersey and Massachusetts.

To look at it disaggregated, you can see that California’s struggles are not just an achievement gap question. It’s true that Black and Hispanic Californians do worse than white and Asian ones, but they also do worse than Black and Hispanic Texans and whatever you call people from Massachusetts. Asian Californians do markedly worse than their peers in other states. White Californians are slightly ahead of white Texans, but that’s pretty bad considering that white California adults are richer and better-educated than white Texans.

My view is that laggards should not usually try to be innovators. If Texas wants to make its schools better, the only clearly superior examples are from liberal states (Massachusetts and New Jersey) with much higher taxes and per-student spending levels. So if you’re a Texas Democrat, the solution is to raise taxes and spend more. And if you’re a Texas Republican, you need to try to innovate. But California should be copying the more successful liberal states.

There’s no strong evidence for detracking

Jo Boaler is a professor of education at Stanford and one of the authors of the new math guidelines. I reached out to her assistant asking if she could provide an example of what she saw as a detracking success story. After a little bit of back and forth, they didn’t really get back to me with an answer.

William Mathis from the University of Colorado at Boulder’s education school cites Finland as a successful example of detracking high school math. I think this is doubly wrong. A very large share of Finnish high school students is enrolled in VET schools doing vocational training. I’d also note that — having visited a VET school for beauticians — even the high schoolers on this track in Finland learned algebra. So I don’t think it’s true that Finland has detracked, and it’s definitely not the case that Finland is doing what they are recommending in California.

Boaler’s published research features a bunch of different articles about the virtues of detracking. However, they all ultimately seem to cite back to her original piece “How a Detracked Mathematics Approach Promoted Respect, Responsibility, and High Achievement.” This is a case study of one urban high school in California (she pseudonyms it Railside) that detracked and showed improved performance. She contrasts it with two other nearby high schools that used a conventional approach and showed no improvement. Case studies are interesting, but this is not exactly state-of-the-art social science for the purpose of making sweeping policy recommendations.

Tom Loveless reviewed the research on this for Brookings (and I think went out of his way to be kind to detrackers) and he notes that even in Boaler’s study, “the learning advantages were evident on some tests of mathematics achievement but not on the state mathematics assessment used for accountability purposes.”

By contrast, David Figlio and Marianne Page did a comprehensive statistical review. They note that a lot of the published literature simply observes that students placed in low tracks have bad outcomes, which doesn’t really say anything about the causal impact of tracking. Trying to do statistics to overcome endogeneity problems, they “find no evidence that tracking hurts low-ability children” and “when we account for the possibility that tracking programs affect school choice, we find evidence that they may help low-ability children.”

I don’t think this is exactly a slam dunk in favor of tracking since it’s an older paper using now-outdated data. But I do think a few things are clear:

There are plenty of examples of school systems that produce better-than-California results without adopting detracking.

There is no particularly compelling evidence in favor of detracking.

Though California’s racial and socioeconomic achievement gaps are large, California’s results with high-scoring groups are not particularly impressive.

The downside risks to being seen as dumbing down the curriculum for the smartest kids seem very real to me. If California policymakers want to get smart, they should ditch this idea and focus on trying to learn whatever they can from Massachusetts and New Jersey. Those states are far from perfect and certainly haven’t eliminated achievement gaps (I am very skeptical there is anything you can ask teachers to do inside the classroom that would achieve that), but they really are doing much better, and not with ideological flights of fancy.

Beyond that, because I am obsessed with housing, let’s note that California is in a very stupid situation in terms of its teacher compensation. On the one hand, the state pays the second-highest teacher salaries on average. On the other hand, tons of California teachers can’t afford to live anywhere near their workplace. This is not the be-all-end-all of California education issues, but it is a good example of how bad housing policy exerts a corrosive influence on other areas and undermines efforts to make other systems work well.

Comment

Share

This post is only for paid subscribers of Slow Boring .

Like & Comment

© 2021 Matthew Yglesias Unsubscribe

548 Market Street PMB 72296, San Francisco, CA 94104

Publish on Substack