Social-Science

A while back, I Links Dumped Josh Rosenau's Post Firing Bad Teachers Doesn't Create good Teachers, arguing that rather than just firing teachers who need some improvement, schools should look at, well, helping them improve. This produced a bunch of scoffing in a place I can't link to, basically taking the view that people are either good at what they do, or they're not, and if they're not, you just fire them and hire somebody else. I was too busy to respond at the time, but marked that doen as something to come back to. So I was psyched when I saw this paper in Science about a scientific…
The other big gender-disparity graph making the rounds yesterday was this one showing the gender distribution in the general workforce and comparing that to science-related fields: This comes from an Economics and Statistics Administration report which has one of the greatest mismatches between the tone of the headline of the press release and the tone of the report itself. Nice work, Commerce Department PR flacks. There are a couple of oddities about this report, the most important being that they appear to have excluded academics from the sample, though that probably depends on how people…
Keeping the week's unofficial education theme, Kevin Drum posts about the latest "kids these days" study, namely the just-released NAEP Geography results. Kevin makes a decent point about the 12th grade questions being fairly sophisticated, but includes one comment that struck me as off base: I gotta tell you: I went through the five sample questions for 12th graders, and they were pretty damn hard. This was not "identify France on a map" stuff. I ended up getting them all right, but I was half guessing on some of them. He says that as if it's a bad thing, but it seems to me that it's really…
One of the standard education reform proposals that gets suggested every time somebody brings up the condition of American public education is that teachers should be offered some form of performance incentive, whether in the form of "merit pay" programs on a continuing basis, or bonuses for reaching particular targets. This is one of those ideas that economists swear ought to work, but a new RAND Corporation study found that, well, they don't. This is based on a three-year pilot program run by the New York City school district, which offered selected districts bonuses of up to $3,000 per…
A lot of pixels have been spent discussing this study of grade inflation, brought to most people's attention via this New York Times blog. The key graph is this one, showing the fraction of grades given in each letter category over the last fifty years: Lots of effort is being put into trying to explain why the number of A's given out has increased so much over this time span, with most of it focussing on the last twenty years or so (see Mad Mike for a plausible but wrong explanation-- the fraction of students going on to graduate school isn't big enough to drive this). I think this is…
This morning, via Twitter, I ran across one of the most spectacular examples of deceptive data presentation that I've ever seen. The graph in question is reproduced in this blog post by Bryan Caplan, and comes from this econ paper about benefits of education. The plot looks like this: This is one panel clipped out of a four-part graph, showing the percentage of survey respondents reporting that they are satisfied with their current job. The horizontal axis is the years of schooling for different categories of respondents. So, I looked at that, and said "Wow, people with more education are…
A bunch of people I follow on social media were buzzing about this blog post yesterday, taking Jonah Lerher to task for "getting spun" in researching and writing this column in the Wall Street Journal about this paper on the "wisdom of crowds" effect. The effect in question is a staple of pop psychology these days, and claims that an aggregate of many guesses by people with little or no information will often turn out to be a very reasonable estimate of the true value. The new paper aims to show the influence of social effects, and in particular, that providing people with information about…
As I noted the other day, we're entering graduation season, one of the two month-long periods (the other being "back to school" time in August/September) when everybody pretends to care deeply about education. Accordingly, the people at the Pew Research Center have released a new report on the opinions of the general public and college presidents about various topics related to higher education. The totally neutral post title is copied from their report. So, what do they find about general public attitudes? The usual confused muddle: Cost and Value. A majority of Americans (57%) say the…
A little while back, Jonah Lehrer did a nice blog post about reasoning that used the famous study by Gilovich, Vallone and Tversky, The Hot Hand in Basketball (PDF link) as an example of a case where people don't want to believe scientific results. The researchers found absolutely no statistical evidence of "hot" shooting-- a player who had made his previous couple of shots was, if anything, slightly less likely to make the next one. Lehrer writes: Why, then, do we believe in the hot hand? Confirmation bias is to blame. Once a player makes two shots in a row - an utterly unremarkable event…
Kevin Drum notes a growing backlash against education reform, citing Diane Ravitch, Emily Yoffe and this Newsweek (which is really this private foundation report in disguise) as examples. The last of these, about the failed attempts of several billionaires to improve education through foundation grants, is really kind of maddening. It makes the billionaires in question (Bill Gates, Michael Dell, Eli Broad, and the Wal-Mart Waltons) sound like feckless idiots, but I can't tell if that's just bad writing. The core of the piece is the finding that the districts these guys put money into haven't…
After chasing a bunch of kids with cell phones off of his lawn, Kevin Drum has kicked off a discussion of "multitasking", specifically about whether it's merely a threat, or a positive menace. He points to an interview with Clifford Nass, a researcher who says his experiments show that nobody is any good at doing two things at once. John Holbo at Crooked Timber picks up the discussion and adds a few good points, and there are some others in the comments (CT's comment section being one of the most civilized and erudite in blogdom). In particular, I think John's comment on satisficing is an…
It's NCAA tournament time, which is time for everybody to break out the moralizing stories about the pernicious aspects of college athletics that they've been sitting on since the football season ended. The Associated Press (via the New York Times) clocks in with a particularly discreditable entry, a story on a study of racial disparities in graduation rates in major college baskeball: An annual report by the University of Central Florida's Institute for Diversity and Ethics in Sport found a 2 percent overall graduation rate increase to 66 percent for Division I players, but showed the rates…
One thing that I thought of while writing yesterday's mammoth post about scientific thinking and stereotypes was the notion of stereotype threat, the psychological phenomenon where students who are reminded of negative stereotypes right before a test tend to score worse than they do when taking the test without the negative reminder. This is a hot topic in education research at the moment, and it seems like EurekAlert throws me about one press release a week relating to the topic (or, at least, it seemed that way before I got too bust to keep up with EurekAlert). I ended up not throwing it in…
The always fraught question of student course evaluations has come up again on campus. In discussions, the correlation between "expected grade" and "overall evaluation" has once again been noted-- that is, students who report expecting a higher grade are more likely to give a good overall score to their professors than students who expect a lower grade. Which, of course, does not indicate a causal relationship between those two things, but that doesn't stop us from spinning hypotheses. Thus, a poll question: There is a positive correlation between the expected grade reported and the…
There's been a lot of hand-wringing and finger-pointing in academic circles this week over the release of a book claiming college students are "Academically Adrift" (see also the follow-up story here). The headline findings, as summarized by Inside Higher Ed are: * 45 percent of students "did not demonstrate any significant improvement in learning" during the first two years of college. * 36 percent of students "did not demonstrate any significant improvement in learning" over four years of college. * Those students who do show improvements tend to show only modest improvements.…
I've probably gotten a dozen pointers to Gregory Petsko's open letter in support of the humanities, addressed to the President of SUNY-Albany, over the last couple of weeks (the link is to a reposting of the letter at Inside Higher Ed; it was originally on Petsko's own blog). I haven't linked to it or commented on it here, mostly because while I'm broadly sympathetic with his position, after the second use of "[Famous Writer] said [interesting thing] which I'm sure your department of [humanities field] could tell you about, if you hadn't eliminated them," my reaction had shifted significantly…
In last weekend's post about arguments from innate differences, I suggested that I might be willing to illustrate my position with adorable toddler pictures. On thinking more about it, I'm a little hesitant to write about this at length, because it could easily topple over into arrogant-physicist territory. But then, it's an excuse to post adorable toddler pictures, so... So, let me put a short disclaimer up front: I'm not attempting to claim that I have suddenly uncovered a unique and obvious flaw in innate-difference arguments, by virtue of my Big Physicist Brain. I am well aware that the…
In yesterday's post about the experience of science, I mentioned that I had both a specific complaint about the article by Alexandra Jellicoe (which I explained in the post) and a general complaint about the class in which the article falls. I want to attempt to explain the latter problem, partly because I think it will be useful, but mostly because it's stuck in my head, and I need to at least type out the explanation before I can move on to other things. The article in question doesn't contain all of the elements I'll mention below, but I think it clearly falls into a class of articles that…
As a sort of follow-up to yesterday's post asking about incompetent teachers, a poll on what you might call the "Peter Threshold," after the Peter Principle. Exactly how many incompetent members can an organization tolerate? The acceptable level of incompetence in any organization (that is, the fraction of employees who can't do their jobs) is:Market Research This was prompted by one commenter's estimate that 30% of business managers are incompetent, which seems awfully high to be acceptable, particularly in the business world where, we're told, incompetents are regularly fired without…
As mentioned in the previous post, there has been a lot of interesting stuff written about education in the last week or so, much of it in response to the manifesto published in the Washington Post, which is the usual union-busting line about how it's too difficult to fire the incompetent teachers who are ruining our public schools. Harry at Crooked Timber has a good response, and links to some more good responses to this. I'm curious about a slightly different question, though, which is in the post title. There's a lot of talk about how incompetent teachers are dragging the system down, but…