Moneyball and the Metrics That Matter in Academic Medicine
You Are Measuring the Wrong Things
There is a moment early in Moneyball where Billy Beane's scouts are sitting around a table arguing about a prospect's arm strength. His batting stance. Whether he looks like a ballplayer.
Peter Brand, the quiet Yale economist, finally speaks up. "Your goal should not be to buy players. Your goal should be to buy wins. And to buy wins, you need to buy runs."
That single insight rewired a sport. And it is exactly the insight that most academic medicine departments still have not absorbed.
RVUs and the Batting Average Problem
In baseball before Moneyball, batting average was king. Scouts and managers built entire strategies around it. The problem, as Michael Lewis details in his 2003 book Moneyball: The Art of Winning an Unfair Game, was that batting average missed most of what actually predicted winning.
In academic medicine, the equivalent sacred metric is the RVU. Relative value units dominate clinical faculty evaluation the same way batting average dominated baseball. How many patients did you see? How many procedures did you bill? What is your productivity number?
RVUs are not useless. But they measure volume, not value. A faculty member can generate impressive RVUs while burning out their team, ignoring trainees, and providing mediocre patient experiences. The number still looks great on the spreadsheet.
That is exactly the trap Beane's scouts fell into. The player looked good on paper. The metric was real. It just was not measuring what mattered.
What Actually Predicts Faculty Success
Beane and Brand went searching for undervalued statistics. On-base percentage. Walks. Plate discipline. Numbers that actually correlated with scoring runs but that nobody was paying attention to.
Academic medicine has its own undervalued metrics. Here are a few that I believe matter far more than most departments track:
- Trainee outcomes. Not just teaching evaluations, which are popularity contests. Where do your mentees end up? Do they stay in academics? Do they thrive?
- Retention of colleagues. When someone joins your section, do people stay? A faculty member who drives away three colleagues costs the department far more than their RVUs generate.
- Time to independent funding for junior faculty. This says more about a department's mentoring culture than any single publication count.
- Patient experience consistency. Not one quarter's scores. The trend over two or three years.
- Citizenship behaviors. Who shows up to grand rounds? Who takes the difficult committee assignments? Who mentors without being asked?
None of these show up on a standard annual review template. But they predict long-term departmental health the way on-base percentage predicts winning baseball games.
The Scouting Problem
The Oakland A's scouts in the film are not stupid. They are experienced and passionate. Their problem is that they have been rewarded for decades for evaluating players a certain way, and they genuinely cannot see why that way might be wrong.
I see this with department chairs and promotion committees. They look at a faculty member's CV and count publications, grants, and H-index. They always have. It has always been the basis for promotion. And for a long time, nobody questioned it.
But a 2019 paper by Atasoylu et al. in Academic Medicine made the case that traditional metrics fail to capture the full scope of faculty contributions, particularly in education and institutional service. The metrics we inherited were designed for a version of academic medicine that no longer exists.
You Do Not Need a Bigger Budget
The Oakland A's were broke. Beane did not solve his problem with money. He solved it by seeing value that richer teams overlooked.
Most department chairs tell me they cannot compete for talent with better-funded institutions. Maybe. But are you getting the full value out of the people you already have?
The faculty member whose clinical work is solid but unspectacular might be your best mentor. The associate professor who publishes modestly might be the reason your fellows keep choosing your program. The quiet mid-career physician who never asks for anything might be the glue holding your section together.
If your evaluation system only rewards RVUs and publication count, you will never see these people clearly. And eventually, they will leave for somewhere that does.
Start Counting What Counts
Beane did not tear down baseball. He asked a better question. Not "who are the best players?" but "what actually produces wins?"
You can do the same thing in your department. Not a wholesale revolution. Just an honest look at whether the things you measure, reward, and celebrate are the things that actually predict the outcomes you care about.
If the answer is no, it is time to rethink the scorecard.
Learn about how coaching for departments can help build a stronger culture on your team.
