The Election Science Behind the Reform Movement

The Science

The field of decision science has advanced considerably in the 200+ years since the founding of the country. In the field of voting theory, practitioners have identified many desirable criteria a given voting method may or may not pass. Basically, most criteria define a certain kind of desirable or undesirable outcome, and say that good voting methods should always exhibit or make such outcomes impossible, respectively.

Then Kenneth Arrow, PhD. came along and won the Nobel Prize for proving that it is impossible to construct a "fair" rank order voting system when there are more than two candidates, where fairness was defined by several desirable but now mutually exclusive criteria. This Impossibility Theorem depressed voting scientists for a half a century, for some interpreted as proof that real democracy is provably impossible.

More contemporary work in the field takes a new approach: rather than ask whether a system meets or fails a particular criterion, statistical evaluation methods determine how frequently problems of all kinds happen in a voting system, and how severely those problems manifest in outcomes that are undesirable from the point of view of simulated voters.

Recent work by Harvard Statistics PhD candidate Jameson Quinn models Voter Satisfaction Efficiency - a percentage of how well a voting method performs between selecting the ideal representative candidate versus a random candidate from the field. This study is the first to compare STAR Voting (labeled SRV below) with other systems:

STAR Voting performs at the head of the pack across a wide range of scenarios, and with both honest and strategic voters. In fact, as the chart below shows, STAR's VSE with a 0-5 rating scale outperforms Score Voting with a 0-10 scale, and in its very worst case performs about the same as Instant Runoff Voting's best case VSE scenario:



These results confirm earlier work in the field. Princeton Mathematics PhD Warren Smith has characterized more than 50 different voting systems. Dr. Smith measured voting systems by two key performance measures. First, its propensity to elect the so-called Condorcet Winner. The Condorcet Winner is the one who would beat every other candidate in a head-to-head contest. The second measure, Bayesian Regret is a more comprehensive measure of the overall satisfaction of the simulated electorate at the outcome of the election. Systems that maximize the number of Condorcet Winners and minimize the electorate's simulated regret with both honest and strategic voters are best.

According to Dr. Smith's analysis, rating systems capture the top four spots as measured by both key performance measures of voting system efficacy.


Instant Runoff Voting is at #42 on the list. #41 is the Plurality Top Two. Removing the single choice limit in the first phase vaults a Top Two from #41 to #2.

It's the clue at the top of the list that shows STAR's full breakthrough: a two-phase, one-election hybrid of the Rating and Ranked Choice categories. Dr. Smith's simulations treated that best overall system as a two-election process, Mr. Quinn's according to the one-election rules of STAR. In Mr. Quinn's words, STAR is "unquestionably a top-shelf method."

Science. It works.

The Evidence. A 2012 exit poll study conducted in Manhattan’s 69th Assembly District substantiates the claim that minor party candidates are unfairly marginalized by today’s system. Participants in the study were asked to re-cast their presidential votes using Plurality Voting and a variety of alternate voting methods, including Approval Voting on each candidate. The results were striking:


Although the district is clearly not philosophically representative of the public as a whole, the single choice limitation empirically favors the two best-funded major party candidates. If voters are given the opportunity to rate each candidate equally and independently then all candidates will receive a more accurate measure of voter support.