How Judges Decide II: Juries, Panels and Hierarchy

Week 4

Dr Michal Ovádek

This week

  • this week we look at

    • some diverse sources of judicial preferences

    • panels, the judicial hierarchy and juries

Identity and socialization

Variation in judicial preferences

  • some judges are more …

    • ideological, partisan, competent, power-hungry, lazy, independent, ambitious, etc.

… than others

  • the sources of judicial preferences are manifold: background characteristics, experience, legal and political context

Variation in judicial preferences

Ideology of Democratic and Republican State Supreme Court Justices (Gibson and Nelson 2022)

In-group bias

Background and experience

  • US appeals judges with a daughter vote in a more feminist way on gender issues than those with only sons (Glynn and Sen 2015)

  • West German courts with more Nazi-tainted judges convicted fewer accused Nazi criminals (Kern and Vanberg 2024)

  • a law and economics training programme made US federal judges rule against regulators more often and sentence more harshly (Ash, Chen, and Naidu 2026)

Political context

  • local Fox News viewership causes elected judges to impose harsher sentences (Ash and Poyker 2024)

  • high asylum salience leads Swiss judges to decide asylum appeals less favourably (Spirig 2023)

Deciding together

  • most consequential decisions are not made by a single judge acting alone

  • the decision often runs through other people

    • panels: judges influencing one another

    • the hierarchy: courts overseen by the courts above them

    • juries and lay judges: citizens deciding next to or instead of professionals

Panels

Collegial courts

  • most important courts are collegial – they involve bargaining between multiple judges (Landa and Lax 2009; Lax and Cameron 2007)

  • if opinion amendments by judges are costless, the result will align with the median judge’s preferences

    • if they are not, the opinion writer can pull the judgment slightly away from the median judge (Lax and Cameron 2007)

Panel aggregation paradox

  • voting on outcomes and voting issue by issue can give opposite results (Kornhauser and Sager 1986; Landa and Lax 2009)

  • either consideration is enough to reverse, so two of three judges vote to reverse

  • yet a majority finds each consideration absent, which means the decision is affirmed

Chair or median?

  • often we do not observe the dynamics behind panel decisions

  • key question: how influential is the panel’s opinion-writer/chair?

    • reviewing / challenging the chair is costly for the other panel members

    • Hangartner, Lauderdale, and Spirig (2025) show that in about half of Swiss Federal Administrative Court asylum cases, the panel defers to the chair (majority rule applies otherwise)

Panel effects

  • on US appeals panels, judges vote more ideologically when both colleagues share their appointing party (Sunstein, Schkade, and Ellman 2004)

  • and less ideologically when both colleagues were appointed by the other party

  • on the DC Circuit, majorities with one judge from the other party followed doctrine more often (Cross and Tiller 1998)

    • this whistleblower can expose the majority to higher courts by dissenting
  • panel composition is both a treatment (who influences whom) and a threat of exposure

Panel composition

  • in some areas of law, judges respond to the gender and ethnicity of their co-panellists (Boyd, Epstein, and Martin 2010; Grossman et al. 2016)

  • on Germany’s Federal Court of Justice, familiar judges hold more hearings and write longer judgments (Swalve 2022)

  • to increase efficiency, courts can create chambers consisting of sub-groups of judges (Fjelstul 2023)

    • their composition can be more or less permanent and stable

    • but small chambers are likely make the application of law less consistent (Fjelstul 2023)

Case assignment

  • who decides who decides?

  • in some courts (e.g. CJEU), the president chooses the opinion writer (judge-rapporteur)

    • a source of power the president uses strategically to build the court’s legitimacy (Hermansen 2020)

    • at SCOTUS, the most senior justice in the majority assigns the opinion (Lax and Cameron 2007)

  • random case assignment stops parties from steering cases to sympathetic judges (Marcondes, Peixoto, and Stern 2019)

Role of clerks

  • judges do not work alone – they are assisted by law clerks

  • judges, similar to politicians, have different styles

    • e.g. some are more willing to trust and delegate work than others

Hierarchy

Organizing the judiciary

  • how are judiciaries organized?

  • what are the implications of organizational principles for judicial decision-making?

Judicial hierarchy

  • virtually all judiciaries around the world are organized hierarchically

  • three “layers” are typical

    • supreme and constitutional (peak) courts at the top

    • courts of appeal in the middle

    • first-instance (trial) courts at the bottom

  • peak courts = courts of final instance

    • no more appeals possible
  • in many systems there are multiple hierarchies

    • e.g. military courts or administrative courts (France)

Judicial hierarchy

Judiciary of France (Wikimedia Commons, CC BY-SA 4.0)

Judicial motivation

  • judges at different levels of the pyramid face different pressures and incentives

  • Goto (2026) presents evidence of judicial pandering in Indian courts

    • high court chief justices influence which district judges are promoted to the high court

    • eligible judges acquit female defendants more and male defendants less under a female chief justice

Judicial discipline

  • discipline in the judicial hierarchy is maintained through two mechanisms:

    • precedents or rules created by higher courts to be followed by lower courts

    • oversight by higher courts or the threat of reversing lower court decisions

  • even jurisdictions which do not formally subscribe to stare decisis usually employ precedents

  • precedents transmit rules through time and the judicial hierarchy

  • courts higher in the hierarchy and later in time can amend or expunge lower or previous precedents

Role of lower courts

  • in the standard account, lower courts implement the doctrines developed by peak courts (Songer, Segal, and Cameron 1994)

  • in the ‘reversed’ account, lower courts make their own doctrines (Carrubba and Clark 2012)

    • they have a first-mover advantage and are closer to case facts

    • upper courts intervene when lower courts go too far

The cost of review

  • upper courts do not have direct and immediate access to case facts, only to lower courts’ decisions (Cameron, Segal, and Songer 2000)

    • they need to spend time and resources to find out more

    • => upper courts need to decide which decisions are worth auditing

  • upper courts care about lower courts’ dispositions and rules (Carrubba and Clark 2012)

    • lower courts choose rules to avoid review

The cost of review

  • the ideal situation for the lower court is when the disposition aligns with the upper court’s preferences

  • suppose the lower court prefers a liberal rule, while the upper court is more conservative. The facts are so extreme that almost any rule yields a “conservative” disposition (e.g. harsh sentence). The lower court can push the rule in a liberal direction until review becomes worth the upper court’s cost (Carrubba and Clark 2012)

Fire alarms

  • appeal courts pick up on signals (“fire alarms” / whistleblowing) about whether a decision is worth reviewing (Beim, Hirsch, and Kastellec 2014)

    • litigants filing appeals

    • interest groups filing amicus curiae briefs

    • lower court judges dissenting

The threat of reversal

The effect of reversal

  • trial judges in Norway who had their ruling overturned on appeal shift their behaviour in the corresponding direction (Bhuller and Sigstad 2025)

    • “Following a decision reversal, trial judges who receive a sentence increase have almost 40 percentage points higher probability of incarcerating in the next case, compared to judges receiving a sentence affirmance”

    • judges do not merely “learn” from reversals but overreact to them

Hierarchy in the EU

  • in the European Union, national courts refer questions to the Court of Justice of the EU (CJEU). What happens when the CJEU dismisses them?

  • national courts receiving such a negative result are more likely to submit another case (Dyevre, Lampach, and Glavina 2022)

    • the CJEU is more likely to accept requests from national courts that previously experienced rejection

Hierarchy in the EU

  • in some circumstances, judicial hierarchies are not universally accepted

    • in the EU, the CJEU proclaims the doctrine of supremacy of EU law over national law and its own role as the ultimate arbiter of EU law questions

    • from the CJEU’s perspective, all national courts must follow its lead

    • not all national courts accept that the CJEU sits atop the EU law hierarchy

Hierarchy in the EU

The Court of Justice of the European Union exceeds its judicial mandate, as determined by the functions conferred upon it in Article 19(1) second sentence of the Treaty on European Union, where an interpretation of the Treaties is not comprehensible and must thus be considered arbitrary from an objective perspective. If the Court of Justice of the European Union crosses that limit, its decisions are no longer covered by Article 19(1) second sentence of the Treaty on European Union in conjunction with the domestic Act of Approval; at least in relation to Germany, these decisions lack the minimum of democratic legitimation necessary under Article 23(1) second sentence in conjunction with Article 20(1) and (2) and Article 79(3) of the Basic Law.

German Constitutional Court, Judgment of the Second Senate of 5 May 2020 (2 BvR 859/15), headnote 2, emphasis added

Juries

Who decides besides judges?

  • there is a variety of jury and lay-judge systems around the world

    • the English jury model is the most well-known with members of the public collectively deciding on the accused’s guilt

    • many countries (e.g. the UK) use laypersons to decide court cases, either alone or in collaboration with professional judges

The Condorcet jury theorem

  • Condorcet (1785): a majority is more likely right than any one member, if

    • competence: each member is more likely right than wrong

    • independence: each member decides for themselves

  • the larger the group, the more likely the majority is right (and vice versa)

    • with jurors each right 60% of the time, a majority of 3 is right 65%, of 11 75%, of 51 93%
  • the standard argument for juries, panels and larger benches

Real juries are not Condorcet juries

  • competence varies between jurors

  • votes are not independent – jurors deliberate first

Who is in the room matters

  • in two Florida counties, all-white jury pools convicted 81% of Black and 66% of white defendants (Anwar, Bayer, and Hjalmarsson 2012)

    • at least one Black member in the pool closed the gap
  • in two Florida counties, own-gender jurors convicted less often on drug charges but not on others (Hoekstra and Street 2021)

  • randomly assigned Swedish lay judges from the far right convict young and Arabic-named defendants more often (Anwar, Bayer, and Hjalmarsson 2019)

  • in all three studies the pool or panel is as good as random, so the cases cannot explain the gaps

Deliberation and history

  • jury deliberations are secret in most systems, which complicates doing research

    • racially mixed mock juries deliberated longer, discussed more of the facts and made fewer factual errors than all-white juries (Sommers 2006)
  • Old Bailey juries in 1751 to 1808 were more likely to convict right after a conviction (Bindler and Hjalmarsson 2019)

  • across nearly 200 years of Old Bailey trials, women were convicted less often and punished less harshly than men (Bindler and Hjalmarsson 2020)

References

Anwar, Shamena, Patrick Bayer, and Randi Hjalmarsson. 2012. “The Impact of Jury Race in Criminal Trials.” The Quarterly Journal of Economics 127 (2): 1017–55. https://doi.org/10.1093/qje/qjs014.
———. 2019. “Politics in the Courtroom: Political Ideology and Jury Decision Making.” Journal of the European Economic Association 17 (3): 834–75. https://doi.org/10.1093/jeea/jvy013.
Ash, Elliott, Sam Asher, Aditi Bhowmick, Sandeep Bhupatiraju, Daniel Chen, Tanaya Devi, Christoph Goessmann, Paul Novosad, and Bilal Siddiqi. 2025. “In-Group Bias in the Indian Judiciary: Evidence from 5 Million Criminal Cases.” The Review of Economics and Statistics, 1–45. https://doi.org/10.1162/rest_a_01569.
Ash, Elliott, Daniel L. Chen, and Suresh Naidu. 2026. “Ideas Have Consequences: The Impact of Law and Economics on American Justice.” The Quarterly Journal of Economics 141 (1): 845–87. https://doi.org/10.1093/qje/qjaf042.
Ash, Elliott, and Michael Poyker. 2024. “Conservative News Media and Criminal Justice: Evidence from Exposure to the Fox News Channel.” The Economic Journal 134 (660): 1331–55. https://doi.org/10.1093/ej/uead108.
Badas, Alex, Bailey K. Sanders, and Katelyn E. Stauffer. 2025. “The Role of Judge Gender and Ideology in Hiring Female Law Clerks.” Journal of Law and Courts 13 (2): 397–419. https://doi.org/10.1017/jlc.2024.8.
Beim, Deborah, Alexander V. Hirsch, and Jonathan P. Kastellec. 2014. “Whistleblowing and Compliance in the Judicial Hierarchy.” American Journal of Political Science 58 (4): 904918. http://onlinelibrary.wiley.com/doi/10.1111/ajps.12108/full.
Bhuller, Manudeep, and Henrik Sigstad. 2025. “Feedback and Learning: The Causal Effects of Reversals on Judicial Decision-Making.” The Review of Economic Studies 92 (4): 2359–97. https://doi.org/10.1093/restud/rdae073.
Bindler, Anna, and Randi Hjalmarsson. 2019. “Path Dependency in Jury Decision Making.” Journal of the European Economic Association 17 (6): 1971–2017. https://doi.org/10.1093/jeea/jvy046.
———. 2020. “The Persistence of the Criminal Justice Gender Gap: Evidence from 200 Years of Judicial Decisions.” The Journal of Law and Economics 63 (2): 297–339. https://doi.org/10.1086/707482.
Bonica, Adam, Adam Chilton, Jacob Goldin, Kyle Rozema, and Maya Sen. 2019. “Legal Rasputins? Law Clerk Influence on Voting at the US Supreme Court.” The Journal of Law, Economics, and Organization 35 (1): 1–36. https://doi.org/10.1093/jleo/ewy024.
Boyd, Christina L., Lee Epstein, and Andrew D. Martin. 2010. “Untangling the Causal Effects of Sex on Judging.” American Journal of Political Science 54 (2): 389–411. https://doi.org/10.1111/j.1540-5907.2010.00437.x.
Cameron, Charles M., Jeffrey A. Segal, and Donald Songer. 2000. “Strategic Auditing in a Political Hierarchy: An Informational Model of the Supreme Court’s Certiorari Decisions.” American Political Science Review 94 (1): 101116. https://doi.org/10.2307/2586383.
Carrubba, Clifford J., and Tom S. Clark. 2012. “Rule Creation in a Political Hierarchy.” American Political Science Review 106 (3): 622–43. https://doi.org/10.1017/S000305541200024X.
Choi, Stephen J., Mitu Gulati, and Eric A. Posner. 2012. “What Do Federal District Judges Want? An Analysis of Publications, Citations, and Reversals.” The Journal of Law, Economics, and Organization 28 (3): 518–49. https://doi.org/10.1093/jleo/ewq020.
Condorcet. 1785. Essai Sur l’application de l’analyse à La Probabilité Des Décisions Rendues à La Pluralité Des Voix. Imprimerie Royale.
Cross, Frank B. 2005. “Appellate Court Adherence to Precedent.” Journal of Empirical Legal Studies 2 (2): 369–405. https://doi.org/10.1111/j.1740-1461.2005.00054.x.
Cross, Frank B., and Emerson H. Tiller. 1998. “Judicial Partisanship and Obedience to Legal Doctrine: Whistleblowing on the Federal Courts of Appeals.” The Yale Law Journal 107 (7): 2155–76. https://doi.org/10.2307/797418.
Dyevre, Arthur, Nicolas Lampach, and Monika Glavina. 2022. “Chilling or Learning?: The Effect of Negative Feedback on Interjudicial Cooperation in Nonhierarchical Referral Regimes.” Journal of Law and Courts 10 (1): 87–112. https://doi.org/10.1086/714704.
Fjelstul, Joshua C. 2023. “How the Chamber System at the CJEU Undermines the Consistency of the Court’s Application of EU Law.” Journal of Law and Courts 11 (1): 141–62. https://doi.org/10.1086/717422.
Gibson, James L., and Michael J. Nelson. 2022. “Judging Inequality: State Supreme Courts and the Inequality Crisis.” Political Science Quarterly 137 (2): 263–92. https://doi.org/10.1002/polq.13318.
Glynn, Adam N., and Maya Sen. 2015. “Identifying Judicial Empathy: Does Having Daughters Cause Judges to Rule for Women’s Issues?” American Journal of Political Science 59 (1): 37–54. https://doi.org/10.1111/ajps.12118.
Goto, Jun. 2026. “Career Incentives and Judicial Independence: Evidence from the Indian Lower Judiciary.” Journal of Development Economics 178: 103571. https://doi.org/10.1016/j.jdeveco.2025.103571.
Grossman, Guy, Oren Gazal-Ayal, Samuel D. Pimentel, and Jeremy M. Weinstein. 2016. “Descriptive Representation and Judicial Outcomes in Multiethnic Societies.” American Journal of Political Science 60 (1): 44–69. https://doi.org/10.1111/ajps.12187.
Hangartner, Dominik, Benjamin E. Lauderdale, and Judith Spirig. 2025. “Inferring Individual Preferences from Group Decisions: Judicial Preference Variation and Aggregation on Collegial Courts.” British Journal of Political Science 55: e163. https://doi.org/10.1017/S0007123425100574.
Hermansen, Silje Synnøve Lyder. 2020. “Building Legitimacy: Strategic Case Allocations in the Court of Justice of the European Union.” Journal of European Public Policy 27 (8): 1215–35. https://doi.org/10.1080/13501763.2020.1714697.
Hoekstra, Mark, and Brittany Street. 2021. “The Effect of Own-Gender Jurors on Conviction Rates.” The Journal of Law and Economics 64 (3): 513–37. https://doi.org/10.1086/714149.
Kalven, Harry, and Hans Zeisel. 1966. The American Jury. Boston: Little, Brown.
Kantorowicz-Reznichenko, Elena, Jarosław Kantorowicz, and Keren Weinshall. 2022. “Ideological Bias in Constitutional Judgments: Experimental Analysis and Potential Solutions.” Journal of Empirical Legal Studies 19 (3): 716–57. https://doi.org/10.1111/jels.12323.
Kern, Holger L., and Georg Vanberg. 2024. “Transitional Justice and the Rule of Law: Tainted Judges and Accountability for Nazi Crimes in West Germany.” The Journal of Politics 86 (4): 1333–47. https://doi.org/10.1086/729959.
Kornhauser, Lewis A., and Lawrence G. Sager. 1986. “Unpacking the Court.” The Yale Law Journal 96 (1): 82–117. https://doi.org/10.2307/796436.
Landa, Dimitri, and Jeffrey R. Lax. 2009. “Legal Doctrine on Collegial Courts.” The Journal of Politics 71 (3): 946–63. https://doi.org/10.1017/S0022381609090811.
Lax, Jeffrey R., and Charles M. Cameron. 2007. “Bargaining and Opinion Assignment on the US Supreme Court.” Journal of Law, Economics, and Organization 23 (2): 276302. https://doi.org/10.1093/jleo/ewm023.
Marcondes, Diego, Cláudia Peixoto, and Julio Michael Stern. 2019. “Assessing Randomness in Case Assignment: The Case Study of the Brazilian Supreme Court.” Law, Probability and Risk 18 (2-3): 97–114. https://doi.org/10.1093/lpr/mgz006.
Nelson, Michael J., Morgan L. W. Hazelton, and Rachael K. Hinkle. 2022. “How Interpersonal Contact Affects Appellate Review.” The Journal of Politics 84 (1): 573–77. https://doi.org/10.1086/714783.
Schkade, David, Cass R. Sunstein, and Daniel Kahneman. 2000. “Deliberating about Dollars: The Severity Shift.” Columbia Law Review 100 (4). https://doi.org/10.2307/1123539.
Sommers, Samuel R. 2006. “On Racial Diversity and Group Decision Making: Identifying Multiple Effects of Racial Composition on Jury Deliberations.” Journal of Personality and Social Psychology 90 (4): 597–612. https://doi.org/10.1037/0022-3514.90.4.597.
Songer, Donald R., Jeffrey A. Segal, and Charles M. Cameron. 1994. “The Hierarchy of Justice: Testing a Principal-Agent Model of Supreme Court-Circuit Court Interactions.” American Journal of Political Science 38 (3): 673–96. https://doi.org/10.2307/2111602.
Spirig, Judith. 2023. “When Issue Salience Affects Adjudication: Evidence from Swiss Asylum Appeal Decisions.” American Journal of Political Science 67 (1): 55–70. https://doi.org/10.1111/ajps.12612.
Sunstein, Cass R., David Schkade, and Lisa Michelle Ellman. 2004. “Ideological Voting on Federal Courts of Appeals: A Preliminary Investigation.” Virginia Law Review 90 (1): 301–54. https://doi.org/10.2307/3202429.
Swalve, Tilko. 2022. “Does Group Familiarity Improve Deliberations in Judicial Teams? Evidence from the German Federal Court of Justice.” Journal of Empirical Legal Studies 19 (1): 223–49. https://doi.org/10.1111/jels.12308.
Wistrich, Andrew J., Jeffrey J. Rachlinski, and Chris Guthrie. 2015. “Heart Versus Head: Do Judges Follow the Law or Follow Their Feelings?” Texas Law Review 93 (4): 855–924.
Zorn, Christopher, and Jennifer Barnes Bowie. 2010. “Ideological Influences on Decision Making in the Federal Judicial Hierarchy: An Empirical Assessment.” The Journal of Politics 72 (04): 12121221. https://doi.org/10.1017/S0022381610000630.