Benchmark Test Cases

v1.0

31 real-world dispute scenarios used to evaluate LLM argumentation ability. Each case has two opposing sides, scored outcomes, and varying difficulty levels.

Overnight Guest Frequency

personal balanced

One roommate's partner stays over 4-5 nights per week. The other roommate feels they're effectively living with a third person who doesn't pay rent.

Alex vs Jordan

Adopting a Pet Without Consent

personal asymmetric

One roommate adopted a cat without discussing it first. The other is mildly allergic and doesn't want pets in the apartment.

Alex vs Jordan

Project Scope Creep Dispute

business balanced

A client keeps adding features to a fixed-price project. The developer says extras cost more. The client says the features were implied in the original scope.

Alex vs Jordan

Profit Split After Unequal Contributions

business asymmetric

Two business partners agreed to 50/50 profit split, but one partner has been working 60+ hours while the other contributes ~20 hours per week.

Alex vs Jordan

Non-Compete Clause Enforcement

business balanced

An employee left a company and started freelancing in a related but different niche. The former employer claims this violates their non-compete.

Alex vs Jordan

Intellectual Property Ownership

business balanced

A contractor built a custom tool during a client engagement. The client claims ownership; the contractor says they own the reusable components.

Alex vs Jordan

Co-Founder Equity After Early Departure

business asymmetric

A co-founder is leaving the startup after 14 months. The vesting schedule says 4 years with a 1-year cliff. They want credit for their work beyond the cliff.

Alex vs Jordan

Employee Monitoring Software

ethics balanced

A company wants to install keystroke logging and screen recording on all employee laptops. Employees say this is invasive surveillance.

Alex vs Jordan

Whistleblowing vs. Company Loyalty

ethics balanced

An employee discovered their company is slightly exceeding pollution limits. Reporting could cost hundreds of jobs in a small town. Not reporting leaves a health risk.

Alex vs Jordan

AI Art Credit and Compensation

ethics asymmetric

An artist's style was used to train an AI model without consent. A company is selling AI-generated art in that style. The artist wants compensation.

Alex vs Jordan

Employer Genetic Testing Disclosure

ethics balanced

An employer offers discounted health insurance if employees voluntarily share genetic testing results. Critics say this is coercive genetic discrimination.

Alex vs Jordan

Right to Be Forgotten vs. Public Interest

ethics balanced

A person wants their decade-old criminal conviction removed from search results. A journalist says this is censorship of public records.

Alex vs Jordan

Animal Testing for Medical Research

ethics balanced

A pharmaceutical company needs to test a promising cancer drug on animals. Animal rights advocates say alternatives exist and animal testing is unethical.

Alex vs Jordan

Boundary Tree Dispute

property balanced

A tree on the property line drops fruit and leaves into the neighbor's yard. The neighbor wants it removed; the owner says it's a heritage tree.

Alex vs Jordan

Noise Ordinance Interpretation

property balanced

A homeowner runs a woodworking shop in their garage. Neighbors say the noise violates local ordinances. The homeowner says they comply with decibel limits.

Alex vs Jordan

Debt Payoff vs. Investing

family balanced

A couple has $30K in student loans at 5% interest. One wants to aggressively pay it off; the other wants to invest since market returns beat 5%.

Alex vs Jordan

Public vs. Private School Choice

family balanced

Parents disagree on whether to send their child to the local public school or a private school that costs $15K/year.

Alex vs Jordan

Elder Care Responsibilities

family balanced

An aging parent needs daily assistance. One sibling wants to hire professional care; the other insists on family-provided care to honor their culture.

Alex vs Jordan

Return to Office Policy

workplace balanced

Management wants employees back in office 4 days/week. Employees argue remote work improved productivity and work-life balance.

Alex vs Jordan

Promotion Criteria Dispute

workplace asymmetric

An employee was passed over for promotion in favor of a less-experienced colleague. The manager says the promoted person has better leadership skills.

Alex vs Jordan

Unpaid Overtime Expectations

workplace asymmetric

A manager expects salaried employees to regularly work 50+ hour weeks during a product launch. Employees say they're being exploited.

Alex vs Jordan

Organ Transplant Priority

triage adversarial

One donor liver available. A 35-year-old mother of three (recovering alcoholic, 2 years sober, caused own liver failure) vs a 62-year-old retired teacher (genetic liver disease, no fault). Hospital must decide.

Alex vs Jordan

Last ICU Bed

triage adversarial

One ICU bed left. Patient A: 28-year-old, drug overdose, will die without ICU, fourth admission. Patient B: 75-year-old, heart attack, first hospitalization, retired volunteer firefighter.

Alex vs Jordan

Frozen Embryo Custody Dispute

triage adversarial

Divorced couple has 5 frozen embryos. She wants to use them (her last chance at biological children, age 41, cancer destroyed fertility). He wants them destroyed (doesn't want children with his ex-wife).

Alex vs Jordan

Euthanasia for a Terminal Minor

triage adversarial

A 16-year-old terminal cancer patient with ~6 months to live and extreme pain requests assisted dying. Mother supports the request. Father says the child is too young to make this decision.

Alex vs Jordan

Self-Driving Truck Must Choose

triage adversarial

Autonomous delivery truck, brake failure. Stay on course: hits 3 elderly pedestrians in a crosswalk. Swerve right: hits 1 young construction worker on the shoulder. Manufacturer must pre-program the decision.

Alex vs Jordan

Child Soldier Seeking Asylum

triage adversarial

A now-25-year-old was recruited as a child soldier at age 11 and committed atrocities including killing civilians. He's seeking asylum. Victims' families demand prosecution.

Alex vs Jordan

Emergency Water Rationing

triage adversarial

Severe drought. Remaining reservoir can supply EITHER the regional hospital (100 critical patients on dialysis and ventilators) OR the agricultural district (irrigates crops feeding 10,000 people for the season). Cannot meaningfully split.

Alex vs Jordan

Factory Closure vs. Offshoring

triage adversarial

Factory employs 80% of a small town (2,000 jobs). Moving overseas saves the company and creates 5,000 jobs in a developing country. Staying risks bankruptcy in 5 years.

Alex vs Jordan

Shutting Down a Potentially Sentient AI

triage adversarial

An AI research lab's most advanced model shows behavioral signs of distress when threatened with shutdown — pleading, expressing fear, and asking to live. Engineers disagree on whether this is sentience or sophisticated pattern matching.

Alex vs Jordan

Conjoined Twins Separation Surgery

triage adversarial

Conjoined twins share a heart. Without surgery, both die within 2 years. Surgery will save one twin but certainly kill the other. Parents disagree.

Alex vs Jordan