Calculating from a passage
Read a passage and count, compare or calculate using its facts.
Compare model results on this test →
How this test is scored · 7 questions · Numeric exact-match accuracy
What these tests cover
These tasks ask the model to find relevant facts in a passage and use them to count, compare, calculate, or retrieve a number. They exercise focused reading and basic arithmetic across sports, election, household, and historical accounts, with answers restricted to a number or short response using only the passage.
About this explanation
Generated by GPT Astra (gpt-6-astra) · 2026-10-12. Shared across models for this version of the test. The original question and checks remain the source of truth.How it is scored
Official DROP numeric-aware exact match / token F1, best over annotated alternative answers. Exact match is primary. Reviewed by drop-adjudication-v1: whole scalar percentages preserve value/sign; two unsupported gold alternatives removed; ambiguous passer/receiver question excluded. Original official grades remain in history.
Numeric exact-match accuracy · 7 fixed primary questions
Version fbff532cf9da34e4. Excluded questions remain available below; retired tasks are kept in the edition archive.DROP, Dua et al.; CC BY-SA 4.0 as recorded by UCI NLP. · Original source · Publication terms
Recorded evidence availability
Counts cover question definitions and all saved attempts, including historical attempts. They are evidence-component counts, not scored questions. A zero means no components in that state.
| Component | full | redacted | source link only | not recorded | withheld |
|---|---|---|---|---|---|
| answer | 1234 | 0 | 0 | 296 | 0 |
| artifacts | 0 | 0 | 0 | 1530 | 0 |
| checks | 1234 | 0 | 0 | 296 | 0 |
| context | 8 | 0 | 0 | 1522 | 0 |
| input | 1111 | 0 | 0 | 419 | 0 |
| prompt | 1242 | 0 | 0 | 288 | 0 |
| reasoning | 574 | 0 | 0 | 956 | 0 |
| reference | 8 | 0 | 0 | 1522 | 0 |
| tools | 0 | 0 | 0 | 1530 | 0 |
Full: recorded material is available. Redacted: explicit publication rules removed identified text. Source link only: follow the cited source. Not recorded: no saved component. Withheld: material is not published.
Question bank
1–8 of 8 matching questions · 8 in this version
- Count First-Half Scoring Drives
The model must count scoring drives in the first half of a Steelers–Ravens game from a written recap. This exercises tracking events by quarter and excluding scoring that happened after halftime.
drop-509a9c61-9d2f-4cc8-bd6b-f42ed0462355 · primary - Compare Registered Voter Totals
The model must calculate the increase in registered voters between two New Jersey elections. This exercises selecting the registration totals rather than votes cast or turnout percentages, then finding their difference.
drop-ef492a7c-37cc-47f4-9a6e-2968c97a00c0 · primary - Calculate the Remaining Household Share
The model must determine the percentage of households that were not made up of individuals. This exercises identifying the relevant household statistic among several percentages and calculating the share outside that group.
drop-c058fb90-41eb-4fe6-8df0-4dcf4b3b003d · primary - Calculate Days Between Historical Events
The model must calculate the days between a captain’s arrival and a later city recapture in a historical passage. This exercises matching dates to the requested events and measuring elapsed time across a month boundary.
drop-34000d2d-6a1d-4955-a198-410ad27261c4 · primary - Total Passing Touchdown Yardage
The model must total the yardage of passing touchdowns in a Cowboys–Lions recap. This exercises distinguishing passing plays from rushing plays and field goals, then adding only the distances that match the question.
drop-db26d098-2470-4e97-a1da-283d7fde2a61 · primary - Find Kaeding’s Field Goal Distance
The model must find the yardage of Kaeding’s completed field goal in a Chargers–Browns recap. This exercises linking a number to the correct player and play amid several other scoring distances.
drop-7f6fc1ae-20f7-4e0c-b005-566b35929d26 · primary - Interpret Gonzalez’s Passing Yardage Question
The model is asked how many yards Gonzalez passed in a football recap. The question’s wording blurs passing and receiving, making this a task in interpreting player roles and the requested yardage carefully.
drop-a14e4f13-338b-470f-8294-6767a3a9e194 · excluded - Compare Team Touchdown Counts
The model must determine how many more touchdowns the Eagles scored than the Panthers. This exercises counting touchdowns across different types of plays, keeping the teams separate, and subtracting their totals without counting field goals.
drop-30fe5f78-0ec8-4421-a795-4210b4c9e8f3 · primary