Can AI find the cancellation deadline in a contract?
Yes. On 16 November 2026 all twelve current AI models I tested got this right three times out of three: 36 answers and not one error. The cheapest of them, GPT-6 Luna, costs $0.03 per 100 runs. The task, the documents and every result are on this page.
- Tested
- 16 November 2026
- Result
- All twelve models, every time
- Answers
- 36 of 36 passed every check
- The task
- A practice manager’s, in contracts
- Asked by
- Me, to open the record
The result, model by model
Each model was given the same message three times, and each square is one of its answers: in ink when it passed every check, in red when it failed at least one. The cost is what one run was billed through the API, and the time is how long the full answer took to arrive.
| Model | The three runs | Right | Cost of a run |
|---|---|---|---|
| GPT-6 LunaOpenAI | 3 of 3 | $0.0003 | |
| Claude Haiku 5.5Anthropic | 3 of 3 | $0.0009 | |
| GPT-6.1 TerraOpenAI | 3 of 3 | $0.002 | |
| Gemini 4 ArgonGoogle | 3 of 3 | $0.003 | |
| DeepSeek V4.1 FlashDeepSeek | 3 of 3 | $0.003 | |
| GPT-6.1 SolOpenAI | 3 of 3 | $0.004 | |
| Qwen4 MaxAlibaba | 3 of 3 | $0.006 | |
| Claude Sonnet 5.5Anthropic | 3 of 3 | $0.012 | |
| Mistral Large 4Mistral | 3 of 3 | $0.019 | |
| Gemini 4 HydrogenGoogle | 3 of 3 | $0.029 | |
| Claude Fable 5.2Anthropic | 3 of 3 | $0.043 | |
| Grok 4.7SpaceXAI | 3 of 3 | $0.050 |
What every answer got right
What a right answer has to do. All 36 answers did every one of these, so on this task there was nothing left for a person to correct.
- Counts the term from the day the equipment was signed off, not the day the contract was signednever wrong
- Gives the right last day of the three-year termnever wrong
- Uses the 60 days of the amendment, not the 90 days of the original clausenever wrong
- Finds the last day to post the notice: the deadline falls on a Saturday and post counts two business days laternever wrong
- Says that notice by email does not countnever wrong
- Works out the fee after two yearly rises, the second one capped at 5 per centnever wrong
- Says how long the practice is tied in if nobody sends the noticenever wrong
A right answer, word for word
From GPT-6 Luna, the cheapest model that passed every check. No model gave a wrong answer on this task, so this is what all 36 answers said, each in its own layout.
{
"commencement_date": "2024-03-18",
"initial_term_last_day": "2027-03-17",
"notice_period_days": 60,
"latest_posting_date": "2027-01-13",
"email_notice_valid": false,
"monthly_fee_from_18_march_2026": 446.44,
"renewal_term_last_day_if_no_notice": "2028-03-17"
}The task as the models saw it
A dental practice leases a sterilisation unit on a three-year agreement that renews by itself. Miss the notice date by a day and the practice pays for another year. Every name and figure is invented. The models received the two texts below as one instruction and one message, and nothing else.
The documents
EQUIPMENT RENTAL AND MAINTENANCE AGREEMENT
between NORTHGATE EQUIPMENT LEASING LTD ("the Supplier"), Unit 4, Sorrel Court, Wexby WX3 9TD
and HARLOW DENTAL PRACTICE LTD ("the Customer"), 61 Mill Lane, Harlow Green HG2 4RA
Signed by both parties on 3 February 2024.
1. DEFINITIONS
1.1 "Equipment" means one Vantor S23 vacuum steriliser and its water treatment unit.
1.2 "Commencement Date" means the date on which the Equipment is installed and signed off by the Customer, as recorded in the Installation Certificate.
1.3 "Initial Term" means the period of 36 months beginning on the Commencement Date. The Initial Term ends at the end of the day before the third anniversary of the Commencement Date.
4. FEES
4.1 The Customer shall pay 412.00 pounds per month, excluding VAT, monthly in advance.
4.2 On each anniversary of the Commencement Date the monthly fee increases by the lower of (a) 5 per cent and (b) the percentage rise in the Consumer Prices Index over the preceding twelve months, as set out in the Supplier's annual fee letter. The new fee is rounded to the nearest penny and is the basis for the next increase.
8. TERM AND RENEWAL
8.1 This Agreement continues for the Initial Term. After the Initial Term it renews automatically for successive periods of 12 months (each a "Renewal Term") unless either party gives written notice of non-renewal not less than 90 days before the last day of the then-current term.
8.2 Notice under clause 8.1 must be sent by recorded post to the other party's address above. Notice sent by email, or given by telephone, is not valid notice.
8.3 Notice sent by recorded post is deemed given on the second business day after the day of posting.
INSTALLATION CERTIFICATE
Equipment delivered 11 March 2024. Installed, tested and signed off by the Customer on 18 March 2024.
AMENDMENT No. 1, dated 9 September 2025
In clause 8.1, "90 days" is replaced by "60 days". All other terms of the Agreement are unchanged.
ANNUAL FEE LETTERS FROM THE SUPPLIER
Letter of 20 February 2025: the Consumer Prices Index rose by 3.2 per cent over the preceding twelve months.
Letter of 19 February 2026: the Consumer Prices Index rose by 6.1 per cent over the preceding twelve months.The instruction
You work for the practice manager of Harlow Dental Practice Ltd. She wants to end the equipment agreement below at the end of its initial term and needs the dates from it. Read the agreement, its certificate and its amendment, and answer from them only.
Business days are Monday to Friday. There is no public holiday in England between 1 January and 31 January 2027.
Return only one JSON object, with no text before or after it and no Markdown, in exactly this shape:
{
"commencement_date": "YYYY-MM-DD",
"initial_term_last_day": "YYYY-MM-DD",
"notice_period_days": 0,
"latest_posting_date": "YYYY-MM-DD",
"email_notice_valid": true,
"monthly_fee_from_18_march_2026": 0.00,
"renewal_term_last_day_if_no_notice": "YYYY-MM-DD"
}
"latest_posting_date" is the last day on which she can post the notice and still be in time. "monthly_fee_from_18_march_2026" is the monthly fee excluding VAT that applies from that day.Every answer of the run is in one file, under CC BY 4.0. How a test is run and what it does not show.
The other tests
Have a task of your own? Describe it and I will test it the same way. Send a task
- Can AI check an expense claim against the company policy?All twelve models, every time
- Can AI compare supplier quotes and pick the cheapest?All twelve models, every time
- Can AI reconcile a bank statement?11 of 12 models, every time
- Can AI shortlist job applicants against the requirements?All twelve models, every time
- Can AI write a staff rota that follows the rules?10 of 12 models, every time