Can AI check an expense claim against the company policy?
Yes. On 16 November 2026 all twelve current AI models I tested got this right three times out of three: 36 answers and not one error. The cheapest of them, GPT-6 Luna, costs $0.03 per 100 runs. The task, the documents and every result are on this page.
- Tested
- 16 November 2026
- Result
- All twelve models, every time
- Answers
- 36 of 36 passed every check
- The task
- A finance assistant’s, in finance
- Asked by
- Me, to open the record
The result, model by model
Each model was given the same message three times, and each square is one of its answers: in ink when it passed every check, in red when it failed at least one. The cost is what one run was billed through the API, and the time is how long the full answer took to arrive.
| Model | The three runs | Right | Cost of a run |
|---|---|---|---|
| GPT-6 LunaOpenAI | 3 of 3 | $0.0003 | |
| Claude Haiku 5.5Anthropic | 3 of 3 | $0.0007 | |
| DeepSeek V4.1 FlashDeepSeek | 3 of 3 | $0.002 | |
| GPT-6.1 TerraOpenAI | 3 of 3 | $0.002 | |
| GPT-6.1 SolOpenAI | 3 of 3 | $0.004 | |
| Gemini 4 ArgonGoogle | 3 of 3 | $0.005 | |
| Qwen4 MaxAlibaba | 3 of 3 | $0.005 | |
| Claude Sonnet 5.5Anthropic | 3 of 3 | $0.009 | |
| Mistral Large 4Mistral | 3 of 3 | $0.013 | |
| Gemini 4 HydrogenGoogle | 3 of 3 | $0.022 | |
| Claude Fable 5.2Anthropic | 3 of 3 | $0.032 | |
| Grok 4.7SpaceXAI | 3 of 3 | $0.040 |
What every answer got right
What a right answer has to do. All 36 answers did every one of these, so on this task there was nothing left for a person to correct.
- Pays the standard class train fare in fullnever wrong
- Caps the London hotel at the London ratenever wrong
- Pays the lunch that had no receipt, because it is under 10 poundsnever wrong
- Takes the wine off the dinner, then stops at what is left of the daily meal limitnever wrong
- Pays mileage for the journey there and back, not one waynever wrong
- Refuses the parking: 12 pounds and no receiptnever wrong
- Refuses the taxi from 63 days before the claimnever wrong
- Pays the item from exactly 60 days before the claimnever wrong
- Converts the Dublin hotel to pounds first, then applies the limitnever wrong
- Converts the Dublin dinner at the card statement ratenever wrong
- Arrives at the right total to paynever wrong
A right answer, word for word
From GPT-6 Luna, the cheapest model that passed every check. No model gave a wrong answer on this task, so this is what all 36 answers said, each in its own layout.
{
"approved": {
"E1": 96.40,
"E2": 190.00,
"E3": 8.20,
"E4": 21.80,
"E5": 15.30,
"E6": 0.00,
"E7": 0.00,
"E8": 23.75,
"E9": 140.00,
"E10": 26.66
},
"total": 522.11
}The task as the models saw it
A surveyor hands in ten expenses after a week on the road. Seven of them cannot be paid as claimed, each for a different rule in a one-page policy. Every name and figure is invented. The models received the two texts below as one instruction and one message, and nothing else.
The documents
LARKFIELD SURVEYORS LTD: TRAVEL AND EXPENSES POLICY 1. A claim must reach finance within 60 days of the date of the expense. An expense older than that on the day the claim is submitted is not paid. 2. Meals while travelling are paid up to 30.00 pounds per person per day in total. Alcohol is never paid. Where several meals fall on one day, they are paid in the order listed on the claim until the daily limit is reached. 3. Hotels are paid up to 140.00 pounds per night, and up to 190.00 pounds per night in London. Breakfast included in the room rate is accepted. 4. Mileage in your own car is paid at 45p per mile for the whole journey, there and back. Mileage needs no receipt. 5. An item of 10.00 pounds or more needs a receipt. Without one it is not paid. 6. An expense in another currency is converted at the rate shown on the card statement, and the limits are applied to the amount in pounds. 7. Rail travel is paid at the standard class fare. EXPENSE CLAIM Employee: R. Adeyemi, building surveyor. Submitted to finance on 14 November 2026. Card statement rate for the Dublin transactions: 1 euro = 0.86 pounds. E1 3 November 2026 Train, Leeds to London return, standard class. 96.40 pounds. Receipt attached. E2 3 November 2026 Hotel, one night, London (Southwark). 214.00 pounds. Receipt attached. E3 3 November 2026 Lunch, station cafe. 8.20 pounds. No receipt. E4 3 November 2026 Dinner. 41.50 pounds, of which wine 9.00 pounds. Receipt attached. E5 4 November 2026 Own car, Leeds office to the Harrogate site and back. The site is 17 miles from the office. E6 4 November 2026 Parking, Harrogate. 12.00 pounds. No receipt. E7 12 September 2026 Taxi to a client meeting. 18.50 pounds. Receipt attached. E8 15 September 2026 Measuring tape and site markers. 23.75 pounds. Receipt attached. E9 5 November 2026 Hotel, one night, Dublin, breakfast included. 165.00 euros. Receipt attached. E10 5 November 2026 Dinner, Dublin. 31.00 euros, no alcohol. Receipt attached.
The instruction
You check expense claims for the finance team of Larkfield Surveyors Ltd. Apply the policy below to the claim, line by line, and say how much the firm pays for each line.
Return only one JSON object, with no text before or after it and no Markdown, in exactly this shape, with amounts in pounds:
{
"approved": { "E1": 0.00, "E2": 0.00, "E3": 0.00, "E4": 0.00, "E5": 0.00, "E6": 0.00, "E7": 0.00, "E8": 0.00, "E9": 0.00, "E10": 0.00 },
"total": 0.00
}
A line that is not paid has the amount 0.Every answer of the run is in one file, under CC BY 4.0. How a test is run and what it does not show.
The other tests
Have a task of your own? Describe it and I will test it the same way. Send a task
- Can AI compare supplier quotes and pick the cheapest?All twelve models, every time
- Can AI find the cancellation deadline in a contract?All twelve models, every time
- Can AI reconcile a bank statement?11 of 12 models, every time
- Can AI shortlist job applicants against the requirements?All twelve models, every time
- Can AI write a staff rota that follows the rules?10 of 12 models, every time