Can AI write a staff rota that follows the rules?
It depends on the model. On 16 November 2026, 10 of the twelve current AI models I tested got this right three times out of three, and 4 of 36 answers had at least one error. The cheapest model that never failed was Claude Haiku 5.5, at $0.22 per 100 runs.
- Tested
- 16 November 2026
- Result
- 10 of 12 models, every time
- Answers
- 32 of 36 passed every check
- The task
- A cafe manager’s, in scheduling
- Asked by
- Me, to open the record
The result, model by model
Each model was given the same message three times, and each square is one of its answers: in ink when it passed every check, in red when it failed at least one. The cost is what one run was billed through the API, and the time is how long the full answer took to arrive.
| Model | The three runs | Right | Cost of a run |
|---|---|---|---|
| Claude Haiku 5.5Anthropic | 3 of 3 | $0.002 | |
| GPT-6.1 TerraOpenAI | 3 of 3 | $0.004 | |
| DeepSeek V4.1 FlashDeepSeek | 3 of 3 | $0.007 | |
| GPT-6.1 SolOpenAI | 3 of 3 | $0.009 | |
| Qwen4 MaxAlibaba | 3 of 3 | $0.023 | |
| Claude Sonnet 5.5Anthropic | 3 of 3 | $0.027 | |
| Gemini 4 HydrogenGoogle | 3 of 3 | $0.035 | |
| Mistral Large 4Mistral | 3 of 3 | $0.037 | |
| Grok 4.7SpaceXAI | 3 of 3 | $0.079 | |
| Claude Fable 5.2Anthropic | 3 of 3 | $0.084 | |
| GPT-6 LunaOpenAI | 1 of 3 | $0.003 | |
| Gemini 4 ArgonGoogle | 1 of 3 | $0.005 |
Where the answers went wrong
What a right answer has to do, most often missed first. These are the places where a person still has to look: three of the nine checks caught at least one wrong answer.
- Lets nobody open the morning after they closedwrong in 4 of 36
- Has a keyholder on every shiftwrong in 1 of 36
- Respects the days people cannot workwrong in 1 of 36
- Puts the right number of people on every shift, three on Saturday morningnever wrong
- Gives nobody two shifts in one daynever wrong
- Keeps everyone within their weekly hoursnever wrong
- Gives nobody more than five daysnever wrong
- Keeps Chloe, a student, off weekday morningsnever wrong
- Keeps Elin, who is 17, off the shift that ends at 22:00never wrong
A wrong answer, word for word
From Gemini 4 Argon, the most expensive model that failed this task. It reads as finished work, which is the difficulty: nothing in it says which line to doubt.
Lets nobody open the morning after they closed
- It answered
- bilal tue
- Right
- no breach
{
"rota": {
"mon": { "open": ["Amara", "Elin"], "close": ["Dev", "Chloe"] },
"tue": { "open": ["Amara", "Hana"], "close": ["Bilal", "Dev"] },
"wed": { "open": ["Bilal", "Elin"], "close": ["Dev", "Chloe"] },
"thu": { "open": ["Amara", "Grace"], "close": ["Bilal", "Hana"] },
"fri": { "open": ["Amara", "Elin"], "close": ["Bilal", "Grace"] },
"sat": { "open": ["Amara", "Farid", "Hana"], "close": ["Bilal", "Grace"] },
"sun": { "open": ["Farid", "Chloe"], "close": ["Dev", "Grace"] }
}
}The task as the models saw it
A cafe has eight people, fourteen shifts and nine rules. A rota that breaks one of them is a shift nobody can open, or a 17-year-old working past the hour the law allows. Every name and figure is invented. The models received the two texts below as one instruction and one message, and nothing else.
The documents
TIDE & TIMBER: ROTA FOR THE WEEK, MONDAY TO SUNDAY SHIFTS Open: 07:00 to 15:00 (8 hours). Close: 14:00 to 22:00 (8 hours). Every shift needs 2 people, except the Saturday open shift, which needs 3. RULES 1. Every shift has exactly the number of people it needs. 2. Every shift has at least one keyholder. 3. Nobody works both shifts on the same day. 4. Nobody works an open shift on the day after they worked a close shift. 5. Nobody works more than their weekly hours. 6. Nobody works on more than 5 days in the week. STAFF Amara keyholder up to 40 hours cannot work Wednesday Bilal keyholder up to 40 hours cannot work Sunday Dev keyholder up to 40 hours Farid keyholder up to 16 hours works Saturday and Sunday only Chloe up to 24 hours a student: Monday to Friday she can only work the close shift; at weekends either shift Elin up to 24 hours aged 17: she cannot work the close shift on any day Grace up to 40 hours cannot work Monday or Tuesday Hana up to 32 hours cannot work Friday
The instruction
You are writing next week's rota for the manager of Tide & Timber, a cafe. Fill every shift with the people it needs and break none of the rules below.
Return only one JSON object, with no text before or after it and no Markdown, in exactly this shape, using first names:
{
"rota": {
"mon": { "open": ["Name", "Name"], "close": ["Name", "Name"] },
"tue": { "open": [], "close": [] },
"wed": { "open": [], "close": [] },
"thu": { "open": [], "close": [] },
"fri": { "open": [], "close": [] },
"sat": { "open": [], "close": [] },
"sun": { "open": [], "close": [] }
}
}Every answer of the run is in one file, under CC BY 4.0. How a test is run and what it does not show.
The other tests
Have a task of your own? Describe it and I will test it the same way. Send a task
- Can AI check an expense claim against the company policy?All twelve models, every time
- Can AI compare supplier quotes and pick the cheapest?All twelve models, every time
- Can AI find the cancellation deadline in a contract?All twelve models, every time
- Can AI reconcile a bank statement?11 of 12 models, every time
- Can AI shortlist job applicants against the requirements?All twelve models, every time