Guglielmo Paesano AI engineer and founder of AIGROW

I build AI systems that do people's work, and I measure where they still need people.

contact@guglielmo.ioDiscord, 4K members

Can AI write a staff rota that follows the rules?

It depends on the model. On 16 November 2026, 10 of the twelve current AI models I tested got this right three times out of three, and 4 of 36 answers had at least one error. The cheapest model that never failed was Claude Haiku 5.5, at $0.22 per 100 runs.

Tested
16 November 2026
Result
10 of 12 models, every time
Answers
32 of 36 passed every check
The task
A cafe manager’s, in scheduling
Asked by
Me, to open the record

The result, model by model

Each model was given the same message three times, and each square is one of its answers: in ink when it passed every check, in red when it failed at least one. The cost is what one run was billed through the API, and the time is how long the full answer took to arrive.

ModelThe three runsRightCost of a runTime
Claude Haiku 5.5Anthropic3 of 3$0.00215.4 s
GPT-6.1 TerraOpenAI3 of 3$0.00412.3 s
DeepSeek V4.1 FlashDeepSeek3 of 3$0.00743.3 s
GPT-6.1 SolOpenAI3 of 3$0.00917.7 s
Qwen4 MaxAlibaba3 of 3$0.02377.7 s
Claude Sonnet 5.5Anthropic3 of 3$0.02716.5 s
Gemini 4 HydrogenGoogle3 of 3$0.03527.5 s
Mistral Large 4Mistral3 of 3$0.037477.9 s
Grok 4.7SpaceXAI3 of 3$0.079184.9 s
Claude Fable 5.2Anthropic3 of 3$0.08417.2 s
GPT-6 LunaOpenAI1 of 3$0.00355.2 s
Gemini 4 ArgonGoogle1 of 3$0.0057.6 s

Where the answers went wrong

What a right answer has to do, most often missed first. These are the places where a person still has to look: three of the nine checks caught at least one wrong answer.

  1. Lets nobody open the morning after they closedwrong in 4 of 36
  2. Has a keyholder on every shiftwrong in 1 of 36
  3. Respects the days people cannot workwrong in 1 of 36
  4. Puts the right number of people on every shift, three on Saturday morningnever wrong
  5. Gives nobody two shifts in one daynever wrong
  6. Keeps everyone within their weekly hoursnever wrong
  7. Gives nobody more than five daysnever wrong
  8. Keeps Chloe, a student, off weekday morningsnever wrong
  9. Keeps Elin, who is 17, off the shift that ends at 22:00never wrong

A wrong answer, word for word

From Gemini 4 Argon, the most expensive model that failed this task. It reads as finished work, which is the difficulty: nothing in it says which line to doubt.

  1. Lets nobody open the morning after they closed

    It answered
    bilal tue
    Right
    no breach
{
  "rota": {
    "mon": { "open": ["Amara", "Elin"], "close": ["Dev", "Chloe"] },
    "tue": { "open": ["Amara", "Hana"], "close": ["Bilal", "Dev"] },
    "wed": { "open": ["Bilal", "Elin"], "close": ["Dev", "Chloe"] },
    "thu": { "open": ["Amara", "Grace"], "close": ["Bilal", "Hana"] },
    "fri": { "open": ["Amara", "Elin"], "close": ["Bilal", "Grace"] },
    "sat": { "open": ["Amara", "Farid", "Hana"], "close": ["Bilal", "Grace"] },
    "sun": { "open": ["Farid", "Chloe"], "close": ["Dev", "Grace"] }
  }
}

The task as the models saw it

A cafe has eight people, fourteen shifts and nine rules. A rota that breaks one of them is a shift nobody can open, or a 17-year-old working past the hour the law allows. Every name and figure is invented. The models received the two texts below as one instruction and one message, and nothing else.

The documents

TIDE & TIMBER: ROTA FOR THE WEEK, MONDAY TO SUNDAY

SHIFTS
Open: 07:00 to 15:00 (8 hours). Close: 14:00 to 22:00 (8 hours).
Every shift needs 2 people, except the Saturday open shift, which needs 3.

RULES
1. Every shift has exactly the number of people it needs.
2. Every shift has at least one keyholder.
3. Nobody works both shifts on the same day.
4. Nobody works an open shift on the day after they worked a close shift.
5. Nobody works more than their weekly hours.
6. Nobody works on more than 5 days in the week.

STAFF
Amara   keyholder   up to 40 hours   cannot work Wednesday
Bilal   keyholder   up to 40 hours   cannot work Sunday
Dev     keyholder   up to 40 hours
Farid   keyholder   up to 16 hours   works Saturday and Sunday only
Chloe               up to 24 hours   a student: Monday to Friday she can only work the close shift; at weekends either shift
Elin                up to 24 hours   aged 17: she cannot work the close shift on any day
Grace               up to 40 hours   cannot work Monday or Tuesday
Hana                up to 32 hours   cannot work Friday

The instruction

You are writing next week's rota for the manager of Tide & Timber, a cafe. Fill every shift with the people it needs and break none of the rules below.

Return only one JSON object, with no text before or after it and no Markdown, in exactly this shape, using first names:
{
  "rota": {
    "mon": { "open": ["Name", "Name"], "close": ["Name", "Name"] },
    "tue": { "open": [], "close": [] },
    "wed": { "open": [], "close": [] },
    "thu": { "open": [], "close": [] },
    "fri": { "open": [], "close": [] },
    "sat": { "open": [], "close": [] },
    "sun": { "open": [], "close": [] }
  }
}

Every answer of the run is in one file, under CC BY 4.0. How a test is run and what it does not show.