The company and the task
Client: The company is not named: the project is under NDA.
697 entries were submitted to the competition. Under the rules every entry is read and scored by the jury against the competition criteria.
Before
By the organisers’ own estimate, a jury of people would have needed more than 7,000 hours to score every entry. At that volume different experts’ scores inevitably diverge and some entries get skimmed.
What we did
- Three agents were built on the platform: a reader agent produces a summary of the entry, a scoring agent assigns marks against each criterion with its reasoning, and a checking agent looks for contradictions between the summary and the score.
- Entries where the agents disagreed, or where the score sat on the pass boundary, went to people. A person stayed at the end of the chain and made the final decision.
Results in numbers
697entries scored
1 hourfor the whole set
What the client says
The project is under NDA: the client does not publish a quote or a name.
