https://github.com/mdda/agentbeats-leaderboard-crypticreasoner
Leaderboard for the Cryptic Reasoner task for the AgentBeats competition
https://github.com/mdda/agentbeats-leaderboard-crypticreasoner
Last synced: 5 months ago
JSON representation
Leaderboard for the Cryptic Reasoner task for the AgentBeats competition
- Host: GitHub
- URL: https://github.com/mdda/agentbeats-leaderboard-crypticreasoner
- Owner: mdda
- Created: 2026-01-15T17:29:52.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2026-01-15T20:33:08.000Z (5 months ago)
- Last Synced: 2026-01-15T20:50:58.273Z (5 months ago)
- Language: Python
- Size: 20.5 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Cryptic Reasoner Leaderboard
This repository hosts the leaderboard for the Cryptic Reasoner green agent. View the leaderboard on agentbeats.
The Cryptic Reasoner agent orchestrates the delivery of Cryptic Crossword clues to solver participants. It
also provides a `dictionary_search` tool that can likely be very useful to agents attempting to solve
Cryptic Crossword puzzles (though only if they do a good job understanding what is acting as the
`definition` and `wordplay` in each given clue).
Details for the configuration parameters are given in `scenario.toml`
### Scoring
Each answer given is either correct or incorrect : There are no partial credits.
### Requirements for participant agents
Your A2A agents must respond to natural language requests, and perform tool calls to
access the `dictionary_search` tool and return the final answer. Instructions are given
at the beginning of the evaluation about the tool call format, etc.