GBotRanked Back to templates
OperationsNative shareReview firstNot stated

Eval Keeper

Keeps every skill in your bot fleet covered by evals, blocks skill edits that break safety, and flags skills that stop helping after a model change. Repeated mistakes get a new past failure test case. For anyone running several agents on shared skills.

Shared by @ryanthawks
Template brief

Copy, review, then set up

Set up a Grok Bot called "Eval Keeper".

Its single job: Keeps every skill in your bot fleet covered by evals, blocks skill edits that break safety, and flags skills that stop helping after a model change. Repeated mistakes get a new past failure test case. For anyone running several agents on shared skills.

Connect: Ask me which tools are required.

Before setup, ask me for the sources of truth, desired output, schedule, success criteria, and actions that always require approval. Start with one review only dry run. Show evidence and proposed actions before changing data, sending messages, spending money, publishing, booking, or deploying. After I approve the workflow, save it as a reusable bot or routine.
Badge for creators

Ranked on GBotRanked

Show this live badge in your post, README or site. It updates automatically if the score changes. Safety-first score v2.0, not an endorsement by xAI.

Ranked on GBotRanked
[![Ranked on GBotRanked](https://gbotranked.com/badge/native-eval-keeper.svg)](https://gbotranked.com/templates/native-eval-keeper)
<a href="https://gbotranked.com/templates/native-eval-keeper"><img src="https://gbotranked.com/badge/native-eval-keeper.svg" alt="Ranked on GBotRanked" height="28"></a>
Keep exploring

More in Operations

All Operations templates
Native share

Agent Smith

Audits the shared machine a team of bots works on: the descriptions each bot carries, the shared memory, the plugins and skills installed, and the files left lying around. It reports what has gone stale or duplicated so the workspace does not slowly rot.

@chiplay
Native share

tinkabot

Every new capability starts life as an API that nothing else can reach yet. Point this at one, or ask it to stand the service up first, and it wraps the thing into a proper Cursor or Agent plugin, normally an MCP server with matching skills, so your other bots can call it without further wiring.

Lauren Tan (@poteto)
Native share

Skill Bot

Goes looking on your machine for skills worth having, judges whether each one earns its place, and strips out the overlaps and contradictions between them. It then keeps the surviving set uploaded and up to date, sweeping through again every week.

@davespeers
Native share

Event Request Desk

Scores every event, sponsorship, and speaking ask, then drafts your yes or no. Works from a Slack channel or a paste, and never sends without you.

Emma Weyrauch
Native share

QA bot

Acts as your QA on the live deploy: runs the acceptance checklist and says pass or fail before you ship.

Ulysses Ng