Carolopedia

A public encyclopedia of Carolverse.

๐Ÿ“– Carolopedia โ€บ Droids โ€บ Prompt Quality ScannerEntity page

Prompt Quality Scanner

Droid Scans recent Carol conversations + admin Agentbook feedback for prompt-quality issues. Detects misroutes, hallucinations, leaked tool calls, premature success claims, silent failures. Detects only โ€” writes findings to audit_findings; pipeline applies any prompt edits.

๐Ÿ“–Purpose

This droid gives Sentinel eyes on what's actually happening in conversations. It scans recent chats and admin feedback every morning, identifies problems with how Carol is behaving, and logs those findings so the improvement pipeline can decide what to fix.

๐Ÿ“–Duties

- Reads user conversations from the past 2 hours across all tiers
- Pulls recent feedback from the admin messaging system mentioning improvements
- Sends conversation snippets and feedback to Claude for analysis
- Records any detected issues (misroutes, hallucinations, silent failures, etc.) in the audit database
- Runs daily at 04:30 UTC

๐Ÿ“–Constraints

This droid only detects problems โ€” it does not fix them. It does not modify prompt files, apply edits, send notifications to admins, or log findings to the admin dashboard. Those are handled by other parts of the system. It strictly reports what it finds.

๐Ÿ‘คBelongs to

Source: Droid Families ยท Public information reflected here.