llm-output-quality-monitor

Tools

Token cost is the o200k count of the tools list JSON, including schemas, before any tool is called.

• quality_validator

  Validate LLM response quality based on length, format, and structure

• drift_detector

  Detect quality drift between current and previous LLM responses

• hallucination_scorer

  Pattern-based heuristic risk scoring for LLM responses (0-100). Detects linguistic signals such as contradictory assertions, unsourced claims, and uncertainty markers. Not a semantic hallucination det

• schema_enforcer

  Validate JSON response against schema

• consistency_check

  Check consistency across multiple LLM responses