deep-eval

Mutant is a red team and behavioral data generation library for LLMs, RAG pipelines, and AI Agents. It provides two powerful capabilities

A local pass/fail gate for LLM agents and RAG pipelines. Golden datasets in, DeepEval scores, SQLite baselines, CI-friendly exit codes out

AI Testing Beyond the Basics: Ensuring Truthful and Reliable Chatbots and Agents Demos

🚦 Behavioral CI/CD for AI Agents. Stop shipping broken agents to production.Production-grade evaluation gates and statistical testing for AI agents in any CI/CD pipeline.

a Secure Retrieval-Augmented Generation (RAG) pipeline with multi-layer defense against prompt injection, data poisoning, and context manipulation.

Guia acessível do MASP com Qwen3 Next no AWS AgentCore e RAG. Projeto com 35 casos de Golden Dataset, 15 ataques de Red Teaming, avaliações no AgentCore e DeepEval, comparação baseline × final e análise de segurança, acessibilidade e qualidade das respostas.

Production-grade RAG evaluation & regression CI framework. Benchmarks two-stage retrieval, grounded generation, safety, and unit economics with DeepEval & Mistral.

Many documents. Many formats. One place to ask.