LangTrail
Reverse proxy and review layer for monitoring LLM agent systems without SDKs or code instrumentation.
- Architected a Rust-based reverse proxy that captures AI agent traffic transparently without modifying existing codebases.
- Designed an LLM-assisted review layer that generates critiques, suggested labels, failure signals, and confidence scores while keeping human approval as the final decision.
- Added a human-in-the-loop pipeline that converts agent traces into training datasets for RLHF and AI agent evaluation.
- Built with Rust, TypeScript, React, PostgreSQL, Vite, Docker, Kubernetes, and Prometheus.