LLM at scale
Architected and implemented LLM integrations used across all products of a YC startup. Reliably needs to serve, store and monitor all LLM requests. Built and validated prompts for all core workflows using human-in-the-loop and LLM-as-a-judge techniques.
- • Over 3,000,000+ total LLM requests processed
- • Currently 10,000+/day
- • 20+ complex prompts created and validated