VERIFYAgents & automation
TypesafeAI Integration with Volna
VLAD ARBATOV ㊙️@vladzima
This project integrates TypesafeAI into Volna, replacing an LLM call with a Jev mechanism for comparing replies to tool results, significantly reducing latency and cost.
integrated @typesafeai into @IamVolna
the check that compares every reply to its own tool results was an llm call, 16s median
jev does the same job as a probability: 0.76s, auc 0.854 on 258 replayed turns. costs pennies
huge