GATEAI infra
Typesafe AI Jev Message Classification
Josh Sowin@joshsowin
This project uses Typesafe AI Jev to quickly classify messages, determining whether to forward them to a large language model, achieving classification in 150ms.
clever way for @typesafeai Jev to make sure people are paying attention before they start to try and chat with a model that can't chat 😂
this thing is fast!!! using it to classify whether to pass a message to an LLM and it's classifying it in 150ms x.com/joshsowin/status/2101418728051314972