← Index

ROUTEAI infra

Jev Model LLM Routing

Project photo 1

This project tests the Jev model for LLM model routing in production environments, starting with high-volume workloads.

Impressive early results from Jev and the team at @typesafeai ! We are starting to test the Jev model across all high volume workloads at OffDeal, and LLM model routing is the first use case where we're making the official switch in prod! Great job by @lruizmorel and @_dadams22 on their extensive testing within 24 hours of receiving model access.