Jev vs. Sonnet Performance Comparison
Waqqas Mir@w_mir01
This project compares the performance of Jev and Sonnet AI models on a resume and job description task, highlighting differences in speed, cost, and score variance.
Same resume, same job description, 5 runs
Sonnet 5 score: swung up to 16 points. temp=0 barely helped and the thinking pass has its own variance.
@typesafeai Jev: ±1 point
Jev vs Sonnet
0.3s vs 19s
$0.00013 vs $0.044
1 pt variance vs 16
Ranking quality: 0.76 vs 0.81 Spearman