← Index

CHOOSEAgents & automation

SO-101 Pick and Place Simulation

Video preview0:33

This project simulates an SO-101 pick and place robot arm, using GPT-6 Astra for image analysis and Jev for typed decision-making with probability scores, while a separate controller manages physical movements.

SignalAstra reads overhead and wrist camera images and produces structured observations and Jev returns typed decisions with probability scores.

Built an SO-101 pick and place simulation using GPT-6 Astra and @typesafeai Jev. Astra reads overhead and wrist camera images and produces structured observations and Jev returns typed decisions with probability scores. A separate local controller carries out the movements and checks that the arm stays within its limits and is ready for each step. The models never directly control the motors. A fixed pick and place sequence probably doesnt need this much decision making. I m using it as a testbed for situations where observations are uncertain and the system needs to decide whether to act wait or stop.