-
SIMA, the Scalable Instructable Multiworld Agent, was developed and tested across multiple video game environments in collaboration with eight game studios. It was designed to perform keyboard and mouse actions, evaluated on 600 basic skills, and tested for its ability to follow instructions across nearly 1500 unique tasks using human judgment. The study compared the performance of specialized and generalist SIMA agents, acknowledging the contributions of numerous authors and game developers.
Main Points- SIMA's DesignSIMA features pre-trained vision models and a main model with memory capability, enabling it to output keyboard and mouse actions.
- Evaluation of SIMAA comprehensive evaluation was carried out, benchmarking SIMA's ability to interact with objects, use menus, and navigate, among other tasks, demonstrating a wide application scope.
- AcknowledgementsThanking numerous paper authors and game developers for their contributions highlights the collaborative nature of the project.
122004763