WorldArena

KO | EN

gitlite — search

#hacktoberfest #llm #go #golang #android #rust #deep-learning #docker #cli #kubernetes #awesome-list #vue #pytorch #openai

(★ 15)

the official repository of the WorldArena benchmark

WorldArena Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models

</div>

</div>

## Table of Contents

- [Overview](#-overview)
- [Video Quality Evaluation](#-video-quality-evaluation)
- [Embodied Task Evaluation](#-embodied-task-evaluation)
- [Leaderboard](#-leaderboard)

## 🔍 Overview

WorldArena is a unified benchmark designed to systematically evaluate embodied world models across both **perceptual** and **functional** dimensions. WorldArena assesses models through **(1) video perception quality**, measured with sixteen metrics across six sub-dimensions; **(2) embodied task functionality**, which evaluates world models as synthetic data engines, policy evaluators, and action planners; **(3) human evaluations**, including overall quality, physics adherence, instruction following and head-to-head win rate. Furthermore, we propose **EWMScore**, a holistic metric integrating multi-dimensional performance into a single interpretable index. This work provides a framework for tracking progress toward truly functional world models in embodied AI.

## 🎬 Video Quality Evaluation
<div align="center">

</div>

Please refer to [video quality](https://github.com/worldarena/WorldArena/blob/main/video_quality/README.md) for implementation.

## 🤖 Embodied Task Evaluation

</div>

Please refer to [embodied task](https://github.com/worldarena/WorldArena/blob/main/embodied_task/Readme.md) for implementation.

## 🏆 Leaderboard

The official WorldArena leaderboard is hosted on HuggingFace: [![Leaderboard](https://img.shields.io/badge/Leaderboard-HuggingFace-2D2D2D?style=flat&logo=huggingface&logoColor=ffcc00)](https://huggingface.co/spaces/WorldArena/WorldArena). It provides standardized evaluation results across video perception quality, embodied task functionality, and the unified EWMScore.

WorldArena

WorldArena Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

WorldArena

WorldArena Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README