CUGA Apps
🚀
60
Explore and launch CUGA apps from a single dashboard
Enterprise Agents and Benchmarks
Enterprise agent ecosystem featuring AssetOpsBench (industrial) and ITBench (SRE, FinOps, CISO), CUGA to accelerate AI Automation
-
-
AssetOpsBench
🚀24Run a quick benchmark of web asset performance
-
CUGA Agent
🤖106Configurable Generalist Agent, leader in AppWorld Benchmark
-
MCP-Cosmos: World Model-Augmented Agents for Complex Task Execution in MCP Environments
Paper • 2605.09131 • Published • 61 -
VAKRA Leaderboard
🏆19Explore and submit AI agent benchmarks on VAKRA
-
ibm-research/AssetOpsBench
Viewer • Updated • 467 • 1.05k • 51 -
ITBench-Lite-Space
🚀9Develop and run interactive code notebooks with JupyterLab
-
Survey on Evaluation of LLM-based Agents
Paper • 2503.16416 • Published • 97 -
ibm-research/ITBench-Lite
Updated • 2.42k • 15 -
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Paper • 2502.05352 • Published • 2 -
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 20 -
ibm-research/ITBench-Trajectories
Updated • 498 • 4 -
From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents
Paper • 2603.22386 • Published • 57 -
ScarfBench
🐠2Java framework migration
-
SPIRAL: Symbolic LLM Planning via Grounded and Reflective Search
Paper • 2512.23167 • Published • 1 -
Results and Retrospective Analysis of the CODS 2025 AssetOpsBench Challenge
Paper • 2605.08518 • Published • 11 -
ibm-research/VAKRA
Viewer • Updated • 1.8k • 22.1k • 49 -
General Agent Evaluation
Paper • 2602.22953 • Published • 14 -
ibm-research/ScarfBench
Updated • 1.79k • 20 -
lyuchao/ITBench-Trajectories
Updated • 108 • 1 -
Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM Agents
Paper • 2606.19704 • Published • 42 -
DRACO: Fine-Grained Credit Assignment with Dynamic Rubrics for Long-Horizon Agent Training
Paper • 2609.04094 • Published • 24