IBM and UC Berkeley Diagnose Why Enterprise Agents Fail Using IT-Bench and MAST
•
18
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
Papers
VAREX: A Benchmark for Multi-Modal Structured Extraction from Documents
Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs
Articles
pinned
Running
6
BlueBench Leaderboard
🥇
An open-source benchmark for enterprise use cases.
Running
ScarfBench
🐠
Java framework migration
Running
16
VAKRA Leaderboard
🏆
Benchmark AI agents on multi‑hop, multi‑source enterprise tasks
Running
1
BPO Benchmark Evaluation
📊
Run BPO recruiting benchmark with CUGA SDK
Sleeping
8
Ai Atlas Nexus Capabilities
📚
Intent to AI Capability with AI Atlas Nexus
Running
18
AssetOpsBench
🚀
Generate and benchmark machine learning models with ease
Running
6
ITBench-Lite-Space
🚀
Develop and run interactive code notebooks with JupyterLab
Running
Featured
98
CUGA Agent
🤖
Configurable Generalist Agent, leader in AppWorld Benchmark
Sleeping
2
3DGrid-VQGAN Demo
🐻
SMILES to 3D grid and reconstruction comparison demo
Running
3
AssetOpsBench
📉
Evaluating Autonomous AI Agents for Industry 4.0 Tasks
Sleeping
2
SMI-TED-demo1
🦦
Generate embeddings from SMILES strings or CSV files
Sleeping
2
Fm4m Eval Demo
👁
Sleeping
4
FM4M-demo2
🐢
Generate and analyze molecular structures
Sleeping
7
FM4M-demo1
🐢
Generate and analyze molecular structures
Running
README
📈
Sleeping
4
Biomed.sm.mv Te 84m
👁
Prediction task tests for biomed-multi-view models