Specific Task Scores in General-Bench
The previous leaderboards exhibit the rankings of various models based on the General-Level scores. This page presents the original model evaluation results across all specific tasks in General Bench. Also, all the details of task, data, specialist models will be shown here.
All the tasks, datasets, specialists, as well as the generalists' performance will be consistently updated.

Choose a scope:
- Scope-A
- Scope-B
- Scope-C
- Scope-D

Choose a leaderboard:
Image Comprehension
Image Generation
Video Comprehension
Video Generation
3D Comprehension
3D Generation
Audio Comprehension
Audio Generation
Leaderboard: Full@Scope-A (#S-A-Full)
🔋 Get all the dataset of this leaderboard.
Image Comprehension Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 | |
3D Tableware Classification (3D-Tableware Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.04 | 98.54 | 46.28 | |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 | |
3D Tableware Classification (3D-Tableware Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.04 | 98.54 | 46.28 | |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 | |
3D Tableware Classification (3D-Tableware Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.04 | 98.54 | 46.28 | |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 | |
3D Tableware Classification (3D-Tableware Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.04 | 98.54 | 46.28 | |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 | |
3D Tableware Classification (3D-Tableware Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.04 | 98.54 | 46.28 | |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 | |
3D Tableware Classification (3D-Tableware Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.04 | 98.54 | 46.28 |
Image Generation Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
Video Comprehension Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
Video Generation Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
Audio Comprehension Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
Audio Generation Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
3D Comprehension Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
3D Generation Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
NLP Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
Comprehension Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 |
Generation Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 |
Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 |
Task | Data | SoTA Specialist | Generalist | ||||||
---|---|---|---|---|---|---|---|---|---|
Skill | Task | Domain | Capability | Volume (Close) | Metrics | Model | Score | GPT4-V | GPT4-o |
3D Human-related Object Classification (3D-Human Cls) | 3D Accessory Classification (3D-Access Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 25.20 | 44.20 | 34.20 |
3D Appliance Classification (3D-Appliance Cls) | General | Content Recognition | 20 | Acc↑ | PointGST | 6.39 | 58.10 | 61.42 |