|
GLM 5.3
|
Melious |
No |
1M |
44.9 |
β |
β
|
91.7 |
β¬3.5000
|
β
|
β
|
β¬4.4000
|
β
|
β¬3.5454
|
β
|
β
|
β
|
β¬3.8820
|
β¬3.0000
|
β
|
β¬3.7957
|
β
|
β
|
β
|
β
|
β¬3.8820
|
β
|
|
Kimi K3
|
1Lyceum Technology2Nebius3Tensorix |
Yes |
1024K |
43.8 |
β |
β
|
93.5 |
β
|
β¬15.0000
|
β
|
β¬16.5000
|
β
|
β
|
β
|
β
|
β¬15.5280
|
β¬12.9400
|
β¬13.7500
|
β
|
β¬12.9400
|
β
|
β
|
β
|
β
|
β¬12.9400
|
β
|
|
GLM 5.3 Flash
|
Entrim |
No |
1024K |
41.9 |
β |
β
|
91.2 |
β
|
β¬0.5000
|
β¬0.3019
|
β¬0.4400
|
β
|
β
|
β
|
β
|
β¬0.5176
|
β¬0.4313
|
β¬0.4000
|
β
|
β¬0.4313
|
β
|
β
|
β
|
β
|
β¬0.4313
|
β
|
|
Qwen3.8 Max
|
Melious |
No |
262K |
40.3 |
β |
β
|
92.7 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬5.4500
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Qwen3.8 2.4T A95B
|
1Lyceum Technology2Tensorix |
No |
262K |
40.0 |
β |
β
|
93.5 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬5.1760
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬5.1760
|
β
|
|
Qwen3.8 Flash Next
|
1Lyceum Technology2Tensorix |
Yes |
262K |
39.9 |
β |
β
|
92.3 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.4313
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.4313
|
β
|
|
DeepSeek V4.1 Flash
|
Melious |
No |
1M |
39.5 |
β |
β
|
β |
β
|
β
|
β
|
β¬1.1000
|
β
|
β
|
β
|
β
|
β¬1.2077
|
β
|
β¬1.0000
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.2940
|
β
|
|
DeepSeek V4 Pro 0813
|
Melious |
No |
1M |
36.3 |
β |
β
|
92.8 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬3.0000
|
β
|
β¬3.4161
|
β
|
β
|
β
|
β
|
β¬3.4507
|
β
|
|
Deepseek V4 Flash 0731
|
Inceptron |
No |
1049K |
34.5 |
β |
β
|
90.8 |
β¬0.5000
|
β
|
β
|
β
|
β
|
β¬0.1185
|
β
|
β
|
β
|
β¬0.2588
|
β¬0.2500
|
β
|
β¬0.2415
|
β
|
β
|
β
|
β¬0.8000
|
β¬0.2588
|
β
|
|
GLM 5.2
|
Inceptron |
No |
432K |
34.0 |
β |
β
|
89.5 |
β
|
β¬4.4000
|
β
|
β¬4.4000
|
β
|
β¬2.5798
|
β
|
β
|
β¬3.7957
|
β¬3.8820
|
β¬4.0000
|
β¬3.7957
|
β¬3.7957
|
β
|
β
|
β¬5.2000
|
β¬5.5000
|
β¬3.8820
|
β¬5.0000
|
|
Qwen3.8 27B
|
OVHcloud |
Yes |
262K |
33.9 |
β |
β
|
90.5 |
β¬2.2000
|
β¬3.0000
|
β¬0.3451
|
β
|
β¬2.3292
|
β
|
β
|
β
|
β¬2.7605
|
β¬2.0704
|
β¬2.4000
|
β
|
β
|
β
|
Free
|
β¬2.1000
|
β
|
β¬2.0704
|
β¬3.0000
|
|
Kimi K2.6
|
Infomaniak |
Yes |
256K |
31.3 |
β |
β
|
91.1 |
β
|
β
|
β
|
β¬3.7510
|
β
|
β¬2.5404
|
β
|
β¬0.6349
|
β¬3.4507
|
β¬3.4507
|
β¬3.5000
|
β
|
β¬3.4507
|
β
|
β
|
β
|
β
|
β
|
β¬5.0000
|
|
DeepSeek V4 Pro
|
1Lyceum Technology2Nebius |
No |
1M |
30.9 |
β |
β
|
88.8 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬3.1056
|
β¬3.0193
|
β¬3.2000
|
β
|
β¬3.0193
|
β
|
β
|
β
|
β
|
β
|
β
|
|
MiniMax M3
|
Nebius |
No |
1M |
29.6 |
β |
β
|
92.9 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.2077
|
β¬1.7253
|
β¬2.0000
|
β
|
β¬1.0352
|
β
|
β
|
β
|
β
|
β¬1.7253
|
β
|
|
GLM 5
|
Melious |
No |
78K |
27.9 |
β |
β
|
82.0 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.9000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
GLM 5 Turbo
|
Tensorix |
No |
203K |
26.6 |
β |
β
|
84.7 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬3.4507
|
β
|
|
GLM 5.1
|
1Lyceum Technology2Nebius3Tensorix |
No |
193K |
26.4 |
β |
β
|
86.8 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬3.7957
|
β¬4.0000
|
β
|
β¬3.7957
|
β
|
β
|
β
|
β
|
β¬3.7957
|
β
|
|
Kimi K2.7 Code
|
Inceptron |
Yes |
262K |
26.3 |
β |
β
|
89.6 |
β
|
β
|
β
|
β¬3.8500
|
β
|
β¬2.7692
|
β
|
β
|
β¬3.4507
|
β¬3.8820
|
β¬3.0000
|
β
|
β¬3.4507
|
β
|
β
|
β
|
β
|
β¬3.8820
|
β
|
|
DeepSeek V4 Flash
|
Entrim |
No |
1M |
24.8 |
β |
β
|
86.7 |
β
|
β
|
β¬0.1467
|
β¬0.3500
|
β
|
β
|
β
|
β
|
β¬0.2588
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Kimi K2.5
|
Nscale |
Yes |
256K |
23.5 |
87.1 |
β
|
87.9 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.5500
|
β
|
β
|
β¬1.8979
|
β
|
β
|
β
|
β
|
β¬5.0000
|
|
GLM 5V Turbo
|
Tensorix |
Yes |
Varies |
23.5 |
β |
β
|
80.9 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬3.4507
|
β
|
|
Nemotron 3 Ultra 550B A55B
|
1Lyceum Technology2Nebius |
No |
256K |
23.4 |
β |
β
|
86.7 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.5880
|
β
|
β
|
β¬2.5880
|
β
|
β
|
β
|
β
|
β
|
β¬4.0000
|
|
MiniMax M2.7
|
1Infercom2Melious |
No |
192K |
23.2 |
β |
β
|
87.4 |
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.4000
|
β
|
β
|
β
|
β¬2.4000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
MiniMax M2.5
|
Tensorix |
No |
160K |
22.8 |
β |
β
|
84.8 |
β
|
β
|
β
|
β¬1.3200
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.2000
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.0352
|
β
|
|
Qwen3.6 27B
|
Entrim |
Yes |
262K |
21.9 |
86.2 |
β
|
84.2 |
β
|
β
|
β¬0.3451
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.2000
|
β
|
β
|
β
|
β¬2.7519
|
β
|
β
|
β
|
β
|
|
DeepSeek V3.2
|
Tensorix |
No |
160K |
21.5 |
86.2 |
86.2
|
84.0 |
β
|
β
|
β
|
β
|
β
|
β
|
β¬4.5000
|
β
|
β
|
β
|
β¬0.5000
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.4313
|
β
|
|
Qwen3.5 397B A17B
|
Infomaniak |
Yes |
262K |
21.4 |
87.8 |
β
|
86.1 |
β
|
β
|
β
|
β¬4.3500
|
β¬3.4507
|
β
|
β
|
β¬0.8465
|
β¬3.1056
|
β¬3.1056
|
β¬3.6000
|
β
|
β¬3.1056
|
β
|
β¬3.6663
|
β
|
β¬3.6000
|
β
|
β
|
|
Qwen3.6 35B A3B
|
Entrim |
Yes |
128K |
18.8 |
85.2 |
β
|
84.1 |
β¬0.5000
|
β
|
β¬0.2157
|
β¬1.8000
|
β
|
β
|
β
|
β
|
β¬1.0352
|
β
|
β¬0.5000
|
β
|
β
|
β
|
β
|
β
|
β¬1.5000
|
β
|
β¬1.2000
|
|
Muse Glimmer
|
Melious |
No |
β |
18.1 |
β |
β
|
83.5 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.0000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Qwen3.5 122B A10B
|
Melious |
No |
262K |
17.7 |
86.7 |
β
|
82.7 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.4232
|
β
|
β
|
β¬0.3000
|
β
|
β
|
β
|
β
|
β¬4.2000
|
β
|
β
|
β
|
|
Gemma 4 26B A4B
|
1AKI.IO2evroc3Melious4Scaleway |
Yes |
128K |
16.7 |
82.6 |
β
|
79.2 |
β¬0.5000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.5000
|
β
|
β
|
β
|
β
|
β
|
β¬0.5000
|
β
|
β¬0.5000
|
|
Gemma 4 31B
|
Infomaniak |
Yes |
128K |
15.4 |
85.2 |
β
|
85.7 |
β
|
β¬0.5000
|
β
|
β
|
β
|
β
|
β¬0.3500
|
β¬0.2116
|
β
|
β
|
β¬0.3000
|
β
|
β
|
β
|
β
|
β¬2.1000
|
β
|
β
|
β
|
|
Mistral Medium 3.5
|
evroc |
Yes |
128K |
14.9 |
β |
β
|
74.8 |
β
|
β
|
β
|
β¬9.0000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬6.4700
|
β
|
β
|
β
|
β
|
β¬7.5000
|
β
|
β¬6.0000
|
|
Qwen3.5 9B
|
IONOS |
Yes |
262K |
13.7 |
82.5 |
β
|
80.6 |
β
|
β
|
β
|
β
|
β¬0.1467
|
β
|
β
|
β
|
β
|
β¬0.1725
|
β¬0.2000
|
β
|
β
|
β
|
β¬0.1553
|
β¬0.3500
|
β
|
β¬0.1725
|
β
|
|
DeepSeek V3.1
|
Infercom |
No |
Varies |
13.7 |
83.3 |
57.7
|
73.5 |
β
|
β
|
β
|
β
|
β
|
β
|
β¬4.5000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Nemotron 3 Super 120B A12B
|
1Lyceum Technology2Nebius |
No |
Varies |
13.6 |
83.7 |
81.2
|
80.0 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.7764
|
β
|
β
|
β¬0.7764
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Nemotron 3 5 Lightning
|
Nebius |
No |
1024K |
13.6 |
β |
β
|
74.3 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2070
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Llama 4 Scout 17B
|
Nscale |
Yes |
128K |
13.5 |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2502
|
β
|
β
|
β
|
β
|
β
|
|
Nemotron 3 Nano 30B A3B
|
Infomaniak |
No |
256K |
13.2 |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.0529
|
β
|
β¬0.2070
|
β¬0.2400
|
β
|
β¬0.2070
|
β¬0.1725
|
β
|
β
|
β
|
β
|
β
|
|
DeepSeek R1 (0528)
|
Melious |
No |
128K |
13.1 |
84.9 |
77.0
|
81.3 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.4000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Qwen2.5 Coder 32B
|
Nscale |
No |
128K |
12.9 |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1725
|
β
|
β
|
β
|
β
|
β
|
|
GPT-OSS 120B
|
Melious |
No |
131K |
12.3 |
80.8 |
87.8
|
78.2 |
β¬0.5500
|
β
|
β
|
β¬0.7000
|
β¬0.6125
|
β
|
β¬0.5900
|
β
|
β¬0.6211
|
β¬0.5176
|
β¬0.2000
|
β
|
β¬0.5176
|
β¬0.3451
|
β¬0.4055
|
β¬4.2000
|
β¬0.6000
|
β
|
β¬0.8000
|
|
Mistral Small 4
|
Infomaniak |
Yes |
262K |
11.5 |
β |
63.6
|
76.9 |
β¬0.6000
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2116
|
β
|
β
|
β¬0.6000
|
β¬0.5176
|
β
|
β
|
β
|
β¬2.1000
|
β
|
β
|
β
|
|
Gemma 3 27B
|
1Lyceum Technology2Nebius |
Yes |
128K |
10.3 |
β |
β
|
β |
β
|
β
|
β
|
β¬1.5000
|
β
|
β
|
β
|
β
|
β
|
β¬0.2588
|
β¬0.5000
|
β
|
β¬0.2588
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Qwen3 Coder Next 80B
|
IONOS |
No |
128K |
10.1 |
β |
β
|
73.7 |
β
|
β
|
β
|
β
|
β¬0.7678
|
β
|
β
|
β
|
β
|
β
|
β¬0.9000
|
β
|
β
|
β
|
β
|
β¬2.0000
|
β
|
β
|
β
|
|
GPT-OSS 20B
|
Melious |
No |
131K |
10.0 |
71.8 |
65.2
|
61.1 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1725
|
β
|
β¬0.1300
|
β
|
β
|
β¬0.1725
|
β¬0.1553
|
β¬0.4200
|
β
|
β
|
β
|
|
Mistral Large 3
|
Mistral AI |
No |
262K |
9.7 |
80.7 |
46.5
|
68.0 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.2940
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.0000
|
|
Qwen3 Coder 30B A3B
|
OVHcloud |
No |
256K |
9.6 |
70.6 |
40.3
|
51.6 |
β
|
β
|
β
|
β¬0.9500
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2400
|
β
|
β
|
β
|
β¬0.2243
|
β
|
β¬0.8000
|
β
|
β
|
|
Qwen3 235B A22B Instruct
|
Tensorix |
No |
128K |
9.5 |
82.8 |
62.2
|
70.0 |
β
|
β
|
β
|
β¬2.7000
|
β
|
β
|
β
|
β
|
β
|
β¬0.5176
|
β¬0.4200
|
β
|
β¬0.5176
|
β¬0.5176
|
β
|
β
|
β¬2.2500
|
β¬0.4003
|
β
|
|
Qwen3-VL 30B A3B
|
LLMBase |
Yes |
128K |
9.5 |
80.7 |
69.7
|
72.0 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.6039
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.8000
|
|
DeepSeek R1 Distill Qwen 14B
|
Nscale |
No |
128K |
7.8 |
74.0 |
37.6
|
48.4 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1725
|
β
|
β
|
β
|
β
|
β
|
|
Qwen3 32B
|
1Nscale2OVHcloud |
No |
32K |
7.3 |
72.7 |
28.8
|
53.5 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2400
|
β
|
β
|
β¬0.2157
|
β¬0.2157
|
β
|
β
|
β
|
β
|
|
Qwen3 14B
|
Nscale |
No |
41K |
6.7 |
67.5 |
28.0
|
47.0 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1725
|
β
|
β
|
β
|
β
|
β
|
|
DeepSeek R1 Distill Llama 8B
|
Nscale |
No |
128K |
6.5 |
54.3 |
23.3
|
30.2 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.0431
|
β
|
β
|
β
|
β
|
β
|
|
Ministral 3 14B
|
Mistral AI |
No |
128K |
6.0 |
69.3 |
35.1
|
57.2 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.3174
|
β
|
β
|
β
|
β¬0.1725
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Qwen3 8B
|
Nscale |
No |
41K |
6.0 |
64.3 |
20.2
|
45.2 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1553
|
β
|
β
|
β
|
β
|
β
|
|
Ministral 3 (8B)
|
Mistral AI |
No |
262K |
5.5 |
64.2 |
30.3
|
47.1 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1294
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Ministral 3 (3B)
|
Mistral AI |
No |
256K |
4.8 |
52.4 |
24.7
|
35.8 |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.0863
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Magistral Small
|
evroc |
No |
128K |
β |
β |
51.3
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.0000
|
|
Devstral 2 123B
|
Melious |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β¬4.4000
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.0000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Devstral Small (2505)
|
Nscale |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2588
|
β
|
β
|
β
|
β
|
β¬0.4000
|
|
Codestral 22B
|
Mistral AI |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.7764
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Mistral Nemo 12B
|
OVHcloud |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β¬0.1467
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1208
|
β
|
β
|
β
|
β
|
|
Mixtral 8x22B
|
Nscale |
No |
64K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.0352
|
β
|
β
|
β
|
β
|
β
|
|
Llama 3.3 70B
|
1Lyceum Technology2Nebius |
No |
131K |
β |
β |
β
|
β |
β¬0.6500
|
β
|
β
|
β¬1.1000
|
β¬0.6125
|
β
|
β¬1.2000
|
β
|
β
|
β¬0.3451
|
β¬0.6500
|
β
|
β¬0.3451
|
β
|
β¬0.6384
|
β¬2.7000
|
β¬0.9000
|
β
|
β¬1.0000
|
|
Pixtral 12B
|
1Melious2Scaleway |
Yes |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β¬0.2500
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2000
|
β
|
β
|
β
|
β
|
β
|
β¬0.2000
|
β
|
β
|
|
Mistral Small 3.2 24B
|
OVHcloud |
Yes |
128K |
β |
β |
β
|
β |
β
|
β¬0.3000
|
β
|
β¬0.4000
|
β¬0.2847
|
β
|
β
|
β
|
β
|
β
|
β¬0.3000
|
β
|
β
|
β
|
β¬0.2674
|
β
|
β¬0.3500
|
β
|
β¬0.4000
|
|
Mistral 7B v0.3
|
OVHcloud |
No |
127K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.0949
|
β
|
β
|
β
|
β
|
|
Qwen2.5-VL 72B
|
OVHcloud |
Yes |
32K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.9500
|
β
|
β
|
β
|
β¬0.8713
|
β
|
β
|
β
|
β
|
|
Llama 3.1 8B
|
Nscale |
No |
128K |
β |
β |
β
|
β |
β¬0.1500
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1500
|
β
|
β
|
β¬0.0518
|
β
|
β
|
β
|
β
|
β
|
|
Qwen3 30B A3B Instruct
|
1Lyceum Technology2Nebius |
No |
128K |
β |
β |
62.6
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2588
|
β¬0.3000
|
β
|
β¬0.2588
|
β
|
β
|
β
|
β
|
β
|
β¬1.2000
|
|
Hermes 4 405B
|
1Lyceum Technology2Nebius |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.5880
|
β¬2.8500
|
β
|
β¬2.5880
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Apertus 70B
|
1AKI.IO2Melious |
No |
128K |
β |
β |
β
|
β |
β¬2.0000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬2.0000
|
β
|
β
|
β
|
β
|
β¬2.1000
|
β
|
β
|
β
|
|
Qwen3 4B Instruct
|
Nscale |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.0259
|
β
|
β
|
β
|
β
|
β
|
|
Qwen3 4B Thinking
|
Nscale |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.0259
|
β
|
β
|
β
|
β
|
β
|
|
DeepSeek R1 Distill Qwen 7B
|
Nscale |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1294
|
β
|
β
|
β
|
β
|
β
|
|
Qwen2.5 Coder 3B
|
Nscale |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.0259
|
β
|
β
|
β
|
β
|
β
|
|
Qwen2.5 Coder 7B
|
Nscale |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.0259
|
β
|
β
|
β
|
β
|
β
|
|
MiniCPM-V 4.5
|
1Lyceum Technology2Nebius |
Yes |
32K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.9576
|
β
|
β
|
β¬0.9576
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Holo2 30B
|
Melious |
Yes |
22K |
β |
β |
β
|
β |
β
|
β
|
β
|
β¬1.8000
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.7000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
GreenL
|
GreenPT |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β¬0.8000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
GreenR
|
GreenPT |
No |
131K |
β |
β |
β
|
β |
β
|
β
|
β
|
β¬0.9500
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Gemma 4
|
GreenPT |
Yes |
33K |
β |
β |
β
|
β |
β
|
β
|
β
|
β¬1.5000
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
MedGemma 27B
|
evroc |
No |
β |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.4000
|
|
Phi-4 15B
|
evroc |
No |
β |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.4000
|
|
Qwen3Guard Gen 8B
|
OVHcloud |
No |
33K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.2000
|
β
|
β
|
β
|
Free
|
β
|
β
|
β
|
β
|
|
Qwen3Guard Gen 0.6B
|
OVHcloud |
No |
33K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.1000
|
β
|
β
|
β
|
Free
|
β
|
β
|
β
|
β
|
|
Voxtral Small
|
evroc |
No |
β |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.5000
|
|
Apertus v1.5 70B
|
Infomaniak |
No |
100K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.7407
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Llama 3.1 405B Instruct
|
Melious |
No |
128K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬1.7500
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
|
Brick Complexity Pro
|
Regolo |
Yes |
100K |
β |
β |
β
|
β |
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β
|
β¬0.4000
|
β
|
β
|
β
|