multimodalart/jev-decision-index

#102 opened about 13 hours ago by

adaamko

Please evaluate PhillyLabs/philly-decider-v2 for the Decision Index

#101 opened 1 day ago by

PhillyLabs

Request to score: Crivo-Prumo 17M, 32M, 68M, 400M, 1B (public 29.79, 31.92, 38.75, 45.50, 52.88)

#100 opened 1 day ago by

Please evaluate roudone/PabJev-4b for the Decision Index

#99 opened 1 day ago by

roudone

Basal-omni-1.0-ultra inclusion

#97 opened 4 days ago by

jglowa

Self-scored Decision Index 0.3 public run for Seb-9B-v2 (9B, Apache-2.0): 59.16

6

#96 opened 4 days ago by

ironbcc

DataJevBench: a proposed data-processing decision evaluation

#95 opened 5 days ago by

halfbrush

HarnessJevBench: a proposed harness runtime control evaluation

#94 opened 5 days ago by

halfbrush

Sieve 27B in Decision Index 0.4, and a label fix for Sieve 27B v2

#93 opened 6 days ago by

sthanika-ai-research

RYS-Jev request

#92 opened 7 days ago by

dnhkng

Vision board request: vLLM-SR d3-turbo (Decision 3.0, 27B)

#91 opened 8 days ago by

Xunzhuo

Request to score: Crivo family (17M, 32M v2, 68M, 150M v2, 1B)

#89 opened 9 days ago by

Self-scored Decision Index 0.3 public run for AJev lm6q (Gemma 4 31B + LoRA, 65.08)

#88 opened 9 days ago by

andyzhang232

Request to score Prumo (rule-based; size 527 hand-set parameters, 0 learned): 20.14 public on 0.3

#87 opened 9 days ago by

Update StartLux org logo

#86 opened 10 days ago by

Lie24

Self-scored Decision Index 0.3 run for Xor 26B-A4B v1.2 (juspay/Xor-26B-A4B): 59.46

#85 opened 11 days ago by

pramodchandra

news: add Haruspex (calibrated ~494M security decision model)

#84 opened 12 days ago by

TyrusRC

Add assix-research/jev-system1-gemma4-26b-decide reproduction

#83 opened 12 days ago by

assix-research

Request to evaluate on nvidia/Aegis-AI-Content-Safety-Dataset-2.0 dataset

#79 opened 13 days ago by

arthur-thuy

Request to score Ventus-2B (Qwen3.5-2B-Base, single-pass decision model): 77.23% micro accuracy, 1.60% ECE

#78 opened 13 days ago by

Ethan33X

Request to score Crivo-400M (Ettin 400M encoder, one-pass option readout): 39.79 public on 0.3

#77 opened 14 days ago by

evaluate https://huggingface.co/cmul8-hf/nirnaya

#76 opened 14 days ago by

cmul8-basab

Request to score gx-cmcc-lanlao-27B v6 (WiSE-FT weight-space interpolation from the v2 checkpoint: negation-prior fix round, tooluse synth removed, lr halved, alpha=0.4)

#75 opened 15 days ago by

gxydResearch

Add Gjusev/MK-SH-1 (trained category): 140M marker-head decision model, calibrated + abstention

#74 opened 15 days ago by

Gjusev

news: add Vega 0.8B and 4B (vega-ml), from the creator of Laya

#73 opened 15 days ago by

nandakishorm

news: add Dex 1B (trained)

#72 opened 15 days ago by

CanadaOrNaw

news: add Ventus-2B (trained)

#71 opened 16 days ago by

Ethan33X

news: add tasksource-decider-nano (trained)

#70 opened 17 days ago by

sileod

Request to score Crivo-32M (Ettin 32M encoder, one-pass option readout): 25.06 public on 0.3

#69 opened 17 days ago by

Vision board request: vLLM-SR Decision 3.0 (d3, d3-flash, d3-mini, d3-nano, d3-lite, d3-edge)

#68 opened 17 days ago by

Xunzhuo

Request to score Crivo-150M (Ettin 150M encoder, one-pass option readout): 36.39 public on 0.3

#67 opened 17 days ago by

news: add Phocinae-Largha-150M-v1 (trained)

#66 opened 17 days ago by

perrylink

Details Heat to head & filter

#65 opened 18 days ago by

Infinity87

news: add Dinah-0 (trained) and decision_ai (decoding)

#63 opened 19 days ago by

Lukitaduarte

Add Jevify (Qwen-AgentWorld-35B-A3B readout LoRA + coherence) to Jev Reproductions Tracker

#62 opened 19 days ago by

Praveenrajus

Add Jevify (Qwen-AgentWorld-35B-A3B readout LoRA + coherence) to Jev Reproductions Tracker

#60 opened 19 days ago by

Praveenrajus

Request for review: Sthānika Sieve submissions for Decision Index v0.3

#59 opened 19 days ago by

sthanika-ai-research

Area header compares the model's area score against a single benchmark's Jev value

#58 opened 19 days ago by

kzfastino

Request to score KnowLine-4B-Gen2 and Gen1 (PelaAI): 0.3 PRs #92 and #90, one-command engine

#57 opened 19 days ago by

PEScn

news: add KnowLine-4B Gen1 and Gen2 (trained)

#53 opened 19 days ago by

PEScn

Request to score d1-3B and d1-omni-600M (Liquid AI)

#52 opened 20 days ago by

Aurelien-Lac

Request to score mogan-decision-31B-it (Gemma 4 31B + LoRA, one-pass option-label readout): 65.42 on 0.2.1

#51 opened 20 days ago by

furkanyllmz

Request to score Image Hopper on the vision index (Qwen3.5-9B + routed LoRA, one-pass option readout)

#50 opened 20 days ago by

ArkidMitra

Request to score CoCo-Decision-4B-Ko (Qwen3.5-4B + LoRA, one-pass option-label readout, Korean/English)

#49 opened 20 days ago by

iamupd

news: add Saracura PT-BR (trained)