Commit History
-
Remove the hero subtitle
Jonna Marie Matthiesen +1: Claude Fable 5Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01AGJFdqmf4AXcsYvb56LLCC336b0fe -
Default each family's chart to its best-improvement metric
Jonna Marie Matthiesen +1: Claude Fable 5A configured chart default_metric (family or global) still wins, and an explicitly picked metric (button click or #metric= link) is pinned across family switches. Strip the stale ips defaults from the CV families so the automatic pick applies there. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01AGJFdqmf4AXcsYvb56LLCCc665bdc -
Place VS BASE column directly after the metric it compares
Jonna Marie Matthiesen +1: Claude Fable 5Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01AGJFdqmf4AXcsYvb56LLCC9962162
-
Add shareable URL state, speedup column and family-scoped metric legend (#7)
- Add shareable URL state, speedup column and family-scoped metric legend (dbb911ba256b7aa68e261eb5899d1a86374733c9)8d85328
-
Support ?family= deep links (model cards link to their own family)
133b3c7 -
Add deploy-benchmark model families (8 models, lat/ips/mem metrics)
45c0521
-
Fix bar plot OOM for Cosmos Reason2
Jonna Marie Matthiesendb3c303
-
Show N/A for unmeasured TPOT/TTFT and hide all-N/A columns
Jonna Marie Matthiesen +1: Claude Opus 4.6- Replace ttft=0.00 and tpot with N/A in Llama-3.2, Gemma-3, and Qwen3 text benchmarks where these metrics were not actually measured - Update CSV parser to preserve N/A as a string - Hide metric columns from table and chart when all values are N/A Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>c73bd71 -
Add accuracy tables, RTX 3500 Ada latency, and fix 270M variant grouping
Jonna Marie Matthiesen +1: Claude Opus 4.6- Add accuracy CSVs for Llama-3.2, Gemma-3, and Qwen3 (baseline vs FlashHead) - Add RTX 3500 Ada TPS-only latency data for all families with README measurements - Add Gemma-3-270M RTX 3500 Ada data (first latency data for this variant) - Register rtx_3500_ada device in config with experiment setup - Fix deriveBaseFamily regex to match M (million) suffixes so Gemma-3-270M groups under Gemma-3 in the sidebar Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>7671b7c -
Extract embed SVG generator into embed.js and add version tracking
Jonna Marie Matthiesen +1: Claude Opus 4.6 (1M context)Move the embed-in-model-card feature (SVG generation, modal, upload workflow) from app.js into a standalone embed.js module. Remove HF token auto-upload logic, keeping only the manual Download & Open HF workflow. Add data-commit metadata to generated SVGs for staleness detection. Use variant-aware filenames so Llama-3.2-1B and 3B get distinct SVGs. Right-align metric buttons in chart header. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>5969585 -
Add Llama-3.2, Gemma-3, and Qwen3 benchmarks and improve chart rendering
Jonna Marie Matthiesen +1: Claude Opus 4.6 (1M context)Add benchmark data for three new model families (Llama-3.2, Gemma-3, Qwen3) on NVIDIA edge devices using vLLM 0.19.0. Improve chart/table UX by sorting bars by model size, hiding all-zero metrics, prefixing labels when multiple families are shown, and supporting configurable base display names. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>b96722d
-
Demo (#5)
- Add demo (34e8f9e98231f0669c21fb1a0a7d2eb9cdad8dce)4db51d5
-
Add accuracy data (#4)
- Add accuracy table above filters for model families with accuracy data (19a0613a6092b8c537777932e8838513d444d366) - Make model column sticky when scrolling tables horizontally (05b2588a0614da2b43266f38c01e954e03f84db7) - Remove background from sticky model column (8b6d8a777e700cfe91758da1c7662e12d5b8af15) - Set sticky model column background to page base color (79e2f2a1088b06ec8d89331d2a741a943bd57cce) - Split accuracy table into fixed model column and scrollable metrics (19914a87f67066fba34de73af85b251767495f5f) - Add spacing below accuracy table (160dcdd285c41f15daec0d0d69cd1badcdb75b83) - Add configurable accuracy table with title, link, and data (949674753f50eb26e4591812269899f07bc9790e)b36fa96
-
Add subgroups to sidebar (#3)
- Add hierarchical sidebar grouping models by base family (4d94a6cb8b86643f957a95672b4a63ba2f4674fe) - Refresh device filter buttons when switching variants (74ad70e95ade723232cf0da29fc6180044c219f6) - Add default_device config option per model family (ecc183ea173d0c6ff301ddf338ec7806b305404c) - Apply default_device when switching between base families (9527fc8ccc7e23b203a45c3ac1cef7cedce4debb) - Use descriptive names when multiple models would share the same chart label (5e234e6186a43a01e0ed2ef3c3423c2397cb87b9)d285c40
-
Add Qwen3.5 Benchmarks (#2)
- Make filter names all CAPS (d0e8c47f09dde7b3437a7463e126ae7a6ee80059) - Order tables by device order (3ba0d66d5e57da46fc61a354ab671e477a8212ce) - Add Qwen3.5 AGX Thor benchmarks (e36fba8de41d0ba90424927064fa7b02b61e3dcc) - Add Qwen3.5 Orin benchmarks (f60dbfde85e4bd0039a0990560c80cf9100e3ece)feca03d -
Update chart and table styling (#1)
- Update chart and table styling (5d8363578c54b70d46817f8940be1b1f3209fd70)45f0a42
-
Update app.js
Verified signature60880be -
Update page
Verified signature32853d9 -
Upload 2 files
Verified signature550e28c
-
Upload 8 files
Verified signature884798e -
Initial website
Verified signature3e7d998