Open source and provenance links in a new tab (Hub refuses framing)
Browse files- harvard-botany-headers/index.html +5 -5
- index.html +5 -5
- overall.html +5 -5
harvard-botany-headers/index.html
CHANGED
|
@@ -55,7 +55,7 @@ details{margin-top:24px}img{max-width:100%;max-height:440px}pre{white-space:pre-
|
|
| 55 |
<h1>GLAM extraction benchmark</h1><p>Harvard Botany Libraries: printed taxon headings and handwritten replacements</p>
|
| 56 |
<label for="dataset">Dataset </label><select id="dataset"><option data-config="overall" value="../overall.html">Overall</option><option data-config="nls-index-cards" value="../index.html">nls-index-cards</option><option data-config="harvard-botany-headers" value="../harvard-botany-headers/index.html" selected>harvard-botany-headers</option></select>
|
| 57 |
<p class="sub">30 documents · 10 models · Harvard University Botany Libraries</p>
|
| 58 |
-
<p>Images and checked labels: <a href="https://huggingface.co/datasets/biglam/index-cards-harvard-botany-metropolitan-flora/tree/986938d535c7710d33f73219a918ecddf16b3483">biglam/index-cards-harvard-botany-metropolitan-flora</a>
|
| 59 |
(public-domain). Visual assistant transcription, not source OCR. Printed fields: Human reviewed. Corrections: Replacement strings human reviewed; absence visually audited.</p>
|
| 60 |
<p class="notice">Predictions were generated for this benchmark config and revision.</p>
|
| 61 |
<p><b>Risk</b> is a wrong identifier or an invented field. <b>Workload</b> is a blank field that
|
|
@@ -91,11 +91,11 @@ Small score differences may be noise.</p>
|
|
| 91 |
<details><summary>Inspect an example document and its checked output</summary>
|
| 92 |
<img src="example.jpg" alt="Example document from the selected evaluation dataset"><pre id="gold"></pre></details>
|
| 93 |
<details><summary>Reproducibility and downloads</summary><p>Config: <code>harvard-botany-headers</code>;
|
| 94 |
-
split: <code>test</code>; <a href="https://huggingface.co/datasets/small-models-for-glam/glam-extraction-benchmark/tree/48e92ea1112d3fc2a32467e875d64e10129c4d46">dataset revision 48e92ea1112d</a>.
|
| 95 |
Harness 0.0.1; scorer 2026-08-26a. Raw prediction files retain their original inference provenance.</p>
|
| 96 |
-
<p><a href="scores.json">Scores and run provenance</a> · <a href="manifest.json">Dataset manifest</a> ·
|
| 97 |
-
<a href="https://github.com/davanstrien/glam-extraction-benchmark">Code</a> ·
|
| 98 |
-
<a href="https://huggingface.co/buckets/small-models-for-glam/glam-extraction-results">Raw predictions</a></p></details>
|
| 99 |
</main><script>function drawSizePlot(rows) {
|
| 100 |
const svg = document.getElementById('size-plot');
|
| 101 |
const escapeText = value => String(value).replace(/[&<>"']/g, c => ({'&':'&','<':'<','>':'>','"':'"',"'":'''}[c]));
|
|
|
|
| 55 |
<h1>GLAM extraction benchmark</h1><p>Harvard Botany Libraries: printed taxon headings and handwritten replacements</p>
|
| 56 |
<label for="dataset">Dataset </label><select id="dataset"><option data-config="overall" value="../overall.html">Overall</option><option data-config="nls-index-cards" value="../index.html">nls-index-cards</option><option data-config="harvard-botany-headers" value="../harvard-botany-headers/index.html" selected>harvard-botany-headers</option></select>
|
| 57 |
<p class="sub">30 documents · 10 models · Harvard University Botany Libraries</p>
|
| 58 |
+
<p>Images and checked labels: <a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/datasets/biglam/index-cards-harvard-botany-metropolitan-flora/tree/986938d535c7710d33f73219a918ecddf16b3483">biglam/index-cards-harvard-botany-metropolitan-flora</a>
|
| 59 |
(public-domain). Visual assistant transcription, not source OCR. Printed fields: Human reviewed. Corrections: Replacement strings human reviewed; absence visually audited.</p>
|
| 60 |
<p class="notice">Predictions were generated for this benchmark config and revision.</p>
|
| 61 |
<p><b>Risk</b> is a wrong identifier or an invented field. <b>Workload</b> is a blank field that
|
|
|
|
| 91 |
<details><summary>Inspect an example document and its checked output</summary>
|
| 92 |
<img src="example.jpg" alt="Example document from the selected evaluation dataset"><pre id="gold"></pre></details>
|
| 93 |
<details><summary>Reproducibility and downloads</summary><p>Config: <code>harvard-botany-headers</code>;
|
| 94 |
+
split: <code>test</code>; <a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/datasets/small-models-for-glam/glam-extraction-benchmark/tree/48e92ea1112d3fc2a32467e875d64e10129c4d46">dataset revision 48e92ea1112d</a>.
|
| 95 |
Harness 0.0.1; scorer 2026-08-26a. Raw prediction files retain their original inference provenance.</p>
|
| 96 |
+
<p><a target="_blank" rel="noopener noreferrer" href="scores.json">Scores and run provenance</a> · <a target="_blank" rel="noopener noreferrer" href="manifest.json">Dataset manifest</a> ·
|
| 97 |
+
<a target="_blank" rel="noopener noreferrer" href="https://github.com/davanstrien/glam-extraction-benchmark">Code</a> ·
|
| 98 |
+
<a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/buckets/small-models-for-glam/glam-extraction-results">Raw predictions</a></p></details>
|
| 99 |
</main><script>function drawSizePlot(rows) {
|
| 100 |
const svg = document.getElementById('size-plot');
|
| 101 |
const escapeText = value => String(value).replace(/[&<>"']/g, c => ({'&':'&','<':'<','>':'>','"':'"',"'":'''}[c]));
|
index.html
CHANGED
|
@@ -55,7 +55,7 @@ details{margin-top:24px}img{max-width:100%;max-height:440px}pre{white-space:pre-
|
|
| 55 |
<h1>GLAM extraction benchmark</h1><p>National Library of Scotland manuscript index cards</p>
|
| 56 |
<label for="dataset">Dataset </label><select id="dataset"><option data-config="overall" value="overall.html">Overall</option><option data-config="nls-index-cards" value="index.html" selected>nls-index-cards</option><option data-config="harvard-botany-headers" value="harvard-botany-headers/index.html">harvard-botany-headers</option></select>
|
| 57 |
<p class="sub">98 documents · 10 models · National Library of Scotland</p>
|
| 58 |
-
<p>Images and checked labels: <a href="https://huggingface.co/datasets/NationalLibraryOfScotland/index-cards-eval/tree/2a81070549d8493c2c538744a9dbbc1dc72cb146">NationalLibraryOfScotland/index-cards-eval</a>
|
| 59 |
(cc0-1.0). Labels drafted by Qwen3.6-35B-A3B-GGUF-Q8_0 and reviewed by NLS cataloguers.</p>
|
| 60 |
<p class="notice">Predictions were generated for this benchmark config and revision.</p>
|
| 61 |
<p><b>Risk</b> is a wrong identifier or an invented field. <b>Workload</b> is a blank field that
|
|
@@ -91,11 +91,11 @@ Small score differences may be noise.</p>
|
|
| 91 |
<details><summary>Inspect an example document and its checked output</summary>
|
| 92 |
<img src="example.jpg" alt="Example document from the selected evaluation dataset"><pre id="gold"></pre></details>
|
| 93 |
<details><summary>Reproducibility and downloads</summary><p>Config: <code>nls-index-cards</code>;
|
| 94 |
-
split: <code>test</code>; <a href="https://huggingface.co/datasets/small-models-for-glam/glam-extraction-benchmark/tree/ecc9c02582f933ca89b73e6751e4ed76888cb24d">dataset revision ecc9c02582f9</a>.
|
| 95 |
Harness 0.0.1; scorer 2026-08-26a. Raw prediction files retain their original inference provenance.</p>
|
| 96 |
-
<p><a href="scores.json">Scores and run provenance</a> · <a href="manifest.json">Dataset manifest</a> ·
|
| 97 |
-
<a href="https://github.com/davanstrien/glam-extraction-benchmark">Code</a> ·
|
| 98 |
-
<a href="https://huggingface.co/buckets/small-models-for-glam/glam-extraction-results">Raw predictions</a></p></details>
|
| 99 |
</main><script>function drawSizePlot(rows) {
|
| 100 |
const svg = document.getElementById('size-plot');
|
| 101 |
const escapeText = value => String(value).replace(/[&<>"']/g, c => ({'&':'&','<':'<','>':'>','"':'"',"'":'''}[c]));
|
|
|
|
| 55 |
<h1>GLAM extraction benchmark</h1><p>National Library of Scotland manuscript index cards</p>
|
| 56 |
<label for="dataset">Dataset </label><select id="dataset"><option data-config="overall" value="overall.html">Overall</option><option data-config="nls-index-cards" value="index.html" selected>nls-index-cards</option><option data-config="harvard-botany-headers" value="harvard-botany-headers/index.html">harvard-botany-headers</option></select>
|
| 57 |
<p class="sub">98 documents · 10 models · National Library of Scotland</p>
|
| 58 |
+
<p>Images and checked labels: <a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/datasets/NationalLibraryOfScotland/index-cards-eval/tree/2a81070549d8493c2c538744a9dbbc1dc72cb146">NationalLibraryOfScotland/index-cards-eval</a>
|
| 59 |
(cc0-1.0). Labels drafted by Qwen3.6-35B-A3B-GGUF-Q8_0 and reviewed by NLS cataloguers.</p>
|
| 60 |
<p class="notice">Predictions were generated for this benchmark config and revision.</p>
|
| 61 |
<p><b>Risk</b> is a wrong identifier or an invented field. <b>Workload</b> is a blank field that
|
|
|
|
| 91 |
<details><summary>Inspect an example document and its checked output</summary>
|
| 92 |
<img src="example.jpg" alt="Example document from the selected evaluation dataset"><pre id="gold"></pre></details>
|
| 93 |
<details><summary>Reproducibility and downloads</summary><p>Config: <code>nls-index-cards</code>;
|
| 94 |
+
split: <code>test</code>; <a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/datasets/small-models-for-glam/glam-extraction-benchmark/tree/ecc9c02582f933ca89b73e6751e4ed76888cb24d">dataset revision ecc9c02582f9</a>.
|
| 95 |
Harness 0.0.1; scorer 2026-08-26a. Raw prediction files retain their original inference provenance.</p>
|
| 96 |
+
<p><a target="_blank" rel="noopener noreferrer" href="scores.json">Scores and run provenance</a> · <a target="_blank" rel="noopener noreferrer" href="manifest.json">Dataset manifest</a> ·
|
| 97 |
+
<a target="_blank" rel="noopener noreferrer" href="https://github.com/davanstrien/glam-extraction-benchmark">Code</a> ·
|
| 98 |
+
<a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/buckets/small-models-for-glam/glam-extraction-results">Raw predictions</a></p></details>
|
| 99 |
</main><script>function drawSizePlot(rows) {
|
| 100 |
const svg = document.getElementById('size-plot');
|
| 101 |
const escapeText = value => String(value).replace(/[&<>"']/g, c => ({'&':'&','<':'<','>':'>','"':'"',"'":'''}[c]));
|
overall.html
CHANGED
|
@@ -79,16 +79,16 @@ Click a column heading to sort; click again to reverse.</p>
|
|
| 79 |
<tr data-params="2.274"><td data-value="Qwen3.5-2B"><a href="https://huggingface.co/Qwen/Qwen3.5-2B" target="_blank" rel="noopener noreferrer" title="Qwen/Qwen3.5-2B">Qwen3.5-2B</a> <small>2.274B</small></td><td class="r" data-value="0.6328972448979592">63.3</td></tr></tbody></table></div>
|
| 80 |
<p id="empty-results" hidden>No models match this size limit.</p>
|
| 81 |
<p class="foot">Scores are shown on a 0–100 scale. Dataset weights, component scores and pinned
|
| 82 |
-
revisions are recorded in <a href="overall-scores.json">the score download</a>.</p>
|
| 83 |
<section class="plot-section" aria-labelledby="plot-title"><h2 id="plot-title">Size vs. overall extraction quality</h2>
|
| 84 |
<p>Upper-left is better: smaller models, higher overall F1. Teal points show the observed Pareto frontier.</p>
|
| 85 |
<svg id="size-plot" data-f1-column="1" viewBox="0 0 760 360" role="group" aria-label="Model size versus overall extraction F1"></svg>
|
| 86 |
<p id="plot-note"></p></section>
|
| 87 |
<details><summary>Sources and reproducibility</summary>
|
| 88 |
-
<p><a href="overall-scores.json">Overall scores and component provenance</a> ·
|
| 89 |
-
<a href="configs.json">Dataset configurations and revisions</a> ·
|
| 90 |
-
<a href="https://github.com/davanstrien/glam-extraction-benchmark">Code</a> ·
|
| 91 |
-
<a href="https://huggingface.co/buckets/small-models-for-glam/glam-extraction-results">Raw predictions</a></p>
|
| 92 |
<p>The overall view combines the selected dataset results; it does not create a new dataset or change individual scores.</p>
|
| 93 |
</details></main><script>function drawSizePlot(rows) {
|
| 94 |
const svg = document.getElementById('size-plot');
|
|
|
|
| 79 |
<tr data-params="2.274"><td data-value="Qwen3.5-2B"><a href="https://huggingface.co/Qwen/Qwen3.5-2B" target="_blank" rel="noopener noreferrer" title="Qwen/Qwen3.5-2B">Qwen3.5-2B</a> <small>2.274B</small></td><td class="r" data-value="0.6328972448979592">63.3</td></tr></tbody></table></div>
|
| 80 |
<p id="empty-results" hidden>No models match this size limit.</p>
|
| 81 |
<p class="foot">Scores are shown on a 0–100 scale. Dataset weights, component scores and pinned
|
| 82 |
+
revisions are recorded in <a target="_blank" rel="noopener noreferrer" href="overall-scores.json">the score download</a>.</p>
|
| 83 |
<section class="plot-section" aria-labelledby="plot-title"><h2 id="plot-title">Size vs. overall extraction quality</h2>
|
| 84 |
<p>Upper-left is better: smaller models, higher overall F1. Teal points show the observed Pareto frontier.</p>
|
| 85 |
<svg id="size-plot" data-f1-column="1" viewBox="0 0 760 360" role="group" aria-label="Model size versus overall extraction F1"></svg>
|
| 86 |
<p id="plot-note"></p></section>
|
| 87 |
<details><summary>Sources and reproducibility</summary>
|
| 88 |
+
<p><a target="_blank" rel="noopener noreferrer" href="overall-scores.json">Overall scores and component provenance</a> ·
|
| 89 |
+
<a target="_blank" rel="noopener noreferrer" href="configs.json">Dataset configurations and revisions</a> ·
|
| 90 |
+
<a target="_blank" rel="noopener noreferrer" href="https://github.com/davanstrien/glam-extraction-benchmark">Code</a> ·
|
| 91 |
+
<a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/buckets/small-models-for-glam/glam-extraction-results">Raw predictions</a></p>
|
| 92 |
<p>The overall view combines the selected dataset results; it does not create a new dataset or change individual scores.</p>
|
| 93 |
</details></main><script>function drawSizePlot(rows) {
|
| 94 |
const svg = document.getElementById('size-plot');
|