ainouche-abderahmane commited on
Commit
b1f50b9
·
verified ·
1 Parent(s): c400a6c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -23,7 +23,7 @@ pipeline_tag: text-generation
23
 
24
  A domain-adapted T5 encoder-decoder for Koine Greek, produced by
25
  training LoRA adapters on GreTa (a Classical Greek T5) with a
26
- 1.34M-token Koine corpus and a Classical Greek replay buffer.
27
 
28
  ## Overview
29
 
@@ -41,7 +41,7 @@ checkpoint. Training takes under one hour on a single GPU.
41
  | Base model | [bowphs/GreTa](https://huggingface.co/bowphs/GreTa) (T5-base, 220M) |
42
  | Adaptation | LoRA (r=16, α=32) |
43
  | Trainable params | 3.7M (1.5%) |
44
- | Training corpus | 1.34M Koine tokens + Classical replay |
45
  | Training time | 58 minutes (NVIDIA A10G) |
46
  | POS accuracy | 96.62% (linear probe) |
47
  | Lemma accuracy | 81.34% (linear probe) |
@@ -94,8 +94,8 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
94
 
95
  | Source | Tokens | Description |
96
  |--------|--------|-------------|
97
- | SBLGNT | ~656K | Full Greek New Testament (27 books) |
98
- | Apostolic Fathers | ~683K | 1-2 Clement, Ignatius, Polycarp, Didache |
99
 
100
  A Classical Greek replay buffer (First1KGreek: Homer, Plato, Xenophon)
101
  was interleaved at 30% to prevent catastrophic forgetting.
 
23
 
24
  A domain-adapted T5 encoder-decoder for Koine Greek, produced by
25
  training LoRA adapters on GreTa (a Classical Greek T5) with a
26
+ 1.5M-token Koine corpus and a Classical Greek replay buffer.
27
 
28
  ## Overview
29
 
 
41
  | Base model | [bowphs/GreTa](https://huggingface.co/bowphs/GreTa) (T5-base, 220M) |
42
  | Adaptation | LoRA (r=16, α=32) |
43
  | Trainable params | 3.7M (1.5%) |
44
+ | Training corpus | 1.5M Koine tokens + Classical replay |
45
  | Training time | 58 minutes (NVIDIA A10G) |
46
  | POS accuracy | 96.62% (linear probe) |
47
  | Lemma accuracy | 81.34% (linear probe) |
 
94
 
95
  | Source | Tokens | Description |
96
  |--------|--------|-------------|
97
+ | SBLGNT | ~773K | Full Greek New Testament (27 books) |
98
+ | Apostolic Fathers | ~732K | 1-2 Clement, Ignatius, Polycarp, Didache |
99
 
100
  A Classical Greek replay buffer (First1KGreek: Homer, Plato, Xenophon)
101
  was interleaved at 30% to prevent catastrophic forgetting.