Text Generation
PEFT
Safetensors
Ancient Greek (to 1453)
ancient-greek
koine-greek
new-testament
synoptic-problem
biblical-studies
digital-humanities
domain-adaptation
lora
Instructions to use ainouche-abderahmane/koineformer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ainouche-abderahmane/koineformer with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("bowphs/GreTa") model = PeftModel.from_pretrained(base_model, "ainouche-abderahmane/koineformer") - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -23,7 +23,7 @@ pipeline_tag: text-generation
|
|
| 23 |
|
| 24 |
A domain-adapted T5 encoder-decoder for Koine Greek, produced by
|
| 25 |
training LoRA adapters on GreTa (a Classical Greek T5) with a
|
| 26 |
-
1.
|
| 27 |
|
| 28 |
## Overview
|
| 29 |
|
|
@@ -41,7 +41,7 @@ checkpoint. Training takes under one hour on a single GPU.
|
|
| 41 |
| Base model | [bowphs/GreTa](https://huggingface.co/bowphs/GreTa) (T5-base, 220M) |
|
| 42 |
| Adaptation | LoRA (r=16, α=32) |
|
| 43 |
| Trainable params | 3.7M (1.5%) |
|
| 44 |
-
| Training corpus | 1.
|
| 45 |
| Training time | 58 minutes (NVIDIA A10G) |
|
| 46 |
| POS accuracy | 96.62% (linear probe) |
|
| 47 |
| Lemma accuracy | 81.34% (linear probe) |
|
|
@@ -94,8 +94,8 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
| 94 |
|
| 95 |
| Source | Tokens | Description |
|
| 96 |
|--------|--------|-------------|
|
| 97 |
-
| SBLGNT | ~
|
| 98 |
-
| Apostolic Fathers | ~
|
| 99 |
|
| 100 |
A Classical Greek replay buffer (First1KGreek: Homer, Plato, Xenophon)
|
| 101 |
was interleaved at 30% to prevent catastrophic forgetting.
|
|
|
|
| 23 |
|
| 24 |
A domain-adapted T5 encoder-decoder for Koine Greek, produced by
|
| 25 |
training LoRA adapters on GreTa (a Classical Greek T5) with a
|
| 26 |
+
1.5M-token Koine corpus and a Classical Greek replay buffer.
|
| 27 |
|
| 28 |
## Overview
|
| 29 |
|
|
|
|
| 41 |
| Base model | [bowphs/GreTa](https://huggingface.co/bowphs/GreTa) (T5-base, 220M) |
|
| 42 |
| Adaptation | LoRA (r=16, α=32) |
|
| 43 |
| Trainable params | 3.7M (1.5%) |
|
| 44 |
+
| Training corpus | 1.5M Koine tokens + Classical replay |
|
| 45 |
| Training time | 58 minutes (NVIDIA A10G) |
|
| 46 |
| POS accuracy | 96.62% (linear probe) |
|
| 47 |
| Lemma accuracy | 81.34% (linear probe) |
|
|
|
|
| 94 |
|
| 95 |
| Source | Tokens | Description |
|
| 96 |
|--------|--------|-------------|
|
| 97 |
+
| SBLGNT | ~773K | Full Greek New Testament (27 books) |
|
| 98 |
+
| Apostolic Fathers | ~732K | 1-2 Clement, Ignatius, Polycarp, Didache |
|
| 99 |
|
| 100 |
A Classical Greek replay buffer (First1KGreek: Homer, Plato, Xenophon)
|
| 101 |
was interleaved at 30% to prevent catastrophic forgetting.
|