Update README.md
Browse files
README.md
CHANGED
|
@@ -3,4 +3,5 @@ license: other
|
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
---
|
| 6 |
-
Very early test model, untested as of the moment.
|
|
|
|
|
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
---
|
| 6 |
+
Very early test model, untested as of the moment. Base model: https://huggingface.co/arcee-ai/AFM-4.5B-Preview
|
| 7 |
+
5k entries of mixed sft data at 2e-6 in 4bit qlora with ebs 16 (bs 4 grad_accum 4) for a total of 2 epochs.
|