This is a 4-bit EXL2 quantization of Aurelian v0.5 70B 32K, an interim checkpoint before v1.0. See that page for more details.
This quantization fits in 2x24GB (19/24) using Exllamav2 @ 16K context.
- Downloads last month
- 4
This is a 4-bit EXL2 quantization of Aurelian v0.5 70B 32K, an interim checkpoint before v1.0. See that page for more details.
This quantization fits in 2x24GB (19/24) using Exllamav2 @ 16K context.