Carnice-27b-GGUF

GGUF quantizations of the merged Carnice-27b full model for local inference.

Included quantizations:

Base merged model:

These GGUF files were converted from the merged full-model release, not from the raw adapter.

GGUF

Model size

27B params

Architecture

qwen35

Hardware compatibility

4-bit

6-bit

8-bit

Model tree for kai-os/Carnice-27b-GGUF

Base model

Finetuned

Quantized

(4)

this model

Quantizations