Instructions to use unsloth/Z-Image-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Studio
How to use unsloth/Z-Image-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/Z-Image-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/Z-Image-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for unsloth/Z-Image-GGUF to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="unsloth/Z-Image-GGUF", max_seq_length=2048, )
Upload folder using huggingface_hub
Browse files- .gitattributes +2 -0
- z-image-BF16.gguf +3 -0
- z-image-Q2_K.gguf +2 -2
- z-image-Q3_K_L.gguf +3 -0
- z-image-Q3_K_M.gguf +2 -2
- z-image-Q3_K_S.gguf +2 -2
- z-image-Q4_K_M.gguf +2 -2
- z-image-Q4_K_S.gguf +2 -2
- z-image-Q5_K_M.gguf +2 -2
- z-image-Q5_K_S.gguf +2 -2
- z-image-Q6_K.gguf +2 -2
.gitattributes
CHANGED
|
@@ -48,3 +48,5 @@ z-image-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
|
| 48 |
z-image-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 49 |
z-image-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 50 |
z-image-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 48 |
z-image-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 49 |
z-image-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 50 |
z-image-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 51 |
+
z-image-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 52 |
+
z-image-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
z-image-BF16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:82eebf65df40cb09cf29094e30b3cdf7b628e873b7fe5f32023ddb6f0188490c
|
| 3 |
+
size 12311939136
|
z-image-Q2_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9bd03aac0202552ff04293125e5ec4f7b209ad7939957c57d623814181240445
|
| 3 |
+
size 3920955456
|
z-image-Q3_K_L.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:22438dded48bde7a099076a7407e23a41c5d74eac458542d6586b69fa201fea1
|
| 3 |
+
size 4528274496
|
z-image-Q3_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7919422f3217ffcff33e01bc24df3788a8b457cb22183bb1e91641443e42b3cc
|
| 3 |
+
size 4469292096
|
z-image-Q3_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1f252f0cacb8ba0ff4ad467920c4c177c7190540271794f0922b3da2882f6b70
|
| 3 |
+
size 4230367296
|
z-image-Q4_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f3a3ad9f0a168c8629c3cb3e8f72d5c83847229733b57f43d3230000175710ba
|
| 3 |
+
size 4996309056
|
z-image-Q4_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:052a3a3a0da4c219d24d600efddaa6a81f0d1a828f80797bcea3f602d18fc6a9
|
| 3 |
+
size 4673749056
|
z-image-Q5_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2313e137871c6cf0ad832e089523b381cc5a0fc7200531a8bee51f16594c82ab
|
| 3 |
+
size 5527442496
|
z-image-Q5_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c15fec55f3969b53616ab58397f9fa6b189f200bce4b445ad4d4bf6e31f5e6fe
|
| 3 |
+
size 5194514496
|
z-image-Q6_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b1e5aacb7e65d281df6913c5f978547c51b665de9ea347732dc6706d83d15111
|
| 3 |
+
size 5926694976
|