cisimcik-base

English Tรผrkรงe

cisimcik-base

cisimcik-base, Tรผrkรงe รถncelikli bir temel (base) dil modelidir (base model). Qwen/Qwen3.5-4B-Base modelinin, รงoฤŸunlukla Tรผrkรงe metinle devam รถn eฤŸitiminden (continued pre-training) eฤŸitilmiลŸ halidir.

  • 4,2 milyar parametre. Qwen3.5 hibrit mimarisi (Gated DeltaNet + full attention), yalnฤฑzca metin.
  • 10B token training. %91,5 Tรผrkรงe, %8,5 replay (ฤฐngilizce, kod, matematik, 23 baลŸka dil).
  • Apache 2.0 lisansฤฑyla aรงฤฑk kaynak olarak yayฤฑnlandฤฑ.

Hฤฑzlฤฑ baลŸlangฤฑรง

pip install "transformers>=5.17" torch
# isteฤŸe baฤŸlฤฑ, NVIDIA GPU'larda daha hฤฑzlฤฑ Gated DeltaNet kernel'leri:
pip install flash-linear-attention
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

tok = AutoTokenizer.from_pretrained("cisimcik/cisimcik-base")
model = AutoModelForCausalLM.from_pretrained("cisimcik/cisimcik-base", dtype=torch.bfloat16)
model = model.to("cuda" if torch.cuda.is_available() else "cpu").eval()

inputs = tok("Kapadokya'daki peri bacalarฤฑ,", return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=150, do_sample=True, temperature=0.7, top_p=0.9)
print(tok.decode(out[0], skip_special_tokens=True))

Bu bir temel modeldir. Sadece verilen prompt'u tamamlar, sohbet etmez. Sohbet iรงin cisimcik-4b kullanฤฑn.

Donanฤฑm. AฤŸฤฑrlฤฑklar bf16'da yaklaลŸฤฑk 8,4 GB: 12 GB veya รผzeri belleฤŸe sahip herhangi bir GPU ya da 16 GB RAM'li bir CPU yeterlidir. flash-linear-attention kurulu deฤŸilse Gated DeltaNet katmanlarฤฑ transformers'ฤฑn PyTorch uygulamasฤฑnฤฑ kullanฤฑr. Bu doฤŸru sonuรง verir ama uzun girdilerde daha yavaลŸtฤฑr.

Gรถrev kฤฑyaslamalarฤฑna bu model รผzerine eฤŸitilen modellerden ulaลŸฤฑlabilir: cisimcik-4b (CETVEL, OpenLLM Turkish Leaderboard) ve tau-4b.

Mimari

Parรงa Ayrฤฑntฤฑ
Model Qwen3.5-4B metin modeli (Qwen3_5ForCausalLM): 32 katman, hidden size 2560, MLP 9216. Her 4. katman full attention (16 query / 4 KV head, head dim 256), diฤŸer 24'รผ Gated DeltaNet linear attention.
Dictionary 248.320, Qwen3.5 tokenizer'ฤฑ deฤŸiลŸtirilmeden. Tied embedding'ler.
Temel modelden รงฤฑkarฤฑlanlar gรถrรผntรผ kodlayฤฑcฤฑ (vision encoder) ve รงoklu token tahmini (MTP) katmanฤฑ
Parametre 4,21 milyar
Context 16.384 token'a kadar dizilerle eฤŸitildi. Pozisyonlar 262.144'e kadar gider (temel modelden)

Dosyalar

Dosya ฤฐรงerik
model-0000*-of-00002.safetensors aฤŸฤฑrlฤฑklar (bf16)
config.json Qwen3_5ForCausalLM config'i
tokenizer*.json, vocab.json, merges.txt Qwen3.5 tokenizer'ฤฑ, deฤŸiลŸtirilmeden

Lisans

Bu depodaki aฤŸฤฑrlฤฑklar Apache License 2.0 ile yayฤฑmlanmฤฑลŸtฤฑr (bkz. LICENSE ve NOTICE). Model, Qwen/Qwen3.5-4B-Base ยฉ 2026 Alibaba Cloud, Apache License 2.0 lisanslฤฑ modelin deฤŸiลŸtirilmiลŸ bir sรผrรผmรผdรผr. Temel model Qwen/Qwen3.5-4B-Base'dir.

Atฤฑf

@misc{cisimcikbase2026,
  title  = {cisimcik-base: a Turkish-first base language model},
  author = {cisimcik},
  year   = {2026},
  url    = {https://huggingface.co/cisimcik/cisimcik-base}
}
Downloads last month
251
Safetensors
Model size
4B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ 2 Ask for provider support

Model tree for cisimcik/cisimcik-base

Finetuned
(270)
this model
Finetunes
2 models
Quantizations
1 model