Hugging Face's logo

flexitok
/
bpe_fas_Arab_8000

Persian
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_fas_Arab_8000

Commit History

Upload safe_v2/flexitok--bpe_fas_Arab_8000_overlap.json with huggingface_hub
0060810
verified

gsaltintas commited on

Upload safe_v2/participating_tokenizers.json with huggingface_hub
2632aae
verified

gsaltintas commited on

Upload safe_v2/flexitok--bpe_fas_Arab_8000.yaml with huggingface_hub
e2893a5
verified

gsaltintas commited on

Upload safe_v2/flexitok--bpe_fas_Arab_8000_info.json with huggingface_hub
c63c2e1
verified

gsaltintas commited on

Upload safe_v2/flexitok--bpe_fas_Arab_8000_vocab.json with huggingface_hub
ec075f3
verified

gsaltintas commited on

Upload safe_v2/flexitok--bpe_fas_Arab_8000_super_mapping.json with huggingface_hub
cc3677d
verified

gsaltintas commited on

Upload safe/flexitok--bpe_fas_Arab_8000_overlap.json with huggingface_hub
a0215d5
verified

gsaltintas commited on

Upload safe/participating_tokenizers.json with huggingface_hub
f6b5d1a
verified

gsaltintas commited on

Upload safe/flexitok--bpe_fas_Arab_8000.yaml with huggingface_hub
0499765
verified

gsaltintas commited on

Upload safe/flexitok--bpe_fas_Arab_8000_info.json with huggingface_hub
d06dbb7
verified

gsaltintas commited on

Upload safe/flexitok--bpe_fas_Arab_8000_vocab.json with huggingface_hub
bafbec1
verified

gsaltintas commited on

Upload safe/flexitok--bpe_fas_Arab_8000_super_mapping.json with huggingface_hub
96ca471
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000_overlap.json with huggingface_hub
be9e9a8
verified

gsaltintas commited on

Upload fineweb2_hq/participating_tokenizers.json with huggingface_hub
7bf3deb
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000.yaml with huggingface_hub
8f2a6df
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000_info.json with huggingface_hub
ab28799
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000_vocab.json with huggingface_hub
c9629cc
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000_super_mapping.json with huggingface_hub
a691807
verified

gsaltintas commited on

Upload folder using huggingface_hub
85a60c6
verified

gsaltintas commited on

Upload folder using huggingface_hub
2b7e096
verified

gsaltintas commited on

initial commit
a9c93ce
verified

gsaltintas commited on