Hugging Face's logo
jaithree's picture

jaithree

jaithree
2 3 21
PhysiQuanty's profile picture AuraZool's profile picture ProCreations's profile picture
·

AI & ML interests

"In the beginning was the word. Then came the **** word processor. Then came the thought processor. Then came the death of literature. And so it goes" -- Hyperion - Dan Simmons

Recent Activity

liked a dataset about 14 hours ago
schneewolflabs/fundgrube
reacted to SeaWolf-AI's post with 👍 about 22 hours ago
📱 POCKET — a 35-billion-parameter model that runs on your iPhone, and on your PC with no GPU We're releasing POCKET, VIDRAFT's flagship Darwin-36B-Opus compressed for on-device use. No fork, no CUDA, no cloud — it runs on stock llama.cpp. It's a sparse Mixture-of-Experts model (256 experts, only 8 active per token), so the file can be large while the work per token stays small. That's what lets a 35B model run on a phone, and generate fast on a CPU with no graphics card. Measured (POCKET-35B IQ1_M vs Bonsai-27B Q1_0): • CPU generate (Xeon, 16 threads): 27.0 vs 10.1 tok/s → 2.69× faster • GPU generate (H100): 197 vs 89 tok/s → 2.22× faster • GPU prompt processing (H100): 753 vs 1816 → 0.41× (Bonsai wins this one — MoE prefill wakes every expert, so sparsity stops helping there. We say so.) • Quality (HellaSwag, 400 q): 61.0% vs 60.0% → a tie (confidence intervals overlap) On a real consumer laptop — MacBook M3 Pro (18 GB) — POCKET wins every axis, prompt processing included: • Metal generate: 25.4 vs 12.8 → 1.99× • CPU generate: 13.8 vs 4.4 → 3.13× • Metal prompt: 240.7 vs 73.4 → 3.28× One more quiet fact: the same-size, quality-oriented rival Ternary-Bonsai-27B (7.2 GB) fails to load in upstream llama.cpp at all — it needs the PrismML fork. POCKET runs on the tools you already have: LM Studio, Ollama, PocketPal, MLX. 📖 Full story (tech, measurements, recipes): https://huggingface.co/blog/FINAL-Bench/pocket Models: 📦 POCKET-35B-GGUF (PC / server, no GPU): https://huggingface.co/FINAL-Bench/POCKET-35B-GGUF 🇰🇷 POCKET-KR-GGUF (Android): https://huggingface.co/FINAL-Bench/POCKET-KR-GGUF 🍎 POCKET-KR-MLX (iPhone / Mac): https://huggingface.co/FINAL-Bench/POCKET-KR-MLX 🌍 POCKET-EN-GGUF (English phone / PC): https://huggingface.co/FINAL-Bench/POCKET-EN-GGUF 🖥️ Live demo (answering on a CPU, no GPU): https://huggingface.co/spaces/FINAL-Bench/POCKET-35B-CPU 📚 Collection: https://huggingface.co/collections/FINAL-Bench/pocket-models-6a618ee5d23eafb7e185a5c6
liked a model about 22 hours ago
mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-MXFP4
View all activity

Organizations

None yet