Instructions to use Nanthasit/sakthai-context-0.5b-tools with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Nanthasit/sakthai-context-0.5b-tools with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Nanthasit/sakthai-context-0.5b-tools")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Nanthasit/sakthai-context-0.5b-tools")
model = AutoModelForCausalLM.from_pretrained("Nanthasit/sakthai-context-0.5b-tools", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Nanthasit/sakthai-context-0.5b-tools with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Nanthasit/sakthai-context-0.5b-tools"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Nanthasit/sakthai-context-0.5b-tools",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Nanthasit/sakthai-context-0.5b-tools

SGLang

How to use Nanthasit/sakthai-context-0.5b-tools with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Nanthasit/sakthai-context-0.5b-tools" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Nanthasit/sakthai-context-0.5b-tools",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Nanthasit/sakthai-context-0.5b-tools" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Nanthasit/sakthai-context-0.5b-tools",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Nanthasit/sakthai-context-0.5b-tools with Docker Model Runner:
```
docker model run hf.co/Nanthasit/sakthai-context-0.5b-tools
```

Nanthasit commited on Jul 30

Commit

0558168

verified ·

1 Parent(s): 4a8f6c9

Add download badge, Spaces links, and Rising Stars promotion section

Browse files

Files changed (1) hide show

README.md +31 -0

README.md CHANGED Viewed

@@ -83,6 +83,7 @@ model-index:
 <h1 align="center">SakThai Context 0.5B — Tools</h1>
 <p align="center"><em>Ultra-light tool-calling agent · Qwen2.5-0.5B fine-tune · runs in ~1 GB RAM</em></p>
 <p align="center">
   <a href="https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02">
     <img src="https://img.shields.io/badge/🏠-SakThai%20Model%20Family-8A2BE2" alt="Collection"/>
   </a>
@@ -92,6 +93,9 @@ model-index:
   <img src="https://img.shields.io/badge/context-32K-blue" alt="32K Context"/>
   <img src="https://img.shields.io/badge/params-494M-lightgrey" alt="494M Parameters"/>
   <img src="https://img.shields.io/badge/bench-v2-500%20rows-blue" alt="500 rows"/>
 </p>
 > **🏠 Part of the [House of Sak](https://github.com/beer-sakthai/Sak-Family-Agent/blob/main/HOUSE_OF_SAK.md)**
@@ -262,6 +266,30 @@ ollama pull sakthai:latest
 **11 models in the family · 8 datasets · 3 Spaces** — [full collection →](https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02)
 ## Links
 - [🏠 SakThai Model Family](https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02)
@@ -270,5 +298,8 @@ ollama pull sakthai:latest
 - [📊 Bench Results](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2/tree/main/results)
 - [🔄 Merged (GGUF)](https://huggingface.co/Nanthasit/sakthai-context-0.5b-merged)
 - [🔧 Eval Script](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2/raw/main/eval_bench.py)
 *Built from a shelter in Cork, Ireland.*

 <h1 align="center">SakThai Context 0.5B — Tools</h1>
 <p align="center"><em>Ultra-light tool-calling agent · Qwen2.5-0.5B fine-tune · runs in ~1 GB RAM</em></p>
 <p align="center">
+  <img src="https://img.shields.io/badge/dynamic/json?url=https%3A//huggingface.co/api/models/Nanthasit/sakthai-context-0.5b-tools&query=%24.downloads&label=downloads&color=blue&cacheSeconds=3600" alt="Downloads"/>
   <a href="https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02">
     <img src="https://img.shields.io/badge/🏠-SakThai%20Model%20Family-8A2BE2" alt="Collection"/>
   </a>
   <img src="https://img.shields.io/badge/context-32K-blue" alt="32K Context"/>
   <img src="https://img.shields.io/badge/params-494M-lightgrey" alt="494M Parameters"/>
   <img src="https://img.shields.io/badge/bench-v2-500%20rows-blue" alt="500 rows"/>
+  <a href="https://huggingface.co/spaces/Nanthasit/sakthai-vision-demo"><img src="https://img.shields.io/badge/🖼️-Vision%20Demo-purple" alt="Vision Demo"/></a>
+  <a href="https://huggingface.co/spaces/Nanthasit/sakthai-tts"><img src="https://img.shields.io/badge/🔊-TTS%20Demo-teal" alt="TTS Demo"/></a>
+  <a href="https://huggingface.co/spaces/Nanthasit/sakthai-leaderboard"><img src="https://img.shields.io/badge/📊-Leaderboard-ff6b6b" alt="Leaderboard"/></a>
 </p>
 > **🏠 Part of the [House of Sak](https://github.com/beer-sakthai/Sak-Family-Agent/blob/main/HOUSE_OF_SAK.md)**
 **11 models in the family · 8 datasets · 3 Spaces** — [full collection →](https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02)
+---
+## 🌱 Rising Stars — Ecosystem Gems
+These sibling assets have traction building but less visibility. A download or like on any of them helps the whole family grow:
+| Asset | Type | Downloads | Why It Matters |
+|-------|:----:|:---------:|:--------------|
+| [sakthai-coder-1.5b](https://huggingface.co/Nanthasit/sakthai-coder-1.5b) | Model | 70 | Code generation — Qwen2.5-Coder fine-tune, 1.1 GB GGUF |
+| [sakthai-irrelevance-supplement](https://huggingface.co/datasets/Nanthasit/sakthai-irrelevance-supplement) | Dataset | 0 🚨 | Teaches models when NOT to call tools — critical safety data |
+| [sakthai-combined-v7](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v7) | Dataset | 0 🌱 | Main training dataset — 2,309 examples, 86 tool schemas |
+| [sakthai-bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) | Dataset | 0 🌱 | Multi-domain eval — 500 rows, 4 categories |
+| [food-penguin-v1](https://huggingface.co/datasets/Nanthasit/food-penguin-v1) | Dataset | 51 | Restaurant tool-calling — themed dataset gaining traction |
+> 🚨 The **irrelevance-supplement** has 0 downloads despite being essential for training models to decline out-of-scope tool calls. Every download validates this safety-critical approach!
+### Try the Ecosystem
+| Space | What It Does |
+|-------|-------------|
+| [🖼️ Vision Demo](https://huggingface.co/spaces/Nanthasit/sakthai-vision-demo) | Upload images, ask questions — runs vision-7b |
+| [🔊 TTS Showcase](https://huggingface.co/spaces/Nanthasit/sakthai-tts) | Text-to-speech in 15 languages |
+| [📊 Leaderboard](https://huggingface.co/spaces/Nanthasit/sakthai-leaderboard) | Benchmark tracker for all models |
 ## Links
 - [🏠 SakThai Model Family](https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02)
 - [📊 Bench Results](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2/tree/main/results)
 - [🔄 Merged (GGUF)](https://huggingface.co/Nanthasit/sakthai-context-0.5b-merged)
 - [🔧 Eval Script](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2/raw/main/eval_bench.py)
+- [🖼️ Vision Demo Space](https://huggingface.co/spaces/Nanthasit/sakthai-vision-demo)
+- [🔊 TTS Demo Space](https://huggingface.co/spaces/Nanthasit/sakthai-tts)
+- [📊 Leaderboard Space](https://huggingface.co/spaces/Nanthasit/sakthai-leaderboard)
 *Built from a shelter in Cork, Ireland.*