Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -21,6 +21,9 @@ tags:
|
|
| 21 |
- avx512
|
| 22 |
- iknn.cpp
|
| 23 |
- tri-tier
|
|
|
|
|
|
|
|
|
|
| 24 |
base_model: Qwen/Qwen3-27B
|
| 25 |
model_type: iknn
|
| 26 |
---
|
|
@@ -31,18 +34,20 @@ model_type: iknn
|
|
| 31 |
>
|
| 32 |
> This repository contains the native runtime `iknn.cpp`, native format `.iknn` (magic `IKNN`), and a 150M-parameter prototype that validates the tri-tier architecture with real CPU measurements.
|
| 33 |
>
|
| 34 |
-
> Organization: `deeprcurs/IKNN-Rl1-A1` β Model: `IKNN-Rl1-A1` β File: `IKNN-Rl1-A1-150M.iknn` β Format `.iknn` native β Runtime `iknn.cpp` β
|
| 35 |
|
| 36 |
As CPU inference becomes the bottleneck for agentic workloads, the question is not just how large we can scale, but how efficiently we can run on existing hardware. IKNN-Rl1-A1 addresses this with **tri-tier phase quantization** and a fully custom CPU runtime.
|
| 37 |
|
| 38 |
-
. No GGUF dependency. GGUF artifact deleted per audit for clarity and branding. 8 kernels: `satu1_avx2/avx512`, `noesa24_avx2/avx512`, `ntarra_avx2/avx512`, `rht_avx2/avx512`.
|
| 46 |
- **RHT Outlier Flattening:** Randomized Hadamard Transform spreads outlier energy (10 β 5.07) while preserving L2 norm (11.3007, diff 9.5e-07). AVX2 matches scalar.
|
| 47 |
- **PG-KVC Phase-Gated KV Cache:** 2-bit + 1-bit gating based on entropy, 94% saving (6.1MB β 338KB) vs -80% target, 96% in full pipeline.
|
| 48 |
- **PEP + ADLP:** Phase-Entropy Predictor two-stage (bigram cheap <0.5% + low-rank d_modelβ16β1, 100% accuracy) and Adaptive Dual Low-Precision dual-worker (fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS).
|
|
@@ -52,11 +57,14 @@ For more details, see `docs/IKNN_SPEC.md`.
|
|
| 52 |
|
| 53 |
## Model Overview
|
| 54 |
|
|
|
|
|
|
|
|
|
|
| 55 |
- **Type:** Causal Language Model β CPU-first β Tri-Tier Phase Quantization
|
| 56 |
- **Training Stage:** Prototype validation + Agentic training iteration 1 (NOT full 19.5B yet)
|
| 57 |
- **Current Prototype (validated):**
|
| 58 |
- Number of Parameters: 150M total (130.5M SatU1 87% + 13.5M NoeSA-24 9% + 6M Ntarra-DnA 4%), 34.5M active, 26MB memory
|
| 59 |
-
- File: `IKNN-Rl1-A1-150M.iknn` β 42MB, 86 tensors, magic `IKNN`, arch `IKNN-Rl1-A1`
|
| 60 |
- Breakdown: SatU1 12.3MB (50 tensors), NoeSA-24 20.2MB (24 tensors), Ntarra-DnA 11.2MB (12 tensors)
|
| 61 |
- Hidden Dimension: 768 (prototype), 3072 FFN, 12 layers, 12 heads, vocab 32000 (full config), 256/6/1024/1000 for fast training demo
|
| 62 |
- Kernels: 8 β AVX2 for Ryzen5 5650U (Zen3, 6C DDR4 38GB/s, ID target 28-42/60-85 TPS) and AVX-512 for Xeon (2 vCPU, EN target 65-90/120-165 TPS estimated)
|
|
@@ -89,7 +97,7 @@ For more details, see `docs/IKNN_SPEC.md`.
|
|
| 89 |
| PG-KVC full pipeline | 1000 tokens 720Γ1-bit 280Γ2-bit 96% saved | KV cache | PASS |
|
| 90 |
| PEP | Two-stage bigram <0.5% + low-rank d_modelβ16β1, 100/100 accuracy | Entropy predictor | PASS |
|
| 91 |
| ADLP dual-worker | Fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS | Dual worker | PASS |
|
| 92 |
-
| IKNN-Rl1-A1-150M.iknn | 42MB 86 tensors magic IKNN arch IKNN-Rl1-A1 | Native format | PASS |
|
| 93 |
| 150M matmul | 1000 tokens 176ms 5681 TPS on Xeon 2 vCPU | CPU | Real |
|
| 94 |
| Full attention (prototype) | 20 tokens ~900ms TPS 21-22 PG-KVC 96% | CPU | Real β gibberish synthetic before agentic training |
|
| 95 |
| Agentic training iter1 | Loss 7.08β0.41 val 6.59β0.50 grad stable 1.0, unique phases [0,3] then [0,2,4] | Logic/reasoning/coding/research/math/science | PASS β shows learning |
|
|
@@ -98,7 +106,7 @@ No claim of 19.5B quality yet β design target only. Prototype validates archit
|
|
| 98 |
|
| 99 |
## Quickstart
|
| 100 |
|
| 101 |
-
### Build iknn.cpp β Native Runtime β deeprcurs/IKNN-Rl1-A1
|
| 102 |
|
| 103 |
```bash
|
| 104 |
# Clone
|
|
@@ -108,10 +116,10 @@ cd IKNN-Rl1-A1
|
|
| 108 |
# Build main runtime (AVX2 + AVX-512)
|
| 109 |
g++ -mavx512f -mavx512bw -mavx512dq -mavx512vl -mavx512vbmi2 -mavx512vpopcntdq -mavx2 -O3 -pthread iknn.cpp -o iknn
|
| 110 |
|
| 111 |
-
# Write native .iknn model (42MB)
|
| 112 |
./iknn --write-iknn
|
| 113 |
# -> IKNN-Rl1-A1-150M.iknn 42MB 86 tensors magic IKNN arch IKNN-Rl1-A1
|
| 114 |
-
# Breakdown: SatU1 12.3MB 50 tensors, NoeSA 20.2MB 24 tensors, Ntarra 11.2MB 12 tensors
|
| 115 |
|
| 116 |
# Run generation (synthetic weights β gibberish now, needs agentic training)
|
| 117 |
./iknn
|
|
@@ -121,13 +129,13 @@ g++ -mavx512f -mavx512bw -mavx512dq -mavx512vl -mavx512vbmi2 -mavx512vpopcntdq -
|
|
| 121 |
### Kernels β AVX2 for Ryzen5 5650U, AVX-512 for Xeon
|
| 122 |
|
| 123 |
```bash
|
| 124 |
-
# Ntarra AVX2 β Ryzen5
|
| 125 |
g++ -mavx2 -O3 -DNTARRA_AVX2_TEST kernels/ntarra_avx2.cpp -o /tmp/ntarra_avx2_test && /tmp/ntarra_avx2_test
|
| 126 |
-
# -> Pack 2x9 PASS, Compute 10/40/160/-40/0 PASS, Block 8x PASS
|
| 127 |
|
| 128 |
# RHT AVX2 β Ryzen5
|
| 129 |
g++ -mavx2 -O3 -DRHT_AVX2_TEST kernels/rht_avx2.cpp -o /tmp/rht_avx2_test && /tmp/rht_avx2_test
|
| 130 |
-
# -> Outlier 10->5.07 flattened, Norm 11.3007 preserved
|
| 131 |
|
| 132 |
# SatU1 AVX-512 β Xeon
|
| 133 |
g++ -mavx512f -O3 -DSATU1_AVX512_TEST kernels/satu1_avx512.cpp -o /tmp/satu1_test && /tmp/satu1_test
|
|
@@ -155,30 +163,32 @@ python scripts/train_iknn_agentic.py
|
|
| 155 |
# -> Model .cache/IKNN-Rl1-A1-150M-agentic.pt
|
| 156 |
```
|
| 157 |
|
| 158 |
-
## File Layout β deeprcurs/IKNN-Rl1-A1 β Model at root beside iknn.cpp β tidy
|
| 159 |
|
| 160 |
```
|
| 161 |
-
deeprcurs/IKNN-Rl1-A1
|
| 162 |
βββ iknn.cpp # Main runtime β loads .iknn magic IKNN β AVX2/AVX-512 β OFFICIAL
|
| 163 |
-
βββ
|
|
|
|
| 164 |
βββ README_DEV_NOTES.md # Dev notes β old overclaim renamed to avoid overlap β NOT main
|
| 165 |
-
βββ
|
| 166 |
-
β βββ
|
| 167 |
-
β βββ IKNN-Rl1-A1-
|
| 168 |
-
β
|
| 169 |
-
|
|
|
|
|
|
|
|
|
|
| 170 |
βββ kernels/ # 8 kernels β AVX2 + AVX-512 β M1 FULL PASS
|
| 171 |
β βββ satu1_avx2.cpp / satu1_avx512.cpp
|
| 172 |
β βββ noesa24_avx2.cpp / noesa24_avx512.cpp
|
| 173 |
β βββ ntarra_avx2.cpp / ntarra_avx512.cpp # NEW per audit β Ryzen5
|
| 174 |
β βββ rht_avx2.cpp / rht_avx512.cpp # NEW per audit β Ryzen5
|
| 175 |
βββ src/ # Prototype components β 150M, router, SIWF, etc.
|
| 176 |
-
βββ docs/
|
| 177 |
-
β βββ IKNN_SPEC.md # Native .iknn spec β deeprcurs/IKNN-Rl1-A1 β GGUF DELETED
|
| 178 |
βββ scripts/
|
| 179 |
β βββ generate_agentic_dataset.py # Agentic dataset β logic/reasoning/coding/research/math/science
|
| 180 |
β βββ train_iknn_agentic.py # Train IKNN 150M mandiri β frontier LLM trains IKNN
|
| 181 |
-
β βββ publish.sh # Publish to HF β org deeprcurs/IKNN-Rl1-A1 β .iknn only
|
| 182 |
βββ internal/ # PRIVATE β not published β 2.0MB β whitepaper drafts, ops, glossary
|
| 183 |
```
|
| 184 |
|
|
@@ -202,9 +212,14 @@ Iteration 1 shows learning (loss down), but needs iteration 2+ (10k/20k data, 50
|
|
| 202 |
|
| 203 |
## Publishing
|
| 204 |
|
| 205 |
-
- **
|
| 206 |
-
- **
|
| 207 |
-
- **
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 208 |
|
| 209 |
## License & Citation
|
| 210 |
|
|
@@ -213,31 +228,33 @@ MIT for code (`iknn.cpp`, `kernels/`), Apache 2.0 for model weights when release
|
|
| 213 |
```bibtex
|
| 214 |
@misc{iknn-rl1-a1,
|
| 215 |
title={IKNN-Rl1-A1: Integrated Knowledge-phase Neural Network β Recursive Language Iteration 1 β Architecture 1},
|
| 216 |
-
author={
|
|
|
|
| 217 |
year={2026},
|
| 218 |
url={https://huggingface.co/deeprcurs/IKNN-Rl1-A1},
|
| 219 |
-
note={150M prototype validates tri-tier quantization, 8 kernels AVX2+AVX-512, .iknn native format, iknn.cpp runtime, agentic training for researcher agent}
|
| 220 |
}
|
| 221 |
```
|
| 222 |
|
| 223 |
## Acknowledgments
|
| 224 |
|
| 225 |
-
- Qwen team for Qwen3 architecture inspiration (
|
| 226 |
-
-
|
| 227 |
-
- Ryzen5 5650U (Zen3) and Xeon AVX-512 for real CPU measurements
|
| 228 |
|
| 229 |
## Next
|
| 230 |
|
| 231 |
- Iterate agentic training: more data (10k, 20k), longer training (500, 1000 steps), correction until truly answers correctly on logic/reasoning/coding/research/math/science
|
| 232 |
- Full model training after 150M validated
|
| 233 |
-
- Publish primary `.iknn` + `iknn.cpp` β no GGUF β professional README with YAML metadata β Qwen-style layout
|
| 234 |
|
| 235 |
---
|
| 236 |
-
**Organization:**
|
|
|
|
| 237 |
**Model:** IKNN-Rl1-A1
|
| 238 |
-
**File:** IKNN-Rl1-A1-150M.iknn β 42MB β 86 tensors β magic IKNN β arch IKNN-Rl1-A1 β OFFICIAL
|
| 239 |
**Format:** .iknn native β OFFICIAL β GGUF DELETED β Audit consistent
|
| 240 |
**Kernels:** 8 β AVX2 + AVX-512 β M1 FULL PASS β ntarra_avx2 + rht_avx2 NEW per audit
|
| 241 |
**Training:** Agentic 150M β 6000 examples logic/reasoning/coding/research/math/science β loss 7.08β0.41 β frontier LLM trains IKNN β NOT chatbot biasa
|
| 242 |
-
**
|
|
|
|
| 243 |
**Timestamp:** 2026-09-03T20:00:00+07:00
|
|
|
|
| 21 |
- avx512
|
| 22 |
- iknn.cpp
|
| 23 |
- tri-tier
|
| 24 |
+
- SatU1
|
| 25 |
+
- NoeSA
|
| 26 |
+
- Ntarra-DnA
|
| 27 |
base_model: Qwen/Qwen3-27B
|
| 28 |
model_type: iknn
|
| 29 |
---
|
|
|
|
| 34 |
>
|
| 35 |
> This repository contains the native runtime `iknn.cpp`, native format `.iknn` (magic `IKNN`), and a 150M-parameter prototype that validates the tri-tier architecture with real CPU measurements.
|
| 36 |
>
|
| 37 |
+
> Organization: **deepRcurs Labs** β Repo: `deeprcurs/IKNN-Rl1-A1` β Model: `IKNN-Rl1-A1` β File: `IKNN-Rl1-A1-150M.iknn` β Format `.iknn` native β Runtime `iknn.cpp` β 8 kernels AVX2+AVX-512.
|
| 38 |
|
| 39 |
As CPU inference becomes the bottleneck for agentic workloads, the question is not just how large we can scale, but how efficiently we can run on existing hardware. IKNN-Rl1-A1 addresses this with **tri-tier phase quantization** and a fully custom CPU runtime.
|
| 40 |
|
| 41 |
+

|
| 42 |
+
|
| 43 |
+
*Figure: IKNN-Rl1-A1 Tri-Tier CPU-first LLM β MoE Router with PEP Entropy Gate, Tri-Tier Expert Computation (Tier1 SatU1 1-BIT 87%, Tier2 NoeSA-24 4.58-BIT 9%, Tier3 Ntarra-DnA 3.17-BIT 4%), RHT Randomized Hadamard Transform, PG-KVC Phase-Gated KV Cache 94% saving, ADLP Dual-Worker, CPU-Focused AVX2/AVX-512 β 150M Prototype, Design Target 19.5B*
|
| 44 |
|
| 45 |
This is an early prototype of the architecture that will underpin larger IKNN models. It is built around a rethinking of how quantization, phase, and KV cache interact on CPU.
|
| 46 |
|
| 47 |
## Highlights
|
| 48 |
|
| 49 |
+
- **Tri-Tier Quantization:** SatU1 1-BIT (binary XNOR+popcount with AVX2/AVX-512 VPOPCNTDQ), NoeSA-24 4.58-BIT (13 values per 60-bit, LUT576, truncated Gaussian), Ntarra-DnA 3.17-BIT (9-state Direction Γ Phase, shift+sign, no multiply). Each tier is mapped to different cognitive roles: throughput vs critical logic/code/math.
|
| 50 |
+
- **Native Format .iknn + Runtime iknn.cpp:** Organization deepRcurs Labs, repo `deeprcurs/IKNN-Rl1-A1`, model `IKNN-Rl1-A1`. Free naming β `iknn.cpp` loads `.iknn` (magic `IKNN`, arch `IKNN-Rl1-A1`). No GGUF dependency. GGUF artifact deleted per audit for clarity and branding. 8 kernels: `satu1_avx2/avx512`, `noesa24_avx2/avx512`, `ntarra_avx2/avx512`, `rht_avx2/avx512`.
|
| 51 |
- **RHT Outlier Flattening:** Randomized Hadamard Transform spreads outlier energy (10 β 5.07) while preserving L2 norm (11.3007, diff 9.5e-07). AVX2 matches scalar.
|
| 52 |
- **PG-KVC Phase-Gated KV Cache:** 2-bit + 1-bit gating based on entropy, 94% saving (6.1MB β 338KB) vs -80% target, 96% in full pipeline.
|
| 53 |
- **PEP + ADLP:** Phase-Entropy Predictor two-stage (bigram cheap <0.5% + low-rank d_modelβ16β1, 100% accuracy) and Adaptive Dual Low-Precision dual-worker (fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS).
|
|
|
|
| 57 |
|
| 58 |
## Model Overview
|
| 59 |
|
| 60 |
+
- **Organization:** deepRcurs Labs
|
| 61 |
+
- **Repo:** `deeprcurs/IKNN-Rl1-A1`
|
| 62 |
+
- **Model:** `IKNN-Rl1-A1`
|
| 63 |
- **Type:** Causal Language Model β CPU-first β Tri-Tier Phase Quantization
|
| 64 |
- **Training Stage:** Prototype validation + Agentic training iteration 1 (NOT full 19.5B yet)
|
| 65 |
- **Current Prototype (validated):**
|
| 66 |
- Number of Parameters: 150M total (130.5M SatU1 87% + 13.5M NoeSA-24 9% + 6M Ntarra-DnA 4%), 34.5M active, 26MB memory
|
| 67 |
+
- File: `IKNN-Rl1-A1-150M.iknn` at root beside `iknn.cpp` β 42MB, 86 tensors, magic `IKNN`, arch `IKNN-Rl1-A1` β tidy, not scattered
|
| 68 |
- Breakdown: SatU1 12.3MB (50 tensors), NoeSA-24 20.2MB (24 tensors), Ntarra-DnA 11.2MB (12 tensors)
|
| 69 |
- Hidden Dimension: 768 (prototype), 3072 FFN, 12 layers, 12 heads, vocab 32000 (full config), 256/6/1024/1000 for fast training demo
|
| 70 |
- Kernels: 8 β AVX2 for Ryzen5 5650U (Zen3, 6C DDR4 38GB/s, ID target 28-42/60-85 TPS) and AVX-512 for Xeon (2 vCPU, EN target 65-90/120-165 TPS estimated)
|
|
|
|
| 97 |
| PG-KVC full pipeline | 1000 tokens 720Γ1-bit 280Γ2-bit 96% saved | KV cache | PASS |
|
| 98 |
| PEP | Two-stage bigram <0.5% + low-rank d_modelβ16β1, 100/100 accuracy | Entropy predictor | PASS |
|
| 99 |
| ADLP dual-worker | Fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS | Dual worker | PASS |
|
| 100 |
+
| IKNN-Rl1-A1-150M.iknn | 42MB 86 tensors magic IKNN arch IKNN-Rl1-A1 at root beside iknn.cpp | Native format | PASS |
|
| 101 |
| 150M matmul | 1000 tokens 176ms 5681 TPS on Xeon 2 vCPU | CPU | Real |
|
| 102 |
| Full attention (prototype) | 20 tokens ~900ms TPS 21-22 PG-KVC 96% | CPU | Real β gibberish synthetic before agentic training |
|
| 103 |
| Agentic training iter1 | Loss 7.08β0.41 val 6.59β0.50 grad stable 1.0, unique phases [0,3] then [0,2,4] | Logic/reasoning/coding/research/math/science | PASS β shows learning |
|
|
|
|
| 106 |
|
| 107 |
## Quickstart
|
| 108 |
|
| 109 |
+
### Build iknn.cpp β Native Runtime β deepRcurs Labs β deeprcurs/IKNN-Rl1-A1
|
| 110 |
|
| 111 |
```bash
|
| 112 |
# Clone
|
|
|
|
| 116 |
# Build main runtime (AVX2 + AVX-512)
|
| 117 |
g++ -mavx512f -mavx512bw -mavx512dq -mavx512vl -mavx512vbmi2 -mavx512vpopcntdq -mavx2 -O3 -pthread iknn.cpp -o iknn
|
| 118 |
|
| 119 |
+
# Write native .iknn model (42MB at root beside iknn.cpp β tidy)
|
| 120 |
./iknn --write-iknn
|
| 121 |
# -> IKNN-Rl1-A1-150M.iknn 42MB 86 tensors magic IKNN arch IKNN-Rl1-A1
|
| 122 |
+
# Breakdown: SatU1 12.3MB 50 tensors, NoeSA-24 20.2MB 24 tensors, Ntarra-DnA 11.2MB 12 tensors
|
| 123 |
|
| 124 |
# Run generation (synthetic weights β gibberish now, needs agentic training)
|
| 125 |
./iknn
|
|
|
|
| 129 |
### Kernels β AVX2 for Ryzen5 5650U, AVX-512 for Xeon
|
| 130 |
|
| 131 |
```bash
|
| 132 |
+
# Ntarra-DnA AVX2 β Ryzen5
|
| 133 |
g++ -mavx2 -O3 -DNTARRA_AVX2_TEST kernels/ntarra_avx2.cpp -o /tmp/ntarra_avx2_test && /tmp/ntarra_avx2_test
|
| 134 |
+
# -> Pack 2x9 PASS, Compute 10/40/160/-40/0 PASS, Block 8x PASS
|
| 135 |
|
| 136 |
# RHT AVX2 β Ryzen5
|
| 137 |
g++ -mavx2 -O3 -DRHT_AVX2_TEST kernels/rht_avx2.cpp -o /tmp/rht_avx2_test && /tmp/rht_avx2_test
|
| 138 |
+
# -> Outlier 10->5.07 flattened, Norm 11.3007 preserved
|
| 139 |
|
| 140 |
# SatU1 AVX-512 β Xeon
|
| 141 |
g++ -mavx512f -O3 -DSATU1_AVX512_TEST kernels/satu1_avx512.cpp -o /tmp/satu1_test && /tmp/satu1_test
|
|
|
|
| 163 |
# -> Model .cache/IKNN-Rl1-A1-150M-agentic.pt
|
| 164 |
```
|
| 165 |
|
| 166 |
+
## File Layout β deepRcurs Labs β deeprcurs/IKNN-Rl1-A1 β Model at root beside iknn.cpp β tidy
|
| 167 |
|
| 168 |
```
|
| 169 |
+
deepRcurs Labs β deeprcurs/IKNN-Rl1-A1 β Model IKNN-Rl1-A1 β File IKNN-Rl1-A1-150M.iknn at root beside iknn.cpp β tidy
|
| 170 |
βββ iknn.cpp # Main runtime β loads .iknn magic IKNN β AVX2/AVX-512 β OFFICIAL
|
| 171 |
+
βββ IKNN-Rl1-A1-150M.iknn # 42MB native model β 86 tensors β magic IKNN β arch IKNN-Rl1-A1 β OFFICIAL β beside iknn.cpp
|
| 172 |
+
βββ README.md # This file β professional β YAML metadata β no overclaim β Qwen-style layout β Organization deepRcurs Labs, Repo deeprcurs/IKNN-Rl1-A1
|
| 173 |
βββ README_DEV_NOTES.md # Dev notes β old overclaim renamed to avoid overlap β NOT main
|
| 174 |
+
βββ docs/
|
| 175 |
+
β βββ IKNN_SPEC.md # Native .iknn spec β deepRcurs Labs β deeprcurs/IKNN-Rl1-A1
|
| 176 |
+
β βββ IKNN-Rl1-A1-architecture-dark.png # Architecture diagram dark BG β correct case SatU1 NoeSA DnA MoE
|
| 177 |
+
β βββ IKNN-Rl1-A1-architecture.png # Light BG version
|
| 178 |
+
βββ benchmarks/ # Benchmarks JSON only β model moved to root beside iknn.cpp for tidiness
|
| 179 |
+
β βββ IKNN-Rl1-A1-agentic-dataset-sample-20260903.json
|
| 180 |
+
β βββ IKNN-Rl1-A1-agentic-training-20260903.json
|
| 181 |
+
β βββ m1-full-avx2-avx512-20260903.json (8 kernels PASS)
|
| 182 |
βββ kernels/ # 8 kernels β AVX2 + AVX-512 β M1 FULL PASS
|
| 183 |
β βββ satu1_avx2.cpp / satu1_avx512.cpp
|
| 184 |
β βββ noesa24_avx2.cpp / noesa24_avx512.cpp
|
| 185 |
β βββ ntarra_avx2.cpp / ntarra_avx512.cpp # NEW per audit β Ryzen5
|
| 186 |
β βββ rht_avx2.cpp / rht_avx512.cpp # NEW per audit β Ryzen5
|
| 187 |
βββ src/ # Prototype components β 150M, router, SIWF, etc.
|
|
|
|
|
|
|
| 188 |
βββ scripts/
|
| 189 |
β βββ generate_agentic_dataset.py # Agentic dataset β logic/reasoning/coding/research/math/science
|
| 190 |
β βββ train_iknn_agentic.py # Train IKNN 150M mandiri β frontier LLM trains IKNN
|
| 191 |
+
β βββ publish.sh # Publish to HF β org deepRcurs Labs β repo deeprcurs/IKNN-Rl1-A1 β .iknn only
|
| 192 |
βββ internal/ # PRIVATE β not published β 2.0MB β whitepaper drafts, ops, glossary
|
| 193 |
```
|
| 194 |
|
|
|
|
| 212 |
|
| 213 |
## Publishing
|
| 214 |
|
| 215 |
+
- **Organization:** deepRcurs Labs
|
| 216 |
+
- **Repo:** `deeprcurs/IKNN-Rl1-A1` β https://huggingface.co/deeprcurs/IKNN-Rl1-A1
|
| 217 |
+
- **Model:** `IKNN-Rl1-A1`
|
| 218 |
+
- **File:** `IKNN-Rl1-A1-150M.iknn` 42MB at root beside `iknn.cpp` β tidy β OFFICIAL β GGUF DELETED
|
| 219 |
+
- **Format:** `.iknn` native magic `IKNN` β NOT GGUF
|
| 220 |
+
- **Runtime:** `iknn.cpp`
|
| 221 |
+
- **README:** Professional with YAML frontmatter β fixes `YAML Metadata Warning: empty or missing yaml metadata` β Qwen-style layout with Highlights, Model Overview, Benchmarks, Quickstart
|
| 222 |
+
- **Image:** `docs/IKNN-Rl1-A1-architecture-dark.png` dark BG, correct case SatU1, NoeSA-24, Ntarra-DnA, MoE Router, PEP, RHT, PG-KVC, ADLP β real image, not placeholder
|
| 223 |
|
| 224 |
## License & Citation
|
| 225 |
|
|
|
|
| 228 |
```bibtex
|
| 229 |
@misc{iknn-rl1-a1,
|
| 230 |
title={IKNN-Rl1-A1: Integrated Knowledge-phase Neural Network β Recursive Language Iteration 1 β Architecture 1},
|
| 231 |
+
author={deepRcurs Labs},
|
| 232 |
+
organization={deepRcurs Labs},
|
| 233 |
year={2026},
|
| 234 |
url={https://huggingface.co/deeprcurs/IKNN-Rl1-A1},
|
| 235 |
+
note={150M prototype validates tri-tier quantization, 8 kernels AVX2+AVX-512, .iknn native format, iknn.cpp runtime, agentic training for researcher agent β Organization deepRcurs Labs, Repo deeprcurs/IKNN-Rl1-A1, Model IKNN-Rl1-A1, File IKNN-Rl1-A1-150M.iknn at root beside iknn.cpp}
|
| 236 |
}
|
| 237 |
```
|
| 238 |
|
| 239 |
## Acknowledgments
|
| 240 |
|
| 241 |
+
- Qwen team for Qwen3.8-Flash-Next architecture and README layout inspiration (Highlights, Model Overview, Benchmarks, Quickstart)
|
| 242 |
+
- Organization deepRcurs Labs β Repo deeprcurs/IKNN-Rl1-A1 β Model IKNN-Rl1-A1
|
|
|
|
| 243 |
|
| 244 |
## Next
|
| 245 |
|
| 246 |
- Iterate agentic training: more data (10k, 20k), longer training (500, 1000 steps), correction until truly answers correctly on logic/reasoning/coding/research/math/science
|
| 247 |
- Full model training after 150M validated
|
| 248 |
+
- Publish primary `.iknn` + `iknn.cpp` β no GGUF β professional README with YAML metadata β Qwen-style layout β image dark BG correct case β Organization deepRcurs Labs, Repo deeprcurs/IKNN-Rl1-A1
|
| 249 |
|
| 250 |
---
|
| 251 |
+
**Organization:** deepRcurs Labs
|
| 252 |
+
**Repo:** deeprcurs/IKNN-Rl1-A1
|
| 253 |
**Model:** IKNN-Rl1-A1
|
| 254 |
+
**File:** IKNN-Rl1-A1-150M.iknn at root beside iknn.cpp β tidy β 42MB β 86 tensors β magic IKNN β arch IKNN-Rl1-A1 β OFFICIAL
|
| 255 |
**Format:** .iknn native β OFFICIAL β GGUF DELETED β Audit consistent
|
| 256 |
**Kernels:** 8 β AVX2 + AVX-512 β M1 FULL PASS β ntarra_avx2 + rht_avx2 NEW per audit
|
| 257 |
**Training:** Agentic 150M β 6000 examples logic/reasoning/coding/research/math/science β loss 7.08β0.41 β frontier LLM trains IKNN β NOT chatbot biasa
|
| 258 |
+
**Image:** docs/IKNN-Rl1-A1-architecture-dark.png β dark BG β correct case SatU1 NoeSA-24 Ntarra-DnA MoE Router PEP RHT PG-KVC ADLP β real image not placeholder
|
| 259 |
+
**HF:** https://huggingface.co/deeprcurs/IKNN-Rl1-A1 β Published SUCCESS β YAML metadata fixed β Qwen-style layout β Organization deepRcurs Labs
|
| 260 |
**Timestamp:** 2026-09-03T20:00:00+07:00
|