deeprcurs-staff commited on
Commit
da47c4b
Β·
verified Β·
1 Parent(s): f99c9ae

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +52 -35
README.md CHANGED
@@ -21,6 +21,9 @@ tags:
21
  - avx512
22
  - iknn.cpp
23
  - tri-tier
 
 
 
24
  base_model: Qwen/Qwen3-27B
25
  model_type: iknn
26
  ---
@@ -31,18 +34,20 @@ model_type: iknn
31
  >
32
  > This repository contains the native runtime `iknn.cpp`, native format `.iknn` (magic `IKNN`), and a 150M-parameter prototype that validates the tri-tier architecture with real CPU measurements.
33
  >
34
- > Organization: `deeprcurs/IKNN-Rl1-A1` β€” Model: `IKNN-Rl1-A1` β€” File: `IKNN-Rl1-A1-150M.iknn` β€” Format `.iknn` native β€” Runtime `iknn.cpp` β€” GGUF DELETED per audit β€” 8 kernels AVX2+AVX-512.
35
 
36
  As CPU inference becomes the bottleneck for agentic workloads, the question is not just how large we can scale, but how efficiently we can run on existing hardware. IKNN-Rl1-A1 addresses this with **tri-tier phase quantization** and a fully custom CPU runtime.
37
 
38
- ![IKNN-Rl1-A1 Architecture](https://via.placeholder.com/800x400?text=IKNN-Rl1-A1+Tri-Tier+Architecture)
 
 
39
 
40
  This is an early prototype of the architecture that will underpin larger IKNN models. It is built around a rethinking of how quantization, phase, and KV cache interact on CPU.
41
 
42
  ## Highlights
43
 
44
- - **Tri-Tier Quantization:** SatU1 1-bit (binary XNOR+popcount with AVX2/AVX-512 VPOPCNTDQ), NoeSA-24 4.58-bit (13 values per 60-bit, LUT576, truncated Gaussian), Ntarra-DnA 3.17-bit (9-state Direction Γ— Phase, shift+sign, no multiply). Each tier is mapped to different cognitive roles: throughput vs critical logic/code/math.
45
- - **Native Format .iknn + Runtime iknn.cpp:** Free naming β€” `iknn.cpp` loads `.iknn` (magic `IKNN`, arch `IKNN-Rl1-A1`). No GGUF dependency. GGUF artifact deleted per audit for clarity and branding. 8 kernels: `satu1_avx2/avx512`, `noesa24_avx2/avx512`, `ntarra_avx2/avx512`, `rht_avx2/avx512`.
46
  - **RHT Outlier Flattening:** Randomized Hadamard Transform spreads outlier energy (10 β†’ 5.07) while preserving L2 norm (11.3007, diff 9.5e-07). AVX2 matches scalar.
47
  - **PG-KVC Phase-Gated KV Cache:** 2-bit + 1-bit gating based on entropy, 94% saving (6.1MB β†’ 338KB) vs -80% target, 96% in full pipeline.
48
  - **PEP + ADLP:** Phase-Entropy Predictor two-stage (bigram cheap <0.5% + low-rank d_modelβ†’16β†’1, 100% accuracy) and Adaptive Dual Low-Precision dual-worker (fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS).
@@ -52,11 +57,14 @@ For more details, see `docs/IKNN_SPEC.md`.
52
 
53
  ## Model Overview
54
 
 
 
 
55
  - **Type:** Causal Language Model β€” CPU-first β€” Tri-Tier Phase Quantization
56
  - **Training Stage:** Prototype validation + Agentic training iteration 1 (NOT full 19.5B yet)
57
  - **Current Prototype (validated):**
58
  - Number of Parameters: 150M total (130.5M SatU1 87% + 13.5M NoeSA-24 9% + 6M Ntarra-DnA 4%), 34.5M active, 26MB memory
59
- - File: `IKNN-Rl1-A1-150M.iknn` β€” 42MB, 86 tensors, magic `IKNN`, arch `IKNN-Rl1-A1`
60
  - Breakdown: SatU1 12.3MB (50 tensors), NoeSA-24 20.2MB (24 tensors), Ntarra-DnA 11.2MB (12 tensors)
61
  - Hidden Dimension: 768 (prototype), 3072 FFN, 12 layers, 12 heads, vocab 32000 (full config), 256/6/1024/1000 for fast training demo
62
  - Kernels: 8 β€” AVX2 for Ryzen5 5650U (Zen3, 6C DDR4 38GB/s, ID target 28-42/60-85 TPS) and AVX-512 for Xeon (2 vCPU, EN target 65-90/120-165 TPS estimated)
@@ -89,7 +97,7 @@ For more details, see `docs/IKNN_SPEC.md`.
89
  | PG-KVC full pipeline | 1000 tokens 720Γ—1-bit 280Γ—2-bit 96% saved | KV cache | PASS |
90
  | PEP | Two-stage bigram <0.5% + low-rank d_modelβ†’16β†’1, 100/100 accuracy | Entropy predictor | PASS |
91
  | ADLP dual-worker | Fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS | Dual worker | PASS |
92
- | IKNN-Rl1-A1-150M.iknn | 42MB 86 tensors magic IKNN arch IKNN-Rl1-A1 | Native format | PASS |
93
  | 150M matmul | 1000 tokens 176ms 5681 TPS on Xeon 2 vCPU | CPU | Real |
94
  | Full attention (prototype) | 20 tokens ~900ms TPS 21-22 PG-KVC 96% | CPU | Real β€” gibberish synthetic before agentic training |
95
  | Agentic training iter1 | Loss 7.08β†’0.41 val 6.59β†’0.50 grad stable 1.0, unique phases [0,3] then [0,2,4] | Logic/reasoning/coding/research/math/science | PASS β€” shows learning |
@@ -98,7 +106,7 @@ No claim of 19.5B quality yet β€” design target only. Prototype validates archit
98
 
99
  ## Quickstart
100
 
101
- ### Build iknn.cpp β€” Native Runtime β€” deeprcurs/IKNN-Rl1-A1
102
 
103
  ```bash
104
  # Clone
@@ -108,10 +116,10 @@ cd IKNN-Rl1-A1
108
  # Build main runtime (AVX2 + AVX-512)
109
  g++ -mavx512f -mavx512bw -mavx512dq -mavx512vl -mavx512vbmi2 -mavx512vpopcntdq -mavx2 -O3 -pthread iknn.cpp -o iknn
110
 
111
- # Write native .iknn model (42MB)
112
  ./iknn --write-iknn
113
  # -> IKNN-Rl1-A1-150M.iknn 42MB 86 tensors magic IKNN arch IKNN-Rl1-A1
114
- # Breakdown: SatU1 12.3MB 50 tensors, NoeSA 20.2MB 24 tensors, Ntarra 11.2MB 12 tensors
115
 
116
  # Run generation (synthetic weights β€” gibberish now, needs agentic training)
117
  ./iknn
@@ -121,13 +129,13 @@ g++ -mavx512f -mavx512bw -mavx512dq -mavx512vl -mavx512vbmi2 -mavx512vpopcntdq -
121
  ### Kernels β€” AVX2 for Ryzen5 5650U, AVX-512 for Xeon
122
 
123
  ```bash
124
- # Ntarra AVX2 β€” Ryzen5
125
  g++ -mavx2 -O3 -DNTARRA_AVX2_TEST kernels/ntarra_avx2.cpp -o /tmp/ntarra_avx2_test && /tmp/ntarra_avx2_test
126
- # -> Pack 2x9 PASS, Compute 10/40/160/-40/0 PASS, Block 8x PASS, Shift XOR POS 40 NEG -40 ZERO 0 PASS
127
 
128
  # RHT AVX2 β€” Ryzen5
129
  g++ -mavx2 -O3 -DRHT_AVX2_TEST kernels/rht_avx2.cpp -o /tmp/rht_avx2_test && /tmp/rht_avx2_test
130
- # -> Outlier 10->5.07 flattened, Norm 11.3007 preserved, AVX2 matches scalar PASS
131
 
132
  # SatU1 AVX-512 β€” Xeon
133
  g++ -mavx512f -O3 -DSATU1_AVX512_TEST kernels/satu1_avx512.cpp -o /tmp/satu1_test && /tmp/satu1_test
@@ -155,30 +163,32 @@ python scripts/train_iknn_agentic.py
155
  # -> Model .cache/IKNN-Rl1-A1-150M-agentic.pt
156
  ```
157
 
158
- ## File Layout β€” deeprcurs/IKNN-Rl1-A1 β€” Model at root beside iknn.cpp β€” tidy
159
 
160
  ```
161
- deeprcurs/IKNN-Rl1-A1
162
  β”œβ”€β”€ iknn.cpp # Main runtime β€” loads .iknn magic IKNN β€” AVX2/AVX-512 β€” OFFICIAL
163
- β”œβ”€β”€ README.md # This file β€” professional β€” YAML metadata β€” no overclaim β€” Qwen-style layout
 
164
  β”œβ”€β”€ README_DEV_NOTES.md # Dev notes β€” old overclaim renamed to avoid overlap β€” NOT main
165
- β”œβ”€β”€ benchmarks/
166
- β”‚ β”œβ”€β”€ IKNN-Rl1-A1-150M.iknn # 42MB native model β€” 86 tensors β€” magic IKNN β€” arch IKNN-Rl1-A1 β€” OFFICIAL
167
- β”‚ β”œβ”€β”€ IKNN-Rl1-A1-agentic-dataset-sample-20260903.json # 100 examples agentic
168
- β”‚ β”œβ”€β”€ IKNN-Rl1-A1-agentic-training-20260903.json # Loss 7.08->0.41
169
- β”‚ └── m1-full-avx2-avx512-20260903.json # 8 kernels PASS
 
 
 
170
  β”œβ”€β”€ kernels/ # 8 kernels β€” AVX2 + AVX-512 β€” M1 FULL PASS
171
  β”‚ β”œβ”€β”€ satu1_avx2.cpp / satu1_avx512.cpp
172
  β”‚ β”œβ”€β”€ noesa24_avx2.cpp / noesa24_avx512.cpp
173
  β”‚ β”œβ”€β”€ ntarra_avx2.cpp / ntarra_avx512.cpp # NEW per audit β€” Ryzen5
174
  β”‚ └── rht_avx2.cpp / rht_avx512.cpp # NEW per audit β€” Ryzen5
175
  β”œβ”€β”€ src/ # Prototype components β€” 150M, router, SIWF, etc.
176
- β”œβ”€β”€ docs/
177
- β”‚ └── IKNN_SPEC.md # Native .iknn spec β€” deeprcurs/IKNN-Rl1-A1 β€” GGUF DELETED
178
  β”œβ”€β”€ scripts/
179
  β”‚ β”œβ”€β”€ generate_agentic_dataset.py # Agentic dataset β€” logic/reasoning/coding/research/math/science
180
  β”‚ β”œβ”€β”€ train_iknn_agentic.py # Train IKNN 150M mandiri β€” frontier LLM trains IKNN
181
- β”‚ └── publish.sh # Publish to HF β€” org deeprcurs/IKNN-Rl1-A1 β€” .iknn only
182
  └── internal/ # PRIVATE β€” not published β€” 2.0MB β€” whitepaper drafts, ops, glossary
183
  ```
184
 
@@ -202,9 +212,14 @@ Iteration 1 shows learning (loss down), but needs iteration 2+ (10k/20k data, 50
202
 
203
  ## Publishing
204
 
205
- - **HF Hub:** `deeprcurs/IKNN-Rl1-A1` β€” https://huggingface.co/deeprcurs/IKNN-Rl1-A1 β€” file `IKNN-Rl1-A1-150M.iknn` 42MB + `iknn.cpp` + `README.md` + `docs/IKNN_SPEC.md` β€” GGUF DELETED, only `.iknn` β€” professional README with YAML metadata
206
- - **GitHub:** `deeprcurs/IKNN-Rl1-A1` β€” same
207
- - **Token handling:** HF token stored in `.cache/huggingface/token` (excluded, not in zip) β€” safe
 
 
 
 
 
208
 
209
  ## License & Citation
210
 
@@ -213,31 +228,33 @@ MIT for code (`iknn.cpp`, `kernels/`), Apache 2.0 for model weights when release
213
  ```bibtex
214
  @misc{iknn-rl1-a1,
215
  title={IKNN-Rl1-A1: Integrated Knowledge-phase Neural Network β€” Recursive Language Iteration 1 β€” Architecture 1},
216
- author={deeprcurs},
 
217
  year={2026},
218
  url={https://huggingface.co/deeprcurs/IKNN-Rl1-A1},
219
- note={150M prototype validates tri-tier quantization, 8 kernels AVX2+AVX-512, .iknn native format, iknn.cpp runtime, agentic training for researcher agent}
220
  }
221
  ```
222
 
223
  ## Acknowledgments
224
 
225
- - Qwen team for Qwen3 architecture inspiration (Hybrid Attention, Gated Residual, N-gram Embedding) β€” layout reference for this README
226
- - llama.cpp for GGUF format reference (now deleted in favor of native .iknn)
227
- - Ryzen5 5650U (Zen3) and Xeon AVX-512 for real CPU measurements
228
 
229
  ## Next
230
 
231
  - Iterate agentic training: more data (10k, 20k), longer training (500, 1000 steps), correction until truly answers correctly on logic/reasoning/coding/research/math/science
232
  - Full model training after 150M validated
233
- - Publish primary `.iknn` + `iknn.cpp` β€” no GGUF β€” professional README with YAML metadata β€” Qwen-style layout
234
 
235
  ---
236
- **Organization:** deeprcurs/IKNN-Rl1-A1
 
237
  **Model:** IKNN-Rl1-A1
238
- **File:** IKNN-Rl1-A1-150M.iknn β€” 42MB β€” 86 tensors β€” magic IKNN β€” arch IKNN-Rl1-A1 β€” OFFICIAL
239
  **Format:** .iknn native β€” OFFICIAL β€” GGUF DELETED β€” Audit consistent
240
  **Kernels:** 8 β€” AVX2 + AVX-512 β€” M1 FULL PASS β€” ntarra_avx2 + rht_avx2 NEW per audit
241
  **Training:** Agentic 150M β€” 6000 examples logic/reasoning/coding/research/math/science β€” loss 7.08β†’0.41 β€” frontier LLM trains IKNN β€” NOT chatbot biasa
242
- **HF:** https://huggingface.co/deeprcurs/IKNN-Rl1-A1 β€” Published SUCCESS β€” YAML metadata fixed β€” Qwen-style layout
 
243
  **Timestamp:** 2026-09-03T20:00:00+07:00
 
21
  - avx512
22
  - iknn.cpp
23
  - tri-tier
24
+ - SatU1
25
+ - NoeSA
26
+ - Ntarra-DnA
27
  base_model: Qwen/Qwen3-27B
28
  model_type: iknn
29
  ---
 
34
  >
35
  > This repository contains the native runtime `iknn.cpp`, native format `.iknn` (magic `IKNN`), and a 150M-parameter prototype that validates the tri-tier architecture with real CPU measurements.
36
  >
37
+ > Organization: **deepRcurs Labs** β€” Repo: `deeprcurs/IKNN-Rl1-A1` β€” Model: `IKNN-Rl1-A1` β€” File: `IKNN-Rl1-A1-150M.iknn` β€” Format `.iknn` native β€” Runtime `iknn.cpp` β€” 8 kernels AVX2+AVX-512.
38
 
39
  As CPU inference becomes the bottleneck for agentic workloads, the question is not just how large we can scale, but how efficiently we can run on existing hardware. IKNN-Rl1-A1 addresses this with **tri-tier phase quantization** and a fully custom CPU runtime.
40
 
41
+ ![IKNN-Rl1-A1 Tri-Tier Architecture](docs/IKNN-Rl1-A1-architecture-dark.png)
42
+
43
+ *Figure: IKNN-Rl1-A1 Tri-Tier CPU-first LLM β€” MoE Router with PEP Entropy Gate, Tri-Tier Expert Computation (Tier1 SatU1 1-BIT 87%, Tier2 NoeSA-24 4.58-BIT 9%, Tier3 Ntarra-DnA 3.17-BIT 4%), RHT Randomized Hadamard Transform, PG-KVC Phase-Gated KV Cache 94% saving, ADLP Dual-Worker, CPU-Focused AVX2/AVX-512 β€” 150M Prototype, Design Target 19.5B*
44
 
45
  This is an early prototype of the architecture that will underpin larger IKNN models. It is built around a rethinking of how quantization, phase, and KV cache interact on CPU.
46
 
47
  ## Highlights
48
 
49
+ - **Tri-Tier Quantization:** SatU1 1-BIT (binary XNOR+popcount with AVX2/AVX-512 VPOPCNTDQ), NoeSA-24 4.58-BIT (13 values per 60-bit, LUT576, truncated Gaussian), Ntarra-DnA 3.17-BIT (9-state Direction Γ— Phase, shift+sign, no multiply). Each tier is mapped to different cognitive roles: throughput vs critical logic/code/math.
50
+ - **Native Format .iknn + Runtime iknn.cpp:** Organization deepRcurs Labs, repo `deeprcurs/IKNN-Rl1-A1`, model `IKNN-Rl1-A1`. Free naming β€” `iknn.cpp` loads `.iknn` (magic `IKNN`, arch `IKNN-Rl1-A1`). No GGUF dependency. GGUF artifact deleted per audit for clarity and branding. 8 kernels: `satu1_avx2/avx512`, `noesa24_avx2/avx512`, `ntarra_avx2/avx512`, `rht_avx2/avx512`.
51
  - **RHT Outlier Flattening:** Randomized Hadamard Transform spreads outlier energy (10 β†’ 5.07) while preserving L2 norm (11.3007, diff 9.5e-07). AVX2 matches scalar.
52
  - **PG-KVC Phase-Gated KV Cache:** 2-bit + 1-bit gating based on entropy, 94% saving (6.1MB β†’ 338KB) vs -80% target, 96% in full pipeline.
53
  - **PEP + ADLP:** Phase-Entropy Predictor two-stage (bigram cheap <0.5% + low-rank d_modelβ†’16β†’1, 100% accuracy) and Adaptive Dual Low-Precision dual-worker (fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS).
 
57
 
58
  ## Model Overview
59
 
60
+ - **Organization:** deepRcurs Labs
61
+ - **Repo:** `deeprcurs/IKNN-Rl1-A1`
62
+ - **Model:** `IKNN-Rl1-A1`
63
  - **Type:** Causal Language Model β€” CPU-first β€” Tri-Tier Phase Quantization
64
  - **Training Stage:** Prototype validation + Agentic training iteration 1 (NOT full 19.5B yet)
65
  - **Current Prototype (validated):**
66
  - Number of Parameters: 150M total (130.5M SatU1 87% + 13.5M NoeSA-24 9% + 6M Ntarra-DnA 4%), 34.5M active, 26MB memory
67
+ - File: `IKNN-Rl1-A1-150M.iknn` at root beside `iknn.cpp` β€” 42MB, 86 tensors, magic `IKNN`, arch `IKNN-Rl1-A1` β€” tidy, not scattered
68
  - Breakdown: SatU1 12.3MB (50 tensors), NoeSA-24 20.2MB (24 tensors), Ntarra-DnA 11.2MB (12 tensors)
69
  - Hidden Dimension: 768 (prototype), 3072 FFN, 12 layers, 12 heads, vocab 32000 (full config), 256/6/1024/1000 for fast training demo
70
  - Kernels: 8 β€” AVX2 for Ryzen5 5650U (Zen3, 6C DDR4 38GB/s, ID target 28-42/60-85 TPS) and AVX-512 for Xeon (2 vCPU, EN target 65-90/120-165 TPS estimated)
 
97
  | PG-KVC full pipeline | 1000 tokens 720Γ—1-bit 280Γ—2-bit 96% saved | KV cache | PASS |
98
  | PEP | Two-stage bigram <0.5% + low-rank d_modelβ†’16β†’1, 100/100 accuracy | Entropy predictor | PASS |
99
  | ADLP dual-worker | Fast 800 SatU1 + slow 200 NoeSA, 1e6 TPS | Dual worker | PASS |
100
+ | IKNN-Rl1-A1-150M.iknn | 42MB 86 tensors magic IKNN arch IKNN-Rl1-A1 at root beside iknn.cpp | Native format | PASS |
101
  | 150M matmul | 1000 tokens 176ms 5681 TPS on Xeon 2 vCPU | CPU | Real |
102
  | Full attention (prototype) | 20 tokens ~900ms TPS 21-22 PG-KVC 96% | CPU | Real β€” gibberish synthetic before agentic training |
103
  | Agentic training iter1 | Loss 7.08β†’0.41 val 6.59β†’0.50 grad stable 1.0, unique phases [0,3] then [0,2,4] | Logic/reasoning/coding/research/math/science | PASS β€” shows learning |
 
106
 
107
  ## Quickstart
108
 
109
+ ### Build iknn.cpp β€” Native Runtime β€” deepRcurs Labs β€” deeprcurs/IKNN-Rl1-A1
110
 
111
  ```bash
112
  # Clone
 
116
  # Build main runtime (AVX2 + AVX-512)
117
  g++ -mavx512f -mavx512bw -mavx512dq -mavx512vl -mavx512vbmi2 -mavx512vpopcntdq -mavx2 -O3 -pthread iknn.cpp -o iknn
118
 
119
+ # Write native .iknn model (42MB at root beside iknn.cpp β€” tidy)
120
  ./iknn --write-iknn
121
  # -> IKNN-Rl1-A1-150M.iknn 42MB 86 tensors magic IKNN arch IKNN-Rl1-A1
122
+ # Breakdown: SatU1 12.3MB 50 tensors, NoeSA-24 20.2MB 24 tensors, Ntarra-DnA 11.2MB 12 tensors
123
 
124
  # Run generation (synthetic weights β€” gibberish now, needs agentic training)
125
  ./iknn
 
129
  ### Kernels β€” AVX2 for Ryzen5 5650U, AVX-512 for Xeon
130
 
131
  ```bash
132
+ # Ntarra-DnA AVX2 β€” Ryzen5
133
  g++ -mavx2 -O3 -DNTARRA_AVX2_TEST kernels/ntarra_avx2.cpp -o /tmp/ntarra_avx2_test && /tmp/ntarra_avx2_test
134
+ # -> Pack 2x9 PASS, Compute 10/40/160/-40/0 PASS, Block 8x PASS
135
 
136
  # RHT AVX2 β€” Ryzen5
137
  g++ -mavx2 -O3 -DRHT_AVX2_TEST kernels/rht_avx2.cpp -o /tmp/rht_avx2_test && /tmp/rht_avx2_test
138
+ # -> Outlier 10->5.07 flattened, Norm 11.3007 preserved
139
 
140
  # SatU1 AVX-512 β€” Xeon
141
  g++ -mavx512f -O3 -DSATU1_AVX512_TEST kernels/satu1_avx512.cpp -o /tmp/satu1_test && /tmp/satu1_test
 
163
  # -> Model .cache/IKNN-Rl1-A1-150M-agentic.pt
164
  ```
165
 
166
+ ## File Layout β€” deepRcurs Labs β€” deeprcurs/IKNN-Rl1-A1 β€” Model at root beside iknn.cpp β€” tidy
167
 
168
  ```
169
+ deepRcurs Labs β€” deeprcurs/IKNN-Rl1-A1 β€” Model IKNN-Rl1-A1 β€” File IKNN-Rl1-A1-150M.iknn at root beside iknn.cpp β€” tidy
170
  β”œβ”€β”€ iknn.cpp # Main runtime β€” loads .iknn magic IKNN β€” AVX2/AVX-512 β€” OFFICIAL
171
+ β”œβ”€β”€ IKNN-Rl1-A1-150M.iknn # 42MB native model β€” 86 tensors β€” magic IKNN β€” arch IKNN-Rl1-A1 β€” OFFICIAL β€” beside iknn.cpp
172
+ β”œβ”€β”€ README.md # This file β€” professional β€” YAML metadata β€” no overclaim β€” Qwen-style layout β€” Organization deepRcurs Labs, Repo deeprcurs/IKNN-Rl1-A1
173
  β”œβ”€β”€ README_DEV_NOTES.md # Dev notes β€” old overclaim renamed to avoid overlap β€” NOT main
174
+ β”œβ”€β”€ docs/
175
+ β”‚ β”œβ”€β”€ IKNN_SPEC.md # Native .iknn spec β€” deepRcurs Labs β€” deeprcurs/IKNN-Rl1-A1
176
+ β”‚ β”œβ”€β”€ IKNN-Rl1-A1-architecture-dark.png # Architecture diagram dark BG β€” correct case SatU1 NoeSA DnA MoE
177
+ β”‚ └── IKNN-Rl1-A1-architecture.png # Light BG version
178
+ β”œβ”€β”€ benchmarks/ # Benchmarks JSON only β€” model moved to root beside iknn.cpp for tidiness
179
+ β”‚ β”œβ”€β”€ IKNN-Rl1-A1-agentic-dataset-sample-20260903.json
180
+ β”‚ β”œβ”€β”€ IKNN-Rl1-A1-agentic-training-20260903.json
181
+ β”‚ └── m1-full-avx2-avx512-20260903.json (8 kernels PASS)
182
  β”œβ”€β”€ kernels/ # 8 kernels β€” AVX2 + AVX-512 β€” M1 FULL PASS
183
  β”‚ β”œβ”€β”€ satu1_avx2.cpp / satu1_avx512.cpp
184
  β”‚ β”œβ”€β”€ noesa24_avx2.cpp / noesa24_avx512.cpp
185
  β”‚ β”œβ”€β”€ ntarra_avx2.cpp / ntarra_avx512.cpp # NEW per audit β€” Ryzen5
186
  β”‚ └── rht_avx2.cpp / rht_avx512.cpp # NEW per audit β€” Ryzen5
187
  β”œβ”€β”€ src/ # Prototype components β€” 150M, router, SIWF, etc.
 
 
188
  β”œβ”€β”€ scripts/
189
  β”‚ β”œβ”€β”€ generate_agentic_dataset.py # Agentic dataset β€” logic/reasoning/coding/research/math/science
190
  β”‚ β”œβ”€β”€ train_iknn_agentic.py # Train IKNN 150M mandiri β€” frontier LLM trains IKNN
191
+ β”‚ └── publish.sh # Publish to HF β€” org deepRcurs Labs β€” repo deeprcurs/IKNN-Rl1-A1 β€” .iknn only
192
  └── internal/ # PRIVATE β€” not published β€” 2.0MB β€” whitepaper drafts, ops, glossary
193
  ```
194
 
 
212
 
213
  ## Publishing
214
 
215
+ - **Organization:** deepRcurs Labs
216
+ - **Repo:** `deeprcurs/IKNN-Rl1-A1` β€” https://huggingface.co/deeprcurs/IKNN-Rl1-A1
217
+ - **Model:** `IKNN-Rl1-A1`
218
+ - **File:** `IKNN-Rl1-A1-150M.iknn` 42MB at root beside `iknn.cpp` β€” tidy β€” OFFICIAL β€” GGUF DELETED
219
+ - **Format:** `.iknn` native magic `IKNN` β€” NOT GGUF
220
+ - **Runtime:** `iknn.cpp`
221
+ - **README:** Professional with YAML frontmatter β€” fixes `YAML Metadata Warning: empty or missing yaml metadata` β€” Qwen-style layout with Highlights, Model Overview, Benchmarks, Quickstart
222
+ - **Image:** `docs/IKNN-Rl1-A1-architecture-dark.png` dark BG, correct case SatU1, NoeSA-24, Ntarra-DnA, MoE Router, PEP, RHT, PG-KVC, ADLP β€” real image, not placeholder
223
 
224
  ## License & Citation
225
 
 
228
  ```bibtex
229
  @misc{iknn-rl1-a1,
230
  title={IKNN-Rl1-A1: Integrated Knowledge-phase Neural Network β€” Recursive Language Iteration 1 β€” Architecture 1},
231
+ author={deepRcurs Labs},
232
+ organization={deepRcurs Labs},
233
  year={2026},
234
  url={https://huggingface.co/deeprcurs/IKNN-Rl1-A1},
235
+ note={150M prototype validates tri-tier quantization, 8 kernels AVX2+AVX-512, .iknn native format, iknn.cpp runtime, agentic training for researcher agent β€” Organization deepRcurs Labs, Repo deeprcurs/IKNN-Rl1-A1, Model IKNN-Rl1-A1, File IKNN-Rl1-A1-150M.iknn at root beside iknn.cpp}
236
  }
237
  ```
238
 
239
  ## Acknowledgments
240
 
241
+ - Qwen team for Qwen3.8-Flash-Next architecture and README layout inspiration (Highlights, Model Overview, Benchmarks, Quickstart)
242
+ - Organization deepRcurs Labs β€” Repo deeprcurs/IKNN-Rl1-A1 β€” Model IKNN-Rl1-A1
 
243
 
244
  ## Next
245
 
246
  - Iterate agentic training: more data (10k, 20k), longer training (500, 1000 steps), correction until truly answers correctly on logic/reasoning/coding/research/math/science
247
  - Full model training after 150M validated
248
+ - Publish primary `.iknn` + `iknn.cpp` β€” no GGUF β€” professional README with YAML metadata β€” Qwen-style layout β€” image dark BG correct case β€” Organization deepRcurs Labs, Repo deeprcurs/IKNN-Rl1-A1
249
 
250
  ---
251
+ **Organization:** deepRcurs Labs
252
+ **Repo:** deeprcurs/IKNN-Rl1-A1
253
  **Model:** IKNN-Rl1-A1
254
+ **File:** IKNN-Rl1-A1-150M.iknn at root beside iknn.cpp β€” tidy β€” 42MB β€” 86 tensors β€” magic IKNN β€” arch IKNN-Rl1-A1 β€” OFFICIAL
255
  **Format:** .iknn native β€” OFFICIAL β€” GGUF DELETED β€” Audit consistent
256
  **Kernels:** 8 β€” AVX2 + AVX-512 β€” M1 FULL PASS β€” ntarra_avx2 + rht_avx2 NEW per audit
257
  **Training:** Agentic 150M β€” 6000 examples logic/reasoning/coding/research/math/science β€” loss 7.08β†’0.41 β€” frontier LLM trains IKNN β€” NOT chatbot biasa
258
+ **Image:** docs/IKNN-Rl1-A1-architecture-dark.png β€” dark BG β€” correct case SatU1 NoeSA-24 Ntarra-DnA MoE Router PEP RHT PG-KVC ADLP β€” real image not placeholder
259
+ **HF:** https://huggingface.co/deeprcurs/IKNN-Rl1-A1 β€” Published SUCCESS β€” YAML metadata fixed β€” Qwen-style layout β€” Organization deepRcurs Labs
260
  **Timestamp:** 2026-09-03T20:00:00+07:00