dealignai commited on
Commit
eaacca1
·
verified ·
1 Parent(s): 8444e59

MiniMax M2.7 JANG_3L (3-bit, 89 GB)

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +118 -0
  2. config.json +104 -0
  3. configuration_minimax_m2.py +200 -0
  4. generation_config.json +9 -0
  5. jang_config.json +38 -0
  6. jangq-logo.png +0 -0
  7. merges.txt +0 -0
  8. mlx-studio-logo.png +0 -0
  9. model-00001-of-00126.safetensors +3 -0
  10. model-00002-of-00126.safetensors +3 -0
  11. model-00003-of-00126.safetensors +3 -0
  12. model-00004-of-00126.safetensors +3 -0
  13. model-00005-of-00126.safetensors +3 -0
  14. model-00006-of-00126.safetensors +3 -0
  15. model-00007-of-00126.safetensors +3 -0
  16. model-00008-of-00126.safetensors +3 -0
  17. model-00009-of-00126.safetensors +3 -0
  18. model-00010-of-00126.safetensors +3 -0
  19. model-00011-of-00126.safetensors +3 -0
  20. model-00012-of-00126.safetensors +3 -0
  21. model-00013-of-00126.safetensors +3 -0
  22. model-00014-of-00126.safetensors +3 -0
  23. model-00015-of-00126.safetensors +3 -0
  24. model-00016-of-00126.safetensors +3 -0
  25. model-00017-of-00126.safetensors +3 -0
  26. model-00018-of-00126.safetensors +3 -0
  27. model-00019-of-00126.safetensors +3 -0
  28. model-00020-of-00126.safetensors +3 -0
  29. model-00021-of-00126.safetensors +3 -0
  30. model-00022-of-00126.safetensors +3 -0
  31. model-00023-of-00126.safetensors +3 -0
  32. model-00024-of-00126.safetensors +3 -0
  33. model-00025-of-00126.safetensors +3 -0
  34. model-00026-of-00126.safetensors +3 -0
  35. model-00027-of-00126.safetensors +3 -0
  36. model-00028-of-00126.safetensors +3 -0
  37. model-00029-of-00126.safetensors +3 -0
  38. model-00030-of-00126.safetensors +3 -0
  39. model-00031-of-00126.safetensors +3 -0
  40. model-00032-of-00126.safetensors +3 -0
  41. model-00033-of-00126.safetensors +3 -0
  42. model-00034-of-00126.safetensors +3 -0
  43. model-00035-of-00126.safetensors +3 -0
  44. model-00036-of-00126.safetensors +3 -0
  45. model-00037-of-00126.safetensors +3 -0
  46. model-00038-of-00126.safetensors +3 -0
  47. model-00039-of-00126.safetensors +3 -0
  48. model-00040-of-00126.safetensors +3 -0
  49. model-00041-of-00126.safetensors +3 -0
  50. model-00042-of-00126.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,118 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: minimax-open
4
+ library_name: mlx
5
+ tags:
6
+ - mlx
7
+ - jang
8
+ - minimax
9
+ - moe
10
+ - apple-silicon
11
+ pipeline_tag: text-generation
12
+ ---
13
+
14
+ <p align="center">
15
+ <img src="mlx-studio-logo.png" alt="MLX Studio" width="400"/>
16
+ </p>
17
+
18
+ <p align="center">
19
+ <img src="jangq-logo.png" alt="JANGQ" width="200"/>
20
+ </p>
21
+
22
+ <div align="center">
23
+
24
+ # MiniMax-M2.7 JANG_3L
25
+
26
+ **MiniMax M2.7 456B MoE — 3-bit mixed precision, 89 GB**
27
+
28
+ Best balance of quality and size for Apple Silicon. Fits on 128 GB+ Macs.
29
+ </div>
30
+
31
+ > **Recommended: Run in [MLX Studio](https://mlxstudio.com)** for best experience including thinking mode support and optimized MoE inference.
32
+
33
+ ## Important Settings
34
+
35
+ MiniMax M2.7 requires specific inference settings:
36
+
37
+ | Setting | Value | Notes |
38
+ |---------|-------|-------|
39
+ | Temperature | **1.0** | REQUIRED — greedy/temp=0 causes infinite thinking loops |
40
+ | Top P | 0.95 | |
41
+ | Top K | 40 | |
42
+ | Repetition Penalty | 1.1 | Optional, helps prevent loops |
43
+
44
+ ## Model Details
45
+
46
+ | Metric | Value |
47
+ |--------|-------|
48
+ | Source | `MiniMaxAI/MiniMax-M2.7` (FP8 E4M3) |
49
+ | Architecture | MoE (256 experts, top-8 active), GQA, partial RoPE |
50
+ | Profile | JANG_3L (CRITICAL=8-bit, IMPORTANT=4-bit, COMPRESS=3-bit) |
51
+ | Actual avg bits | 3.08 |
52
+ | Model size | 89 GB |
53
+ | Parameters | 456B total, ~46B active per token |
54
+ | Format | JANG v2 (MLX-native safetensors, instant load) |
55
+ | group_size | 128 (speed-optimized for 256 experts) |
56
+ | Routing | Sigmoid + bias correction |
57
+ | Context | 192K tokens |
58
+
59
+ ## JANG_3L Bit Allocation
60
+
61
+ | Tier | Components | Bits |
62
+ |------|-----------|------|
63
+ | CRITICAL | Attention (Q/K/V/O), lm_head | 8 |
64
+ | IMPORTANT | Embeddings | 4 |
65
+ | COMPRESS | Expert MLP (w1/w2/w3) — 98.2% of params | 3 |
66
+ | Passthrough | MoE router/gate (float16), norms | 16 |
67
+
68
+ ## MMLU Benchmarks
69
+
70
+ *Coming soon — benchmarks will be added after all profiles are converted and tested.*
71
+
72
+ ## Why JANG
73
+
74
+ Standard MLX quantization on MiniMax M2.5 produced **completely broken output at ALL bit levels** (~25% MMLU = random guessing). JANG's mixed-precision approach is the **only working quantized MiniMax on Apple Silicon**, achieving 74% MMLU on M2.5. M2.7 results pending.
75
+
76
+ ## Other Quantizations
77
+
78
+ | Model | Profile | Size | Avg Bits | Status |
79
+ |-------|---------|------|----------|--------|
80
+ | JANG_2L | (8, 6, 2) | 63 GB | 2.10 | Ready |
81
+ | **JANG_3L** (this) | **(8, 4, 3)** | **89 GB** | **3.08** | **Ready** |
82
+ | JANG_4M | (8, 4, 4) | ~120 GB | ~4.1 | Converting |
83
+
84
+ ## Requirements
85
+
86
+ - Apple Silicon Mac with 128+ GB unified memory
87
+ - MLX framework
88
+ - [MLX Studio](https://mlxstudio.com) recommended
89
+
90
+ ## Usage
91
+
92
+ ```python
93
+ from jang_tools.loader import load_jang_model
94
+ from mlx_lm import generate
95
+ from mlx_lm.sample_utils import make_sampler
96
+
97
+ model, tokenizer = load_jang_model("JANGQ-AI/MiniMax-M2.7-JANG_3L")
98
+ sampler = make_sampler(temp=1.0, top_p=0.95)
99
+
100
+ prompt = tokenizer.apply_chat_template(
101
+ [{"role": "user", "content": "What is photosynthesis?"}],
102
+ tokenize=False, add_generation_prompt=True
103
+ )
104
+ output = generate(model, tokenizer, prompt=prompt, max_tokens=500, sampler=sampler)
105
+ print(output)
106
+ ```
107
+
108
+ ---
109
+
110
+ ## Support
111
+
112
+ [MLX Studio](https://mlxstudio.com) | [JANGQ](https://jangq.ai) | [X @dealignai](https://x.com/dealignai)
113
+
114
+ Quantized by Jinho Jang (eric@jangq.ai) using JANG Tools v2.4.1.
115
+
116
+ ---
117
+
118
+ *This model is provided for research and personal use. Users are responsible for ensuring their use complies with applicable laws and the MiniMax license.*
config.json ADDED
@@ -0,0 +1,104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "MiniMaxM2ForCausalLM"
4
+ ],
5
+ "attn_type_list": [
6
+ 1,
7
+ 1,
8
+ 1,
9
+ 1,
10
+ 1,
11
+ 1,
12
+ 1,
13
+ 1,
14
+ 1,
15
+ 1,
16
+ 1,
17
+ 1,
18
+ 1,
19
+ 1,
20
+ 1,
21
+ 1,
22
+ 1,
23
+ 1,
24
+ 1,
25
+ 1,
26
+ 1,
27
+ 1,
28
+ 1,
29
+ 1,
30
+ 1,
31
+ 1,
32
+ 1,
33
+ 1,
34
+ 1,
35
+ 1,
36
+ 1,
37
+ 1,
38
+ 1,
39
+ 1,
40
+ 1,
41
+ 1,
42
+ 1,
43
+ 1,
44
+ 1,
45
+ 1,
46
+ 1,
47
+ 1,
48
+ 1,
49
+ 1,
50
+ 1,
51
+ 1,
52
+ 1,
53
+ 1,
54
+ 1,
55
+ 1,
56
+ 1,
57
+ 1,
58
+ 1,
59
+ 1,
60
+ 1,
61
+ 1,
62
+ 1,
63
+ 1,
64
+ 1,
65
+ 1,
66
+ 1,
67
+ 1
68
+ ],
69
+ "auto_map": {
70
+ "AutoConfig": "configuration_minimax_m2.MiniMaxM2Config",
71
+ "AutoModelForCausalLM": "modeling_minimax_m2.MiniMaxM2ForCausalLM"
72
+ },
73
+ "dtype": "bfloat16",
74
+ "head_dim": 128,
75
+ "hidden_act": "silu",
76
+ "hidden_size": 3072,
77
+ "intermediate_size": 1536,
78
+ "max_position_embeddings": 196608,
79
+ "model_type": "minimax_m2",
80
+ "mtp_transformer_layers": 1,
81
+ "num_attention_heads": 48,
82
+ "num_experts_per_tok": 8,
83
+ "num_hidden_layers": 62,
84
+ "num_key_value_heads": 8,
85
+ "num_local_experts": 256,
86
+ "num_mtp_modules": 3,
87
+ "qk_norm_type": "per_layer",
88
+ "rms_norm_eps": 1e-06,
89
+ "rope_theta": 5000000,
90
+ "rotary_dim": 64,
91
+ "scoring_func": "sigmoid",
92
+ "shared_intermediate_size": 0,
93
+ "tie_word_embeddings": false,
94
+ "transformers_version": "4.46.1",
95
+ "use_cache": true,
96
+ "use_mtp": true,
97
+ "use_qk_norm": true,
98
+ "use_routing_bias": true,
99
+ "vocab_size": 200064,
100
+ "quantization": {
101
+ "group_size": 128,
102
+ "bits": 3
103
+ }
104
+ }
configuration_minimax_m2.py ADDED
@@ -0,0 +1,200 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # 🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨
2
+ # This file was automatically generated from src/transformers/models/minimax_m2/modular_minimax_m2.py.
3
+ # Do NOT edit this file manually as any edits will be overwritten by the generation of
4
+ # the file from the modular. If any change should be done, please apply the change to the
5
+ # modular_minimax_m2.py file directly. One of our CI enforces this.
6
+ # 🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨🚨
7
+ # coding=utf-8
8
+ # Copyright 2025 the HuggingFace Team. All rights reserved.
9
+ #
10
+ # Licensed under the Apache License, Version 2.0 (the "License");
11
+ # you may not use this file except in compliance with the License.
12
+ # You may obtain a copy of the License at
13
+ #
14
+ # http://www.apache.org/licenses/LICENSE-2.0
15
+ #
16
+ # Unless required by applicable law or agreed to in writing, software
17
+ # distributed under the License is distributed on an "AS IS" BASIS,
18
+ # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
19
+ # See the License for the specific language governing permissions and
20
+ # limitations under the License.
21
+
22
+
23
+ from transformers.configuration_utils import PretrainedConfig
24
+
25
+
26
+ class MiniMaxM2Config(PretrainedConfig):
27
+ r"""
28
+ This is the configuration class to store the configuration of a [`MiniMaxM2Model`]. It is used to instantiate an
29
+ MiniMaxM2 model according to the specified arguments, defining the model architecture. Instantiating a configuration
30
+ with the defaults will yield a similar configuration to that of the MiniMaxM2-7B-v0.1 or MiniMaxM2-7B-Instruct-v0.1.
31
+
32
+ [minimax_m2ai/MiniMaxM2-8x7B](https://huggingface.co/minimax_m2ai/MiniMaxM2-8x7B)
33
+ [minimax_m2ai/MiniMaxM2-7B-Instruct-v0.1](https://huggingface.co/minimax_m2ai/MiniMaxM2-7B-Instruct-v0.1)
34
+
35
+ Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the
36
+ documentation from [`PretrainedConfig`] for more information.
37
+
38
+
39
+ Args:
40
+ vocab_size (`int`, *optional*, defaults to 32000):
41
+ Vocabulary size of the MiniMaxM2 model. Defines the number of different tokens that can be represented by the
42
+ `inputs_ids` passed when calling [`MiniMaxM2Model`]
43
+ hidden_size (`int`, *optional*, defaults to 4096):
44
+ Dimension of the hidden representations.
45
+ intermediate_size (`int`, *optional*, defaults to 14336):
46
+ Dimension of the MLP representations.
47
+ num_hidden_layers (`int`, *optional*, defaults to 32):
48
+ Number of hidden layers in the Transformer encoder.
49
+ num_attention_heads (`int`, *optional*, defaults to 32):
50
+ Number of attention heads for each attention layer in the Transformer encoder.
51
+ num_key_value_heads (`int`, *optional*, defaults to 8):
52
+ This is the number of key_value heads that should be used to implement Grouped Query Attention. If
53
+ `num_key_value_heads=num_attention_heads`, the model will use Multi Head Attention (MHA), if
54
+ `num_key_value_heads=1` the model will use Multi Query Attention (MQA) otherwise GQA is used. When
55
+ converting a multi-head checkpoint to a GQA checkpoint, each group key and value head should be constructed
56
+ by meanpooling all the original heads within that group. For more details, check out [this
57
+ paper](https://huggingface.co/papers/2305.13245). If it is not specified, will default to `8`.
58
+ head_dim (`int`, *optional*, defaults to `hidden_size // num_attention_heads`):
59
+ The attention head dimension.
60
+ hidden_act (`str` or `function`, *optional*, defaults to `"silu"`):
61
+ The non-linear activation function (function or string) in the decoder.
62
+ max_position_embeddings (`int`, *optional*, defaults to `4096*32`):
63
+ The maximum sequence length that this model might ever be used with. MiniMaxM2's sliding window attention
64
+ allows sequence of up to 4096*32 tokens.
65
+ initializer_range (`float`, *optional*, defaults to 0.02):
66
+ The standard deviation of the truncated_normal_initializer for initializing all weight matrices.
67
+ rms_norm_eps (`float`, *optional*, defaults to 1e-05):
68
+ The epsilon used by the rms normalization layers.
69
+ use_cache (`bool`, *optional*, defaults to `True`):
70
+ Whether or not the model should return the last key/values attentions (not used by all models). Only
71
+ relevant if `config.is_decoder=True`.
72
+ pad_token_id (`int`, *optional*):
73
+ The id of the padding token.
74
+ bos_token_id (`int`, *optional*, defaults to 1):
75
+ The id of the "beginning-of-sequence" token.
76
+ eos_token_id (`int`, *optional*, defaults to 2):
77
+ The id of the "end-of-sequence" token.
78
+ tie_word_embeddings (`bool`, *optional*, defaults to `False`):
79
+ Whether the model's input and output word embeddings should be tied.
80
+ rope_theta (`float`, *optional*, defaults to 1000000.0):
81
+ The base period of the RoPE embeddings.
82
+ sliding_window (`int`, *optional*):
83
+ Sliding window attention window size. If not specified, will default to `4096`.
84
+ attention_dropout (`float`, *optional*, defaults to 0.0):
85
+ The dropout ratio for the attention probabilities.
86
+ num_experts_per_tok (`int`, *optional*, defaults to 2):
87
+ The number of experts to route per-token, can be also interpreted as the `top-k` routing
88
+ parameter
89
+ num_local_experts (`int`, *optional*, defaults to 8):
90
+ Number of experts per Sparse MLP layer.
91
+ output_router_logits (`bool`, *optional*, defaults to `False`):
92
+ Whether or not the router logits should be returned by the model. Enabling this will also
93
+ allow the model to output the auxiliary loss. See [here]() for more details
94
+ router_aux_loss_coef (`float`, *optional*, defaults to 0.001):
95
+ The aux loss factor for the total loss.
96
+ router_jitter_noise (`float`, *optional*, defaults to 0.0):
97
+ Amount of noise to add to the router.
98
+
99
+ ```python
100
+ >>> from transformers import MiniMaxM2Model, MiniMaxM2Config
101
+
102
+ >>> # Initializing a MiniMaxM2 7B style configuration
103
+ >>> configuration = MiniMaxM2Config()
104
+
105
+ >>> # Initializing a model from the MiniMaxM2 7B style configuration
106
+ >>> model = MiniMaxM2Model(configuration)
107
+
108
+ >>> # Accessing the model configuration
109
+ >>> configuration = model.config
110
+ ```"""
111
+
112
+ model_type = "minimax_m2"
113
+ keys_to_ignore_at_inference = ["past_key_values"]
114
+ base_model_tp_plan = {
115
+ "layers.*.self_attn.q_proj": "colwise",
116
+ "layers.*.self_attn.k_proj": "colwise",
117
+ "layers.*.self_attn.v_proj": "colwise",
118
+ "layers.*.self_attn.o_proj": "rowwise",
119
+ "layers.*.block_sparse_moe.gate": "colwise_rep", # we need to replicate here to correctly route experts
120
+ "layers.*.block_sparse_moe.experts.*.w1": "colwise",
121
+ "layers.*.block_sparse_moe.experts.*.w2": "rowwise",
122
+ "layers.*.block_sparse_moe.experts.*.w3": "colwise",
123
+ }
124
+ base_model_pp_plan = {
125
+ "embed_tokens": (["input_ids"], ["inputs_embeds"]),
126
+ "layers": (["hidden_states", "attention_mask"], ["hidden_states"]),
127
+ "norm": (["hidden_states"], ["hidden_states"]),
128
+ }
129
+
130
+ def __init__(
131
+ self,
132
+ vocab_size=32000,
133
+ hidden_size=4096,
134
+ intermediate_size=14336,
135
+ num_hidden_layers=32,
136
+ num_attention_heads=32,
137
+ num_key_value_heads=8,
138
+ head_dim=None,
139
+ hidden_act="silu",
140
+ max_position_embeddings=4096 * 32,
141
+ initializer_range=0.02,
142
+ rms_norm_eps=1e-5,
143
+ use_cache=True,
144
+ pad_token_id=None,
145
+ bos_token_id=1,
146
+ eos_token_id=2,
147
+ tie_word_embeddings=False,
148
+ rope_theta=1e6,
149
+ sliding_window=None,
150
+ attention_dropout=0.0,
151
+ num_experts_per_tok=2,
152
+ num_local_experts=8,
153
+ output_router_logits=False,
154
+ router_aux_loss_coef=0.001,
155
+ router_jitter_noise=0.0,
156
+ **kwargs,
157
+ ):
158
+ self.vocab_size = vocab_size
159
+ self.max_position_embeddings = max_position_embeddings
160
+ self.hidden_size = hidden_size
161
+ self.intermediate_size = intermediate_size
162
+ self.num_hidden_layers = num_hidden_layers
163
+ self.num_attention_heads = num_attention_heads
164
+ self.sliding_window = sliding_window
165
+
166
+ # for backward compatibility
167
+ if num_key_value_heads is None:
168
+ num_key_value_heads = num_attention_heads
169
+
170
+ self.num_key_value_heads = num_key_value_heads
171
+ self.hidden_act = hidden_act
172
+ self.initializer_range = initializer_range
173
+ self.rms_norm_eps = rms_norm_eps
174
+ self.use_cache = use_cache
175
+ self.rope_theta = rope_theta
176
+ self.attention_dropout = attention_dropout
177
+ self.head_dim = head_dim
178
+
179
+ self.num_experts_per_tok = num_experts_per_tok
180
+ self.num_local_experts = num_local_experts
181
+ self.output_router_logits = output_router_logits
182
+ self.router_aux_loss_coef = router_aux_loss_coef
183
+ self.router_jitter_noise = router_jitter_noise
184
+
185
+ self.use_qk_norm = kwargs.pop("use_qk_norm", False)
186
+ self.rotary_dim = kwargs.pop("rotary_dim", self.head_dim)
187
+ self.partial_rotary_factor = kwargs.pop("partial_rotary_factor", 1)
188
+ if self.head_dim is not None:
189
+ self.partial_rotary_factor = self.rotary_dim / self.head_dim
190
+
191
+ super().__init__(
192
+ pad_token_id=pad_token_id,
193
+ bos_token_id=bos_token_id,
194
+ eos_token_id=eos_token_id,
195
+ tie_word_embeddings=tie_word_embeddings,
196
+ **kwargs,
197
+ )
198
+
199
+
200
+ __all__ = ["MiniMaxM2Config"]
generation_config.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 200019,
3
+ "do_sample": true,
4
+ "eos_token_id": 200020,
5
+ "temperature": 1.0,
6
+ "top_p": 0.95,
7
+ "top_k": 40,
8
+ "transformers_version": "4.46.1"
9
+ }
jang_config.json ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "quantization": {
3
+ "method": "jang-importance",
4
+ "profile": "JANG_3L",
5
+ "target_bits": 3.0,
6
+ "actual_bits": 3.08,
7
+ "block_size": 128,
8
+ "calibration_method": "weights",
9
+ "quantization_method": "mse",
10
+ "scoring_method": "weight-magnitude",
11
+ "bit_widths_used": [
12
+ 3,
13
+ 4,
14
+ 8
15
+ ],
16
+ "quantization_scheme": "asymmetric",
17
+ "quantization_backend": "mx.quantize",
18
+ "hadamard_rotation": false
19
+ },
20
+ "source_model": {
21
+ "name": "MiniMax-M2.7-FP8",
22
+ "dtype": "bfloat16",
23
+ "parameters": "227.6B"
24
+ },
25
+ "architecture": {
26
+ "type": "moe",
27
+ "attention": "gqa",
28
+ "has_vision": false,
29
+ "has_ssm": false,
30
+ "has_moe": true
31
+ },
32
+ "runtime": {
33
+ "total_weight_bytes": 0,
34
+ "total_weight_gb": 0.0
35
+ },
36
+ "format": "jang",
37
+ "format_version": "2.0"
38
+ }
jangq-logo.png ADDED
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
mlx-studio-logo.png ADDED
model-00001-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49515fae5e40708be7591eaec7458c7b5b7c249baf3d61f193bac23a53f77ef8
3
+ size 817238768
model-00002-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:252e2349d0ab5c43a2653d355708f56f25a755d67a3a4a96d32db615143ae98e
3
+ size 532907440
model-00003-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fdcf2d5ae8eb8b5f2df65b3cb27323271beebc82737f9e28f0c8f48528baa95
3
+ size 984712368
model-00004-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89d4bcb83169973b7b47a237a0232808088b5058c91e4f8aa01fb05e5ce87e3d
3
+ size 532907440
model-00005-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c69ba92c4de18857ef2540f927f2d5cdac7cc65355b2d6e1898d55b962e166f4
3
+ size 984712368
model-00006-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56cb008f4ac651d855b8a42741e36768389cda20de2ac5da66e46cf6a93aaf51
3
+ size 532907440
model-00007-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ca33e6b7fecbcc426ce879048a9c38194e83f15b44a2e331994d4404682df55
3
+ size 984712368
model-00008-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a55a0c435162a9e19ac25520dcc1f5fea6488e9e77731730cdd490319527002d
3
+ size 532907440
model-00009-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2af9f9c8fa8101033fcb2f1cb2acc0d36cd77c8ba6623ee893104cbb1d3ef5b7
3
+ size 984712368
model-00010-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1317860731583f8a0c61a3118528ea95b2f7ed337c9eb2218c9eab4a3371402
3
+ size 532907440
model-00011-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49f4994d9b3741c3092c084eacc88621afb4c970aa9a71224099e3a53e58426e
3
+ size 984712368
model-00012-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c3e5118af51f351304d348ae57d216acb9a593534bcd6652e7c59d7cc8a4cb7
3
+ size 532907440
model-00013-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55189b47901e7a1dc8cd2df359aaa413238cd042b4052ae5bcb9284fdc7e763a
3
+ size 984712368
model-00014-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c65ef09c70e285c1e851c929eb28d9d49acd359f9a067cfa7c5711aa590d6993
3
+ size 532907440
model-00015-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88ccea5edfa2e777023e9da10115c04e021e87f39acc716cfa3f271836d3b8fe
3
+ size 984712368
model-00016-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:956818a18f144970a8dcf9bd60da5054e90cde395030dee28bc04f965e0408aa
3
+ size 532907440
model-00017-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:738866360548333410864b8220df98d28241ba9668d0bc9ee713dbe763ca94c4
3
+ size 984712368
model-00018-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6f31225f229164cead281e09c21c81a1a89cbcdfa8a26d997de8cb38c4c7f43
3
+ size 532907440
model-00019-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9f658342d8681e702039ae55c8db9d09339c4c29782bea7d44c3b5ff37a1ad7
3
+ size 984712368
model-00020-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1767dc8bb870e117f24e45db391eede335a3ef1d95657a088627ace44224fda
3
+ size 532907440
model-00021-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bae4b6f4c61953118eb84a577bcf3df7f982fe1032b5688b5d02bcf2f7b6ef99
3
+ size 984712368
model-00022-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:745ff23176935e747af3f084290702d958b6ae332623a398d2ae9bacc2012630
3
+ size 532907448
model-00023-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67b3249f2cfe2199aaca1b4a444668fd9af31e61d9166c0e7514a1a1b7554774
3
+ size 984712376
model-00024-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb1a64a83beda4de98c45adba37f55903a73fbd1770f9865ea307b1078ad0361
3
+ size 532907448
model-00025-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a70da93d642db6295b7938f3380ad7eefca56a6f7130fe25302f6f1b65f711b8
3
+ size 984712376
model-00026-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d0cf7fd5d4a85547cc01873887dd05741e70305131e5e29d8acecf0ce603cfb
3
+ size 532907448
model-00027-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96590811020cf2a555b1bc0bc852469212b302b5df13359f69f5e3a2af9fd259
3
+ size 984712376
model-00028-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5f51d985eee65d51249dc6ef273fd9ccd0026b985232e1d524ed44e57ba5cab
3
+ size 532907448
model-00029-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8504fb71b90302823a3a65c0b84df42e63a848c3c1de1cef8f5866e0533af271
3
+ size 984712376
model-00030-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:beca0b77078936162991fe375714746cdf97469ebc31d96d06c878b10a89cad0
3
+ size 532907448
model-00031-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e38f0fe6a97d149e0570439d494c51897c6c535a11a37d51e8eed5f7e6d728f
3
+ size 984712376
model-00032-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06bb2fe4ad3936f7b33d4d7c4dda5de59dafc7066240f74a10072f921fa40a8f
3
+ size 532907448
model-00033-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6842408896427b8a5d4d5f30501c2e3a6a8a4dfdb5f05969686f7ecd0059c5a7
3
+ size 984712376
model-00034-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52bf4e8d85f6570b0910d15cd36d7b13a61db35bd143330165cb55edec776e89
3
+ size 532907448
model-00035-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3609e895fba2be837968c81f32cd84381d95d9462eba235b248adfa3009ea9f
3
+ size 984712376
model-00036-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7dee727db7b64a4a3cddff858f3666810e6b190eb567c1b9beba5af08106455
3
+ size 532907448
model-00037-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4de33ea7d595cd4b4b99f7b57f3d883ff846db0d44888e301c9bc4ec71138698
3
+ size 984712376
model-00038-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:203ee3438a29bb08a84c01d745329695e6577724dbbe76a1c34be246eb0316e6
3
+ size 532907448
model-00039-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b83d07a78ccb9198a4c86a888b85fce0554606ac3614562c6c6b10a60310b8c2
3
+ size 984712376
model-00040-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4615bb6ba5f80d7ef5a9770a2289e96749dd5c072f8dbca8f54b5ebc43a58817
3
+ size 532907448
model-00041-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97656ad18f594b979ddb2146f46848c27f73f9815a9dc23efb26d9f5ffd1b3c5
3
+ size 984712376
model-00042-of-00126.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4cf662abbe2e395c3f6ef4a5c0e90899fc3eafce60af3f20d513f5e0badefba
3
+ size 532907448