openvino-ci commited on
Commit
a305f62
·
verified ·
1 Parent(s): 86cb5da

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  license: other
3
  license_name: lfm1.0
4
- license_link: https://huggingface.co/LiquidAI/LFM2.5-350M/blob/main/LICENSE
5
  base_model:
6
  - LiquidAI/LFM2.5-350M
7
  base_model_relation: quantized
@@ -14,8 +14,10 @@ language:
14
  - ja
15
  - ko
16
  - es
 
17
  pipeline_tag: text-generation
18
  tags:
 
19
  - liquid
20
  - lfm2.5
21
  - edge
@@ -27,9 +29,6 @@ library_name: openvino
27
  * Model creator: [LiquidAI](https://huggingface.co/LiquidAI)
28
  * Original model: [LFM2.5-350M](https://huggingface.co/LiquidAI/LFM2.5-350M)
29
 
30
- > **EXPERIMENTAL MODEL**
31
- > This model has not been fully validated with OpenVINO. It may be fully supported and validated in the future.
32
-
33
  ## Description
34
 
35
  This is [LFM2.5-350M](https://huggingface.co/LiquidAI/LFM2.5-350M) model converted to the [OpenVINO™ IR](https://docs.openvino.ai/2026/documentation/openvino-ir-format.html) (Intermediate Representation) format with weights compressed to INT8 by [NNCF](https://github.com/openvinotoolkit/nncf).
@@ -47,15 +46,15 @@ For more information on quantization, check the [OpenVINO model optimization gui
47
 
48
  The provided OpenVINO™ IR model is compatible with:
49
 
50
- * OpenVINO version 2026.1.0 and higher
51
- * Optimum Intel 1.27.0 and higher
52
 
53
  ## Running Model Inference with [Optimum Intel](https://huggingface.co/docs/optimum/intel/index)
54
 
55
  1. Install packages required for using [Optimum Intel](https://huggingface.co/docs/optimum/intel/index) integration with the OpenVINO backend:
56
 
57
  ```
58
- pip install optimum[openvino]
59
  ```
60
 
61
  2. Run model inference:
@@ -69,9 +68,8 @@ tokenizer = AutoTokenizer.from_pretrained(model_id)
69
  model = OVModelForCausalLM.from_pretrained(model_id)
70
 
71
  inputs = tokenizer("What is a capital of France?", return_tensors="pt")
72
- inputs.pop("token_type_ids", None)
73
 
74
- outputs = model.generate(**inputs, max_length=200)
75
  text = tokenizer.batch_decode(outputs)[0]
76
  print(text)
77
  ```
@@ -103,17 +101,15 @@ hf_hub.snapshot_download(model_id, local_dir=model_path)
103
  import openvino_genai as ov_genai
104
 
105
  device = "CPU"
106
- pipeline_config = {"ATTENTION_BACKEND": "SDPA"}
107
- pipe = ov_genai.LLMPipeline(model_path, device, **pipeline_config)
108
- print(pipe.generate("What is a capital of France?", max_length=200))
109
  ```
110
 
111
  More GenAI usage examples can be found in OpenVINO GenAI library [docs](https://docs.openvino.ai/2026/openvino-workflow-generative/inference-with-genai.html) and [samples](https://github.com/openvinotoolkit/openvino.genai?tab=readme-ov-file#openvino-genai-samples)
112
 
113
  You can find more detailed usage examples in OpenVINO Notebooks:
114
 
115
- - [LLM](https://openvinotoolkit.github.io/openvino_notebooks/?search=LLM)
116
- - [RAG text generation](https://openvinotoolkit.github.io/openvino_notebooks/?search=RAG+system&tasks=Text+Generation)
117
 
118
  ## Limitations
119
 
@@ -121,7 +117,7 @@ Check the original [model card](https://huggingface.co/LiquidAI/LFM2.5-350M) for
121
 
122
  ## Legal information
123
 
124
- The original model is distributed under [lfm1.0](https://huggingface.co/LiquidAI/LFM2.5-350M/blob/main/LICENSE) license. More details can be found in [LFM2.5-350M](https://huggingface.co/LiquidAI/LFM2.5-350M).
125
 
126
  ## Disclaimer
127
 
 
1
  ---
2
  license: other
3
  license_name: lfm1.0
4
+ license_link: LICENSE
5
  base_model:
6
  - LiquidAI/LFM2.5-350M
7
  base_model_relation: quantized
 
14
  - ja
15
  - ko
16
  - es
17
+ - pt
18
  pipeline_tag: text-generation
19
  tags:
20
+ - openvino
21
  - liquid
22
  - lfm2.5
23
  - edge
 
29
  * Model creator: [LiquidAI](https://huggingface.co/LiquidAI)
30
  * Original model: [LFM2.5-350M](https://huggingface.co/LiquidAI/LFM2.5-350M)
31
 
 
 
 
32
  ## Description
33
 
34
  This is [LFM2.5-350M](https://huggingface.co/LiquidAI/LFM2.5-350M) model converted to the [OpenVINO™ IR](https://docs.openvino.ai/2026/documentation/openvino-ir-format.html) (Intermediate Representation) format with weights compressed to INT8 by [NNCF](https://github.com/openvinotoolkit/nncf).
 
46
 
47
  The provided OpenVINO™ IR model is compatible with:
48
 
49
+ * OpenVINO version 2026.3.0 and higher
50
+ * Optimum Intel built from the `main` branch
51
 
52
  ## Running Model Inference with [Optimum Intel](https://huggingface.co/docs/optimum/intel/index)
53
 
54
  1. Install packages required for using [Optimum Intel](https://huggingface.co/docs/optimum/intel/index) integration with the OpenVINO backend:
55
 
56
  ```
57
+ pip install -U optimum[openvino] transformers==5.2.0 --extra-index-url https://download.pytorch.org/whl/cpu
58
  ```
59
 
60
  2. Run model inference:
 
68
  model = OVModelForCausalLM.from_pretrained(model_id)
69
 
70
  inputs = tokenizer("What is a capital of France?", return_tensors="pt")
 
71
 
72
+ outputs = model.generate(**inputs, max_new_tokens=200)
73
  text = tokenizer.batch_decode(outputs)[0]
74
  print(text)
75
  ```
 
101
  import openvino_genai as ov_genai
102
 
103
  device = "CPU"
104
+ pipe = ov_genai.LLMPipeline(model_path, device)
105
+ print(pipe.generate("What is a capital of France?", max_new_tokens=200))
 
106
  ```
107
 
108
  More GenAI usage examples can be found in OpenVINO GenAI library [docs](https://docs.openvino.ai/2026/openvino-workflow-generative/inference-with-genai.html) and [samples](https://github.com/openvinotoolkit/openvino.genai?tab=readme-ov-file#openvino-genai-samples)
109
 
110
  You can find more detailed usage examples in OpenVINO Notebooks:
111
 
112
+ - [LFM2.5-350M](https://openvinotoolkit.github.io/openvino_notebooks/?search=LFM2.5-350M)
 
113
 
114
  ## Limitations
115
 
 
117
 
118
  ## Legal information
119
 
120
+ The original model is distributed under [lfm1.0](LICENSE) license. More details can be found in [LFM2.5-350M](https://huggingface.co/LiquidAI/LFM2.5-350M).
121
 
122
  ## Disclaimer
123
 
chat_template.jinja CHANGED
@@ -1,16 +1,61 @@
1
  {{- bos_token -}}
2
- {%- set keep_past_thinking = keep_past_thinking | default(false) -%}
3
- {%- set ns = namespace(system_prompt="") -%}
4
- {%- if messages[0]["role"] == "system" -%}
5
- {%- set sys_content = messages[0]["content"] -%}
6
- {%- if sys_content is not string -%}
7
- {%- for item in sys_content -%}
8
- {%- if item["type"] == "text" -%}
9
- {%- set ns.system_prompt = ns.system_prompt + item["text"] -%}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  {%- endif -%}
11
  {%- endfor -%}
12
- {%- else -%}
13
- {%- set ns.system_prompt = sys_content -%}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  {%- endif -%}
15
  {%- set messages = messages[1:] -%}
16
  {%- endif -%}
@@ -30,35 +75,51 @@
30
  {%- if ns.system_prompt -%}
31
  {{- "<|im_start|>system\n" + ns.system_prompt + "<|im_end|>\n" -}}
32
  {%- endif -%}
33
- {%- set ns.last_assistant_index = -1 -%}
34
  {%- for message in messages -%}
35
  {%- if message["role"] == "assistant" -%}
36
  {%- set ns.last_assistant_index = loop.index0 -%}
37
  {%- endif -%}
38
  {%- endfor -%}
39
  {%- for message in messages -%}
40
- {{- "<|im_start|>" + message["role"] + "\n" -}}
41
- {%- set content = message["content"] -%}
42
- {%- if content is not string -%}
43
- {%- set ns.content = "" -%}
44
- {%- for item in content -%}
45
- {%- if item["type"] == "image" -%}
46
- {%- set ns.content = ns.content + "<image>" -%}
47
- {%- elif item["type"] == "text" -%}
48
- {%- set ns.content = ns.content + item["text"] -%}
49
- {%- else -%}
50
- {%- set ns.content = ns.content + item | tojson -%}
51
- {%- endif -%}
52
- {%- endfor -%}
53
- {%- set content = ns.content -%}
54
- {%- endif -%}
55
- {%- if message["role"] == "assistant" and not keep_past_thinking and loop.index0 != ns.last_assistant_index -%}
56
- {%- if "</think>" in content -%}
57
  {%- set content = content.split("</think>")[-1] | trim -%}
58
  {%- endif -%}
59
- {%- endif -%}
60
- {{- content + "<|im_end|>\n" -}}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
61
  {%- endfor -%}
62
  {%- if add_generation_prompt -%}
63
  {{- "<|im_start|>assistant\n" -}}
64
- {%- endif -%}
 
1
  {{- bos_token -}}
2
+ {%- set preserve_thinking = preserve_thinking | default(keep_past_thinking | default(false)) -%}
3
+
4
+ {%- macro format_arg_value(arg_value) -%}
5
+ {%- if arg_value is string -%}
6
+ {{- "'" + (arg_value | replace("\\", "\\\\") | replace("'", "\\'") | replace("\n", "\\n") | replace("\r", "\\r")) + "'" -}}
7
+ {%- elif arg_value is mapping or arg_value is iterable -%}
8
+ {{- arg_value | tojson -}}
9
+ {%- else -%}
10
+ {{- arg_value | string -}}
11
+ {%- endif -%}
12
+ {%- endmacro -%}
13
+
14
+ {%- macro parse_content(content) -%}
15
+ {%- if content is string -%}
16
+ {{- content -}}
17
+ {%- elif content is mapping -%}
18
+ {{- content | tojson -}}
19
+ {%- elif content is iterable -%}
20
+ {%- set _ns = namespace(result="") -%}
21
+ {%- for item in content -%}
22
+ {%- if item is string -%}
23
+ {%- set _ns.result = _ns.result + item -%}
24
+ {%- elif item is mapping and item.get("type") == "image" -%}
25
+ {%- set _ns.result = _ns.result + "<image>" -%}
26
+ {%- elif item is mapping and item.get("type") == "text" -%}
27
+ {%- set _ns.result = _ns.result + ((item.get("text") or "") | string) -%}
28
+ {%- else -%}
29
+ {%- set _ns.result = _ns.result + (item | tojson) -%}
30
  {%- endif -%}
31
  {%- endfor -%}
32
+ {{- _ns.result -}}
33
+ {%- endif -%}
34
+ {%- endmacro -%}
35
+
36
+ {%- macro render_tool_calls(tool_calls) -%}
37
+ {%- set tool_calls_ns = namespace(tool_calls=[]) -%}
38
+ {%- for tool_call in tool_calls -%}
39
+ {%- set func = tool_call["function"] if "function" in tool_call else tool_call -%}
40
+ {%- set func_name = func["name"] -%}
41
+ {%- set func_args = func.get("arguments") -%}
42
+ {%- set args_ns = namespace(arg_strings=[]) -%}
43
+ {%- if func_args is mapping -%}
44
+ {%- for arg_name, arg_value in func_args.items() -%}
45
+ {%- set args_ns.arg_strings = args_ns.arg_strings + [arg_name + "=" + format_arg_value(arg_value)] -%}
46
+ {%- endfor -%}
47
+ {%- elif func_args is string and (func_args | trim) not in ["", "{}", "null"] -%}
48
+ {{- raise_exception("Tool call arguments must be a mapping, got a JSON-encoded string: parse arguments with json.loads() before applying the chat template") -}}
49
+ {%- endif -%}
50
+ {%- set tool_calls_ns.tool_calls = tool_calls_ns.tool_calls + [func_name + "(" + (args_ns.arg_strings | join(", ")) + ")"] -%}
51
+ {%- endfor -%}
52
+ {{- "<|tool_call_start|>[" + (tool_calls_ns.tool_calls | join(", ")) + "]<|tool_call_end|>" -}}
53
+ {%- endmacro -%}
54
+
55
+ {%- set ns = namespace(system_prompt="", last_assistant_index=-1) -%}
56
+ {%- if messages and messages[0]["role"] == "system" -%}
57
+ {%- if messages[0].get("content") -%}
58
+ {%- set ns.system_prompt = parse_content(messages[0]["content"]) -%}
59
  {%- endif -%}
60
  {%- set messages = messages[1:] -%}
61
  {%- endif -%}
 
75
  {%- if ns.system_prompt -%}
76
  {{- "<|im_start|>system\n" + ns.system_prompt + "<|im_end|>\n" -}}
77
  {%- endif -%}
 
78
  {%- for message in messages -%}
79
  {%- if message["role"] == "assistant" -%}
80
  {%- set ns.last_assistant_index = loop.index0 -%}
81
  {%- endif -%}
82
  {%- endfor -%}
83
  {%- for message in messages -%}
84
+ {{- "<|im_start|>" + message.role + "\n" -}}
85
+ {%- if message.role == "assistant" -%}
86
+ {%- generation -%}
87
+ {%- set keep_thinking = preserve_thinking or loop.index0 == ns.last_assistant_index -%}
88
+ {%- set thinking = message.thinking or message.reasoning or message.reasoning_content -%}
89
+ {%- set thinking = thinking if thinking is string else "" -%}
90
+ {%- if thinking and keep_thinking -%}
91
+ {{- "<think>" + thinking + "</think>" -}}
92
+ {%- endif -%}
93
+ {%- set _cfm_tag = "CONTINUE_FINAL_MESSAGE_TAG " -%}
94
+ {%- set _has_cfm = false -%}
95
+ {%- set content = "" -%}
96
+ {%- if message.get("content") -%}
97
+ {%- set content = parse_content(message.content) -%}
98
+ {%- endif -%}
99
+ {%- if not keep_thinking and "</think>" in content -%}
 
100
  {%- set content = content.split("</think>")[-1] | trim -%}
101
  {%- endif -%}
102
+ {%- if content.endswith(_cfm_tag) -%}
103
+ {%- set _has_cfm = true -%}
104
+ {%- set _trunc_len = (content | length) - (_cfm_tag | length) -%}
105
+ {%- set content = content[:_trunc_len] -%}
106
+ {%- endif -%}
107
+ {{- content -}}
108
+ {%- if message.tool_calls -%}
109
+ {{- render_tool_calls(message.tool_calls) -}}
110
+ {%- endif -%}
111
+ {%- if _has_cfm -%}
112
+ {{- _cfm_tag -}}
113
+ {%- endif -%}
114
+ {{- "<|im_end|>\n" -}}
115
+ {%- endgeneration -%}
116
+ {%- else %}
117
+ {%- if message.get("content") -%}
118
+ {{- parse_content(message["content"]) -}}
119
+ {%- endif -%}
120
+ {{- "<|im_end|>\n" -}}
121
+ {%- endif %}
122
  {%- endfor -%}
123
  {%- if add_generation_prompt -%}
124
  {{- "<|im_start|>assistant\n" -}}
125
+ {%- endif -%}
config.json CHANGED
@@ -52,9 +52,9 @@
52
  "rope_theta": 1000000.0,
53
  "rope_type": "default"
54
  },
55
- "rope_theta": 1000000.0,
56
  "tie_embedding": true,
57
- "transformers_version": "4.57.6",
 
58
  "use_cache": true,
59
  "use_pos_enc": true,
60
  "vocab_size": 65536
 
52
  "rope_theta": 1000000.0,
53
  "rope_type": "default"
54
  },
 
55
  "tie_embedding": true,
56
+ "tie_word_embeddings": true,
57
+ "transformers_version": "5.2.0",
58
  "use_cache": true,
59
  "use_pos_enc": true,
60
  "vocab_size": 65536
generation_config.json CHANGED
@@ -3,5 +3,5 @@
3
  "bos_token_id": 1,
4
  "eos_token_id": 7,
5
  "pad_token_id": 0,
6
- "transformers_version": "4.57.6"
7
  }
 
3
  "bos_token_id": 1,
4
  "eos_token_id": 7,
5
  "pad_token_id": 0,
6
+ "transformers_version": "5.2.0"
7
  }
openvino_config.json CHANGED
@@ -1,9 +1,10 @@
1
  {
2
  "dtype": "",
3
  "input_info": null,
4
- "optimum_version": "2.1.0",
5
  "output_attentions": false,
6
  "quantization_config": {
 
7
  "dataset": null,
8
  "default_config": {
9
  "quant_method": "default"
@@ -15,5 +16,5 @@
15
  "tokenizer": "LiquidAI/LFM2.5-350M"
16
  },
17
  "save_onnx_model": false,
18
- "transformers_version": "4.57.6"
19
  }
 
1
  {
2
  "dtype": "",
3
  "input_info": null,
4
+ "optimum_version": "2.3.0",
5
  "output_attentions": false,
6
  "quantization_config": {
7
+ "_dataset_kwargs": {},
8
  "dataset": null,
9
  "default_config": {
10
  "quant_method": "default"
 
16
  "tokenizer": "LiquidAI/LFM2.5-350M"
17
  },
18
  "save_onnx_model": false,
19
+ "transformers_version": "5.2.0"
20
  }
openvino_detokenizer.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:866214ab962259d51b044d5d9c4eafb0ee6739f096542c0f16a40712a052edf2
3
- size 911427
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c1ce1a047e78fec2b22895ff200cbf9bf89f0a42325de0251bc84ad9f9e965d
3
+ size 911403
openvino_detokenizer.xml CHANGED
@@ -1,16 +1,16 @@
1
  <?xml version="1.0"?>
2
  <net name="detokenizer" version="11">
3
  <layers>
4
- <layer id="0" name="Parameter_131" type="Parameter" version="opset1">
5
  <data shape="?,?" element_type="i64" />
6
  <output>
7
- <port id="0" precision="I64" names="Parameter_131">
8
  <dim>-1</dim>
9
  <dim>-1</dim>
10
  </port>
11
  </output>
12
  </layer>
13
- <layer id="1" name="Convert_336" type="Convert" version="opset1">
14
  <data destination_type="i32" />
15
  <input>
16
  <port id="0" precision="I64">
@@ -25,7 +25,7 @@
25
  </port>
26
  </output>
27
  </layer>
28
- <layer id="2" name="Constant_133" type="Const" version="opset1">
29
  <data element_type="i32" shape="64402" offset="0" size="257608" />
30
  <output>
31
  <port id="0" precision="I32">
@@ -33,7 +33,7 @@
33
  </port>
34
  </output>
35
  </layer>
36
- <layer id="3" name="Constant_135" type="Const" version="opset1">
37
  <data element_type="i32" shape="64402" offset="257608" size="257608" />
38
  <output>
39
  <port id="0" precision="I32">
@@ -41,7 +41,7 @@
41
  </port>
42
  </output>
43
  </layer>
44
- <layer id="4" name="Constant_137" type="Const" version="opset1">
45
  <data element_type="u8" shape="394175" offset="515216" size="394175" />
46
  <output>
47
  <port id="0" precision="U8">
@@ -49,15 +49,15 @@
49
  </port>
50
  </output>
51
  </layer>
52
- <layer id="5" name="Slice_142" type="Const" version="opset1">
53
- <data element_type="i32" shape="509" offset="909391" size="2036" />
54
  <output>
55
  <port id="0" precision="I32">
56
- <dim>509</dim>
57
  </port>
58
  </output>
59
  </layer>
60
- <layer id="6" name="VocabDecoder_144" type="VocabDecoder" version="extension">
61
  <data skip_tokens="" />
62
  <input>
63
  <port id="0" precision="I32">
@@ -74,7 +74,7 @@
74
  <dim>394175</dim>
75
  </port>
76
  <port id="4" precision="I32">
77
- <dim>509</dim>
78
  </port>
79
  </input>
80
  <output>
@@ -95,7 +95,7 @@
95
  </port>
96
  </output>
97
  </layer>
98
- <layer id="7" name="FuzeRagged_145" type="FuzeRagged" version="extension">
99
  <input>
100
  <port id="0" precision="I32">
101
  <dim>-1</dim>
@@ -119,7 +119,7 @@
119
  </port>
120
  </output>
121
  </layer>
122
- <layer id="8" name="UTF8Validate_146" type="UTF8Validate" version="extension">
123
  <data replace_mode="true" />
124
  <input>
125
  <port id="0" precision="I32">
@@ -144,7 +144,7 @@
144
  </port>
145
  </output>
146
  </layer>
147
- <layer id="9" name="StringTensorPack_147" type="StringTensorPack" version="opset15">
148
  <input>
149
  <port id="0" precision="I32">
150
  <dim>-1</dim>
@@ -157,12 +157,12 @@
157
  </port>
158
  </input>
159
  <output>
160
- <port id="3" precision="STRING" names="Result_148,string_output">
161
  <dim>-1</dim>
162
  </port>
163
  </output>
164
  </layer>
165
- <layer id="10" name="Result_148" type="Result" version="opset1" output_names="Result_148,string_output">
166
  <input>
167
  <port id="0" precision="STRING">
168
  <dim>-1</dim>
@@ -190,27 +190,29 @@
190
  <edge from-layer="9" from-port="3" to-layer="10" to-port="0" />
191
  </edges>
192
  <rt_info>
 
193
  <add_attention_mask value="True" />
194
  <add_prefix_space />
195
  <add_special_tokens value="True" />
196
  <bos_token_id value="1" />
 
197
  <clean_up_tokenization_spaces />
198
  <detokenizer_input_type value="i64" />
199
  <eos_token_id value="7" />
200
  <handle_special_tokens_with_re />
201
  <max_length />
202
  <number_of_inputs value="1" />
203
- <openvino_tokenizers_version value="2026.1.0.0-657-742d15e4be9" />
204
- <openvino_version value="2026.1.0-21367-63e31528c62-releases/2026/1" />
205
  <original_post_processor_template value="{&quot;type&quot;: &quot;Sequence&quot;, &quot;processors&quot;: [{&quot;type&quot;: &quot;ByteLevel&quot;, &quot;add_prefix_space&quot;: true, &quot;trim_offsets&quot;: false, &quot;use_regex&quot;: true}, {&quot;type&quot;: &quot;TemplateProcessing&quot;, &quot;single&quot;: [{&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;A&quot;, &quot;type_id&quot;: 0}}], &quot;pair&quot;: [{&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;A&quot;, &quot;type_id&quot;: 0}}, {&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;B&quot;, &quot;type_id&quot;: 0}}], &quot;special_tokens&quot;: {&quot;&lt;|startoftext|>&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;ids&quot;: [1], &quot;tokens&quot;: [&quot;&lt;|startoftext|>&quot;]}}}]}" />
206
- <original_tokenizer_class value="&lt;class 'transformers.tokenization_utils_fast.PreTrainedTokenizerFast'>" />
207
  <pad_token_id value="0" />
208
  <processed_post_processor_template value="{&quot;single&quot;: {&quot;ids&quot;: [1, -1], &quot;type_ids&quot;: [0, 0]}, &quot;pair&quot;: {&quot;ids&quot;: [1, -1, 1, -2], &quot;type_ids&quot;: [0, 0, 0, 0]}}" />
209
  <skip_special_tokens value="True" />
210
  <streaming_detokenizer value="False" />
211
  <tokenizer_output_type value="i64" />
212
  <tokenizers_version value="0.22.2" />
213
- <transformers_version value="4.57.6" />
214
  <use_max_padding value="False" />
215
  <use_sentencepiece_backend value="False" />
216
  <utf8_replace_mode value="replace" />
 
1
  <?xml version="1.0"?>
2
  <net name="detokenizer" version="11">
3
  <layers>
4
+ <layer id="0" name="Parameter_95085" type="Parameter" version="opset1">
5
  <data shape="?,?" element_type="i64" />
6
  <output>
7
+ <port id="0" precision="I64" names="Parameter_95085">
8
  <dim>-1</dim>
9
  <dim>-1</dim>
10
  </port>
11
  </output>
12
  </layer>
13
+ <layer id="1" name="Convert_95120" type="Convert" version="opset1">
14
  <data destination_type="i32" />
15
  <input>
16
  <port id="0" precision="I64">
 
25
  </port>
26
  </output>
27
  </layer>
28
+ <layer id="2" name="Constant_95087" type="Const" version="opset1">
29
  <data element_type="i32" shape="64402" offset="0" size="257608" />
30
  <output>
31
  <port id="0" precision="I32">
 
33
  </port>
34
  </output>
35
  </layer>
36
+ <layer id="3" name="Constant_95089" type="Const" version="opset1">
37
  <data element_type="i32" shape="64402" offset="257608" size="257608" />
38
  <output>
39
  <port id="0" precision="I32">
 
41
  </port>
42
  </output>
43
  </layer>
44
+ <layer id="4" name="Constant_95091" type="Const" version="opset1">
45
  <data element_type="u8" shape="394175" offset="515216" size="394175" />
46
  <output>
47
  <port id="0" precision="U8">
 
49
  </port>
50
  </output>
51
  </layer>
52
+ <layer id="5" name="Slice_95096" type="Const" version="opset1">
53
+ <data element_type="i32" shape="503" offset="909391" size="2012" />
54
  <output>
55
  <port id="0" precision="I32">
56
+ <dim>503</dim>
57
  </port>
58
  </output>
59
  </layer>
60
+ <layer id="6" name="VocabDecoder_95098" type="VocabDecoder" version="extension">
61
  <data skip_tokens="" />
62
  <input>
63
  <port id="0" precision="I32">
 
74
  <dim>394175</dim>
75
  </port>
76
  <port id="4" precision="I32">
77
+ <dim>503</dim>
78
  </port>
79
  </input>
80
  <output>
 
95
  </port>
96
  </output>
97
  </layer>
98
+ <layer id="7" name="FuzeRagged_95099" type="FuzeRagged" version="extension">
99
  <input>
100
  <port id="0" precision="I32">
101
  <dim>-1</dim>
 
119
  </port>
120
  </output>
121
  </layer>
122
+ <layer id="8" name="UTF8Validate_95100" type="UTF8Validate" version="extension">
123
  <data replace_mode="true" />
124
  <input>
125
  <port id="0" precision="I32">
 
144
  </port>
145
  </output>
146
  </layer>
147
+ <layer id="9" name="StringTensorPack_95101" type="StringTensorPack" version="opset15">
148
  <input>
149
  <port id="0" precision="I32">
150
  <dim>-1</dim>
 
157
  </port>
158
  </input>
159
  <output>
160
+ <port id="3" precision="STRING" names="Result_95102,string_output">
161
  <dim>-1</dim>
162
  </port>
163
  </output>
164
  </layer>
165
+ <layer id="10" name="Result_95102" type="Result" version="opset1" output_names="Result_95102,string_output">
166
  <input>
167
  <port id="0" precision="STRING">
168
  <dim>-1</dim>
 
190
  <edge from-layer="9" from-port="3" to-layer="10" to-port="0" />
191
  </edges>
192
  <rt_info>
193
+ <info name="OpenVINO Runtime" value="2026.3.0-22451-8a17657b995-releases/2026/3" />
194
  <add_attention_mask value="True" />
195
  <add_prefix_space />
196
  <add_special_tokens value="True" />
197
  <bos_token_id value="1" />
198
+ <chat_template value="{{- bos_token -}}&#10;{%- set preserve_thinking = preserve_thinking | default(keep_past_thinking | default(false)) -%}&#10;&#10;{%- macro format_arg_value(arg_value) -%}&#10; {%- if arg_value is string -%}&#10; {{- &quot;'&quot; + (arg_value | replace(&quot;\\&quot;, &quot;\\\\&quot;) | replace(&quot;'&quot;, &quot;\\'&quot;) | replace(&quot;\n&quot;, &quot;\\n&quot;) | replace(&quot;\r&quot;, &quot;\\r&quot;)) + &quot;'&quot; -}}&#10; {%- elif arg_value is mapping or arg_value is iterable -%}&#10; {{- arg_value | tojson -}}&#10; {%- else -%}&#10; {{- arg_value | string -}}&#10; {%- endif -%}&#10;{%- endmacro -%}&#10;&#10;{%- macro parse_content(content) -%}&#10; {%- if content is string -%}&#10; {{- content -}}&#10; {%- elif content is mapping -%}&#10; {{- content | tojson -}}&#10; {%- elif content is iterable -%}&#10; {%- set _ns = namespace(result=&quot;&quot;) -%}&#10; {%- for item in content -%}&#10; {%- if item is string -%}&#10; {%- set _ns.result = _ns.result + item -%}&#10; {%- elif item is mapping and item.get(&quot;type&quot;) == &quot;image&quot; -%}&#10; {%- set _ns.result = _ns.result + &quot;&lt;image>&quot; -%}&#10; {%- elif item is mapping and item.get(&quot;type&quot;) == &quot;text&quot; -%}&#10; {%- set _ns.result = _ns.result + ((item.get(&quot;text&quot;) or &quot;&quot;) | string) -%}&#10; {%- else -%}&#10; {%- set _ns.result = _ns.result + (item | tojson) -%}&#10; {%- endif -%}&#10; {%- endfor -%}&#10; {{- _ns.result -}}&#10; {%- endif -%}&#10;{%- endmacro -%}&#10;&#10;{%- macro render_tool_calls(tool_calls) -%}&#10; {%- set tool_calls_ns = namespace(tool_calls=[]) -%}&#10; {%- for tool_call in tool_calls -%}&#10; {%- set func = tool_call[&quot;function&quot;] if &quot;function&quot; in tool_call else tool_call -%}&#10; {%- set func_name = func[&quot;name&quot;] -%}&#10; {%- set func_args = func.get(&quot;arguments&quot;) -%}&#10; {%- set args_ns = namespace(arg_strings=[]) -%}&#10; {%- if func_args is mapping -%}&#10; {%- for arg_name, arg_value in func_args.items() -%}&#10; {%- set args_ns.arg_strings = args_ns.arg_strings + [arg_name + &quot;=&quot; + format_arg_value(arg_value)] -%}&#10; {%- endfor -%}&#10; {%- elif func_args is string and (func_args | trim) not in [&quot;&quot;, &quot;{}&quot;, &quot;null&quot;] -%}&#10; {{- raise_exception(&quot;Tool call arguments must be a mapping, got a JSON-encoded string: parse arguments with json.loads() before applying the chat template&quot;) -}}&#10; {%- endif -%}&#10; {%- set tool_calls_ns.tool_calls = tool_calls_ns.tool_calls + [func_name + &quot;(&quot; + (args_ns.arg_strings | join(&quot;, &quot;)) + &quot;)&quot;] -%}&#10; {%- endfor -%}&#10; {{- &quot;&lt;|tool_call_start|>[&quot; + (tool_calls_ns.tool_calls | join(&quot;, &quot;)) + &quot;]&lt;|tool_call_end|>&quot; -}}&#10;{%- endmacro -%}&#10;&#10;{%- set ns = namespace(system_prompt=&quot;&quot;, last_assistant_index=-1) -%}&#10;{%- if messages and messages[0][&quot;role&quot;] == &quot;system&quot; -%}&#10; {%- if messages[0].get(&quot;content&quot;) -%}&#10; {%- set ns.system_prompt = parse_content(messages[0][&quot;content&quot;]) -%}&#10; {%- endif -%}&#10; {%- set messages = messages[1:] -%}&#10;{%- endif -%}&#10;{%- if tools -%}&#10; {%- set ns.system_prompt = ns.system_prompt + (&quot;\n&quot; if ns.system_prompt else &quot;&quot;) + &quot;List of tools: [&quot; -%}&#10; {%- for tool in tools -%}&#10; {%- if tool is not string -%}&#10; {%- set tool = tool | tojson -%}&#10; {%- endif -%}&#10; {%- set ns.system_prompt = ns.system_prompt + tool -%}&#10; {%- if not loop.last -%}&#10; {%- set ns.system_prompt = ns.system_prompt + &quot;, &quot; -%}&#10; {%- endif -%}&#10; {%- endfor -%}&#10; {%- set ns.system_prompt = ns.system_prompt + &quot;]&quot; -%}&#10;{%- endif -%}&#10;{%- if ns.system_prompt -%}&#10; {{- &quot;&lt;|im_start|>system\n&quot; + ns.system_prompt + &quot;&lt;|im_end|>\n&quot; -}}&#10;{%- endif -%}&#10;{%- for message in messages -%}&#10; {%- if message[&quot;role&quot;] == &quot;assistant&quot; -%}&#10; {%- set ns.last_assistant_index = loop.index0 -%}&#10; {%- endif -%}&#10;{%- endfor -%}&#10;{%- for message in messages -%}&#10; {{- &quot;&lt;|im_start|>&quot; + message.role + &quot;\n&quot; -}}&#10; {%- if message.role == &quot;assistant&quot; -%}&#10; {%- generation -%}&#10; {%- set keep_thinking = preserve_thinking or loop.index0 == ns.last_assistant_index -%}&#10; {%- set thinking = message.thinking or message.reasoning or message.reasoning_content -%}&#10; {%- set thinking = thinking if thinking is string else &quot;&quot; -%}&#10; {%- if thinking and keep_thinking -%}&#10; {{- &quot;&lt;think>&quot; + thinking + &quot;&lt;/think>&quot; -}}&#10; {%- endif -%}&#10; {%- set _cfm_tag = &quot;CONTINUE_FINAL_MESSAGE_TAG &quot; -%}&#10; {%- set _has_cfm = false -%}&#10; {%- set content = &quot;&quot; -%}&#10; {%- if message.get(&quot;content&quot;) -%}&#10; {%- set content = parse_content(message.content) -%}&#10; {%- endif -%}&#10; {%- if not keep_thinking and &quot;&lt;/think>&quot; in content -%}&#10; {%- set content = content.split(&quot;&lt;/think>&quot;)[-1] | trim -%}&#10; {%- endif -%}&#10; {%- if content.endswith(_cfm_tag) -%}&#10; {%- set _has_cfm = true -%}&#10; {%- set _trunc_len = (content | length) - (_cfm_tag | length) -%}&#10; {%- set content = content[:_trunc_len] -%}&#10; {%- endif -%}&#10; {{- content -}}&#10; {%- if message.tool_calls -%}&#10; {{- render_tool_calls(message.tool_calls) -}}&#10; {%- endif -%}&#10; {%- if _has_cfm -%}&#10; {{- _cfm_tag -}}&#10; {%- endif -%}&#10; {{- &quot;&lt;|im_end|>\n&quot; -}}&#10; {%- endgeneration -%}&#10; {%- else %}&#10; {%- if message.get(&quot;content&quot;) -%}&#10; {{- parse_content(message[&quot;content&quot;]) -}}&#10; {%- endif -%}&#10; {{- &quot;&lt;|im_end|>\n&quot; -}}&#10; {%- endif %}&#10;{%- endfor -%}&#10;{%- if add_generation_prompt -%}&#10; {{- &quot;&lt;|im_start|>assistant\n&quot; -}}&#10;{%- endif -%}&#10;" />
199
  <clean_up_tokenization_spaces />
200
  <detokenizer_input_type value="i64" />
201
  <eos_token_id value="7" />
202
  <handle_special_tokens_with_re />
203
  <max_length />
204
  <number_of_inputs value="1" />
205
+ <openvino_tokenizers_version value="2026.3.0.0-703-183c6f25cda" />
206
+ <openvino_version value="2026.3.0-22451-8a17657b995-releases/2026/3" />
207
  <original_post_processor_template value="{&quot;type&quot;: &quot;Sequence&quot;, &quot;processors&quot;: [{&quot;type&quot;: &quot;ByteLevel&quot;, &quot;add_prefix_space&quot;: true, &quot;trim_offsets&quot;: false, &quot;use_regex&quot;: true}, {&quot;type&quot;: &quot;TemplateProcessing&quot;, &quot;single&quot;: [{&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;A&quot;, &quot;type_id&quot;: 0}}], &quot;pair&quot;: [{&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;A&quot;, &quot;type_id&quot;: 0}}, {&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;B&quot;, &quot;type_id&quot;: 0}}], &quot;special_tokens&quot;: {&quot;&lt;|startoftext|>&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;ids&quot;: [1], &quot;tokens&quot;: [&quot;&lt;|startoftext|>&quot;]}}}]}" />
208
+ <original_tokenizer_class value="&lt;class 'transformers.tokenization_utils_tokenizers.TokenizersBackend'>" />
209
  <pad_token_id value="0" />
210
  <processed_post_processor_template value="{&quot;single&quot;: {&quot;ids&quot;: [1, -1], &quot;type_ids&quot;: [0, 0]}, &quot;pair&quot;: {&quot;ids&quot;: [1, -1, 1, -2], &quot;type_ids&quot;: [0, 0, 0, 0]}}" />
211
  <skip_special_tokens value="True" />
212
  <streaming_detokenizer value="False" />
213
  <tokenizer_output_type value="i64" />
214
  <tokenizers_version value="0.22.2" />
215
+ <transformers_version value="5.2.0" />
216
  <use_max_padding value="False" />
217
  <use_sentencepiece_backend value="False" />
218
  <utf8_replace_mode value="replace" />
openvino_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:48ad4073982a9db953b5f536dfe6979aafd2d3694533030e07fd40f914bb60ed
3
- size 355608038
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:406c1b9ebc07ec3ee5e043850a093934dad655dbb81d3f01e99e8fe3c1ec7c1e
3
+ size 355485078
openvino_model.xml CHANGED
The diff for this file is too large to render. See raw diff
 
openvino_tokenizer.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:329e8d7a8e901352c4861fb3251e4ba29e761ed2d4aff7f583f426f344c52ed8
3
- size 2339620
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4eebc4855b79ce9c237ca0c897321a20d2e49e10685ce8c69ac9fd1549722053
3
+ size 2339619
openvino_tokenizer.xml CHANGED
@@ -1,27 +1,27 @@
1
  <?xml version="1.0"?>
2
  <net name="tokenizer" version="11">
3
  <layers>
4
- <layer id="0" name="Parameter_1" type="Parameter" version="opset1">
5
  <data shape="?" element_type="string" />
6
  <output>
7
- <port id="0" precision="STRING" names="Parameter_1">
8
  <dim>-1</dim>
9
  </port>
10
  </output>
11
  </layer>
12
- <layer id="1" name="Constant_115" type="Const" version="opset1">
13
  <data element_type="i32" shape="" offset="0" size="4" />
14
  <output>
15
  <port id="0" precision="I32" />
16
  </output>
17
  </layer>
18
- <layer id="2" name="Constant_116" type="Const" version="opset1">
19
  <data element_type="i32" shape="" offset="4" size="4" />
20
  <output>
21
  <port id="0" precision="I32" />
22
  </output>
23
  </layer>
24
- <layer id="3" name="Constant_117" type="Const" version="opset1">
25
  <data element_type="i32" shape="1" offset="4" size="4" />
26
  <output>
27
  <port id="0" precision="I32">
@@ -29,13 +29,13 @@
29
  </port>
30
  </output>
31
  </layer>
32
- <layer id="4" name="Constant_7" type="Const" version="opset1">
33
  <data element_type="i64" shape="" offset="8" size="8" />
34
  <output>
35
  <port id="0" precision="I64" />
36
  </output>
37
  </layer>
38
- <layer id="5" name="StringTensorUnpack_2" type="StringTensorUnpack" version="opset15">
39
  <input>
40
  <port id="0" precision="STRING">
41
  <dim>-1</dim>
@@ -53,7 +53,7 @@
53
  </port>
54
  </output>
55
  </layer>
56
- <layer id="6" name="ShapeOf_3" type="ShapeOf" version="opset3">
57
  <data output_type="i64" />
58
  <input>
59
  <port id="0" precision="I32">
@@ -66,19 +66,19 @@
66
  </port>
67
  </output>
68
  </layer>
69
- <layer id="7" name="Constant_4" type="Const" version="opset1">
70
  <data element_type="i64" shape="" offset="8" size="8" />
71
  <output>
72
  <port id="0" precision="I64" />
73
  </output>
74
  </layer>
75
- <layer id="8" name="Constant_5" type="Const" version="opset1">
76
  <data element_type="i64" shape="" offset="8" size="8" />
77
  <output>
78
  <port id="0" precision="I64" />
79
  </output>
80
  </layer>
81
- <layer id="9" name="Gather_6" type="Gather" version="opset8">
82
  <data batch_dims="0" />
83
  <input>
84
  <port id="0" precision="I64">
@@ -91,13 +91,13 @@
91
  <port id="3" precision="I64" />
92
  </output>
93
  </layer>
94
- <layer id="10" name="Constant_8" type="Const" version="opset1">
95
  <data element_type="i64" shape="" offset="16" size="8" />
96
  <output>
97
  <port id="0" precision="I64" />
98
  </output>
99
  </layer>
100
- <layer id="11" name="Range_9" type="Range" version="opset4">
101
  <data output_type="i32" />
102
  <input>
103
  <port id="0" precision="I64" />
@@ -110,19 +110,19 @@
110
  </port>
111
  </output>
112
  </layer>
113
- <layer id="12" name="Constant_10" type="Const" version="opset1">
114
  <data element_type="i64" shape="" offset="16" size="8" />
115
  <output>
116
  <port id="0" precision="I64" />
117
  </output>
118
  </layer>
119
- <layer id="13" name="Constant_11" type="Const" version="opset1">
120
  <data element_type="i64" shape="" offset="16" size="8" />
121
  <output>
122
  <port id="0" precision="I64" />
123
  </output>
124
  </layer>
125
- <layer id="14" name="Add_12" type="Add" version="opset1">
126
  <data auto_broadcast="numpy" />
127
  <input>
128
  <port id="0" precision="I64" />
@@ -132,13 +132,13 @@
132
  <port id="2" precision="I64" />
133
  </output>
134
  </layer>
135
- <layer id="15" name="Constant_13" type="Const" version="opset1">
136
  <data element_type="i64" shape="" offset="16" size="8" />
137
  <output>
138
  <port id="0" precision="I64" />
139
  </output>
140
  </layer>
141
- <layer id="16" name="Range_14" type="Range" version="opset4">
142
  <data output_type="i32" />
143
  <input>
144
  <port id="0" precision="I64" />
@@ -151,7 +151,7 @@
151
  </port>
152
  </output>
153
  </layer>
154
- <layer id="17" name="Constant_78" type="Const" version="opset1">
155
  <data element_type="u8" shape="10805" offset="24" size="10805" />
156
  <output>
157
  <port id="0" precision="U8">
@@ -159,7 +159,7 @@
159
  </port>
160
  </output>
161
  </layer>
162
- <layer id="18" name="SpecialTokensSplit_79" type="SpecialTokensSplit" version="extension">
163
  <input>
164
  <port id="0" precision="I32">
165
  <dim>-1</dim>
@@ -201,7 +201,7 @@
201
  </port>
202
  </output>
203
  </layer>
204
- <layer id="19" name="Constant_81" type="Const" version="opset1">
205
  <data element_type="u8" shape="115" offset="10829" size="115" />
206
  <output>
207
  <port id="0" precision="U8">
@@ -209,7 +209,7 @@
209
  </port>
210
  </output>
211
  </layer>
212
- <layer id="20" name="RegexSplit_82" type="RegexSplit" version="extension">
213
  <data behaviour="isolate" invert="false" max_splits="-1" />
214
  <input>
215
  <port id="0" precision="I32">
@@ -255,7 +255,7 @@
255
  </port>
256
  </output>
257
  </layer>
258
- <layer id="21" name="Constant_84" type="Const" version="opset1">
259
  <data element_type="i32" shape="64402" offset="10944" size="257608" />
260
  <output>
261
  <port id="0" precision="I32">
@@ -263,7 +263,7 @@
263
  </port>
264
  </output>
265
  </layer>
266
- <layer id="22" name="Constant_86" type="Const" version="opset1">
267
  <data element_type="i32" shape="64402" offset="268552" size="257608" />
268
  <output>
269
  <port id="0" precision="I32">
@@ -271,7 +271,7 @@
271
  </port>
272
  </output>
273
  </layer>
274
- <layer id="23" name="Constant_88" type="Const" version="opset1">
275
  <data element_type="u8" shape="394175" offset="526160" size="394175" />
276
  <output>
277
  <port id="0" precision="U8">
@@ -279,7 +279,7 @@
279
  </port>
280
  </output>
281
  </layer>
282
- <layer id="24" name="Constant_96" type="Const" version="opset1">
283
  <data element_type="i32" shape="63683" offset="920335" size="254732" />
284
  <output>
285
  <port id="0" precision="I32">
@@ -287,7 +287,7 @@
287
  </port>
288
  </output>
289
  </layer>
290
- <layer id="25" name="Constant_98" type="Const" version="opset1">
291
  <data element_type="i32" shape="63683" offset="1175067" size="254732" />
292
  <output>
293
  <port id="0" precision="I32">
@@ -295,7 +295,7 @@
295
  </port>
296
  </output>
297
  </layer>
298
- <layer id="26" name="Constant_100" type="Const" version="opset1">
299
  <data element_type="u8" shape="201784" offset="1429799" size="201784" />
300
  <output>
301
  <port id="0" precision="U8">
@@ -303,7 +303,7 @@
303
  </port>
304
  </output>
305
  </layer>
306
- <layer id="27" name="Constant_102" type="Const" version="opset1">
307
  <data element_type="i32" shape="63683" offset="1631583" size="254732" />
308
  <output>
309
  <port id="0" precision="I32">
@@ -311,7 +311,7 @@
311
  </port>
312
  </output>
313
  </layer>
314
- <layer id="28" name="Constant_104" type="Const" version="opset1">
315
  <data element_type="i32" shape="63683" offset="1886315" size="254732" />
316
  <output>
317
  <port id="0" precision="I32">
@@ -319,7 +319,7 @@
319
  </port>
320
  </output>
321
  </layer>
322
- <layer id="29" name="Constant_106" type="Const" version="opset1">
323
  <data element_type="u8" shape="184190" offset="2141047" size="184190" />
324
  <output>
325
  <port id="0" precision="U8">
@@ -327,7 +327,7 @@
327
  </port>
328
  </output>
329
  </layer>
330
- <layer id="30" name="Constant_90" type="Const" version="opset1">
331
  <data element_type="i32" shape="508" offset="2325237" size="2032" />
332
  <output>
333
  <port id="0" precision="I32">
@@ -335,7 +335,7 @@
335
  </port>
336
  </output>
337
  </layer>
338
- <layer id="31" name="Constant_92" type="Const" version="opset1">
339
  <data element_type="i32" shape="508" offset="2327269" size="2032" />
340
  <output>
341
  <port id="0" precision="I32">
@@ -343,7 +343,7 @@
343
  </port>
344
  </output>
345
  </layer>
346
- <layer id="32" name="Constant_94" type="Const" version="opset1">
347
  <data element_type="u8" shape="8265" offset="2329301" size="8265" />
348
  <output>
349
  <port id="0" precision="U8">
@@ -351,7 +351,7 @@
351
  </port>
352
  </output>
353
  </layer>
354
- <layer id="33" name="Constant_107" type="Const" version="opset1">
355
  <data element_type="i32" shape="508" offset="2337566" size="2032" />
356
  <output>
357
  <port id="0" precision="I32">
@@ -359,7 +359,7 @@
359
  </port>
360
  </output>
361
  </layer>
362
- <layer id="34" name="BPETokenizer_108" type="BPETokenizer" version="extension">
363
  <data unk_token="" fuse_unk="false" suffix_indicator="" end_suffix="" byte_fallback="false" cache_capacity="20000" />
364
  <input>
365
  <port id="0" precision="I32">
@@ -429,29 +429,29 @@
429
  </port>
430
  </output>
431
  </layer>
432
- <layer id="35" name="Constant_109" type="Const" version="opset1">
433
  <data element_type="i32" shape="" offset="2339598" size="4" />
434
  <output>
435
  <port id="0" precision="I32" />
436
  </output>
437
  </layer>
438
- <layer id="36" name="Constant_111" type="Const" version="opset1">
439
- <data element_type="u8" shape="5" offset="2339602" size="5" />
440
  <output>
441
  <port id="0" precision="U8">
442
- <dim>5</dim>
443
  </port>
444
  </output>
445
  </layer>
446
- <layer id="37" name="Constant_113" type="Const" version="opset1">
447
- <data element_type="u8" shape="13" offset="2339607" size="13" />
448
  <output>
449
  <port id="0" precision="U8">
450
  <dim>13</dim>
451
  </port>
452
  </output>
453
  </layer>
454
- <layer id="38" name="Truncate_114" type="Truncate" version="extension">
455
  <data m_num_inputs="1" />
456
  <input>
457
  <port id="0" precision="I32">
@@ -465,7 +465,7 @@
465
  </port>
466
  <port id="3" precision="I32" />
467
  <port id="4" precision="U8">
468
- <dim>5</dim>
469
  </port>
470
  <port id="5" precision="U8">
471
  <dim>13</dim>
@@ -483,7 +483,7 @@
483
  </port>
484
  </output>
485
  </layer>
486
- <layer id="39" name="Constant_118" type="Const" version="opset1">
487
  <data element_type="i32" shape="2" offset="8" size="8" />
488
  <output>
489
  <port id="0" precision="I32">
@@ -491,7 +491,7 @@
491
  </port>
492
  </output>
493
  </layer>
494
- <layer id="40" name="CombineSegments_119" type="CombineSegments" version="extension">
495
  <input>
496
  <port id="0" precision="I32" />
497
  <port id="1" precision="I32" />
@@ -532,7 +532,7 @@
532
  </port>
533
  </output>
534
  </layer>
535
- <layer id="41" name="Subtract_120" type="Subtract" version="opset1">
536
  <data auto_broadcast="numpy" />
537
  <input>
538
  <port id="0" precision="I32">
@@ -548,13 +548,13 @@
548
  </port>
549
  </output>
550
  </layer>
551
- <layer id="42" name="Constant_121" type="Const" version="opset1">
552
  <data element_type="i32" shape="" offset="0" size="4" />
553
  <output>
554
  <port id="0" precision="I32" />
555
  </output>
556
  </layer>
557
- <layer id="43" name="ReduceMax_122" type="ReduceMax" version="opset1">
558
  <data keep_dims="false" />
559
  <input>
560
  <port id="0" precision="I32">
@@ -566,14 +566,14 @@
566
  <port id="2" precision="I32" />
567
  </output>
568
  </layer>
569
- <layer id="44" name="Constant_123" type="Const" version="opset1">
570
  <data element_type="i32" shape="" offset="0" size="4" />
571
  <output>
572
  <port id="0" precision="I32" />
573
  </output>
574
  </layer>
575
- <layer id="45" name="RaggedToDense_124" type="RaggedToDense" version="extension">
576
- <data pad_right="true" m_pad_max_length="false" />
577
  <input>
578
  <port id="0" precision="I32">
579
  <dim>-1</dim>
@@ -598,7 +598,7 @@
598
  </port>
599
  </output>
600
  </layer>
601
- <layer id="46" name="Convert_125" type="Convert" version="opset1">
602
  <data destination_type="i32" />
603
  <input>
604
  <port id="0" precision="BOOL">
@@ -613,7 +613,7 @@
613
  </port>
614
  </output>
615
  </layer>
616
- <layer id="47" name="Convert_125.0" type="Convert" version="opset1">
617
  <data destination_type="i64" />
618
  <input>
619
  <port id="0" precision="I32">
@@ -628,7 +628,7 @@
628
  </port>
629
  </output>
630
  </layer>
631
- <layer id="48" name="RaggedToDense_124.0" type="Convert" version="opset1">
632
  <data destination_type="i64" />
633
  <input>
634
  <port id="0" precision="I32">
@@ -643,7 +643,7 @@
643
  </port>
644
  </output>
645
  </layer>
646
- <layer id="49" name="Result_128" type="Result" version="opset1" output_names="input_ids">
647
  <input>
648
  <port id="0" precision="I64">
649
  <dim>-1</dim>
@@ -651,7 +651,7 @@
651
  </port>
652
  </input>
653
  </layer>
654
- <layer id="50" name="Result_130" type="Result" version="opset1" output_names="attention_mask">
655
  <input>
656
  <port id="0" precision="I64">
657
  <dim>-1</dim>
@@ -734,27 +734,29 @@
734
  <edge from-layer="48" from-port="1" to-layer="49" to-port="0" />
735
  </edges>
736
  <rt_info>
 
737
  <add_attention_mask value="True" />
738
  <add_prefix_space />
739
  <add_special_tokens value="True" />
740
  <bos_token_id value="1" />
 
741
  <clean_up_tokenization_spaces />
742
  <detokenizer_input_type value="i64" />
743
  <eos_token_id value="7" />
744
  <handle_special_tokens_with_re />
745
  <max_length />
746
  <number_of_inputs value="1" />
747
- <openvino_tokenizers_version value="2026.1.0.0-657-742d15e4be9" />
748
- <openvino_version value="2026.1.0-21367-63e31528c62-releases/2026/1" />
749
  <original_post_processor_template value="{&quot;type&quot;: &quot;Sequence&quot;, &quot;processors&quot;: [{&quot;type&quot;: &quot;ByteLevel&quot;, &quot;add_prefix_space&quot;: true, &quot;trim_offsets&quot;: false, &quot;use_regex&quot;: true}, {&quot;type&quot;: &quot;TemplateProcessing&quot;, &quot;single&quot;: [{&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;A&quot;, &quot;type_id&quot;: 0}}], &quot;pair&quot;: [{&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;A&quot;, &quot;type_id&quot;: 0}}, {&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;B&quot;, &quot;type_id&quot;: 0}}], &quot;special_tokens&quot;: {&quot;&lt;|startoftext|>&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;ids&quot;: [1], &quot;tokens&quot;: [&quot;&lt;|startoftext|>&quot;]}}}]}" />
750
- <original_tokenizer_class value="&lt;class 'transformers.tokenization_utils_fast.PreTrainedTokenizerFast'>" />
751
  <pad_token_id value="0" />
752
  <processed_post_processor_template value="{&quot;single&quot;: {&quot;ids&quot;: [1, -1], &quot;type_ids&quot;: [0, 0]}, &quot;pair&quot;: {&quot;ids&quot;: [1, -1, 1, -2], &quot;type_ids&quot;: [0, 0, 0, 0]}}" />
753
  <skip_special_tokens value="True" />
754
  <streaming_detokenizer value="False" />
755
  <tokenizer_output_type value="i64" />
756
  <tokenizers_version value="0.22.2" />
757
- <transformers_version value="4.57.6" />
758
  <use_max_padding value="False" />
759
  <use_sentencepiece_backend value="False" />
760
  <utf8_replace_mode value="replace" />
 
1
  <?xml version="1.0"?>
2
  <net name="tokenizer" version="11">
3
  <layers>
4
+ <layer id="0" name="Parameter_94955" type="Parameter" version="opset1">
5
  <data shape="?" element_type="string" />
6
  <output>
7
+ <port id="0" precision="STRING" names="Parameter_94955">
8
  <dim>-1</dim>
9
  </port>
10
  </output>
11
  </layer>
12
+ <layer id="1" name="Constant_95069" type="Const" version="opset1">
13
  <data element_type="i32" shape="" offset="0" size="4" />
14
  <output>
15
  <port id="0" precision="I32" />
16
  </output>
17
  </layer>
18
+ <layer id="2" name="Constant_95070" type="Const" version="opset1">
19
  <data element_type="i32" shape="" offset="4" size="4" />
20
  <output>
21
  <port id="0" precision="I32" />
22
  </output>
23
  </layer>
24
+ <layer id="3" name="Constant_95071" type="Const" version="opset1">
25
  <data element_type="i32" shape="1" offset="4" size="4" />
26
  <output>
27
  <port id="0" precision="I32">
 
29
  </port>
30
  </output>
31
  </layer>
32
+ <layer id="4" name="Constant_94961" type="Const" version="opset1">
33
  <data element_type="i64" shape="" offset="8" size="8" />
34
  <output>
35
  <port id="0" precision="I64" />
36
  </output>
37
  </layer>
38
+ <layer id="5" name="StringTensorUnpack_94956" type="StringTensorUnpack" version="opset15">
39
  <input>
40
  <port id="0" precision="STRING">
41
  <dim>-1</dim>
 
53
  </port>
54
  </output>
55
  </layer>
56
+ <layer id="6" name="ShapeOf_94957" type="ShapeOf" version="opset3">
57
  <data output_type="i64" />
58
  <input>
59
  <port id="0" precision="I32">
 
66
  </port>
67
  </output>
68
  </layer>
69
+ <layer id="7" name="Constant_94958" type="Const" version="opset1">
70
  <data element_type="i64" shape="" offset="8" size="8" />
71
  <output>
72
  <port id="0" precision="I64" />
73
  </output>
74
  </layer>
75
+ <layer id="8" name="Constant_94959" type="Const" version="opset1">
76
  <data element_type="i64" shape="" offset="8" size="8" />
77
  <output>
78
  <port id="0" precision="I64" />
79
  </output>
80
  </layer>
81
+ <layer id="9" name="Gather_94960" type="Gather" version="opset8">
82
  <data batch_dims="0" />
83
  <input>
84
  <port id="0" precision="I64">
 
91
  <port id="3" precision="I64" />
92
  </output>
93
  </layer>
94
+ <layer id="10" name="Constant_94962" type="Const" version="opset1">
95
  <data element_type="i64" shape="" offset="16" size="8" />
96
  <output>
97
  <port id="0" precision="I64" />
98
  </output>
99
  </layer>
100
+ <layer id="11" name="Range_94963" type="Range" version="opset4">
101
  <data output_type="i32" />
102
  <input>
103
  <port id="0" precision="I64" />
 
110
  </port>
111
  </output>
112
  </layer>
113
+ <layer id="12" name="Constant_94964" type="Const" version="opset1">
114
  <data element_type="i64" shape="" offset="16" size="8" />
115
  <output>
116
  <port id="0" precision="I64" />
117
  </output>
118
  </layer>
119
+ <layer id="13" name="Constant_94965" type="Const" version="opset1">
120
  <data element_type="i64" shape="" offset="16" size="8" />
121
  <output>
122
  <port id="0" precision="I64" />
123
  </output>
124
  </layer>
125
+ <layer id="14" name="Add_94966" type="Add" version="opset1">
126
  <data auto_broadcast="numpy" />
127
  <input>
128
  <port id="0" precision="I64" />
 
132
  <port id="2" precision="I64" />
133
  </output>
134
  </layer>
135
+ <layer id="15" name="Constant_94967" type="Const" version="opset1">
136
  <data element_type="i64" shape="" offset="16" size="8" />
137
  <output>
138
  <port id="0" precision="I64" />
139
  </output>
140
  </layer>
141
+ <layer id="16" name="Range_94968" type="Range" version="opset4">
142
  <data output_type="i32" />
143
  <input>
144
  <port id="0" precision="I64" />
 
151
  </port>
152
  </output>
153
  </layer>
154
+ <layer id="17" name="Constant_95032" type="Const" version="opset1">
155
  <data element_type="u8" shape="10805" offset="24" size="10805" />
156
  <output>
157
  <port id="0" precision="U8">
 
159
  </port>
160
  </output>
161
  </layer>
162
+ <layer id="18" name="SpecialTokensSplit_95033" type="SpecialTokensSplit" version="extension">
163
  <input>
164
  <port id="0" precision="I32">
165
  <dim>-1</dim>
 
201
  </port>
202
  </output>
203
  </layer>
204
+ <layer id="19" name="Constant_95035" type="Const" version="opset1">
205
  <data element_type="u8" shape="115" offset="10829" size="115" />
206
  <output>
207
  <port id="0" precision="U8">
 
209
  </port>
210
  </output>
211
  </layer>
212
+ <layer id="20" name="RegexSplit_95036" type="RegexSplit" version="extension">
213
  <data behaviour="isolate" invert="false" max_splits="-1" />
214
  <input>
215
  <port id="0" precision="I32">
 
255
  </port>
256
  </output>
257
  </layer>
258
+ <layer id="21" name="Constant_95038" type="Const" version="opset1">
259
  <data element_type="i32" shape="64402" offset="10944" size="257608" />
260
  <output>
261
  <port id="0" precision="I32">
 
263
  </port>
264
  </output>
265
  </layer>
266
+ <layer id="22" name="Constant_95040" type="Const" version="opset1">
267
  <data element_type="i32" shape="64402" offset="268552" size="257608" />
268
  <output>
269
  <port id="0" precision="I32">
 
271
  </port>
272
  </output>
273
  </layer>
274
+ <layer id="23" name="Constant_95042" type="Const" version="opset1">
275
  <data element_type="u8" shape="394175" offset="526160" size="394175" />
276
  <output>
277
  <port id="0" precision="U8">
 
279
  </port>
280
  </output>
281
  </layer>
282
+ <layer id="24" name="Constant_95050" type="Const" version="opset1">
283
  <data element_type="i32" shape="63683" offset="920335" size="254732" />
284
  <output>
285
  <port id="0" precision="I32">
 
287
  </port>
288
  </output>
289
  </layer>
290
+ <layer id="25" name="Constant_95052" type="Const" version="opset1">
291
  <data element_type="i32" shape="63683" offset="1175067" size="254732" />
292
  <output>
293
  <port id="0" precision="I32">
 
295
  </port>
296
  </output>
297
  </layer>
298
+ <layer id="26" name="Constant_95054" type="Const" version="opset1">
299
  <data element_type="u8" shape="201784" offset="1429799" size="201784" />
300
  <output>
301
  <port id="0" precision="U8">
 
303
  </port>
304
  </output>
305
  </layer>
306
+ <layer id="27" name="Constant_95056" type="Const" version="opset1">
307
  <data element_type="i32" shape="63683" offset="1631583" size="254732" />
308
  <output>
309
  <port id="0" precision="I32">
 
311
  </port>
312
  </output>
313
  </layer>
314
+ <layer id="28" name="Constant_95058" type="Const" version="opset1">
315
  <data element_type="i32" shape="63683" offset="1886315" size="254732" />
316
  <output>
317
  <port id="0" precision="I32">
 
319
  </port>
320
  </output>
321
  </layer>
322
+ <layer id="29" name="Constant_95060" type="Const" version="opset1">
323
  <data element_type="u8" shape="184190" offset="2141047" size="184190" />
324
  <output>
325
  <port id="0" precision="U8">
 
327
  </port>
328
  </output>
329
  </layer>
330
+ <layer id="30" name="Constant_95044" type="Const" version="opset1">
331
  <data element_type="i32" shape="508" offset="2325237" size="2032" />
332
  <output>
333
  <port id="0" precision="I32">
 
335
  </port>
336
  </output>
337
  </layer>
338
+ <layer id="31" name="Constant_95046" type="Const" version="opset1">
339
  <data element_type="i32" shape="508" offset="2327269" size="2032" />
340
  <output>
341
  <port id="0" precision="I32">
 
343
  </port>
344
  </output>
345
  </layer>
346
+ <layer id="32" name="Constant_95048" type="Const" version="opset1">
347
  <data element_type="u8" shape="8265" offset="2329301" size="8265" />
348
  <output>
349
  <port id="0" precision="U8">
 
351
  </port>
352
  </output>
353
  </layer>
354
+ <layer id="33" name="Constant_95061" type="Const" version="opset1">
355
  <data element_type="i32" shape="508" offset="2337566" size="2032" />
356
  <output>
357
  <port id="0" precision="I32">
 
359
  </port>
360
  </output>
361
  </layer>
362
+ <layer id="34" name="BPETokenizer_95062" type="BPETokenizer" version="extension">
363
  <data unk_token="" fuse_unk="false" suffix_indicator="" end_suffix="" byte_fallback="false" cache_capacity="20000" />
364
  <input>
365
  <port id="0" precision="I32">
 
429
  </port>
430
  </output>
431
  </layer>
432
+ <layer id="35" name="Constant_95063" type="Const" version="opset1">
433
  <data element_type="i32" shape="" offset="2339598" size="4" />
434
  <output>
435
  <port id="0" precision="I32" />
436
  </output>
437
  </layer>
438
+ <layer id="36" name="Constant_95065" type="Const" version="opset1">
439
+ <data element_type="u8" shape="4" offset="2339602" size="4" />
440
  <output>
441
  <port id="0" precision="U8">
442
+ <dim>4</dim>
443
  </port>
444
  </output>
445
  </layer>
446
+ <layer id="37" name="Constant_95067" type="Const" version="opset1">
447
+ <data element_type="u8" shape="13" offset="2339606" size="13" />
448
  <output>
449
  <port id="0" precision="U8">
450
  <dim>13</dim>
451
  </port>
452
  </output>
453
  </layer>
454
+ <layer id="38" name="Truncate_95068" type="Truncate" version="extension">
455
  <data m_num_inputs="1" />
456
  <input>
457
  <port id="0" precision="I32">
 
465
  </port>
466
  <port id="3" precision="I32" />
467
  <port id="4" precision="U8">
468
+ <dim>4</dim>
469
  </port>
470
  <port id="5" precision="U8">
471
  <dim>13</dim>
 
483
  </port>
484
  </output>
485
  </layer>
486
+ <layer id="39" name="Constant_95072" type="Const" version="opset1">
487
  <data element_type="i32" shape="2" offset="8" size="8" />
488
  <output>
489
  <port id="0" precision="I32">
 
491
  </port>
492
  </output>
493
  </layer>
494
+ <layer id="40" name="CombineSegments_95073" type="CombineSegments" version="extension">
495
  <input>
496
  <port id="0" precision="I32" />
497
  <port id="1" precision="I32" />
 
532
  </port>
533
  </output>
534
  </layer>
535
+ <layer id="41" name="Subtract_95074" type="Subtract" version="opset1">
536
  <data auto_broadcast="numpy" />
537
  <input>
538
  <port id="0" precision="I32">
 
548
  </port>
549
  </output>
550
  </layer>
551
+ <layer id="42" name="Constant_95075" type="Const" version="opset1">
552
  <data element_type="i32" shape="" offset="0" size="4" />
553
  <output>
554
  <port id="0" precision="I32" />
555
  </output>
556
  </layer>
557
+ <layer id="43" name="ReduceMax_95076" type="ReduceMax" version="opset1">
558
  <data keep_dims="false" />
559
  <input>
560
  <port id="0" precision="I32">
 
566
  <port id="2" precision="I32" />
567
  </output>
568
  </layer>
569
+ <layer id="44" name="Constant_95077" type="Const" version="opset1">
570
  <data element_type="i32" shape="" offset="0" size="4" />
571
  <output>
572
  <port id="0" precision="I32" />
573
  </output>
574
  </layer>
575
+ <layer id="45" name="RaggedToDense_95078" type="RaggedToDense" version="extension">
576
+ <data pad_right="false" m_pad_max_length="false" />
577
  <input>
578
  <port id="0" precision="I32">
579
  <dim>-1</dim>
 
598
  </port>
599
  </output>
600
  </layer>
601
+ <layer id="46" name="Convert_95079" type="Convert" version="opset1">
602
  <data destination_type="i32" />
603
  <input>
604
  <port id="0" precision="BOOL">
 
613
  </port>
614
  </output>
615
  </layer>
616
+ <layer id="47" name="Convert_95079.0" type="Convert" version="opset1">
617
  <data destination_type="i64" />
618
  <input>
619
  <port id="0" precision="I32">
 
628
  </port>
629
  </output>
630
  </layer>
631
+ <layer id="48" name="RaggedToDense_95078.0" type="Convert" version="opset1">
632
  <data destination_type="i64" />
633
  <input>
634
  <port id="0" precision="I32">
 
643
  </port>
644
  </output>
645
  </layer>
646
+ <layer id="49" name="Result_95082" type="Result" version="opset1" output_names="input_ids">
647
  <input>
648
  <port id="0" precision="I64">
649
  <dim>-1</dim>
 
651
  </port>
652
  </input>
653
  </layer>
654
+ <layer id="50" name="Result_95084" type="Result" version="opset1" output_names="attention_mask">
655
  <input>
656
  <port id="0" precision="I64">
657
  <dim>-1</dim>
 
734
  <edge from-layer="48" from-port="1" to-layer="49" to-port="0" />
735
  </edges>
736
  <rt_info>
737
+ <info name="OpenVINO Runtime" value="2026.3.0-22451-8a17657b995-releases/2026/3" />
738
  <add_attention_mask value="True" />
739
  <add_prefix_space />
740
  <add_special_tokens value="True" />
741
  <bos_token_id value="1" />
742
+ <chat_template value="{{- bos_token -}}&#10;{%- set preserve_thinking = preserve_thinking | default(keep_past_thinking | default(false)) -%}&#10;&#10;{%- macro format_arg_value(arg_value) -%}&#10; {%- if arg_value is string -%}&#10; {{- &quot;'&quot; + (arg_value | replace(&quot;\\&quot;, &quot;\\\\&quot;) | replace(&quot;'&quot;, &quot;\\'&quot;) | replace(&quot;\n&quot;, &quot;\\n&quot;) | replace(&quot;\r&quot;, &quot;\\r&quot;)) + &quot;'&quot; -}}&#10; {%- elif arg_value is mapping or arg_value is iterable -%}&#10; {{- arg_value | tojson -}}&#10; {%- else -%}&#10; {{- arg_value | string -}}&#10; {%- endif -%}&#10;{%- endmacro -%}&#10;&#10;{%- macro parse_content(content) -%}&#10; {%- if content is string -%}&#10; {{- content -}}&#10; {%- elif content is mapping -%}&#10; {{- content | tojson -}}&#10; {%- elif content is iterable -%}&#10; {%- set _ns = namespace(result=&quot;&quot;) -%}&#10; {%- for item in content -%}&#10; {%- if item is string -%}&#10; {%- set _ns.result = _ns.result + item -%}&#10; {%- elif item is mapping and item.get(&quot;type&quot;) == &quot;image&quot; -%}&#10; {%- set _ns.result = _ns.result + &quot;&lt;image>&quot; -%}&#10; {%- elif item is mapping and item.get(&quot;type&quot;) == &quot;text&quot; -%}&#10; {%- set _ns.result = _ns.result + ((item.get(&quot;text&quot;) or &quot;&quot;) | string) -%}&#10; {%- else -%}&#10; {%- set _ns.result = _ns.result + (item | tojson) -%}&#10; {%- endif -%}&#10; {%- endfor -%}&#10; {{- _ns.result -}}&#10; {%- endif -%}&#10;{%- endmacro -%}&#10;&#10;{%- macro render_tool_calls(tool_calls) -%}&#10; {%- set tool_calls_ns = namespace(tool_calls=[]) -%}&#10; {%- for tool_call in tool_calls -%}&#10; {%- set func = tool_call[&quot;function&quot;] if &quot;function&quot; in tool_call else tool_call -%}&#10; {%- set func_name = func[&quot;name&quot;] -%}&#10; {%- set func_args = func.get(&quot;arguments&quot;) -%}&#10; {%- set args_ns = namespace(arg_strings=[]) -%}&#10; {%- if func_args is mapping -%}&#10; {%- for arg_name, arg_value in func_args.items() -%}&#10; {%- set args_ns.arg_strings = args_ns.arg_strings + [arg_name + &quot;=&quot; + format_arg_value(arg_value)] -%}&#10; {%- endfor -%}&#10; {%- elif func_args is string and (func_args | trim) not in [&quot;&quot;, &quot;{}&quot;, &quot;null&quot;] -%}&#10; {{- raise_exception(&quot;Tool call arguments must be a mapping, got a JSON-encoded string: parse arguments with json.loads() before applying the chat template&quot;) -}}&#10; {%- endif -%}&#10; {%- set tool_calls_ns.tool_calls = tool_calls_ns.tool_calls + [func_name + &quot;(&quot; + (args_ns.arg_strings | join(&quot;, &quot;)) + &quot;)&quot;] -%}&#10; {%- endfor -%}&#10; {{- &quot;&lt;|tool_call_start|>[&quot; + (tool_calls_ns.tool_calls | join(&quot;, &quot;)) + &quot;]&lt;|tool_call_end|>&quot; -}}&#10;{%- endmacro -%}&#10;&#10;{%- set ns = namespace(system_prompt=&quot;&quot;, last_assistant_index=-1) -%}&#10;{%- if messages and messages[0][&quot;role&quot;] == &quot;system&quot; -%}&#10; {%- if messages[0].get(&quot;content&quot;) -%}&#10; {%- set ns.system_prompt = parse_content(messages[0][&quot;content&quot;]) -%}&#10; {%- endif -%}&#10; {%- set messages = messages[1:] -%}&#10;{%- endif -%}&#10;{%- if tools -%}&#10; {%- set ns.system_prompt = ns.system_prompt + (&quot;\n&quot; if ns.system_prompt else &quot;&quot;) + &quot;List of tools: [&quot; -%}&#10; {%- for tool in tools -%}&#10; {%- if tool is not string -%}&#10; {%- set tool = tool | tojson -%}&#10; {%- endif -%}&#10; {%- set ns.system_prompt = ns.system_prompt + tool -%}&#10; {%- if not loop.last -%}&#10; {%- set ns.system_prompt = ns.system_prompt + &quot;, &quot; -%}&#10; {%- endif -%}&#10; {%- endfor -%}&#10; {%- set ns.system_prompt = ns.system_prompt + &quot;]&quot; -%}&#10;{%- endif -%}&#10;{%- if ns.system_prompt -%}&#10; {{- &quot;&lt;|im_start|>system\n&quot; + ns.system_prompt + &quot;&lt;|im_end|>\n&quot; -}}&#10;{%- endif -%}&#10;{%- for message in messages -%}&#10; {%- if message[&quot;role&quot;] == &quot;assistant&quot; -%}&#10; {%- set ns.last_assistant_index = loop.index0 -%}&#10; {%- endif -%}&#10;{%- endfor -%}&#10;{%- for message in messages -%}&#10; {{- &quot;&lt;|im_start|>&quot; + message.role + &quot;\n&quot; -}}&#10; {%- if message.role == &quot;assistant&quot; -%}&#10; {%- generation -%}&#10; {%- set keep_thinking = preserve_thinking or loop.index0 == ns.last_assistant_index -%}&#10; {%- set thinking = message.thinking or message.reasoning or message.reasoning_content -%}&#10; {%- set thinking = thinking if thinking is string else &quot;&quot; -%}&#10; {%- if thinking and keep_thinking -%}&#10; {{- &quot;&lt;think>&quot; + thinking + &quot;&lt;/think>&quot; -}}&#10; {%- endif -%}&#10; {%- set _cfm_tag = &quot;CONTINUE_FINAL_MESSAGE_TAG &quot; -%}&#10; {%- set _has_cfm = false -%}&#10; {%- set content = &quot;&quot; -%}&#10; {%- if message.get(&quot;content&quot;) -%}&#10; {%- set content = parse_content(message.content) -%}&#10; {%- endif -%}&#10; {%- if not keep_thinking and &quot;&lt;/think>&quot; in content -%}&#10; {%- set content = content.split(&quot;&lt;/think>&quot;)[-1] | trim -%}&#10; {%- endif -%}&#10; {%- if content.endswith(_cfm_tag) -%}&#10; {%- set _has_cfm = true -%}&#10; {%- set _trunc_len = (content | length) - (_cfm_tag | length) -%}&#10; {%- set content = content[:_trunc_len] -%}&#10; {%- endif -%}&#10; {{- content -}}&#10; {%- if message.tool_calls -%}&#10; {{- render_tool_calls(message.tool_calls) -}}&#10; {%- endif -%}&#10; {%- if _has_cfm -%}&#10; {{- _cfm_tag -}}&#10; {%- endif -%}&#10; {{- &quot;&lt;|im_end|>\n&quot; -}}&#10; {%- endgeneration -%}&#10; {%- else %}&#10; {%- if message.get(&quot;content&quot;) -%}&#10; {{- parse_content(message[&quot;content&quot;]) -}}&#10; {%- endif -%}&#10; {{- &quot;&lt;|im_end|>\n&quot; -}}&#10; {%- endif %}&#10;{%- endfor -%}&#10;{%- if add_generation_prompt -%}&#10; {{- &quot;&lt;|im_start|>assistant\n&quot; -}}&#10;{%- endif -%}&#10;" />
743
  <clean_up_tokenization_spaces />
744
  <detokenizer_input_type value="i64" />
745
  <eos_token_id value="7" />
746
  <handle_special_tokens_with_re />
747
  <max_length />
748
  <number_of_inputs value="1" />
749
+ <openvino_tokenizers_version value="2026.3.0.0-703-183c6f25cda" />
750
+ <openvino_version value="2026.3.0-22451-8a17657b995-releases/2026/3" />
751
  <original_post_processor_template value="{&quot;type&quot;: &quot;Sequence&quot;, &quot;processors&quot;: [{&quot;type&quot;: &quot;ByteLevel&quot;, &quot;add_prefix_space&quot;: true, &quot;trim_offsets&quot;: false, &quot;use_regex&quot;: true}, {&quot;type&quot;: &quot;TemplateProcessing&quot;, &quot;single&quot;: [{&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;A&quot;, &quot;type_id&quot;: 0}}], &quot;pair&quot;: [{&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;A&quot;, &quot;type_id&quot;: 0}}, {&quot;SpecialToken&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;type_id&quot;: 0}}, {&quot;Sequence&quot;: {&quot;id&quot;: &quot;B&quot;, &quot;type_id&quot;: 0}}], &quot;special_tokens&quot;: {&quot;&lt;|startoftext|>&quot;: {&quot;id&quot;: &quot;&lt;|startoftext|>&quot;, &quot;ids&quot;: [1], &quot;tokens&quot;: [&quot;&lt;|startoftext|>&quot;]}}}]}" />
752
+ <original_tokenizer_class value="&lt;class 'transformers.tokenization_utils_tokenizers.TokenizersBackend'>" />
753
  <pad_token_id value="0" />
754
  <processed_post_processor_template value="{&quot;single&quot;: {&quot;ids&quot;: [1, -1], &quot;type_ids&quot;: [0, 0]}, &quot;pair&quot;: {&quot;ids&quot;: [1, -1, 1, -2], &quot;type_ids&quot;: [0, 0, 0, 0]}}" />
755
  <skip_special_tokens value="True" />
756
  <streaming_detokenizer value="False" />
757
  <tokenizer_output_type value="i64" />
758
  <tokenizers_version value="0.22.2" />
759
+ <transformers_version value="5.2.0" />
760
  <use_max_padding value="False" />
761
  <use_sentencepiece_backend value="False" />
762
  <utf8_replace_mode value="replace" />
tokenizer.json CHANGED
@@ -100,7 +100,7 @@
100
  "lstrip": false,
101
  "rstrip": false,
102
  "normalized": false,
103
- "special": true
104
  },
105
  {
106
  "id": 11,
@@ -109,7 +109,7 @@
109
  "lstrip": false,
110
  "rstrip": false,
111
  "normalized": false,
112
- "special": true
113
  },
114
  {
115
  "id": 12,
@@ -4501,7 +4501,7 @@
4501
  "lstrip": false,
4502
  "rstrip": false,
4503
  "normalized": true,
4504
- "special": true
4505
  },
4506
  {
4507
  "id": 64014,
@@ -4510,7 +4510,7 @@
4510
  "lstrip": false,
4511
  "rstrip": false,
4512
  "normalized": true,
4513
- "special": true
4514
  },
4515
  {
4516
  "id": 64394,
@@ -4573,7 +4573,7 @@
4573
  "lstrip": false,
4574
  "rstrip": false,
4575
  "normalized": false,
4576
- "special": true
4577
  },
4578
  {
4579
  "id": 64401,
@@ -4582,7 +4582,7 @@
4582
  "lstrip": false,
4583
  "rstrip": false,
4584
  "normalized": false,
4585
- "special": true
4586
  }
4587
  ],
4588
  "normalizer": null,
 
100
  "lstrip": false,
101
  "rstrip": false,
102
  "normalized": false,
103
+ "special": false
104
  },
105
  {
106
  "id": 11,
 
109
  "lstrip": false,
110
  "rstrip": false,
111
  "normalized": false,
112
+ "special": false
113
  },
114
  {
115
  "id": 12,
 
4501
  "lstrip": false,
4502
  "rstrip": false,
4503
  "normalized": true,
4504
+ "special": false
4505
  },
4506
  {
4507
  "id": 64014,
 
4510
  "lstrip": false,
4511
  "rstrip": false,
4512
  "normalized": true,
4513
+ "special": false
4514
  },
4515
  {
4516
  "id": 64394,
 
4573
  "lstrip": false,
4574
  "rstrip": false,
4575
  "normalized": false,
4576
+ "special": false
4577
  },
4578
  {
4579
  "id": 64401,
 
4582
  "lstrip": false,
4583
  "rstrip": false,
4584
  "normalized": false,
4585
+ "special": false
4586
  }
4587
  ],
4588
  "normalizer": null,
tokenizer_config.json CHANGED
@@ -1,4083 +1,21 @@
1
  {
2
- "added_tokens_decoder": {
3
- "0": {
4
- "content": "<|pad|>",
5
- "lstrip": false,
6
- "normalized": false,
7
- "rstrip": false,
8
- "single_word": false,
9
- "special": true
10
- },
11
- "1": {
12
- "content": "<|startoftext|>",
13
- "lstrip": false,
14
- "normalized": false,
15
- "rstrip": false,
16
- "single_word": false,
17
- "special": true
18
- },
19
- "2": {
20
- "content": "<|endoftext|>",
21
- "lstrip": false,
22
- "normalized": false,
23
- "rstrip": false,
24
- "single_word": false,
25
- "special": true
26
- },
27
- "3": {
28
- "content": "<|fim_pre|>",
29
- "lstrip": false,
30
- "normalized": false,
31
- "rstrip": false,
32
- "single_word": false,
33
- "special": true
34
- },
35
- "4": {
36
- "content": "<|fim_mid|>",
37
- "lstrip": false,
38
- "normalized": false,
39
- "rstrip": false,
40
- "single_word": false,
41
- "special": true
42
- },
43
- "5": {
44
- "content": "<|fim_suf|>",
45
- "lstrip": false,
46
- "normalized": false,
47
- "rstrip": false,
48
- "single_word": false,
49
- "special": true
50
- },
51
- "6": {
52
- "content": "<|im_start|>",
53
- "lstrip": false,
54
- "normalized": false,
55
- "rstrip": false,
56
- "single_word": false,
57
- "special": true
58
- },
59
- "7": {
60
- "content": "<|im_end|>",
61
- "lstrip": false,
62
- "normalized": false,
63
- "rstrip": false,
64
- "single_word": false,
65
- "special": true
66
- },
67
- "8": {
68
- "content": "<|tool_list_start|>",
69
- "lstrip": false,
70
- "normalized": false,
71
- "rstrip": false,
72
- "single_word": false,
73
- "special": true
74
- },
75
- "9": {
76
- "content": "<|tool_list_end|>",
77
- "lstrip": false,
78
- "normalized": false,
79
- "rstrip": false,
80
- "single_word": false,
81
- "special": true
82
- },
83
- "10": {
84
- "content": "<|tool_call_start|>",
85
- "lstrip": false,
86
- "normalized": false,
87
- "rstrip": false,
88
- "single_word": false,
89
- "special": true
90
- },
91
- "11": {
92
- "content": "<|tool_call_end|>",
93
- "lstrip": false,
94
- "normalized": false,
95
- "rstrip": false,
96
- "single_word": false,
97
- "special": true
98
- },
99
- "12": {
100
- "content": "<|tool_response_start|>",
101
- "lstrip": false,
102
- "normalized": false,
103
- "rstrip": false,
104
- "single_word": false,
105
- "special": true
106
- },
107
- "13": {
108
- "content": "<|tool_response_end|>",
109
- "lstrip": false,
110
- "normalized": false,
111
- "rstrip": false,
112
- "single_word": false,
113
- "special": true
114
- },
115
- "16": {
116
- "content": "<|reserved_6|>",
117
- "lstrip": false,
118
- "normalized": false,
119
- "rstrip": false,
120
- "single_word": false,
121
- "special": true
122
- },
123
- "17": {
124
- "content": "<|reserved_7|>",
125
- "lstrip": false,
126
- "normalized": false,
127
- "rstrip": false,
128
- "single_word": false,
129
- "special": true
130
- },
131
- "18": {
132
- "content": "<|reserved_8|>",
133
- "lstrip": false,
134
- "normalized": false,
135
- "rstrip": false,
136
- "single_word": false,
137
- "special": true
138
- },
139
- "19": {
140
- "content": "<|reserved_9|>",
141
- "lstrip": false,
142
- "normalized": false,
143
- "rstrip": false,
144
- "single_word": false,
145
- "special": true
146
- },
147
- "20": {
148
- "content": "<|reserved_10|>",
149
- "lstrip": false,
150
- "normalized": false,
151
- "rstrip": false,
152
- "single_word": false,
153
- "special": true
154
- },
155
- "21": {
156
- "content": "<|reserved_11|>",
157
- "lstrip": false,
158
- "normalized": false,
159
- "rstrip": false,
160
- "single_word": false,
161
- "special": true
162
- },
163
- "22": {
164
- "content": "<|reserved_12|>",
165
- "lstrip": false,
166
- "normalized": false,
167
- "rstrip": false,
168
- "single_word": false,
169
- "special": true
170
- },
171
- "23": {
172
- "content": "<|reserved_13|>",
173
- "lstrip": false,
174
- "normalized": false,
175
- "rstrip": false,
176
- "single_word": false,
177
- "special": true
178
- },
179
- "24": {
180
- "content": "<|reserved_14|>",
181
- "lstrip": false,
182
- "normalized": false,
183
- "rstrip": false,
184
- "single_word": false,
185
- "special": true
186
- },
187
- "25": {
188
- "content": "<|reserved_15|>",
189
- "lstrip": false,
190
- "normalized": false,
191
- "rstrip": false,
192
- "single_word": false,
193
- "special": true
194
- },
195
- "26": {
196
- "content": "<|reserved_16|>",
197
- "lstrip": false,
198
- "normalized": false,
199
- "rstrip": false,
200
- "single_word": false,
201
- "special": true
202
- },
203
- "27": {
204
- "content": "<|reserved_17|>",
205
- "lstrip": false,
206
- "normalized": false,
207
- "rstrip": false,
208
- "single_word": false,
209
- "special": true
210
- },
211
- "28": {
212
- "content": "<|reserved_18|>",
213
- "lstrip": false,
214
- "normalized": false,
215
- "rstrip": false,
216
- "single_word": false,
217
- "special": true
218
- },
219
- "29": {
220
- "content": "<|reserved_19|>",
221
- "lstrip": false,
222
- "normalized": false,
223
- "rstrip": false,
224
- "single_word": false,
225
- "special": true
226
- },
227
- "30": {
228
- "content": "<|reserved_20|>",
229
- "lstrip": false,
230
- "normalized": false,
231
- "rstrip": false,
232
- "single_word": false,
233
- "special": true
234
- },
235
- "31": {
236
- "content": "<|reserved_21|>",
237
- "lstrip": false,
238
- "normalized": false,
239
- "rstrip": false,
240
- "single_word": false,
241
- "special": true
242
- },
243
- "32": {
244
- "content": "<|reserved_22|>",
245
- "lstrip": false,
246
- "normalized": false,
247
- "rstrip": false,
248
- "single_word": false,
249
- "special": true
250
- },
251
- "33": {
252
- "content": "<|reserved_23|>",
253
- "lstrip": false,
254
- "normalized": false,
255
- "rstrip": false,
256
- "single_word": false,
257
- "special": true
258
- },
259
- "34": {
260
- "content": "<|reserved_24|>",
261
- "lstrip": false,
262
- "normalized": false,
263
- "rstrip": false,
264
- "single_word": false,
265
- "special": true
266
- },
267
- "35": {
268
- "content": "<|reserved_25|>",
269
- "lstrip": false,
270
- "normalized": false,
271
- "rstrip": false,
272
- "single_word": false,
273
- "special": true
274
- },
275
- "36": {
276
- "content": "<|reserved_26|>",
277
- "lstrip": false,
278
- "normalized": false,
279
- "rstrip": false,
280
- "single_word": false,
281
- "special": true
282
- },
283
- "37": {
284
- "content": "<|reserved_27|>",
285
- "lstrip": false,
286
- "normalized": false,
287
- "rstrip": false,
288
- "single_word": false,
289
- "special": true
290
- },
291
- "38": {
292
- "content": "<|reserved_28|>",
293
- "lstrip": false,
294
- "normalized": false,
295
- "rstrip": false,
296
- "single_word": false,
297
- "special": true
298
- },
299
- "39": {
300
- "content": "<|reserved_29|>",
301
- "lstrip": false,
302
- "normalized": false,
303
- "rstrip": false,
304
- "single_word": false,
305
- "special": true
306
- },
307
- "40": {
308
- "content": "<|reserved_30|>",
309
- "lstrip": false,
310
- "normalized": false,
311
- "rstrip": false,
312
- "single_word": false,
313
- "special": true
314
- },
315
- "41": {
316
- "content": "<|reserved_31|>",
317
- "lstrip": false,
318
- "normalized": false,
319
- "rstrip": false,
320
- "single_word": false,
321
- "special": true
322
- },
323
- "42": {
324
- "content": "<|reserved_32|>",
325
- "lstrip": false,
326
- "normalized": false,
327
- "rstrip": false,
328
- "single_word": false,
329
- "special": true
330
- },
331
- "43": {
332
- "content": "<|reserved_33|>",
333
- "lstrip": false,
334
- "normalized": false,
335
- "rstrip": false,
336
- "single_word": false,
337
- "special": true
338
- },
339
- "44": {
340
- "content": "<|reserved_34|>",
341
- "lstrip": false,
342
- "normalized": false,
343
- "rstrip": false,
344
- "single_word": false,
345
- "special": true
346
- },
347
- "45": {
348
- "content": "<|reserved_35|>",
349
- "lstrip": false,
350
- "normalized": false,
351
- "rstrip": false,
352
- "single_word": false,
353
- "special": true
354
- },
355
- "46": {
356
- "content": "<|reserved_36|>",
357
- "lstrip": false,
358
- "normalized": false,
359
- "rstrip": false,
360
- "single_word": false,
361
- "special": true
362
- },
363
- "47": {
364
- "content": "<|reserved_37|>",
365
- "lstrip": false,
366
- "normalized": false,
367
- "rstrip": false,
368
- "single_word": false,
369
- "special": true
370
- },
371
- "48": {
372
- "content": "<|reserved_38|>",
373
- "lstrip": false,
374
- "normalized": false,
375
- "rstrip": false,
376
- "single_word": false,
377
- "special": true
378
- },
379
- "49": {
380
- "content": "<|reserved_39|>",
381
- "lstrip": false,
382
- "normalized": false,
383
- "rstrip": false,
384
- "single_word": false,
385
- "special": true
386
- },
387
- "50": {
388
- "content": "<|reserved_40|>",
389
- "lstrip": false,
390
- "normalized": false,
391
- "rstrip": false,
392
- "single_word": false,
393
- "special": true
394
- },
395
- "51": {
396
- "content": "<|reserved_41|>",
397
- "lstrip": false,
398
- "normalized": false,
399
- "rstrip": false,
400
- "single_word": false,
401
- "special": true
402
- },
403
- "52": {
404
- "content": "<|reserved_42|>",
405
- "lstrip": false,
406
- "normalized": false,
407
- "rstrip": false,
408
- "single_word": false,
409
- "special": true
410
- },
411
- "53": {
412
- "content": "<|reserved_43|>",
413
- "lstrip": false,
414
- "normalized": false,
415
- "rstrip": false,
416
- "single_word": false,
417
- "special": true
418
- },
419
- "54": {
420
- "content": "<|reserved_44|>",
421
- "lstrip": false,
422
- "normalized": false,
423
- "rstrip": false,
424
- "single_word": false,
425
- "special": true
426
- },
427
- "55": {
428
- "content": "<|reserved_45|>",
429
- "lstrip": false,
430
- "normalized": false,
431
- "rstrip": false,
432
- "single_word": false,
433
- "special": true
434
- },
435
- "56": {
436
- "content": "<|reserved_46|>",
437
- "lstrip": false,
438
- "normalized": false,
439
- "rstrip": false,
440
- "single_word": false,
441
- "special": true
442
- },
443
- "57": {
444
- "content": "<|reserved_47|>",
445
- "lstrip": false,
446
- "normalized": false,
447
- "rstrip": false,
448
- "single_word": false,
449
- "special": true
450
- },
451
- "58": {
452
- "content": "<|reserved_48|>",
453
- "lstrip": false,
454
- "normalized": false,
455
- "rstrip": false,
456
- "single_word": false,
457
- "special": true
458
- },
459
- "59": {
460
- "content": "<|reserved_49|>",
461
- "lstrip": false,
462
- "normalized": false,
463
- "rstrip": false,
464
- "single_word": false,
465
- "special": true
466
- },
467
- "60": {
468
- "content": "<|reserved_50|>",
469
- "lstrip": false,
470
- "normalized": false,
471
- "rstrip": false,
472
- "single_word": false,
473
- "special": true
474
- },
475
- "61": {
476
- "content": "<|reserved_51|>",
477
- "lstrip": false,
478
- "normalized": false,
479
- "rstrip": false,
480
- "single_word": false,
481
- "special": true
482
- },
483
- "62": {
484
- "content": "<|reserved_52|>",
485
- "lstrip": false,
486
- "normalized": false,
487
- "rstrip": false,
488
- "single_word": false,
489
- "special": true
490
- },
491
- "63": {
492
- "content": "<|reserved_53|>",
493
- "lstrip": false,
494
- "normalized": false,
495
- "rstrip": false,
496
- "single_word": false,
497
- "special": true
498
- },
499
- "64": {
500
- "content": "<|reserved_54|>",
501
- "lstrip": false,
502
- "normalized": false,
503
- "rstrip": false,
504
- "single_word": false,
505
- "special": true
506
- },
507
- "65": {
508
- "content": "<|reserved_55|>",
509
- "lstrip": false,
510
- "normalized": false,
511
- "rstrip": false,
512
- "single_word": false,
513
- "special": true
514
- },
515
- "66": {
516
- "content": "<|reserved_56|>",
517
- "lstrip": false,
518
- "normalized": false,
519
- "rstrip": false,
520
- "single_word": false,
521
- "special": true
522
- },
523
- "67": {
524
- "content": "<|reserved_57|>",
525
- "lstrip": false,
526
- "normalized": false,
527
- "rstrip": false,
528
- "single_word": false,
529
- "special": true
530
- },
531
- "68": {
532
- "content": "<|reserved_58|>",
533
- "lstrip": false,
534
- "normalized": false,
535
- "rstrip": false,
536
- "single_word": false,
537
- "special": true
538
- },
539
- "69": {
540
- "content": "<|reserved_59|>",
541
- "lstrip": false,
542
- "normalized": false,
543
- "rstrip": false,
544
- "single_word": false,
545
- "special": true
546
- },
547
- "70": {
548
- "content": "<|reserved_60|>",
549
- "lstrip": false,
550
- "normalized": false,
551
- "rstrip": false,
552
- "single_word": false,
553
- "special": true
554
- },
555
- "71": {
556
- "content": "<|reserved_61|>",
557
- "lstrip": false,
558
- "normalized": false,
559
- "rstrip": false,
560
- "single_word": false,
561
- "special": true
562
- },
563
- "72": {
564
- "content": "<|reserved_62|>",
565
- "lstrip": false,
566
- "normalized": false,
567
- "rstrip": false,
568
- "single_word": false,
569
- "special": true
570
- },
571
- "73": {
572
- "content": "<|reserved_63|>",
573
- "lstrip": false,
574
- "normalized": false,
575
- "rstrip": false,
576
- "single_word": false,
577
- "special": true
578
- },
579
- "74": {
580
- "content": "<|reserved_64|>",
581
- "lstrip": false,
582
- "normalized": false,
583
- "rstrip": false,
584
- "single_word": false,
585
- "special": true
586
- },
587
- "75": {
588
- "content": "<|reserved_65|>",
589
- "lstrip": false,
590
- "normalized": false,
591
- "rstrip": false,
592
- "single_word": false,
593
- "special": true
594
- },
595
- "76": {
596
- "content": "<|reserved_66|>",
597
- "lstrip": false,
598
- "normalized": false,
599
- "rstrip": false,
600
- "single_word": false,
601
- "special": true
602
- },
603
- "77": {
604
- "content": "<|reserved_67|>",
605
- "lstrip": false,
606
- "normalized": false,
607
- "rstrip": false,
608
- "single_word": false,
609
- "special": true
610
- },
611
- "78": {
612
- "content": "<|reserved_68|>",
613
- "lstrip": false,
614
- "normalized": false,
615
- "rstrip": false,
616
- "single_word": false,
617
- "special": true
618
- },
619
- "79": {
620
- "content": "<|reserved_69|>",
621
- "lstrip": false,
622
- "normalized": false,
623
- "rstrip": false,
624
- "single_word": false,
625
- "special": true
626
- },
627
- "80": {
628
- "content": "<|reserved_70|>",
629
- "lstrip": false,
630
- "normalized": false,
631
- "rstrip": false,
632
- "single_word": false,
633
- "special": true
634
- },
635
- "81": {
636
- "content": "<|reserved_71|>",
637
- "lstrip": false,
638
- "normalized": false,
639
- "rstrip": false,
640
- "single_word": false,
641
- "special": true
642
- },
643
- "82": {
644
- "content": "<|reserved_72|>",
645
- "lstrip": false,
646
- "normalized": false,
647
- "rstrip": false,
648
- "single_word": false,
649
- "special": true
650
- },
651
- "83": {
652
- "content": "<|reserved_73|>",
653
- "lstrip": false,
654
- "normalized": false,
655
- "rstrip": false,
656
- "single_word": false,
657
- "special": true
658
- },
659
- "84": {
660
- "content": "<|reserved_74|>",
661
- "lstrip": false,
662
- "normalized": false,
663
- "rstrip": false,
664
- "single_word": false,
665
- "special": true
666
- },
667
- "85": {
668
- "content": "<|reserved_75|>",
669
- "lstrip": false,
670
- "normalized": false,
671
- "rstrip": false,
672
- "single_word": false,
673
- "special": true
674
- },
675
- "86": {
676
- "content": "<|reserved_76|>",
677
- "lstrip": false,
678
- "normalized": false,
679
- "rstrip": false,
680
- "single_word": false,
681
- "special": true
682
- },
683
- "87": {
684
- "content": "<|reserved_77|>",
685
- "lstrip": false,
686
- "normalized": false,
687
- "rstrip": false,
688
- "single_word": false,
689
- "special": true
690
- },
691
- "88": {
692
- "content": "<|reserved_78|>",
693
- "lstrip": false,
694
- "normalized": false,
695
- "rstrip": false,
696
- "single_word": false,
697
- "special": true
698
- },
699
- "89": {
700
- "content": "<|reserved_79|>",
701
- "lstrip": false,
702
- "normalized": false,
703
- "rstrip": false,
704
- "single_word": false,
705
- "special": true
706
- },
707
- "90": {
708
- "content": "<|reserved_80|>",
709
- "lstrip": false,
710
- "normalized": false,
711
- "rstrip": false,
712
- "single_word": false,
713
- "special": true
714
- },
715
- "91": {
716
- "content": "<|reserved_81|>",
717
- "lstrip": false,
718
- "normalized": false,
719
- "rstrip": false,
720
- "single_word": false,
721
- "special": true
722
- },
723
- "92": {
724
- "content": "<|reserved_82|>",
725
- "lstrip": false,
726
- "normalized": false,
727
- "rstrip": false,
728
- "single_word": false,
729
- "special": true
730
- },
731
- "93": {
732
- "content": "<|reserved_83|>",
733
- "lstrip": false,
734
- "normalized": false,
735
- "rstrip": false,
736
- "single_word": false,
737
- "special": true
738
- },
739
- "94": {
740
- "content": "<|reserved_84|>",
741
- "lstrip": false,
742
- "normalized": false,
743
- "rstrip": false,
744
- "single_word": false,
745
- "special": true
746
- },
747
- "95": {
748
- "content": "<|reserved_85|>",
749
- "lstrip": false,
750
- "normalized": false,
751
- "rstrip": false,
752
- "single_word": false,
753
- "special": true
754
- },
755
- "96": {
756
- "content": "<|reserved_86|>",
757
- "lstrip": false,
758
- "normalized": false,
759
- "rstrip": false,
760
- "single_word": false,
761
- "special": true
762
- },
763
- "97": {
764
- "content": "<|reserved_87|>",
765
- "lstrip": false,
766
- "normalized": false,
767
- "rstrip": false,
768
- "single_word": false,
769
- "special": true
770
- },
771
- "98": {
772
- "content": "<|reserved_88|>",
773
- "lstrip": false,
774
- "normalized": false,
775
- "rstrip": false,
776
- "single_word": false,
777
- "special": true
778
- },
779
- "99": {
780
- "content": "<|reserved_89|>",
781
- "lstrip": false,
782
- "normalized": false,
783
- "rstrip": false,
784
- "single_word": false,
785
- "special": true
786
- },
787
- "100": {
788
- "content": "<|reserved_90|>",
789
- "lstrip": false,
790
- "normalized": false,
791
- "rstrip": false,
792
- "single_word": false,
793
- "special": true
794
- },
795
- "101": {
796
- "content": "<|reserved_91|>",
797
- "lstrip": false,
798
- "normalized": false,
799
- "rstrip": false,
800
- "single_word": false,
801
- "special": true
802
- },
803
- "102": {
804
- "content": "<|reserved_92|>",
805
- "lstrip": false,
806
- "normalized": false,
807
- "rstrip": false,
808
- "single_word": false,
809
- "special": true
810
- },
811
- "103": {
812
- "content": "<|reserved_93|>",
813
- "lstrip": false,
814
- "normalized": false,
815
- "rstrip": false,
816
- "single_word": false,
817
- "special": true
818
- },
819
- "104": {
820
- "content": "<|reserved_94|>",
821
- "lstrip": false,
822
- "normalized": false,
823
- "rstrip": false,
824
- "single_word": false,
825
- "special": true
826
- },
827
- "105": {
828
- "content": "<|reserved_95|>",
829
- "lstrip": false,
830
- "normalized": false,
831
- "rstrip": false,
832
- "single_word": false,
833
- "special": true
834
- },
835
- "106": {
836
- "content": "<|reserved_96|>",
837
- "lstrip": false,
838
- "normalized": false,
839
- "rstrip": false,
840
- "single_word": false,
841
- "special": true
842
- },
843
- "107": {
844
- "content": "<|reserved_97|>",
845
- "lstrip": false,
846
- "normalized": false,
847
- "rstrip": false,
848
- "single_word": false,
849
- "special": true
850
- },
851
- "108": {
852
- "content": "<|reserved_98|>",
853
- "lstrip": false,
854
- "normalized": false,
855
- "rstrip": false,
856
- "single_word": false,
857
- "special": true
858
- },
859
- "109": {
860
- "content": "<|reserved_99|>",
861
- "lstrip": false,
862
- "normalized": false,
863
- "rstrip": false,
864
- "single_word": false,
865
- "special": true
866
- },
867
- "110": {
868
- "content": "<|reserved_100|>",
869
- "lstrip": false,
870
- "normalized": false,
871
- "rstrip": false,
872
- "single_word": false,
873
- "special": true
874
- },
875
- "111": {
876
- "content": "<|reserved_101|>",
877
- "lstrip": false,
878
- "normalized": false,
879
- "rstrip": false,
880
- "single_word": false,
881
- "special": true
882
- },
883
- "112": {
884
- "content": "<|reserved_102|>",
885
- "lstrip": false,
886
- "normalized": false,
887
- "rstrip": false,
888
- "single_word": false,
889
- "special": true
890
- },
891
- "113": {
892
- "content": "<|reserved_103|>",
893
- "lstrip": false,
894
- "normalized": false,
895
- "rstrip": false,
896
- "single_word": false,
897
- "special": true
898
- },
899
- "114": {
900
- "content": "<|reserved_104|>",
901
- "lstrip": false,
902
- "normalized": false,
903
- "rstrip": false,
904
- "single_word": false,
905
- "special": true
906
- },
907
- "115": {
908
- "content": "<|reserved_105|>",
909
- "lstrip": false,
910
- "normalized": false,
911
- "rstrip": false,
912
- "single_word": false,
913
- "special": true
914
- },
915
- "116": {
916
- "content": "<|reserved_106|>",
917
- "lstrip": false,
918
- "normalized": false,
919
- "rstrip": false,
920
- "single_word": false,
921
- "special": true
922
- },
923
- "117": {
924
- "content": "<|reserved_107|>",
925
- "lstrip": false,
926
- "normalized": false,
927
- "rstrip": false,
928
- "single_word": false,
929
- "special": true
930
- },
931
- "118": {
932
- "content": "<|reserved_108|>",
933
- "lstrip": false,
934
- "normalized": false,
935
- "rstrip": false,
936
- "single_word": false,
937
- "special": true
938
- },
939
- "119": {
940
- "content": "<|reserved_109|>",
941
- "lstrip": false,
942
- "normalized": false,
943
- "rstrip": false,
944
- "single_word": false,
945
- "special": true
946
- },
947
- "120": {
948
- "content": "<|reserved_110|>",
949
- "lstrip": false,
950
- "normalized": false,
951
- "rstrip": false,
952
- "single_word": false,
953
- "special": true
954
- },
955
- "121": {
956
- "content": "<|reserved_111|>",
957
- "lstrip": false,
958
- "normalized": false,
959
- "rstrip": false,
960
- "single_word": false,
961
- "special": true
962
- },
963
- "122": {
964
- "content": "<|reserved_112|>",
965
- "lstrip": false,
966
- "normalized": false,
967
- "rstrip": false,
968
- "single_word": false,
969
- "special": true
970
- },
971
- "123": {
972
- "content": "<|reserved_113|>",
973
- "lstrip": false,
974
- "normalized": false,
975
- "rstrip": false,
976
- "single_word": false,
977
- "special": true
978
- },
979
- "124": {
980
- "content": "<|reserved_114|>",
981
- "lstrip": false,
982
- "normalized": false,
983
- "rstrip": false,
984
- "single_word": false,
985
- "special": true
986
- },
987
- "125": {
988
- "content": "<|reserved_115|>",
989
- "lstrip": false,
990
- "normalized": false,
991
- "rstrip": false,
992
- "single_word": false,
993
- "special": true
994
- },
995
- "126": {
996
- "content": "<|reserved_116|>",
997
- "lstrip": false,
998
- "normalized": false,
999
- "rstrip": false,
1000
- "single_word": false,
1001
- "special": true
1002
- },
1003
- "127": {
1004
- "content": "<|reserved_117|>",
1005
- "lstrip": false,
1006
- "normalized": false,
1007
- "rstrip": false,
1008
- "single_word": false,
1009
- "special": true
1010
- },
1011
- "128": {
1012
- "content": "<|audio_start|>",
1013
- "lstrip": false,
1014
- "normalized": false,
1015
- "rstrip": false,
1016
- "single_word": false,
1017
- "special": true
1018
- },
1019
- "129": {
1020
- "content": "<|text_start|>",
1021
- "lstrip": false,
1022
- "normalized": false,
1023
- "rstrip": false,
1024
- "single_word": false,
1025
- "special": true
1026
- },
1027
- "130": {
1028
- "content": "<|text_end|>",
1029
- "lstrip": false,
1030
- "normalized": false,
1031
- "rstrip": false,
1032
- "single_word": false,
1033
- "special": true
1034
- },
1035
- "131": {
1036
- "content": "<|mixed_start|>",
1037
- "lstrip": false,
1038
- "normalized": false,
1039
- "rstrip": false,
1040
- "single_word": false,
1041
- "special": true
1042
- },
1043
- "132": {
1044
- "content": "<|mixed_end|>",
1045
- "lstrip": false,
1046
- "normalized": false,
1047
- "rstrip": false,
1048
- "single_word": false,
1049
- "special": true
1050
- },
1051
- "133": {
1052
- "content": "<|reserved_123|>",
1053
- "lstrip": false,
1054
- "normalized": false,
1055
- "rstrip": false,
1056
- "single_word": false,
1057
- "special": true
1058
- },
1059
- "134": {
1060
- "content": "<|reserved_124|>",
1061
- "lstrip": false,
1062
- "normalized": false,
1063
- "rstrip": false,
1064
- "single_word": false,
1065
- "special": true
1066
- },
1067
- "135": {
1068
- "content": "<|reserved_125|>",
1069
- "lstrip": false,
1070
- "normalized": false,
1071
- "rstrip": false,
1072
- "single_word": false,
1073
- "special": true
1074
- },
1075
- "136": {
1076
- "content": "<|reserved_126|>",
1077
- "lstrip": false,
1078
- "normalized": false,
1079
- "rstrip": false,
1080
- "single_word": false,
1081
- "special": true
1082
- },
1083
- "137": {
1084
- "content": "<|reserved_127|>",
1085
- "lstrip": false,
1086
- "normalized": false,
1087
- "rstrip": false,
1088
- "single_word": false,
1089
- "special": true
1090
- },
1091
- "138": {
1092
- "content": "<|reserved_128|>",
1093
- "lstrip": false,
1094
- "normalized": false,
1095
- "rstrip": false,
1096
- "single_word": false,
1097
- "special": true
1098
- },
1099
- "139": {
1100
- "content": "<|reserved_129|>",
1101
- "lstrip": false,
1102
- "normalized": false,
1103
- "rstrip": false,
1104
- "single_word": false,
1105
- "special": true
1106
- },
1107
- "140": {
1108
- "content": "<|reserved_130|>",
1109
- "lstrip": false,
1110
- "normalized": false,
1111
- "rstrip": false,
1112
- "single_word": false,
1113
- "special": true
1114
- },
1115
- "141": {
1116
- "content": "<|reserved_131|>",
1117
- "lstrip": false,
1118
- "normalized": false,
1119
- "rstrip": false,
1120
- "single_word": false,
1121
- "special": true
1122
- },
1123
- "142": {
1124
- "content": "<|reserved_132|>",
1125
- "lstrip": false,
1126
- "normalized": false,
1127
- "rstrip": false,
1128
- "single_word": false,
1129
- "special": true
1130
- },
1131
- "143": {
1132
- "content": "<|reserved_133|>",
1133
- "lstrip": false,
1134
- "normalized": false,
1135
- "rstrip": false,
1136
- "single_word": false,
1137
- "special": true
1138
- },
1139
- "144": {
1140
- "content": "<|reserved_134|>",
1141
- "lstrip": false,
1142
- "normalized": false,
1143
- "rstrip": false,
1144
- "single_word": false,
1145
- "special": true
1146
- },
1147
- "145": {
1148
- "content": "<|reserved_135|>",
1149
- "lstrip": false,
1150
- "normalized": false,
1151
- "rstrip": false,
1152
- "single_word": false,
1153
- "special": true
1154
- },
1155
- "146": {
1156
- "content": "<|reserved_136|>",
1157
- "lstrip": false,
1158
- "normalized": false,
1159
- "rstrip": false,
1160
- "single_word": false,
1161
- "special": true
1162
- },
1163
- "147": {
1164
- "content": "<|reserved_137|>",
1165
- "lstrip": false,
1166
- "normalized": false,
1167
- "rstrip": false,
1168
- "single_word": false,
1169
- "special": true
1170
- },
1171
- "148": {
1172
- "content": "<|reserved_138|>",
1173
- "lstrip": false,
1174
- "normalized": false,
1175
- "rstrip": false,
1176
- "single_word": false,
1177
- "special": true
1178
- },
1179
- "149": {
1180
- "content": "<|reserved_139|>",
1181
- "lstrip": false,
1182
- "normalized": false,
1183
- "rstrip": false,
1184
- "single_word": false,
1185
- "special": true
1186
- },
1187
- "150": {
1188
- "content": "<|reserved_140|>",
1189
- "lstrip": false,
1190
- "normalized": false,
1191
- "rstrip": false,
1192
- "single_word": false,
1193
- "special": true
1194
- },
1195
- "151": {
1196
- "content": "<|reserved_141|>",
1197
- "lstrip": false,
1198
- "normalized": false,
1199
- "rstrip": false,
1200
- "single_word": false,
1201
- "special": true
1202
- },
1203
- "152": {
1204
- "content": "<|reserved_142|>",
1205
- "lstrip": false,
1206
- "normalized": false,
1207
- "rstrip": false,
1208
- "single_word": false,
1209
- "special": true
1210
- },
1211
- "153": {
1212
- "content": "<|reserved_143|>",
1213
- "lstrip": false,
1214
- "normalized": false,
1215
- "rstrip": false,
1216
- "single_word": false,
1217
- "special": true
1218
- },
1219
- "154": {
1220
- "content": "<|reserved_144|>",
1221
- "lstrip": false,
1222
- "normalized": false,
1223
- "rstrip": false,
1224
- "single_word": false,
1225
- "special": true
1226
- },
1227
- "155": {
1228
- "content": "<|reserved_145|>",
1229
- "lstrip": false,
1230
- "normalized": false,
1231
- "rstrip": false,
1232
- "single_word": false,
1233
- "special": true
1234
- },
1235
- "156": {
1236
- "content": "<|reserved_146|>",
1237
- "lstrip": false,
1238
- "normalized": false,
1239
- "rstrip": false,
1240
- "single_word": false,
1241
- "special": true
1242
- },
1243
- "157": {
1244
- "content": "<|reserved_147|>",
1245
- "lstrip": false,
1246
- "normalized": false,
1247
- "rstrip": false,
1248
- "single_word": false,
1249
- "special": true
1250
- },
1251
- "158": {
1252
- "content": "<|reserved_148|>",
1253
- "lstrip": false,
1254
- "normalized": false,
1255
- "rstrip": false,
1256
- "single_word": false,
1257
- "special": true
1258
- },
1259
- "159": {
1260
- "content": "<|reserved_149|>",
1261
- "lstrip": false,
1262
- "normalized": false,
1263
- "rstrip": false,
1264
- "single_word": false,
1265
- "special": true
1266
- },
1267
- "160": {
1268
- "content": "<|reserved_150|>",
1269
- "lstrip": false,
1270
- "normalized": false,
1271
- "rstrip": false,
1272
- "single_word": false,
1273
- "special": true
1274
- },
1275
- "161": {
1276
- "content": "<|reserved_151|>",
1277
- "lstrip": false,
1278
- "normalized": false,
1279
- "rstrip": false,
1280
- "single_word": false,
1281
- "special": true
1282
- },
1283
- "162": {
1284
- "content": "<|reserved_152|>",
1285
- "lstrip": false,
1286
- "normalized": false,
1287
- "rstrip": false,
1288
- "single_word": false,
1289
- "special": true
1290
- },
1291
- "163": {
1292
- "content": "<|reserved_153|>",
1293
- "lstrip": false,
1294
- "normalized": false,
1295
- "rstrip": false,
1296
- "single_word": false,
1297
- "special": true
1298
- },
1299
- "164": {
1300
- "content": "<|reserved_154|>",
1301
- "lstrip": false,
1302
- "normalized": false,
1303
- "rstrip": false,
1304
- "single_word": false,
1305
- "special": true
1306
- },
1307
- "165": {
1308
- "content": "<|reserved_155|>",
1309
- "lstrip": false,
1310
- "normalized": false,
1311
- "rstrip": false,
1312
- "single_word": false,
1313
- "special": true
1314
- },
1315
- "166": {
1316
- "content": "<|reserved_156|>",
1317
- "lstrip": false,
1318
- "normalized": false,
1319
- "rstrip": false,
1320
- "single_word": false,
1321
- "special": true
1322
- },
1323
- "167": {
1324
- "content": "<|reserved_157|>",
1325
- "lstrip": false,
1326
- "normalized": false,
1327
- "rstrip": false,
1328
- "single_word": false,
1329
- "special": true
1330
- },
1331
- "168": {
1332
- "content": "<|reserved_158|>",
1333
- "lstrip": false,
1334
- "normalized": false,
1335
- "rstrip": false,
1336
- "single_word": false,
1337
- "special": true
1338
- },
1339
- "169": {
1340
- "content": "<|reserved_159|>",
1341
- "lstrip": false,
1342
- "normalized": false,
1343
- "rstrip": false,
1344
- "single_word": false,
1345
- "special": true
1346
- },
1347
- "170": {
1348
- "content": "<|reserved_160|>",
1349
- "lstrip": false,
1350
- "normalized": false,
1351
- "rstrip": false,
1352
- "single_word": false,
1353
- "special": true
1354
- },
1355
- "171": {
1356
- "content": "<|reserved_161|>",
1357
- "lstrip": false,
1358
- "normalized": false,
1359
- "rstrip": false,
1360
- "single_word": false,
1361
- "special": true
1362
- },
1363
- "172": {
1364
- "content": "<|reserved_162|>",
1365
- "lstrip": false,
1366
- "normalized": false,
1367
- "rstrip": false,
1368
- "single_word": false,
1369
- "special": true
1370
- },
1371
- "173": {
1372
- "content": "<|reserved_163|>",
1373
- "lstrip": false,
1374
- "normalized": false,
1375
- "rstrip": false,
1376
- "single_word": false,
1377
- "special": true
1378
- },
1379
- "174": {
1380
- "content": "<|reserved_164|>",
1381
- "lstrip": false,
1382
- "normalized": false,
1383
- "rstrip": false,
1384
- "single_word": false,
1385
- "special": true
1386
- },
1387
- "175": {
1388
- "content": "<|reserved_165|>",
1389
- "lstrip": false,
1390
- "normalized": false,
1391
- "rstrip": false,
1392
- "single_word": false,
1393
- "special": true
1394
- },
1395
- "176": {
1396
- "content": "<|reserved_166|>",
1397
- "lstrip": false,
1398
- "normalized": false,
1399
- "rstrip": false,
1400
- "single_word": false,
1401
- "special": true
1402
- },
1403
- "177": {
1404
- "content": "<|reserved_167|>",
1405
- "lstrip": false,
1406
- "normalized": false,
1407
- "rstrip": false,
1408
- "single_word": false,
1409
- "special": true
1410
- },
1411
- "178": {
1412
- "content": "<|reserved_168|>",
1413
- "lstrip": false,
1414
- "normalized": false,
1415
- "rstrip": false,
1416
- "single_word": false,
1417
- "special": true
1418
- },
1419
- "179": {
1420
- "content": "<|reserved_169|>",
1421
- "lstrip": false,
1422
- "normalized": false,
1423
- "rstrip": false,
1424
- "single_word": false,
1425
- "special": true
1426
- },
1427
- "180": {
1428
- "content": "<|reserved_170|>",
1429
- "lstrip": false,
1430
- "normalized": false,
1431
- "rstrip": false,
1432
- "single_word": false,
1433
- "special": true
1434
- },
1435
- "181": {
1436
- "content": "<|reserved_171|>",
1437
- "lstrip": false,
1438
- "normalized": false,
1439
- "rstrip": false,
1440
- "single_word": false,
1441
- "special": true
1442
- },
1443
- "182": {
1444
- "content": "<|reserved_172|>",
1445
- "lstrip": false,
1446
- "normalized": false,
1447
- "rstrip": false,
1448
- "single_word": false,
1449
- "special": true
1450
- },
1451
- "183": {
1452
- "content": "<|reserved_173|>",
1453
- "lstrip": false,
1454
- "normalized": false,
1455
- "rstrip": false,
1456
- "single_word": false,
1457
- "special": true
1458
- },
1459
- "184": {
1460
- "content": "<|reserved_174|>",
1461
- "lstrip": false,
1462
- "normalized": false,
1463
- "rstrip": false,
1464
- "single_word": false,
1465
- "special": true
1466
- },
1467
- "185": {
1468
- "content": "<|reserved_175|>",
1469
- "lstrip": false,
1470
- "normalized": false,
1471
- "rstrip": false,
1472
- "single_word": false,
1473
- "special": true
1474
- },
1475
- "186": {
1476
- "content": "<|reserved_176|>",
1477
- "lstrip": false,
1478
- "normalized": false,
1479
- "rstrip": false,
1480
- "single_word": false,
1481
- "special": true
1482
- },
1483
- "187": {
1484
- "content": "<|reserved_177|>",
1485
- "lstrip": false,
1486
- "normalized": false,
1487
- "rstrip": false,
1488
- "single_word": false,
1489
- "special": true
1490
- },
1491
- "188": {
1492
- "content": "<|reserved_178|>",
1493
- "lstrip": false,
1494
- "normalized": false,
1495
- "rstrip": false,
1496
- "single_word": false,
1497
- "special": true
1498
- },
1499
- "189": {
1500
- "content": "<|reserved_179|>",
1501
- "lstrip": false,
1502
- "normalized": false,
1503
- "rstrip": false,
1504
- "single_word": false,
1505
- "special": true
1506
- },
1507
- "190": {
1508
- "content": "<|reserved_180|>",
1509
- "lstrip": false,
1510
- "normalized": false,
1511
- "rstrip": false,
1512
- "single_word": false,
1513
- "special": true
1514
- },
1515
- "191": {
1516
- "content": "<|reserved_181|>",
1517
- "lstrip": false,
1518
- "normalized": false,
1519
- "rstrip": false,
1520
- "single_word": false,
1521
- "special": true
1522
- },
1523
- "192": {
1524
- "content": "<|reserved_182|>",
1525
- "lstrip": false,
1526
- "normalized": false,
1527
- "rstrip": false,
1528
- "single_word": false,
1529
- "special": true
1530
- },
1531
- "193": {
1532
- "content": "<|reserved_183|>",
1533
- "lstrip": false,
1534
- "normalized": false,
1535
- "rstrip": false,
1536
- "single_word": false,
1537
- "special": true
1538
- },
1539
- "194": {
1540
- "content": "<|reserved_184|>",
1541
- "lstrip": false,
1542
- "normalized": false,
1543
- "rstrip": false,
1544
- "single_word": false,
1545
- "special": true
1546
- },
1547
- "195": {
1548
- "content": "<|reserved_185|>",
1549
- "lstrip": false,
1550
- "normalized": false,
1551
- "rstrip": false,
1552
- "single_word": false,
1553
- "special": true
1554
- },
1555
- "196": {
1556
- "content": "<|reserved_186|>",
1557
- "lstrip": false,
1558
- "normalized": false,
1559
- "rstrip": false,
1560
- "single_word": false,
1561
- "special": true
1562
- },
1563
- "197": {
1564
- "content": "<|reserved_187|>",
1565
- "lstrip": false,
1566
- "normalized": false,
1567
- "rstrip": false,
1568
- "single_word": false,
1569
- "special": true
1570
- },
1571
- "198": {
1572
- "content": "<|reserved_188|>",
1573
- "lstrip": false,
1574
- "normalized": false,
1575
- "rstrip": false,
1576
- "single_word": false,
1577
- "special": true
1578
- },
1579
- "199": {
1580
- "content": "<|reserved_189|>",
1581
- "lstrip": false,
1582
- "normalized": false,
1583
- "rstrip": false,
1584
- "single_word": false,
1585
- "special": true
1586
- },
1587
- "200": {
1588
- "content": "<|reserved_190|>",
1589
- "lstrip": false,
1590
- "normalized": false,
1591
- "rstrip": false,
1592
- "single_word": false,
1593
- "special": true
1594
- },
1595
- "201": {
1596
- "content": "<|reserved_191|>",
1597
- "lstrip": false,
1598
- "normalized": false,
1599
- "rstrip": false,
1600
- "single_word": false,
1601
- "special": true
1602
- },
1603
- "202": {
1604
- "content": "<|reserved_192|>",
1605
- "lstrip": false,
1606
- "normalized": false,
1607
- "rstrip": false,
1608
- "single_word": false,
1609
- "special": true
1610
- },
1611
- "203": {
1612
- "content": "<|reserved_193|>",
1613
- "lstrip": false,
1614
- "normalized": false,
1615
- "rstrip": false,
1616
- "single_word": false,
1617
- "special": true
1618
- },
1619
- "204": {
1620
- "content": "<|reserved_194|>",
1621
- "lstrip": false,
1622
- "normalized": false,
1623
- "rstrip": false,
1624
- "single_word": false,
1625
- "special": true
1626
- },
1627
- "205": {
1628
- "content": "<|reserved_195|>",
1629
- "lstrip": false,
1630
- "normalized": false,
1631
- "rstrip": false,
1632
- "single_word": false,
1633
- "special": true
1634
- },
1635
- "206": {
1636
- "content": "<|reserved_196|>",
1637
- "lstrip": false,
1638
- "normalized": false,
1639
- "rstrip": false,
1640
- "single_word": false,
1641
- "special": true
1642
- },
1643
- "207": {
1644
- "content": "<|reserved_197|>",
1645
- "lstrip": false,
1646
- "normalized": false,
1647
- "rstrip": false,
1648
- "single_word": false,
1649
- "special": true
1650
- },
1651
- "208": {
1652
- "content": "<|reserved_198|>",
1653
- "lstrip": false,
1654
- "normalized": false,
1655
- "rstrip": false,
1656
- "single_word": false,
1657
- "special": true
1658
- },
1659
- "209": {
1660
- "content": "<|reserved_199|>",
1661
- "lstrip": false,
1662
- "normalized": false,
1663
- "rstrip": false,
1664
- "single_word": false,
1665
- "special": true
1666
- },
1667
- "210": {
1668
- "content": "<|reserved_200|>",
1669
- "lstrip": false,
1670
- "normalized": false,
1671
- "rstrip": false,
1672
- "single_word": false,
1673
- "special": true
1674
- },
1675
- "211": {
1676
- "content": "<|reserved_201|>",
1677
- "lstrip": false,
1678
- "normalized": false,
1679
- "rstrip": false,
1680
- "single_word": false,
1681
- "special": true
1682
- },
1683
- "212": {
1684
- "content": "<|reserved_202|>",
1685
- "lstrip": false,
1686
- "normalized": false,
1687
- "rstrip": false,
1688
- "single_word": false,
1689
- "special": true
1690
- },
1691
- "213": {
1692
- "content": "<|reserved_203|>",
1693
- "lstrip": false,
1694
- "normalized": false,
1695
- "rstrip": false,
1696
- "single_word": false,
1697
- "special": true
1698
- },
1699
- "214": {
1700
- "content": "<|reserved_204|>",
1701
- "lstrip": false,
1702
- "normalized": false,
1703
- "rstrip": false,
1704
- "single_word": false,
1705
- "special": true
1706
- },
1707
- "215": {
1708
- "content": "<|reserved_205|>",
1709
- "lstrip": false,
1710
- "normalized": false,
1711
- "rstrip": false,
1712
- "single_word": false,
1713
- "special": true
1714
- },
1715
- "216": {
1716
- "content": "<|reserved_206|>",
1717
- "lstrip": false,
1718
- "normalized": false,
1719
- "rstrip": false,
1720
- "single_word": false,
1721
- "special": true
1722
- },
1723
- "217": {
1724
- "content": "<|reserved_207|>",
1725
- "lstrip": false,
1726
- "normalized": false,
1727
- "rstrip": false,
1728
- "single_word": false,
1729
- "special": true
1730
- },
1731
- "218": {
1732
- "content": "<|reserved_208|>",
1733
- "lstrip": false,
1734
- "normalized": false,
1735
- "rstrip": false,
1736
- "single_word": false,
1737
- "special": true
1738
- },
1739
- "219": {
1740
- "content": "<|reserved_209|>",
1741
- "lstrip": false,
1742
- "normalized": false,
1743
- "rstrip": false,
1744
- "single_word": false,
1745
- "special": true
1746
- },
1747
- "220": {
1748
- "content": "<|reserved_210|>",
1749
- "lstrip": false,
1750
- "normalized": false,
1751
- "rstrip": false,
1752
- "single_word": false,
1753
- "special": true
1754
- },
1755
- "221": {
1756
- "content": "<|reserved_211|>",
1757
- "lstrip": false,
1758
- "normalized": false,
1759
- "rstrip": false,
1760
- "single_word": false,
1761
- "special": true
1762
- },
1763
- "222": {
1764
- "content": "<|reserved_212|>",
1765
- "lstrip": false,
1766
- "normalized": false,
1767
- "rstrip": false,
1768
- "single_word": false,
1769
- "special": true
1770
- },
1771
- "223": {
1772
- "content": "<|reserved_213|>",
1773
- "lstrip": false,
1774
- "normalized": false,
1775
- "rstrip": false,
1776
- "single_word": false,
1777
- "special": true
1778
- },
1779
- "224": {
1780
- "content": "<|reserved_214|>",
1781
- "lstrip": false,
1782
- "normalized": false,
1783
- "rstrip": false,
1784
- "single_word": false,
1785
- "special": true
1786
- },
1787
- "225": {
1788
- "content": "<|reserved_215|>",
1789
- "lstrip": false,
1790
- "normalized": false,
1791
- "rstrip": false,
1792
- "single_word": false,
1793
- "special": true
1794
- },
1795
- "226": {
1796
- "content": "<|reserved_216|>",
1797
- "lstrip": false,
1798
- "normalized": false,
1799
- "rstrip": false,
1800
- "single_word": false,
1801
- "special": true
1802
- },
1803
- "227": {
1804
- "content": "<|reserved_217|>",
1805
- "lstrip": false,
1806
- "normalized": false,
1807
- "rstrip": false,
1808
- "single_word": false,
1809
- "special": true
1810
- },
1811
- "228": {
1812
- "content": "<|reserved_218|>",
1813
- "lstrip": false,
1814
- "normalized": false,
1815
- "rstrip": false,
1816
- "single_word": false,
1817
- "special": true
1818
- },
1819
- "229": {
1820
- "content": "<|reserved_219|>",
1821
- "lstrip": false,
1822
- "normalized": false,
1823
- "rstrip": false,
1824
- "single_word": false,
1825
- "special": true
1826
- },
1827
- "230": {
1828
- "content": "<|reserved_220|>",
1829
- "lstrip": false,
1830
- "normalized": false,
1831
- "rstrip": false,
1832
- "single_word": false,
1833
- "special": true
1834
- },
1835
- "231": {
1836
- "content": "<|reserved_221|>",
1837
- "lstrip": false,
1838
- "normalized": false,
1839
- "rstrip": false,
1840
- "single_word": false,
1841
- "special": true
1842
- },
1843
- "232": {
1844
- "content": "<|reserved_222|>",
1845
- "lstrip": false,
1846
- "normalized": false,
1847
- "rstrip": false,
1848
- "single_word": false,
1849
- "special": true
1850
- },
1851
- "233": {
1852
- "content": "<|reserved_223|>",
1853
- "lstrip": false,
1854
- "normalized": false,
1855
- "rstrip": false,
1856
- "single_word": false,
1857
- "special": true
1858
- },
1859
- "234": {
1860
- "content": "<|reserved_224|>",
1861
- "lstrip": false,
1862
- "normalized": false,
1863
- "rstrip": false,
1864
- "single_word": false,
1865
- "special": true
1866
- },
1867
- "235": {
1868
- "content": "<|reserved_225|>",
1869
- "lstrip": false,
1870
- "normalized": false,
1871
- "rstrip": false,
1872
- "single_word": false,
1873
- "special": true
1874
- },
1875
- "236": {
1876
- "content": "<|reserved_226|>",
1877
- "lstrip": false,
1878
- "normalized": false,
1879
- "rstrip": false,
1880
- "single_word": false,
1881
- "special": true
1882
- },
1883
- "237": {
1884
- "content": "<|reserved_227|>",
1885
- "lstrip": false,
1886
- "normalized": false,
1887
- "rstrip": false,
1888
- "single_word": false,
1889
- "special": true
1890
- },
1891
- "238": {
1892
- "content": "<|reserved_228|>",
1893
- "lstrip": false,
1894
- "normalized": false,
1895
- "rstrip": false,
1896
- "single_word": false,
1897
- "special": true
1898
- },
1899
- "239": {
1900
- "content": "<|reserved_229|>",
1901
- "lstrip": false,
1902
- "normalized": false,
1903
- "rstrip": false,
1904
- "single_word": false,
1905
- "special": true
1906
- },
1907
- "240": {
1908
- "content": "<|reserved_230|>",
1909
- "lstrip": false,
1910
- "normalized": false,
1911
- "rstrip": false,
1912
- "single_word": false,
1913
- "special": true
1914
- },
1915
- "241": {
1916
- "content": "<|reserved_231|>",
1917
- "lstrip": false,
1918
- "normalized": false,
1919
- "rstrip": false,
1920
- "single_word": false,
1921
- "special": true
1922
- },
1923
- "242": {
1924
- "content": "<|reserved_232|>",
1925
- "lstrip": false,
1926
- "normalized": false,
1927
- "rstrip": false,
1928
- "single_word": false,
1929
- "special": true
1930
- },
1931
- "243": {
1932
- "content": "<|reserved_233|>",
1933
- "lstrip": false,
1934
- "normalized": false,
1935
- "rstrip": false,
1936
- "single_word": false,
1937
- "special": true
1938
- },
1939
- "244": {
1940
- "content": "<|reserved_234|>",
1941
- "lstrip": false,
1942
- "normalized": false,
1943
- "rstrip": false,
1944
- "single_word": false,
1945
- "special": true
1946
- },
1947
- "245": {
1948
- "content": "<|reserved_235|>",
1949
- "lstrip": false,
1950
- "normalized": false,
1951
- "rstrip": false,
1952
- "single_word": false,
1953
- "special": true
1954
- },
1955
- "246": {
1956
- "content": "<|reserved_236|>",
1957
- "lstrip": false,
1958
- "normalized": false,
1959
- "rstrip": false,
1960
- "single_word": false,
1961
- "special": true
1962
- },
1963
- "247": {
1964
- "content": "<|reserved_237|>",
1965
- "lstrip": false,
1966
- "normalized": false,
1967
- "rstrip": false,
1968
- "single_word": false,
1969
- "special": true
1970
- },
1971
- "248": {
1972
- "content": "<|reserved_238|>",
1973
- "lstrip": false,
1974
- "normalized": false,
1975
- "rstrip": false,
1976
- "single_word": false,
1977
- "special": true
1978
- },
1979
- "249": {
1980
- "content": "<|reserved_239|>",
1981
- "lstrip": false,
1982
- "normalized": false,
1983
- "rstrip": false,
1984
- "single_word": false,
1985
- "special": true
1986
- },
1987
- "250": {
1988
- "content": "<|reserved_240|>",
1989
- "lstrip": false,
1990
- "normalized": false,
1991
- "rstrip": false,
1992
- "single_word": false,
1993
- "special": true
1994
- },
1995
- "251": {
1996
- "content": "<|reserved_241|>",
1997
- "lstrip": false,
1998
- "normalized": false,
1999
- "rstrip": false,
2000
- "single_word": false,
2001
- "special": true
2002
- },
2003
- "252": {
2004
- "content": "<|reserved_242|>",
2005
- "lstrip": false,
2006
- "normalized": false,
2007
- "rstrip": false,
2008
- "single_word": false,
2009
- "special": true
2010
- },
2011
- "253": {
2012
- "content": "<|reserved_243|>",
2013
- "lstrip": false,
2014
- "normalized": false,
2015
- "rstrip": false,
2016
- "single_word": false,
2017
- "special": true
2018
- },
2019
- "254": {
2020
- "content": "<|reserved_244|>",
2021
- "lstrip": false,
2022
- "normalized": false,
2023
- "rstrip": false,
2024
- "single_word": false,
2025
- "special": true
2026
- },
2027
- "255": {
2028
- "content": "<|reserved_245|>",
2029
- "lstrip": false,
2030
- "normalized": false,
2031
- "rstrip": false,
2032
- "single_word": false,
2033
- "special": true
2034
- },
2035
- "256": {
2036
- "content": "<|reserved_246|>",
2037
- "lstrip": false,
2038
- "normalized": false,
2039
- "rstrip": false,
2040
- "single_word": false,
2041
- "special": true
2042
- },
2043
- "257": {
2044
- "content": "<|reserved_247|>",
2045
- "lstrip": false,
2046
- "normalized": false,
2047
- "rstrip": false,
2048
- "single_word": false,
2049
- "special": true
2050
- },
2051
- "258": {
2052
- "content": "<|reserved_248|>",
2053
- "lstrip": false,
2054
- "normalized": false,
2055
- "rstrip": false,
2056
- "single_word": false,
2057
- "special": true
2058
- },
2059
- "259": {
2060
- "content": "<|reserved_249|>",
2061
- "lstrip": false,
2062
- "normalized": false,
2063
- "rstrip": false,
2064
- "single_word": false,
2065
- "special": true
2066
- },
2067
- "260": {
2068
- "content": "<|reserved_250|>",
2069
- "lstrip": false,
2070
- "normalized": false,
2071
- "rstrip": false,
2072
- "single_word": false,
2073
- "special": true
2074
- },
2075
- "261": {
2076
- "content": "<|reserved_251|>",
2077
- "lstrip": false,
2078
- "normalized": false,
2079
- "rstrip": false,
2080
- "single_word": false,
2081
- "special": true
2082
- },
2083
- "262": {
2084
- "content": "<|reserved_252|>",
2085
- "lstrip": false,
2086
- "normalized": false,
2087
- "rstrip": false,
2088
- "single_word": false,
2089
- "special": true
2090
- },
2091
- "263": {
2092
- "content": "<|reserved_253|>",
2093
- "lstrip": false,
2094
- "normalized": false,
2095
- "rstrip": false,
2096
- "single_word": false,
2097
- "special": true
2098
- },
2099
- "264": {
2100
- "content": "<|reserved_254|>",
2101
- "lstrip": false,
2102
- "normalized": false,
2103
- "rstrip": false,
2104
- "single_word": false,
2105
- "special": true
2106
- },
2107
- "265": {
2108
- "content": "<|reserved_255|>",
2109
- "lstrip": false,
2110
- "normalized": false,
2111
- "rstrip": false,
2112
- "single_word": false,
2113
- "special": true
2114
- },
2115
- "266": {
2116
- "content": "<|reserved_256|>",
2117
- "lstrip": false,
2118
- "normalized": false,
2119
- "rstrip": false,
2120
- "single_word": false,
2121
- "special": true
2122
- },
2123
- "267": {
2124
- "content": "<|reserved_257|>",
2125
- "lstrip": false,
2126
- "normalized": false,
2127
- "rstrip": false,
2128
- "single_word": false,
2129
- "special": true
2130
- },
2131
- "268": {
2132
- "content": "<|reserved_258|>",
2133
- "lstrip": false,
2134
- "normalized": false,
2135
- "rstrip": false,
2136
- "single_word": false,
2137
- "special": true
2138
- },
2139
- "269": {
2140
- "content": "<|reserved_259|>",
2141
- "lstrip": false,
2142
- "normalized": false,
2143
- "rstrip": false,
2144
- "single_word": false,
2145
- "special": true
2146
- },
2147
- "270": {
2148
- "content": "<|reserved_260|>",
2149
- "lstrip": false,
2150
- "normalized": false,
2151
- "rstrip": false,
2152
- "single_word": false,
2153
- "special": true
2154
- },
2155
- "271": {
2156
- "content": "<|reserved_261|>",
2157
- "lstrip": false,
2158
- "normalized": false,
2159
- "rstrip": false,
2160
- "single_word": false,
2161
- "special": true
2162
- },
2163
- "272": {
2164
- "content": "<|reserved_262|>",
2165
- "lstrip": false,
2166
- "normalized": false,
2167
- "rstrip": false,
2168
- "single_word": false,
2169
- "special": true
2170
- },
2171
- "273": {
2172
- "content": "<|reserved_263|>",
2173
- "lstrip": false,
2174
- "normalized": false,
2175
- "rstrip": false,
2176
- "single_word": false,
2177
- "special": true
2178
- },
2179
- "274": {
2180
- "content": "<|reserved_264|>",
2181
- "lstrip": false,
2182
- "normalized": false,
2183
- "rstrip": false,
2184
- "single_word": false,
2185
- "special": true
2186
- },
2187
- "275": {
2188
- "content": "<|reserved_265|>",
2189
- "lstrip": false,
2190
- "normalized": false,
2191
- "rstrip": false,
2192
- "single_word": false,
2193
- "special": true
2194
- },
2195
- "276": {
2196
- "content": "<|reserved_266|>",
2197
- "lstrip": false,
2198
- "normalized": false,
2199
- "rstrip": false,
2200
- "single_word": false,
2201
- "special": true
2202
- },
2203
- "277": {
2204
- "content": "<|reserved_267|>",
2205
- "lstrip": false,
2206
- "normalized": false,
2207
- "rstrip": false,
2208
- "single_word": false,
2209
- "special": true
2210
- },
2211
- "278": {
2212
- "content": "<|reserved_268|>",
2213
- "lstrip": false,
2214
- "normalized": false,
2215
- "rstrip": false,
2216
- "single_word": false,
2217
- "special": true
2218
- },
2219
- "279": {
2220
- "content": "<|reserved_269|>",
2221
- "lstrip": false,
2222
- "normalized": false,
2223
- "rstrip": false,
2224
- "single_word": false,
2225
- "special": true
2226
- },
2227
- "280": {
2228
- "content": "<|reserved_270|>",
2229
- "lstrip": false,
2230
- "normalized": false,
2231
- "rstrip": false,
2232
- "single_word": false,
2233
- "special": true
2234
- },
2235
- "281": {
2236
- "content": "<|reserved_271|>",
2237
- "lstrip": false,
2238
- "normalized": false,
2239
- "rstrip": false,
2240
- "single_word": false,
2241
- "special": true
2242
- },
2243
- "282": {
2244
- "content": "<|reserved_272|>",
2245
- "lstrip": false,
2246
- "normalized": false,
2247
- "rstrip": false,
2248
- "single_word": false,
2249
- "special": true
2250
- },
2251
- "283": {
2252
- "content": "<|reserved_273|>",
2253
- "lstrip": false,
2254
- "normalized": false,
2255
- "rstrip": false,
2256
- "single_word": false,
2257
- "special": true
2258
- },
2259
- "284": {
2260
- "content": "<|reserved_274|>",
2261
- "lstrip": false,
2262
- "normalized": false,
2263
- "rstrip": false,
2264
- "single_word": false,
2265
- "special": true
2266
- },
2267
- "285": {
2268
- "content": "<|reserved_275|>",
2269
- "lstrip": false,
2270
- "normalized": false,
2271
- "rstrip": false,
2272
- "single_word": false,
2273
- "special": true
2274
- },
2275
- "286": {
2276
- "content": "<|reserved_276|>",
2277
- "lstrip": false,
2278
- "normalized": false,
2279
- "rstrip": false,
2280
- "single_word": false,
2281
- "special": true
2282
- },
2283
- "287": {
2284
- "content": "<|reserved_277|>",
2285
- "lstrip": false,
2286
- "normalized": false,
2287
- "rstrip": false,
2288
- "single_word": false,
2289
- "special": true
2290
- },
2291
- "288": {
2292
- "content": "<|reserved_278|>",
2293
- "lstrip": false,
2294
- "normalized": false,
2295
- "rstrip": false,
2296
- "single_word": false,
2297
- "special": true
2298
- },
2299
- "289": {
2300
- "content": "<|reserved_279|>",
2301
- "lstrip": false,
2302
- "normalized": false,
2303
- "rstrip": false,
2304
- "single_word": false,
2305
- "special": true
2306
- },
2307
- "290": {
2308
- "content": "<|reserved_280|>",
2309
- "lstrip": false,
2310
- "normalized": false,
2311
- "rstrip": false,
2312
- "single_word": false,
2313
- "special": true
2314
- },
2315
- "291": {
2316
- "content": "<|reserved_281|>",
2317
- "lstrip": false,
2318
- "normalized": false,
2319
- "rstrip": false,
2320
- "single_word": false,
2321
- "special": true
2322
- },
2323
- "292": {
2324
- "content": "<|reserved_282|>",
2325
- "lstrip": false,
2326
- "normalized": false,
2327
- "rstrip": false,
2328
- "single_word": false,
2329
- "special": true
2330
- },
2331
- "293": {
2332
- "content": "<|reserved_283|>",
2333
- "lstrip": false,
2334
- "normalized": false,
2335
- "rstrip": false,
2336
- "single_word": false,
2337
- "special": true
2338
- },
2339
- "294": {
2340
- "content": "<|reserved_284|>",
2341
- "lstrip": false,
2342
- "normalized": false,
2343
- "rstrip": false,
2344
- "single_word": false,
2345
- "special": true
2346
- },
2347
- "295": {
2348
- "content": "<|reserved_285|>",
2349
- "lstrip": false,
2350
- "normalized": false,
2351
- "rstrip": false,
2352
- "single_word": false,
2353
- "special": true
2354
- },
2355
- "296": {
2356
- "content": "<|reserved_286|>",
2357
- "lstrip": false,
2358
- "normalized": false,
2359
- "rstrip": false,
2360
- "single_word": false,
2361
- "special": true
2362
- },
2363
- "297": {
2364
- "content": "<|reserved_287|>",
2365
- "lstrip": false,
2366
- "normalized": false,
2367
- "rstrip": false,
2368
- "single_word": false,
2369
- "special": true
2370
- },
2371
- "298": {
2372
- "content": "<|reserved_288|>",
2373
- "lstrip": false,
2374
- "normalized": false,
2375
- "rstrip": false,
2376
- "single_word": false,
2377
- "special": true
2378
- },
2379
- "299": {
2380
- "content": "<|reserved_289|>",
2381
- "lstrip": false,
2382
- "normalized": false,
2383
- "rstrip": false,
2384
- "single_word": false,
2385
- "special": true
2386
- },
2387
- "300": {
2388
- "content": "<|reserved_290|>",
2389
- "lstrip": false,
2390
- "normalized": false,
2391
- "rstrip": false,
2392
- "single_word": false,
2393
- "special": true
2394
- },
2395
- "301": {
2396
- "content": "<|reserved_291|>",
2397
- "lstrip": false,
2398
- "normalized": false,
2399
- "rstrip": false,
2400
- "single_word": false,
2401
- "special": true
2402
- },
2403
- "302": {
2404
- "content": "<|reserved_292|>",
2405
- "lstrip": false,
2406
- "normalized": false,
2407
- "rstrip": false,
2408
- "single_word": false,
2409
- "special": true
2410
- },
2411
- "303": {
2412
- "content": "<|reserved_293|>",
2413
- "lstrip": false,
2414
- "normalized": false,
2415
- "rstrip": false,
2416
- "single_word": false,
2417
- "special": true
2418
- },
2419
- "304": {
2420
- "content": "<|reserved_294|>",
2421
- "lstrip": false,
2422
- "normalized": false,
2423
- "rstrip": false,
2424
- "single_word": false,
2425
- "special": true
2426
- },
2427
- "305": {
2428
- "content": "<|reserved_295|>",
2429
- "lstrip": false,
2430
- "normalized": false,
2431
- "rstrip": false,
2432
- "single_word": false,
2433
- "special": true
2434
- },
2435
- "306": {
2436
- "content": "<|reserved_296|>",
2437
- "lstrip": false,
2438
- "normalized": false,
2439
- "rstrip": false,
2440
- "single_word": false,
2441
- "special": true
2442
- },
2443
- "307": {
2444
- "content": "<|reserved_297|>",
2445
- "lstrip": false,
2446
- "normalized": false,
2447
- "rstrip": false,
2448
- "single_word": false,
2449
- "special": true
2450
- },
2451
- "308": {
2452
- "content": "<|reserved_298|>",
2453
- "lstrip": false,
2454
- "normalized": false,
2455
- "rstrip": false,
2456
- "single_word": false,
2457
- "special": true
2458
- },
2459
- "309": {
2460
- "content": "<|reserved_299|>",
2461
- "lstrip": false,
2462
- "normalized": false,
2463
- "rstrip": false,
2464
- "single_word": false,
2465
- "special": true
2466
- },
2467
- "310": {
2468
- "content": "<|reserved_300|>",
2469
- "lstrip": false,
2470
- "normalized": false,
2471
- "rstrip": false,
2472
- "single_word": false,
2473
- "special": true
2474
- },
2475
- "311": {
2476
- "content": "<|reserved_301|>",
2477
- "lstrip": false,
2478
- "normalized": false,
2479
- "rstrip": false,
2480
- "single_word": false,
2481
- "special": true
2482
- },
2483
- "312": {
2484
- "content": "<|reserved_302|>",
2485
- "lstrip": false,
2486
- "normalized": false,
2487
- "rstrip": false,
2488
- "single_word": false,
2489
- "special": true
2490
- },
2491
- "313": {
2492
- "content": "<|reserved_303|>",
2493
- "lstrip": false,
2494
- "normalized": false,
2495
- "rstrip": false,
2496
- "single_word": false,
2497
- "special": true
2498
- },
2499
- "314": {
2500
- "content": "<|reserved_304|>",
2501
- "lstrip": false,
2502
- "normalized": false,
2503
- "rstrip": false,
2504
- "single_word": false,
2505
- "special": true
2506
- },
2507
- "315": {
2508
- "content": "<|reserved_305|>",
2509
- "lstrip": false,
2510
- "normalized": false,
2511
- "rstrip": false,
2512
- "single_word": false,
2513
- "special": true
2514
- },
2515
- "316": {
2516
- "content": "<|reserved_306|>",
2517
- "lstrip": false,
2518
- "normalized": false,
2519
- "rstrip": false,
2520
- "single_word": false,
2521
- "special": true
2522
- },
2523
- "317": {
2524
- "content": "<|reserved_307|>",
2525
- "lstrip": false,
2526
- "normalized": false,
2527
- "rstrip": false,
2528
- "single_word": false,
2529
- "special": true
2530
- },
2531
- "318": {
2532
- "content": "<|reserved_308|>",
2533
- "lstrip": false,
2534
- "normalized": false,
2535
- "rstrip": false,
2536
- "single_word": false,
2537
- "special": true
2538
- },
2539
- "319": {
2540
- "content": "<|reserved_309|>",
2541
- "lstrip": false,
2542
- "normalized": false,
2543
- "rstrip": false,
2544
- "single_word": false,
2545
- "special": true
2546
- },
2547
- "320": {
2548
- "content": "<|reserved_310|>",
2549
- "lstrip": false,
2550
- "normalized": false,
2551
- "rstrip": false,
2552
- "single_word": false,
2553
- "special": true
2554
- },
2555
- "321": {
2556
- "content": "<|reserved_311|>",
2557
- "lstrip": false,
2558
- "normalized": false,
2559
- "rstrip": false,
2560
- "single_word": false,
2561
- "special": true
2562
- },
2563
- "322": {
2564
- "content": "<|reserved_312|>",
2565
- "lstrip": false,
2566
- "normalized": false,
2567
- "rstrip": false,
2568
- "single_word": false,
2569
- "special": true
2570
- },
2571
- "323": {
2572
- "content": "<|reserved_313|>",
2573
- "lstrip": false,
2574
- "normalized": false,
2575
- "rstrip": false,
2576
- "single_word": false,
2577
- "special": true
2578
- },
2579
- "324": {
2580
- "content": "<|reserved_314|>",
2581
- "lstrip": false,
2582
- "normalized": false,
2583
- "rstrip": false,
2584
- "single_word": false,
2585
- "special": true
2586
- },
2587
- "325": {
2588
- "content": "<|reserved_315|>",
2589
- "lstrip": false,
2590
- "normalized": false,
2591
- "rstrip": false,
2592
- "single_word": false,
2593
- "special": true
2594
- },
2595
- "326": {
2596
- "content": "<|reserved_316|>",
2597
- "lstrip": false,
2598
- "normalized": false,
2599
- "rstrip": false,
2600
- "single_word": false,
2601
- "special": true
2602
- },
2603
- "327": {
2604
- "content": "<|reserved_317|>",
2605
- "lstrip": false,
2606
- "normalized": false,
2607
- "rstrip": false,
2608
- "single_word": false,
2609
- "special": true
2610
- },
2611
- "328": {
2612
- "content": "<|reserved_318|>",
2613
- "lstrip": false,
2614
- "normalized": false,
2615
- "rstrip": false,
2616
- "single_word": false,
2617
- "special": true
2618
- },
2619
- "329": {
2620
- "content": "<|reserved_319|>",
2621
- "lstrip": false,
2622
- "normalized": false,
2623
- "rstrip": false,
2624
- "single_word": false,
2625
- "special": true
2626
- },
2627
- "330": {
2628
- "content": "<|reserved_320|>",
2629
- "lstrip": false,
2630
- "normalized": false,
2631
- "rstrip": false,
2632
- "single_word": false,
2633
- "special": true
2634
- },
2635
- "331": {
2636
- "content": "<|reserved_321|>",
2637
- "lstrip": false,
2638
- "normalized": false,
2639
- "rstrip": false,
2640
- "single_word": false,
2641
- "special": true
2642
- },
2643
- "332": {
2644
- "content": "<|reserved_322|>",
2645
- "lstrip": false,
2646
- "normalized": false,
2647
- "rstrip": false,
2648
- "single_word": false,
2649
- "special": true
2650
- },
2651
- "333": {
2652
- "content": "<|reserved_323|>",
2653
- "lstrip": false,
2654
- "normalized": false,
2655
- "rstrip": false,
2656
- "single_word": false,
2657
- "special": true
2658
- },
2659
- "334": {
2660
- "content": "<|reserved_324|>",
2661
- "lstrip": false,
2662
- "normalized": false,
2663
- "rstrip": false,
2664
- "single_word": false,
2665
- "special": true
2666
- },
2667
- "335": {
2668
- "content": "<|reserved_325|>",
2669
- "lstrip": false,
2670
- "normalized": false,
2671
- "rstrip": false,
2672
- "single_word": false,
2673
- "special": true
2674
- },
2675
- "336": {
2676
- "content": "<|reserved_326|>",
2677
- "lstrip": false,
2678
- "normalized": false,
2679
- "rstrip": false,
2680
- "single_word": false,
2681
- "special": true
2682
- },
2683
- "337": {
2684
- "content": "<|reserved_327|>",
2685
- "lstrip": false,
2686
- "normalized": false,
2687
- "rstrip": false,
2688
- "single_word": false,
2689
- "special": true
2690
- },
2691
- "338": {
2692
- "content": "<|reserved_328|>",
2693
- "lstrip": false,
2694
- "normalized": false,
2695
- "rstrip": false,
2696
- "single_word": false,
2697
- "special": true
2698
- },
2699
- "339": {
2700
- "content": "<|reserved_329|>",
2701
- "lstrip": false,
2702
- "normalized": false,
2703
- "rstrip": false,
2704
- "single_word": false,
2705
- "special": true
2706
- },
2707
- "340": {
2708
- "content": "<|reserved_330|>",
2709
- "lstrip": false,
2710
- "normalized": false,
2711
- "rstrip": false,
2712
- "single_word": false,
2713
- "special": true
2714
- },
2715
- "341": {
2716
- "content": "<|reserved_331|>",
2717
- "lstrip": false,
2718
- "normalized": false,
2719
- "rstrip": false,
2720
- "single_word": false,
2721
- "special": true
2722
- },
2723
- "342": {
2724
- "content": "<|reserved_332|>",
2725
- "lstrip": false,
2726
- "normalized": false,
2727
- "rstrip": false,
2728
- "single_word": false,
2729
- "special": true
2730
- },
2731
- "343": {
2732
- "content": "<|reserved_333|>",
2733
- "lstrip": false,
2734
- "normalized": false,
2735
- "rstrip": false,
2736
- "single_word": false,
2737
- "special": true
2738
- },
2739
- "344": {
2740
- "content": "<|reserved_334|>",
2741
- "lstrip": false,
2742
- "normalized": false,
2743
- "rstrip": false,
2744
- "single_word": false,
2745
- "special": true
2746
- },
2747
- "345": {
2748
- "content": "<|reserved_335|>",
2749
- "lstrip": false,
2750
- "normalized": false,
2751
- "rstrip": false,
2752
- "single_word": false,
2753
- "special": true
2754
- },
2755
- "346": {
2756
- "content": "<|reserved_336|>",
2757
- "lstrip": false,
2758
- "normalized": false,
2759
- "rstrip": false,
2760
- "single_word": false,
2761
- "special": true
2762
- },
2763
- "347": {
2764
- "content": "<|reserved_337|>",
2765
- "lstrip": false,
2766
- "normalized": false,
2767
- "rstrip": false,
2768
- "single_word": false,
2769
- "special": true
2770
- },
2771
- "348": {
2772
- "content": "<|reserved_338|>",
2773
- "lstrip": false,
2774
- "normalized": false,
2775
- "rstrip": false,
2776
- "single_word": false,
2777
- "special": true
2778
- },
2779
- "349": {
2780
- "content": "<|reserved_339|>",
2781
- "lstrip": false,
2782
- "normalized": false,
2783
- "rstrip": false,
2784
- "single_word": false,
2785
- "special": true
2786
- },
2787
- "350": {
2788
- "content": "<|reserved_340|>",
2789
- "lstrip": false,
2790
- "normalized": false,
2791
- "rstrip": false,
2792
- "single_word": false,
2793
- "special": true
2794
- },
2795
- "351": {
2796
- "content": "<|reserved_341|>",
2797
- "lstrip": false,
2798
- "normalized": false,
2799
- "rstrip": false,
2800
- "single_word": false,
2801
- "special": true
2802
- },
2803
- "352": {
2804
- "content": "<|reserved_342|>",
2805
- "lstrip": false,
2806
- "normalized": false,
2807
- "rstrip": false,
2808
- "single_word": false,
2809
- "special": true
2810
- },
2811
- "353": {
2812
- "content": "<|reserved_343|>",
2813
- "lstrip": false,
2814
- "normalized": false,
2815
- "rstrip": false,
2816
- "single_word": false,
2817
- "special": true
2818
- },
2819
- "354": {
2820
- "content": "<|reserved_344|>",
2821
- "lstrip": false,
2822
- "normalized": false,
2823
- "rstrip": false,
2824
- "single_word": false,
2825
- "special": true
2826
- },
2827
- "355": {
2828
- "content": "<|reserved_345|>",
2829
- "lstrip": false,
2830
- "normalized": false,
2831
- "rstrip": false,
2832
- "single_word": false,
2833
- "special": true
2834
- },
2835
- "356": {
2836
- "content": "<|reserved_346|>",
2837
- "lstrip": false,
2838
- "normalized": false,
2839
- "rstrip": false,
2840
- "single_word": false,
2841
- "special": true
2842
- },
2843
- "357": {
2844
- "content": "<|reserved_347|>",
2845
- "lstrip": false,
2846
- "normalized": false,
2847
- "rstrip": false,
2848
- "single_word": false,
2849
- "special": true
2850
- },
2851
- "358": {
2852
- "content": "<|reserved_348|>",
2853
- "lstrip": false,
2854
- "normalized": false,
2855
- "rstrip": false,
2856
- "single_word": false,
2857
- "special": true
2858
- },
2859
- "359": {
2860
- "content": "<|reserved_349|>",
2861
- "lstrip": false,
2862
- "normalized": false,
2863
- "rstrip": false,
2864
- "single_word": false,
2865
- "special": true
2866
- },
2867
- "360": {
2868
- "content": "<|reserved_350|>",
2869
- "lstrip": false,
2870
- "normalized": false,
2871
- "rstrip": false,
2872
- "single_word": false,
2873
- "special": true
2874
- },
2875
- "361": {
2876
- "content": "<|reserved_351|>",
2877
- "lstrip": false,
2878
- "normalized": false,
2879
- "rstrip": false,
2880
- "single_word": false,
2881
- "special": true
2882
- },
2883
- "362": {
2884
- "content": "<|reserved_352|>",
2885
- "lstrip": false,
2886
- "normalized": false,
2887
- "rstrip": false,
2888
- "single_word": false,
2889
- "special": true
2890
- },
2891
- "363": {
2892
- "content": "<|reserved_353|>",
2893
- "lstrip": false,
2894
- "normalized": false,
2895
- "rstrip": false,
2896
- "single_word": false,
2897
- "special": true
2898
- },
2899
- "364": {
2900
- "content": "<|reserved_354|>",
2901
- "lstrip": false,
2902
- "normalized": false,
2903
- "rstrip": false,
2904
- "single_word": false,
2905
- "special": true
2906
- },
2907
- "365": {
2908
- "content": "<|reserved_355|>",
2909
- "lstrip": false,
2910
- "normalized": false,
2911
- "rstrip": false,
2912
- "single_word": false,
2913
- "special": true
2914
- },
2915
- "366": {
2916
- "content": "<|reserved_356|>",
2917
- "lstrip": false,
2918
- "normalized": false,
2919
- "rstrip": false,
2920
- "single_word": false,
2921
- "special": true
2922
- },
2923
- "367": {
2924
- "content": "<|reserved_357|>",
2925
- "lstrip": false,
2926
- "normalized": false,
2927
- "rstrip": false,
2928
- "single_word": false,
2929
- "special": true
2930
- },
2931
- "368": {
2932
- "content": "<|reserved_358|>",
2933
- "lstrip": false,
2934
- "normalized": false,
2935
- "rstrip": false,
2936
- "single_word": false,
2937
- "special": true
2938
- },
2939
- "369": {
2940
- "content": "<|reserved_359|>",
2941
- "lstrip": false,
2942
- "normalized": false,
2943
- "rstrip": false,
2944
- "single_word": false,
2945
- "special": true
2946
- },
2947
- "370": {
2948
- "content": "<|reserved_360|>",
2949
- "lstrip": false,
2950
- "normalized": false,
2951
- "rstrip": false,
2952
- "single_word": false,
2953
- "special": true
2954
- },
2955
- "371": {
2956
- "content": "<|reserved_361|>",
2957
- "lstrip": false,
2958
- "normalized": false,
2959
- "rstrip": false,
2960
- "single_word": false,
2961
- "special": true
2962
- },
2963
- "372": {
2964
- "content": "<|reserved_362|>",
2965
- "lstrip": false,
2966
- "normalized": false,
2967
- "rstrip": false,
2968
- "single_word": false,
2969
- "special": true
2970
- },
2971
- "373": {
2972
- "content": "<|reserved_363|>",
2973
- "lstrip": false,
2974
- "normalized": false,
2975
- "rstrip": false,
2976
- "single_word": false,
2977
- "special": true
2978
- },
2979
- "374": {
2980
- "content": "<|reserved_364|>",
2981
- "lstrip": false,
2982
- "normalized": false,
2983
- "rstrip": false,
2984
- "single_word": false,
2985
- "special": true
2986
- },
2987
- "375": {
2988
- "content": "<|reserved_365|>",
2989
- "lstrip": false,
2990
- "normalized": false,
2991
- "rstrip": false,
2992
- "single_word": false,
2993
- "special": true
2994
- },
2995
- "376": {
2996
- "content": "<|reserved_366|>",
2997
- "lstrip": false,
2998
- "normalized": false,
2999
- "rstrip": false,
3000
- "single_word": false,
3001
- "special": true
3002
- },
3003
- "377": {
3004
- "content": "<|reserved_367|>",
3005
- "lstrip": false,
3006
- "normalized": false,
3007
- "rstrip": false,
3008
- "single_word": false,
3009
- "special": true
3010
- },
3011
- "378": {
3012
- "content": "<|reserved_368|>",
3013
- "lstrip": false,
3014
- "normalized": false,
3015
- "rstrip": false,
3016
- "single_word": false,
3017
- "special": true
3018
- },
3019
- "379": {
3020
- "content": "<|reserved_369|>",
3021
- "lstrip": false,
3022
- "normalized": false,
3023
- "rstrip": false,
3024
- "single_word": false,
3025
- "special": true
3026
- },
3027
- "380": {
3028
- "content": "<|reserved_370|>",
3029
- "lstrip": false,
3030
- "normalized": false,
3031
- "rstrip": false,
3032
- "single_word": false,
3033
- "special": true
3034
- },
3035
- "381": {
3036
- "content": "<|reserved_371|>",
3037
- "lstrip": false,
3038
- "normalized": false,
3039
- "rstrip": false,
3040
- "single_word": false,
3041
- "special": true
3042
- },
3043
- "382": {
3044
- "content": "<|reserved_372|>",
3045
- "lstrip": false,
3046
- "normalized": false,
3047
- "rstrip": false,
3048
- "single_word": false,
3049
- "special": true
3050
- },
3051
- "383": {
3052
- "content": "<|reserved_373|>",
3053
- "lstrip": false,
3054
- "normalized": false,
3055
- "rstrip": false,
3056
- "single_word": false,
3057
- "special": true
3058
- },
3059
- "384": {
3060
- "content": "<|reserved_374|>",
3061
- "lstrip": false,
3062
- "normalized": false,
3063
- "rstrip": false,
3064
- "single_word": false,
3065
- "special": true
3066
- },
3067
- "385": {
3068
- "content": "<|reserved_375|>",
3069
- "lstrip": false,
3070
- "normalized": false,
3071
- "rstrip": false,
3072
- "single_word": false,
3073
- "special": true
3074
- },
3075
- "386": {
3076
- "content": "<|reserved_376|>",
3077
- "lstrip": false,
3078
- "normalized": false,
3079
- "rstrip": false,
3080
- "single_word": false,
3081
- "special": true
3082
- },
3083
- "387": {
3084
- "content": "<|reserved_377|>",
3085
- "lstrip": false,
3086
- "normalized": false,
3087
- "rstrip": false,
3088
- "single_word": false,
3089
- "special": true
3090
- },
3091
- "388": {
3092
- "content": "<|reserved_378|>",
3093
- "lstrip": false,
3094
- "normalized": false,
3095
- "rstrip": false,
3096
- "single_word": false,
3097
- "special": true
3098
- },
3099
- "389": {
3100
- "content": "<|reserved_379|>",
3101
- "lstrip": false,
3102
- "normalized": false,
3103
- "rstrip": false,
3104
- "single_word": false,
3105
- "special": true
3106
- },
3107
- "390": {
3108
- "content": "<|reserved_380|>",
3109
- "lstrip": false,
3110
- "normalized": false,
3111
- "rstrip": false,
3112
- "single_word": false,
3113
- "special": true
3114
- },
3115
- "391": {
3116
- "content": "<|reserved_381|>",
3117
- "lstrip": false,
3118
- "normalized": false,
3119
- "rstrip": false,
3120
- "single_word": false,
3121
- "special": true
3122
- },
3123
- "392": {
3124
- "content": "<|reserved_382|>",
3125
- "lstrip": false,
3126
- "normalized": false,
3127
- "rstrip": false,
3128
- "single_word": false,
3129
- "special": true
3130
- },
3131
- "393": {
3132
- "content": "<|reserved_383|>",
3133
- "lstrip": false,
3134
- "normalized": false,
3135
- "rstrip": false,
3136
- "single_word": false,
3137
- "special": true
3138
- },
3139
- "394": {
3140
- "content": "<|reserved_384|>",
3141
- "lstrip": false,
3142
- "normalized": false,
3143
- "rstrip": false,
3144
- "single_word": false,
3145
- "special": true
3146
- },
3147
- "395": {
3148
- "content": "<|reserved_385|>",
3149
- "lstrip": false,
3150
- "normalized": false,
3151
- "rstrip": false,
3152
- "single_word": false,
3153
- "special": true
3154
- },
3155
- "396": {
3156
- "content": "<image>",
3157
- "lstrip": false,
3158
- "normalized": false,
3159
- "rstrip": false,
3160
- "single_word": false,
3161
- "special": true
3162
- },
3163
- "397": {
3164
- "content": "<|img_row_1_col_1|>",
3165
- "lstrip": false,
3166
- "normalized": false,
3167
- "rstrip": false,
3168
- "single_word": false,
3169
- "special": true
3170
- },
3171
- "398": {
3172
- "content": "<|img_row_1_col_2|>",
3173
- "lstrip": false,
3174
- "normalized": false,
3175
- "rstrip": false,
3176
- "single_word": false,
3177
- "special": true
3178
- },
3179
- "399": {
3180
- "content": "<|img_row_1_col_3|>",
3181
- "lstrip": false,
3182
- "normalized": false,
3183
- "rstrip": false,
3184
- "single_word": false,
3185
- "special": true
3186
- },
3187
- "400": {
3188
- "content": "<|img_row_1_col_4|>",
3189
- "lstrip": false,
3190
- "normalized": false,
3191
- "rstrip": false,
3192
- "single_word": false,
3193
- "special": true
3194
- },
3195
- "401": {
3196
- "content": "<|img_row_1_col_5|>",
3197
- "lstrip": false,
3198
- "normalized": false,
3199
- "rstrip": false,
3200
- "single_word": false,
3201
- "special": true
3202
- },
3203
- "402": {
3204
- "content": "<|img_row_1_col_6|>",
3205
- "lstrip": false,
3206
- "normalized": false,
3207
- "rstrip": false,
3208
- "single_word": false,
3209
- "special": true
3210
- },
3211
- "403": {
3212
- "content": "<|img_row_1_col_7|>",
3213
- "lstrip": false,
3214
- "normalized": false,
3215
- "rstrip": false,
3216
- "single_word": false,
3217
- "special": true
3218
- },
3219
- "404": {
3220
- "content": "<|img_row_1_col_8|>",
3221
- "lstrip": false,
3222
- "normalized": false,
3223
- "rstrip": false,
3224
- "single_word": false,
3225
- "special": true
3226
- },
3227
- "405": {
3228
- "content": "<|img_row_1_col_9|>",
3229
- "lstrip": false,
3230
- "normalized": false,
3231
- "rstrip": false,
3232
- "single_word": false,
3233
- "special": true
3234
- },
3235
- "406": {
3236
- "content": "<|img_row_1_col_10|>",
3237
- "lstrip": false,
3238
- "normalized": false,
3239
- "rstrip": false,
3240
- "single_word": false,
3241
- "special": true
3242
- },
3243
- "407": {
3244
- "content": "<|img_row_2_col_1|>",
3245
- "lstrip": false,
3246
- "normalized": false,
3247
- "rstrip": false,
3248
- "single_word": false,
3249
- "special": true
3250
- },
3251
- "408": {
3252
- "content": "<|img_row_2_col_2|>",
3253
- "lstrip": false,
3254
- "normalized": false,
3255
- "rstrip": false,
3256
- "single_word": false,
3257
- "special": true
3258
- },
3259
- "409": {
3260
- "content": "<|img_row_2_col_3|>",
3261
- "lstrip": false,
3262
- "normalized": false,
3263
- "rstrip": false,
3264
- "single_word": false,
3265
- "special": true
3266
- },
3267
- "410": {
3268
- "content": "<|img_row_2_col_4|>",
3269
- "lstrip": false,
3270
- "normalized": false,
3271
- "rstrip": false,
3272
- "single_word": false,
3273
- "special": true
3274
- },
3275
- "411": {
3276
- "content": "<|img_row_2_col_5|>",
3277
- "lstrip": false,
3278
- "normalized": false,
3279
- "rstrip": false,
3280
- "single_word": false,
3281
- "special": true
3282
- },
3283
- "412": {
3284
- "content": "<|img_row_2_col_6|>",
3285
- "lstrip": false,
3286
- "normalized": false,
3287
- "rstrip": false,
3288
- "single_word": false,
3289
- "special": true
3290
- },
3291
- "413": {
3292
- "content": "<|img_row_2_col_7|>",
3293
- "lstrip": false,
3294
- "normalized": false,
3295
- "rstrip": false,
3296
- "single_word": false,
3297
- "special": true
3298
- },
3299
- "414": {
3300
- "content": "<|img_row_2_col_8|>",
3301
- "lstrip": false,
3302
- "normalized": false,
3303
- "rstrip": false,
3304
- "single_word": false,
3305
- "special": true
3306
- },
3307
- "415": {
3308
- "content": "<|img_row_2_col_9|>",
3309
- "lstrip": false,
3310
- "normalized": false,
3311
- "rstrip": false,
3312
- "single_word": false,
3313
- "special": true
3314
- },
3315
- "416": {
3316
- "content": "<|img_row_2_col_10|>",
3317
- "lstrip": false,
3318
- "normalized": false,
3319
- "rstrip": false,
3320
- "single_word": false,
3321
- "special": true
3322
- },
3323
- "417": {
3324
- "content": "<|img_row_3_col_1|>",
3325
- "lstrip": false,
3326
- "normalized": false,
3327
- "rstrip": false,
3328
- "single_word": false,
3329
- "special": true
3330
- },
3331
- "418": {
3332
- "content": "<|img_row_3_col_2|>",
3333
- "lstrip": false,
3334
- "normalized": false,
3335
- "rstrip": false,
3336
- "single_word": false,
3337
- "special": true
3338
- },
3339
- "419": {
3340
- "content": "<|img_row_3_col_3|>",
3341
- "lstrip": false,
3342
- "normalized": false,
3343
- "rstrip": false,
3344
- "single_word": false,
3345
- "special": true
3346
- },
3347
- "420": {
3348
- "content": "<|img_row_3_col_4|>",
3349
- "lstrip": false,
3350
- "normalized": false,
3351
- "rstrip": false,
3352
- "single_word": false,
3353
- "special": true
3354
- },
3355
- "421": {
3356
- "content": "<|img_row_3_col_5|>",
3357
- "lstrip": false,
3358
- "normalized": false,
3359
- "rstrip": false,
3360
- "single_word": false,
3361
- "special": true
3362
- },
3363
- "422": {
3364
- "content": "<|img_row_3_col_6|>",
3365
- "lstrip": false,
3366
- "normalized": false,
3367
- "rstrip": false,
3368
- "single_word": false,
3369
- "special": true
3370
- },
3371
- "423": {
3372
- "content": "<|img_row_3_col_7|>",
3373
- "lstrip": false,
3374
- "normalized": false,
3375
- "rstrip": false,
3376
- "single_word": false,
3377
- "special": true
3378
- },
3379
- "424": {
3380
- "content": "<|img_row_3_col_8|>",
3381
- "lstrip": false,
3382
- "normalized": false,
3383
- "rstrip": false,
3384
- "single_word": false,
3385
- "special": true
3386
- },
3387
- "425": {
3388
- "content": "<|img_row_3_col_9|>",
3389
- "lstrip": false,
3390
- "normalized": false,
3391
- "rstrip": false,
3392
- "single_word": false,
3393
- "special": true
3394
- },
3395
- "426": {
3396
- "content": "<|img_row_3_col_10|>",
3397
- "lstrip": false,
3398
- "normalized": false,
3399
- "rstrip": false,
3400
- "single_word": false,
3401
- "special": true
3402
- },
3403
- "427": {
3404
- "content": "<|img_row_4_col_1|>",
3405
- "lstrip": false,
3406
- "normalized": false,
3407
- "rstrip": false,
3408
- "single_word": false,
3409
- "special": true
3410
- },
3411
- "428": {
3412
- "content": "<|img_row_4_col_2|>",
3413
- "lstrip": false,
3414
- "normalized": false,
3415
- "rstrip": false,
3416
- "single_word": false,
3417
- "special": true
3418
- },
3419
- "429": {
3420
- "content": "<|img_row_4_col_3|>",
3421
- "lstrip": false,
3422
- "normalized": false,
3423
- "rstrip": false,
3424
- "single_word": false,
3425
- "special": true
3426
- },
3427
- "430": {
3428
- "content": "<|img_row_4_col_4|>",
3429
- "lstrip": false,
3430
- "normalized": false,
3431
- "rstrip": false,
3432
- "single_word": false,
3433
- "special": true
3434
- },
3435
- "431": {
3436
- "content": "<|img_row_4_col_5|>",
3437
- "lstrip": false,
3438
- "normalized": false,
3439
- "rstrip": false,
3440
- "single_word": false,
3441
- "special": true
3442
- },
3443
- "432": {
3444
- "content": "<|img_row_4_col_6|>",
3445
- "lstrip": false,
3446
- "normalized": false,
3447
- "rstrip": false,
3448
- "single_word": false,
3449
- "special": true
3450
- },
3451
- "433": {
3452
- "content": "<|img_row_4_col_7|>",
3453
- "lstrip": false,
3454
- "normalized": false,
3455
- "rstrip": false,
3456
- "single_word": false,
3457
- "special": true
3458
- },
3459
- "434": {
3460
- "content": "<|img_row_4_col_8|>",
3461
- "lstrip": false,
3462
- "normalized": false,
3463
- "rstrip": false,
3464
- "single_word": false,
3465
- "special": true
3466
- },
3467
- "435": {
3468
- "content": "<|img_row_4_col_9|>",
3469
- "lstrip": false,
3470
- "normalized": false,
3471
- "rstrip": false,
3472
- "single_word": false,
3473
- "special": true
3474
- },
3475
- "436": {
3476
- "content": "<|img_row_4_col_10|>",
3477
- "lstrip": false,
3478
- "normalized": false,
3479
- "rstrip": false,
3480
- "single_word": false,
3481
- "special": true
3482
- },
3483
- "437": {
3484
- "content": "<|img_row_5_col_1|>",
3485
- "lstrip": false,
3486
- "normalized": false,
3487
- "rstrip": false,
3488
- "single_word": false,
3489
- "special": true
3490
- },
3491
- "438": {
3492
- "content": "<|img_row_5_col_2|>",
3493
- "lstrip": false,
3494
- "normalized": false,
3495
- "rstrip": false,
3496
- "single_word": false,
3497
- "special": true
3498
- },
3499
- "439": {
3500
- "content": "<|img_row_5_col_3|>",
3501
- "lstrip": false,
3502
- "normalized": false,
3503
- "rstrip": false,
3504
- "single_word": false,
3505
- "special": true
3506
- },
3507
- "440": {
3508
- "content": "<|img_row_5_col_4|>",
3509
- "lstrip": false,
3510
- "normalized": false,
3511
- "rstrip": false,
3512
- "single_word": false,
3513
- "special": true
3514
- },
3515
- "441": {
3516
- "content": "<|img_row_5_col_5|>",
3517
- "lstrip": false,
3518
- "normalized": false,
3519
- "rstrip": false,
3520
- "single_word": false,
3521
- "special": true
3522
- },
3523
- "442": {
3524
- "content": "<|img_row_5_col_6|>",
3525
- "lstrip": false,
3526
- "normalized": false,
3527
- "rstrip": false,
3528
- "single_word": false,
3529
- "special": true
3530
- },
3531
- "443": {
3532
- "content": "<|img_row_5_col_7|>",
3533
- "lstrip": false,
3534
- "normalized": false,
3535
- "rstrip": false,
3536
- "single_word": false,
3537
- "special": true
3538
- },
3539
- "444": {
3540
- "content": "<|img_row_5_col_8|>",
3541
- "lstrip": false,
3542
- "normalized": false,
3543
- "rstrip": false,
3544
- "single_word": false,
3545
- "special": true
3546
- },
3547
- "445": {
3548
- "content": "<|img_row_5_col_9|>",
3549
- "lstrip": false,
3550
- "normalized": false,
3551
- "rstrip": false,
3552
- "single_word": false,
3553
- "special": true
3554
- },
3555
- "446": {
3556
- "content": "<|img_row_5_col_10|>",
3557
- "lstrip": false,
3558
- "normalized": false,
3559
- "rstrip": false,
3560
- "single_word": false,
3561
- "special": true
3562
- },
3563
- "447": {
3564
- "content": "<|img_row_6_col_1|>",
3565
- "lstrip": false,
3566
- "normalized": false,
3567
- "rstrip": false,
3568
- "single_word": false,
3569
- "special": true
3570
- },
3571
- "448": {
3572
- "content": "<|img_row_6_col_2|>",
3573
- "lstrip": false,
3574
- "normalized": false,
3575
- "rstrip": false,
3576
- "single_word": false,
3577
- "special": true
3578
- },
3579
- "449": {
3580
- "content": "<|img_row_6_col_3|>",
3581
- "lstrip": false,
3582
- "normalized": false,
3583
- "rstrip": false,
3584
- "single_word": false,
3585
- "special": true
3586
- },
3587
- "450": {
3588
- "content": "<|img_row_6_col_4|>",
3589
- "lstrip": false,
3590
- "normalized": false,
3591
- "rstrip": false,
3592
- "single_word": false,
3593
- "special": true
3594
- },
3595
- "451": {
3596
- "content": "<|img_row_6_col_5|>",
3597
- "lstrip": false,
3598
- "normalized": false,
3599
- "rstrip": false,
3600
- "single_word": false,
3601
- "special": true
3602
- },
3603
- "452": {
3604
- "content": "<|img_row_6_col_6|>",
3605
- "lstrip": false,
3606
- "normalized": false,
3607
- "rstrip": false,
3608
- "single_word": false,
3609
- "special": true
3610
- },
3611
- "453": {
3612
- "content": "<|img_row_6_col_7|>",
3613
- "lstrip": false,
3614
- "normalized": false,
3615
- "rstrip": false,
3616
- "single_word": false,
3617
- "special": true
3618
- },
3619
- "454": {
3620
- "content": "<|img_row_6_col_8|>",
3621
- "lstrip": false,
3622
- "normalized": false,
3623
- "rstrip": false,
3624
- "single_word": false,
3625
- "special": true
3626
- },
3627
- "455": {
3628
- "content": "<|img_row_6_col_9|>",
3629
- "lstrip": false,
3630
- "normalized": false,
3631
- "rstrip": false,
3632
- "single_word": false,
3633
- "special": true
3634
- },
3635
- "456": {
3636
- "content": "<|img_row_6_col_10|>",
3637
- "lstrip": false,
3638
- "normalized": false,
3639
- "rstrip": false,
3640
- "single_word": false,
3641
- "special": true
3642
- },
3643
- "457": {
3644
- "content": "<|img_row_7_col_1|>",
3645
- "lstrip": false,
3646
- "normalized": false,
3647
- "rstrip": false,
3648
- "single_word": false,
3649
- "special": true
3650
- },
3651
- "458": {
3652
- "content": "<|img_row_7_col_2|>",
3653
- "lstrip": false,
3654
- "normalized": false,
3655
- "rstrip": false,
3656
- "single_word": false,
3657
- "special": true
3658
- },
3659
- "459": {
3660
- "content": "<|img_row_7_col_3|>",
3661
- "lstrip": false,
3662
- "normalized": false,
3663
- "rstrip": false,
3664
- "single_word": false,
3665
- "special": true
3666
- },
3667
- "460": {
3668
- "content": "<|img_row_7_col_4|>",
3669
- "lstrip": false,
3670
- "normalized": false,
3671
- "rstrip": false,
3672
- "single_word": false,
3673
- "special": true
3674
- },
3675
- "461": {
3676
- "content": "<|img_row_7_col_5|>",
3677
- "lstrip": false,
3678
- "normalized": false,
3679
- "rstrip": false,
3680
- "single_word": false,
3681
- "special": true
3682
- },
3683
- "462": {
3684
- "content": "<|img_row_7_col_6|>",
3685
- "lstrip": false,
3686
- "normalized": false,
3687
- "rstrip": false,
3688
- "single_word": false,
3689
- "special": true
3690
- },
3691
- "463": {
3692
- "content": "<|img_row_7_col_7|>",
3693
- "lstrip": false,
3694
- "normalized": false,
3695
- "rstrip": false,
3696
- "single_word": false,
3697
- "special": true
3698
- },
3699
- "464": {
3700
- "content": "<|img_row_7_col_8|>",
3701
- "lstrip": false,
3702
- "normalized": false,
3703
- "rstrip": false,
3704
- "single_word": false,
3705
- "special": true
3706
- },
3707
- "465": {
3708
- "content": "<|img_row_7_col_9|>",
3709
- "lstrip": false,
3710
- "normalized": false,
3711
- "rstrip": false,
3712
- "single_word": false,
3713
- "special": true
3714
- },
3715
- "466": {
3716
- "content": "<|img_row_7_col_10|>",
3717
- "lstrip": false,
3718
- "normalized": false,
3719
- "rstrip": false,
3720
- "single_word": false,
3721
- "special": true
3722
- },
3723
- "467": {
3724
- "content": "<|img_row_8_col_1|>",
3725
- "lstrip": false,
3726
- "normalized": false,
3727
- "rstrip": false,
3728
- "single_word": false,
3729
- "special": true
3730
- },
3731
- "468": {
3732
- "content": "<|img_row_8_col_2|>",
3733
- "lstrip": false,
3734
- "normalized": false,
3735
- "rstrip": false,
3736
- "single_word": false,
3737
- "special": true
3738
- },
3739
- "469": {
3740
- "content": "<|img_row_8_col_3|>",
3741
- "lstrip": false,
3742
- "normalized": false,
3743
- "rstrip": false,
3744
- "single_word": false,
3745
- "special": true
3746
- },
3747
- "470": {
3748
- "content": "<|img_row_8_col_4|>",
3749
- "lstrip": false,
3750
- "normalized": false,
3751
- "rstrip": false,
3752
- "single_word": false,
3753
- "special": true
3754
- },
3755
- "471": {
3756
- "content": "<|img_row_8_col_5|>",
3757
- "lstrip": false,
3758
- "normalized": false,
3759
- "rstrip": false,
3760
- "single_word": false,
3761
- "special": true
3762
- },
3763
- "472": {
3764
- "content": "<|img_row_8_col_6|>",
3765
- "lstrip": false,
3766
- "normalized": false,
3767
- "rstrip": false,
3768
- "single_word": false,
3769
- "special": true
3770
- },
3771
- "473": {
3772
- "content": "<|img_row_8_col_7|>",
3773
- "lstrip": false,
3774
- "normalized": false,
3775
- "rstrip": false,
3776
- "single_word": false,
3777
- "special": true
3778
- },
3779
- "474": {
3780
- "content": "<|img_row_8_col_8|>",
3781
- "lstrip": false,
3782
- "normalized": false,
3783
- "rstrip": false,
3784
- "single_word": false,
3785
- "special": true
3786
- },
3787
- "475": {
3788
- "content": "<|img_row_8_col_9|>",
3789
- "lstrip": false,
3790
- "normalized": false,
3791
- "rstrip": false,
3792
- "single_word": false,
3793
- "special": true
3794
- },
3795
- "476": {
3796
- "content": "<|img_row_8_col_10|>",
3797
- "lstrip": false,
3798
- "normalized": false,
3799
- "rstrip": false,
3800
- "single_word": false,
3801
- "special": true
3802
- },
3803
- "477": {
3804
- "content": "<|img_row_9_col_1|>",
3805
- "lstrip": false,
3806
- "normalized": false,
3807
- "rstrip": false,
3808
- "single_word": false,
3809
- "special": true
3810
- },
3811
- "478": {
3812
- "content": "<|img_row_9_col_2|>",
3813
- "lstrip": false,
3814
- "normalized": false,
3815
- "rstrip": false,
3816
- "single_word": false,
3817
- "special": true
3818
- },
3819
- "479": {
3820
- "content": "<|img_row_9_col_3|>",
3821
- "lstrip": false,
3822
- "normalized": false,
3823
- "rstrip": false,
3824
- "single_word": false,
3825
- "special": true
3826
- },
3827
- "480": {
3828
- "content": "<|img_row_9_col_4|>",
3829
- "lstrip": false,
3830
- "normalized": false,
3831
- "rstrip": false,
3832
- "single_word": false,
3833
- "special": true
3834
- },
3835
- "481": {
3836
- "content": "<|img_row_9_col_5|>",
3837
- "lstrip": false,
3838
- "normalized": false,
3839
- "rstrip": false,
3840
- "single_word": false,
3841
- "special": true
3842
- },
3843
- "482": {
3844
- "content": "<|img_row_9_col_6|>",
3845
- "lstrip": false,
3846
- "normalized": false,
3847
- "rstrip": false,
3848
- "single_word": false,
3849
- "special": true
3850
- },
3851
- "483": {
3852
- "content": "<|img_row_9_col_7|>",
3853
- "lstrip": false,
3854
- "normalized": false,
3855
- "rstrip": false,
3856
- "single_word": false,
3857
- "special": true
3858
- },
3859
- "484": {
3860
- "content": "<|img_row_9_col_8|>",
3861
- "lstrip": false,
3862
- "normalized": false,
3863
- "rstrip": false,
3864
- "single_word": false,
3865
- "special": true
3866
- },
3867
- "485": {
3868
- "content": "<|img_row_9_col_9|>",
3869
- "lstrip": false,
3870
- "normalized": false,
3871
- "rstrip": false,
3872
- "single_word": false,
3873
- "special": true
3874
- },
3875
- "486": {
3876
- "content": "<|img_row_9_col_10|>",
3877
- "lstrip": false,
3878
- "normalized": false,
3879
- "rstrip": false,
3880
- "single_word": false,
3881
- "special": true
3882
- },
3883
- "487": {
3884
- "content": "<|img_row_10_col_1|>",
3885
- "lstrip": false,
3886
- "normalized": false,
3887
- "rstrip": false,
3888
- "single_word": false,
3889
- "special": true
3890
- },
3891
- "488": {
3892
- "content": "<|img_row_10_col_2|>",
3893
- "lstrip": false,
3894
- "normalized": false,
3895
- "rstrip": false,
3896
- "single_word": false,
3897
- "special": true
3898
- },
3899
- "489": {
3900
- "content": "<|img_row_10_col_3|>",
3901
- "lstrip": false,
3902
- "normalized": false,
3903
- "rstrip": false,
3904
- "single_word": false,
3905
- "special": true
3906
- },
3907
- "490": {
3908
- "content": "<|img_row_10_col_4|>",
3909
- "lstrip": false,
3910
- "normalized": false,
3911
- "rstrip": false,
3912
- "single_word": false,
3913
- "special": true
3914
- },
3915
- "491": {
3916
- "content": "<|img_row_10_col_5|>",
3917
- "lstrip": false,
3918
- "normalized": false,
3919
- "rstrip": false,
3920
- "single_word": false,
3921
- "special": true
3922
- },
3923
- "492": {
3924
- "content": "<|img_row_10_col_6|>",
3925
- "lstrip": false,
3926
- "normalized": false,
3927
- "rstrip": false,
3928
- "single_word": false,
3929
- "special": true
3930
- },
3931
- "493": {
3932
- "content": "<|img_row_10_col_7|>",
3933
- "lstrip": false,
3934
- "normalized": false,
3935
- "rstrip": false,
3936
- "single_word": false,
3937
- "special": true
3938
- },
3939
- "494": {
3940
- "content": "<|img_row_10_col_8|>",
3941
- "lstrip": false,
3942
- "normalized": false,
3943
- "rstrip": false,
3944
- "single_word": false,
3945
- "special": true
3946
- },
3947
- "495": {
3948
- "content": "<|img_row_10_col_9|>",
3949
- "lstrip": false,
3950
- "normalized": false,
3951
- "rstrip": false,
3952
- "single_word": false,
3953
- "special": true
3954
- },
3955
- "496": {
3956
- "content": "<|img_row_10_col_10|>",
3957
- "lstrip": false,
3958
- "normalized": false,
3959
- "rstrip": false,
3960
- "single_word": false,
3961
- "special": true
3962
- },
3963
- "497": {
3964
- "content": "<|img_thumbnail|>",
3965
- "lstrip": false,
3966
- "normalized": false,
3967
- "rstrip": false,
3968
- "single_word": false,
3969
- "special": true
3970
- },
3971
- "498": {
3972
- "content": "<|image_start|>",
3973
- "lstrip": false,
3974
- "normalized": false,
3975
- "rstrip": false,
3976
- "single_word": false,
3977
- "special": true
3978
- },
3979
- "499": {
3980
- "content": "<|image_end|>",
3981
- "lstrip": false,
3982
- "normalized": false,
3983
- "rstrip": false,
3984
- "single_word": false,
3985
- "special": true
3986
- },
3987
- "500": {
3988
- "content": "<|image_split|>",
3989
- "lstrip": false,
3990
- "normalized": false,
3991
- "rstrip": false,
3992
- "single_word": false,
3993
- "special": true
3994
- },
3995
- "64011": {
3996
- "content": "Mathias",
3997
- "lstrip": false,
3998
- "normalized": true,
3999
- "rstrip": false,
4000
- "single_word": false,
4001
- "special": true
4002
- },
4003
- "64014": {
4004
- "content": "python",
4005
- "lstrip": false,
4006
- "normalized": true,
4007
- "rstrip": false,
4008
- "single_word": false,
4009
- "special": true
4010
- },
4011
- "64394": {
4012
- "content": "<|cot_start|>",
4013
- "lstrip": false,
4014
- "normalized": false,
4015
- "rstrip": false,
4016
- "single_word": false,
4017
- "special": true
4018
- },
4019
- "64395": {
4020
- "content": "<|cot_end|>",
4021
- "lstrip": false,
4022
- "normalized": false,
4023
- "rstrip": false,
4024
- "single_word": false,
4025
- "special": true
4026
- },
4027
- "64396": {
4028
- "content": "<|review_start|>",
4029
- "lstrip": false,
4030
- "normalized": false,
4031
- "rstrip": false,
4032
- "single_word": false,
4033
- "special": true
4034
- },
4035
- "64397": {
4036
- "content": "<|review_end|>",
4037
- "lstrip": false,
4038
- "normalized": false,
4039
- "rstrip": false,
4040
- "single_word": false,
4041
- "special": true
4042
- },
4043
- "64398": {
4044
- "content": "<|file_start|>",
4045
- "lstrip": false,
4046
- "normalized": false,
4047
- "rstrip": false,
4048
- "single_word": false,
4049
- "special": true
4050
- },
4051
- "64399": {
4052
- "content": "<|file_end|>",
4053
- "lstrip": false,
4054
- "normalized": false,
4055
- "rstrip": false,
4056
- "single_word": false,
4057
- "special": true
4058
- },
4059
- "64400": {
4060
- "content": "<think>",
4061
- "lstrip": false,
4062
- "normalized": false,
4063
- "rstrip": false,
4064
- "single_word": false,
4065
- "special": true
4066
- },
4067
- "64401": {
4068
- "content": "</think>",
4069
- "lstrip": false,
4070
- "normalized": false,
4071
- "rstrip": false,
4072
- "single_word": false,
4073
- "special": true
4074
- }
4075
- },
4076
  "bos_token": "<|startoftext|>",
4077
  "clean_up_tokenization_spaces": false,
4078
  "eos_token": "<|im_end|>",
4079
- "extra_special_tokens": {},
 
 
 
 
 
 
4080
  "model_max_length": 1000000000000000019884624838656,
 
4081
  "pad_token": "<|pad|>",
4082
- "tokenizer_class": "PreTrainedTokenizerFast"
 
 
 
 
4083
  }
 
1
  {
2
+ "backend": "tokenizers",
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  "bos_token": "<|startoftext|>",
4
  "clean_up_tokenization_spaces": false,
5
  "eos_token": "<|im_end|>",
6
+ "extra_special_tokens": [],
7
+ "is_local": false,
8
+ "legacy": false,
9
+ "model_input_names": [
10
+ "input_ids",
11
+ "attention_mask"
12
+ ],
13
  "model_max_length": 1000000000000000019884624838656,
14
+ "model_specific_special_tokens": {},
15
  "pad_token": "<|pad|>",
16
+ "sp_model_kwargs": {},
17
+ "spaces_between_special_tokens": false,
18
+ "tokenizer_class": "TokenizersBackend",
19
+ "use_default_system_prompt": false,
20
+ "use_fast": true
21
  }