software-mansion/react-native-executorch-lfm-2.5

lfm-2.5

This repository hosts the lfm-2.5 models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Variants

Path	Backend	Precision	Context length
2_6b/mlx/lfm_2_5_2_6b_mlx_int4.pte	mlx	int4	8,192
2_6b/xnnpack/lfm_2_5_2_6b_xnnpack_8da4w.pte	xnnpack	8da4w	8,192
2_6b/vulkan/lfm_2_5_2_6b_vulkan_8da4w.pte	vulkan	8da4w	8,192
1_2b/mlx/lfm_2_5_1_2b_mlx_int4.pte	mlx	int4	16,384
1_2b/xnnpack/lfm_2_5_1_2b_xnnpack_8da4w.pte	xnnpack	8da4w	16,384
350m/mlx/lfm_2_5_350m_mlx_int4.pte	mlx	int4	16,384
350m/xnnpack/lfm_2_5_350m_xnnpack_8da4w.pte	xnnpack	8da4w	16,384
vl_1_6b/mlx/lfm_2_5_vl_1_6b_mlx_int4.pte	mlx	int4	2,048
vl_1_6b/mlx/lfm_2_5_vl_1_6b_mlx_int8.pte	mlx	int8	2,048
vl_1_6b/vulkan/lfm_2_5_vl_1_6b_vulkan_8da4w.pte	vulkan	8da4w	2,048
vl_1_6b/xnnpack/lfm_2_5_vl_1_6b_xnnpack_8da4w.pte	xnnpack	8da4w	2,048
vl_450m/mlx/lfm_2_5_vl_450m_mlx_int4.pte	mlx	int4	2,048
vl_450m/vulkan/lfm_2_5_vl_450m_vulkan_8da4w.pte	vulkan	8da4w	2,048
vl_450m/xnnpack/lfm_2_5_vl_450m_xnnpack_8da4w.pte	xnnpack	8da4w	2,048

Repository structure

1_2b/mlx/config.json                               1.2 KiB
1_2b/mlx/lfm_2_5_1_2b_mlx_int4.pte                 849 MiB
1_2b/tokenizer.json                                4.5 MiB
1_2b/tokenizer_config.json                         92.4 KiB
1_2b/xnnpack/config.json                           1.2 KiB
1_2b/xnnpack/lfm_2_5_1_2b_xnnpack_8da4w.pte        773 MiB
350m/mlx/config.json                               1.2 KiB
350m/mlx/lfm_2_5_350m_mlx_int4.pte                 308 MiB
350m/tokenizer.json                                4.5 MiB
350m/tokenizer_config.json                         2.9 KiB
350m/xnnpack/config.json                           1.2 KiB
350m/xnnpack/lfm_2_5_350m_xnnpack_8da4w.pte        279 MiB
config.json                                        29 B
vl_1_6b/mlx/config.json                            1.7 KiB
vl_1_6b/mlx/lfm_2_5_vl_1_6b_mlx_int4.pte           2.2 GiB
vl_1_6b/mlx/lfm_2_5_vl_1_6b_mlx_int8.pte           2.8 GiB
vl_1_6b/tokenizer.json                             4.5 MiB
vl_1_6b/tokenizer_config.json                      3.2 KiB
vl_1_6b/vulkan/config.json                         2.1 KiB
vl_1_6b/vulkan/lfm_2_5_vl_1_6b_vulkan_8da4w.pte    2.3 GiB
vl_1_6b/xnnpack/config.json                        2.1 KiB
vl_1_6b/xnnpack/lfm_2_5_vl_1_6b_xnnpack_8da4w.pte  2.3 GiB
vl_450m/mlx/config.json                            1.0 KiB
vl_450m/mlx/lfm_2_5_vl_450m_mlx_int4.pte           555 MiB
vl_450m/tokenizer.json                             4.5 MiB
vl_450m/tokenizer_config.json                      3.2 KiB
vl_450m/vulkan/config.json                         2.1 KiB
vl_450m/vulkan/lfm_2_5_vl_450m_vulkan_8da4w.pte    594 MiB
vl_450m/xnnpack/config.json                        2.1 KiB
vl_450m/xnnpack/lfm_2_5_vl_450m_xnnpack_8da4w.pte  619 MiB

LFM2.5 2.6B chat model

2_6b/ contains the instruction-tuned LiquidAI/LFM2.5-2.6B checkpoint, exported for chat assistants with an 8,192-token context and 128-token prefill chunks. Its chat template strips thinking from every assistant message when rendering history, matching Qwen3 and keeping incremental KV-cache prompts monotonic. Generation still starts with <think>. tokenizer_config.json contains the corrected template. Both XNNPACK and MLX artifacts were executed on a physical Apple Silicon Mac, including generation and the maximum prefill chunk size. See 2_6b/validation.json for smoke-test results and 2_6b/export_manifest.json for checkpoint provenance and SHA-256 hashes.

The MLX artifact requires the React Native ExecuTorch MLX runtime from the software-mansion-labs ExecuTorch fork. The embedding lookup uses a portable int4 kernel; the decoder runs in one MLX partition.

The 8K exports were checked with 8,000-token prompts and generation beyond position 4096. Vulkan was tested on a Samsung Galaxy S20+ (Exynos 990, Mali-G77) using the Android libraries shipped by React Native ExecuTorch. It delegates the entire forward graph, including quantized embeddings and mutable caches, to one Vulkan partition. The current fp16 layout requires maxImageDimension3D >= 16384; the tested Mali-G77 supports that limit. Native tool calls and tool-result follow-up generation were also tested on that device. XNNPACK remains the Android default because it was faster on this phone. These are smoke tests, not a long-context quality benchmark; see the validation metadata for timings.

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.