Open Vision, Layout & OCR Models by Loay
Collection
This collection hosts a series of Vision Language Models (VLMs) fine-tuned for Optical Character Recognition (OCR) and Document Processing. โข 5 items โข Updated โข 1
How to use loay/Arabic-OCR-Qwen2.5-VL-7B-Vision with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "image-to-text" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# 'pip install "transformers<5.0.0'
from transformers import pipeline
pipe = pipeline("image-to-text", model="loay/Arabic-OCR-Qwen2.5-VL-7B-Vision") # Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM
processor = AutoProcessor.from_pretrained("loay/Arabic-OCR-Qwen2.5-VL-7B-Vision")
model = AutoModelForMultimodalLM.from_pretrained("loay/Arabic-OCR-Qwen2.5-VL-7B-Vision", device_map="auto")This repository contains the float16 merged version of a Vision-Language Model (VLM), fine-tuned by loay for the specific task of performing Optical Character Recognition (OCR) on Arabic text from images.
The model was created by fine-tuning the unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit model using LoRA adapters. The high-performance training was made possible by the Unsloth library, and the adapters were then merged back into the base model for easy deployment.
unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bitfloat16 precision model, ideal for inference on GPUs with sufficient VRAM (requires >14GB).Base model
Qwen/Qwen2.5-VL-7B-Instruct