davanstrien/unlimited-ocr-smoke

Document OCR using Unlimited-OCR

This dataset contains OCR results for davanstrien/ufo-ColPali produced by baidu/Unlimited-OCR with vLLM.

Processing Details

• —Source Dataset: davanstrien/ufo-ColPali
• —Model: baidu/Unlimited-OCR
• —Mode: single image per row
• —Number of Samples: 5
• —Processing Time: 2.3 min
• —Processing Date: 2026-06-28 09:12 UTC
• —Output Column: markdown
• —Split: train

Output

The column holds the model's raw layout-grounded markdown: text spans tagged <|ref|>...<|/ref|> with <|det|>...<|/det|> coordinate boxes (coords 0-1000). Strip them with re.sub(r'<\|det\|>.*?<\|/det\|>', '', t) then re.sub(r'<\|/?ref\|>', '', t).

In multi-page runs, pages are separated by <PAGE>. Tables are returned as HTML and equations as LaTeX.

Usage

from datasets import load_dataset

ds = load_dataset("davanstrien/unlimited-ocr-smoke", split="train")
print(ds[0]["markdown"])

Reproduction

Generated with the uv-scripts/ocr Unlimited-OCR vLLM recipe. Unlimited-OCR needs Baidu's dedicated vLLM image:

hf jobs uv run --flavor l4x1 -s HF_TOKEN \
    --image vllm/vllm-openai:unlimited-ocr --python /usr/bin/python3 \
    -e PYTHONPATH=/usr/local/lib/python3.12/dist-packages \
    https://huggingface.co/datasets/uv-scripts/ocr/raw/main/unlimited-ocr-vllm.py \
    davanstrien/ufo-ColPali <output-dataset>

Generated with UV Scripts