nrl-ai/pp-ocrv5-voicebridge-snapdragon
PP-OCRv5 VoiceBridge — Snapdragon 8 Elite NPU (int8 TFLite)
PP-OCRv5 text detection and recognition for industrial ZH/KO safety signage, compiled to int8 TFLite via Qualcomm AI Hub for the Snapdragon 8 Elite (SM8750) Hexagon V79 HTP NPU.
Built for VoiceBridge — an offline VN↔EN/KO/ZH speech + sign translator for the OneVoice AI Challenge 2026 (Saigon AI Hub + Qualcomm).
Models
Full ZH/KO sign pipeline ≈ 2.2 ms on Hexagon NPU. 100% NPU — zero CPU fallback.
Performance
Latency — Samsung Galaxy S25 Ultra (SM8750, Android 15)
Measured via Qualcomm AI Hub cloud-hosted real device. Bench date: 2026-06-06. Tool: qai-hub==0.50.0, qairt==2.45.0.
AI Hub job IDs: det=jg98xw1qp, zh=jp38we2x5, ko=jgnx7evm5, lat=jgj1wln8g
Accuracy — public dataset (ChineseOCRBench / ReCTS, Apache-2.0)
Real store-front signage photos (200 scored), standard ChineseOCRBench substring matching.
ReCTS is VQA-style (ground truth = one region; full-image OCR is substring-matched), so recall@full understates pure recognition; char-recall reflects character-level quality on real, cluttered, perspective-distorted signs. Eval script in the VoiceBridge repo (benchmarks/ocr/bench_public.py).
Vietnamese: PP-OCRv5's Latin dictionary has no precomposed Vietnamese tone-mark vowels (verified by byte-level grep). Do not use this for Vietnamese — use a Vietnamese-specialized recognizer (e.g. VietOCR) or ML Kit.
Usage
# Download models
from huggingface_hub import hf_hub_download
det = hf_hub_download("nrl-ai/pp-ocrv5-voicebridge-snapdragon", "pp_ocrv5_det_mobile.tflite")
rec = hf_hub_download("nrl-ai/pp-ocrv5-voicebridge-snapdragon", "pp_ocrv5_zh_rec.tflite")On-device (Flutter/Android + LiteRT + QNN delegate):
// See lib/pp_ocrv5.dart in vietanhdev/voicebridge for the full integration.
final engine = PpOcrV5Engine();
final results = await engine.recognize(imagePath, 'zh');Source models & compilation
- Source: PaddleOCR 3.x (Apache-2.0) — https://github.com/PaddlePaddle/PaddleOCR
- ONNX exports: monkt/paddleocr-onnx (Apache-2.0, no pickle)
- Compiled:
qai-hub submit_compile_job(..., options="--target_runtime tflite --quantize_full_type int8")with random PTQ calibration data (100 samples per model)
Script: benchmarks/ocr/compile_aihub.py in https://github.com/vietanhdev/voicebridge
Citation
@software{voicebridge2026,
author = {Nguyen, Viet-Anh and {Neural Research Lab}},
title = {{VoiceBridge}: Offline On-Device Speech and Sign Translator},
year = {2026},
url = {https://github.com/vietanhdev/voicebridge},
note = {OneVoice AI Challenge 2026, Saigon AI Hub + Qualcomm}
}