CoolFace
Modelpublic

cstr/lilt-funsd-GGUF

sourceHugging Facemitupdated 2mo agoView on Hugging Face
0likes192downloads
Model Card

LiLT FUNSD — GGUF

GGUF conversion of philschmid/lilt-en-funsd for use with CrispEmbed.

LiLT (Language-independent Layout Transformer) is a dual-stream encoder that combines RoBERTa (768d text) with a parallel layout transformer (192d) via BiACM (bidirectional attention complementation). It takes OCR text + bounding boxes and performs token classification for document understanding.

This variant is fine-tuned on FUNSD (Form Understanding in Noisy Scanned Documents) with 7 IOB labels: O, B-HEADER, I-HEADER, B-QUESTION, I-QUESTION, B-ANSWER, I-ANSWER.

Model Details

PropertyValue
ArchitectureLiLT (RoBERTa + Layout Transformer + BiACM)
Parameters130.7M
Hidden size768 (text) / 192 (layout)
Layers12
Heads12
Vocab50,265 (RoBERTa BPE)
Labels7 (FUNSD IOB)
LicenseMIT
Base modelSCUT-DLVCLab/lilt-roberta-en-base

Available Formats

FileFormatSize
Float32498 MB
Q8_0134 MB
Q4_K90 MB

Usage

Python

CLI

Parity

Verified against HuggingFace transformers using the crispembed-diff harness:

  • 25/25 encoder stages: cos_min = 1.000000
  • 16/16 token labels match (100%)
  • max_abs < 1.6e-03 across all layers

Citation

Provenance and EU AI Act Art. 53 note

  • Upstream model: philschmid/lilt-en-funsd — published by philschmid.
  • Upstream licence: mit. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
  • What was done here: format conversion and/or quantisation only (GGUF). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
  • Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
  • Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.