Falcon OCR

Falcon OCR is a 0.27B early-fusion document OCR model by the Technology Innovation Institute (TII). One transformer reads image patches and text together and writes the page as text, with LaTeX for formulas and HTML for tables. LibreYOLO runs a PyTorch port of Falcon OCR 1.5 on the ocr task.

작업
ocr
설치
pip install "libreyolo[vlm]"
지원 티어
별도 티어, v1.8.0부터 지원. 자체 팩토리와 계약을 갖춘 별도의 제품 영역입니다.
업스트림
Technology Innovation Institute (TII)의 Falcon OCR, Apache-2.0. 논문, 소스
라이선스
코드 Apache-2.0, 가중치 Apache-2.0. 상업적 사용

Install

Falcon OCR belongs to LibreYOLO's VLM tier and needs the vlm extra.

bash
pip install "libreyolo[vlm]"

Predict

Weights download on first use from LibreYOLO/LibreFalconOCR270m, a byte-identical mirror of tiiuae/Falcon-OCR pinned to a revision. The release runs on FlexAttention and a Triton kernel through remote code; LibreYOLO runs a plain PyTorch port with neither.

Python
from libreyolo import LibreVLM model = LibreVLM("falcon-ocr")         # weights download on first useresult = model.predict("page.png")      # a scanned or rendered page print(result.ocr.markdown)              # the page text
With layout
from libreyolo import LibreVLM # PP-DocLayoutV3 finds regions in reading order; each crop is read# with its category prompt.model = LibreVLM("falcon-ocr", layout=True)result = model.predict("page.png") for label, text in zip(result.ocr.labels, result.ocr.texts):    print(label, text[:60])
One element
from libreyolo import LibreVLM model = LibreVLM("falcon-ocr", prompt="table")result = model.predict("table.png")     # a cropped tableprint(result.ocr.markdown)              # HTML table

The family loads through LibreVLM(), or the LibreFalconOCR class. There are two modes, as upstream:

  • Default: the whole page is read in one pass. Results.ocr holds one region covering the image, label plain, and Results.ocr.markdown is the same text.
  • layout=True: LibreYOLO's PP-DocLayoutV3 port finds regions in reading order at layout_threshold=0.3, nested boxes are dropped, and each crop is read with its category prompt. One region per crop, labels holds the layout class, det_conf the layout score, and markdown joins the texts with blank lines. Pictures and classes without an upstream prompt category are skipped.

prompt= takes a category (plain, text, table, formula, caption, footnote, list-item, page-footer, page-header, section-header, title) or a custom instruction. Pages are resized so both sides fall between 64 and 1536 px. Decoding is greedy with a budget of 8192 new tokens. A generative model emits no score, so conf is a constant 1.0.

Variants

One size, 270m. CUDA runs the bf16 weights under torch.autocast; CPU and MPS run float32, about 1.1 GB of weights. Batches of one. On CPU in float32 the port reproduces the release token for token on six OCR fixtures and a synthetic report page; CUDA bf16 and the layout mode were not compared against upstream.

Validate

val() runs the shared OCR validator.

Python
from libreyolo import LibreVLM model = LibreVLM("falcon-ocr")metrics = model.val(data="ocr_dataset/")

Export

Inference only: train() and export() raise.

Licensing

내려받는 특정 가중치의 Hugging Face 저장소에서 라이선스를 확인하십시오. LibreYOLO 조직의 모든 체크포인트에는 라이선스가 있으며 한 계열 안에서도 항상 같지는 않습니다. 해당 저장소가 신뢰할 수 있는 기준입니다. 아래 요약은 이 페이지를 마지막으로 검증했을 때 적용된 내용을 설명합니다.

관련 라이선스에 관한 설명이며 법률 자문이 아닙니다. 상업적으로 중요한 사안이라면 라이선스를 직접 읽고 별도의 법률 자문을 받으십시오.

원작
Falcon OCR, Technology Innovation Institute (TII)
업스트림 라이선스
Apache-2.0
LibreYOLO 코드
MIT
가중치
Apache-2.0, huggingface.co/LibreYOLO에 다시 게시됨
해석
Apache-2.0 is a permissive license, so the Falcon OCR weights and code can be used in commercial and closed-source products. Redistributing them means keeping the license text and TII's NOTICE, and the license grants a patent license. LibreYOLO ports the inference code of the Hugging Face release tiiuae/Falcon-OCR at revision 0bc28f89c90fbe8bdb063097fab144d4ce4c19b5 (Falcon OCR 1.5), which shares its architecture with TII's Falcon Perception repository (commit c457916c9974efbacfa91f0f6ecc2c49c6543e56, Apache-2.0, whose NOTICE covers the weights); see libreyolo/models/falconocr/NOTICE. The adapter is MIT, and the optional layout stage uses LibreYOLO's Apache-2.0 PP-DocLayoutV3 port. The weights are an unmodified, ungated mirror at LibreYOLO/LibreFalconOCR270m that ships the LICENSE and NOTICE.

Falcon OCR is Apache-2.0, code and weights, by the Technology Innovation Institute. Commercial use is allowed. The weights are an ungated, byte-identical mirror. The optional layout stage uses LibreYOLO's Apache-2.0 PP-DocLayoutV3 port.

Citation

@article{bevli2026falcon,
  title   = {Falcon Perception},
  author  = {Bevli, Aviraj and Chaybouti, Sofian and Dahou, Yasser and Hacid, Hakim and Huynh, Ngoc Dung and Le Khac, Phuc H. and Narayan, Sanath and Para, Wamiq Reyaz and Singh, Ankit},
  journal = {arXiv preprint arXiv:2603.27365},
  year    = {2026},
  url     = {https://arxiv.org/abs/2603.27365}
}

huggingface.co/tiiuae/Falcon-OCR#citation에 있는 저자의 인용 블록에서 복사했습니다.

LibreYOLO v1.8.0에서 검증되었습니다. 이 페이지의 지원 표, 체크포인트, 벤치마크 수치는 출시된 라이브러리와 공개된 가중치에서 생성되며 수동으로 작성되지 않습니다.