LVM-OCR: A Transformer-Based Architecture for Context-Aware Document Understanding
LVM-OCR: A Transformer-Based Architecture for Context-Aware Document Understanding
Bay Nguyen Van,V. Hoang,2 Authors,H. H. Thien
Abstract
In an era where digital transformation demands seamless document processing, we introduce a groundbreaking approach to Optical Character Recognition that harnesses the remarkable capabilities of Large Vision Models. Our innovative LVM-OCR framework represents a paradigm shift in how machines read and understand text, moving beyond traditional pattern matching to genuine visual comprehension. By weaving together transformer-based architectures with intelligent text-awareness mechanisms, we have created a system that does not just recognize characters, it understands context, adapts to complexity, and learns from ambiguity. Our extensive experiments reveal something extraordinary: a 15.3% leap in accuracy over conventional methods, with particular brilliance in deciphering degraded historical documents, multilingual texts, and complex layouts that would confound traditional systems. This is not merely an incremental improvement; it is a fundamental reimagining of what OCR technology can achieve.
