• Stars
    star
    384
  • Rank 111,088 (Top 3 %)
  • Language
  • License
    Creative Commons ...
  • Created almost 5 years ago
  • Updated about 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

CORD: A Consolidated Receipt Dataset for Post-OCR Parsing

Shield: CC BY 4.0

This work is licensed under a Creative Commons Attribution 4.0 International License.

CC BY 4.0

CORD: A Consolidated Receipt Dataset for Post-OCR Parsing

We introduce a novel dataset called CORD, which stands for a COnsolidated Receipt Dataset for post-OCR parsing.

teaser

Abstract [paper]

OCR is inevitably linked to NLP since its final output is in text. Advances in document intelligence are driving the need for a unified technology that integrates OCR with various NLP tasks, especially semantic parsing. Since OCR and semantic parsing have been studied as separate tasks so far, the datasets for each task on their own are rich, while those for the integrated post-OCR parsing tasks are relatively insufficient. In this study, we publish a consolidated dataset for receipt parsing as the first step towards post-OCR parsing tasks. The dataset consists of thousands of Indonesian receipts, which contains images and box/text annotations for OCR, and multi-level semantic labels for parsing. The proposed dataset can be used to address various OCR and parsing tasks.

Updates

  • CORD v2 data has been uploaded to the Hugging Face Datasets. We investigated all data and corrected the incorrect labels. Also, we added the attribute sub_group_id to each element of valid_line. We can use this information to describe more accurate hierarchy of the resulting parse. See the gt_parse of the examples containing the menu.sub_nm, and compare those of the CORD v1. [20220720]
  • CORD v1 data has been uploaded to the Hugging Face Datasets. CORD v1 has the same contents as v0 except the gt_parse attribute. gt_parse represents the parse format constructed from the valid_line. [20220720]
  • 1,000 sample dataset will be available soon. Some class labels shown in the original paper were removed due to Indonesian legal issues. In particular, the store_info, payment_info, and etc fields have been removed from the target class to be published. [20191212]
  • 1,000 sample dataset has been released. [20191226]
  • Some categories not used in the current dataset have been removed from the class definition. [20200210]

Key Features

  • Large Scale: over 11,000 Indonesian receipts collected from shops and restaurants
  • Fine-grained classes: five superclass and 42 subclass labels
  • Multi hierarchy: includes group annotations
  • Additional information: line group (row_id), region of interest (roi), cut lines (repeating_symbol), and is_key flag

Data Specification (for the whole dataset)

Class Definition (total 30)

No Category Tag field (subclasses) Description
1 menu (14) menu.nm name of menu
2 menu.num identification # of menu
3 menu.unitprice unit price of menu
4 menu.cnt quantity of menu
5 menu.discountprice discounted price of menu
6 menu.price total price of menu
7 menu.itemsubtotal price of each menu after discount applied
8 menu.vatyn whether the price includes tax or not
9 menu.etc others
10 menu.sub_nm name of submenu
11 menu.sub_num identification # of submenu
12 menu.sub_unitprice unit price of submenu
13 menu.sub_cnt quantity of submenu
14 menu.sub_discountprice discounted price of submenu
15 menu.sub_price total price of submenu
16 menu.sub_etc others
17 void menu (2) void_menu.nm name of menu
18 voidmenu.num identification # of menu
19 voidmenu.unitprice unit price of menu
20 voidmenu.cnt quantity of menu
21 void_menu.price total price of menu
22 voidmenu.etc others
23 subtotal (6) subtotal.subtotal_price subtotal price
24 subtotal.discount_price discounted price in total
25 subtotal.subtotal_count Total number of items
26 subtotal.service_price service charge
27 subtotal.othersvc_price added charge other than service charge
28 subtotal.tax_price tax amount
29 subtotal.tax_and_service tax + service
30 subtotal.etc others
31 void total (0) voidtotal.subtotal_price void subtotal price
32 voidtotal.tax_price void tax price
33 voidtotal.total_price total void price
34 voidtotal.etc void etc information
35 total (8) total.total_price total price
36 total.total_etc others
37 total.cashprice amount of price paid in cash
38 total.changeprice amount of change in cash
39 total.creditcardprice amount of price paid in credit/debit card
40 total.emoneyprice amount of price paid in emoney, point
41 total.menutype_cnt total count of type of menu
42 total.menuqty_cnt total count of quantity

Json Hierarchy

Attribute Name Description
valid_line words quad Four coordinates of quadrilateral
is_key Flag to indicates the text used as a key or not
row_id Line index
text Incorporating text of the corresponding box
category Parse class label
group_id Group id to which the valid_line belongs
---------------- ---------- ------ ----------------------------------------------------------
meta version Dataset version
image_id Corresponding image id
split 'train' or 'dev' or 'test'
image_size Size of the image (by pixel)
---------------- ---------- ------ ----------------------------------------------------------
roi* Four coordinates that encompass the area of receipt region
---------------- ---------- ------ ----------------------------------------------------------
repeating_symbol quad Four coordinates of quadrilateral
text = or - or . or etc.

*A blank 'roi' value means the entire area of the image.

Download Link

Version Name Total # train # dev # test release date
v0 sample (zip) 1,000 800 100 100 26 Dec 2019
v1 Hugging Face Datasets Link 1,000 800 100 100 20 Jul 2022
v2 Hugging Face Datasets Link 1,000 800 100 100 20 Jul 2022

Citation

CORD: A Consolidated Receipt Dataset for Post-OCR Parsing

@article{park2019cord,
  title={CORD: A Consolidated Receipt Dataset for Post-OCR Parsing},
  author={Park, Seunghyun and Shin, Seung and Lee, Bado and Lee, Junyeop and Surh, Jaeheung and Seo, Minjoon and Lee, Hwalsuk}
  booktitle={Document Intelligence Workshop at Neural Information Processing Systems}
  year={2019}
}

Post-OCR parsing: building simple and robust parser via BIO tagging

@article{hwang2019post,
  title={Post-OCR parsing: building simple and robust parser via BIO tagging},
  author={Hwang, Wonseok and Kim, Seonghyeon and Yim, Jinyeong and Seo, Minjoon and Park, Seunghyun and Park, Sungrae and Lee, Junyeop and Lee, Bado and Lee, Hwalsuk}
  booktitle={Document Intelligence Workshop at Neural Information Processing Systems}
  year={2019}
}

OCR-free Document Understanding Transformer 🍩

@article{kim2021donut,
   title={OCR-free Document Understanding Transformer},
   author={Kim, Geewook and Hong, Teakgyu and Yim, Moonbin and Nam, JeongYeon and Park, Jinyoung and Yim, Jinyeong and Hwang, Wonseok and Yun, Sangdoo and Han, Dongyoon and Park, Seunghyun},
   journal={arXiv preprint arXiv:2111.15664},
   year={2021}
}

More Repositories

1

donut

Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022
Python
5,573
star
2

deep-text-recognition-benchmark

Text recognition (optical character recognition) with deep learning methods, ICCV 2019
Jupyter Notebook
3,692
star
3

stargan-v2

StarGAN v2 - Official PyTorch Implementation (CVPR 2020)
Python
3,459
star
4

CRAFT-pytorch

Official implementation of Character Region Awareness for Text Detection (CRAFT)
Python
3,024
star
5

CutMix-PyTorch

Official Pytorch implementation of CutMix regularizer
Python
1,211
star
6

voxceleb_trainer

In defence of metric learning for speaker recognition
Python
1,012
star
7

WCT2

Software that can perform photorealistic style transfer without the need of any post-processing steps.
Python
867
star
8

synthtiger

Official Implementation of SynthTIGER (Synthetic Text Image Generator), ICDAR 2021
Python
457
star
9

tunit

Rethinking the Truly Unsupervised Image-to-Image Translation - Official PyTorch Implementation (ICCV 2021)
Python
452
star
10

rexnet

Official Pytorch implementation of ReXNet (Rank eXpansion Network) with pretrained models
Python
451
star
11

AdamP

AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
Python
411
star
12

overhaul-distillation

Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)
Python
409
star
13

cutblur

Rethinking Data Augmentation for Image Super-resolution (CVPR 2020)
Jupyter Notebook
379
star
14

wsolevaluation

Evaluating Weakly Supervised Object Localization Methods Right (CVPR 2020)
Python
331
star
15

assembled-cnn

Tensorflow implementation of "Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network"
Python
329
star
16

generative-evaluation-prdc

Code base for the precision, recall, density, and coverage metrics for generative models. ICML 2020.
Python
239
star
17

ext_portrait_segmentation

Python
238
star
18

ClovaCall

ClovaCall dataset and Pytorch LAS baseline code (Interspeech 2020)
Python
218
star
19

fewshot-font-generation

The unified repository for few-shot font generation methods. This repository includes FUNIT (ICCV'19), DM-Font (ECCV'20), LF-Font (AAAI'21) and MX-Font (ICCV'21).
Python
199
star
20

EXTD_Pytorch

Official EXTD Pytorch code
Python
187
star
21

stargan-v2-tensorflow

StarGAN v2 - Official Tensorflow Implementation (CVPR 2020)
Python
187
star
22

CLEval

CLEval: Character-Level Evaluation for Text Detection and Recognition Tasks
Python
184
star
23

TedEval

TedEval: A Fair Evaluation Metric for Scene Text Detectors
Python
176
star
24

rebias

Official Pytorch implementation of ReBias (Learning De-biased Representations with Biased Representations), ICML 2020
Python
168
star
25

SATRN

Official Tensorflow Implementation of SATRN (CVPR Workshop WTDDLE 2020)
Python
162
star
26

bros

Python
156
star
27

lffont

Official PyTorch implementation of LF-Font (Few-shot Font Generation with Localized Style Representations and Factorization) AAAI 2021
Python
153
star
28

aasist

Official PyTorch implementation of "AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networks"
Python
151
star
29

som-dst

SOM-DST: Efficient Dialogue State Tracking by Selectively Overwriting Memory (ACL 2020)
Python
150
star
30

mxfont

Official PyTorch implementation of MX-Font (Multiple Heads are Better than One: Few-shot Font Generation with Multiple Localized Experts) ICCV 2021
Python
147
star
31

dmfont

Official PyTorch implementation of DM-Font (ECCV 2020)
Python
133
star
32

rainbow-memory

Official pytorch implementation of Rainbow Memory (CVPR 2021)
Python
117
star
33

FocusSeq2Seq

[EMNLP 2019] Mixture Content Selection for Diverse Sequence Generation (Question Generation / Abstractive Summarization)
Python
113
star
34

attention-feature-distillation

Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
Python
111
star
35

frostnet

FrostNet: Towards Quantization-Aware Network Architecture Search
Python
106
star
36

webvicob

Official Implementation of Web-based Visual Corpus Builder (Webvicob), ICDAR 2023
Python
101
star
37

length-adaptive-transformer

Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
Python
99
star
38

spade

Python
81
star
39

embedding-expansion

Official MXNet implementation of "Embedding Expansion: Augmentation in Embedding Space for Deep Metric Learning" (CVPR 2020)
Python
76
star
40

symmetrical-synthesis

Official Tensorflow implementation of "Symmetrical Synthesis for Deep Metric Learning" (AAAI 2020)
Python
71
star
41

units

Python
70
star
42

lookwhostalking

Look Who’s Talking: Active Speaker Detection in the Wild
Python
70
star
43

subword-qac

Subword Language Model for Query Auto-Completion
Python
67
star
44

ssmix

Official PyTorch Implementation of SSMix (Findings of ACL 2021)
Python
60
star
45

SSUL

[NeurIPS 2021] SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning
Python
59
star
46

BESTIE

[CVPR 2022] Beyond Semantic to Instance Segmentation: Weakly-Supervised Instance Segmentation via Semantic Knowledge Transfer and Self-Refinement
Python
55
star
47

PointWSSIS

[CVPR2023] The Devil is in the Points: Weakly Semi-Supervised Instance Segmentation via Point-Guided Mask Representation
Python
55
star
48

c3_sinet

Python
52
star
49

EResFD

Lightweight Face Detector from CLOVA
Python
44
star
50

puridiver

Official PyTorch Implementation of PuriDivER CVPR 2022.
Python
44
star
51

minimal-rnr-qa

[NAACL 2021] Designing a Minimal Retrieve-and-Read System for Open-Domain Question Answering
Python
36
star
52

ECLIPSE

(CVPR 2024) ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning
Python
34
star
53

group-transformer

Official code for Group-Transformer (Scale down Transformer by Grouping Features for a Lightweight Character-level Language Model, COLING-2020).
Python
25
star
54

ProxyDet

Official implementation of the paper "ProxyDet: Synthesizing Proxy Novel Classes via Classwise Mixup for Open-Vocabulary Object Detection"
Python
22
star
55

GeNAS

Official pytorch implementation for GeNAS: Neural Architecture Search with Better Generalization
Python
15
star
56

meev

Python
12
star
57

pkm-transformers

Official implementation of PKM-augmented language models (Findings of EMNLP 2020)
9
star
58

DCutMix

DCutMix official repo
Python
8
star
59

TVQ-VAE

Official pytorch implementation for TVQ-VAE
Jupyter Notebook
8
star
60

textual-kd-slu

Official Implementation of Textual KD SLU (ICASSP 2021)
Python
6
star
61

vat-d

Official Implementation of VAT-D
Python
5
star
62

ActiveASR_AugCR

Repositoty for Efficient Active Learning for Automatic Speech Recognition via Augmented Consistency Regularization
3
star
63

WSSS-BED

Rethinking Saliency-Guided Weakly-Supervised Semantic Segmentation
Python
1
star