Image-to-Markup / dataset
IM2LATEX-100K
Mathematical expression images and LaTeX source, introduced by Yuntian Deng and collaborators in the Image-to-Markup research.
Origin and attribution.
IM2LATEX-100K was introduced in Deng, Kanervisto, and Rush’s 2016 visual markup decompiler paper and described in the 2017 ICML paper by Deng, Kanervisto, Ling, and Rush. The original formulas were extracted from arXiv LaTeX sources in the Cornell KDD Cup collection and rendered as images.
The original Zenodo archive was prepared and deposited by coauthor Anssi Kanervisto; its displayed publication date is 21 June 2016. The project’s code repository provides preprocessing, training, and evaluation.
Using a mirror or processed version? Please cite the original research paper below and identify the distribution you used. A new file format, hosting location, or rerendering should retain the original dataset provenance; additional contributions can be credited alongside it.
Choose the right version
One lineage, distinct distributions.
The paper’s benchmark description, hosted file lists, and later Hugging Face exports have different counts. These are documented separately so experiments can identify their exact input data.
| Distribution | Train | Validation | Test | What is counted |
|---|---|---|---|---|
| ICML 2017 paper | 83,883 | 9,319 | 10,354 | 103,556 examples reported in the paper |
| Hosted raw lists | 83,884 | 9,320 | 10,355 | 103,559 list records |
| Hosted processed lists | 75,275 | 8,370 | 10,355 | 94,000 list records; test is not filtered |
| HF im2latex-100k | 55,033 | 6,072 | 6,810 | 67,915 rows with normalized targets |
| HF im2latex-100k-raw | 165,099 | 18,216 | 20,430 | 203,745 rows: three target representations per source row |
The hosted formula lists each contain 103,559 indexed lines. Preserve empty entries in the tokenized and normalized lists: removing them changes formula indices. The hosted counts describe the files served here; they do not revise the paper’s reported experiment sizes. File sizes and hashes · SHA-256 checksums
Direct downloads
Original project files.
The existing file addresses remain unchanged. Use the original repository’s preprocessing and evaluation scripts when reproducing its pipeline.
Processed files
The preprocessing pipeline crops images, downsamples and pads them for batching, and tokenizes or normalizes formula targets. Training and validation are filtered; the test list is converted to the processed format without filtering.
- im2latex_formulas.norm.lstNormalized LaTeX targets · 103,559 indexed lines
- im2latex_formulas.tok.lstTokenized LaTeX targets · 103,559 indexed lines
- formula_images_processed.tar.gzCropped, downsampled and padded expression images
- im2latex_train_filter.lstProcessed training list · 75,275 records
- im2latex_validate_filter.lstProcessed validation list · 8,370 records
- im2latex_test_filter.lstFormat-converted test list · 10,355 records; not filtered
Raw files
Formula source and original split lists. Raw list records use formula_index image_name render_type; processed records use image_filename formula_index. Formula indices are zero-based.
- im2latex_formulas.lstOriginal LaTeX targets · 103,559 indexed lines
- im2latex_train.lstRaw training list · 83,884 records
- im2latex_validate.lstRaw validation list · 9,320 records
- im2latex_test.lstRaw test list · 10,355 records
- formula_images.tar.gzOriginal rendered images
IM2LATEX-100K-HANDWRITTEN
The synthetic handwritten-expression release used for pretraining in the paper, distinct from the printed-expression dataset.
- IM2LATEX-100K-HANDWRITTEN.tgzSynthetic handwritten images, formula targets and split files
Hugging Face
Ready-to-load exports.
yuntian-deng/im2latex-100k
67,915 rows across train, val, and test, with image, formula, and filename fields. The targets are normalized LaTeX.
yuntian-deng/im2latex-100k-raw
Adds a preprocessing field with none, tokenized, and normalized targets. The three target representations explain the threefold row count; these are not three independent sets of formulas.
from datasets import load_dataset
# Normalized targets; split names are train, val, test.
data = load_dataset("yuntian-deng/im2latex-100k")
# Three target representations, labeled by preprocessing.
variants = load_dataset("yuntian-deng/im2latex-100k-raw")These exports are subsets of the hosted project files, not interchangeable copies of the full benchmark. Consult their dataset cards for exact provenance, repeated filenames, and evaluation limitations; record the repository revision in your experiments.
Reproducibility
Before training or comparing results.
Keep formula indices and newline handling intact
Raw split files point into the formula list by zero-based line index. Read the list with explicit LF newline handling, as documented in the original archive. Do not delete empty normalized targets or treat every line as a valid rendered sample without checking the accompanying split and image.
Report preprocessing and evaluation choices
Record the dataset distribution, revision or file hashes, formula normalization, image preprocessing, and split sizes. Different LaTeX strings can render the same expression. The original code provides both text-based and rendered-image evaluation; report the metric you actually use.
Distinguish printed and handwritten data
IM2LATEX-100K contains rendered printed expressions. The separate handwritten archive contains synthetically generated handwritten expressions; it should not be described as a collection of human handwriting. The ICML paper documents the transfer experiments and their evaluation setting.
Source licenses and intended use
The original dataset archive declares CC0 1.0. The model code is MIT-licensed; that is a separate license. Consult the specific release’s documentation when redistributing processed or handwritten data. The data is a research resource for mathematical-expression recognition; its rendered scientific expressions do not represent the full range of real-world images or handwriting.
Citation
Cite the original work.
If you use IM2LATEX-100K, its processed versions, or the Image-to-Markup model, please cite the ICML 2017 paper and identify the exact data release and preprocessing you used. When using a derivative, credit its additional contribution alongside the original dataset.
Yuntian Deng, Anssi Kanervisto, Jeffrey Ling, and Alexander M. Rush. Image-to-Markup Generation with Coarse-to-Fine Attention. ICML 2017, PMLR 70:980–989.
@inproceedings{pmlr-v70-deng17a,
title = {Image-to-Markup Generation with Coarse-to-Fine Attention},
author = {Deng, Yuntian and Kanervisto, Anssi and Ling, Jeffrey and Rush, Alexander M.},
booktitle = {Proceedings of the 34th International Conference on Machine Learning},
pages = {980--989},
year = {2017},
volume = {70},
series = {Proceedings of Machine Learning Research},
publisher = {PMLR},
url = {https://proceedings.mlr.press/v70/deng17a.html}
}
For the original dataset archive, also identify Anssi Kanervisto’s 2016 Zenodo release, DOI 10.5281/zenodo.56198. The archive citation and the research-paper citation describe related contributions.