Image-to-Markup / im2latex

Image-to-Markup / dataset

IM2LATEX-100K

Mathematical expression images and LaTeX source, introduced by Yuntian Deng and collaborators in the Image-to-Markup research.

Research citation: Yuntian Deng, Anssi Kanervisto, Jeffrey Ling, and Alexander M. Rush · ICML 2017

Origin and attribution.

IM2LATEX-100K was introduced in Deng, Kanervisto, and Rush’s 2016 visual markup decompiler paper and described in the 2017 ICML paper by Deng, Kanervisto, Ling, and Rush. The original formulas were extracted from arXiv LaTeX sources in the Cornell KDD Cup collection and rendered as images.

The original Zenodo archive was prepared and deposited by coauthor Anssi Kanervisto; its displayed publication date is 21 June 2016. The project’s code repository provides preprocessing, training, and evaluation.

Using a mirror or processed version? Please cite the original research paper below and identify the distribution you used. A new file format, hosting location, or rerendering should retain the original dataset provenance; additional contributions can be credited alongside it.

Choose the right version

One lineage, distinct distributions.

The paper’s benchmark description, hosted file lists, and later Hugging Face exports have different counts. These are documented separately so experiments can identify their exact input data.

Split counts: paper as published; hosted files verified 19 October 2026.
DistributionTrainValidationTestWhat is counted
ICML 2017 paper83,8839,31910,354103,556 examples reported in the paper
Hosted raw lists83,8849,32010,355103,559 list records
Hosted processed lists75,2758,37010,35594,000 list records; test is not filtered
HF im2latex-100k55,0336,0726,81067,915 rows with normalized targets
HF im2latex-100k-raw165,09918,21620,430203,745 rows: three target representations per source row

The hosted formula lists each contain 103,559 indexed lines. Preserve empty entries in the tokenized and normalized lists: removing them changes formula indices. The hosted counts describe the files served here; they do not revise the paper’s reported experiment sizes. File sizes and hashes · SHA-256 checksums

Direct downloads

Original project files.

The existing file addresses remain unchanged. Use the original repository’s preprocessing and evaluation scripts when reproducing its pipeline.

Processed files

The preprocessing pipeline crops images, downsamples and pads them for batching, and tokenizes or normalizes formula targets. Training and validation are filtered; the test list is converted to the processed format without filtering.

Raw files

Formula source and original split lists. Raw list records use formula_index image_name render_type; processed records use image_filename formula_index. Formula indices are zero-based.

IM2LATEX-100K-HANDWRITTEN

The synthetic handwritten-expression release used for pretraining in the paper, distinct from the printed-expression dataset.

Hugging Face

Ready-to-load exports.

yuntian-deng/im2latex-100k

67,915 rows across train, val, and test, with image, formula, and filename fields. The targets are normalized LaTeX.

yuntian-deng/im2latex-100k-raw

Adds a preprocessing field with none, tokenized, and normalized targets. The three target representations explain the threefold row count; these are not three independent sets of formulas.

from datasets import load_dataset

# Normalized targets; split names are train, val, test.
data = load_dataset("yuntian-deng/im2latex-100k")

# Three target representations, labeled by preprocessing.
variants = load_dataset("yuntian-deng/im2latex-100k-raw")

These exports are subsets of the hosted project files, not interchangeable copies of the full benchmark. Consult their dataset cards for exact provenance, repeated filenames, and evaluation limitations; record the repository revision in your experiments.

Reproducibility

Before training or comparing results.

Keep formula indices and newline handling intact

Raw split files point into the formula list by zero-based line index. Read the list with explicit LF newline handling, as documented in the original archive. Do not delete empty normalized targets or treat every line as a valid rendered sample without checking the accompanying split and image.

Report preprocessing and evaluation choices

Record the dataset distribution, revision or file hashes, formula normalization, image preprocessing, and split sizes. Different LaTeX strings can render the same expression. The original code provides both text-based and rendered-image evaluation; report the metric you actually use.

Distinguish printed and handwritten data

IM2LATEX-100K contains rendered printed expressions. The separate handwritten archive contains synthetically generated handwritten expressions; it should not be described as a collection of human handwriting. The ICML paper documents the transfer experiments and their evaluation setting.

Source licenses and intended use

The original dataset archive declares CC0 1.0. The model code is MIT-licensed; that is a separate license. Consult the specific release’s documentation when redistributing processed or handwritten data. The data is a research resource for mathematical-expression recognition; its rendered scientific expressions do not represent the full range of real-world images or handwriting.

Citation

Cite the original work.

If you use IM2LATEX-100K, its processed versions, or the Image-to-Markup model, please cite the ICML 2017 paper and identify the exact data release and preprocessing you used. When using a derivative, credit its additional contribution alongside the original dataset.

Yuntian Deng, Anssi Kanervisto, Jeffrey Ling, and Alexander M. Rush. Image-to-Markup Generation with Coarse-to-Fine Attention. ICML 2017, PMLR 70:980–989.

@inproceedings{pmlr-v70-deng17a,
  title = {Image-to-Markup Generation with Coarse-to-Fine Attention},
  author = {Deng, Yuntian and Kanervisto, Anssi and Ling, Jeffrey and Rush, Alexander M.},
  booktitle = {Proceedings of the 34th International Conference on Machine Learning},
  pages = {980--989},
  year = {2017},
  volume = {70},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
  url = {https://proceedings.mlr.press/v70/deng17a.html}
}

For the original dataset archive, also identify Anssi Kanervisto’s 2016 Zenodo release, DOI 10.5281/zenodo.56198. The archive citation and the research-paper citation describe related contributions.