Who publishes Complex Document Information Processing (CDIP) dataset?

National Institute of Standards and Technology, part of Department of Commerce, publishes this dataset on Data.gov.

How often is it updated?

The publisher lists the update frequency as irregularly. The last update was on 01/01/1996.

How do I download it?

It is available as TXT. Use the links in Files and access, which open the official government source.

Checked Oct 30, 2026

Federal data

Complex Document Information Processing (CDIP) dataset

Name: Complex Document Information Processing (CDIP) dataset
Creator: National Institute of Standards and Technology
License: https://www.nist.gov/open/license

Published by National Institute of Standards and Technology · Updated 01/01/1996 · Irregularly

Official source Download TXT

Last updated: 01/01/1996
Update frequency: Irregularly
Formats: 1; TXT
Coverage: Nationwide; Federal data

About this dataset

This dataset is called the "IIT CDIP collection". "CDIP" stands for "Complex Document Information Processing" and "IIT" stands for "Illinois Institute of Technology" who originally built the dataset. The dataset consists of documents from the states' lawsuit against the tobacco industry in the 1990s. As a result of the settlement of that lawsuit (the "Master Settlement Agreement"), the companies had to make all the documents public in an archive, which currently resides at UCSF, the University of California, San Francisco.IIT used this data to build a dataset of "messy" documents that were challenging for existing systems to process. There is handwriting on the documents, stains, etc. TREC used an automatic text conversion of this dataset in the TREC Legal Track, and we also have the original TIFF scans of the documents. The dataset consists of around 7 million documents, preprocessed with 90s-era OCR, and also the original page scans in TIFF format. See contact information in this record for access to this dataset.

Files and access

Links open the official government source

TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
TXTdata.nist.govTXT
DOI Access for Complex Document Information Processing (CDIP) datasetdoi.org
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov
Resourcedata.nist.gov

Links open outside websites we do not control.

Frequently asked questions

Who publishes Complex Document Information Processing (CDIP) dataset?: National Institute of Standards and Technology, part of Department of Commerce, publishes this dataset on Data.gov.
How often is it updated?: The publisher lists the update frequency as irregularly. The last update was on 01/01/1996.
How do I download it?: It is available as TXT. Use the links in Files and access, which open the official government source.

Where this catalog comes from

Data.gov CatalogU.S. General Services Administration
State and local open data portalsSocrata Discovery API
State and city CKAN portalsCalifornia, Virginia, Boston, Houston and more
Government ArcGIS Hub sitesCity and county GIS data

Catalog checked 10/24/2026

We list dataset descriptions only. Downloads and APIs link straight to the official government source, which holds the current version and its terms of use.

Source: Data.gov · Last updated 10/24/2026 · Listing only; the data stays with the publisher