Dictionary of Applied Machine Learning: 114 machine-learning terms, each with a definition, a figure, citations and a Python demo · All terms · Demos · Start here

data

Updated on 2026-10-29

Readiness 100/100

▶ Run the Python demo Open in Colab Typeset PDF LaTeX source Markdown Cite this entry

See also data point dataset

Data are representations of information, recorded in a form suitable for storage, communication and processing, and the word carries three technical senses in machine learning (ML). In its general sense, it denotes recorded information in a form suitable for processing by ML methods. As a data point, it is an elementary information-carrying unit; as a dataset, it is an indexed collection of data points. A related regulatory term, personal data, is defined in the general data protection regulation (GDPR) and adopted by the EU AI Act.

Figure produced by the Python demo of the entry data
Figure written by the entry's Python demo data.py, which recomputes what the entry states: the script block by block · open in Colab

Definition

P-recordA weather station measures the temperature at its location and stores the value $23.4\,^{\circ}\mathrm{C}$ together with a timestamp (see Fig. 1(a)). Such recorded values are data: representations of information, recorded in a form suitable for storage, communication, and processing by machine learning systems (ML systems) (International Organization for Standardization and International Electrotechnical Commission, 2015). Every machine learning (ML) method trains a model on data, and the usefulness of the hypothesis the method learns is limited by the quality and quantity of the available data.

The word data is used in three technical senses, summarized in Fig. 1, and additionally in a legal sense. In its broadest use, data refer to recorded information. This sense applies when it does not matter whether a single data point or a collection of them is meant. Examples are raw sensor measurements such as the temperature reading in Fig. 1(a) and compound terms such as data parallelism, networked data, and data augmentation.

P-datapointAs a formal unit, a data point is the fundamental information-carrying unit (Fig. 1(b)). Its information is contained in two types of properties: features, which are easy to measure or compute, and labels, which are difficult to measure or compute or need human annotation. The formal model of a domain set, a label set and a labeling function that assigns each domain point its label is given by Shalev-Shwartz and Ben-David (2014, Sect. 2.1).

P-datasetAs a formal collection, a dataset $\mathcal{D} = \{{\mathbf z}^{(1)}, \ldots, {\mathbf z}^{(m)}\}$ is the indexed collection of data points on which model training and validation are performed (Fig. 1(c)) (Goodfellow et al., 2016, Sect. 5.1). The quality and the quantity of data that limit a learned hypothesis are properties of this collection: the labels of its data points and their number.

Figure 1 of the entry data
Figure 1: Three technical meanings of the word data in ML applications. (a) Data in the general sense: a temperature reading sampled at time instant $t^{*}$. (b) A data point $\datapoint=(\feature,\truelabel)$ with a single feature $\feature$ and label $\truelabel$. (c) A dataset that consists of a finite number of data points
The word data also carries a regulatory meaning. The general data protection regulation (GDPR) defines personal data as any information relating to an identified or identifiable natural person (European Parliament and Council of the European Union, 2016, Art. 4(1)). The EU AI Act adopts that definition and defines biometric data as personal data resulting from specific technical processing (European Parliament and Council of the European Union, 2024, Art. 3(34) and 3(50)). Several regulatory obligations on ML systems, including the data minimization principle, the right to erasure, and the right to explanation, refer to data in this legal sense.

See also: data point, dataset, personal data, general data protection regulation, EU AI Act.

References

  1. International Organization for Standardization and International Electrotechnical Commission (2015). Information technology --- Vocabulary. www.iso.org/obp/ui/#iso:std:iso-iec:2382:ed-1:v2:en
  2. Shalev-Shwartz and Ben-David (2014). Understanding Machine Learning: From Theory to Algorithms. Cambridge Univ. Press. doi.org/10.1017/cbo9781107298019
  3. Goodfellow et al. (2016). Deep Learning. MIT Press.
  4. European Parliament and Council of the European Union (2016). Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation) (Text with EEA relevance). eur-lex.europa.eu/eli/reg/2016/679/oj
  5. European Parliament and Council of the European Union (2024). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending Regulations (EC) No 300/2008, (EU) No 167/2013, (EU) No 168/2013, (EU) 2018/858, (EU) 2018/1139 and (EU) 2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828 (Artificial Intelligence Act) (Text with EEA relevance). eur-lex.europa.eu/eli/reg/2024/1689/oj/eng

Cite this entry

Published version: doi.org/10.1007/978-981-92-2012-0_1-1, in Dictionary of Applied Machine Learning (Springer Nature Singapore). Please cite that version. This page corresponds to version 1 of that entry.

@incollection{dictml_data,
  author = {Jung, Alexander},
  editor = {Olioumtsevits, Konstantina and Schnoor, Ekkehard},
  title = {data},
  booktitle = {Dictionary of Applied Machine Learning},
  publisher = {Springer Nature Singapore},
  year = {2026},
  doi = {10.1007/978-981-92-2012-0_1-1},
  isbn = {978-981-92-2012-0},
  url = {https://doi.org/10.1007/978-981-92-2012-0_1-1}
}