Dictionary of Applied Machine Learning

transparency

Updated on 2026-09-11

Typeset PDF version — the authoritative form of this entry

Python demo — a script that recomputes what this entry states and prints one line per check

Transparency is a key requirement for trustworthy artificial intelligence (trustworthy AI): it names the duties to close the information gaps between the provider of an artificial intelligence system (AI system), its deployer, and the persons affected by its predictions. For machine learning (ML) methods, transparency is often used interchangeably with explainability: explanations, delivered along with the predictions of a learned hypothesis, let a human user anticipate those predictions. The EU AI Act makes transparency a binding design requirement. Under the Act, the provider must design a high-risk artificial intelligence system (high-risk AI system) so that its deployer can interpret the delivered predictions, persons interacting with an AI system must be informed of that fact, and affected persons may obtain an explanation of decisions based on the predictions delivered by a high-risk AI system. The Act also requires documentation of the algorithm design, the training datasets, and the intended use of an AI system, as well as a machine-readable marking of synthetic content as artificially generated.

Definition

Consider a bank that uses an artificial intelligence system (AI system) to score loan applications. The loan officer sees only the score, and the applicant might not even know that an AI system was involved. Transparency names the duties to close such information gaps; it is a fundamental requirement for trustworthy artificial intelligence (trustworthy AI) (Intelligence, 2019).

P-methodsIn the context of machine learning (ML) methods, transparency is often used interchangeably with explainability (Gallese, 2023; Jung and Nardelli, 2020): explanations, delivered along with the predictions of a learned hypothesis, let a human user anticipate those predictions. Some ML methods inherently offer this form of transparency. Classification methods quantify the confidence in an individual prediction via the distance of the feature vector from the decision boundary. A shallow decision tree does not require a separately constructed explanation: presenting the tree as a flow chart of explicit, human-readable decision rules is an explanation of every prediction it delivers (see interpretable machine learning (interpretable ML)) (Rudin, 2019).

In the broader scope of AI systems, transparency extends beyond explainability: it includes informing persons that an AI system is in use and providing information about the limitations, the overall reliability, and the intended use of the system as a whole. The binding transparency obligations discussed below are those of the EU AI Act; other jurisdictions impose related but distinct duties, e.g., the Colorado Automated Decision-Making Technology Act (Assembly, 2026) and the court proceedings State v. Loomis on the use of a proprietary recidivism-risk score in sentencing (Wisconsin, 2016). The Act distributes its obligations among three roles: the provider that develops an AI system, the deployer that uses it, and the persons who interact with the AI system or are affected by its output (see deployer). The Act's term output denotes the predictions delivered by a learned hypothesis; the ML term prediction is used below. Like interpretability and explainability, which are relative to a specific user or group of users, transparency is relative to its addressee: what must be disclosed depends on the role.

P-readConcretely, Fig. 1 locates these obligations in a scatterplot of training set data points together with a learned hypothesis, for the credit-scoring example. The solid curve depicts the learned hypothesis $\learnthypothesis$ that the AI system applies: it maps the income $\feature$ of an applicant to a predicted credit score $\learnthypothesis(\feature)$, and a loan is approved when the predicted score exceeds an approval threshold (dotted line). Art. 13 concerns the use of this map: the deployer must be able to interpret the delivered predictions — here, to read off the prediction $\learnthypothesis(\feature')$ for an applicant with income $\feature'$ (open square) and its distance from the threshold.

P-trainThe filled circles depict the training set $\trainset$ of completed loans, with income as the feature $\feature$ and credit score as the label $\truelabel$, from which $\learnthypothesis$ was learned, e.g., via empirical risk minimization (ERM) — by minimizing the average loss of the hypothesis over $\trainset$. Art. 11 requires the provider to document both ingredients of this training: the dataset $\trainset$ and the design of the algorithm, including the model and the loss used. Income levels outside the range covered by $\trainset$ (shaded region) are a limitation that the documentation must state.

P-cfThe right to explanation of Art. 86 concerns a single prediction: the applicant with income $\feature'$, whose predicted score falls below the threshold, may ask why. One answer is a counterfactual: the smallest change of the feature that flips the decision — the income $\feature''$ (open diamond, arrow) at which $\learnthypothesis$ reaches the threshold.

Figure 1 of the entry transparency
Figure 1: Transparency obligations of the EU AI Act for a credit-scoring ML application. The solid curve depicts the learned hypothesis $\learnthypothesis$, whose predictions the deployer must be able to interpret (Art. 13): the prediction $\learnthypothesis(\feature')$ for a loan applicant with income $\feature'$ (open square) falls below the approval threshold (dotted line). Filled circles are the data points of the training set $\trainset$ from which $\learnthypothesis$ was learned via ERM; the provider must document this dataset and the algorithm design (Art. 11), and the shaded range of incomes not covered by $\trainset$ is a limitation the documentation must state. The applicant is informed that the AI system is used (Art. 26(11)) and may obtain an explanation of the decision (Art. 86), e.g., the counterfactual income $\feature''$ (open diamond, arrow) at which $\learnthypothesis$ reaches the threshold
Specifically, toward the deployer, the provider must design and develop a high-risk artificial intelligence system (high-risk AI system) so that its operation is sufficiently transparent to enable the deployers to interpret its predictions and use them appropriately (Parliament and Union, 2024, Art. 13). In medical diagnosis, the provider is, e.g., a company that develops an X-ray analysis tool, and a clinic that uses the tool acts as the deployer: the provider can meet the duty of Art. 13 by designing the tool to disclose to the clinician the confidence level for the predictions delivered by a learned hypothesis. This duty targets the meaning of the predictions in the context of their use; the AI Risk Management Framework of the US National Institute of Standards and Technology reserves the term interpretability for this contextual meaning (Standards and Technology, 2023). This usage differs from interpretability as the comprehension of the computational process of the method; Art. 13 does not require that comprehension.

Toward persons who interact directly with an AI system, such as an artificial intelligence (AI)-powered chatbot, the provider must design the AI system so that these persons are informed of that fact (Parliament and Union, 2024, Art. 50(1)). Providers of AI systems that generate synthetic audio, image, video, or text content must mark such content in a machine-readable format as artificially generated (Parliament and Union, 2024, Art. 50(2)). This marking duty applies whether or not the AI system is a high-risk AI system; it is waived, e.g., where the AI system only performs an assistive function for standard editing (Parliament and Union, 2024, Art. 50(2)). For a deep fake, the deployer must, in addition, disclose visibly that the content is artificially generated or manipulated (Parliament and Union, 2024, Art. 50(4)).

A person can be affected by an AI system without directly interacting with it. A patient whose diagnosis is supported by an AI-based system deals only with the clinician. Nevertheless, the deployer must inform the patient that a high-risk AI system is used concerning them (Parliament and Union, 2024, Art. 26(11)). The EU AI Act also grants the affected person a right to explanation: the deployer must, on request, provide a clear and meaningful explanation of the role of the AI system in a decision based on its predictions (Parliament and Union, 2024, Art. 86). In credit scoring, for example, a loan applicant faced with an adverse automated decision may obtain from the deployer, under this right, an explanation of the contributing factors, such as income level or credit history, and use it to contest the decision (see Fig. 1).

Transparency also encompasses documentation detailing the purpose and design choices underlying the AI system. For a high-risk AI system, the provider must provide documentation that covers the algorithm design and the datasets used for training (Parliament and Union, 2024, Art. 11). The provider of a general-purpose AI model (GPAI model) must additionally publish a sufficiently detailed summary of the content used for training (Parliament and Union, 2024, Art. 53). Datasheets for datasets (Gebru et al., 2021) and model cards (Mitchell et al., 2019) help practitioners understand the intended use cases and limitations of an AI system.

Fig. 2 summarizes these transparency obligations as information flows between the provider of an AI system, its deployer, and the persons exposed to its predictions.

Figure 2 of the entry transparency
Figure 2: Transparency obligations of the EU AI Act as information flows, with the roles instantiated by the medical-diagnosis example. The provider of a high-risk AI system supplies technical documentation, covering the algorithm design and the training datasets, along with instructions for use. The deployer must be able to interpret the predictions of the AI system. Persons who interact directly with the AI system must be informed of that fact, and generated content must carry a machine-readable mark that it is artificial (Art. 50). An affected person who never interacts with the AI system, such as a patient whose diagnosis the system supports, is informed of its use, and owed an explanation of an adverse decision, by the deployer (Arts. 26(11), 86)
See also: trustworthy AI, explainability, interpretability, interpretable ML, explanation, counterfactual, right to explanation, EU AI Act, high-risk AI system, AI system, GPAI model, provider, deployer, watermarking, deep fake, content provenance.

References

  1. Intelligence (2019). Ethics Guidelines for Trustworthy AI. digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai
  2. Gallese (2023). The AI Act proposal: A new right to technical interpretability?. SSRN Electron. J.. doi.org/10.2139/ssrn.4398206
  3. Jung and Nardelli (2020). An Information-Theoretic Approach to Personalized Explainable Machine Learning. IEEE Signal Process. Lett.. doi.org/10.1109/lsp.2020.2993176
  4. Rudin (2019). Stop explaining black box machine learning models for high-stakes decisions and use interpretable models instead. Nature Mach. Intell.. doi.org/10.1038/s42256-019-0048-x
  5. Assembly (2026). Senate Bill 26-189 --- Automated Decision-Making Technology. leg.colorado.gov/bills/sb26-189
  6. Wisconsin (2016). State v. Loomis, 2016 WI 68, 881 N.W.2d 749. www.wicourts.gov/sc/opinion/DisplayDocument.pdf?content=pdf&seqNo=171690
  7. Parliament and Union (2024). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending Regulations (EC) No 300/2008, (EU) No 167/2013, (EU) No 168/2013, (EU) 2018/858, (EU) 2018/1139 and (EU) 2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828 (Artificial Intelligence Act) (Text with EEA relevance). eur-lex.europa.eu/eli/reg/2024/1689/oj/eng
  8. Standards and Technology (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0). doi.org/10.6028/NIST.AI.100-1
  9. Gebru et al. (2021). Datasheets for datasets. Commun. ACM. doi.org/10.1145/3458723
  10. Mitchell et al. (2019). Model Cards for Model Reporting. Proc. Conf. Fairness, Accountability, Transparency. doi.org/10.1145/3287560.3287596

Cite this entry

@misc{dictml_transparency,
  author = {Jung, Alexander},
  editor = {Olioumtsevits, Konstantina and Schnoor, Ekkehard},
  title = {transparency},
  howpublished = {Dictionary of Applied Machine Learning (course edition)},
  year = {2026},
  doi = {10.5281/zenodo.21569296},
  note = {ISBN 978-952-64-3013-3, CC BY 4.0, retrieved 2026-09-21},
  url = {https://dictionaryofml.org/terms/transparency.html}
}