Algorithmengestützte Verwaltungsverfahren – Einsatzfelder, Risiken und Notwendigkeit ergänzender Kontrollen
Year: 2022
Author: Englisch, Joachim, Schuh, Mathias
Die Verwaltung, Vol. 55 (2022), Iss. 2 : pp. 155–190
Abstract
The digitization of the German public sector is gaining momentum and it now also extends to the use of algorithms and artificial intelligence in administrative procedures. On the basis of recently published official data, a broad spectrum of fields and variants of application can be identified. However, this increasing reliance on algorithms also creates particular challenges to the rule of law. In particular, the reliance on algorithms can increase the risk of systematic unlawfulness and bias in administrative decision-making, whether fully automated or still accounted for by a human official. Recent studies suggest that also in the latter case, those risks are often not properly managed – and are sometimes even exacerbated – by the humans in the loop. The traditional instruments of judicial protection and internal administrative supervision are not well suited to address the aforementioned inherent and operational risks either; moreover, they offer only ex post remedies and have no preventive effect. Therefore, additional technical precautions and institutional arrangements are required to uphold the rule of law. They should include investments in explainable artificial intelligence (“XAI”) and adequate staff training programs, as well as the creation of public registers and independent standard-setting and auditing bodies for public sector algorithms. In particularly sensitive areas of administration, the use of technical or proprietary black box algorithms should be entirely banned until further technological progress on transparency and risk control has been made.
You do not have full access to this article.
Already a Subscriber? Sign in as an individual or via your institution
Journal Article Details
Publisher Name: Global Science Press
Language: German
DOI: https://doi.org/10.3790/verw.55.2.155
Die Verwaltung, Vol. 55 (2022), Iss. 2 : pp. 155–190
Published online: 2022-04
AMS Subject Headings: Duncker & Humblot
Copyright: COPYRIGHT: © Global Science Press
Pages: 36
Author Details
| Section Title | Page | Action | Price |
|---|---|---|---|
| Joachim Englisch/Mathias Schuh: Algorithmengestützte Verwaltungsverfahren– Einsatzfelder, Risiken und Notwendigkeit ergänzender Kontrollen – | 155 | ||
| I. Einleitung | 155 | ||
| II. Einsatzfelder und Kategorien algorithmengestützten Entscheidens | 157 | ||
| 1. Quellenlage | 157 | ||
| 2. Abgrenzung des Untersuchungsgegenstands | 158 | ||
| 3. Kategorisierung des untersuchten Algorithmeneinsatzes | 160 | ||
| III. Risiken des Einsatzes von Algorithmen für rechtsstaatliche Entscheidungsfindung | 165 | ||
| 1. Fehlerhafte Ergebnisse | 165 | ||
| 2. Gruppenspezifische Benachteiligung oder Begünstigung | 169 | ||
| IV. Unzulänglichkeit herkömmlicher Rechenschaftspflichten und Kontrollen | 176 | ||
| 1. Reduzierte Effektivität individualschützender Transparenzerfordernisse und Rechtsbehelfe | 176 | ||
| 2. Unzureichende Adressierung technologischer und operationeller Risiken | 178 | ||
| V. Lösungsansätze | 180 | ||
| 1. Technische Vorkehrungen für nachvollziehbare Einzelfallbegründungen | 180 | ||
| 2. Stärkung der Kontrollfunktion der am Algorithmeneinsatz beteiligten Amtsträger | 184 | ||
| 3. Öffentliche Modelltransparenz | 185 | ||
| 4. Systemprüfungen durch übergeordnete Kontrollinstanzen | 186 | ||
| 5. Verbot des Algorithmeneinsatzes bei unverhältnismäßigen Risiken | 187 | ||
| VI. Zusammenfassung | 188 | ||
| Abstract | 190 |