Ethische Künstliche Intelligenz. EU AI Act et al.

Ethische Künstliche Intelligenz EU AI Act et al. Dr. Christian M. Stracke Rheinische Friedrich-Wilhelms-Universität Bonn, Germany Vortrag am 15. Mai 2025 in Göttingen beim ZKI-Bundestreffen Arbeitskreis Cloud-Management [email protected]e https://opening-up.education https://doi.org/10.5281/zenodo.15518578 With Creative Commons Open License for saving, sharing & re-using slides "Attribution –Noncommercial –Share Alike 3.0" You can freely share, copy, distribute and transmit the work under the following conditions: 1. Attribution –2. Noncommercial –3. Share Alike Some rights reserved, see: http://creativecommons.org/licenses/by-nc-sa/3.0/ 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 2 This presentation will be published on: https://opening-up.education 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 3 About myself Coordinator Cloud Strategy, OE and AI&ED, University of Bonn Adjunct Professor, Korean National Open University Advisory Professor, East China Normal University Founder & Director, European Research Institute eLC 100+ research projects with 55+ Mio. € budgets 200+ scientific publications incl. 100+ peer-reviewed / SSCI Creative design & training for 15,000 teachers & 5,000 schools Elected Chair of ISO & CEN Standardization Committees 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 4 Martin Wolpers' Lifetime Award Lifetime Award to excellence in research, education and significant impact in the society: “your large expertise in multi-authored, successful research projects and activities, full of multi-culturalism, with a realistic view, which gives the community useful outcomes with great impact for an immediate application” http://research.unir.net/blog/martin-wolpers-2023-award-christian-m-stracke The Big Picture 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 6 Aktuelle Herausforderungen https://www.unicef.org/reports/unicef-75-preventing-a-lost-decade COVID-19 Pandemie & Lockdowns Krieg in Ukraine & vielen Ländern Klimawandel, Armut, Hunger Und jetzt tritt Künstliche Intelligenz auf und verändert Denkweisen überall New Normal? KI-Nutzende: Welt vs. Deutschland 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 7 Statista (2025) KI-Markt: Welt vs. Deutschland 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 8 Statista (2025) Technologienvorhersage 2023-2033 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 9 https://unctad.org/news/ai-market-projected-hit-48-trillion-2033-emerging-dominant-frontier-technology 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 16 Geschichte der KI KI-Konzept von McCarthy und Forschung seit 1950s schwache KI vs. starke KI vs. Superintelligenz Stracke, C. M. et al. (2024). https://doi.org/10.1007/978-3-031-64315-6_21 (pre-print: https://doi.org/10.5281/zenodo.11518072) 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 17 Differenzierung von KI Schwache KI: Programmierung Automatisierung … benötigt Training Starke KI: Selbstentwicklung "Intelligenz" … entscheidet selbst 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 18 Modelle der KI Knowledge-based AI vs. Data-driven AI Hybride Systeme & Trainings (GenAI / GPAI) Stracke, C. M. et al. (2024). https://doi.org/10.1007/978-3-031-64315-6_21 (pre-print: https://doi.org/10.5281/zenodo.11518072) KI und generative KI 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 19 https://www.ibm.com/de-de/think/topics/artificial-intelligence 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 20 Zeitdruck: Exponentielles Wachstum Figure: Christian Bauckhage (University of Bonn) 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 21 KI-Widersprüche "Pause Giant AI Experiments: An Open Letter. We call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4." (Future of Life Institute, 22nd of March 2023) "Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war." (Center for AI Safety, 30th of May 2023) KI-Firmen & CEOs leugnen Eigeninteressen & Optionen 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 22 KI-Versprechen Arbeitserleichterungen und Effektivität Standardisierung und Effizienz Personalisierungen (vor allem durch Chatbots) Automatische Prüfungen und Bewertungen Entscheidungen über Zulassungen, Bestehen, etc. Innovationen durch Technologie und Prozesse? 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 23 KI-Auswirkungen Halluzinationen, fake news und Propaganda Naives Vertrauen oder Glaubwürdigkeitsverlust Entscheidungsfehler (Zulassung, Note, Kredit, Job ...) Diskriminierung von einzelnen gefährdeten Gruppen Medizinische Fehldiagnosen Abhängigkeit von Technologie und Monopolisten 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 24 KI-Regulierungen European Commission: Ethical Guidelines (2022) & AI Act (2024) European Parliament: Hearing of Committee for Education (2022) Council of Europe: Framework Convention on AI - "Treaty" (2024) 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 25 AI Act EU AI Act (into force: 1st August 2024) Unacceptable risk - prohibited High-risk - regulated Limited risk - transparency and awareness obligations Minimal risk - unregulated General-purpose AI - added later 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 32 Ethische AI&ED & Menschenrechte AI&ED zur Stärkung der Gesellschaft: "Artificial Intelligence and Education: Ethical Questions and Guidelines for Their Relations Based on Human Rights, Democracy and the Rule of Law" (Dezember 2024) https://doi.org/10.1007/978-981-97-8638-1_7 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 33 Three Ethical Imperatives for AI&ED Technology-independent (for objectives) Impact-oriented (for all levels) Society-focused (for commons) Stracke, C. M. et al. (2024). Global trends in scientific debates on trustworthy and ethical Artificial Intelligence and education. https://doi.org/10.1007/978-3-031-64315-6_21 (pre-print: https://doi.org/10.5281/zenodo.11518072) 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 34 AI&ED Expert Group by CoE https://opening-up.education/artificial-intelligence-and-education 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 35 Council of Europe (CoE) Mandate by Ministries of Education: (26th session of their Standing Conference on 29th of September 2023) 1. International convention as binding law for AI in Education 2. Recommendation for AI Literacy https://opening-up.education/artificial-intelligence-and-education 36 Artificial Intelligence and education –through a CoE lens Ethical AI and Education: The need for international regulation to foster human rights, democracy and equity Workshop at AIED 2025 in Palermo, Italy https://aied2025.learning-innovations.eu 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 38 KI-Kompetenzen KI-Nutzung KI-Training benötigt reflektiert Unsere faire Gesellschaft? "Heute nimmt in Amerika eine Oligarchie extremen Reichtums, extremer Macht und extremen Einflusses Gestalt an, die buchstäblich unsere gesamte Demokratie, unsere Grundrechte und Freiheiten und eine faire Chance für jeden, voranzukommen, bedroht." 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 39 Joe Biden am 15.1.2025 https://tagesschau.de - https://bidenwhitehouse.archives.gov/briefing-room/speeches-remarks/2025/01/15/remarks-by-president-biden-in-a-farewell-address-to-the-nation/ Impact von KI? Wie wird KI unsere Wirtschaft, Bildung und Gesellschaft gestalten und beeinflussen? 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 40 Impact von KI? How is AI shaping and impacting research? 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 41 https://www.404media.co/project-analyzing-human-language-usage-shuts-down-because-generative-ai-has-polluted-the-data/ Offene KI-Fragen zur Diskussion Rechtlich: AI Act, Treaty 225, DSA, GDPR, CLOUD Act u.a., Strategien Technologisch: Blackbox, Souveränität Ethisch: Bias, Mündigkeit, deskilling Gesellschaftlich: Menschenrechte, Literacy, Autonomie, Ressourcen, divide 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 48 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 49 AI and Education Dr. Christian M. Stracke Coordinator Cloud Strategy, OE and AI&ED Research [email protected] www.hrz.uni-bonn.de www.opening-up.education Interested? Contact me! 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 50 References Stracke, C. M. (2024). Artificial Intelligence and Education: Ethical questions and guidelines for their relations based on human rights, democracy and the rule of law. In D. Burgos et al. (Eds.), Radical Solutions for Artificial Intelligence and Digital Transformation in Education (pp. 97-107). https://doi.org/10.1007/978-981-97-8638-1_7 [Open Access] Burgos, D., Branch, J. W., Tlili, A., Stracke, C. M., & de la Higuera, C. (2024). Artificial Intelligence, Digital Transformation, and Education as a Combined Contribution to Society. In D. Burgos et al. (Eds.), Radical Solutions for Artificial Intelligence and Digital Transformation in Education (pp. 3-13). https://doi.org/10.1007/978-981-97-8638-1_1 [Open Access] Burgos, D., Branch, J. W., Tlili, A., Huang, R., Jemni, M., Stracke, C. M., ... , & Berrada, K. (2024) (Eds.), Radical Solutions for Artificial Intelligence and Digital Transformation in Education. Utilising Disruptive Technology for a Better Society. https://doi.org/10.1007/978-981-97-8638-1 [Open Access] 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 51 References Stracke, C. M., Chounta, I.-A., & Holmes, W. (2024). Global trends in scientific debates on trustworthy and ethical Artificial Intelligence and education. In Artificial Intelligence in Education. AIED 2024. Communications in Computer and Information Science. https://doi.org/10.5281/zenodo.11518072 Stracke, C. M. et al. (2024): What is Artificial Intelligence (AI)? How can I use AI ethically at university? Edited by the German Network "Ethische Nutzung von KI". https://doi.org/10.5281/zenodo.10995669 Stracke, C. M., Chounta, I.-A., Holmes, W., Tlili, A., & Bozkurt, A. (2023). A standardised PRISMA-based protocol for systematic reviews of the scientific literature on Artificial Intelligence and education (AI&ED). Journal of Applied Learning and Teaching, 6(2), 64-70. https://doi.org/10.37074/jalt.2023.6.2.38 Huang, R., Tlili, A., Xu, L., Chen, Y., Zheng, L., Saleh Metwally, A. H., Da, T., Chang, T., Wang, H., Mason, J., Stracke, C. M., Sampson, D., & Bonk, C. J. (2023). Educational futures of intelligent synergies between humans, digital twins, avatars, and robots - the iSTAR framework. Journal of Applied Learning & Teaching, 6(2), 28-43. https://doi.org/10.37074/jalt.2023.6.2.33 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 52 References Bozkurt, A., Xiao, J., Lambert, S., Pazurek, A., Crompton, H., Koseoglu, S., Farrow, R., Bond, M., Nerantzi, C., Honeychurch, S., Bali, M., Dron, J., Mir, K., Stewart, B., Costello, E., Mason, J., Stracke, C. M., ..., & Jandrić, P. (2023). Speculative Futures on ChatGPT and Generative Artificial Intelligence (AI): A Collective Reflection from the Educational Landscape. Asian Journal of Distance Education, 18(1), 53-130. https://www.asianjde.com/ojs/index.php/AsianJDE/article/view/709/394 Stracke, C. M., Bozkurt, A., McGreal, R., & Zawacki-Richter, O. (2022). Open Educational Resources and their global needs, benefits and practices: The call for a future research agenda. IEEE Bulletin of the Technical Committee on Learning Technology. https://tc.computer.org/tclt/10-1109-proofread-2022-03007 [ESCI] Tlili, A., Burgos, D., Stracke, C. M., Mason, J., Denden, M., Altinay, F., & Nascimbeni, F. (2022). Impact of personality on educator attitudes towards open educational resources. Knowledge Management & E-Learning, 14(4), 444–465. https://doi.org/10.34105/j.kmel.2022.14.023 [SSCI, Open Access] 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 53 References Stracke, C. M., Burgos, D., Santos-Hermosa, G., Bozkurt, A., Sharma, R. C., Swiatek, C., Inamorato dos Santos, A., Mason, J., Ossiannilsson, E., Shon, J. G., Wan, M., Agbu, J.-F., Farrow, R., Karakaya, Ö., Nerantzi, C., Ramírez Montoya, M. S., Conole, G., Cox, G., & Truong, V. (2022). Responding to the initial challenge of COVID-19 pandemic: Analysis of international responses and impact in school and higher education. Sustainability, 14(3), 1876. https://doi.org/10.3390/su14031876 [SSCI, Open Access] Awarded by the National Institute for Digital Learning (Ireland) as Global Top 10 COVID-19 research in 2022! Stracke, C. M., Sharma, R. C., Bozkurt, A., Burgos, D., Swiatek, C., Inamorato dos Santos, A., Mason, J., Ossiannilsson, E., Santos-Hermosa, G., Shon, J. G., Wan, M., Agbu, J.-F., Farrow, R., Karakaya, Ö., Nerantzi, C., Ramírez Montoya, M. S., Conole, G., Cox, G., & Truong, V. (2022). Impact of COVID-19 on formal education: An international review on practices and potentials of Open Education at a distance. The International Review of Research in Open and Distributed Learning, 23(4), 1-18. https://doi.org/10.19173/irrodl.v23i4.6120 [SSCI, Open Access] 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 54 References Stracke, C. M., Sharma, R. C., Swiatek, C., Burgos, D., Bozkurt, A., Karakaya, Ö., Ossiannilsson, E., Mason, J., Nerantzi, C., Agbu, J.-F., Ramírez Montoya, M. S., Shon, J. G., Inamorato dos Santos, A., Farrow, R., Wan, M., Santos-Hermosa, G., & Conole, G. (2021). How COVID-19 has an impact on formal education: A collective international evaluation of open education in distance learning. Proceedings of the 14th Annual International Conference of Education, Research and Innovation (ICERI) (pp. 4270-4275). https://doi.org/10.5281/zenodo.5764585 Truong, V., Denison, T., & Stracke, C. M. (2021). Developing institutional Open Educational Resource repositories in Vietnam: Opportunities and challenges. The International Review of Research in Open and Distributed Learning, 22(4), 109-124. https://doi.org/10.19173/irrodl.v23i1.5582 [SSCI, Open Access] Stracke, C. M., & Skuballa, I. (2021). Using, analysing and evaluating eye-tracking at different educational levels: Towards an evaluation framework for impact assessment. TEM JOURNAL - Technology, Education, Management, Informatics, 10(2), 483-487. https://doi.org/10.18421/TEM102-01 [ESCI, Open Access] 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 55 References Stracke, C. M., & Trisolini, G. (2021). A Systematic Literature Review on the Quality of MOOCs. Sustainability, 13(11), 5817. https://doi.org/10.3390/su13115817 [SSCI, Open Access] Holubinka, K., Stracke, C. M., Forsman, P., & Juutinen, S. (2021). Virtual Internationalization in Higher Education: Design Reflections and Lessons Learned. Zeitschrift für Hochschulentwicklung (ZfHE), 16(2), 43-56. https://doi.org/10.3217/zfhe-16-02/03 [Open Access] Stracke, C. M., van Dijk, G., Fasen, J., Lisdat, F., & Simoens, W. (2020). A Holistic Pedagogical Model for STEM learning and education inside and outside the classroom. In P. Zaphiris & A. Ioannou (Eds.): Learning and Collaboration Technologies. Designing, Developing and Deploying Learning Experiences. LCT 2020, Part I, HCII 2020, LNCS 12205 (pp. 568–581). https://doi.org/10.1007/978-3-030-50513-4_41 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 56 References Stracke, C. M. (2020). Open Science and Radical Solutions for Diversity, Equity and Quality in Research: A Literature Review of Different Research Schools, Philosophies and Frameworks and Their Potential Impact on Science and Education. In D. Burgos (Ed.), Radical Solutions and Open Science. An Open Approach to Boost Higher Education. Lecture Notes in Educational Technology (pp. 17-37). Springer: Singapore. https://doi.org/10.1007/978-981-15-4276-3_2 [Open Access] Stracke, C. M., Downes, S., Conole, G., Burgos, D., & Nascimbeni, F. (2019). Are MOOCs Open Educational Resources? A literature review on history, definitions and typologies of OER and MOOCs. Open Praxis, 11(4), 331-341. https://doi.org/10.5944/openpraxis.11.4.1010 [ESCI, Open Access] Stracke, C. M. (2019). Quality Frameworks and Learning Design for Open Education. The International Review of Research in Open and Distributed Learning, 20(2), 180-203. https://doi.org/10.19173/irrodl.v20i2.4213 [SSCI, Open Access] and many more, all are openly and freely available at: http://www.opening-up.education Let us cooperate! [email protected] @ChrMStracke @[email protected] https://www.linkedin.com/in/christian-m-stracke www.opening-up.education 15. Mai 2025 Ethische Künstliche Intelligenz (KI) und EU AI Act et al. - Christian M. Stracke 57