ATLAS: Enabling Open Methods and Technical Transparency in AI

CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI1 ATLAS: Enabling Open Methods and Technical Transparency in AI James Smithies, Glen Berman, Karaitiana Taiuru, Roxanne Missingham, Barbara McGillivray, Martin Spychal, John Moore 4 DECEMBER 2025 Digital Humanities Australasia 2025 December 4 The Australian National University CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C Overview 01 The AI as Infrastructure Project 02 The Problem: AI Product Design 03 The Solution: HASTRICT Principles 04 ATLAS Darwin 3 ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI 4 DECEMBER 2025 CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C 01 THE AI AS INFRASTRUCTURE (AIINFRA) PROJECT 3 •https://aiinfra.anu.edu.au/ •ANU HASS Digital Research Hub •ANU Library •Aotearoa / New Zealand Department of Internal Affairs •Australian Parliamentary Library •King’s College London •The National Library of Australia •UK History of Parliament project •UK National Archives •2024 – 2026, ANU Futures Scheme Partners A trans-national project focussed on assessing the value of Retrieval Augmented Generation (RAG) for historical research, using Hansard debates from Australia, New Zealand, United Kingdom as our content baseline. ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI 4 DECEMBER 2025 CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C 01 THE AI AS INFRASTRUCTURE (AIINFRA) PROJECT 4 •Identify and implement best practices for the design, development, evaluation, and maintenance of historical research tools enabled by Large Language Models (LLMs). •Develop high-level principles (the HASTRICT principles), an organisational maturity model, and associated evaluation framework to support the responsible implementation of AI tools into the GLAM and academic sector. •Develop a prototype technical ‘test harness’ for the evaluation of LLM Retrieval Augmented Generation (RAG) systems, and as a test bed for development of the other project outputs, using open-source tools. Goals ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI 4 DECEMBER 2025 CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C 02 THE PROBLEM: AI PRODUCT DESIGN 5 ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI 4 DECEMBER 2025 CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C 6 •H: Human •A: Accountability •S: System targets •T: Transparent •R: Reproducible •I: Iterative •C: Contextually Informed Measures & Baselines •T: Tasks, workflows & use cases 03 HASTRICT PRINCIPLES James Smithies, Glen Berman, Karaitiana Taiuru, ‘Operationalisation of Responsible AI in the Research and Cultural Sectors’. In Building Digital Humanities, edited by Simon Burrows et al. Radboud University Press. Under review. Department of Industry Science and Resources, “Guidance for AI Adoption: Implementation”, Department of Industry Science and Resources,” October 21, 2025, https://www.industry.gov.au/publications/guidance-for-ai-adoption/guidance-ai-adoptionimplementation-practices. ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI 4 DECEMBER 2025 CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C 7 04 ATLAS DARWIN ATLAS: Analysis and Testing of Language Models for Archival Systems •https://github.com/AI-as-Infrastructure/aiinfra-atlas •https://github.com/AI-as-Infrastructure/aiinfra-atlasdarwin •Vector store (database): ChromaDB •Backend (Python): •FastAPI •Langchain •Frontend (Javascript) •Vue •LLMs: •Anthropic, OpenAI etc •Open models via AWS Bedrock or locally via Ollama ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI 4 DECEMBER 2025 CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C 8 04 ATLAS DARWIN ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI 4 DECEMBER 2025 CHOOSE A SLIDE STYLE FROM 1. Home tab 2. New Slide 3. Choose layout 4. If layout goes awry, select Reset TEXT There are 5 levels of formatted text available. Please move between text levels using the increase/decrease button on the menu above. CHANGE SLIDE BACKGROUND 1. Design Menu 2. Format Background 3. Picture or Texture Fill 4. Find image REPLACE IMAGE IN SHAPE OR ON PAGE 1. Right click on image 2. Change Picture 3. Select your image OR 1. Delete the image 2. Click on icon 3. Find the new image TO REPOSITION IMAGE WITHIN SHAPE 1. Click on image 2. Format menu 3. Click on Crop button 4. To fit the whole image inside select FIT 5. To use only a portion select FILL then crop, move or resize image to show properly within shape. ADD/CHANGE FOOTER 1. Insert Menu 2. Header & Footer 3. Tick to activate/Untick to remove 4. Change text TEQSA PROVIDER ID: PRV12002 (AUSTRALIAN UNIVERSITY) CRICOS PROVIDER CODE: 00120C 9 04 ATLAS DARWIN ANU HASS DIGITAL RESEARCH HUB | ATLAS: ENABLING OPEN METHODS AND TECHNICAL TRANSPARENCY IN AI 4 DECEMBER 2025