Sustainability of AI-scale digital research infrastructure workshop
Monday 16th October - eResearch Australasia 2023
report
The workshop created a safe environment, enabling broad representation from the community to discuss and develop a shared understanding of an AI-centric future. It ratified the gaps in collective knowledge and provided an example approach for ecosystem-wide co-design of pre-competitive facets.
Across all themes, we discussed matters across the hardware, services and research stack. For example, at the data centre level, the Australian DRI ecosystem has sufficient buying power to adopt cooling innovation progressively. An increased consciousness exists to tailor performance/watt and cooling efficiency to local concerns. The key gap, however, is the need for more attention given to software efficiency, given its dominant role in overall efficiency.
With a baseline understanding set, community engagement & confidence in the format, and distinct themes with learnings, we propose a series of workshops to develop the questions and findings further.
You can view the presentation version of the summary report online (see right, expandable to full screen) or register to download the print-friendly version. Please get in touch with us for further evidence or details.
about
A decade of the cloud movement has inadvertently produced global year-on-year data centre energy efficiencies. Over this period, total data centre electricity use has barely grown, but we are using over 500x more (virtualised) servers. Recently the world has been captured by a disruption popularised by ChatGPTv3 - how Large Language Model forms of deep learning AI will imminently transform business, society and research. Unlike the Web-2.0 era, adapting LLMs to an organisation or project is compute-intensive, requiring dedicated use of traditionally HPC-scale facilities. The electricity needed for data centres will explode, raising significant environmental and cost questions. Are we ready for this?
Data centre power consumption is growing exponentially
source: McKinsey & Company
​
This workshop covers four distinct groups of our ecosystem: large research-centric datacentres, emerging sustainability driven AI technology vendors, research and industry driving AI platforms and research organisations and communities.
structure of the day
The objective of the day is to
-
educate on the AI-driven transition and how this will affect the digital infrastructure landscape and inform sovereign direction
-
showcase some emerging approaches & technologies to mitigate and alleviate
-
produce a summary report will be openly published, and
-
bring the community of stakeholders together
To achieve this, the workshop will be interactive in assessing the current awareness and barriers to systemic co-design. The structure of the workshop is as follows:
-
welcome and context
-
perspectives from large research-centric datacentres
-
exposure to emerging sustainability driven AI technology vendors
-
exposure to research and industry driving AI platforms, and
-
consolidating learnings & next steps​
​
The questions and deliberations will be centred on the following themes:
-
[E] environmental sustainability
-
[S] AI DRI role in supply chain, scarcity & sovereignty
-
[I] AI DRI role in industry, commercialisation, new ecosystems
-
[T] AI DRI role transforming global disciplines to AI
-
[F] FAIR in the context of AI
-
[L] literacy/skills
organising committee
Innate Innovation
Steve Quenette, the founder of Innate Innovation, recently left his role at Monash University after 12 years of distinction as a thought leader. During his time...
Steve Quenette
Founder, principal and CEO
Results-oriented and ambitious Digital Transformation Leader with 15+ years of leadership delivering digital technology at scale at an institutional, state and ...
Carmel Walsh
Australian Bureau of Meteorology
Tim looks after the HPC services capability and technology directions to sustain the Bureau's forecast and warning services and develop the next generation of n...
Tim Pugh
HPC Services
Max has a comprehensive background in research data management, data govenance and storage infrastructure operations. He is currently a Programme Manager at the...
Max Wilkinson
Dr
Pawsey Supercomputing Research Centre
Mark Gray
Head of Strategic Partnerships
Australian Research Data Commons
Paul has been manager of the ARDC Nectar Research Cloud since 2016 and has more than 35 years experience in digital research infrastructure including cloud comp...
Paul Coddington
Associate Director, Research Cloud
plus...​
-
Alan Williams - NCI
-
Angus Macoustra - CSIRO