鶹ýAV

Skip to content

Shelly Palmer - AI Training Technique Promises Efficiency

Shelly Palmer has been named LinkedIn’s “Top Voice in Technology,” and writes a popular daily business blog.
aicircuit-unsplash
Given the high energy consumption of large-scale AI systems, this advancement is noteworthy.

Greetings from NYC. I hope everyone had a wonderful holiday weekend.

In the news: Google's DeepMind researchers have introduced a new method to accelerate AI training, which they claim significantly reduces the computational resources and time required.

The technique, called multimodal contrastive learning with joint example selection (JEST), outperforms state-of-the-art models by requiring up to 13 times fewer iterations and 10 times less computational power. Given the high energy consumption of large-scale AI systems, this advancement is noteworthy. For instance, Microsoft's water consumption increased by 34% from 2021 to 2022 due to heightened AI computing demands, with ChatGPT consuming nearly half a liter of water per 5 to 50 prompts.

The International Energy Agency (IEA) projects that data center electricity consumption will double from 2022 to 2026, drawing parallels between the energy demands of AI and the energy-intensive cryptocurrency mining industry. However, JEST’s efficient data selection process may mitigate some of this impact. By optimizing which data is used for training, JEST reduces the number of iterations and computational power needed, thereby lowering overall energy consumption.

AI is power-hungry. If JEST (and JEST-like) training methods substantially reduce power consumption, and if synthetic data can be used for ethical training, and if the AI community figures out a way to align AI output with human expectations, all we'll have to do is figure out how to find work for the people these tools displace. That's a lot of ifs.

As always your thoughts and comments are both welcome and encouraged. Just reply to this email. -s

P.S. If you find my daily newsletter valuable, please share it with a colleague and post a link to today's to one of your social media accounts. Thx.


ABOUT SHELLY PALMER

Shelly Palmer is the Professor of Advanced Media in Residence at Syracuse University’s S.I. Newhouse School of Public Communications and CEO of The Palmer Group, a consulting practice that helps Fortune 500 companies with technology, media and marketing. Named  he covers tech and business for , is a regular commentator on CNN and writes a popular . He's a , and the creator of the popular, free online course, . Follow  or visit . 

push icon
Be the first to read breaking stories. Enable push notifications on your device. Disable anytime.
No thanks