News
Qualcomm's New Chip Aims To Improve AI Inference Performance in the Datacenter
Earlier this month Qualcomm Technologies Inc. announced the upcoming Qualcomm Cloud AI 100, a new accelerator chip designed to improve inference performance (as opposed to training) of AI projects while also making use of power more efficiently than other solutions.
"With this introduction, Qualcomm Technologies facilitates distributed intelligence from the cloud to the client edge and all points in between," the company stated in its official announcement of the chip.
The chip is expected to be released later this year. When it is, Qualcomm said it will feature "10x performance per watt over the industry's most advanced AI inference solutions deployed today," 7nm process nodes and support for TensorFlow, PyTorch, Glow and Keras (among others), all sitting on a new chip designed specifically for AI inference workloads.
"Our all new Qualcomm Cloud AI 100 accelerator will significantly raise the bar for the AI inference processing relative to any combination of CPUs, GPUs, and/or FPGAs used in today's data centers," commented Keith Kressin, Qualcomm senior vice president of product management, in a prepared statement. "Furthermore, Qualcomm Technologies is now well positioned to support complete cloud-to-edge AI solutions all connected with high-speed and low-latency 5G connectivity."
Qualcomm said it will release a "full stack of tools and frameworks" for developers to work with the accelerator.
About the Author
Becky Nagel is the former editorial director and director of Web for 1105 Media's Converge 360 group, and she now serves as vice president of AI for company, specializing in developing media, events and training for companies around AI and generative AI technology. She's the author of "ChatGPT Prompt 101 Guide for Business Users" and other popular AI resources with a real-world business perspective. She regularly speaks, writes and develops content around AI, generative AI and other business tech. Find her on X/Twitter @beckynagel.