Qualcomm's top AI chip runs 30-billion-parameter models on a mobile phone

Abstract:Qualcomms Snapdragon 8 Elite Extreme Gen 6 can run a 30-billion-parameter AI model directly on a handset, without going to the cloud. The chipmaker

Qualcomms Snapdragon 8 Elite Extreme Gen 6 can run a 30-billion-parameter AI model directly on a handset, without going to the cloud.

The chipmaker announced it at its Snapdragon Summit on September 22, along with a step-down Snapdragon 8 Elite Gen 6.

Mixture-of-experts design outsizes Apples WWDC release

The model is a mixture-of-experts design. The full model has 30 billion parameters, but just a slice fires for any one task, keeping the compute burden controllable on a battery-powered device.

In June, Apple revealed a 20-billion-parameter mixture-of-experts model at its Worldwide Developer Conference. It was Apples most advanced third-generation foundation model.

The two chips also have new sensing hubs that run smaller models of up to 200 million parameters. Those let a phone run a personal transcription tool locally and differentiate one speaker from another, Qualcomm said.

Hubs also build a memory of how a person uses the device to propose automated tasks. The company said a full voice-in, voice-out agent can run through the chip.

Nine brands sign on, led by Motorolas Signature 27

“Today marks a milestone as we introduce not one, but two new flagship mobile platforms, delivering agentic AI experiences that are immediate, personal, and adaptive,” said Chris Patrick, senior vice president and general manager of mobile handsets at Qualcomm Technologies.

Both chips are fabricated on a 2-nanometer process. They use Qualcomms custom Oryon CPU, a rearchitected Adreno GPU, and a Hexagon neural processing unit, the company said.

The Extreme is capable of capturing 8K video at 60 frames per second and 4K at 240 frames per second for slow motion. Both chips have Qualcomms voice bubble feature for voice isolation.

The platforms are lined up for use by HONOR, iQOO, Motorola, OnePlus, OPPO, REDMI, RedMagic, vivo, and Xiaomi. Motorola announced the Motorola Signature 27 on the Extreme chip at the event, with general availability sometime this year.

Cryptopolitan reported on September 22 that Apple is positioning its new Mac mini and Mac Studio desktops as local AI machines for businesses with no per-token cloud fees.

Disclaimer

The views in this article only represent the author's personal views, and do not constitute investment advice on this platform. This platform does not guarantee the accuracy, completeness and timeliness of the information in the article, and will not be liable for any loss caused by the use of or reliance on the information in the article.
Previous Post

Coinbase stock tokens top $1B in trades, but exit depth is unproven

Next

Bitcoin Falls Below $84,000 After $438M in Long Liquidations