Qualcomm's top AI chip runs 30-billion-parameter models on a mobile phone

Zusammenfassung:Qualcomms Snapdragon 8 Elite Extreme Gen 6 can run a 30-billion-parameter AI model directly on a handset, without going to the cloud. The chipmaker

Qualcomms Snapdragon 8 Elite Extreme Gen 6 can run a 30-billion-parameter AI model directly on a handset, without going to the cloud.

The chipmaker announced it at its Snapdragon Summit on September 22, along with a step-down Snapdragon 8 Elite Gen 6.

Mixture-of-experts design outsizes Apples WWDC release

The model is a mixture-of-experts design. The full model has 30 billion parameters, but just a slice fires for any one task, keeping the compute burden controllable on a battery-powered device.

In June, Apple revealed a 20-billion-parameter mixture-of-experts model at its Worldwide Developer Conference. It was Apples most advanced third-generation foundation model.

The two chips also have new sensing hubs that run smaller models of up to 200 million parameters. Those let a phone run a personal transcription tool locally and differentiate one speaker from another, Qualcomm said.

Hubs also build a memory of how a person uses the device to propose automated tasks. The company said a full voice-in, voice-out agent can run through the chip.

Nine brands sign on, led by Motorolas Signature 27

“Today marks a milestone as we introduce not one, but two new flagship mobile platforms, delivering agentic AI experiences that are immediate, personal, and adaptive,” said Chris Patrick, senior vice president and general manager of mobile handsets at Qualcomm Technologies.

Both chips are fabricated on a 2-nanometer process. They use Qualcomms custom Oryon CPU, a rearchitected Adreno GPU, and a Hexagon neural processing unit, the company said.

The Extreme is capable of capturing 8K video at 60 frames per second and 4K at 240 frames per second for slow motion. Both chips have Qualcomms voice bubble feature for voice isolation.

The platforms are lined up for use by HONOR, iQOO, Motorola, OnePlus, OPPO, REDMI, RedMagic, vivo, and Xiaomi. Motorola announced the Motorola Signature 27 on the Extreme chip at the event, with general availability sometime this year.

Cryptopolitan reported on September 22 that Apple is positioning its new Mac mini and Mac Studio desktops as local AI machines for businesses with no per-token cloud fees.

Haftungsausschluss

Die Ansichten in diesem Artikel stellen nur die persönlichen Ansichten des Autors dar und stellen keine Anlageberatung der Plattform dar. Diese Plattform übernimmt keine Garantie für die Richtigkeit, Vollständigkeit und Aktualität der Artikelinformationen und haftet auch nicht für Verluste, die durch die Nutzung oder das Vertrauen der Artikelinformationen verursacht werden.
Letzter Artikel

Bitcoin-Liquidationen von Long-Positionen erreichen 280 Mio. US-Dollar, da der BTC-Kurs unter 84.000 US-Dollar fällt

Nächste

Trump legt Kauf von Strategy-Aktien im Wert von bis zu 100.000 US-Dollar in Ethikmeldung offen