Qualcomm Extreme Chip Can Run 30B-Parameter Model Locally

Qualcomm says its Snapdragon 8 Elite Extreme Gen 6, unveiled at its Snapdragon Summit, can run a 30-billion-parameter mixture-of-experts model locally. Apple released a 20-billion-parameter mixture-of-experts model at its Worldwide Developer Conference in June.