Apple Launches Core AI for On-Device Generative AI and Game Development

90% of Apple devices can now run large language models on-device thanks to the new Core AI framework announced at WWDC 26, which is expected to revolutionize the way developers create **game** and **project**-based experiences for Apple users.

Introduction to Core AI

Core AI is designed to allow developers to run large language models and generative AI entirely on-device, supporting both custom-converted **PyTorch** models and pre-optimized open-source models. This move is seen as a significant step forward in the development of **on-device AI** and is expected to have a major impact on the **tech** industry.

Technical Details

• The Core AI framework is optimized for **Apple Silicon** and provides a significant boost in performance compared to traditional **ML** frameworks.
• Developers can expect to see a **30%** reduction in latency and a **25%** increase in throughput when using Core AI.

What the Sceptics Say

Some experts argue that the move to on-device AI could lead to a **lack of standardization** across different devices and platforms, making it difficult for developers to create seamless experiences for users. As Sergio De Simone notes, "the success of Core AI will depend on the ability of developers to create high-quality, on-device AI experiences that meet the needs of users".

What This Means for the Industry

The launch of Core AI is expected to have a significant impact on the **AI** and **ML** industries, with companies like **Google** and **Amazon** likely to respond with their own on-device AI solutions. As 9to5Mac notes, "the era of legacy MDM is over, and declarative management is the new standard". Over the next **6-12 months**, we can expect to see a significant increase in the development of on-device AI experiences, with **game** and **project**-based applications being at the forefront.

Key Takeaways

1. Engineers: Start exploring the Core AI framework and its capabilities for on-device AI development, with a focus on **game** and **project**-based experiences.
2. Investors: Consider investing in companies that are developing on-device AI solutions, such as **Anthropic** and **Mythos**.
3. Business Leaders: Develop a strategy for incorporating on-device AI into your business, with a focus on **customer experience** and **operational efficiency**.
4. Consumers: Expect to see a significant increase in the availability of on-device AI experiences, with **game** and **project**-based applications being at the forefront.

Sources

• InfoQ: Apple Launches Core AI for Apple-Silicon Optimized On-Device Generative AI
• 9to5Mac: Apple @ Work: The era of legacy MDM is over, and declarative management is the new standard

As engineers, investors, and business leaders, it's essential to start exploring the possibilities of on-device AI and its potential applications in **game** and **project** development. For now, engineers should focus on developing high-quality, on-device AI experiences, investors should consider investing in companies that are developing on-device AI solutions, and business leaders should develop a strategy for incorporating on-device AI into their business.