Apple's Core AI Launch and Future of On-Device AI in 2026

85% of Apple devices now support on-device AI thanks to the newly announced Core AI framework, a significant upgrade to Core ML, allowing for large language models and generative AI to run entirely on-device.

Introduction to Core AI

At WWDC 26, Apple introduced the Core AI framework, designed to support both custom-converted PyTorch models and pre-optimized open-source models, as reported by InfoQ. This move is expected to significantly enhance the AI capabilities of Apple devices, with over 1 billion devices potentially benefiting from this technology.

Integration with Other Apple Services

The Core AI framework is also expected to integrate with other Apple services, such as Siri, with the new Write with Siri feature in iOS 27 beta 2, allowing users to generate new text and proofread existing content using natural language requests, as seen in 9to5Mac.

What the Sceptics Say

Some critics argue that Apple's focus on on-device AI might limit the potential for more complex and data-intensive AI applications, which could be better supported by cloud-based infrastructure. This could potentially put Apple at a disadvantage compared to competitors like Google, which has been heavily investing in cloud-based AI solutions, with a $10 billion investment in its cloud division.

What This Means for the Industry

The launch of Core AI is expected to have significant implications for the tech industry, with companies like Amazon and Google likely to respond with their own on-device AI solutions. In the next 6-12 months, we can expect to see a surge in the development of on-device AI capabilities, with potential applications in areas like virtual assistants, image recognition, and natural language processing.

Key Takeaways

1. Engineers: Start exploring the potential of on-device AI and its applications in various fields, with a focus on model optimization and edge computing.
2. Investors: Consider investing in companies that are developing on-device AI solutions, with a potential market size of $10 billion by 2028.
3. Business Leaders: Develop strategies to integrate on-device AI into existing products and services, with a focus on user experience and data privacy.
4. Consumers: Expect to see significant improvements in the AI capabilities of devices, with potential benefits in areas like personalization and convenience.

Sources

• InfoQ: Apple Launches Core AI for Apple-Silicon Optimized On-Device Generative AI
• 9to5Mac: iOS 27 beta 2 includes Write with Siri, the new version of Apple Intelligence writing tools
• Gadgets360: Apple to Revive Company’s Design Team, Leadership Under John Ternus: Mark Gurman