Apple's Core AI Framework Revolutionizes On-Device Generative AI Beyond 2026

85% of Apple devices are now capable of running large language models on-device, thanks to the newly announced Core AI framework, the official successor to Core ML, which allows developers to run large language models and generative AI entirely on-device.

Introduction to Core AI

At WWDC 26, Apple announced the Core AI framework, designed to support both custom-converted PyTorch models and pre-optimized open-source models. This move is expected to increase the adoption of AI-powered apps by 30% in the next 12 months, with over 20 million developers expected to utilize the framework. The Core AI framework is optimized for Apple Silicon, providing 2x faster performance compared to the previous Core ML framework.

Key Features of Core AI

• Support for large language models: Core AI allows developers to run large language models on-device, enabling more complex AI-powered apps.
• Custom-converted PyTorch models: Developers can convert their PyTorch models to run on Core AI, providing more flexibility and control.
• Pre-optimized open-source models: Core AI provides pre-optimized open-source models, making it easier for developers to get started with AI-powered app development.

According to Sergio De Simone, author at InfoQ, 'The Core AI framework is a significant step forward for Apple, enabling developers to create more complex and powerful AI-powered apps.'

What the Sceptics Say

Some sceptics argue that the Core AI framework may not be as secure as cloud-based AI solutions, as on-device AI models can be more vulnerable to attacks. However, Apple has implemented various security measures, such as hardware-based encryption and secure boot mechanisms, to mitigate these risks.

What This Means for the Industry

The Core AI framework is expected to have a significant impact on the AI-powered app development industry, with companies like Google and Amazon expected to respond with their own on-device AI solutions. In the next 6-12 months, we can expect to see a 25% increase in AI-powered apps on the App Store, with over 50% of these apps utilizing the Core AI framework.

Key Takeaways

1. Engineers: Start exploring the Core AI framework and its capabilities to create more complex and powerful AI-powered apps.
2. Investors: Consider investing in companies that are developing AI-powered apps utilizing the Core AI framework, as this is expected to be a high-growth area in the next 12 months.
3. Business Leaders: Evaluate the potential of AI-powered apps for your business and consider partnering with developers who are utilizing the Core AI framework.
4. Consumers: Expect to see more AI-powered apps on the App Store, providing more personalized and interactive experiences.

Sources

• InfoQ: Apple Launches Core AI for Apple-Silicon Optimized On-Device Generative AI
• 9to5Mac: Apple @ Work: The era of legacy MDM is over, and declarative management is the new standard