On-device AI After WWDC 2026: What's New?

In 2025, Apple's on-device model access came to React Native. It let apps call Apple's small local model for short generation, structured output, and tool calling without downloading a model or sending every request to a server.

At WWDC 2026, Apple expanded that surface. Apple Foundation models now run on-device and through Private Cloud Compute, Foundation Models gains image input, and Core AI gives apps a native path for their own local models.

In this article, you’ll learn what’s new and what we’re bringing to React Native in the coming months.

What Apple announced

WWDC 2026 adds five changes that matter for on-device AI:

  • Apple Foundation models now run on-device and through Private Cloud Compute. (source)
  • Apple is adding a second, more capable on-device model for higher-end iPhone, iPad, and Mac systems. (source)
  • The advanced local model supports text, image understanding, and speech. (source)
  • Foundation Models now accepts image input, supports custom skills, and can call server-running models through the same Swift API. (source)
  • Core AI gives developers a native framework for running other local models with Apple silicon. (source)

Apple is making model routing part of the OS

Apple described Apple Foundation models as the core of Apple Intelligence. It also said the new models were created with technologies behind Google's Gemini family, then adapted for Apple hardware and Private Cloud Compute.

On-device models are for fast, private work that can run with limited context. Private Cloud Compute is the path when the task needs more capacity, longer context, or heavier reasoning.

Apple Foundation models now run on-device and through Private Cloud Compute.

For app teams, this changes the boundary conditions. A feature can now be evaluated against device class, model availability, latency budget, privacy requirement, and acceptable error rate before it ever becomes a cloud decision.

The most powerful on-device model creates a new device boundary

Apple's upgraded models push Apple Intelligence into more visual and multimodal work: generating realistic images, editing photos, and answering questions about visual content.

The strongest on-device version goes further with speech generation and understanding, better dictation, stronger natural language understanding, and more expressive voices.

Apple's more capable on-device model is limited to its highest-end systems.

In practice, it means a feature may work fully on a newer iPhone, partially on another supported device, and through a server path when local capacity is not enough.

Foundation Models gets image input

In 2025, Foundation Models opened Apple's on-device language model to app developers. It was useful for text generation, extraction, summarization, guided generation, and tool calling. But it could not take an image as input.

At WWDC 2026, Apple said Foundation Models now supports images alongside text. The keynote example used a photo of an outfit: the model identified clothing items, then the app used its own product logic to recommend similar pieces.

Foundation Models now accepts image input in addition to text.

Thanks to recent update, the app does not need to ship a large vision-language model just to understand a private user-selected image, provided Apple's model is accurate enough for the use case.

Siri shows the orchestration layer

Apple described Siri AI as a system that combines personal context, App Actions, on-screen awareness, image understanding, and world knowledge. If your app exposes actions and content through the system, Siri has something to route to. If it does not, Apple Intelligence has less to work with, even when the model is stronger.

For developers, App Intents and Spotlight indexing become AI infrastructure. They decide whether your app can participate in system-level requests like "show me the quote from yesterday", "add this receipt to my expense report" or "use this image in the project brief".

Siri AI combines device context, app actions, screen awareness, images, and world knowledge.

Core AI is the native path for custom local inference

Foundation Models is Apple's model. Core AI is for your model. Until now, custom local inference on Apple platforms often meant using an external runtime. Core AI moves more of that work into the platform: local execution on Apple silicon, across Apple platforms, without making every app maintain its own inference layer.

Core AI is Apple's new framework for running third-party models locally.

Use Foundation Models when Apple's model fits the task. Use Core AI when the app needs specialized model such as a domain classifier, an embedding model or a specialized vision model.

What comes next for React Native

We are working on bringing these updates into the React Native AI stack. Expect package updates in the coming days as we map the new Apple APIs.

We'll also be working with customers and early users over the coming months to test all new capabilities in production.

If you want to follow the work or participate, watch the GitHub repository: callstackincubator/ai.

Insights

Learn more about AI

Building a Software Factory: Write Specs an Agent Can Build From — cover

Nov 6Article

Building a Software Factory: Write Specs an Agent Can Build From

Learn how to research requirements, resolve open decisions, and write testable specs that AI coding agents can implement without the planning conversation.

 Large-Scale Migrations With Coding Agents: Planning, Verification, and Rollback — cover

Nov 4Article

Large-Scale Migrations With Coding Agents: Planning, Verification, and Rollback

Plan codebase migrations with coding agents using reviewable requirements, verification checks, staged rollouts, and defined rollback criteria.

Conversational Banking: From Customer Questions to Authorized Actions — cover

Nov 2Article

Conversational Banking: From Customer Questions to Authorized Actions

Explore conversational banking architecture through a card-dispute example, covering tool access, authorization, execution, observability, and human handoff.

Building a Software Factory: The Night My Agents Waited for Me — cover

Oct 28Article

Building a Software Factory: The Night My Agents Waited for Me

Learn how permissions, review limits, and missing product decisions stalled two overnight coding agent runs, and how their maintainer revised the workflow.

Your AI Coding Agent Still Needs an Architecture — cover

Oct 22Article

Your AI Coding Agent Still Needs an Architecture

Use explicit contracts, behavior tests, and dependency checks to guide AI coding agents and review their changes through a TypeScript favorites example.

cover

Oct 15Live Stream

Who Left the Agents Running? React Native Software Factories

Join Kewin Wereszczyński and Szymon Chmal to explore what can go wrong in a React Native software factory overnight and the controls that keep agents on track.

cover

Oct 14Podcast

When Coding Gets Faster, What Breaks Next?

Matt Hargett explains how AI moves bottlenecks across testing, deployment, infrastructure, support, and the rest of software delivery.

cover

Oct 12Podcast

AI Coding Agents and Hermes With Tzvetan Mikov

Tzvetan Mikov discusses AI coding agents, context switching, low-level engine optimization, reviewing specs and tests, and his plans for Hermes X.

cover

Oct 12Podcast

State Machines for AI Agents With David Khourshid

David Khourshid explains state machines for AI agents, human approval steps, tracing, and handling invalid model outputs in agent workflows.

cover

Oct 9Article

How to Maximize AI SDLC? Measure the Outer Business Loop, Not the Inner Developer Loop

Connect AI-assisted development to measurable business outcomes. Matt Hargett shares a checklist for assessing user exposure, results, and delivery costs.

cover

Oct 7Talk

Automating Mobile QA with Cloud Agents

Michał Pierzchała shows how cloud-based QA agents can test real iOS and Android user flows and bring screenshots, recordings, and logs into pull requests.

cover

Oct 1Live Stream

Can Jev Make AI Agent Decisions Faster?

Explore Jev with Kewin Wereszczyński and Szymon Chmal: how it works, its approach to faster agent decisions, and possible local alternatives.

cover

Mar 19Tutorial

The Hard Way vs. The React Native AI SDK Way: Stop Writing Custom Modules for Every Model

Learn how React Native AI uses a unified provider model to switch between cloud and on-device LLMs without rewriting application logic, enabling reliable AI experiences online and offline.

cover

Mar 12Tutorial

Build Smarter Apps: Tool Calling & AI Orchestration Explained

Learn how on-device models in React Native can call tools, interact with external APIs, and return structured outputs you can use directly in application logic.

cover

Mar 5Tutorial

MLC LLM + React Native: On-Device AI Without the Pain

Learn how to run third-party on-device LLMs in React Native using MLC LLM. Choose your models, run them efficiently across platforms, and keep a unified JavaScript API with React Native AI.

cover

Feb 24Tutorial

Intelligent Fallbacks with Apple Intelligence in React Native

Learn how to use Apple’s built-in Foundation Models in React Native apps, reduce memory usage, and enable fast, fully on-device AI with React Native AI Apple.

cover

Feb 10Tutorial

What Is the React Native AI SDK? A Complete Intro & Quickstart

Learn why on-device AI matters for React Native apps, how local LLMs behave offline, and what problems React Native AI is designed to solve from day one.

cover

Jan 29Tutorial

Implementing an Android TurboModule with Kotlin

Learn how to implement a React Native TurboModule on Android, from the TypeScript spec and Codegen to the Kotlin implementation and package registration.

cover

Jan 19Tutorial

Working with Different Threads in Swift TurboModules

Learn how JavaScript, native module, background, and main threads interact in React Native TurboModules, and how to use GCD queues to run async work safely in Swift.

cover

Jan 9Tutorial

How to Add Type-Safe Constants to Swift TurboModules

Learn how to expose typed, immutable constants from a Swift TurboModule using Codegen, and get full end-to-end type safety between native and JavaScript.

cover

Dec 30Tutorial

Adding Event Emitters to Your TurboModule in Swift

Learn how to emit native events from a Swift TurboModule and subscribe to them in JavaScript, including proper memory management and Codegen integration.

cover

Dec 22Tutorial

Writing Your First TurboModule in Swift

Learn how to build a fully working TurboModule in Swift, integrate it with Codegen, and bridge it through Objective‑C inside an Expo app.