What Is the React Native AI SDK? A Complete Intro & Quickstart

Teachers
Szymon Rybczak
Software Developer
@
Callstack

Many mobile AI features assume constant connectivity. This episode starts from a different assumption: real users lose network access all the time.

Using a health app example, the video shows what happens when a user opens an app underground, without signal, and asks a question. With a cloud-based API, the request never completes. With on-device AI, the response starts streaming immediately because the model runs on the phone itself.

From there, the episode explains why Callstack built React Native AI, what problems it is meant to solve, and how it fits into real-world mobile constraints around privacy, offline usage, reliability, and cost.

When cloud AI fails in mobile environments

The opening scenario focuses on a common mobile case: a user on a morning commute with no network access. The transcript highlights the dependency chain behind cloud AI calls, including DNS resolution, HTTP handshakes, and server queues. When connectivity drops, the app shows a loading spinner and never produces an answer.

This section establishes the baseline problem React Native AI is designed to address.

Running inference directly on the device

The video contrasts cloud calls with local inference. With on-device AI, responses stream instantly because there is no network involved. The phone becomes the server, and inference happens where the user interaction occurs.

This moment introduces the core idea of on-device LLMs and why they fundamentally change how AI features behave in React Native apps.

Privacy and compliance by default

The next section shifts the same health app scenario to sensitive data. The transcript explains how cloud AI sends user input to third-party servers, making compliance the developer’s responsibility.

With React Native AI configured for local inference, inputs never leave the device. The model processes data in the user’s hand, removing third-party data transfer and reducing compliance risk by design.

Offline usage and resilience during outages

The video returns to offline scenarios such as subways, flights, and large service outages. Cloud LLMs stop responding when connectivity drops, while local models continue working.

This section highlights that on-device AI is not only about speed or privacy, but about ensuring that AI features remain available regardless of network conditions.

Free inference after installation

A key moment in the episode explains the cost model of on-device AI. Once the app and model are downloaded, every interaction is free for both developers and users.

There is no per-token billing and no usage-based invoices. This changes how AI features can be designed and scaled in mobile apps.

React Native AI architecture overview

The final part of the episode explains how React Native AI is structured. The library supports built-in models shipped with the operating system as well as third-party models tailored to specific needs.

The transcript introduces the two supported engines, Apple Foundation Models via @react-native-ai/apple and MLC LLM via @react-native-ai/mlc, and explains why the JavaScript layer is built on top of the Vercel AI SDK using a provider-based approach.

This section sets the foundation for the rest of the series, which explores each of these pieces in more detail.

Insights

Learn more about AI

Building a Software Factory: Write Specs an Agent Can Build From — cover

Nov 6Article

Building a Software Factory: Write Specs an Agent Can Build From

Learn how to research requirements, resolve open decisions, and write testable specs that AI coding agents can implement without the planning conversation.

 Large-Scale Migrations With Coding Agents: Planning, Verification, and Rollback — cover

Nov 4Article

Large-Scale Migrations With Coding Agents: Planning, Verification, and Rollback

Plan codebase migrations with coding agents using reviewable requirements, verification checks, staged rollouts, and defined rollback criteria.

Conversational Banking: From Customer Questions to Authorized Actions — cover

Nov 2Article

Conversational Banking: From Customer Questions to Authorized Actions

Explore conversational banking architecture through a card-dispute example, covering tool access, authorization, execution, observability, and human handoff.

How AI Agents Can Cut Manual QA by 30% — cover

Oct 30Article

How AI Agents Can Cut Manual QA by 30%

Explore an agentic QA workflow targeting 30% less manual effort across mobile, web, and TV, with test selection, failure triage, and validation.

Building a Software Factory: The Night My Agents Waited for Me — cover

Oct 28Article

Building a Software Factory: The Night My Agents Waited for Me

Learn how permissions, review limits, and missing product decisions stalled two overnight coding agent runs, and how their maintainer revised the workflow.

Your AI Coding Agent Still Needs an Architecture — cover

Oct 22Article

Your AI Coding Agent Still Needs an Architecture

Use explicit contracts, behavior tests, and dependency checks to guide AI coding agents and review their changes through a TypeScript favorites example.

cover

Oct 15Live Stream

Who Left the Agents Running? React Native Software Factories

Join Kewin Wereszczyński and Szymon Chmal to explore what can go wrong in a React Native software factory overnight and the controls that keep agents on track.

cover

Oct 14Podcast

When Coding Gets Faster, What Breaks Next?

Matt Hargett explains how AI moves bottlenecks across testing, deployment, infrastructure, support, and the rest of software delivery.

cover

Oct 12Podcast

AI Coding Agents and Hermes With Tzvetan Mikov

Tzvetan Mikov discusses AI coding agents, context switching, low-level engine optimization, reviewing specs and tests, and his plans for Hermes X.

cover

Oct 12Podcast

State Machines for AI Agents With David Khourshid

David Khourshid explains state machines for AI agents, human approval steps, tracing, and handling invalid model outputs in agent workflows.

cover

Oct 7Talk

Automating Mobile QA with Cloud Agents

Michał Pierzchała shows how cloud-based QA agents can test real iOS and Android user flows and bring screenshots, recordings, and logs into pull requests.

cover

Oct 1Live Stream

Can Jev Make AI Agent Decisions Faster?

Explore Jev with Kewin Wereszczyński and Szymon Chmal: how it works, its approach to faster agent decisions, and possible local alternatives.

cover

Mar 19Tutorial

The Hard Way vs. The React Native AI SDK Way: Stop Writing Custom Modules for Every Model

Learn how React Native AI uses a unified provider model to switch between cloud and on-device LLMs without rewriting application logic, enabling reliable AI experiences online and offline.

cover

Mar 12Tutorial

Build Smarter Apps: Tool Calling & AI Orchestration Explained

Learn how on-device models in React Native can call tools, interact with external APIs, and return structured outputs you can use directly in application logic.

cover

Mar 5Tutorial

MLC LLM + React Native: On-Device AI Without the Pain

Learn how to run third-party on-device LLMs in React Native using MLC LLM. Choose your models, run them efficiently across platforms, and keep a unified JavaScript API with React Native AI.

cover

Feb 24Tutorial

Intelligent Fallbacks with Apple Intelligence in React Native

Learn how to use Apple’s built-in Foundation Models in React Native apps, reduce memory usage, and enable fast, fully on-device AI with React Native AI Apple.

cover

Feb 10Tutorial

What Is the React Native AI SDK? A Complete Intro & Quickstart

Learn why on-device AI matters for React Native apps, how local LLMs behave offline, and what problems React Native AI is designed to solve from day one.

cover

Jan 29Tutorial

Implementing an Android TurboModule with Kotlin

Learn how to implement a React Native TurboModule on Android, from the TypeScript spec and Codegen to the Kotlin implementation and package registration.

cover

Jan 19Tutorial

Working with Different Threads in Swift TurboModules

Learn how JavaScript, native module, background, and main threads interact in React Native TurboModules, and how to use GCD queues to run async work safely in Swift.

cover

Jan 9Tutorial

How to Add Type-Safe Constants to Swift TurboModules

Learn how to expose typed, immutable constants from a Swift TurboModule using Codegen, and get full end-to-end type safety between native and JavaScript.

cover

Dec 30Tutorial

Adding Event Emitters to Your TurboModule in Swift

Learn how to emit native events from a Swift TurboModule and subscribe to them in JavaScript, including proper memory management and Codegen integration.

cover

Dec 22Tutorial

Writing Your First TurboModule in Swift

Learn how to build a fully working TurboModule in Swift, integrate it with Codegen, and bridge it through Objective‑C inside an Expo app.