---
title: "React Native AI: Bringing On-Device LLMs With AI SDK"
description: "Need offline AI in your mobile app? This talk recording demonstrates how to use the AI SDK to create a custom provider for on-device LLMs in React Native, ensuring privacy and functionality anywhere."
url: https://www.callstack.com/events/react-native-ai-bringing-on-device-llms-with-ai-sdk
updated: 2026-10-24T08:39:21.513Z
---

# React Native AI: Bringing On-Device LLMs With AI SDK

Need offline AI in your mobile app? This talk recording demonstrates how to use the AI SDK to create a custom provider for on-device LLMs in React Native, ensuring privacy and functionality anywhere.

_Talk · 9/2/2025 · Wrocław, Poland · Recording: 18:56 · Category: AI_

Organizer: AI Meetup

Speakers: Szymon Rybczak (Software Developer @ Callstack)

[Watch the recording](https://www.youtube.com/watch?v=ctj7hsJClnk)

The AI SDK provides an elegant abstraction layer that simplifies building sophisticated AI applications across cloud and on-device environments. AI SDK allows providing custom providers; and [in this talk](https://gitnation.com/contents/react-native-ai-bringing-on-device-llms-with-ai-sdk-to-react-native), Szymon demonstrates how we built a custom provider and brought on-device local offline LLMs to mobile apps.

Let’s discuss the creation of [React Native AI](https://github.com/callstackincubator/ai), a custom AI SDK provider that enables local LLM execution directly in React Native apps. Szymon also talks about the provider architecture of AI SDK and shows how we leveraged it to integrate with MLC LLM Engine and Apple's foundation models to mobile devices.

What you'll discover:

- **AI SDK:** Why we decided to rely on it when building React Native AI
- **AI SDK provider architecture:** Understanding the core abstraction and how providers work
- **Building custom providers:** Step-by-step implementation of on-device LLM providers
- **Seamless integration:** How ⁠React Native AI into ⁠`generateText()` and ⁠`streamText()`
- **Apple Intelligence provider:** Creating ⁠`@react-native-ai/apple` as an AI SDK-compatible provider
- **Provider flexibility:** Switching between cloud and on-device models with identical APIs
- **Live demo:** Szymon will showcase how the same AI SDK code works seamlessly across OpenAI's cloud models and local on-device LLMs, highlighting the power of AI SDK.
