
The Offline AI: On-Device LLMs in React Native With AI SDK

On-device LLMs, unlike remotely accessed models, unlock private-by-default, low-latency AI experiences that work anywhere, offline; ideal for mobile. In this talk, Michał will show how to run LLMs directly inside React Native apps using Vercel's AI SDK that provides a robust abstraction layer to simplify building AI applications. Same interface to run local and remote models. These capabilities are possible thanks to an open-source set of libraries we created. He'll dive deep into the provider architecture and demonstrate how we integrated it with the MLC LLM Engine and Apple’s Foundation Models available on their latest mobile devices.
We help teams leverage AI to accelerate development and deliver smarter user experiences.
Let's chatAgentic Delivery
/Custom & Private Models
Use the right AI model, locally or in the cloud.
Tell us where hosted models fall short for your team today. We'll come back with the right approach for your data and workload, and what the rollout path looks like.
- Keep sensitive data off third-party systems
- Get better output from the model
- Choose where the model runs
On-Premise LLM Deployment
LLM Fine-Tuning
Model Evaluation





















