Building AI Agents With Eve: Tools, Skills, and Evals

Featuring
Kewin Wereszczyński
Software Engineer
@
Callstack
Artur Morys-Magiera
Software Engineer
@
Callstack

Why Eve Matters for Agent Development

Eve gives developers a structured way to build durable backend AI agents. Its filesystem-first approach organizes agent behavior around clear project conventions: instructions, tools, skills, channels, schedules, sandboxes, subagents, and evals.

That structure was the main focus of the session. Instead of wiring every part of an agent manually, Eve provides predictable places to define what the agent can do, how it should behave, and how it interacts with its environment.

Building a Local Agent with Eve

The demo centered on a coaching-style agent built with a local exercise dataset stored as JSON. The goal was to test whether Eve could support a practical workflow without relying on external APIs or paid model providers.

The agent ran against a local Gemma model through Ollama, using an MLX-optimized version suitable for Apple Silicon. This setup made it possible to test tool calling, instruction design, and local inference while keeping the experiment offline.

Tools, Sandboxes, and Agent Behavior

Eve’s sandbox gives an agent access to a controlled workspace where it can read files, write data, and work with project resources. The first step was testing direct access to the sandbox, followed by a more structured implementation using tools for retrieving and filtering exercises.

Designing tools with AI agents in mind is critical. Tools that are too limited or overly strict can actually harm the quality of the output by restricting what the agent can access or infer, while more flexible designs allow the model to better interpret context and deliver more useful results.

Skills, Instructions, and Where Context Belongs

The session also explored the boundary between instructions and skills. Information needed for most interactions is usually better placed in the main instructions, while skills are more useful for domain-specific context that only applies to certain requests.

An exercise recommendation skill was added and tested to see when Eve would load it.

Running, Testing, and Evaluating the Agent

The agent was also run as a server and accessed over HTTP, showing how Eve can expose agents beyond a local terminal workflow. Evals were then used to check whether the agent called the expected tools and loaded the expected skill.

The main takeaway is that Eve does not remove the need for thoughtful prompt design, tool design, safety decisions, or testing. What it does provide is a clear structure for those concerns. For teams building AI workflows, that structure can make agents easier to inspect, extend, and improve.

Watch the full recording to see Eve used to build, run, debug, and evaluate an AI agent step by step.

‍

Insights

Learn more about AI

Building a Software Factory: Write Specs an Agent Can Build From — cover

Nov 6Article

Building a Software Factory: Write Specs an Agent Can Build From

Learn how to research requirements, resolve open decisions, and write testable specs that AI coding agents can implement without the planning conversation.

 Large-Scale Migrations With Coding Agents: Planning, Verification, and Rollback — cover

Nov 4Article

Large-Scale Migrations With Coding Agents: Planning, Verification, and Rollback

Plan codebase migrations with coding agents using reviewable requirements, verification checks, staged rollouts, and defined rollback criteria.

Conversational Banking: From Customer Questions to Authorized Actions — cover

Nov 2Article

Conversational Banking: From Customer Questions to Authorized Actions

Explore conversational banking architecture through a card-dispute example, covering tool access, authorization, execution, observability, and human handoff.

Building a Software Factory: The Night My Agents Waited for Me — cover

Oct 28Article

Building a Software Factory: The Night My Agents Waited for Me

Learn how permissions, review limits, and missing product decisions stalled two overnight coding agent runs, and how their maintainer revised the workflow.

Your AI Coding Agent Still Needs an Architecture — cover

Oct 22Article

Your AI Coding Agent Still Needs an Architecture

Use explicit contracts, behavior tests, and dependency checks to guide AI coding agents and review their changes through a TypeScript favorites example.

cover

Oct 15Live Stream

Who Left the Agents Running? React Native Software Factories

Join Kewin Wereszczyński and Szymon Chmal to explore what can go wrong in a React Native software factory overnight and the controls that keep agents on track.

cover

Oct 14Podcast

When Coding Gets Faster, What Breaks Next?

Matt Hargett explains how AI moves bottlenecks across testing, deployment, infrastructure, support, and the rest of software delivery.

cover

Oct 12Podcast

AI Coding Agents and Hermes With Tzvetan Mikov

Tzvetan Mikov discusses AI coding agents, context switching, low-level engine optimization, reviewing specs and tests, and his plans for Hermes X.

cover

Oct 12Podcast

State Machines for AI Agents With David Khourshid

David Khourshid explains state machines for AI agents, human approval steps, tracing, and handling invalid model outputs in agent workflows.

cover

Oct 9Article

How to Maximize AI SDLC? Measure the Outer Business Loop, Not the Inner Developer Loop

Connect AI-assisted development to measurable business outcomes. Matt Hargett shares a checklist for assessing user exposure, results, and delivery costs.

cover

Oct 7Talk

Automating Mobile QA with Cloud Agents

Michał Pierzchała shows how cloud-based QA agents can test real iOS and Android user flows and bring screenshots, recordings, and logs into pull requests.

cover

Oct 1Live Stream

Can Jev Make AI Agent Decisions Faster?

Explore Jev with Kewin Wereszczyński and Szymon Chmal: how it works, its approach to faster agent decisions, and possible local alternatives.

cover

Mar 19Tutorial

The Hard Way vs. The React Native AI SDK Way: Stop Writing Custom Modules for Every Model

Learn how React Native AI uses a unified provider model to switch between cloud and on-device LLMs without rewriting application logic, enabling reliable AI experiences online and offline.

cover

Mar 12Tutorial

Build Smarter Apps: Tool Calling & AI Orchestration Explained

Learn how on-device models in React Native can call tools, interact with external APIs, and return structured outputs you can use directly in application logic.

cover

Mar 5Tutorial

MLC LLM + React Native: On-Device AI Without the Pain

Learn how to run third-party on-device LLMs in React Native using MLC LLM. Choose your models, run them efficiently across platforms, and keep a unified JavaScript API with React Native AI.

cover

Feb 24Tutorial

Intelligent Fallbacks with Apple Intelligence in React Native

Learn how to use Apple’s built-in Foundation Models in React Native apps, reduce memory usage, and enable fast, fully on-device AI with React Native AI Apple.

cover

Feb 10Tutorial

What Is the React Native AI SDK? A Complete Intro & Quickstart

Learn why on-device AI matters for React Native apps, how local LLMs behave offline, and what problems React Native AI is designed to solve from day one.

cover

Jan 29Tutorial

Implementing an Android TurboModule with Kotlin

Learn how to implement a React Native TurboModule on Android, from the TypeScript spec and Codegen to the Kotlin implementation and package registration.

cover

Jan 19Tutorial

Working with Different Threads in Swift TurboModules

Learn how JavaScript, native module, background, and main threads interact in React Native TurboModules, and how to use GCD queues to run async work safely in Swift.

cover

Jan 9Tutorial

How to Add Type-Safe Constants to Swift TurboModules

Learn how to expose typed, immutable constants from a Swift TurboModule using Codegen, and get full end-to-end type safety between native and JavaScript.

cover

Dec 30Tutorial

Adding Event Emitters to Your TurboModule in Swift

Learn how to emit native events from a Swift TurboModule and subscribe to them in JavaScript, including proper memory management and Codegen integration.

cover

Dec 22Tutorial

Writing Your First TurboModule in Swift

Learn how to build a fully working TurboModule in Swift, integrate it with Codegen, and bridge it through Objective‑C inside an Expo app.