pi-rust

pi-rust is a sophisticated Rust-native coding-agent runtime that emphasizes a library-first design approach, tailored for terminal CLI usage. Inspired by the Pi SDK, this multi-crate implementation enables developers to construct composable large language model (LLM) agents, integrating various providers, tools, sessions, and plugins seamlessly.

Key Features

• Rust Agent SDK: Serves as a robust SDK for developing Rust-based coding agents, allowing easy customization and flexibility for various applications.
• Terminal CLI: The rpi command-line interface offers instantaneous access to its features, making it straightforward to test and utilize the complete coding loop.
• Composable Architecture: Designed with modularity in mind, the architecture supports the integration of multiple providers and plugins through a stable C ABI, enhancing extensibility.

Core Components

The project consists of several published crates, each prefixed with rpi-, providing distinct functionalities:

Building Agents

Creating a coding agent with pi-rust is intuitive. A straightforward example illustrates the use of the rpi framework:

use rpi_agent::{AgentBuilder, AgentEvent};
use rpi_ai::providers::faux::{FauxProvider, FauxScript};

let provider = std::sync::Arc::new(FauxProvider::new(FauxScript::new().with_text("Hello!")));
let model = provider.default_model().clone();
let agent = AgentBuilder::new()
    .model(model)
    .system_prompt("You are a helpful assistant.")
    .tools(vec![/* MyTool */])
    .stream_fn(make_stream_fn(provider))
    .build()
    .unwrap();

let mut events = agent.subscribe();
tokio::spawn(async move {
    while let Some(ev) = events.recv().await {
        match ev { /* AgentEvent::MessageUpdate { .. }, etc. */ }
    }
});

agent.prompt("Hello!").await.unwrap();

This snippet highlights the simplicity of building an agent with integrated functionalities, demonstrating the flexibility of the API.

Plugin Development

Creating plugins is streamlined with the rpi-plugin-sdk, facilitating the publication of Rust cdylib libraries. For instance, the following command builds a simple echo tool plugin:

cargo build -p plugin-stub

This empowers developers to readily extend the agent's capabilities, linking new functionality through dynamic libraries.

Package Management

Extensions can be easily managed using the rpi CLI. The system is designed to allow seamless installation of packages from crates.io, simplifying the integration of new features and functionality:

rpi install rpi-extension-example

By combining the power of Rust with a flexible coding-agent architecture, pi-rust is positioned as a valuable tool for developers looking to harness the power of LLMs in their coding or automation tasks. For full documentation, refer to the project's website and the complete design documentation.