Pawmc

Pawmc is a personal LLM (Large Language Model) assistant designed to run seamlessly on Cloudflare Workers while providing a user-guided compounding knowledge base. This innovative tool allows users to select historical context for conversations by choosing specific categories and topics, enhancing the relevance and accuracy of interactions. As conversations unfold, Pawmc compounds knowledge daily or upon request, creating a robust contextual foundation over time.

Key Advantages

Compounding Context

Pawmc enhances user experience by requiring minimal engagement to achieve substantial context continuity. Upon initiating a new chat, users specify a "category" and "topic"—whether existing or new—serving as the backdrop for context accumulation. With time, this facilitates a diverse background for new conversations tailored to personal interests such as "personal," "project-x," "hobby-y," or "philosophy."

Simplicity

Unlike many LLMs that rely on extensive system prompts, Pawmc utilizes a concise, straightforward prompt focused on clarity and effectiveness. This simplicity creates a more streamlined user experience, free from the complexities often associated with advanced language models.

Control Over Data

With Pawmc, users maintain full control over their data and conversations. The self-hosted database seamlessly manages all chat records and summaries. Users can modify prompts, redact summaries, and even select different models for personalized interaction. While full LLM autonomy is not yet feasible for many, Pawmc prioritizes user data ownership wherever possible.

Cost-Effectiveness

Deploying and hosting Pawmc while utilizing Cloudflare's services typically remains within the free tier limits. Users even benefit from complimentary daily tokens through Workers AI, making it both an economical and efficient solution for personal LLM assistance.

Features

• Conversation Storage: Organizes conversations by category and topic for easy retrieval and reference.
• Context-Aware: Automatically maintains AI-generated summaries tailored to each category and topic.
• Daily Summaries: Efficiently updates summaries on a daily basis via cron jobs, ensuring information remains current.
• API Key Authentication: Secure access through Bearer token authentication.
• Web Interface: User-friendly chat interface at the root URL, facilitating easy interaction.

Advanced Setup

For users looking to enhance their experience, Pawmc supports integration with OpenRouter in addition to the default Cloudflare Workers AI, allowing for greater flexibility and control.

Pawmc is a powerful blend of simplicity, control, and contextual awareness, making it an ideal choice for those seeking a reliable LLM assistant that respects user data and preferences.