Laptop AI transforms personal computing by allowing users to query their local files with AI-driven insights. This local-first memory engine indexes selected folders using custom disk-backed databases and retrieves source-cited answers, all while keeping data private and secure.
Laptop AI is a cutting-edge, local-first AI memory engine designed to enhance productivity by allowing users to query information about files stored on their computer. This project enables the creation of a personalized and secure environment where AI can assist with data retrieval, ensuring privacy and source citation through its custom disk-backed vector database.
The functionality can be easily demonstrated with the following command sequences:
./laptop-ai init
./laptop-ai index ./examples/notes
./laptop-ai ask "what controls movement in my biology notes?"
This would yield a structured response that includes both the answer and the sources from which it was derived:
Answer:
Your biology notes say that the basal ganglia helps control movement. The
direct pathway promotes movement, while the indirect pathway suppresses movement.
Sources:
1. examples/notes/biology.md
Laptop AI operates through a well-defined architecture that processes input as follows:
flowchart LR
A[Selected folder] --> B[Allowlist, denylist, secret scan]
B --> C[Text extraction]
C --> D[Chunker]
D --> E[Local embeddings: nomic-embed-text]
E --> F[Custom vector DB]
F --> G[Cosine top-k search]
G --> H[Prompt with untrusted context]
H --> I[Local LLM: llama3]
I --> J[Answer + sources]
The system has a robust security model, defaulting to a local-only operation that seeks to minimize risks associated with data breaches. Key measures include:
Recent performance tests highlight the efficiency of Laptop AI:
The project will continue to evolve, focusing on:
search, sources, forget, and doctor to improve functionality.Laptop AI represents a significant advancement in how personal computers can utilize local AI for memory and knowledge management, paving the way for more secure and private interactions with technology.
No comments yet.
Sign in to be the first to comment.