Apogee

Apogee is an innovative browser extension that leverages the power of local large language models to deliver a seamless and private AI-powered summarization experience for various types of content, including articles, videos, emails, and PDFs. It operates entirely on your device, utilizing advanced technologies such as WebGPU and WebAssembly. Apogee ensures that your data remains confidential by performing all processes locally, with no need for backend servers or API keys.

Key Features

• Local Operations: Apogee runs directly in the browser on your GPU (for Chromium browsers via WebGPU) or on your CPU (for Firefox via WebAssembly). This architecture eliminates the dependence on cloud services, enhancing both speed and privacy.
• Privacy-Centric: With Apogee, content is never sent to external servers. All summarization occurs on-device or through a local Ollama instance, preserving the user’s privacy while navigating the web.
• Customizable for Power Users: Users can choose to switch from in-browser AI to a Local Ollama mode, providing the option to run larger models directly from their machine without intermediaries.

How It Works

1. In-Browser Execution: Apogee utilizes WebLLM for GPU execution in supported browsers, while Transformers.js is employed for CPU execution in Firefox. These frameworks enable efficient model execution with minimal latency.
2. Advanced Retrieval: Beyond simple summarization, Apogee provides intelligent answers by embedding content locally and retrieving relevant passages related to user queries, allowing deep insights from lengthy materials.
3. Highlight-in-Page Feature: Users can easily cross-reference summaries with source content. By clicking on a bullet point, Apogee locates the corresponding text on the original page, enhancing the verification of summarized claims.

Usage

To begin using Apogee:

1. Install the extension from your browser’s extension store.
2. Open any webpage and click the Apogee icon, then select the option to summarize the page. On first use, the model weights will automatically download.
3. For efficiency, utilize the keyboard shortcut Alt+Shift+U to summarize without opening the popup UI.

Benefits of Apogee

• Efficiency: Fast, accurate summaries and answers without the need for internet connectivity after the initial model download.
• Flexibility: Two operational modes cater to different user preferences; quick setup for general users and expansive capabilities for advanced users.
• No Compromised Privacy: Apogee guarantees that sensitive data remains on the user’s device without exposure to potential breaches associated with cloud services.

Apogee positions itself as a leading solution for those who prioritize privacy and the ability to interact intelligently with online content, while also respecting user autonomy by keeping operations local.