Local Human Intent Controller

Local Human Intent Controller (LHIC) offers a robust framework tailored for high-performance, secure browser automation, focusing on translating human intent into precise computer actions. This local-first solution ensures deterministic and verifiable execution, making it a valuable tool for developers and organizations aiming for efficiency in their web practices.

Key Features

• Fast Path Execution Engine: LHIC enhances browser task execution (e.g., login, form submissions, search, navigation) by utilizing Playwright and advanced high-level skills. It achieves a 100% success rate on Fast Path operations with a remarkable median latency of under 35 milliseconds for standard tasks.

• Self-Healing Semantic Locators: The solution is designed to withstand typical website updates, boasting an 80% higher success rate in handling layout modifications compared to traditional CSS/XPath selectors.

• State-of-the-Art Security & Key Management:

  • KmsKeyManager: Seamless integration with AWS KMS, GCP KMS, and HashiCorp Vault to verify keys for high-risk actions.
  • AES-256-GCM Encryption: This feature provides robust encryption for sensitive user data, including cookies and session information at the software database level.
  • PII & Credential Guard: Automatically removes sensitive information such as credentials and personally identifiable information from system logs, enhancing user privacy.

• Enterprise Concurrency & Durability:

  • BrowserPool: Implementing thread-safe Chromium context pooling along with pre-warming and state purification ensures efficient resource management.
  • Account-level Locking: A distributed SQL-based queue system prevents conflicting executions on the same accounts.
  • Durable Workflows: Facilitates resilient execution of workflows with capabilities for step recovery and state-saving.

• VNC Screencast Streaming: Enables real-time JPEG screen frame broadcasting via CDP at configurable frame rates, allowing for responsive remote interventions.

• APM Observability: Uses OpenTelemetry (OTLP) for robust performance monitoring, ensuring comprehensive tracking and logging of system spans.

Package Monorepo Structure

LHIC organizes its rich set of features into a structured monorepo for easy navigation, consisting of:

• packages/schema: Core Zod schemas and validation types.
• packages/browser: Playwright control wrappers, Screencast, and BrowserPool utilities.
• packages/verifier: Tools for dynamic DOM and URL verification, including file downloads.
• packages/trace: Provides redacted JSON logs and OpenTelemetry APM exporting.
• packages/memory: Maintains SQLite-based workflow states and resilient selector data.
• packages/security: Houses key management, PII redaction, and database encryption methods.
• packages/skills: Features predefined, fault-tolerant browser skills.
• packages/controller: Manages decision routing and confidence scoring, including the Slow Path interface.
• apps/cli: Command-line interface entry point for LHIC.
• apps/mcp-server: Provides a standard Model Context Protocol for control via stdio entrypoints and HTTP API.

CLI Commands & Usage

Users can easily interact with LHIC through command-line operations, including:

npm install
npm run build

To verify the environment:

npm run preflight

For running an action that requires human approval:

npx tsx apps/cli/src/main.ts run action <action-file> [approval-file]

And for internal benchmarking:

npm run bench:internal
npm run bench:simulate

Utilizing LHIC streamlines browser automation while ensuring top-notch performance, security, and adaptability, making it a critical asset for organizations aiming for innovative automation solutions.