p10logs — Simplified Kubernetes logging for multi…

Pitch

Description

Comments

About this project

p10logs offers a streamlined logging solution for Kubernetes that captures pod logs across multiple clusters without unnecessary complexity. With a single DaemonSet agent and an intuitive UI, it provides swift access to logs, ensuring efficient browsing, searching, and tailing of logs without the overhead of additional metrics or storage solutions.

p10logs is a lightweight, self-contained logging system designed specifically for Kubernetes environments, focusing solely on delivering persistent pod logs across multiple clusters. Comprised of a single DaemonSet agent and a centralized hub with persistent storage, p10logs allows users to efficiently browse, search, and tail logs from pods without the overhead of additional metrics, Elasticsearch, Grafana, or other observability tools.

Key Features

Persistent Logs: Logs from each pod's stdout and stderr are preserved, ensuring continuity even across pod restarts, deletions, or node reboots. Users have control over retention policies, with options for time-based and size-based storage management.
Multi-Cluster Support: p10logs enables seamless integration across multiple clusters, allowing agents in different environments to communicate with a central hub securely via HTTPS. This setup allows users to access logs from all clusters in one unified interface.
Fast Built-in UI: The intuitive user interface allows users to navigate through a hierarchical tree structure representing cluster, namespace, pod, and container. Features include live tailing logs from multiple pods, filter and search functionalities, and the ability to export log views.
Minimal System Resource Usage: The design prioritizes a lightweight footprint with minimal resource consumption on both the agent and hub, making p10logs suitable for a variety of deployment scenarios, including resource-constrained environments.
Reliable Log Processing: The system is built to ensure data integrity, employing mechanisms that prevent data loss or duplication even during interruptions such as pod and hub restarts.

Example Usage

To query logs for a specific pod using the provided REST API, the following command can be executed:

curl -s -u admin:password 'http://localhost:8080/api/v1/query?namespace=example&pod=api-example&start=-1h&q=error'

Why Choose p10logs?

p10logs offers a straightforward solution for teams looking for an efficient way to retrieve logs without the complexity and overhead of full observability stacks. It is tailored for users who need a user-friendly experience with built-in authentication and a simplistic yet powerful mechanism for managing log data.