flowg

FlowG is an innovative log management platform designed for seamless ingestion, transformation, and querying of logs through a user-friendly visual pipeline builder. Leveraging the robust BadgerDB as its storage backend, FlowG allows you to manage structured logs effortlessly without the need for predefined schemas.

Key Features

• Intuitive Pipelines: Visualize and manage your log processing pipelines with ease. FlowG supports transformations using VRL scripts and allows for conditional routing to dedicated streams, simplifying log management.
• Dynamic Logs: Say goodbye to rigid structures! FlowG enables you to handle logs with varying structures effortlessly, eliminating the need for predefined schemas.
• Seamless Interoperability: All configuration and log ingestion processes can be accomplished via a REST API, enhancing your integration capabilities.
• Real-time Observability: Experience the power of real-time querying and visualization of your logs in the integrated web interface, ensuring you stay informed about your data at all times.

Why Choose FlowG?

FlowG dramatically simplifies log refinement and routing, making it accessible for users with minimal coding experience. Built on React Flow, it empowers users to create complex log pipelines easily. The solution replaces complex tools like Logstash by integrating crucial features directly into the platform.

Additionally, FlowG harnesses the capabilities of BadgerDB, a well-respected Key/Value database, which offers excellent support for dynamically structured logs and log compression.

Benchmark Testing

FlowG has been tested for performance, demonstrating impressive results:

export BENCHMARK_ITERATIONS="1000000"
export BENCHMARK_JOBS="24"  # usually, number of CPUs
task docker:build test:bench

System Specs:

• CPU: 13th Gen Intel(R) Core(TM) i7-13700K
• RAM: 64GB
  Results:

Requests sent: 1000000  
Total time:    266.75s  
Rate:          3748.76 req/s  

Embark on your log management journey with FlowG – where efficiency meets simplicity!