Dynamo TUI — Real time Terminal UI for NVIDIA Dynamo…

Pitch

Description

Comments

About this project

Dynamo TUI is a K9s-like terminal interface designed for effectively monitoring NVIDIA Dynamo deployments. With features like real-time ETCD service discovery, NATS monitoring, and Prometheus metrics integration, it provides a comprehensive view of system health and performance. Navigate efficiently with keyboard shortcuts to enhance your operational workflow.

Dynamo TUI is a powerful Terminal User Interface designed for real-time monitoring of NVIDIA Dynamo deployments. Modeled after K9s, Dynamo TUI offers a seamless experience for users managing ETCD services, NATS messaging, and Prometheus metrics, all in a concise and intuitive layout.

Key Features

ETCD Discovery: Monitor all ETCD activities dynamically, keeping track of namespaces, components, and endpoints.
Hierarchical View: Utilize a structured three-column display to efficiently visualize the relationships between Namespaces, Components, and Endpoints.
Health Monitoring: Access visual indicators that represent the current statuses — Ready, Provisioning, or Offline — of your services.
NATS Monitoring: Track connection statuses, message statistics, and details about JetStream streams.
Prometheus Metrics: Optionally scrape metrics related to TTFT, TPOT, throughput, and queue depth for deeper insights into system performance.
Keyboard Navigation: Navigate effortlessly with Vim-style (hjkl) and arrow-key controls, enhancing the user interaction experience.

Usage Example

Dynamo TUI can be executed simply as follows:

# Basic usage (connects to local ETCD + NATS)
dynamo-tui

# With Prometheus metrics endpoint
dynamo-tui \
  --metrics-url http://localhost:9100/metrics \
  --metrics-interval 3s \
  --nats-interval 2s

# With custom ETCD/NATS endpoints
dynamo-tui \
  --etcd-endpoints http://etcd1:2379,http://etcd2:2379 \
  --nats-server nats://nats-server:4222

Dynamo TUI integrates various components ensuring a robust monitoring system:

+-------------------------------------------------+
|  Sources (async Tokio tasks)                    |
|  +------+  +------+  +---------+               |
|  | ETCD |  | NATS |  | Metrics |               |
|  +--+---+  +--+---+  +----+----+               |
|     +----------+-----------+                    |
|                | mpsc channel                   |
|                v                                |
|  +---------------------+                       |
|  |     App (state)     | <- Input events        |
|  +----------+----------+                       |
|             |                                   |
|             v                                   |
|  +---------------------+                       |
|  |   UI (Ratatui)      |                       |
|  +---------------------+                       |
+-------------------------------------------------+

Dynamo TUI is an essential tool for efficiently managing and monitoring NVIDIA Dynamo environments, providing visibility into key metrics and statuses, enhancing operational insight, and facilitating rapid navigation through a user-friendly interface.