sql-pipe

sql-pipe is a high-performance command-line interface (CLI) tool designed for seamless interaction with CSV data and in-memory SQLite databases. This zero-dependency utility enables users to efficiently pipe CSV input from the standard input (stdin), perform instant SQL queries, and output the results directly as CSV. Built upon the Zig programming language, it allows users to avoid the complexities associated with other tools, such as awk, or the overhead of launching a Python interpreter just for a simple task.

Key Features

• Instant SQL Querying: Execute SQL queries on CSV data without pre-defined schemas or setup processes.
• Simple Syntax: Load CSV data and run queries with a minimal command, streamlining the data analysis process.

$ curl -s https://example.com/data.csv | sql-pipe 'SELECT region, SUM(revenue) FROM t GROUP BY region ORDER BY 2 DESC'

How It Works

The tool automatically detects the first row of the CSV file as headers, creating a table called t. Each column's data type is inferred based on the initial rows. If you prefer, a flag can be used to treat all columns as text.

Usage Examples

• Selecting All Data:

$ printf 'name,age\nAlice,30\nBob,25\nCarol,35' | sql-pipe 'SELECT * FROM t'

• Aggregating Data:

$ cat orders.csv | sql-pipe 'SELECT COUNT(*), AVG(amount) FROM t WHERE status = "paid"'

• Handling Complex Queries:

$ cat events.csv \
  | sql-pipe 'SELECT user_id, COUNT(*) as n FROM t GROUP BY user_id' \
  | sql-pipe 'SELECT * FROM t WHERE n > 100'

Available Flags

Exit Codes

Limitations

• Currently, sql-pipe supports only a single table per invocation. For more complex operations involving joins, users can chain multiple sql-pipe calls or utilize Common Table Expressions (CTE).

sql-pipe is ideal for users familiar with SQL who work with CSV files in terminal environments, offering a fast and efficient solution for on-the-fly data analysis.