a2acompress

a2acompress is a cutting-edge, lossless wire format designed specifically for agent-to-agent handoffs, resulting in an impressive reduction of 36.6% in real cl100k_base tokens during testing against ToolBench trajectories. This format accounts for every byte of decoding overhead, ensuring a byte-exact round trip without any loss of data.

In multi-agent workflows, such as those involving planners, builders, and reviewers, a significant amount of context is often wasted in re-sending structured information like JSON keys, quoted identifiers, and tool catalog references. The a2acompress codec addresses these inefficiencies by offering an exact, reversible compression method that is straightforward and cost-effective in terms of decoding.

Features and Benefits

• Compact Representation: By utilizing a sophisticated encoding strategy, a2acompress compacts data without losing critical information, maintaining the fidelity of each handoff.
• Exact Reversibility: Guarantees that the original data can be reconstructed exactly from the compressed format, through comprehensive decoding instructions that are included with each session.
• Efficient Handoff Management: Suitable for multi-agent systems where efficient communication is crucial, particularly when dealing with repeated structures such as tool catalogs and quoted outputs.

Example of Encoding and Decoding

Utilization of the codec can be achieved seamlessly through a concise Python API:

from a2acompress.protocol import ProtocolOptions, encode_session, decode_session

options = ProtocolOptions(
    positional_body=True, packed_header=True,
    minimal_instructions=True, inline_backrefs=True, token_aligned_refs=True,
)
encoded = encode_session(records, options)      # Encode your session records
restored = decode_session(encoded.payload, options)
assert restored == records                       # Confirm no data loss

Benchmarking

The effectiveness of a2acompress is showcased in rigorous benchmarks, with the full cost defined as the sum of the compact payload, reconstruction instructions, and any dictionary used. The method adheres to stringent performance rules to ensure accuracy in reporting token savings and decoding standards.

When to Utilize a2acompress

• Beneficial when operating in a multi-agent environment where both encoding and decoding processes can be controlled.
• Ideal for data scenarios that involve substantial structural repetition.

Limitations

• Not suited for use as a generic proxy compressing arbitrary prompts.
• Requires both sides to implement the protocol consistently for optimal functionality.

This project presents a thorough performance assessment, enabling users to replicate results and evaluate the efficiency of their own datasets against predefined benchmarks. For additional insights and data availability, refer to the detailed optimization report and accompanying results.