MCP Cross Exam

MCP Cross Exam is designed to audit a single MCP server and produce a comprehensive scored report. This tool facilitates the analysis of server behavior and configuration, ensuring that the server adheres to desired specifications and standards.

Features

• Auditing: Evaluate server response and configurations against defined parameters.
• Probes: Collect data on potential issues categorized into two primary families:
  • Transport and Session: Detect problems related to negotiation, headers, reconnecting, stream resumption, or expired sessions.
  • Schema: Identify discrepancies between tool definitions, arguments, errors, and descriptions in relation to server operations.

The findings from the audit are coded with specific exit statuses to reflect the condition of the server. For instance, running an audit against a server with no defects results in an exit code of 0, while servers with issues will exit with code 3, unless otherwise specified by the --fail-on option.

Getting Started

To initiate the audit process, launch a local server, which defaults to the specified sessions. Use the following commands to serve the fixture and evaluate your local MCP server:

mcp-cross-exam fixture serve --http 127.0.0.1:8765
mcp-cross-exam http://127.0.0.1:8765/mcp

Safety and Compatibility

MCP Cross Exam operates in a safe manner, using standard I/O and a loopback host locally, while ensuring that any other hosts comply with the [target] allow settings. Credentials are handled securely, originating from the environment and redacted during operation. Notably, this tool is neither a penetration testing suite, a load tester, nor a proxy or gateway, ensuring its focused functionality in server audits.

Additional Resources

• Usage Documentation
• Detailed Methodology
• Change Log
• Limitations

This tool is invaluable for developers and system administrators seeking to enhance the reliability and integrity of their MCP servers.