The OpenMessaging Benchmark Framework

This repository houses user-friendly, cloud-ready benchmarking suites for the following messaging platforms:

• Apache Kafka
• Apache Pulsar (incubating)

A benchmarking suite for RabbitMQ will be available soon.

For each platform, the suite includes easy-to-use scripts for deploying the platform on Amazon Web Services (AWS). For instructions on running the benchmarks, see platform-specific docs for:

• Kafka
• Pulsar

Project goals

The goal of the OpenMessaging Benchmark Framework is to provide benchmarking suites for an ever-expanding variety of messaging platforms. These suites are intended to be:

• Cloud friendly --- All benchmarks are run on cloud infrastructure, not on your laptop
• Easy to use --- Just a few CLI commands get you from zero to completed benchmarks
• Transparent --- All benchmarking code is open source, with pull requests very welcome
• Realistic --- Benchmarks should be largely oriented toward standard use cases rather than bizarre edge cases

Adding a new platform

In order to add a new platform for benchmarking, you need to provide the following:

• A Terraform configuration for creating the necessary AWS resources (example)
• An Ansible playbook for installing and starting the platform on AWS (example)
• An implementation of the Java driver-api library (example)
• A YAML configuration file that provides any necessary client configuration info (example)