Comment on page
Our approach to SQL performance benchmarking is to use
sysbench, an industry standard benchmarking tool.
Dolt is slower than MySQL. The goal is to get Dolt to match MySQL latency for common operations. Dolt is currently 2X slower than MySQL, approximately 1.5X on writes and 2.5X on reads. The
multiplecolumn represents this relationship with regard to a particular benchmark.
It's important recognize that these are industry standard tests, and are OLTP oriented. Performance results may vary but Dolt is generally competitive on latency with MySQL and Postgres.
Below are the results of running
sysbenchMySQL tests against Dolt SQL Server for the most recent release of Dolt in the current default storage format. We will update this with every release. The tests attempt to run as many queries as possible in a fixed 2 minute time window. The
MySQLcolumns show the median latency in milliseconds (ms) of each query during that 2 minute time window.
The Dolt version is
NOTE: There was a recent change in these benchmarks. On the night of October 31, both MySQL and Dolt write benchmarks got slower but MySQL's got slower more. On writes, Dolt went from 1.3X MySQL with no single measure faster than MySQL to 1.1X MySQL with five individual measures faster than MySQL. This does not correspond to a change in the MySQL or Dolt version.We narrowed this performance change down to a change in AWS Elastic Block Store latencies. Dolt relies on fsyncing to disk less than MySQL and thus is less sensitive to disk latency. We suspect some change to EBS increased disk latencies on October 31.We chose to keep this benchmark because both Hosted Dolt and AWS RDS MySQL rely on EBS for disk. We are closely monitoring this benchmark and will be publishing more on the topic soon.