Empirical complexity

O(n log n)·O(n) space
81632641282565121k2k4.1k8.2k16k33k66k101001k10k100k1Minput size ncomparisons
  • Merge sort

The axes are set: 14 sizes from 8 to 65,536, against a count that will reach 1,000,000. Nothing has been measured yet.

The axes are set: 14 sizes from 8 to 65,536, against a count that will reach 1,000,000. Nothing has been measured yet.
Fit so far—

Merge sort: O(n log n), claimed as n log₂n − n + 1

  1. 1set up the axes: the sizes to measure, and the counts they will reach
  2. 2take the next size, and build an input of that size in the chosen shape
  3. 3run the algorithm on it, counting one operation at a time
  4. 4plot the point, and refit the textbook bound to everything measured so far
  5. 5stop: report how well the bound fits, and what a handful of sizes cannot prove

What the measurement shows

Nothing has been measured yet. The ladder runs from 8 to 65,536, in 14 steps.

Sizes measured
0
Operations counted
0
Largest single count
0
Comparisons
0
Moves
0

Complexity

BestO(n log n)
AverageO(n log n)
WorstO(n log n)
Extra spaceO(n)

Merge sort

Split the list in half, sort each half the same way, and then walk the two sorted halves together taking the smaller front element each time. The splitting stops at runs of one, which are sorted already, so there are ⌈log₂ n⌉ levels of splitting and each level merges a total of n elements. That gives n log n, and it gives it on every input: unlike quicksort there is no arrangement that makes the split uneven. The curve plots comparisons, which is what every textbook bound for a sort is about and what makes the four of them directly comparable. The moves are counted too and shown in the panel beside it — worth a look on merge sort, whose comparison count hides the fact that it touches every element on every level.

The claim being tested

O(n log n)

When it is the right choice

When the worst case matters, when the sort has to be stable, or when the data does not fit in memory — merge sort is the basis of every external sort, because merging two sorted streams needs only one element of each in memory at a time. Its cost is the scratch space: O(n) extra, which is why an in-place quicksort is usually preferred when the worst case can be ruled out.

How it works

Worth noticing

Cost

Best
O(n log n)
Average
O(n log n)
Worst
O(n log n)
Extra space
O(n)
n is
the length of a list of numbers
Measures
shuffled: up to n = 131,072; sorted: up to n = 131,072; reversed: up to n = 131,072

The ceilings are a time limit rather than a memory one, which makes this tool the odd one out in the suite. Its recorded steps are tiny — one step per measured size, not one per operation — so nothing about the trace would ever stop a run. What has to be stopped is the measuring itself: a configuration that would take more than forty million operations to count is refused before a single one of them is counted, from a formula in the input sizes rather than by starting and giving up. Two further limits sit beside it that no formula in operations can see: building the input is real work, and a recursion n deep overflows the call stack long before its operation count becomes interesting.

A fit over a dozen sizes is evidence and not proof. It cannot rule out a term that only begins to matter past the largest size measured, and it says nothing at all about the constant factors that decide which of two algorithms in the same class is actually faster on a real machine.

Worth comparing

All measured subjects