Empirical complexity

O(n) sorted · O(n²) otherwise·O(1) space
81632641282565121k2k4.1k101001k10k100k1M10Minput size ncomparisons
  • Insertion sort (reversed)

The axes are set: 10 sizes from 8 to 4,096, against a count that will reach 10,000,000. Nothing has been measured yet.

The axes are set: 10 sizes from 8 to 4,096, against a count that will reach 10,000,000. Nothing has been measured yet.
Fit so far—

Insertion sort: O(n²), claimed as n(n−1)/2

  1. 1set up the axes: the sizes to measure, and the counts they will reach
  2. 2take the next size, and build an input of that size in the chosen shape
  3. 3run the algorithm on it, counting one operation at a time
  4. 4plot the point, and refit the textbook bound to everything measured so far
  5. 5stop: report how well the bound fits, and what a handful of sizes cannot prove

What the measurement shows

Nothing has been measured yet. The ladder runs from 8 to 4,096, in 10 steps.

Sizes measured
0
Operations counted
0
Largest single count
0
Comparisons
0
Moves
0

Complexity

BestO(n)
AverageO(n²)
WorstO(n²)
Extra spaceO(1)

Insertion sort

Take each element in turn and slide it left past everything larger than it, until it sits in the right place among the elements already handled. How far it has to slide is exactly how many elements to its left are larger than it, so the total work is the number of inverted pairs in the input. On a sorted list there are none, every element stops on its first comparison, and the count is n − 1. On a reversed list every pair is inverted, and the count is n(n−1)/2. The curve plots comparisons, which is what every textbook bound for a sort is about and what makes the four of them directly comparable. The moves are counted too and shown in the panel beside it — worth a look on merge sort, whose comparison count hides the fact that it touches every element on every level.

The claim being tested

O(n) sorted · O(n²) otherwise

When it is the right choice

On small lists, where its tiny constant factor beats an asymptotically better sort outright — most production sorts switch to it below about sixteen elements. And on data that is already nearly in order, where it is genuinely linear rather than merely fast: a list with a handful of elements out of place costs a handful of slides, which no divide-and-conquer sort can match.

How it works

Worth noticing

Cost

Best
O(n)
Average
O(n²)
Worst
O(n²)
Extra space
O(1)
n is
the length of a list of numbers
Measures
shuffled: up to n = 4,096; sorted: up to n = 131,072; reversed: up to n = 4,096

The ceilings are a time limit rather than a memory one, which makes this tool the odd one out in the suite. Its recorded steps are tiny — one step per measured size, not one per operation — so nothing about the trace would ever stop a run. What has to be stopped is the measuring itself: a configuration that would take more than forty million operations to count is refused before a single one of them is counted, from a formula in the input sizes rather than by starting and giving up. Two further limits sit beside it that no formula in operations can see: building the input is real work, and a recursion n deep overflows the call stack long before its operation count becomes interesting.

A fit over a dozen sizes is evidence and not proof. It cannot rule out a term that only begins to matter past the largest size measured, and it says nothing at all about the constant factors that decide which of two algorithms in the same class is actually faster on a real machine.

Worth comparing

All measured subjects