Benchmark Results
All measurements below were captured using the methodology described in Benchmark Methodology. Unless stated otherwise:
Expected run length λ = 150
2 warm-up runs, 10 timed runs
Dataset sizes: 1,000 / 10,000 / 100,000 observations
Summary (100k Observations, Online Mode)
Model |
Throughput (obs/s) |
Description |
|
|---|---|---|---|
Bernoulli-Beta |
33 |
573 |
Binary outcomes (fastest model) |
Gaussian-NIG |
25 |
063 |
Continuous data (mean & variance unknown) |
Gamma-Gamma |
24 |
290 |
Positive continuous amounts/durations |
Student-t (Fixed ν) |
21 |
796 |
Robust continuous w/ known ν |
Poisson-Gamma |
21 |
402 |
Event counts per interval |
Binomial-Beta |
14 |
599 |
k successes out of N trials |
Student-t (Grid ν) |
3 |
471 |
Robust continuous w/ ν inference |
Offline mode delivers ~1.3–1.5× higher throughput for every model due to reduced Python call overhead and better cache locality.
Gaussian-NIG
Use case: general-purpose continuous data with unknown mean and variance.
Size |
Mode |
Median (s) |
Throughput (obs/s) |
CV% |
|
|---|---|---|---|---|---|
1k |
Online |
0.0322 |
31 |
009 |
0.1% |
1k |
Offline |
0.0228 |
43 |
835 |
1.7% |
10k |
Online |
0.3838 |
26 |
057 |
0.1% |
10k |
Offline |
0.2882 |
34 |
699 |
0.1% |
100k |
Online |
3.9899 |
25 |
063 |
0.9% |
100k |
Offline |
3.0314 |
32 |
988 |
0.5% |
Student-t (Fixed ν)
Use case: robust changepoint detection when degrees of freedom are known.
Size |
Mode |
Median (s) |
Throughput (obs/s) |
CV% |
|
|---|---|---|---|---|---|
1k |
Online |
0.0377 |
26 |
504 |
0.5% |
1k |
Offline |
0.0280 |
35 |
714 |
0.2% |
10k |
Online |
0.4507 |
22 |
189 |
0.3% |
10k |
Offline |
0.3520 |
28 |
409 |
0.5% |
100k |
Online |
4.5880 |
21 |
796 |
0.2% |
100k |
Offline |
3.6040 |
27 |
747 |
0.1% |
Student-t (Grid ν)
Use case: robust detection when ν is unknown and inferred from a grid.
Size |
Mode |
Median (s) |
Throughput (obs/s) |
CV% |
|
|---|---|---|---|---|---|
1k |
Online |
0.2261 |
4 |
422 |
0.2% |
1k |
Offline |
0.2150 |
4 |
652 |
0.4% |
10k |
Online |
2.8238 |
3 |
541 |
0.1% |
10k |
Offline |
2.7136 |
3 |
685 |
0.1% |
100k |
Online |
28.8063 |
3 |
471 |
0.5% |
100k |
Offline |
27.7352 |
3 |
606 |
0.1% |
Bernoulli-Beta
Use case: binary observations (success/failure, on/off).
Size |
Mode |
Median (s) |
Throughput (obs/s) |
CV% |
|
|---|---|---|---|---|---|
1k |
Online |
0.0281 |
35 |
608 |
0.5% |
1k |
Offline |
0.0222 |
45 |
013 |
0.2% |
10k |
Online |
0.2952 |
33 |
871 |
1.8% |
10k |
Offline |
0.2468 |
40 |
521 |
0.1% |
100k |
Online |
2.9786 |
33 |
573 |
1.0% |
100k |
Offline |
2.5797 |
38 |
765 |
1.0% |
Binomial-Beta
Use case: proportion data (k successes out of N trials).
Size |
Mode |
Median (s) |
Throughput (obs/s) |
CV% |
|
|---|---|---|---|---|---|
1k |
Online |
0.0574 |
17 |
422 |
0.3% |
1k |
Offline |
0.0429 |
23 |
314 |
0.2% |
10k |
Online |
0.6762 |
14 |
788 |
0.2% |
10k |
Offline |
0.5307 |
18 |
843 |
0.2% |
100k |
Online |
6.8500 |
14 |
599 |
0.1% |
100k |
Offline |
5.3848 |
18 |
571 |
0.1% |
Poisson-Gamma
Use case: event counts per time interval.
Size |
Mode |
Median (s) |
Throughput (obs/s) |
CV% |
|
|---|---|---|---|---|---|
1k |
Online |
0.0399 |
25 |
039 |
0.5% |
1k |
Offline |
0.0261 |
38 |
249 |
8.0% |
10k |
Online |
0.4592 |
21 |
777 |
0.4% |
10k |
Offline |
0.3212 |
31 |
131 |
0.1% |
100k |
Online |
4.6725 |
21 |
402 |
0.1% |
100k |
Offline |
3.2575 |
30 |
698 |
0.1% |
Gamma-Gamma (Fixed Shape)
Use case: positive continuous data (durations, lifetimes, transaction amounts).
Size |
Mode |
Median (s) |
Throughput (obs/s) |
CV% |
|
|---|---|---|---|---|---|
1k |
Online |
0.0340 |
29 |
448 |
0.2% |
1k |
Offline |
0.0243 |
41 |
103 |
0.2% |
10k |
Online |
0.3908 |
25 |
586 |
0.1% |
10k |
Offline |
0.2950 |
33 |
894 |
1.0% |
100k |
Online |
4.1170 |
24 |
290 |
0.1% |
100k |
Offline |
3.1020 |
32 |
237 |
0.1% |
Key Observations
Most models sustain 20k–35k obs/s even at 100k points.
Offline mode yields 30–50% better throughput thanks to reduced Python overhead.
CV% is usually < 1%, indicating stable, repeatable performance across runs.
Student-t Grid trades speed for robustness; expect a 6–7× slowdown versus fixed-ν.