Patch CI statistics

Pipeline reads CI wall-clock time. Corpus reads today's patchsets laid out over PostgreSQL's history.

Runs
1,887
terminal, in range
Success rate
85.6%
1,616 of 1,887
Median build
2m 49s
successful and failed alike
Median test
5m 12s
successful and failed alike
Median queue wait
0m 00s
queued to started
Infra errors
0.0%
0 runs
GitHub re-attempts
0
attempt > 1 on one run id

Runs by result

terminal runs only; timeouts fold into their failure band

Show data
WhenResultRuns
17 Aug 00:00success10
17 Aug 00:00tests failed1
18 Aug 00:00build failed78
18 Aug 00:00success1,606
18 Aug 00:00tests failed192

Success rate

hollow points sit below 5 terminal runs in the bucket

Show data
WhenSuccess rateTerminal runs
17 Aug 00:0090.9%11
18 Aug 00:0085.6%1,876

Build and test duration by era

median seconds; successful runs only

Show data
WhenEraBuild medianTest medianBuild p25-p75
18 Aug 00:00bookworm2m 51s4m 02s2m 38s - 2m 57s
18 Aug 00:00bullseye2m 11s3m 13s2m 04s - 2m 15s
18 Aug 00:00buster1m 58s2m 59s1m 55s - 2m 01s
17 Aug 00:00trixie2m 49s5m 24s2m 49s - 2m 54s
18 Aug 00:00trixie2m 51s5m 18s2m 45s - 2m 55s

ccache hit rate

median per bucket; the image's warm cache was baked against one reference commit, so a patch on a different base misses most of it

Show data
WhenHit rateRuns
17 Aug 00:001.5%10
18 Aug 00:001.5%1,606

Build time against ccache hit rate

one point per successful run; table shows the first 50

Show data
Hit rateBuild
3.3%1m 56s
3.3%2m 01s
1.5%2m 56s
3.3%1m 35s
3.3%1m 55s
3.3%1m 55s
3.3%2m 01s
3.3%1m 58s
3.3%2m 05s
3.3%1m 58s
1.5%2m 52s
1.7%2m 02s
1.7%2m 08s
3.3%1m 56s
1.6%2m 02s
1.6%1m 58s
1.6%2m 02s
1.5%2m 13s
4.8%2m 05s
3.3%1m 31s
4.8%2m 09s
4.7%1m 36s
4.8%2m 16s
4.8%2m 04s
4.8%2m 05s
4.8%2m 10s
4.8%2m 04s
4.8%2m 07s
1.5%2m 47s
1.5%2m 50s
3.0%2m 07s
3.0%2m 10s
4.4%1m 42s
2.9%2m 12s
2.9%2m 12s
4.4%2m 14s
3.1%2m 15s
1.5%2m 56s
2.9%1m 47s
2.9%2m 16s
1.5%2m 47s
4.8%2m 07s
2.9%2m 14s
2.9%2m 14s
2.9%1m 32s
2.9%2m 15s
1.5%2m 48s
2.9%1m 47s
2.9%1m 46s
2.9%2m 23s

Queue latency

median seconds

Show data
WhenPush to queuedQueued to started
17 Aug 00:000m 02s0m 00s
18 Aug 00:000m 02s0m 00s

Average concurrency

time-weighted average of runs in flight per bucket, against the 30-slot budget

Show data
WhenAvg concurrency
17 Aug 00:0013.9
18 Aug 00:0015.9

Push lag

time from the patch being posted to CI queueing it

Show data
WhenLagRuns
17 Aug 00:00same day6
17 Aug 00:00days5
18 Aug 00:00same day29
18 Aug 00:00days61
18 Aug 00:00weeks172
18 Aug 00:00months674
18 Aug 00:00older940

Push kind

first push, a re-push on a newer master, or a retry of the same head

Show data
WhenKindRuns
17 Aug 00:00first push6
17 Aug 00:00rebase re-push5
18 Aug 00:00first push384
18 Aug 00:00rebase re-push1,492

Suites failed per failing run

one suite is usually a patch bug; dozens is usually one crash cascading

Show data
Suites failedRuns
167
213
36
448
513
63
77
82
91
102
113
122
211
291
331
581
591
621
681
761
831
1071
1221
1291
1321
1571

Top failing suites

total failures, and in brackets the number of distinct patchsets - many failures on few patchsets means one broken patch retried; roughly one per patchset means either a flaky suite or a suite that reruns others and inherits their failures

recovery/027_stream_regress
80 (80 branches)
pg_upgrade/002_pg_upgrade
77 (77 branches)
test_plan_advice/001_replan_regress
74 (74 branches)
regress/partition_join
11 (11 branches)
regress/subselect
10 (10 branches)
postgres_fdw/postgres_fdw
9 (9 branches)
regress/alter_table
9 (9 branches)
regress/collate.icu.utf8
9 (9 branches)
regress/copy2
9 (9 branches)
isolation/horizons
8 (8 branches)
regress/generated_virtual
8 (8 branches)
regress/partition_split
8 (8 branches)
regress/plpgsql
8 (8 branches)
regress/predicate
8 (8 branches)
regress/stats
8 (8 branches)
regress/with
8 (8 branches)
isolation/eval-plan-qual
7 (7 branches)
regress/domain
7 (7 branches)
regress/explain
7 (7 branches)
regress/foreign_key
7 (7 branches)

Infra health

Everything here should be zero. Non-zero is worth a look, not a panic.

ConditionCount
infra errors0
in flight past 48h0
branches with a failed push2
payloads we could not parse0
runs with no payload0
built but pushed no image17
Retried heads
0
same head_sha pushed again, new run id
Verdict changed
-
0 of 0 - meaningless until this denominator grows
discussionsallactive only
Tracked patchsets
5,828
current, not superseded, all patchsets
Median base age
932 days
behind master, all patchsets
On recent master
33.4%
base 30 days or newer, all patchsets
Has a verdict
88.9%
terminal CI status, all patchsets
Has a runnable image
85.4%
counted by digest, all patchsets
recent
1,949
base age tier, all patchsets
stale
398
base age tier, all patchsets
ancient
3,391
base age tier, all patchsets
unknown
90
base age tier, all patchsets

Master re-check recency

when each patchset was last tried against master; overdue is past 26h with master moved since. Unlike the base age tiles above, this follows the discussions control.

current
6
behind
378
overdue
112
never
16

Base age distribution

all current patchsets against those in active discussions

Show data
Base ageAllActive discussions
<1d1,639319
1-7d6555
7-30d24599
30-90d6216
90d-1y33610
1-2y3632
2-5y1,0000
>5y2,0281
unknown9010

Outcome by base commit year

current patchsets, by the year of the master commit they apply to

Show data
Base yearOutcomePatchsets
unknownnever applied10
2021success1
2025success2
2025tests failed1
2026success424
2026cancelled1
2026tests failed31
2026build failed6
2026infra error1
2026no verdict5
2026never applied30

Success rate by base commit year

of patchsets carrying a verdict

Show data
Base yearSuccess rateWith a verdict
2021100.0%1
202566.7%3
202691.6%465

Apply failures by base commit year

patchsets that would not apply even to their own detected base - a patch-extraction / base-detection signal, not a staleness measure; the rate is in the table

Show data
Base yearPatchsetsFailed to applyFailure rate
unknown1010100.0%
2021100.0%
2025300.0%
2026498306.0%

Build and test time over PostgreSQL history

median seconds of successful runs, by the base commit's year

Show data
Base yearBuild medianTest median
20212m 17s3m 02s
20252m 32s5m 43s
20262m 53s5m 21s

Test suites over PostgreSQL history

median executed suites of successful runs, by the base commit's year

Show data
Base yearSuites median
2021623
2025905
20261019

Per PostgreSQL major

A major whose era image is still a disabled stub is marked - those patchsets sit in won't-retry until the image exists.

PGEraPatchsetsRunsSuccessBuild medianTest medianSuitesImages
15bullseye11100.0%2m 17s3m 02s6231
19trixie161580.0%2m 47s4m 45s99714
20trixie4844,43291.0%2m 52s5m 21s1019440

Files the corpus conflicts on

from apply-stage failures; in brackets the number of distinct patchsets

src/backend/utils/adt/float.c
3 (3 branches)
src/include/utils/float.h
3 (3 branches)
doc/src/sgml/release-18.sgml
2 (2 branches)
doc/src/sgml/release-19.sgml
2 (2 branches)
src/backend/commands/publicationcmds.c
2 (2 branches)
contrib/pg_buffercache/pg_buffercache_pages.c
1 (1 branches)
doc/src/sgml/perform.sgml
1 (1 branches)
doc/src/sgml/protocol.sgml
1 (1 branches)
doc/src/sgml/ref/explain.sgml
1 (1 branches)
src/backend/access/common/reloptions.c
1 (1 branches)
src/backend/access/common/toast_internals.c
1 (1 branches)
src/backend/access/heap/heapam.c
1 (1 branches)
src/backend/access/table/toast_helper.c
1 (1 branches)
src/backend/optimizer/path/allpaths.c
1 (1 branches)
src/backend/optimizer/path/joinpath.c
1 (1 branches)
src/backend/optimizer/plan/subselect.c
1 (1 branches)
src/backend/optimizer/prep/prepjointree.c
1 (1 branches)
src/backend/optimizer/util/pathnode.c
1 (1 branches)
src/backend/postmaster/checkpointer.c
1 (1 branches)
src/backend/replication/logical/relation.c
1 (1 branches)

Verdict coverage in active discussions

patchsets in threads with a message in the last 30 days

Show data
EraWith a verdictNo verdict
bullseye10
trixie46832
unknown011

Patch size against outcome

files touched per patchset, from the recorded submission paths

Show data
Files touchedOutcomePatchsets
unknownsuccess427
unknowncancelled1
unknowntests failed32
unknownbuild failed6
unknowninfra error1
unknownno verdict5
unknownnever applied40

Patchset versions per topic

every version, superseded included; split by whether the topic was committed

Show data
VersionsTopicTopics
1not committed4,981
1committed534
2not committed157
2committed36
3not committed46
3committed8
4not committed14
4committed5
5committed2
5not committed8
6committed1
6not committed5
7not committed4
8not committed2
10committed1
11not committed1

Why the orchestrator won't retry

The dashboard shows the top three of this same breakdown.

ReasonPatchsets
base too old3,249
committed118
patchset touches .github/11