Unexpected behavior after OOM errors

1 patchset tracked - current t248567_32

v32t248567_32posted Jul 27, 14:33successappliesrecent 0dpg 20

baseba6d9ee25 about 13 hours ago on master

applyapplied about 12 hours ago

rebaselast tried about 12 hours ago on ba6d9ee25

pushabout 12 hours ago -> cb9f377aa branch diff vs base

Result	Att	PG	Tests	Build / test	Image	When
success	1	20	1049 / 1049	2m 45s / 5m 12s	`docker run ... :t248567`	about 12 hours ago
run 39745098132 executed 1049 - ccache 78 hit / 6544 miss - head cb9f377aa - digest sha256:e0e15a067c2564... - run 39745098132
success	1	20	1049 / 1049	3m 01s / 5m 31s	`docker run ... @sha256:8df09c2...`	1 day ago
run 39565861630 executed 1049 - ccache 78 hit / 6544 miss - head a5699252e - digest sha256:8df09c26b363d9... - run 39565861630
success	1	20	1049 / 1049	1m 51s / 4m 27s	`docker run ... @sha256:2d4b214...`	3 days ago
run 39388758405 executed 1049 - ccache 78 hit / 6544 miss - head 77c301c62 - digest sha256:2d4b21485117bc... - run 39388758405
success	1	20	1049 / 1049	2m 56s / 5m 33s	`docker run ... @sha256:fad012c...`	4 days ago
run 39217983003 executed 1049 - ccache 78 hit / 6544 miss - head b1e6d8597 - digest sha256:fad012c56d9e53... - run 39217983003
success	1	20	1049 / 1049	2m 54s / 5m 43s	`docker run ... @sha256:1bb3de7...`	5 days ago
run 39108659917 executed 1049 - ccache 78 hit / 6544 miss - head 039e6cba4 - digest sha256:1bb3de77325f7c... - run 39108659917
success	1	20	1049 / 1049	2m 53s / 5m 22s	`docker run ... @sha256:c8ffaa4...`	6 days ago
run 39014525327 executed 1049 - ccache 78 hit / 6544 miss - head f086043a1 - digest sha256:c8ffaa4aa14db4... - run 39014525327
success	1	20	1049 / 1049	2m 59s / 5m 34s	`docker run ... @sha256:1150d87...`	7 days ago
run 38868641410 executed 1049 - ccache 78 hit / 6544 miss - head 09b535123 - digest sha256:1150d87cf88064... - run 38868641410
success	1	20	1047 / 1047	2m 53s / 5m 36s	`docker run ... @sha256:b3cb1e0...`	Oct 15, 07:48
run 38700047370 executed 1047 - ccache 78 hit / 6544 miss - head abe778825 - digest sha256:b3cb1e03d32c8f... - run 38700047370
success	1	20	1044 / 1044	2m 12s / 4m 39s	`docker run ... @sha256:7af223c...`	Oct 14, 07:42
run 38529031047 executed 1044 - ccache 78 hit / 6544 miss - head 79e8362b9 - digest sha256:7af223c3bb9f4b... - run 38529031047
success	1	20	1044 / 1044	2m 42s / 4m 34s	`docker run ... @sha256:d6b695f...`	Oct 13, 07:38
run 38362828604 executed 1044 - ccache 78 hit / 6544 miss - head 8731fb966 - digest sha256:d6b695fc4d8fe5... - run 38362828604
success	1	20	1044 / 1044	2m 54s / 5m 38s	`docker run ... @sha256:0dc11dd...`	Oct 12, 07:35
run 38217568944 executed 1044 - ccache 78 hit / 6544 miss - head 55d057724 - digest sha256:0dc11dd6a1c80d... - run 38217568944
success	1	20	1044 / 1044	2m 54s / 5m 13s	`docker run ... @sha256:c808327...`	Oct 11, 01:35
run 38101760522 executed 1044 - ccache 78 hit / 6544 miss - head 262f8e1ec - digest sha256:c808327ea7cd04... - run 38101760522
success	1	20	1043 / 1043	2m 54s / 5m 36s	`docker run ... @sha256:b42eea1...`	Oct 10, 01:34
run 38012974221 executed 1043 - ccache 78 hit / 6544 miss - head 407838145 - digest sha256:b42eea1a55e9dd... - run 38012974221
success	1	20	1043 / 1043	1m 53s / 4m 16s	`docker run ... @sha256:9d6c8ad...`	Oct 09, 01:30
run 37869427988 executed 1043 - ccache 78 hit / 6544 miss - head 4f42f8433 - digest sha256:9d6c8ad7697845... - run 37869427988
success	1	20	1042 / 1042	1m 54s / 4m 15s	`docker run ... @sha256:b0e4f92...`	Oct 08, 01:25
run 37712109883 executed 1042 - ccache 78 hit / 6544 miss - head 4d9cf05a2 - digest sha256:b0e4f9249de422... - run 37712109883
success	1	20	1041 / 1041	2m 16s / 4m 32s	`docker run ... @sha256:ef7a854...`	Oct 07, 01:24
run 37556151264 executed 1041 - ccache 78 hit / 6544 miss - head 8d3270269 - digest sha256:ef7a8549d9d5b6... - run 37556151264
success	1	20	1039 / 1039	2m 52s / 5m 10s	`docker run ... @sha256:d4a5af5...`	Oct 06, 01:23
run 37397999610 executed 1039 - ccache 78 hit / 6544 miss - head ceedf2b81 - digest sha256:d4a5af54740a21... - run 37397999610
success	1	20	1039 / 1039	2m 52s / 5m 30s	`docker run ... @sha256:fe2ae20...`	Oct 05, 01:22
run 37250440658 executed 1039 - ccache 78 hit / 6544 miss - head fc790873d - digest sha256:fe2ae201b61f7e... - run 37250440658
success	1	20	1039 / 1039	2m 52s / 5m 28s	`docker run ... @sha256:8cbbae3...`	Oct 04, 01:19
run 37167138645 executed 1039 - ccache 78 hit / 6544 miss - head 52d5a9c5f - digest sha256:8cbbae35008a5f... - run 37167138645
success	1	20	1039 / 1039	2m 51s / 5m 20s	`docker run ... @sha256:6b9cad8...`	Oct 03, 01:19
run 37084948728 executed 1039 - ccache 78 hit / 6544 miss - head fc8b57798 - digest sha256:6b9cad81c2cdf9... - run 37084948728
success	1	20	1039 / 1039	2m 55s / 5m 32s	`docker run ... @sha256:28f3683...`	Oct 02, 01:18
run 36949462322 executed 1039 - ccache 78 hit / 6544 miss - head 666cd7262 - digest sha256:28f368324d873b... - run 36949462322
success	1	20	1039 / 1039	1m 52s / 4m 00s	`docker run ... @sha256:b789db5...`	Oct 01, 01:07
run 36798917786 executed 1039 - ccache 78 hit / 6544 miss - head 2003ba9a1 - digest sha256:b789db51ec8276... - run 36798917786
success	1	20	1039 / 1039	2m 52s / 5m 18s	`docker run ... @sha256:55fa3f8...`	Sep 30, 01:08
run 36652830365 executed 1039 - ccache 78 hit / 6544 miss - head 55bff9550 - digest sha256:55fa3f8fcb34b5... - run 36652830365
success	1	20	1039 / 1039	2m 12s / 4m 39s	`docker run ... @sha256:8913da1...`	Sep 29, 01:04
run 36505397026 executed 1039 - ccache 78 hit / 6544 miss - head 496eada17 - digest sha256:8913da13adcf7f... - run 36505397026
success	1	20	1039 / 1039	2m 53s / 5m 18s	`docker run ... @sha256:6ff698f...`	Sep 28, 01:04
run 36363895442 executed 1039 - ccache 78 hit / 6544 miss - head da7725202 - digest sha256:6ff698f68c03d9... - run 36363895442
success	1	20	1039 / 1039	2m 16s / 4m 23s	`docker run ... @sha256:3ed04eb...`	Sep 26, 20:17
run 36268488697 executed 1039 - ccache 78 hit / 6544 miss - head 46092c4a7 - digest sha256:3ed04ebeb2151f... - run 36268488697
success	1	20	1039 / 1039	2m 14s / 4m 56s	`docker run ... @sha256:8cbab90...`	Sep 25, 20:09
run 36183052182 executed 1039 - ccache 78 hit / 6544 miss - head 25da840ed - digest sha256:8cbab9095d4cf6... - run 36183052182
success	1	20	1038 / 1038	2m 54s / 5m 39s	`docker run ... @sha256:23121d5...`	Sep 24, 20:09
run 36051771578 executed 1038 - ccache 78 hit / 6544 miss - head 210778ff1 - digest sha256:23121d5c18f1c7... - run 36051771578
success	1	20	1036 / 1036	2m 53s / 5m 26s	`docker run ... @sha256:e9457bb...`	Sep 23, 20:04
run 35912312479 executed 1036 - ccache 98 hit / 6524 miss - head bd41270b1 - digest sha256:e9457bbe1ce356... - run 35912312479
success	1	20	1036 / 1036	2m 53s / 5m 39s	`docker run ... @sha256:ffd693f...`	Sep 22, 20:00
run 35776275267 executed 1036 - ccache 98 hit / 6524 miss - head cb207015d - digest sha256:ffd693ff4d5496... - run 35776275267
success	1	20	1036 / 1036	2m 49s / 5m 31s	`docker run ... @sha256:4c610cd...`	Sep 21, 19:53
run 35646454868 executed 1036 - ccache 98 hit / 6524 miss - head 015c513c8 - digest sha256:4c610cd4480e87... - run 35646454868
success	1	20	1036 / 1036	1m 51s / 4m 19s	`docker run ... @sha256:f79ddfa...`	Sep 20, 14:17
run 35515589009 executed 1036 - ccache 98 hit / 6524 miss - head 18b6a6a84 - digest sha256:f79ddfa6c41118... - run 35515589009
success	1	20	1036 / 1036	2m 50s / 5m 23s	`docker run ... @sha256:d0ccbbc...`	Sep 19, 14:17
run 35447721299 executed 1036 - ccache 98 hit / 6524 miss - head 0b2287e23 - digest sha256:d0ccbbc50ed521... - run 35447721299
success	1	20	1036 / 1036	2m 50s / 5m 14s	`docker run ... @sha256:0028c8f...`	Sep 18, 14:15
run 35354046904 executed 1036 - ccache 98 hit / 6524 miss - head 713b49810 - digest sha256:0028c8fbb32e35... - run 35354046904
success	1	20	1036 / 1036	2m 44s / 4m 44s	`docker run ... @sha256:d2a5501...`	Sep 17, 14:11
run 35230842437 executed 1036 - ccache 98 hit / 6524 miss - head 6863751d9 - digest sha256:d2a55012b8290f... - run 35230842437
success	1	20	1036 / 1036	2m 57s / 5m 14s	`docker run ... @sha256:8afc53b...`	Sep 16, 14:04
run 35104851557 executed 1036 - ccache 98 hit / 6524 miss - head be0fb0ac9 - digest sha256:8afc53b6053d91... - run 35104851557
success	1	20	1036 / 1036	2m 56s / 5m 24s	`docker run ... @sha256:dbefcf6...`	Sep 15, 14:00
run 34977576923 executed 1036 - ccache 98 hit / 6523 miss - head 1f2782891 - digest sha256:dbefcf6b45628d... - run 34977576923
success	1	20	1036 / 1036	2m 45s / 5m 06s	`docker run ... @sha256:d3e91d7...`	Sep 14, 13:54
run 34851067591 executed 1036 - ccache 98 hit / 6523 miss - head 558751ded - digest sha256:d3e91d70b006fe... - run 34851067591
success	1	20	1023 / 1023	2m 52s / 5m 29s	`docker run ... @sha256:4e1c4fd...`	Sep 13, 13:16
run 34758872180 executed 1023 - ccache 98 hit / 6523 miss - head ebd88fb99 - digest sha256:4e1c4fdc33fd96... - run 34758872180
success	1	20	1023 / 1023	2m 34s / 4m 31s	`docker run ... @sha256:4f0a62d...`	Sep 12, 12:58
run 34694692788 executed 1023 - ccache 98 hit / 6523 miss - head 6951421b1 - digest sha256:4f0a62da4bcbda... - run 34694692788
success	1	20	1022 / 1022	2m 53s / 5m 27s	`docker run ... @sha256:4296074...`	Sep 11, 12:56
run 34600619187 executed 1022 - ccache 98 hit / 6523 miss - head 1f52522c6 - digest sha256:4296074cc27793... - run 34600619187
success	1	20	1022 / 1022	2m 18s / 4m 26s	`docker run ... @sha256:da65a93...`	Sep 10, 12:54
run 34478402356 executed 1022 - ccache 98 hit / 6523 miss - head 755a81304 - digest sha256:da65a93e8f6a50... - run 34478402356
success	1	20	1020 / 1020	2m 55s / 5m 31s	`docker run ... @sha256:7999f16...`	Sep 09, 12:51
run 34352429891 executed 1020 - ccache 98 hit / 6523 miss - head 8765b48e5 - digest sha256:7999f16be8e78a... - run 34352429891
success	1	20	1020 / 1020	2m 49s / 5m 40s	`docker run ... @sha256:7eaf816...`	Sep 08, 12:50
run 34227292490 executed 1020 - ccache 98 hit / 6523 miss - head c290a7b85 - digest sha256:7eaf816647b348... - run 34227292490
success	1	20	1024 / 1024	2m 49s / 4m 42s	`docker run ... @sha256:d8359b3...`	Sep 07, 12:44
run 34122517892 executed 1024 - ccache 98 hit / 6527 miss - head f86433ebe - digest sha256:d8359b32687642... - run 34122517892
success	1	20	1024 / 1024	2m 52s / 5m 31s	`docker run ... @sha256:fcd4143...`	Sep 05, 14:37
run 33971784116 executed 1024 - ccache 98 hit / 6527 miss - head a395dc607 - digest sha256:fcd41432cf6baa... - run 33971784116
success	1	20	1024 / 1024	2m 56s / 5m 26s	`docker run ... @sha256:8bd2ee8...`	Sep 04, 14:35
run 33883542576 executed 1024 - ccache 98 hit / 6527 miss - head b3c18410b - digest sha256:8bd2ee81d9c209... - run 33883542576
success	1	20	1023 / 1023	2m 48s / 5m 31s	`docker run ... @sha256:548ae7a...`	Sep 03, 14:36
run 33766600684 executed 1023 - ccache 98 hit / 6526 miss - head da75cc534 - digest sha256:548ae7abbc70fd... - run 33766600684
cancelled	1	-	-	-	-	Sep 03, 14:23
run 33766596965 head da75cc534 - run 33766596965
success	1	20	1022 / 1022	2m 58s / 5m 46s	`docker run ... @sha256:bb9b31a...`	Sep 02, 14:35
run 33641617341 executed 1022 - ccache 98 hit / 6526 miss - head 198fba45c - digest sha256:bb9b31a12dfec3... - run 33641617341
success	1	20	1022 / 1022	2m 50s / 5m 39s	`docker run ... @sha256:bdcd53b...`	Sep 01, 14:34
run 33518984001 executed 1022 - ccache 98 hit / 6526 miss - head cbcb6b99c - digest sha256:bdcd53bf544d15... - run 33518984001
success	1	20	1022 / 1022	2m 21s / 4m 21s	`docker run ... @sha256:81a838f...`	Aug 31, 14:24
run 33401447231 executed 1022 - ccache 98 hit / 6526 miss - head d7eb8689e - digest sha256:81a838f811b74c... - run 33401447231
success	1	20	1021 / 1021	2m 58s / 5m 26s	`docker run ... @sha256:c8c4ee1...`	Aug 30, 14:23
run 33316241412 executed 1021 - ccache 98 hit / 6525 miss - head 8ba4486c8 - digest sha256:c8c4ee1a9a7b1a... - run 33316241412
success	1	20	1021 / 1021	3m 02s / 5m 40s	`docker run ... @sha256:612f98b...`	Aug 29, 14:22
run 33256923645 executed 1021 - ccache 98 hit / 6525 miss - head c1061cb6d - digest sha256:612f98b660dfc8... - run 33256923645
success	1	20	1021 / 1021	2m 53s / 5m 31s	`docker run ... @sha256:cb9f408...`	Aug 28, 14:21
run 33178854468 executed 1021 - ccache 98 hit / 6525 miss - head f1cf33de6 - digest sha256:cb9f408f5a1934... - run 33178854468
success	1	20	1021 / 1021	2m 48s / 5m 04s	`docker run ... @sha256:7553c50...`	Aug 27, 14:18
run 33080601013 executed 1021 - ccache 98 hit / 6525 miss - head 44b871f43 - digest sha256:7553c5071fa5b0... - run 33080601013
success	1	20	1024 / 1024	2m 52s / 5m 25s	`docker run ... @sha256:84af977...`	Aug 26, 14:05
run 32976958855 executed 1024 - ccache 98 hit / 6525 miss - head 0eaacfdd8 - digest sha256:84af9775bc3bbd... - run 32976958855
success	1	20	1024 / 1024	2m 24s / 4m 26s	`docker run ... @sha256:a0e0642...`	Aug 25, 13:57
run 32855521566 executed 1024 - ccache 98 hit / 6525 miss - head 1700e9a96 - digest sha256:a0e0642803f7c9... - run 32855521566
success	1	20	1023 / 1023	2m 50s / 5m 32s	`docker run ... @sha256:c4d24ef...`	Aug 24, 13:57
run 32734719099 executed 1023 - ccache 98 hit / 6525 miss - head 51cdccb8e - digest sha256:c4d24ef981c968... - run 32734719099
success	1	20	1023 / 1023	3m 02s / 5m 29s	`docker run ... @sha256:db02f32...`	Aug 23, 13:57
run 32643376414 executed 1023 - ccache 98 hit / 6525 miss - head 2ad55dd85 - digest sha256:db02f32214dc3d... - run 32643376414
success	1	20	1023 / 1023	2m 49s / 4m 51s	`docker run ... @sha256:91ea6c0...`	Aug 22, 13:55
run 32576670143 executed 1023 - ccache 98 hit / 6525 miss - head 05c0b4f3d - digest sha256:91ea6c0c0d7e72... - run 32576670143
success	1	20	1023 / 1023	2m 50s / 4m 41s	`docker run ... @sha256:114c632...`	Aug 21, 13:53
run 32488349267 executed 1023 - ccache 98 hit / 6525 miss - head 89e748829 - digest sha256:114c632052e2cb... - run 32488349267
success	1	20	1023 / 1023	2m 58s / 5m 07s	`docker run ... @sha256:6b7ff90...`	Aug 20, 13:52
run 32375728570 executed 1023 - ccache 98 hit / 6525 miss - head afd2139f0 - digest sha256:6b7ff902e9754e... - run 32375728570
success	1	20	1023 / 1023	2m 56s / 5m 42s	`docker run ... @sha256:d1d4fe6...`	Aug 19, 13:50
run 32259319928 executed 1023 - ccache 98 hit / 6525 miss - head c1304b5c0 - digest sha256:d1d4fe6ebceae0... - run 32259319928
success	1	20	1021 / 1021	3m 01s / 5m 53s	`docker run ... @sha256:84fd13f...`	Aug 18, 13:42
run 32142413044 executed 1021 - ccache 98 hit / 6525 miss - head f9c5a36f9 - digest sha256:84fd13faa11567... - run 32142413044