Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w8MXC-000SZm-0V for pgsql-bugs@arkaria.postgresql.org; Thu, 02 Apr 2026 18:12:50 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.96) (envelope-from ) id 1w8MX9-007PVy-2E for pgsql-bugs@arkaria.postgresql.org; Thu, 02 Apr 2026 18:12:48 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1w8MX9-007PVp-19 for pgsql-bugs@lists.postgresql.org; Thu, 02 Apr 2026 18:12:47 +0000 Received: from relay6-d.mail.gandi.net ([2001:4b98:dc4:8::226]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.98.2) (envelope-from ) id 1w8MX7-00000000F0z-0apt for pgsql-bugs@lists.postgresql.org; Thu, 02 Apr 2026 18:12:47 +0000 Received: by mail.gandi.net (Postfix) with ESMTPSA id 1A0F43EC61; Thu, 2 Apr 2026 18:12:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vondra.me; s=gm1; t=1775153559; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Chgn61KVoWmF02ZC2sZvSiHXgQrW5dkq2VsJmahoZ54=; b=gUEk5O1kbT4Yl+g1Tdthaj0umrDO9Rhpw1aXhJSAtb/m8xlkxl8OKV/WQ4L299ktHmC9XZ csRGImY2EVUcJe1VjQC+3j2nywa8mPtStjEnnwkTpeP0uEdVCfJVePDk/V7gynl23qyrHh /OPdFd4LFYdqsPTIHM7Ev1x8whMkkcuoCHJlFc277cprPAn1yC7SSrRzhPAZidnq5FPOyQ GGv270CI7ywC+/wskfZGL8UQblzYryT80EoVXRTK0w5zeEuD0OQS04FxxQrPZz5aIQ3bIs xNMe4//Og8Jlx3b98NREBdbcDkncl8cKUfcbTgnKv4rZ9ItL4vEznFx2Ey+o4w== Content-Type: multipart/mixed; boundary="------------zhWm0qkt0B6ojMUAI0ll977p" Message-ID: <2747373b-d188-43b1-8e49-66f9e23e3c24@vondra.me> Date: Thu, 2 Apr 2026 20:12:38 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: BUG #19449: Massive performance degradation for complex query on Postgres 16+ (few seconds -> multiple hours) To: =?UTF-8?Q?Adrian_M=C3=B6nnich?= , Andres Freund Cc: pgsql-bugs@lists.postgresql.org, Tomas Vondra , Thomas Munro References: <19449-4fac687c06cc7def@postgresql.org> <43225458.20260402160627@cern.ch> <94712944.20260402164957@cern.ch> Content-Language: en-US From: Tomas Vondra In-Reply-To: <94712944.20260402164957@cern.ch> X-GND-Sasl: tomas@vondra.me X-GND-State: clean X-GND-Score: -100 X-GND-Cause: dmFkZTG4NzN1udQa1NeTu1tKml0OLHiYJ3m8Cd6hk7OmIjK4kgbcbys+20kzZLXQa9tBtHjIttkxrjlq4GoSPQM+4Jng3r2HbzxWM/PaRLsGaiYkBDZ0Mgp4fUy7bgnM9qvbyHYoD1gJ/FkoEUEUuuC10K4PWUFC5d64LDDznjQQ4qicWaQSOkc/NIHE2NcNgqh6EcKmIiTMOAXmhyM/3xAJRaag2KcVtqScQISHN5dph3SUd1XTI3Q7MynRDw3FAfmXyNr1IMGkgt+4XP9Fq700Y5zA6mFLlroZSQuKP5ZHtf7yoOisJRf4CUk+d7DNIPf/0hNd0/4jUoOMA98B8dR4Z1bvtHcRqmWbRwjETWx0B+M8PVnQOEakQiFsABjb/2H145xdLRYu9ZLq/vUMoV0D7GTLGRpdrrKviSniEMM1/uWzDLck/TOPm1o+FhAtfzXSCTY7APM3vJQtZSMJt9B+wzB6Zb28W8lV/1iw7BIL56q7e5YBL3Ru+5Q6PjRkvB0Fx9CBlYtBgBt0hUynq9SDK0Rc6FPSAWknN7k3zbYoXMQliOavhXiJK4xCheyXW6AFsx92/itHv3Z49wTIdcq4IDIWhYhnKJ1opQjAWYZ80kHnoIYIxBoW1EFXKgum1mzTOWTdgZSmJWlOn+oPy34kOComFB1dAhPIO1zmzrS3LCWO+Q List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk This is a multi-part message in MIME format. --------------zhWm0qkt0B6ojMUAI0ll977p Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Hi, I can reproduce the performance getting much worse in 16, using the provided SQL scripts. This is what I see: 14: 1551.363 ms 15: 1385.414 ms 16: 161571.400 ms 17: 156434.543 ms 18: 159095.001 ms I'm attaching the explains for 15+16. I don't know what's causing it, but I have a couple interesting observations. 1) If I disable parallel query, the timings change to 14: 3990.439 ms 15: 3518.453 ms 16: 3606.460 ms 17: 3591.039 ms 18: 3617.872 ms So no regression in this case. It seems to be related to parallelism. 2) There seems to be an explosion of temporary files. We don't have that in explain, but I queried pg_stat_database before/after the query, and there's huge difference. Both start at temp_files | 112 temp_bytes | 1942275280 so 112 files, ~2GB disk space. But after the query, 15 says temp_files | 721 temp_bytes | 2755839184 while 16 has temp_files | 2078995 temp_bytes | 70607906000 2M files and 70GB? Wow! 3) Indeed, before the query completes the pgsql_tmp directory has this: 63M pgsql_tmp3499395.0.fileset 63G pgsql_tmp3499395.1.fileset 95M pgsql_tmp3499395.2.fileset 95M pgsql_tmp3499395.3.fileset 127M pgsql_tmp3499395.4.fileset So I guess that's one of the parallel hash joins doing something, and consuming 63GB of disk space? I don't see anything suspicious in the plan, but I assume parallel HJ may not report the relevant stats. FWIW bumping up work_mem (to 64MB) solved this with the sample data. I suspect this is going to be something like the hash join explosion, where we just happen to add more and more batches. I don't have time to investigate this more at the moment. regards -- Tomas Vondra --------------zhWm0qkt0B6ojMUAI0ll977p Content-Type: text/x-log; charset=UTF-8; name="16.log" Content-Disposition: attachment; filename="16.log" Content-Transfer-Encoding: base64 ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgUVVF UlkgUExBTiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0KIEZpbmFsaXplIEFnZ3JlZ2F0ZSAgKGNvc3Q9NDI0ODAzLjcwLi40MjQ4 MDMuNzEgcm93cz0xIHdpZHRoPTgpIChhY3R1YWwgdGltZT0xNDMwMjAuMjMwLi4xNjE1Njcu ODcyIHJvd3M9MSBsb29wcz0xKQogICAtPiAgR2F0aGVyICAoY29zdD00MjQ4MDMuNDguLjQy NDgwMy42OSByb3dzPTIgd2lkdGg9OCkgKGFjdHVhbCB0aW1lPTE0Mjk2NC40NTcuLjE2MTU2 Ny44NTEgcm93cz0zIGxvb3BzPTEpCiAgICAgICAgIFdvcmtlcnMgUGxhbm5lZDogMgogICAg ICAgICBXb3JrZXJzIExhdW5jaGVkOiAyCiAgICAgICAgIC0+ICBQYXJ0aWFsIEFnZ3JlZ2F0 ZSAgKGNvc3Q9NDIzODAzLjQ4Li40MjM4MDMuNDkgcm93cz0xIHdpZHRoPTgpIChhY3R1YWwg dGltZT0xNDI5NjMuMjgwLi4xNDI5NjguNTU5IHJvd3M9MSBsb29wcz0zKQogICAgICAgICAg ICAgICAtPiAgUGFyYWxsZWwgSGFzaCBKb2luICAoY29zdD0zMzg2NDAuNzIuLjQyMTc4My42 OCByb3dzPTgwNzkxOSB3aWR0aD00KSAoYWN0dWFsIHRpbWU9MTQyNzQ2LjgyMC4uMTQyOTMz LjU4MCByb3dzPTE1MjMyMzIgbG9vcHM9MykKICAgICAgICAgICAgICAgICAgICAgSGFzaCBD b25kOiAoYXR0YWNobWVudHMuZm9sZGVyX2lkID0gZm9sZGVycy5pZCkKICAgICAgICAgICAg ICAgICAgICAgLT4gIFBhcmFsbGVsIFNlcSBTY2FuIG9uIGF0dGFjaG1lbnRzICAoY29zdD0w LjAwLi41NDc0OC45NyByb3dzPTE5ODAxNzcgd2lkdGg9OCkgKGFjdHVhbCB0aW1lPTAuMjMz Li44NS4zODAgcm93cz0xNTc2Njg1IGxvb3BzPTMpCiAgICAgICAgICAgICAgICAgICAgICAg ICAgIEZpbHRlcjogKE5PVCBpc19kZWxldGVkKQogICAgICAgICAgICAgICAgICAgICAgICAg ICBSb3dzIFJlbW92ZWQgYnkgRmlsdGVyOiAzMjc3NjcKICAgICAgICAgICAgICAgICAgICAg LT4gIFBhcmFsbGVsIEhhc2ggIChjb3N0PTMyOTY5NC45OS4uMzI5Njk0Ljk5IHJvd3M9NTQ1 MjU4IHdpZHRoPTQpIChhY3R1YWwgdGltZT0xNDI1MzIuODYxLi4xNDI1MzguMTM2IHJvd3M9 MTAzMDYzMyBsb29wcz0zKQogICAgICAgICAgICAgICAgICAgICAgICAgICBCdWNrZXRzOiAy NjIxNDQgIEJhdGNoZXM6IDE2ICBNZW1vcnkgVXNhZ2U6IDk2NjRrQgogICAgICAgICAgICAg ICAgICAgICAgICAgICAtPiAgUGFyYWxsZWwgSGFzaCBSaWdodCBKb2luICAoY29zdD0yMjgw OTQuNTAuLjMyOTY5NC45OSByb3dzPTU0NTI1OCB3aWR0aD00KSAoYWN0dWFsIHRpbWU9NDg2 MjAuNjU1Li4xNDI0NDkuOTg0IHJvd3M9MTAzMDYzMyBsb29wcz0zKQogICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICBIYXNoIENvbmQ6IChjb250cmlidXRpb25zLmlkID0gZm9s ZGVycy5jb250cmlidXRpb25faWQpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IEZpbHRlcjogKE5PVCBDT0FMRVNDRShzZXNzaW9ucy5pc19kZWxldGVkLCBjb250cmlidXRp b25zLmlzX2RlbGV0ZWQsIHN1YmNvbnRyaWJ1dGlvbnMuaXNfZGVsZXRlZCwgZmFsc2UpKQog ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBSb3dzIFJlbW92ZWQgYnkgRmlsdGVy OiA1MjgzCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0+ICBQYXJhbGxlbCBT ZXEgU2NhbiBvbiBjb250cmlidXRpb25zICAoY29zdD0wLjAwLi42MTQ2MS4zMSByb3dzPTI2 NzQxMzEgd2lkdGg9NSkgKGFjdHVhbCB0aW1lPTAuMDM0Li4xNDkuMTM0IHJvd3M9MjEzOTM1 OSBsb29wcz0zKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxs ZWwgSGFzaCAgKGNvc3Q9MjA5MTM4LjA1Li4yMDkxMzguMDUgcm93cz0xMDkwNTE2IHdpZHRo PTEwKSAoYWN0dWFsIHRpbWU9MjI3NzQuOTk4Li4yMjc3NS4zMDggcm93cz0xMDM1OTE2IGxv b3BzPTMpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEJ1Y2tldHM6 IDI2MjE0NCAob3JpZ2luYWxseSAyNjIxNDQpICBCYXRjaGVzOiAyNjIxNDQgKG9yaWdpbmFs bHkgMzIpICBNZW1vcnkgVXNhZ2U6IDE5MTY4a0IKICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggTGVmdCBKb2luICAoY29zdD0xMTU3 MjIuNjAuLjIwOTEzOC4wNSByb3dzPTEwOTA1MTYgd2lkdGg9MTApIChhY3R1YWwgdGltZT01 NDIuODU4Li42MTcuNDkxIHJvd3M9MTAzNTkxNiBsb29wcz0zKQogICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIYXNoIENvbmQ6IChmb2xkZXJzLnNlc3Np b25faWQgPSBzZXNzaW9ucy5pZCkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggTGVmdCBKb2luICAoY29zdD0xMDU5MzAu NjQuLjE4NDg2Mi40OCByb3dzPTEwOTA1MTYgd2lkdGg9MTMpIChhY3R1YWwgdGltZT00MTIu MTI0Li40NzIuMTk5IHJvd3M9MTAzNTkxNiBsb29wcz0zKQogICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIYXNoIENvbmQ6IChmb2xkZXJzLnN1 YmNvbnRyaWJ1dGlvbl9pZCA9IHN1YmNvbnRyaWJ1dGlvbnMuaWQpCiAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEZpbHRlcjogKChjb250cmli dXRpb25zXzEuaXNfZGVsZXRlZCBJUyBOVUxMKSBPUiAoTk9UIGNvbnRyaWJ1dGlvbnNfMS5p c19kZWxldGVkKSkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgUm93cyBSZW1vdmVkIGJ5IEZpbHRlcjogMTUwCiAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0+ICBQYXJhbGxlbCBIYXNoIEpv aW4gIChjb3N0PTIzNjgyLjUxLi44NTI3Ni4zOCByb3dzPTExNjM3NTUgd2lkdGg9MTYpIChh Y3R1YWwgdGltZT0xNTguNzYwLi4yNDIuNDU1IHJvd3M9MTAzNjA2NiBsb29wcz0zKQogICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBI YXNoIENvbmQ6IChmb2xkZXJzLmV2ZW50X2lkID0gZXZlbnRzLmlkKQogICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxs ZWwgU2VxIFNjYW4gb24gZm9sZGVycyAgKGNvc3Q9MC4wMC4uNDAzMjEuMDcgcm93cz0xMzMx NzMwIHdpZHRoPTIwKSAoYWN0dWFsIHRpbWU9MC4wMDkuLjU4LjIxMSByb3dzPTEwNjQ3MDEg bG9vcHM9MykKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgRmlsdGVyOiAoKE5PVCBpc19kZWxldGVkKSBBTkQgKGxpbmtf dHlwZSA8PiAxKSkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgUm93cyBSZW1vdmVkIGJ5IEZpbHRlcjogNDQyNAogICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAt PiAgUGFyYWxsZWwgSGFzaCAgKGNvc3Q9MTQ1NzUuNTMuLjE0NTc1LjUzIHJvd3M9NTU1MDM5 IHdpZHRoPTQpIChhY3R1YWwgdGltZT00MC40MTMuLjQwLjQxOCByb3dzPTQ0NDM3MCBsb29w cz0zKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICBCdWNrZXRzOiAyNjIxNDQgIEJhdGNoZXM6IDE2ICBNZW1vcnkgVXNh Z2U6IDUzNDRrQgogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxsZWwgU2VxIFNjYW4gb24gZXZlbnRzICAo Y29zdD0wLjAwLi4xNDU3NS41MyByb3dzPTU1NTAzOSB3aWR0aD00KSAoYWN0dWFsIHRpbWU9 MC4wMDkuLjE5LjA5NSByb3dzPTQ0NDM3MCBsb29wcz0zKQogICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBGaWx0 ZXI6IChOT1QgaXNfZGVsZXRlZCkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgUm93cyBSZW1vdmVkIGJ5IEZp bHRlcjogNjM3NTIKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggIChjb3N0PTc2OTA3LjQ0Li43NjkwNy40NCBy b3dzPTMyNTQ5NSB3aWR0aD02KSAoYWN0dWFsIHRpbWU9MTE5LjE4Ny4uMTE5LjE5MCByb3dz PTE4NDQ0NyBsb29wcz0zKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICBCdWNrZXRzOiAyNjIxNDQgIEJhdGNoZXM6IDQgIE1lbW9y eSBVc2FnZTogODU3NmtCCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgIC0+ICBOZXN0ZWQgTG9vcCBMZWZ0IEpvaW4gIChjb3N0PTAu NDQuLjc2OTA3LjQ0IHJvd3M9MzI1NDk1IHdpZHRoPTYpIChhY3R1YWwgdGltZT0wLjAyNi4u MTA1LjI0MiByb3dzPTE4NDQ0NyBsb29wcz0zKQogICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxsZWwgU2Vx IFNjYW4gb24gc3ViY29udHJpYnV0aW9ucyAgKGNvc3Q9MC4wMC4uNjI5NC45NSByb3dzPTMy NTQ5NSB3aWR0aD05KSAoYWN0dWFsIHRpbWU9MC4wMDIuLjYuNzcxIHJvd3M9MTg0NDQ3IGxv b3BzPTMpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIC0+ICBNZW1vaXplICAoY29zdD0wLjQ0Li4wLjg0IHJvd3M9MSB3 aWR0aD01KSAoYWN0dWFsIHRpbWU9MC4wMDAuLjAuMDAwIHJvd3M9MSBsb29wcz01NTMzNDEp CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIENhY2hlIEtleTogc3ViY29udHJpYnV0aW9ucy5jb250cmlidXRp b25faWQKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgQ2FjaGUgTW9kZTogbG9naWNhbAogICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICBIaXRzOiAxMjM4OTQgIE1pc3NlczogNDQ0NjIgIEV2aWN0aW9uczogMCAgT3ZlcmZsb3dz OiAwICBNZW1vcnkgVXNhZ2U6IDQ2OTBrQgogICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBXb3JrZXIgMDogIEhp dHM6IDE0Mjc3MyAgTWlzc2VzOiA0OTQ0MiAgRXZpY3Rpb25zOiAwICBPdmVyZmxvd3M6IDAg IE1lbW9yeSBVc2FnZTogNTIxNWtCCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFdvcmtlciAxOiAgSGl0czog MTQyNDk2ICBNaXNzZXM6IDUwMjc0ICBFdmljdGlvbnM6IDAgIE92ZXJmbG93czogMCAgTWVt b3J5IFVzYWdlOiA1MzAza0IKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLT4gIEluZGV4IFNjYW4gdXNpbmcg cGtfY29udHJpYnV0aW9ucyBvbiBjb250cmlidXRpb25zIGNvbnRyaWJ1dGlvbnNfMSAgKGNv c3Q9MC40My4uMC44MyByb3dzPTEgd2lkdGg9NSkgKGFjdHVhbCB0aW1lPTAuMDAxLi4wLjAw MSByb3dzPTEgbG9vcHM9MTQ0MTc4KQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBJbmRleCBDb25k OiAoaWQgPSBzdWJjb250cmlidXRpb25zLmNvbnRyaWJ1dGlvbl9pZCkKICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggIChj b3N0PTU3MTUuOTguLjU3MTUuOTggcm93cz0yNDgzOTggd2lkdGg9NSkgKGFjdHVhbCB0aW1l PTIwLjY5Ny4uMjAuNjk4IHJvd3M9MTk4NzE5IGxvb3BzPTMpCiAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEJ1Y2tldHM6IDI2MjE0NCAgQmF0 Y2hlczogNCAgTWVtb3J5IFVzYWdlOiA3OTM2a0IKICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVsIFNlcSBTY2FuIG9uIHNl c3Npb25zICAoY29zdD0wLjAwLi41NzE1Ljk4IHJvd3M9MjQ4Mzk4IHdpZHRoPTUpIChhY3R1 YWwgdGltZT0wLjAwMy4uNy4xNjUgcm93cz0xOTg3MTkgbG9vcHM9MykKIFBsYW5uaW5nIFRp bWU6IDEuNDQ2IG1zCiBFeGVjdXRpb24gVGltZTogMTYxNTcxLjQwMCBtcwooNTIgcm93cykK --------------zhWm0qkt0B6ojMUAI0ll977p Content-Type: text/x-log; charset=UTF-8; name="15.log" Content-Disposition: attachment; filename="15.log" Content-Transfer-Encoding: base64 ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgUVVF UlkgUExBTiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0KIEZpbmFsaXplIEFnZ3JlZ2F0ZSAgKGNvc3Q9NDMzOTM4LjQwLi40MzM5 MzguNDEgcm93cz0xIHdpZHRoPTgpIChhY3R1YWwgdGltZT0xMzI0LjgwNS4uMTM4NC42OTQg cm93cz0xIGxvb3BzPTEpCiAgIC0+ICBHYXRoZXIgIChjb3N0PTQzMzkzOC4xOS4uNDMzOTM4 LjQwIHJvd3M9MiB3aWR0aD04KSAoYWN0dWFsIHRpbWU9MTMyMy43MTIuLjEzODQuNjkwIHJv d3M9MyBsb29wcz0xKQogICAgICAgICBXb3JrZXJzIFBsYW5uZWQ6IDIKICAgICAgICAgV29y a2VycyBMYXVuY2hlZDogMgogICAgICAgICAtPiAgUGFydGlhbCBBZ2dyZWdhdGUgIChjb3N0 PTQzMjkzOC4xOS4uNDMyOTM4LjIwIHJvd3M9MSB3aWR0aD04KSAoYWN0dWFsIHRpbWU9MTMy Mi40NDQuLjEzMjIuNDU1IHJvd3M9MSBsb29wcz0zKQogICAgICAgICAgICAgICAtPiAgUGFy YWxsZWwgSGFzaCBKb2luICAoY29zdD0zNDc4ODguMjkuLjQzMDkxOC41MyByb3dzPTgwNzg2 MSB3aWR0aD00KSAoYWN0dWFsIHRpbWU9MTEzNS44MzEuLjEyODcuODg2IHJvd3M9MTUyMzIz MiBsb29wcz0zKQogICAgICAgICAgICAgICAgICAgICBIYXNoIENvbmQ6IChhdHRhY2htZW50 cy5mb2xkZXJfaWQgPSBmb2xkZXJzLmlkKQogICAgICAgICAgICAgICAgICAgICAtPiAgUGFy YWxsZWwgU2VxIFNjYW4gb24gYXR0YWNobWVudHMgIChjb3N0PTAuMDAuLjU0Njg5LjYzIHJv d3M9MTk3NTA3NCB3aWR0aD04KSAoYWN0dWFsIHRpbWU9MC4wMTUuLjc0LjgyMSByb3dzPTE1 NzY2ODUgbG9vcHM9MykKICAgICAgICAgICAgICAgICAgICAgICAgICAgRmlsdGVyOiAoTk9U IGlzX2RlbGV0ZWQpCiAgICAgICAgICAgICAgICAgICAgICAgICAgIFJvd3MgUmVtb3ZlZCBi eSBGaWx0ZXI6IDMyNzc2NwogICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxsZWwgSGFz aCAgKGNvc3Q9MzM4OTE5LjQ1Li4zMzg5MTkuNDUgcm93cz01NDY2Mjcgd2lkdGg9NCkgKGFj dHVhbCB0aW1lPTk4OC45NzAuLjk4OC45Nzkgcm93cz0xMDMwNjMzIGxvb3BzPTMpCiAgICAg ICAgICAgICAgICAgICAgICAgICAgIEJ1Y2tldHM6IDI2MjE0NCAgQmF0Y2hlczogMTYgIE1l bW9yeSBVc2FnZTogOTY2NGtCCiAgICAgICAgICAgICAgICAgICAgICAgICAgIC0+ICBQYXJh bGxlbCBIYXNoIEpvaW4gIChjb3N0PTIyMjkzMC43OS4uMzM4OTE5LjQ1IHJvd3M9NTQ2NjI3 IHdpZHRoPTQpIChhY3R1YWwgdGltZT04NjIuNDM4Li45NDIuNTUwIHJvd3M9MTAzMDYzMyBs b29wcz0zKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBIYXNoIENvbmQ6IChm b2xkZXJzLmV2ZW50X2lkID0gZXZlbnRzLmlkKQogICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAtPiAgUGFyYWxsZWwgSGFzaCBMZWZ0IEpvaW4gIChjb3N0PTE5OTIxOC41Mi4u MzA2NTIyLjU1IHJvd3M9NjIzNDgyIHdpZHRoPTgpIChhY3R1YWwgdGltZT02NDcuMzg4Li43 NzQuMTMwIHJvd3M9MTA1ODEwOSBsb29wcz0zKQogICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICBIYXNoIENvbmQ6IChmb2xkZXJzLmNvbnRyaWJ1dGlvbl9pZCA9IGNv bnRyaWJ1dGlvbnMuaWQpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IEZpbHRlcjogKE5PVCBDT0FMRVNDRShzZXNzaW9ucy5pc19kZWxldGVkLCBjb250cmlidXRp b25zLmlzX2RlbGV0ZWQsIHN1YmNvbnRyaWJ1dGlvbnMuaXNfZGVsZXRlZCwgZmFsc2UpKQog ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBSb3dzIFJlbW92ZWQgYnkg RmlsdGVyOiA2NDM0CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0+ ICBQYXJhbGxlbCBIYXNoIExlZnQgSm9pbiAgKGNvc3Q9OTM5MDkuMjMuLjE3NTMxNC45OCBy b3dzPTEyNDY5NjQgd2lkdGg9MTQpIChhY3R1YWwgdGltZT0zNTEuMTM0Li40MDQuMzQyIHJv d3M9MTA2NDU0NCBsb29wcz0zKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICBIYXNoIENvbmQ6IChmb2xkZXJzLnNlc3Npb25faWQgPSBzZXNzaW9ucy5p ZCkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLT4gIFBh cmFsbGVsIEhhc2ggTGVmdCBKb2luICAoY29zdD04NDEyNi4yNy4uMTQ2NjczLjc0IHJvd3M9 MTI0Njk2NCB3aWR0aD0xNykgKGFjdHVhbCB0aW1lPTIxNy40NjYuLjI3OS44ODkgcm93cz0x MDY0NTQ0IGxvb3BzPTMpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIEhhc2ggQ29uZDogKGZvbGRlcnMuc3ViY29udHJpYnV0aW9uX2lkID0g c3ViY29udHJpYnV0aW9ucy5pZCkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgRmlsdGVyOiAoKGNvbnRyaWJ1dGlvbnNfMS5pc19kZWxldGVk IElTIE5VTEwpIE9SIChOT1QgY29udHJpYnV0aW9uc18xLmlzX2RlbGV0ZWQpKQogICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBSb3dzIFJlbW92 ZWQgYnkgRmlsdGVyOiAxNTcKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVsIFNlcSBTY2FuIG9uIGZvbGRlcnMgIChjb3N0 PTAuMDAuLjQwMjg5LjA3IHJvd3M9MTMzMTM3MyB3aWR0aD0yMCkgKGFjdHVhbCB0aW1lPTAu MDE2Li41OS4zMjIgcm93cz0xMDY0NzAxIGxvb3BzPTMpCiAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEZpbHRlcjogKChOT1QgaXNf ZGVsZXRlZCkgQU5EIChsaW5rX3R5cGUgPD4gMSkpCiAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFJvd3MgUmVtb3ZlZCBieSBGaWx0 ZXI6IDQ0MjQKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggIChjb3N0PTc4Nzg1LjU4Li43ODc4NS41OCByb3dz PTMyNTQ5NSB3aWR0aD02KSAoYWN0dWFsIHRpbWU9MTAzLjUzNS4uMTAzLjUzNiByb3dzPTE4 NDQ0NyBsb29wcz0zKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICBCdWNrZXRzOiAyNjIxNDQgIEJhdGNoZXM6IDQgIE1lbW9yeSBV c2FnZTogNzQ4OGtCCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIC0+ICBOZXN0ZWQgTG9vcCBMZWZ0IEpvaW4gIChjb3N0PTAuNDQu Ljc4Nzg1LjU4IHJvd3M9MzI1NDk1IHdpZHRoPTYpIChhY3R1YWwgdGltZT0wLjAzMC4uOTAu NTIwIHJvd3M9MTg0NDQ3IGxvb3BzPTMpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0+ICBQYXJhbGxlbCBTZXEgU2Nh biBvbiBzdWJjb250cmlidXRpb25zICAoY29zdD0wLjAwLi42MjQ2Ljk1IHJvd3M9MzI1NDk1 IHdpZHRoPTkpIChhY3R1YWwgdGltZT0wLjAwMi4uNi4yOTggcm93cz0xODQ0NDcgbG9vcHM9 MykKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgLT4gIE1lbW9pemUgIChjb3N0PTAuNDQuLjAuODQgcm93cz0xIHdpZHRo PTUpIChhY3R1YWwgdGltZT0wLjAwMC4uMC4wMDAgcm93cz0xIGxvb3BzPTU1MzM0MSkKICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgQ2FjaGUgS2V5OiBzdWJjb250cmlidXRpb25zLmNvbnRyaWJ1dGlvbl9p ZAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICBDYWNoZSBNb2RlOiBsb2dpY2FsCiAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEhp dHM6IDEzNTMzMyAgTWlzc2VzOiA0NzgxNyAgRXZpY3Rpb25zOiAwICBPdmVyZmxvd3M6IDAg IE1lbW9yeSBVc2FnZTogNDkwNGtCCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFdvcmtlciAwOiAgSGl0czog MTM2Mzg5ICBNaXNzZXM6IDQ4NDI2ICBFdmljdGlvbnM6IDAgIE92ZXJmbG93czogMCAgTWVt b3J5IFVzYWdlOiA0OTY2a0IKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgV29ya2VyIDE6ICBIaXRzOiAxMzcy NjggIE1pc3NlczogNDgxMDggIEV2aWN0aW9uczogMCAgT3ZlcmZsb3dzOiAwICBNZW1vcnkg VXNhZ2U6IDQ5MzNrQgogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtPiAgSW5kZXggU2NhbiB1c2luZyBwa19j b250cmlidXRpb25zIG9uIGNvbnRyaWJ1dGlvbnMgY29udHJpYnV0aW9uc18xICAoY29zdD0w LjQzLi4wLjgzIHJvd3M9MSB3aWR0aD01KSAoYWN0dWFsIHRpbWU9MC4wMDEuLjAuMDAxIHJv d3M9MSBsb29wcz0xNDQzNTEpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEluZGV4IENvbmQ6IChp ZCA9IHN1YmNvbnRyaWJ1dGlvbnMuY29udHJpYnV0aW9uX2lkKQogICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxsZWwgSGFzaCAgKGNvc3Q9 NTcwNi45OC4uNTcwNi45OCByb3dzPTI0ODM5OCB3aWR0aD01KSAoYWN0dWFsIHRpbWU9MTcu NjY3Li4xNy42Njcgcm93cz0xOTg3MTkgbG9vcHM9MykKICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgQnVja2V0czogMjYyMTQ0ICBCYXRjaGVz OiA0ICBNZW1vcnkgVXNhZ2U6IDc5MzZrQgogICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxsZWwgU2VxIFNjYW4gb24gc2Vzc2lv bnMgIChjb3N0PTAuMDAuLjU3MDYuOTggcm93cz0yNDgzOTggd2lkdGg9NSkgKGFjdHVhbCB0 aW1lPTAuMDAzLi43LjIyOSByb3dzPTE5ODcxOSBsb29wcz0zKQogICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAtPiAgUGFyYWxsZWwgSGFzaCAgKGNvc3Q9NjE0MzQu OTEuLjYxNDM0LjkxIHJvd3M9MjY3NDE5MSB3aWR0aD01KSAoYWN0dWFsIHRpbWU9MTg0LjEw OS4uMTg0LjEwOSByb3dzPTIxMzkzNTkgbG9vcHM9MykKICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgQnVja2V0czogMjYyMTQ0ICBCYXRjaGVzOiA2NCAg TWVtb3J5IFVzYWdlOiA2MDQ4a0IKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgLT4gIFBhcmFsbGVsIFNlcSBTY2FuIG9uIGNvbnRyaWJ1dGlvbnMgIChj b3N0PTAuMDAuLjYxNDM0LjkxIHJvd3M9MjY3NDE5MSB3aWR0aD01KSAoYWN0dWFsIHRpbWU9 MC4wMDkuLjgzLjk5NSByb3dzPTIxMzkzNTkgbG9vcHM9MykKICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVsIEhhc2ggIChjb3N0PTE0NTc1LjUzLi4xNDU3 NS41MyByb3dzPTU1Njg1OSB3aWR0aD00KSAoYWN0dWFsIHRpbWU9MzguODU1Li4zOC44NTUg cm93cz00NDQzNzAgbG9vcHM9MykKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgQnVja2V0czogMjYyMTQ0ICBCYXRjaGVzOiAxNiAgTWVtb3J5IFVzYWdlOiA1MzQ0 a0IKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLT4gIFBhcmFsbGVs IFNlcSBTY2FuIG9uIGV2ZW50cyAgKGNvc3Q9MC4wMC4uMTQ1NzUuNTMgcm93cz01NTY4NTkg d2lkdGg9NCkgKGFjdHVhbCB0aW1lPTAuMDA4Li4xOC44OTMgcm93cz00NDQzNzAgbG9vcHM9 MykKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgRmlsdGVy OiAoTk9UIGlzX2RlbGV0ZWQpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgIFJvd3MgUmVtb3ZlZCBieSBGaWx0ZXI6IDYzNzUyCiBQbGFubmluZyBUaW1l OiAxLjM1NCBtcwogRXhlY3V0aW9uIFRpbWU6IDEzODUuNDE0IG1zCig1MiByb3dzKQo= --------------zhWm0qkt0B6ojMUAI0ll977p--