[tahoe-lafs-trac-stream] [Tahoe-LAFS] #4178: Intermittent 502 response from Trac

[Tahoe-LAFS]

#4178: Intermittent 502 response from Trac
--------------------------------+---------------------------
 Reporter:  btlogy              |          Owner:  meejah
     Type:  defect              |         Status:  new
 Priority:  normal              |      Milestone:  undecided
Component:  dev-infrastructure  |        Version:  n/a
 Keywords:                      |  Launchpad Bug:
--------------------------------+---------------------------
 As mentioned in #4176, some users have confirmed receiving the following
 answer from [https://tahoe-lafs.org/trac/tahoe-lafs/ Trac] intermittently:

 {{{
 502 Bad Gateway
 nginx/1.10.3 (Ubuntu)
 }}}

 Now the disk space issue has been fixed, it seems like refreshing the page
 usually works around this 502 problem.

 However, as the checks from the Upttime monitoring seems to show, there
 are cases where a user could not get a proper answer from the server even
 after 3 retries!

 Here are the details about the incidents reported for yesterday 20th of
 May:
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/424 Wiki
 is down at 07:27 UTC #424]
 {{{
 Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki
 Current status wiki up 2025-02-27T09:34:01.873Z
 Result from test 502 0.028272
 Result from test 502 0.016042
 Result from test 502 0.016079
 }}}
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/425 Web is
 down at 08:06 UTC #425]
 {{{
 Checking https://www.tahoe-lafs.org/
 Current status web up 2025-02-27T09:33:58.812Z
 Result from test 502 1.064882
 Result from test 502 0.13437
 Result from test 502 0.13468
 }}}
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/426 Wiki
 is down at 08:21 UTC #426]
 {{{
 Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki
 Current status wiki up 2025-02-27T09:34:01.873Z
 Result from test 502 0.169718
 Result from test 502 0.131224
 Result from test 502 0.094317
 }}}
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/427 Wiki
 is down at 10:22 UTC #427]
 {{{
 Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
 Current status wiki up 2025-02-27T09:34:01.873Z
 Result from test 502 0.063878
 Result from test 502 0.063225
 Result from test 502 0.07016
 }}}
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/428
 Tickets is down at 10:56 UTC #428]
 {{{
 Checking https://tahoe-lafs.org/trac/tahoe-lafs/query
 Current status tickets up 2025-02-27T09:34:00.432Z
 Result from test 502 0.652738
 Result from test 502 0.068121
 Result from test 502 0.068075
 }}}
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/429 Wiki
 is down at 18:06 UTC #429]
 {{{
 Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
 Current status wiki up 2025-02-27T09:34:01.873Z
 Result from test 502 0.05107
 Result from test 502 0.050887
 Result from test 502 0.050857
 }}}
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/430 Web is
 down at 20:21 UTC #430]
 {{{
 Checking https://www.tahoe-lafs.org/
 Current status web up 2025-02-27T09:33:58.812Z
 Result from test 502 1.079979
 Result from test 502 0.031663
 Result from test 502 0.031868
 }}}
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/431 Wiki
 is down at 20:34 UTC #431]
 {{{
 Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
 Current status wiki down 2025-02-27T09:34:01.873Z
 Result from test 502 0.079088
 Result from test 502 0.065165
 Result from test 502 0.079371
 }}}
 - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/432 Web is
 down at 21:01 UTC #432]
 {{{
 Checking https://www.tahoe-lafs.org/
 Current status web up 2025-02-27T09:33:58.812Z
 Result from test 502 1.622923
 Result from test 502 0.106893
 Result from test 502 0.160037
 }}}

 There are likely more cases which have not raised incident like the
 following one where one of the retries get the proper answer:

 {{{
 Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
 Current status wiki down 2025-02-27T09:34:01.873Z
 Result from test 502 0.083277
 Result from test 502 0.097025
 Result from test 200 13.603759
 }}}

 Hopefully those timestamp could help to spot the root cause in the logs of
 the server.

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/4178>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage