[tahoe-lafs-trac-stream] [Tahoe-LAFS] #4178: Intermittent 502 response from Trac
Tahoe-LAFS
trac at tahoe-lafs.org
Thu May 22 06:58:42 UTC 2025
#4178: Intermittent 502 response from Trac
------------------------------------+-----------------------
Reporter: btlogy | Owner:
Type: defect | Status: new
Priority: normal | Milestone: undecided
Component: dev-infrastructure | Version: n/a
Resolution: | Keywords:
Launchpad Bug: |
------------------------------------+-----------------------
Description changed by btlogy:
Old description:
> As mentioned in #4176, some users have confirmed receiving the following
> answer from [https://tahoe-lafs.org/trac/tahoe-lafs/ Trac]
> intermittently:
>
> {{{
> 502 Bad Gateway
> nginx/1.10.3 (Ubuntu)
> }}}
>
> Now the disk space issue has been fixed, it seems like refreshing the
> page usually works around this 502 problem.
>
> However, as the checks from the Upttime monitoring seems to show, there
> are cases where a user could not get a proper answer from the server even
> after 3 retries!
>
> Here are the details about the incidents reported for yesterday 20th of
> May:
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/424 Wiki
> is down at 07:27 UTC #424]
> {{{
> Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki
> Current status wiki up 2025-02-27T09:34:01.873Z
> Result from test 502 0.028272
> Result from test 502 0.016042
> Result from test 502 0.016079
> }}}
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/425 Web
> is down at 08:06 UTC #425]
> {{{
> Checking https://www.tahoe-lafs.org/
> Current status web up 2025-02-27T09:33:58.812Z
> Result from test 502 1.064882
> Result from test 502 0.13437
> Result from test 502 0.13468
> }}}
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/426 Wiki
> is down at 08:21 UTC #426]
> {{{
> Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki
> Current status wiki up 2025-02-27T09:34:01.873Z
> Result from test 502 0.169718
> Result from test 502 0.131224
> Result from test 502 0.094317
> }}}
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/427 Wiki
> is down at 10:22 UTC #427]
> {{{
> Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
> Current status wiki up 2025-02-27T09:34:01.873Z
> Result from test 502 0.063878
> Result from test 502 0.063225
> Result from test 502 0.07016
> }}}
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/428
> Tickets is down at 10:56 UTC #428]
> {{{
> Checking https://tahoe-lafs.org/trac/tahoe-lafs/query
> Current status tickets up 2025-02-27T09:34:00.432Z
> Result from test 502 0.652738
> Result from test 502 0.068121
> Result from test 502 0.068075
> }}}
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/429 Wiki
> is down at 18:06 UTC #429]
> {{{
> Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
> Current status wiki up 2025-02-27T09:34:01.873Z
> Result from test 502 0.05107
> Result from test 502 0.050887
> Result from test 502 0.050857
> }}}
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/430 Web
> is down at 20:21 UTC #430]
> {{{
> Checking https://www.tahoe-lafs.org/
> Current status web up 2025-02-27T09:33:58.812Z
> Result from test 502 1.079979
> Result from test 502 0.031663
> Result from test 502 0.031868
> }}}
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/431 Wiki
> is down at 20:34 UTC #431]
> {{{
> Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
> Current status wiki down 2025-02-27T09:34:01.873Z
> Result from test 502 0.079088
> Result from test 502 0.065165
> Result from test 502 0.079371
> }}}
> - [https://tahoe-lafs.github.io/infrastructure-upptime/incident/432 Web
> is down at 21:01 UTC #432]
> {{{
> Checking https://www.tahoe-lafs.org/
> Current status web up 2025-02-27T09:33:58.812Z
> Result from test 502 1.622923
> Result from test 502 0.106893
> Result from test 502 0.160037
> }}}
>
> There are likely more cases which have not raised incident like the
> following one where one of the retries get the proper answer:
>
> {{{
> Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
> Current status wiki down 2025-02-27T09:34:01.873Z
> Result from test 502 0.083277
> Result from test 502 0.097025
> Result from test 200 13.603759
> }}}
>
> Hopefully those timestamp could help to spot the root cause in the logs
> of the server.
New description:
As mentioned in #4176, some users have confirmed receiving the following
answer from [https://tahoe-lafs.org/trac/tahoe-lafs/ Trac] intermittently:
{{{
502 Bad Gateway
nginx/1.10.3 (Ubuntu)
}}}
Now the disk space issue has been fixed, it seems like refreshing the page
usually works around this 502 problem.
However, as the checks from the Upttime monitoring seems to show, there
are cases where a user could not get a proper answer from the server even
after 3 retries!
Here are the details about the incidents reported for yesterday 20th of
May:
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/424 Wiki
is down at 07:27 UTC #424]
{{{
Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki
Result from test 502 0.028272
Result from test 502 0.016042
Result from test 502 0.016079
}}}
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/425 Web is
down at 08:06 UTC #425]
{{{
Checking https://www.tahoe-lafs.org/
Result from test 502 1.064882
Result from test 502 0.13437
Result from test 502 0.13468
}}}
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/426 Wiki
is down at 08:21 UTC #426]
{{{
Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki
Result from test 502 0.169718
Result from test 502 0.131224
Result from test 502 0.094317
}}}
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/427 Wiki
is down at 10:22 UTC #427]
{{{
Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
Result from test 502 0.063878
Result from test 502 0.063225
Result from test 502 0.07016
}}}
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/428
Tickets is down at 10:56 UTC #428]
{{{
Checking https://tahoe-lafs.org/trac/tahoe-lafs/query
Result from test 502 0.652738
Result from test 502 0.068121
Result from test 502 0.068075
}}}
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/429 Wiki
is down at 18:06 UTC #429]
{{{
Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
Result from test 502 0.05107
Result from test 502 0.050887
Result from test 502 0.050857
}}}
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/430 Web is
down at 20:21 UTC #430]
{{{
Checking https://www.tahoe-lafs.org/
Result from test 502 1.079979
Result from test 502 0.031663
Result from test 502 0.031868
}}}
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/431 Wiki
is down at 20:34 UTC #431]
{{{
Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
Result from test 502 0.079088
Result from test 502 0.065165
Result from test 502 0.079371
}}}
- [https://tahoe-lafs.github.io/infrastructure-upptime/incident/432 Web is
down at 21:01 UTC #432]
{{{
Checking https://www.tahoe-lafs.org/
Result from test 502 1.622923
Result from test 502 0.106893
Result from test 502 0.160037
}}}
There are likely more cases which have not raised incident like the
following one where one of the retries get the proper answer:
{{{
Checking https://tahoe-lafs.org/trac/tahoe-lafs/wiki/TitleIndex
Result from test 502 0.083277
Result from test 502 0.097025
Result from test 200 13.603759
}}}
Hopefully those timestamps could help to spot the root cause in the logs
of the server.
--
--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/4178#comment:2>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage
More information about the tahoe-lafs-trac-stream
mailing list