[tahoe-lafs-trac-stream] [Tahoe-LAFS] #1581: Trac file uploads/attachments failing/corrupted

[Tahoe-LAFS]

#1581: Trac file uploads/attachments failing/corrupted
---------------------------------+-----------------------------------------
     Reporter:  warner           |      Owner:  zooko
         Type:  defect           |     Status:  assigned
     Priority:  normal           |  Milestone:  soon (release n/a)
    Component:  dev-             |    Version:  n/a
  infrastructure                 |   Keywords:  trac attachment nginx uwsgi
   Resolution:                   |
Launchpad Bug:                   |
---------------------------------+-----------------------------------------

Old description:

> Since the migration (and switching from Apache/mod_python to
> nginx/uwsgi), uploads of moderate-sized files are failing in weird ways.
> Small patches sometimes work, but larger patches fail in weird ways:
>
> * sirvaliance tried to upload a 600kB .png to #1185 and observed reported
> success, but the image was not present on the subsequent attachment list
> * warner tried to upload 900kB-1.1MB .jpg files to wiki:Summit2Day1 .
> Sometimes it failed with a !UnicodeDecodeError, sometimes with an nginx
> 413 Request Entity Too Large.
>
> Somebody needs to study the way that nginx invokes uwsgi with large
> request bodies. If it writes them to a file before handing them to uwsgi
> (seems unlikely), then it's conceivable that a file-permission/ownership
> problem is involved.
>
> I'm going to assign this one to Zooko, since he configured nginx/uwsgi on
> this box, and thus far is the only one who even begins to understand
> them.
>
> For now, I'm manually scp'ing files to tahoe-lafs.org and using 'trac-
> admin' to attach them to tickets.

New description:

 Since the migration (and switching from Apache/mod_python to nginx/uwsgi),
 uploads of moderate-sized files are failing in weird ways. Small patches
 sometimes work, but larger patches fail in weird ways:

 * sirvaliance tried to upload a 600kB .png to #1185 and observed reported
 success, but the image was not present on the subsequent attachment list
 * warner tried to upload 900kB-1.1MB .jpg files to wiki:Summit2Day1 .
 Sometimes it failed with a !UnicodeDecodeError, sometimes with an nginx
 413 Request Entity Too Large.

 Somebody needs to study the way that nginx invokes uwsgi with large
 request bodies. If it writes them to a file before handing them to uwsgi
 (seems unlikely), then it's conceivable that a file-permission/ownership
 problem is involved.

 I'm going to assign this one to Zooko, since he configured nginx/uwsgi on
 this box, and thus far is the only one who even begins to understand them.

 For now, I'm manually scp'ing files to tahoe-lafs.org and using 'trac-
 admin' to attach them to tickets.

--

Comment (by zooko):

 Possibly related: #2241

--
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1581#comment:15>
Tahoe-LAFS <https://Tahoe-LAFS.org>
secure decentralized storage