[tahoe-lafs-trac-stream] [tahoe-lafs] #1572: migrate to new server

[tahoe-lafs]

#1572: migrate to new server
------------------------------------+--------------------------------
     Reporter:  warner              |      Owner:  somebody
         Type:  task                |     Status:  new
     Priority:  major               |  Milestone:  soon (release n/a)
    Component:  dev-infrastructure  |    Version:  n/a
   Resolution:                      |   Keywords:
Launchpad Bug:                      |
------------------------------------+--------------------------------

Old description:

> This ticket is to track the task of moving this Trac instance, and the
> mailing lists, etc, from the old original "org" box (currently in the
> Undisclosed Location) to the new linode-based "new-org" box.
>
> Remaining Tasks:
>
> * ~~get basic webserver running~~
> * ~~move Mailman, list archives, cgi-bin/mailman control panels~~
> * ~~update MX records to send tahoe-lafs.org mail to new box~~
> * copy all trac DBs/workdirs to new box
> * activate all trac instances on new box
> * copy all static content (tarballs, deps, debs, all sorts of random
> stuff)
> * ~~move source trees, canonical darcs repos~~
> * ~~get post-commit hooks working~~
> * get any cronjobs migrated
> * ~~move buildmaster~~, either get buildslave admins to update their
> configs, or wait for DNS to change
>  * ~~add "buildmaster.tahoe-lafs.org" DNS name (pointing at new-org)~~
>  * tell buildslave admins to point buildslaves at that
>  * meanwhile, old slaves will just use tahoe-lafs.org and work normally
> * ~~update DNS~~
> * power down old box, or move to Peter's basement for emergency access
> * ~~set up trac backup-to-git cronjob on new box~~
> * ~~get SSL cert fixed~~
> * ~~fix bitcoin-donation box on front page~~
> * ~~repopulate http://tahoe-lafs.org/source/tahoe-lafs/deps/tahoe-dep-
> sdists/~~
> * check other tahoe-deps directories
> * move the external (non-https) hosted images from the front page to the
> local server, to hush the mixed-content warning
> * ~~davidsarah noticed that the 'view tickets' link in the nav bar is
> broken.. it points to {{{https://tahoe-lafs.org/trac/tahoe-lafs//tahoe-
> lafs.org/trac/tahoe-lafs/wiki/ViewTickets}}}~~
> * some buildslaves are failing to do darcs fetches. A local 'wget' of the
> inventory file (on my OS-X 10.6 box) complained about not being able to
> verify the cert. related?
>  * hypothesis is that the old darcs on those boxes is treating HTTPS urls
> as if they were HTTP, and then failing with the http->https redirect.
> tcpdump shows one buildslave clearly fetching from port 80 despite being
> given an HTTPS URL
>  * ~~move those buildslaves to Unsupported~~
>  * zooko will mail the owners, ask them to update darcs
>  * later, move them back to Supported
> * ~~darcs pushes aren't showing up on the Trac timeline, although the
> buildbot sees them~~
>  * trac.db and all darcs-repo files need to be gid=source, and all
> committers must be in the 'source' group

New description:

 This ticket is to track the task of moving this Trac instance, and the
 mailing lists, etc, from the old original "org" box (currently in the
 Undisclosed Location) to the new linode-based "new-org" box.

 Remaining Tasks:

 * ~~get basic webserver running~~
 * ~~move Mailman, list archives, cgi-bin/mailman control panels~~
 * ~~update MX records to send tahoe-lafs.org mail to new box~~
 * copy all trac DBs/workdirs to new box
 * activate all trac instances on new box
 * copy all static content (tarballs, deps, debs, all sorts of random
 stuff)
 * ~~move source trees, canonical darcs repos~~
 * ~~get post-commit hooks working~~
 * get any cronjobs migrated
 * ~~move buildmaster~~, either get buildslave admins to update their
 configs, or wait for DNS to change
  * ~~add "buildmaster.tahoe-lafs.org" DNS name (pointing at new-org)~~
  * tell buildslave admins to point buildslaves at that
  * meanwhile, old slaves will just use tahoe-lafs.org and work normally
 * ~~update DNS~~
 * power down old box, or move to Peter's basement for emergency access
 * ~~set up trac backup-to-git cronjob on new box~~
 * ~~get SSL cert fixed~~
 * ~~fix bitcoin-donation box on front page~~
 * ~~repopulate http://tahoe-lafs.org/source/tahoe-lafs/deps/tahoe-dep-
 sdists/~~
 * check other tahoe-deps directories
 * move the external (non-https) hosted images from the front page to the
 local server, to hush the mixed-content warning
 * ~~davidsarah noticed that the 'view tickets' link in the nav bar is
 broken.. it points to {{{https://tahoe-lafs.org/trac/tahoe-lafs//tahoe-
 lafs.org/trac/tahoe-lafs/wiki/ViewTickets}}}~~
 * some buildslaves are failing to do darcs fetches. A local 'wget' of the
 inventory file (on my OS-X 10.6 box) complained about not being able to
 verify the cert. related?
  * hypothesis is that the old darcs on those boxes is treating HTTPS urls
 as if they were HTTP, and then failing with the http->https redirect.
 tcpdump shows one buildslave clearly fetching from port 80 despite being
 given an HTTPS URL
  * ~~move those buildslaves to Unsupported~~
  * zooko will mail the owners, ask them to update darcs
  * later, move them back to Supported
 * ~~darcs pushes aren't showing up on the Trac timeline, although the
 buildbot sees them~~
  * trac.db and all darcs-repo files need to be gid=source, and all
 committers must be in the 'source' group
 * bookmarks like http://tahoe-lafs.org/trac/tahoe no longer work (they get
 redirected to https://tahoe-lafs.org/trac/tahoe , but that gives a
 "Environment not found" error). This also happens for deeper URLs like
 http://tahoe-lafs.org/trac/tahoe/ticket/1572 . I think this needs to be
 rewritten to e.g. https://tahoe-lasf.org/trac/tahoe-lafs .

--

Comment (by warner):

 Add note about https://tahoe-lafs.org/trac/tahoe/ticket/1572 not working.

 Note: having "Tahoe-LAFS" be the full public name of the project is great
 (since "Tahoe" by itself is hard to search for), and having "tahoe-
 lafs.org" be the hostname for the project is great (because "tahoe.org" is
 probably owned by some car company or ski resort). But of course, when
 talking about it, we use just "tahoe" as an abbreviation. And I don't
 think it's necessary to make every single directory and URL component
 spell out the full name. There are a growing number of symlinks and URL
 rewriting rules to replace "tahoe" with "tahoe-lafs" on the web site, and
 I think those are going to eventually drive us completely insane. So let's
 avoid changing anything if we can, identify which URLs have been around
 the longest, and make them work without introducing new variants.

-- 
Ticket URL: <https://tahoe-lafs.org/trac/tahoe-lafs/ticket/1572#comment:17>
tahoe-lafs <https://tahoe-lafs.org>
secure decentralized storage