#2439 closed defect (fixed)

add windows dependencies to a sumo tarball (zip)

Reported by: WinLAFS Owned by: warner
Priority: normal Milestone: 1.11.0
Component: packaging Version: 1.10.0
Keywords: sumo tarball windows Cc: WinLAFS
Launchpad Bug:

Description

add windows dependencies to sumo tarball it is mainly additional the binary .EGGs and Nevow-0.10.0.tar.gz i think the others are already in the sumo package

The additional files:

this is not in the sumo package:

Nevow-0.10.0.tar.gz pycrypto-2.4.1-py2.7-win32.egg pycrypto-2.5-py2.7-win-amd64.egg pycryptopp-0.6.0.1206569328141510525648634803928199668821045408958-py2.7-win-amd64.egg pycryptopp-0.6.0.1206569328141510525648634803928199668821045408958-py2.7-win32.egg pyOpenSSL-0.13.1-py2.7-win-amd64.egg pyOpenSSL-0.13.1-py2.7-win32.egg Twisted-12.1.0-py2.7-win-amd64.egg Twisted-12.1.0-py2.7-win32.egg zfec-1.4.22-py2.7-win-amd64.egg zfec-1.4.22-py2.7-win32.egg zope.interface-3.6.1-py2.7-win-amd64.egg zope.interface-3.6.1-py2.7-win32.egg

needed but already in the sumo package:

pyutil-1.9.4.tar.gz service_identity-14.0.0.tar.gz simplejson-3.1.3.tar.gz zbase32-1.1.5.tar.gz argparse-1.2.1.tar.gz characteristic-14.3.0.tar.gz foolscap-0.8.0.tar.gz mock-1.0.1.tar.gz pyasn1-0.1.6.tar.gz pyasn1-modules-0.0.5.tar.gz

Change History (11)

comment:1 Changed at 2015-06-01T13:04:04Z by daira

  • Owner changed from WinLAFS to warner

comment:2 Changed at 2015-06-01T13:04:44Z by daira

  • Keywords windows release-blocker added; Windows removed
  • Priority changed from minor to major
  • Type changed from enhancement to defect

comment:3 Changed at 2015-06-01T13:24:16Z by daira

The options are: a) include these files even though they're not needed for non-Windows platforms; b) add separate sumo .zip files for Windows (one for 32-bit and one for 64-bit); c) document that using the sumo file doesn't help on Windows.

The files mentioned are 19,869,361 bytes in total, and the SUMO tarball is currently roughly 9,500,000 bytes. I guess that rules out option a) because the tarball would become 3 times bigger.

Last edited at 2015-06-01T13:31:32Z by daira (previous) (diff)

comment:4 Changed at 2015-06-01T13:24:29Z by daira

  • Keywords release-blocker removed

comment:5 Changed at 2015-06-01T13:27:01Z by daira

  • Milestone changed from 1.10.1 to undecided

comment:6 Changed at 2015-06-01T13:28:35Z by daira

  • Priority changed from major to normal

comment:7 Changed at 2015-06-10T10:56:50Z by daira

For 1.10.1 I'm in favour of adding Nevow-0.10.0.tar.gz and Twisted-12.1.0.tar.gz to the tarball, but no binary eggs.

comment:8 Changed at 2015-06-10T10:58:24Z by daira

... and documenting that using the SUMO doesn't necessarily avoid network access nor compilation.

Last edited at 2015-06-10T10:59:32Z by daira (previous) (diff)

comment:9 follow-up: Changed at 2015-06-10T17:31:42Z by warner

We've added Nevow-0.10 and Twisted-12.1.0 to the deps tarball, and they are present in the allmydata-tahoe-1.10.1b1.post2-SUMO tarballs (we added them after b1 was tagged). We also updated Twisted, so it has both Twisted-12.1.0 (for windows) and Twisted-15.2.1 (for everyone else).

I think the rule is still "a compiler and SUMO means you don't need access", even on windows, but who knows. For sure the (windows, SUMO, no compiler) triple is going to need network to fetch the eggs.

comment:10 in reply to: ↑ 9 Changed at 2015-06-11T14:17:36Z by daira

Replying to warner:

We've added Nevow-0.10 and Twisted-12.1.0 to the deps tarball, and they are present in the allmydata-tahoe-1.10.1b1.post2-SUMO tarballs (we added them after b1 was tagged). We also updated Twisted, so it has both Twisted-12.1.0 (for windows) and Twisted-15.2.1 (for everyone else).

+1

I think the rule is still "a compiler and SUMO means you don't need access", even on windows, but who knows.

The build will look for eggs (and newer versions) regardless of what is available locally, and will use them if found. I think it's simpler to not claim anything about network access, TBH.

comment:11 Changed at 2016-03-26T23:25:47Z by warner

  • Milestone changed from undecided to 1.11.0
  • Resolution set to fixed
  • Status changed from new to closed

We no longer provide the SUMO tarball, but we do host binary wheels (for mac and windows) for all dependencies, and the following command uses them instead of trying to compile anything:

pip install --find-links=https://tahoe-lafs.org/deps tahoe-lafs

I've added docs/desert-island.rst to explain how to build things without network access (by pre-fetching wheels and making sure they're in pip's wheel cache).

So I think we can close this one out now.

Note: See TracTickets for help on using tickets.