add windows dependencies to a sumo tarball (zip)

[WinLAFS]

add windows dependencies to sumo tarball it is mainly additional the binary .EGGs and Nevow-0.10.0.tar.gz i think the others are already in the sumo package

The additional files:

this is not in the sumo package:

Nevow-0.10.0.tar.gz pycrypto-2.4.1-py2.7-win32.egg pycrypto-2.5-py2.7-win-amd64.egg pycryptopp-0.6.0.1206569328141510525648634803928199668821045408958-py2.7-win-amd64.egg pycryptopp-0.6.0.1206569328141510525648634803928199668821045408958-py2.7-win32.egg pyOpenSSL-0.13.1-py2.7-win-amd64.egg pyOpenSSL-0.13.1-py2.7-win32.egg Twisted-12.1.0-py2.7-win-amd64.egg Twisted-12.1.0-py2.7-win32.egg zfec-1.4.22-py2.7-win-amd64.egg zfec-1.4.22-py2.7-win32.egg zope.interface-3.6.1-py2.7-win-amd64.egg zope.interface-3.6.1-py2.7-win32.egg

needed but already in the sumo package:

pyutil-1.9.4.tar.gz service_identity-14.0.0.tar.gz simplejson-3.1.3.tar.gz zbase32-1.1.5.tar.gz argparse-1.2.1.tar.gz characteristic-14.3.0.tar.gz foolscap-0.8.0.tar.gz mock-1.0.1.tar.gz pyasn1-0.1.6.tar.gz pyasn1-modules-0.0.5.tar.gz

[daira]

The options are: a) include these files even though they're not needed for non-Windows platforms; b) add separate sumo .zip files for Windows (one for 32-bit and one for 64-bit); c) document that using the sumo file doesn't help on Windows.

The files mentioned are 19,869,361 bytes in total, and the SUMO tarball is currently roughly 9,500,000 bytes. I guess that rules out option a) because the tarball would become 3 times bigger.

[daira]

For 1.10.1 I'm in favour of adding Nevow-0.10.0.tar.gz and Twisted-12.1.0.tar.gz to the tarball, but no binary eggs.

[daira]

... and documenting that using the SUMO doesn't necessarily avoid network access nor compilation.

[warner]

We've added Nevow-0.10 and Twisted-12.1.0 to the deps tarball, and they are present in the allmydata-tahoe-1.10.1b1.post2-SUMO tarballs (we added them after b1 was tagged). We also updated Twisted, so it has both Twisted-12.1.0 (for windows) and Twisted-15.2.1 (for everyone else).

I think the rule is still "a compiler and SUMO means you don't need access", even on windows, but who knows. For sure the (windows, SUMO, no compiler) triple is going to need network to fetch the eggs.

[daira]

Replying to warner:

We've added Nevow-0.10 and Twisted-12.1.0 to the deps tarball, and they are present in the allmydata-tahoe-1.10.1b1.post2-SUMO tarballs (we added them after b1 was tagged). We also updated Twisted, so it has both Twisted-12.1.0 (for windows) and Twisted-15.2.1 (for everyone else).

+1

I think the rule is still "a compiler and SUMO means you don't need access", even on windows, but who knows.

The build will look for eggs (and newer versions) regardless of what is available locally, and will use them if found. I think it's simpler to not claim anything about network access, TBH.

[warner]

We no longer provide the SUMO tarball, but we do host binary wheels (for mac and windows) for all dependencies, and the following command uses them instead of trying to compile anything:

pip install --find-links=https://tahoe-lafs.org/deps tahoe-lafs

I've added docs/desert-island.rst to explain how to build things without network access (by pre-fetching wheels and making sure they're in pip's wheel cache).

So I think we can close this one out now.