#1137 closed defect

test-from-egg and test-from-prefixdir are not testing the right code — at Version 1

Reported by: davidsarah Owned by: somebody
Priority: major Milestone: 1.8.1
Component: dev-infrastructure Version: 1.7.1
Keywords: test setuptools buildbot Cc:
Launchpad Bug:

Description (last modified by davidsarah)

The test-from-egg and test-from-prefixdir buildbot steps are supposed to be testing the same code that was built, but they may actually test a previous version that is installed in site-packages.

For example,

are supposed to be testing 1.7.1-r4600 on the ticket1074 branch, but are actually testing the 1.7.1 release.

Change History (1)

comment:1 Changed at 2010-07-26T22:43:23Z by davidsarah

  • Description modified (diff)

I wrote in the original description:

To detect this problem, we could have the commands that run these steps set an environment variable, say REQUIRED_TAHOE_VERSION, and then fail the tests if that is set and doesn't match allmydata.__version__.

Actually this wouldn't be enough. We're not just supposed to be testing the right version, we're supposed to be testing a specific egg or installation, so that we know that it is usable (not missing any needed files, for example). So we need to:

  1. Fail if the code we are testing is not loaded from the expected egg or prefix directory.
  2. Fail if the code in that directory is not the right Tahoe version. (Or, equivalently given that check 1 passes: fail if the code we are testing is not the right Tahoe version.)
  3. Run the tests in such a way that the preceding checks don't fail.

We should also consider checking constraints on the versions of our dependencies, but I think that's a separate ticket.

Note: See TracTickets for help on using tickets.