id	summary	reporter	owner	description	type	status	priority	milestone	component	version	resolution	keywords	cc	launchpad_bug
3274	NixOS CI job sometimes fails in Eliot test suite	exarkun	exarkun	"The NixOS CI job builds an Eliot package because Eliot isn't packaged in Nixpkgs.  Our Eliot expression involves running the Eliot test suite.  This is nice because it demonstrates Eliot is working as we have packaged it.  However it is not nice because there is an intermittent failure in the Eliot test suite.

{{{
======================================================================
FAIL: test_omitLoggerFromActionType (eliot.tests.test_validation.EndToEndValidationTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File ""/tmp/nix-build-python2.7-eliot-1.7.0.drv-0/eliot-1.7.0/eliot/tests/test_validation.py"", line 895, in test_omitLoggerFromActionType
    self.assertEqual(messages[0][""key""], 123)
AssertionError: 5 != 123

----------------------------------------------------------------------
}}}

This has been reported upstream - https://github.com/itamarst/eliot/issues/436 - but hasn't been fixed yet and may not receive much attention any time soon.

We could fix the upstream bug and update our packaging to include the fix.

We could skip the affected test when we run the Eliot test suite.
"	defect	closed	normal	undecided	unknown	n/a	fixed	review