"leap test" fails without clear reason
leap_platform: latest develop, with latest master merged leap_cli: latest develop test environment: testbot@greyhound:~/rewire_develop/rewire
testbot@greyhound:~/rewire_develop/rewire$ leap_develop test E, [2014-08-29T14:46:05.390553 #26891] ERROR -- net.ssh.authentication.agent[1ae43d0]: could not connect to ssh-agent = [rewdevmonitor1.rewire.org] PASS: Network > Can connect to internet? = [rewdevmonitor1.rewire.org] PASS: Network > Is stunnel running? = [rewdevmonitor1.rewire.org] PASS: Network > Is shorewall running? = [rewdevmonitor1.rewire.org] 3 tests: 3 passes, 0 skips, 0 warnings, 0 failures, 0 errors E, [2014-08-29T14:46:05.784902 #26891] ERROR -- net.ssh.authentication.agent[196b2d8]: could not connect to ssh-agent = [rewdevcouch2.rewire.org] PASS: Network > Can connect to internet? = [rewdevcouch2.rewire.org] PASS: Network > Is stunnel running? = [rewdevcouch2.rewire.org] PASS: Network > Is shorewall running? = [rewdevcouch2.rewire.org] PASS: CouchDB > Are daemons running? = [rewdevcouch2.rewire.org] PASS: CouchDB > Is CouchDB running? = [rewdevcouch2.rewire.org] PASS: CouchDB > Is cluster membership ok? = [rewdevcouch2.rewire.org] PASS: CouchDB > Are configured nodes online? = [rewdevcouch2.rewire.org] PASS: CouchDB > Do ACL users exist? = [rewdevcouch2.rewire.org] PASS: CouchDB > Do required databases exist? = [rewdevcouch2.rewire.org] WARN: CouchDB > assert auth fail: = [rewdevcouch2.rewire.org] Expected a '401 Unauthorized' response, but got 200 instead (GET /users/_all_docs with username 'leap_mx'). = [rewdevcouch2.rewire.org] WARN: CouchDB > assert auth fail: = [rewdevcouch2.rewire.org] Expected a '401 Unauthorized' response, but got 200 instead (GET /users/_all_docs with username 'leap_mx'). = [rewdevcouch2.rewire.org] PASS: CouchDB > What? = [rewdevcouch2.rewire.org] 11 tests: 10 passes, 0 skips, 2 warnings, 0 failures, 0 errors Capistrano::CommandError: failed: "sh -c '/srv/leap/bin/run_tests'" on rewdevcouch2.rewire.org testbot@greyhound:~/rewire_develop/rewire$ echo $? 0 testbot@greyhound:~/rewire_develop/rewire$ leap_develop test --continue E, [2014-08-29T14:47:03.011415 #26961] ERROR -- net.ssh.authentication.agent[fb5d88]: could not connect to ssh-agent = [rewdevmonitor1.rewire.org] PASS: Network > Can connect to internet? = [rewdevmonitor1.rewire.org] PASS: Network > Is stunnel running? = [rewdevmonitor1.rewire.org] PASS: Network > Is shorewall running? = [rewdevmonitor1.rewire.org] 3 tests: 3 passes, 0 skips, 0 warnings, 0 failures, 0 errors E, [2014-08-29T14:47:03.401393 #26961] ERROR -- net.ssh.authentication.agent[e3c3a8]: could not connect to ssh-agent = [rewdevcouch2.rewire.org] PASS: Network > Can connect to internet? = [rewdevcouch2.rewire.org] PASS: Network > Is stunnel running? = [rewdevcouch2.rewire.org] PASS: Network > Is shorewall running? = [rewdevcouch2.rewire.org] PASS: CouchDB > Are daemons running? = [rewdevcouch2.rewire.org] PASS: CouchDB > Is CouchDB running? = [rewdevcouch2.rewire.org] PASS: CouchDB > Is cluster membership ok? = [rewdevcouch2.rewire.org] PASS: CouchDB > Are configured nodes online? = [rewdevcouch2.rewire.org] PASS: CouchDB > Do ACL users exist? = [rewdevcouch2.rewire.org] PASS: CouchDB > Do required databases exist? = [rewdevcouch2.rewire.org] WARN: CouchDB > assert auth fail: = [rewdevcouch2.rewire.org] Expected a '401 Unauthorized' response, but got 200 instead (GET /users/_all_docs with username 'leap_mx'). = [rewdevcouch2.rewire.org] WARN: CouchDB > assert auth fail: = [rewdevcouch2.rewire.org] Expected a '401 Unauthorized' response, but got 200 instead (GET /users/_all_docs with username 'leap_mx'). = [rewdevcouch2.rewire.org] PASS: CouchDB > What? = [rewdevcouch2.rewire.org] 11 tests: 10 passes, 0 skips, 2 warnings, 0 failures, 0 errors Capistrano::CommandError: failed: "sh -c '/srv/leap/bin/run_tests --continue'" on rewdevcouch2.rewire.org testbot@greyhound:~/rewire_develop/rewire$ echo $? 0
on top of failing, it returns 0 as exit code
(from redmine: created on 2014-08-29, closed on 2014-12-10, relates #6028 (closed))