| openstackrecheck | openstack/cinder change: https://review.openstack.org/49088 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 00:11 |
|---|---|---|
| openstackrecheck | openstack/keystone change: https://review.openstack.org/48988 failed tempest with an unrecognized error | 00:14 |
| openstackrecheck | openstack/python-novaclient change: https://review.openstack.org/49050 failed tempest with an unrecognized error | 00:15 |
| openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/48471 failed tempest with an unrecognized error | 00:16 |
| *** rhsu1 has quit IRC | 00:22 | |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/48880 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 00:32 |
| *** nosnos has joined #openstack-qa | 00:50 | |
| *** anteaya has quit IRC | 00:56 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/47030 failed tempest because of: https://bugs.launchpad.net/bugs/1218391 | 00:59 |
| *** rockyg has quit IRC | 01:01 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49079 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 01:32 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48953 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 01:32 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49073 failed tempest with an unrecognized error | 01:33 |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/48575 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 01:41 |
| *** rockyg has joined #openstack-qa | 01:54 | |
| *** sthaha has joined #openstack-qa | 02:03 | |
| *** rhsu has joined #openstack-qa | 02:12 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Default to the ML2 plugin in Neutron instead of OVS https://review.openstack.org/47837 | 02:22 |
| openstackrecheck | openstack/swift change: https://review.openstack.org/48608 failed tempest because of: https://bugs.launchpad.net/bugs/1211915 | 02:39 |
| *** dims has quit IRC | 02:40 | |
| *** rhsu has quit IRC | 02:45 | |
| openstackgerrit | Ivan-Zhu proposed a change to openstack/tempest: meta should be metadata in rebuild server https://review.openstack.org/48906 | 03:10 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48931 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 03:15 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48455 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 03:15 |
| *** DennyZhang has joined #openstack-qa | 03:20 | |
| *** prekarat has joined #openstack-qa | 03:20 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/47720 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 03:26 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48930 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 03:58 |
| *** DennyZhang has quit IRC | 04:08 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48841 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 04:12 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48170 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 04:12 |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/48872 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 04:18 |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tempest: introduces skipBecause decorator https://review.openstack.org/48121 | 04:19 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/49097 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 04:27 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48906 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 04:27 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/49100 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 04:28 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48904 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 04:34 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48460 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 04:34 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/48968 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 04:34 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/48382 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 04:38 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/47339 failed tempest with an unrecognized error | 04:49 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48220 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 04:55 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/47348 failed tempest with an unrecognized error | 04:56 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/47816 failed tempest with an unrecognized error | 04:57 |
| *** ken1ohmichi has joined #openstack-qa | 05:05 | |
| *** afazekas has quit IRC | 05:05 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48121 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 05:07 |
| *** SergeyLukjanov has joined #openstack-qa | 05:08 | |
| ken1ohmichi | hi | 05:11 |
| ken1ohmichi | somebody know whether tempest is in FF now? | 05:11 |
| ken1ohmichi | we got a question about FF at https://review.openstack.org/#/c/48841/ | 05:12 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/41345 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 05:13 |
| *** SergeyLukjanov has quit IRC | 05:14 | |
| *** SergeyLukjanov has joined #openstack-qa | 05:15 | |
| *** jlibosva has joined #openstack-qa | 05:18 | |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/48770 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 05:18 |
| *** afazekas has joined #openstack-qa | 05:35 | |
| *** afazekas is now known as afazekas_no_irq | 05:49 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/43621 failed tempest because of: https://bugs.launchpad.net/bugs/1218391 | 05:49 |
| * afazekas_no_irq trying to reproduce the neutron issue | 05:49 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/47434 failed tempest because of: https://bugs.launchpad.net/bugs/1217734 | 05:50 |
| openstackrecheck | openstack/swift change: https://review.openstack.org/48863 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 06:04 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48220 failed tempest with an unrecognized error | 06:06 |
| *** Madan has joined #openstack-qa | 06:08 | |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/48382 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 06:14 |
| *** SergeyLukjanov has quit IRC | 06:15 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49103 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 06:31 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49104 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 06:32 |
| openstackgerrit | nayna-patel proposed a change to openstack/tempest: Adds "list hosts" test case - Cinder https://review.openstack.org/48933 | 06:32 |
| openstackrecheck | openstack/swift change: https://review.openstack.org/48954 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 06:32 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/48720 failed tempest because of: https://bugs.launchpad.net/bugs/1217734 | 06:37 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48170 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 06:38 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49073 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 06:45 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/49019 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 06:51 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/48116 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 07:08 |
| *** dkorn has joined #openstack-qa | 07:11 | |
| *** salv-orlando has joined #openstack-qa | 07:15 | |
| *** SergeyLukjanov has joined #openstack-qa | 07:18 | |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/46193 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 07:22 |
| openstackrecheck | openstack/glance change: https://review.openstack.org/27091 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 07:30 |
| *** jhenner has joined #openstack-qa | 07:30 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48205 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 07:41 |
| *** fbo_away is now known as fbo | 07:42 | |
| *** dkorn has quit IRC | 07:47 | |
| *** mkollaro has joined #openstack-qa | 07:57 | |
| *** dkorn has joined #openstack-qa | 08:03 | |
| *** salv-orlando has quit IRC | 08:05 | |
| *** dkorn has quit IRC | 08:10 | |
| *** yassine has joined #openstack-qa | 08:11 | |
| *** jhenner has quit IRC | 08:13 | |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/47942 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 08:14 |
| *** dkorn has joined #openstack-qa | 08:19 | |
| *** gfidente has joined #openstack-qa | 08:30 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48933 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 08:34 |
| openstackgerrit | Ivan-Zhu proposed a change to openstack/tempest: meta should be metadata in rebuild server https://review.openstack.org/48906 | 08:37 |
| *** jhenner has joined #openstack-qa | 08:42 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48326 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 08:45 |
| *** tkammer has joined #openstack-qa | 08:45 | |
| openstackrecheck | openstack/heat change: https://review.openstack.org/48778 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 08:46 |
| openstackrecheck | openstack/glance change: https://review.openstack.org/42640 failed tempest with an unrecognized error | 08:50 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/47969 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 09:12 |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/48898 failed tempest because of: https://bugs.launchpad.net/bugs/1218391 | 09:15 |
| *** ken1ohmichi has quit IRC | 09:19 | |
| *** dosaboy has quit IRC | 09:22 | |
| *** dosaboy has joined #openstack-qa | 09:22 | |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/49064 failed tempest because of: https://bugs.launchpad.net/bugs/1218391 | 09:42 |
| *** kavan has joined #openstack-qa | 09:50 | |
| *** kavan has quit IRC | 09:51 | |
| *** prekarat has quit IRC | 09:52 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49083 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 09:58 |
| *** kong has joined #openstack-qa | 10:04 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49103 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 10:05 |
| openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/48673 failed tempest with an unrecognized error | 10:07 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49032 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 10:08 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/49105 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 10:11 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/48382 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 10:12 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48952 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 10:13 |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/49107 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 10:16 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49073 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 10:16 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49075 failed tempest with an unrecognized error | 10:17 |
| Anju | afazekas_no_irq: ping | 10:17 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49074 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 10:17 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48935 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 10:17 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49079 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 10:18 |
| kong | Anju, ping | 10:21 |
| *** SergeyLukjanov has quit IRC | 10:25 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48455 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 10:26 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48906 failed tempest with an unrecognized error | 10:27 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48326 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 10:27 |
| *** SergeyLukjanov has joined #openstack-qa | 10:27 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48933 failed tempest because of: https://bugs.launchpad.net/bugs/1218391 | 10:28 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/45596 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 10:29 |
| *** Madan has quit IRC | 10:30 | |
| openstackrecheck | openstack/glance change: https://review.openstack.org/46279 failed tempest because of: https://bugs.launchpad.net/bugs/1211915 | 10:45 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/48880 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 10:47 |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/48971 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 10:56 |
| openstackrecheck | openstack/swift change: https://review.openstack.org/43476 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 10:57 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/49019 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 10:57 |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/49107 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 11:02 |
| *** dkorn has quit IRC | 11:14 | |
| *** dims has joined #openstack-qa | 11:18 | |
| *** nosnos has quit IRC | 11:33 | |
| *** matsuhashi has quit IRC | 11:37 | |
| *** yassine_ has joined #openstack-qa | 11:52 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48570 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 11:52 |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/48911 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 11:53 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48460 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 11:53 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48935 failed tempest with an unrecognized error | 11:54 |
| *** yassine has quit IRC | 11:56 | |
| openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: Revert "Enable tenant isolation to tempest for neutron" https://review.openstack.org/49143 | 11:59 |
| *** dkranz has joined #openstack-qa | 12:01 | |
| *** jhenner has quit IRC | 12:01 | |
| *** jhenner1 has joined #openstack-qa | 12:01 | |
| *** mkollaro1 has joined #openstack-qa | 12:01 | |
| *** mkollaro has quit IRC | 12:01 | |
| *** jhenner1 has quit IRC | 12:02 | |
| *** jhenner has joined #openstack-qa | 12:02 | |
| *** tkammer has quit IRC | 12:03 | |
| *** dims has quit IRC | 12:07 | |
| *** dims has joined #openstack-qa | 12:08 | |
| *** Anju has quit IRC | 12:08 | |
| *** mriedem has joined #openstack-qa | 12:15 | |
| kong | is David Kranzhere? | 12:19 |
| *** tkammer has joined #openstack-qa | 12:22 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48952 failed tempest because of: https://bugs.launchpad.net/bugs/1218391 | 12:23 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/48413 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 12:26 |
| *** jasondot_ has joined #openstack-qa | 12:28 | |
| *** rfolco has joined #openstack-qa | 12:32 | |
| openstackrecheck | openstack/glance change: https://review.openstack.org/49009 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 12:36 |
| openstackrecheck | openstack/glance change: https://review.openstack.org/48943 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 12:40 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49139 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 12:41 |
| openstackrecheck | openstack/glance change: https://review.openstack.org/46117 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 12:42 |
| openstackgerrit | Zhu Zhu proposed a change to openstack/tempest: Test for the nova diagnostics API https://review.openstack.org/48249 | 12:45 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49103 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 12:49 |
| openstackgerrit | Bob Ball proposed a change to openstack-dev/devstack: XenAPI: Get pool default SR rather than "Local storage" https://review.openstack.org/48866 | 12:49 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48935 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 12:49 |
| openstackrecheck | openstack/python-novaclient change: https://review.openstack.org/48406 failed tempest with an unrecognized error | 12:56 |
| *** dkorn has joined #openstack-qa | 12:58 | |
| *** rockyg has quit IRC | 13:02 | |
| *** mkollaro has joined #openstack-qa | 13:03 | |
| *** weshay has joined #openstack-qa | 13:04 | |
| *** anteaya has joined #openstack-qa | 13:04 | |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/47542 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 13:05 |
| *** jasondot_ has quit IRC | 13:06 | |
| *** mkollaro1 has quit IRC | 13:07 | |
| *** jhenner has quit IRC | 13:07 | |
| openstackgerrit | A change was merged to openstack-dev/devstack: Revert "Enable tenant isolation to tempest for neutron" https://review.openstack.org/49143 | 13:08 |
| *** adalbas has joined #openstack-qa | 13:10 | |
| *** jasondot_ has joined #openstack-qa | 13:12 | |
| *** yassine has joined #openstack-qa | 13:15 | |
| *** yassine_ has quit IRC | 13:19 | |
| *** jhenner has joined #openstack-qa | 13:20 | |
| dims | jog0, sdague - managed to get some info on the simultaneous read/write - looks like rpc and http calls are tripping over each other - added comments here - https://bugs.launchpad.net/oslo/+bug/1229475/comments/9 | 13:24 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/45596 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 13:24 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/47984 failed tempest with an unrecognized error | 13:25 |
| *** jasondot_ has quit IRC | 13:30 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48249 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 13:33 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/48866 failed tempest with an unrecognized error | 13:34 |
| *** tkammer has quit IRC | 13:47 | |
| *** dkranz has quit IRC | 13:47 | |
| openstackrecheck | openstack/swift change: https://review.openstack.org/48990 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 13:58 |
| *** tkammer has joined #openstack-qa | 14:01 | |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some tests for aggregate https://review.openstack.org/49157 | 14:03 |
| *** Anju has joined #openstack-qa | 14:06 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48935 failed tempest with an unrecognized error | 14:12 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49104 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 14:13 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/48413 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 14:13 |
| *** mkoderer has quit IRC | 14:15 | |
| *** Anju has quit IRC | 14:16 | |
| openstackgerrit | Zhu Zhu proposed a change to openstack/tempest: Test for the nova diagnostics API https://review.openstack.org/48249 | 14:29 |
| openstackrecheck | openstack/glance change: https://review.openstack.org/49029 failed tempest with an unrecognized error | 14:34 |
| openstackgerrit | A change was merged to openstack/tempest: Add tempest tests for os-aggregate update https://review.openstack.org/47720 | 14:41 |
| *** Anju has joined #openstack-qa | 14:41 | |
| *** tkammer has quit IRC | 14:43 | |
| *** tkammer has joined #openstack-qa | 14:44 | |
| giulivo | mtreinish, thanks for reviewing that stuff | 14:44 |
| giulivo | I thought you were going to ask me for some marriage | 14:44 |
| openstackgerrit | A change was merged to openstack/tempest: Make smoketests working again with Python 2.6/nose https://review.openstack.org/48930 | 14:46 |
| openstackgerrit | A change was merged to openstack/tempest: unskipping bug related to test_stamp_pattern.py https://review.openstack.org/47434 | 14:46 |
| mtreinish | sdague: ^^^ here comes another race... | 14:48 |
| sdague | mtreinish: yeh, though I wonder if the cinder fix will actually handle that one now | 14:49 |
| mriedem | sdague: mean mriedem? | 14:51 |
| mriedem | oh, nm | 14:51 |
| sdague | no, for once I got my matts right :) | 14:51 |
| mtreinish | mriedem: heh | 14:51 |
| mtreinish | sdague: it might, I thought that other volume attach race was related to the stamp_pattern fail | 14:52 |
| *** jasondot_ has joined #openstack-qa | 14:54 | |
| sdague | mtreinish: is elastic-recheck able to find multiple race bugs in a job? | 15:02 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/48116 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 15:04 |
| jgriffith | mtreinish: *other* attach race? | 15:05 |
| *** dkranz has joined #openstack-qa | 15:05 | |
| jgriffith | sdague: mtreinish well it looks like that bug might not be fixed anyway according to logstash | 15:10 |
| sdague | jgriffith: which query are you using? | 15:12 |
| *** mkollaro has quit IRC | 15:12 | |
| jgriffith | Is there a way to find the run info for a querie I hit in logstash? | 15:12 |
| jgriffith | sdague: last 24 hours for: " NovaException: iSCSI device not found at" | 15:12 |
| sdague | yeh, click on the hit | 15:12 |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/47542 failed tempest with an unrecognized error | 15:12 |
| jgriffith | sdague: derp! | 15:12 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/47950 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 15:13 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/49157 failed tempest with an unrecognized error | 15:13 |
| *** dkorn has quit IRC | 15:16 | |
| jgriffith | POS! | 15:18 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48249 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 15:19 |
| mtreinish | jgriffith: sorry I stepped out, the one you pushed the fix for by adding a break | 15:22 |
| jgriffith | mtreinish: yeah | 15:22 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/49023 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 15:23 |
| jgriffith | mtreinish: turns out that tgtd may just be a pile of steaming crap | 15:23 |
| mtreinish | sdague: no it goes in order through the queries file and returns a match when it finds one | 15:23 |
| sdague | mtreinish: can you change it to return all matches? | 15:23 |
| mtreinish | sdague: sure, it shouldn't be too hard | 15:24 |
| sdague | that would help us sort out dups as well | 15:24 |
| mtreinish | jgriffith: you'll get no argument from me on that :) | 15:24 |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some tests for aggregate https://review.openstack.org/49157 | 15:24 |
| jgriffith | mtreinish: I wonder if it would be more robust if I seperated the process into two actions: | 15:29 |
| jgriffith | mtreinish: 1. create a bare target | 15:29 |
| jgriffith | mtreinish: 2. create a lun | 15:29 |
| jgriffith | mtreinish: Rather than doing an all in one via the update | 15:29 |
| openstackrecheck | openstack/glance change: https://review.openstack.org/49163 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 15:30 |
| mtreinish | jgriffith: it's worth a try | 15:32 |
| *** fungi has quit IRC | 15:33 | |
| *** fungi has joined #openstack-qa | 15:33 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Add support for multiple bug matches in a failure https://review.openstack.org/49171 | 15:34 |
| mtreinish | sdague: ^^^ there you go | 15:34 |
| giulivo | mtreinish, regarding your comments I've a new patch ready but I kept the # to preserve the visual appearance of an actual bug numer | 15:38 |
| giulivo | you think it's not worth it given the argument is bug= ? | 15:38 |
| *** dkranz has quit IRC | 15:39 | |
| giulivo | I wouldn't make it optional as the whole point here is to enforce some common 'rule' so ... | 15:39 |
| giulivo | ... it should either be in there or not | 15:40 |
| mtreinish | giulivo: yeah, that and also because I don't think bug #1234 is any better in the logs compared to bug 1234. | 15:40 |
| mtreinish | I agree we should stick with one and enforce it | 15:40 |
| giulivo | okay stripping that then | 15:40 |
| giulivo | thanks | 15:40 |
| mtreinish | giulivo: sure np | 15:41 |
| *** sthaha has quit IRC | 15:41 | |
| giulivo | I wouldn't make this support lists but that can be a future enhancement | 15:41 |
| mtreinish | is that something that's come up before, a skip because of multiple bugs? | 15:43 |
| giulivo | I'm not sure but ideally that could happen | 15:43 |
| giulivo | would you make the print an actual http url to launchpad? | 15:44 |
| mtreinish | giulivo: I think just the bug number is fine, it's not really used for much in the logs. The skip tracker gives links if we're investigating a skip. | 15:45 |
| giulivo | :) | 15:45 |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/49039 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 15:47 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49075 failed tempest with an unrecognized error | 15:47 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48894 failed tempest with an unrecognized error | 15:48 |
| mtreinish | and stamp_pattern is back ^^^ :) | 15:48 |
| mtreinish | sdague, afazekas_no_irq, jog0: ^^^ | 15:49 |
| *** thomasbiege has joined #openstack-qa | 15:49 | |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tempest: introduces skipBecause decorator https://review.openstack.org/48121 | 15:49 |
| *** mlavalle has joined #openstack-qa | 15:51 | |
| *** yassine has quit IRC | 15:52 | |
| *** dkranz has joined #openstack-qa | 15:52 | |
| mtreinish | giulivo: on the import nit I was saying time belongs in the first block not the second, not to remove it. See: http://docs.openstack.org/developer/hacking/#imports | 15:53 |
| *** SergeyLukjanov has quit IRC | 15:54 | |
| giulivo | oh I see what you mean, it is not just alphabetical order, they are split in groups | 15:54 |
| *** thomasbiege has quit IRC | 15:54 | |
| giulivo | didn't know about | 15:54 |
| giulivo | ok that's a hard to pick rule for me | 15:55 |
| giulivo | fixed though, thanks | 15:56 |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tempest: introduces skipBecause decorator https://review.openstack.org/48121 | 15:56 |
| *** dosaboy has quit IRC | 15:56 | |
| *** dosaboy has joined #openstack-qa | 15:56 | |
| giulivo | dosaboy, the test expired, I'm sorry about that but couldn't debug why it was still failing | 15:57 |
| openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Update style guide link in HACKING.rst https://review.openstack.org/49179 | 15:57 |
| sdague | mtreinish: so given the rest of the races, can you revert the unskip | 15:58 |
| *** jasondot_ has quit IRC | 15:58 | |
| mtreinish | sdague: sure, one sec | 15:58 |
| sdague | mtreinish: going to hit the bike in 5 minutes to meet you for lunch | 15:59 |
| giulivo | sdague, you 're ot with these bike things and making me jealous | 16:00 |
| giulivo | I should kick you from the chan | 16:00 |
| dosaboy | giulivo: it looks like a swift backup auth issue | 16:00 |
| dosaboy | giulivo: it uses it's own auth creds | 16:00 |
| giulivo | dosaboy, yeah not auth against keystone | 16:01 |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/49166 failed tempest with an unrecognized error | 16:01 |
| mtreinish | sdague: ok | 16:01 |
| dosaboy | i asked mkoderer to take a look cause he added the swift backup auth stuff | 16:01 |
| openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Revert "unskipping bug related to test_stamp_pattern.py" https://review.openstack.org/49181 | 16:02 |
| dosaboy | not sure what best way is to configure that stuff in tempest | 16:02 |
| mtreinish | sdague: ^^^ revert pushed | 16:02 |
| *** adalbas has quit IRC | 16:02 | |
| giulivo | dosaboy, you mean swift isn't configured to auth against the local keystone at all? | 16:03 |
| giulivo | that's something we can look at in devstack, I don't think that should be the case | 16:03 |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/48739 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 16:06 |
| dosaboy | giulivo: no i mean the cinder swift-backup service specifically | 16:06 |
| dosaboy | it has its own auth config | 16:06 |
| giulivo | yeah I noticed that but it has per-user and global ... by default it is on per-user and given you were using admin credentials it should have worked | 16:07 |
| giulivo | can I take care of that and try to repost it next week with a few changes? | 16:07 |
| jgriffith | mtreinish: I'm a bit confused... https://review.openstack.org/#/c/49181/1/tempest/scenario/test_stamp_pattern.py | 16:10 |
| mtreinish | jgriffith: sdague just asked me to do that | 16:10 |
| mtreinish | since it merged a little over an hour ago I've seen 2 or 3 test failures because of it | 16:10 |
| jgriffith | mtreinish: I'm assuming that's the same as Bug 1226337 | 16:11 |
| jgriffith | hmm... ok | 16:11 |
| jgriffith | different bug I guess then | 16:11 |
| mtreinish | jgriffith: I just did a straight revert | 16:11 |
| mtreinish | that was the bug that was there before | 16:11 |
| mtreinish | I can change it if you think it's a dup | 16:11 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/47950 failed tempest with an unrecognized error | 16:12 |
| mtreinish | jgriffith: ^^^ there's another one :) | 16:13 |
| jgriffith | mtreinish: nah... I'll leave it to you guys :) | 16:13 |
| mtreinish | I should probably add a query for that bug | 16:13 |
| *** thomasbiege has joined #openstack-qa | 16:15 | |
| *** adalbas has joined #openstack-qa | 16:15 | |
| afazekas_no_irq | mtreinish: do we need to increase the timeout ? | 16:16 |
| *** mkoderer_ has joined #openstack-qa | 16:18 | |
| jog0 | dims: ping | 16:19 |
| *** thomasbiege has quit IRC | 16:19 | |
| *** SergeyLukjanov has joined #openstack-qa | 16:20 | |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/48948 failed tempest because of: https://bugs.launchpad.net/bugs/1217734 | 16:20 |
| dims | jog0, pong | 16:20 |
| openstackrecheck | openstack/swift change: https://review.openstack.org/49169 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 16:21 |
| afazekas_no_irq | https://review.openstack.org/#/c/48970/ is it really fixed the issue ? | 16:22 |
| afazekas_no_irq | looks like the timeout is enough, it should finish in 80 sec | 16:22 |
| jog0 | dims: good hunting on https://bugs.launchpad.net/oslo/+bug/1229475/ | 16:22 |
| jog0 | any ideas on how to fix it or at least reduce the frequency of the issue | 16:22 |
| afazekas_no_irq | is anybody knows why nova does not eventlet monkey_patch the ``os`` module ? | 16:27 |
| *** DennyZhang has joined #openstack-qa | 16:28 | |
| *** DennyZhang has quit IRC | 16:28 | |
| dims | jog0, going to try running this now - https://review.openstack.org/#/c/49210/ | 16:29 |
| jog0 | dims: heres to hoping it works | 16:30 |
| jog0 | if you need anything let me know | 16:30 |
| dims | jog0, will do. i will be lost if that does not work honestly, grasping at straws | 16:31 |
| jog0 | dims: yeah ... these bugs are strange and hard | 16:31 |
| *** DennyZhang has joined #openstack-qa | 16:32 | |
| jog0 | dims: btw http://logstash.openstack.org/#eyJzZWFyY2giOiJAbWVzc2FnZTpcIk5vdmFFeGNlcHRpb246IGlTQ1NJIGRldmljZSBub3QgZm91bmQgYXRcIiBBTkQgQGZpZWxkcy5idWlsZF9zdGF0dXM6XCJGQUlMVVJFXCIgQU5EIEBmaWVsZHMuZmlsZW5hbWU6XCJsb2dzL3NjcmVlbi1uLWNwdS50eHRcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiMTcyODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTM4MDY0NTE2ODczMX0= | 16:33 |
| jog0 | for https://bugs.launchpad.net/cinder/+bug/1226337/ | 16:33 |
| jog0 | looks like bug is fixed enough for now | 16:33 |
| jog0 | but still there | 16:33 |
| dims | sigh, yes | 16:33 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49180 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 16:34 |
| jog0 | I think at least for now its fixed enough to mark this as open but not critical | 16:34 |
| jgriffith | So there's something I'm wondering here... maybe folks can help me think through this... | 16:35 |
| jgriffith | The failure on the boot pattern (ie the iSCSI device not found on attach) | 16:35 |
| dims | y jgriffith | 16:35 |
| jgriffith | That actually started when I implemented the retry in iSCSI create, the "original failure" | 16:35 |
| dims | jog0, +1 | 16:35 |
| jgriffith | was ISCSITargetCreateFailed | 16:35 |
| jgriffith | so if we back up (that's I think root cause of the issues) | 16:36 |
| dims | jgriffith, it started 3 days before your change for retry | 16:36 |
| jog0 | jgriffith: btw see ^ and my comment in https://bugs.launchpad.net/cinder/+bug/1226337/ | 16:36 |
| jgriffith | That started first showing up on 9/18 | 16:36 |
| jog0 | jgriffith: logstash only has 2 weeks of logs | 16:37 |
| jgriffith | so much for that | 16:37 |
| jog0 | jgriffith: yeah :( | 16:37 |
| jgriffith | jog0: and yes, I'm aware that we're still seeing that unfortunately | 16:37 |
| jog0 | clarkb: ^ we may want to bump taht up | 16:37 |
| dims | jgriffith, it has been there, we made it worse by the loop of 2 | 16:37 |
| jgriffith | jog0: so what's happening is we create the target, but now we sometimes don't get the backing lun | 16:38 |
| jog0 | jgriffith: cool, but it looks like your fix definitly helped significantly | 16:38 |
| dims | jog0: right agree | 16:38 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/49179 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 16:38 |
| jgriffith | jog0: dims the problem with my loop was I never broke out of it :) | 16:38 |
| jgriffith | jog0: dims I ALWAYS re-issued the create which really screwed things up | 16:39 |
| jgriffith | jog0: dims tgtd isn't all that great anyway, then I start doing that and it puuuukes | 16:39 |
| dims | jgriffith, ah ok | 16:39 |
| jgriffith | jog0: dims so I'm looking at trying something else here | 16:39 |
| jog0 | jgriffith: ahh at least you got the more frequent bug fixed | 16:40 |
| jgriffith | jog0: dims if nothing else we'll move it back to failing on the create before it goes to nova (fail early) | 16:40 |
| jgriffith | and it will be more focused on exactly where the issue is | 16:40 |
| dims | jgriffith, +1 | 16:40 |
| jgriffith | I'm going to try and see if I can detect the failure of the backing lun and create it independently | 16:40 |
| jog0 | jgriffith: good luck! | 16:41 |
| jgriffith | I should be able to do that because the target controller seems to be ina good state | 16:41 |
| jgriffith | jog0: :) | 16:41 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/49181 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 16:43 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48121 failed tempest with an unrecognized error | 16:44 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49183 failed tempest because of: https://bugs.launchpad.net/bugs/1218391 | 16:47 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/43335 failed tempest with an unrecognized error | 16:48 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49185 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 16:51 |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: Show where files are copied for sudo switch to stack user https://review.openstack.org/49213 | 16:52 |
| jog0 | jgriffith: I don't know if you have seen this: http://logs.openstack.org/35/43335/12/check/check-tempest-devstack-vm-full/49e7df0/logs/screen-c-vol.txt.gz?level=TRACE | 16:52 |
| jog0 | not criticalbut funny | 16:52 |
| *** tkammer has quit IRC | 16:52 | |
| jgriffith | jog0: whaaaa | 16:53 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/48894 failed tempest with an unrecognized error | 16:53 |
| jgriffith | I'll put it on my list... | 16:54 |
| jgriffith | :) | 16:54 |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: Pass FORCE through to sudo invocation https://review.openstack.org/49214 | 16:54 |
| jgriffith | jog0: actually, lemme see if I can get somebody to look at it before me | 16:54 |
| jog0 | jgriffith: want me to file a bug? | 16:54 |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: set errexit and xtrace in helper scripts https://review.openstack.org/49215 | 16:56 |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: Make unstack.sh work when run as root https://review.openstack.org/49216 | 16:57 |
| jog0 | jgriffith: added a bug https://bugs.launchpad.net/cinder/+bug/1233763 | 16:58 |
| *** jlibosva1 has joined #openstack-qa | 16:59 | |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/48929 failed tempest because of: https://bugs.launchpad.net/bugs/1223161 | 17:00 |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: Ensure SSL CA certificates are installed for curl https://review.openstack.org/49217 | 17:00 |
| giulivo | jog0, mtreinish how do I contribute my first search to elastic ? the bug is https://bugs.launchpad.net/tempest/+bug/1233743 | 17:01 |
| jgriffith | jog0: yup... thank you much | 17:01 |
| clarkb | jgriffith: jog0: yeah I think we may be able to handle 3 or 4 weeks | 17:01 |
| *** mlavalle has quit IRC | 17:01 | |
| jog0 | giulivo: first go to logstash.o.o and find a good query | 17:02 |
| *** jlibosva has quit IRC | 17:02 | |
| *** jlibosva1 has quit IRC | 17:02 | |
| jog0 | giulivo: write the query in the bug and submit a patch like this http://git.openstack.org/cgit/openstack-infra/elastic-recheck/commit/?id=563e81564d184ab65360777d0f51c71d16989195 | 17:02 |
| *** jlibosva has joined #openstack-qa | 17:02 | |
| *** DennyZhang has quit IRC | 17:02 | |
| jog0 | giulivo: in general listing the tempest side error isn't specific enough | 17:03 |
| jog0 | if you can find a query that finds the error in nova cinder neutron etc that is better | 17:03 |
| giulivo | I see, thanks! | 17:03 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/45676 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 17:03 |
| jog0 | giulivo: thank you! | 17:04 |
| *** afazekas_no_irq has quit IRC | 17:05 | |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: Uniquify unsupported distro error message https://review.openstack.org/49218 | 17:06 |
| *** fbo is now known as fbo_away | 17:06 | |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: Don't bail when setting up horizon on openSUSE https://review.openstack.org/49219 | 17:06 |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: Fix handling of pip and virtualenv on openSUSE https://review.openstack.org/49220 | 17:08 |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/49190 failed tempest with an unrecognized error | 17:11 |
| *** jlibosva1 has joined #openstack-qa | 17:11 | |
| *** jlibosva has quit IRC | 17:11 | |
| openstackgerrit | Adam Spiers proposed a change to openstack-dev/devstack: Add support for openSUSE 12.3 https://review.openstack.org/49222 | 17:11 |
| dkranz | jog0: I have seen a few cases like https://review.openstack.org/#/c/49179/ where the recheck message is giving the wrong bug number | 17:11 |
| jog0 | dkranz: thanks for noticing thats why we have a manual step | 17:12 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49188 failed tempest with an unrecognized error | 17:12 |
| jog0 | dkranz: it looks right to me | 17:14 |
| jog0 | ttp://logs.openstack.org/79/49179/1/check/check-tempest-devstack-vm-neutron/2276bae/logs/screen-n-cpu.txt.gz#_2013-10-01_16_26_19_411 | 17:14 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49075 failed tempest with an unrecognized error | 17:14 |
| jog0 | which matches the bug number | 17:14 |
| dkranz | jog0: The console error looks like the bug I rechecked with | 17:14 |
| dkranz | jog0: Is the recheck match based on the logs and not console? | 17:15 |
| clarkb | dkranz: jog0: it can be both | 17:15 |
| jog0 | dkranz: the same tempest test can fail for many reasons | 17:15 |
| clarkb | it can be both but I am told it shouldn't be because you need the service logs to determine actual cause | 17:16 |
| jog0 | if you didn't see cannot understand JSON in the logs somewhere | 17:16 |
| dkranz | clarkb: Oh. I assumed it was matching the log which is a lot easier to look at (only one of them) | 17:16 |
| dkranz | clarkb: I meant the console | 17:16 |
| dkranz | clarkb: But now I understand | 17:16 |
| jog0 | dkranz: we match based on logs whenever possible because those are more accurate | 17:16 |
| openstackrecheck | openstack/oslo.config change: https://review.openstack.org/49195 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 17:17 |
| jog0 | dkranz: the console logs are bad for finding underlying bugs | 17:17 |
| openstackrecheck | openstack/python-glanceclient change: https://review.openstack.org/49198 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 17:18 |
| openstackrecheck | openstack/python-heatclient change: https://review.openstack.org/49199 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 17:20 |
| openstackrecheck | openstack/python-ceilometerclient change: https://review.openstack.org/49197 failed tempest because of: https://bugs.launchpad.net/bugs/1223469 | 17:24 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/49189 failed tempest with an unrecognized error | 17:25 |
| openstackrecheck | openstack/python-novaclient change: https://review.openstack.org/49203 failed tempest with an unrecognized error | 17:28 |
| jog0 | sdague mtreinish: ^ has ssh in it? tempest doing something perhaps? | 17:30 |
| openstackrecheck | openstack/horizon change: https://review.openstack.org/49055 failed tempest with an unrecognized error | 17:32 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49211 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 17:32 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49032 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 17:33 |
| mtreinish | jog0: the failure in 49203 looks like the same test_stamp_pattern failure | 17:36 |
| mtreinish | that test does ssh into the guest | 17:36 |
| openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/49201 failed tempest with an unrecognized error | 17:38 |
| jog0 | mtreinish: do we have a query for that yet? | 17:38 |
| mtreinish | jog0: not yet, the commit removing the skip was just merged this morning. So it hadn't come up before | 17:39 |
| mtreinish | although sdague asked me to revert the skip removal | 17:39 |
| jog0 | mtreinish: whats the reason? because know we know how common it is? | 17:40 |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/49202 failed tempest with an unrecognized error | 17:40 |
| mtreinish | jog0: yeah that and we've got enough other non-deterministic failures to fix right now holding up the gate that adding another one doesn't help | 17:41 |
| jog0 | mtreinish: I am fine with that reasoning for now. | 17:41 |
| jog0 | I don't like that idea in general, but due to timing sure | 17:41 |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/49210 failed tempest with an unrecognized error | 17:42 |
| mtreinish | jog0: I agree, when the gate gets a bit more stable I'm all for removing the skip again | 17:42 |
| jog0 | mtreinish: cool | 17:43 |
| jog0 | we should update the bug saying this happens a lot | 17:43 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49212 failed tempest with an unrecognized error | 17:43 |
| mtreinish | dkranz, giulivo,: https://review.openstack.org/#/c/49181/ can you push this through? | 17:43 |
| dkranz | mtreinish: I rechecked it hour and a half ago. Not sure why it's not going. | 17:44 |
| dkranz | mtreinish: Should I approve it or just +2? | 17:44 |
| mtreinish | dkranz: I'm fine with you doing a sole +A if you want it's just a skip | 17:45 |
| sdague | back now, I can +A | 17:45 |
| sdague | dkranz: well I +2ed it, if you want to do the second +2, and +A, go for it | 17:46 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48121 failed tempest with an unrecognized error | 17:46 |
| sdague | jog0: so, I wanted to run something by you before I go do it on elastic-recheck | 17:46 |
| dkranz | mtreinish: It's Approved now but I'm still not sure why my previous recheck didn't start a job. | 17:47 |
| jog0 | sdague: oh? | 17:47 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49214 failed tempest with an unrecognized error | 17:48 |
| sdague | I think we should remove all AND @fields.build_status:"FAILURE" | 17:48 |
| jog0 | sdague: yeah | 17:48 |
| jog0 | and put that in the template? | 17:48 |
| mtreinish | dkranz: it did it just still going | 17:48 |
| sdague | jog0: no, it shouldn't be in the query | 17:48 |
| openstackrecheck | openstack/glance change: https://review.openstack.org/48496 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 17:48 |
| jog0 | hmm at all? | 17:48 |
| sdague | if the string shows up in success runs, it's not a fingerprint | 17:48 |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/49175 failed tempest because of: https://bugs.launchpad.net/bugs/1211915 | 17:48 |
| sdague | it's actually a pretty good way of knowing that something isn't a fingerprint | 17:48 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/48880 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 17:49 |
| jog0 | sdague: hmm I am not against the idea but, I think that is assuming we can find 1:1 mappings between bugs and logs | 17:49 |
| jog0 | which I am not convinced is easy | 17:49 |
| sdague | jog0: if we can't, we don't have a fingerprint | 17:49 |
| jog0 | sdague: well thats why we don't assume we are correct just tell the user | 17:50 |
| sdague | right, but most users are going to just put that number in | 17:50 |
| sdague | so I'd rather be conservative on our findings | 17:50 |
| sdague | also, if we can't find a finger print.... we need to address logging in the servers | 17:51 |
| sdague | because if we, the folks writing this code, can't predictably point to races, production folks.... | 17:51 |
| jog0 | well we only check the logs if the build_status is failure | 17:51 |
| sdague | jog0: sure | 17:51 |
| jog0 | so we can get rid of that part of the query anyway | 17:51 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/47174 failed tempest with an unrecognized error | 17:52 |
| jog0 | but if you add in a test that checks if any queries work for build_status"SUCCUESS" we can do what you want | 17:52 |
| jog0 | and have a test fail if build_status:"SUCCESS" works | 17:53 |
| jog0 | so an example of why this doesn't work: if tempest has any retry logic in it | 17:53 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49215 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 17:53 |
| jog0 | sdague: oh and we should stop naming bugs after the failing tempest job | 17:54 |
| jog0 | because a failing tempest job doesn't correlate strongly to the underlying issue | 17:54 |
| sdague | jog0: agree | 17:54 |
| jog0 | sdague: as for your idea, if you can get it to work I am all for it just don' think its possible | 17:55 |
| sdague | jog0: explain the problem if about tempest retry logic? | 17:55 |
| sdague | the only place we have any retry logic is on setup / teardown (if it's somewhere else it's wrong) | 17:56 |
| jog0 | sdague: tempest tries an action, action fails because of race condition underneath. tempest retries and works so tempest passes. but we hit a valid race condition | 17:56 |
| sdague | jog0: right, agreed, that's a matter of ensuring we don't let those things in tempest | 17:56 |
| jog0 | not even in setup teardown | 17:56 |
| sdague | also, we'll fix that from beneath by scouring the logs for fails | 17:56 |
| mtreinish | jog0: so we hit according to logstash we've hit the stamp_pattern failure 41 times since the skip was pulled | 17:57 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49218 failed tempest with an unrecognized error | 17:57 |
| jog0 | sdague mtreinish: sounds like we all agree that disabling that again is fine for now | 17:57 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49216 failed tempest because of: https://bugs.launchpad.net/bugs/1229475 | 17:57 |
| mtreinish | actually 43 based on the last message :) | 17:57 |
| mtreinish | jog0: yeah the revert has been approved | 17:57 |
| jog0 | sdague: sounds like we have more work to do before we can impliment your idea, which I like. | 17:58 |
| jog0 | also gating on tracebacks will help with this I think | 17:58 |
| jog0 | make debugging much easier | 17:58 |
| sdague | yep | 17:59 |
| sdague | it's going to get incrementally better over time, I just want to make sure we don't accidentally mask some issues by elastic-recheck being too broad | 17:59 |
| jog0 | sdague: speaking of which https://bugs.launchpad.net/bugs/1230407 is too broad | 18:00 |
| sdague | so given that we only search backwards through the FAILURE logs anyway, I won't break anything if I purge it right? | 18:00 |
| jog0 | sdague: correct | 18:00 |
| jog0 | but making sure the fingerprints don't show up in success logs will break things today | 18:00 |
| jog0 | sdague: I agree elastic-recheck being to broad is an issue but its a better issue then too many recheck no bugs | 18:01 |
| sdague | jog0: well, I can go at things manually and figure out how many of ours do, then come up with tighter queries | 18:01 |
| jog0 | sdague: ++ | 18:02 |
| sdague | I'm definitely not trying to break what's working :) | 18:03 |
| jog0 | sdague: haha yeah, tigher queries are always better | 18:03 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: don't look for things only in FAILURE logs https://review.openstack.org/49228 | 18:04 |
| jog0 | also I think we are having great success so far. got a bunch of bugs fixed and more are being debugged | 18:04 |
| jog0 | sdague: while your at it want to write a README about what queries should look like | 18:04 |
| jog0 | as we make this easier to use etc | 18:04 |
| sdague | jog0: sure, let me do the SUCCESS audit first | 18:05 |
| jog0 | sdague: awesome sauce | 18:05 |
| sdague | and I agree, this is already really showing it's value | 18:05 |
| jgriffith | sdague: jog0 dims https://review.openstack.org/#/c/49229/ | 18:06 |
| jgriffith | ^^ ain't pretty but it should give us a shot and at the very least give us MUCH better debug info to go off of | 18:07 |
| sdague | jgriffith: I like it | 18:07 |
| jog0 | jgriffith: woot! | 18:07 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49219 failed tempest with an unrecognized error | 18:07 |
| jog0 | heh time.sleep(10) | 18:07 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49220 failed tempest with an unrecognized error | 18:07 |
| jgriffith | jog0: errr... pay no attention to that please :) | 18:07 |
| dims | jgriffith, nice | 18:08 |
| jgriffith | I have a theory, and this will either fix it or at the very least prove/disprove it | 18:08 |
| jgriffith | we didn't turn that test off did we? | 18:09 |
| jgriffith | I absolutely can NOT reproduce it locally, so I have to rely on gates | 18:09 |
| jgriffith | although I guess no need to worry til this lands | 18:09 |
| mtreinish | jgriffith: which test? | 18:10 |
| jgriffith | mtreinish: tempest.scenario.test_volume_boot_pattern | 18:11 |
| mtreinish | jgriffith: no that one is still live | 18:11 |
| jgriffith | mtreinish: Yeah, I was initially confused with the stamp pattern one | 18:11 |
| jgriffith | mtreinish: of course it may take 12 hours for this to merge again :( | 18:12 |
| dkranz | sdague: Is there a reason tempest is not in the projects.txt file in requirements? If not I will add it. | 18:12 |
| mtreinish | dkranz: https://review.openstack.org/#/c/49225/ | 18:12 |
| dkranz | mtreinish: OK :) | 18:12 |
| mtreinish | jgriffith: yeah the same is probably true for my commit adding the skip back for stamp_pattern | 18:13 |
| openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some negative tests for attach_interfaces https://review.openstack.org/49231 | 18:13 |
| *** jlibosva1 has quit IRC | 18:16 | |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/47942 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 18:18 |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/49210 failed tempest with an unrecognized error | 18:32 |
| *** kong has quit IRC | 18:33 | |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/49225 failed tempest with an unrecognized error | 18:39 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/45120 failed tempest because of: https://bugs.launchpad.net/bugs/1223161 | 18:49 |
| *** mlavalle has joined #openstack-qa | 18:51 | |
| sdague | jog0: so we are actually better than I expected - http://paste.openstack.org/show/47784/ | 18:58 |
| jog0 | sdague: not bad! | 18:59 |
| sdague | also it's really interesting about the things that show up in success | 18:59 |
| sdague | also, I need to write a wrapper class around those ES result returns, that nesting is killing me :) | 19:00 |
| openstackgerrit | Ed Cranford proposed a change to openstack-dev/devstack: Adds trove-conductor service to trove. https://review.openstack.org/49237 | 19:03 |
| openstackrecheck | openstack/swift change: https://review.openstack.org/49169 failed tempest with an unrecognized error | 19:08 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Add support for multiple bug matches in a failure https://review.openstack.org/49171 | 19:10 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48249 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 19:11 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/49233 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 19:12 |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/48745 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 19:12 |
| sdague | so, mtreinish, how about some unit tests on elastic-recheck that we can gate on? :) | 19:14 |
| mtreinish | sdague: I started working on mocking out gerrit just as the first tests but I haven't gotten that far with it yet | 19:15 |
| mtreinish | I keep getting sidetracked | 19:15 |
| * mtreinish wonders who keeps asking him to do random things | 19:15 | |
| sdague | heheh | 19:17 |
| jamielennox | dtroyer: ping | 19:17 |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/48993 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 19:20 |
| *** annegentle_ has joined #openstack-qa | 19:21 | |
| *** fboz has joined #openstack-qa | 19:22 | |
| *** fboz is now known as fbo | 19:22 | |
| *** jeblair_ has joined #openstack-qa | 19:22 | |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49220 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 19:23 |
| *** jeblair has quit IRC | 19:24 | |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49214 failed tempest with an unrecognized error | 19:24 |
| *** jeblair_ is now known as jeblair | 19:24 | |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49215 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 19:26 |
| *** adam_g` has joined #openstack-qa | 19:26 | |
| *** adam_g has quit IRC | 19:27 | |
| *** annegentle has quit IRC | 19:27 | |
| *** fbo_away has quit IRC | 19:27 | |
| *** dtroyer has quit IRC | 19:27 | |
| *** EmilienM has quit IRC | 19:27 | |
| *** adam_g` is now known as adam_g | 19:28 | |
| *** EmilienM has joined #openstack-qa | 19:30 | |
| *** dtroyer has joined #openstack-qa | 19:31 | |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49216 failed tempest with an unrecognized error | 19:37 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: don't look for things only in FAILURE logs https://review.openstack.org/49228 | 19:37 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49211 failed tempest with an unrecognized error | 19:40 |
| openstackrecheck | openstack/python-cinderclient change: https://review.openstack.org/49234 failed tempest with an unrecognized error | 19:40 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49229 failed tempest with an unrecognized error | 19:41 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add check_success tool https://review.openstack.org/49246 | 19:44 |
| jog0 | sdague: why not just put in test_queries? | 19:48 |
| jog0 | thats where the other checks are | 19:48 |
| jog0 | (make sure real bug in launchpad), make sure there are results in logstash etc | 19:48 |
| sdague | because this isn't a test, it's a tool. I think we're going to emerge a lot of tools based on some common libs to work with elastic search, and we should start having them be tools | 19:51 |
| sdague | I also think that we need to start unwinding the tests to be real unit tests, and then maybe some other validation tools on the data | 19:51 |
| jog0 | I can get behind that, but first I think we need a doc about writting new queires | 19:52 |
| sdague | yep, that's fair | 19:52 |
| jog0 | sdague: no arguement here | 19:52 |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/48971 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 19:52 |
| sdague | ok, time for me to go pick up vegetables | 19:52 |
| sdague | to be back in time for project meeting | 19:52 |
| jog0 | o/ | 19:53 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49192 failed tempest with an unrecognized error | 19:55 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49075 failed tempest with an unrecognized error | 19:55 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49182 failed tempest with an unrecognized error | 19:55 |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/49225 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 19:56 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/49237 failed tempest with an unrecognized error | 19:56 |
| timello | interesting... does this mean they are possible rechecks or they really need recheck using known bugs? | 19:59 |
| jog0 | timello: ? | 20:00 |
| timello | openstackrechecks above jog0 | 20:00 |
| jog0 | unknown error means something failed and don't have a classifcation for it yet | 20:00 |
| mtreinish | timello: most of the unrecognized errors are probably: https://bugs.launchpad.net/tempest/+bug/1205344 | 20:00 |
| mtreinish | we just don't have a query for it yet | 20:00 |
| timello | ah | 20:00 |
| openstackrecheck | openstack/neutron change: https://review.openstack.org/47432 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 20:07 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49239 failed tempest with an unrecognized error | 20:19 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49103 failed tempest because of: https://bugs.launchpad.net/bugs/1223469 | 20:20 |
| openstackrecheck | openstack/python-heatclient change: https://review.openstack.org/49199 failed tempest with an unrecognized error | 20:20 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/48079 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 20:21 |
| dims | jog0, comstud, russellb, sdague - https://review.openstack.org/#/c/49210/ is ready i believe. 3 rechecks and no sign of the bad fd(s) | 20:21 |
| clarkb | dims: nice! | 20:22 |
| jog0 | dims: unfortunately the fd bug isn't 33% percent of the time right? | 20:22 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49188 failed tempest with an unrecognized error | 20:22 |
| dims | jog0, running one more now | 20:22 |
| jog0 | that is to say we wont know until we merge | 20:22 |
| dims | true | 20:22 |
| dims | gonna take a break from this one now :) | 20:23 |
| jog0 | haha if your next test passes I am all for merge and see what happens | 20:23 |
| clarkb | ++ | 20:24 |
| dims | cross my fingers | 20:24 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/47969 failed tempest with an unrecognized error | 20:25 |
| openstackrecheck | openstack/nova change: https://review.openstack.org/49245 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 20:32 |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/49225 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 20:45 |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/48739 failed tempest with an unrecognized error | 20:46 |
| openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/49201 failed tempest with an unrecognized error | 20:47 |
| openstackrecheck | openstack/heat change: https://review.openstack.org/48964 failed tempest with an unrecognized error | 20:51 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49229 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 20:53 |
| *** rockyg has joined #openstack-qa | 20:56 | |
| openstackrecheck | openstack/heat change: https://review.openstack.org/49075 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 20:59 |
| *** harlowja has quit IRC | 21:02 | |
| *** weshay has quit IRC | 21:04 | |
| *** rfolco has quit IRC | 21:06 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Bug 1230407 was at least two problems, split apart. https://review.openstack.org/49261 | 21:08 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/48794 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 21:13 |
| openstackrecheck | openstack/python-cinderclient change: https://review.openstack.org/49234 failed tempest with an unrecognized error | 21:19 |
| *** weshay has joined #openstack-qa | 21:19 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49103 failed tempest because of: https://bugs.launchpad.net/bugs/1230407 | 21:26 |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/49210 failed tempest because of: https://bugs.launchpad.net/bugs/1226337 | 21:26 |
| *** rockyg has quit IRC | 21:27 | |
| *** rockyg has joined #openstack-qa | 21:27 | |
| *** rockyg has quit IRC | 21:29 | |
| dims | jog0, comstud, russellb, sdague , clarkb - 4th recheck passed - https://review.openstack.org/#/c/49210/ | 21:30 |
| jog0 | dims: I say go for it | 21:30 |
| sdague | dims: no, it failed | 21:30 |
| jog0 | sdague: for a different reason :/ | 21:30 |
| dims | sdague, that's the boot volume and stamp | 21:31 |
| sdague | oh, gotcha | 21:31 |
| jog0 | sdague: too many bugs :( | 21:31 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49032 failed tempest because of: https://bugs.launchpad.net/bugs/1223469 | 21:31 |
| sdague | oh, you know what, we should turn on the neutron extra tests for neutron client | 21:31 |
| sdague | that would make this easier to see | 21:32 |
| *** dkranz has quit IRC | 21:33 | |
| *** rockyg has joined #openstack-qa | 21:34 | |
| dims | sdague, +1 | 21:36 |
| *** rockyg has quit IRC | 21:36 | |
| *** rockyg has joined #openstack-qa | 21:37 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Add mox fixture to baste TestCase https://review.openstack.org/49264 | 21:38 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Make test_required_files.py real unit tests https://review.openstack.org/49265 | 21:38 |
| jog0 | sdague mtreinish: we need to do a better job of classifying the remaning devstack failures | 21:39 |
| sdague | jog0: agreed, only so many hours :) | 21:39 |
| jog0 | sdague: yeah :/ | 21:40 |
| sdague | also, we're only a week in | 21:40 |
| jog0 | when the next one pops up here lets try to jump on it | 21:40 |
| jog0 | sdague: a very important week | 21:40 |
| jog0 | but agreed | 21:40 |
| *** harlowja has joined #openstack-qa | 21:42 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Make test_queries save stdout in tox testr https://review.openstack.org/49080 | 21:44 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Make test_required_files.py real unit tests https://review.openstack.org/49265 | 21:48 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Add mox fixture to base TestCase https://review.openstack.org/49264 | 21:48 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Bug 1230407 was at least two problems, split apart. https://review.openstack.org/49261 | 21:49 |
| sdague | ok, why is it restricted to tempest only? | 21:51 |
| jog0 | limit to tempest originally because that was what triggered most transient errors | 21:51 |
| jog0 | didn't want to classify every unittest failure etc | 21:52 |
| sdague | ok, I'd actually like to classify everything | 21:52 |
| jog0 | sdague: I am all for that | 21:52 |
| jog0 | but baby steps | 21:52 |
| sdague | sure | 21:52 |
| jog0 | we don't want to classify any pep8 failures | 21:52 |
| sdague | sure | 21:52 |
| jog0 | and almost never want to do unit tests | 21:52 |
| mtreinish | jog0, sdague: I thought we restricted to tempest only because if it also failed unit tests then it was probably a bad commit in the check queue | 21:52 |
| jog0 | but everything else ... sure | 21:53 |
| mtreinish | or am I just imagining things | 21:53 |
| jog0 | mtreinish: exactly | 21:53 |
| jog0 | but sdague has another case | 21:53 |
| sdague | mtreinish: so we now know which queue it's in | 21:54 |
| sdague | or I guess we always did | 21:54 |
| sdague | so we can classify on that | 21:54 |
| *** SergeyLukjanov has quit IRC | 21:54 | |
| mtreinish | sdague: ok | 21:54 |
| jog0 | sdague: I vote we do all these cool things post summit | 21:54 |
| sdague | :) | 21:54 |
| jog0 | so we can all talk f2f about this | 21:54 |
| sdague | sure | 21:54 |
| jog0 | I like your idea but lets get what we have work really well before adding to much more | 21:55 |
| sdague | that being said, I do want to add the requirements install and grenade jobs | 21:55 |
| jog0 | sdague: ++ | 21:55 |
| sdague | as those should be in our classifier RSN | 21:55 |
| jog0 | we picked tempest at first because it cought the most bugs | 21:56 |
| *** mlavalle has quit IRC | 21:56 | |
| sdague | so this all comes down to the get_failed_tempest filter, right? | 21:56 |
| sdague | and that's a gerrit stream | 21:56 |
| jog0 | sdague: yeah but lets hold off on changing that for now | 21:56 |
| jog0 | we have plenty of work to do before we grow scope | 21:56 |
| sdague | well, exept I really want the pypi CDN fail in the auto classification | 21:57 |
| jog0 | sdague: how frequently does that happen? | 21:57 |
| sdague | http://logstash.openstack.org/#eyJzZWFyY2giOiJAbWVzc2FnZTpcIkVycm9yIFRoZSByZWFkIG9wZXJhdGlvbiB0aW1lZCBvdXQgd2hpbGUgZ2V0dGluZyA8YSBocmVmPSdodHRwczovL3B5cGkucHl0aG9uLm9yZ1wiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiIxNzI4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxMzgwNjY0MTQ2MDY1fQ== | 21:57 |
| sdague | pretty frequently | 21:57 |
| sdague | and the pypi folks upstream have been asking how bad it's hurting us | 21:57 |
| jog0 | why always thrift? | 21:58 |
| sdague | no idea | 21:58 |
| jog0 | sdague: 77 in last 7 days | 21:58 |
| *** SergeyLukjanov has joined #openstack-qa | 21:58 | |
| jog0 | for now I think making sure that bug is easy to find on status.o.o/rechecks is good | 21:58 |
| sdague | it's more interesting when you realize we only run that on global-requirements repo | 21:58 |
| jog0 | don't get me wrong i really like the idea | 21:59 |
| jog0 | sdague: ohh hmm | 21:59 |
| jog0 | sdague: I still think classifying remaining issues is more important | 21:59 |
| sdague | I'm not sure I understand why you are pushing back against adding jobs we are watching? | 21:59 |
| jog0 | (tempest based that is) | 21:59 |
| jog0 | sdague: we have bugs in elastic-recheck still and I want to get things a little better with more tests etc before growing | 22:00 |
| sdague | well I've got a classification for a bug right now, we could add, and have broader coverage on rechecks. So I'd like to do that before it falls off the table. | 22:01 |
| jog0 | sdague: but if you propose a patch we can evaluate it | 22:01 |
| *** SergeyLukjanov has quit IRC | 22:01 | |
| jog0 | but if the change to e-r is non-trivial I would like to hold off | 22:01 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Make test_required_files.py real unit tests https://review.openstack.org/49265 | 22:05 |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/elastic-recheck: Add mox fixture to base TestCase https://review.openstack.org/49264 | 22:05 |
| *** mriedem has quit IRC | 22:09 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Cleanup tests https://review.openstack.org/48764 | 22:13 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Enforce E501 max-line-length at 100 chars https://review.openstack.org/48763 | 22:18 |
| *** mriedem has joined #openstack-qa | 22:32 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Add query for bug 1232748 https://review.openstack.org/49280 | 22:34 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Cleanup README https://review.openstack.org/49281 | 22:51 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add support for multiple bug matches in a failure https://review.openstack.org/49171 | 22:55 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add requirements-install to watch test runs https://review.openstack.org/49283 | 22:58 |
| *** sthaha has joined #openstack-qa | 23:06 | |
| *** openstackrecheck has quit IRC | 23:09 | |
| *** openstackrecheck has joined #openstack-qa | 23:09 | |
| openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/49210 failed tempest with an unrecognized error | 23:12 |
| *** dims has quit IRC | 23:13 | |
| *** rockyg has quit IRC | 23:13 | |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/49273 failed tempest because of: https://bugs.launchpad.net/bugs/1211915 and https://bugs.launchpad.net/bugs/1230407 and https://bugs.launchpad.net/bugs/1223469 and | 23:16 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Stop using While True to wait for ElasticSearch https://review.openstack.org/48766 | 23:18 |
| jog0 | mtreinish: ^^ | 23:18 |
| jog0 | double failes | 23:18 |
| jog0 | fails | 23:18 |
| jog0 | sdague: ^ | 23:19 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49229 failed tempest with an unrecognized error | 23:23 |
| *** dims has joined #openstack-qa | 23:26 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/49275 failed tempest because of: https://bugs.launchpad.net/bugs/1225664 | 23:27 |
| *** ken1ohmichi has joined #openstack-qa | 23:40 | |
| *** rfolco has joined #openstack-qa | 23:47 | |
| *** DennyZhang has joined #openstack-qa | 23:52 | |
| *** rfolco has quit IRC | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!