Monday, 2016-05-09

*** tmatsu_ has joined #openstack-qa00:01
*** tmatsu has quit IRC00:04
*** hichihara has joined #openstack-qa00:18
openstackrecheckopenstack/glance change: https://review.openstack.org/306073 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error00:19
*** markvoelker has quit IRC00:30
*** ddieterly has joined #openstack-qa01:03
openstackrecheckopenstack/cinder change: https://review.openstack.org/147738 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/157886601:08
openstackLaunchpad bug 1578866 in OpenStack Identity (keystone) "test_user_update_own_password failing intermittently" [High,Confirmed]01:08
openstackgerritEinst Crazy proposed openstack-dev/devstack: Set config file to db sync and other manage operation  https://review.openstack.org/31237001:44
*** ddieterly is now known as ddieterly[away]01:53
*** tmatsu has joined #openstack-qa01:56
*** tmatsu__ has joined #openstack-qa01:57
*** tmatsu_ has quit IRC02:00
*** tmatsu has quit IRC02:01
*** hoangcx has joined #openstack-qa02:07
openstackgerritzhufl proposed openstack/tempest: Correct mispell words in comments  https://review.openstack.org/31324202:26
*** minwang2 has joined #openstack-qa02:38
*** salv-orlando has joined #openstack-qa02:42
openstackgerritzhufl proposed openstack/tempest: Correct mispell words in comments  https://review.openstack.org/31324202:43
*** tmatsu has joined #openstack-qa02:43
*** minwang2 has quit IRC02:46
*** minwang2 has joined #openstack-qa02:46
*** tmatsu__ has quit IRC02:47
*** dkranz has quit IRC02:47
*** salv-orlando has quit IRC02:47
*** minwang2 has quit IRC02:47
*** minwang2 has joined #openstack-qa02:52
*** ddieterly[away] has quit IRC02:54
*** minwang2 has quit IRC02:54
*** minwang2 has joined #openstack-qa02:56
openstackgerritHaifeng Yan proposed openstack-dev/devstack: Fix ovs-vsctl executed in worlddump.py failed issue  https://review.openstack.org/31105503:03
*** amotoki has joined #openstack-qa03:07
*** zackf has quit IRC03:12
openstackrecheckConsole logs not available after 13:22s for gate-cinder-python34-db 280492,8,282099e03:14
openstackrecheckopenstack/nova change: https://review.openstack.org/309329 failed gate-nova-python27-db in the gate queue with an unrecognized error03:14
*** amotoki has quit IRC03:18
openstackgerritBin Bin Cong proposed openstack/tempest: Skip multinodes testing if no same/different scheduler filter enabled  https://review.openstack.org/31384003:24
*** markvoelker has joined #openstack-qa03:26
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-full 296176,5,4c2cfdf03:28
*** markvoel_ has joined #openstack-qa03:29
*** slowrie has quit IRC03:29
*** zz_dimtruck is now known as dimtruck03:29
*** slowrie has joined #openstack-qa03:30
openstackgerritIan Wienand proposed openstack-dev/devstack: Fix return code detection in plugin list generation  https://review.openstack.org/31397203:30
*** tochi has quit IRC03:31
*** markvoelker has quit IRC03:32
*** minwang2 has quit IRC03:32
*** amotoki has joined #openstack-qa03:40
*** minwang2 has joined #openstack-qa03:45
*** salv-orlando has joined #openstack-qa03:46
*** salv-orlando has quit IRC03:48
*** anshul has joined #openstack-qa03:48
*** anshul has quit IRC03:48
*** salv-orlando has joined #openstack-qa03:59
*** tochi has joined #openstack-qa03:59
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-full 313113,4,5b58c6104:00
*** salv-orlando has quit IRC04:03
*** dwalleck has quit IRC04:04
*** dimtruck is now known as zz_dimtruck04:09
*** zz_dimtruck is now known as dimtruck04:09
*** dimtruck is now known as zz_dimtruck04:19
*** minwang2 has quit IRC04:31
*** fedexo has joined #openstack-qa04:37
*** tmatsu_ has joined #openstack-qa04:38
*** tmatsu__ has joined #openstack-qa04:41
*** tmatsu has quit IRC04:42
*** tmatsu_ has quit IRC04:45
*** hoangcx has quit IRC04:45
*** hoangcx has joined #openstack-qa04:45
*** amotoki_ has joined #openstack-qa04:46
*** hichihara has quit IRC04:49
*** amotoki has quit IRC04:49
*** gamado has joined #openstack-qa05:02
openstackgerritLiron Kuchlani proposed openstack/tempest: Quota usage after volume transfer  https://review.openstack.org/30820505:15
*** tmatsu__ has quit IRC05:16
*** tmatsu has joined #openstack-qa05:18
*** sridharg has joined #openstack-qa05:18
*** markvoel_ has quit IRC05:20
*** tmatsu_ has joined #openstack-qa05:22
*** salv-orlando has joined #openstack-qa05:23
*** tmatsu has quit IRC05:24
*** zackf has joined #openstack-qa05:24
*** zackf has quit IRC05:28
*** salv-orlando has quit IRC05:30
*** amotoki_ has quit IRC05:35
*** itzikb has joined #openstack-qa05:35
*** salv-orlando has joined #openstack-qa05:36
*** salv-orlando has quit IRC05:36
*** salv-orlando has joined #openstack-qa05:36
*** Poornima has joined #openstack-qa05:37
*** rcernin has joined #openstack-qa05:40
*** salv-orl_ has joined #openstack-qa05:42
*** salv-orlando has quit IRC05:45
*** amotoki has joined #openstack-qa05:51
openstackgerritAlex Stafeyev proposed openstack/tempest: Editing descripition for _create_loginable_secgroup_rule  https://review.openstack.org/31392405:52
*** yolanda has joined #openstack-qa05:58
*** tmatsu has joined #openstack-qa06:06
*** tmatsu_ has quit IRC06:09
*** afazekas_ is now known as afazekas06:10
*** bkopilov has joined #openstack-qa06:11
openstackgerritMasayuki Igawa proposed openstack/openstack-health: Add tooltips to know which projects are showed  https://review.openstack.org/31399006:13
*** gouthamr has quit IRC06:14
*** markvoelker has joined #openstack-qa06:14
*** markvoelker has quit IRC06:19
openstackgerritMasayuki Igawa proposed openstack/openstack-health: Make context-legend nowrap  https://review.openstack.org/31399106:21
openstackrecheckConsole logs not available after 13:26s for gate-tempest-dsvm-postgres-full 313984,1,37f8d0f06:22
*** k4n0 has joined #openstack-qa06:24
*** k4n0 has quit IRC06:24
openstackgerritEyal Dannon proposed openstack/tempest: Adding documentation to dynamic_creds functions  https://review.openstack.org/31199406:28
*** salv-orl_ has quit IRC06:29
openstackrecheckConsole logs not available after 13:22s for gate-nova-python27-db 313902,3,e14a1bd06:36
*** tmatsu_ has joined #openstack-qa06:36
*** tmatsu has quit IRC06:39
*** anshul has joined #openstack-qa06:42
*** anshul is now known as Guest7875606:43
*** openstackgerrit has quit IRC06:47
*** openstackgerrit has joined #openstack-qa06:48
*** fedexo has quit IRC06:48
openstackgerritMasayuki Igawa proposed openstack/openstack-health: Move feedback link to fixed-bottom  https://review.openstack.org/31399506:49
openstackgerritOpenStack Proposal Bot proposed openstack-dev/devstack: Updated from generate-devstack-plugins-list  https://review.openstack.org/31233506:52
*** tesseract has joined #openstack-qa07:01
openstackgerritMasayuki Igawa proposed openstack/openstack-health: Move crumb menu to fixed top  https://review.openstack.org/31399807:04
*** jlanoux has joined #openstack-qa07:06
*** shausy has joined #openstack-qa07:06
*** yaume has joined #openstack-qa07:13
*** yolanda has quit IRC07:17
*** zackf has joined #openstack-qa07:19
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-postgres-full 307124,10,2396a2c07:22
*** yolanda has joined #openstack-qa07:23
*** zackf has quit IRC07:24
*** grafuls has joined #openstack-qa07:27
*** zeih has joined #openstack-qa07:29
*** ifarkas has joined #openstack-qa07:29
*** binbincong has quit IRC07:32
*** jpena|off is now known as jpena07:36
*** shardy has joined #openstack-qa07:38
*** zackf has joined #openstack-qa07:46
*** zackf has quit IRC07:50
*** zeih has quit IRC07:51
*** binbincong has joined #openstack-qa07:57
openstackgerritMasayuki Igawa proposed openstack/openstack-health: Add tooltips to know which projects are showed  https://review.openstack.org/31399008:00
*** salv-orlando has joined #openstack-qa08:01
*** drptbl has joined #openstack-qa08:01
*** jordanP has joined #openstack-qa08:01
*** drptbl has quit IRC08:02
*** Alex_Stef has joined #openstack-qa08:02
*** markvoelker has joined #openstack-qa08:03
*** drptbl has joined #openstack-qa08:04
*** itzikb has quit IRC08:04
*** drptbl has quit IRC08:07
*** markvoelker has quit IRC08:07
*** sridharg has quit IRC08:10
*** yfried has joined #openstack-qa08:15
*** openstackgerrit has quit IRC08:17
*** openstackgerrit has joined #openstack-qa08:18
*** lezbar has joined #openstack-qa08:18
*** lucas-afk has quit IRC08:19
*** lucasagomes has joined #openstack-qa08:24
*** Serlex has joined #openstack-qa08:25
*** itzikb has joined #openstack-qa08:33
*** nadya has joined #openstack-qa08:34
*** jamielennox is now known as jamielennox|away08:40
*** zeih has joined #openstack-qa08:40
*** e0ne has joined #openstack-qa08:42
*** zeih has quit IRC08:44
*** sridharg has joined #openstack-qa08:49
openstackrecheckopenstack/nova change: https://review.openstack.org/309342 failed because of: gate-grenade-dsvm-multinode: https://bugs.launchpad.net/bugs/153118708:50
openstackLaunchpad bug 1531187 in OpenStack-Gate "subnode fails to be accessable over ssh" [Undecided,New]08:50
*** gfidente has joined #openstack-qa08:57
*** gfidente has quit IRC08:57
*** gfidente has joined #openstack-qa08:57
*** cdent has joined #openstack-qa08:58
*** e0ne has quit IRC09:03
*** jlanoux has quit IRC09:03
*** jlanoux has joined #openstack-qa09:03
*** itzikb has quit IRC09:03
*** mkoderer__ has joined #openstack-qa09:03
*** itzikb has joined #openstack-qa09:04
openstackrecheckConsole logs not available after 13:32s for gate-nova-python34-db 303345,50,c93d3b009:04
*** tmatsu has joined #openstack-qa09:05
*** lezbar has quit IRC09:06
*** zeih has joined #openstack-qa09:07
*** tmatsu_ has quit IRC09:08
*** castulo has quit IRC09:11
*** tmatsu_ has joined #openstack-qa09:11
*** tmatsu has quit IRC09:11
*** zeih has quit IRC09:12
*** luzC has quit IRC09:12
*** jlwhite has quit IRC09:12
*** salv-orlando has quit IRC09:14
*** zeih has joined #openstack-qa09:18
*** dtantsur|afk is now known as dtantsur09:19
*** mvk has joined #openstack-qa09:23
*** yaume has quit IRC09:34
*** yaume_ has joined #openstack-qa09:34
openstackgerritDmitry Tantsur proposed openstack-dev/devstack: Revert "Update auth params in Nova Hypervisor-Ironic"  https://review.openstack.org/31402409:36
dtantsurit seems like this broke ironic gate ^^^09:37
jordanPhi tempest core, could someone review https://review.openstack.org/#/c/277907/ (Introduce new helper: call_and_ignore_notfound_exc()) please ? Thanks !09:38
openstackgerritLiron Kuchlani proposed openstack/tempest: Snapshot list using 'limit' parameter  https://review.openstack.org/29939309:40
*** markvoelker has joined #openstack-qa09:51
*** tochi has quit IRC09:52
*** tosky has joined #openstack-qa09:53
*** markvoelker has quit IRC09:56
*** gszasz has joined #openstack-qa09:56
*** castulo has joined #openstack-qa09:56
*** luzC has joined #openstack-qa09:56
*** jlwhite has joined #openstack-qa09:57
*** sambetts|afk is now known as sambetts09:57
*** sdague has joined #openstack-qa10:01
*** apevec has joined #openstack-qa10:01
*** k4n0 has joined #openstack-qa10:02
openstackgerritSagi Shnaidman proposed openstack-infra/elastic-recheck: Add bug for TripleO timeouts  https://review.openstack.org/31303810:07
openstackgerritJordan Pittier proposed openstack/tempest: Added logic to validate storage policy info  https://review.openstack.org/30678810:12
*** e0ne has joined #openstack-qa10:12
*** hoangcx has quit IRC10:15
*** zeih_ has joined #openstack-qa10:15
*** zeih_ has quit IRC10:17
*** zeih has quit IRC10:18
openstackgerritMerged openstack/tempest: Skip multinodes testing if no same/different scheduler filter enabled  https://review.openstack.org/31384010:21
*** yamahata has quit IRC10:21
*** zeih has joined #openstack-qa10:22
openstackgerritMerged openstack/tempest: Correct mispell words in comments  https://review.openstack.org/31324210:35
*** e0ne has quit IRC10:35
*** zeih has quit IRC10:38
*** e0ne has joined #openstack-qa10:39
*** apevec has left #openstack-qa10:45
*** tmatsu_ has quit IRC10:47
*** dmellado|off is now known as dmellado10:47
*** tmatsu has joined #openstack-qa10:49
*** tmatsu has quit IRC10:49
*** tmatsu has joined #openstack-qa10:49
*** zeih has joined #openstack-qa10:58
*** cdent has left #openstack-qa10:58
*** e0ne has quit IRC11:06
*** rodrigods has quit IRC11:07
*** rodrigods has joined #openstack-qa11:07
*** panbalag has joined #openstack-qa11:09
jrollsdague: dtroyer: https://review.openstack.org/#/c/314024/11:20
sdaguejroll: ironic doesn't work with v3?11:20
sdagueis there a log link?11:20
jrollsdague: those nova conf options don't exist11:21
jrollsee dtantsur comments here https://review.openstack.org/#/c/300151/211:21
jrolland the log there, n-cpu doesn't start up11:21
sdagueok, reverted11:22
jrollthanks11:23
sdaguethough that seems like an issue that the nova -> ironic auth doesn't have the keystone v3 bits in there11:23
jrollyeah, I think we may need a change there, our client does support v3 afaik11:23
jrollthough I guess I'm not sure what, I think it may just work11:25
*** cdent has joined #openstack-qa11:25
*** panbalag has quit IRC11:26
*** panbalag has joined #openstack-qa11:28
*** cdent has left #openstack-qa11:30
*** panbalag has quit IRC11:32
*** tmatsu has quit IRC11:34
*** e0ne has joined #openstack-qa11:36
*** amotoki has quit IRC11:36
*** frontrunner has quit IRC11:37
*** markvoelker has joined #openstack-qa11:39
*** e0ne has quit IRC11:42
openstackrecheckopenstack/nova change: https://review.openstack.org/302446 failed gate-tempest-dsvm-full, gate-tempest-dsvm-full-devstack-plugin-ceph in the gate queue with an unrecognized error11:42
*** lucasagomes is now known as lucas-hungry11:43
*** markvoelker has quit IRC11:44
*** yamamoto has quit IRC11:44
*** panbalag has joined #openstack-qa11:45
*** e0ne has joined #openstack-qa11:46
*** bkopilov has quit IRC11:48
*** Abhishek has joined #openstack-qa11:50
openstackrecheckopenstack/nova change: https://review.openstack.org/281137 failed because of: gate-tempest-dsvm-cells: unrecognized error, gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/1577558 https://bugs.launchpad.net/bugs/1298006 https://bugs.launchpad.net/bugs/128287611:55
openstackLaunchpad bug 1577558 in OpenStack Security Advisory "v2.0 fernet tokens audit ids are inconsistent" [Undecided,Incomplete]11:55
openstackLaunchpad bug 1298006 in OpenStack-Gate "network sometimes unreachable accessing our git server" [Medium,Triaged]11:55
openstackLaunchpad bug 1282876 in OpenStack-Gate "git clone fails with "fatal: Not a git repository", "git remote update failed."" [Critical,Fix released] - Assigned to Jeremy Stanley (fungi)11:55
*** yolanda has quit IRC11:57
*** e0ne has quit IRC11:58
*** panbalag has quit IRC12:01
*** yolanda has joined #openstack-qa12:02
*** panbalag has joined #openstack-qa12:02
*** raildo-afk is now known as raildo12:04
*** pauloewerton has joined #openstack-qa12:08
*** aysyd has joined #openstack-qa12:09
*** coreyob has joined #openstack-qa12:09
jrollsdague: aha, that devstack change was missing depends-on for https://review.openstack.org/#/c/300154/12:10
sdaguejroll: ok, that makes a bit more sense12:10
*** vinc has quit IRC12:11
*** weshay has joined #openstack-qa12:11
*** vinc has joined #openstack-qa12:12
*** early` has quit IRC12:14
openstackrecheckopenstack/nova change: https://review.openstack.org/303074 failed gate-tempest-dsvm-neutron-full in the gate queue with an unrecognized error12:17
*** cdent has joined #openstack-qa12:19
*** anteaya has joined #openstack-qa12:24
*** zeih has quit IRC12:24
*** dkranz has joined #openstack-qa12:24
*** zeih has joined #openstack-qa12:25
*** edmondsw has joined #openstack-qa12:30
*** zeih has quit IRC12:30
*** jpena is now known as jpena|lunch12:31
openstackgerritRyan Moats proposed openstack-infra/devstack-gate: Don't enable Q_USE_DEBUG_COMMAND  https://review.openstack.org/31407912:33
*** markvoelker has joined #openstack-qa12:33
*** rfolco has joined #openstack-qa12:37
*** markvoelker has quit IRC12:38
*** agireud has quit IRC12:38
*** jecarey has quit IRC12:38
*** agireud has joined #openstack-qa12:40
*** early has joined #openstack-qa12:43
*** itzkb_ has joined #openstack-qa12:44
*** itzikb has quit IRC12:44
*** ddieterly has joined #openstack-qa12:50
*** lucas-hungry is now known as lucasagomes12:54
*** rossella_s has joined #openstack-qa12:58
*** yolanda has quit IRC12:58
openstackgerritRafael Folco proposed openstack-dev/devstack: [WIP] Enable MariaDB for Ubuntu  https://review.openstack.org/31408713:00
*** ddieterly has quit IRC13:02
*** yolanda has joined #openstack-qa13:04
*** apevec has joined #openstack-qa13:11
*** krtaylor has quit IRC13:12
*** markvoelker has joined #openstack-qa13:13
*** rossella_s has quit IRC13:16
*** amotoki has joined #openstack-qa13:17
*** gamado has quit IRC13:18
*** rossella_s has joined #openstack-qa13:18
*** zackf has joined #openstack-qa13:19
*** krtaylor has joined #openstack-qa13:19
*** edmondsw has quit IRC13:20
openstackrecheckopenstack/nova change: https://review.openstack.org/312910 failed gate-nova-python27-db in the gate queue with an unrecognized error13:30
*** ddieterly has joined #openstack-qa13:31
*** k4n0 has quit IRC13:32
*** mtanino has joined #openstack-qa13:32
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/314024 failed gate-grenade-dsvm-multinode in the gate queue with an unrecognized error13:33
*** wznoinsk has quit IRC13:34
*** wznoinsk has joined #openstack-qa13:35
*** yolanda has quit IRC13:36
*** jpena|lunch is now known as jpena13:37
*** Poornima has quit IRC13:39
*** ddieterly is now known as ddieterly[away]13:43
*** yolanda has joined #openstack-qa13:43
*** Yogi1 has joined #openstack-qa13:44
*** yfried has quit IRC13:47
*** david-lyle_ has joined #openstack-qa13:48
*** mtanino has quit IRC13:49
*** bauzas_off is now known as bauzas13:49
*** mriedem1 has joined #openstack-qa13:49
*** david-lyle has quit IRC13:50
*** ddieterly[away] is now known as ddieterly13:50
jordanPhum anyone knows why http://status.openstack.org//openstack-health/#/test/tempest.api.identity.admin.test_users_negative.UsersNegativeTestJSON.test_get_users_request_without_token?groupKey=project&resolutionKey=hour&end=2016-05-09T13:47:08.020Z13:52
jordanPreports "no data available" ?13:52
*** mriedem has joined #openstack-qa13:52
*** itzkb_ has quit IRC13:54
*** mriedem1 has quit IRC13:54
*** markvoelker has quit IRC13:55
*** porrua has joined #openstack-qa13:56
*** edmondsw has joined #openstack-qa13:57
*** mriedem1 has joined #openstack-qa13:59
*** mriedem has quit IRC14:00
*** shausy has quit IRC14:00
*** itzikb has joined #openstack-qa14:01
*** sigmavirus24_awa is now known as sigmavirus2414:06
*** minwang2 has joined #openstack-qa14:07
*** ramishra has quit IRC14:08
*** ramishra has joined #openstack-qa14:09
*** mfisher_ora has joined #openstack-qa14:10
*** rbak has joined #openstack-qa14:11
*** jecarey has joined #openstack-qa14:12
openstackgerritJordan Pittier proposed openstack/tempest: WIP : also log Auth-Token  https://review.openstack.org/31412114:14
*** gszasz has quit IRC14:16
*** sabeen has joined #openstack-qa14:20
*** zz_dimtruck is now known as dimtruck14:21
*** yaume_ has quit IRC14:24
*** yaume has joined #openstack-qa14:25
*** pglass has joined #openstack-qa14:28
openstackgerritJordan Pittier proposed openstack/tempest: Add cleanup in identity/test_users_negative.py  https://review.openstack.org/31413014:28
openstackgerritSagi Shnaidman proposed openstack-infra/elastic-recheck: Add bug for TripleO timeouts  https://review.openstack.org/31303814:29
openstackgerritSean M. Collins proposed openstack-dev/devstack: Begin new lib/neutron  https://review.openstack.org/16843814:31
*** cargonza has quit IRC14:32
*** amotoki has quit IRC14:34
mtreinishjordanP: that gets displayed if there is no data being returned from the api server14:35
mtreinishmy guess is that test hasn't been run in the past month (or there is no data in the db for the past month for it)14:36
mtreinishlet me manually query the db and I'll check14:36
jordanPmtreinish, the test is run all the time14:37
jordanPI think it's flacky so I want to dig more14:37
mtreinishjordanP: ah, so that's the wrong test it was moved into a v2 subdir at some point > 6months ago14:38
mtreinishjordanP: http://status.openstack.org//openstack-health/#/test/tempest.api.identity.admin.v2.test_users_negative.UsersNegativeTestJSON.test_get_users_request_without_token?groupKey=project&resolutionKey=day&end=2016-05-09T13:47:08.020Z&duration=P3M14:38
mtreinishthat's the link you want14:38
mtreinishthe other one was a ref to the old name which doesn't have any data for graphing (just the aggregate stuff remains)14:39
*** mtanino has joined #openstack-qa14:39
jordanPmtreinish, thanks !14:40
*** Guest78756 has quit IRC14:42
*** EinstCrazy has joined #openstack-qa14:42
jordanPmtreinish, while you are here. I have a couple of Python 3 patches to Tempest: https://review.openstack.org/#/q/project:openstack/tempest+message:PY3+status:open14:44
jordanPwhat do you think ?14:44
*** dkranz has quit IRC14:45
jordanPand also if you could readd your +1 to https://review.openstack.org/#/c/312172/ Change urllib3 version to urllib3>=1.15 that would be great14:45
*** gszasz has joined #openstack-qa14:46
*** dkranz has joined #openstack-qa14:48
mtreinishjordanP: on the python3 stuff I'm +2, but I need to think about the extra hacking rules some more14:48
*** ddieterly is now known as ddieterly[away]14:49
mtreinishI'm not sure we want to add the rules if they're not perfect matches14:49
jordanPthe general idea is: if I think the occurence of the python 3 incompatible statement can appear again or is not super trivial to fix, add a hacking rule14:49
*** woodster_ has joined #openstack-qa14:49
jordanPotherwise we can fix this on the fly14:49
openstackrecheckopenstack/nova change: https://review.openstack.org/263804 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error14:52
jordanP^^ perfect !14:53
jordanPjust the race I am tracking right now14:53
*** ddieterly[away] is now known as ddieterly14:53
jordanPI think we have a serious problem here14:54
jordanPmessage:"self.assertRaises(lib_exc.Unauthorized, self.users_client.list_users)"14:54
jordanPshow 30 failures in the last 7 days14:54
jordanPI feel it's related to fernet token which landed 10 days ago14:54
*** mriedem1 is now known as mriedem14:54
jordanPalready brought this on #openstack-keystone14:54
jordanPbut we can't reproduce locally14:54
lbragstadjordanP agreed - bknudson dolphm and myself each setup environments locally but we could reproduce it all weekend14:55
lbragstadcouldn't*14:55
jordanPyeah me too, havent"t had luck so far14:55
*** zackf has quit IRC14:56
*** itzikb has quit IRC14:56
jordanPI have this https://review.openstack.org/#/c/314121/ to also log the token14:56
jordanPto see if the same token that was deleted is reused14:56
jordanPas expected14:56
lbragstadjordanP oh - nice14:57
lbragstadjordanP did you notice anything out of the ordinary with that?14:58
jordanPlbragstad, with what ?14:58
mtreinishlbragstad: that fernet switchover has been nothing but trouble....14:58
lbragstadjordanP logging the token14:58
*** minwang2 has quit IRC14:58
jordanPso far Jenkins has not ran yet so the results are not available14:58
jordanPthey will be in 20min or so14:58
lbragstadjordanP cool - i'll keep an eye on it14:59
jordanPit's as if the delete token statement returned but still the token is not deleted and can be reused in the next 100ms or so15:00
jordanPmaybe some kind of cache15:00
jordanPbut there's still a small chance that's a bug in Tempest15:00
bknudsonI didn't get a chance to look at the tempest logs so that's probably the next thing I'd do. Maybe there's some more logging that would help15:00
lbragstadjordanP I was seeing it a lot within the test_roles_negative tests - https://github.com/openstack/tempest/blob/87e64c4af4f5b7d28d8cdfe14f8e7c402581f9f2/tempest/api/identity/admin/v2/test_roles_negative.py#L39-L46 but it sounds like the same pattern you described15:04
jordanPthe tempest logs are quite clear, only filter at INFO level15:04
jordanPyou can see a DELETE token statement15:04
jordanPand a few ms after a GET orDELETE that succeeds but it should have failed15:05
bknudsonwe must be doing something wrong if we can't recreate.15:07
lbragstadyeah15:07
bknudsonsounds like it should be simple15:08
lbragstadbknudson did you try to reproduce with the tempest test or did you use your own test?15:08
bknudsonlbragstad: I used my own test.15:08
*** gouthamr has joined #openstack-qa15:08
lbragstadbknudson ok - I looped a failing tempest test and also looped the entire identity tempest api suite15:09
*** yolanda has quit IRC15:09
*** gouthamr_ has joined #openstack-qa15:10
jordanPsame here15:10
openstackgerritMarcus V R Nascimento proposed openstack/tempest: Adds clone/snapshot volume test for create volume  https://review.openstack.org/31006115:11
bknudsonmaybe we're running with a different config15:11
bknudsoncaching or something15:12
openstackgerritRafael Folco proposed openstack-dev/devstack: [WIP] Enable MariaDB for Ubuntu  https://review.openstack.org/31408715:12
*** zackf has joined #openstack-qa15:13
*** r-mibu has quit IRC15:13
*** r-mibu has joined #openstack-qa15:14
*** gouthamr has quit IRC15:14
*** gouthamr_ is now known as gouthamr15:14
*** EinstCrazy has quit IRC15:18
*** yolanda has joined #openstack-qa15:19
*** ddieterly is now known as ddieterly[away]15:20
*** davideagnello has joined #openstack-qa15:24
*** ddieterly[away] is now known as ddieterly15:26
*** fnaval has joined #openstack-qa15:27
*** yaume has quit IRC15:28
*** vhosakot has joined #openstack-qa15:28
*** yaume has joined #openstack-qa15:28
*** Swami has joined #openstack-qa15:29
*** dwalleck has joined #openstack-qa15:29
*** dtantsur is now known as dtantsur|bbl15:37
*** samueldmq has joined #openstack-qa15:39
*** minwang2 has joined #openstack-qa15:40
samueldmqlbragstad: jordanP: any update on bug 1578866 ?15:40
openstackbug 1578866 in OpenStack Identity (keystone) "test_user_update_own_password failing intermittently" [High,Confirmed] https://launchpad.net/bugs/157886615:40
jordanPsamueldmq, jenkins just passed on https://review.openstack.org/#/c/314121/15:42
jordanPlemme find the relevant log15:42
samueldmqjordanP: that is the thing we were talking aobut earlier ?15:42
jordanPyes15:42
jordanPso it looks like the same token is used15:43
*** jogo has quit IRC15:43
jordanPi.e the token that is deleted is reused to do an subsequent operation15:43
jordanPhttp://logs.openstack.org/21/314121/1/check/gate-tempest-dsvm-full-mitaka/92de074/logs/tempest.txt.gz#_2016-05-09_14_46_44_34715:43
jordanPtoken is 9f2b285c31b545215:44
*** cdent has quit IRC15:44
*** jogo has joined #openstack-qa15:44
jordanPbut in that run, the  subsequent operation is denied with a 401, as expected15:44
lbragstadjordanP cool - so that's reassuring15:45
jordanPwhat makes me feel it's a fernet thing is that, out of the 30 failures they all affected the "master" branch of the project15:45
jordanPnever mitaka or liberty15:46
lbragstadjordanP so now we're sure that it's a race condition15:46
lbragstadin keystone15:46
jordanPand the fernet switch have only been made in devstack master15:46
lbragstadjordanP right - but revocation is handled differently depending on what token provider you use in keystone15:46
jordanPas Tempest is branchless, if it was a tempest bug, it should have affected all branches15:46
lbragstadjordanP ah, right15:47
samueldmqjordanP: why is that ID different from the one you passed me earlier ?15:47
jordanPwhich id ?15:47
samueldmqjordanP: lbragstad: this one seems to be UUID while the other was a fernet?15:47
samueldmqnow is 9f2b285c31b5452b9a327551ce45585115:48
jordanPno no, I only gave you the first 15 bytes15:48
openstackgerritLiron Kuchlani proposed openstack/tempest: Snapshot list using 'limit' parameter  https://review.openstack.org/29939315:48
lbragstadjordanP we're only logging enough of the token to make assumption that we're dealing with the same one15:48
lbragstadan assumption*15:48
samueldmqcompare the requests15:49
jordanPthe full token is too big to be logged so I only logged first 15 bytes and last 15 bytes15:49
samueldmqhttp://127.0.0.1:35357/v2.0/tokens/gAAAAABXMGnluQ1tzfT1XOAIs9jn6pwTdQu8dvE6xIsxtN8aW3k8Qz8l64mfOwT1Ifg8T85RekwrVYW2KidG6AcsDI0RHI_0GQ66_UKTfBMdmFhd8jr3nSz4-atUQPWOOOHnc-g0fEqXXnX5LzZAiTL6nP7GIEIn8RaO2gjr5S3snQSzIQPelMk15:49
samueldmqagainst:15:49
samueldmqhttp://127.0.0.1:35357/v2.0/tokens/9f2b285c31b5452b9a327551ce45585115:49
jordanPyeah my bad !15:49
jordanPI took it from a mitaka job15:49
jordanPwhich use uuid15:49
samueldmqgate-tempest-dsvm-full-mitaka15:50
jordanPbut tempest is branch less so the tempest logic is the same15:50
jordanPonly the token format changed15:50
jordanPexample for the master branch of keystone: http://logs.openstack.org/21/314121/1/check/gate-tempest-dsvm-full/71050d4/logs/tempest.txt.gz?level=DEBUG#_2016-05-09_14_58_55_28715:52
jordanPfernet token starts with gAAAAABXMKWmpnscB6j15:52
jordanPnow I can leave a couple of "recheck" on that review and hopefully the race will show up15:53
*** gouthamr_ has joined #openstack-qa15:56
*** armax has joined #openstack-qa15:56
*** davideagnello has quit IRC15:58
*** gouthamr has quit IRC15:58
*** sridharg has quit IRC16:01
*** tesseract has quit IRC16:01
samueldmqjordanP: btw it'd be helpful if tempest always logged that token info when DEBUG is on ? at least for devstack and our gates16:03
mtreinishsamueldmq: is that really useful? we have to weigh it against the increased verbosity and log output size16:04
mtreinishI'm not sure having all of that is generally useful enough16:04
*** ramishra_ has joined #openstack-qa16:04
*** pcrews__ has quit IRC16:04
mtreinishbut I could be wrong16:04
*** pcrews has joined #openstack-qa16:05
samueldmqmtreinish: something is already logged, it's only a matter of not ommiting the x-auth-token16:05
samueldmqmtreinish: https://github.com/openstack/tempest-lib/blob/master/tempest_lib/common/rest_client.py#L40216:05
*** rcernin has quit IRC16:06
samueldmqomitting*16:06
mtreinishsamueldmq: right, and I'm saying that's gonna end up in a lot more data being generated16:06
mtreinishhow many api requests does tempest make during a run?16:06
mtreinishthe tempest log file is already ~25M uncompressed16:06
*** ramishra has quit IRC16:07
samueldmqmtreinish: you mean logging len(token) rather than len('<omitted>') ?16:07
mtreinishyes16:08
samueldmqmtreinish: that information would help us now to determine the issue was in keystone16:08
mtreinishin debugging this 1 issue. I'm saying is it generally useful enough information to warrant increasing our log size16:09
jordanPthat info would also benefit andreaf by the look of https://review.openstack.org/#/c/255815/1116:09
mtreinishsamueldmq: it's really (len(token) - len('<omitted>')) * # of api requests that I'm worried about16:10
samueldmqmtreinish: I don't know about other cases .. but I know in this case it would be a great information16:10
mtreinishsamueldmq: or that number * # of runs per day (which is about 12k)16:10
samueldmqmtreinish: what about reducing other fixed strings like : "Request - Headers:" -> "Headers:" (we already know it's the headers of the request16:11
samueldmqand also "Starting Request (%s): %s %s" -> "Starting (%s): %s %s" (it's obvious a request is the thing starting there)16:11
mtreinishsamueldmq: we can't do that because we log requests and responses and logs are interleved16:11
mtreinishso we need to match things up16:12
jordanPyes, confirmed16:12
samueldmqmtreinish: yes, what you said makes sense16:13
samueldmqjordanP: confirmed what?16:13
jordanP we can't do that because we log requests and responses and logs are interleved16:13
jordanPotherwise, is was a good idea16:13
samueldmqmtreinish: however that info will help in all potential problems we have with revocations, ec16:13
samueldmqwith tokens in general, because we will ensure it isn't a tempest issue16:14
mtreinishsamueldmq: I'm not saying we can't add the extra logging, I'm just saying we need to think of the larger implications of something like that16:14
jordanPyeah I am in favor of this too. Let's see if we can save a couple of bytes here and here to make room for this16:14
jordanP'Content-Type': 'application/json', 'Accept': 'application/json' is logged 13k times16:14
jordanPif we could replace it with 'Content-Type': 'a/j, 'Accept': 'a/j'... that's ugly I know16:15
samueldmqmtreinish: gotcha, I understand the implication16:15
samueldmqjordanP: not sure that's the right way to save things ... we'll make it not understandable that way16:16
*** dwalleck has quit IRC16:16
mtreinishjordanP: we might be able to drop those lines, that header info was useful when there was xml on the wire16:16
mtreinishbut I'm not sure we care about the content-type if it's almost always json16:17
jordanPwell you figured out that auth-token: <omittied> was a substitute by Tempest16:17
jordanPin 2min, so you would as quickly figured out that tempest replaces application/json with a/j16:17
samueldmqjordanP: maybe just dropping those ? as mtreinish just said ?16:17
*** cdent has joined #openstack-qa16:17
jordanPI think it's application/json 99.9% of the time, but not always16:18
samueldmqkeystone side is always json16:18
mtreinishjordanP: so to be fair that omitted thing for the auth token was two fold, first the tokens can get gigantic depending on the provider16:18
mtreinishand secondly there was a potential sec implication depending on how tokens are setup on the cloud16:18
openstackgerritDrew Thorstensen proposed openstack-dev/devstack: WIP: Switch to neutron OVS networks as the default  https://review.openstack.org/31179316:18
jordanPyeah yeah, I know16:18
jordanPI am not advocating for logging the full token :)16:18
samueldmqmtreinish: in the security side, what about that being a tempest option ? (whether to log the token or not)16:19
samueldmqand also not logging the full token, as jordanP said, so we will always have a fixed length16:19
jordanPit would have to be set to True in the Gate and the logs would grow16:19
samueldmqjordanP: yes, that only solves the security side16:20
openstackgerritDrew Thorstensen proposed openstack-dev/devstack: WIP: Switch doc to use to neutron by default.  https://review.openstack.org/31179316:21
samueldmqjordanP: have you seen any failure where a stable branch fails as well ?16:21
samueldmqjordanP: or where only a stable branch fails ?16:21
pglasscould tempest log a hash of of the token?16:21
jordanPno, 0 failure on a stable branch16:21
*** ihrachys has joined #openstack-qa16:21
jordanPa hash doesn"t give us much more than just logging the first/last 10 bytes16:23
jordanPdoes it ?16:23
mtreinishpglass: we could, but it doesn't necessarily solve the sec issue depending on how we hash it16:23
* mtreinish seems to remember having this exact discussion a long time ago16:24
pglassthat's true. I know from looking at openstack client debug logs, the token is always logged as `X-Auth-Token: {SHA1}9211a8090fca73092823b8a7aed8a105ac135ef3`16:24
*** apoorvad has joined #openstack-qa16:24
pglassone other thing I've noticed tempest do, is log the response body of a token issue, which I figure should be censored.16:25
mtreinishpglass: I thought it was, that might be a bug16:26
pglassmtreinish: well, let me double check that might be a downstream client i add to some internal tests16:26
mtreinishwe normally log all the request and response bodies at debug, but I thought tokens and passwords were omitted16:26
mtreinishit's been a while since I've looked at that so I dunno16:27
*** nadya has quit IRC16:27
pglassmtreinish: so for example: http://logs.openstack.org/64/308964/7/check/gate-tempest-dsvm-designate-bind9/7f2f3ac/logs/tempest.txt.gz#_2016-05-06_19_01_11_15316:28
pglassthat's a designate job using tempest plugin, but it's all the same auth stuff from tempest.lib16:29
mtreinishyeah, hmm16:30
mtreinishoh, I was thinking of the request side that contains the actual creds16:30
mtreinishI guess we don't actually think of it as a sec issue :)16:30
*** gouthamr_ has quit IRC16:31
pglassokay, so the omission of auth tokens from tempest logs is just to keep the log size manageable16:32
openstackgerritMarcus V R Nascimento proposed openstack/tempest: Adds clone/snapshot volume test for create volume  https://review.openstack.org/31006116:34
mtreinishyeah, I guess so16:35
openstackgerritMerged openstack-dev/devstack: Prevent spawning two VPN agents  https://review.openstack.org/31064216:35
openstackrecheckopenstack/nova change: https://review.openstack.org/312910 failed gate-grenade-dsvm in the gate queue with an unrecognized error16:36
*** rcernin has joined #openstack-qa16:37
mugsiehey - what is the best way to start developing a grenade plugin ? create a grenade/plugins/<project> folder, and start hacking on it there, or is there a better way?16:40
pglassbut okay. given the use of dynamic credentials (which always need to authenticate once the user is provisioned), tempest ends up logging those huge service catalog response bodies16:40
*** yamahata has joined #openstack-qa16:44
openstackgerritMerged openstack-dev/devstack: Revert "Update auth params in Nova Hypervisor-Ironic"  https://review.openstack.org/31402416:44
*** david-lyle_ is now known as david-lyle16:45
jlvillalsdague: FYI: https://review.openstack.org/#/c/313132/  is all tested and I no longer see error messages about 'short_source'16:48
*** Ravikiran_K has joined #openstack-qa16:49
sdaguejlvillal: thank you16:49
*** gfidente is now known as gfidente|afk16:49
*** jordanP has quit IRC16:51
*** ihrachys has quit IRC16:54
*** yaume has quit IRC16:54
*** salv-orlando has joined #openstack-qa16:55
*** ihrachys has joined #openstack-qa16:56
*** dtantsur|bbl is now known as dtantsur16:57
*** dwalleck has joined #openstack-qa17:00
*** dwalleck has quit IRC17:05
*** dwalleck has joined #openstack-qa17:05
*** yolanda has quit IRC17:06
openstackgerritMerged openstack/tempest: Fix the docstring of skip_unless_config()  https://review.openstack.org/31382817:10
openstackgerritRafael Folco proposed openstack-dev/devstack: [WIP] Enable MariaDB for Ubuntu  https://review.openstack.org/31408717:11
*** Serlex has quit IRC17:11
*** yolanda has joined #openstack-qa17:12
*** sabeen has quit IRC17:21
*** ddieterly is now known as ddieterly[away]17:23
openstackrecheckConsole logs not available after 13:33s for keystone-coverage-db 314188,1,de6b88417:24
mugsieis there any good resources for developing a grenade plugin - I am kind of fumbling in the dark right now17:25
openstackrecheckopenstack/horizon change: https://review.openstack.org/311178 failed gate-horizon-dsvm-integration in the gate queue with an unrecognized error17:30
*** davideagnello has joined #openstack-qa17:32
*** jpena is now known as jpena|off17:36
*** madhu_ak has joined #openstack-qa17:41
*** davideagnello has quit IRC17:43
*** austin81 has joined #openstack-qa17:44
*** ddieterly[away] is now known as ddieterly17:47
*** ddieterly is now known as ddieterly[away]17:47
*** harlowja has joined #openstack-qa17:48
mugsieOK - an easier question - is it possible to disable the other services in grenade? I want to test designate, which requires keystone, rabbit, and mysql - not nova, neutron, cinder, glance etc.17:52
mugsienova is failing to start for me in the mitaka branch, with something to do with networking, and I just want to skip it17:53
*** nadya has joined #openstack-qa17:53
*** tosky has quit IRC17:55
*** nadya has quit IRC17:56
*** davideagnello has joined #openstack-qa17:58
*** dtantsur is now known as dtantsur|afk18:03
*** lucasagomes is now known as lucas-dinner18:04
*** ifarkas has quit IRC18:08
*** sabeen has joined #openstack-qa18:12
*** mvk has quit IRC18:12
*** nadya has joined #openstack-qa18:22
*** nadya has quit IRC18:23
*** nadya has joined #openstack-qa18:24
openstackgerritSean M. Collins proposed openstack-dev/devstack: Begin new lib/neutron  https://review.openstack.org/16843818:26
mugsieanyone know anything about grenade?18:28
*** dwalleck has quit IRC18:29
*** salv-orlando has quit IRC18:29
sc68calmugsie: what specifically18:30
*** Guest78756 has joined #openstack-qa18:30
sc68calmugsie: http://docs.openstack.org/developer/grenade/plugins.html18:31
*** rmoats has joined #openstack-qa18:31
*** openstackgerrit has quit IRC18:33
mugsiesc68cal: yeah - I got that. but I was asking for the intial development - whats the best way to start the dev18:33
*** openstackgerrit has joined #openstack-qa18:33
mugsieand can we disable some of the default services?18:33
*** dwalleck has joined #openstack-qa18:33
sc68calmugsie: that would defeat the point.18:34
sc68calThe point is, upgrading a service shouldn't disrupt an openstack environment18:34
sc68calor break another service18:34
mugsieyeah - I am just trying to do it to test my plugin18:35
*** rmoats has quit IRC18:36
mugsienova keeps breaking locally for me right now, and I wanted to just not use it18:36
mugsie2016-05-09 17:50:58.774 | +./stack.sh:main:1233                      /usr/local/bin/nova-manage --config-file /etc/nova/nova.conf network create private 10.0.0.0/24 1 25618:36
mugsie2016-05-09 17:51:24.188 | ./stack.sh: line 1240: 22128 Segmentation fault      (core dumped) $NOVA_BIN_DIR/nova-manage --config-file $NM_CONF network create "$PRIVATE_NETWORK_NAME" $FIXED_RANGE 1 $FIXED_NETWORK_SIZE $NETWORK_CREATE_ARGS18:36
*** ddieterly[away] is now known as ddieterly18:38
*** nadya has quit IRC18:39
*** tqtran has joined #openstack-qa18:45
*** jpena|off has quit IRC18:45
sc68calI think a core dump is a serious issue that probably deserves investigation18:46
*** ajo has quit IRC18:47
*** dmellado has quit IRC18:47
*** dkranz has quit IRC18:47
*** mtanino has quit IRC18:47
*** yolanda has quit IRC18:51
*** yfried has joined #openstack-qa18:52
mugsiesc68cal: any pointers I should look at? - there was a dashboard for the -stable periodic jobs - do you know where that is, just to see if I am a one off18:52
sc68calmugsie: http://status.openstack.org/openstack-health/#/18:52
sc68calhowever a core dump is quite unusual18:53
mtreinishsc68cal: your dollar is in the mail :)18:53
sc68cal:)18:53
mtreinishsc68cal: so you +2d https://review.openstack.org/#/c/312615/1 on mitaka but not master?18:55
*** jlanoux has quit IRC18:56
sc68calah. I thought I rubber stamped the original18:56
sc68calwell make jenkins happy and I'll +2 it :)18:57
* mtreinish wonders how many rechecks it'll take18:57
*** asselin has quit IRC18:59
mtreinishdtroyer, sdague, oomichi: if you get a sec: https://review.openstack.org/#/c/312615/ should be fast19:04
mtreinishand that'll enable people to run jobs with tempest plugins and real venv isolation19:04
*** gszasz has quit IRC19:04
mugsiesc68cal: my bad - I managed to boot the VM with 2GB of RAM -_-19:07
sc68calmugsie: that would do it19:07
mugsieyeah19:07
mugsienot sure how that got into the vagrantfile19:07
*** nadya has joined #openstack-qa19:14
*** ihrachys has quit IRC19:15
*** bkopilov has joined #openstack-qa19:17
openstackgerritMatthew Treinish proposed openstack-dev/devstack: Use common tempest tox venv and add plugin install variable  https://review.openstack.org/31274419:25
*** ddieterly is now known as ddieterly[away]19:27
openstackgerritMatthew Treinish proposed openstack-dev/devstack: Use common tempest tox venv and add plugin install variable  https://review.openstack.org/31274519:31
*** nwkarsten has joined #openstack-qa19:33
*** nadya has quit IRC19:36
*** salv-orlando has joined #openstack-qa19:38
*** ksantoshk has joined #openstack-qa19:40
*** madhu_ak_ has joined #openstack-qa19:40
openstackrecheckopenstack/nova change: https://review.openstack.org/309357 failed because of: gate-tempest-dsvm-cells: https://bugs.launchpad.net/bugs/157886619:41
openstackLaunchpad bug 1578866 in OpenStack Identity (keystone) "test_user_update_own_password failing intermittently" [High,Confirmed]19:41
*** madhu_ak has quit IRC19:42
*** madhu_ak_ is now known as madhu_ak19:42
*** apevec has left #openstack-qa19:44
*** ddieterly[away] is now known as ddieterly19:50
openstackrecheckopenstack/horizon change: https://review.openstack.org/309569 failed gate-horizon-dsvm-integration in the gate queue with an unrecognized error19:52
*** weshay has quit IRC19:55
*** lucas-dinner has quit IRC20:06
*** rcernin has quit IRC20:15
*** lucasagomes has joined #openstack-qa20:16
*** lucasagomes is now known as lucas-dinner20:17
*** Yogi1 has quit IRC20:24
*** sambetts is now known as sambetts|afk20:29
*** rossella_s has quit IRC20:30
*** jeblair has quit IRC20:33
*** yfried has quit IRC20:33
*** jeblair has joined #openstack-qa20:33
*** suyash has joined #openstack-qa20:34
*** e0ne has joined #openstack-qa20:39
*** dkranz has joined #openstack-qa20:42
*** Alex_Stef has quit IRC20:42
*** Guest78756 has quit IRC20:43
*** nwkarsten has quit IRC20:44
*** nwkarsten has joined #openstack-qa20:47
*** nwkarsten has quit IRC20:47
*** nwkarsten has joined #openstack-qa20:47
*** Alex_Stef has joined #openstack-qa20:48
*** mvk has joined #openstack-qa20:57
*** porrua has quit IRC20:57
*** dwalleck has quit IRC20:57
*** salv-orlando has quit IRC20:58
*** dwalleck has joined #openstack-qa20:58
*** Ravikiran_K has quit IRC21:00
hockeynutmtreinish (and anyone else interested) I'm having a problem running tempest.scenario.test_network_basic_ops tests from my laptop tempest against a devstack VM - they time out trying to check public network connectivity.  See https://gist.github.com/sheyman/e6d081af3ea92c7e509c6544f9be9a6a.  Same tests run fine if I run from the devstack VM itself.  Possibly someone else has encountered this (and knows the magical21:03
hockeynut incantations to resolve)?21:03
mtreinishhockeynut: that's a devstack networking setup question, ask sc68cal. I rarely get it right either21:05
mtreinishbut it sounds like however you configured it, you don't actually have publically addressable vms in the devstack cloud21:05
mtreinishwhich is a requirement for some of the tempest tests (there a bunch of options to tempest to tell it how to talk to vms)21:06
hockeynuttyvm mtreinish - I'm still coming up to speed w/neutron, its a scary place :-)21:06
*** dwalleck has quit IRC21:08
mtreinishhockeynut: there could be a bug in lib/tempest in devstack too, where it's not configuring tempest correctly. (in other words you can get public networking to your vms but devstack is configuring tempest incorrectly so tempest does it wrong)21:08
hockeynutah, ok mtreinish - I can dig around21:09
mtreinishwe've had issues there in the past because of how weird the current devstack neutron stuff is, but it's hard to say one way or the other21:09
hockeynutI am using a script that my esteemed collegue fnaval wrote which brings up my devstack w/neutron and its wonderful with this one small exception.  Everything works great if I just stay on the the devstack VM but I really like my pycharm21:10
fnavalah, the vms may be only accessible from the devstack box, hence not being publicly avaiable.   hmmm21:12
openstackrecheckopenstack/horizon change: https://review.openstack.org/295884 failed gate-horizon-dsvm-integration in the gate queue with an unrecognized error21:13
fnavaltie the vms to specific ports on the devstack box?21:13
*** jecarey has quit IRC21:14
hockeynutfnaval maybe some iptables magic on the vm?21:14
fnavalor just run devstack locally21:14
hockeynutI refuse to give in :-)21:15
fnavalhockeynut: or ssh tunnel in21:15
fnavalproxy via localhost21:15
fnavalthat should probably work21:16
fnavalwithout modifying anything in the devstack instance21:17
*** pauloewerton has quit IRC21:17
*** aysyd has quit IRC21:22
*** edmondsw has quit IRC21:29
*** jecarey has joined #openstack-qa21:29
*** shardy has quit IRC21:33
*** cdent has quit IRC21:33
*** jecarey has quit IRC21:34
prometheanfireso... https://review.openstack.org/#/c/310838 (devstack, just needs one more +2, been waiting a while..., blocking other work...)21:34
*** e0ne has quit IRC21:42
*** mriedem is now known as mriedem_afk21:50
openstackgerritMerged openstack/stackviz: Add service to summarize different artifact types  https://review.openstack.org/31089321:50
*** Swami_ has joined #openstack-qa21:52
*** yamahata has quit IRC21:52
*** Swami has quit IRC21:55
*** Swami_ has quit IRC21:58
*** itzikb has joined #openstack-qa21:58
*** salv-orlando has joined #openstack-qa21:58
*** salv-orlando has quit IRC22:03
*** amotoki has joined #openstack-qa22:03
*** gfidente|afk has quit IRC22:04
*** bkopilov has quit IRC22:09
*** dimtruck is now known as zz_dimtruck22:10
*** zz_dimtruck is now known as dimtruck22:10
*** itzikb has quit IRC22:12
*** jecarey has joined #openstack-qa22:16
*** bkopilov has joined #openstack-qa22:18
*** ddieterly is now known as ddieterly[away]22:19
*** austin81 has left #openstack-qa22:19
*** dimtruck is now known as zz_dimtruck22:20
*** jecarey has quit IRC22:20
*** nwkarsten has quit IRC22:21
*** dave-mccowan has quit IRC22:22
*** nwkarsten has joined #openstack-qa22:22
*** ddieterly[away] is now known as ddieterly22:23
*** sigmavirus24 is now known as sigmavirus24_awa22:24
openstackrecheckopenstack/horizon change: https://review.openstack.org/294289 failed gate-horizon-dsvm-integration in the gate queue with an unrecognized error22:26
*** nwkarste_ has joined #openstack-qa22:27
*** nwkarsten has quit IRC22:27
*** itzikb has joined #openstack-qa22:27
*** salv-orlando has joined #openstack-qa22:29
*** dustins has joined #openstack-qa22:30
*** nwkarste_ has quit IRC22:31
*** ddieterly has quit IRC22:33
*** salv-orlando has quit IRC22:35
*** jamielennox|away is now known as jamielennox22:35
*** Swami has joined #openstack-qa22:37
*** sambetts|afk has quit IRC22:43
*** sambetts has joined #openstack-qa22:47
*** sdague has quit IRC22:58
*** dwalleck has joined #openstack-qa22:59
*** pglass has quit IRC23:00
*** rbak has quit IRC23:00
*** dwalleck has quit IRC23:04
*** dwalleck has joined #openstack-qa23:05
openstackgerritAndrea Frittoli proposed openstack/tempest: Introduce scope in the auth API  https://review.openstack.org/31317123:10
openstackgerritAndrea Frittoli proposed openstack/tempest: Debugging v3 token client  https://review.openstack.org/31386923:10
openstackgerritAndrea Frittoli proposed openstack/tempest: Use scope in v3 identity client  https://review.openstack.org/22102023:10
openstackgerritAndrea Frittoli proposed openstack/tempest: Add admin role on domain for v3  https://review.openstack.org/22629723:10
*** zz_dimtruck is now known as dimtruck23:11
*** vhosakot has quit IRC23:13
openstackrecheckConsole logs not available after 13:26s for gate-horizon-tox-py27dj19 305479,12,8a4735923:15
*** madhu_ak has quit IRC23:15
*** nwkarsten has joined #openstack-qa23:20
*** nwkarsten has quit IRC23:25
*** tochi has joined #openstack-qa23:34
*** dustins has quit IRC23:34
*** minwang2 has quit IRC23:36
*** salv-orlando has joined #openstack-qa23:37
*** dustins has joined #openstack-qa23:39
*** dustins has quit IRC23:39
*** dustins has joined #openstack-qa23:39
openstackrecheckopenstack/cinder change: https://review.openstack.org/313584 failed gate-tempest-dsvm-full-devstack-plugin-ceph in the gate queue with an unrecognized error23:40
*** salv-orlando has quit IRC23:42
*** Gen has joined #openstack-qa23:43
*** Gen has quit IRC23:44
*** dustins has quit IRC23:44
openstackgerritLance Bragstad proposed openstack/tempest: WIP: add logging for bug 1578866  https://review.openstack.org/31433023:46
openstackbug 1578866 in OpenStack Identity (keystone) "test_user_update_own_password failing intermittently" [High,Confirmed] https://launchpad.net/bugs/157886623:46
*** ddieterly has joined #openstack-qa23:51
*** ddieterly is now known as ddieterly[away]23:55
openstackgerritJohn L. Villalovos proposed openstack-dev/grenade: WIP: Debug code  https://review.openstack.org/31433423:57
*** armax has quit IRC23:57
*** ksantoshk has quit IRC23:58
*** hichihara has joined #openstack-qa23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!