Thursday, 2016-09-08

*** spzala has quit IRC00:00
*** spzala has joined #openstack-qa00:00
*** spzala has quit IRC00:00
*** spzala has joined #openstack-qa00:01
*** spzala has quit IRC00:01
*** spzala has joined #openstack-qa00:01
*** sabeen has joined #openstack-qa00:03
*** spzala has quit IRC00:04
mtreinishtonyb: in tempest? or in general?00:16
tonybmtreinish: tempest00:17
*** yangyapeng has quit IRC00:17
mtreinishtonyb: so normally we tell people to skip via the test runner you use00:17
tonybmtreinish: but it turns out of the CI in question sets 2 (tempest) config options the test will "just work"00:17
mtreinishbut if it's for a configurable openstack feature there is likely a config option to switch it on or off00:17
mtreinishtonyb: http://docs.openstack.org/developer/tempest/configuration.html00:18
mtreinishwhich options00:18
mtreinishit really depends on the test and the options00:18
tonybmtreinish: I41c09d5a682cdb068b97b4bd1be3403ee7973c7c is the review that added the new options that have poor defaults for thr CI in question00:19
tonybmtreinish: I don't normally care about it but $employer would like the see a +1 vote on a liberty backport00:19
mtreinishwow, that review takes me back00:20
mtreinishI remember discussing that on irc00:20
*** sabeen has quit IRC00:21
mtreinishtonyb: I've actually been trying to clean up that section of config again it's kinda of a tangled ball of yarn still00:21
mtreinishso much so I documented it :)00:21
mtreinishtonyb: http://docs.openstack.org/developer/tempest/configuration.html#images00:21
mtreinishthe second half00:21
tonybmtreinish: Thanks!00:22
mtreinishtonyb: so the ci in question (which one is it?) uses a non-qcow2 image and teh defaults fail on them00:23
tonybXenServer00:23
tonyb[ http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/31/329231/3/check/dsvm-tempest-nova-network/b323a09/run_tests.log ]00:23
*** tochi has quit IRC00:23
*** Apoorva_ has joined #openstack-qa00:24
mtreinishtonyb: ah, yeah that's a config bug on the ci (likely in their devstack) http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/31/329231/3/check/dsvm-tempest-nova-network/b323a09/logs/tempest_conf.txt.gz00:24
tonybmtreinish: Yeah I started unrollign the ball of twine and found that too00:25
mtreinishit's quite clearly configuring tempest to upload an image and not specifiying a non-qcow format (although I'm pretty sure that disk image is qcow)00:25
*** trisq has joined #openstack-qa00:26
*** Apoorva has quit IRC00:27
mtreinishtonyb: one thing to check is if this was applied on their devstack checkout: https://review.openstack.org/#/c/358201/00:28
mtreinishthat was a revert of my attempt to switch devstack to use qcow by default (which is long overdue)00:28
mtreinishit blew up on grenade in an unexpected way and we had to revert it00:28
*** Apoorva_ has quit IRC00:28
mtreinishbut a change in default like that could break a xen ci very easily if people weren't looking for it00:28
*** sabeen has joined #openstack-qa00:28
*** tochi has joined #openstack-qa00:29
mtreinishfwiw, that is going to happen eventually probably in early ocata when we can sit down and make sure it doesn't break the gate when we land it00:29
*** harlowja has joined #openstack-qa00:29
tonybmtreinish: Cool.  I'll include that in my email when I poke them00:30
mtreinishtonyb: so making the xenserver ci's localrc/local.conf opinionated in it's images is good future proofing either way00:30
mtreinishtonyb: the end game is this: https://review.openstack.org/#/c/338377/00:30
mtreinishwhich requires all of those pieces in devstack to land first00:31
tonybmtreinish: +100:32
openstackgerritzhufl proposed openstack/tempest: Update Available para link of keystone v3 client  https://review.openstack.org/36660100:37
*** tqtran has quit IRC00:39
*** akshai has joined #openstack-qa00:39
*** ddieterly has joined #openstack-qa00:44
*** spzala has joined #openstack-qa00:48
*** akshai has quit IRC00:48
*** gyee_ has quit IRC00:48
*** gouthamr_ has quit IRC00:51
openstackgerritGhanshyam Mann proposed openstack/tempest: Define separate inherited_roles_client for inherited roles  https://review.openstack.org/36585900:56
openstackgerritMerged openstack-dev/devstack: Keystone re-enable catalog caching  https://review.openstack.org/36394800:59
*** dimtruck is now known as zz_dimtruck01:00
*** rfolco has quit IRC01:02
*** akshai has joined #openstack-qa01:03
*** trisq has quit IRC01:03
*** zz_dimtruck is now known as dimtruck01:06
*** gouthamr has joined #openstack-qa01:06
openstackgerritGhanshyam Mann proposed openstack/tempest: Move v3 roles_client to library interface  https://review.openstack.org/36661101:10
*** pvaneck has quit IRC01:11
openstackgerritGhanshyam Mann proposed openstack/tempest: Move v3 inherited_roles_client to library interface  https://review.openstack.org/36664101:15
*** yangyapeng has joined #openstack-qa01:19
openstackgerritGhanshyam Mann proposed openstack/tempest: Move v3 inherited_roles_client to library interface  https://review.openstack.org/36664101:19
openstackgerritGhanshyam Mann proposed openstack/tempest: Move v3 inherited_roles_client to library interface  https://review.openstack.org/36664101:22
*** salv-orlando has joined #openstack-qa01:23
*** gvrangan has quit IRC01:24
*** salv-orlando has quit IRC01:26
*** trisq has joined #openstack-qa01:29
*** ddieterly has quit IRC01:35
*** tqtran has joined #openstack-qa01:36
*** armax has quit IRC01:36
*** tqtran has quit IRC01:40
*** openstack has joined #openstack-qa01:43
*** sabeen has quit IRC01:44
*** ddieterly has quit IRC01:46
*** sabeen has joined #openstack-qa01:46
*** gouthamr has quit IRC01:48
*** gouthamr has joined #openstack-qa01:49
*** clu_ has quit IRC02:01
*** spzala has quit IRC02:04
*** spzala has joined #openstack-qa02:05
*** ddieterly has joined #openstack-qa02:06
*** spzala has quit IRC02:07
*** spzala has joined #openstack-qa02:07
*** bkopilov has quit IRC02:10
*** bkopilov_ has quit IRC02:10
*** dimtruck is now known as zz_dimtruck02:14
openstackgerritMatthew Treinish proposed openstack-dev/devstack: Revert "Revert "Switch devstack to use qcow cirros img""  https://review.openstack.org/36704802:14
openstackgerritMatthew Treinish proposed openstack-dev/devstack: Revert "Revert "Switch devstack to use qcow cirros img""  https://review.openstack.org/36704902:15
*** gyx has joined #openstack-qa02:16
*** ddieterly has quit IRC02:19
*** yamahata has quit IRC02:21
*** ddieterly has joined #openstack-qa02:22
*** Swami has quit IRC02:25
openstackgerritMatthew Treinish proposed openstack/tempest: Migrate is_extension_enabled to helper module  https://review.openstack.org/36690102:26
openstackgerritMatthew Treinish proposed openstack/tempest: Remove 404 logic on secgroup deletion in dynamic creds cleanup  https://review.openstack.org/36690202:26
*** yangyape_ has joined #openstack-qa02:26
*** yangyap__ has joined #openstack-qa02:28
openstackgerritSteve Martinelli proposed openstack-dev/devstack: Switch fernet to be the default token provider  https://review.openstack.org/36705202:29
*** yangyapeng has quit IRC02:29
openstackgerritSteve Martinelli proposed openstack-dev/devstack: DO NOT MERGE!! Switch fernet to be the default token provider  https://review.openstack.org/36705202:29
*** yangyape_ has quit IRC02:32
*** salv-orlando has joined #openstack-qa02:33
*** spzala has quit IRC02:33
*** spzala has joined #openstack-qa02:33
*** armax has joined #openstack-qa02:34
*** spzala has quit IRC02:35
*** spzala has joined #openstack-qa02:35
*** ddieterly has quit IRC02:41
*** salv-orlando has quit IRC02:43
*** spzala has quit IRC02:50
*** spzala has joined #openstack-qa02:51
*** spzala has quit IRC02:55
*** yangyap__ has quit IRC03:21
*** tochi has quit IRC03:27
*** bkopilov_ has joined #openstack-qa03:28
*** bkopilov has joined #openstack-qa03:28
*** salv-orlando has joined #openstack-qa03:42
*** rfolco has joined #openstack-qa03:44
*** rfolco has quit IRC03:47
*** salv-orlando has quit IRC03:49
*** tochi has joined #openstack-qa03:52
*** hoangcx has joined #openstack-qa03:52
*** jgriffith is now known as jgriffith_away04:00
*** rbak has joined #openstack-qa04:03
*** rbak has quit IRC04:05
*** gvrangan has joined #openstack-qa04:06
*** sabeen has quit IRC04:18
*** rfolco has joined #openstack-qa04:20
*** amotoki has joined #openstack-qa04:23
*** k4n0 has joined #openstack-qa04:27
*** k4n0 is now known as k4n0_away04:28
*** Alex_Stef has joined #openstack-qa04:28
*** yangyapeng has joined #openstack-qa04:30
*** markvoelker has quit IRC04:30
*** markvoelker has joined #openstack-qa04:31
*** hieulq has quit IRC04:35
*** hieulq has joined #openstack-qa04:35
*** woodster_ has quit IRC04:39
openstackgerritMerged openstack/tempest: Update Available para link of network client  https://review.openstack.org/36647104:48
*** salv-orlando has joined #openstack-qa04:52
*** pgadiya has joined #openstack-qa04:52
openstackgerritCao Xuan Hoang proposed openstack/tempest-lib: TrivialFix: Remove logging import unused  https://review.openstack.org/36707804:52
*** akshai has quit IRC04:58
*** salv-orl_ has joined #openstack-qa04:59
*** salv-orl_ has quit IRC04:59
*** salv-orlando has quit IRC04:59
*** salv-orlando has joined #openstack-qa05:00
*** chandankumar has joined #openstack-qa05:05
*** sshnaidm|afk has quit IRC05:07
*** itzikb has joined #openstack-qa05:22
*** itzkb_ has joined #openstack-qa05:24
*** itzikb has quit IRC05:24
*** spzala has joined #openstack-qa05:27
*** AmitGalitz has joined #openstack-qa05:31
*** spzala has quit IRC05:31
*** rfolco has quit IRC05:32
*** tqtran has joined #openstack-qa05:38
*** tqtran has quit IRC05:42
*** _nadya_ has joined #openstack-qa05:55
*** gouthamr has quit IRC05:55
*** _nadya_ has quit IRC05:56
openstackgerritGhanshyam Mann proposed openstack/tempest: Move v3 roles_client to library interface  https://review.openstack.org/36661105:56
*** gouthamr has joined #openstack-qa05:56
openstackgerritGhanshyam Mann proposed openstack/tempest: Move v3 inherited_roles_client to library interface  https://review.openstack.org/36664105:57
openstackgerritGhanshyam Mann proposed openstack/tempest: Define separate inherited_roles_client for inherited roles  https://review.openstack.org/36585905:57
openstackgerritGhanshyam Mann proposed openstack/tempest: Move v3 roles_client to library interface  https://review.openstack.org/36661105:58
*** hferenc has joined #openstack-qa05:58
hferenchi all05:58
hferencwill there be a qa team meeting today?05:58
*** Ravikiran_K has joined #openstack-qa06:04
openstackgerritzhufl proposed openstack/tempest: Update Available para link of keystone v3 client  https://review.openstack.org/36660106:04
*** paul-carlton2 has joined #openstack-qa06:07
*** grafuls has joined #openstack-qa06:11
*** gvrangan has quit IRC06:14
*** gvrangan has joined #openstack-qa06:20
masayukighferenc : yeah, there will be. gmann will send an email for it :)06:21
*** gcheresh has joined #openstack-qa06:22
*** e0ne has joined #openstack-qa06:22
*** _nadya_ has joined #openstack-qa06:24
hferencmasayukig: ok, thx! is it going to be at 9:00UTC or at 17:00UTC again?06:24
masayukighferenc : in 2.5 hours (I'm not familiar with UTC, actually :-p)06:26
*** yamahata has joined #openstack-qa06:26
masayukigand you can check it on http://eavesdrop.openstack.org/#QA_Team_Meeting and06:26
masayukighttp://eavesdrop.openstack.org/calendars/qa-team-meeting.ics06:26
*** gyx has quit IRC06:27
gmannhferenc: 9 UTC, just sent mail06:28
masayukiggmann : thanks!06:28
masayukighferenc : Here's the agenda https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_September_8th_2016_.280900_UTC.2906:28
hferencyeah, i saw that the wiki page just got updated06:28
*** gyx has joined #openstack-qa06:29
hferencthanks guys06:30
*** gvrangan has quit IRC06:33
openstackgerritGhanshyam Mann proposed openstack/tempest: Move v3 inherited_roles_client to library interface  https://review.openstack.org/36664106:34
openstackgerritzhufl proposed openstack/tempest: Wait for port to finish building when getting server ip  https://review.openstack.org/36711306:35
*** chandankumar has quit IRC06:41
*** gouthamr_ has joined #openstack-qa06:47
*** gouthamr has quit IRC06:51
*** _nadya_ has quit IRC06:51
*** gamado has joined #openstack-qa06:52
*** jpena|away is now known as jpena|off06:52
openstackgerritOpenStack Proposal Bot proposed openstack-dev/devstack: Updated from generate-devstack-plugins-list  https://review.openstack.org/35699106:54
*** ttx has quit IRC06:54
*** salv-orlando has quit IRC06:54
*** ttx has joined #openstack-qa06:54
*** ttx has quit IRC06:54
*** ttx has joined #openstack-qa06:55
*** hoangcx has quit IRC06:57
openstackgerritMerged openstack/stackviz: Update home-page url  https://review.openstack.org/35617506:57
*** k4n0_away has quit IRC07:00
*** anshul has joined #openstack-qa07:00
*** trisq has quit IRC07:01
*** trisq has joined #openstack-qa07:02
*** chandankumar has joined #openstack-qa07:02
*** tesseract- has joined #openstack-qa07:04
*** trisq has quit IRC07:08
*** trisq has joined #openstack-qa07:09
*** trisq has quit IRC07:14
*** trisq has joined #openstack-qa07:15
*** sridharg has joined #openstack-qa07:17
*** oomichi has quit IRC07:18
*** oomichi has joined #openstack-qa07:19
*** e0ne has quit IRC07:22
*** jlanoux has joined #openstack-qa07:24
*** yaume has joined #openstack-qa07:28
*** yaume is now known as yaume[away]07:28
*** armax has quit IRC07:29
*** yaume[away] is now known as yaume07:30
*** yaume is now known as yaume[away]07:30
*** ifarkas_afk is now known as ifarkas07:33
*** openstackgerrit has quit IRC07:33
*** openstackgerrit has joined #openstack-qa07:34
*** gouthamr_ has quit IRC07:35
*** yaume[away] is now known as yaume07:37
*** yaume is now known as yaume[away]07:37
*** markus_z has joined #openstack-qa07:37
*** ihrachys has joined #openstack-qa07:39
*** tqtran has joined #openstack-qa07:39
*** chandankumar is now known as chandankumar|lun07:40
*** dtantsur|afk is now known as dtantsur07:42
*** tqtran has quit IRC07:43
*** ihrachys has quit IRC07:45
*** yaume[away] is now known as yaume07:52
*** yaume is now known as yaume[away]07:52
*** jpena|off is now known as jpena07:54
*** itzkb_ has quit IRC07:57
*** salv-orlando has joined #openstack-qa07:59
*** yamahata has quit IRC08:01
*** salv-orlando has quit IRC08:01
*** pgadiya has quit IRC08:01
*** paul-carlton2 has quit IRC08:01
*** chandankumar|lun is now known as chandankumar08:02
*** _nadya_ has joined #openstack-qa08:02
*** paul-carlton2 has joined #openstack-qa08:02
*** kbaikov has quit IRC08:02
*** k4n0_away has joined #openstack-qa08:02
*** k4n0_away is now known as k4n008:02
*** itzikb has joined #openstack-qa08:04
*** paul-carlton2 has quit IRC08:06
openstackgerritMasayuki Igawa proposed openstack/openstack-health: Add caching on get_all_runs_time_series_by_key for homepage  https://review.openstack.org/36717208:06
*** yaume[away] is now known as yaume08:10
*** sshnaidm|afk has joined #openstack-qa08:14
*** sshnaidm|afk is now known as sshnaidm08:14
*** ajo_ has quit IRC08:16
*** tochi has quit IRC08:17
*** sridhargaddam has joined #openstack-qa08:18
*** jogo has quit IRC08:20
*** sridharg has quit IRC08:21
*** yaume_ has joined #openstack-qa08:22
*** salv-orlando has joined #openstack-qa08:23
*** jogo has joined #openstack-qa08:25
*** yaume has quit IRC08:25
*** paul-carlton2 has joined #openstack-qa08:25
*** shardy has joined #openstack-qa08:26
*** tochi has joined #openstack-qa08:27
*** salv-orl_ has joined #openstack-qa08:30
*** ihrachys has joined #openstack-qa08:31
*** chandankumar has quit IRC08:31
gyxDo we have a tempest version?08:31
gyxLike mitaka,newton?08:31
*** jordanP has joined #openstack-qa08:32
gmanngyx: not on release base, its branch less, and yes we do have version in Tempest08:32
*** salv-orlando has quit IRC08:33
*** anshul has quit IRC08:33
gyxgmann :  Oh , how can I see the tempest version of the process?08:35
gmanngyx: you can check with pip show tempest08:37
gmanngyx: its python pckg if you have installed08:37
*** chandankumar has joined #openstack-qa08:37
dmelladoalso, if you fetch from git08:39
dmelladoyou may want to check the tag08:39
dmelladoor just the release notes08:39
openstackgerritzhufl proposed openstack/tempest: Use api_extensions to decide security_group type nova used  https://review.openstack.org/36721208:43
gyxgmann: dmellado: So we are now on 12.2.0?08:48
hferencgyx: yes, thats the latest08:48
dmelladogyx: latest tag is that one, yes08:49
dmelladoyou can check the relese notes in the releasenotes tox env08:49
*** anshul has joined #openstack-qa08:49
gyxdmellado: And when we will finish this version?08:50
dmelladowhat do you mean by 'we will finish'?08:50
dmelladotempest is branchless and we do release tags for it08:50
dmelladothat means that whenever we decide that we've achieved a milestone08:51
dmelladowe'll most probably release another tag08:51
*** kbaikov has joined #openstack-qa08:53
gyxdmellado: So when we feel good enough ,we will release a tag, there is no time limit, yes?08:54
dmelladogyx: not usually, althought there's an etherpad with release goals and milestones08:55
dmelladoand take into consideration that for instance, some requirements bumps will be bumped by global-reqs08:56
*** pilgrimstack1 has quit IRC08:57
gyxdmellado: gmann: hferenc: Thanks , I think  I probably understand.09:00
*** pilgrimstack has joined #openstack-qa09:01
dmelladogyx: np! you're welcome!09:01
hferencyw09:01
gyx:)09:01
gmannQA meeting in case anyone want to join09:03
lennybDevstack Cores, pls review tiny vfio permission patch https://review.openstack.org/#/c/365333/09:04
*** itzikb has quit IRC09:15
*** sridharg has joined #openstack-qa09:19
*** lucasagomes is now known as lucas-relocate09:21
*** sridhargaddam has quit IRC09:22
*** r-mibu has quit IRC09:33
*** r-mibu has joined #openstack-qa09:33
*** anshul has quit IRC09:38
*** pilgrimstack has quit IRC09:42
*** mvk has quit IRC09:43
*** pgadiya has joined #openstack-qa09:43
*** e0ne has joined #openstack-qa09:44
*** sshnaidm is now known as sshnaidm|lnch09:44
*** pilgrimstack has joined #openstack-qa09:45
*** anshul has joined #openstack-qa09:49
*** spzala has joined #openstack-qa09:52
*** spzala has quit IRC09:56
andreafgmann: I missed this in the meeting - perhaps someone from the QA team has time to look into http://lists.openstack.org/pipermail/openstack-dev/2016-September/103216.html09:58
hferencjordanP: are there any low-hanging-fruit like tasks on py3?09:59
gmannandreaf: ok.10:00
gmannandreaf: bugs says this is merged - https://review.openstack.org/#/c/358610/10:00
gmannoh, it reverting it seems10:00
andreafgmann: well it seems there are issues both with and without the patch10:00
gmanni see10:01
andreafgmann: I really haven't looked much into it, but I'm kind of busy right now so I was wondering if someone had the bw to pick it up10:01
gmannandreaf: something top do with reading the stdout without ready flag etc10:02
jordanPhferenc, there's https://review.openstack.org/#/c/333485/ and https://review.openstack.org/#/c/344184/ that need review or update. And any test you can do on a Py3 platform10:02
gmannandreaf: i can try to look tomorrow if i get early in from my visa interview10:02
hferencjordanP: ok, i'll have a look10:03
andreafgmann: nice, thanks10:03
*** lucas-relocate is now known as lucasagomes10:05
*** gszasz has joined #openstack-qa10:06
*** tochi has quit IRC10:10
*** mvk has joined #openstack-qa10:13
*** sridhargaddam has joined #openstack-qa10:20
*** yangyapeng has quit IRC10:20
*** sshnaidm|lnch is now known as sshnaidm10:21
*** sridharg has quit IRC10:23
*** cdent has joined #openstack-qa10:26
*** ababich has joined #openstack-qa10:27
*** cdent has quit IRC10:28
*** ramishra has quit IRC10:29
*** ramishra has joined #openstack-qa10:32
*** tochi has joined #openstack-qa10:33
*** tqtran has joined #openstack-qa10:42
*** yaume_ has quit IRC10:43
*** tqtran has quit IRC10:46
*** amotoki has quit IRC10:48
*** sshnaidm is now known as sshnaidm|afk10:54
*** kbaikov has quit IRC10:56
openstackgerritMerged openstack/tempest: Define separate inherited_roles_client for inherited roles  https://review.openstack.org/36585910:56
*** cdent has joined #openstack-qa10:58
openstackgerritMerged openstack/tempest: Move v3 roles_client to library interface  https://review.openstack.org/36661110:58
*** pgadiya has quit IRC10:59
*** jpena is now known as jpena|lunch10:59
*** bkopilov has quit IRC11:01
*** bkopilov_ has quit IRC11:02
*** sdague has joined #openstack-qa11:06
*** pgadiya has joined #openstack-qa11:07
openstackgerritguo yunxian proposed openstack/tempest: Move method to v2 volumes_client  https://review.openstack.org/36728911:10
*** trisq has quit IRC11:12
*** itzikb has joined #openstack-qa11:14
*** sridharg has joined #openstack-qa11:22
*** salv-orl_ has quit IRC11:22
*** sridhargaddam has quit IRC11:24
*** rfolco has joined #openstack-qa11:44
ylobankovjordanP, andreaf, gmann, oomichi: Hi guys! Could you please take a look at https://review.openstack.org/#/c/322118/ ? The issue affects our test statistics against Fuel 9.1. Thanks in advance!11:46
*** lucasagomes is now known as lucas-hungry11:48
*** AmitGalitz has quit IRC11:49
*** sshnaidm|afk is now known as sshnaidm12:00
*** mriedem has joined #openstack-qa12:10
*** tochi has quit IRC12:12
mriedemoomichi: the nova stable branch patches are up for https://review.openstack.org/#/c/356095/ now, the depends-on i mean12:13
mriedemhttps://review.openstack.org/#/q/I8a8ae8cdbe2d9d77e7f1ae94ebdf6e4ad46eaf00,n,z12:13
mriedemso the tempest change won't merge until the nova stable branch changes are merged12:13
*** raildo has joined #openstack-qa12:17
*** jpena|lunch is now known as jpena12:21
*** sridhargaddam has joined #openstack-qa12:22
*** k4n0 has quit IRC12:25
*** sridharg has quit IRC12:26
*** bkopilov_ has joined #openstack-qa12:27
*** bkopilov has joined #openstack-qa12:29
openstackgerritguo yunxian proposed openstack/tempest: Move method to v2 volumes_client  https://review.openstack.org/36728912:30
*** EinstCrazy has joined #openstack-qa12:31
*** akshai has joined #openstack-qa12:32
*** tochi has joined #openstack-qa12:34
*** akshai_ has joined #openstack-qa12:36
mriedemjohnthetubaguy: also ^ to move a tempest test change forward, we have some nova backports to make the test pass on stable12:36
*** k4n0 has joined #openstack-qa12:37
*** lucas-hungry is now known as lucasagomes12:38
*** akshai has quit IRC12:39
*** gyx has quit IRC12:42
jordanPylobankov, you here ?12:44
*** yaume has joined #openstack-qa12:45
jordanPabout #322118, what about the note "NOTE(afazekas): The deletion not asserted, because neutron is not forbidden to reschedule the router to the same agent" ? It's not true anymore ?12:45
jordanPand what about "This is a temporary work around to prevent a race condition." ? The workaround is not needed anymore ?12:47
*** amotoki has joined #openstack-qa12:48
openstackgerritDaniel Mellado proposed openstack/tempest: Define v3 trusts_client as library  https://review.openstack.org/36557712:48
*** mmedvede has quit IRC12:49
ylobankovjordanP: It looks like these notes may be actual when we create a router and add an internal network interface to it. I deleted this code in the patch and now we just create a router without creating a network and adding the network interface to the router.12:53
jordanPylobankov, test_list_routers_on_l3_agent might fail then ?12:55
jordanPbecause " Sometimes we have seen this test fail with dvr in,12:55
jordanP                # multinode tests, since the dhcp port is not created before12:55
jordanP                # the test gets executed and so the router is not scheduled12:55
jordanP                # on the given agent." ?12:55
*** shardy is now known as shardy_mtg12:57
*** yangyapeng has joined #openstack-qa12:57
ylobankovI don't think that the test_list_routers_on_l3_agent test can fail because we just list routers on some L3 agent.12:57
ylobankovjordanP: ^^^12:58
jordanPtrue12:59
*** apuimedo has joined #openstack-qa13:00
apuimedoAny tips for debugging devstack plugins?13:00
ylobankovjordanP: Probably we need neutron experts to review these tests13:00
jordanPthere's something fishy in that test. 3 NOTE(s) + dvr extension (hardly test in the Gate) + multi node scenarios (hardy tested)13:00
jordanPthat a recipe for bad things to happen13:01
jordanPI won't +2 until some people involved in the history of that patch weight in13:01
ylobankovjordanP: it makes sense :)13:02
openstackrecheckopenstack/cinder change: https://review.openstack.org/367131 failed because of: gate-tempest-dsvm-full-devstack-plugin-ceph: https://bugs.launchpad.net/bugs/147533313:02
openstackLaunchpad bug 1475333 in devstack "gate-tempest-dsvm-full-ceph fails with Insufficient free space for volume creation on host ubuntu@ceph#ceph (requested / avail): 1/0.0" [High,Confirmed]13:02
ylobankovjordanP: maybe afazekas can tell us something about this test13:03
openstackgerritDaniel Mellado proposed openstack/tempest: Define v3 credentials_client as library  https://review.openstack.org/36567113:05
ylobankovafazekas: could you please read our small conversation log with jordanP?13:05
afazekasjordanP, These things are very internal to neutron and very plugin dependent, I am not really sure we really want to test those behaviors in tempest13:06
*** spzala has joined #openstack-qa13:06
jordanPthe test is called "test_add_list_remove_router_on_l3_agent" that seems reasonable to test in Tempest13:07
dmelladoafazekas: jordanP also I don't know if you read the email13:08
dmelladoproposing having sriov and such things inside tempest, untested13:09
afazekaswhich mail ? , please send more context url -;)13:09
*** yamahata has joined #openstack-qa13:09
afazekasjordanP, for example that test assumes the neutron requires a hosting agent for a router, which does not necessary required part of a neutron backend13:10
dmelladohttp://lists.openstack.org/pipermail/openstack-dev/2016-September/103196.html13:11
dmelladoafazekas: ^^13:11
dmelladoI was looking for that13:11
dmelladoit proposes having such test, which are NFV-related, inside tempest13:11
dmelladoI'd put up a plugin for that, rather than adding them directly at tempest, in part because of what you were discussing13:11
*** timello has quit IRC13:13
afazekasdmellado, That thing looks like a good topik for summit, we have too many conflicting view about things ..13:14
dmelladoas it would assume even more services, which I'm not sure that we'd have a gate for that13:14
dmelladoafazekas: +1, at least for the mid-cycle first13:14
*** shardy_mtg is now known as shardy13:14
afazekasOriginally we decided we do not want dead code in tempest , tests which never runs13:14
dmelladoI'd rather avoid that as well13:15
*** Alex_Stef has quit IRC13:15
afazekaslot of people  want to contribute such thing time to time ..13:15
afazekasmaybe we should have 'tempest2' named  or tempest-contrib repo for those as tempest plugin13:16
dmelladoif you check my comment on here: https://review.openstack.org/#/c/366091/13:17
dmelladothat's what I'm having some concerns about13:17
*** mmedvede has joined #openstack-qa13:17
*** rossella_s has quit IRC13:18
*** rossella_s has joined #openstack-qa13:19
*** pgadiya has quit IRC13:19
*** timello has joined #openstack-qa13:20
*** porrua has joined #openstack-qa13:20
openstackgerritOleksii Butenko proposed openstack/tempest: Move test_snapshot_list_* tests to new file  https://review.openstack.org/33206613:22
afazekaslooks like we will have more tempest plugin than cpan module at the end.. ;-) I am not sure is it right way, but we are moving to that direction now, we might reunite it again in the future13:22
*** sshnaidm is now known as sshnaidm|afk13:23
*** sridharg has joined #openstack-qa13:23
openstackgerritOleksii Butenko proposed openstack/tempest: Move test_snapshot_list_* tests to new file  https://review.openstack.org/33206613:25
*** yamahata has quit IRC13:25
*** sridhargaddam has quit IRC13:26
*** ddieterly has joined #openstack-qa13:27
*** sshnaidm|afk has quit IRC13:27
*** ddieterly has quit IRC13:31
*** pgadiya has joined #openstack-qa13:32
dmelladoafazekas: lol13:32
*** pgadiya has quit IRC13:33
*** eeiden has quit IRC13:34
*** salv-orlando has joined #openstack-qa13:34
dmelladomtreinish: re your comment on the nova patch, what would your opinion be on the mail?13:36
*** tochi has quit IRC13:37
mtreinishdmellado: which patch? and which mail?13:37
dmelladomtreinish: https://review.openstack.org/#/c/366091/13:37
dmelladothis patch13:37
dmelladoand this email thread http://lists.openstack.org/pipermail/openstack-dev/2016-September/103196.html13:38
dmelladowhich was asking to add skip decorators for nfv to tempest, which I think would lead to dead code around13:38
mtreinishI'm only -1 there because of the name, it's completely misleading. If people want to make a whitebox test tempest plugin repo they can go right ahead. It just needs to be named to indicate that's what it actually is13:39
mtreinishpersonally I don't think it's a good idea, but that's not a reason to stop it13:39
mtreinishthat was kinda the point of the plugin interface :)13:39
dmelladomtreinish: and about the email thread? for me, it would make more sense for them to put up a tempest plugin repo13:40
openstackgerritLance Bragstad proposed openstack-dev/grenade: WIP: Create fernet repository for tokens on upgrade  https://review.openstack.org/36738413:40
mtreinishdmellado: as for the ml thread I will chime in on it in a bit. But as I read it they're only talking about random tests in neutron's in tree tempest plugin13:40
dmelladobasically they want to add tests that woudln't run on the usual gates, but 'downstream'13:41
dmelladosriov and so on13:41
mtreinishnone of that actually applies to tempest itself. Tempest also has a strong policy to not land tests we don't have a voting ci on13:41
dmelladosame thinking here13:41
mtreinishdmellado: right, that's a bad because it leads to dead code. I think we're in agreement on that13:41
*** weshay is now known as weshay_pto13:41
*** salv-orlando has quit IRC13:42
*** woodster_ has joined #openstack-qa13:45
dtantsurhey folks, have you had a chance to look at thread titled "Problem with paramiko on grenade"? We got a sudden breakage in our grenade gate, and we can't really figure it out..13:45
dtantsurthis puts us at the border of disabling grenade for ironic-inspector for now13:46
*** rlrossit has joined #openstack-qa13:47
mtreinishdtantsur: heh, I'm really tired of that paramaiko issue. We've modified the poll() code in that module like 3 different times and every change seems to break someone13:49
mtreinishit doesn't help that its super tricky to debug13:49
*** spzala has quit IRC13:49
dtantsursigh..13:49
*** spzala has joined #openstack-qa13:50
mtreinishit's always the same symptom the connection hangs13:50
dtantsurthat does not sound promising13:51
*** yangyapeng has quit IRC13:52
*** yangyapeng has joined #openstack-qa13:52
*** kbaikov has joined #openstack-qa13:54
*** spzala has quit IRC13:55
dtantsurmtreinish, maybe you have some wild guesses why our (ironic-inspector) gate is so special to trigger this? ironic's gate does not suffer from it...13:55
mtreinishI don't even know what the ironic-inspector gate is doing differently13:57
mtreinishbut that's where we should start looking13:57
dtantsurwell... I wrote the initial devstack plugin, and I also have no idea where to even start13:58
mtreinishdtantsur: do you use different guest images? Also do you have independent tests that ssh into guests?13:58
*** rbak has joined #openstack-qa13:58
dtantsurmtreinish, no. the only different test does introspection, which means getting a ramdisk on a node and collecting some data. and it succeeds.13:58
*** eeiden has joined #openstack-qa14:01
*** amotoki has quit IRC14:01
*** rajinir has joined #openstack-qa14:02
*** amotoki has joined #openstack-qa14:02
*** ddieterly has joined #openstack-qa14:02
mtreinishdtantsur: and it's uses the same guest images and flavors (same amount of ram, cpu, etc) as the normal ironic job14:03
*** hongbin has joined #openstack-qa14:03
dtantsurI'll double-check project-config now, but it's supposed to14:03
mtreinishdtantsur: do you have an example log?14:03
dtantsursure, lemme undig one14:03
mtreinishwe should also check logstash to see if it's isolated to just ironic-inspector14:03
*** mfisher_ora has joined #openstack-qa14:05
*** dkranz has joined #openstack-qa14:05
dtantsurprobably my internet disconnected before this message was sent:14:10
dtantsurhere's timeout during "old" phase: http://logs.openstack.org/62/365662/6/gate/gate-grenade-dsvm-ironic-inspector/a3398ff/logs/grenade.sh.txt.gz#_2016-09-08_08_51_23_53214:10
dtantsurand this in new: http://logs.openstack.org/95/352295/9/check/gate-grenade-dsvm-ironic-inspector/b6e3aa7/console.html#_2016-09-08_08_12_20_05012014:10
dtantsurmtreinish, sorry, unstable internet ^^^14:10
*** sabeen has joined #openstack-qa14:13
*** sabeen1 has joined #openstack-qa14:15
*** EinstCrazy has quit IRC14:15
*** sabeen has quit IRC14:17
*** amotoki has quit IRC14:17
*** zz_dimtruck is now known as dimtruck14:19
*** EinstCrazy has joined #openstack-qa14:19
*** yaume_ has joined #openstack-qa14:20
mtreinishdtantsur: hmm well those are 2 different failure fingerprints14:20
mtreinishdtantsur: in one case the timeout fixture kills the test, which likely means it hung and stopped responding (or long times overlapped and hit that threshold)14:21
dtantsurcorrect. we get a few different failures in the same exec_command.14:21
mtreinishand in the other case the ssh poll loop itself timed out waiting for data back from ssh14:21
*** yaume has quit IRC14:23
*** sshnaidm|afk has joined #openstack-qa14:23
*** sshnaidm|afk is now known as sshnaidm14:23
*** rlrossit_ has joined #openstack-qa14:23
*** sridhargaddam has joined #openstack-qa14:24
*** bnemec has quit IRC14:24
*** pglass has joined #openstack-qa14:25
*** ihrachys has quit IRC14:25
mtreinishdtantsur: so yeah looking at http://status.openstack.org/openstack-health/#/test/tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops14:25
*** rlrossit has quit IRC14:26
mtreinishthat test is really only failing on ironic inspector grenade14:26
mtreinish(the puppet failures are unrelated)14:26
*** yangyapeng has quit IRC14:26
mtreinishoh, sry meant to link: http://status.openstack.org/openstack-health/#/test/tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops?duration=P7D14:27
mtreinish(the same thing but limited to a week)14:27
*** sridharg has quit IRC14:27
openstackgerritSteve Martinelli proposed openstack-dev/devstack: Revert "Specify a cloud for openstack complete"  https://review.openstack.org/36629614:27
*** ihrachys has joined #openstack-qa14:27
*** bnemec has joined #openstack-qa14:27
*** amotoki has joined #openstack-qa14:28
mtreinishdtantsur: so we need to figure out what makes ironic inspector grenade jobs different from everything else14:28
*** yangyapeng has joined #openstack-qa14:28
dtantsurmtreinish, my only suspect is networking config, e.g. https://github.com/openstack/ironic-inspector/blob/master/devstack/plugin.sh#L254-L25814:29
*** sridhargaddam has quit IRC14:31
mtreinishdtantsur: oh, yeah if you're doing manual networking config in the devstack plugin I could see that potentially causing an issue with sshing into the guest14:32
openstackrecheckConsole logs not available after 13:32s for gate-glance-python27-db-ubuntu-xenial 367370,1,cf2d79314:32
dtantsurmtreinish, this is really the only thing that I can think of.. but it used to work for roughly a year.14:33
*** amotoki has quit IRC14:33
mtreinishdtantsur: but also why only grenade?14:33
mtreinishI think that likely means it's something in mitaka causing an issue14:34
dtantsurmtreinish, only grenade runs tests that are not specific to us (i.e. everything with "smoke" tag)14:34
*** rodrigods has quit IRC14:35
mtreinishoh, so you just don't run this test on other jobs?14:35
*** rodrigods has joined #openstack-qa14:35
dtantsurcorrect14:35
*** _nadya_ has quit IRC14:36
dtantsuraarefiev, do you remember when exactly our problems with grenade started?14:36
*** anshul has quit IRC14:37
aarefiev2 days ago ?14:37
dtantsurI don't think so, https://review.openstack.org/#/c/352295/ first failed on Sep 214:38
dtantsuryeah, this is probably the first time we've faced it: http://logs.openstack.org/95/352295/9/gate/gate-grenade-dsvm-ironic-inspector/ad566d2/logs/grenade.sh.txt.gz#_2016-09-02_10_10_56_79114:39
aarefievwow14:39
aarefievyeah, then I know about it 2 days14:40
mtreinishdtantsur: yeah it was sept 2nd according to openstack health (which is only with data from the gate queue)14:40
dtantsuryeah, fun fact: first days it only failed in gate, not in check14:40
*** salv-orlando has joined #openstack-qa14:40
mtreinishthat makes it even more confusing14:41
dtantsurit passed once on Sep 5 and once on Set 6, then went down completely...14:41
*** EinstCrazy has quit IRC14:41
dtantsurthis. is. really. strange.14:42
*** mvk has quit IRC14:42
mtreinishdtantsur: so the next thing to do is look at what the test in question is doing (which in this case will be a pain those scenario tests are horrible)14:43
*** gvrangan has joined #openstack-qa14:44
*** sridhargaddam has joined #openstack-qa14:44
mtreinishbecause you're passing other tests that ssh which means it's likely a combination of whatever neutron operations we're running there and trying to ssh14:44
*** gcheresh has quit IRC14:44
mtreinishdtantsur: https://github.com/openstack/tempest/blob/master/tempest/scenario/test_network_basic_ops.py#L363-L41114:44
mtreinishsc68cal_: ^^^ you might be able to help with debugging this too14:45
* sc68cal_ looks14:45
aarefievbut it connects via ssh fine in this case too, it fails when trying to get event via poll.poll()14:46
dtantsurit seems to always be _check_network_external_connectivity, right aarefiev?14:46
aarefievyeah14:46
aarefievhttp://paste.openstack.org/show/569237/14:47
aarefievssh connection to cirros@172.24.5.9 successfully created14:47
*** gvrangan has quit IRC14:48
mtreinishaarefiev: right it's not returning any data on the connection after we ask it to ping the external ip (which I assume is the router) https://github.com/openstack/tempest/blob/master/tempest/scenario/test_network_basic_ops.py#L328-L33514:48
mtreinishand the test times out14:49
*** armax has joined #openstack-qa14:49
aarefievmtreinish: it looks like hangs on this call14:50
aarefievbecause we fail with test timeout14:50
aarefievtimeout from fixtures14:50
mtreinishaarefiev: right, but the failure dtantsur pointed on the new side showed it not hanging. Which is making me think there just isn't any data coming back over the connection14:51
mtreinishand the timoutfixture is a distraction and just showing up because the times add up to trip that before the ssh timeout14:51
mtreinishaarefiev: http://logs.openstack.org/95/352295/9/check/gate-grenade-dsvm-ironic-inspector/b6e3aa7/console.html#_2016-09-08_08_12_20_05012014:51
mtreinishbut that's just a guess14:52
aarefievssh_timeout = 120014:53
mtreinishthat's a really long timeout, the default for the timeout fixture is 500 (although iirc ironic bumps that up)14:54
aarefievDEVSTACK_GATE_OS_TEST_TIMEOUT=240014:56
mtreinishaarefiev: right, so if the test before we attempt the failing ssh connection takes >1200 secs we trip the timeout fixture14:57
openstackrecheckConsole logs not available after 13:40s for gate-tempest-dsvm-full-drbd-devstack 366920,1,f560a2514:57
*** gouthamr has joined #openstack-qa14:59
aarefievso if it returns no data it should fail with tempest.lib.exceptions.TimeoutException: Request timed out in 120014:59
*** rlrossit_ has quit IRC15:00
*** gouthamr_ has joined #openstack-qa15:00
*** gamado has quit IRC15:00
aarefievmtreinish: btw I've tested grenade 3 times with this https://review.openstack.org/#/c/366806/15:01
aarefievand it passed15:01
*** ddieterly has quit IRC15:01
mtreinishaarefiev: well I'm looking at the code: https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L133-L16415:02
*** rlrossit_ has joined #openstack-qa15:03
*** rlrossit_ has quit IRC15:04
*** gouthamr has quit IRC15:04
*** rlrossit_ has joined #openstack-qa15:04
mtreinishand that exception only gets triggered if the poll returns nothing15:04
*** yangyapeng has quit IRC15:04
*** akshai_ has quit IRC15:04
*** yangyapeng has joined #openstack-qa15:05
aarefievyep15:05
mtreinishaarefiev: sure so that makes that makes the exec command blocking until it exits: http://docs.paramiko.org/en/2.0/api/channel.html#paramiko.channel.Channel.recv_exit_status15:06
mtreinishwhich was causing hangs for other people15:06
*** _nadya_ has joined #openstack-qa15:06
*** jlanoux has quit IRC15:06
mtreinishthe problem with debugging these issues is we have no clue what's taking so long is it a guest issue an network issue, etc15:07
mtreinishaarefiev: where is the patch which tests the tempest revert?15:08
mtreinishtempest doesn't run the inspector grenade job15:08
*** sridhargaddam has quit IRC15:08
aarefievmtreinish: https://review.openstack.org/#/c/366602/115:08
aarefievtrying one more time15:08
aarefievI'm wondering why it doesn't affect ironic grenade15:10
sc68cal_mtreinish: sorry, got pulled into a meeting, I'll try and circle back15:11
*** akshai has joined #openstack-qa15:14
*** itzikb has quit IRC15:15
*** spzala has joined #openstack-qa15:16
*** akshai has quit IRC15:19
*** scarab_ has joined #openstack-qa15:19
*** akshai has joined #openstack-qa15:19
*** sabeen1 has quit IRC15:21
*** sabeen has joined #openstack-qa15:27
*** amotoki has joined #openstack-qa15:29
openstackgerritAnna Babich proposed openstack/tempest: Use local variable for volume instead of instance one  https://review.openstack.org/36746415:29
*** dtantsur is now known as dtantsur|afk15:29
*** mriedem has quit IRC15:29
*** akshai has quit IRC15:32
mtreinishaarefiev: I'm reading the paramiko channel module docs right now, and I'm wondering if we should just rebuild this function from the ground up to make it a bit more reliable15:33
*** akshai has joined #openstack-qa15:33
*** amotoki has quit IRC15:34
*** jlanoux has joined #openstack-qa15:35
*** gouthamr_ is now known as gouthamr15:42
*** vhosakot has joined #openstack-qa15:42
*** xinli has joined #openstack-qa15:48
*** mriedem has joined #openstack-qa15:51
*** jgriffith_away is now known as jgriffith15:53
*** chandankumar has quit IRC15:55
mtreinishaarefiev: let's give this a try too: https://review.openstack.org/#/c/367478/15:57
* mtreinish wonders where gerritbot went15:57
*** akshai has quit IRC15:58
*** rlrossit_ has quit IRC15:59
*** akshai has joined #openstack-qa15:59
*** sayalilunkad has quit IRC16:00
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Update query for n-api deadlock bug 1480305  https://review.openstack.org/36747916:00
openstackbug 1480305 in OpenStack Compute (nova) "DBDeadlock inserting into instance_extra" [Medium,Triaged] https://launchpad.net/bugs/148030516:00
*** _nadya_ has quit IRC16:00
mtreinishaarefiev: err, that patch probably is all sorts of broken. It's hanging unit tests for me locally :)16:04
*** paul-carlton has joined #openstack-qa16:04
*** grafuls has quit IRC16:08
*** gvrangan has joined #openstack-qa16:08
openstackgerritMerged openstack-infra/elastic-recheck: Update query for n-api deadlock bug 1480305  https://review.openstack.org/36747916:09
openstackbug 1480305 in OpenStack Compute (nova) "DBDeadlock inserting into instance_extra" [Medium,Triaged] https://launchpad.net/bugs/1480305 - Assigned to John Garbutt (johngarbutt)16:09
*** yaume_ has quit IRC16:09
openstackrecheckConsole logs not available after 13:27s for gate-nova-python27-db-ubuntu-xenial 359069,2,42e336a16:11
*** dkranz has quit IRC16:13
*** openstackrecheck has quit IRC16:15
*** openstackrecheck has joined #openstack-qa16:15
*** tesseract- has quit IRC16:21
*** markus_z has quit IRC16:22
aarefievmtreinish: sorry was on call, so the problem is we are polling in loop16:24
openstackgerritMatthew Treinish proposed openstack/tempest: WIP: Refactor ssh exec command  https://review.openstack.org/36747816:24
*** timello has quit IRC16:29
*** dimtruck is now known as zz_dimtruck16:30
*** amotoki has joined #openstack-qa16:31
*** amotoki has quit IRC16:31
*** amotoki has joined #openstack-qa16:31
*** zz_dimtruck is now known as dimtruck16:34
ylobankovafazekas, jordanP: by the way, we have different logics in the test_add_list_remove_router_on_l3_agent test (https://review.openstack.org/#/c/322118/) depending on whether DVR is enabled or not. Now in https://review.openstack.org/#/c/322118/ wehave one logic for both cases.16:36
*** jlanoux has quit IRC16:38
ylobankovafazekas: could you please review and comment https://review.openstack.org/#/c/322118/ since you wrote some code pieces of the test?16:39
*** spzala has quit IRC16:39
*** _nadya_ has joined #openstack-qa16:39
*** minwang2 has joined #openstack-qa16:40
*** spzala has joined #openstack-qa16:40
*** scarab_ has quit IRC16:40
*** dkranz has joined #openstack-qa16:40
oomichimriedem: ah, thanks for your work. Now I drop my temporary -216:40
*** gyee_ has joined #openstack-qa16:40
*** jordanP has quit IRC16:40
*** _nadya_ has quit IRC16:41
xinlirodrigods: I add my questions regarding the addCleanup() in this paste: http://paste.openstack.org/show/569264/16:41
ylobankovoomichi: could you please take a look at https://review.openstack.org/#/c/322118/ as well? Your opinion is appreciated as well.16:42
*** timello has joined #openstack-qa16:42
oomichiylobankov: OK, I am checking. BTW, the patch contains multiple topics like cleanup, fixing, or something16:42
*** minwang2 has left #openstack-qa16:43
*** clenimar has joined #openstack-qa16:43
oomichiylobankov: that is hard to be reviewed.. Can you separate the patch into multiple ones for easy review?16:43
oomichiylobankov: I will put some comments anyways.16:43
ylobankovoomichi: ok, will do. Thanks!16:44
*** spzala has quit IRC16:44
rodrigodsxinli, when considering something regarding comments in reviews, please reply at the review itself - otherwise it gets lost16:45
oomichiylobankov: maybe comments will be a lot. Please don't lose heart16:45
*** moravec has quit IRC16:45
*** spzala has joined #openstack-qa16:46
xinlirodrigods: OK, I will, thx16:46
*** scarab_ has joined #openstack-qa16:47
*** scarab_ has quit IRC16:47
*** rlrossit has joined #openstack-qa16:47
openstackgerritYaroslav Lobankov proposed openstack/tempest: Fixing test_add_list_remove_router_on_l3_agent test  https://review.openstack.org/32211816:47
ylobankovoomichi: ok :)16:48
*** lucasagomes is now known as lucas-dinner16:48
ylobankovoomichi: I submitted the new patch set.16:50
*** spzala has quit IRC16:50
*** yangyape_ has joined #openstack-qa16:52
*** yangyapeng has quit IRC16:52
oomichiylobankov: yeah I know, because my comments for the previous patches are lost ;-)16:53
oomichiylobankov: A new one seems simple, thanks16:53
oomichiylobankov: ah, but the commit message also is necessary to be updated for current change16:54
*** Apoorva has joined #openstack-qa16:55
ylobankovoomichi: yes, you are right16:56
*** _nadya_ has joined #openstack-qa16:56
openstackgerritYaroslav Lobankov proposed openstack/tempest: Fixing test_add_list_remove_router_on_l3_agent test  https://review.openstack.org/32211816:57
*** spzala has joined #openstack-qa16:57
ylobankovoomichi: done16:58
openstackgerritMerged openstack-dev/devstack: Adding vfio to cgroup_device_acl during libvirt configuration  https://review.openstack.org/36533316:59
*** spzala has quit IRC17:02
*** swamireddy has quit IRC17:03
*** vhosakot has quit IRC17:03
*** paul-carlton has quit IRC17:03
*** vaidy has quit IRC17:04
*** paul-carlton has joined #openstack-qa17:05
*** moravec has joined #openstack-qa17:05
*** vhosakot has joined #openstack-qa17:08
openstackgerritMatt Riedemann proposed openstack-dev/devstack: nova: stop setting deprecated use_usb_tablet option  https://review.openstack.org/36752617:09
*** spzala has joined #openstack-qa17:09
*** k4n0 has quit IRC17:12
oomichiylobankov: thanks, new patch just seems to revert https://review.openstack.org/#/c/165246/17:12
*** yangyape_ has quit IRC17:13
*** yangyapeng has joined #openstack-qa17:13
oomichiylobankov: One condition of the problem is multiple l3 agents, right?17:13
ylobankovoomichi: yes17:14
*** spzala has quit IRC17:14
ylobankovoomichi: it looks like now we can add a dvr router to L3 agent without adding an internal network interface to the router.17:16
ylobankovoomichi: the patch that you mentioned exactly does it17:17
oomichiylobankov: Can we add a dvr router even if L3 agent is a single?17:17
*** rlrossit has quit IRC17:17
oomichiylobankov: yeah, I just read your commit message ;)17:17
*** rlrossit has joined #openstack-qa17:18
*** rossella_s has quit IRC17:18
*** rossella_s has joined #openstack-qa17:19
oomichiarmax: hi, could you help https://review.openstack.org/#/c/322118 ? That reverts your previous https://review.openstack.org/#/c/16524617:19
armaxoomichi: looking17:19
ylobankovoomichi: I must dash. If you have any questions, please ask them in the patch. Thanks a lot for you review!17:20
oomichiarmax: Your help from neutron side is helpful17:20
oomichiarmax: thanks! :)17:20
oomichiylobankov: no problem, thanks for doing that :)17:20
*** jpena is now known as jpena|off17:21
*** rlrossit has quit IRC17:22
*** spzala has joined #openstack-qa17:25
auggymtreinish: heya! i'm a little confused about this error and where the tabs came from - http://logs.openstack.org/67/351367/7/check/gate-devstack-bashate/04f2187/console.html17:27
auggymtreinish: i checked my change and i didn't add any tab characters17:28
auggymtreinish: oh i'm full of lies17:28
auggymtreinish: the tabs aren't showing up for me locally for some reason :/ i'll fix that, i see them in gerrit now17:29
*** spzala has quit IRC17:29
*** rlrossit has joined #openstack-qa17:29
openstackgerritAugustina Ragwitz proposed openstack-dev/devstack: WIP: add tempest run support to devstack  https://review.openstack.org/35136717:30
mtreinishauggy: heh, ok17:30
*** spzala has joined #openstack-qa17:31
auggyi have to run to an appointment but i'll see what we need to to do remove the WIP from that change17:31
auggywhen i get back i mean17:31
*** spzala has quit IRC17:35
*** Suyi_ has joined #openstack-qa17:35
*** rlrossit has quit IRC17:39
*** swamireddy has joined #openstack-qa17:40
mtreinishaarefiev: https://review.openstack.org/#/c/367480/ my patch fixed the inspector jobs17:41
mtreinishunfortunately it's failing randomly on the regular jobs17:41
*** _nadya_ has quit IRC17:42
*** spzala has joined #openstack-qa17:42
*** kvcobb has joined #openstack-qa17:45
*** tqtran has joined #openstack-qa17:46
*** kvcobb has quit IRC17:46
xinlirodrigods: I missed to post set8, and now I post in set9, I really want to follow up your comments.17:46
rodrigodsxinli, ok, let me take a look17:47
*** spzala has quit IRC17:47
xinlirodrigods: thanks17:47
aarefievmtreinish: yeah, I saw, it's cool, thanks for fix, did you figure out what the root cause was?17:47
mtreinishno clue17:48
*** vaidy has joined #openstack-qa17:48
*** spzala has joined #openstack-qa17:48
mtreinishbut I figured if we just used the paramiko constructs for everything then we don't have to worry about our manual poll() loop hanging on us (as much :) )17:49
*** gszasz has quit IRC17:49
*** krtaylor has quit IRC17:49
*** gvrangan has quit IRC17:49
harlowjaqq for folks, just to see if anyone else has done this (and maybe i don't have to)17:49
harlowjai'm working on some stupid simple devstack based multi-node shell scripts (say enable_service=key) on one vm, then do that setup there17:49
harlowjathen start another vm, the use devstack to setup n-cpu17:50
harlowja*then use17:50
harlowja(even if this isn't fully automated has anyone tried this kind of stuff before, even if its sorta ghetto)17:50
*** moravec has quit IRC17:52
*** scarab_ has joined #openstack-qa17:52
*** spzala has quit IRC17:52
mtreinishaarefiev: I am a bit concerned by the failures I saw on the tempest change though17:52
mtreinishaarefiev: it's making me think what we have now is more reliable17:53
mtreinishaarefiev: like in one case it was expecting a timestamp on stdout and it got nothing :/17:53
*** sabeen has quit IRC17:53
*** akshai has quit IRC17:54
mtreinishharlowja: take a look at the grenade multinode stuff in d-g. That's essentially how it works17:54
harlowjakk17:54
mtreinishit deploys stable branch devstack multinode with only a handful of services on the subnode17:54
harlowjagot a quick link to that?17:54
*** moravec has joined #openstack-qa17:56
aarefievmtreinish: you mean via poll is more reliable, right?17:56
mtreinishaarefiev: yeah17:58
*** e0ne has quit IRC17:58
mtreinishharlowja: off the top of my head know. I just know at a high level that's how we do it. It's been a while since I looked at the details though17:59
aarefievmtreinish: so what will be the solution17:59
mtreinishs/know/no17:59
harlowjamtreinish np17:59
mtreinishaarefiev: I'm not sure at this point17:59
mtreinishaarefiev: I'm really tired of shifting that paramiko blocking call around (we've done it before)17:59
mtreinishso I'd rather just get something better than revert that and break everyone who was effected by the earlier hang bugs18:00
mtreinishbut if my patch is unreliable that might not be an option18:00
aarefievmtreinish: I see your point, what the problem with your patch18:01
*** akshai has joined #openstack-qa18:02
aarefievI'll take look on it tomorrow, it's too late for me now18:03
aarefievthank you18:03
*** ifarkas is now known as ifarkas_afk18:04
*** rlrossit has joined #openstack-qa18:04
*** vaidy has quit IRC18:06
*** swamireddy has quit IRC18:06
*** gyee_ has quit IRC18:06
*** swamireddy has joined #openstack-qa18:08
*** vaidy has joined #openstack-qa18:09
*** spzala has joined #openstack-qa18:09
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for cells v1 delete host changed bug 1621574  https://review.openstack.org/36755918:11
openstackbug 1621574 in OpenStack Compute (nova) "Instance fails to delete while building in cells v1 due to "ObjectActionError: Object action destroy failed because: host changed"" [Undecided,Confirmed] https://launchpad.net/bugs/162157418:11
*** akshai has quit IRC18:14
*** spzala has quit IRC18:14
*** ihrachys has quit IRC18:15
openstackgerritMerged openstack-infra/elastic-recheck: Add query for cells v1 delete host changed bug 1621574  https://review.openstack.org/36755918:21
openstackbug 1621574 in OpenStack Compute (nova) "Instance fails to delete while building in cells v1 due to "ObjectActionError: Object action destroy failed because: host changed"" [Medium,Confirmed] https://launchpad.net/bugs/1621574 - Assigned to Andrew Laski (alaski)18:21
*** krtaylor has joined #openstack-qa18:24
*** spzala has joined #openstack-qa18:33
*** paul-carlton has quit IRC18:33
*** akshai has joined #openstack-qa18:35
*** scarab_ has quit IRC18:38
*** Swami has joined #openstack-qa18:39
*** scarab_ has joined #openstack-qa18:40
*** scarab_ has quit IRC18:42
*** Ravikiran_K has quit IRC18:44
*** gvrangan has joined #openstack-qa18:46
*** _nadya_ has joined #openstack-qa18:50
*** scarab_ has joined #openstack-qa18:51
*** david-lyle has quit IRC18:53
*** xinli has quit IRC18:53
*** david-lyle has joined #openstack-qa18:53
*** sabeen has joined #openstack-qa18:54
*** _nadya_ has quit IRC18:56
*** vhosakot_ has joined #openstack-qa19:00
*** vhosakot has quit IRC19:03
*** rlrossit has quit IRC19:04
openstackrecheckopenstack/cinder change: https://review.openstack.org/366655 failed because of: gate-tempest-dsvm-full-devstack-plugin-ceph: https://bugs.launchpad.net/bugs/147533319:05
openstackLaunchpad bug 1475333 in devstack "gate-tempest-dsvm-full-ceph fails with Insufficient free space for volume creation on host ubuntu@ceph#ceph (requested / avail): 1/0.0" [High,Confirmed]19:05
*** salv-orlando has quit IRC19:06
*** rlrossit has joined #openstack-qa19:07
*** vhosakot_ has quit IRC19:08
*** openstackrecheck has quit IRC19:09
*** openstackrecheck has joined #openstack-qa19:09
*** vhosakot has joined #openstack-qa19:12
*** xinli has joined #openstack-qa19:18
*** clu_ has joined #openstack-qa19:19
*** e0ne has joined #openstack-qa19:21
openstackgerritVasyl Saienko proposed openstack-dev/devstack: Avoid removing $HOME by clean.sh  https://review.openstack.org/36759319:36
openstackgerritLance Bragstad proposed openstack/tempest: WIP: Allow for wait in _restore_password  https://review.openstack.org/36759519:39
*** sshnaidm is now known as sshnaidm|afk19:41
*** Apoorva has quit IRC19:41
*** _nadya_ has joined #openstack-qa19:43
*** _nadya_ has quit IRC19:45
*** yamahata has joined #openstack-qa19:49
*** cdent has quit IRC19:54
*** minwang2 has joined #openstack-qa19:55
*** porrua has quit IRC20:03
*** mfisher_ora has quit IRC20:16
*** e0ne has quit IRC20:17
*** e0ne has joined #openstack-qa20:18
*** salv-orlando has joined #openstack-qa20:18
*** yamahata has quit IRC20:20
*** salv-orlando has quit IRC20:22
*** salv-orlando has joined #openstack-qa20:33
*** Apoorva has joined #openstack-qa20:41
*** gvrangan has quit IRC20:44
*** Apoorva has quit IRC20:46
*** shardy has quit IRC20:49
*** sdague has quit IRC20:52
*** mvk has joined #openstack-qa20:58
*** harlowja_ has joined #openstack-qa20:59
*** harlowja has quit IRC21:00
*** raildo has quit IRC21:01
*** e0ne has quit IRC21:02
*** mmedvede has quit IRC21:09
*** dkranz has quit IRC21:15
*** e0ne has joined #openstack-qa21:15
*** rossella_s has quit IRC21:18
*** rossella_s has joined #openstack-qa21:19
*** e0ne has quit IRC21:25
*** e0ne has joined #openstack-qa21:26
*** e0ne has quit IRC21:26
*** gvrangan has joined #openstack-qa21:28
*** minwang2 has left #openstack-qa21:29
*** vhosakot has quit IRC21:53
*** mmedvede has joined #openstack-qa21:53
*** scarab_ has quit IRC21:55
*** rlrossit has quit IRC22:02
*** scarab_ has joined #openstack-qa22:09
*** xinli has quit IRC22:10
*** dimtruck is now known as zz_dimtruck22:11
*** dtantsur|afk has quit IRC22:12
*** scarab_ has quit IRC22:14
*** dtantsur has joined #openstack-qa22:14
*** harlowja has joined #openstack-qa22:18
*** pglass has quit IRC22:22
*** harlowja_ has quit IRC22:22
*** mvk has quit IRC22:23
*** artom has quit IRC22:25
*** sabeen has quit IRC22:31
*** artom has joined #openstack-qa22:32
*** mriedem has quit IRC22:36
*** mvk has joined #openstack-qa22:37
*** akshai has quit IRC22:42
*** spzala has quit IRC22:48
*** scarab_ has joined #openstack-qa22:48
*** spzala has joined #openstack-qa22:49
*** krtaylor has quit IRC22:51
*** spzala has quit IRC22:53
*** scarab_ has quit IRC22:54
*** rbak has quit IRC22:58
*** hferenc has quit IRC23:05
*** lucas-dinner has quit IRC23:12
*** Apoorva has joined #openstack-qa23:18
*** moravec1 has joined #openstack-qa23:22
*** moravec has quit IRC23:22
*** markvoelker has quit IRC23:25
*** mriedem has joined #openstack-qa23:25
*** lucasagomes has joined #openstack-qa23:26
*** tochi has joined #openstack-qa23:35
*** scarab_ has joined #openstack-qa23:43
*** krtaylor has joined #openstack-qa23:45
*** scarab_ has quit IRC23:48
*** Suyi_ has quit IRC23:48
*** Swami has quit IRC23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!