Thursday, 2021-02-11

*** paras333_ has quit IRC00:08
*** tosky has quit IRC00:17
*** andrebeltrami has quit IRC00:20
gmannrpittau|afk: \o/ networking-generic-switch-tempest-dlm-python2  is passing now, let me get tempest and devstack fixes merged. https://review.opendev.org/c/openstack/networking-generic-switch/+/77333500:26
openstackgerritGhanshyam proposed openstack/tempest master: Use configured upper-constraints for non-master Tempest run  https://review.opendev.org/c/openstack/tempest/+/77491300:27
openstackgerritGhanshyam proposed openstack/devstack master: Add a variable to configure the Tempest venv upper constraints  https://review.opendev.org/c/openstack/devstack/+/77471100:33
openstackgerritGhanshyam proposed openstack/devstack stable/victoria: Add a variable to configure the Tempest venv upper constraints  https://review.opendev.org/c/openstack/devstack/+/77471400:37
openstackgerritGhanshyam proposed openstack/devstack stable/ussuri: Add a variable to configure the Tempest venv upper constraints  https://review.opendev.org/c/openstack/devstack/+/77471500:39
openstackgerritGhanshyam proposed openstack/devstack stable/train: Add a variable to configure the Tempest venv upper constraints  https://review.opendev.org/c/openstack/devstack/+/77471600:42
openstackgerritGhanshyam proposed openstack/devstack stable/stein: Add a variable to configure the Tempest venv upper constraints  https://review.opendev.org/c/openstack/devstack/+/77505200:44
openstackgerritGhanshyam proposed openstack/tempest master: Use configured upper-constraints for non-master Tempest run  https://review.opendev.org/c/openstack/tempest/+/77491300:46
*** dmellado has quit IRC01:03
*** dmellado has joined #openstack-qa01:12
*** yamamoto has joined #openstack-qa01:46
*** yamamoto has quit IRC01:50
openstackgerritGhanshyam proposed openstack/tempest master: Use configured upper-constraints for non-master Tempest run  https://review.opendev.org/c/openstack/tempest/+/77491302:00
openstackgerritMerged openstack/tempest master: Refactor skip_because decorator  https://review.opendev.org/c/openstack/tempest/+/77262502:08
openstackgerritMerged openstack/tempest master: Fix race condition for image test  https://review.opendev.org/c/openstack/tempest/+/73563102:21
*** yamamoto has joined #openstack-qa02:27
*** dmellado has quit IRC02:36
*** ramishra has joined #openstack-qa02:37
*** yamamoto has quit IRC02:44
*** dmellado has joined #openstack-qa03:02
*** yamamoto has joined #openstack-qa03:12
*** yamamoto has quit IRC03:16
openstackgerritMerged openstack/devstack master: orchestrate-devstack: Copy controller ceph.conf and keyrings to subnode  https://review.opendev.org/c/openstack/devstack/+/75527003:23
*** yamamoto has joined #openstack-qa04:22
*** dviroel has quit IRC04:28
*** yamamoto has quit IRC04:52
*** yamamoto has joined #openstack-qa05:05
*** yamamoto has quit IRC05:06
*** yamamoto has joined #openstack-qa05:28
*** yamamoto has quit IRC05:28
*** yamamoto has joined #openstack-qa05:28
*** yamamoto has quit IRC05:29
*** ysirndjuro has quit IRC05:29
*** yamamoto has joined #openstack-qa05:29
*** whoami-rajat__ has joined #openstack-qa06:03
*** yamamoto has quit IRC06:07
*** yamamoto has joined #openstack-qa06:08
*** yamamoto has quit IRC06:08
*** yamamoto has joined #openstack-qa06:14
*** yamamoto has quit IRC06:14
*** yamamoto has joined #openstack-qa06:15
*** yamamoto has quit IRC06:20
*** vhari has quit IRC06:22
*** vishalmanchanda has joined #openstack-qa06:22
*** gcheresh has joined #openstack-qa06:23
*** yamamoto has joined #openstack-qa06:26
*** ralonsoh has joined #openstack-qa06:49
*** ccamposr has joined #openstack-qa07:08
*** sboyron_ has joined #openstack-qa07:10
*** zenkuro has joined #openstack-qa07:21
*** eolivare has joined #openstack-qa07:39
*** slaweq has joined #openstack-qa07:44
*** rpittau|afk is now known as rpittau07:53
rpittaugmann: that's great! thank you so much for the help! :)07:54
*** gfidente has joined #openstack-qa08:10
*** jpena|off is now known as jpena08:29
*** hemanth_n has joined #openstack-qa08:31
*** tosky has joined #openstack-qa08:36
*** yamamoto has quit IRC09:03
*** lucasagomes has joined #openstack-qa09:10
toskylyarwood: hi! I guess time to start backporting https://review.opendev.org/c/openstack/devstack/+/755270 ? :)09:10
lyarwoodtosky: lets get the job landed and running in Nova first :)09:21
lyarwoodtosky: thanks again for pushing this along btw09:21
*** yamamoto has joined #openstack-qa09:22
*** yamamoto has quit IRC09:27
toskylyarwood: oh, right; it's just needs to be backported in devstack before backporting the nova job :)09:31
*** rnoriega has quit IRC09:32
*** rnoriega has joined #openstack-qa09:33
*** ralonsoh has quit IRC09:34
*** ralonsoh has joined #openstack-qa09:34
*** yamamoto has joined #openstack-qa09:44
lyarwoodtosky: yup I'll get on it once this lands in master09:48
*** dtantsur|afk is now known as dtantsur10:00
openstackgerritMartin Kopec proposed openstack/tempest master: add unittest for trust client operation interface in identity part  https://review.opendev.org/c/openstack/tempest/+/70053010:06
openstackgerritMartin Kopec proposed openstack/tempest master: Modify the port fake data according to api reference  https://review.opendev.org/c/openstack/tempest/+/74189510:13
frickleryoctozepto: I assume you were talking about the async patches earlier? IMO devstack should focus more on being easily debuggable and repeatable than on being fast, but since I don't have much time to spend on it myself, I also won't object whatever you think is reasonable11:30
yoctozeptofrickler: yes, thanks; I think dansmith's version is still quite debuggable and I am pretty sure we have to be fast as well because the majority of openstack jobs rely on devstack+tempest so optimising these is going to give us better CI experience, not to mention the developer experience11:33
yoctozeptogmann: ^11:33
fricklerwell, speeding up devstack won't solve any of the unstable test issues that we have. in addition, running things out of order introduces a lot of new potential for error, so I don't agree about the better experience.11:38
*** dviroel has joined #openstack-qa12:02
*** andrebeltrami has joined #openstack-qa12:02
yoctozeptofrickler: true that but, at least so far, the optimisations seem nice to have and not that scary to introduce odd issues12:07
*** jpena is now known as jpena|lunch12:33
*** hemanth_n has quit IRC12:47
*** yamamoto has quit IRC12:50
*** mgagne has quit IRC12:52
*** mgagne has joined #openstack-qa12:53
*** yamamoto has joined #openstack-qa13:00
*** yamamoto has quit IRC13:00
*** yamamoto has joined #openstack-qa13:00
*** yamamoto has quit IRC13:04
*** yamamoto has joined #openstack-qa13:05
*** yamamoto has quit IRC13:05
*** yamamoto has joined #openstack-qa13:05
*** yamamoto has quit IRC13:06
*** yamamoto has joined #openstack-qa13:07
*** yamamoto has quit IRC13:07
*** yamamoto has joined #openstack-qa13:07
*** yamamoto has quit IRC13:07
*** yamamoto has joined #openstack-qa13:08
*** yamamoto has quit IRC13:08
*** yamamoto has joined #openstack-qa13:09
*** yamamoto has quit IRC13:13
*** dmellado has quit IRC13:25
*** dmellado has joined #openstack-qa13:25
*** jpena|lunch is now known as jpena13:26
*** nweinber has joined #openstack-qa13:38
*** vhari has joined #openstack-qa13:46
dansmithyoctozepto: yeah, we're wasting a lot of CI resources being slow13:52
dansmithyoctozepto: and ever since I've been able to stack locally in 5 minutes.. holy crap so much better for dev UX13:52
*** stand has quit IRC13:54
yoctozeptodansmith: persuade frickler, not me13:54
dansmithyoctozepto: yeah I was just agreeing with you.. sounds like he's not going to object though yeah?13:55
yoctozeptoack, I also understood it this way13:57
*** vishalmanchanda has quit IRC14:14
openstackgerritGhanshyam proposed openstack/tempest master: Use configured upper-constraints for non-master Tempest run  https://review.opendev.org/c/openstack/tempest/+/77491314:43
gmannyoctozepto: frickler dansmith ack, yeah I agree that it is not hard to debug and dansmith is there to bug if it break :)14:52
*** dmellado has quit IRC14:53
*** dmellado has joined #openstack-qa14:54
*** ricolin has joined #openstack-qa15:08
*** yamamoto has joined #openstack-qa15:10
*** dmellado has quit IRC15:10
*** dmellado has joined #openstack-qa15:12
kopecmartingmann: i wanted to test the tempest-slow job for rocky change https://review.opendev.org/c/openstack/tempest/+/774764 by it seems the DNM patch doesn't pull the changes o.O https://review.opendev.org/c/openstack/nova/+/77500315:31
*** yamamoto has quit IRC15:31
gmannkopecmartin: ah, let me check after meeting15:32
gmannkopecmartin: ah, rocky use old tempest 23.0.0 so job is pulled from there?15:45
gmannlet me check the zuul inventory15:45
-openstackstatus- NOTICE: Recent POST_FAILURE results from Zuul for builds started prior to 15:47 UTC were due to network connectivity issues reaching one of our log storage providers, and can be safely rechecked15:51
gmannkopecmartin: this is isuse, it pick master version of zuul job https://zuul.opendev.org/t/openstack/build/7b0c8511460c444b8b922641626d296d/log/zuul-info/inventory.yaml#22715:55
*** ricolin has quit IRC15:56
openstackgerritGhanshyam proposed openstack/tempest master: change ipv6 public network cidr on tempest-slow job  https://review.opendev.org/c/openstack/tempest/+/77476415:59
gmannkopecmartin: ^^ this should work15:59
kopecmartingmann: hmm, i was thinking about that but after reading zuul's doc i was under an impression that zuul picks the job which has a more specific match16:01
kopecmartinanyway, maybe I didn't get it right, let's see16:01
gmannkopecmartin: yeah but if it matches more then it pick other one like you can see in https://zuul.opendev.org/t/openstack/build/7b0c8511460c444b8b922641626d296d/log/zuul-info/inventory.yaml#22716:02
gmannit picked rocky one then master one which was also eligible for rocky16:04
gmannand then base job of rocky one16:04
kopecmartinoh, i see now, yeah, that makes actually sense16:04
gmannits not easy to detect from doc or so but zuul inventory log are very clear and helpful16:06
gouthamrhi there! andrebeltrami and I have a tempest/zuulv3 question - we have a config option of type "MultiOpt" in manila-tempest-conf - so a repeatable option - however, it looks like it's being de-duplicated16:06
gouthamrmanila-tempest-plugin*16:06
gouthamrwondering if is this a known issue? i can see why we would want to deduplicate - because of the way zuulv3 handles overrides16:07
clarkbgouthamr: is it in a dict?16:08
clarkbif the keys collide then yaml (and python) will just pick one16:08
gouthamrclarkb: yes, https://review.opendev.org/c/openstack/manila-tempest-plugin/+/775034/3/zuul.d/manila-tempest-jobs.yaml16:08
clarkbya that won't work due to how yaml dicts work16:09
clarkb(I believe yaml takes the first one, but its been a while since I looked at this behavior)16:09
gouthamroh :( yes16:09
clarkbI think there may be a way to supply raw config to devstack and you probably need to do that instead16:09
clarkbbasically as a quoted string rather than as part of a dict data structure16:10
gouthamroh, that could work - thanks clarkb16:11
* gouthamr reads the manual16:11
gmanngouthamr: clarkb yaah tempest conf will be override with like we do iniset in what order16:13
gmannor better it will be set tempest conf option in devstack plugins based on flag if value is based on flag or so instead is all different for all jobs16:14
gouthamr^ yes, that's a good option too, ty gmann - we do some of that right now, but thought we could clean that up and move all tempest config to the job manifests instead16:16
gmanngouthamr: yeah, that will be better way.16:18
gmanni see lot of tempest conf change there16:18
gouthamryeah, patterns over time :D16:19
openstackgerritLajos Katona proposed openstack/tempest master: WIP: Add live migration with trunk test  https://review.opendev.org/c/openstack/tempest/+/77468916:30
*** ricolin has joined #openstack-qa16:56
*** lucasagomes has quit IRC16:58
*** ricolin has quit IRC17:06
*** afazekas has joined #openstack-qa17:26
*** yamamoto has joined #openstack-qa17:29
openstackgerritMartin Kopec proposed openstack/tempest master: Fix run-tempest black/exclude var setting  https://review.opendev.org/c/openstack/tempest/+/77483517:29
*** rpittau is now known as rpittau|afk17:43
*** yamamoto has quit IRC17:45
*** dtantsur is now known as dtantsur|afk17:45
*** jpena is now known as jpena|off17:47
*** gcheresh has quit IRC17:49
*** ralonsoh has quit IRC17:54
gmannkopecmartin: this is ready https://review.opendev.org/c/openstack/tempest/+/77470117:56
gmannyoctozepto: frickler can you check these to avoid stable branch installing tempest in system wide- https://review.opendev.org/q/I23c77f98c2e969d8046d5212b883e343c36cd1b117:57
*** gfidente is now known as gfidente|afk18:02
dansmithgmann: kopecmartin: This tempest test should go in to validate patches already landed in glance: https://review.opendev.org/c/openstack/tempest/+/77107118:04
dansmithit depends on a small devstack change too18:04
dansmith"should go in" or tell me what to change, of course :P18:04
gmanndansmith: checking18:04
dansmithactually, I just realized I might need a glance side change to set that flag to prove it works to you18:06
dansmithtested locally a while ago of course, but..you probably want that18:06
dansmithoh no wait, it's enabled in the devstack, nevermind18:08
gmannyeah https://review.opendev.org/c/openstack/devstack/+/771252/1/lib/tempest18:08
gmanndansmith: i comment about need of config option https://review.opendev.org/c/openstack/tempest/+/771071/18:17
*** eolivare has quit IRC18:19
dansmithgmann: replied18:21
gmanndansmith: ah got it. I think that is clear in api=-ref also sorry I did not read that before - https://docs.openstack.org/api-ref/image/v2/index.html?expanded=create-image-detail#images18:27
gmann'Available key names may be limited by the cloud’s property protection configuration and reserved namespaces like os_glance.'18:27
dansmithgmann: well the "namespaces like os_glance" was added recently with my change, but yes, the first part has been there and is what brian is referencing :)18:28
gmannthis onw right 'Here’s some important information about image properties:'18:28
gmann3rd point18:28
dansmithyeah18:29
gmanndansmith: +A on tempest and +2 on devstack.18:30
dansmithgmann: thanks much!18:31
*** sboyron_ has quit IRC19:18
openstackgerritGhanshyam proposed openstack/tempest master: Switch to new rolevar for run-temepst role  https://review.opendev.org/c/openstack/tempest/+/77525919:35
*** gcheresh has joined #openstack-qa19:41
*** yamamoto has joined #openstack-qa19:42
gmannkopecmartin: pushed the changes for testing the new role var - https://review.opendev.org/q/topic:%22inclusive_jargon%22+(status:open%20OR%20status:merged)19:45
gmanni think that will cover the all pattern and see if all work fine19:45
gmannonce everything pass then we can cut new release19:46
kopecmartingmann: great, thanks19:47
kopecmartinyeah, we can, scneario manager is practically done - https://review.opendev.org/q/topic:bp/tempest-scenario-manager-stable+status:open19:47
gmannkopecmartin: nice, i will check after my lunch19:51
kopecmartingmann: so this https://review.opendev.org/c/openstack/tempest/+/774701 will fix tempest-all ran on periodic? i see lots of timeout issues19:51
*** gcheresh has quit IRC19:52
gmannkopecmartin: yes, you can see in experimental queue and that is passing19:52
kopecmartini see, great .. +A then19:52
gmannthanks19:52
*** gfidente|afk has quit IRC19:57
*** yamamoto has quit IRC19:59
yoctozeptogmann: ack, approved20:02
yoctozeptogmann, dansmith: async tasks going in now20:02
yoctozeptoI commented with Jens thoughts there20:03
dansmithyoctozepto: sweet thanks!20:03
dansmithI will propose converting some jobs I watch regularly to parallel and we can see how it goes20:05
gmannyoctozepto: thanks20:38
gmannkopecmartin: can you fix this quickly https://review.opendev.org/c/openstack/tempest/+/758658/3/tempest/scenario/manager.py#42320:49
kopecmartingmann: so should I just replace backup by snapshot?20:52
gmannyeah20:52
kopecmartinok, let me push a new patch set then20:52
openstackgerritMartin Kopec proposed openstack/tempest master: Allow kwargs in create_volume_snapshot  https://review.opendev.org/c/openstack/tempest/+/75865820:54
openstackgerritMerged openstack/devstack master: Increase volumes quota for service project  https://review.opendev.org/c/openstack/devstack/+/77417220:55
gmannkopecmartin: thanks +A20:59
kopecmartincool, thank you20:59
openstackgerritGhanshyam proposed openstack/tempest master: Use configured upper-constraints for non-master Tempest run  https://review.opendev.org/c/openstack/tempest/+/77491321:19
*** rcernin has joined #openstack-qa21:20
gmannkopecmartin: soniya29 so this need to be split into separate right? https://review.opendev.org/c/openstack/tempest/+/76601521:30
kopecmartingmann: that's abandoned but yeah, soniya29 did split it already , i think it's also merged already21:36
kopecmartingmann: looking here https://etherpad.opendev.org/p/tempest-scenario-manager I think only two pieces left, one is making _create_security_group public - it's used somewhere, so that might be complicated and take some time, so let's not block a new release by that21:40
kopecmartinand the second is create_subnet method which already has a patch up https://review.opendev.org/c/openstack/tempest/+/766472  however it's not that easy to review21:41
kopecmartinbtw, before the release let's definitely merge a reno for all scenario manager work https://review.opendev.org/c/openstack/tempest/+/76438321:42
gmannok, there are still more private method21:43
gmanni wrote TODO inL339 etherpad https://etherpad.opendev.org/p/tempest-scenario-manager21:43
gmannkopecmartin: soniya29 ^^21:43
gmann2nd part is completely move to neutron interface and stop using nova proxy APi21:44
gmannkopecmartin: i reviewed create_subnet one /766472  and seem good to me, few comment there21:44
gmannkopecmartin: if you can have your eyes on that also now.21:44
gmannlet me know L339 onwards suggestion make sense ?21:45
*** nweinber has quit IRC21:53
kopecmartinyup, the suggestions sound good21:54
kopecmartinchecking the subnet now21:54
*** yamamoto has joined #openstack-qa21:57
kopecmartingmann: hmm, regarding the six package, can we right py3 only code? i'm just wondering because last time when we discussed if we can remove six imports we came to the conclusion we can't as we would break stable jobs21:58
kopecmartininteresting, these deprecations and code removals give me headache sometimes :D21:58
gmannkopecmartin: heh :)21:59
gmannthat is usual nature of branchless repo :)21:59
gmanndo you have link to our IRC conversation on that22:00
gmannI think I cannot recall the discussion completely22:01
gmannTempest is not installable in py2.7. but master Tempest can be used in testing the py2.7 openstack22:01
gmannfrom py3 virtual env like we tests py2.7 job in stein and train22:02
gmanntill this point we are good to remove but from our previous discussion I can check if i miss any  scenario22:02
kopecmartinfound it http://eavesdrop.openstack.org/irclogs/%23openstack-qa/%23openstack-qa.2021-02-02.log.html#t2021-02-02T15:02:1022:03
gmannkopecmartin: unittest2  is separate scenario as it depends on stestr version22:05
gmannbut keeping six mean no benefit seems as we cannot run tempest master code in python2.722:06
gmannkopecmartin: I am very tired today and cannot use much brain :). I will think freshly tomorrow on why we need to keep six.22:07
gmannits too late for you too i think? unless you re in different TZ?22:08
kopecmartinso, even if tempest is used to test py2 cloud , it's still executed by py3 (in a venv) right? than it's not that difficult maybe22:08
kopecmartinyeah, let's think about it more and let's see22:08
kopecmartinit is, it's almost 11 pm here :)22:09
gmannyeah.22:09
gmannohk, too late.22:09
*** gmann is now known as gmann_afk22:10
*** yamamoto has quit IRC22:25
openstackgerritMerged openstack/tempest master: Disable file injection tests until bug/1882421  https://review.opendev.org/c/openstack/tempest/+/77470122:32
openstackgerritMerged openstack/devstack master: Async task support  https://review.opendev.org/c/openstack/devstack/+/77150522:33
openstackgerritMerged openstack/devstack stable/victoria: Stop installing Tempest at system wide for stable branch  https://review.opendev.org/c/openstack/devstack/+/77487722:33
openstackgerritMerged openstack/devstack stable/ussuri: Stop installing Tempest at system wide for stable branch  https://review.opendev.org/c/openstack/devstack/+/77488122:34
*** yamamoto has joined #openstack-qa22:41
openstackgerritMerged openstack/tempest master: Implemetation of tempest client for keystone v3 OS_FEDERATION API  https://review.opendev.org/c/openstack/tempest/+/76314822:46
openstackgerritMerged openstack/tempest master: add unittest for trust client operation interface in identity part  https://review.opendev.org/c/openstack/tempest/+/70053022:47
*** slaweq has quit IRC23:09
*** gmann_afk is now known as gmann23:11
openstackgerritMerged openstack/whitebox-tempest-plugin master: Update iniparse for py2.7 deployments  https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/77490123:23
openstackgerritJames Parker proposed openstack/whitebox-tempest-plugin master: Added emulator thread pinning tests  https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/68764323:32
*** whoami-rajat__ has quit IRC23:43
*** zenkuro has quit IRC23:43
*** ccamposr has quit IRC23:48

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!