Friday, 2020-04-24

*** stephenfin has quit IRC00:37
*** stephenfin has joined #openstack-qa00:43
*** Liang__ has joined #openstack-qa01:00
*** brinzhang has joined #openstack-qa01:23
*** brinzhang_ has quit IRC01:26
openstackgerritMerged openstack/patrole master: Add release notes page for version 0.9.0  https://review.opendev.org/72253201:31
*** brinzhang_ has joined #openstack-qa01:55
*** brinzhang has quit IRC01:58
openstackgerritKevin Zhao proposed openstack/devstack master: arm64 devstack run  https://review.opendev.org/70831702:23
*** rh-jelabarre has quit IRC02:40
openstackgerritKevin Zhao proposed openstack/devstack master: arm64 devstack run  https://review.opendev.org/70831702:46
openstackgerritMerged openstack/tempest master: Add release notes page for version 24.0.0  https://review.opendev.org/72253003:05
*** yamamoto has quit IRC03:37
*** yamamoto has joined #openstack-qa03:39
*** brinzhang has joined #openstack-qa03:49
*** brinzhang_ has quit IRC03:52
*** nweinber has quit IRC04:09
*** elod has quit IRC04:13
*** gcheresh has joined #openstack-qa04:20
*** evrardjp has quit IRC04:35
*** evrardjp has joined #openstack-qa04:35
*** yamamoto has quit IRC04:36
*** yamamoto has joined #openstack-qa04:59
*** yamamoto has quit IRC05:05
*** yamamoto has joined #openstack-qa05:10
*** yamamoto has quit IRC05:40
*** yamamoto has joined #openstack-qa05:43
*** yamamoto has quit IRC05:49
*** yamamoto has joined #openstack-qa05:51
*** udesale has joined #openstack-qa05:57
*** yamamoto has quit IRC05:57
*** brinzhang has quit IRC05:57
*** brinzhang has joined #openstack-qa05:58
*** yamamoto has joined #openstack-qa06:00
*** gcheresh has quit IRC06:14
*** elod has joined #openstack-qa06:20
*** elod has quit IRC06:25
*** rcernin has quit IRC06:27
*** vishalmanchanda has joined #openstack-qa06:28
*** rcernin has joined #openstack-qa06:29
*** brinzhang_ has joined #openstack-qa06:30
*** yamamoto has quit IRC06:31
*** elod has joined #openstack-qa06:31
*** brinzhang_ has quit IRC06:32
*** brinzhang has quit IRC06:33
*** nightmare_unreal has joined #openstack-qa06:39
*** yamamoto has joined #openstack-qa06:41
*** slaweq has joined #openstack-qa06:59
*** rpittau|afk is now known as rpittau07:17
*** jpena|off is now known as jpena07:20
*** tosky has joined #openstack-qa07:33
*** rcernin has quit IRC07:35
*** ralonsoh has joined #openstack-qa08:01
*** yamamoto has quit IRC08:14
*** yamamoto has joined #openstack-qa08:14
*** dtantsur|afk is now known as dtantsur08:17
*** lucasagomes has joined #openstack-qa08:20
*** yamamoto has quit IRC08:35
*** ricolin has quit IRC08:39
*** yamamoto has joined #openstack-qa08:44
*** yamamoto has quit IRC08:47
*** yamamoto has joined #openstack-qa08:48
*** yamamoto has quit IRC08:53
*** gcheresh has joined #openstack-qa08:53
*** yamamoto has joined #openstack-qa08:55
*** brinzhang has joined #openstack-qa09:03
*** brinzhang_ has joined #openstack-qa09:06
*** yamamoto has quit IRC09:07
*** yamamoto has joined #openstack-qa09:08
*** yamamoto has quit IRC09:08
*** brinzhang has quit IRC09:09
*** yamamoto has joined #openstack-qa09:11
*** yamamoto has quit IRC09:13
*** dtantsur is now known as dtantsur|brb09:15
*** yamamoto has joined #openstack-qa09:16
*** gfidente|afk is now known as gfidente09:22
*** Liang__ has quit IRC09:39
*** gcheresh has quit IRC09:40
iurygregorytosky, hey o09:50
iurygregoryo/09:50
iurygregorythe timeout for grenade is 3hrs only?09:50
*** yoctozepto has quit IRC10:09
*** rpittau is now known as rpittau|bbl10:12
*** yoctozepto has joined #openstack-qa10:22
*** elod has quit IRC10:24
*** brinzhang_ has quit IRC10:25
*** elod has joined #openstack-qa10:30
toskyiurygregory: you can extend it11:04
iurygregorytosky, ack o/11:04
toskyiurygregory: about the logs, I didn't realize you need to save both the old and the new logs; in that case, I suspect I need to add a new variable to allow you to extend the list of items collected both from old and new11:05
iurygregorytosky, no worries =) I think logs/old logs/new will to the work there11:07
toskyiurygregory: uhm, no, because that's not a directory name, but a constant value11:07
iurygregoryO.o11:07
iurygregoryso how in the last result I got the folder in the old/ dir? .-.11:08
iurygregoryhttps://bcb62cd3b58770c4d24c-70dea16a033889bf287c43a782362fa1.ssl.cf2.rackcdn.com/703995/8/check/ironic-inspector-grenade/bb31ba5/controller/logs/old/11:08
toskyuhm11:09
toskylet me see the source11:09
iurygregoryI think new didn't show any because I got the timeout only...11:09
toskyiurygregory: that's the documentation: https://opendev.org/zuul/zuul-jobs/raw/branch/master/roles/stage-output/README.rst11:10
toskyso technically anything which is not logs, artifacts, docs, null, may break anytime11:11
toskyiurygregory: but I have an alternative solution11:11
toskywhich I'm going to implement quickly11:11
iurygregorywell it's only log files from the virtual baremetal nodes =) so I think it's ok, but I'm happy to hear your solution and update the patch o/11:12
iurygregorysince I will probably increase the timeout =)11:12
*** dtantsur|brb is now known as dtantsur11:14
toskygive me, uhm, 2 hours11:17
iurygregorytake your time =)11:19
*** yamamoto has quit IRC11:20
*** jpena is now known as jpena|lunch11:28
*** yamamoto has joined #openstack-qa11:37
*** rh-jelabarre has joined #openstack-qa12:08
*** yamamoto has quit IRC12:10
*** rpittau|bbl is now known as rpittau12:13
*** raildo has joined #openstack-qa12:20
*** ramishra has quit IRC12:29
*** nweinber has joined #openstack-qa12:29
*** paras333 has joined #openstack-qa12:33
*** jpena|lunch is now known as jpena12:38
*** gcheresh has joined #openstack-qa12:42
*** yamamoto has joined #openstack-qa12:43
*** yamamoto has quit IRC12:49
*** yamamoto has joined #openstack-qa12:49
*** ramishra has joined #openstack-qa13:21
openstackgerritLuigi Toscano proposed openstack/grenade master: Setup native grenade Zuul v3 jobs  https://review.opendev.org/54893613:44
openstackgerritLuigi Toscano proposed openstack/grenade master: DNM - grenade test jobs (heat, neutron)  https://review.opendev.org/63977413:44
toskyiurygregory: around? If ^^ works, please add the directory you want as grenade_devstack_saved_files (as a list)13:44
iurygregorytosky, I'm o/13:44
* iurygregory looks at the patch13:45
iurygregorytosky, http://paste.openstack.org/show/792663/ something like this?13:51
toskyiurygregory: even easier, just:13:52
toskygrenade_devstack_saved_files:13:52
tosky  - ironic-bm-logs13:52
iurygregoryO.o13:52
iurygregory=O13:52
iurygregoryok13:52
toskyuh13:52
toskymoment13:52
iurygregoryok13:52
toskyno :/13:53
toskythat works for files only13:53
iurygregoryops13:53
toskyI should add a way to recursively copy directories13:53
iurygregorythe dir has a lot of files and another dir inside13:53
toskyand you want to copy everything13:53
iurygregoryyeah13:53
iurygregoryso if it fails we can debug easier13:53
toskythe problem is that iirc the copy ansible module with remote_src does not work on dirs13:53
iurygregoryif the VM got kernel panic etc13:54
*** udesale_ has joined #openstack-qa13:54
toskyI guess I should use synchronize13:55
toskyoh, it seems it may work with ansible 2.813:55
*** iurygregory has quit IRC13:55
toskyand I think it's the version used on opendev.org13:55
*** iurygregory has joined #openstack-qa13:56
iurygregorysorry xchat crashed =)13:57
toskyiurygregory: remote_src supports recursive copying from ansible 2.8, so it should work13:57
toskyas iirc that's the version used on opendev.org13:57
iurygregoryok so just - ironic-bm-logs ?13:57
toskyyep13:57
iurygregorycool13:57
iurygregoryI'll grive a try now13:57
toskythanks!13:57
*** udesale has quit IRC13:57
iurygregoryzuul_copy_output can go away right?13:57
toskyyes, because it's already handled by a rule in the grenade job definition13:58
iurygregorycool13:58
toskythe two lines13:58
tosky'{{ devstack_bases.logs_old }}': logs13:58
tosky'{{ devstack_bases.logs_new }}': logs13:59
iurygregorydone14:00
toskycan you please also use the new topic native-zuulv3-migration? This work is now the  step 0 for that community goal14:00
*** gcheresh has quit IRC14:02
iurygregorysure14:04
iurygregoryI will update the topic14:04
iurygregorydone =)14:07
toskythanks! It's easier to track them14:09
iurygregoryyw14:14
*** udesale_ has quit IRC14:19
gmanntosky: its all good from me now on grenade job. waiting for final result.14:31
toskygmann: I did a final update (see the chat above)14:31
toskyhopefully it should fix another small use case14:31
gmannchecking..14:31
gmanngot it, good idea.14:33
gmannbasically this one   -https://review.opendev.org/#/c/703098/14/zuul.d/ironic-jobs.yaml@70314:35
iurygregoryI will be happy to give my +1 after I can verify the logs =D14:37
toskygmann: I've seen the comment in the nova grenade patch; but why do they explicitly have grenade-py3 if they get it from the integrated-gate-compute project template?15:16
gmanntosky: that is to define the irrelevant-files which are project specific and cannot be defined in template15:22
gmannsame for tempest change - https://review.opendev.org/#/c/722551/215:24
gmannone idea is once we merge the new job then we will push the patches to all those repo which should not be much and then send ML about this migration and running of duplicate job until they merge the proposed patch and template .15:25
*** vishalmanchanda has quit IRC15:34
*** lucasagomes has quit IRC16:06
*** ricolin has joined #openstack-qa16:17
*** yamamoto has quit IRC16:23
*** dtantsur is now known as dtantsur|afk16:29
*** evrardjp has quit IRC16:35
*** evrardjp has joined #openstack-qa16:35
*** rpittau is now known as rpittau|afk16:41
*** jpena is now known as jpena|off16:48
*** nightmare_unreal has quit IRC16:48
*** slaweq has quit IRC16:55
toskyiurygregory: it seems it worked16:55
iurygregorytosky, yeah I'm just wondering if we really run something in new that would generate the ironic-bm-logs dir sicne it's not in https://01fb33cabfdc519700fe-39ea9922466a012ae87f5ade696bc311.ssl.cf2.rackcdn.com/703098/14/check/ironic-grenade/ce6c10b/controller/logs/new/ .-.16:56
toskyiurygregory: which component does create that directory? devstack only runs in old/, so something else should create (or copy) that directory in new/16:56
iurygregoryoh16:57
iurygregoryI thought devstack also run in new no?16:57
iurygregoryafter we do the upgrade16:57
*** yamamoto has joined #openstack-qa16:57
toskyno, devstack is only charge of the initial deployment, then grenade runs its upgrade scripts16:58
iurygregoryoh16:58
iurygregorygotcha16:58
toskythe difference now is that devstack is executed directly through the existing zuul roles, while grenade.sh runs devstack in the legacy jobs16:58
iurygregorygotcha16:59
iurygregoryironic-grenade-dsvm only have ironic-bm-log dir in old also17:00
iurygregoryhttps://07ee508b1ec6931ea42a-55c346d8a0a53f06bfa3e84321f61ba5.ssl.cf1.rackcdn.com/712042/10/check/ironic-grenade-dsvm/553cca4/logs/new/17:00
toskyok - so you don't really need to use that variable and you could rely on zuul_copy_output, but at least we tested that the change works :)17:01
toskythat's up to you17:01
iurygregoryyeah I will ask Julia just to confirm =)17:02
*** yamamoto has quit IRC17:03
iurygregorytosky, yeah it's correct =)17:05
openstackgerritMerged openstack/devstack-gate master: Set TOX_CONSTRAINTS_FILE  https://review.opendev.org/72171817:06
*** elod has quit IRC17:42
*** elod has joined #openstack-qa17:48
*** ralonsoh has quit IRC17:52
*** gfidente has quit IRC18:16
toskyit seems grenade is green18:34
*** paras333 has quit IRC18:35
*** paras333 has joined #openstack-qa18:36
gmanntosky: iurygregory is 'ironic-bm-logs' dir nested with same name - if you have observed in old node logs- https://zuul.opendev.org/t/openstack/build/ce6c10bcb02a491eb0b51c463fab264d/logs18:41
toskyuhm18:43
gmannthis looks fine - https://review.opendev.org/#/c/703098/14/zuul.d/ironic-jobs.yaml@70218:44
*** gcheresh has joined #openstack-qa18:48
*** mvkr has quit IRC18:49
*** gcheresh has quit IRC19:18
*** ccamposr has joined #openstack-qa19:25
*** ricolin has quit IRC19:26
toskygmann: I suspect it's the copy ansible module: if I specify X as directory, it's specified both as src and dest, so it creates X as dest and copies X inside X19:27
*** ccamposr__ has quit IRC19:28
*** paras333 has quit IRC19:28
toskynot sure how to easily solve it19:29
toskyprobably a new option in ansible and wait for ansible 2.12 or whenever is going to be implemented :)19:29
toskyat this point, given that it's an optional feature which not many users is going to use, and that the information is there, I would rather not implement a separate check for directories (also because it's complicated as you can't use loops with ansible, I would need to have a separate module maybe)19:33
tosky(also, it turned out that this specific case can be handled by just saving the results from old/)19:33
*** paras333 has joined #openstack-qa19:38
*** nweinber has quit IRC19:50
*** mgagne has joined #openstack-qa19:51
gmanntosky: yeah, i was trying few way for if directory cases but does not work19:51
gmanntosky: let's go with that and later we will see19:51
gmanntosky: +2. thanks again.19:54
tosky\o/ thanks19:54
gmannfrickler: yoctozepto can one of you check this, we should get this merge before grenade ussuri branch is cut - https://review.opendev.org/#/c/548936/11619:54
gmanntosky: two beers for you when ever we will meet :)19:55
toskynah, I just implemented a small brick :)19:55
toskyI need to chase other cores now :)19:55
yoctozeptofwiw, it looks hardly small19:58
yoctozeptoI'll take on it tomorrow, too tired to handle this today19:58
yoctozeptogmann, tosky ^19:58
gmannyoctozepto: sure, thanks19:58
gmanntake rest.19:59
toskyno problem, it's late19:59
toskyand there are still a few projects that lacks the stable/ussuri branch anyway19:59
AJaegertosky: you have it working? WOOOW Congrats!19:59
gmanntosky: yeah, devstack is first to cut. i think we have time to get it merge.19:59
toskyAJaeger: I mean, I'm in front of my computer anyway19:59
toskydoing other stuff, but the chat is still there20:00
*** toabctl has quit IRC20:00
toskythe only thing I'd like to know is which location this patch holds in the rank of "reviews ordered by amount of patchesets"20:02
gmannhehe, yeah good to check that :)20:03
yoctozeptoprobably one of the leaders, but still: https://review.opendev.org/69684120:05
yoctozeptoat one point we joked the merger happens only at powers of two so there is a need to move till 25620:05
* yoctozepto going to bed20:05
gmann:)20:06
toskyoh, wow20:07
*** mvkr has joined #openstack-qa20:16
-openstackstatus- NOTICE: The Zuul project gating service is reporting new patches in merge conflict erroneously due to a configuration error, fix in progress20:20
*** paras333 has quit IRC20:21
*** paras333 has joined #openstack-qa20:28
iurygregorygmann, yeah I noticed, I will update the patches to copy using zuul_copy_output since we will on have the dir in old anyways =)20:38
*** paras333 has quit IRC20:49
*** paras333 has joined #openstack-qa20:49
*** gcheresh has joined #openstack-qa20:58
*** raildo has quit IRC21:07
*** gcheresh has quit IRC21:29
*** rf0lc0 has quit IRC21:36
*** rh-jelabarre has quit IRC21:52
*** paras333 has quit IRC22:34
*** rf0lc0 has joined #openstack-qa22:55
-openstackstatus- NOTICE: the This Zuul outage was taken as an opportunity to perform an impromptu maintenance for changing our service deployment model; any merge failures received from Zuul between 19:40 and 20:20 UTC were likely in error and those changes should be rechecked; any patches uploaded between 20:55 and 22:45 UTC were missed entirely by Zuul and should also be rechecked to get fresh test results22:58
*** tosky has quit IRC23:14
*** rf0lc0 has quit IRC23:30

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!