Tuesday, 2020-11-24

*** tosky has quit IRC00:17
*** armax has quit IRC00:17
*** armax has joined #openstack-release00:22
*** armax has quit IRC00:28
*** armax has joined #openstack-release00:32
*** brinzhang has joined #openstack-release00:38
*** freerunner has quit IRC02:12
*** freerunner has joined #openstack-release02:13
*** brinzhang has quit IRC02:16
*** iurygregory has quit IRC02:25
*** ykarel has joined #openstack-release02:26
*** whoami-rajat__ has quit IRC02:31
*** ykarel has quit IRC03:19
*** ykarel has joined #openstack-release04:48
*** ykarel_ has joined #openstack-release04:53
*** ykarel has quit IRC04:53
*** ykarel_ is now known as ykarel04:54
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-release05:33
*** ykarel has quit IRC05:55
*** ykarel has joined #openstack-release06:08
*** iurygregory has joined #openstack-release07:02
*** ykarel_ has joined #openstack-release07:22
*** ykarel has quit IRC07:25
*** rpittau|afk is now known as rpittau07:39
*** ykarel__ has joined #openstack-release07:45
*** ykarel_ has quit IRC07:48
*** sboyron__ has joined #openstack-release07:58
*** slaweq has joined #openstack-release08:02
*** ykarel__ is now known as ykarel08:05
*** openstackgerrit has joined #openstack-release08:08
openstackgerritIury Gregory Melo Ferreira proposed openstack/releases master: Release Bifrost 9.0.1 for Victoria  https://review.opendev.org/c/openstack/releases/+/76393608:08
*** jbadiapa has joined #openstack-release08:09
*** sboyron__ is now known as sboyron08:12
*** mgoddard has joined #openstack-release08:44
*** tosky has joined #openstack-release08:48
*** dtantsur|afk is now known as dtantsur09:01
*** ricolin has joined #openstack-release09:19
openstackgerritIury Gregory Melo Ferreira proposed openstack/releases master: Release Ironic 16.0.2 for Victoria  https://review.opendev.org/c/openstack/releases/+/76394809:30
openstackgerritIury Gregory Melo Ferreira proposed openstack/releases master: Release Ironic Inspector 10.4.1 for Victoria  https://review.opendev.org/c/openstack/releases/+/76394909:36
*** iurygregory has quit IRC09:37
*** e0ne has joined #openstack-release09:40
*** e0ne has quit IRC09:40
*** iurygregory has joined #openstack-release09:43
*** ricolin has quit IRC09:44
*** e0ne has joined #openstack-release10:04
*** mgoddard has quit IRC10:11
*** mgoddard has joined #openstack-release10:25
*** mgoddard has quit IRC10:35
*** mgoddard has joined #openstack-release10:49
*** e0ne has quit IRC11:29
*** e0ne has joined #openstack-release12:04
*** dtantsur is now known as dtantsur|brb12:22
*** ykarel is now known as ykarel|away12:23
*** slaweq has quit IRC12:29
*** slaweq has joined #openstack-release12:31
*** ykarel|away has quit IRC12:44
hberaudfungi: o/ all the pieces of the solution are now merged (https://review.opendev.org/c/openstack/project-config/+/763797/, https://review.opendev.org/c/openstack/project-config/+/763830/, https://review.opendev.org/c/zuul/zuul-jobs/+/763834/) can we try to reenqueue a ref? (by example 2f6e3e30f67df4f60e0e2b386755118bb1338059)13:26
*** armstrong has joined #openstack-release13:28
*** dave-mccowan has joined #openstack-release13:39
*** dtantsur|brb is now known as dtantsur13:41
*** whoami-rajat__ has joined #openstack-release13:44
*** mgoddard has quit IRC13:46
*** mgoddard has joined #openstack-release13:53
openstackgerritIury Gregory Melo Ferreira proposed openstack/releases master: Release IPA 6.4.2 for Victoria  https://review.opendev.org/c/openstack/releases/+/76397914:23
fungihberaud: we still need 763834 (which in turn needs 763866 to be able to merge)14:26
hberaudfungi: ah yes sorry I missed that wasn't yet merged14:27
hberauds/that/that it/14:28
fungii'm trying to get them approved shortly14:28
hberaudawesome, thanks14:29
fungiand then, yep, i'll reenqueue that failed build again14:29
*** gouthamr_ has quit IRC14:36
*** e0ne has quit IRC14:57
*** e0ne has joined #openstack-release15:24
openstackgerritchandan kumar proposed openstack/releases master: Release collect-logs role 1.0.0  https://review.opendev.org/c/openstack/releases/+/76399015:34
-openstackstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted quickly to troubleshoot an SMTP queuing backlog, downtime should be less than 5 minutes16:42
*** timburke has quit IRC17:00
*** rpittau is now known as rpittau|afk17:01
*** e0ne has quit IRC17:11
openstackgerritGhanshyam proposed openstack/releases master: release oslo for wallaby - 2020-11-24  https://review.opendev.org/c/openstack/releases/+/76404417:42
gmannhberaud: ^^17:42
hberaudgmann: ack, thanks17:43
openstackgerritGhanshyam proposed openstack/releases master: release oslo for wallaby - 2020-11-24  https://review.opendev.org/c/openstack/releases/+/76404417:44
*** iurygregory has quit IRC17:59
*** dtantsur is now known as dtantsur|afk18:01
*** jbadiapa has quit IRC18:05
*** mgoddard has quit IRC18:07
*** iurygregory has joined #openstack-release18:27
*** whoami-rajat__ has quit IRC18:53
fungiokay, the launchpadlib change in zuul-jobs just landed. i'll reenqueue our earlier build again19:24
fungisudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=2f6e3e30f67df4f60e0e2b386755118bb133805919:24
fungisucceeded and tags are now appearing for senlin and senlin-dashboard19:40
fungiif someone has a moment to go over the logs to make sure it all looks sane: https://zuul.opendev.org/t/openstack/build/4a7cbbcb0adc4253b19745b6c9fe58e219:41
*** sboyron has quit IRC20:09
*** sboyron has joined #openstack-release20:18
hberaudfungi: thanks for the heads up, omw to take a look20:20
fungiif we're comfortable with it, i can proceed with reenqueuing the rest20:21
hberaudsure, let me check that one before20:21
hberaudfungi: everything LGTM20:28
hberaudso I think you're right we can start to reenqueue the rest20:29
hberaudfungi: ^20:29
fungiyep, working on it now, thanks!20:29
hberaudthanks to you!20:30
fungisudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=ec68594ba6faeb92eb9ad82410e3ab91db023b1920:33
fungisudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=7bf3e98f71afeeafdd703390390677728f1749e620:34
fungibit of a pause, i think zuul is in the midst of a reconfiguration20:35
fungisudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=3f2136e225577bf80cc90481db8e8aced937e5ec20:38
fungisudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=f2b5d964aa5fd3290ca82c0cd12baa29e679b68720:38
fungisudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=2f6e3e30f67df4f60e0e2b386755118bb133805920:39
fungii think that's all the ones reported to the release-job-failures ml20:39
hberaudfungi: correct, that's all20:44
fungioh, that last one i enqueued was also the first one i enqueued to test earlier... i expect it will fail since those tags already exist? or maybe it will simply no-op20:45
hberaudah right, good question20:45
hberaudnormally I think it will fail20:46
hberaudas git would surely reject the push command without the forcing option20:46
hberaudbut I'm not sure how it will behave20:47
hberaudI mean if we try to push an already existing tag to a repo I suppose git need to be forced else it will reject the push command as when we amending a commit20:49
hberaudso normally in this case I suppose that the git cmd will exit with an error code and then your job will exit in error too20:50
hberaudapparently it successed https://07b458ee4721db79ef19-f29e759a440a8c469e5909803b48c54b.ssl.cf2.rackcdn.com/2f6e3e30f67df4f60e0e2b386755118bb1338059/release-post/tag-releases/3033cb1/job-output.txt20:51
hberaudec68594ba6faeb92eb9ad82410e3ab91db023b19 is ok too20:57
hberaudfungi: 3f2136e225577bf80cc90481db8e8aced937e5ec is OK21:07
hberaud7bf3e98f71afeeafdd703390390677728f1749e6 is OK21:10
hberaudf2b5d964aa5fd3290ca82c0cd12baa29e679b687 is OK21:11
fungiyeah, i think it looks ahead and skips pushing tags which already exist21:11
hberaudTo summarize every reenqueued ref seems OK21:12
hberaudThen I think we can restart approving patch21:13
hberaudfungi: thanks for your great help21:13
fungiyes, please approve one to start with and make sure it's still okay21:15
hberaudsec I'm looking for an interesting patch to test21:19
hberaudfungi: ok let's observe this one https://review.opendev.org/c/openstack/releases/+/76375821:23
slaweqhi release team21:24
slaweqI need some adivce about neutron stein and train21:24
hberaudo/ slaweq21:24
slaweqwe made horrible mistake some time ago21:24
slaweqand we now have bug https://bugs.launchpad.net/neutron/+bug/1903531 in Neutron Train and Stein21:25
openstackLaunchpad bug 1903531 in neutron "Update of neutron-server breaks compatibility to previous neutron-agent version" [Critical,Confirmed] - Assigned to Slawek Kaplonski (slaweq)21:25
hberaudslaweq: how we can help you?21:25
slaweqour fault is that we merged and backported code which makes older agent incompatible with newer neutron-server21:25
hberaudit was a minor release?21:26
slaweqand worts thing is that we already released that code in both versions21:26
slaweqhberaud: yes21:26
slaweqso basically, lets talk about Train now but for Stein it's the same21:26
hberaudhmm... you can revert these changes, propose a new release, and black list the previous one on requirements21:26
slaweqif someone have got neutron 15.1 and will wand to update to 15.3 he will have this problem21:26
hberauds/previous one/previous ones/21:27
slaweqso neutron-ovs-agent run with 15.1 will not be compatible with neutron server 15.321:27
hberaudI see21:27
slaweqhberaud: we already proposed revert but then frickler and bug owner raised the issue that is someone already fixed neutron during update from 15.1->15.3, now he will have some problem again21:28
slaweqbut tbh, we discussed that today and we don't see better way to "fix" it21:28
hberaudMy main concern is that stein is going to become EM21:28
slaweqas potential fix would need to go to agent's code, and if You already update agent, then this new "fix" wouldn't be really needed21:28
hberaudIf I correctly remember neutron transition to EM isn't yet merged21:29
slaweqhberaud: yes, and that bug is the reason why I -1'ed EM patch21:29
hberaudmake sense21:29
slaweqhberaud: correct :)21:29
slaweqso I wanted to ask You about some advice21:29
slaweqdo You think that we shoud:21:29
hberaudso you've a last chance to properly fix stein21:29
slaweq1. revert change21:29
slaweq2. blacklist versions which contains this broken patch21:30
slaweq3. warn users who already are on 15.3 that they will have problem again - e.g. on mailing list21:30
slaweqor maybe do You see any other better solution for that?21:30
hberaud1. blacklist the version 2. revert the changes 3. quickly warn users 4. propose a reverted release21:30
slaweqby 4 You means new release with reverted patch, right?21:31
hberaudI think your priority is to blacklist the bad version21:31
openstackgerritMerged openstack/releases master: Final Stein releases for Kolla projects  https://review.opendev.org/c/openstack/releases/+/76375821:31
slaweqhow we can blacklist those versions?21:31
hberaudto avoid users to start to use it21:32
hberaudI don't when the last stein release was proposed21:32
hberaudand I don't since these changes are landed21:32
hberauds/I don't know/21:32
slaweqit was pretty long time ago, like few weeks or even months :/21:32
hberaudand I suppose the last release too?21:32
slaweqso, for train we would need to blacklist 15.2.0 and 15.3.0 as those versions contains this patch21:33
slaweqfor Stein it's 14.3.1, 14.4.0 and 14.4.121:33
hberaudbut before acting it could be worth to the requirements team too21:33
slaweqso last good one is 14.3.021:33
*** sboyron has quit IRC21:34
hberaudI mean doing a new release isn't a big deal, but blocking an existing version that exist since awhile isn't the same problem21:34
*** sboyron has joined #openstack-release21:34
hberaudprometheanfire: any opinion? ^21:34
slaweqwhat channel requirements team is using? where should I ask them?21:34
slaweqhberaud: I know that it isn't trivial thing, that's why I'm asking here :)21:35
hberaudsure np21:35
hberaudyou're welcome21:35
prometheanfirehberaud: sorry, what's the question?21:39
hberaudfungi: 1ddbb150446de8ab12676b6c896eadb8ed12d7c3 is OK21:47
fungiawesome, i expect it's thoroughly fixed in that case21:48
hberaudfungi: Yes, its late for me, tomorrow morning I'll try a last one and if everything is fine I'll notify everyone that we restart approving patches21:50
hberaudfungi: the last one that I'll try tomorrow will be a patch of the transition to stein-em to properly close this topic in similar conditions that to the previous patches which failed21:53
hberaudsee you tomorrow21:53
*** sboyron has quit IRC21:58
*** sboyron has joined #openstack-release21:59
fungisounds good, i'll be around!21:59
*** sboyron has quit IRC22:11
*** sboyron has joined #openstack-release22:11
*** sboyron has quit IRC22:12
*** sboyron has joined #openstack-release22:13
*** sboyron has quit IRC22:15
*** sboyron has joined #openstack-release22:16
*** sboyron has quit IRC22:20
*** sboyron has joined #openstack-release22:20
*** sboyron has quit IRC22:25
*** sboyron has joined #openstack-release22:26
*** sboyron has quit IRC22:33
*** sboyron has joined #openstack-release22:34
*** sboyron has quit IRC22:40
*** sboyron has joined #openstack-release22:41
*** sboyron has quit IRC22:48
openstackgerritGhanshyam proposed openstack/releases master: release oslo for wallaby - 2020-11-24  https://review.opendev.org/c/openstack/releases/+/76404422:48
*** sboyron has joined #openstack-release22:48
*** sboyron has quit IRC22:57
*** sboyron has joined #openstack-release23:07
*** slaweq has quit IRC23:09
*** slaweq has joined #openstack-release23:28
*** slaweq has quit IRC23:33
*** tosky has quit IRC23:57
*** openstackgerrit has quit IRC23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!