| *** tosky has quit IRC | 00:17 | |
| *** armax has quit IRC | 00:17 | |
| *** armax has joined #openstack-release | 00:22 | |
| *** armax has quit IRC | 00:28 | |
| *** armax has joined #openstack-release | 00:32 | |
| *** brinzhang has joined #openstack-release | 00:38 | |
| *** freerunner has quit IRC | 02:12 | |
| *** freerunner has joined #openstack-release | 02:13 | |
| *** brinzhang has quit IRC | 02:16 | |
| *** iurygregory has quit IRC | 02:25 | |
| *** ykarel has joined #openstack-release | 02:26 | |
| *** whoami-rajat__ has quit IRC | 02:31 | |
| *** ykarel has quit IRC | 03:19 | |
| *** ykarel has joined #openstack-release | 04:48 | |
| *** ykarel_ has joined #openstack-release | 04:53 | |
| *** ykarel has quit IRC | 04:53 | |
| *** ykarel_ is now known as ykarel | 04:54 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-release | 05:33 | |
| *** ykarel has quit IRC | 05:55 | |
| *** ykarel has joined #openstack-release | 06:08 | |
| *** iurygregory has joined #openstack-release | 07:02 | |
| *** ykarel_ has joined #openstack-release | 07:22 | |
| *** ykarel has quit IRC | 07:25 | |
| *** rpittau|afk is now known as rpittau | 07:39 | |
| *** ykarel__ has joined #openstack-release | 07:45 | |
| *** ykarel_ has quit IRC | 07:48 | |
| *** sboyron__ has joined #openstack-release | 07:58 | |
| *** slaweq has joined #openstack-release | 08:02 | |
| *** ykarel__ is now known as ykarel | 08:05 | |
| *** openstackgerrit has joined #openstack-release | 08:08 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/releases master: Release Bifrost 9.0.1 for Victoria https://review.opendev.org/c/openstack/releases/+/763936 | 08:08 |
|---|---|---|
| *** jbadiapa has joined #openstack-release | 08:09 | |
| *** sboyron__ is now known as sboyron | 08:12 | |
| *** mgoddard has joined #openstack-release | 08:44 | |
| *** tosky has joined #openstack-release | 08:48 | |
| *** dtantsur|afk is now known as dtantsur | 09:01 | |
| *** ricolin has joined #openstack-release | 09:19 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/releases master: Release Ironic 16.0.2 for Victoria https://review.opendev.org/c/openstack/releases/+/763948 | 09:30 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/releases master: Release Ironic Inspector 10.4.1 for Victoria https://review.opendev.org/c/openstack/releases/+/763949 | 09:36 |
| *** iurygregory has quit IRC | 09:37 | |
| *** e0ne has joined #openstack-release | 09:40 | |
| *** e0ne has quit IRC | 09:40 | |
| *** iurygregory has joined #openstack-release | 09:43 | |
| *** ricolin has quit IRC | 09:44 | |
| *** e0ne has joined #openstack-release | 10:04 | |
| *** mgoddard has quit IRC | 10:11 | |
| *** mgoddard has joined #openstack-release | 10:25 | |
| *** mgoddard has quit IRC | 10:35 | |
| *** mgoddard has joined #openstack-release | 10:49 | |
| *** e0ne has quit IRC | 11:29 | |
| *** e0ne has joined #openstack-release | 12:04 | |
| *** dtantsur is now known as dtantsur|brb | 12:22 | |
| *** ykarel is now known as ykarel|away | 12:23 | |
| *** slaweq has quit IRC | 12:29 | |
| *** slaweq has joined #openstack-release | 12:31 | |
| *** ykarel|away has quit IRC | 12:44 | |
| hberaud | fungi: o/ all the pieces of the solution are now merged (https://review.opendev.org/c/openstack/project-config/+/763797/, https://review.opendev.org/c/openstack/project-config/+/763830/, https://review.opendev.org/c/zuul/zuul-jobs/+/763834/) can we try to reenqueue a ref? (by example 2f6e3e30f67df4f60e0e2b386755118bb1338059) | 13:26 |
| *** armstrong has joined #openstack-release | 13:28 | |
| *** dave-mccowan has joined #openstack-release | 13:39 | |
| *** dtantsur|brb is now known as dtantsur | 13:41 | |
| *** whoami-rajat__ has joined #openstack-release | 13:44 | |
| *** mgoddard has quit IRC | 13:46 | |
| *** mgoddard has joined #openstack-release | 13:53 | |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/releases master: Release IPA 6.4.2 for Victoria https://review.opendev.org/c/openstack/releases/+/763979 | 14:23 |
| fungi | hberaud: we still need 763834 (which in turn needs 763866 to be able to merge) | 14:26 |
| hberaud | fungi: ah yes sorry I missed that wasn't yet merged | 14:27 |
| hberaud | s/that/that it/ | 14:28 |
| fungi | i'm trying to get them approved shortly | 14:28 |
| hberaud | awesome, thanks | 14:29 |
| fungi | and then, yep, i'll reenqueue that failed build again | 14:29 |
| hberaud | thanks | 14:29 |
| *** gouthamr_ has quit IRC | 14:36 | |
| *** e0ne has quit IRC | 14:57 | |
| *** e0ne has joined #openstack-release | 15:24 | |
| openstackgerrit | chandan kumar proposed openstack/releases master: Release collect-logs role 1.0.0 https://review.opendev.org/c/openstack/releases/+/763990 | 15:34 |
| -openstackstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted quickly to troubleshoot an SMTP queuing backlog, downtime should be less than 5 minutes | 16:42 | |
| *** timburke has quit IRC | 17:00 | |
| *** rpittau is now known as rpittau|afk | 17:01 | |
| *** e0ne has quit IRC | 17:11 | |
| openstackgerrit | Ghanshyam proposed openstack/releases master: release oslo for wallaby - 2020-11-24 https://review.opendev.org/c/openstack/releases/+/764044 | 17:42 |
| gmann | hberaud: ^^ | 17:42 |
| hberaud | gmann: ack, thanks | 17:43 |
| openstackgerrit | Ghanshyam proposed openstack/releases master: release oslo for wallaby - 2020-11-24 https://review.opendev.org/c/openstack/releases/+/764044 | 17:44 |
| *** iurygregory has quit IRC | 17:59 | |
| *** dtantsur is now known as dtantsur|afk | 18:01 | |
| *** jbadiapa has quit IRC | 18:05 | |
| *** mgoddard has quit IRC | 18:07 | |
| *** iurygregory has joined #openstack-release | 18:27 | |
| *** whoami-rajat__ has quit IRC | 18:53 | |
| fungi | okay, the launchpadlib change in zuul-jobs just landed. i'll reenqueue our earlier build again | 19:24 |
| fungi | sudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=2f6e3e30f67df4f60e0e2b386755118bb1338059 | 19:24 |
| fungi | succeeded and tags are now appearing for senlin and senlin-dashboard | 19:40 |
| fungi | if someone has a moment to go over the logs to make sure it all looks sane: https://zuul.opendev.org/t/openstack/build/4a7cbbcb0adc4253b19745b6c9fe58e2 | 19:41 |
| *** sboyron has quit IRC | 20:09 | |
| *** sboyron has joined #openstack-release | 20:18 | |
| hberaud | fungi: thanks for the heads up, omw to take a look | 20:20 |
| fungi | if we're comfortable with it, i can proceed with reenqueuing the rest | 20:21 |
| hberaud | sure, let me check that one before | 20:21 |
| hberaud | fungi: everything LGTM | 20:28 |
| hberaud | so I think you're right we can start to reenqueue the rest | 20:29 |
| hberaud | fungi: ^ | 20:29 |
| fungi | yep, working on it now, thanks! | 20:29 |
| hberaud | thanks to you! | 20:30 |
| fungi | sudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=ec68594ba6faeb92eb9ad82410e3ab91db023b19 | 20:33 |
| fungi | sudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=7bf3e98f71afeeafdd703390390677728f1749e6 | 20:34 |
| fungi | bit of a pause, i think zuul is in the midst of a reconfiguration | 20:35 |
| hberaud | sure | 20:36 |
| fungi | sudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=3f2136e225577bf80cc90481db8e8aced937e5ec | 20:38 |
| fungi | sudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=f2b5d964aa5fd3290ca82c0cd12baa29e679b687 | 20:38 |
| fungi | sudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release-post --project=openstack/releases --ref=refs/heads/master --newrev=2f6e3e30f67df4f60e0e2b386755118bb1338059 | 20:39 |
| fungi | i think that's all the ones reported to the release-job-failures ml | 20:39 |
| hberaud | fungi: correct, that's all | 20:44 |
| fungi | oh, that last one i enqueued was also the first one i enqueued to test earlier... i expect it will fail since those tags already exist? or maybe it will simply no-op | 20:45 |
| hberaud | ah right, good question | 20:45 |
| hberaud | normally I think it will fail | 20:46 |
| hberaud | as git would surely reject the push command without the forcing option | 20:46 |
| hberaud | but I'm not sure how it will behave | 20:47 |
| hberaud | I mean if we try to push an already existing tag to a repo I suppose git need to be forced else it will reject the push command as when we amending a commit | 20:49 |
| hberaud | so normally in this case I suppose that the git cmd will exit with an error code and then your job will exit in error too | 20:50 |
| hberaud | apparently it successed https://07b458ee4721db79ef19-f29e759a440a8c469e5909803b48c54b.ssl.cf2.rackcdn.com/2f6e3e30f67df4f60e0e2b386755118bb1338059/release-post/tag-releases/3033cb1/job-output.txt | 20:51 |
| hberaud | ec68594ba6faeb92eb9ad82410e3ab91db023b19 is ok too | 20:57 |
| hberaud | fungi: 3f2136e225577bf80cc90481db8e8aced937e5ec is OK | 21:07 |
| hberaud | 7bf3e98f71afeeafdd703390390677728f1749e6 is OK | 21:10 |
| hberaud | f2b5d964aa5fd3290ca82c0cd12baa29e679b687 is OK | 21:11 |
| fungi | yeah, i think it looks ahead and skips pushing tags which already exist | 21:11 |
| hberaud | To summarize every reenqueued ref seems OK | 21:12 |
| hberaud | Then I think we can restart approving patch | 21:13 |
| hberaud | fungi: thanks for your great help | 21:13 |
| fungi | yes, please approve one to start with and make sure it's still okay | 21:15 |
| hberaud | ok | 21:17 |
| hberaud | sec I'm looking for an interesting patch to test | 21:19 |
| hberaud | fungi: ok let's observe this one https://review.opendev.org/c/openstack/releases/+/763758 | 21:23 |
| slaweq | hi release team | 21:24 |
| slaweq | I need some adivce about neutron stein and train | 21:24 |
| hberaud | o/ slaweq | 21:24 |
| slaweq | we made horrible mistake some time ago | 21:24 |
| slaweq | and we now have bug https://bugs.launchpad.net/neutron/+bug/1903531 in Neutron Train and Stein | 21:25 |
| openstack | Launchpad bug 1903531 in neutron "Update of neutron-server breaks compatibility to previous neutron-agent version" [Critical,Confirmed] - Assigned to Slawek Kaplonski (slaweq) | 21:25 |
| hberaud | slaweq: how we can help you? | 21:25 |
| slaweq | our fault is that we merged and backported code which makes older agent incompatible with newer neutron-server | 21:25 |
| hberaud | it was a minor release? | 21:26 |
| slaweq | and worts thing is that we already released that code in both versions | 21:26 |
| slaweq | hberaud: yes | 21:26 |
| slaweq | so basically, lets talk about Train now but for Stein it's the same | 21:26 |
| hberaud | hmm... you can revert these changes, propose a new release, and black list the previous one on requirements | 21:26 |
| slaweq | if someone have got neutron 15.1 and will wand to update to 15.3 he will have this problem | 21:26 |
| hberaud | s/previous one/previous ones/ | 21:27 |
| slaweq | so neutron-ovs-agent run with 15.1 will not be compatible with neutron server 15.3 | 21:27 |
| hberaud | I see | 21:27 |
| slaweq | hberaud: we already proposed revert but then frickler and bug owner raised the issue that is someone already fixed neutron during update from 15.1->15.3, now he will have some problem again | 21:28 |
| hberaud | yes | 21:28 |
| slaweq | but tbh, we discussed that today and we don't see better way to "fix" it | 21:28 |
| hberaud | My main concern is that stein is going to become EM | 21:28 |
| slaweq | as potential fix would need to go to agent's code, and if You already update agent, then this new "fix" wouldn't be really needed | 21:28 |
| hberaud | If I correctly remember neutron transition to EM isn't yet merged | 21:29 |
| slaweq | hberaud: yes, and that bug is the reason why I -1'ed EM patch | 21:29 |
| hberaud | make sense | 21:29 |
| slaweq | hberaud: correct :) | 21:29 |
| slaweq | so I wanted to ask You about some advice | 21:29 |
| slaweq | do You think that we shoud: | 21:29 |
| hberaud | so you've a last chance to properly fix stein | 21:29 |
| slaweq | 1. revert change | 21:29 |
| slaweq | 2. blacklist versions which contains this broken patch | 21:30 |
| slaweq | 3. warn users who already are on 15.3 that they will have problem again - e.g. on mailing list | 21:30 |
| slaweq | or maybe do You see any other better solution for that? | 21:30 |
| hberaud | 1. blacklist the version 2. revert the changes 3. quickly warn users 4. propose a reverted release | 21:30 |
| slaweq | by 4 You means new release with reverted patch, right? | 21:31 |
| hberaud | I think your priority is to blacklist the bad version | 21:31 |
| hberaud | yes | 21:31 |
| slaweq | ok | 21:31 |
| openstackgerrit | Merged openstack/releases master: Final Stein releases for Kolla projects https://review.opendev.org/c/openstack/releases/+/763758 | 21:31 |
| slaweq | how we can blacklist those versions? | 21:31 |
| hberaud | to avoid users to start to use it | 21:32 |
| hberaud | I don't when the last stein release was proposed | 21:32 |
| hberaud | and I don't since these changes are landed | 21:32 |
| hberaud | s/I don't know/ | 21:32 |
| slaweq | it was pretty long time ago, like few weeks or even months :/ | 21:32 |
| hberaud | and I suppose the last release too? | 21:32 |
| slaweq | so, for train we would need to blacklist 15.2.0 and 15.3.0 as those versions contains this patch | 21:33 |
| hberaud | yes | 21:33 |
| slaweq | for Stein it's 14.3.1, 14.4.0 and 14.4.1 | 21:33 |
| hberaud | but before acting it could be worth to the requirements team too | 21:33 |
| slaweq | so last good one is 14.3.0 | 21:33 |
| *** sboyron has quit IRC | 21:34 | |
| hberaud | I mean doing a new release isn't a big deal, but blocking an existing version that exist since awhile isn't the same problem | 21:34 |
| *** sboyron has joined #openstack-release | 21:34 | |
| hberaud | prometheanfire: any opinion? ^ | 21:34 |
| slaweq | what channel requirements team is using? where should I ask them? | 21:34 |
| slaweq | hberaud: I know that it isn't trivial thing, that's why I'm asking here :) | 21:35 |
| hberaud | #openstack-requirements | 21:35 |
| hberaud | sure np | 21:35 |
| hberaud | you're welcome | 21:35 |
| prometheanfire | hberaud: sorry, what's the question? | 21:39 |
| hberaud | fungi: 1ddbb150446de8ab12676b6c896eadb8ed12d7c3 is OK | 21:47 |
| fungi | awesome, i expect it's thoroughly fixed in that case | 21:48 |
| hberaud | fungi: Yes, its late for me, tomorrow morning I'll try a last one and if everything is fine I'll notify everyone that we restart approving patches | 21:50 |
| hberaud | fungi: the last one that I'll try tomorrow will be a patch of the transition to stein-em to properly close this topic in similar conditions that to the previous patches which failed | 21:53 |
| hberaud | see you tomorrow | 21:53 |
| hberaud | thanks | 21:53 |
| *** sboyron has quit IRC | 21:58 | |
| *** sboyron has joined #openstack-release | 21:59 | |
| fungi | sounds good, i'll be around! | 21:59 |
| *** sboyron has quit IRC | 22:11 | |
| *** sboyron has joined #openstack-release | 22:11 | |
| *** sboyron has quit IRC | 22:12 | |
| *** sboyron has joined #openstack-release | 22:13 | |
| *** sboyron has quit IRC | 22:15 | |
| *** sboyron has joined #openstack-release | 22:16 | |
| *** sboyron has quit IRC | 22:20 | |
| *** sboyron has joined #openstack-release | 22:20 | |
| *** sboyron has quit IRC | 22:25 | |
| *** sboyron has joined #openstack-release | 22:26 | |
| *** sboyron has quit IRC | 22:33 | |
| *** sboyron has joined #openstack-release | 22:34 | |
| *** sboyron has quit IRC | 22:40 | |
| *** sboyron has joined #openstack-release | 22:41 | |
| *** sboyron has quit IRC | 22:48 | |
| openstackgerrit | Ghanshyam proposed openstack/releases master: release oslo for wallaby - 2020-11-24 https://review.opendev.org/c/openstack/releases/+/764044 | 22:48 |
| *** sboyron has joined #openstack-release | 22:48 | |
| *** sboyron has quit IRC | 22:57 | |
| *** sboyron has joined #openstack-release | 23:07 | |
| *** slaweq has quit IRC | 23:09 | |
| *** slaweq has joined #openstack-release | 23:28 | |
| *** slaweq has quit IRC | 23:33 | |
| *** tosky has quit IRC | 23:57 | |
| *** openstackgerrit has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!