*** mriedem has quit IRC | 01:09 | |
*** whoami-rajat has joined #openstack-release | 02:03 | |
*** tinwood has quit IRC | 02:10 | |
*** tinwood has joined #openstack-release | 02:12 | |
*** hongbin has joined #openstack-release | 02:12 | |
*** mriedem has joined #openstack-release | 02:23 | |
*** mriedem has quit IRC | 02:29 | |
*** samueldmq has quit IRC | 03:16 | |
*** hongbin has quit IRC | 03:52 | |
openstackgerrit | Merged openstack/releases master: Release reno 2.11.3 https://review.openstack.org/649626 | 03:53 |
---|---|---|
*** ykarel has joined #openstack-release | 04:03 | |
*** udesale has joined #openstack-release | 04:09 | |
*** ekcs has joined #openstack-release | 04:27 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/releases master: Do minor release for tripleo-common for Stein https://review.openstack.org/649875 | 04:51 |
*** ricolin has joined #openstack-release | 04:57 | |
*** pcaruana has joined #openstack-release | 04:58 | |
*** lbragstad has quit IRC | 05:06 | |
*** e0ne has joined #openstack-release | 05:12 | |
*** e0ne has quit IRC | 05:18 | |
*** ykarel is now known as ykarel|afk | 05:19 | |
*** ykarel|afk has quit IRC | 05:23 | |
*** ykarel|afk has joined #openstack-release | 05:42 | |
*** ykarel|afk is now known as ykarel | 05:43 | |
*** armax has quit IRC | 05:53 | |
*** armax has joined #openstack-release | 06:00 | |
evrardjp | I am confused smcginnis -- I thought we are using requierments upper constraints, which means IMO we didn't need that bump ? | 06:03 |
*** slaweq has joined #openstack-release | 06:21 | |
*** e0ne has joined #openstack-release | 06:47 | |
*** hberaud|gone is now known as hberaud | 07:04 | |
*** tesseract has joined #openstack-release | 07:09 | |
*** dims has quit IRC | 07:22 | |
*** dims has joined #openstack-release | 07:24 | |
*** tosky has joined #openstack-release | 07:26 | |
e0ne | hi. could anybody help me with release notes? I've got the following error "Inline emphasis start-string without end-string" | 07:28 |
e0ne | http://logs.openstack.org/31/648631/4/check/build-openstack-releasenotes/5ca4b2b/job-output.txt.gz#_2019-04-04_07_25_50_247324 | 07:28 |
*** dims has quit IRC | 07:31 | |
evrardjp | e0ne: which branch is that? | 07:32 |
e0ne | evrardjp: it's horizon master branch | 07:32 |
e0ne | I've got the same error on my dev environment too :( | 07:32 |
evrardjp | that's interesting | 07:33 |
evrardjp | I don't really have the time to look at this right now though | 07:33 |
*** dims has joined #openstack-release | 07:34 | |
evrardjp | there is nothing wrong from what I can see at first sight, so I suppose it's the sphinx2 which is biting us | 07:34 |
e0ne | any guidelines would be helpful for me | 07:34 |
evrardjp | maybe an issue with a release note in stein ? | 07:36 |
evrardjp | did you check that by keeping one good release note only in your local env, to see how it goes? | 07:36 |
evrardjp | (stabbing in the dark here) I can check a little further with you if you prefer, but I can't do it now | 07:37 |
e0ne | I'll try to run `tox -e releasenotes` without new release note | 07:39 |
evrardjp | don't forget to commit your changes :) | 07:44 |
evrardjp | before rerunning | 07:44 |
evrardjp | but, as I said, pretty new to reno | 07:44 |
evrardjp | I am* | 07:44 |
evrardjp | maybe wait for dhellmann later today | 07:44 |
e0ne | evrardjp: thanks for the help. looks like I understood what went wrong | 07:45 |
evrardjp | was it a release note with an un-closed emphasis? | 07:45 |
evrardjp | or something completely different? | 07:45 |
evrardjp | or requirements mismatch? | 07:46 |
evrardjp | so many things :) | 07:46 |
e0ne | so, I created a release note using 'reno new policy-sync' command | 07:46 |
e0ne | after that, I renamed policy-sync-f867d52d2599525a.yaml to policy-sync-stein-f867d52d2599525a.yaml and it broke the build | 07:47 |
evrardjp | oh I see | 07:47 |
evrardjp | so basically mismatch of things between branches? | 07:47 |
evrardjp | (sorry to be digging deeper) | 07:48 |
evrardjp | at least you isolated the reno causing the failure | 07:48 |
*** ykarel is now known as ykarel|lunch | 07:48 | |
e0ne | I need to dig a bit deeper on know reno works to understand the root cause | 07:49 |
evrardjp | I don't see that reno in your notes/ | 07:49 |
e0ne | what do you mean? | 07:49 |
evrardjp | *tilt* | 07:50 |
evrardjp | I just understood what you were doing. | 07:50 |
evrardjp | I assumed you had a release issue | 07:50 |
evrardjp | nevermind it's the morning for me | 07:51 |
e0ne | no, I'm trying to fix the last minute bug before doing the RC2 | 07:51 |
evrardjp | I think it's not the rename, but the content of the release note, at first sight | 07:52 |
evrardjp | (now that I am looking at the right things, it helps) | 07:53 |
e0ne | everything begin work after I rename the file as it was originally created | 07:53 |
*** jpich has joined #openstack-release | 07:53 | |
* e0ne is not a reno expert at all | 07:53 | |
*** amoralej|off is now known as amoralej | 07:53 | |
evrardjp | ok good :) | 07:54 |
*** spsurya has joined #openstack-release | 07:55 | |
*** dtantsur|afk is now known as dtantsur | 08:25 | |
openstackgerrit | Luka Peschke proposed openstack/releases master: Release cloudkitty stein rc2 https://review.openstack.org/649313 | 08:28 |
*** e0ne has quit IRC | 08:30 | |
*** e0ne has joined #openstack-release | 08:40 | |
*** e0ne has quit IRC | 08:42 | |
*** ykarel|lunch is now known as ykarel | 08:45 | |
openstackgerrit | Jens Harbott (frickler) proposed openstack/releases master: Tag Chef OpenStack repos with newton-eol https://review.openstack.org/649945 | 08:47 |
*** frickler has joined #openstack-release | 08:47 | |
*** e0ne has joined #openstack-release | 08:50 | |
e0ne | evrardjp: something goes wrong:(. release notes build is success until I commit a new relese note file:( | 08:51 |
evrardjp | change the text of said release note :) | 08:52 |
evrardjp | try if it works better | 08:52 |
evrardjp | remove the : ` * | 08:52 |
evrardjp | and _ | 08:53 |
evrardjp | well that's what I would do | 08:53 |
*** ricolin has quit IRC | 08:53 | |
evrardjp | just making sure everyhting is alright : ) | 08:53 |
*** jaosorior has quit IRC | 08:54 | |
e0ne | thanks, will try it | 08:55 |
*** electrofelix has joined #openstack-release | 08:58 | |
*** ykarel is now known as ykarel|away | 09:00 | |
*** ykarel|away has quit IRC | 09:05 | |
*** ykarel|away has joined #openstack-release | 09:33 | |
*** ykarel|away is now known as ykarel | 09:33 | |
openstackgerrit | Merged openstack/releases master: Release cloudkitty stein rc2 https://review.openstack.org/649313 | 09:41 |
*** e0ne has quit IRC | 09:44 | |
*** e0ne has joined #openstack-release | 09:54 | |
*** dtantsur is now known as dtantsur|brb | 10:07 | |
openstackgerrit | dharmendra kushwaha proposed openstack/releases master: Release tacker stein rc2 https://review.openstack.org/649962 | 10:17 |
*** jaosorior has joined #openstack-release | 10:52 | |
*** udesale has quit IRC | 10:54 | |
*** jaosorior has quit IRC | 10:59 | |
*** jaosorior has joined #openstack-release | 11:01 | |
*** hberaud is now known as hberaud|lunch | 11:04 | |
*** zbr has quit IRC | 11:14 | |
*** cdent has joined #openstack-release | 11:17 | |
*** zbr has joined #openstack-release | 11:31 | |
*** samueldmq has joined #openstack-release | 11:40 | |
*** ykarel has quit IRC | 11:45 | |
*** ykarel has joined #openstack-release | 11:46 | |
*** e0ne has quit IRC | 11:50 | |
*** dtantsur|brb is now known as dtantsur | 11:57 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/releases master: First release of ansible-config_template https://review.openstack.org/629809 | 12:02 |
*** hberaud|lunch is now known as hberaud | 12:12 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/releases master: First release of ansible-config_template https://review.openstack.org/629809 | 12:17 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/releases master: First release of ansible-config_template https://review.openstack.org/629809 | 12:19 |
openstackgerrit | Trinh Nguyen proposed openstack/releases master: Release python-searchlight client 1.5.1 for stein https://review.openstack.org/649487 | 12:30 |
*** jaosorior has quit IRC | 12:31 | |
*** jaosorior has joined #openstack-release | 12:31 | |
*** zul has joined #openstack-release | 12:52 | |
*** mriedem has joined #openstack-release | 12:54 | |
*** lbragstad has joined #openstack-release | 12:59 | |
*** jaosorior has quit IRC | 13:04 | |
*** jaosorior has joined #openstack-release | 13:04 | |
*** udesale has joined #openstack-release | 13:05 | |
smcginnis | evrardjp: Sorry, what was the question about requirements? | 13:14 |
*** e0ne has joined #openstack-release | 13:22 | |
evrardjp | currious about why the bump was required, as the min requirement is > 0.1.0 and we are installing with a constraint from upper constraint which should be 0.2.0 so I thought this was not required | 13:44 |
openstackgerrit | Merged openstack/releases master: Release freezer for 7.1.0 and 2.2.0 https://review.openstack.org/647996 | 13:45 |
openstackgerrit | Merged openstack/releases master: Release tacker stein rc2 https://review.openstack.org/649962 | 13:45 |
smcginnis | evrardjp: Bump of what? | 13:47 |
smcginnis | evrardjp: Oh, sphinxcontrib.datatemplates? | 13:49 |
smcginnis | Because we know 0.1.0 will not work, so even though it would pick up the newer version with upper-constraints being raised, this makes sure we are correctly declaring what version is needed. | 13:49 |
*** spsurya has quit IRC | 13:51 | |
evrardjp | got it | 13:51 |
*** altlogbot_2 has quit IRC | 13:54 | |
*** e0ne has quit IRC | 13:59 | |
openstackgerrit | Sean McGinnis proposed openstack/releases master: Remove networking-generic-switch-tempest-plugin https://review.openstack.org/650013 | 14:01 |
*** smrcascao has joined #openstack-release | 14:01 | |
*** e0ne has joined #openstack-release | 14:05 | |
*** udesale has quit IRC | 14:06 | |
*** udesale has joined #openstack-release | 14:07 | |
*** udesale has quit IRC | 14:11 | |
*** udesale has joined #openstack-release | 14:11 | |
*** armstrong has joined #openstack-release | 14:12 | |
openstackgerrit | Merged openstack/releases master: Release keystone 14.1.0 for stable/rocky https://review.openstack.org/645018 | 14:15 |
*** mlavalle has joined #openstack-release | 14:16 | |
openstackgerrit | Carlos Goncalves proposed openstack/releases master: Release Octavia Stein RC2 https://review.openstack.org/650019 | 14:19 |
*** hberaud is now known as hberaud|school-r | 14:24 | |
*** hberaud|school-r is now known as hberaud | 14:33 | |
*** e0ne has quit IRC | 14:46 | |
openstackgerrit | Matt Riedemann proposed openstack/releases master: nova: release stein 19.0.0.0rc2 https://review.openstack.org/649656 | 14:47 |
*** e0ne has joined #openstack-release | 14:52 | |
*** e0ne has quit IRC | 14:57 | |
*** jaosorior has quit IRC | 15:01 | |
dhellmann | evrardjp , smcginnis : we also don't use upper constraints for the releases repo because no one needs to install that code along side openstack | 15:27 |
smcginnis | We actually do for docs. | 15:28 |
evrardjp | we do for docs indeed :) | 15:28 |
*** udesale has quit IRC | 15:32 | |
*** e0ne has joined #openstack-release | 15:46 | |
openstackgerrit | Ivan Kolodyazhny proposed openstack/releases master: Release Horizon Stein RC2 https://review.openstack.org/650055 | 15:47 |
*** e0ne has quit IRC | 15:48 | |
*** e0ne has joined #openstack-release | 15:48 | |
*** e0ne has quit IRC | 15:48 | |
ttx | meeeeeting | 15:59 |
smcginnis | #startmeeting releaseteam | 16:00 |
openstack | Meeting started Thu Apr 4 16:00:01 2019 UTC and is due to finish in 60 minutes. The chair is smcginnis. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
*** openstack changes topic to " (Meeting topic: releaseteam)" | 16:00 | |
openstack | The meeting name has been set to 'releaseteam' | 16:00 |
smcginnis | ttx: You're jumping the gun. :) | 16:00 |
* ttx might have to urgently pause in middle to drive kid somewhere | 16:00 | |
smcginnis | #link https://etherpad.openstack.org/p/stein-relmgt-tracking | 16:00 |
ttx | that's why I'm starting early | 16:00 |
smcginnis | They can walk. | 16:00 |
smcginnis | :) | 16:00 |
smcginnis | We're on line 518. | 16:00 |
smcginnis | Ping list: smcginnis ttx dhellmann diablo_rojo hberaud evrardjp fungi armstrong | 16:01 |
dhellmann | o/ | 16:01 |
evrardjp | o/ | 16:01 |
smcginnis | #topic Stein release | 16:01 |
*** openstack changes topic to "Stein release (Meeting topic: releaseteam)" | 16:01 | |
smcginnis | We had one unreleased that I took care of this morning, so we can skip that. | 16:02 |
smcginnis | Missing stable branches: There's a few. | 16:02 |
hberaud | o/ | 16:02 |
smcginnis | Looks like the proposed patches did not include any branching. | 16:02 |
*** amoralej is now known as amoralej|off | 16:02 | |
smcginnis | I figure we can branch those early tomorrow. Or should we do it today? | 16:02 |
evrardjp | mmm | 16:03 |
smcginnis | Or no one cares. :D | 16:04 |
evrardjp | you mean for L523? | 16:04 |
ttx | So it's normal to have missing stable | 16:04 |
dhellmann | do we have anything other than tempest plugins that don't have branches? | 16:04 |
smcginnis | Yeah, basically. | 16:04 |
ttx | we are supposed to cut them this week | 16:04 |
smcginnis | dhellmann: Yeah, there's a list of them in the etherpad in the meeting agenda. | 16:04 |
ttx | A couple are very old releases though | 16:04 |
ttx | so we might want to doublecheck recent changes | 16:04 |
smcginnis | ec2-api is very low activity. | 16:04 |
evrardjp | my question is what do you really want to branch :) | 16:04 |
smcginnis | Not sure about manila-ui. | 16:05 |
dhellmann | oh, sorry, I was looking too high up in that section of the pad | 16:05 |
evrardjp | and shouldn't that be at least done by the PTLs? | 16:05 |
*** e0ne has joined #openstack-release | 16:05 | |
ttx | It's all fine since they all have done a release during the cycle | 16:05 |
smcginnis | evrardjp: Well, a lot should be done by the PTLs, but they don't. We need to make sure a stable branch is created. | 16:05 |
ttx | and we said we would cut stable/stein from most recent release | 16:05 |
smcginnis | Yep, we did announce we would do them if they were not proposed by now. | 16:06 |
openstackgerrit | Ivan Kolodyazhny proposed openstack/releases master: Release Horizon Stein RC2 https://review.openstack.org/650055 | 16:06 |
evrardjp | smcginnis: agreed on general releases, tagging. But here it's to create a branch -- I am not so sure. Sorry to get cold feet | 16:06 |
ttx | manila-ui has only test changes | 16:06 |
ttx | so 2.17.0 probably ok | 16:06 |
ttx | and 8.0.0 is current for ec2-api | 16:06 |
dhellmann | evrardjp : part of the move we've made over the last couple of cycles is to do more of this stuff for the teams, instead of trying to chase down everyone to ensure they do it themselves | 16:06 |
ttx | so all good | 16:06 |
smcginnis | evrardjp: It's a good point that a stable branch can be created from the tag as needed. But good to have them created before they are needed to make sure. | 16:06 |
evrardjp | dhellmann: agreed I like this, but I thought branching was a big thing due to the backport burden | 16:07 |
ttx | no branching is cheap | 16:07 |
evrardjp | but line 534 clarifies it's not a big thing | 16:07 |
smcginnis | I can propose the branches today and push them through. Or we can approve them early tomorrow. Any preferences? | 16:07 |
evrardjp | ttx: true for us :) | 16:07 |
*** ykarel is now known as ykarel|away | 16:07 | |
ttx | smcginnis: approve early tomorrow | 16:08 |
gouthamr | smcginnis: to clarify, we did release stein with https://review.openstack.org/#/c/631776/ in manila-ui, no new changes were made, except gate stuff like ttx mentioned | 16:08 |
smcginnis | gouthamr: Thanks! | 16:08 |
evrardjp | smcginnis: no preference | 16:08 |
dhellmann | gouthamr : if we branch without those changes, your new stable branch will be broken | 16:08 |
tbarron | gouthamr: +1 | 16:08 |
dhellmann | s/will/may | 16:08 |
dhellmann | do you need to tag a more current point release so we can branch from that? | 16:08 |
tbarron | dhellmann: gouthamr: we can certainly do that | 16:09 |
gouthamr | dhellmann: sure, yes.. tbarron is here, so we will do momentarily | 16:09 |
dhellmann | sounds good, thanks | 16:09 |
smcginnis | Great, thanks. That should help with the concern evrardjp raised of then making teams need to backport things. | 16:09 |
smcginnis | OK, translations... | 16:10 |
*** diablo_rojo has joined #openstack-release | 16:10 | |
smcginnis | Horizon was the only one called out in the etherpad, but I see Ivan just proposed an RC2. | 16:10 |
smcginnis | So we should be good there. | 16:10 |
ttx | ++ | 16:11 |
smcginnis | Late RCs | 16:11 |
smcginnis | I saw a new nova RC proposed. | 16:11 |
* smcginnis checks if it includes that bug. | 16:11 | |
ttx | there is a thread about that bug on the list | 16:11 |
ttx | so I think we need to keep an eye on that one | 16:11 |
smcginnis | Ah, missed it. | 16:11 |
ttx | it's the only panic-potential thing I know of | 16:12 |
smcginnis | Does look like something that's pretty critical. | 16:12 |
ttx | But then I have been traveling a bit last week, did you all hear of anything else? | 16:12 |
dhellmann | is that the oslo.service thing? | 16:12 |
ttx | smcginnis: it's critical if it is a regression | 16:12 |
smcginnis | Though Matt's last comment on the bug says it was there in rocky. | 16:12 |
*** e0ne has quit IRC | 16:12 | |
ttx | right, so now it's almost a feature | 16:13 |
smcginnis | So not a regression. | 16:13 |
* diablo_rojo sneaks in late becuase she didn't notice her IRCclient was disconnected | 16:13 | |
smcginnis | Undocumented feature. ;) | 16:13 |
ttx | More generally, there is general flakiness in tests that point to a potential loss of quality | 16:14 |
smcginnis | So I think we can continue with plans to do final release proposal. If that comes through in time, great. If not, looks like it will need to be a stable backport at least for rocky. | 16:14 |
ttx | so we need to keep our ears on the ground | 16:14 |
smcginnis | ++ | 16:14 |
dhellmann | we could propose the nova final release on top of that rc2 and let eric block it until they're ready | 16:15 |
* dhellmann doesn't see efried in channel | 16:15 | |
dhellmann | maybe melwitt is managing that instead? | 16:15 |
smcginnis | It is still stein. | 16:15 |
dhellmann | yeah | 16:15 |
smcginnis | We can follow up and watch for that. | 16:16 |
smcginnis | Let's move on to release week organization. | 16:16 |
smcginnis | So after the final RC deadline today, we can propose the final release patch. | 16:17 |
smcginnis | I can do that in the morning. We don't need to wait on the branching for that. | 16:17 |
dhellmann | ++ | 16:17 |
smcginnis | For the newer folks, we add all PTLs to that and request that they ack the patch. | 16:17 |
smcginnis | Not strictly needed. We won't hold it if we don't get an ack. But gives us the warm fuzzies. | 16:18 |
smcginnis | And ends up in the metadata that the PTLs signed off on it. | 16:18 |
ttx | I don't think we did: "The week before final release test the release process using the openstack/release-test repository." | 16:18 |
dhellmann | I saw one of those earlier today? or late yesterday? | 16:19 |
dhellmann | and we've done releases this week | 16:19 |
smcginnis | We did do a release-test release yesterday. | 16:19 |
smcginnis | I used dhellmann's test patch to make sure things were working after the sphinx 2 issues. | 16:19 |
smcginnis | s/yesterday/earlier this week/ | 16:19 |
smcginnis | I've lost track of all time. | 16:19 |
dhellmann | that's in the process because we don't expect to be doing releases this week, and once we had an unexpected failure in the process | 16:19 |
ttx | cool | 16:20 |
* ttx strikes out | 16:20 | |
smcginnis | We've had a LOT of releases this week this time around. | 16:20 |
dhellmann | do we have a step to ask infra to hold off changing zuul config that might effect releases? | 16:20 |
smcginnis | I don't think we call that out. | 16:20 |
ttx | "On the morning of the deadline for final release candidates, check the list of unreleased changes for milestone projects and verify with the PTLs and liaisons that they are planning a release or that they do not need one." ?? | 16:20 |
ttx | I haven't checked that ^ | 16:20 |
dhellmann | I can run the script while we continue the meeting | 16:21 |
dhellmann | tools/list_rc_updates.sh | 16:21 |
ttx | dhellmann: thx! | 16:21 |
smcginnis | OK, thanks dhellmann | 16:21 |
smcginnis | Next week we should run the missing-releases script to look for any missing tarballs, pypi packages, etc. | 16:22 |
smcginnis | Anyone want to volunteer for that? | 16:22 |
ttx | ack, can do | 16:22 |
fungi | yeah, exercising the automation lightly before pushing the big red button remains a good idea. the infra team is trying to limit changes which could impact release processes, but you never know what could slip through | 16:22 |
smcginnis | Another easy "run script, report issues" task evrardjp and diablo_rojo_phon ;) | 16:22 |
smcginnis | Thanks fungi | 16:22 |
evrardjp | will have a look smcginnis | 16:23 |
evrardjp | I suppose the ttx "ack" was for that, so I can do that with him | 16:23 |
ttx | evrardjp: sure | 16:23 |
diablo_rojo | I can look too | 16:23 |
smcginnis | Thanks! | 16:24 |
smcginnis | Next task - after release, we need to update series_status so releases.o.o shows it as released. | 16:24 |
smcginnis | Pretty simple update with an example of previous times. | 16:25 |
dhellmann | here's the unreleased rc report: http://paste.openstack.org/show/748878/ | 16:25 |
dhellmann | I can look through that report for anything important | 16:25 |
*** hberaud is now known as hberaud|gone | 16:25 | |
smcginnis | Good, mostly normal branching updates for most of them. | 16:25 |
smcginnis | Any volunteers to update the series_status. It's an easy one. | 16:26 |
smcginnis | I can take it if no volunteers. | 16:26 |
smcginnis | But trying to "delegate". | 16:26 |
smcginnis | OK, I'll put my name on that one. Just let me know if someone else wants to grab it though. | 16:27 |
ttx | Confirming PR is officially going out at 10am CT on the 10th, so we should target finishing the release process around that | 16:27 |
evrardjp | take it,and I will check if I can help you tomorrow | 16:27 |
evrardjp | smcginnis: ^ | 16:27 |
diablo_rojo | smcginnis, I would say go ahead and do it, but I will look at it too. | 16:27 |
ttx | (it's also ok if we take more tiem, it's just a nice target to have) | 16:27 |
evrardjp | diablo_rojo: haha :) | 16:27 |
smcginnis | evrardjp: OK, thanks. | 16:28 |
smcginnis | ttx: Thanks, was wondering about tat. | 16:28 |
smcginnis | that | 16:28 |
smcginnis | I'll get the announcement ready to send out Wednesday. | 16:28 |
smcginnis | Do we usually wait for the PR to go out first, or doesn't it matter. | 16:29 |
smcginnis | I can't remember now. Just around the same time? | 16:29 |
ttx | We try to finish before | 16:29 |
openstackgerrit | Doug Hellmann proposed openstack/releases master: heat 12.0.0.0rc2 https://review.openstack.org/650066 | 16:29 |
ttx | like 1-30min before the PR release | 16:29 |
smcginnis | OK, then we should approve that final patch early and I will have the announcement queued up to go. | 16:30 |
ttx | (the PR usually leaks as press articles want to be the first out) | 16:30 |
ttx | final patch can be approved a long time before | 16:30 |
fungi | in don't have anything going on that morning, so will make sure i'm on hand to keep tabs on the automation/ci bits | 16:30 |
smcginnis | fungi: Thanks, that will be great to make sure nothing gets tripped up. | 16:31 |
smcginnis | ttx: Do you want to hit the approval on the final release patch earlier in the day so it's done in time? | 16:32 |
ttx | smcginnis: that is generally what we do | 16:32 |
smcginnis | We can all +2 it by Tuesday, so it should be good to go. | 16:32 |
ttx | re: unreleased changes, looks like we should ping a few teams for late RCs before doing teh final-release patch | 16:32 |
openstackgerrit | Doug Hellmann proposed openstack/releases master: magnum 8.0.0.0rc2 https://review.openstack.org/650067 | 16:32 |
smcginnis | Hah, or just propose them I suppose. Thanks dhellmann | 16:33 |
dhellmann | yeah, there are only a few, I'll just do them now | 16:33 |
ttx | ++ | 16:33 |
evrardjp | thanks dhellmann | 16:33 |
openstackgerrit | Doug Hellmann proposed openstack/releases master: mistral 8.0.0.0rc2 https://review.openstack.org/650069 | 16:33 |
ttx | OK I think that is all | 16:33 |
smcginnis | Let's get those through as soon as they pass today. Add branches and propose final release tomorrow morning. | 16:33 |
smcginnis | Collect PTL +1's, add out own +2's, then ttx approves early on the 10th. | 16:34 |
openstackgerrit | Doug Hellmann proposed openstack/releases master: murano 7.0.0.0rc2 https://review.openstack.org/650070 | 16:34 |
smcginnis | Love it when a plan comes together. | 16:34 |
evrardjp | :) | 16:34 |
*** jpich has quit IRC | 16:34 | |
openstackgerrit | Doug Hellmann proposed openstack/releases master: octavia 4.0.0.0rc2 https://review.openstack.org/650071 | 16:34 |
smcginnis | I think (knock on wood) we are in good shape. | 16:35 |
dhellmann | ok, that's all of them | 16:35 |
smcginnis | #topic Open floor | 16:35 |
*** openstack changes topic to "Open floor (Meeting topic: releaseteam)" | 16:35 | |
johnsom | dhellmann I already have a release patch up | 16:35 |
dhellmann | johnsom : ah, thanks, which project? | 16:35 |
fungi | so... what time on wednesday should i be keeping an eye on things? 14:00z? earlier? | 16:35 |
johnsom | dhellmann https://review.openstack.org/649765 | 16:35 |
dhellmann | ah, your wip dropped it off of my dashboard | 16:36 |
smcginnis | fungi: It sounds like earlier since we want it complete by 15:00 | 16:36 |
johnsom | Yeah, just waiting for a patch or two to get through zuul | 16:36 |
fungi | smcginnis: thanks, i mathed wrong ;) | 16:36 |
smcginnis | ttx: You want to coordinate with fungi on timing there to have the fire brigade ready? | 16:37 |
ttx | All set. Just need to find a stein to drink on release day | 16:37 |
fungi | i have a wooden stein on hand | 16:37 |
fungi | not lidded though | 16:37 |
ttx | fungi: how much time do you expect the patch to run? | 16:37 |
evrardjp | I have two of them not sure I can post one of the two in time. ttx :( | 16:38 |
ttx | i was thinking on hitting W+1 around 9:00utc | 16:38 |
fungi | judging from recent past releases, seems like it was something like 30 minutes from push to finish | 16:38 |
* smcginnis is really disappointed no vendors used the opportunity to give out stein swag | 16:38 | |
ttx | ah, then yes, 13z? | 16:38 |
evrardjp | smcginnis: :) | 16:38 |
evrardjp | ttx: isn't that short on time? | 16:39 |
fungi | i can certainly be around at 09:00z but might be a bit groggy | 16:39 |
ttx | fungi: how about 12:00z | 16:39 |
smcginnis | Hopefully you can sleep through things. | 16:39 |
fungi | we'll probably have ianw and frickler more wide-eyed and bushy-tailed even if i'm not | 16:39 |
ttx | that leaves us 3 hours to fix things on a 30-min run script | 16:39 |
fungi | but sure, 12:00z is easy for me | 16:39 |
melwitt | hi, I just wanted to mention that the bug we're holding rc2 for is new in stein and is a security problem (leaks cell database and message queue credentials to the notifications message queue) | 16:40 |
dhellmann | this is for wednesday, right? | 16:40 |
ttx | also, not the end of the world if things are not ready by 15z | 16:40 |
fungi | melwitt: i saw, thanks for prioritizing that one! | 16:40 |
smcginnis | melwitt: Ah, I remember Matt mentioning that. How's that coming along? | 16:40 |
evrardjp | ttx: I suppose it's not great to have PR on something not yet released? Or did I misunderstand the times? | 16:41 |
melwitt | smcginnis: master change is approved, we just had to recheck it a few min ago. so just have to babysit through the gate and then approve the stein backport after | 16:41 |
smcginnis | OK, good. Then barring gate shenanigans, we should be good on timing there. | 16:41 |
ttx | evrardjp: PR release time is 15z. If we push the patch around 12z that will be done by then | 16:41 |
smcginnis | fungi: Maybe we should bump up that nova patch? | 16:42 |
evrardjp | yeah but it was for your comment "not the end of the world if things are not ready by 15z" | 16:42 |
ttx | Also PR is not really resulting in thousands of downloads. | 16:42 |
evrardjp | ttx: fiar | 16:42 |
evrardjp | fair* | 16:42 |
fungi | i've blocked out 1200-1500z in my schedule on the 10th now | 16:42 |
*** tosky has quit IRC | 16:43 | |
ttx | What we need to have up by 15z is the links that the PR points to (the landing page for stein release) | 16:43 |
dhellmann | I'll be around early, but have to leave for a while at 1400 | 16:43 |
ttx | that in turn points to releases.o.o/stein which may still have RCs and nobody would notice :) | 16:44 |
fungi | evrardjp: it's a double-edged sword, because it we release too far ahead the outlets who are syndicating the press release feel undercut because details will have already had time to circulate and steal their thunder | 16:44 |
evrardjp | ttx: I see | 16:44 |
evrardjp | fungi: indeed | 16:44 |
smcginnis | I will plan on running the meeting next Thursday so we can debrief. But then tonyb will likely take over from there. Let's watch for updates from him on meeting details. | 16:45 |
ttx | also, we usually get press articles BEFORE the release is out anyway | 16:45 |
fungi | smcginnis: melwitt: is there urgency in getting the master security fix in before proposing/approving the backport for stein? | 16:45 |
dhellmann | I hope the backport patch is already up? | 16:46 |
smcginnis | Normally we want the later one to merge before cherry-picking, but probably safe to go ahead in this case. | 16:46 |
melwitt | we have the stein backport proposed | 16:46 |
smcginnis | OK, good. | 16:46 |
evrardjp | fungi: I guess if +w and merged while master is not merged, then it could be a pain . | 16:46 |
melwitt | it's just we don't +W until the master change merges | 16:46 |
melwitt | yeah, exactly evrardjp | 16:46 |
fungi | fair enough. how long do we expect that to set back the last rc? | 16:46 |
melwitt | if the master change fails in the gate or something | 16:47 |
evrardjp | then it's fine if it's just waiting for +w | 16:47 |
evrardjp | I guess babysitting will matter :) | 16:47 |
evrardjp | it always is! | 16:47 |
melwitt | yes, we are babysitting it | 16:47 |
melwitt | just had to recheck it for an ssh timeout a little while ago | 16:47 |
smcginnis | Just wondering if it needs an infra magic kick to the top to make sure it makes it through in time to not impact final release activities. | 16:48 |
evrardjp | hoping the gates gods are stable | 16:48 |
johnsom | Same here, we have two in the gates, but keep getting nova timeouts. 5 minutes to schedule?? ugh | 16:48 |
melwitt | ?? that doesn't sound normal | 16:48 |
johnsom | Agreed. That was limestone | 16:48 |
melwitt | oh, yeah ok | 16:48 |
johnsom | Vexxhost just had a cirros stuck in build | 16:49 |
evrardjp | that's probably a discussion for infra :) | 16:50 |
fungi | yeah, looks like there's a bit of a run on the gate for a variety of failures | 16:50 |
fungi | per ttx's earlier comment about various sorts of failures on the rise suggesting openstack code quality slipping | 16:50 |
johnsom | I think what we are seeing is mostly high load on limited resources. These have not been happening over the course of the release. | 16:51 |
smcginnis | I guess we'll watch and see what happens. | 16:52 |
smcginnis | Anything else for the meeting today? | 16:52 |
ttx | nope | 16:52 |
evrardjp | none | 16:52 |
fungi | yep, but remember these tests are running on openstack... so problems seen in the infrastructure we're using are still quite oftenn openstack problems | 16:52 |
cdent | fungi++ | 16:52 |
smcginnis | Thanks everyone! | 16:52 |
smcginnis | #endmeeting | 16:52 |
*** openstack changes topic to "OpenStack Release Managers office - Come here to discuss how to release OpenStack components - Logged at http://eavesdrop.openstack.org/irclogs/%23openstack-release/" | 16:52 | |
openstack | Meeting ended Thu Apr 4 16:52:51 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:52 |
fungi | anyway, i'll reenqueue and promote the nova master fix now | 16:52 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/releaseteam/2019/releaseteam.2019-04-04-16.00.html | 16:52 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/releaseteam/2019/releaseteam.2019-04-04-16.00.txt | 16:52 |
openstack | Log: http://eavesdrop.openstack.org/meetings/releaseteam/2019/releaseteam.2019-04-04-16.00.log.html | 16:52 |
smcginnis | fungi: Thanks! | 16:53 |
fungi | thanks smcginnis! | 16:53 |
evrardjp | thanks smcginnis | 16:53 |
*** electrofelix has quit IRC | 16:58 | |
*** dtantsur is now known as dtantsur|afk | 17:00 | |
fungi | melwitt: mriedem: smcginnis: 649775,3 is now back at the top of the integrated gate queue | 17:00 |
smcginnis | Thanks! | 17:01 |
* fungi wonders when we remove py35 jobs from master and stable/stein | 17:01 | |
fungi | oh, looks like nova-tox-functional-py35 doesn't have a py36 counterpart running even on master yet | 17:02 |
mriedem | fungi: https://review.openstack.org/#/c/643871/ | 17:03 |
fungi | oof | 17:03 |
fungi | hopefully we'll get to backport that to stable/stein eventually so we don't continue relying on xenial | 17:03 |
*** v12aml has quit IRC | 17:15 | |
cdent | smcginnis: "Final RC deadline: April 1" time travel? | 17:17 |
smcginnis | cdent: Oops. :] | 17:18 |
smcginnis | I was supposed to move that line since it's for the week past the final RC deadline. | 17:18 |
*** v12aml has joined #openstack-release | 17:19 | |
*** diablo_rojo has quit IRC | 17:21 | |
fungi | he's merely backdating an april fools joke | 17:26 |
*** spsurya has joined #openstack-release | 17:37 | |
*** gmann is now known as gmann_afk | 17:44 | |
fungi | ugh, i took the liberty of resetting the gate to restart the nova security fix, since it was failing out on an openstack-tox-lower-constraints job timeout: http://logs.openstack.org/75/649775/3/gate/openstack-tox-lower-constraints/255252d/job-output.txt.gz#_2019-04-04_17_41_47_120332 | 17:51 |
*** diablo_rojo has joined #openstack-release | 17:56 | |
*** diablo_rojo_ has joined #openstack-release | 17:56 | |
*** diablo_rojo_ has quit IRC | 17:56 | |
*** diablo_rojo has quit IRC | 17:56 | |
*** diablo_rojo has joined #openstack-release | 17:57 | |
fungi | current eta is ~2hrs | 18:06 |
smcginnis | Thanks for keeping an eye on that fungi | 18:14 |
smcginnis | johnsom: How are things coming along for octavia RC2? | 18:14 |
johnsom | Both are in the check gate still | 18:16 |
openstackgerrit | Sean McGinnis proposed openstack/releases master: heat 12.0.0.0rc2 https://review.openstack.org/650066 | 18:16 |
johnsom | smcginnis FYI, https://review.openstack.org/649503 and https://review.openstack.org/649906 | 18:17 |
smcginnis | johnsom: And these are things that shouldn't wait for the first stable release? | 18:17 |
johnsom | smcginnis One completely breaks centos, so we would really like to get that in. | 18:17 |
johnsom | Well, fixes the break. lol | 18:18 |
smcginnis | :) | 18:18 |
smcginnis | OK, we can wait until end of the deadline then. At least they are both the stable patches and don't need to be cherry-picked yet. | 18:19 |
johnsom | Yeah, it's just getting them through the process. | 18:19 |
smcginnis | The jobs always seem to take extra long on deadline days. ;) | 18:20 |
johnsom | Yeah, these unexpected nova issues are painful. Especially when the jobs don't even get to our tests.... | 18:21 |
smcginnis | EmilienM: I'm not sure what Juan's nick is... did you see my comment on https://review.openstack.org/#/c/649875/ | 18:22 |
smcginnis | EmilienM: Just need feedback one way or the other if that's an issue or not. | 18:23 |
openstackgerrit | Merged openstack/releases master: Release Horizon Stein RC2 https://review.openstack.org/650055 | 18:28 |
EmilienM | smcginnis: ok will look | 18:30 |
smcginnis | EmilienM: Thanks! | 18:31 |
EmilienM | smcginnis: done. No concern, as we never used that container, so safe to remove in the yaml | 18:31 |
smcginnis | EmilienM: Great, thanks for checking on it. | 18:32 |
openstackgerrit | Merged openstack/releases master: magnum 8.0.0.0rc2 https://review.openstack.org/650067 | 18:33 |
openstackgerrit | Merged openstack/releases master: mistral 8.0.0.0rc2 https://review.openstack.org/650069 | 18:33 |
openstackgerrit | Merged openstack/releases master: murano 7.0.0.0rc2 https://review.openstack.org/650070 | 18:34 |
melwitt | fungi: thanks for doing that. I also realized the other patch we need for rc2 was approved and not merged yet (sorry) and it's #4 in the gate right now https://review.openstack.org/649630, fingers crossed | 18:36 |
fungi | cool, let me know if you spot anything else going off the rails there | 18:38 |
*** cdent has quit IRC | 18:40 | |
melwitt | will do, thank you | 18:43 |
openstackgerrit | Merged openstack/releases master: heat 12.0.0.0rc2 https://review.openstack.org/650066 | 18:51 |
openstackgerrit | Merged openstack/releases master: Do minor release for tripleo-common for Stein https://review.openstack.org/649875 | 18:51 |
openstackgerrit | Sean McGinnis proposed openstack/releases master: Add release note links https://review.openstack.org/650112 | 19:08 |
openstackgerrit | Alex Schultz proposed openstack/releases master: Add a few tripleo cycle highlights https://review.openstack.org/650114 | 19:10 |
smcginnis | tbarron: Was there going to be another manila-ui release yet? | 19:15 |
tbarron | smcginnis: yeah, I'll do one. Do I have time to add a couple bug fixes so we don't have to backport them to Stein? | 19:15 |
tbarron | smcginnis: if not, I'll use the current master head for the hash | 19:16 |
openstackgerrit | Merged openstack/releases master: Remove networking-generic-switch-tempest-plugin https://review.openstack.org/650013 | 19:16 |
smcginnis | tbarron: At this point, probably not likely unless they are already in the gate queue. | 19:16 |
tbarron | smcginnis: if i have a couple hours I'll include https://review.openstack.org/#/q/project:openstack/manila-ui+status:open | 19:16 |
smcginnis | tbarron: We can wait until later and see how the gate progress is going. | 19:17 |
smcginnis | Oh, those aren't even approved yet. | 19:17 |
smcginnis | Well, we can wait and see how it goes. | 19:17 |
tbarron | smcginnis: I thought they were going to be approved two hours ago but I think bswartz got called into a meeting | 19:17 |
tbarron | smcginnis: lemme check | 19:17 |
* tbarron cracks the whip over in #openstack-manila | 19:20 | |
smcginnis | :) | 19:21 |
openstackgerrit | Ben Nemec proposed openstack/releases master: Create stable/stein branches for oslo.messaging devstack plugins https://review.openstack.org/650118 | 19:24 |
bnemec | smcginnis: ^ | 19:25 |
smcginnis | bnemec: Thanks! | 19:25 |
bnemec | np | 19:25 |
smcginnis | Comment was to note that there wasn't a release in rocky. | 19:25 |
smcginnis | Can really just be removed. | 19:26 |
openstackgerrit | Sean McGinnis proposed openstack/releases master: Create stable/stein branches for oslo.messaging devstack plugins https://review.openstack.org/650118 | 19:27 |
openstackgerrit | Alex Schultz proposed openstack/releases master: Add a few tripleo cycle highlights https://review.openstack.org/650114 | 19:29 |
bnemec | I think we left the comment to avoid confusion in the next cycle. Apparently it wasn't very effective. :-) | 19:29 |
bnemec | Maybe we should change it to say that the deliverable file only exists to allow branching of the repo? | 19:30 |
smcginnis | bnemec: That's added by our scripts when we set up the next cycle as a back reference to make sure we're aware. | 19:31 |
bnemec | Ah, okay. | 19:31 |
*** tosky has joined #openstack-release | 19:33 | |
fungi | tempest-slow-py3 lives up to its name, but the nova security fix is green on all other jobs, just waiting for that one to wrap up now (zuul estimates another 30 minutes) | 19:43 |
smcginnis | Thanks | 19:44 |
openstackgerrit | Eric Kao proposed openstack/releases master: Congress stein RC2 https://review.openstack.org/650121 | 19:47 |
*** gmann_afk is now known as gmann | 19:49 | |
openstackgerrit | Merged openstack/releases master: Create stable/stein branches for oslo.messaging devstack plugins https://review.openstack.org/650118 | 19:53 |
fungi | and the job is wrapping up now | 19:58 |
fungi | melwitt: mriedem: looks like 649775 just merged so you should be all clear to approve the backport | 20:00 |
melwitt | fungi: woot, thanks | 20:00 |
melwitt | it's approved now https://review.openstack.org/650043 | 20:04 |
openstackgerrit | Tom Barron proposed openstack/releases master: Release manila-ui 2.18.0 https://review.openstack.org/650127 | 20:07 |
smcginnis | tbarron: Deciding to go ahead? | 20:18 |
tbarron | smcginnis: we got them merged, was going to ping you when I saw CI (since I kept fat-fingering yaml last time I was here) | 20:18 |
tbarron | smcginnis: should I be submitting a branch for stable/stein off that sha too? when do you want to cut that? | 20:19 |
smcginnis | :) | 20:19 |
smcginnis | tbarron: That would be good to include it. | 20:19 |
tbarron | smcginnis: will resubmit with that in a sec then | 20:19 |
smcginnis | Thanks! | 20:20 |
*** tesseract has quit IRC | 20:21 | |
smcginnis | tbarron: I'm going to have to pick up some other missed branches anyway. | 20:25 |
smcginnis | tbarron: Let's go with what you've got and I'll pick up the branching later. | 20:25 |
tbarron | smcginnis: kk, or let me know and I'll do a followup | 20:25 |
EmilienM | smcginnis: it would help a lot if you could land https://review.openstack.org/#/c/643185/ please | 20:26 |
smcginnis | EmilienM: I've given +2. Anyone else that can do the second one and approve? | 20:26 |
EmilienM | smcginnis: I think it's safe to land, clean backport and fixing an actual bug with IPv6 | 20:27 |
smcginnis | EmilienM: OK, I'll ninja it. | 20:28 |
EmilienM | but i'll defer to your judgment, i'm not core | 20:28 |
EmilienM | smcginnis: you're the best! | 20:28 |
EmilienM | thanks | 20:28 |
smcginnis | Hah, no problem. | 20:28 |
*** pcaruana has quit IRC | 20:29 | |
*** pcaruana has joined #openstack-release | 20:30 | |
openstackgerrit | Merged openstack/releases master: Release manila-ui 2.18.0 https://review.openstack.org/650127 | 20:41 |
*** armstrong has quit IRC | 20:42 | |
tbarron | smcginnis: thanks for your patience on that ^ | 20:42 |
*** diablo_rojo has quit IRC | 20:43 | |
smcginnis | tbarron: No worries at all, thanks for getting things in place to get it through. | 20:44 |
*** spsurya has quit IRC | 20:54 | |
*** slaweq has quit IRC | 20:58 | |
*** cdent has joined #openstack-release | 20:58 | |
*** jrist has quit IRC | 20:59 | |
*** jrist has joined #openstack-release | 21:01 | |
*** ltomasbo has quit IRC | 21:01 | |
*** amoralej|off has quit IRC | 21:01 | |
*** slaweq has joined #openstack-release | 21:26 | |
*** bobh has joined #openstack-release | 21:26 | |
*** bobh has quit IRC | 21:27 | |
*** slaweq has quit IRC | 21:30 | |
fungi | at efried's request (in #openstack-nova) i've enqueued and promoted 650043,2 in the gate pipeline just now (the stable/stein security fix corresponding to the master branch fix earlier) | 21:50 |
*** pcaruana has quit IRC | 21:51 | |
*** slaweq has joined #openstack-release | 21:52 | |
*** slaweq has quit IRC | 21:57 | |
*** bnemec has quit IRC | 22:01 | |
*** diablo_rojo has joined #openstack-release | 22:20 | |
*** cdent has quit IRC | 22:26 | |
*** diablo_rojo has quit IRC | 22:28 | |
*** diablo_rojo has joined #openstack-release | 22:28 | |
*** diablo_rojo has quit IRC | 22:31 | |
*** whoami-rajat has quit IRC | 22:32 | |
*** ykarel|away has quit IRC | 22:33 | |
*** diablo_rojo has joined #openstack-release | 22:34 | |
*** ykarel has joined #openstack-release | 22:36 | |
*** diablo_rojo has quit IRC | 22:51 | |
*** diablo_rojo has joined #openstack-release | 22:53 | |
*** tosky has quit IRC | 23:43 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!