Thursday, 2019-04-04

*** mriedem has quit IRC01:09
*** whoami-rajat has joined #openstack-release02:03
*** tinwood has quit IRC02:10
*** tinwood has joined #openstack-release02:12
*** hongbin has joined #openstack-release02:12
*** mriedem has joined #openstack-release02:23
*** mriedem has quit IRC02:29
*** samueldmq has quit IRC03:16
*** hongbin has quit IRC03:52
openstackgerritMerged openstack/releases master: Release reno 2.11.3
*** ykarel has joined #openstack-release04:03
*** udesale has joined #openstack-release04:09
*** ekcs has joined #openstack-release04:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/releases master: Do minor release for tripleo-common for Stein
*** ricolin has joined #openstack-release04:57
*** pcaruana has joined #openstack-release04:58
*** lbragstad has quit IRC05:06
*** e0ne has joined #openstack-release05:12
*** e0ne has quit IRC05:18
*** ykarel is now known as ykarel|afk05:19
*** ykarel|afk has quit IRC05:23
*** ykarel|afk has joined #openstack-release05:42
*** ykarel|afk is now known as ykarel05:43
*** armax has quit IRC05:53
*** armax has joined #openstack-release06:00
evrardjpI am confused smcginnis -- I thought we are using requierments upper constraints, which means IMO we didn't need that bump ?06:03
*** slaweq has joined #openstack-release06:21
*** e0ne has joined #openstack-release06:47
*** hberaud|gone is now known as hberaud07:04
*** tesseract has joined #openstack-release07:09
*** dims has quit IRC07:22
*** dims has joined #openstack-release07:24
*** tosky has joined #openstack-release07:26
e0nehi. could anybody help me with release notes? I've got the following error "Inline emphasis start-string without end-string"07:28
*** dims has quit IRC07:31
evrardjpe0ne: which branch is that?07:32
e0neevrardjp: it's horizon master branch07:32
e0neI've got the same error on my dev environment too :(07:32
evrardjpthat's interesting07:33
evrardjpI don't really have the time to look at this right now though07:33
*** dims has joined #openstack-release07:34
evrardjpthere is nothing wrong from what I can see at first sight, so I suppose it's the sphinx2 which is biting us07:34
e0neany guidelines would be helpful for me07:34
evrardjpmaybe an issue with a release note in stein ?07:36
evrardjpdid you check that by keeping one good release note only in your local env, to see how it goes?07:36
evrardjp(stabbing in the dark here) I can check a little further with you if you prefer, but I can't do it now07:37
e0neI'll try to run `tox -e releasenotes` without new release note07:39
evrardjpdon't forget to commit your changes :)07:44
evrardjpbefore rerunning07:44
evrardjpbut, as I said, pretty new to reno07:44
evrardjpI am*07:44
evrardjpmaybe wait for dhellmann later today07:44
e0neevrardjp: thanks for the help. looks like I understood what went wrong07:45
evrardjpwas it a release note with an un-closed emphasis?07:45
evrardjpor something completely different?07:45
evrardjpor requirements mismatch?07:46
evrardjpso many things :)07:46
e0neso, I created a release note using 'reno new policy-sync' command07:46
e0neafter that, I renamed policy-sync-f867d52d2599525a.yaml to policy-sync-stein-f867d52d2599525a.yaml and it broke the build07:47
evrardjpoh I see07:47
evrardjpso basically mismatch of things between branches?07:47
evrardjp(sorry to be digging deeper)07:48
evrardjpat least you isolated the reno causing the failure07:48
*** ykarel is now known as ykarel|lunch07:48
e0neI need to dig a bit deeper on know reno works to understand the root cause07:49
evrardjpI don't see that reno in your notes/07:49
e0newhat do you mean?07:49
evrardjpI just understood what you were doing.07:50
evrardjpI assumed you had a release issue07:50
evrardjpnevermind it's the morning for me07:51
e0neno, I'm trying to fix the last minute bug before doing the RC207:51
evrardjpI think it's not the rename, but the content of the release note, at first sight07:52
evrardjp(now that I am looking at the right things, it helps)07:53
e0neeverything begin work  after I rename the file as it was originally created07:53
*** jpich has joined #openstack-release07:53
* e0ne is not a reno expert at all07:53
*** amoralej|off is now known as amoralej07:53
evrardjpok good :)07:54
*** spsurya has joined #openstack-release07:55
*** dtantsur|afk is now known as dtantsur08:25
openstackgerritLuka Peschke proposed openstack/releases master: Release cloudkitty stein rc2
*** e0ne has quit IRC08:30
*** e0ne has joined #openstack-release08:40
*** e0ne has quit IRC08:42
*** ykarel|lunch is now known as ykarel08:45
openstackgerritJens Harbott (frickler) proposed openstack/releases master: Tag Chef OpenStack repos with newton-eol
*** frickler has joined #openstack-release08:47
*** e0ne has joined #openstack-release08:50
e0neevrardjp: something goes wrong:(. release notes build is success until I commit a new relese note file:(08:51
evrardjpchange the text of said release note :)08:52
evrardjptry if it works better08:52
evrardjpremove the : ` *08:52
evrardjpand _08:53
evrardjpwell that's what I would do08:53
*** ricolin has quit IRC08:53
evrardjpjust making sure everyhting is alright : )08:53
*** jaosorior has quit IRC08:54
e0nethanks, will try it08:55
*** electrofelix has joined #openstack-release08:58
*** ykarel is now known as ykarel|away09:00
*** ykarel|away has quit IRC09:05
*** ykarel|away has joined #openstack-release09:33
*** ykarel|away is now known as ykarel09:33
openstackgerritMerged openstack/releases master: Release cloudkitty stein rc2
*** e0ne has quit IRC09:44
*** e0ne has joined #openstack-release09:54
*** dtantsur is now known as dtantsur|brb10:07
openstackgerritdharmendra kushwaha proposed openstack/releases master: Release tacker stein rc2
*** jaosorior has joined #openstack-release10:52
*** udesale has quit IRC10:54
*** jaosorior has quit IRC10:59
*** jaosorior has joined #openstack-release11:01
*** hberaud is now known as hberaud|lunch11:04
*** zbr has quit IRC11:14
*** cdent has joined #openstack-release11:17
*** zbr has joined #openstack-release11:31
*** samueldmq has joined #openstack-release11:40
*** ykarel has quit IRC11:45
*** ykarel has joined #openstack-release11:46
*** e0ne has quit IRC11:50
*** dtantsur|brb is now known as dtantsur11:57
openstackgerritJean-Philippe Evrard proposed openstack/releases master: First release of ansible-config_template
*** hberaud|lunch is now known as hberaud12:12
openstackgerritJean-Philippe Evrard proposed openstack/releases master: First release of ansible-config_template
openstackgerritJean-Philippe Evrard proposed openstack/releases master: First release of ansible-config_template
openstackgerritTrinh Nguyen proposed openstack/releases master: Release python-searchlight client 1.5.1 for stein
*** jaosorior has quit IRC12:31
*** jaosorior has joined #openstack-release12:31
*** zul has joined #openstack-release12:52
*** mriedem has joined #openstack-release12:54
*** lbragstad has joined #openstack-release12:59
*** jaosorior has quit IRC13:04
*** jaosorior has joined #openstack-release13:04
*** udesale has joined #openstack-release13:05
smcginnisevrardjp: Sorry, what was the question about requirements?13:14
*** e0ne has joined #openstack-release13:22
evrardjpcurrious about why the bump was required, as the min requirement is > 0.1.0 and we are installing with a constraint from upper constraint which should be 0.2.0 so I thought this was not required13:44
openstackgerritMerged openstack/releases master: Release freezer for 7.1.0 and 2.2.0
openstackgerritMerged openstack/releases master: Release tacker stein rc2
smcginnisevrardjp: Bump of what?13:47
smcginnisevrardjp: Oh, sphinxcontrib.datatemplates?13:49
smcginnisBecause we know 0.1.0 will not work, so even though it would pick up the newer version with upper-constraints being raised, this makes sure we are correctly declaring what version is needed.13:49
*** spsurya has quit IRC13:51
evrardjpgot it13:51
*** altlogbot_2 has quit IRC13:54
*** e0ne has quit IRC13:59
openstackgerritSean McGinnis proposed openstack/releases master: Remove networking-generic-switch-tempest-plugin
*** smrcascao has joined #openstack-release14:01
*** e0ne has joined #openstack-release14:05
*** udesale has quit IRC14:06
*** udesale has joined #openstack-release14:07
*** udesale has quit IRC14:11
*** udesale has joined #openstack-release14:11
*** armstrong has joined #openstack-release14:12
openstackgerritMerged openstack/releases master: Release keystone 14.1.0 for stable/rocky
*** mlavalle has joined #openstack-release14:16
openstackgerritCarlos Goncalves proposed openstack/releases master: Release Octavia Stein RC2
*** hberaud is now known as hberaud|school-r14:24
*** hberaud|school-r is now known as hberaud14:33
*** e0ne has quit IRC14:46
openstackgerritMatt Riedemann proposed openstack/releases master: nova: release stein
*** e0ne has joined #openstack-release14:52
*** e0ne has quit IRC14:57
*** jaosorior has quit IRC15:01
dhellmannevrardjp , smcginnis : we also don't use upper constraints for the releases repo because no one needs to install that code along side openstack15:27
smcginnisWe actually do for docs.15:28
evrardjpwe do for docs indeed :)15:28
*** udesale has quit IRC15:32
*** e0ne has joined #openstack-release15:46
openstackgerritIvan Kolodyazhny proposed openstack/releases master: Release Horizon Stein RC2
*** e0ne has quit IRC15:48
*** e0ne has joined #openstack-release15:48
*** e0ne has quit IRC15:48
smcginnis#startmeeting releaseteam16:00
openstackMeeting started Thu Apr  4 16:00:01 2019 UTC and is due to finish in 60 minutes.  The chair is smcginnis. Information about MeetBot at
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: releaseteam)"16:00
openstackThe meeting name has been set to 'releaseteam'16:00
smcginnisttx: You're jumping the gun. :)16:00
* ttx might have to urgently pause in middle to drive kid somewhere16:00
ttxthat's why I'm starting early16:00
smcginnisThey can walk.16:00
smcginnisWe're on line 518.16:00
smcginnisPing list: smcginnis ttx dhellmann diablo_rojo hberaud evrardjp fungi armstrong16:01
smcginnis#topic Stein release16:01
*** openstack changes topic to "Stein release (Meeting topic: releaseteam)"16:01
smcginnisWe had one unreleased that I took care of this morning, so we can skip that.16:02
smcginnisMissing stable branches: There's a few.16:02
smcginnisLooks like the proposed patches did not include any branching.16:02
*** amoralej is now known as amoralej|off16:02
smcginnisI figure we can branch those early tomorrow. Or should we do it today?16:02
smcginnisOr no one cares. :D16:04
evrardjpyou mean for L523?16:04
ttxSo it's normal to have missing stable16:04
dhellmanndo we have anything other than tempest plugins that don't have branches?16:04
smcginnisYeah, basically.16:04
ttxwe are supposed to cut them this week16:04
smcginnisdhellmann: Yeah, there's a list of them in the etherpad in the meeting agenda.16:04
ttxA couple are very old releases though16:04
ttxso we might want to doublecheck recent changes16:04
smcginnisec2-api is very low activity.16:04
evrardjpmy question is what do you really want to branch :)16:04
smcginnisNot sure about manila-ui.16:05
dhellmannoh, sorry, I was looking too high up in that section of the pad16:05
evrardjpand shouldn't that be at least done by the PTLs?16:05
*** e0ne has joined #openstack-release16:05
ttxIt's all fine since they all have done a release during the cycle16:05
smcginnisevrardjp: Well, a lot should be done by the PTLs, but they don't. We need to make sure a stable branch is created.16:05
ttxand we said we would cut stable/stein from most recent release16:05
smcginnisYep, we did announce we would do them if they were not proposed by now.16:06
openstackgerritIvan Kolodyazhny proposed openstack/releases master: Release Horizon Stein RC2
evrardjpsmcginnis: agreed on general releases, tagging. But here it's to create a branch -- I am not so sure. Sorry to get cold feet16:06
ttxmanila-ui has only test changes16:06
ttxso 2.17.0 probably ok16:06
ttxand 8.0.0 is current for ec2-api16:06
dhellmannevrardjp : part of the move we've made over the last couple of cycles is to do more of this stuff for the teams, instead of trying to chase down everyone to ensure they do it themselves16:06
ttxso all good16:06
smcginnisevrardjp: It's a good point that a stable branch can be created from the tag as needed. But good to have them created before they are needed to make sure.16:06
evrardjpdhellmann: agreed I like this, but I thought branching was a big thing due to the backport burden16:07
ttxno branching is cheap16:07
evrardjpbut line 534 clarifies it's not a big thing16:07
smcginnisI can propose the branches today and push them through. Or we can approve them early tomorrow. Any preferences?16:07
evrardjpttx: true for us :)16:07
*** ykarel is now known as ykarel|away16:07
ttxsmcginnis: approve early tomorrow16:08
gouthamrsmcginnis: to clarify, we did release stein with in manila-ui, no new changes were made, except gate stuff like ttx mentioned16:08
smcginnisgouthamr: Thanks!16:08
evrardjpsmcginnis: no preference16:08
dhellmanngouthamr : if we branch without those changes, your new stable branch will be broken16:08
tbarrongouthamr: +116:08
dhellmanndo you need to tag a more current point release so we can branch from that?16:08
tbarrondhellmann: gouthamr: we can certainly do that16:09
gouthamrdhellmann: sure, yes.. tbarron is here, so we will do momentarily16:09
dhellmannsounds good, thanks16:09
smcginnisGreat, thanks. That should help with the concern evrardjp raised of then making teams need to backport things.16:09
smcginnisOK, translations...16:10
*** diablo_rojo has joined #openstack-release16:10
smcginnisHorizon was the only one called out in the etherpad, but I see Ivan just proposed an RC2.16:10
smcginnisSo we should be good there.16:10
smcginnisLate RCs16:11
smcginnisI saw a new nova RC proposed.16:11
* smcginnis checks if it includes that bug.16:11
ttxthere is a thread about that bug on the list16:11
ttxso I think we need to keep an eye on that one16:11
smcginnisAh, missed it.16:11
ttxit's the only panic-potential thing I know of16:12
smcginnisDoes look like something that's pretty critical.16:12
ttxBut then I have been traveling a bit last week, did you all hear of anything else?16:12
dhellmannis that the oslo.service thing?16:12
ttxsmcginnis: it's critical if it is a regression16:12
smcginnisThough Matt's last comment on the bug says it was there in rocky.16:12
*** e0ne has quit IRC16:12
ttxright, so now it's almost a feature16:13
smcginnisSo not a regression.16:13
* diablo_rojo sneaks in late becuase she didn't notice her IRCclient was disconnected16:13
smcginnisUndocumented feature. ;)16:13
ttxMore generally, there is general flakiness in tests that point to a potential loss of quality16:14
smcginnisSo I think we can continue with plans to do final release proposal. If that comes through in time, great. If not, looks like it will need to be a stable backport at least for rocky.16:14
ttxso we need to keep our ears on the ground16:14
dhellmannwe could propose the nova final release on top of that rc2 and let eric block it until they're ready16:15
* dhellmann doesn't see efried in channel16:15
dhellmannmaybe melwitt is managing that instead?16:15
smcginnisIt is still stein.16:15
smcginnisWe can follow up and watch for that.16:16
smcginnisLet's move on to release week organization.16:16
smcginnisSo after the final RC deadline today, we can propose the final release patch.16:17
smcginnisI can do that in the morning. We don't need to wait on the branching for that.16:17
smcginnisFor the newer folks, we add all PTLs to that and request that they ack the patch.16:17
smcginnisNot strictly needed. We won't hold it if we don't get an ack. But gives us the warm fuzzies.16:18
smcginnisAnd ends up in the metadata that the PTLs signed off on it.16:18
ttxI don't think we did: "The week before final release test the release process using the openstack/release-test repository."16:18
dhellmannI saw one of those earlier today? or late yesterday?16:19
dhellmannand we've done releases this week16:19
smcginnisWe did do a release-test release yesterday.16:19
smcginnisI used dhellmann's test patch to make sure things were working after the sphinx 2 issues.16:19
smcginniss/yesterday/earlier this week/16:19
smcginnisI've lost track of all time.16:19
dhellmannthat's in the process because we don't expect to be doing releases this week, and once we had an unexpected failure in the process16:19
* ttx strikes out16:20
smcginnisWe've had a LOT of releases this week this time around.16:20
dhellmanndo we have a step to ask infra to hold off changing zuul config that might effect releases?16:20
smcginnisI don't think we call that out.16:20
ttx"On the morning of the deadline for final release candidates, check the list of unreleased changes for milestone projects and verify with the PTLs and liaisons that they are planning a release or that they do not need one." ??16:20
ttxI haven't checked that ^16:20
dhellmannI can run the script while we continue the meeting16:21
ttxdhellmann: thx!16:21
smcginnisOK, thanks dhellmann16:21
smcginnisNext week we should run the missing-releases script to look for any missing tarballs, pypi packages, etc.16:22
smcginnisAnyone want to volunteer for that?16:22
ttxack, can do16:22
fungiyeah, exercising the automation lightly before pushing the big red button remains a good idea. the infra team is trying to limit changes which could impact release processes, but you never know what could slip through16:22
smcginnisAnother easy "run script, report issues" task evrardjp and diablo_rojo_phon ;)16:22
smcginnisThanks fungi16:22
evrardjpwill have a look smcginnis16:23
evrardjpI suppose the ttx "ack" was for that, so I can do that with him16:23
ttxevrardjp: sure16:23
diablo_rojoI can look too16:23
smcginnisNext task - after release, we need to update series_status so releases.o.o shows it as released.16:24
smcginnisPretty simple update with an example of previous times.16:25
dhellmannhere's the unreleased rc report:
dhellmannI can look through that report for anything important16:25
*** hberaud is now known as hberaud|gone16:25
smcginnisGood, mostly normal branching updates for most of them.16:25
smcginnisAny volunteers to update the series_status. It's an easy one.16:26
smcginnisI can take it if no volunteers.16:26
smcginnisBut trying to "delegate".16:26
smcginnisOK, I'll put my name on that one. Just let me know if someone else wants to grab it though.16:27
ttxConfirming PR is officially going out at 10am CT on the 10th, so we should target finishing the release process around that16:27
evrardjptake it,and I will check if I can help you tomorrow16:27
evrardjpsmcginnis: ^16:27
diablo_rojosmcginnis, I would say go ahead and do it, but I will look at it too.16:27
ttx(it's also ok if we take more tiem, it's just a nice target to have)16:27
evrardjpdiablo_rojo: haha :)16:27
smcginnisevrardjp: OK, thanks.16:28
smcginnisttx: Thanks, was wondering about tat.16:28
smcginnisI'll get the announcement ready to send out Wednesday.16:28
smcginnisDo we usually wait for the PR to go out first, or doesn't it matter.16:29
smcginnisI can't remember now. Just around the same time?16:29
ttxWe try to finish before16:29
openstackgerritDoug Hellmann proposed openstack/releases master: heat
ttxlike 1-30min before the PR release16:29
smcginnisOK, then we should approve that final patch early and I will have the announcement queued up to go.16:30
ttx(the PR usually leaks as press articles want to be the first out)16:30
ttxfinal patch can be approved a long time before16:30
fungiin don't have anything going on that morning, so will make sure i'm on hand to keep tabs on the automation/ci bits16:30
smcginnisfungi: Thanks, that will be great to make sure nothing gets tripped up.16:31
smcginnisttx: Do you want to hit the approval on the final release patch earlier in the day so it's done in time?16:32
ttxsmcginnis: that is generally what we do16:32
smcginnisWe can all +2 it by Tuesday, so it should be good to go.16:32
ttxre: unreleased changes, looks like we should ping a few teams for late RCs before doing teh final-release patch16:32
openstackgerritDoug Hellmann proposed openstack/releases master: magnum
smcginnisHah, or just propose them I suppose. Thanks dhellmann16:33
dhellmannyeah, there are only a few, I'll just do them now16:33
evrardjpthanks dhellmann16:33
openstackgerritDoug Hellmann proposed openstack/releases master: mistral
ttxOK I think that is all16:33
smcginnisLet's get those through as soon as they pass today. Add branches and propose final release tomorrow morning.16:33
smcginnisCollect PTL +1's, add out own +2's, then ttx approves early on the 10th.16:34
openstackgerritDoug Hellmann proposed openstack/releases master: murano
smcginnisLove it when a plan comes together.16:34
*** jpich has quit IRC16:34
openstackgerritDoug Hellmann proposed openstack/releases master: octavia
smcginnisI think (knock on wood) we are in good shape.16:35
dhellmannok, that's all of them16:35
smcginnis#topic Open floor16:35
*** openstack changes topic to "Open floor (Meeting topic: releaseteam)"16:35
johnsomdhellmann I already have a release patch up16:35
dhellmannjohnsom : ah, thanks, which project?16:35
fungiso... what time on wednesday should i be keeping an eye on things? 14:00z? earlier?16:35
dhellmannah, your wip dropped it off of my dashboard16:36
smcginnisfungi: It sounds like earlier since we want it complete by 15:0016:36
johnsomYeah, just waiting for a patch or two to get through zuul16:36
fungismcginnis: thanks, i mathed wrong ;)16:36
smcginnisttx: You want to coordinate with fungi on timing there to have the fire brigade ready?16:37
ttxAll set. Just need to find a stein to drink on release day16:37
fungii have a wooden stein on hand16:37
funginot lidded though16:37
ttxfungi: how much time do you expect the patch to run?16:37
evrardjpI have two of them not sure I can post one of the two in time. ttx :(16:38
ttxi was thinking on hitting W+1 around 9:00utc16:38
fungijudging from recent past releases, seems like it was something like 30 minutes from push to finish16:38
* smcginnis is really disappointed no vendors used the opportunity to give out stein swag16:38
ttxah, then yes, 13z?16:38
evrardjpsmcginnis: :)16:38
evrardjpttx: isn't that short on time?16:39
fungii can certainly be around at 09:00z but might be a bit groggy16:39
ttxfungi: how about 12:00z16:39
smcginnisHopefully you can sleep through things.16:39
fungiwe'll probably have ianw and frickler more wide-eyed and bushy-tailed even if i'm not16:39
ttxthat leaves us 3 hours to fix things on a 30-min run script16:39
fungibut sure, 12:00z is easy for me16:39
melwitthi, I just wanted to mention that the bug we're holding rc2 for is new in stein and is a security problem (leaks cell database and message queue credentials to the notifications message queue)16:40
dhellmannthis is for wednesday, right?16:40
ttxalso, not the end of the world if things are not ready by 15z16:40
fungimelwitt: i saw, thanks for prioritizing that one!16:40
smcginnismelwitt: Ah, I remember Matt mentioning that. How's that coming along?16:40
evrardjpttx: I suppose it's not great to have PR on something not yet released? Or did I misunderstand the times?16:41
melwittsmcginnis: master change is approved, we just had to recheck it a few min ago. so just have to babysit through the gate and then approve the stein backport after16:41
smcginnisOK, good. Then barring gate shenanigans, we should be good on timing there.16:41
ttxevrardjp: PR release time is 15z. If we push the patch around 12z that will be done by then16:41
smcginnisfungi: Maybe we should bump up that nova patch?16:42
evrardjpyeah but it was for your comment "not the end of the world if things are not ready by 15z"16:42
ttxAlso PR is not really resulting in thousands of downloads.16:42
evrardjpttx: fiar16:42
fungii've blocked out 1200-1500z in my schedule on the 10th now16:42
*** tosky has quit IRC16:43
ttxWhat we need to have up by 15z is the links that the PR points to (the landing page for stein release)16:43
dhellmannI'll be around early, but have to leave for a while at 140016:43
ttxthat in turn points to releases.o.o/stein which may still have RCs and nobody would notice :)16:44
fungievrardjp: it's a double-edged sword, because it we release too far ahead the outlets who are syndicating the press release feel undercut because details will have already had time to circulate and steal their thunder16:44
evrardjpttx: I see16:44
evrardjpfungi: indeed16:44
smcginnisI will plan on running the meeting next Thursday so we can debrief. But then tonyb will likely take over from there. Let's watch for updates from him on meeting details.16:45
ttxalso, we usually get press articles BEFORE the release is out anyway16:45
fungismcginnis: melwitt: is there urgency in getting the master security fix in before proposing/approving the backport for stein?16:45
dhellmannI hope the backport patch is already up?16:46
smcginnisNormally we want the later one to merge before cherry-picking, but probably safe to go ahead in this case.16:46
melwittwe have the stein backport proposed16:46
smcginnisOK, good.16:46
evrardjpfungi: I guess if +w  and merged while master is not merged, then it could be a pain .16:46
melwittit's just we don't +W until the master change merges16:46
melwittyeah, exactly evrardjp16:46
fungifair enough. how long do we expect that to set back the last rc?16:46
melwittif the master change fails in the gate or something16:47
evrardjpthen it's fine if it's just waiting for +w16:47
evrardjpI guess babysitting will matter :)16:47
evrardjpit always is!16:47
melwittyes, we are babysitting it16:47
melwittjust had to recheck it for an ssh timeout a little while ago16:47
smcginnisJust wondering if it needs an infra magic kick to the top to make sure it makes it through in time to not impact final release activities.16:48
evrardjphoping the gates gods are stable16:48
johnsomSame here, we have two in the gates, but keep getting nova timeouts. 5 minutes to schedule?? ugh16:48
melwitt?? that doesn't sound normal16:48
johnsomAgreed. That was limestone16:48
melwittoh, yeah ok16:48
johnsomVexxhost just had a cirros stuck in build16:49
evrardjpthat's probably a discussion for infra :)16:50
fungiyeah, looks like there's a bit of a run on the gate for a variety of failures16:50
fungiper ttx's earlier comment about various sorts of failures on the rise suggesting openstack code quality slipping16:50
johnsomI think what we are seeing is mostly high load on limited resources. These have not been happening over the course of the release.16:51
smcginnisI guess we'll watch and see what happens.16:52
smcginnisAnything else for the meeting today?16:52
fungiyep, but remember these tests are running on openstack... so problems seen in the infrastructure we're using are still quite oftenn openstack problems16:52
smcginnisThanks everyone!16:52
*** openstack changes topic to "OpenStack Release Managers office - Come here to discuss how to release OpenStack components - Logged at"16:52
openstackMeeting ended Thu Apr  4 16:52:51 2019 UTC.  Information about MeetBot at . (v 0.1.4)16:52
fungianyway, i'll reenqueue and promote the nova master fix now16:52
openstackMinutes (text):
smcginnisfungi: Thanks!16:53
fungithanks smcginnis!16:53
evrardjpthanks smcginnis16:53
*** electrofelix has quit IRC16:58
*** dtantsur is now known as dtantsur|afk17:00
fungimelwitt: mriedem: smcginnis: 649775,3 is now back at the top of the integrated gate queue17:00
* fungi wonders when we remove py35 jobs from master and stable/stein17:01
fungioh, looks like nova-tox-functional-py35 doesn't have a py36 counterpart running even on master yet17:02
fungihopefully we'll get to backport that to stable/stein eventually so we don't continue relying on xenial17:03
*** v12aml has quit IRC17:15
cdentsmcginnis: "Final RC deadline: April 1" time travel?17:17
smcginniscdent: Oops. :]17:18
smcginnisI was supposed to move that line since it's for the week past the final RC deadline.17:18
*** v12aml has joined #openstack-release17:19
*** diablo_rojo has quit IRC17:21
fungihe's merely backdating an april fools joke17:26
*** spsurya has joined #openstack-release17:37
*** gmann is now known as gmann_afk17:44
fungiugh, i took the liberty of resetting the gate to restart the nova security fix, since it was failing out on an openstack-tox-lower-constraints job timeout:
*** diablo_rojo has joined #openstack-release17:56
*** diablo_rojo_ has joined #openstack-release17:56
*** diablo_rojo_ has quit IRC17:56
*** diablo_rojo has quit IRC17:56
*** diablo_rojo has joined #openstack-release17:57
fungicurrent eta is ~2hrs18:06
smcginnisThanks for keeping an eye on that fungi18:14
smcginnisjohnsom: How are things coming along for octavia RC2?18:14
johnsomBoth are in the check gate still18:16
openstackgerritSean McGinnis proposed openstack/releases master: heat
johnsomsmcginnis FYI, and
smcginnisjohnsom: And these are things that shouldn't wait for the first stable release?18:17
johnsomsmcginnis One completely breaks centos, so we would really like to get that in.18:17
johnsomWell, fixes the break. lol18:18
smcginnisOK, we can wait until end of the deadline then. At least they are both the stable patches and don't need to be cherry-picked yet.18:19
johnsomYeah, it's just getting them through the process.18:19
smcginnisThe jobs always seem to take extra long on deadline days. ;)18:20
johnsomYeah, these unexpected nova issues are painful. Especially when the jobs don't even get to our tests....18:21
smcginnisEmilienM: I'm not sure what Juan's nick is... did you see my comment on
smcginnisEmilienM: Just need feedback one way or the other if that's an issue or not.18:23
openstackgerritMerged openstack/releases master: Release Horizon Stein RC2
EmilienMsmcginnis: ok will look18:30
smcginnisEmilienM: Thanks!18:31
EmilienMsmcginnis: done. No concern, as we never used that container, so safe to remove in the yaml18:31
smcginnisEmilienM: Great, thanks for checking on it.18:32
openstackgerritMerged openstack/releases master: magnum
openstackgerritMerged openstack/releases master: mistral
openstackgerritMerged openstack/releases master: murano
melwittfungi: thanks for doing that. I also realized the other patch we need for rc2 was approved and not merged yet (sorry) and it's #4 in the gate right now, fingers crossed18:36
fungicool, let me know if you spot anything else going off the rails there18:38
*** cdent has quit IRC18:40
melwittwill do, thank you18:43
openstackgerritMerged openstack/releases master: heat
openstackgerritMerged openstack/releases master: Do minor release for tripleo-common for Stein
openstackgerritSean McGinnis proposed openstack/releases master: Add release note links
openstackgerritAlex Schultz proposed openstack/releases master: Add a few tripleo cycle highlights
smcginnistbarron: Was there going to be another manila-ui release yet?19:15
tbarronsmcginnis: yeah, I'll do one.  Do I have time to add a couple bug fixes so we don't have to backport them to Stein?19:15
tbarronsmcginnis: if not, I'll use the current master head for the hash19:16
openstackgerritMerged openstack/releases master: Remove networking-generic-switch-tempest-plugin
smcginnistbarron: At this point, probably not likely unless they are already in the gate queue.19:16
tbarronsmcginnis: if i have a couple hours I'll include
smcginnistbarron: We can wait until later and see how the gate progress is going.19:17
smcginnisOh, those aren't even approved yet.19:17
smcginnisWell, we can wait and see how it goes.19:17
tbarronsmcginnis: I thought they were going to be approved two hours ago but I think bswartz got called into a meeting19:17
tbarronsmcginnis: lemme check19:17
* tbarron cracks the whip over in #openstack-manila19:20
openstackgerritBen Nemec proposed openstack/releases master: Create stable/stein branches for oslo.messaging devstack plugins
bnemecsmcginnis: ^19:25
smcginnisbnemec: Thanks!19:25
smcginnisComment was to note that there wasn't a release in rocky.19:25
smcginnisCan really just be removed.19:26
openstackgerritSean McGinnis proposed openstack/releases master: Create stable/stein branches for oslo.messaging devstack plugins
openstackgerritAlex Schultz proposed openstack/releases master: Add a few tripleo cycle highlights
bnemecI think we left the comment to avoid confusion in the next cycle. Apparently it wasn't very effective. :-)19:29
bnemecMaybe we should change it to say that the deliverable file only exists to allow branching of the repo?19:30
smcginnisbnemec: That's added by our scripts when we set up the next cycle as a back reference to make sure we're aware.19:31
bnemecAh, okay.19:31
*** tosky has joined #openstack-release19:33
fungitempest-slow-py3 lives up to its name, but the nova security fix is green on all other jobs, just waiting for that one to wrap up now (zuul estimates another 30 minutes)19:43
openstackgerritEric Kao proposed openstack/releases master: Congress stein RC2
*** gmann_afk is now known as gmann19:49
openstackgerritMerged openstack/releases master: Create stable/stein branches for oslo.messaging devstack plugins
fungiand the job is wrapping up now19:58
fungimelwitt: mriedem: looks like 649775 just merged so you should be all clear to approve the backport20:00
melwittfungi: woot, thanks20:00
melwittit's approved now
openstackgerritTom Barron proposed openstack/releases master: Release manila-ui 2.18.0
smcginnistbarron: Deciding to go ahead?20:18
tbarronsmcginnis: we got them merged, was going to ping you when I saw CI (since I kept fat-fingering  yaml last time I was here)20:18
tbarronsmcginnis: should I be submitting a branch for stable/stein off that sha too?  when do you want to cut that?20:19
smcginnistbarron: That would be good to include it.20:19
tbarronsmcginnis: will resubmit with that in a sec then20:19
*** tesseract has quit IRC20:21
smcginnistbarron: I'm going to have to pick up some other missed branches anyway.20:25
smcginnistbarron: Let's go with what you've got and I'll pick up the branching later.20:25
tbarronsmcginnis: kk, or let me know and I'll do a followup20:25
EmilienMsmcginnis: it would help a lot if you could land please20:26
smcginnisEmilienM: I've given +2. Anyone else that can do the second one and approve?20:26
EmilienMsmcginnis: I think it's safe to land, clean backport and fixing an actual bug with IPv620:27
smcginnisEmilienM: OK, I'll ninja it.20:28
EmilienMbut i'll defer to your judgment, i'm not core20:28
EmilienMsmcginnis: you're the best!20:28
smcginnisHah, no problem.20:28
*** pcaruana has quit IRC20:29
*** pcaruana has joined #openstack-release20:30
openstackgerritMerged openstack/releases master: Release manila-ui 2.18.0
*** armstrong has quit IRC20:42
tbarronsmcginnis: thanks for your patience on that ^20:42
*** diablo_rojo has quit IRC20:43
smcginnistbarron: No worries at all, thanks for getting things in place to get it through.20:44
*** spsurya has quit IRC20:54
*** slaweq has quit IRC20:58
*** cdent has joined #openstack-release20:58
*** jrist has quit IRC20:59
*** jrist has joined #openstack-release21:01
*** ltomasbo has quit IRC21:01
*** amoralej|off has quit IRC21:01
*** slaweq has joined #openstack-release21:26
*** bobh has joined #openstack-release21:26
*** bobh has quit IRC21:27
*** slaweq has quit IRC21:30
fungiat efried's request (in #openstack-nova) i've enqueued and promoted 650043,2 in the gate pipeline just now (the stable/stein security fix corresponding to the master branch fix earlier)21:50
*** pcaruana has quit IRC21:51
*** slaweq has joined #openstack-release21:52
*** slaweq has quit IRC21:57
*** bnemec has quit IRC22:01
*** diablo_rojo has joined #openstack-release22:20
*** cdent has quit IRC22:26
*** diablo_rojo has quit IRC22:28
*** diablo_rojo has joined #openstack-release22:28
*** diablo_rojo has quit IRC22:31
*** whoami-rajat has quit IRC22:32
*** ykarel|away has quit IRC22:33
*** diablo_rojo has joined #openstack-release22:34
*** ykarel has joined #openstack-release22:36
*** diablo_rojo has quit IRC22:51
*** diablo_rojo has joined #openstack-release22:53
*** tosky has quit IRC23:43

Generated by 2.15.3 by Marius Gedminas - find it at!