Tuesday, 2017-10-24

*** pbandark has quit IRC00:00
*** wolverineav has joined #openstack-release00:01
*** wolverineav has quit IRC00:05
*** bobh has quit IRC00:23
fungismcginnis: dhellmann: i tried reenqueuing that last test release to confirm https://review.openstack.org/514491 has fixed things, but looks like it won't try to comment on the bug again... i guess we need another test release approved when people wake up00:36
*** sree has joined #openstack-release00:37
*** sree has quit IRC00:42
*** thorst has joined #openstack-release00:43
*** thorst has quit IRC00:44
*** dave-mccowan has joined #openstack-release01:01
*** mriedem_away has quit IRC01:13
*** bobh has joined #openstack-release01:25
*** bobh has quit IRC01:28
*** thorst has joined #openstack-release01:33
*** thorst has quit IRC01:39
*** Qiming has quit IRC01:41
*** pkovar has quit IRC01:42
*** tellesnobrega has quit IRC01:48
*** hongbin has joined #openstack-release01:56
*** Qiming has joined #openstack-release02:01
*** kumarmn has joined #openstack-release02:01
openstackgerritMerged openstack/releases master: release neutron-lib 1.11.0  https://review.openstack.org/51077402:07
*** wolverineav has joined #openstack-release02:12
*** wolverineav has quit IRC02:17
*** Qiming has quit IRC02:19
*** ricolin has joined #openstack-release02:38
*** kzaitsev_pi has quit IRC02:39
smcginnisneutron-lib jobs look good, package is on pypi, tarfile is uploaded.02:40
*** yamahata has quit IRC02:41
*** iyamahat has quit IRC02:42
*** kzaitsev_pi has joined #openstack-release02:46
smcginnisI didn't see where it did any bug updates though.02:49
*** wolverineav has joined #openstack-release02:49
*** wolverineav has quit IRC02:53
smcginnisOh, missed it http://logs.openstack.org/8d/8dad0065cabfeb241d44adc9543f47c948018d36/release-post/tag-releases/96d8aec/job-output.txt.gz#_2017-10-24_02_15_16_82095202:59
smcginnisWe're good!02:59
openstackgerritMerged openstack/releases master: Cinder Queens Milestone 1 Release  https://review.openstack.org/51318603:08
*** witek has quit IRC03:14
*** ricolin has quit IRC03:15
*** witek has joined #openstack-release03:15
*** ricolin has joined #openstack-release03:16
*** kumarmn has quit IRC03:17
EmilienMsmcginnis: everything is fixed?03:18
*** ekcs has quit IRC03:20
*** kumarmn has joined #openstack-release03:22
*** wolverineav has joined #openstack-release03:23
*** wolverineav has quit IRC03:28
openstackgerritYAMAMOTO Takashi proposed openstack/releases master: Add variants of publish-to-pypi jobs  https://review.openstack.org/51450903:28
*** Qiming has joined #openstack-release03:29
*** Qiming has quit IRC03:33
*** hongbin has quit IRC03:47
*** dave-mccowan has quit IRC03:47
*** kumarmn has quit IRC03:49
*** wolverineav has joined #openstack-release03:58
*** sree has joined #openstack-release04:01
*** wolverineav has quit IRC04:02
*** claudiub|2 has joined #openstack-release04:05
*** armax has quit IRC04:05
*** udesale has joined #openstack-release04:22
openstackgerritTony Breeds proposed openstack/releases master: Neutron: release Queens M-1 milestones for neutron projects  https://review.openstack.org/51243204:35
*** mburned is now known as mburned_out04:42
*** iyamahat has joined #openstack-release04:43
*** claudiub|2 has quit IRC04:59
*** wolverineav has joined #openstack-release05:10
*** udesale has quit IRC05:12
*** udesale has joined #openstack-release05:13
*** udesale has quit IRC05:13
*** wolverineav has quit IRC05:14
*** udesale has joined #openstack-release05:17
*** rosmaita has quit IRC05:17
*** jtomasek has quit IRC05:27
*** wolverineav has joined #openstack-release05:49
*** wolverineav has quit IRC05:53
*** yamahata has joined #openstack-release06:04
*** coolsvap has joined #openstack-release06:06
openstackgerritJuan Antonio Osorio Robles proposed openstack/reno master: Add option to create release note from user-provided template  https://review.openstack.org/51172206:12
*** claudiub|2 has joined #openstack-release06:34
*** pcaruana has joined #openstack-release07:02
* ttx yawns07:06
*** iyamahat has quit IRC07:35
*** amoralej|off is now known as amoralej07:42
*** sree has quit IRC07:57
*** sree has joined #openstack-release07:58
*** sree has quit IRC08:02
*** pbandark has joined #openstack-release08:05
*** jpich has joined #openstack-release08:07
*** dtantsur|afk is now known as dtantsur08:12
*** lucas-afk is now known as lucasagomes08:32
*** yamamoto has quit IRC08:32
*** sree has joined #openstack-release08:41
*** electrofelix has joined #openstack-release08:44
*** jtomasek has joined #openstack-release08:44
evrardjpwhat is the current status of releases? Everything is ok now?08:46
*** jtomasek has quit IRC08:50
*** jtomasek has joined #openstack-release08:51
*** sdague has joined #openstack-release09:16
*** yamamoto has joined #openstack-release09:32
*** yamamoto has quit IRC09:42
*** thorst has joined #openstack-release09:56
*** thorst has quit IRC10:00
*** yamahata has quit IRC10:05
*** yamamoto has joined #openstack-release10:08
*** mburned_out is now known as mburned10:23
*** yamamoto has quit IRC10:25
*** tellesnobrega has joined #openstack-release10:32
*** tellesnobrega has quit IRC10:37
*** sree has quit IRC10:44
*** sree has joined #openstack-release10:44
*** sdague has quit IRC10:48
*** sree has quit IRC10:49
*** sdague has joined #openstack-release10:51
*** udesale has quit IRC10:53
*** dtantsur is now known as dtantsur|brb10:53
*** yamamoto has joined #openstack-release11:04
*** lucasagomes is now known as lucas-hungry11:14
*** udesale has joined #openstack-release11:46
*** tellesnobrega has joined #openstack-release11:48
*** pkovar has joined #openstack-release11:56
*** amoralej is now known as amoralej|lunch12:01
*** thorst has joined #openstack-release12:04
smcginnisEmilienM: I wouldn't state "everything" yet, but at least Python libs and services appear to be OK.12:05
smcginnisevrardjp: Same comment to you I guess. ^ :)12:06
smcginnisWe can at least get some things through now.12:06
evrardjpgreat!12:06
evrardjpI think I have a few pending :)12:06
evrardjpwant me to ping?12:07
evrardjpI am pretty sure you can find them on your own, but why not doing lobbying! :p12:07
*** gcb has joined #openstack-release12:07
smcginnisevrardjp: Nah, don't worry. We've got a list to work through. ;)12:08
evrardjp:D12:08
*** amrith_ has joined #openstack-release12:15
*** amrith is now known as Guest5765712:15
*** amrith_ is now known as amrith12:15
*** lucas-hungry is now known as lucasagomes12:15
*** amrith_ has joined #openstack-release12:15
*** amrith_ is now known as Guest321112:16
*** amrith has quit IRC12:17
ttxsmcginnis: are we clear to approve things?12:22
smcginnisttx: We've had a couple end-to-end successes. I was going to approve a few more python-only "normal" projects, one at a time, to start just to make sure we don't run into anything else odd. Then once we have more confidence start to do a few more in parallel.12:24
smcginnisJust not fully confident yet and don't want to have to redo too much. ;)12:25
ttxok, i'll let you handle it then12:25
ttxLet me know when we are all clear12:25
smcginnisWill do. I'm hoping we are, but just being cautious.12:25
smcginnisWe haven't tried some of the older stable branches yet, and we think we fixed the puppet project issues, but have not tried it since the last "fix" merged.12:26
* ttx is struggling to catch up from last week travel + day off yesterday12:26
*** dave-mccowan has joined #openstack-release12:30
*** rosmaita has joined #openstack-release12:32
openstackgerritMerged openstack/releases master: nova: release queens 17.0.0.0b1  https://review.openstack.org/51349512:36
*** dtantsur|brb is now known as dtantsur12:38
* smcginnis is struggling from travel and not taking a day off :)12:40
*** sree has joined #openstack-release12:41
dhellmanno/12:42
smcginnisdhellmann: Morning12:42
dhellmannsmcginnis : let me know where I can help12:42
smcginnisNova patch going through now. Can say watching the stream, launchpad is most definitely working now.12:43
smcginnisWow, a lot of bugfixes in nova q-1.12:43
dhellmanngood12:43
dhellmannon both counts :-)12:43
smcginnisQuite the subtle bug on that one. Interesting reading the scrollback between you and fungi last night.12:44
*** pkovar has quit IRC12:45
dhellmannyeah, my kingdom for a proper shell with expansion :-)12:45
*** sree has quit IRC12:46
* smcginnis actually didn't even know sh wouldn't expand ~12:46
dhellmannit depends on what shell you have installed as sh :-)12:47
smcginnisI just always stick with bash, mostly because I'm lazy.12:48
dhellmannyeah, every once in a while I flirt with zsh but I haven't made the switch12:48
dhellmannit looks like the nova job failed to upload data to logstash but that error was ignored because it's part of post-processing12:51
smcginnisI'm seeing that on all jobs actually. The gearman error?12:52
*** pkovar has joined #openstack-release12:52
dhellmannthe announce job correctly decided not to send email for a beta12:52
dhellmannsmcginnis : yeah12:52
smcginnisIf it's that one, just pointed that out a bit ago in infra.12:52
dhellmannI assume that's not related to our jobs12:53
dhellmanncool12:53
smcginnisYeah, appears to be all jobs.12:53
fungiyup, there's still some performance kinks to be ironed out with the logstash submission tasks i expect, but we switched them to not result in post_failure results for job until solved at least, to reduce the impact12:55
dhellmannlooking at the list of test scenarios in https://etherpad.openstack.org/p/release-job-failures we're doing pretty well12:55
smcginnisJust sent glance through.12:56
dhellmannI'd like to find a non-service release that won't involve a constraint update to make sure that skips correctly12:56
smcginnisWe can probably start approving more of them. We've had a few good runs now.12:56
smcginnisNeed to check out of my hotel and move over to the conference, but I'll be back soon and start approving more of them.12:57
dhellmannsyntribos would test *not* updating constraints for us https://review.openstack.org/#/c/512446/12:57
dhellmannsmcginnis : ok12:57
*** sree has joined #openstack-release12:57
smcginnisdhellmann: Want to approve that one? Might as well start seeing some other types go through.12:58
*** mriedem has joined #openstack-release12:58
dhellmannsure12:58
dhellmannoh, except they botched the actual file, so no12:59
*** Qiming has joined #openstack-release13:00
*** sree has quit IRC13:00
*** sree has joined #openstack-release13:01
*** bobh has joined #openstack-release13:01
openstackgerritMerged openstack/releases master: Release Glance 16.0.0.0b1  https://review.openstack.org/51350413:02
*** amoralej|lunch is now known as amoralej|mtg13:03
*** edmondsw has joined #openstack-release13:04
*** wolverineav has joined #openstack-release13:18
*** kumarmn has joined #openstack-release13:31
EmilienMrelease-managers: what's missing for https://review.openstack.org/#/c/512792/ ?13:36
openstackgerritMerged openstack/releases master: Propose keystone queens-1  https://review.openstack.org/51382713:36
openstackgerritMerged openstack/releases master: set up test for branch jobs  https://review.openstack.org/51434413:39
smcginnisEmilienM: Our confidence. :)13:39
EmilienMsmcginnis: ok :D13:39
smcginnisEmilienM: We should probably be able to try it soon. We've been able to get a few simpler ones through successfully. That one will be a little more interesting, but hopefully we're ready for it.13:40
EmilienMok13:40
*** tellesnobrega has quit IRC13:41
openstackgerritOpenStack Release Bot proposed openstack/release-test master: Update reno for stable/queens  https://review.openstack.org/51467913:43
dhellmannsmcginnis, ttx, dims : I would appreciate your input on this thread http://lists.openstack.org/pipermail/openstack-dev/2017-October/123926.html13:43
smcginnisdhellmann: Ack13:43
smcginnisdhellmann: Looks like the branching process worked for release-test.13:44
dhellmannoh, good13:44
dimsdhellmann : ack. at the car dealers (head light busted) will respond in a little bit13:44
dhellmanndims : ack, thanks13:44
*** armax has joined #openstack-release13:46
ttxdhellmann: ack looking13:48
*** coolsvap has quit IRC13:53
*** tellesnobrega has joined #openstack-release13:53
*** yamahata has joined #openstack-release13:58
*** pkovar has quit IRC14:00
*** yamamoto has quit IRC14:00
*** iyamahat has joined #openstack-release14:01
*** yamamoto has joined #openstack-release14:02
armaxdhellmann: reading your email on how to solve the release empasse14:04
armaxbut coffee hasn’t kicked in yet, so bear with me :)14:05
dhellmannarmax : yeah, it's easy enough to fix in either way I'm just not sure what direction we want to be going in14:05
*** pkovar has joined #openstack-release14:08
*** tellesnobrega has quit IRC14:10
andreafsmcginnis: I wanted to make a tempest release - are release jobs now back into shape?14:11
dhellmannandreaf : if you propose the release, we'll approve it when we're sure things are working14:14
andreafdhellmann: ok cool14:14
andreafthanks14:14
*** shardy has joined #openstack-release14:15
andreaf#success Tempest test base class is now a stable API for plugins14:16
openstackstatusandreaf: Added success to Success page14:17
andreafok I wanted to do that in the QA room :P14:17
*** hongbin has joined #openstack-release14:18
smcginnisandreaf: Nice!14:18
*** udesale has quit IRC14:21
openstackgerritDoug Hellmann proposed openstack/releases master: TripleO queens-m1 release  https://review.openstack.org/51279214:22
openstackgerritDoug Hellmann proposed openstack/releases master: do not assume that modules with setup.py are packaged with python jobs  https://review.openstack.org/51469014:22
openstackgerritDoug Hellmann proposed openstack/releases master: add verbose output as we try to guess the release-type  https://review.openstack.org/51469114:22
*** tellesnobrega has joined #openstack-release14:24
*** tellesnobrega has quit IRC14:37
*** pbandark has quit IRC14:46
openstackgerritAndrea Frittoli proposed openstack/releases master: Release Tempest 17.1.0  https://review.openstack.org/51470314:48
openstackgerritMerged openstack/releases master: request Congress queens-1 release  https://review.openstack.org/51321114:48
openstackgerritMerged openstack/releases master: Add oslo releases for queens Oct 23, 2017  https://review.openstack.org/51414914:48
*** sree has quit IRC14:50
openstackgerritMerged openstack/releases master: Release ironic 6.3.0 for Newton  https://review.openstack.org/51438814:58
openstackgerritDoug Hellmann proposed openstack/releases master: do not assume that modules with setup.py are packaged with python jobs  https://review.openstack.org/51469015:00
openstackgerritDoug Hellmann proposed openstack/releases master: TripleO queens-m1 release  https://review.openstack.org/51279215:00
openstackgerritDoug Hellmann proposed openstack/releases master: add verbose output as we try to guess the release-type  https://review.openstack.org/51469115:00
dhellmannsmcginnis : I'm not seeing release announce emails. It looks like there's an issue sending via the list server directly15:20
dhellmannsmcginnis : moving to -infra15:21
*** wolverineav has quit IRC15:25
*** wolverineav has joined #openstack-release15:25
*** ricolin has quit IRC15:35
*** yamamoto has quit IRC15:40
*** pkovar1 has joined #openstack-release15:47
*** pkovar has quit IRC15:47
*** yamahata has quit IRC16:00
openstackgerritGraham Hayes proposed openstack/releases master: Release Designate 5.0.1  https://review.openstack.org/51473116:02
*** iyamahat has quit IRC16:02
dhellmannsmcginnis, ttx, dims: for some reason I don't understand, the oslo release job with multiple items did not tag all of them16:04
dhellmannhttp://logs.openstack.org/7d/7d3a7e81f9a4d4abb1bec7d5f405ab06ba397f08/release-post/tag-releases/9abec8b/job-output.txt.gz#_2017-10-24_15_02_04_70187016:04
dhellmannlocal testing running it by hand does not reproduce the problem16:04
*** amoralej|mtg is now known as amoralej16:05
*** dtantsur is now known as dtantsur|afk16:10
*** lucasagomes is now known as lucas-afk16:22
*** iyamahat has joined #openstack-release16:25
smcginnisdhellmann: Just getting back online. Where do things stand so far?16:25
*** pcaruana has quit IRC16:25
dhellmannsmcginnis : let's not approve any more releases until the looping thing is figured out.16:29
dhellmannI'm going to pick up lunch, bbiab16:30
* smcginnis goes looking for "looping thing"16:31
*** shardy has quit IRC16:33
*** jpich has quit IRC16:40
*** yamamoto has joined #openstack-release16:41
*** yamahata has joined #openstack-release16:42
*** pbandark has joined #openstack-release16:46
*** jtomasek has quit IRC16:56
*** yamamoto has quit IRC16:57
*** sree has joined #openstack-release17:18
*** sree has quit IRC17:22
dhellmannsmcginnis : while we wait, maybe you want to look at https://review.openstack.org/514690 which unblocks the tripleo release17:38
smcginnisDone17:38
*** ekcs has joined #openstack-release17:42
openstackgerritMerged openstack/releases master: do not assume that modules with setup.py are packaged with python jobs  https://review.openstack.org/51469017:47
openstackgerritGraham Hayes proposed openstack/releases master: Release Designate 5.0.1  https://review.openstack.org/51473118:03
*** iyamahat has quit IRC18:04
*** tellesnobrega has joined #openstack-release18:06
*** iyamahat has joined #openstack-release18:11
*** iyamahat has quit IRC18:14
*** iyamahat has joined #openstack-release18:14
*** amoralej is now known as amoralej|off18:14
*** pbandark1 has joined #openstack-release18:18
*** pbandark has quit IRC18:19
*** pbandark1 is now known as pbandark18:19
*** electrofelix has quit IRC18:23
openstackgerritArmando Migliaccio proposed openstack/releases master: Neutron: release Queens M-1 milestones for neutron projects  https://review.openstack.org/51243218:31
*** pkovar1 has quit IRC18:36
dhellmannsmcginnis : did any of the other release requests approved today include multiple items?18:38
smcginnisdhellmann: No, I don't believe so. I was trying to keep it simple.18:38
*** dasanind has quit IRC18:38
dhellmannok, good18:38
*** iyamahat has quit IRC18:56
openstackgerritGraham Hayes proposed openstack/releases master: Release Designate 6.0.0.0b1  https://review.openstack.org/51479819:03
openstackgerritGraham Hayes proposed openstack/releases master: Release designate-dashboard 6.0.0.0b1  https://review.openstack.org/51480019:07
*** pbandark has quit IRC19:30
*** pkovar has joined #openstack-release19:33
*** tellesnobrega has quit IRC19:38
openstackgerritGraham Hayes proposed openstack/releases master: Release designate-dashboard 6.0.0.0b1  https://review.openstack.org/51480019:47
openstackgerritGraham Hayes proposed openstack/releases master: Release Designate 6.0.0.0b1  https://review.openstack.org/51479819:47
*** rockyg has joined #openstack-release19:51
*** tellesnobrega has joined #openstack-release20:14
*** armax has quit IRC20:22
*** rockyg has quit IRC20:30
*** bobh has quit IRC20:38
tonybI'm starting to see a few releases happening, so are we all sysyems go or still testing?20:51
dhellmanntonyb : I think we have more of it working than earlier today, but I'm still not confident that everything works for all cases.20:55
dhellmannreleasing libs was working, and releasing multiple things in one patch is now working20:55
tonybdhellmann: okay20:56
dhellmannwe could try another release and see how it goes, but I'm dropping offline shortly20:56
tonybdhellmann: I'll check from time to time but until I hear otherwise I'll avoid the +W20:56
dhellmannwhat you're seeing now is the result of finally getting the oslo release job to work20:56
tonyb\o/20:56
dhellmanntonyb : sounds good. I'm running the tool to verify that everything we think was released is actually on the tarballs site20:57
smcginnisOn plane about to shut down, but saw the requirements updates go through, so had to say - yay!20:57
tonyb:)20:57
tonybdhellmann: It'd be nice to have the 3 newton releases done but only if they're in the low risk category20:58
dhellmannsmcginnis, fungi : it looks like signing might not be working right? http://paste.openstack.org/show/624518/20:58
dhellmanntonyb : ^^20:58
*** iyamahat has joined #openstack-release20:59
dhellmannthose are all beta releases, though. I wonder if we do the signing for those? I think thought we signed everything20:59
dhellmannthat's output from "tox -e venv -- missing-releases --series queens"20:59
fungiyeah, i think we normally signed all sdists and wheels regardless21:00
fungii'll take a look after i get some food down21:00
*** rosmaita has quit IRC21:00
*** tbarron is now known as tbarron|bbl21:03
*** iyamahat has quit IRC21:04
*** thorst has quit IRC21:06
*** thorst has joined #openstack-release21:07
*** thorst has quit IRC21:12
*** armax has joined #openstack-release21:18
*** sree has joined #openstack-release21:19
*** sree has quit IRC21:24
*** wolverineav has quit IRC21:28
*** bobh has joined #openstack-release21:29
fungidhellmann: taking nova 17.0.0.0b1 as an example to investigate first, looks like that was tagged at 12:41:22z today21:31
*** thorst has joined #openstack-release21:32
fungiit looks like we didn't run the signing job in the pre-release pipeline: http://logs.openstack.org/2b/2bf4b000dfaf5d84b37dd0ce194efb509566b22c/pre-release/21:32
dhellmannthat sounds like a job misconfiguration problem21:32
fungiso your theory seems likely. i'll take a look at how we decide when to do those21:32
fungidhellmann: we include a sign-artifacts role as a post task for the python-tarball playbook21:35
openstackgerritDoug Hellmann proposed openstack/releases master: add wheel checks to missing-releases  https://review.openstack.org/51484421:36
*** thorst has quit IRC21:36
fungistill working on figuring out why it didn't run though21:37
*** iyamahat has joined #openstack-release21:37
*** thorst has joined #openstack-release21:38
openstackgerritIan Wienand proposed openstack-infra/release-tools master: Add some notes on eol_branch.sh  https://review.openstack.org/51484621:39
*** thorst has quit IRC21:43
*** iyamahat has quit IRC21:47
dhellmannI'm going to call it a night21:47
*** gcb has quit IRC21:48
openstackgerritTony Breeds proposed openstack-infra/release-tools master: Add some notes on eol_branch.sh  https://review.openstack.org/51484621:54
hongbinhi release, could we proceed this release https://review.openstack.org/#/c/513069/ ?22:00
dhellmannhongbin : the release jobs are still not function at 100%, so we are proceeding carefully when we can watch jobs run and deal with errors.22:08
hongbindhellmann: i see, understand22:08
*** bobh has quit IRC22:14
*** wolverineav has joined #openstack-release22:15
*** claudiub|2 has quit IRC22:22
*** edmondsw has quit IRC22:29
*** edmondsw has joined #openstack-release22:29
*** kumarmn has quit IRC22:33
*** edmondsw has quit IRC22:34
*** pabelanger has joined #openstack-release22:38
*** thorst has joined #openstack-release22:43
*** mriedem has quit IRC22:46
*** mriedem has joined #openstack-release22:47
*** thorst has quit IRC22:49
*** sdague has quit IRC22:59
*** askb has quit IRC23:12
*** hongbin has quit IRC23:14
*** bobh has joined #openstack-release23:17
*** bobh has quit IRC23:19
*** sree has joined #openstack-release23:20
*** bobh has joined #openstack-release23:21
*** sree has quit IRC23:25
*** kumarmn has joined #openstack-release23:47
*** bobh has quit IRC23:49
*** edmondsw has joined #openstack-release23:55
*** tbarron|bbl is now known as tbarron23:58
*** edmondsw has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!