Friday, 2020-07-24

*** ricolin has joined #openstack-release02:02
*** dave-mccowan has quit IRC02:26
*** ykarel_ has joined #openstack-release03:49
*** ykarel_ is now known as ykarel04:11
*** udesale has joined #openstack-release04:33
*** armax has quit IRC04:33
*** dmellado has quit IRC06:27
*** tinwood is now known as tinwood-afk06:33
*** amoralej|off is now known as amoralej07:31
*** tosky has joined #openstack-release07:37
*** e0ne has joined #openstack-release07:54
*** e0ne_ has joined #openstack-release08:01
*** e0ne has quit IRC08:03
openstackgerritElod Illes proposed openstack/releases master: nova: Release 19.3.0  https://review.opendev.org/74176008:06
*** dmellado has joined #openstack-release08:20
*** jbadiapa has joined #openstack-release08:23
ttxsmcginnis: I think they should be made cycle-independent really08:28
ttxe0ne_: my point there was that those were never, ever released08:29
ttxso I wonder what their point is08:29
e0ne_ttx: need to check. we cleaned up something similar last year08:29
ttxsure but those were very recently added08:30
ttxFeb 21, 202008:30
ttxSo new xstatic repositories were created in February. Never released08:30
e0ne_oh.. I see08:30
e0ne_it's vitrage-dashboard dependencies08:30
ttxThey are either needed (and should be released) or not needed (and then repo should be removed)08:30
ttxyes08:31
ttxI suspect they will want a release at some point08:31
e0ne_looks like something went wrong08:31
e0ne_they are published to pypi08:32
ttxmaybe they did a release but outside of the releases repo08:32
e0ne_and there should be at lease one release per library08:32
ttxOK, I'll check from there08:32
ttxMight just be a case taht we need to retroactively add files for those08:32
ttxe0ne_: thanks08:33
e0ne_ttx: you're welcome. I can propose releases to openstack/releases repo08:33
e0ne_ttx: horizon team doesn't support these libs, but from vitrage perspective I can do it08:33
ttxhmm... looks like those were never generated on tarballs.o.o08:33
ttxso.... manually built/uploaded08:34
e0ne_:(08:34
ttxwe'll likely want to replace those with new versions that went through automation and are properly signed08:35
ttxI'll dig further08:36
ttxThose were tagged, and then manually uploaded. probably no release job defined and all08:37
*** tinwood-afk is now known as tinwood08:45
*** dtantsur|afk is now known as dtantsur08:53
e0ne_ttx: what's our plan with these libraries?09:13
openstackgerritMerged openstack/releases master: Correct a typo of an annotation  https://review.opendev.org/74259709:15
openstackgerritMerged openstack/releases master: Cinder: EOL Ocata  https://review.opendev.org/74251309:17
openstackgerritThierry Carrez proposed openstack/releases master: Update Summit to be virtual event  https://review.opendev.org/74270509:46
ttxe0ne_: We'll likely have to add release jobs first, then issue a new x.y.z.a+1 revision09:47
ttxso that it goes through the whole machinery09:47
*** ricolin has quit IRC09:51
*** hberaud has quit IRC09:51
ttxactually they have release jobs already10:03
ttxok so we probably only need to issue that refresh10:04
ttxI'll produce one10:05
*** hberaud has joined #openstack-release10:06
ttxor simpler, just document existing release.10:07
openstackgerritThierry Carrez proposed openstack/releases master: Re-release recent xstatic packages  https://review.opendev.org/74284910:36
ttxe0ne_, smcginnis That should do it ^10:36
ttxhttps://review.opendev.org/#/q/status:open+topic:refresh-releases10:37
*** udesale_ has joined #openstack-release11:11
*** udesale has quit IRC11:13
*** amoralej is now known as amoralej|lunch12:44
*** dave-mccowan has joined #openstack-release13:15
*** zigo has quit IRC13:19
*** amoralej|lunch is now known as amoralej13:28
*** zigo has joined #openstack-release13:32
*** armax has joined #openstack-release14:07
openstackgerritAlex Schultz proposed openstack/releases master: Release tripleo-operator-ansible  https://review.opendev.org/74289114:12
*** ricolin has joined #openstack-release14:19
openstackgerritThierry Carrez proposed openstack/releases master: Re-release recent xstatic packages  https://review.opendev.org/74284914:21
openstackgerritMerged openstack/releases master: Update Summit to be virtual event  https://review.opendev.org/74270514:32
openstackgerritMerged openstack/releases master: Fix list_unreleased_changes when repo doesn't exist or haven't been released  https://review.opendev.org/74245414:36
* clarkb notices that some release things are merging and realizes the release team may not be subscribed to service-announce@lists.opendev.org14:39
clarkbsmcginnis: ttx et al we are going to rename gerrit projects in about 20 minutes which requires a short gerrit downtime14:39
smcginnisclarkb: OK, I will hold off on any new approvals.14:39
smcginnisA few in the chute right now. Hopefully those should be out of the way by then.14:40
clarkbif you haven't subscribed to that list I'd highly recommend it. its been low traffic and largely geared towards large changes or planned outages14:40
* clarkb warned all the project mailing lists multiple times then got tired of CC'ign the world for those announcements :)14:40
smcginnisYeah, missed that. I'll subscribe now. Though I don't necessarily check my ML account regularly.14:41
ttxsame14:41
clarkbalso I generally liked fridays for planned outages because i thought ya'll avoided friday releaeses? maybe that assumption isn't a good one14:42
smcginnisclarkb: That has been the policy. Just with the guardrails in place being decent these days, we've relaxed on avoiding Friday's lately.14:43
smcginnisHuh, apparently I'm already subscribed to that mailing list, but I don't recall ever seeing anything coming from it.14:44
clarkbhttp://lists.opendev.org/pipermail/service-announce/2020-July/000008.html is the email14:44
clarkbmight give you terms to search on to see where it went14:44
clarkb(to be claer we'll let the things in the gate flush through and won't take gerrit down until those are happy)14:47
clarkbI'll confirm here when I think we are clear14:47
openstackgerritMerged openstack/releases master: nova: Release 19.3.0  https://review.opendev.org/74176014:50
openstackgerritMerged openstack/releases master: Release monasca-ui for stable/stein  https://review.opendev.org/74175214:51
clarkbsmcginnis: ^ it should be those two then we are good right? so need the post and release jobs to complete?14:51
smcginnisclarkb: Yep, I believe that's it.14:51
openstackgerritwes hayutin proposed openstack/releases master: minor update release for tripleo ussuri  https://review.opendev.org/74247814:53
*** udesale_ has quit IRC14:55
openstackgerritwes hayutin proposed openstack/releases master: tripleo victoria-1 release  https://review.opendev.org/74249214:57
clarkbsmcginnis: also what I'm taking away from this is zuul needs stickers that say "Worry Free Friday Releases"14:57
openstackgerritwes hayutin proposed openstack/releases master: minor update release for tripleo ussuri  https://review.opendev.org/74247815:05
smcginnisclarkb: ;)15:16
smcginnisfungi: Another AFS release job failure: https://f437990ebfb472cf4f1b-84c9f5cd8c2b87d7cd3ff61e3f0a2559.ssl.cf1.rackcdn.com/98c44130abfc13aaca11b588adaedd3eec984b3a/release/release-openstack-python/ad0de3a/job-output.txt15:16
clarkbsmcginnis: monasca-ui is done with its release jobs but is still running publish-tox-docs-release in release-post. Nova failed in release due to the afs issues fungi ahs been debugging but packages were uploaded to twine. Nova also has tox-docs-release queued up in release-post15:16
fungiyeah, just saw the nova one15:17
fungii'll fix it up after the maintenance15:17
clarkbsmcginnis: I believe all of the jobs that need gerrit to be up (pushing tags and pushing constraints updates) are done15:17
clarkbsmcginnis: do you agree and if so are we good to proceed with gerrit maintenance?15:17
smcginnisclarkb: Yep, looks like it should be good.15:17
clarkbthank you for confirming we shall proceed momentarily15:18
smcginnisfungi: Same /afs/.openstack.org thing.15:18
fungiyeah, i think that error is misleading, it seems to be a write permission error for creating the project directory in the tarballs site15:19
*** ykarel is now known as ykarel|away15:20
-openstackstatus- NOTICE: We are renaming projects in Gerrit and review.opendev.org will experience a short outage. Thank you for your patience.15:23
openstackgerritIury Gregory Melo Ferreira proposed openstack/releases master: Release 4.3.1 of ironic-lib  https://review.opendev.org/74293115:45
*** bnemec is now known as beekneemech15:46
smcginnisclarkb: We're all clear now, right?15:49
clarkbsmcginnis: I think so, we've discovered an unrelated issue in our continuous deployment machinery we need to address so not completely clear but as far as gerrit being back up I think we are good15:49
smcginnisOK, thanks15:50
*** dtantsur is now known as dtantsur|afk15:53
*** gibi is now known as gibi_pto15:58
*** amoralej is now known as amoralej|off16:08
*** jbadiapa has quit IRC16:10
fungi#status log copied nova 19.3.0 wheel/sdist from pypi to the tarballs site after verifying with release key signatures (also uploaded) from build failure log16:22
openstackstatusfungi: finished logging16:22
fungismcginnis: ^16:22
fungionce again, i was able to write to the same location from the same executor which originally saw that permission error16:23
*** e0ne_ has quit IRC16:44
*** e0ne has joined #openstack-release16:48
*** ykarel|away has quit IRC16:58
openstackgerritMerged openstack/releases master: Release openstacksdk for stable/stein  https://review.opendev.org/74176317:05
openstackgerritHervĂ© Beraud proposed openstack/releases master: Add newline between projects in std output format  https://review.opendev.org/74248617:13
*** e0ne has quit IRC17:21
*** ricolin has quit IRC17:43
*** e0ne has joined #openstack-release18:04
*** gmann is now known as gmann_lunch18:13
openstackgerritMerged openstack/releases master: Release monasca-notification for stable/stein  https://review.opendev.org/74175018:16
openstackgerritMerged openstack/releases master: Release monasca-agent for stable/stein  https://review.opendev.org/74174818:16
openstackgerritMerged openstack/releases master: Release monasca-api for stable/stein  https://review.opendev.org/74174918:18
openstackgerritMerged openstack/releases master: Release monasca-transform for stable/stein  https://review.opendev.org/74175118:18
*** e0ne has quit IRC18:23
openstackgerritMerged openstack/releases master: minor update release for tripleo ussuri  https://review.opendev.org/74247818:28
openstackgerritMerged openstack/releases master: Release 4.3.1 of ironic-lib  https://review.opendev.org/74293118:29
openstackgerritMerged openstack/releases master: Add newline between projects in std output format  https://review.opendev.org/74248618:31
*** slaweq has joined #openstack-release18:35
smcginnisfungi: Rethinking that releasing on Friday thing. Another failure: https://dde020785e8980fb096e-a14e38753e0be0421688088ac432b074.ssl.cf5.rackcdn.com/71ec781e252c2d876fc6d65392449c27380cb48c/release/release-openstack-python/74ecc0b/job-output.txt18:46
smcginnisA couple of release note publish job failures with AFS permission denied errors too.18:46
smcginniss/couple/few/18:47
fungismcginnis: i can take a look once our other fires are out18:47
smcginnisToo warm out for all these fires.18:48
*** e0ne has joined #openstack-release18:50
EmilienMyeah I saw them too18:53
EmilienMhttps://d91d6e9aa5357de7fdf6-27ba51e152f37c2c550101a1da9a359d.ssl.cf5.rackcdn.com/4851ef7a9bc9abe68354c9c059fcdc9a802e7d44/tag/publish-openstack-releasenotes-python3/fc7f30d/job-output.txt18:53
smcginnisEmilienM: There's been something funny going on with AFS access on some of the nodes.18:53
smcginnisBut it's one of those intermittent things with no easily identifiable cause, so it's been a challenge to figure out a root cause.18:54
EmilienMok, let me know if we need to do something on our side18:54
EmilienMyeah I imagine :(18:54
smcginnisEmilienM: You should be good, but thank, will definitely ping you if we need anything.18:54
*** gmann_lunch is now known as gmann19:19
*** e0ne has quit IRC19:44
*** e0ne has joined #openstack-release20:17
*** dave-mccowan has quit IRC20:20
*** dave-mccowan has joined #openstack-release20:26
*** e0ne has quit IRC20:56
*** dave-mccowan has quit IRC22:44
*** dave-mccowan has joined #openstack-release22:49
*** dave-mccowan has quit IRC22:56
*** tonyb[m] has left #openstack-release23:21
*** tosky has quit IRC23:55

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!