| *** lbragstad has quit IRC | 00:20 | |
| *** bobh has joined #openstack-release | 00:36 | |
| *** bobh has quit IRC | 00:37 | |
| *** ekcs has quit IRC | 01:11 | |
| fungi | i've just finished confirming release-openstack-python is working for a reenqueued openstack/release-test 1.4.2 tag | 01:17 |
|---|---|---|
| fungi | so i think we're clear to reenqueue the rest of the failures | 01:18 |
| fungi | it's a bit late here but if someone's keen for me to go ahead with those i can, or i can churn them out tomorrow | 01:19 |
| fungi | maybe tonyb's call | 01:19 |
| fungi | i know a lot of folks are travelling or getting ready to at this point, so can understand if you'd rather hold off | 01:20 |
| *** mlavalle has quit IRC | 01:23 | |
| *** dave-mccowan has quit IRC | 01:28 | |
| *** whoami-rajat has joined #openstack-release | 01:31 | |
| *** ykarel|away has joined #openstack-release | 01:36 | |
| *** gmann_afk is now known as gmann | 01:42 | |
| *** hongbin has joined #openstack-release | 01:44 | |
| *** binh_ has quit IRC | 01:46 | |
| *** nhbinh_ has quit IRC | 01:46 | |
| *** binh___ has joined #openstack-release | 01:47 | |
| *** binh_ has joined #openstack-release | 01:47 | |
| *** ykarel|away is now known as ykarel | 01:49 | |
| fungi | gonna hit the hay for now and catch up tomorrow | 02:21 |
| *** ekcs has joined #openstack-release | 02:26 | |
| *** mriedem has quit IRC | 02:32 | |
| *** samueldmq has quit IRC | 03:04 | |
| *** hongbin has quit IRC | 03:39 | |
| *** ykarel has quit IRC | 03:43 | |
| *** ykarel has joined #openstack-release | 03:59 | |
| *** udesale has joined #openstack-release | 04:00 | |
| *** ykarel_ has joined #openstack-release | 04:05 | |
| *** ykarel has quit IRC | 04:07 | |
| *** pcaruana has joined #openstack-release | 04:23 | |
| *** ekcs has quit IRC | 05:32 | |
| *** electrofelix has joined #openstack-release | 06:16 | |
| *** pcaruana has quit IRC | 06:48 | |
| *** e0ne has joined #openstack-release | 06:49 | |
| *** pcaruana has joined #openstack-release | 06:55 | |
| *** ykarel__ has joined #openstack-release | 07:18 | |
| *** ykarel__ is now known as ykarel | 07:18 | |
| *** nhbinh_ has joined #openstack-release | 07:20 | |
| *** ykarel_ has quit IRC | 07:20 | |
| *** udesale has quit IRC | 07:20 | |
| *** binh_ has quit IRC | 07:20 | |
| *** tosky has joined #openstack-release | 07:20 | |
| *** flaper87 has quit IRC | 07:21 | |
| *** udesale has joined #openstack-release | 07:23 | |
| *** flaper87 has joined #openstack-release | 07:27 | |
| *** ykarel is now known as ykarel|lunch | 07:45 | |
| *** tesseract__ has joined #openstack-release | 07:58 | |
| *** tesseract__ has joined #openstack-release | 08:00 | |
| *** tesseract__ has quit IRC | 08:01 | |
| *** jpich has joined #openstack-release | 08:07 | |
| *** dtantsur|afk is now known as dtantsur | 08:26 | |
| *** ykarel|lunch is now known as ykarel | 08:32 | |
| *** shardy has joined #openstack-release | 09:07 | |
| *** ykarel is now known as ykarel|afk | 11:12 | |
| *** udesale has quit IRC | 11:22 | |
| *** ykarel|afk is now known as ykarel | 12:13 | |
| *** lbragstad has joined #openstack-release | 12:31 | |
| *** EmilienM is now known as EvilienM | 12:31 | |
| *** mriedem has joined #openstack-release | 12:33 | |
| fungi | getting the feeling i should hold off reenqueuing the previously-failed tags if there are no release team members on hand to keep an eye on things | 13:11 |
| fungi | but happy to do so at any time | 13:11 |
| smcginnis | fungi: I'm around all today. We could start slow with one at a time, and if all looks good batch up the remaining ones. | 13:20 |
| smcginnis | Then if things are good, I can push through some of the release request backlog. | 13:20 |
| smcginnis | Might be nice to get some of those out of the way before next week. | 13:20 |
| *** openstackgerrit has quit IRC | 13:27 | |
| fungi | sure, i think i can just pick them off the failed builds list in the zuul dashboard | 13:55 |
| fungi | hold on and i'll put together a list | 13:55 |
| fungi | looking at http://zuul.opendev.org/t/openstack/builds?result=POST_FAILURE&pipeline=release&pipeline=pre-release&pipeline=tag i think the ones from the 17th and 18th got reenqueued successfully, but will double-check | 13:58 |
| smcginnis | I started to capture some failures in the release tracking etherpad, but not sure if anything else was done with them. | 14:00 |
| smcginnis | Let me know if I can help get a list of failures. | 14:00 |
| fungi | the list of failures is easy to pu together from zuul, double-checking which ones have since been retried and succeeded will just take a few minutes | 14:01 |
| fungi | the openstack/networking-arista was rerun successfully | 14:02 |
| fungi | as was openstack/solum | 14:02 |
| smcginnis | solum was the only one I was aware of. | 14:03 |
| *** bnemec is now known as beekneemech | 14:04 | |
| fungi | openstack/puppet-tripleo too | 14:05 |
| fungi | so that means that (deduplicated) all the failed runs listed at http://zuul.opendev.org/t/openstack/builds?job_name=release-openstack-python starting from the 22nd, except the test repo, need reenqueuing | 14:07 |
| smcginnis | Looks reasonable to me. | 14:09 |
| smcginnis | It's a longer list than I had realized. | 14:09 |
| fungi | yeah, assembling it programmatically just so i hopefully don't miss any | 14:11 |
| fungi | smcginnis: okay, by my reckoning, these 23 need to be reenqueued: http://paste.openstack.org/show/749816 | 14:21 |
| fungi | i can just start from the top with one or two and see what happens before accelerating | 14:21 |
| smcginnis | fungi: ++ that sounds like a good plan. | 14:24 |
| *** mlavalle has joined #openstack-release | 14:25 | |
| fungi | okay, in goes the aodh tag to test the waters | 14:25 |
| smcginnis | Oddly, paste still hasn't loaded for me. | 14:26 |
| fungi | if that checks out in a few minutes, i can trickle a few more in | 14:26 |
| smcginnis | 👍 | 14:26 |
| fungi | possible paste.o.o timed out its mysql connection to the trove instance in the past couple minutes | 14:26 |
| smcginnis | It did finally load. | 14:27 |
| fungi | we probably need to just move its database back onto the server | 14:27 |
| * smcginnis watches for aodh to boil | 14:27 | |
| smcginnis | Yeah, I heard trove isn't stable. | 14:27 |
| smcginnis | (too soon?) | 14:27 |
| fungi | in their defense, i'm unsure what rackspace is hosting is actually trove, vs just something api-compatible | 14:28 |
| smcginnis | fungi: Looks like we're good with the ensure-twine bit at least - http://logs.openstack.org/83/83aa4f7c6111678a32a0a953e084425de952818d/release/release-openstack-python/afe9756/job-output.txt.gz#_2019-04-26_14_33_07_639966 | 14:36 |
| smcginnis | fungi: Do you think I should revert my changes for capturing the python runtime environment? Or OK to keep that in there in case we ever need it again? | 14:37 |
| fungi | it's probably fine to revert, but not urgent | 14:38 |
| smcginnis | I better do it now, or I'll forget all about it. | 14:39 |
| fungi | okay, looks like the aodh tag completed its jobs with no problem? | 14:45 |
| smcginnis | Yep, looks like it was good. | 14:46 |
| smcginnis | Batch up a few more? | 14:46 |
| fungi | sure, i'll chuck in the next three | 14:47 |
| fungi | and there they go | 14:47 |
| smcginnis | fungi: To make it easier to track what is done and what is left, and to leave a clue for anyone else, I've added the list of reenqueue commands to the release tracking etherpad. | 14:49 |
| fungi | thanks! | 14:49 |
| smcginnis | ceilometer and designate-dashboard are good. | 14:53 |
| *** ianychoi_ has joined #openstack-release | 15:00 | |
| smcginnis | fungi: Looks like all the critical pieces of those three passed. Ready for more whenever you are. | 15:01 |
| fungi | okay, time for five more | 15:03 |
| fungi | and in they go | 15:03 |
| smcginnis | weeee | 15:03 |
| *** ianychoi has quit IRC | 15:03 | |
| *** zbr|rover is now known as zbr|over | 15:16 | |
| smcginnis | Looks like all the release-openstack-python jobs passed. | 15:17 |
| *** ykarel is now known as ykarel|afk | 15:21 | |
| *** lbragstad has quit IRC | 15:21 | |
| smcginnis | fungi: Last one's announce job is finishing up. Good for another batch at your convenience. | 15:22 |
| fungi | oops, i accidentally re-added openstack/freezer | 15:30 |
| fungi | trying to dequeue it now | 15:31 |
| fungi | okay, hopefully i dequeued it before it got too far | 15:32 |
| fungi | 5 more in the hopper now | 15:33 |
| smcginnis | Over halfway through the list! | 15:36 |
| *** lbragstad has joined #openstack-release | 15:39 | |
| smcginnis | All release-openstack-python jobs have passed. We can probably resume starting with os-win. I think the remaining 9 are probably all safe to submit. | 15:48 |
| *** ykarel|afk has quit IRC | 15:49 | |
| *** e0ne has quit IRC | 15:58 | |
| *** electrofelix has quit IRC | 16:00 | |
| fungi | yep, all remaining 9 submitting now | 16:07 |
| *** shardy has quit IRC | 16:07 | |
| fungi | since we've been given the green light following the scheduler restart | 16:08 |
| smcginnis | Thanks fungi. After the backlog is out of the way, I'll approve one and make sure everything else is good, then start working on some of the others. | 16:08 |
| *** shardy has joined #openstack-release | 16:09 | |
| smcginnis | Feels good to go into the weekend and Summit travel with these out of the way. | 16:09 |
| fungi | cool, i'll still be around in case something goes sideways | 16:10 |
| *** ykarel has joined #openstack-release | 16:15 | |
| *** jpich has quit IRC | 16:21 | |
| fungi | looks like those all cleared | 16:36 |
| smcginnis | Success! | 16:38 |
| smcginnis | No issues that I saw anywhere. I've approved the oslo releases. | 16:39 |
| *** openstackgerrit has joined #openstack-release | 16:40 | |
| openstackgerrit | Merged openstack/releases master: Oslo releases for 2019-4-22 https://review.opendev.org/654620 | 16:40 |
| fungi | cool, well i need to run some pre-travel errands and grab lunch, but should be back soon if anything goes awry | 16:44 |
| smcginnis | Enjoy! | 16:44 |
| openstackgerrit | Merged openstack/releases master: [zaqar] final releases for pike https://review.opendev.org/652912 | 16:53 |
| openstackgerrit | Merged openstack/releases master: [barbican] create pike-em tag against final releases https://review.opendev.org/652881 | 16:54 |
| openstackgerrit | Sean McGinnis proposed openstack/releases master: [cinder] create pike-em tag against final releases https://review.opendev.org/652861 | 17:00 |
| *** zxiiro has quit IRC | 17:03 | |
| *** zxiiro has joined #openstack-release | 17:04 | |
| openstackgerrit | Merged openstack/releases master: [OpenStackAnsible] final releases for pike https://review.opendev.org/652834 | 17:08 |
| openstackgerrit | Merged openstack/releases master: [nova] final releases for pike https://review.opendev.org/652868 | 17:08 |
| openstackgerrit | Merged openstack/releases master: [kuryr] create pike-em tag against final releases https://review.opendev.org/652871 | 17:08 |
| openstackgerrit | Merged openstack/releases master: [winstackers] create pike-em tag against final releases https://review.opendev.org/652885 | 17:08 |
| openstackgerrit | Merged openstack/releases master: [searchlight] create pike-em tag against final releases https://review.opendev.org/652863 | 17:08 |
| openstackgerrit | Merged openstack/releases master: [tacker] final releases for pike https://review.opendev.org/652850 | 17:08 |
| *** ekcs has joined #openstack-release | 17:14 | |
| openstackgerrit | Merged openstack/releases master: [cinder] create pike-em tag against final releases https://review.opendev.org/652861 | 17:40 |
| openstackgerrit | Matt Riedemann proposed openstack/releases master: [nova] create pike-em tag against final releases https://review.opendev.org/652869 | 17:48 |
| *** shardy has quit IRC | 17:59 | |
| *** shardy has joined #openstack-release | 18:01 | |
| *** jaosorior has quit IRC | 18:11 | |
| *** cmurphy is now known as cmurpheus | 18:17 | |
| *** dtantsur is now known as dtantsur|afk | 18:57 | |
| fungi | back, everything going smoothly? | 19:05 |
| mriedem | nova pike-em should be good to go now https://review.opendev.org/#/c/652869/4 | 19:11 |
| *** ykarel is now known as ykarel|away | 19:21 | |
| *** dims has quit IRC | 19:25 | |
| *** dims has joined #openstack-release | 19:30 | |
| *** dims has quit IRC | 19:31 | |
| *** dims has joined #openstack-release | 19:31 | |
| *** dims has quit IRC | 19:38 | |
| *** dims has joined #openstack-release | 19:48 | |
| *** dims has quit IRC | 19:52 | |
| *** dims has joined #openstack-release | 19:59 | |
| *** ykarel|away has quit IRC | 19:59 | |
| *** dims has quit IRC | 20:04 | |
| *** dims has joined #openstack-release | 20:05 | |
| openstackgerrit | Merged openstack/releases master: [nova] create pike-em tag against final releases https://review.opendev.org/652869 | 20:06 |
| openstackgerrit | Merged openstack/releases master: [ironic] create pike-em tag against final releases https://review.opendev.org/652845 | 20:08 |
| *** mriedem has quit IRC | 20:52 | |
| *** beekneemech has quit IRC | 21:06 | |
| *** whoami-rajat has quit IRC | 21:10 | |
| *** pcaruana has quit IRC | 21:16 | |
| *** ekcs has quit IRC | 21:30 | |
| *** EvilienM is now known as EmilienM | 22:51 | |
| *** tosky has quit IRC | 23:08 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!