| *** eernst has quit IRC | 00:02 | |
| *** yamamoto has joined #openstack-infra | 00:02 | |
| *** adriant has joined #openstack-infra | 00:09 | |
| openstackgerrit | Merged opendev/system-config master: Re-add gitea01 replacement to inventory https://review.opendev.org/672354 | 00:09 |
|---|---|---|
| *** pkopec has quit IRC | 00:09 | |
| clarkb | and now we wait for ansible | 00:10 |
| clarkb | fungi: did you accept the ssh key on bridge yet (I remember that hitting me) | 00:10 |
| clarkb | I can do it if not | 00:10 |
| clarkb | I did it | 00:13 |
| *** auristor has quit IRC | 00:16 | |
| *** eernst has joined #openstack-infra | 00:16 | |
| *** ianychoi has quit IRC | 00:18 | |
| fungi | not yet, thanks! | 00:20 |
| *** ianychoi has joined #openstack-infra | 00:20 | |
| *** auristor has joined #openstack-infra | 00:20 | |
| *** eernst has quit IRC | 00:21 | |
| *** eernst has joined #openstack-infra | 00:23 | |
| *** eernst has quit IRC | 00:28 | |
| *** eernst has joined #openstack-infra | 00:29 | |
| *** gyee has quit IRC | 00:31 | |
| openstackgerrit | Merged zuul/zuul master: Fix sphinx error https://review.opendev.org/672372 | 00:33 |
| *** eernst has quit IRC | 00:34 | |
| *** eernst has joined #openstack-infra | 00:36 | |
| *** mattw4 has quit IRC | 00:37 | |
| *** eernst has quit IRC | 00:40 | |
| *** eernst has joined #openstack-infra | 00:42 | |
| *** eernst has quit IRC | 00:47 | |
| *** eernst has joined #openstack-infra | 00:48 | |
| *** jamesmcarthur has joined #openstack-infra | 00:52 | |
| *** eernst has quit IRC | 00:53 | |
| *** eernst has joined #openstack-infra | 00:55 | |
| *** jamesmcarthur has quit IRC | 00:58 | |
| *** ricolin has joined #openstack-infra | 00:59 | |
| *** eernst has quit IRC | 01:00 | |
| *** yamamoto has quit IRC | 01:04 | |
| *** igordc has quit IRC | 01:04 | |
| openstackgerrit | Joshua Hesketh proposed opendev/system-config master: Update zuul status URL's to opendev https://review.opendev.org/671435 | 01:06 |
| openstackgerrit | Joshua Hesketh proposed opendev/system-config master: Toggle CI should also hide old zuul comments https://review.opendev.org/671436 | 01:06 |
| *** eernst has joined #openstack-infra | 01:06 | |
| *** eernst has quit IRC | 01:11 | |
| *** eernst has joined #openstack-infra | 01:12 | |
| *** eharney has quit IRC | 01:15 | |
| *** eernst has quit IRC | 01:17 | |
| *** imacdonn has quit IRC | 01:18 | |
| *** imacdonn has joined #openstack-infra | 01:18 | |
| *** eernst has joined #openstack-infra | 01:19 | |
| *** jamesmcarthur has joined #openstack-infra | 01:20 | |
| fungi | jhesketh: thanks!!! i wasn't sure how to do that | 01:23 |
| *** eernst has quit IRC | 01:23 | |
| jhesketh | no worries :-) | 01:24 |
| *** hongbin has joined #openstack-infra | 01:29 | |
| *** eernst has joined #openstack-infra | 01:32 | |
| *** hongbin_ has joined #openstack-infra | 01:32 | |
| *** hongbin has quit IRC | 01:33 | |
| *** eernst has quit IRC | 01:36 | |
| *** eernst has joined #openstack-infra | 01:38 | |
| *** ykarel|away has joined #openstack-infra | 01:39 | |
| *** eernst has quit IRC | 01:42 | |
| *** eernst has joined #openstack-infra | 01:51 | |
| *** bhavikdbavishi has joined #openstack-infra | 01:52 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 01:55 | |
| *** eernst has quit IRC | 01:56 | |
| *** bhavikdbavishi has quit IRC | 01:57 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 01:57 | |
| *** eernst has joined #openstack-infra | 01:57 | |
| *** eernst has quit IRC | 02:02 | |
| *** ykarel|away has quit IRC | 02:04 | |
| *** eernst has joined #openstack-infra | 02:04 | |
| *** _erlon_ has quit IRC | 02:05 | |
| *** hongbin_ has quit IRC | 02:06 | |
| *** eernst has quit IRC | 02:08 | |
| *** eernst has joined #openstack-infra | 02:10 | |
| *** yamamoto has joined #openstack-infra | 02:11 | |
| *** eernst has quit IRC | 02:15 | |
| *** jamesmcarthur has quit IRC | 02:16 | |
| *** zzzeek has quit IRC | 02:16 | |
| *** eernst has joined #openstack-infra | 02:17 | |
| *** stakeda has joined #openstack-infra | 02:17 | |
| *** jamesmcarthur has joined #openstack-infra | 02:17 | |
| *** rh-jelabarre has quit IRC | 02:18 | |
| *** zzzeek has joined #openstack-infra | 02:19 | |
| prometheanfire | yay, pyparsing unpublished their latest release | 02:20 |
| *** jamesmcarthur has quit IRC | 02:21 | |
| prometheanfire | https://github.com/pyparsing/pyparsing/issues/105 | 02:21 |
| *** eernst has quit IRC | 02:21 | |
| *** jamesmcarthur has joined #openstack-infra | 02:22 | |
| ianw | :/ ... pull out the Cher ... if I could turn back time ... :) | 02:23 |
| *** hongbin has joined #openstack-infra | 02:23 | |
| *** eernst has joined #openstack-infra | 02:23 | |
| prometheanfire | ya... | 02:23 |
| prometheanfire | actually, I might edit my comment in that bug for that now | 02:24 |
| *** jamesmcarthur has quit IRC | 02:24 | |
| *** jamesmcarthur has joined #openstack-infra | 02:24 | |
| *** n-saito has joined #openstack-infra | 02:27 | |
| fungi | niiiice | 02:28 |
| *** eernst has quit IRC | 02:28 | |
| *** jamesmcarthur has quit IRC | 02:32 | |
| *** dklyle has quit IRC | 02:34 | |
| *** david-lyle has joined #openstack-infra | 02:35 | |
| *** diablo_rojo has joined #openstack-infra | 02:36 | |
| *** eernst has joined #openstack-infra | 02:39 | |
| *** eernst has quit IRC | 02:44 | |
| *** eernst has joined #openstack-infra | 02:46 | |
| *** bhavikdbavishi has quit IRC | 02:46 | |
| *** eernst has quit IRC | 02:51 | |
| *** eernst has joined #openstack-infra | 02:52 | |
| *** tkajinam_ has joined #openstack-infra | 02:57 | |
| *** eernst has quit IRC | 02:57 | |
| *** diablo_rojo has quit IRC | 02:58 | |
| *** tkajinam has quit IRC | 02:59 | |
| *** eernst has joined #openstack-infra | 03:05 | |
| *** tkajinam__ has joined #openstack-infra | 03:07 | |
| *** xinranwang has joined #openstack-infra | 03:08 | |
| *** tkajinam_ has quit IRC | 03:09 | |
| *** eernst has quit IRC | 03:10 | |
| *** eernst has joined #openstack-infra | 03:12 | |
| *** eernst has quit IRC | 03:16 | |
| *** ramishra has joined #openstack-infra | 03:17 | |
| *** mattw4 has joined #openstack-infra | 03:21 | |
| *** eernst has joined #openstack-infra | 03:24 | |
| *** eernst has quit IRC | 03:29 | |
| *** psachin has joined #openstack-infra | 03:31 | |
| *** eernst has joined #openstack-infra | 03:31 | |
| *** hongbin has quit IRC | 03:33 | |
| *** bhavikdbavishi has joined #openstack-infra | 03:35 | |
| *** eernst has quit IRC | 03:36 | |
| *** mattw4 has quit IRC | 03:37 | |
| *** eernst has joined #openstack-infra | 03:42 | |
| *** mattw4 has joined #openstack-infra | 03:43 | |
| *** eernst has quit IRC | 03:46 | |
| *** hongbin has joined #openstack-infra | 03:47 | |
| *** eernst has joined #openstack-infra | 03:48 | |
| *** armax has quit IRC | 03:50 | |
| *** mattw4 has quit IRC | 03:51 | |
| *** whoami-rajat has joined #openstack-infra | 03:52 | |
| *** eernst has quit IRC | 03:54 | |
| *** udesale has joined #openstack-infra | 03:54 | |
| *** eernst has joined #openstack-infra | 03:55 | |
| *** igordc has joined #openstack-infra | 03:58 | |
| *** gregoryo has joined #openstack-infra | 03:59 | |
| *** eernst has quit IRC | 04:00 | |
| *** igordc has quit IRC | 04:01 | |
| *** eernst has joined #openstack-infra | 04:01 | |
| *** raukadah is now known as chandankumar | 04:02 | |
| *** eernst has quit IRC | 04:06 | |
| *** hongbin has quit IRC | 04:06 | |
| *** eernst has joined #openstack-infra | 04:07 | |
| *** eernst has quit IRC | 04:12 | |
| *** eernst has joined #openstack-infra | 04:14 | |
| *** eernst has quit IRC | 04:19 | |
| *** apetrich has quit IRC | 04:20 | |
| *** ykarel|away has joined #openstack-infra | 04:24 | |
| *** eernst has joined #openstack-infra | 04:27 | |
| *** pcaruana has joined #openstack-infra | 04:27 | |
| *** eernst has quit IRC | 04:29 | |
| *** ykarel|away is now known as ykarel | 04:31 | |
| *** michael-beaver has quit IRC | 04:31 | |
| *** eernst has joined #openstack-infra | 04:46 | |
| *** eernst has quit IRC | 04:51 | |
| *** eernst has joined #openstack-infra | 04:52 | |
| *** jmccrory has quit IRC | 04:52 | |
| *** odicha has joined #openstack-infra | 04:52 | |
| *** eernst has quit IRC | 04:57 | |
| *** eernst has joined #openstack-infra | 04:59 | |
| *** eernst has quit IRC | 05:04 | |
| *** jmccrory has joined #openstack-infra | 05:04 | |
| *** eernst has joined #openstack-infra | 05:05 | |
| *** eernst has quit IRC | 05:10 | |
| *** eernst has joined #openstack-infra | 05:11 | |
| *** pcaruana has quit IRC | 05:12 | |
| *** jmccrory has quit IRC | 05:14 | |
| *** jmccrory has joined #openstack-infra | 05:14 | |
| *** eernst has quit IRC | 05:16 | |
| *** eernst has joined #openstack-infra | 05:18 | |
| *** eernst has quit IRC | 05:23 | |
| *** eernst has joined #openstack-infra | 05:24 | |
| *** pcaruana has joined #openstack-infra | 05:25 | |
| *** eernst has quit IRC | 05:29 | |
| *** eernst has joined #openstack-infra | 05:31 | |
| *** eernst has quit IRC | 05:35 | |
| *** eernst has joined #openstack-infra | 05:37 | |
| *** jmccrory has quit IRC | 05:41 | |
| *** eernst has quit IRC | 05:42 | |
| *** xinranwang has quit IRC | 05:48 | |
| *** eernst has joined #openstack-infra | 05:48 | |
| *** kjackal has joined #openstack-infra | 05:49 | |
| *** eernst has quit IRC | 05:52 | |
| *** eernst has joined #openstack-infra | 05:54 | |
| *** eernst has quit IRC | 05:59 | |
| *** pgaxatte has joined #openstack-infra | 06:01 | |
| *** eernst has joined #openstack-infra | 06:01 | |
| *** pgaxatte has quit IRC | 06:05 | |
| *** pgaxatte has joined #openstack-infra | 06:05 | |
| *** eernst has quit IRC | 06:05 | |
| *** jmccrory has joined #openstack-infra | 06:11 | |
| *** kopecmartin|off is now known as kopecmartin | 06:11 | |
| *** eernst has joined #openstack-infra | 06:14 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Enable IAD opendev.org mirror https://review.opendev.org/672404 | 06:18 |
| *** eernst has quit IRC | 06:18 | |
| *** hwoarang has quit IRC | 06:21 | |
| *** hwoarang has joined #openstack-infra | 06:25 | |
| *** eernst has joined #openstack-infra | 06:27 | |
| *** eernst has quit IRC | 06:31 | |
| *** dtantsur|afk is now known as dtantsur | 06:35 | |
| *** eernst has joined #openstack-infra | 06:37 | |
| *** pgaxatte has quit IRC | 06:39 | |
| *** eernst has quit IRC | 06:40 | |
| *** iurygregory has joined #openstack-infra | 06:40 | |
| *** tosky has joined #openstack-infra | 06:41 | |
| *** pgaxatte has joined #openstack-infra | 06:41 | |
| *** eernst has joined #openstack-infra | 06:50 | |
| *** eernst has quit IRC | 06:55 | |
| *** rlandy has joined #openstack-infra | 06:58 | |
| *** eernst has joined #openstack-infra | 07:03 | |
| *** rcernin has quit IRC | 07:04 | |
| *** tesseract has joined #openstack-infra | 07:05 | |
| *** dpawlik has joined #openstack-infra | 07:07 | |
| *** eernst has quit IRC | 07:08 | |
| *** ginopc has joined #openstack-infra | 07:10 | |
| *** slaweq has joined #openstack-infra | 07:11 | |
| *** bkannada has joined #openstack-infra | 07:11 | |
| *** jpena|off is now known as jpena | 07:12 | |
| bkannada | We are creating centos qcow build with diskimagebuilder with DIB_IMAGE_SIZE=40, this is setting the maximum cap of disk size. The problem is this doesn't consider the flavor size which we are passing in instance create. Please let me know how to make it dynamically adapt to the flavor size given. | 07:14 |
| *** eernst has joined #openstack-infra | 07:17 | |
| *** kjackal has quit IRC | 07:19 | |
| *** jpena is now known as jpena|mtg | 07:19 | |
| *** gfidente has joined #openstack-infra | 07:19 | |
| *** eernst has quit IRC | 07:21 | |
| *** kjackal has joined #openstack-infra | 07:22 | |
| *** eernst has joined #openstack-infra | 07:23 | |
| openstackgerrit | Ian Wienand proposed zuul/nodepool master: Enable debug logs for openstack-functional tests https://review.opendev.org/672412 | 07:23 |
| *** rpittau|afk is now known as rpittau | 07:27 | |
| *** eernst has quit IRC | 07:28 | |
| yoctozepto | hey infra, I have an issue where upper constraints enforce a package version that's not on the mirrors :-( | 07:28 |
| yoctozepto | Downloading http://mirror.regionone.fortnebula.opendev.org/pypifiles/packages/ff/2b/8265224812912bc5b7a607c44bf7b027554e1b9775e9ee0de8032e3de4b2/backports.ssl_match_hostname-3.7.0.1.tar.gz | 07:28 |
| yoctozepto | Collecting pyparsing===2.4.1 (from -c https://releases.openstack.org/constraints/upper/master (line 492)) | 07:28 |
| yoctozepto | ERROR: Could not find a version that satisfies the requirement pyparsing===2.4.1 (from -c https://releases.openstack.org/constraints/upper/master (line 492)) (from versions: 1.4.6, 1.4.7, 1.4.8, 1.4.11, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.5.7, 2.0.0, 2.0.1, 2.0.2, 2.0.3, 2.0.4, 2.0.5, 2.0.6, 2.0.7, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.1.4, 2.1.5, 2.1.6, 2.1.7, 2.1.8, 2.1.9, 2.1.10, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1, 2.4.0) | 07:28 |
| yoctozepto | ERROR: No matching distribution found for pyparsing===2.4.1 (from -c https://releases.openstack.org/constraints/upper/master (line 492)) | 07:28 |
| yoctozepto | it killed a few most recent kolla jobs | 07:29 |
| ykarel | yoctozepto, https://review.opendev.org/#/c/672395/ is needed | 07:30 |
| yoctozepto | wonder whether that's just some unlucky mirror or we are stuck for a moment ;-) | 07:30 |
| yoctozepto | ykarel: thanks! | 07:30 |
| ianw | yoctozepto: yeah, it was discussed a bit before, pyparsing unpublished a release - https://github.com/pyparsing/pyparsing/issues/105 | 07:32 |
| ianw | except, you can never really unpublish something :) | 07:32 |
| yoctozepto | ianw: yeah, they really should have just released a 2.4.2 undoing 2.4.1, we would not mind | 07:33 |
| *** eernst has joined #openstack-infra | 07:36 | |
| yoctozepto | it's a pity "partially broken" 2.4.1 actually worked fine for our purposes, yet unpublishing it made things bad ;D | 07:36 |
| ianw | i'm not sure on that requirements change, possibly the integration test is actually broken | 07:37 |
| ianw | tonyb: ^ might know (https://review.opendev.org/#/c/672395) | 07:37 |
| *** ykarel is now known as ykarel|lunch | 07:37 | |
| yoctozepto | ianw: I figured that out, ykarel|lunch based it off the failing git-related change | 07:40 |
| *** eernst has quit IRC | 07:40 | |
| yoctozepto | (<3 the |lunch part) | 07:41 |
| *** eernst has joined #openstack-infra | 07:42 | |
| yoctozepto | sorry, ykarel|lunch, meant to say mthode, looked at wrong field | 07:43 |
| *** eernst has quit IRC | 07:48 | |
| yoctozepto | geez, should have drunk that coffee | 07:48 |
| yoctozepto | I reverted my baddie | 07:48 |
| *** lucasagomes has joined #openstack-infra | 07:51 | |
| *** ralonsoh has joined #openstack-infra | 07:53 | |
| *** e0ne has joined #openstack-infra | 07:58 | |
| *** eernst has joined #openstack-infra | 07:59 | |
| *** eernst has quit IRC | 08:04 | |
| *** apetrich has joined #openstack-infra | 08:05 | |
| *** gregoryo has quit IRC | 08:10 | |
| *** dchen has quit IRC | 08:10 | |
| *** Goneri has joined #openstack-infra | 08:11 | |
| *** eernst has joined #openstack-infra | 08:12 | |
| *** pkopec has joined #openstack-infra | 08:15 | |
| *** eernst has quit IRC | 08:17 | |
| *** pkopec has quit IRC | 08:18 | |
| *** tkajinam__ has quit IRC | 08:18 | |
| *** priteau has joined #openstack-infra | 08:19 | |
| *** eernst has joined #openstack-infra | 08:19 | |
| *** elod has quit IRC | 08:19 | |
| *** pkopec has joined #openstack-infra | 08:20 | |
| *** eernst has quit IRC | 08:24 | |
| *** jtomasek has joined #openstack-infra | 08:25 | |
| *** gfidente has quit IRC | 08:25 | |
| *** ykarel|lunch is now known as ykarel | 08:33 | |
| *** elod2 has joined #openstack-infra | 08:35 | |
| *** eernst has joined #openstack-infra | 08:39 | |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Build docker images of gerrit https://review.opendev.org/671457 | 08:40 |
| *** priteau has quit IRC | 08:43 | |
| *** eernst has quit IRC | 08:43 | |
| *** priteau has joined #openstack-infra | 08:44 | |
| *** priteau has quit IRC | 08:44 | |
| *** eernst has joined #openstack-infra | 08:45 | |
| *** iurygregory has quit IRC | 08:46 | |
| *** siqbal has joined #openstack-infra | 08:50 | |
| *** eernst has quit IRC | 08:50 | |
| *** rlandy is now known as rlandy|mtg | 08:51 | |
| *** altlogbot_1 has quit IRC | 08:51 | |
| *** irclogbot_0 has quit IRC | 08:51 | |
| *** altlogbot_0 has joined #openstack-infra | 08:52 | |
| *** irclogbot_1 has joined #openstack-infra | 08:52 | |
| *** eernst has joined #openstack-infra | 08:54 | |
| *** eernst has quit IRC | 08:59 | |
| *** eernst has joined #openstack-infra | 09:01 | |
| *** eernst has quit IRC | 09:05 | |
| *** lpetrut has joined #openstack-infra | 09:07 | |
| *** eernst has joined #openstack-infra | 09:07 | |
| stephenfin | fungi: Ian has added openstackadmin to the doc8 project, so you should be able to move that now | 09:12 |
| *** eernst has quit IRC | 09:12 | |
| stephenfin | fungi: Wait, I see you've done it already. Nice. Thanks! | 09:12 |
| stephenfin | (missed the scrollback, sorry) | 09:13 |
| *** derekh has joined #openstack-infra | 09:13 | |
| *** eernst has joined #openstack-infra | 09:14 | |
| openstackgerrit | Stephen Finucane proposed openstack/project-config master: Ends project gating for doc8 https://review.opendev.org/671483 | 09:16 |
| *** eernst has quit IRC | 09:18 | |
| *** eernst has joined #openstack-infra | 09:20 | |
| *** ccamacho has joined #openstack-infra | 09:20 | |
| *** eernst has quit IRC | 09:25 | |
| *** eernst has joined #openstack-infra | 09:27 | |
| *** priteau has joined #openstack-infra | 09:31 | |
| *** eernst has quit IRC | 09:32 | |
| *** eernst has joined #openstack-infra | 09:33 | |
| *** bhavikdbavishi has quit IRC | 09:38 | |
| *** eernst has quit IRC | 09:39 | |
| *** eernst has joined #openstack-infra | 09:40 | |
| *** eernst has quit IRC | 09:45 | |
| *** lpetrut has quit IRC | 09:47 | |
| *** iurygregory has joined #openstack-infra | 09:48 | |
| *** jamesmcarthur has joined #openstack-infra | 09:49 | |
| *** yamamoto has quit IRC | 09:51 | |
| *** arxcruz is now known as arxcruz|brb | 09:54 | |
| *** eernst has joined #openstack-infra | 09:55 | |
| *** apetrich has quit IRC | 09:56 | |
| *** jamesmcarthur has quit IRC | 09:58 | |
| *** jamesmcarthur_ has joined #openstack-infra | 09:58 | |
| *** jaosorior has joined #openstack-infra | 09:59 | |
| *** eernst has quit IRC | 10:00 | |
| *** eernst has joined #openstack-infra | 10:02 | |
| *** eernst has quit IRC | 10:06 | |
| *** trident has quit IRC | 10:06 | |
| *** eernst has joined #openstack-infra | 10:08 | |
| *** trident has joined #openstack-infra | 10:08 | |
| *** lpetrut has joined #openstack-infra | 10:09 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:10 | |
| *** jamesmcarthur_ has quit IRC | 10:11 | |
| *** eernst has quit IRC | 10:12 | |
| *** yamamoto has joined #openstack-infra | 10:13 | |
| *** eernst has joined #openstack-infra | 10:14 | |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: Return dependency cycle failure to user https://review.opendev.org/672487 | 10:16 |
| *** eernst has quit IRC | 10:19 | |
| *** eernst has joined #openstack-infra | 10:21 | |
| *** pgaxatte has quit IRC | 10:24 | |
| *** eernst has quit IRC | 10:24 | |
| *** eernst has joined #openstack-infra | 10:27 | |
| *** eernst has quit IRC | 10:32 | |
| *** eernst has joined #openstack-infra | 10:34 | |
| *** eernst has quit IRC | 10:39 | |
| *** dpawlik has quit IRC | 10:39 | |
| *** eernst has joined #openstack-infra | 10:40 | |
| *** eernst has quit IRC | 10:46 | |
| *** eernst has joined #openstack-infra | 10:47 | |
| *** eernst has quit IRC | 10:52 | |
| *** eernst has joined #openstack-infra | 10:57 | |
| *** eernst has quit IRC | 11:02 | |
| *** yamamoto has quit IRC | 11:07 | |
| *** bkannada has quit IRC | 11:08 | |
| *** dpawlik has joined #openstack-infra | 11:08 | |
| *** yamamoto has joined #openstack-infra | 11:14 | |
| *** Lucas_Gray has joined #openstack-infra | 11:15 | |
| *** udesale has quit IRC | 11:15 | |
| *** yamamoto has quit IRC | 11:15 | |
| *** eernst has joined #openstack-infra | 11:17 | |
| *** yamamoto has joined #openstack-infra | 11:17 | |
| *** eernst has quit IRC | 11:19 | |
| *** iurygregory has quit IRC | 11:19 | |
| *** Lucas_Gray has quit IRC | 11:21 | |
| *** eernst has joined #openstack-infra | 11:23 | |
| *** Lucas_Gray has joined #openstack-infra | 11:24 | |
| *** iurygregory has joined #openstack-infra | 11:26 | |
| *** eernst has quit IRC | 11:27 | |
| *** iurygregory has quit IRC | 11:27 | |
| *** eernst has joined #openstack-infra | 11:29 | |
| donnyd | So here are the jobs with build timeouts in the last 48 hours | 11:33 |
| donnyd | https://www.irccloud.com/pastebin/rkXKEkyT/ | 11:33 |
| *** irclogbot_1 has quit IRC | 11:33 | |
| donnyd | 15 jobs in the last 48 hours | 11:34 |
| *** irclogbot_2 has joined #openstack-infra | 11:34 | |
| donnyd | rax-ord had 27 | 11:34 |
| *** eernst has quit IRC | 11:35 | |
| donnyd | Looks to me like similar jobs are failing. | 11:35 |
| *** eernst has joined #openstack-infra | 11:36 | |
| donnyd | vexxhost-sjc1 had 12, but they are different jobs. So I am not sure that the timeouts are related to cloud infra | 11:37 |
| *** eernst has quit IRC | 11:38 | |
| *** jcoufal has joined #openstack-infra | 11:42 | |
| *** yamamoto has quit IRC | 11:42 | |
| openstackgerrit | Merged openstack/project-config master: Ends project gating for doc8 https://review.opendev.org/671483 | 11:42 |
| priteau | Hi. We're seeing some Kayobe Zuul checks failing with this error: | 11:43 |
| priteau | ERROR: Could not find a version that satisfies the requirement pyparsing===2.4.1 (from -c https://opendev.org/openstack/requirements/raw/branch/master/upper-constraints.txt (line 492)) (from versions: 1.4.6, 1.4.7, 1.4.8, 1.4.11, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.5.7, 2.0.0, 2.0.1, 2.0.2, 2.0.3, 2.0.4, 2.0.5, 2.0.6, 2.0.7, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.1.4, 2.1.5, 2.1.6, 2.1.7, 2 | 11:43 |
| priteau | .1.8, 2.1.9, 2.1.10, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1, 2.4.0) | 11:43 |
| priteau | Looks like pyparsing 2.4.1 was released two days ago and upper-constraints was bumped, but now it's gone from PyPI: https://pypi.org/project/pyparsing/ | 11:44 |
| mordred | priteau: a release of pyparsing was unpublished. I believe upper-constraints has now been fixed, so it should be safe to recheck | 11:44 |
| mordred | priteau: oh - sorry - fix is in the gate: https://review.opendev.org/#/c/672395/ | 11:45 |
| ykarel | mordredit's still in gate | 11:45 |
| priteau | Thanks mordred. I see there is a patch which is being merged. | 11:45 |
| priteau | I should have searched on Gerrit before asking, sorry for the noise | 11:45 |
| *** joeguo has quit IRC | 11:47 | |
| *** jaosorior has quit IRC | 11:48 | |
| *** apetrich has joined #openstack-infra | 11:49 | |
| *** tdasilva has joined #openstack-infra | 11:50 | |
| *** yamamoto has joined #openstack-infra | 11:55 | |
| *** yamamoto has quit IRC | 11:55 | |
| yoctozepto | priteau, mordred, ykarel: looking at the bright side - this is probably the best reviewed change in gerrit in some time | 12:02 |
| *** rh-jelabarre has joined #openstack-infra | 12:03 | |
| *** pgaxatte has joined #openstack-infra | 12:03 | |
| *** zul has joined #openstack-infra | 12:04 | |
| AJaeger | config-core, could you review https://review.opendev.org/672053 as a new template for openstack-zuul-jobs, please? | 12:05 |
| *** rosmaita has joined #openstack-infra | 12:09 | |
| *** yamamoto has joined #openstack-infra | 12:10 | |
| *** bhavikdbavishi has joined #openstack-infra | 12:12 | |
| *** yamamoto has quit IRC | 12:14 | |
| AJaeger | thanks, mordred ^ | 12:18 |
| donnyd | does anyone know if zuul will work with openshift yet? | 12:18 |
| *** roman_g has joined #openstack-infra | 12:20 | |
| *** yamamoto has joined #openstack-infra | 12:21 | |
| mnaser | donnyd: maybe a better question for #zuul | 12:25 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Add build releasenotes py3 template https://review.opendev.org/672053 | 12:26 |
| Shrews | donnyd: there is support for openshift in the nodepool code base, though I do not know how widely it is used, so there are likely bugs/issues as yet undiscovered | 12:26 |
| donnyd | thanks mnaser Shrews | 12:27 |
| Shrews | donnyd: https://zuul-ci.org/docs/nodepool/configuration.html#openshift-driver | 12:27 |
| *** gfidente has joined #openstack-infra | 12:27 | |
| donnyd | That is super helpful Shrews . Thanks!!! | 12:28 |
| *** arxcruz|brb is now known as arxcruz | 12:29 | |
| *** bhavikdbavishi has quit IRC | 12:35 | |
| *** mriedem has joined #openstack-infra | 12:35 | |
| *** bhavikdbavishi has joined #openstack-infra | 12:39 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 12:42 | |
| roman_g | Hello team! User'ss question. I have 2 dependent changes in 2 repos - A and B. Change in repo B has proper Depends-On: xxxxxx pointing to the change in repo A. Code in repo B git-clones repo A internally and it currently clones 'master'. How could I properly utilize Zuul to do git-clone repo A for me, and apply the parent change over it? | 12:43 |
| *** yamamoto has quit IRC | 12:43 | |
| *** bhavikdbavishi has quit IRC | 12:43 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 12:43 | |
| *** yamamoto has joined #openstack-infra | 12:44 | |
| AJaeger | roman_g: just answered in #zuul ;) | 12:44 |
| *** coreycb has quit IRC | 12:45 | |
| *** coreycb has joined #openstack-infra | 12:47 | |
| *** jaosorior has joined #openstack-infra | 12:49 | |
| *** eharney has joined #openstack-infra | 12:49 | |
| *** pkopec_ has joined #openstack-infra | 12:56 | |
| roman_g | AJaeger: thank you! | 12:56 |
| *** liuyulong has joined #openstack-infra | 12:56 | |
| *** e0ne has quit IRC | 12:57 | |
| *** e0ne has joined #openstack-infra | 12:57 | |
| *** aedc has joined #openstack-infra | 12:58 | |
| *** pkopec has quit IRC | 12:58 | |
| *** aaronsheffield has joined #openstack-infra | 13:01 | |
| *** yamamoto has quit IRC | 13:01 | |
| *** elod has joined #openstack-infra | 13:01 | |
| *** elod2 has quit IRC | 13:02 | |
| *** tdasilva has quit IRC | 13:06 | |
| *** ykarel is now known as ykarel|away | 13:08 | |
| *** siqbal has quit IRC | 13:11 | |
| *** jpena|mtg is now known as jpena|off | 13:12 | |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: Return dependency cycle failure to user https://review.opendev.org/672487 | 13:15 |
| *** ykarel|away has quit IRC | 13:16 | |
| *** siqbal has joined #openstack-infra | 13:16 | |
| *** rfarr has joined #openstack-infra | 13:19 | |
| yoctozepto | infra, any idea why http://zuul.openstack.org/builds?project=openstack%2Fkolla-ansible&pipeline=periodic&pipeline=periodic-stable&branch=master&branch=stable%2Fstein&branch=stable%2Frocky&branch=stable%2Fqueens does not want to load? | 13:19 |
| *** rfarr_ has joined #openstack-infra | 13:19 | |
| yoctozepto | (it does load for kolla though, just not kolla-ansible) | 13:19 |
| *** rfarr_ has quit IRC | 13:20 | |
| *** bhavikdbavishi has quit IRC | 13:20 | |
| *** tdasilva has joined #openstack-infra | 13:22 | |
| *** jpena|off is now known as jpena | 13:25 | |
| *** jpena is now known as jpena|mtg | 13:27 | |
| *** yamamoto has joined #openstack-infra | 13:28 | |
| *** liuyulong has quit IRC | 13:41 | |
| yoctozepto | it seems this combo crashes: http://zuul.openstack.org/builds?project=openstack%2Fkolla-ansible&pipeline=periodic-stable | 13:44 |
| *** apetrich has quit IRC | 13:47 | |
| *** yamamoto has quit IRC | 13:53 | |
| *** armax has joined #openstack-infra | 13:54 | |
| *** jamesmcarthur has joined #openstack-infra | 13:55 | |
| *** apetrich has joined #openstack-infra | 13:56 | |
| *** ykarel|away has joined #openstack-infra | 13:59 | |
| *** ykarel|away is now known as ykarel | 14:00 | |
| *** siqbal has quit IRC | 14:02 | |
| *** odicha has quit IRC | 14:04 | |
| yoctozepto | hmm, proposed kolla jobs fail with http://mirror.iad.rax.openstack.org/centos/7/sclo/x86_64/rh/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found | 14:07 |
| yoctozepto | e.g. hit 12:47 | 14:07 |
| yoctozepto | it has been like this for a while | 14:08 |
| yoctozepto | yet when I connect | 14:08 |
| yoctozepto | http://mirror.iad.rax.openstack.org/centos/7/sclo/x86_64/rh/repodata/repomd.xml | 14:08 |
| yoctozepto | it works fine | 14:08 |
| yoctozepto | ;o | 14:08 |
| yoctozepto | any ideas what makes CI get 404? | 14:09 |
| *** goldyfruit has joined #openstack-infra | 14:11 | |
| *** siqbal has joined #openstack-infra | 14:12 | |
| *** tdasilva has quit IRC | 14:14 | |
| *** tdasilva has joined #openstack-infra | 14:16 | |
| *** lennyb has quit IRC | 14:18 | |
| *** tdasilva has quit IRC | 14:21 | |
| *** tdasilva has joined #openstack-infra | 14:23 | |
| *** iurygregory has joined #openstack-infra | 14:25 | |
| *** dpawlik has quit IRC | 14:25 | |
| *** jamesmcarthur has quit IRC | 14:25 | |
| *** pots78 has joined #openstack-infra | 14:26 | |
| *** jeremy_houser has joined #openstack-infra | 14:29 | |
| *** mriedem has quit IRC | 14:29 | |
| *** michael-beaver has joined #openstack-infra | 14:29 | |
| jeremy_houser | Hello; I'm trying to build a minor check/gate to run a tempest sanity check for my tempest plugin, but I cant get my .zuul.yaml to hook the new env I defined in my tox.ini. If anyone could take a look, I'd appreciate some input on changes I should make to my tox.ini or .zuul.yaml. I can execute the tox successfully fine on my vm, so I think I'm jus | 14:29 |
| jeremy_houser | t missing something in .zuul.yaml https://review.opendev.org/#/c/671135/17 | 14:29 |
| *** tdasilva has quit IRC | 14:30 | |
| clarkb | yoctozepto: Do you have logs you can share? | 14:30 |
| *** mattw4 has joined #openstack-infra | 14:31 | |
| *** rlandy|mtg has quit IRC | 14:32 | |
| clarkb | jeremy_houser: the envlist var should apply to specific jobs. You could for example add a tox job then provide an envlidt to it | 14:32 |
| clarkb | I dont think it will update the existing openstack python jobs templates | 14:32 |
| *** dpawlik has joined #openstack-infra | 14:33 | |
| jeremy_houser | ah, so I need to define a custom job, have it inherit from the openstack jobs, and then define the envlist var to run everything in my tox.ini? | 14:33 |
| clarkb | define the envlist to run what you need out of tox.ini (the openstack python jobs template likely covers much of it already). And for the inheritance the base zuul-jobs tox job may be sufficient | 14:35 |
| jeremy_houser | yeah, they cover everything except my new tempest tox job. | 14:36 |
| jeremy_houser | thanks, I'll give that a try | 14:36 |
| *** jpena|mtg is now known as jpena|off | 14:36 | |
| *** tdasilva has joined #openstack-infra | 14:36 | |
| *** ykarel is now known as ykarel|afk | 14:36 | |
| yoctozepto | clarkb: yeah, plenty actually | 14:37 |
| yoctozepto | https://review.opendev.org/671178 | 14:38 |
| yoctozepto | http://logs.openstack.org/78/671178/7/check/kolla-build-centos-source/6649f48/kolla/build/000_FAILED_ceph-base.txt.gz | 14:38 |
| fungi | stephenfin: yeah, if everything looks correct i can unjoin openstackadmin from the pycqa org | 14:38 |
| yoctozepto | this is another mirror actually | 14:38 |
| yoctozepto | they all seem to behave this way, odd | 14:39 |
| stephenfin | fungi: I still don't have permission to configure Travis for the repo, but I doubt you can do anything about that. You can remove the link, yup | 14:39 |
| *** siqbal has quit IRC | 14:39 | |
| *** tdasilva has quit IRC | 14:40 | |
| *** siqbal has joined #openstack-infra | 14:40 | |
| clarkb | yoctozepto: well that data is served from the same afs volume which meansif one 404s we should expect the others to (good thing they do) | 14:40 |
| clarkb | yoctozepto: is it possible that that filr actually was removed by upstream then we mirrored that? | 14:40 |
| yoctozepto | clarkb: but go to the link yourself to discover it's not 404 :D | 14:40 |
| yoctozepto | it's been like this since beginning | 14:41 |
| yoctozepto | no, this file does not change its place | 14:41 |
| *** gfidente has quit IRC | 14:41 | |
| *** tdasilva has joined #openstack-infra | 14:41 | |
| *** psachin has quit IRC | 14:41 | |
| clarkb | I get a 404... | 14:42 |
| jonher | neither of the mirror links works for me either, 404 on both, in centos/7 the folder sclo is missing | 14:42 |
| *** ricolin_ has joined #openstack-infra | 14:42 | |
| yoctozepto | clarkb: now for me too | 14:43 |
| clarkb | I would check upstream | 14:43 |
| yoctozepto | but it was not cached here, I swear | 14:43 |
| *** tdasilva has quit IRC | 14:43 | |
| yoctozepto | I literally just downloaded it ;p | 14:43 |
| clarkb | if it is gone upstream then our mirrors are correct | 14:43 |
| clarkb | if it is not gone upstream we'll have to dig more | 14:44 |
| *** tdasilva has joined #openstack-infra | 14:44 | |
| *** ricolin has quit IRC | 14:45 | |
| *** david-lyle is now known as dklyle | 14:45 | |
| yoctozepto | clarkb: http://mirror.lstn.net/centos/7/sclo/x86_64/rh/repodata/repomd.xml | 14:46 |
| yoctozepto | also see: https://review.opendev.org/671449 | 14:46 |
| yoctozepto | this is where it was enabled for sync | 14:46 |
| yoctozepto | and it was there | 14:47 |
| mnaser | gitea seems to be a lil weirdly slow | 14:48 |
| clarkb | mnaser on nova and neutron? | 14:48 |
| *** dpawlik has quit IRC | 14:48 | |
| mnaser | keystone is what im browsing | 14:48 |
| mnaser | https://opendev.org/openstack/keystone/src/branch/stable/rocky/keystone/token/providers -- © Gitea Version: 6eb53ac570ab9af51fc9cbd79f1db782edce57e0 Page: 4873ms Template: 7ms | 14:48 |
| clarkb | possible keystone is big enough to suffer from that too | 14:48 |
| clarkb | mnaser: what corvus found is gitea scans the last commit for every file to render that info for you and it doesnt cache the data | 14:49 |
| *** bobh has joined #openstack-infra | 14:49 | |
| clarkb | yoctozepto: do we know the sclo mirroring worked for this particular file? | 14:49 |
| yoctozepto | clarkb: could it be that it gets synced from time to time and deleted in the meantime? it really makes my head burn | 14:49 |
| clarkb | yoctozepto: its possible afs only half synced | 14:49 |
| *** igordc has joined #openstack-infra | 14:49 | |
| yoctozepto | clarkb: per Ian's link, yeah | 14:50 |
| yoctozepto | http://files.openstack.org/mirror/logs/rsync-mirrors/centos.log | 14:50 |
| yoctozepto | the whole subtree is missing - for sclo | 14:50 |
| clarkb | yoctozepto: that should only be possible if upstream deletesit. What is possible is software collections was too large to sync before the afs credential timeout andit broke halgway through | 14:50 |
| clarkb | I suppose if the rsync reverted to the excludeit would go away | 14:51 |
| clarkb | did that change get reverted? | 14:51 |
| yoctozepto | clarkb: nope | 14:51 |
| *** mgoddard has joined #openstack-infra | 14:51 | |
| *** mattw4 has quit IRC | 14:51 | |
| yoctozepto | it is as if something deleted the whole subtree | 14:52 |
| *** pkopec_ has quit IRC | 14:52 | |
| yoctozepto | ianw's links suggests it was fully remirrored at 2019-07-24T06:43:01,782361375+00:00 | 14:52 |
| yoctozepto | so it was rightfully gone | 14:52 |
| *** jbadiapa has quit IRC | 14:52 | |
| *** tdasilva has quit IRC | 14:53 | |
| *** ykarel|afk is now known as ykarel | 14:59 | |
| *** mattw4 has joined #openstack-infra | 15:00 | |
| *** ricolin_ is now known as ricolin | 15:02 | |
| *** ccamacho has quit IRC | 15:05 | |
| *** Goneri has quit IRC | 15:05 | |
| clarkb | I think the problem is that mirror-update.openstack.org and mirror-update.opendev.org are bothin updating the cetnos repo but mirror-update.openstack.org is no longer updating that script | 15:05 |
| clarkb | seems the transition between the hosts for rsync mirrors is not complete and this is caught in the middle | 15:05 |
| *** jbadiapa has joined #openstack-infra | 15:06 | |
| *** pgaxatte has quit IRC | 15:07 | |
| clarkb | ya the centos cron is in there commented out and not commented out so puppet must have replaced it | 15:08 |
| * clarkb checks to see if it was removed from puppet | 15:08 | |
| *** mriedem has joined #openstack-infra | 15:09 | |
| *** rfarr has quit IRC | 15:11 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Remove centos mirror from openstack mirror update https://review.opendev.org/672546 | 15:12 |
| clarkb | yoctozepto: ^ I think that is the fix | 15:12 |
| *** yamamoto has joined #openstack-infra | 15:13 | |
| *** gyee has joined #openstack-infra | 15:13 | |
| clarkb | the other rsync mirrors appear to have been properly removed, this one was missed | 15:13 |
| *** pkopec has joined #openstack-infra | 15:15 | |
| clarkb | fungi: ansible is running on new gitea01 but doesn't seem to be running the docker and gitea installation bits, any idea what is going on there yet? | 15:16 |
| yoctozepto | clarkb: thanks, I always <3 the "you-do-not-know-you-have-an-issue-until-you-do-something" things | 15:17 |
| *** rascasoft has quit IRC | 15:17 | |
| *** iurygregory has quit IRC | 15:20 | |
| fungi | clarkb: i'm about caught back up to the point where i can look at it some more, will check | 15:22 |
| *** rascasoft has joined #openstack-infra | 15:22 | |
| *** tdasilva has joined #openstack-infra | 15:23 | |
| *** yamamoto has quit IRC | 15:24 | |
| clarkb | k, I'm still juggling breakfast and laptop updates along with digging into things from today | 15:24 |
| clarkb | mnaser: fwiw that looks like the nova/neutron behavior just not as bad | 15:25 |
| clarkb | mnaser: and ya we seem to have tracked that back to a lack of caching most recent commit info for files/dirs that are part of the rendered info | 15:26 |
| clarkb | I think we were still hoping someone would volunteer to help debug that (there was an openstack-discuss thread on it but it died as soon as I wrote down how people can debug it). We (opendev) are still trying to replace all of the servers so that we can make replication reliable | 15:26 |
| fungi | fatal: [gitea01.opendev.org]: FAILED! => {"changed": false, "cmd": "/usr/bin/apt-key add -", "msg": "Warning: apt-key output should not be parsed (stdout is not a terminal)\ngpg: failed to start agent '/usr/bin/gpg-agent': No such file or directory[...] | 15:36 |
| fungi | i think we're missing a package | 15:37 |
| clarkb | I don't remember running into that, I suppose we need to install gpg2 as part of our base package list? | 15:37 |
| fungi | but yeah, it's dying there for install-docker | 15:37 |
| clarkb | fungi: system-config/playbooks/roles/base-server/vars/Debian.yaml ? | 15:37 |
| stephenfin | harlowja: Polite reminder to add me to doc8-core, or just merge this yourself and abandon everything else that's proposed https://review.opendev.org/#/c/670552/ | 15:39 |
| *** diablo_rojo has joined #openstack-infra | 15:39 | |
| * clarkb reboots for updates back soon | 15:39 | |
| fungi | yup, confirmed the other gitea servers have the gnupg package installed | 15:42 |
| *** mattw4 has quit IRC | 15:44 | |
| clarkb | fungi: I don't remember running into this myself, is it possible something was depending on it and now isn't so we don't pull it in? | 15:44 |
| *** mattw4 has joined #openstack-infra | 15:44 | |
| clarkb | in any case I suppose adding it to the package list should be safe | 15:44 |
| *** siqbal has quit IRC | 15:47 | |
| openstackgerrit | Jeremy Stanley proposed opendev/system-config master: Install GNU Privacy Guard on Gitea servers https://review.opendev.org/672551 | 15:48 |
| fungi | yeah, i just wanted to dig a little first | 15:48 |
| fungi | i'm disappointed (but not surprised) that apt-key seems to expect to use gpg-agent | 15:48 |
| *** mattw4 has quit IRC | 15:49 | |
| fungi | looking forward to the next ubuntu lts when we can stop using apt-key and just switch to stuffing ascii-armored public keys into a directory in /etc | 15:49 |
| clarkb | corvus: mordred have a sec for https://review.opendev.org/672551 | 15:52 |
| fungi | i'm going to grab a quick lunch while that merges | 15:52 |
| fungi | and hopefully by the time i'm done it'll be applied on the new server | 15:52 |
| *** pkopec has quit IRC | 15:53 | |
| mordred | clarkb, fungi: +3 - although fwiw, it seems like maybe we should enhance the install-docker role to install gnupg since it depends on it? | 15:58 |
| clarkb | mordred: probably a good idea, though it is weird to me that apt depends on it and doesn't install it. Maybe that is because we don't install recommends? | 15:58 |
| fungi | well, it depends on apt-key which depends on gnupg... | 15:59 |
| fungi | yeah, could be it's a recommends | 15:59 |
| clarkb | https://packages.ubuntu.com/bionic/add-apt-key apt-key depends on gnupg | 16:02 |
| *** siqbal has joined #openstack-infra | 16:02 | |
| mordred | that seems super weird then | 16:02 |
| fungi | that's the add-apt-key package | 16:03 |
| clarkb | oh | 16:03 |
| clarkb | I see apt-key may not be in tat package /me look sbetter | 16:04 |
| fungi | the apt package provides /usr/bin/apt-key | 16:04 |
| fungi | https://packages.ubuntu.com/bionic/amd64/apt/filelist | 16:04 |
| fungi | dpkg -S `which apt-key` | 16:05 |
| fungi | when in doubt | 16:05 |
| clarkb | and that suggest gnupg | 16:05 |
| fungi | yeah | 16:05 |
| fungi | suggests is weaker than recommends is weaker than depends | 16:05 |
| clarkb | there is a separate package just to verify gpg signatures which it requires | 16:05 |
| fungi | gpgv, yep | 16:05 |
| fungi | anyway, gonna get lunch. bbiab | 16:05 |
| *** lucasagomes has quit IRC | 16:06 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Download-artifact: use the artifact type rather than name https://review.opendev.org/672557 | 16:09 |
| *** tdasilva_ has joined #openstack-infra | 16:09 | |
| *** tdasilva has quit IRC | 16:12 | |
| *** diablo_rojo has quit IRC | 16:12 | |
| openstackgerrit | Merged opendev/system-config master: Remove centos mirror from openstack mirror update https://review.opendev.org/672546 | 16:13 |
| *** kjackal has quit IRC | 16:13 | |
| *** pcaruana has quit IRC | 16:13 | |
| *** kjackal has joined #openstack-infra | 16:15 | |
| clarkb | mordred: semi related the ansible warnings about aptitude not being present are super annoying. I wonder if we could convince ansible that that is a silly warning to make considering that aptitude isn't available by default? | 16:21 |
| mordred | clarkb: yeah | 16:22 |
| mordred | clarkb: or should we just bow to peer-pressure and install aptitude? does it make anything in the apt module noticably better somehow? | 16:22 |
| clarkb | mordred: I think the claim is the dep resolver is better r something like that | 16:22 |
| clarkb | another idea I had was getting ansible to write warnings once (the first time) then being quiet | 16:23 |
| clarkb | maybe that can be a config option? | 16:23 |
| *** ricolin has quit IRC | 16:23 | |
| clarkb | because I still want the warnings I just don't need them for every task * every host | 16:23 |
| *** ykarel is now known as ykarel|away | 16:23 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add log browsing to build page https://review.opendev.org/671906 | 16:25 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Move artifacts to their own section https://review.opendev.org/672379 | 16:25 |
| mordred | clarkb: https://github.com/ansible/ansible/issues/56832 and https://github.com/ansible/ansible/issues/18987 are both related | 16:26 |
| *** rpittau is now known as rpittau|afk | 16:26 | |
| mordred | also https://github.com/ansible/ansible/pull/27962 | 16:27 |
| *** siqbal has quit IRC | 16:27 | |
| clarkb | zbr_ seems to summarize it nicely | 16:28 |
| clarkb | aptitude is not the default package manager therefore ugh | 16:28 |
| clarkb | fwiw I like aptitude as a tool and install it on my own machines | 16:28 |
| clarkb | I wouldn't be opposed to adding it to our instances, but I also don't think it should be necessary | 16:29 |
| mordred | I don't have any issues with aptitude and I'm not angry when it exists - but I also never actually use it mysefl | 16:29 |
| mordred | then again - sometimes I use dselect - so I may be weird | 16:29 |
| *** siqbal has joined #openstack-infra | 16:33 | |
| *** kjackal has quit IRC | 16:36 | |
| *** diablo_rojo has joined #openstack-infra | 16:43 | |
| clarkb | yoctozepto: the centos mirror cron entry has been removed from the older server, hopefully things go back to expected on the next mirror update pulse | 16:45 |
| *** mattw4 has joined #openstack-infra | 16:46 | |
| openstackgerrit | Merged opendev/system-config master: Install GNU Privacy Guard on Gitea servers https://review.opendev.org/672551 | 16:48 |
| *** dtantsur is now known as dtantsur|afk | 16:52 | |
| *** Lucas_Gray has quit IRC | 16:55 | |
| yoctozepto | clarkb: thanks, do you know when that would be? | 16:55 |
| yoctozepto | 6 AM UTC tomorrow? | 16:55 |
| yoctozepto | earlier? | 16:55 |
| clarkb | yoctozepto: it runs every 2 hours so at 1800UTC I think? | 16:56 |
| yoctozepto | clarkb: great, will take a look then | 16:56 |
| *** derekh has quit IRC | 16:56 | |
| yoctozepto | clarkb: http://mirror.sjc1.vexxhost.openstack.org/centos/7/sclo/x86_64/rh/repodata/repomd.xml | 16:57 |
| yoctozepto | is it 404 for you or not? :D | 16:57 |
| yoctozepto | (cause I cannot trust myself) | 16:57 |
| clarkb | it isn't | 16:57 |
| yoctozepto | yay :D | 16:57 |
| clarkb | its possible the removal of the other cron got in early enough or something | 16:57 |
| yoctozepto | great, rechecking changes | 16:57 |
| clarkb | if it reverts back in the near future it should go back to working after 1800UTC though | 16:57 |
| yoctozepto | or it's magic | 16:57 |
| *** kjackal has joined #openstack-infra | 16:58 | |
| yoctozepto | clarkb: 2019-07-24T15:27:02,566724681+00:00 | 16:59 |
| yoctozepto | from Ian's log | 16:59 |
| yoctozepto | hopefully it does not go now | 17:04 |
| zbr_ | clarkb: i seen that you mentioned one comment of mine but i was not able to find it. is some there something I can help with? | 17:09 |
| clarkb | zbr_: https://github.com/ansible/ansible/issues/56832#issuecomment-508569039 that one | 17:10 |
| *** siqbal has quit IRC | 17:10 | |
| zbr_ | clarkb: ahh, right. afaik searching for packages needs aptitude, or at least I do not know how to search for them with apt(-get) | 17:13 |
| clarkb | zbr_: apt-cache search is one option | 17:13 |
| zbr_ | ouch, some many tools... | 17:14 |
| fungi | clarkb: the dep solver in aptitude had some benefits over the one in libapt once upon a time. it no longer does afaik (but you want to use `apt` instead of `apt-get` to take advantage of them) | 17:15 |
| zbr_ | i kinds like the simplicity of "<tool> install|search|remove" | 17:15 |
| zbr_ | if someone has a PR to address that bug, i could ping few people to get it fixed, maybe even backported to 2.8 | 17:16 |
| fungi | zbr_: apt-search is how you would search for packages without aptitude, fwiw | 17:16 |
| *** igordc has quit IRC | 17:16 | |
| fungi | zbr_: er, `apt search ...` | 17:16 |
| *** igordc has joined #openstack-infra | 17:17 | |
| fungi | then again, my opinions are formed from using debian/unstable on all my personal systems since decades, so i tend to be a bit oblivious about when things trickle into derivatives like ubuntu | 17:18 |
| clarkb | /usr/bin/gpg exists on gitea01, not quite far neough to install docker yet | 17:22 |
| fungi | yeah, was just reviewing the run_all log | 17:23 |
| fungi | 17:02:00z it said it couldn't find /usr/bin/gpg-agent | 17:24 |
| openstackgerrit | James E. Blair proposed zuul/zuul-operator master: WIP: testing https://review.opendev.org/672567 | 17:24 |
| fungi | 2019-07-24 17:20:44 status installed gnupg:amd64 2.2.4-1ubuntu1.2 | 17:24 |
| fungi | so this pass ought to take care of it | 17:24 |
| *** sgw has quit IRC | 17:25 | |
| *** igordc has quit IRC | 17:27 | |
| *** priteau has quit IRC | 17:30 | |
| *** e0ne has quit IRC | 17:37 | |
| *** kjackal has quit IRC | 17:39 | |
| *** pcaruana has joined #openstack-infra | 17:41 | |
| *** bobh has quit IRC | 17:42 | |
| clarkb | fungi: there is a gitea running now on gitea01, should be safe to proceed | 17:48 |
| fungi | i concur, process start time is 17:34z | 17:49 |
| fungi | i guess next step is the manual db import? | 17:49 |
| *** ramishra has quit IRC | 17:50 | |
| *** ralonsoh has quit IRC | 17:55 | |
| portdirect | is zuul taking a nap atm? or just the status page? | 17:56 |
| clarkb | portdirect: should just be the status page | 17:56 |
| clarkb | (there is a sql query making it sad) | 17:56 |
| portdirect | roger - thanks dude | 17:56 |
| clarkb | logs for the zuul scheduler indicate it is still prcessing jobs behind the scenes | 17:57 |
| fungi | the status page is served by a different daemon | 17:57 |
| *** igordc has joined #openstack-infra | 18:01 | |
| *** diablo_rojo has quit IRC | 18:02 | |
| corvus | fungi, clarkb, yoctozepto, Shrews: there are no long running queries now, so if zuul-web is still not responding, let's restart it | 18:19 |
| corvus | i'll do that? | 18:19 |
| clarkb | corvus: wfm | 18:19 |
| fungi | sounds good | 18:19 |
| *** gary_perkins_ has quit IRC | 18:19 | |
| corvus | that's done; still no go -- it may actually be apache at fault? | 18:20 |
| *** gary_perkins has joined #openstack-infra | 18:20 | |
| corvus | i'll restart apache | 18:20 |
| corvus | yep that was it | 18:21 |
| corvus | i'm mildly curious what was up with that | 18:21 |
| corvus | if it happens again, maybe we can debug that some more | 18:21 |
| yoctozepto | corvus: changing channels? | 18:22 |
| yoctozepto | restart is fine by me | 18:22 |
| corvus | yoctozepto: this was more of an openstack-infra operational thing; i'm happy for "zuul has broken sql query" to happen in #zuul | 18:22 |
| yoctozepto | corvus: roger that | 18:23 |
| *** wolke has quit IRC | 18:24 | |
| *** panda has quit IRC | 18:25 | |
| *** wolke has joined #openstack-infra | 18:27 | |
| clarkb | fungi: I've realized a missing step in the docs is that we want to run the gc over all the repos once replicatio nis complete (for performance reasons) | 18:32 |
| clarkb | that came up a little later in the 06 rebuild | 18:32 |
| *** panda has joined #openstack-infra | 18:33 | |
| *** ykarel|away has quit IRC | 18:35 | |
| fungi | clarkb: so x. copy db in from another server, y. force replication, z. perform git gc? | 18:38 |
| clarkb | fungi: ya and somewhere between x and y is click button to create missing repos, update dns, and accept the rsa ssh key | 18:39 |
| fungi | but regardless, the db copy is our next step. i'll get that going | 18:40 |
| *** tosky has quit IRC | 18:42 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: WIP: debug zuul-operator-functional-k8s job https://review.opendev.org/672576 | 18:43 |
| fungi | `sudo docker ps -a` suggests that the id of the container running mariadb is 3f7f9803272d | 18:44 |
| fungi | (on gitea01) | 18:44 |
| fungi | the next step suggests that we should stop all the gitea containers, but doesn't indicate whether that's meant to include or exclude the mariadb container... do you happen to know, clarkb? | 18:45 |
| *** georgk has quit IRC | 18:45 | |
| clarkb | fungi: not the mariadb container. If yo ustop the mariadb container you won't be able to restore the db. This was mostly a safety thing to avoid gitea running and db restore running over each other | 18:46 |
| *** georgk has joined #openstack-infra | 18:46 | |
| fungi | i see. thanks | 18:47 |
| fungi | it wasn't entirely clear to me what "stopping" a container actually means | 18:47 |
| fungi | (whether that stops all the processes running within it, or just stops management of it) | 18:47 |
| clarkb | oh! sudo docker kill $containerid | 18:47 |
| clarkb | it stops the processes in the container but docker retains knowledge of it and it can be started again | 18:48 |
| fungi | okay | 18:48 |
| clarkb | sudo docker ps -a to confirm | 18:48 |
| clarkb | it is a lot like service management | 18:49 |
| *** tesseract has quit IRC | 18:49 | |
| fungi | `sudo docker ps -a` indicates all the containers except the one for mariadb are in an "exited" state now | 18:49 |
| clarkb | perfect | 18:50 |
| *** lpetrut has quit IRC | 18:50 | |
| *** diablo_rojo has joined #openstack-infra | 18:51 | |
| *** hwoarang has quit IRC | 18:53 | |
| fungi | so for the db restore/import, can i just grab a nightly from /var/backups/gitea-mariadb/gitea-mariadb.sql.gz.1 on one of the other servers, or do i need to make a special/more recent dump? | 18:53 |
| fungi | i guess if we've actually frozen new project creation then it's all the same | 18:54 |
| clarkb | as long as we haven't created any new projects since the last backup the last backup should be fine | 18:54 |
| clarkb | this is predominantly about restoring the project redirects | 18:54 |
| clarkb | yup | 18:54 |
| *** hwoarang has joined #openstack-infra | 18:54 | |
| fungi | clarkb: the procedure refers to $MYSQL_ROOT_PASSWORD, what's the best place to obtain that? | 19:00 |
| clarkb | fungi: it is meant to be used as a literal var as is | 19:00 |
| fungi | ahh | 19:00 |
| clarkb | fungi: the container env has it defined | 19:00 |
| clarkb | so it gets interpolated for you when you run the command in the container | 19:00 |
| fungi | so are $DB_CONTAINER_ID and $GITEA_CONTAINER_IDS handled similarly then? i was hand-substituting those | 19:01 |
| clarkb | no those are to be inferred from the docker ps -a listing | 19:02 |
| fungi | cool, seems to be working so far | 19:03 |
| fungi | looks like it created tables and added data | 19:05 |
| clarkb | excellent | 19:05 |
| fungi | the gitea containers are restarted, but i didn't do it | 19:06 |
| fungi | `sudo docker ps -a` says they've been up for 3 minutes... ansible? | 19:06 |
| fungi | does it start stopped containers? | 19:06 |
| *** jeremy_houser has quit IRC | 19:07 | |
| *** bobh has joined #openstack-infra | 19:07 | |
| clarkb | oh hrm ya if docker-compose runs it will likely restart them automatically | 19:07 |
| fungi | is that likely to cause data integrity issues? | 19:07 |
| fungi | do they just need to be stopped and started again? | 19:08 |
| clarkb | I wasn't able to confirm or deny it causing data integrity issues so I was being cautious | 19:08 |
| clarkb | if it only takes a few minutes may as well rerun the restore? (it should have table drops and all that in it right?) | 19:08 |
| fungi | should i stop them again, perform a new db import and then start them once more? | 19:08 |
| fungi | will do | 19:08 |
| fungi | done | 19:10 |
| *** kopecmartin is now known as kopecmartin|offf | 19:13 | |
| mordred | clarkb, fung: back from lunch - anything my eyes are needed for? | 19:21 |
| clarkb | mordred: I don't think so? we are just working throuh the gitea stuff | 19:21 |
| clarkb | I'm somewhat distracted by the television | 19:21 |
| mordred | clarkb: is the television talking to you? | 19:23 |
| clarkb | not directly | 19:23 |
| fungi | the sox lost | 19:24 |
| mordred | fungi: that's one of the sports balls that I don't sports ball | 19:25 |
| *** e0ne has joined #openstack-infra | 19:25 | |
| *** hwoarang has quit IRC | 19:30 | |
| *** hwoarang has joined #openstack-infra | 19:31 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Revert "Speed up build list query under mysql" https://review.opendev.org/672581 | 19:33 |
| clarkb | fungi: any luck with the next steps for gitea? | 19:34 |
| fungi | i'm up to creating the bare repos | 19:35 |
| *** jtomasek has quit IRC | 19:39 | |
| openstackgerrit | Merged zuul/zuul master: Update xterm to >= 3.14.5 https://review.opendev.org/671858 | 19:39 |
| *** priteau has joined #openstack-infra | 19:40 | |
| openstackgerrit | Jeremy Stanley proposed opendev/zone-opendev.org master: Update IP address for gitea01 https://review.opendev.org/672584 | 19:45 |
| clarkb | fungi: I single core approved ^ since it is just an IP update | 19:46 |
| *** e0ne has quit IRC | 19:46 | |
| *** pots78 has quit IRC | 19:48 | |
| fungi | thanks | 19:48 |
| fungi | that was keeping me from doing the bare repo init | 19:48 |
| clarkb | oh? | 19:49 |
| clarkb | it does work to hit the ip addr | 19:49 |
| clarkb | (but both things need to be done anyway so is fine) | 19:49 |
| fungi | ahh, yeah, i could have done it via the ip address and accepted the ssl warnings i guess | 19:50 |
| openstackgerrit | Merged opendev/zone-opendev.org master: Update IP address for gitea01 https://review.opendev.org/672584 | 19:51 |
| clarkb | you'll have ssl warnings either way | 19:51 |
| fungi | yeah, true | 19:53 |
| fungi | since it'll be a cert for gitea.o.o not gitea01.o.o | 19:53 |
| *** e0ne has joined #openstack-infra | 19:57 | |
| *** priteau has quit IRC | 20:02 | |
| *** eharney has quit IRC | 20:05 | |
| *** e0ne has quit IRC | 20:19 | |
| *** hwoarang has quit IRC | 20:25 | |
| *** goldyfruit has quit IRC | 20:26 | |
| *** hwoarang has joined #openstack-infra | 20:26 | |
| *** bobh has quit IRC | 20:28 | |
| clarkb | fungi: I see new gitea01 dns record on my resolver now | 20:30 |
| *** bobh has joined #openstack-infra | 20:30 | |
| fungi | me too and it's working in-browser | 20:32 |
| fungi | reinitialization is underway too | 20:33 |
| fungi | All missing Git repositories for which records existed have been reinitialized. | 20:33 |
| clarkb | /var/gitea/data/git/repositories seems to have stuff in it | 20:34 |
| *** panda has quit IRC | 20:35 | |
| fungi | is the $USER at https://docs.openstack.org/infra/system-config/gitea.html#replicate-git-repo-content-from-gerrit a placeholder or expected to be filled in by the shell environment? | 20:36 |
| *** panda has joined #openstack-infra | 20:37 | |
| clarkb | fungi: it is a placeholder. My user is cboylan on gerrit but clark(b) most places | 20:38 |
| *** jcoufal has quit IRC | 20:39 | |
| *** bobh has quit IRC | 20:39 | |
| fungi | oh, i see, this is meant to be run as the person doing the steps, not from the gerrit2 account on review.o.o | 20:41 |
| fungi | more of a context shift than i anticipated. thanks | 20:41 |
| clarkb | It is possible that project-creator can request a replication but I'm not sure | 20:43 |
| fungi | 2038 tasks pending | 20:43 |
| clarkb | at this point we want to ensure it is actually working (and we don't end up with a bunch of retries. That happened to me last time due to the madness around ssh host keys) | 20:45 |
| fungi | https://gitea01.opendev.org:3000/openstack/security-doc/commits/branch/master | 20:46 |
| fungi | seems to be | 20:46 |
| clarkb | \o/ | 20:47 |
| clarkb | Then when replication is complete manually run the gc cron (this isn't in my docs :( ) then we can add it to the haproxy again | 20:48 |
| *** joeguo has joined #openstack-infra | 20:48 | |
| *** raissa has quit IRC | 20:49 | |
| openstackgerrit | Clark Boylan proposed opendev/puppet-mediawiki master: Remove extension which are git submodules https://review.opendev.org/672594 | 20:50 |
| clarkb | fungi: ^ I think that might be the wiki fix | 20:50 |
| clarkb | I confirmed those were submodules by viewing .gitmodules in the mediawiki repo then removed all of them that show up as errors in syslog | 20:51 |
| clarkb | on wiki-dev02 | 20:51 |
| fungi | ahh, interesting... does it clone all the submodules independently, or do we still need something to do that piece? | 20:52 |
| clarkb | they all looked to be checked out properl.y I think modern git does that for you now? | 20:53 |
| clarkb | so this may actually be a conflict between git versions. In the past you had to take extra steps to get that and now you don't? | 20:53 |
| fungi | oh, makes sense | 20:53 |
| clarkb | 1175 ish tasks now | 20:53 |
| fungi | still remembering back when you needed to do `git submodule init` and so on | 20:54 |
| *** eharney has joined #openstack-infra | 20:56 | |
| clarkb | basically git is saying I can't clone these into that dir because there is stuff there alreaday | 20:56 |
| clarkb | and they appear to be there already because they are git submodules of the mediawiki repo | 20:56 |
| fungi | under 1000 | 20:56 |
| fungi | (not over 9000) | 20:57 |
| *** tdasilva_ is now known as tdasilva | 21:01 | |
| *** e0ne has joined #openstack-infra | 21:04 | |
| *** pcaruana has quit IRC | 21:05 | |
| fungi | down to the last few | 21:05 |
| *** jeremy_houser has joined #openstack-infra | 21:05 | |
| fungi | and done... now we just need to readd it to the haproxy config? | 21:06 |
| clarkb | we should do the gc first | 21:07 |
| clarkb | since running without that led to performance issues | 21:07 |
| clarkb | (it will pack stuff which is what helps a lot aiui) | 21:07 |
| clarkb | that command is in root's crontab on the host | 21:07 |
| clarkb | `docker exec -t giteadocker_gitea-web_1 find /data/git/repositories/ -maxdepth 2 -name *.git -type d -execdir git --git-dir={} gc --quiet \;` | 21:08 |
| openstackgerrit | Jeremy Stanley proposed opendev/system-config master: Readd gitea01 to haproxy pools https://review.opendev.org/672597 | 21:08 |
| fungi | doing now | 21:09 |
| fungi | it's running | 21:10 |
| *** jeremy_houser has left #openstack-infra | 21:10 | |
| clarkb | I want to say that only takes a few minutes | 21:10 |
| clarkb | maybe 10 max | 21:10 |
| clarkb | haproxy change lgtm and that should auto reload config now too \o/ | 21:10 |
| fungi | it'll take longer than that to get 672597 in anyway | 21:10 |
| clarkb | mordred: corvus have a quick sec for 672597? the gc'ing should be done by the time that merges if you approve it now | 21:11 |
| fungi | thanks corvus! | 21:12 |
| *** kjackal has joined #openstack-infra | 21:12 | |
| *** imacdonn has quit IRC | 21:16 | |
| *** mattw4 has quit IRC | 21:18 | |
| *** raissa has joined #openstack-infra | 21:19 | |
| corvus | clarkb: https://review.opendev.org/671852 needs to happen | 21:26 |
| clarkb | oh | 21:27 |
| * clarkb looks at those failures | 21:27 | |
| ianw | clarkb: ahh, thanks for finding that duplicated cron job | 21:28 |
| ianw | infra-root: are we ok with switching on IAD opendev.org for a while? https://review.opendev.org/#/c/672404/ i can monitor today; can probably turn it off this evening (my time) after we've got some results | 21:30 |
| *** e0ne has quit IRC | 21:30 | |
| clarkb | corvus: ^ I rechecked that change as the failures don't make sense to me and I've left a note about a minor thing we may want tochange | 21:30 |
| clarkb | ianw: this is with now building kernel updates? | 21:31 |
| *** mattw4 has joined #openstack-infra | 21:31 | |
| *** aedc has quit IRC | 21:31 | |
| clarkb | approved | 21:31 |
| ianw | clarkb: yeah the iad mirror is currently running the TOT afs-next kernel (based on 5.3-rc1) with the afs changes for fallback across vos releases and a few other changes for 5.3 | 21:32 |
| fungi | ianw: seems worthwhile to get some stats | 21:32 |
| clarkb | mordred: ianw corvus https://review.opendev.org/#/c/672594/ should hopefully give us a bit more progress on the wiki rebuild | 21:38 |
| clarkb | if yall have a moment for that | 21:38 |
| *** e0ne has joined #openstack-infra | 21:39 | |
| fungi | fwiw, the git gc is still underway | 21:39 |
| openstackgerrit | Merged openstack/project-config master: Enable IAD opendev.org mirror https://review.opendev.org/672404 | 21:43 |
| clarkb | it is on nova currently | 21:44 |
| *** e0ne has quit IRC | 21:46 | |
| * clarkb pops out for a bit | 21:53 | |
| fungi | puppet-openstack_extras now | 21:54 |
| fungi | so at least it got through nova | 21:54 |
| fungi | now it's on nova-specs, so not in alpha order | 21:58 |
| fungi | if the ordering of the find command is deterministic, it's ~50% through by repository count | 22:02 |
| fungi | yeah, seems to be deterministic for now | 22:03 |
| *** xek has quit IRC | 22:12 | |
| *** mattw4 has quit IRC | 22:12 | |
| *** mattw4 has joined #openstack-infra | 22:16 | |
| openstackgerrit | Merged opendev/system-config master: Readd gitea01 to haproxy pools https://review.opendev.org/672597 | 22:17 |
| fungi | 80% of repos garbage-collected now | 22:18 |
| fungi | should finish by the time that ^ gets applied anyway | 22:18 |
| fungi | and it's done | 22:24 |
| fungi | not been readded to haproxy yet, watching for that now | 22:24 |
| *** kjackal has quit IRC | 22:28 | |
| openstackgerrit | Merged opendev/puppet-mediawiki master: Remove extension which are git submodules https://review.opendev.org/672594 | 22:32 |
| openstackgerrit | Jeff Liu proposed zuul/zuul-operator master: [WIP] Verify Operator Pod Running https://review.opendev.org/670395 | 22:32 |
| *** pkopec has joined #openstack-infra | 22:33 | |
| *** dchen has joined #openstack-infra | 22:37 | |
| fungi | balance_git_http,gitea01.opendev.org,0,0,0,0,,0,0,0,,0,,0,0,0,0,UP,1,1,0,0,0,8,0,,1,2,1,,0,,2,0,,0,L4OK,,0,,,,,,,,,,,0,0,,,,,-1,,,0,0,0,0,,,,Layer4 check passed,,2,3,4,,,,38.108.68.172:3080,,tcp,,,,,,,,0,0,0,,, | 22:43 |
| clarkb | fungi: I think it just restarted with the new config | 22:43 |
| clarkb | ya that cool | 22:43 |
| fungi | it's in rotation | 22:43 |
| clarkb | now only 6 more to go :) I'll try to get through one of them tomorrow | 22:44 |
| fungi | i can try to knock out gitea02 tomorrow now that more of the rough edges are smoothed over | 22:44 |
| *** slaweq has quit IRC | 22:45 | |
| clarkb | fungi: ++ maybe we can even get two done tomorrow | 22:45 |
| fungi | right on | 22:45 |
| *** harlowja has quit IRC | 22:45 | |
| fungi | see if we've missed anything else | 22:45 |
| clarkb | fungi: you ran into quota problems right? was wondering if maybe we could boot all 6 then production line them into haproxy | 22:46 |
| clarkb | but I'm guessing we have to do them a bit more serially | 22:46 |
| fungi | i did not run into any quota problems | 22:48 |
| clarkb | oh flaw with that is we ha e to remove the old ones from inventory to boot new ones | 22:51 |
| fungi | yup | 22:51 |
| clarkb | so ya cycling through may be easiest | 22:51 |
| fungi | but maybe we can two-by-two | 22:51 |
| fungi | only down 25% capacity that way | 22:51 |
| fungi | do we need to remove them from the inventory to boot the replacements, or only after? that might simplify things | 22:52 |
| clarkb | need it for booting replacements | 22:53 |
| clarkb | launch node uses global inventory and is confused by name collisions | 22:53 |
| *** tkajinam has joined #openstack-infra | 22:57 | |
| *** xek has joined #openstack-infra | 22:58 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Improve SQL query performance in some cases https://review.opendev.org/672606 | 23:13 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Improve SQL query performance in some cases https://review.opendev.org/672606 | 23:14 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Improve SQL query performance in some cases https://review.opendev.org/672606 | 23:15 |
| openstackgerrit | James E. Blair proposed opendev/puppet-zuul master: Update to new zuul JS content url https://review.opendev.org/671852 | 23:18 |
| corvus | clarkb: checks came back okay; updated to https | 23:19 |
| corvus | should be gtg | 23:19 |
| clarkb | +2 | 23:22 |
| *** michael-beaver has quit IRC | 23:24 | |
| openstackgerrit | Ian Wienand proposed zuul/nodepool master: Enable debug logs for openstack-functional tests https://review.opendev.org/672412 | 23:28 |
| *** aaronsheffield has quit IRC | 23:30 | |
| *** rcernin has joined #openstack-infra | 23:30 | |
| ianw | clarkb: if you could take a look @ https://review.opendev.org/#/c/669939 to set the debug levels in nodepool jobs; i had a poke around yesterday as we ended up with about 3 ways doing ~ same thing :) | 23:31 |
| *** eernst has joined #openstack-infra | 23:34 | |
| clarkb | +3 | 23:36 |
| *** eernst has quit IRC | 23:36 | |
| *** eernst has joined #openstack-infra | 23:37 | |
| *** pkopec has quit IRC | 23:39 | |
| *** eernst has quit IRC | 23:41 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Enable nodepool debugging for functional tests https://review.opendev.org/672608 | 23:42 |
| *** rh-jelabarre has quit IRC | 23:43 | |
| *** mattw4 has quit IRC | 23:44 | |
| *** eernst has joined #openstack-infra | 23:45 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Enable nodepool debugging for functional tests https://review.opendev.org/672608 | 23:45 |
| *** eernst has quit IRC | 23:49 | |
| *** Frootloop has joined #openstack-infra | 23:55 | |
| *** diablo_rojo has quit IRC | 23:55 | |
| *** xek has quit IRC | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!