| opendevreview | Merged opendev/system-config master: base: restrict bastion login to bridge01.opendev.org https://review.opendev.org/c/opendev/system-config/+/862765 | 00:02 |
|---|---|---|
| opendevreview | Merged opendev/system-config master: Remove snapd from our servers https://review.opendev.org/c/opendev/system-config/+/862834 | 00:12 |
| opendevreview | Merged opendev/system-config master: Don't install phased package updates with apt https://review.opendev.org/c/opendev/system-config/+/862835 | 00:12 |
| ianw | just watching infra-prod-base which is running ^ now | 00:38 |
| ianw | ok, green again thankfully -> https://zuul.openstack.org/builds?job_name=infra-prod-base&project=opendev/system-config | 00:52 |
| *** rlandy|bbl is now known as rlandy|out | 01:09 | |
| opendevreview | Ian Wienand proposed opendev/system-config master: cloud-launcher: use venv with openstacksdk installed https://review.opendev.org/c/opendev/system-config/+/863473 | 04:10 |
| opendevreview | Ian Wienand proposed opendev/system-config master: Remove old bridge testing https://review.opendev.org/c/opendev/system-config/+/862766 | 04:10 |
| opendevreview | Merged opendev/system-config master: Remove old bridge testing https://review.opendev.org/c/opendev/system-config/+/862766 | 04:19 |
| *** yadnesh|away is now known as yadnesh | 04:31 | |
| opendevreview | Ian Wienand proposed opendev/system-config master: Revert "Update to tip of master in periodic jobs" https://review.opendev.org/c/opendev/system-config/+/862854 | 05:52 |
| opendevreview | Ian Wienand proposed opendev/system-config master: Reference bastion through prod_bastion group https://review.opendev.org/c/opendev/system-config/+/862845 | 05:52 |
| *** ysandeep|out is now known as ysandeep | 05:53 | |
| opendevreview | Jie Niu proposed openstack/project-config master: Apply cfn repository for code and storyboard https://review.opendev.org/c/openstack/project-config/+/863168 | 06:52 |
| *** jpena|off is now known as jpena | 08:25 | |
| jieniu | Hi, could some one help to review and approve my change? or who may i ask for review normally? https://review.opendev.org/c/openstack/project-config/+/863168 | 08:30 |
| *** rlandy|out is now known as rlandy | 10:38 | |
| *** ysandeep is now known as ysandeep|afk | 10:53 | |
| *** dviroel|holiday is now known as dviroel|rover | 11:19 | |
| *** ysandeep|afk is now known as ysandeep | 12:22 | |
| *** yadnesh is now known as yadnesh|afk | 12:26 | |
| *** ysandeep is now known as ysandeep|out | 13:44 | |
| *** yadnesh|afk is now known as yadnesh | 13:53 | |
| *** yadnesh is now known as yadnesh|away | 14:19 | |
| *** dasm|off is now known as dasm | 14:28 | |
| clarkb | corvus: the grafana graph for zk follower count is working again | 15:30 |
| *** dviroel|rover is now known as dviroel|afk | 15:50 | |
| corvus | clarkb: w00t | 16:09 |
| *** marios is now known as marios|out | 16:39 | |
| clarkb | I've been asked to rebase my pip cache change on top of main with the theory that will make it mergeable (pass checks) | 16:48 |
| clarkb | I've done so and maybe the fix will get into the next release. | 16:48 |
| *** dviroel|afk is now known as dviroel|rover | 16:56 | |
| *** jpena is now known as jpena|off | 17:22 | |
| *** gibi is now known as gibi_pto | 19:15 | |
| ianw | clarkb: if you're around https://review.opendev.org/c/opendev/system-config/+/863473 was one i found yesterday, where putting ansible in venv on bridge meant service-bridge doesn't have openstacksdk. that uses ansible_python_interpreter to point it at the ansible venv for cloud launhcing purposes | 19:56 |
| clarkb | ianw: ya I've been taking a look at https://review.opendev.org/c/opendev/system-config/+/862854/ and the rest of that stack again and I'm worried opendev-infra-prod-setup-src is where we're moving the project-config updates but that job doesn't seem to be used anywhere: https://codesearch.opendev.org/?q=opendev-infra-prod-setup-src&i=nope&literal=nope&files=&excludeFiles=&repos= I | 20:00 |
| clarkb | think it might not be correct to move the project config checkouts as that stack does | 20:00 |
| clarkb | ianw: can you double check that? Basically we move the project-config stuff out of system-config and into base-jobs but the base-jobs side is in a base job that doesn't have any children? | 20:01 |
| *** arxcruz|ruck is now known as arxcruz | 20:05 | |
| corvus | i'm going to restart zuul-web | 20:06 |
| corvus | 01 is restarting now | 20:08 |
| corvus | up; restarting 02 now | 20:10 |
| corvus | web app looks good now. note: reload may be required | 20:11 |
| clarkb | yup errors load now after a refresh | 20:12 |
| corvus | 02 is up | 20:14 |
| corvus | #status log restarted zuul-web on current master to pick up bugfixes | 20:15 |
| opendevstatus | corvus: finished logging | 20:15 |
| fungi | JayF: ^ | 20:22 |
| fungi | issue you pointed out is addressed | 20:23 |
| JayF | woo, thanks | 20:23 |
| JayF | what a fast turnaround | 20:23 |
| fungi | there's something to be said for continuous deployment | 20:24 |
| clarkb | we also upgraded zookeeper through two versions yesterday and I don't think anyone noticed :) | 20:25 |
| JayF | I brought back a wayward lion and there was nobody around to thank me; that makes sense now, thanks! | 20:26 |
| fungi | i caught the tail end of that process, quite awesome. thanks for upgrading! | 20:26 |
| opendevreview | Gage Hugo proposed opendev/irc-meetings master: Change openstack-helm meeting frequency to monthly https://review.opendev.org/c/opendev/irc-meetings/+/863557 | 20:26 |
| clarkb | I think it is really neat that we're able to run zuul like this now. It was a long time coming and definitely reduces the impact people notice | 20:28 |
| opendevreview | Merged opendev/irc-meetings master: Change openstack-helm meeting frequency to monthly https://review.opendev.org/c/opendev/irc-meetings/+/863557 | 20:38 |
| ianw | clarkb: yeah, sorry i think that opendev-infra-prod-setup-src has snuck in as part of the parallelism work, but has not been completed yet | 21:06 |
| ianw | the idea is that when we want the jobs to run in parallel, they all need to depend on that job. it runs first and sets up the source that all the production jobs then use; so they don't try to update over the top of each other | 21:07 |
| clarkb | oh right | 21:07 |
| ianw | but currently, that gets pulled in via the pre.yaml playbook | 21:07 |
| ianw | https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/infra-prod/pre.yaml#L5 | 21:07 |
| clarkb | ianw: so maybe we need to rebase that stack and put the top at the bottom and come back to the reorg of jobs after? | 21:07 |
| clarkb | oh wait I see | 21:08 |
| clarkb | the plain pre.yaml is including that but we split it out explicitly in the future job bit you are talking about | 21:08 |
| clarkb | so that means we do run that playbook in every job today? | 21:08 |
| ianw | yes, currently they run one-by-one and each runs that at the start of the job. which is fine as they never try updating anything over a running job | 21:09 |
| clarkb | got it | 21:10 |
| clarkb | give me a few and I'll update my reviews | 21:10 |
| ianw | this is the change that we havne't merged that finalises that split --> https://review.opendev.org/c/opendev/system-config/+/820651 | 21:11 |
| ianw | sorry really it's parent https://review.opendev.org/c/opendev/system-config/+/820320/4 | 21:12 |
| ianw | i'll have to context switch that back in and remerge it -- but i think the complication there might have been the root rsa key bits of the bootstrap -- something we worked around recently | 21:12 |
| clarkb | ianw: re the group change which I'm about to properly do review for, I think before landing that we should put bridge.openstack.org in the emergency file on bridge01.opendev.org. This was it won't reenable the zuul reboot cron job | 21:25 |
| clarkb | then we can sort out how to handle making that cron job a singleton in a followup? | 21:26 |
| clarkb | I expect that might not be striaghtforward so don't want to hold back landing your change on it. I think adding the old host to the emergency file is sufficient? | 21:26 |
| ianw | ++ -- the other option is probably to drop it from the inventory file now | 21:26 |
| ianw | going back through the history -- https://review.opendev.org/c/opendev/system-config/+/820250 was the revert of the changes that tried to make things checkout the sources once | 21:28 |
| ianw | after all that failed the work kind of got put on the backburner | 21:28 |
| clarkb | ianw: ya removing it from the inventory would do it too. we'd need that in the same change or stacked under though | 21:29 |
| clarkb | otherwise landing the change will undo my commented out cronjob | 21:29 |
| clarkb | oh wait nevermind this may be fine because the node is bridge.openstack.org and we only match bridge.opendev.org in the gorup with that change | 21:30 |
| clarkb | ianw: should also update setup-keys.yaml in base-jobs for consistency? (I don't think it actually uses the group there though so maybe we can drop the group entirely?) | 21:32 |
| opendevreview | Ian Wienand proposed opendev/system-config master: Remove bridge.openstack.org https://review.opendev.org/c/opendev/system-config/+/863564 | 21:32 |
| ianw | clarkb: yeah, we can drop the group there indeed | 21:33 |
| clarkb | ianw: I think I found a bug in 862845. But it makes sense overall | 21:42 |
| *** benj_70 is now known as benj_7 | 21:43 | |
| ianw | clarkb: thanks, looking | 22:09 |
| ianw | i'm not sure why i don't use add-bastion-host in run-production-bootstrap-bridge | 22:14 |
| opendevreview | Ian Wienand proposed opendev/base-jobs master: infra-prod: use prod_bastion group https://review.opendev.org/c/opendev/base-jobs/+/863566 | 22:26 |
| *** dviroel|rover is now known as dviroel|afk | 22:29 | |
| opendevreview | Ian Wienand proposed opendev/system-config master: Reference bastion through prod_bastion group https://review.opendev.org/c/opendev/system-config/+/862845 | 22:35 |
| opendevreview | Ian Wienand proposed opendev/system-config master: run-production-bootstrap-bridge: use add-bastion-host https://review.opendev.org/c/opendev/system-config/+/863567 | 22:35 |
| opendevreview | Ian Wienand proposed opendev/system-config master: zuul reboot: pin to bridge01.opendev.org https://review.opendev.org/c/opendev/system-config/+/863568 | 22:35 |
| ianw | doh i think i rebased that unnecessarily :/ | 22:35 |
| *** dasm is now known as dasm|off | 22:58 | |
| *** rlandy is now known as rlandy|PTO | 23:33 | |
| opendevreview | Ian Wienand proposed opendev/system-config master: infra-prod: setup system-config on bridge in bootstrap job https://review.opendev.org/c/opendev/system-config/+/820320 | 23:38 |
| opendevreview | Ian Wienand proposed opendev/system-config master: infra-prod-base: parent to infra-prod-setup-keys https://review.opendev.org/c/opendev/system-config/+/820651 | 23:38 |
| ianw | clarkb: ^ i'm actually now pretty convinced that this bridge abstraction work has actually helped lay a foundation for 820320 above, which is basically having all our prod jobs run in parallel as soon as we want to drop the semaphore | 23:39 |
| clarkb | I'll have to page all of that back in | 23:41 |
| clarkb | ianw: if you have time for https://review.opendev.org/c/zuul/zuul-jobs/+/863098 landing that will allow us to land https://review.opendev.org/c/opendev/zone-opendev.org/+/862941 | 23:42 |
| opendevreview | Ian Wienand proposed opendev/system-config master: infra-prod: setup system-config on bridge in bootstrap job https://review.opendev.org/c/opendev/system-config/+/820320 | 23:44 |
| opendevreview | Ian Wienand proposed opendev/system-config master: infra-prod-base: parent to infra-prod-setup-keys https://review.opendev.org/c/opendev/system-config/+/820651 | 23:44 |
| opendevreview | Merged zuul/zuul-jobs master: Fix check zone role for Jammy https://review.opendev.org/c/zuul/zuul-jobs/+/863098 | 23:51 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!