| *** mlavalle has quit IRC | 00:22 | |
| openstackgerrit | Merged opendev/system-config master: ask.openstack.org static site https://review.opendev.org/c/opendev/system-config/+/792789 | 01:05 |
|---|---|---|
| *** stevebaker has quit IRC | 02:45 | |
| clarkb | fwiw storyboard seems to have a happy cert now | 02:47 |
| clarkb | I'll followup with translate tomorrow | 02:47 |
| clarkb | hrm storyboard actually seems to be serving me both certs. May need to more forcefully restart apache. But again tomorrow :) | 02:49 |
| corvus | i got an le cert | 02:50 |
| clarkb | corvus: ya I refreshed and got the old one | 02:51 |
| clarkb | it happens when the apache reload doesn't force all the children to die and respawn | 02:51 |
| clarkb | doing a restart of apache clears it up usually | 02:51 |
| corvus | yep | 02:52 |
| *** stevebaker has joined #opendev | 03:07 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use containers for functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/791888 | 03:29 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use containers for functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/791888 | 03:35 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use containers for functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/791888 | 03:42 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use containers for functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/791888 | 03:46 |
| *** ykarel has joined #opendev | 04:01 | |
| *** ysandeep|away is now known as ysandeep|ruck | 04:04 | |
| prometheanfire | freenode is hijacking the old gentoo channels, so... | 04:20 |
| prometheanfire | hmm, can I move a openstack projects channel to another network? | 04:21 |
| prometheanfire | asking for a... friend | 04:22 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove octvia-v1-dsvm-* jobs https://review.opendev.org/c/openstack/diskimage-builder/+/793096 | 04:23 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use containers for functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/791888 | 04:29 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Do not uninstall non-installed packages https://review.opendev.org/c/openstack/diskimage-builder/+/793097 | 04:34 |
| *** ykarel has quit IRC | 04:41 | |
| *** ykarel has joined #opendev | 04:42 | |
| *** ykarel is now known as ykarel|afk | 04:48 | |
| *** ykarel|afk is now known as ykarel | 04:57 | |
| frickler | prometheanfire: didn't gentoo move to libera? also, did you see http://lists.opendev.org/pipermail/service-discuss/2021-May/000236.html ? | 04:57 |
| frickler | prometheanfire: other than that, each project is free to move their channel anywhere they want, but we can only run our service bots in one network. we are preparing to move those to oftc, but no decision has yet been made afaict | 05:01 |
| prometheanfire | we did | 05:03 |
| prometheanfire | freenode decided to take over some of our channels after we mentioned the move in our /topic | 05:03 |
| prometheanfire | oftc is ok, maybe not what I would have personally chosen, but I've been there before :P | 05:04 |
| *** marios has joined #opendev | 05:05 | |
| frickler | freenode taking over old channels is a known "issue", one of the reasons to motivate a fast move IMO. just happened for #systemd, too | 05:06 |
| prometheanfire | heheheh, I mean it's really unfortunate how deep they steped in it | 05:08 |
| prometheanfire | like watching a train wreck | 05:08 |
| frickler | oh, and also ubuntu it seems | 05:08 |
| prometheanfire | we had a june 14th date for our deadline, I feel like we will be pushing that up now | 05:09 |
| *** ralonsoh has joined #opendev | 05:10 | |
| *** ykarel is now known as ykarel|afk | 05:17 | |
| *** sboyron has joined #opendev | 05:27 | |
| *** ykarel|afk is now known as ykarel | 05:34 | |
| *** slaweq has joined #opendev | 05:42 | |
| *** fressi has joined #opendev | 05:58 | |
| *** fressi has joined #opendev | 06:09 | |
| *** ysandeep|ruck is now known as ysandeep|brb | 06:28 | |
| *** timburke has quit IRC | 06:38 | |
| *** ysandeep|brb is now known as ysandeep|ruck | 06:45 | |
| *** redrobot8 has joined #opendev | 06:49 | |
| paladox | Freenode is taking control of channels that mention libera lol | 06:50 |
| *** redrobot has quit IRC | 06:50 | |
| *** redrobot8 is now known as redrobot | 06:50 | |
| ianw | #status log ask.openstack.org retired and redirected to static site | 06:54 |
| openstackstatus | ianw: finished logging | 06:55 |
| ianw | i'll shut down ask01.openstack.org and make a note to remove it in a week or so in case of any last minute thoughts | 06:55 |
| ianw | vale ask.openstack.org | 06:55 |
| *** vishalmanchanda has joined #opendev | 07:00 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use containers for functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/791888 | 07:02 |
| *** redrobot8 has joined #opendev | 07:05 | |
| *** redrobot has quit IRC | 07:06 | |
| *** redrobot8 is now known as redrobot | 07:06 | |
| *** whoami-rajat has quit IRC | 07:09 | |
| *** amoralej|off is now known as amoralej | 07:14 | |
| *** andrewbonney has joined #opendev | 07:14 | |
| *** tosky has joined #opendev | 07:35 | |
| *** gnuoy has quit IRC | 07:39 | |
| *** gnuoy has joined #opendev | 07:40 | |
| *** rpittau|afk is now known as rpittau | 07:41 | |
| paladox | https://github.com/freenode/web-7.0/commit/904fbdc8c8b21ab88c36170795ad6d624b661147 they are calling people who move “mentally ill” | 07:46 |
| *** gnuoy has quit IRC | 07:48 | |
| *** gnuoy has joined #opendev | 07:49 | |
| *** sshnaidm is now known as sshnaidm|afk | 07:58 | |
| *** jpena|off is now known as jpena | 08:01 | |
| *** lucasagomes has joined #opendev | 08:03 | |
| mnasiadka | Morning - can anybody look at zuul jobs for 792999,2? one job is hanging in queued state for over 1h30m | 08:52 |
| *** ykarel is now known as ykarel|lunch | 08:53 | |
| *** dtantsur|afk is now known as dtantsur | 08:56 | |
| *** stephenfin has joined #opendev | 08:58 | |
| *** lourot has quit IRC | 09:01 | |
| *** lourot has joined #opendev | 09:02 | |
| *** hashar has joined #opendev | 09:05 | |
| *** fressi has quit IRC | 09:16 | |
| *** fressi has joined #opendev | 09:17 | |
| *** ykarel|lunch is now known as ykarel | 09:33 | |
| *** logan- has quit IRC | 09:46 | |
| *** logan- has joined #opendev | 09:56 | |
| *** fressi has quit IRC | 10:03 | |
| jonher | paladox yeah.. they are basically refering to "policy" but there is no policy against mentioning that you moved to another network in case people are running old verions with old irc info. it feels like censorship at this point, and they are not adressing questions about it in #freenode and set it to +z so people can't talk about it openly | 10:06 |
| jonher | no matter the "fight" that led to this, this is not good and makes me want to leave freenode but not the openstack community | 10:07 |
| tosky | johnsom: totally correct, just one thing: #freenode iirc has always been set to let only moderator can read all messages | 10:13 |
| yoctozepto | infra-root: would it be possible to touch https://zuul.opendev.org/t/openstack/status#792999 as it has not run one job at all | 10:18 |
| jonher | tosky: there was activity there before i think, and today when i re-joined i noticed a op saying: "<@eskimo> oh this chan is still +z lol" so i think that suggest it is not usually on, but idk about that part, i'm just upset about the "censorship" and unwritten policies being applied regardless of the previous issues | 10:20 |
| *** fressi has joined #opendev | 10:22 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:25 | |
| *** fressi has quit IRC | 10:32 | |
| *** akurbatov has joined #opendev | 10:43 | |
| *** parallax has left #opendev | 10:51 | |
| *** fressi has joined #opendev | 11:22 | |
| *** jpena is now known as jpena|lunch | 11:35 | |
| yoctozepto | infra-root config-core http://lists.openstack.org/pipermail/openstack-discuss/2021-May/022703.html please feel very welcome to join TC today at 14:30 UTC | 11:48 |
| *** ysandeep|ruck is now known as ysandeep|mtg | 11:57 | |
| *** fressi has quit IRC | 12:12 | |
| *** fressi has joined #opendev | 12:23 | |
| *** jpena|lunch is now known as jpena | 12:24 | |
| *** ysandeep|mtg is now known as ysandeep|ruck | 12:33 | |
| *** fressi has quit IRC | 12:45 | |
| fungi | #status log Restarted the nodepool launcher container on nl02 in order to free stuck node request locks | 12:46 |
| openstackstatus | fungi: finished logging | 12:46 |
| fungi | yoctozepto: it's got a node assignment now | 12:46 |
| fungi | there were a few other changes in a similar situation and they all seem to be progressing now | 12:49 |
| *** arxcruz|rover has quit IRC | 12:50 | |
| *** arxcruz has joined #opendev | 12:51 | |
| *** mattmceuen has quit IRC | 12:52 | |
| *** mattmceuen has joined #opendev | 12:54 | |
| *** fressi has joined #opendev | 12:56 | |
| *** rm_work has quit IRC | 12:56 | |
| *** rm_work has joined #opendev | 12:56 | |
| *** sourav has joined #opendev | 13:02 | |
| sourav | hello anyone | 13:02 |
| sourav | alive? | 13:02 |
| *** sourav has left #opendev | 13:04 | |
| *** dmsimard has quit IRC | 13:06 | |
| yoctozepto | fungi: thanks | 13:07 |
| fungi | any time | 13:07 |
| *** dmsimard has joined #opendev | 13:07 | |
| *** dmsimard has quit IRC | 13:17 | |
| *** dmsimard has joined #opendev | 13:39 | |
| *** fressi has quit IRC | 13:55 | |
| ysandeep|ruck | #opendev we are noticing some jobs failing due to network related issues.. | 13:57 |
| ysandeep|ruck | for example: https://99e02e92a26472cf4bfd-76db863cb86d059bc445c2f80e5d4947.ssl.cf5.rackcdn.com/772571/26/check/tripleo-ci-centos-8-containers-multinode-ussuri/4503771/job-output.txt | 13:57 |
| ysandeep|ruck | Failed to establish a new connection: [Errno 101] Network is unreachable',)) | 13:57 |
| ysandeep|ruck | another example: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_cc8/793145/2/check/tripleo-ci-centos-8-content-provider/cc8dbe8/logs/undercloud/home/zuul/repo_setup.log | 13:58 |
| ysandeep|ruck | Error: Failed to download metadata for repo 'centos-8-fix': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried | 13:58 |
| ysandeep|ruck | Many jobs in post_failure too. | 13:59 |
| *** whoami-rajat_ has joined #opendev | 13:59 | |
| *** SpamapS has quit IRC | 14:01 | |
| fungi | ysandeep|ruck: i'm about to head to an appointment but can take a look when i get back if nobody else beats me to it. do they seem to be primarily in a particular provider? | 14:07 |
| ysandeep|ruck | fungi, i found in 2 provider already limestone and gra1.ovh | 14:08 |
| ysandeep|ruck | http://mirror.gra1.ovh.opendev.org/epel/7/x86_64/repodata/repomd.xml [Could not resolve host: mirror.gra1.ovh.opendev.org] | 14:08 |
| fungi | unfortunately the log urls lack a lot of the build metadata, it would help if you linked to the build report instead so we don't have to dig the build uuid out of the inventory and construct the build url ourselves | 14:08 |
| ysandeep|ruck | Timeout was reached for http://mirror.regionone.limestone.opendev.org:8080/rdo/centos8-master/deps/c8-fix/repodata/repomd.xml [Operation too slow. Less than 1000 bytes/sec transferred the last 30 | 14:08 |
| ysandeep|ruck | ack o/ | 14:10 |
| ysandeep|ruck | fungi, i will share the build report once zuul reports back | 14:11 |
| *** tkajinam has quit IRC | 14:12 | |
| *** tkajinam has joined #opendev | 14:12 | |
| fungi | thanks! | 14:14 |
| ysandeep|ruck | also too many jobs hitting post_failure.. https://zuul.openstack.org/builds?result=post_failure logs not available. | 14:14 |
| fungi | infra-root: ^ if someone has time to look before i get done with my errands | 14:16 |
| *** tristanC has left #opendev | 14:22 | |
| *** JayF has quit IRC | 14:30 | |
| *** ykarel has quit IRC | 14:32 | |
| *** ykarel has joined #opendev | 14:32 | |
| clarkb | The post failurse look like issues hitting ovh keystone. I can hit it from here currently. I think we wait on that and see if it persists | 14:40 |
| clarkb | if it persists or gets worse we can pull ovh swift from log destinations | 14:40 |
| clarkb | ysandeep|ruck: for the other issues they all look similar but different and in different clouds. For example I can currently hit http://mirror.regionone.limestone.opendev.org:8080/rdo/centos8-master/deps/c8-fix/repodata/repomd.xml from here (note you can always test that yourself too to see if it is persistent) | 14:41 |
| clarkb | ysandeep|ruck: for the upper constraints fetch why are your jobs not using the repo in zuul? | 14:42 |
| clarkb | ysandeep|ruck: https://gitea0X.opendev.org:3081/openstack/requirements/raw/branch/stable/ussuri/upper-constraints.txt is also accessible for values of X 1-8. These are our backends for opendev.org | 14:43 |
| * ysandeep|ruck in a mtg currently, will ping back shortly | 14:44 | |
| clarkb | ysandeep|ruck: in general the internet is known to be flaky and that is why we suggest jobs rely on local resources as much as possible. This includes using constraints from the local openstack/requirements repo | 14:44 |
| clarkb | infra-root all of the storyboard apache processes seem recent now so I guess apache aged them out automatically | 14:47 |
| clarkb | I have approved the translate LE switch change | 14:50 |
| * ysandeep|ruck back | 14:52 | |
| ysandeep|ruck | clarkb, thanks for looking, yes i can also hit http://mirror.regionone.limestone.opendev.org:8080/rdo/centos8-master/deps/c8-fix/repodata/repomd.xml and https://gitea0X.opendev.org:3081/openstack/requirements/raw/branch/stable/ussuri/upper-constraints.txt locally, so it was just a transient network issue. | 14:53 |
| clarkb | ysandeep|ruck: basically all of those look like similar but different the internet is unreliable issues. If they persist we can dig in further but as is its hard to say anything actually went wrong on our end. repomd.xml being too slow could be the backend we proxy to. the post failures were an issue with ovh keystone that seems to be working now and so on | 14:54 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Update certcheck additional domains https://review.opendev.org/c/opendev/system-config/+/793193 | 14:54 |
| clarkb | if they persist then we can dig in further and see if we need to mitigate or report upstream etc | 14:55 |
| *** noonedeadpunk_ has joined #opendev | 14:55 | |
| ysandeep|ruck | clarkb, thanks for recommendation around using constraints from the local openstack/requirements repo. I will discuss about moving to this/ instead of pulling over network within tripleo-ci team. | 14:55 |
| ysandeep|ruck | clarkb, we will report here if too many jobs hit the network issue/ if issue persists. | 14:57 |
| ysandeep|ruck | clarkb++ fungi++ | 14:57 |
| openstackgerrit | Merged opendev/system-config master: Switch translate to LE cert https://review.opendev.org/c/opendev/system-config/+/792855 | 15:09 |
| *** dmellado has quit IRC | 15:14 | |
| *** gibi has quit IRC | 15:15 | |
| *** gibi has joined #opendev | 15:15 | |
| *** dmellado has joined #opendev | 15:15 | |
| *** gibi has quit IRC | 15:18 | |
| *** gibi has joined #opendev | 15:18 | |
| *** mlavalle has joined #opendev | 15:20 | |
| fungi | clarkb: catching up, but was it timeouts or error responses from ovh keystone? if the latter (which we see for brief periods occasionally) there's usually a ticket listed for it on their service status site | 15:25 |
| clarkb | fungi: I think it was a timeout establishign a tcp connection | 15:26 |
| *** ykarel is now known as ykarel|away | 15:26 | |
| fungi | ahh, okay. from where? could it be a recurrence of the cogent routing problems we saw with vexxhost a few days ago? | 15:27 |
| clarkb | fungi: ze04 was one of the nodes. that is rax dfw | 15:27 |
| clarkb | I suppose of cogent is between ovh and rax then ya its possible | 15:28 |
| clarkb | and might explain some of the other networking issues we saw | 15:28 |
| *** ysandeep|ruck is now known as ysandeep|away | 15:28 | |
| *** ykarel|away has quit IRC | 15:32 | |
| fungi | nah, i didn't even see rax traverse cogent to reach vexxhost, i don't think they peer with them | 15:32 |
| fungi | i suppose it's possible we might transit cogent between rax's backbone peers and ovh's, but i think we wind up going through zayo and abovenet | 15:34 |
| fungi | i'd have to do some traceroutes to confirm | 15:34 |
| clarkb | could be a blip in another provider that ovh and rax peer with | 15:36 |
| clarkb | we saw other similar connection type issues in the jobs too (hitting things like the proxy caches) | 15:36 |
| clarkb | fungi: https://review.opendev.org/c/opendev/system-config/+/793193/1 is an easy followup after we LE'd some services. I'm going to look at openstackid next too | 15:38 |
| fungi | thanks | 15:39 |
| *** marios has quit IRC | 15:45 | |
| *** dhellmann has quit IRC | 15:52 | |
| *** dhellmann has joined #opendev | 15:58 | |
| *** Ramereth has quit IRC | 16:01 | |
| *** dhellmann has quit IRC | 16:01 | |
| *** dhellmann has joined #opendev | 16:02 | |
| *** rpittau is now known as rpittau|afk | 16:03 | |
| *** lucasagomes has quit IRC | 16:03 | |
| *** ykarel|away has joined #opendev | 16:10 | |
| *** ykarel|away has quit IRC | 16:22 | |
| *** Jeffrey4l has quit IRC | 16:25 | |
| *** Jeffrey4l has joined #opendev | 16:26 | |
| *** timburke has joined #opendev | 16:28 | |
| *** tobiash has joined #opendev | 16:41 | |
| *** ralonsoh has quit IRC | 16:42 | |
| *** AJaeger has joined #opendev | 16:44 | |
| *** AJaeger has quit IRC | 16:46 | |
| *** AJaeger has joined #opendev | 16:47 | |
| *** AJaeger has quit IRC | 16:47 | |
| *** AJaeger has joined #opendev | 16:48 | |
| *** AJaeger has quit IRC | 16:51 | |
| *** lourot has quit IRC | 16:55 | |
| *** lourot has joined #opendev | 16:55 | |
| openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Switch the IRC access check to OFTC https://review.opendev.org/c/openstack/project-config/+/792843 | 16:56 |
| openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Revert "Accessbot OFTC channel list stopgap" https://review.opendev.org/c/openstack/project-config/+/792857 | 16:56 |
| *** lourot has quit IRC | 17:04 | |
| *** lourot has joined #opendev | 17:05 | |
| *** jpena is now known as jpena|off | 17:05 | |
| *** AJaeger has joined #opendev | 17:07 | |
| *** AJaeger has quit IRC | 17:07 | |
| *** lourot has quit IRC | 17:09 | |
| *** lourot has joined #opendev | 17:09 | |
| *** avass has quit IRC | 17:10 | |
| *** fdegir has quit IRC | 17:23 | |
| *** amotoki has quit IRC | 17:23 | |
| *** felixedel has quit IRC | 17:24 | |
| *** mhu has quit IRC | 17:24 | |
| *** fdegir8 has joined #opendev | 17:25 | |
| *** ianw_ has joined #opendev | 17:25 | |
| *** smcginni1 has quit IRC | 17:25 | |
| *** felixedel has joined #opendev | 17:25 | |
| *** ianw has quit IRC | 17:25 | |
| *** ianw_ is now known as ianw | 17:25 | |
| *** smcginnis has joined #opendev | 17:26 | |
| *** amotoki has joined #opendev | 17:30 | |
| openstackgerrit | Jeremy Stanley proposed opendev/system-config master: Retool accessbot for OFTC https://review.opendev.org/c/opendev/system-config/+/793062 | 17:33 |
| fungi | that's ^ coming along but i'm still trying to wrap my head around specifically how to integrate per-channel admins and ops | 17:33 |
| *** dhellmann has quit IRC | 17:40 | |
| *** dhellmann has joined #opendev | 17:41 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Remove AJaeger from accessbot https://review.opendev.org/c/openstack/project-config/+/793213 | 17:41 |
| *** cgoncalves has quit IRC | 17:42 | |
| openstackgerrit | Andreas Jaeger proposed opendev/system-config master: Remove AJaeger from statusbot https://review.opendev.org/c/opendev/system-config/+/793214 | 17:43 |
| *** irclogbot_1 has quit IRC | 17:43 | |
| *** cgoncalves has joined #opendev | 17:43 | |
| *** irclogbot_0 has joined #opendev | 17:47 | |
| *** openstack has quit IRC | 18:09 | |
| *** openstack has joined #opendev | 18:10 | |
| *** ChanServ sets mode: +o openstack | 18:10 | |
| *** dhellmann has quit IRC | 18:16 | |
| *** vishalmanchanda has quit IRC | 18:33 | |
| openstackgerrit | Merged opendev/system-config master: Remove AJaeger from statusbot https://review.opendev.org/c/opendev/system-config/+/793214 | 18:34 |
| frickler | fungi: not sure if you looked into the failures for your oftc patch yet, those seem unrelated to me, looks like a regression with the latest pbr meeting older python https://zuul.opendev.org/t/openstack/build/c0a17b38c77649f5b6a57b10351b84b9/console | 18:38 |
| fungi | frickler: neat, no i haven't yet, thanks for checking in on it | 18:38 |
| *** dmellado has quit IRC | 18:39 | |
| fungi | i saw 793213 failed project-config-irc-access as well and that change should have been basically non-impacting | 18:39 |
| *** dmellado has joined #opendev | 18:39 | |
| fungi | so some external change seems likely | 18:40 |
| frickler | fungi: the latter is a different thing: 'openstackinfra does not have permissions on #rdo' | 18:40 |
| fungi | neat, i wonder why that's suddenly a problem on freenode | 18:41 |
| frickler | because freenode admins took over the channel, I'd assume | 18:41 |
| fungi | ahh, fun. yeah i guess we need to clean it out of our config for now | 18:42 |
| fungi | (that'll mean yet still more rebases for my wip stack on project-config, but c'est la vie) | 18:43 |
| frickler | oh, they are even listed in the error https://zuul.opendev.org/t/openstack/build/b67bff8d1da24828a7d4e0fba6644203/log/job-output.txt#909-914 | 18:43 |
| frickler | maybe if we don't manage to move fast, just disable this check until we're on the other side | 18:44 |
| fungi | well, my wip stack also removes #rdo because they registered it separately some time ago on oftc so our opendevaccess account doesn't have master role on it there yet either. i have a followup task to get with their current channel admins to add us | 18:45 |
| clarkb | fungi: we probably shouldn't be managing their IRC channels anyway? | 18:46 |
| fungi | channels in a similar state are #edeploy, #openstack-sahara and #puppet-openstack | 18:46 |
| fungi | though that's probably an easy set of tasks for some other volunteers to take up (look at the current access lists for those and try to get their admins to add opendevaccess with master access) | 18:47 |
| fungi | if they get fixed before this weekend we can stop removing them in 792842 and also take them out of the revert of that in 792857 | 18:48 |
| fungi | clarkb: i think we were previously managing #rdo because they wanted our gerritbot and maybe also meetbot functionality in there | 18:49 |
| fungi | (possibly statusbot as well) | 18:49 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Remove AJaeger from accessbot https://review.opendev.org/c/openstack/project-config/+/793213 | 18:49 |
| clarkb | I see | 18:50 |
| frickler | humm, the one I thing I missed to save from zuul01 is my bash history which I used to lookup the details of how to submit a hold ;-S | 18:52 |
| frickler | but that's likely to be some docker invocation now anyway, right? | 18:54 |
| frickler | "sudo docker exec -it zuul-scheduler_scheduler_1 zuul autohold-list --tenant openstack" seems to work | 18:55 |
| frickler | although it's weird that I need to specify a tenant and the result still lists multiple tenants | 18:57 |
| fungi | frickler: perhaps easier, `sudo docker-compose exec zuul-scheduler zuul autohold-list --tenant openstack` | 18:58 |
| frickler | fungi: ah, yes, that's a bit simpler. anyway, holding a node for looking at the pbr failures now, not sure if I'll still do it today, though | 19:01 |
| fungi | frickler: also we'll probably soon have a `zuul` wrapper which calls `docker-compose exec zuul-scheduler zuul $@` but long term using zuul-client may make more sense (can it do autoholds already?) | 19:04 |
| *** whoami-rajat_ has quit IRC | 19:09 | |
| *** iurygregory has quit IRC | 19:10 | |
| *** iurygregory has joined #opendev | 19:10 | |
| *** iurygregory has quit IRC | 19:11 | |
| *** andrewbonney has quit IRC | 19:11 | |
| *** iurygregory has joined #opendev | 19:12 | |
| *** akurbatov has quit IRC | 19:20 | |
| *** avass has joined #opendev | 19:21 | |
| *** fdegir8 is now known as fdegir | 19:29 | |
| *** sboyron has quit IRC | 19:36 | |
| clarkb | the openstackid LE stuff is a bit more involved. And I'm juggling new computer fun, but will try to get patches up today | 19:46 |
| *** dhellmann has joined #opendev | 19:49 | |
| *** openstackstatus has quit IRC | 19:50 | |
| *** openstackstatus has joined #opendev | 19:50 | |
| *** ChanServ sets mode: +v openstackstatus | 19:50 | |
| *** hashar has quit IRC | 20:00 | |
| *** hamalq has joined #opendev | 20:12 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Provision LE certs for openstackid.org https://review.opendev.org/c/opendev/system-config/+/793235 | 20:28 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Switch openstackid to LE certs https://review.opendev.org/c/opendev/system-config/+/793236 | 20:28 |
| clarkb | I need to update dns befor we can land those ^ doing that now | 20:28 |
| *** slaweq has quit IRC | 20:34 | |
| clarkb | ianw: ^ you've currently got the secrets file open which effectively locks it, any chacen you can stop that process? | 20:34 |
| *** guilhermesp has quit IRC | 20:36 | |
| *** slaweq has joined #opendev | 20:37 | |
| *** guilhermesp has joined #opendev | 20:37 | |
| *** dmellado has quit IRC | 20:37 | |
| *** slaweq has quit IRC | 20:37 | |
| *** dmellado has joined #opendev | 20:38 | |
| *** slaweq has joined #opendev | 20:38 | |
| *** slaweq has quit IRC | 20:40 | |
| *** slaweq has joined #opendev | 20:40 | |
| *** slaweq has quit IRC | 20:41 | |
| *** slaweq has joined #opendev | 20:42 | |
| *** hamalq has quit IRC | 20:45 | |
| *** hamalq has joined #opendev | 20:45 | |
| *** hashar has joined #opendev | 20:46 | |
| *** hashar has quit IRC | 20:46 | |
| *** slaweq has quit IRC | 20:49 | |
| *** slaweq has joined #opendev | 20:50 | |
| *** mkowalski has left #opendev | 20:50 | |
| *** tobiash_ has joined #opendev | 20:51 | |
| *** openstack has joined #opendev | 21:25 | |
| *** ChanServ sets mode: +o openstack | 21:25 | |
| *** slaweq_ has joined #opendev | 21:29 | |
| *** slaweq has quit IRC | 21:31 | |
| *** slaweq_ has quit IRC | 21:33 | |
| *** slaweq has joined #opendev | 21:34 | |
| *** slaweq has quit IRC | 21:35 | |
| *** slaweq has joined #opendev | 21:39 | |
| *** slaweq has quit IRC | 21:41 | |
| *** slaweq has joined #opendev | 21:42 | |
| *** amotoki has quit IRC | 21:43 | |
| *** melwitt has quit IRC | 21:51 | |
| *** melwitt has joined #opendev | 21:51 | |
| *** amotoki has joined #opendev | 21:52 | |
| *** stevebaker has quit IRC | 22:01 | |
| ianw | clarkb: sorry! accidentally left the window open when i fiddle the ask.openstack.org dns yesterday | 22:13 |
| *** melwitt has quit IRC | 22:14 | |
| *** melwitt has joined #opendev | 22:14 | |
| clarkb | thanks! I will go update openstackid dns momentarily | 22:19 |
| clarkb | infra-root ok DNS records for https://review.opendev.org/c/opendev/system-config/+/793235 should be in place now | 22:23 |
| clarkb | ianw: https://review.opendev.org/c/opendev/system-config/+/793239 and https://review.opendev.org/c/opendev/system-config/+/793193 are easy reviews. The openstackid LE changes are up now too. I'm happy to approve those tomorrow after they have had some review and can be monitored | 22:41 |
| *** timburke_ has joined #opendev | 22:54 | |
| *** timburke has quit IRC | 22:56 | |
| *** hamalq has quit IRC | 22:58 | |
| *** tosky has quit IRC | 22:58 | |
| *** hamalq has joined #opendev | 22:58 | |
| *** timburke_ is now known as timburke | 23:00 | |
| ianw | lgtm, thanks! be nice to have that additional domains list empty! :) | 23:06 |
| *** hamalq has quit IRC | 23:30 | |
| *** hamalq has joined #opendev | 23:30 | |
| openstackgerrit | Merged opendev/system-config master: Stop testing nodepool when puppet changes https://review.opendev.org/c/opendev/system-config/+/793239 | 23:34 |
| openstackgerrit | Merged opendev/system-config master: Update certcheck additional domains https://review.opendev.org/c/opendev/system-config/+/793193 | 23:35 |
| ianw | "sudo docker-compose exec zuul-scheduler zuul autohold-list" doesn't seem to to work for me | 23:38 |
| ianw | on new zuul server | 23:38 |
| clarkb | ianw: are you running that within the dir with the docker compose file? | 23:39 |
| corvus | don't run zuul-scheduler | 23:39 |
| clarkb | oh also that | 23:39 |
| corvus | it's just 'zuul autohold-list' | 23:39 |
| clarkb | oh no I think that is right it says exec in the zuul-scheduler container and run zuul autohold-list | 23:39 |
| corvus | oh sorry | 23:40 |
| ianw | yeah i am in the docker-compose directory | 23:40 |
| clarkb | I've only used docker exec with it and that worked ok | 23:41 |
| ianw | i get a 1 exit but nothing suggesting why ... | 23:41 |
| corvus | s/zuul-scheduler/scheduler | 23:42 |
| clarkb | `sudo docker exec zuul-scheduler_scheduler_1 zuul autohold-list --tenant openstack` works | 23:42 |
| clarkb | corvus: ah the container is a different name | 23:43 |
| ianw | yep, both of those work | 23:43 |
| corvus | if you want to use the compose method, it's the name of the service in the compose file, which is 'scheduler' | 23:43 |
| ianw | yeah; i was pasting in fungi's suggested command above :) | 23:43 |
| ianw | alright, yak shaving achieved, i might be able to put a node on hold now to debug the actual problem | 23:44 |
| ianw | clarkb: do you still need "clarkb inspecting mailman ansible work"? | 23:45 |
| clarkb | ianw: I do want to hold a set of those jobs so that I can test the inplace upgrade but its probably best to do that with a new hold. You can clean that one up | 23:46 |
| clarkb | (or I can if you prefer) | 23:46 |
| fungi | aha, thanks, i was guessing based on frickler's docker command, guess i had it almost right ;) | 23:46 |
| ianw | clarkb: there's also "clarkb testing review-test replication" | 23:46 |
| ianw | corvus: and "corvus debug gerrit" which looks old too | 23:47 |
| clarkb | ianw: that one can be cleaned up too, its set up as the replication target from review-test, but I stopped srvices on review-test in prep for further cleanup (further cleanup has not happened yet) | 23:47 |
| fungi | ianw: i may still have a node held troubleshooting the zuul nodepool functional job, if so it can be deleted i'll make another one when i'm freed up enough to resume that effort | 23:47 |
| corvus | i need 0 held nodes at this point | 23:48 |
| ianw | cool, there is now only an old one for vexxhost and an eavesdrop one for frickler | 23:48 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!