*** zimmerry has joined #opendev | 00:02 | |
*** zbr has quit IRC | 00:27 | |
*** zbr5 has joined #opendev | 00:27 | |
clarkb | https://zuul.opendev.org/t/openstack/build/617e5ddcd55543b5b8b58f361cb66961/log/applytest/puppetapplytest24.final.out.FAILED is a weird failure, ansible couldn't ssh to localhost | 00:30 |
---|---|---|
clarkb | host key verification failed? do we race openssh-server updates or something? | 00:31 |
clarkb | the other puppet applies (via ansible) seemed fine so I have rechecked 771521 again | 00:31 |
ianw | i feel like we have randomly seen that from time to time and never quite got to the bottom of it | 00:39 |
*** hamalq has quit IRC | 00:41 | |
*** mlavalle has quit IRC | 00:58 | |
*** DSpider has quit IRC | 01:01 | |
openstackgerrit | Merged opendev/system-config master: openafs-client: cleanup PPA install https://review.opendev.org/c/opendev/system-config/+/771521 | 01:26 |
mnaser | fungi: the drafted email looks good to me :) | 01:26 |
fungi | thanks mnaser! i'll send it along to the ml momentarily | 01:43 |
*** cloudnull has quit IRC | 01:56 | |
*** cloudnull has joined #opendev | 01:59 | |
*** hemanth_n has joined #opendev | 03:07 | |
*** zoharm has joined #opendev | 04:07 | |
*** logan- has quit IRC | 04:08 | |
*** zigo has quit IRC | 04:08 | |
*** zigo has joined #opendev | 04:14 | |
*** mordred has quit IRC | 04:20 | |
*** Eighth_Doctor has quit IRC | 04:20 | |
*** logan- has joined #opendev | 04:33 | |
*** ykarel has joined #opendev | 04:35 | |
*** logan- has quit IRC | 04:36 | |
*** logan- has joined #opendev | 04:38 | |
*** logan- has quit IRC | 04:54 | |
*** logan- has joined #opendev | 04:57 | |
*** mordred has joined #opendev | 05:45 | |
*** Eighth_Doctor has joined #opendev | 05:59 | |
*** lbragstad has quit IRC | 06:03 | |
*** lbragstad has joined #opendev | 06:03 | |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: simplify updating python versions in gentoo https://review.opendev.org/c/openstack/diskimage-builder/+/771861 | 06:10 |
*** marios has joined #opendev | 06:11 | |
prometheanfire | if [[ -a /usr/sbin/migrate-pax ]]; then /usr/sbin/migrate-pax -m; fi AND [[ -a /usr/sbin/migrate-pax ]] && /usr/sbin/migrate-pax -m are not the same thing... | 06:13 |
*** calcmandan has quit IRC | 06:39 | |
*** calcmandan has joined #opendev | 06:40 | |
*** calcmandan has quit IRC | 06:50 | |
*** calcmandan has joined #opendev | 06:55 | |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: simplify updating python versions in gentoo https://review.opendev.org/c/openstack/diskimage-builder/+/771861 | 07:21 |
openstackgerrit | Martin Kopec proposed opendev/system-config master: Deploy refstack with ansible docker https://review.opendev.org/c/opendev/system-config/+/705258 | 07:24 |
*** lpetrut has joined #opendev | 07:32 | |
*** aprice has quit IRC | 07:32 | |
*** ralonsoh has joined #opendev | 07:34 | |
*** aprice has joined #opendev | 07:34 | |
*** eolivare has joined #opendev | 07:39 | |
*** fressi has joined #opendev | 07:46 | |
*** sboyron has joined #opendev | 07:49 | |
*** andrewbonney has joined #opendev | 08:08 | |
*** slaweq has joined #opendev | 08:08 | |
*** ykarel is now known as ykarel|lunch | 08:13 | |
*** rpittau|afk is now known as rpittau | 08:30 | |
*** klonn has joined #opendev | 08:30 | |
openstackgerrit | Aleksey proposed openstack/diskimage-builder master: Add 'DIB_UBUNTU_MIRROR_DISTS' to ubuntu-minimal https://review.opendev.org/c/openstack/diskimage-builder/+/772502 | 08:32 |
openstackgerrit | Aleksey proposed openstack/diskimage-builder master: Add 'DIB_UBUNTU_MIRROR_DISTS' to ubuntu-minimal https://review.opendev.org/c/openstack/diskimage-builder/+/772502 | 08:32 |
*** tosky has joined #opendev | 08:43 | |
*** yoctozepto5 has joined #opendev | 08:47 | |
*** yoctozepto has quit IRC | 08:48 | |
*** yoctozepto5 is now known as yoctozepto | 08:48 | |
*** hashar has joined #opendev | 08:53 | |
openstackgerrit | Riccardo Pittau proposed openstack/diskimage-builder master: Convert multi line if statement to case https://review.opendev.org/c/openstack/diskimage-builder/+/734479 | 08:54 |
*** jpena|off is now known as jpena | 08:57 | |
*** fressi has quit IRC | 09:13 | |
*** ykarel|lunch is now known as ykarel | 09:14 | |
*** tkajinam has quit IRC | 09:22 | |
*** fressi has joined #opendev | 09:22 | |
*** klonn has quit IRC | 09:26 | |
*** klonn has joined #opendev | 09:27 | |
*** DSpider has joined #opendev | 09:47 | |
openstackgerrit | Slawek Kaplonski proposed openstack/project-config master: Update neutron grafana dashboard https://review.opendev.org/c/openstack/project-config/+/772643 | 09:55 |
*** klonn has quit IRC | 10:08 | |
*** calcmandan has quit IRC | 10:09 | |
*** calcmandan has joined #opendev | 10:12 | |
*** sboyron has quit IRC | 10:14 | |
*** sboyron has joined #opendev | 10:14 | |
openstackgerrit | Sorin Sbârnea proposed zuul/zuul-jobs master: Add tox-py39 job https://review.opendev.org/c/zuul/zuul-jobs/+/762192 | 10:14 |
*** dtantsur|afk is now known as dtantsur | 10:18 | |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: WIP: Make output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:27 |
*** whoami-rajat__ has joined #opendev | 10:28 | |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: WIP: Make output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:28 |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: WIP: Make output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:30 |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: WIP: Make output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:33 |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: WIP: Make output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:34 |
openstackgerrit | Pranali Deore proposed openstack/project-config master: Add official-openstack-repo-jobs for openstack/glance-tempest-plugin https://review.opendev.org/c/openstack/project-config/+/771954 | 10:34 |
openstackgerrit | Pranali Deore proposed openstack/project-config master: Add official-openstack-repo-jobs for openstack/glance-tempest-plugin https://review.opendev.org/c/openstack/project-config/+/771954 | 10:35 |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: WIP: Make output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:35 |
openstackgerrit | Pranali Deore proposed openstack/project-config master: Add official-openstack-repo-jobs for openstack/glance-tempest-plugin https://review.opendev.org/c/openstack/project-config/+/771954 | 10:36 |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: WIP: Make output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:36 |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: WIP: Make output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:40 |
*** ykarel_ has joined #opendev | 10:48 | |
*** ykarel has quit IRC | 10:51 | |
*** ykarel_ is now known as ykarel | 10:51 | |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: Make default output less verbose https://review.opendev.org/c/opendev/git-review/+/772646 | 10:51 |
*** calcmandan has quit IRC | 10:52 | |
*** calcmandan has joined #opendev | 10:53 | |
*** ysandeep is now known as ysandeep|away | 10:55 | |
*** calcmandan has quit IRC | 10:58 | |
*** calcmandan has joined #opendev | 10:59 | |
*** yoctozepto5 has joined #opendev | 11:01 | |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: Test/assert Python 3.9 support https://review.opendev.org/c/opendev/git-review/+/772589 | 11:02 |
*** yoctozepto has quit IRC | 11:02 | |
*** yoctozepto5 is now known as yoctozepto | 11:02 | |
openstackgerrit | daniel.pawlik proposed openstack/diskimage-builder master: Install epel-release for RHEL from URL https://review.opendev.org/c/openstack/diskimage-builder/+/772652 | 11:15 |
dpawlik | ianw: hey, could you check it please: https://review.opendev.org/c/openstack/diskimage-builder/+/772652 | 11:16 |
openstackgerrit | daniel.pawlik proposed openstack/diskimage-builder master: Install epel-release from URL https://review.opendev.org/c/openstack/diskimage-builder/+/772652 | 11:33 |
*** hashar has quit IRC | 11:54 | |
*** ysandeep|away is now known as ysandeep | 12:13 | |
*** jpena is now known as jpena|lunch | 12:35 | |
*** hashar has joined #opendev | 12:38 | |
*** hemanth_n has quit IRC | 12:50 | |
*** klonn has joined #opendev | 12:54 | |
openstackgerrit | Martin Kopec proposed opendev/system-config master: Deploy refstack with ansible docker https://review.opendev.org/c/opendev/system-config/+/705258 | 13:10 |
*** hashar has quit IRC | 13:15 | |
*** zbr5 has quit IRC | 13:20 | |
*** zbr has joined #opendev | 13:20 | |
*** chateaulav has joined #opendev | 13:26 | |
*** yoctozepto2 has joined #opendev | 13:27 | |
*** d34dh0r53 has quit IRC | 13:27 | |
*** d34dh0r53 has joined #opendev | 13:28 | |
*** yoctozepto has quit IRC | 13:28 | |
*** yoctozepto2 is now known as yoctozepto | 13:28 | |
*** JohnnyRainbow has joined #opendev | 13:35 | |
JohnnyRainbow | Hi, do you know who is reponsible for paste.openstack.org? I need to ask someone of something who is responsible for that. Thanks in advance for info! :) | 13:36 |
*** hemanth_n has joined #opendev | 13:53 | |
*** chateaulav has quit IRC | 13:54 | |
openstackgerrit | Merged zuul/zuul-jobs master: Add tox-py39 job https://review.opendev.org/c/zuul/zuul-jobs/+/762192 | 13:54 |
*** jpena|lunch is now known as jpena | 14:01 | |
*** zoharm has quit IRC | 14:03 | |
*** spotz has joined #opendev | 14:03 | |
*** zoharm has joined #opendev | 14:05 | |
openstackgerrit | Andy Ladjadj proposed zuul/zuul-jobs master: [ensure-python] install python version only if not present https://review.opendev.org/c/zuul/zuul-jobs/+/770656 | 14:07 |
*** yoctozepto8 has joined #opendev | 14:14 | |
*** yoctozepto has quit IRC | 14:15 | |
*** yoctozepto8 is now known as yoctozepto | 14:15 | |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: Fixes test system dependencies https://review.opendev.org/c/opendev/git-review/+/772699 | 14:29 |
fungi | JohnnyRainbow: we run it as a part of the opendev collaboratory, so any of the current opendev sysadmins have root level access to the server, if that's what you're asking. it's effectively the base_users list from this file (looks like our usernames are the same as our irc nicks): https://opendev.org/opendev/system-config/src/branch/master/inventory/base/group_vars/all.yaml#L167 | 14:31 |
fungi | but generally, just say infra-root and we've pretty much all set up a highlight in our irc clients for that string | 14:32 |
*** zoharm1 has joined #opendev | 14:33 | |
*** klonn has quit IRC | 14:33 | |
*** tosky has quit IRC | 14:35 | |
*** tosky has joined #opendev | 14:36 | |
*** zoharm has quit IRC | 14:36 | |
sshnaidm|ruck | is gerrit slow for everyone today? patch submit takes a long time | 14:36 |
fungi | it's at least under very heavy use at the moment. 5-minute system load average is 35 on a server with 16 cpus | 14:41 |
*** yoctozepto0 has joined #opendev | 14:41 | |
*** yoctozepto has quit IRC | 14:41 | |
*** yoctozepto0 is now known as yoctozepto | 14:41 | |
*** tosky has quit IRC | 14:50 | |
*** tosky has joined #opendev | 14:50 | |
dtantsur | would it be possible to disable the browser warning on meetpad? it's not true and very annoying. | 15:01 |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: Remove test site dirs before doing copytree https://review.opendev.org/c/opendev/git-review/+/772703 | 15:01 |
*** fressi has left #opendev | 15:05 | |
fungi | dtantsur: i thought we already discussed it and someone proposed a patch. maybe it hadn't gotten that far? i'll check in a bit | 15:06 |
dtantsur | thx! | 15:06 |
fungi | a number of us (including frequent firefox users like me) were unable to get it to work with firefox originally and were able to get it working with chromium | 15:07 |
dtantsur | yeah, I remember that time. seems the other way around now (or at least on par) | 15:08 |
openstackgerrit | Jeremy Stanley proposed opendev/git-review master: Test/assert Python 3.9 support https://review.opendev.org/c/opendev/git-review/+/772589 | 15:15 |
openstackgerrit | Jeremy Stanley proposed opendev/git-review master: Add release notes in preparation for next release https://review.opendev.org/c/opendev/git-review/+/772590 | 15:15 |
openstackgerrit | sebastian marcet proposed opendev/puppet-openstackid master: Fixed PIP version https://review.opendev.org/c/opendev/puppet-openstackid/+/772705 | 15:15 |
*** zoharm has joined #opendev | 15:17 | |
*** zoharm1 has quit IRC | 15:20 | |
*** ykarel_ has joined #opendev | 15:21 | |
*** ykarel has quit IRC | 15:23 | |
*** mlavalle has joined #opendev | 15:26 | |
*** klonn has joined #opendev | 15:43 | |
*** hashar has joined #opendev | 15:49 | |
*** ykarel_ has quit IRC | 15:55 | |
*** lpetrut has quit IRC | 16:00 | |
clarkb | dtantsur: fungi: and as a reminder if the change isn't pushed yet anyone can push it :) | 16:06 |
clarkb | fungi: I'm figuring out breakfast but then I think my gerrit accounts next steps are: draft up a commit message in an etherpad that we think will give future us enough breadcrumbs if necessary. Then write a script that takes as input the user ref, fetches it, checks it out, updates account.config the way we want, commits with our commit message, then tells me/you/theuser to do a git show HEAD and git push | 16:07 |
clarkb | origin $ref if the commit and diff look good | 16:07 |
clarkb | fungi: then we can review the results of that script on a couple of users and if we're happy with it maybe split the list and burn through it together? something along those lines | 16:07 |
openstackgerrit | Sorin Sbârnea proposed opendev/git-review master: Remove test site dirs before doing copytree https://review.opendev.org/c/opendev/git-review/+/772703 | 16:15 |
openstackgerrit | Merged opendev/puppet-openstackid master: Fixed PIP version https://review.opendev.org/c/opendev/puppet-openstackid/+/772705 | 16:18 |
*** rpittau is now known as rpittau|afk | 16:24 | |
fungi | clarkb: yeah, sounds good, i'm trying to eat something and look into gerrit system load cause, then happy to switch gears | 16:27 |
*** yoctozepto2 has joined #opendev | 16:28 | |
clarkb | ya no rush I still need to actually make tea then write these things | 16:28 |
*** yoctozepto has quit IRC | 16:29 | |
*** yoctozepto2 is now known as yoctozepto | 16:29 | |
fungi | just looking at raw request volume isn't much help since most of them turn out to be gertty clients syncing | 16:33 |
*** clayg has quit IRC | 16:37 | |
*** erbarr has quit IRC | 16:37 | |
*** mwhahaha has quit IRC | 16:37 | |
*** zaro has quit IRC | 16:37 | |
*** ildikov has quit IRC | 16:37 | |
*** mnaser has quit IRC | 16:37 | |
*** jmorgan has quit IRC | 16:37 | |
*** hillpd has quit IRC | 16:37 | |
*** sgw has joined #opendev | 16:37 | |
*** jbryce has quit IRC | 16:37 | |
*** johnsom has quit IRC | 16:38 | |
*** walshh_ has quit IRC | 16:38 | |
*** bbezak has quit IRC | 16:38 | |
*** gmann has quit IRC | 16:38 | |
*** mattmceuen has quit IRC | 16:38 | |
*** whoami-rajat__ has quit IRC | 16:38 | |
*** Open10K8S has quit IRC | 16:38 | |
*** donnyd has quit IRC | 16:38 | |
*** diablo_rojo_phon has quit IRC | 16:38 | |
*** aprice has quit IRC | 16:38 | |
*** knikolla has quit IRC | 16:38 | |
*** rpittau|afk has quit IRC | 16:38 | |
*** TheJulia has quit IRC | 16:38 | |
*** guilhermesp has quit IRC | 16:38 | |
*** mnasiadka has quit IRC | 16:38 | |
*** portdirect has quit IRC | 16:38 | |
*** seongsoocho has quit IRC | 16:38 | |
*** andrewbonney has quit IRC | 16:38 | |
fungi | the two highest volume requesters during the 1500z hour were not gertty clients, but rather provide a ua of "Python-urllib/1.17" | 16:38 |
*** dviroel has quit IRC | 16:38 | |
*** ShadowJonathan has quit IRC | 16:38 | |
*** parallax has quit IRC | 16:38 | |
fungi | and they're requesting things like /changes/openstack%2Fnova~491854/revisions/5/files/nova%2Fconf%2Fscheduler.py/download?parent=1 | 16:38 |
fungi | both addresses are from a university network in italy | 16:39 |
fungi | so seems we may have another research project dragging the whole site to build up a dataset | 16:39 |
*** johnsom has joined #opendev | 16:39 | |
*** andrewbonney has joined #opendev | 16:39 | |
*** clayg has joined #opendev | 16:40 | |
*** gouthamr has quit IRC | 16:40 | |
*** jrosser has quit IRC | 16:40 | |
*** erbarr has joined #opendev | 16:40 | |
*** hillpd has joined #opendev | 16:40 | |
*** knikolla has joined #opendev | 16:40 | |
*** bbezak has joined #opendev | 16:40 | |
*** ildikov has joined #opendev | 16:40 | |
*** rm_work has quit IRC | 16:40 | |
*** TheJulia has joined #opendev | 16:40 | |
*** donnyd has joined #opendev | 16:40 | |
fungi | that example query was pulling files for a merged nova change from 2017 | 16:40 |
*** rpittau|afk has joined #opendev | 16:41 | |
*** dviroel has joined #opendev | 16:41 | |
*** hemanth_n has quit IRC | 16:41 | |
*** walshh_ has joined #opendev | 16:42 | |
*** mattmceuen has joined #opendev | 16:42 | |
*** whoami-rajat__ has joined #opendev | 16:42 | |
*** guilhermesp has joined #opendev | 16:42 | |
fungi | load is up around 40 right now, i'm going to temporarily block these addresses as a first step | 16:42 |
*** ShadowJonathan has joined #opendev | 16:44 | |
*** mwhahaha has joined #opendev | 16:44 | |
*** jbryce has joined #opendev | 16:44 | |
*** Open10K8S has joined #opendev | 16:45 | |
*** aprice has joined #opendev | 16:45 | |
fungi | er, one is in an italian university it network, the other is a vodafone customer in italy, both with the same user agent and making the same pattern of queries, so likely the same bot | 16:45 |
*** gmann has joined #opendev | 16:45 | |
*** mnaser has joined #opendev | 16:46 | |
*** d34dh0r53 has quit IRC | 16:46 | |
fungi | okay, blocked, let's see if things start to calm down now | 16:46 |
fungi | system load is falling rapidly | 16:46 |
*** d34dh0r53 has joined #opendev | 16:46 | |
*** d34dh0r53 has quit IRC | 16:47 | |
fungi | they were also the most active clients (so far) for the 1600z hour | 16:48 |
*** d34dh0r53 has joined #opendev | 16:48 | |
openstackgerrit | Sorin Sbârnea proposed opendev/bindep master: Assure bindep can be called as a module https://review.opendev.org/c/opendev/bindep/+/772746 | 16:50 |
*** jmorgan has joined #opendev | 16:50 | |
*** parallax has joined #opendev | 16:50 | |
*** zaro has joined #opendev | 16:50 | |
*** portdirect has joined #opendev | 16:50 | |
*** rm_work has joined #opendev | 16:50 | |
*** rm_work has quit IRC | 16:50 | |
*** mnasiadka has joined #opendev | 16:50 | |
clarkb | fungi: nice detective work | 16:54 |
*** jrosser has joined #opendev | 16:55 | |
*** mnasiadka has quit IRC | 16:55 | |
*** zaro has quit IRC | 16:55 | |
*** portdirect has quit IRC | 16:55 | |
*** parallax has quit IRC | 16:55 | |
*** seongsoocho has joined #opendev | 16:56 | |
*** parallax has joined #opendev | 16:57 | |
*** zaro has joined #opendev | 16:57 | |
*** mnasiadka has joined #opendev | 16:57 | |
*** portdirect has joined #opendev | 16:58 | |
*** marios has quit IRC | 17:01 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/project-config master: Update ACLs of Ironic Projects to allow Edit Hashtags https://review.opendev.org/c/openstack/project-config/+/772427 | 17:10 |
*** klonn has quit IRC | 17:11 | |
iurygregory | I hope this will work | 17:12 |
* iurygregory fingers crossed | 17:12 | |
*** rm_work has joined #opendev | 17:13 | |
*** rm_work has quit IRC | 17:13 | |
*** zaro has quit IRC | 17:17 | |
clarkb | fungi: review-test:~clarkb/gerrit-consistency-notes/retire-user.sh I just put the commit message draft in there beacuse using a heredoc was what I wanted in the script anyway | 17:17 |
*** mnasiadka has quit IRC | 17:18 | |
*** jmorgan has quit IRC | 17:18 | |
*** parallax has quit IRC | 17:18 | |
*** portdirect has quit IRC | 17:18 | |
openstackgerrit | Sorin Sbârnea proposed opendev/bindep master: Assure bindep can be called as a module https://review.opendev.org/c/opendev/bindep/+/772746 | 17:18 |
*** jmorgan has joined #opendev | 17:19 | |
*** parallax has joined #opendev | 17:19 | |
*** portdirect has joined #opendev | 17:19 | |
*** zaro has joined #opendev | 17:20 | |
*** stand has joined #opendev | 17:20 | |
*** mnasiadka has joined #opendev | 17:20 | |
*** andrewbonney has quit IRC | 17:21 | |
*** andrewbonney has joined #opendev | 17:24 | |
iurygregory | clarkb, hey by any chance you know who would be able to provide some feedback on https://review.opendev.org/c/openstack/project-config/+/772484 I'm trying in my patch https://review.opendev.org/c/openstack/project-config/+/772427 (not sure if using a chain would work or if I need to wait till the first merges) | 17:24 |
clarkb | iurygregory: project-config is a "trusted" project which means the zuul configs for it are going to be static until merged. But the repo content like tools/normalize_acl.py should be used out of your commit | 17:26 |
*** eolivare has quit IRC | 17:26 | |
*** hashar is now known as hasharAway | 17:26 | |
clarkb | all that to say I think the -1 is pointing out an issue somewhere in the validation you are running | 17:26 |
openstackgerrit | Merged opendev/git-review master: Remove test site dirs before doing copytree https://review.opendev.org/c/opendev/git-review/+/772703 | 17:30 |
iurygregory | humm now the problem is with exclusiveGroupPermissions, maybe I need to add editHashtags to it in the projects | 17:31 |
clarkb | iurygregory: what that means is if some other group has that permission from a higher level acl it is ignored | 17:32 |
clarkb | I think it would be fine to have for now at least. If we decide we want some global edit hash tags group then we'd need to adjust it | 17:32 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: simplify updating python versions in gentoo https://review.opendev.org/c/openstack/diskimage-builder/+/771861 | 17:34 |
fungi | clarkb: sorry, still trying to dig myself out of the morning correspondence pit, but almost free | 17:34 |
iurygregory | clarkb, ack | 17:35 |
clarkb | fungi: no worries, I'm getting prepped locally to execute that stuff against prod assuming you think it looks good | 17:35 |
*** klonn has joined #opendev | 17:37 | |
fungi | btw, for the 1700z hour so far the highest volume http requester looks like it's probably a misconfigured jenkins. ua of "Apache-HttpClient/4.5.10 (Java/1.8.0_212)" repeatedly polling /plugins/events-log/ which is a perpetual 404 because we don't have that plugin | 17:38 |
fungi | system load is still high-ish but that's likely attributable to just having a lot of folks awake and using the service | 17:38 |
fungi | no further queries like the ones i saw from the addresses i blocked earlier | 17:39 |
clarkb | we could block that jenkins to see if they notice that a bit more | 17:40 |
clarkb | but doubtful since it is already a 404 | 17:40 |
fungi | #status log Blocked two IP addresses from Italy (one from a university and another from a phone provider network) at 16:45z because they seemed to be significantly increasingly system load by crawling file download links for old changes | 17:41 |
openstackstatus | fungi: finished logging | 17:41 |
fungi | mmm, i should have said it was for gerrit, but readers will likely get that from context | 17:42 |
tosky | fungi: just FYI, but it's not so relevant, some Italian phone providers (well, all of them) also provide fiber connectivity | 17:43 |
fungi | tosky: yeah, good point, "network provider" seemed like it might be too nonspecific for referring to vodafone | 17:45 |
tosky | yeah, so it may be even a broadband connection - but many mobile contracts allows for a lot of data, so it may be that too | 17:47 |
*** klonn has quit IRC | 17:49 | |
*** hasharAway is now known as hashar | 17:56 | |
*** tosky has quit IRC | 17:58 | |
*** tosky has joined #opendev | 17:58 | |
*** klonn has joined #opendev | 17:59 | |
*** seongsoocho has quit IRC | 18:00 | |
*** mnasiadka has quit IRC | 18:00 | |
*** jpena is now known as jpena|off | 18:00 | |
*** seongsoocho has joined #opendev | 18:00 | |
*** mnasiadka has joined #opendev | 18:01 | |
*** fbo is now known as fbo|off | 18:02 | |
*** ildikov has quit IRC | 18:04 | |
*** dviroel has quit IRC | 18:04 | |
*** ildikov has joined #opendev | 18:05 | |
*** dviroel has joined #opendev | 18:05 | |
*** andrewbonney has quit IRC | 18:05 | |
corvus | dtantsur, fungi: iirc the meetbot issue with ff was not so much that ff didn't work (it did) but that if any participant was using ff, the video quality degraded for everyone (due to ff sending too much data or something). | 18:06 |
dtantsur | ah well, we don't use video pretty much.. | 18:06 |
dtantsur | better than chromium crashing :) | 18:06 |
corvus | should be fine then :) | 18:06 |
fungi | dtantsur: has google still not fixed that crash bug in chromium? | 18:07 |
fungi | sounded like it was maybe related to video acceleration support or something | 18:08 |
dtantsur | I would expect them to have fixed it by now, but this week at least one person had severe problems | 18:08 |
dtantsur | (manifesting differently, CPU 150% + a crash, so a different issue likely) | 18:08 |
clarkb | google has also removed sync support from not chrome. Users are being told to usefirefox aiui | 18:09 |
corvus | dtantsur, fungi: this seems to be the latest on jitsi+ff: https://github.com/jitsi/jitsi-meet/issues/4758#issuecomment-754995549 | 18:09 |
corvus | looks like it's either working or nearly working | 18:09 |
clarkb | sounds like 83 was happy then 84 was less happy but changing bit rate settings makes 84 happier? | 18:10 |
corvus | yeah that's how i'm reading it | 18:10 |
dtantsur | 84 works for me, but we did not use video | 18:11 |
corvus | i'd be inclined to say it's probably time to remove the warning | 18:12 |
*** ralonsoh has quit IRC | 18:13 | |
openstackgerrit | Jeremy Stanley proposed opendev/git-review master: Test/assert Python 3.9 support https://review.opendev.org/c/opendev/git-review/+/772589 | 18:13 |
openstackgerrit | Jeremy Stanley proposed opendev/git-review master: Add release notes in preparation for next release https://review.opendev.org/c/opendev/git-review/+/772590 | 18:13 |
*** mnasiadka has quit IRC | 18:13 | |
*** dviroel has quit IRC | 18:14 | |
*** seongsoocho has quit IRC | 18:14 | |
*** ildikov has quit IRC | 18:14 | |
openstackgerrit | Merged opendev/bindep master: Assure bindep can be called as a module https://review.opendev.org/c/opendev/bindep/+/772746 | 18:16 |
*** bbezak has quit IRC | 18:17 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/project-config master: Add key editHashtags to normalize_acl script https://review.opendev.org/c/openstack/project-config/+/772484 | 18:17 |
*** clayg has quit IRC | 18:17 | |
*** erbarr has quit IRC | 18:17 | |
*** guilhermesp has quit IRC | 18:17 | |
*** jmorgan has quit IRC | 18:17 | |
*** mnaser has quit IRC | 18:17 | |
*** donnyd has quit IRC | 18:17 | |
iurygregory | missing comma ftw | 18:17 |
corvus | clarkb, fungi: super quick +3 for ya'll: https://review.opendev.org/772133 | 18:18 |
*** jmorgan has joined #opendev | 18:18 | |
*** bbezak has joined #opendev | 18:18 | |
*** clayg has joined #opendev | 18:18 | |
*** donnyd has joined #opendev | 18:18 | |
*** seongsoocho has joined #opendev | 18:18 | |
*** dviroel has joined #opendev | 18:18 | |
*** mnaser has joined #opendev | 18:18 | |
*** mnasiadka has joined #opendev | 18:18 | |
*** guilhermesp has joined #opendev | 18:18 | |
*** ildikov has joined #opendev | 18:18 | |
fungi | thanks, lgtm, approved it | 18:19 |
*** erbarr has joined #opendev | 18:19 | |
*** gouthamr has joined #opendev | 18:20 | |
*** bbezak has quit IRC | 18:24 | |
*** clayg has quit IRC | 18:25 | |
*** dviroel has quit IRC | 18:25 | |
*** seongsoocho has quit IRC | 18:25 | |
*** jmorgan has quit IRC | 18:25 | |
*** mnasiadka has quit IRC | 18:25 | |
*** donnyd has quit IRC | 18:25 | |
*** ildikov has quit IRC | 18:25 | |
*** guilhermesp has quit IRC | 18:25 | |
*** ildikov has joined #opendev | 18:26 | |
*** klonn has quit IRC | 18:27 | |
*** mnaser has quit IRC | 18:27 | |
*** klonn has joined #opendev | 18:27 | |
*** seongsoocho has joined #opendev | 18:28 | |
*** donnyd has joined #opendev | 18:28 | |
*** guilhermesp has joined #opendev | 18:31 | |
*** clayg has joined #opendev | 18:31 | |
*** dviroel_ has joined #opendev | 18:31 | |
*** bbezak has joined #opendev | 18:32 | |
*** mnaser has joined #opendev | 18:32 | |
*** mnasiadka has joined #opendev | 18:33 | |
*** zbr0 has joined #opendev | 18:35 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/project-config master: Update ACLs of Ironic Projects to allow Edit Hashtags https://review.opendev.org/c/openstack/project-config/+/772427 | 18:35 |
*** jmorgan has joined #opendev | 18:36 | |
*** zbr has quit IRC | 18:37 | |
*** zbr0 is now known as zbr | 18:37 | |
*** dtantsur is now known as dtantsur|afk | 18:44 | |
iurygregory | FYI project-config jobs are running on ubuntu-bionic (not sure if this is expected =) ) | 18:45 |
iurygregory | finally green \o/ https://review.opendev.org/c/openstack/project-config/+/772427/ | 18:46 |
fungi | iurygregory: i think opendev's default nodeset in the base job is still ubuntu-bionic | 18:46 |
iurygregory | fungi, gotcha =) | 18:47 |
fungi | we've just never gotten around to updatig that, needs an announcement at the very least | 18:47 |
iurygregory | yeah, since things can break =) | 18:49 |
*** zoharm1 has joined #opendev | 18:53 | |
*** clayg has quit IRC | 18:54 | |
*** dviroel_ has quit IRC | 18:54 | |
*** mnasiadka has quit IRC | 18:54 | |
*** guilhermesp has quit IRC | 18:54 | |
*** jmorgan has quit IRC | 18:55 | |
*** mnaser has quit IRC | 18:55 | |
*** zoharm has quit IRC | 18:56 | |
*** jmorgan has joined #opendev | 19:04 | |
*** jmorgan has quit IRC | 19:08 | |
*** hamalq has joined #opendev | 19:08 | |
openstackgerrit | Merged opendev/system-config master: Remove old service cleanups from zuul https://review.opendev.org/c/opendev/system-config/+/772133 | 19:08 |
*** dviroel_ has joined #opendev | 19:15 | |
*** gouthamr_ has joined #opendev | 19:18 | |
*** dviroel_ is now known as dviroel | 19:19 | |
*** mnaser has joined #opendev | 19:19 | |
*** guilhermesp has joined #opendev | 19:20 | |
*** mnasiadka has joined #opendev | 19:20 | |
*** clayg has joined #opendev | 19:21 | |
fungi | infra-root: clarkb and i are handling some retirements for unused/unusable accounts which are showing up in account conflict validation on gerrit, just a heads up in case something goes sideways, we'll stick a copy of the log of all the operations on review.o.o in case questions arise | 19:25 |
*** zoharm1 has quit IRC | 19:32 | |
*** paladox has quit IRC | 19:40 | |
*** clayg has quit IRC | 19:40 | |
*** gouthamr_ has quit IRC | 19:40 | |
*** mnaser has quit IRC | 19:40 | |
*** guilhermesp has quit IRC | 19:40 | |
*** mnasiadka has quit IRC | 19:40 | |
*** clayg has joined #opendev | 19:41 | |
*** guilhermesp has joined #opendev | 19:42 | |
*** mnasiadka has joined #opendev | 19:42 | |
*** mnaser has joined #opendev | 19:42 | |
openstackgerrit | Martin Kopec proposed opendev/system-config master: Deploy refstack with ansible docker https://review.opendev.org/c/opendev/system-config/+/705258 | 19:43 |
*** paladox has joined #opendev | 19:43 | |
*** yoctozepto9 has joined #opendev | 19:50 | |
*** yoctozepto has quit IRC | 19:51 | |
*** yoctozepto9 is now known as yoctozepto | 19:51 | |
*** diablo_rojo_phon has joined #opendev | 20:14 | |
*** jmorgan has joined #opendev | 20:18 | |
clarkb | the log is in place in my homedir on review. We are done doing the writes and are working to run the consistency chcek and confirm things are happier | 20:32 |
*** klonn has quit IRC | 20:37 | |
*** stand has quit IRC | 20:42 | |
*** dviroel has quit IRC | 20:43 | |
*** stand has joined #opendev | 20:46 | |
*** hashar has quit IRC | 20:46 | |
clarkb | checking consistency reflects the fixes we have made | 21:25 |
clarkb | and now I need to find food | 21:25 |
clarkb | 81 accounts with inconsistenct config were fixed. out of ~752. That is >10% | 21:25 |
clarkb | next up I will start an etherpad tracking what we've roughly done and what needs to be done | 21:25 |
*** whoami-rajat__ has quit IRC | 21:37 | |
*** dviroel_ has joined #opendev | 21:42 | |
*** Eighth_Doctor has quit IRC | 21:50 | |
*** mordred has quit IRC | 21:50 | |
*** rm_work has joined #opendev | 21:55 | |
*** rm_work has quit IRC | 21:55 | |
*** sboyron has quit IRC | 22:02 | |
*** zigo has quit IRC | 22:29 | |
*** zigo has joined #opendev | 22:30 | |
*** slaweq has quit IRC | 22:51 | |
clarkb | fungi: I'm going through the remaining preferred email has no external ids list and a trend is starting to appear | 22:52 |
clarkb | there is an older account with a preferred email that has no external id matching that. This account has openids and often ssh username too. If you grep the preferred email you find a second (or third, etc) account that seems put together | 22:53 |
clarkb | I think what was commonly happening is people changed their email address in gerrit then changed it in lp. The next time they logged in they get a new account | 22:53 |
clarkb | I think we can probably give these the same treatment we gave the previous set and treat them as dead since uesrs seem to have transitioned to the new one. And if anyone cmplains because we break them maybe we revert and go from there | 22:54 |
clarkb | but I'm still only like 8 accouints into the set of 28 | 22:54 |
clarkb | altenatively we could attempt to revert the preferred email change that presumably precipitated all this and set it to the value in the openid | 22:56 |
*** tkajinam has joined #opendev | 22:59 | |
clarkb | if we give them the retired account treatment then we'll potentially break people who were using ssh but not https on that older account | 23:00 |
clarkb | if we update the preferred email then ssh will continue to work but good chance we will start sending emails into black holes if ssh is used. Particularly when the email change indicates a change of employer | 23:01 |
clarkb | found a case where the preferred email is in use by an older account | 23:04 |
*** rm_work has joined #opendev | 23:04 | |
*** rm_work has quit IRC | 23:04 | |
clarkb | not sure how thatwould have happened | 23:04 |
*** rm_work has joined #opendev | 23:06 | |
fungi | yeah, i think if there's a username and at least one of ssh key or http password then we have to assume they could still be logging into that account for some actions, just not with the webui | 23:21 |
clarkb | fungi: I agree, but I'm also starting to think that disabling that account and making them say "wtf?!" may be our best option anyway | 23:29 |
clarkb | in particular a lot of these emails seem to be for old employers and I wouldn't trustthem to go anywhere that is read | 23:29 |
clarkb | anyway I'm still trying to go through the greps and write notes and maybe from there we can make a decision on what to do | 23:30 |
*** mordred has joined #opendev | 23:35 | |
fungi | still seems like those could go into the hopper for an activity query. if they haven't been used in ages and they're in conflict, then let's clean them up | 23:36 |
fungi | i suspect many if not most will wind up in that camp | 23:36 |
clarkb | what does "clean them up" mean in this context? | 23:37 |
clarkb | I mean I want all of them to be clean :) but do you mean deactivate them or merge them or maybe its context dependent? | 23:37 |
fungi | strip out the addresses/external ids from them and set them inactive | 23:37 |
clarkb | got it | 23:38 |
clarkb | ya that seems reasonable | 23:38 |
fungi | though i suppose we could merge them into an active account if one in the group is recently active and the rest are not | 23:38 |
fungi | but i expect we'll find plenty where the entire group for a given conflict is long inactive | 23:38 |
fungi | and if we remove their external ids and addresses, then if they ever come back with their openid they'll just get a new account | 23:39 |
fungi | one other metric we could use to identify which accounts to keep: are they members of any groups | 23:39 |
fungi | gerrit groups i mean, not conflict groups | 23:39 |
clarkb | ya since those are semi curated | 23:40 |
fungi | in many cases, account conflicts historically came to our attention because someone was trying to add them to a group, so if the account is actually in a group then that was probably the keeper | 23:40 |
*** Eighth_Doctor has joined #opendev | 23:55 | |
clarkb | what I suspect some of these are are accounts that we merged into another account and then didn't move the ssh username over beacuse you can only have one | 23:55 |
clarkb | and so ya simply turning them off and moving on is reasonable | 23:55 |
fungi | yep | 23:57 |
fungi | that would be my guess for most of them as well | 23:57 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!