| ianw | if ^ works we might as well see if we can get rid of 3.7 images i'd say, and try to just keep latest 2 | 00:00 |
|---|---|---|
| clarkb | I think we may have a few external users of those images (at least vexxhost) may want to run that plan by them as well | 00:00 |
| clarkb | I think that should work for us though | 00:00 |
| *** mlavalle has quit IRC | 00:07 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 00:18 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Cleanup ssl_cert_check puppet components https://review.opendev.org/c/opendev/system-config/+/789652 | 00:21 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Cleanup ssl_cert_check puppet components https://review.opendev.org/c/opendev/system-config/+/789652 | 00:22 |
| openstackgerrit | Merged opendev/system-config master: Deprovision Limesurvey config management and docs https://review.opendev.org/c/opendev/system-config/+/789060 | 00:37 |
| *** tkajinam has joined #opendev | 01:13 | |
| openstackgerrit | YuehuiLei proposed openstack/diskimage-builder master: setup.cfg: Replace dashes with underscores https://review.opendev.org/c/openstack/diskimage-builder/+/789688 | 02:12 |
| *** ykarel has joined #opendev | 04:20 | |
| *** fressi has joined #opendev | 04:44 | |
| *** vishalmanchanda has joined #opendev | 04:51 | |
| *** marios has joined #opendev | 05:36 | |
| *** dhellmann has quit IRC | 06:10 | |
| *** ralonsoh has joined #opendev | 06:11 | |
| *** whoami-rajat has joined #opendev | 06:18 | |
| *** d34dh0r53 has quit IRC | 06:18 | |
| *** d34dh0r53 has joined #opendev | 06:20 | |
| *** slaweq has joined #opendev | 06:26 | |
| *** sboyron has joined #opendev | 06:49 | |
| *** avass has joined #opendev | 06:51 | |
| *** fressi has joined #opendev | 06:54 | |
| *** rpittau|afk is now known as rpittau | 07:12 | |
| *** hashar has joined #opendev | 07:19 | |
| *** andrewbonney has joined #opendev | 07:22 | |
| *** sboyron has quit IRC | 07:28 | |
| *** tosky has joined #opendev | 07:30 | |
| *** sboyron has joined #opendev | 07:56 | |
| *** jpena|off is now known as jpena | 07:57 | |
| *** amoralej|off is now known as amoralej | 08:14 | |
| *** ysandeep is now known as ysandeep|lunch | 08:28 | |
| *** hemanth_n has joined #opendev | 08:42 | |
| *** dtantsur|afk is now known as dtantsur | 09:21 | |
| *** ykarel has quit IRC | 09:22 | |
| *** ykarel has joined #opendev | 09:22 | |
| *** osmanlicilegi has quit IRC | 09:50 | |
| openstackgerrit | Luigi Toscano proposed openstack/project-config master: gerritbot: fix the regex for the validations channels https://review.opendev.org/c/openstack/project-config/+/789774 | 10:05 |
| *** DSpider has joined #opendev | 10:08 | |
| *** ysandeep|lunch is now known as ysandeep | 10:10 | |
| *** osmanlicilegi has joined #opendev | 10:16 | |
| openstackgerrit | Luigi Toscano proposed openstack/project-config master: gerritbot: fix the regex for the validations channels https://review.opendev.org/c/openstack/project-config/+/789774 | 10:29 |
| *** hashar has quit IRC | 10:32 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:34 | |
| *** tosky has quit IRC | 10:38 | |
| *** tosky has joined #opendev | 10:38 | |
| *** tosky_ has joined #opendev | 10:45 | |
| *** tosky has quit IRC | 10:47 | |
| *** tosky_ is now known as tosky | 10:49 | |
| openstackgerrit | Luigi Toscano proposed openstack/project-config master: gerritbot: fix the regex for the validations channels https://review.opendev.org/c/openstack/project-config/+/789774 | 10:58 |
| *** jpena is now known as jpena|lunch | 11:26 | |
| marios | elod: o/ gentle reminder please add to your list of release things to review thank you for your time https://review.opendev.org/c/openstack/releases/+/789558 fyi /for your convenience | 11:38 |
| marios | https://review.opendev.org/c/openstack/releases/+/789558/1#message-588b5a3573c955ac717d0be8716b9a154d821082 | 11:38 |
| marios | elod: thank you ^^ | 11:38 |
| *** artom has quit IRC | 11:40 | |
| *** amoralej is now known as amoralej|lunch | 12:14 | |
| fungi | marios: there's also a #openstack-release channel, if that helps | 12:23 |
| marios | thanks fungi :) | 12:25 |
| *** hashar has joined #opendev | 12:25 | |
| marios | fungi: i'll go harrass there in due course if current harrass didn't work :) thanks | 12:25 |
| *** marios is now known as marios|call | 12:25 | |
| *** jpena|lunch is now known as jpena | 12:30 | |
| *** marios|call is now known as marios | 12:34 | |
| *** ricksanchez has joined #opendev | 12:50 | |
| *** ricksanchez has quit IRC | 13:00 | |
| *** amoralej|lunch is now known as amoralej | 13:09 | |
| *** fbo has quit IRC | 13:20 | |
| *** akahat|ruck has quit IRC | 13:21 | |
| *** dpawlik has quit IRC | 13:22 | |
| *** kopecmartin has quit IRC | 13:23 | |
| *** hashar has quit IRC | 13:25 | |
| *** hashar has joined #opendev | 13:25 | |
| *** akahat has joined #opendev | 13:33 | |
| *** kopecmartin has joined #opendev | 13:33 | |
| *** fbo has joined #opendev | 13:36 | |
| *** artom has joined #opendev | 13:41 | |
| *** hemanth_n has quit IRC | 13:56 | |
| *** dhellmann has joined #opendev | 14:02 | |
| *** fbo has quit IRC | 14:03 | |
| TheJulia | Quick question, does anyone know who would be authorative for docs.openstack.org administration? | 14:09 |
| fungi | TheJulia: in what sense? | 14:09 |
| fungi | what needs to be administrated? the term is kinda vague | 14:10 |
| TheJulia | Well, a question was raised if we could get some robots.txt entries added so old releases are not indexed | 14:10 |
| TheJulia | basically, super old releases are always the first index result | 14:10 |
| TheJulia | and we want to try and peel some of that back | 14:10 |
| TheJulia | And still have the docs available. | 14:10 |
| fungi | https://docs.openstack.org/robots.txt exists so i guess we need to figure out if that's installed by openstack-manuals or something else | 14:11 |
| * TheJulia clones the repo | 14:12 | |
| fungi | TheJulia: https://opendev.org/openstack/openstack-manuals/src/branch/master/www/static/robots.txt | 14:13 |
| fungi | yep, that's it | 14:14 |
| fungi | TheJulia: so as far as who's authoritative over that, i suppose the tech writing sig | 14:14 |
| TheJulia | awesome, thanks | 14:14 |
| fungi | yw! | 14:14 |
| *** dpawlik5 has joined #opendev | 14:27 | |
| *** dpawlik5 is now known as dpawlik | 14:32 | |
| *** avass has quit IRC | 14:32 | |
| elod | marios: sorry, had some other errands/meeting... let's continue on #openstack-release :) | 14:52 |
| fungi | infra-root: i announced the survey.openstack.org service retirement to openstack-discuss rather than service-announce, similar to firehose.openstack.org, as i expect that's the only community which really tried it | 14:58 |
| fungi | also it was, arguably, never officially an opendev service just a holdover from openstack-infra | 14:58 |
| clarkb | ++ | 14:58 |
| fungi | since 789383 merged i'm going to work on gerrit global config cleanup shortly | 14:59 |
| marios | elod: no problem in your own time thank you | 15:04 |
| *** avass has joined #opendev | 15:10 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 15:11 |
| clarkb | I don't understand why ^ isn't working so I've added some debug output. If that doesn't help I'll probably need to hold some nodes | 15:11 |
| *** mlavalle has joined #opendev | 15:21 | |
| *** ysandeep is now known as ysandeep|away | 15:27 | |
| *** ykarel has quit IRC | 15:28 | |
| openstackgerrit | Marcin Juszkiewicz proposed opendev/system-config master: reprepro: mirror Ubuntu UCA Xena https://review.opendev.org/c/opendev/system-config/+/789905 | 15:45 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 15:45 |
| *** rpittau is now known as rpittau|afk | 15:52 | |
| *** hashar has quit IRC | 15:54 | |
| fungi | #status log Removed OpenStack Release Manager permissions from global Gerrit config as reflected in https://review.opendev.org/789383 | 16:05 |
| openstackstatus | fungi: finished logging | 16:05 |
| fungi | infra-root: this is the diff, for reference... http://paste.openstack.org/show/804977/ | 16:05 |
| fungi | i notice we still have some old entries in there for zuul refs, permission for the zuul account to push tags, et cetera | 16:06 |
| fungi | might not be a bad idea to take a close look at the all-projects config and see what we can safely trim out | 16:06 |
| clarkb | ++ | 16:07 |
| fungi | i also set the api-projects project to hidden status, since we don't actually carry any configuration defining it and no projects currently inherit from it | 16:10 |
| fungi | not really sure what the best thing to do with that cruft is | 16:10 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 16:12 |
| clarkb | the most recent error on ^ was weird, I didn't get a stdout_lines from a command task's registered output | 16:12 |
| clarkb | On the off chance that my debugging output from before is the source of that problem I have cleaned up the now unnecessary debugging output, but that is really weird | 16:13 |
| *** hashar has joined #opendev | 16:22 | |
| fungi | speaking of service updates and configuration management, what was the plan for the future of our zuul database? mysql container on the scheduler? separate db cluster servers? | 16:27 |
| fungi | i happen to be looking in our rackspace trove instance list right now figuring out what's safe to delete while i'm there cleaning up the limesurvey db | 16:28 |
| clarkb | fungi: that is a good question and one I hadn't considered as part of the zuul cluster upgrade but probably makes sense to give it some thought | 16:29 |
| fungi | pretty sure the ara db can do, we never got around to setting up persistent ara for the bastion before we switched to zuul jobs right? | 16:29 |
| clarkb | fungi: any idea what sort of sizing needs it has right now? | 16:29 |
| fungi | er, can go | 16:29 |
| clarkb | yes I don't think the ara db was ever really used (but maybe double check bridge?) | 16:29 |
| fungi | clarkb: the current "zuul-v3" trove instance has 4gb ram (which mysql helpfully preallocates) but i don't think it's really using a ton of that because cpu consumption seems to be down around 10% for the past week. filesystem is 50gb but only 15gb in use | 16:31 |
| fungi | if we're planning to do redundant schedulers though, we probably should have a redundant database for them as well | 16:33 |
| fungi | we still have a trove instance for ipsilon, we deleted the poc server for that ages ago though right? | 16:33 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 16:35 |
| clarkb | fungi: re ipsilon I think that is a question for corvus, but yes I think so | 16:35 |
| clarkb | fungi: that is a good point. If we split up schedulers but then put a new spof on them that isn't so great | 16:35 |
| clarkb | fungi: in that case I think we can keep the existing db until we remove the scheduler spof and address the db at that point? | 16:36 |
| fungi | yeah, i'd probably do those as separate steps, and that sequence seems good | 16:36 |
| *** hemanth_n has joined #opendev | 16:37 | |
| fungi | i'm backing up the limesurvey trove instance before i delete it, just in case someone has survey results they desperately needed to get out of it | 16:37 |
| *** dtantsur is now known as dtantsur|afk | 16:38 | |
| *** marios is now known as marios|out | 16:40 | |
| *** DSpider has quit IRC | 16:43 | |
| *** jpena is now known as jpena|off | 16:46 | |
| *** marios|out has quit IRC | 16:47 | |
| *** osmanlicilegi has quit IRC | 16:54 | |
| clarkb | ok I think I see my issue with ansible. Apparently you can't register the same var name if doing an if else case because you'll register the skipped value | 16:57 |
| clarkb | maybe I should rewrite it into a block | 16:57 |
| corvus | fungi: yes you can delete the ipsilon db | 16:59 |
| corvus | keeping the existing db around until we feel like running a pxc cluster sounds good; downtime on that is pretty small. it may be small enough to always be acceptable to us. | 17:00 |
| *** osmanlicilegi has joined #opendev | 17:01 | |
| *** hemanth_n has quit IRC | 17:01 | |
| fungi | thanks corvus! | 17:01 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 17:03 |
| fungi | clarkb: think today is a good day to merge 788584? | 17:19 |
| clarkb | fungi: sure | 17:21 |
| clarkb | I think the mailman change has just passed for the first time \o/ | 17:25 |
| fungi | i've approved 788584 just now | 17:25 |
| clarkb | I have a few todos I want to look at, but I'll also work on getting the actual lists config into that change | 17:26 |
| clarkb | Then maybe we induce a failure and can inspect the host to make sure it looks how we expect it? | 17:26 |
| fungi | once it's in, that's every openstack/ namespace project except meta-config and project-config covered by the meta-config inheritance | 17:26 |
| fungi | which will also enable a few -eol tagged branches on some retired openstack projects to be deleted, as there are actually some of those | 17:27 |
| *** andrewbonney has quit IRC | 17:31 | |
| fungi | browsing the limesurvey db, it looks like it was only ever used to create two surveys, on 2018-07-03 and 2019-02-12 | 17:35 |
| fungi | and a total of 11 users, most of whom were us | 17:36 |
| *** ralonsoh has quit IRC | 17:36 | |
| fungi | anyway i stuck a mysqldump of its db in my homedir on bridge too for now, named limesurvey_backup_2021-05-05.sql.gz | 17:37 |
| openstackgerrit | Merged openstack/project-config master: Move projects under meta-config acl (19) https://review.opendev.org/c/openstack/project-config/+/788584 | 17:38 |
| *** amoralej is now known as amoralej|off | 17:43 | |
| clarkb | sounds good | 17:47 |
| fungi | #status Deleted server instance survey01.openstack.org, database instance limesurvey, and dns records for survey.openstack.org and survey01.openstack.org | 18:01 |
| openstackstatus | fungi: unknown command | 18:01 |
| fungi | i also cleaned up the old unused ara and ipsilon databases | 18:01 |
| fungi | #status log Deleted server instance survey01.openstack.org, database instance limesurvey, and related DNS records for survey.openstack.org and survey01.openstack.org | 18:03 |
| openstackstatus | fungi: finished logging | 18:03 |
| *** hashar has quit IRC | 18:06 | |
| *** hashar has joined #opendev | 18:07 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 18:10 |
| *** knikolla has joined #opendev | 18:10 | |
| clarkb | I think that change is ready for review now | 18:10 |
| clarkb | though I did just update the testing a bit | 18:10 |
| clarkb | I've also got one ansible behavior around command argv that I want to test | 18:10 |
| *** ricksanchez has joined #opendev | 18:17 | |
| fungi | stepping out for a few to pick up dinner, should be back in ~30 | 18:19 |
| *** amoralej|off is now known as amoralej | 18:32 | |
| *** amoralej is now known as amoralej|off | 18:33 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 18:39 |
| clarkb | some local testing foudn a small issue that ^ should address | 18:39 |
| clarkb | the ternary filter doesn't handle the case where a var is undefined so need to filter through default() first | 18:39 |
| clarkb | I'm also open to ideas for how we might be able to break it down into more digestable pieces. I sort of went all in here because it made the testing more straightforward | 18:41 |
| *** Jeffrey4l has quit IRC | 18:44 | |
| *** vishalmanchanda has quit IRC | 18:46 | |
| *** Jeffrey4l has joined #opendev | 18:47 | |
| clarkb | fungi: can you check my responses on https://review.opendev.org/c/opendev/system-config/+/789594 and see that they make sense | 18:49 |
| fungi | will do, gonna take a few minutes an eat first since nothing seems on fire | 18:50 |
| clarkb | yup no rush | 18:50 |
| *** hashar has quit IRC | 19:02 | |
| clarkb | anyone know what happens if you newlist a list that already exists? (I think that may be the biggest potential for problems in my ansible mailman change if I somehow don't get the checks right and it tries that and that does something undesirable) | 19:03 |
| *** ricksanchez has quit IRC | 19:15 | |
| *** fressi has left #opendev | 19:29 | |
| openstackgerrit | Merged openstack/project-config master: Add Debian bullseye wheel cache publish jobs https://review.opendev.org/c/openstack/project-config/+/783633 | 19:39 |
| openstackgerrit | Merged opendev/system-config master: Add support for Xenial ESM repos to our base roles https://review.opendev.org/c/opendev/system-config/+/789594 | 19:54 |
| *** slaweq has quit IRC | 20:10 | |
| *** ricksanchez has joined #opendev | 20:28 | |
| *** ricksanchez has quit IRC | 20:31 | |
| *** ricksanchez has joined #opendev | 20:32 | |
| *** ricksanchez has quit IRC | 20:39 | |
| *** sboyron has quit IRC | 20:42 | |
| clarkb | has anyone had a chance to look at the ansible mailman stuff yet? I know the diff line count is huge and scary but the bulk of that is simply copying the html template files for openstack :) | 21:05 |
| fungi | i have not yet but can focus on that next | 21:27 |
| fungi | did you manage to figure out whether list creation is idempotent/noop? | 21:28 |
| clarkb | I haven't, but I think I'll push a followup change that induces a failure and hold the nodes then we can directly inspect the results of this too to compare as well | 21:28 |
| clarkb | (and I can test a newlist rerun there) | 21:28 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: DNM forcing a failure in lists playbook for inspection https://review.opendev.org/c/opendev/system-config/+/789945 | 21:30 |
| clarkb | fungi: ^ that should do it and I've put a hold in place for the system-config-run-lists job against that change | 21:32 |
| *** ricksanchez has joined #opendev | 21:37 | |
| *** ricksanchez has quit IRC | 21:52 | |
| clarkb | cool that held node has already helped me find one bug (/etc/mailman/sites is all one line instead of a site per line) | 21:55 |
| clarkb | running newlist against a listname that already exists exits 1 and reports 'List already exists: service-announce' | 21:58 |
| clarkb | fungi: apache2 is having cgi problems on the held node too which makes me wonder if we'remissing some sort of cgi lib/package something | 22:09 |
| clarkb | AH01257: unable to connect to cgi daemon after multiple tries: /usr/lib/cgi-bin/mailman/listinfo | 22:09 |
| clarkb | internet says that can be a socket file perms thing | 22:11 |
| clarkb | confirmed that chowning /var/run/apache2 to www-data fixes this on the test node. however prod doesn't do this so I'm confused | 22:16 |
| clarkb | anyone know what I might be missing there? | 22:16 |
| clarkb | ok I think it may just be a bootstrapping problem on a new host. It seems that if I restart apache2 even without the chown its happy | 22:24 |
| clarkb | I'll work on some fixes, clean up this hold, then make another for what I push up | 22:25 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Ansible mailman configs https://review.opendev.org/c/opendev/system-config/+/789622 | 22:27 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: DNM forcing a failure in lists playbook for inspection https://review.opendev.org/c/opendev/system-config/+/789945 | 22:27 |
| clarkb | new hold is up. We want to confirm apache2 is happy and that /etc/mailman/sites is one line per site. I don't think the order in that file matters and it will change due to my updates | 22:28 |
| clarkb | I poked around at a few other things and didn't see anything obviously broken | 22:29 |
| *** ricksanchez has joined #opendev | 22:44 | |
| clarkb | ok the job hasn't failed yet but ssh'ing in things look good. The cgid socket is there, telling /etc/hosts the test node is lists.opendev.org loads mailman web stuff. And the /etc/mailman/sites file is a site per line now | 22:46 |
| clarkb | one thing i notice is that private lists show up on the test node. I think this is because the steps to configure a list as private happen after the lists are created by the list admins. And since this change is only creating lists this shouldn't be a problem with prod | 22:47 |
| clarkb | so ya I think we're good to have people review the change and investigate the held nodes (and compare them to prod) | 22:49 |
| *** tosky has quit IRC | 23:03 | |
| clarkb | I've done some self review and left notes for other reviewers. Feel free to mark it up :) | 23:12 |
| clarkb | fungi: the two gpg related changes you've got up have plenty of +2s now. Is there any reason to not approve both of them? | 23:28 |
| *** ricksanchez has quit IRC | 23:28 | |
| fungi | nah, feel free to approve | 23:54 |
| clarkb | fungi: do you want to monitor the key change? I guess unlikely that any releases will happen now so we can land that | 23:57 |
| clarkb | I've approved both | 23:57 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!