| opendevreview | Merged zuul/zuul-jobs master: Improve stage-output functional test https://review.opendev.org/c/zuul/zuul-jobs/+/856215 | 00:04 |
|---|---|---|
| *** dviroel is now known as dviroel|pto | 00:40 | |
| *** ysandeep|out is now known as ysandeep | 01:25 | |
| ianw | i'm running the backup prune on backup02 now in a root screen | 03:10 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: upload-npm : support authToken argument https://review.opendev.org/c/zuul/zuul-jobs/+/856225 | 03:30 |
| ianw | > You are receiving this notice because you are running a MySQL 5.1 database on the Rackspace Public Cloud. | 03:33 |
| *** ysandeep is now known as ysandeep|afk | 04:04 | |
| ianw | sorry vm decided to crash at this point ... | 04:27 |
| ianw | #status log pruned backups on backup02 | 04:34 |
| opendevstatus | ianw: finished logging | 04:34 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: upload-npm: use latest nvm https://review.opendev.org/c/zuul/zuul-jobs/+/856227 | 04:37 |
| ianw | i'm going to update the translate-dev db and see what happens ... | 04:41 |
| ianw | (i'm surprise that server is still operational at all) | 04:41 |
| ianw | it's upgraded, i've logged in and can poke around without error, so i'll assume it has worked | 04:55 |
| ianw | i'm now finalising the update from the rax ui | 04:56 |
| *** ysandeep|afk is now known as ysandeep | 04:58 | |
| ianw | ok, actually it creates a new db. i've now manually updated the standalone.xml to point to the new db hostname and restarted wildfly, and it seems happy, so i'm pretty convinced it's talking to the upgraded db | 05:02 |
| ianw | i'm out of time for now but will pick this up tomorrow and migrate it properly. so currently we have translate-dev-MySQL_upgrade and translate-dev-MySQL | 05:03 |
| *** jpena|off is now known as jpena | 07:34 | |
| *** ysandeep is now known as ysandeep|lunch | 07:45 | |
| *** ysandeep|lunch is now known as ysandeep | 09:10 | |
| *** ysandeep is now known as ysandeep|afk | 10:17 | |
| *** rlandy|out is now known as rlandy | 10:34 | |
| *** ysandeep|afk is now known as ysandeep | 11:30 | |
| frickler | don't think this will affect us anywhere, but interesting anyway https://moyix.blogspot.com/2022/09/someones-been-messing-with-my-subnormals.html | 12:33 |
| fungi | that's fun | 12:48 |
| opendevreview | Hervé Beraud proposed opendev/irc-meetings master: Update Oslo meetings' Chair https://review.opendev.org/c/opendev/irc-meetings/+/856281 | 13:31 |
| opendevreview | Merged opendev/irc-meetings master: Update Oslo meetings' Chair https://review.opendev.org/c/opendev/irc-meetings/+/856281 | 13:49 |
| *** ysandeep is now known as ysandeep|out | 14:16 | |
| knikolla | cloudnull: o/ Gerrit reports your email as undefined and it's confusing the election tooling :) can you please update it. | 15:33 |
| fungi | well, that may be contributions associated with an account we've deactivated for being a duplicate | 15:44 |
| fungi | in which case it can't really be updated, nor should it be | 15:45 |
| knikolla | fungi: there are commits associated to the gerrit account from a few days ago. so i don't think it's deactivated. | 15:55 |
| fungi | knikolla: have a link to one of the commits? | 15:56 |
| knikolla | fungi: https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/855803 | 15:56 |
| knikolla | https://review.opendev.org/q/owner:7353 | 15:56 |
| fungi | indeed, not sure how it was possible for that account to have no e-mail address | 15:57 |
| fungi | it's definitely a very old account though, going from its index number | 15:58 |
| fungi | so probably the address was removed at some point when gerrit was still more lax about such things | 16:00 |
| *** marios is now known as marios|out | 16:00 | |
| *** jpena is now known as jpena|off | 16:34 | |
| clarkb | it may have been caught in our cleanups. Though I tried to avoid touching things for active users | 16:45 |
| clarkb | all the logs are on the gerrit host | 16:45 |
| clarkb | or ya could've been done before gerrit became more picky | 16:45 |
| fungi | that seems likely. it's a very early account | 16:47 |
| clarkb | infra-root corvus has reviewed the zuul reboot update stack ending at https://review.opendev.org/c/opendev/system-config/+/856183 if I could get a second reviewer I would appreciate it. I'm happy to update per corvus' suggestion in that change too if others prefer the suggested alternative. Then once the stack lands I figure I'll manually run the playbook to ensure it is all happy | 17:04 |
| clarkb | before the weekly run | 17:04 |
| cloudnull | clarkb fungi knikolla is there something I need to update? | 17:12 |
| fungi | cloudnull: set a preferred e-mail address in your gerrit account | 17:15 |
| cloudnull | oic . | 17:16 |
| cloudnull | I guess "undefined" isn't valid :D | 17:16 |
| fungi | heh ;) | 17:16 |
| fungi | and yeah, the election tooling got unhappy that it couldn't figure out how you're supposed to be contacted to get a ballot for the tc election | 17:16 |
| cloudnull | fixed. | 17:17 |
| cloudnull | I guess when I removed my old corp email it didn't fall back to the remaining addresses. | 17:17 |
| cloudnull | https://review.opendev.org/q/owner:cloudnull should work now. but if I'm still breaking things let me know. | 17:19 |
| fungi | knikolla: ^ | 17:44 |
| fungi | thanks cloudnull! | 17:46 |
| *** dviroel is now known as dviroel|out | 17:58 | |
| opendevreview | Merged zuul/zuul-jobs master: Speed up log file fetching tasks https://review.opendev.org/c/zuul/zuul-jobs/+/855402 | 18:19 |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Correct inline comment about ansible-lint pin https://review.opendev.org/c/openstack/project-config/+/856314 | 18:42 |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Correct inline comment about ansible-lint pin https://review.opendev.org/c/openstack/project-config/+/856314 | 18:43 |
| opendevreview | Merged opendev/system-config master: Retry apt tasks in zuul_reboot if apt lock is held https://review.opendev.org/c/opendev/system-config/+/856176 | 18:44 |
| clarkb | Once the other zuul_reboot fixup lands and system-config updates on bridge I'll start that playbook manually in a root screen there | 18:48 |
| opendevreview | Merged opendev/system-config master: Handle no running containers during zuul graceful stop https://review.opendev.org/c/opendev/system-config/+/856183 | 18:49 |
| clarkb | Manual run of zuul_reboot is started in screen and logging to the normal file | 19:00 |
| fungi | thanks! | 19:00 |
| clarkb | The other two things on my list for today are the gitea 1.17.2 upgrade and testing mm3 migration stuff on the newly held host. It is lunch time though so I'll pick those up in a bit. Still keeping an eye on devstack for stage-output trouble but haven't seen any yet | 19:02 |
| opendevreview | James E. Blair proposed opendev/system-config master: Add Jaeger tracing server https://review.opendev.org/c/opendev/system-config/+/855983 | 19:34 |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Replace old Zed cycle key with 2023.1/Antelope https://review.opendev.org/c/openstack/project-config/+/856326 | 19:43 |
| clarkb | fungi: if you get a chance https://review.opendev.org/c/opendev/system-config/+/856212 is the gitea 1.17.2 upgrade | 20:01 |
| fungi | oh, yep thanks for the reminder! | 20:02 |
| fungi | i've been scattered every direction and back again today | 20:02 |
| fungi | lgtm | 20:04 |
| clarkb | I also approved https://review.opendev.org/c/opendev/system-config/+/855826/ which should haev a super minimal impact | 20:07 |
| fungi | oh, yep i'd overlooked that one but good idea | 20:13 |
| opendevreview | Merged opendev/system-config master: Append zuul reboot logs instead of truncating them https://review.opendev.org/c/opendev/system-config/+/855826 | 20:37 |
| clarkb | waiting on ze01 to finish one more job before it gets updated and restarted which should fully test the changes that just landed on the executors. Then we wait for it to get to the mergers but the mergers should be fine if I got the executors right unless I typod something | 20:39 |
| fungi | trying to compile all the new python minor versions today for the security update, and it seems like none of them can be successfully tested with the latest openssl (3.0.5) in debian/unstable | 20:40 |
| slittle1 | Can't push a signed tag to ssh://review.opendev.org:29418/starlingx/rook-ceph.git ssh://review.opendev.org:29418/starlingx/test.git | 20:58 |
| clarkb | slittle1: have you checked the acls? | 21:00 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Fix overindented ansible in zuul_reboot.yaml playbook https://review.opendev.org/c/opendev/system-config/+/856333 | 21:04 |
| clarkb | infra-root ^ I'm glad I am testing this now :) just a small ansible syntax issue. The upside is that ze01 is already stopped and has no container running which means we'll properly test the other thing when that lands and I try again | 21:04 |
| clarkb | I'd appreciate quick review on that so I can hopefully restart the manual run today | 21:05 |
| clarkb | slittle1: rook-ceph appears to have starglinx-release set for pushing signed tags and you are in that group. More info would be appreciated if you'd like us to help debug | 21:07 |
| clarkb | fungi: corvus thanks! | 21:08 |
| clarkb | and now a school run. Should be back in time to monitor the gitea deployment after the hourly jobs and then rerun the manual run of the zuul restarting | 21:11 |
| *** dasm is now known as dasm|off | 21:11 | |
| fungi | slittle1: just to check, you're using git tag -s as described at https://docs.opendev.org/opendev/infra-manual/latest/drivers.html#tagging-a-release ? | 21:12 |
| opendevreview | Merged opendev/system-config master: Update to Gitea 1.17.2 https://review.opendev.org/c/opendev/system-config/+/856212 | 21:17 |
| Clark[m] | Gitea01 is up and seems to be serving content. It was really slow to start but maybe that was my mobile connection. Seems fine now | 21:49 |
| Clark[m] | Definitely seems like a slow startup with 02 as well | 21:52 |
| Clark[m] | Cold caches I guess. I know it caches the rendered stuff pretty aggressively | 21:53 |
| opendevreview | Merged opendev/system-config master: Fix overindented ansible in zuul_reboot.yaml playbook https://review.opendev.org/c/opendev/system-config/+/856333 | 21:56 |
| *** rlandy is now known as rlandy|out | 22:03 | |
| clarkb | rerunning the reboot playbook now. I think the giteas are happy | 22:14 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Fix docker wait requires at least one argument https://review.opendev.org/c/opendev/system-config/+/856341 | 22:18 |
| clarkb | infra-root ^ I'm almost glad the apt stuff broke now :) | 22:18 |
| clarkb | I'll leave ze01 in a shutdown state just to be sure that ^ fixes everything when we run it again | 22:20 |
| clarkb | we don't seem to need the extra executor right now so that should be fine | 22:20 |
| opendevreview | Merged openstack/project-config master: Correct inline comment about ansible-lint pin https://review.opendev.org/c/openstack/project-config/+/856314 | 22:31 |
| ianw | i'm going to log back in and migrate the translate db to 5.7 as requested by rax -- it seemed to work for translate-dev. | 23:12 |
| ianw | what is happening with these is another question, but at least the db won't go bye-bye | 23:12 |
| ianw | if anyone has time for https://review.opendev.org/c/zuul/zuul-jobs/+/856225 that changes the npm role so we can use a token auth | 23:13 |
| clarkb | ianw: I'll take a look at that change. Will you do a mysqldump before doing the upgrade just in case? | 23:13 |
| ianw | testing there is ... very light. i don't think we can do what we do with pypi and upload to the staging site. and i'm not sure i'd want to write that all either | 23:13 |
| ianw | clarkb: it forks a new db; so the old one stays around. yesterday i manually changed the db connection on translate-dev and it seemed happy enough | 23:14 |
| ianw | i'll have to update the addresses in our vars and make sure puppet applies | 23:14 |
| clarkb | ianw: hrm in that case what keeps things in sync? do we have to worry about desync? | 23:15 |
| clarkb | But ya i'm not opposed to that happening. Kind of bad timing with the end of the openstack release but what can you do | 23:15 |
| ianw | i'll shut it down before i do it; it only takes a few minutes | 23:16 |
| clarkb | gotcha sounds good | 23:16 |
| ianw | yeah, it's just otherwise rax are going to just run a script to do it, from what i could tell in the mail | 23:16 |
| ianw | hrm, the upgrade didn't seem to work the same way as the translate-dev | 23:35 |
| ianw | maybe it just takes a while to bring up the new instance | 23:37 |
| ianw | it has moved to "verify upgrade" status, but i don't seem to have the replica to verify against which is weird | 23:47 |
| clarkb | I've got dinner now. But I'll check in later and try to run the zuul reboot playbook again | 23:59 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!