Wednesday, 2022-09-07

opendevreviewMerged zuul/zuul-jobs master: Improve stage-output functional test
*** dviroel is now known as dviroel|pto00:40
*** ysandeep|out is now known as ysandeep01:25
ianwi'm running the backup prune on backup02 now in a root screen03:10
opendevreviewIan Wienand proposed zuul/zuul-jobs master: upload-npm : support authToken argument
ianw> You are receiving this notice because you are running a MySQL 5.1 database on the Rackspace Public Cloud.03:33
*** ysandeep is now known as ysandeep|afk04:04
ianwsorry vm decided to crash at this point ...04:27
ianw#status log pruned backups on backup0204:34
opendevstatusianw: finished logging04:34
opendevreviewIan Wienand proposed zuul/zuul-jobs master: upload-npm: use latest nvm
ianwi'm going to update the translate-dev db and see what happens ...04:41
ianw(i'm surprise that server is still operational at all)04:41
ianwit's upgraded, i've logged in and can poke around without error, so i'll assume it has worked04:55
ianwi'm now finalising the update from the rax ui04:56
*** ysandeep|afk is now known as ysandeep04:58
ianwok, actually it creates a new db.  i've now manually updated the standalone.xml to point to the new db hostname and restarted wildfly, and it seems happy, so i'm pretty convinced it's talking to the upgraded db05:02
ianwi'm out of time for now but will pick this up tomorrow and migrate it properly.  so currently we have translate-dev-MySQL_upgrade and translate-dev-MySQL05:03
*** jpena|off is now known as jpena07:34
*** ysandeep is now known as ysandeep|lunch07:45
*** ysandeep|lunch is now known as ysandeep09:10
*** ysandeep is now known as ysandeep|afk10:17
*** rlandy|out is now known as rlandy10:34
*** ysandeep|afk is now known as ysandeep11:30
fricklerdon't think this will affect us anywhere, but interesting anyway
fungithat's fun12:48
opendevreviewHervĂ© Beraud proposed opendev/irc-meetings master: Update Oslo meetings' Chair
opendevreviewMerged opendev/irc-meetings master: Update Oslo meetings' Chair
*** ysandeep is now known as ysandeep|out14:16
knikollacloudnull: o/ Gerrit reports your email as undefined and it's confusing the election tooling :) can you please update it. 15:33
fungiwell, that may be contributions associated with an account we've deactivated for being a duplicate15:44
fungiin which case it can't really be updated, nor should it be15:45
knikollafungi: there are commits associated to the gerrit account from a few days ago. so i don't think it's deactivated. 15:55
fungiknikolla: have a link to one of the commits?15:56
knikolla 15:56
fungiindeed, not sure how it was possible for that account to have no e-mail address15:57
fungiit's definitely a very old account though, going from its index number15:58
fungiso probably the address was removed at some point when gerrit was still more lax about such things16:00
*** marios is now known as marios|out16:00
*** jpena is now known as jpena|off16:34
clarkbit may have been caught in our cleanups. Though I tried to avoid touching things for active users16:45
clarkball the logs are on the gerrit host16:45
clarkbor ya could've been done before gerrit became more picky16:45
fungithat seems likely. it's a very early account16:47
clarkbinfra-root corvus has reviewed the zuul reboot update stack ending at if I could get a second reviewer I would appreciate it. I'm happy to update per corvus' suggestion in that change too if others prefer the suggested alternative. Then once the stack lands I figure I'll manually run the playbook to ensure it is all happy17:04
clarkbbefore the weekly run17:04
cloudnullclarkb fungi knikolla is there something I need to update?17:12
fungicloudnull: set a preferred e-mail address in your gerrit account17:15
cloudnulloic . 17:16
cloudnullI guess "undefined" isn't valid :D17:16
fungiheh ;)17:16
fungiand yeah, the election tooling got unhappy that it couldn't figure out how you're supposed to be contacted to get a ballot for the tc election17:16
cloudnullfixed. 17:17
cloudnullI guess when I removed my old corp email it didn't fall back to the remaining addresses. 17:17
cloudnull should work now. but if I'm still breaking things let me know. 17:19
fungiknikolla: ^17:44
fungithanks cloudnull!17:46
*** dviroel is now known as dviroel|out17:58
opendevreviewMerged zuul/zuul-jobs master: Speed up log file fetching tasks
opendevreviewJeremy Stanley proposed openstack/project-config master: Correct inline comment about ansible-lint pin
opendevreviewJeremy Stanley proposed openstack/project-config master: Correct inline comment about ansible-lint pin
opendevreviewMerged opendev/system-config master: Retry apt tasks in zuul_reboot if apt lock is held
clarkbOnce the other zuul_reboot fixup lands and system-config updates on bridge I'll start that playbook manually in a root screen there18:48
opendevreviewMerged opendev/system-config master: Handle no running containers during zuul graceful stop
clarkbManual run of zuul_reboot is started in screen and logging to the normal file19:00
clarkbThe other two things on my list for today are the gitea 1.17.2 upgrade and testing mm3 migration stuff on the newly held host. It is lunch time though so I'll pick those up in a bit. Still keeping an eye on devstack for stage-output trouble but haven't seen any yet19:02
opendevreviewJames E. Blair proposed opendev/system-config master: Add Jaeger tracing server
opendevreviewJeremy Stanley proposed openstack/project-config master: Replace old Zed cycle key with 2023.1/Antelope
clarkbfungi: if you get a chance is the gitea 1.17.2 upgrade20:01
fungioh, yep thanks for the reminder!20:02
fungii've been scattered every direction and back again today20:02
clarkbI also approved which should haev a super minimal impact20:07
fungioh, yep i'd overlooked that one but good idea20:13
opendevreviewMerged opendev/system-config master: Append zuul reboot logs instead of truncating them
clarkbwaiting on ze01 to finish one more job before it gets updated and restarted which should fully test the changes that just landed on the executors. Then we wait for it to get to the mergers but the mergers should be fine if I got the executors right unless I typod something20:39
fungitrying to compile all the new python minor versions today for the security update, and it seems like none of them can be successfully tested with the latest openssl (3.0.5) in debian/unstable20:40
slittle1Can't push a signed tag to ssh:// ssh://
clarkbslittle1: have you checked the acls?21:00
opendevreviewClark Boylan proposed opendev/system-config master: Fix overindented ansible in zuul_reboot.yaml playbook
clarkbinfra-root ^ I'm glad I am testing this now :) just a small ansible syntax issue. The upside is that ze01 is already stopped and has no container running which means we'll properly test the other thing when that lands and I try again21:04
clarkbI'd appreciate quick review on that so I can hopefully restart the manual run today21:05
clarkbslittle1: rook-ceph appears to have starglinx-release set for pushing signed tags and you are in that group. More info would be appreciated if you'd like us to help debug21:07
clarkbfungi: corvus thanks!21:08
clarkband now a school run. Should be back in time to monitor the gitea deployment after the hourly jobs and then rerun the manual run of the zuul restarting21:11
*** dasm is now known as dasm|off21:11
fungislittle1: just to check, you're using git tag -s as described at ?21:12
opendevreviewMerged opendev/system-config master: Update to Gitea 1.17.2
Clark[m]Gitea01 is up and seems to be serving content. It was really slow to start but maybe that was my mobile connection. Seems fine now21:49
Clark[m]Definitely seems like a slow startup with 02 as well21:52
Clark[m]Cold caches I guess. I know it caches the rendered stuff pretty aggressively 21:53
opendevreviewMerged opendev/system-config master: Fix overindented ansible in zuul_reboot.yaml playbook
*** rlandy is now known as rlandy|out22:03
clarkbrerunning the reboot playbook now. I think the giteas are happy22:14
opendevreviewClark Boylan proposed opendev/system-config master: Fix docker wait requires at least one argument
clarkbinfra-root ^ I'm almost glad the apt stuff broke now :)22:18
clarkbI'll leave ze01 in a shutdown state just to be sure that ^ fixes everything when we run it again22:20
clarkbwe don't seem to need the extra executor right now so that should be fine22:20
opendevreviewMerged openstack/project-config master: Correct inline comment about ansible-lint pin
ianwi'm going to log back in and migrate the translate db to 5.7 as requested by rax -- it seemed to work for translate-dev.  23:12
ianwwhat is happening with these is another question, but at least the db won't go bye-bye23:12
ianwif anyone has time for that changes the npm role so we can use a token auth23:13
clarkbianw: I'll take a look at that change. Will you do a mysqldump before doing the upgrade just in case?23:13
ianwtesting there is ... very light.  i don't think we can do what we do with pypi and upload to the staging site.  and i'm not sure i'd want to write that all either23:13
ianwclarkb: it forks a new db; so the old one stays around.  yesterday i manually changed the db connection on translate-dev and it seemed happy enough23:14
ianwi'll have to update the addresses in our vars and make sure puppet applies23:14
clarkbianw: hrm in that case what keeps things in sync? do we have to worry about desync?23:15
clarkbBut ya i'm not opposed to that happening. Kind of bad timing with the end of the openstack release but what can you do23:15
ianwi'll shut it down before i do it; it only takes a few minutes23:16
clarkbgotcha sounds good23:16
ianwyeah, it's just otherwise rax are going to just run a script to do it, from what i could tell in the mail23:16
ianwhrm, the upgrade didn't seem to work the same way as the translate-dev23:35
ianwmaybe it just takes a while to bring up the new instance23:37
ianwit has moved to "verify upgrade" status, but i don't seem to have the replica to verify against which is weird23:47
clarkbI've got dinner now. But I'll check in later and try to run the zuul reboot playbook again23:59

Generated by 2.17.3 by Marius Gedminas - find it at!