| elodilles | frickler: there are some seconds already between branch deletions, but a timestamp can be added | 05:36 |
|---|---|---|
| opendevreview | Dmitriy Rabotyagov proposed openstack/project-config master: Report Vitrage changes to stable branches in the IRC https://review.opendev.org/c/openstack/project-config/+/894256 | 07:21 |
| opendevreview | Artem Goncharov proposed openstack/project-config master: Rollback to LaunchPad for issuetracking https://review.opendev.org/c/openstack/project-config/+/894285 | 09:17 |
| *** ykarel|away is now known as ykarel | 09:18 | |
| opendevreview | Guillaume Boutry proposed openstack/project-config master: Add OpenStack K8S Designate charms https://review.opendev.org/c/openstack/project-config/+/894289 | 09:35 |
| frickler | TIL https://github-debug.com/ , maybe we should clone that to debug opendev.org issues | 12:43 |
| frickler | fungi: clarkb: regarding switching openstacksdk back to LP: launchpad.net/openstacksdk doesn't exist yet, but there is https://launchpad.net/python-openstacksdk . do you think you could try to contact one of the people in https://launchpad.net/~python-osdk-team/+members#active to see if they could hand it over? | 12:55 |
| frickler | or does that require the administrator (jnoller, never heard that name I think)? | 12:56 |
| frickler | would it make sense to talk to launchpad admins instead or if that fails? | 12:56 |
| frickler | jamespage: or maybe going via you and canonical might be another option? | 12:58 |
| fungi | frickler: any of the members of that group should be able to change the maintainer/driver for the project to another group. i think i've seen bcurtin around still from time to time? if not, doug has always been amazingly responsive but i would avoid pestering him about it except as a last resort | 13:01 |
| fungi | (he's lurking in this channel, i'm just trying not to ping him unnecessarily) | 13:01 |
| fungi | frickler: do you have a group in lp you want to be the new owner? make sure the group itself is owned by openstack-admins too, so that we have a fallback escalation path should the same problem arise there in the future | 13:02 |
| frickler | I don't have a group yet, is that what https://launchpad.net/people/+newteam would create? not sure which details to consider there. maybe it would be best if gtema as ptl would create one called "openstacksdk"? | 13:12 |
| gtema | frickler - https://launchpad.net/~openstacksdks | 13:15 |
| gtema | I invited admins | 13:15 |
| gtema | I explicitly used plural form for future | 13:17 |
| fungi | gtema: please set the owner of that team to https://launchpad.net/~openstack-admins if it's going to be a driver/maintainer/bug-supervisor for an openstack project on lp | 13:34 |
| fungi | that way we don't have the same problem you ran into with the abandoned team there | 13:34 |
| gtema | I think first you should accept invite | 13:35 |
| gtema | cause I can't set anything while invite is not accepted | 13:35 |
| fungi | can do | 13:39 |
| fungi | looks like i may need to be an administrator of openstack-admins in order to accept invites on behalf of that team. corvus ^ is that something you can help with? | 13:43 |
| frickler | corvus: I also would not mind getting added to https://launchpad.net/~openstack-admins while you're at it ;) | 13:50 |
| corvus | fungi: done | 14:25 |
| fungi | thanks corvus! | 14:30 |
| fungi | looks like now i have access to see all the teams it's been invited to, i'll go ahead and approve the relevant ones | 14:32 |
| frickler | gtema: I neglected to check this earlier, but the situation is looking better for https://launchpad.net/python-openstackclient , the associated team is owned by openstack-admins | 14:57 |
| frickler | do we need two different projects or can we use one for both sdk and osc? | 14:58 |
| gtema | oh, ok | 14:58 |
| frickler | fungi: do you happen to know if project renaming is supported on LP? | 14:58 |
| gtema | I would say we should merge - this is anyway what we did on our side merging 2 teams/projects | 14:58 |
| fungi | i have no idea, can't say i've ever tried to rename a project there | 14:58 |
| frickler | gtema: you should be able to request to "Join the team" on https://launchpad.net/~python-openstackclient-drivers and I hope then fungi as openstack-admins member should be able to approve that and me? | 15:01 |
| gtema | requested | 15:02 |
| gtema | and what is this team? | 15:03 |
| frickler | that's the owner/driver for https://launchpad.net/python-openstackclient | 15:03 |
| gtema | ah, ok | 15:03 |
| frickler | and then we can check whether renaming is possible or otherwise I guess just create openstacksdk project with the same team | 15:03 |
| fungi | frickler: i've invited you to openstack-admins just now, so you should be able to try it yourself i think? | 15:05 |
| fungi | er, added you i mean | 15:06 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update to gitea 1.20.4 https://review.opendev.org/c/opendev/system-config/+/894382 | 15:11 |
| clarkb | corvus: I found two small things on the Gerrit bookworm change https://review.opendev.org/c/opendev/system-config/+/892699 do you want to take a look or should I go ahead and push a new patchset? | 15:17 |
| clarkb | I don't think either are critical but worth sorting out upfront if we can | 15:18 |
| corvus | clarkb: i think if you grok that it'd be great if you pushed the new ps | 15:19 |
| clarkb | will do | 15:20 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update gerrit image to bookworm https://review.opendev.org/c/opendev/system-config/+/892699 | 15:29 |
| opendevreview | Clark Boylan proposed opendev/system-config master: DNM Forced fail on Gerrit to check bookworm/java 17 update https://review.opendev.org/c/opendev/system-config/+/893571 | 15:29 |
| frickler | fungi: the addition has worked and I could approve both gtema and myself | 15:30 |
| clarkb | I went ahead and rotated the autohold for that gerrit change too | 15:30 |
| frickler | editing the display name for the project seems possible, too, but it has a warning "Avoid changing the Name, because that will change the project group’s URL, which will break all links from outside Launchpad. " | 15:30 |
| frickler | so maybe better create openstacksdk separately? or openstacksdks? | 15:31 |
| gtema | you mean project or group? | 15:31 |
| frickler | project, sorry | 15:31 |
| frickler | it is also being actively used by ubuntu as https://bugs.launchpad.net/ubuntu/+source/python-openstackclient | 15:32 |
| gtema | well, then we should just create as many project as repos we have | 15:32 |
| gtema | openstacksdk, python-openstackclient (whether it is possible), osc-cli, ... | 15:32 |
| frickler | hmm | 15:32 |
| frickler | I'd have argued to place osc-cli into python-openstackclient. and things like cliff maybe into openstacksdk | 15:33 |
| frickler | similar like neutron has all their subprojects under the neutron name on LP | 15:33 |
| gtema | cliff into sdk is a bad idea. It is not used there at all | 15:34 |
| frickler | ah, right, that's cli | 15:34 |
| frickler | I was just looking for an example what could belong to sdk | 15:34 |
| clarkb | the verification code for infra root is me trying to figure out that account | 16:31 |
| clarkb | wow it now wants me to provide a phone number to get a code.... I have a feeling this might forever associate my phone number with that account which isn't ideal | 16:32 |
| clarkb | but here we go | 16:32 |
| fungi | this is for the g00g? | 16:33 |
| clarkb | yes | 16:33 |
| clarkb | any objections to me providing my numebr for that purpose? | 16:33 |
| clarkb | looks like they will actively send an sms code to it so a random number or landline won't work | 16:34 |
| fungi | no objection | 16:34 |
| fungi | especially since we have no idea what it was even used for | 16:34 |
| frickler | well you'll lock yourself in as opendev coordinator for life, but I'm fine with that, too ;) | 16:35 |
| clarkb | haha | 16:35 |
| clarkb | the name on the account is "OpenDev Zuul" and I did login. That resets the December 1 account gets deleted timer at least | 16:36 |
| clarkb | still have no idea what this was used for | 16:36 |
| clarkb | Note there is no positive confirmation this resets the account deletion timer but the warning email said the simplest way to avoid deletion is to log in to the account which I have done | 16:37 |
| clarkb | I am the only current session and the account appears to have last been managed in September 2019 | 16:38 |
| clarkb | maybe if I look at irc logs from around then I'll find some clues | 16:39 |
| clarkb | oh! I think this account might be used to do third party CI with gerrit? | 16:39 |
| clarkb | *Upstream gerrit | 16:40 |
| clarkb | there is a connection to googlesource.com which is upstream gerrit and comparing to zuul config I think this is the case | 16:41 |
| clarkb | so ya we'll just need to manually login like I just did every couple of years to keep this connection with upstream gerrit working. | 16:41 |
| clarkb | I've logged out as I think that is mystery solved | 16:43 |
| clarkb | it didn't appear to add my phone number to the list of phone numbers associated with the account. I think they must be using that to help determine if you are a real human (possibly by checking the phone number against data they have on all of us humans) | 16:43 |
| clarkb | corvus: ^ fyi since I think you set that up | 16:44 |
| clarkb | corvus: you may also need to do similar for Gerrit's Zuul? I'm not sure | 16:55 |
| yoctozepto | morning; do you have around some metrics related to the performance / resource consumption of the Hound instance at OpenDev? (both indexer and the query web ui) has it been problematic on this front? and what is your hw config for it? | 17:42 |
| fungi | yoctozepto: looks like we missed adding data collection for it to http://cacti.openstack.org/ but i can pull some quick stats | 17:48 |
| fungi | 8gb ram virtual machine currently using about 1gb for active pages plus most of the rest for buffers/cache | 17:49 |
| fungi | we're doing all the indexing on the 40gb rootfs though it's starting to get full-ish | 17:51 |
| fungi | the hound container us using /var/lib/hound/data for that and i should have a du for it shortly | 17:51 |
| fungi | 28gb in that directory | 17:52 |
| fungi | yoctozepto: our recipe for building the container image is at https://opendev.org/opendev/system-config/src/branch/master/docker/hound | 17:53 |
| clarkb | its not something that gets continuous use. Instead its pretty spiky I think. When it starts up and indexes everything that takes a while and some queries with a lot of results can take a while. | 17:53 |
| fungi | yoctozepto: and https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/codesearch is the ansible role we deploy it to the server with (compose file is under templates) | 17:53 |
| clarkb | depending on your tolerance for that you many want more CPU/memory/IO but I'm not sure where it bottlenecks | 17:54 |
| fungi | yoctozepto: if you want to propose a change to add it to our cacti we could probably get some usage trends that way | 17:54 |
| fungi | https://opendev.org/opendev/system-config/src/branch/master/hiera/common.yaml | 17:58 |
| fungi | took me a minute to find that, i forgot cacti is one of the last remaining services we're configuring with puppet still | 17:58 |
| clarkb | ya we have a spec to replace it... | 17:58 |
| fungi | indeed we do | 17:59 |
| yoctozepto | thank you, fungi and clarkb for the thorough answers! I will be looking into your config and may add this cacti integration for you along the way ;-) | 18:01 |
| fungi | my pleasure | 18:02 |
| yoctozepto | oh, and how much code does it index? do you have a handy stat showing the count of bytes of all indexed repositories (code, not .git)? | 18:04 |
| clarkb | infra-root https://104.239.175.80 is the held gerrit after my updates to the bookworm + java 17 change | 18:04 |
| clarkb | it seems to be working. If you agree and https://review.opendev.org/c/opendev/system-config/+/892699/ looks good we should land that today in prep for switching to it tomorrow | 18:05 |
| clarkb | yoctozepto: I don't think we have that data because it is only indexing a single branch for each repo | 18:05 |
| yoctozepto | yeah, that I'm aware of | 18:06 |
| clarkb | but it won't be more than the grand total of all the branch as an upper bound which might be easier to determine | 18:06 |
| yoctozepto | indeed | 18:06 |
| yoctozepto | though I can also download all "HEADs" myself and du that | 18:06 |
| fungi | well, as i said, the index itself is occupying 28gb of disk | 18:07 |
| fungi | not sure if that's what you need | 18:07 |
| clarkb | https://review.opendev.org/c/opendev/system-config/+/894382 passed CI too to update gitea to 1.20.4. I'm going to run some errands around lunch but am otherwise around for either or both | 18:07 |
| clarkb | fungi: I'm guessing the idea is to figure out how large of an input produces the 28gb output index | 18:07 |
| yoctozepto | fungi: I mean the source data that led to that index now :D | 18:07 |
| yoctozepto | exactly | 18:07 |
| clarkb | then you can rough math on how large other instances might be based on their inputs | 18:08 |
| yoctozepto | precisely | 18:08 |
| fungi | oh, i can actually separate that because the directory contains the index and the worktrees it was built from | 18:10 |
| yoctozepto | awesome! | 18:10 |
| fungi | it does include .git directories but seems to be using shallow clones based on a quick survey of what's in there | 18:12 |
| fungi | so should be approximately representative of the worktree sizes | 18:13 |
| yoctozepto | would not it be roughly "divide by 2" then? | 18:13 |
| yoctozepto | I don't remember how shallow copies work | 18:14 |
| fungi | mmm. yeah maybe it will be cleaner to just subtract the .git sizes | 18:15 |
| fungi | yoctozepto: du of all the vcs directories minus du of all their .git subdirs gives me 2151mib or 2.1gib | 18:18 |
| yoctozepto | tyvm, fungi! | 18:19 |
| fungi | so the data directory seems to contain approximately 13x the raw source code | 18:19 |
| fungi | actually more like 12x | 18:21 |
| fungi | the /var/lib/hound/data directory contains 25.3gib | 18:21 |
| fungi | huh, i'm rather disappointed in du's summarizations | 18:27 |
| fungi | `du -sm /var/lib/hound/data` should be mebibytes and reports 28305, yet `du -sb /var/lib/hound/data` reports 27169695799 bytes which is 25911 mebibytes | 18:28 |
| fungi | and it's not a mebibytes vs megabytes confusion i don't think because `du -sBMB /var/lib/hound/data` is supposed to be how you tell it to report in megabytes and that returns 29681 | 18:30 |
| fungi | oh, maybe i need --apparent-size | 18:30 |
| fungi | okay, that's it. if you ask in bytes it seems to return the apparent size automatically, while any other units do actual size rather than apparent size. how confusing | 18:32 |
| fungi | aha, i should read the manpage more carefully... "-b, --bytes: equivalent to '--apparent-size --block-size=1'" | 18:33 |
| fungi | "-m: like --block-size=1M" | 18:34 |
| fungi | so inconsistent, but at least documented | 18:34 |
| clarkb | fungi: did you still want to do gerrit tomorrow? we should review and possibly land https://review.opendev.org/c/opendev/system-config/+/892699/ if so. Also did we state a time for the things tomorrow? | 19:57 |
| fungi | clarkb: oh, i thought i mentioned but maybe i got the dates wrong. i won't actually be around this weekend (out of town for a concert) | 20:02 |
| fungi | i might be able to squeeze in a restart if it's before 16:00 utc, but hitting the road about that time | 20:03 |
| clarkb | oh I missed that | 20:13 |
| clarkb | in that case I'm also happy to stick with the zuul stuff. I think corvus might be out today so being on the safer side is fine | 20:13 |
| clarkb | fungi: maybe you can review the chagne but hold off approving and we can decide later? | 20:14 |
| fungi | sure thing | 20:17 |
| clarkb | my family has asserted they are done doing things for a bit. We have had a busy busy time over the last couple of months. That just means more time for biking and video games | 20:18 |
| fungi | i probably said i would help and forgot i wasn't going to be around, sounds like something i'd do anyway | 20:18 |
| fungi | change lgtm, i'll check out the held node too | 20:20 |
| fungi | yeah, seems to be working as desired | 20:24 |
| fungi | clarkb: there's a couple of exceptions in the error_log, are those benign? | 20:24 |
| fungi | com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalArgumentException: cannot convert null into a String | 20:24 |
| clarkb | good question | 20:26 |
| fungi | looks like there's an occurrence in our production error_log.2023-08-23.gz | 20:26 |
| fungi | did we restart gerrit on that date? | 20:26 |
| fungi | indeed we did | 20:26 |
| fungi | so it seems to maybe only occur at startup and we saw it on the old images too, i think | 20:26 |
| clarkb | https://zuul.opendev.org/t/openstack/build/ab4245df0c494fcdb1821f019afc8d6b/log/review99.opendev.org/logs/error_log#40 that error? | 20:27 |
| clarkb | I think it is related to us not explicitly enabling the plugin but having it installed and ya it occurs previously | 20:27 |
| clarkb | it is trying to load the plugin config and failing because it isn't present | 20:27 |
| fungi | makes sense then, yep | 20:27 |
| dpanech_ | Hello, one of our gerrit reviews (https://review.opendev.org/c/starlingx/gui/+/885834) is failing a zuul gate (https://zuul.opendev.org/t/openstack/build/96a0f650c9f548ae83055d922ed1c467). I think we are missing a couple of OS packages on the zuul host. Would it be possible to install them? | 20:39 |
| dpanech_ | It's a debian/bullseye system, I believe installing these packages should solve the problem: libsasl2-dev libldap2-dev libssl-dev | 20:40 |
| clarkb | dpanech_: if you need extra packages your job should install them | 20:41 |
| clarkb | looks like the job is running the bindep role so you can add dependencies to the repo's bindep.txt file | 20:43 |
| clarkb | https://opendev.org/openstack/nova/src/branch/master/bindep.txt is nova's file for example | 20:44 |
| dpanech_ | clarkb: thanks! | 20:45 |
| clarkb | you're welcome | 20:45 |
| *** enzo is now known as Guest2261 | 20:46 | |
| corvus | clarkb: oh im around | 20:49 |
| clarkb | corvus: oh hi. Not sure if you saw the note about google accounts and zuul things but that might be useful to check for gerrit's zuul too. | 20:49 |
| clarkb | corvus: and then I guess do we still want to do all the things tomorrow (if yes we should land the image update), but fungi won't be able to join | 20:50 |
| corvus | am debugging deduplication of circular dependencies in independent pipelines, so pretty long mental cycles today. i'm up for air now. :) | 20:50 |
| corvus | clarkb: yeah, i saw the gerrit thing; thanks. tbh, i'm not sure if that applies... there is a zuul user in gerrit, but it's authenticated using the google cloud service account... so... <shrug?> :) | 20:52 |
| corvus | like... is it a real account even? and if it is, does using the google cloud service to authenticate reset the login timer? | 20:53 |
| clarkb | corvus: oh I see you're using the cloud account to do double duty there. My guess is as long as that account "pays" then its fine | 20:54 |
| clarkb | the account timeout thing seems to be more of an issue for free idle accoutns | 20:54 |
| corvus | clarkb: plus, if they delete it, we get to have a fun conversation with people at google :) | 20:54 |
| corvus | clarkb: re tomorrow, that still works for me (did we specify a time? or just "morning" which i'd interpret as sometime between 14:00 and 16:00) ? | 20:55 |
| clarkb | 1500 should work for me. I'm also happy to wait on the Gerrit restart since those are much quicker these days we can do them another time | 20:56 |
| corvus | clarkb: okay, if we're not doing a coordinated gerrit restart, then i could probably just do the zuul thing when i wake up which might be a little before 1500; then you could come by at 1500 and maybe say "yup looks fine" or if everything is on fire help put it out. how's that sound? | 20:58 |
| corvus | (if we are coordinating, then syncing at 15:00 sounds better) | 20:58 |
| clarkb | that sounds great to me | 20:59 |
| corvus | kk | 21:01 |
| fungi | i might be around still at that point, though will probably be scarfing down a quick lunch before heading out the door | 21:09 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!