Monday, 2024-04-29

opendevreviewJulia Kreger proposed opendev/glean master: Detect ironic, and skip partition mount.  https://review.opendev.org/c/opendev/glean/+/91727800:36
opendevreviewMerged openstack/diskimage-builder master: Add Ubuntu 24.04 (noble) build to testing  https://review.opendev.org/c/openstack/diskimage-builder/+/91591507:51
opendevreviewJan Marchel proposed openstack/project-config master: Add new repository for NebulOuS testing data  https://review.opendev.org/c/openstack/project-config/+/91687613:00
fricklermnaser: did you ever get to look at the unplanned shutdown of review.opendev.org?13:57
fungifrom roughly a month ago, 2024-03-26 according to my notes14:02
fungidmesg indicates the reboot occurred at 03:40:41 utc, but no idea how accurate the clock was that early in the boot process14:03
fricklerinfra-root: I'm in the process of setting up the new afs volume mirror.ceph-deb-reef, but I'm a bit confused by the acl part https://docs.opendev.org/opendev/system-config/latest/afs.html#mirrors14:18
fricklerfrom what I see for existing volumes, we don't use a specific account, but service.reprepro for all of these?14:19
fungigood question. i mainly use that document as a source of hints to remind me what the various commands and subcommands are, but for things like quotas and acls i tend to compare to other existing volumes that have a similar purpose14:22
fricklerthat would have been my idea, too. so I guess I'll go ahead with that and see how it works out14:23
fungisince we create volumes for a variety of different purposes, and for mirrors specifically we have a variety of scripts relying on different tools and grouped in different ways, i'm not surprised that the doc might have e.g. been written based on an rsync mirror and reprepro mirrors are done a different way14:25
*** dhill is now known as Guest259814:38
clarkbfungi: if you have time https://review.opendev.org/c/opendev/glean/+/916952 is part of the xenial cleanup work and is also a logical followon to our recent glean udpates (basically get the ci jobs to match something closer what our priorities are)14:54
clarkbdid zigo and tkajinam's emails arrive out of order for anyone else? I suspect this is because tkajinam was copied directly so wasn't affected by delay in lists deliveries but then zigo's mail server delivered the email to lists.openstack.org much later which was then compounded by the lists.openstack.org delivery delays?14:58
clarkbor maybe it is a problem with my mailserver and lists.openstack.org is only having trouble deliverying to me?14:59
zigoclarkb: My fault, my mail went moderated because using the wrong email address, sorry.14:59
clarkboh that would explain it. Just making sure we don't have any problem to investigate on our side. Thank you for the clarification15:00
zigoIs there a way to get my personal email address whitelisted, even though it's not subscribed?15:00
zigoBecause that happens to me often ... :/15:00
clarkbyou may be able to associate it with your mailman3 account, but I'm not sure15:00
clarkbit does look like you can have multiple addresses for each mailman3 user account, but that addresses are explicitlypart of lists and not just the account15:01
clarkbso you'd have to add the email to the account then add the email to the list?15:01
fungizigo: one option is to subscribe it but set the subscription's delivery method to disabled15:07
zigofungi: Ok, thanks.15:10
fungii'm headed out to lunch, back soon15:10
zigoBTW, "subscriber only post" is a bad idea. It's annoying well behaving persons when posting, only because of bad spammers, which should never be done.15:11
clarkbuntil you're the person who has to combat the spam15:12
zigoI respectfully don't agree! :)15:13
JayFYeah you have no idea how many crap messages fungi and I (mostly fungi) have to reject outta the queue15:13
JayFThe list would be unusable if we allowed unrestricted non-subscriber mosting15:13
JayF**posting15:13
* zigo wonders .oO( how the debian listmasters are doing )15:14
clarkbthe upstream mailing lists for mailman even require first post moderation. Which has been discussed here to help mitigate against spam coming directly via the web ui15:20
clarkbbut that seems to have remained infrequent enough15:20
clarkbfrickler: all of the existing noble related changes have merged right?15:22
clarkblooks like both dib changes have landed and I think the project-config change for element updates also landed15:22
fricklerclarkb: I think so, yes15:34
clarkbthanks for confirming. Want to make sure I'm not letting thigns slip after the weekend15:34
fricklertests on the ceph reef patch are passing now. I would like to approve it now and assume that the mirror is small enough that manual first-seeding isn't necessary https://review.opendev.org/c/opendev/system-config/+/91655215:47
clarkblooks like the other ceph volumes are under 5GB I agree it should be fine to let that run automatically without manual seeding15:50
opendevreviewMerged opendev/glean master: Update zuul config to drop xenial jobs  https://review.opendev.org/c/opendev/glean/+/91695216:19
fungizigo: perhaps surprisingly, we mostly catch the spam posts because they're not from subscribers, and catch the ones spoofed from subscribers because they're over the default length limit. i agree a more robust solution would involve something like spamassassin and clamav as early filters in mailman before handing off to mailman, but that does require someone to take the time to set up and16:51
fungimaintain it16:51
JayF(and right now, until I volunteered to help, fungi was the only person even doing the moderation in the panel ... so evidence points to little interest in helping with maintenance of the ML)16:52
fungiactually the upstream mailman lists require posts to come from subscribers, but *in addition* they screen initial posts from those new subscribers to make sure they're not spam, and then switch them from moderated to allowed. they immediately reject posts from non-subscribers16:52
fungizigo: the debian mailing lists frontend everything with separate spam filters, which has the alternative downside of annoying legitimate senders who send something with a disallowed pattern inside their message content16:54
AlbinVass[m]Is it possible to use opendevs zuul for personal GitHub projects? I wanna use zuul but I don't want to host it myself :)16:56
clarkbAlbinVass[m]: no we are not a general purpose ci system for github16:58
opendevreviewMerged opendev/system-config master: Ubuntu 22.04: Add ceph quincy and reef to mirror  https://review.opendev.org/c/opendev/system-config/+/91655216:58
clarkbwe do support third party testing of things hosted in opendev against things hosted in github but that requires an opendev project host the jobs and pipeline definitions and work through the problems in github if/when they arise16:58
fungiAlbinVass[m]: the original summary of our position on that can be found in https://lists.openstack.org/pipermail/openstack-infra/2019-January/006269.html17:00
AlbinVass[m]clarkb: yeah I thought so. Worth asking though, but I should probably set it up myself. The uptime probably won't be as good17:00
fungithe "kata experiment" mentioned in that post was wound down about a year later when the project involved seemed disinterested in helping with opendev's side of things17:01
fungiour (albeit limited) experience has been that users who don't have a vested interest in interacting with the code review and code hosting platforms we maintain are also disinterested in assisting with the ci/cd system we've integrated with them17:02
fungiand tend to be purely consumers, not collaborators17:03
fungimirror config deploys are failing because (unused) mirror01.sjc1.vexxhost is unavailable17:08
fungiopenstack server show indicates the instance's status is "active"17:10
fungiopenstack console log show doesn't include anything useful (ends with a login prompt)17:12
fungii'll try rebooting it from the api17:13
fungidoing `openstack server reboot` doesn't seem to have made it reachable, even though `openstack console log show` indicates that it did reboot17:20
fungimnaser: guilhermesp: ^ anything odd going on in vexxhost sjc1?17:20
mnaserfungi: do you have vm uuid handy?17:21
fungimnaser: a23a4761-58f3-4237-a2da-30717f96a6fa17:22
mnaserah, I think that HV got stuck somehow a few days ago.17:23
fungimnaser: thanks for checking it!17:23
mnaserfungi: how about now ?17:24
fungimnaser: still seeing "ssh: connect to host mirror01.sjc1.vexxhost port 22: No route to host"17:25
mnaserYou might need to give it a reboot it probably timed out on dhcp attempts17:25
fungiping to its ipv6 address is returning "Destination unreachable: Address unreachable"17:25
fungiokay, thanks, will reboot it again now17:26
fungiyay, another reboot and it's responding to ping again17:27
fungiyep, i can ssh into it again17:28
fungithanks mnaser!17:28
mnaserNo problem. Sorry about that17:28
fungino worries, just weren't sure what was going on17:28
clarkbLooking at more xenial cleanup stuff openstack-python-jobs runs on bionic for python2.7 so that one isn't impacted thankfully17:32
clarkbhttps://codesearch.opendev.org/?q=openstack-python35-jobs&i=nope&literal=nope&files=&excludeFiles=&repos= shows the reach of the python35 jobs on master though. A couple of those jump out to me: the already mentioned devstack-gate and bashate17:34
clarkbbashate is no longer developed on opendev right? I Guess no one took the time to retire it after they moved it to github?17:34
clarkboh and openstack/releases is using that template17:34
clarkbthough I don't see the jobs reporting to releases so maybe it isn't actually used?17:35
clarkboh its in a comment so ya its just example code in releases. Nevermind that one17:36
clarkbAs a heads up I've had a meh start to the week. GOing to try and reboot my day over lunch and go for a bike ride and generally try to reset things18:32
fungisounds good, not a ton of stuff going on anyway. good luck!18:35
opendevreviewJulia Kreger proposed openstack/diskimage-builder master: ConfigDrive: Disable cloud-init auto dhcp by default  https://review.opendev.org/c/openstack/diskimage-builder/+/89988618:39
opendevreviewClark Boylan proposed opendev/afsmon master: Update afsmon python testing to modern versions  https://review.opendev.org/c/opendev/afsmon/+/91747018:40
clarkbthat repo would be an easy one to move to the opendev tenant18:41
fungioh, yeah probably so18:42
clarkbI think for many of the other projects with python35 templates in their zuul confings I may just propose we drop them from zuul's tenant config18:42
clarkbspot checking them many haven't had any updatse since the opendev reorg and assocaited .gitreview file updates18:43
fricklerseems the sjc1 issue also caused our periodic jobs fail early at infra-prod-base for the last three days https://zuul.opendev.org/t/openstack/builds?job_name=infra-prod-base&project=opendev/system-config , only confirmed in the log for the last run though18:43
fungimakes sense18:46
fungithose should hopefully get back to working again18:46
fricklerdo we have ppl from starlingx around to ping about https://zuul.opendev.org/t/openstack/config-errors?project=starlingx%2Fzuul-jobs&skip=0 ?19:21
fungislittle: ^19:44
opendevreviewClark Boylan proposed opendev/system-config master: Update etherpad to v2.0.3  https://review.opendev.org/c/opendev/system-config/+/91411921:18
opendevreviewClark Boylan proposed opendev/system-config master: DNM force etherpad failure to hold node  https://review.opendev.org/c/opendev/system-config/+/84097221:18
clarkbthere is a 2.0.3 release now so I've udpated that stack to make it mergeable. I have also rotated the autohold for the DNM change21:20
clarkbnow to sort out a meeting agenda for tomorrow21:20
clarkbok I'ev got my edits into the meeting agenda21:28
clarkbI'll send that out later today when others have had a chance to edit21:28
opendevreviewClark Boylan proposed opendev/afsmon master: Update afsmon python testing to modern versions  https://review.opendev.org/c/opendev/afsmon/+/91747021:43

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!