Monday, 2020-11-16

corvusspacex/nasa/jaxa crew-1 launch scheduled in a bit under 30m00:00
*** DSpider has quit IRC00:36
fungisupposed to be able to see it pass overhead here01:05
corvusfungi: i think it did pass over you ~30m ago01:06
fungiyeah, i was otherwise occupied, and it was cloudy here. have seen my share of dots moving through the sky anyway01:07
*** prometheanfire has joined #opendev01:45
*** iurygregory has quit IRC02:07
*** dmsimard has quit IRC02:49
*** dmsimard has joined #opendev02:50
*** fressi has joined #opendev03:29
*** fressi has quit IRC05:02
*** dviroel has quit IRC05:40
*** dviroel has joined #opendev05:40
*** aprice has quit IRC05:41
*** aprice has joined #opendev05:41
openstackgerritMerged opendev/system-config master: Remove rsyslogd xconsole workaround  https://review.opendev.org/75662806:13
*** marios has joined #opendev06:31
*** marios is now known as marios|ruck07:14
*** sboyron has joined #opendev07:16
*** slaweq has joined #opendev07:25
*** rpittau|afk is now known as rpittau07:26
*** iurygregory has joined #opendev07:29
*** ralonsoh has joined #opendev07:33
*** sboyron has quit IRC07:40
*** brinzhang has joined #opendev07:42
*** sshnaidm|off is now known as sshnaidm07:46
*** rpittau is now known as rpittau|bbl07:52
*** eolivare has joined #opendev07:55
*** hashar has joined #opendev08:10
*** sboyron has joined #opendev08:11
*** roman_g has joined #opendev08:29
openstackgerritSlawek Kaplonski proposed zuul/zuul-jobs master: [multi-node-bridge] Add script to configure connectivity  https://review.opendev.org/76265008:33
*** andrewbonney has joined #opendev08:49
*** tosky has joined #opendev08:49
*** fressi has joined #opendev09:22
*** sean-k-mooney2 has joined #opendev10:05
*** sean-k-mooney1 has quit IRC10:08
*** sean-k-mooney has joined #opendev10:27
*** DSpider has joined #opendev10:30
*** sean-k-mooney2 has quit IRC10:30
*** dtantsur|afk is now known as dtantsur10:30
*** sean-k-mooney1 has joined #opendev10:32
openstackgerritJavier Peña proposed opendev/system-config master: Switch CentOS 7 mirror source to kernel.org mirror  https://review.opendev.org/76281210:34
*** sean-k-mooney has quit IRC10:35
*** fressi has quit IRC10:50
openstackgerritLiam Young proposed openstack/project-config master: Add Magpie charm to OpenStack charms  https://review.opendev.org/76281910:59
*** Green_Bird has joined #opendev11:25
*** sean-k-mooney1 has quit IRC11:27
*** sean-k-mooney1 has joined #opendev11:28
*** sean-k-mooney1 is now known as sean-k-mooney11:28
*** rpittau|bbl is now known as rpittau11:30
*** DSpider has quit IRC11:33
*** lpetrut has joined #opendev12:00
*** brinzhang_ has joined #opendev12:48
*** brinzhang has quit IRC12:51
*** DSpider has joined #opendev12:53
*** weshay|ruck has joined #opendev13:22
*** d34dh0r53 has joined #opendev13:45
*** slaweq has quit IRC13:47
*** tbarron has joined #opendev13:47
*** slaweq has joined #opendev13:50
openstackgerritMohammed Naser proposed opendev/irc-meetings master: Update TC to meet weekly  https://review.opendev.org/76284514:10
fricklerinfra-root: seems we have a new failure mode for ipv4-less nodes: https://zuul.opendev.org/t/openstack/build/a7217131f804437bb7321ae4c4354c3e https://d0439ae4739e0ce9dbbb-be043fd2e3d9156a0edcda5d98bda85d.ssl.cf5.rackcdn.com/743007/2/gate/tempest-full-py3/a721713/controller/logs/rabbitmq/startup_log14:24
fricklergiven the backlog for nodes I'm still hesitant to disable that cloud completely, maybe we can build a check in pre that fails with no v4 available?14:25
*** dtroyer has quit IRC14:31
fungithat seems like it might help14:39
*** brinzhang0 has joined #opendev14:46
*** brinzhang_ has quit IRC14:48
*** lpetrut has quit IRC15:05
*** hashar has quit IRC15:32
*** redrobot has quit IRC15:35
*** hashar has joined #opendev15:48
clarkbwe do already have a similar network connectivity check, but I think it is happy if any connectivity exists15:56
clarkbcan probably modify it to assert ipv4 is present15:56
openstackgerritMerged zuul/zuul-jobs master: Create upload-container-image role  https://review.opendev.org/76258116:00
*** mlavalle has joined #opendev16:02
*** eolivare has quit IRC16:44
*** eolivare has joined #opendev16:53
*** mgoddard has joined #opendev16:59
*** marios|ruck is now known as marios|out17:04
openstackgerritMerged opendev/system-config master: Switch CentOS 7 mirror source to kernel.org mirror  https://review.opendev.org/76281217:04
*** Green_Bird has quit IRC17:05
*** Green_Bird has joined #opendev17:06
*** hamalq has joined #opendev17:12
*** rpittau is now known as rpittau|afk17:41
clarkbinfra-root https://review.opendev.org/#/c/762191/1 and https://review.opendev.org/#/c/757153/3 are two gerrit config changes that I Think are safe to land now pre upgrade to prep for thinsg that newer gerrit will want to write into the config17:41
clarkbthis was we don't hve the two sides fighting each other17:41
openstackgerritClark Boylan proposed opendev/system-config master: Clean up old Gerrit html theming and commentlinks  https://review.opendev.org/75716117:45
openstackgerritClark Boylan proposed opendev/system-config master: Remove reviewdb config from Gerrit  https://review.opendev.org/75716217:45
openstackgerritClark Boylan proposed opendev/system-config master: Omnibus Gerrit 3.2 changes  https://review.opendev.org/76289517:45
clarkband ^ there I squashed together the 4 changes we need to land together. I used a new changeid so the old changes are still up and can be viewed independently to aid in debugging if necessary17:45
clarkbI will change the topic on them to avoid confusion though17:45
*** marios|out has quit IRC17:56
*** brinzhang_ has joined #opendev17:56
*** brinzhang0 has quit IRC17:59
*** mgoddard has quit IRC18:05
clarkbfungi: is the ovh work done now?18:07
clarkbtrying to remember when we should reenable swift log storage there18:07
fungi20:00 utc for gra118:10
fungibhs1 was supposedly out of maintenance hours ago18:10
fungibut easier to just batch them together18:10
fungiclarkb: 762712 should go on the pile of gerrit upgrade related changes we can merge ahead of the maintenance window18:15
clarkbfungi: cool, I updated the topic to match what I'ev been using and will review it now18:15
fungiahh, thanks18:16
clarkbfungi: why does that use a proxypassmatch and a rewrite rule?18:16
clarkbI don't think it will hurt anything but the proxypassmatch seems unnecessary?18:18
fungiclarkb: the proxypassmatch line can be used to test the maintenance text while the main proxy is still in use18:18
clarkbah18:18
fungibut you're right, it shouldn't be necessary if the proxy lines lower down are commented out18:18
fungiit seemed like the proxy took effect before the rewrite though if not commented out18:19
fungithere are probably cleaner ways to do it, i came up with that one under pressure during an outage18:20
clarkbsticking with what is known to work seems good :)18:20
clarkbfungi: that change also conflicts with my omnibus squash. Maybe we can land your apache change and the gerrit apache2 changes then I can rebase the remainder of my stack to address that18:28
fungithat works, and yeah i didn't consider we might have vhost changes in that other set18:29
clarkbits the /p/ block cleanup18:29
clarkbwhich isn't suepr critical but I'd like to get it right18:29
clarkbseems easy to foget things like that otherwise18:29
fungioh, yep18:30
*** diablo_rojo has joined #opendev18:31
*** eolivare has quit IRC18:53
fungiclarkb: i had a question on an earlier patchset of 757153 which i don't know if we've covered yet18:53
clarkboh sorry I hadn't seen that. I think that could be a good followup once the upgrade has settled18:54
fungii'll make a note on my to do list18:54
clarkbunrelated I don't see the mirrorupdate server getting updated with the new centos mirror target yet. I'm assuming that means we've got unhappy ansible somewhere18:55
clarkboh wait no18:55
clarkbwe set MIRROR multiple times and only updated it in one place?18:56
clarkbya ok that change only updated centos 7 and not 8 ...18:56
clarkbI guess we can see if centos 7 updates properly18:56
fungiit's in place, i'm tailing the live redirected log on the server and have been for ~15 minutes18:57
clarkbya we didn't update it across the board18:57
clarkbwhich is what confused me18:57
clarkbwe should update it across the board if it works18:57
fungidefinitely hit mirrors.kernel.org for the main centos 7 rsync, and it's updating many, many, many packages18:57
fungistill going18:57
clarkbya centos 8 is still limestone18:57
fungihttps://static.opendev.org/mirror/logs/rsync-mirrors/centos.log should update once it's done18:58
*** andrewbonney has quit IRC19:10
fungilooks like the mirror logs get a vos release at half past every hour, so 17 minutes and that should have the new log entries19:13
fungi(the update completed)19:13
fungisent 593,189 bytes  received 8,342,039,117 bytes  6,818,661.47 bytes/sec19:13
mnaserit would be nice if we can rebuild python-base, there's currently a few fixed CVEs in those base images19:50
mnaserspecifically perl 5.28.1-6+deb10u119:50
mnaserwhich cover CVE-2020-12723, CVE-2020-10878, CVE-2020-1054319:51
clarkbmnaser: if you push up a change we can land that and it will be rebuilt19:52
mnaserwhat sort of noop change pattern is used?19:53
clarkbI think in the past we've justmodified a comment in the dockerfile19:54
mnaser"I couldn't come up with a good actual change so I added a . to a comment instead." :p19:55
openstackgerritMohammed Naser proposed opendev/system-config master: python-base: rebuild images  https://review.opendev.org/76290819:56
*** kwazar has joined #opendev20:00
*** ralonsoh has quit IRC20:00
*** dtantsur is now known as dtantsur|afk20:02
clarkbfungi: ^20:10
fungithanks!20:16
fungialso we've actually pushed up "null" changes in the past to trigger these too20:16
fungigit commit --allow-empty -m "Update the image to address some vulnerabilities"20:17
fungimnaser: clarkb: ^ in case you need the recipe in the future20:17
mnaserfungi: would that trigger everything?  would I do a git add for the non edited file?20:18
clarkbya the trouble we've run into is that you need the files to be edited for the publish jobs to run20:18
clarkbthis is why my edits to gerrit image jobs recently that only updated plugin versiosn didn't publish anything20:19
fungiahh, yeah if we do files matchers then that could be a problem20:19
clarkbwe ran the build jobs but then didn't run the publish jobs20:19
*** hashar has quit IRC20:21
*** roman_g has quit IRC20:36
*** iurygregory has quit IRC20:40
*** iurygregory has joined #opendev20:43
openstackgerritMerged opendev/base-jobs master: Revert "Temporarily stop OVH log uploads for maintenance"  https://review.opendev.org/76269721:10
*** DSpider has quit IRC21:16
openstackgerritJeremy Stanley proposed opendev/irc-meetings master: Update Airship meeting time and week  https://review.opendev.org/76292221:25
openstackgerritMerged opendev/system-config master: python-base: rebuild images  https://review.opendev.org/76290821:31
ianwdo we know mirror01.us-east.openedge.opendev.org is down?21:32
clarkbianw: yes, OE's edge router died21:34
clarkbI guess we need to put it in the emergency file?21:34
clarkb(I didn't think of that when donnyd mentioned the router had died)21:34
ianwoh, i see it's still at 0.  i'll put it in emergency to avoid bridge job failures21:34
clarkbI'm putting the meeting agenda together. Anything else to add to it?21:43
*** sboyron has quit IRC22:08
*** sboyron has joined #opendev22:09
clarkbmelwitt: logstash is still looking good22:14
diablo_rojofungi, or clarkb would you mind giving this a review when you've got a moment? https://review.opendev.org/#/c/762590/22:15
clarkbya one sec22:16
fungithird thursday of the month, eh?22:17
clarkbquadweekly-week-3 I think you mean22:17
melwittclarkb: nice, so far so good22:17
diablo_rojofungi, yep22:18
diablo_rojoHopefully I did that right..22:18
diablo_rojothanks clarkb!22:20
openstackgerritMerged opendev/irc-meetings master: Add OpenStackSDK Meeting  https://review.opendev.org/76259022:37
*** slaweq has quit IRC22:39
*** slaweq has joined #opendev22:48
*** tosky_ has joined #opendev22:52
*** tosky is now known as Guest4141922:55
*** tosky_ is now known as tosky22:55
*** Guest41419 has quit IRC22:55
*** slaweq has quit IRC22:58
*** sboyron has quit IRC23:03
*** slaweq has joined #opendev23:07
*** slaweq has quit IRC23:13
*** Green_Bird has quit IRC23:22

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!