Thursday, 2022-02-24

opendevreviewVerification of a change to openstack/kayobe master failed: ntp: Remove removal of chrony container  https://review.opendev.org/c/openstack/kayobe/+/82748702:04
opendevreviewwangxiyuan proposed openstack/kolla-ansible master: [WIP]Add openEuler Distro support  https://review.opendev.org/c/openstack/kolla-ansible/+/83011502:32
opendevreviewwangxiyuan proposed openstack/kolla-ansible master: [WIP]Add openEuler Distro support  https://review.opendev.org/c/openstack/kolla-ansible/+/83011507:02
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible master: Add missing services to logrotate  https://review.opendev.org/c/openstack/kolla-ansible/+/83043307:50
mnasiadkamorning07:59
sri_morning 08:01
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add openvswitch and prometheus to logrotate  https://review.opendev.org/c/openstack/kolla-ansible/+/83043308:03
mnasiadkayoctozepto: I hate useless commit messages ;-)08:03
fricklermnasiadka: +108:08
mnasiadkafrickler: do you know if Rocky builds work now? I noticed the EPEL patch to DIB has been merged.08:19
yoctozeptomnasiadka: "useless" is a bit harsh but yours is better08:19
SvenKieskemorning! is the above logrotate fix going to be backported? seems fairly simple08:20
mnasiadkayes, just added "should backport" flag08:22
mnasiadkafrickler: I'll reply to myself, now it's this to fix: https://review.opendev.org/c/opendev/glean/+/83053908:26
wxy-xiyuan_Hi team, I'm facing a problem that the VM created from nova can't be ping and ssh. https://zuul.opendev.org/t/openstack/build/7987ce78edfd4ed792b53bda220eee6a It looks that DHCP maybe hits the problem. Any idea about the issue? Big thanks08:29
mnasiadkacheck openvswitch log08:38
SvenKieskewhat do you think, is it worthwhile backporting this? https://review.opendev.org/c/openstack/kolla-ansible/+/758576 I will need to backport it internally anyway, so I thought it might be cool to get it upstream as well. I still need some review btw, if you don't mind. :) 08:47
mnasiadkaFirst let's merge it in master :) You can propose a backport then - since it's a bugfix08:55
SvenKieskecool :)08:58
*** hrw is now known as Guest36909:00
*** hrww is now known as hrw09:00
*** Guest369 is now known as hrw09:00
opendevreviewSven Kieske proposed openstack/kolla-ansible master: re-add rabbitmq config for interfaces  https://review.opendev.org/c/openstack/kolla-ansible/+/75857609:02
*** hrw is now known as Guest37109:16
*** hrww is now known as hrw09:16
wxy-xiyuan_neutron-openvswitch-agent doesn't refresh iptable rules, but it seems there is no erorr raised in the agent log. 09:36
opendevreviewMerged openstack/kolla-ansible master: Add openvswitch and prometheus to logrotate  https://review.opendev.org/c/openstack/kolla-ansible/+/83043310:37
opendevreviewMerged openstack/kolla-ansible stable/xena: CI: Bump Ceph to Pacific  https://review.opendev.org/c/openstack/kolla-ansible/+/82875710:37
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible stable/xena: Add openvswitch and prometheus to logrotate  https://review.opendev.org/c/openstack/kolla-ansible/+/83071211:15
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible stable/wallaby: Add openvswitch and prometheus to logrotate  https://review.opendev.org/c/openstack/kolla-ansible/+/83071311:15
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible stable/victoria: Add openvswitch and prometheus to logrotate  https://review.opendev.org/c/openstack/kolla-ansible/+/83071411:16
opendevreviewRadosław Piliszek proposed openstack/kolla-ansible stable/victoria: Add openvswitch and prometheus to logrotate  https://review.opendev.org/c/openstack/kolla-ansible/+/83071411:17
opendevreviewMerged openstack/kayobe stable/xena: Sync enable flag defaults with kolla ansible  https://review.opendev.org/c/openstack/kayobe/+/83057811:27
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Remove stale interfaces  https://review.opendev.org/c/openstack/kayobe/+/83022211:35
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Remove stale interfaces  https://review.opendev.org/c/openstack/kayobe/+/83022211:55
jingvarHi!12:26
jingvarHow can I update certs on a working cloud12:27
yoctozeptojingvar: hi, update them in the deployment config and rerun the deploy13:01
jingvarthe main question what happens with cloud, recrteating enpoints etc?13:21
priteaumnasiadka: Are you planning to submit Kolla cycle highlights this week so they can be integrated in marketing material?13:26
mnasiadkapriteau: it's still in the plan, although I had some unplanned support work ;)13:36
mnasiadkapriteau: if you have any proposals for highlights, feel free to pass them to me :)13:40
priteaumnasiadka: for kayobe, I think the support for building multiple disk images through direct use of diskimage-builder is worth mentioning13:43
priteaufor kolla, libvirt-exporter13:43
mnasiadkapriteau, yoctozepto, mgoddard: https://review.opendev.org/c/openstack/releases/+/830821 - feel free to update if there's anything missing.14:04
yoctozeptomnasiadka: extra whitespace14:05
yoctozeptomnasiadka: I wonder if we can use highlights to mention deprecation of binary14:06
yoctozeptoas it's quite a highlight14:06
yoctozeptojingvar: haproxy will bounce14:06
mnasiadkayoctozepto: so add it there, I feel like in a middle of warfare today :)14:07
yoctozeptoso existing connections will be terminated14:07
yoctozeptomnasiadka: I'm not sure if it's appropriate, waiting for opinions of others14:07
mnasiadkayoctozepto: mgoddard is off today, so I guess we can ask priteau and frickler for opinions :)14:08
yoctozepto++14:08
priteauyoctozepto: I fixed the whitespace14:08
yoctozeptopriteau ++14:08
yoctozeptothough that was not disputable :D14:08
priteauCycle highlights give a high-level, user-focused summary of what has changed in the latest release. This is not necessarily the most technically complex work you accomplished in the release, but is the work that will have the largest impact on users.14:09
priteauDefinitely binary should be mentioned, according to these criteria14:09
yoctozeptook, so I felt right14:09
priteauFeel free to add it on top14:09
yoctozeptoadded14:10
yoctozeptoI wonder if lines need to broken14:11
yoctozeptowe will see14:11
mnasiadkayoctozepto: https://ethercalc.openstack.org/kolla-ovs-versions - look at the bug in the bottom (I did a proper facepalm today) :)14:36
yoctozeptomnasiadka: oh no!15:04
mnasiadkayoctozepto: currently I solved it downstream, but question if we want to solve it upstream15:05
yoctozeptoyeah, it looks like relying on upper constraints does not make sense?15:06
yoctozeptowhat makes sense then?15:06
yoctozeptosurely the testing is faulty if it missed it15:06
yoctozeptomeh15:06
mnasiadkaI don't think we're testing Octavia with OVN15:09
yoctozeptomnasiadka: we are15:10
yoctozeptobut I meant for neutron/octavia15:10
mnasiadkaWell, they test OVS version they use in CI, and I guess it's not 2.16/2.1715:10
mnasiadkaAnd the commit I located in openvswitch repo - probably that's the only case of breakage when you use OVS 2.1615:11
yoctozeptomnasiadka: hmm15:11
yoctozeptocanonical used to bump ovs in devstack15:11
mnasiadkabased on the bug report - we should be using python ovs package version the same as installed openvswitch15:11
yoctozeptomaybe they forgot, eh15:11
yoctozeptohmm15:12
yoctozeptowe can override that one thing15:12
mnasiadkaand what is even more bizarre - this bug is visible in Octavia, but not in Neutron (which is doing all operations in the background and properly retrying the connection until they don't hit this bug)15:12
yoctozeptoodd15:20
mnasiadkawell, not really odd, for some reason ovn-octavia-provider is doing the tasks and responding to user API call that they are done (instead of doing them in background)15:24
yoctozeptomhm15:32
mnasiadkabut anyway, it's just a workaround to retry and retry the OVSDB transaction and wait for proper seq_no ;)15:43
yoctozeptoyeah, kinda dumb15:43
yoctozeptoI would go with overriding the ovs python package version15:43
yoctozeptojust need to know the version (-:15:44
mnasiadkawell, I guess newest should work on older OVS, just not the other way around15:44
yoctozepto*maybe*15:45
yoctozeptothough I would not risk going assuming 2 versions back are still supported15:46
yoctozeptoas it's the usual contract boundary15:46
mnasiadkaOther option is just to pin to some version15:46
mnasiadkaJust wondering if removing upper-constraints entry and using distro provided python3-openvswitch would not work here.15:47
mnasiadka(this way we would get consistent ovs pip package with installed openvswitch)15:48
mnasiadkaAnd I stumbled also across this - https://review.opendev.org/c/openstack/kolla/+/701880 - wonder if it's needed anymore - because we're carrying this :)15:49
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: Use stream8 images with molecule  https://review.opendev.org/c/openstack/kayobe/+/83072515:50
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: Set correct gateway for the bifrost provision network  https://review.opendev.org/c/openstack/kayobe/+/82774515:51
yoctozeptomnasiadka: no idea, probably yes, who knows15:51
yoctozeptoanyway, it makes sense to me to use distro-provided version15:51
yoctozeptosame like libvirt15:51
yoctozepto(the reason why I prefer containerised libvirt is that we control both sides)15:52
mnasiadkaOk, I'll try the distro approach and let's see what breaks.15:53
yoctozepto++15:54
yoctozeptodo you recall any other similar deps?15:54
yoctozeptoI can't15:54
jingvar<yoctozepto: for some reasons  openstack.kolla/centos-source-prometheus-openstack-exporter:xena   "dumb-init --single-…"   9 days ago       Up 20 minutes   15:55
yoctozeptoI don't understand why I'm called15:55
jingvarok, thanks15:56
opendevreviewMichal Nasiadka proposed openstack/kolla master: WIP: Use python3-openvswitch from distro  https://review.opendev.org/c/openstack/kolla/+/83084416:01
opendevreviewMichal Nasiadka proposed openstack/kolla master: Revert "neutron: fix build in stable branches"  https://review.opendev.org/c/openstack/kolla/+/83085816:01
mnasiadkalet's see if that is still required16:02
mnasiadkabecause looks at least funny16:02
mnasiadkaand neutron itself is not in upper-constraints anymore16:03
yoctozeptomnasiadka: neutron ovs agent does not need it?16:05
mnasiadkahttps://review.opendev.org/c/openstack/requirements/+/55303016:05
yoctozeptomnasiadka: I mean ovs16:05
mnasiadkayes, it uses ovsdbapp, which is a ,,middleware'' for talking to ovs library - but we install python3-openvswitch in neutron-base I think16:06
mnasiadkayes we do, in neutron-base16:06
mnasiadkaeven in source16:06
mnasiadkaI think dropping binary in Zed will be fun, finding all these additional packages which we don't need in -source16:07
yoctozeptointeresting16:08
yoctozeptoso it was feeding neutron already16:08
yoctozeptoit should be in ovs agent though16:08
yoctozeptono need for server to talk to ovs16:09
yoctozeptoor linuxbridge16:09
mnasiadkaserver talks with ovs - in ovn case16:09
mnasiadkaovn dbs are ovsdb :)16:09
yoctozeptoand it's the same library then, got it16:09
yoctozeptoand l3 and dhcp also talk to it16:09
yoctozeptomakes sense16:09
yoctozeptook16:09
yoctozeptoso we should be good with your patch16:09
mnasiadkabut I think it was downgraded due to upper-constraints.txt entry16:09
yoctozeptoyeah, it should have got reinstalled16:10
yoctozeptobut you could check16:10
yoctozeptofor sanity16:10
mnasiadkayeah, waiting for CI to build images and will check the logs16:10
yoctozeptoI mean before the change16:11
mnasiadkaah, yeah - let's see16:11
mnasiadkayes, it is being downgraded to 2.1316:12
yoctozeptook, then we have our sanity16:14
mnasiadkahmm, not really downgraded, installed freshly in the venv under /var/lib/kolla/venv16:19
mnasiadkaah right, now I get it, we're creating the venv in openstack-base16:19
mnasiadkaso python3-openvswitch would need to be installed there16:19
yoctozeptois not the venv including system packages?16:22
yoctozeptoit doesn't matter when you install then16:22
mnasiadkait is16:23
mnasiadkaok then, so maybe due to upper-constraints.txt it was installing older in the venv16:23
yoctozeptoyes16:23
yoctozeptoit should stop now16:23
yoctozeptoif you filtered right16:23
yoctozeptowe'll see16:23
yoctozeptoI've also sent "check experimental" to test a bit more16:24
mnasiadkahttps://9a0240ca9f61a595b570-86672578d4e6ceb498f2d932b0da6815.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/kolla/master/kolla-publish-centos8s-source-quay/772ff82/kolla/build/neutron-base.log16:24
mnasiadkayep, tried to uninstall and installed older in the venv path16:25
opendevreviewMerged openstack/kayobe master: ntp: Remove removal of chrony container  https://review.opendev.org/c/openstack/kayobe/+/82748716:30
mnasiadkaINFO:kolla.common.utils.neutron-base:Requirement already satisfied: ovs>=2.10.0 in /usr/lib64/python3.6/site-packages (from neutron==19.1.0.dev536) (2.15.4)16:56
mnasiadkalooks ok16:56
mnasiadkaUbuntu feels the same16:57
mnasiadkaINFO:kolla.common.utils.neutron-base:Requirement already satisfied: ovs>=2.10.0 in /usr/lib/python3/dist-packages (from neutron==19.1.0.dev536) (2.16.90)16:57
opendevreviewMichal Nasiadka proposed openstack/kolla master: Use python3-openvswitch from distro  https://review.opendev.org/c/openstack/kolla/+/83084417:00
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: CentOS Stream: update DNF repo file names  https://review.opendev.org/c/openstack/kayobe/+/83087317:06
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: Use stream8 images with molecule  https://review.opendev.org/c/openstack/kayobe/+/83072517:07
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: CentOS Stream: update DNF repo file names  https://review.opendev.org/c/openstack/kayobe/+/83087317:10
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: Use stream8 images with molecule  https://review.opendev.org/c/openstack/kayobe/+/83072517:11
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: Set correct gateway for the bifrost provision network  https://review.opendev.org/c/openstack/kayobe/+/82774517:11
fricklershould we mention ansible-kolla-collection in the highlights or that something for the next cycle?17:18
opendevreviewFranco Mariotti proposed openstack/kolla-ansible master: exposes Prometheuss exporters on kolla external interface  https://review.opendev.org/c/openstack/kolla-ansible/+/83087717:25
mnasiadkafrickler: I don't know if that's any feature for the users, we might add something later when that's merged and working in Kayobe :)17:31
opendevreviewMichal Nasiadka proposed openstack/kolla master: Use python3-openvswitch from distro  https://review.opendev.org/c/openstack/kolla/+/83084417:38
opendevreviewFranco Mariotti proposed openstack/kolla-ansible master: exposes Prometheuss exporters on kolla external interface  https://review.opendev.org/c/openstack/kolla-ansible/+/83087717:45
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: CI: set kayobe-*-upgrade-centos8s jobs non-voting  https://review.opendev.org/c/openstack/kayobe/+/83088618:41
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: CI: set kayobe-*-upgrade-centos8s jobs non-voting  https://review.opendev.org/c/openstack/kayobe/+/83088619:11
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: Set correct gateway for the bifrost provision network  https://review.opendev.org/c/openstack/kayobe/+/82774519:12
opendevreviewPierre Riteau proposed openstack/kayobe stable/victoria: CI: drop failing jobs on stable/victoria  https://review.opendev.org/c/openstack/kayobe/+/83090721:59
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: CI: temporary disable voting of some jobs  https://review.opendev.org/c/openstack/kayobe/+/83088622:27
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: CentOS Stream: update DNF repo file names  https://review.opendev.org/c/openstack/kayobe/+/83087322:29
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: Use stream8 images with molecule  https://review.opendev.org/c/openstack/kayobe/+/83072522:29
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/victoria: Set correct gateway for the bifrost provision network  https://review.opendev.org/c/openstack/kayobe/+/82774522:31

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!