opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Deprecate OpenDaylight support https://review.opendev.org/c/openstack/openstack-ansible/+/897437 | 06:27 |
---|---|---|
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Tune SSH in pre-step setup https://review.opendev.org/c/openstack/openstack-ansible/+/899318 | 07:45 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: DNM test metal CI speed without connection plugin https://review.opendev.org/c/openstack/openstack-ansible/+/899312 | 07:47 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: DNM test metal CI speed without connection plugin https://review.opendev.org/c/openstack/openstack-ansible/+/899312 | 07:47 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: DNM test metal CI speed without connection plugin https://review.opendev.org/c/openstack/openstack-ansible/+/899312 | 07:47 |
opendevreview | Merged openstack/openstack-ansible master: Map default value of rabbitmq_management_ssl to haproxy_ssl https://review.opendev.org/c/openstack/openstack-ansible/+/899416 | 11:14 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Map default value of rabbitmq_management_ssl to haproxy_ssl https://review.opendev.org/c/openstack/openstack-ansible/+/899331 | 11:46 |
opendevreview | Merged openstack/ansible-role-zookeeper master: Use jdk 17 for Zookeeper https://review.opendev.org/c/openstack/ansible-role-zookeeper/+/899386 | 12:25 |
opendevreview | Merged openstack/openstack-ansible-os_gnocchi stable/2023.1: Use proper galera port in configuration https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/892356 | 12:57 |
spatel | morning folks!! | 13:20 |
NeilHanlon | mornin'! | 13:20 |
spatel | Finally I got little time today to breath so saying Helll | 13:21 |
spatel | hello* | 13:21 |
NeilHanlon | that is good to hear! It's been quite a week | 13:21 |
spatel | Yep!! | 13:38 |
spatel | I am busy in building out new datacenter and its giving me tough time :( | 13:38 |
spatel | Its not easy to start thing from scratch!! | 13:39 |
NeilHanlon | :( hopefully you won't have to work this weekend? | 13:39 |
spatel | Not weekend but in to late nights :) | 13:39 |
spatel | I am almost done!! hope next week start rolling out openstack | 13:40 |
NeilHanlon | No no it's not.. I had to do something similar a few years ago under a time crunch. Was only in town for a week and I had to install and bootstrap a whole new network and get traffic flowing to our old cage | 13:40 |
NeilHanlon | nice! :) | 13:40 |
spatel | My developer asking for k8s cluster so spending lots of time there to make it right :) | 13:42 |
spatel | Do you guys still using openvswitch plugin for production or OVN? | 13:42 |
NeilHanlon | https://drop1.neilhanlon.me/irc/uploads/db0b9822a4757f71/image.png relevant re: kubernetes ;) | 13:44 |
NeilHanlon | I'm still using ovs in my `production` -- though it's really not anything close to production, just my home lab. Slowly I am trying to move to OVN (though, reluctantly) | 13:45 |
mgariepy | lol kubernetes | 13:52 |
mgariepy | I have both in prod but not much beside base and manila services for now. | 13:54 |
jamesdenton | spatel we are all OVS here, but next big production cloud is slated to use OVN. Need to really determine parity, though | 13:54 |
spatel | NeilHanlon lol for that funny link :) | 13:54 |
spatel | jamesdenton I am still worried to deploy OVN.. just human nervousness | 13:55 |
spatel | I don't want to end up midnight to debug something I am not very good at.. | 13:56 |
spatel | I am planning to deploy small 60 node cluster using OVN in next few month just to use for k8s. | 13:56 |
spatel | currently deploying 600 node cloud but thinking to use OVS only. | 13:57 |
spatel | 600 for OVN will be big milestone.. I would start with 60 first to get hands on | 13:57 |
NeilHanlon | I think it is smart to stick with what you know while learning the new thing | 13:57 |
spatel | +1 | 13:57 |
jamesdenton | spatel i am nervous too :) | 13:57 |
NeilHanlon | OVN makes sense to me conceptually, but I grok the concepts themselves. For me, though, I just don't have the scale at which I require something like OVN | 13:58 |
spatel | I am reading all mailing list everyday and people brining strange issues with OVN and I have no idea what are those :) | 13:58 |
NeilHanlon | Remember RFC 1925 | 13:58 |
NeilHanlon | (6) It is easier to move a problem around (for example, by moving | 13:58 |
NeilHanlon | the problem to a different part of the overall network | 13:58 |
NeilHanlon | architecture) than it is to solve it. | 13:58 |
jamesdenton | #truth | 13:59 |
spatel | :) | 13:59 |
opendevreview | Merged openstack/openstack-ansible stable/zed: Define install_method default when hosts resolution depend on it https://review.opendev.org/c/openstack/openstack-ansible/+/898073 | 13:59 |
mgariepy | i aggree it's a whole set of new tool to learn. | 13:59 |
NeilHanlon | (yes, I _do_ have that RFC bookmarked 😂) | 13:59 |
spatel | I think OVN is better fit for k8s the way it works | 13:59 |
spatel | The Twelve Networking Truths RFC 1925 | 13:59 |
spatel | jamesdenton my engineering asking can we ssh to k8s pod/container... :O | 14:00 |
spatel | I think k8s doesn't support to take your native vlans to pod level correct? | 14:01 |
spatel | In GCP you can do that but I am sure they are using BGP to make it possible | 14:01 |
spatel | They want to bring physical server and pods on same vlan so they can talk to each other without LB etc.. shit to expose things | 14:02 |
spatel | Did you guys try nomad ? - https://bluexp.netapp.com/blog/cvo-blg-kubernetes-vs-nomad-understanding-the-tradeoffs | 14:03 |
jamesdenton | i think using native k8s constructs is prob best for everyone. lots of terrible ideas out there :D | 14:07 |
spatel | lol | 14:08 |
spatel | How do you maintaining so many virtual routers for k8s? | 14:09 |
spatel | That is different challenge with openvswitch | 14:10 |
mgariepy | spatel, are you using ovs flow with ovs ? or still on iptables shim ? | 14:21 |
spatel | Planning to use ovs flow instead of iptables | 14:23 |
spatel | why? any thing i should be worry? | 14:23 |
mgariepy | no | 14:23 |
mgariepy | it works flawlessly | 14:23 |
spatel | ++++1 | 14:23 |
mgariepy | it's just not iptables. and need a new parser in your brain to read/understand it ;) | 14:24 |
spatel | I see | 14:24 |
spatel | mostly every few time you have to deal with that level of debugging.. | 14:24 |
mgariepy | good news is that it's the same for ovn after that.. | 14:24 |
spatel | Yes! | 14:25 |
noonedeadpunk | Folks, does anybody see `LIBVIRT_PRT` iptables table for nat on ubuntu 22.04 compute node? | 16:07 |
spatel | noonedeadpunk what is the use of it? first time heard | 16:20 |
noonedeadpunk | in openstack world - no use. | 16:21 |
noonedeadpunk | But kinda wonder how to get rid of that | 16:22 |
jrosser | is it libvirts "default" network? | 16:22 |
noonedeadpunk | yeah, kinda. But you better not to create a neutron network that will intersect with that | 16:22 |
jrosser | `virsh net-list` or smth | 16:22 |
noonedeadpunk | yeah ` default active yes yes` | 16:25 |
noonedeadpunk | How to prevent libvirt creating it... | 16:26 |
noonedeadpunk | but deleting network breaks connectivity to VMs | 16:30 |
noonedeadpunk | wtf | 16:30 |
jrosser | do you use ovs + iptables? maybe that got broken | 16:33 |
noonedeadpunk | yup | 16:33 |
noonedeadpunk | is it safe to use mix of computes for iptables and native ovs? | 16:33 |
noonedeadpunk | crap | 16:35 |
noonedeadpunk | Seems I should really switch to native ovs, huh | 16:39 |
noonedeadpunk | hm... and we have this obviously: https://opendev.org/openstack/openstack-ansible-os_nova/src/branch/master/tasks/drivers/kvm/nova_compute_kvm_virsh_net_remove.yml | 16:44 |
noonedeadpunk | which obviously didn't work for me somehow... | 16:44 |
jrosser | NeilHanlon: do we have an ovs package oddness here? https://review.opendev.org/c/openstack/openstack-ansible/+/899331?tab=change-view-tab-header-zuul-results-summary | 16:45 |
noonedeadpunk | wtf | 16:46 |
NeilHanlon | bleh. apparently.. | 17:06 |
NeilHanlon | sorry.. i need to track their updates better | 17:06 |
NeilHanlon | I've got the updates building now | 17:11 |
NeilHanlon | tagged them to -release just now. I think the packages should be available within a day. sorry again | 19:58 |
opendevreview | Dmitriy Rabotyagov proposed openstack/ansible-role-systemd_service master: Filter loop lists instead of conditionally run them https://review.opendev.org/c/openstack/ansible-role-systemd_service/+/899509 | 20:25 |
noonedeadpunk | so... I've checked ansible logs of compute deployments and on all computes these 2 tasks were skipeed https://opendev.org/openstack/openstack-ansible-os_nova/src/branch/master/tasks/drivers/kvm/nova_compute_kvm_virsh_net_remove.yml#L21-L28 | 22:18 |
noonedeadpunk | what is more /o\ is that after default net removal and compute reboot it re-appears | 22:18 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!