| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Deprecate OpenDaylight support https://review.opendev.org/c/openstack/openstack-ansible/+/897437 | 06:27 |
|---|---|---|
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Tune SSH in pre-step setup https://review.opendev.org/c/openstack/openstack-ansible/+/899318 | 07:45 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: DNM test metal CI speed without connection plugin https://review.opendev.org/c/openstack/openstack-ansible/+/899312 | 07:47 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: DNM test metal CI speed without connection plugin https://review.opendev.org/c/openstack/openstack-ansible/+/899312 | 07:47 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: DNM test metal CI speed without connection plugin https://review.opendev.org/c/openstack/openstack-ansible/+/899312 | 07:47 |
| opendevreview | Merged openstack/openstack-ansible master: Map default value of rabbitmq_management_ssl to haproxy_ssl https://review.opendev.org/c/openstack/openstack-ansible/+/899416 | 11:14 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Map default value of rabbitmq_management_ssl to haproxy_ssl https://review.opendev.org/c/openstack/openstack-ansible/+/899331 | 11:46 |
| opendevreview | Merged openstack/ansible-role-zookeeper master: Use jdk 17 for Zookeeper https://review.opendev.org/c/openstack/ansible-role-zookeeper/+/899386 | 12:25 |
| opendevreview | Merged openstack/openstack-ansible-os_gnocchi stable/2023.1: Use proper galera port in configuration https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/892356 | 12:57 |
| spatel | morning folks!! | 13:20 |
| NeilHanlon | mornin'! | 13:20 |
| spatel | Finally I got little time today to breath so saying Helll | 13:21 |
| spatel | hello* | 13:21 |
| NeilHanlon | that is good to hear! It's been quite a week | 13:21 |
| spatel | Yep!! | 13:38 |
| spatel | I am busy in building out new datacenter and its giving me tough time :( | 13:38 |
| spatel | Its not easy to start thing from scratch!! | 13:39 |
| NeilHanlon | :( hopefully you won't have to work this weekend? | 13:39 |
| spatel | Not weekend but in to late nights :) | 13:39 |
| spatel | I am almost done!! hope next week start rolling out openstack | 13:40 |
| NeilHanlon | No no it's not.. I had to do something similar a few years ago under a time crunch. Was only in town for a week and I had to install and bootstrap a whole new network and get traffic flowing to our old cage | 13:40 |
| NeilHanlon | nice! :) | 13:40 |
| spatel | My developer asking for k8s cluster so spending lots of time there to make it right :) | 13:42 |
| spatel | Do you guys still using openvswitch plugin for production or OVN? | 13:42 |
| NeilHanlon | https://drop1.neilhanlon.me/irc/uploads/db0b9822a4757f71/image.png relevant re: kubernetes ;) | 13:44 |
| NeilHanlon | I'm still using ovs in my `production` -- though it's really not anything close to production, just my home lab. Slowly I am trying to move to OVN (though, reluctantly) | 13:45 |
| mgariepy | lol kubernetes | 13:52 |
| mgariepy | I have both in prod but not much beside base and manila services for now. | 13:54 |
| jamesdenton | spatel we are all OVS here, but next big production cloud is slated to use OVN. Need to really determine parity, though | 13:54 |
| spatel | NeilHanlon lol for that funny link :) | 13:54 |
| spatel | jamesdenton I am still worried to deploy OVN.. just human nervousness | 13:55 |
| spatel | I don't want to end up midnight to debug something I am not very good at.. | 13:56 |
| spatel | I am planning to deploy small 60 node cluster using OVN in next few month just to use for k8s. | 13:56 |
| spatel | currently deploying 600 node cloud but thinking to use OVS only. | 13:57 |
| spatel | 600 for OVN will be big milestone.. I would start with 60 first to get hands on | 13:57 |
| NeilHanlon | I think it is smart to stick with what you know while learning the new thing | 13:57 |
| spatel | +1 | 13:57 |
| jamesdenton | spatel i am nervous too :) | 13:57 |
| NeilHanlon | OVN makes sense to me conceptually, but I grok the concepts themselves. For me, though, I just don't have the scale at which I require something like OVN | 13:58 |
| spatel | I am reading all mailing list everyday and people brining strange issues with OVN and I have no idea what are those :) | 13:58 |
| NeilHanlon | Remember RFC 1925 | 13:58 |
| NeilHanlon | (6) It is easier to move a problem around (for example, by moving | 13:58 |
| NeilHanlon | the problem to a different part of the overall network | 13:58 |
| NeilHanlon | architecture) than it is to solve it. | 13:58 |
| jamesdenton | #truth | 13:59 |
| spatel | :) | 13:59 |
| opendevreview | Merged openstack/openstack-ansible stable/zed: Define install_method default when hosts resolution depend on it https://review.opendev.org/c/openstack/openstack-ansible/+/898073 | 13:59 |
| mgariepy | i aggree it's a whole set of new tool to learn. | 13:59 |
| NeilHanlon | (yes, I _do_ have that RFC bookmarked 😂) | 13:59 |
| spatel | I think OVN is better fit for k8s the way it works | 13:59 |
| spatel | The Twelve Networking Truths RFC 1925 | 13:59 |
| spatel | jamesdenton my engineering asking can we ssh to k8s pod/container... :O | 14:00 |
| spatel | I think k8s doesn't support to take your native vlans to pod level correct? | 14:01 |
| spatel | In GCP you can do that but I am sure they are using BGP to make it possible | 14:01 |
| spatel | They want to bring physical server and pods on same vlan so they can talk to each other without LB etc.. shit to expose things | 14:02 |
| spatel | Did you guys try nomad ? - https://bluexp.netapp.com/blog/cvo-blg-kubernetes-vs-nomad-understanding-the-tradeoffs | 14:03 |
| jamesdenton | i think using native k8s constructs is prob best for everyone. lots of terrible ideas out there :D | 14:07 |
| spatel | lol | 14:08 |
| spatel | How do you maintaining so many virtual routers for k8s? | 14:09 |
| spatel | That is different challenge with openvswitch | 14:10 |
| mgariepy | spatel, are you using ovs flow with ovs ? or still on iptables shim ? | 14:21 |
| spatel | Planning to use ovs flow instead of iptables | 14:23 |
| spatel | why? any thing i should be worry? | 14:23 |
| mgariepy | no | 14:23 |
| mgariepy | it works flawlessly | 14:23 |
| spatel | ++++1 | 14:23 |
| mgariepy | it's just not iptables. and need a new parser in your brain to read/understand it ;) | 14:24 |
| spatel | I see | 14:24 |
| spatel | mostly every few time you have to deal with that level of debugging.. | 14:24 |
| mgariepy | good news is that it's the same for ovn after that.. | 14:24 |
| spatel | Yes! | 14:25 |
| noonedeadpunk | Folks, does anybody see `LIBVIRT_PRT` iptables table for nat on ubuntu 22.04 compute node? | 16:07 |
| spatel | noonedeadpunk what is the use of it? first time heard | 16:20 |
| noonedeadpunk | in openstack world - no use. | 16:21 |
| noonedeadpunk | But kinda wonder how to get rid of that | 16:22 |
| jrosser | is it libvirts "default" network? | 16:22 |
| noonedeadpunk | yeah, kinda. But you better not to create a neutron network that will intersect with that | 16:22 |
| jrosser | `virsh net-list` or smth | 16:22 |
| noonedeadpunk | yeah ` default active yes yes` | 16:25 |
| noonedeadpunk | How to prevent libvirt creating it... | 16:26 |
| noonedeadpunk | but deleting network breaks connectivity to VMs | 16:30 |
| noonedeadpunk | wtf | 16:30 |
| jrosser | do you use ovs + iptables? maybe that got broken | 16:33 |
| noonedeadpunk | yup | 16:33 |
| noonedeadpunk | is it safe to use mix of computes for iptables and native ovs? | 16:33 |
| noonedeadpunk | crap | 16:35 |
| noonedeadpunk | Seems I should really switch to native ovs, huh | 16:39 |
| noonedeadpunk | hm... and we have this obviously: https://opendev.org/openstack/openstack-ansible-os_nova/src/branch/master/tasks/drivers/kvm/nova_compute_kvm_virsh_net_remove.yml | 16:44 |
| noonedeadpunk | which obviously didn't work for me somehow... | 16:44 |
| jrosser | NeilHanlon: do we have an ovs package oddness here? https://review.opendev.org/c/openstack/openstack-ansible/+/899331?tab=change-view-tab-header-zuul-results-summary | 16:45 |
| noonedeadpunk | wtf | 16:46 |
| NeilHanlon | bleh. apparently.. | 17:06 |
| NeilHanlon | sorry.. i need to track their updates better | 17:06 |
| NeilHanlon | I've got the updates building now | 17:11 |
| NeilHanlon | tagged them to -release just now. I think the packages should be available within a day. sorry again | 19:58 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/ansible-role-systemd_service master: Filter loop lists instead of conditionally run them https://review.opendev.org/c/openstack/ansible-role-systemd_service/+/899509 | 20:25 |
| noonedeadpunk | so... I've checked ansible logs of compute deployments and on all computes these 2 tasks were skipeed https://opendev.org/openstack/openstack-ansible-os_nova/src/branch/master/tasks/drivers/kvm/nova_compute_kvm_virsh_net_remove.yml#L21-L28 | 22:18 |
| noonedeadpunk | what is more /o\ is that after default net removal and compute reboot it re-appears | 22:18 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!