| *** cgoncalves has joined #openstack-lbaas | 00:09 | |
| *** rcernin has joined #openstack-lbaas | 00:13 | |
| *** trident has joined #openstack-lbaas | 00:33 | |
| *** altlogbot_3 has quit IRC | 01:28 | |
| *** altlogbot_3 has joined #openstack-lbaas | 01:29 | |
| openstackgerrit | Merged openstack/octavia stable/stein: Update tox.ini for new upper constraints strategy https://review.opendev.org/668272 | 01:31 |
|---|---|---|
| *** spatel has joined #openstack-lbaas | 01:37 | |
| *** yamamoto has joined #openstack-lbaas | 02:16 | |
| *** AlexStaf has joined #openstack-lbaas | 03:03 | |
| *** AlexStaf has quit IRC | 03:08 | |
| *** spatel has quit IRC | 03:14 | |
| *** yamamoto has quit IRC | 03:18 | |
| *** psachin has joined #openstack-lbaas | 03:28 | |
| openstackgerrit | Merged openstack/octavia stable/rocky: Update tox.ini for new upper constraints strategy https://review.opendev.org/668257 | 04:37 |
| openstackgerrit | Merged openstack/octavia stable/queens: Update tox.ini for new upper constraints strategy https://review.opendev.org/668258 | 04:42 |
| openstackgerrit | Merged openstack/octavia-tempest-plugin master: Update tox.ini for new upper constraints strategy https://review.opendev.org/668262 | 04:48 |
| *** gcheresh_ has joined #openstack-lbaas | 05:07 | |
| *** gcheresh_ has quit IRC | 05:14 | |
| *** pcaruana has joined #openstack-lbaas | 06:12 | |
| *** numans has joined #openstack-lbaas | 06:18 | |
| *** luksky11 has joined #openstack-lbaas | 06:34 | |
| *** gcheresh_ has joined #openstack-lbaas | 06:37 | |
| *** gcheresh has joined #openstack-lbaas | 06:42 | |
| *** gcheresh_ has quit IRC | 06:42 | |
| *** rcernin has quit IRC | 07:12 | |
| *** ivve has joined #openstack-lbaas | 07:13 | |
| *** ricolin has joined #openstack-lbaas | 07:18 | |
| *** psachin has quit IRC | 07:19 | |
| *** ileixe has joined #openstack-lbaas | 07:19 | |
| *** rpittau|afk is now known as rpittau | 08:03 | |
| *** ataraday has joined #openstack-lbaas | 08:16 | |
| *** ccamposr__ has joined #openstack-lbaas | 08:18 | |
| *** ccamposr has quit IRC | 08:20 | |
| *** psachin has joined #openstack-lbaas | 08:34 | |
| *** dayou_ has quit IRC | 09:01 | |
| *** dayou_ has joined #openstack-lbaas | 09:01 | |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: [WIP] Transition amphora flows to dicts https://review.opendev.org/668898 | 09:49 |
| *** luksky11 has quit IRC | 10:12 | |
| *** gcheresh_ has joined #openstack-lbaas | 10:44 | |
| *** gcheresh has quit IRC | 10:44 | |
| *** luksky11 has joined #openstack-lbaas | 11:11 | |
| *** gcheresh_ has quit IRC | 11:16 | |
| *** gcheresh_ has joined #openstack-lbaas | 11:17 | |
| *** tesseract has joined #openstack-lbaas | 11:17 | |
| *** yamamoto has joined #openstack-lbaas | 11:18 | |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: [WIP] Transition amphora flows to dicts https://review.opendev.org/668898 | 11:20 |
| *** tesseract has quit IRC | 11:20 | |
| *** tesseract has joined #openstack-lbaas | 11:21 | |
| *** yamamoto has quit IRC | 11:22 | |
| *** ricolin has quit IRC | 11:26 | |
| *** happyhemant has joined #openstack-lbaas | 11:37 | |
| *** boden has joined #openstack-lbaas | 11:56 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia master: Prevent UDP LBs to use different IP protocol versions in amphora driver https://review.opendev.org/668617 | 11:57 |
| *** henriqueof has joined #openstack-lbaas | 11:59 | |
| *** goldyfruit has quit IRC | 12:22 | |
| openstackgerrit | Merged openstack/octavia-lib master: Update tox.ini for new upper constraints strategy https://review.opendev.org/668267 | 12:41 |
| *** KeithMnemonic has joined #openstack-lbaas | 12:57 | |
| *** goldyfruit has joined #openstack-lbaas | 13:10 | |
| *** tesseract has quit IRC | 13:14 | |
| *** henriqueof has quit IRC | 13:15 | |
| *** tesseract has joined #openstack-lbaas | 13:16 | |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: [WIP] Transition amphora flows to dicts https://review.opendev.org/668898 | 13:19 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix cryptsetup --pbkdf-memory failures https://review.opendev.org/668215 | 13:21 |
| *** spatel has joined #openstack-lbaas | 13:28 | |
| *** spatel has quit IRC | 13:29 | |
| *** spatel has joined #openstack-lbaas | 13:31 | |
| *** lucashxu has joined #openstack-lbaas | 13:45 | |
| *** dmellado has quit IRC | 14:09 | |
| *** dmellado has joined #openstack-lbaas | 14:11 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Fix IPv6 tests if ipv6-private-subnet is stateless https://review.opendev.org/668996 | 14:18 |
| *** dmellado has quit IRC | 14:30 | |
| *** dmellado has joined #openstack-lbaas | 14:32 | |
| *** ricolin has joined #openstack-lbaas | 14:35 | |
| *** dmellado has quit IRC | 14:49 | |
| *** gcheresh_ has quit IRC | 14:50 | |
| *** dmellado has joined #openstack-lbaas | 14:53 | |
| *** fnaval has joined #openstack-lbaas | 15:09 | |
| *** ivve has quit IRC | 15:16 | |
| *** henriqueof has joined #openstack-lbaas | 15:30 | |
| *** Vorrtex has joined #openstack-lbaas | 15:41 | |
| *** tesseract has quit IRC | 15:46 | |
| *** tesseract has joined #openstack-lbaas | 15:48 | |
| *** tesseract has quit IRC | 16:18 | |
| larsks | a/quit | 16:26 |
| *** boden has quit IRC | 16:47 | |
| *** ivve has joined #openstack-lbaas | 16:48 | |
| openstackgerrit | Carlos Goncalves proposed openstack/octavia master: DNM CentOS7 gate test https://review.opendev.org/665464 | 16:49 |
| *** rpittau is now known as rpittau|afk | 16:50 | |
| *** luksky11 has quit IRC | 16:51 | |
| *** psachin has quit IRC | 16:55 | |
| *** dasp has quit IRC | 17:06 | |
| *** henriqueof has quit IRC | 17:12 | |
| *** boden has joined #openstack-lbaas | 17:20 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix cryptsetup --pbkdf-memory failures https://review.opendev.org/668215 | 17:23 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Switch the default Ubuntu kernel to -virtual https://review.opendev.org/669725 | 17:30 |
| *** henriqueof has joined #openstack-lbaas | 17:32 | |
| *** spatel has quit IRC | 17:38 | |
| *** mithilarun has joined #openstack-lbaas | 17:42 | |
| *** dasp has joined #openstack-lbaas | 17:42 | |
| *** spatel has joined #openstack-lbaas | 18:28 | |
| xgerman | FYI: https://didibmbuyredhat.live/ | 18:30 |
| cgoncalves | *facepalm* | 18:57 |
| spatel | xgerman: or johnsom | 19:18 |
| spatel | i have shorted out all my switch looping issue... | 19:18 |
| spatel | now i am starting everything with fresh mind.. | 19:18 |
| johnsom | Cool | 19:19 |
| spatel | i spun up on amphora and it didn't get IP address from DHCP | 19:19 |
| spatel | so i manually provide IP address to amphora for troubleshooting.. | 19:19 |
| spatel | from that amphora i can ping br-lbaas ip address of controller | 19:20 |
| spatel | but i can't ping namespace dhcp ip on same controller node. | 19:20 |
| spatel | so its clear my namespace dhcp isn't wire-up with vlan_27 | 19:21 |
| *** ricolin has quit IRC | 19:21 | |
| spatel | how do i check namespace is correctly configure and attached with VLAN interface? | 19:21 |
| *** yamamoto has joined #openstack-lbaas | 19:22 | |
| -spatel- [root@ostack-infra-2-1 ~]# ip netns exec qdhcp-1f81a77d-02d2-4f64-b767-22222fc5368c ip a | grep ns | 19:23 | |
| -spatel- 2: ns-99b9b080-91@if21: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 | 19:23 | |
| spatel | This is my ns DHCP interface | 19:23 |
| spatel | ns-99b9b080-91 | 19:23 |
| spatel | according to this output its connected to following bridge interface | 19:24 |
| -spatel- [root@ostack-infra-2-1 ~]# brctl show brq1f81a77d-02 | 19:24 | |
| -spatel- bridge namebridge idSTP enabledinterfaces | 19:24 | |
| -spatel- brq1f81a77d-028000.38eaa733b9a8nobr-vlan.27 | 19:24 | |
| -spatel- tap99b9b080-91 | 19:24 | |
| spatel | here is the full output - http://paste.openstack.org/show/754172/ | 19:25 |
| spatel | look like its correctly wire up with br-vlan.27 | 19:25 |
| *** yamamoto has quit IRC | 19:26 | |
| *** mithilarun has quit IRC | 19:27 | |
| spatel | This is very strange that i can ping br-lbaas ip on same node but can't ping namespace | 19:27 |
| *** mithilarun has joined #openstack-lbaas | 19:27 | |
| spatel | xgerman: does that make sense ? | 19:28 |
| xgerman | that’s on a worker node? | 19:30 |
| spatel | controller node | 19:31 |
| spatel | controller node has br-lbass and namespace for Octavia | 19:31 |
| *** mithilarun has quit IRC | 19:32 | |
| spatel | from amphora i can ping br-lbaas 172.27.8.21/21 | 19:33 |
| spatel | i can't ping DHCP namespace of octavia ( that is why i am not getting IP from dhcp) | 19:33 |
| spatel | in short from NS i can't ping anything out or in | 19:34 |
| xgerman | Ok, that is strange — but I usually pinged mostkly from the octavia container (also keep in mind the security groups I don’t recall if we allow pings) | 19:35 |
| spatel | not seeing any traffic on tcpdump also | 19:35 |
| spatel | let me try to ping from container to NS ip | 19:36 |
| xgerman | Yeah, if an amphora is up it should send udp messages | 19:36 |
| xgerman | I always looked for those as well :-) | 19:36 |
| spatel | I am running full tcpdump -i any -nn | 19:37 |
| spatel | from octavia container i can't ping DHCP | 19:38 |
| spatel | how do i make sure NS is correctly configured for VLAN_27 | 19:38 |
| spatel | as per brctl show command i can see its correct connected to vlan27 | 19:38 |
| spatel | do you think its conflict with br-lbaas subnet? | 19:39 |
| spatel | because i have same subnet on br-lbaas and ns space | 19:39 |
| xgerman | so you are looking at NS on amphora (just wrapping my head around) | 19:40 |
| spatel | NS is for namespace "netns" | 19:40 |
| xgerman | Yeah, we do one on the amp as well | 19:40 |
| spatel | lb-mgmt-net has own netns space | 19:41 |
| spatel | if amphora not getting IP address mean its not able to talk to DHCP netns | 19:41 |
| spatel | i am troubleshooting that part | 19:41 |
| xgerman | yes, that makes sense and lb-mgmt-net has access to octavia services, etc. — we put the haproxy itself in it’s own namesoace and it only has access to the vip subnet/pool subnets | 19:42 |
| spatel | yup.. | 19:42 |
| spatel | I am using same subnet 172.27.8.0/21 for br-lbaas and dhcp netns subnet range | 19:43 |
| spatel | i don't think that would be my problem | 19:43 |
| xgerman | no, that shoudl be fine | 19:43 |
| spatel | my amphora can ping controller br-lbaas IP | 19:43 |
| spatel | but on same controller node i have netns IP which i am not able to ping :( | 19:44 |
| xgerman | well, at least one of them works ;-) | 19:44 |
| spatel | hahaha | 19:45 |
| spatel | if somehow i can get that dhcp piece working i should be good to go | 19:45 |
| xgerman | I don’t even recall if i had another namespace on the controller… I remember that I had. abridge on each worker bridging the plan to the vms | 19:45 |
| xgerman | s/plan/vlan/ | 19:46 |
| spatel | http://paste.openstack.org/show/754172/ | 19:46 |
| spatel | if you see brctl output | 19:46 |
| spatel | you can see my netns correct map with br-vlan.27 | 19:47 |
| spatel | so it should work :) | 19:47 |
| spatel | also running tcpdump -i brq1f81a77d-02 -nn | 19:48 |
| xgerman | mmh, I usually dumped in the octavia container | 19:48 |
| spatel | look like that netns not responding to any arp also.. | 19:48 |
| spatel | dumped what? | 19:49 |
| xgerman | tcpdump | 19:49 |
| spatel | i can ping container | 19:49 |
| spatel | every single IP in container i can ping | 19:50 |
| spatel | This netns is not running inside container, its running on host controller | 19:50 |
| xgerman | Ok, and that’s the one you exoect dhcp to run inside | 19:51 |
| spatel | yes.. | 19:51 |
| spatel | neutron created that netns dhcp for octavia | 19:52 |
| spatel | on host controller | 19:52 |
| xgerman | ok, gotcha. And you can’t get anywahere from that netns | 19:53 |
| spatel | yes... | 19:53 |
| spatel | now you are on point | 19:53 |
| -spatel- - network: | 19:54 | |
| -spatel- container_bridge: "br-lbaas" | 19:54 | |
| -spatel- container_interface: "eth14" | 19:54 | |
| -spatel- container_type: "veth" | 19:54 | |
| -spatel- group_binds: | 19:54 | |
| -spatel- - neutron_linuxbridge_agent | 19:54 | |
| -spatel- - octavia-worker | 19:54 | |
| -spatel- - octavia-housekeeping | 19:54 | |
| -spatel- - octavia-health-manager | 19:54 | |
| -spatel- host_bind_override: "eth14" | 19:54 | |
| -spatel- ip_from_q: "lbaas" | 19:54 | |
| -spatel- net_name: "lbaas" | 19:54 | |
| -spatel- type: "raw" | 19:54 | |
| spatel | This is my openstack_user_config.yml | 19:54 |
| spatel | I have set interface type: raw | 19:54 |
| spatel | i have bad feeling about that | 19:55 |
| spatel | xgerman: ^ | 19:55 |
| spatel | is that correct? | 19:55 |
| spatel | in documentation they gave example of type: flat | 19:55 |
| xgerman | Yeah, but the dhcp swrver gets creatd when you create a subnet in neutron | 19:56 |
| spatel | yes | 19:56 |
| xgerman | so that should be unrelated | 19:56 |
| spatel | that was i thought too but wanted to confirm | 19:56 |
| xgerman | I haven’t been on an OSA cluster since February so things are hazy for me | 19:57 |
| spatel | I have other netns and they all working fine.. | 19:57 |
| spatel | for other VLANs for vms | 19:57 |
| xgerman | yeah, this is standard fare | 19:57 |
| spatel | xgerman: i can understand | 19:58 |
| spatel | i may ask in neutron channel | 19:58 |
| xgerman | or ask in OSA… some of them might know how it’s suppsoed to look like. I remember trailing the dhcp logs as well | 19:59 |
| spatel | hmm let me see | 19:59 |
| *** mithilarun has joined #openstack-lbaas | 20:03 | |
| *** mithilarun has quit IRC | 20:08 | |
| *** mithilarun has joined #openstack-lbaas | 20:14 | |
| *** AlexStaf has joined #openstack-lbaas | 20:22 | |
| *** luksky11 has joined #openstack-lbaas | 20:25 | |
| *** AlexStaf has quit IRC | 20:27 | |
| spatel | xgerman: do you know how to restart namespace netns process? | 20:38 |
| spatel | i think neutron* should do that | 20:39 |
| *** ianychoi has joined #openstack-lbaas | 20:41 | |
| *** spatel has quit IRC | 20:48 | |
| *** pcaruana has quit IRC | 20:50 | |
| *** mithilarun has quit IRC | 20:51 | |
| *** mithilarun has joined #openstack-lbaas | 20:51 | |
| *** mithilarun has quit IRC | 20:56 | |
| *** mithilarun has joined #openstack-lbaas | 21:13 | |
| *** goldyfruit has quit IRC | 21:14 | |
| *** mithilarun has quit IRC | 21:17 | |
| *** mithilarun has joined #openstack-lbaas | 21:19 | |
| *** Vorrtex has quit IRC | 21:34 | |
| *** henriqueof has quit IRC | 21:35 | |
| *** ivve has quit IRC | 21:39 | |
| *** boden has quit IRC | 21:45 | |
| *** mithilarun has quit IRC | 22:09 | |
| *** luksky11 has quit IRC | 22:19 | |
| *** mithilarun has joined #openstack-lbaas | 22:29 | |
| *** fnaval has quit IRC | 22:45 | |
| *** goldyfruit has joined #openstack-lbaas | 22:56 | |
| *** tkajinam has quit IRC | 23:01 | |
| *** tkajinam has joined #openstack-lbaas | 23:01 | |
| *** goldyfruit has quit IRC | 23:19 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Add listener scalability scenario test https://review.opendev.org/669541 | 23:22 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Make amphora use a single HAProxy instance https://review.opendev.org/668068 | 23:24 |
| *** rcernin has joined #openstack-lbaas | 23:36 | |
| *** spatel has joined #openstack-lbaas | 23:41 | |
| *** fnaval has joined #openstack-lbaas | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!