Monday, 2020-05-04

« Sunday, 2020-05-03 Index Tuesday, 2020-05-05 »
*** acidfu has joined #openvswitch00:03
*** acidfoo_ has quit IRC00:05
*** zhouhan_ has joined #openvswitch00:37
*** zhouhan has quit IRC00:40
*** acidfu has quit IRC00:55
*** acidfu has joined #openvswitch00:56
*** acidfu has quit IRC01:20
*** gregwork has quit IRC01:33
dusoovs-vsctl add-bond ovsbr0 lacp0 enp2s0f0 enp2s0f1 lacp=active gives me a bond_mode: active-backup when I view the bond with ovs-appctl bond/show lacp0. What have I done wrong?02:22
*** acidfu has joined #openvswitch02:49
*** imaximets has quit IRC03:23
*** imaximets has joined #openvswitch03:23
*** imaximets has quit IRC03:24
*** imaximets has joined #openvswitch03:24
*** yamamoto has joined #openvswitch03:35
*** yamamoto has quit IRC03:38
*** imaximets has quit IRC04:10
*** imaximets has joined #openvswitch04:10
*** psahoo has joined #openvswitch04:22
*** anilvenkata has joined #openvswitch05:00
*** zhouhan_ has quit IRC05:33
*** zhouhan has joined #openvswitch05:33
*** dholler has joined #openvswitch05:37
*** thaller_ has joined #openvswitch05:44
*** thaller has quit IRC05:45
*** erig has quit IRC05:49
*** FH_thecat has quit IRC06:06
*** slaweq has joined #openvswitch06:13
*** yogananth has joined #openvswitch06:29
*** mbarroso has joined #openvswitch06:55
*** eelco has joined #openvswitch06:57
bernhi duso, I think I can answer your first question. With NM you need 3 "connections": one for the bridge, one for the port and one for an interface (onto which you put the local IP).07:53
bernnmcli conn add type ovs-bridge conn.interface br007:53
bernnmcli conn add type ovs-port conn.interface port0 master br007:54
bernnmcli conn add type ovs-interface slave-type ovs-port conn.interface int0 master port0 ipv4.method manual ipv4.address 192.0.2.1/2407:55
*** dceara has joined #openvswitch07:57
*** mmirecki has joined #openvswitch08:38
*** thaller_ has quit IRC09:08
*** thaller has joined #openvswitch09:09
dusobern: Thanks bern, I finally got it working by using systemd-networkd and writing my own network scripts, makes a lot more sense to me now. Next will step will be getting  SR-IOV working ... =)09:22
dusobern: I am using Arch linux, what was throwing me was that ovs-vsctl show was  showing me my bridge ovsbr0, but nmcli device was not showing it.09:24
*** Eryn_1983_FL has joined #openvswitch09:26
Eryn_1983_FLhello guys09:26
Eryn_1983_FLhow do i find out what using eth009:26
Eryn_1983_FL        Port "eth0"09:26
Eryn_1983_FL            Interface "eth0"09:26
Eryn_1983_FL                error: "could not add network device eth0 to ofproto (Device or resource busy)"09:26
Eryn_1983_FLi need to free it to fix my openstacks.09:26
dusoEryn_1983_FL: I had this one today when NetworkManager was bringing up the interface and not letting openvswitch have it - do you have networkmanager running and are any connections using the eth0 interface?09:28
Eryn_1983_FLi think its what ssh is using..09:33
Eryn_1983_FLi dont see any network manager09:34
Eryn_1983_FLill pb my configs09:34
dusowhat distro are you using?09:35
Eryn_1983_FLhttps://pastebin.com/uryk6eR809:35
Eryn_1983_FLubuntu09:35
Eryn_1983_FLboss said it was the 'easiest' :/09:36
*** grive has quit IRC09:36
*** grive has joined #openvswitch09:37
*** BlackDex has quit IRC09:37
Eryn_1983_FLhttps://pastebin.com/tT7sgteh09:38
Eryn_1983_FLthats what happens when i try to restart09:38
Eryn_1983_FLopenvswithc09:38
*** BlackDex has joined #openvswitch09:39
Eryn_1983_FLhow can i figure out whats using eth009:40
dusocan you paste the output of "nmcli con show" please?09:41
Eryn_1983_FLyeah09:42
Eryn_1983_FLnot found09:42
Eryn_1983_FLhttps://pastebin.com/dWJJbfmd09:43
Eryn_1983_FL:(09:43
dusothats a good thing, the bad thing I am not familiar what network system / scripts ubuntu uses, I have not used ubuntu a lot.09:44
dusotry "systemctl status systemd-networkd09:44
duso"09:44
dusoit is  saying that is running?09:45
griveEryn_1983_FL, you can know what is using a socket with `ss` and `lsof`09:48
Eryn_1983_FLlooking09:48
Eryn_1983_FLty so much for help09:48
grivess -tu to list opened TCP / UDP09:48
Eryn_1983_FLsystemctl status systemd-networkd09:48
Eryn_1983_FL is up09:48
grivelsof -i:<port> to know which app is using specific port09:48
griveso you might filter ss output with the IP(s) from eth0, and from there determine which PID is hogging eth009:49
Eryn_1983_FLthere is no ip for eth009:49
dusook, look in /etc/systemd/network and there should be a file in there with 'eth0' ending with .network09:50
dusophone - bbiab09:50
*** yamamoto has joined #openvswitch09:50
griveOk, if it's not eth0 that is used, then it might be its device. Are you able to unbind eth0 from its kmod?09:51
Eryn_1983_FLnot sure how do i do that09:51
Eryn_1983_FLlooking09:52
griveyou have dpdk-devbind.py in DPDK to do that for example, or you can do that manually using the sysfs09:52
Eryn_1983_FLnothing in /etc/systemd/network09:53
Eryn_1983_FL0000:01:00.0 'NetXtreme BCM5720 Gigabit Ethernet PCIe 165f' if=eth0 drv=tg3 unused=09:55
Eryn_1983_FLsysfs not found09:55
grivenothing in /sys/bus/pci/0000\:01\:00.0/ ?09:56
Eryn_1983_FLok so br-eth0 is what is holding on to it..09:57
Eryn_1983_FLlookin09:57
grivemissing a devices there sorry09:57
grive  /sys/bus/pci/devices/0000\:01\:00.0/09:57
Eryn_1983_FLpasting09:58
*** yamamoto has quit IRC09:58
Eryn_1983_FLhttps://pastebin.com/2pFU1RMX09:58
grivereadlink on driver there will give you the sysfs of your port driver09:59
Eryn_1983_FLok09:59
Eryn_1983_FL../../../../bus/pci/drivers/tg309:59
griveyeah, should be /sys/bus/pci/drivers/tg3 anyway10:00
griveare you sure it's support by DPDK?10:00
Eryn_1983_FLnot sure of anything,10:00
griveanyway, you should be able to try `echo "0000:01:00.0" > /sys/bus/pci/drivers/tg3/unbind10:00
Eryn_1983_FLhe said he just enabled that yesterday.. i am not sure what that means10:00
Eryn_1983_FLmaybe it was not on by default10:00
Eryn_1983_FLok10:01
grivemake sure your ssh connection is not on eth0...10:01
Eryn_1983_FLit might be10:01
griveif eth0 has no IP, probably not10:01
Eryn_1983_FLok10:01
Eryn_1983_FLyeah10:02
griveyou got a list of supported NICs for DPDK here: https://core.dpdk.org/supported/nics/10:02
griveare you able to find your model?10:02
griveIt seems to be this: https://doc.dpdk.org/guides/nics/bnxt.html10:03
griveIf not, then you won't be able to configure a dpdk-netdev port using this port in OvS10:03
Eryn_1983_FLand... that was the port i was connecting to fml10:04
griveHuh, what I mean by "it seems to be this", is that if it is supported, it should be with this driver, but you must check that you model is there10:04
griveHaha10:04
Eryn_1983_FLyeah10:04
grivesorry, it happened to most I think10:04
Eryn_1983_FLits ok i can restart it10:04
grivebut then, eth0 had an IP!10:04
Eryn_1983_FLyeah it was on some bridge10:04
griveyeah, sorry I should have made you check support first10:05
grivebut then, you should probably not try to add your management link in OvS10:05
griveespecially with DPDK, it will cut all existing connections10:06
Eryn_1983_FLyeah10:07
Eryn_1983_FLi need the drac console working right10:07
griveI only find BCM57<n>0X, n >= 3 in supported NICS, seems your BCM5720 might not be10:08
griveyes you can use it for OOB mgmt10:08
Eryn_1983_FLi dont got a user to login to the console, its like i jump from one box to another to get to root10:08
Eryn_1983_FLthis shit is annoying10:08
Eryn_1983_FLshould I just remove dpdk?10:08
griveI think so10:08
Eryn_1983_FLok10:08
*** armax has joined #openvswitch10:09
Eryn_1983_FLty so much for you help10:10
grivenp, there is a lot to take first10:10
griveespecially if you are trying a DPDK config :\10:10
Eryn_1983_FLyeah boss had started this project and had some nodes setup already, when I can back from being laid off..10:11
Eryn_1983_FLdont got a clue how it all works..10:11
Eryn_1983_FLits nice when it works, its been down a few times already. i am not impressed10:11
grivehe might want to document the platforms on which his config works, that'd be helpful10:13
Eryn_1983_FLyeah but all of them are down10:14
Eryn_1983_FLso i got no known good,10:14
Eryn_1983_FLok i removed it now i am going to restart10:18
Eryn_1983_FLsee what happens10:18
Eryn_1983_FL:)10:18
Eryn_1983_FLok same shit10:22
dusoback. Just skimmed through, you guys have been busy. So I have not messed with DPDK yet, but I was looking for another bridge or connection using eth0 that would not have let ovs bring it up. What is br-eth0?10:24
Eryn_1983_FLi just found these10:25
Eryn_1983_FLhttps://pastebin.com/iGZTUU4V10:26
Eryn_1983_FLhttps://pastebin.com/PAKU0y7J10:26
Eryn_1983_FLhttps://docs.openstack.org/operations-guide/ops-network-troubleshooting.html#troubleshooting-open-vswitch10:27
Eryn_1983_FL i am guess its the bridge that connects the inside to the outside?10:27
Eryn_1983_FLvia vlan2?10:28
grivethe external bridge seems br-ex10:30
dusobut br-eth0 is not an openvswitch, it is just a normal linux bridge and it is using eth0 to connect all the guest vms (veth*) to the outside world. That is why openvswitch can not use it.10:31
Eryn_1983_FLok10:31
Eryn_1983_FLso should i remove it?10:31
dusoso dumb question - what are you trying to achieve? I guess I need a better idea of the topology10:31
Eryn_1983_FLopenstack cluster, we did a hard reboot,10:32
Eryn_1983_FLim trying to get the network back up so i can start he instances,10:32
Eryn_1983_FLas far as topology i dont know10:32
dusoseems 6 guest vm's are using it, if you remove eth0 from br-eth0 then they will lose all conectivity10:32
Eryn_1983_FLno vms are running10:32
Eryn_1983_FLmaybe the neutron stuff? i dunno10:33
Eryn_1983_FLwish the openstack people would talk to me10:33
dusohow many interfaces does the host have?10:34
Eryn_1983_FL410:35
Eryn_1983_FLhttps://pastebin.com/FwaitH0W10:35
dusoso everything was up and running fine, your boss made some changes but your not sure what, the system was rebooted and now something is not working? The opening question was ovs is not able to bring up eth0 on a port because the resource is busy with with br-eth0, but it looks like it is supposed to be that way. The name, br-eth0 suggests it is a bridge specifically for eth0, so the question is why is10:47
dusoovs configured to try and use eth0 as well10:47
Eryn_1983_FLill ask him if he tried to put it in ovs when he wakes up10:49
Eryn_1983_FLcan we remove it for now? i can make me an account so i can login on drac out of band10:50
dusoThis is a tough puzzle to crack without knowing a lot more info. Do you log in as your own username and sudo -i to root? Maybe go through your bosses history file to find out exactly what he did10:50
dusocan you paste out output of "ovs-vsctl show" "ip link" and "ip a" but if you have public IP's, you might want to mask the output of "ip a"10:55
Eryn_1983_FLif he did it he did it in the gui10:56
Eryn_1983_FLno their not public10:56
dusoalso, do a "systemctl --failed" and see if everything restarted ok10:56
Eryn_1983_FLhttps://pastebin.com/PAKU0y7J10:56
Eryn_1983_FLyeah its all in the pastbins10:57
Eryn_1983_FLhttps://pastebin.com/PAKU0y7J10:57
Eryn_1983_FLok big one10:59
Eryn_1983_FLhttps://pastebin.com/BpywKzPH11:00
*** mmichelson has joined #openvswitch11:01
Eryn_1983_FLalso why are there enos and eth0s on the same box?11:01
Eryn_1983_FLjeebus11:01
Eryn_1983_FLdoes that make anysense to you? pick one wtf.11:01
*** mmichelson_ has quit IRC11:02
dusolittle. I'll answer what I can. You have a four port nic, the system is renaming eno0 to eth0 and eno1 to eth1, eno2 is not getting renamed but IDK why eno4 is not eno311:04
dusoif you look at "journalctl -u systemd-networkd" it will help you make sense. Would be good to see if there are any error messages in there too11:06
dusoeno2 & eno4 are not important, it does not look like they are used and are down11:06
Eryn_1983_FLhttps://pastebin.com/rxvRB65g11:06
dusoI think *11:06
Eryn_1983_FLok11:07
Eryn_1983_FLsays its not managed11:07
dusoyeah, I am seeing that too11:11
dusoyou said there are no config files in /etc/systemd/network/ ?11:11
Eryn_1983_FLnothing11:12
dusoso why is systemd-networkd daemon running then?11:13
Eryn_1983_FLdunno11:14
dusook, lets attack this another way - do you know what IP address br-eth0 is supposed to have?11:14
Eryn_1983_FLnope :(11:14
dusonm, it has 172.27.1.211:15
Eryn_1983_FLok11:15
Eryn_1983_FLyeah that one11:15
dusoso you can ping the gateway from the host?11:15
Eryn_1983_FLi can get out11:16
dusoit seems your basic network is fine, the problem is something with openflow configuring the flows for eth0 and I don't know enough about SDN to help much with that11:17
Eryn_1983_FLyeah it sucks11:17
Eryn_1983_FLi dont know enough about it either11:17
*** slaweq_ has joined #openvswitch11:18
*** slaweq has quit IRC11:21
*** imaximets has quit IRC11:23
dusoI found this, no solution though https://mail.openvswitch.org/pipermail/ovs-discuss/2018-April/046591.html11:23
*** imaximets has joined #openvswitch11:23
dusosorry Eryn, this one is beyond me.11:26
Eryn_1983_FLnp11:27
*** timothy has joined #openvswitch11:34
*** yamamoto has joined #openvswitch11:37
*** imaximets has quit IRC11:38
*** imaximets has joined #openvswitch11:38
*** erig has joined #openvswitch11:47
*** fbl has joined #openvswitch11:51
*** fbl has quit IRC12:03
*** fbl has joined #openvswitch12:05
*** bostondriver has joined #openvswitch12:47
*** drizztbsd has joined #openvswitch13:03
*** timothy has quit IRC13:03
*** drizztbsd is now known as timothy13:03
*** yamamoto has joined #openvswitch13:11
*** yamamoto has quit IRC13:16
*** tbachman has joined #openvswitch13:21
*** FH_thecat has joined #openvswitch13:30
*** rburkholder has quit IRC14:03
*** rburkholder has joined #openvswitch14:04
*** zhouhan has quit IRC14:11
*** zhouhan has joined #openvswitch14:11
*** dceara has quit IRC14:16
*** dceara has joined #openvswitch14:19
*** eelco has quit IRC15:16
*** mmirecki has quit IRC15:29
*** troulouliou_div2 has joined #openvswitch15:45
*** troulouliou_div2 has joined #openvswitch15:45
*** troulouliou_div2 has joined #openvswitch15:45
*** dcbw has joined #openvswitch15:53
*** strondeak has quit IRC16:13
*** strondeak has joined #openvswitch16:14
*** strondeak has quit IRC16:28
*** strondeak has joined #openvswitch16:31
*** zhouhan has quit IRC16:36
*** zhouhan has joined #openvswitch16:37
*** mmirecki has joined #openvswitch16:51
*** mmirecki has quit IRC16:55
*** zhouhan_ has joined #openvswitch17:08
*** zhouhan has quit IRC17:11
*** dholler has quit IRC17:17
*** mmirecki has joined #openvswitch17:17
*** mmirecki has quit IRC17:29
*** psahoo has quit IRC17:29
*** dholler has joined #openvswitch17:34
*** anilvenkata has quit IRC18:12
*** acidfu has quit IRC18:13
*** acidfu has joined #openvswitch18:19
*** acidfu has quit IRC18:23
*** anilvenkata has joined #openvswitch18:27
*** acidfu has joined #openvswitch18:28
*** duso has quit IRC18:31
*** duso has joined #openvswitch18:33
*** dceara has quit IRC18:43
Eryn_1983_FL?ss19:11
*** mbarroso has quit IRC19:29
*** magnusj has joined #openvswitch20:27
*** mmirecki has joined #openvswitch20:42
*** anilvenkata has quit IRC20:58
*** slaweq_ has quit IRC21:08
*** slaweq_ has joined #openvswitch21:15
*** slaweq_ has quit IRC21:19
*** duso has quit IRC21:40
*** timothy has quit IRC21:41
*** duso has joined #openvswitch21:42
*** mmirecki has quit IRC22:04
*** zhouhan_ has quit IRC22:11
*** zhouhan has joined #openvswitch22:12
*** rcernin has joined #openvswitch22:22
*** LisaMarie has joined #openvswitch22:38
*** LisaMarie has quit IRC22:41
*** zhouhan_ has joined #openvswitch23:06
*** zhouhan has quit IRC23:09
*** bostondriver has quit IRC23:16
« Sunday, 2020-05-03 Index Tuesday, 2020-05-05 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!