*** diogogmt has joined #openstack-kuryr | 00:11 | |
*** banix has joined #openstack-kuryr | 00:24 | |
*** vikasc has joined #openstack-kuryr | 00:33 | |
*** tonanhngo has joined #openstack-kuryr | 00:34 | |
*** tonanhngo has quit IRC | 00:39 | |
*** banix has quit IRC | 00:44 | |
*** limao has joined #openstack-kuryr | 00:53 | |
*** limao has quit IRC | 00:54 | |
*** limao_ has joined #openstack-kuryr | 00:54 | |
*** limao_ has quit IRC | 01:01 | |
*** limao has joined #openstack-kuryr | 01:01 | |
*** tonanhngo has joined #openstack-kuryr | 01:22 | |
*** tonanhngo has quit IRC | 01:26 | |
openstackgerrit | Liping Mao proposed openstack/kuryr-libnetwork: Fix hard-code listen ip "0.0.0.0" https://review.openstack.org/354563 | 01:35 |
---|---|---|
*** banix has joined #openstack-kuryr | 02:04 | |
*** banix has quit IRC | 02:26 | |
*** limao has quit IRC | 02:42 | |
*** hongbin has joined #openstack-kuryr | 02:44 | |
*** yuanying has quit IRC | 02:49 | |
*** limao has joined #openstack-kuryr | 02:51 | |
*** yuanying has joined #openstack-kuryr | 02:52 | |
*** limao has quit IRC | 03:07 | |
*** shashank_hegde has joined #openstack-kuryr | 03:30 | |
*** diogogmt has quit IRC | 03:34 | |
*** shashank_hegde has quit IRC | 03:36 | |
*** limao has joined #openstack-kuryr | 03:36 | |
*** hongbin has quit IRC | 03:45 | |
*** yuanying has quit IRC | 03:48 | |
*** yuanying has joined #openstack-kuryr | 03:51 | |
openstackgerrit | Liping Mao proposed openstack/kuryr: Set up MTU docker interface https://review.openstack.org/355712 | 04:10 |
openstackgerrit | Liping Mao proposed openstack/kuryr-libnetwork: Set up MTU docker interface https://review.openstack.org/355714 | 04:16 |
*** irenab has quit IRC | 04:42 | |
*** irenab has joined #openstack-kuryr | 05:11 | |
*** limao has quit IRC | 05:29 | |
*** limao has joined #openstack-kuryr | 05:31 | |
*** shashank_hegde has joined #openstack-kuryr | 05:42 | |
openstackgerrit | Liping Mao proposed openstack/kuryr-libnetwork: Fix hard-code listen ip "0.0.0.0" https://review.openstack.org/354563 | 05:45 |
*** shashank_hegde has quit IRC | 05:49 | |
*** vikasc has quit IRC | 05:54 | |
*** oanson has joined #openstack-kuryr | 05:58 | |
*** vikasc has joined #openstack-kuryr | 06:06 | |
openstackgerrit | Liping Mao proposed openstack/kuryr-libnetwork: Fix hard-code listen ip "0.0.0.0" https://review.openstack.org/354563 | 06:19 |
*** diga_ has joined #openstack-kuryr | 06:22 | |
*** shashank_hegde has joined #openstack-kuryr | 06:26 | |
*** shashank_hegde has quit IRC | 07:18 | |
openstackgerrit | janonymous proposed openstack/kuryr-libnetwork: Modify fullstack test cases for kuryr-libnetwork https://review.openstack.org/355786 | 08:44 |
*** yamamoto has quit IRC | 08:44 | |
*** janki has joined #openstack-kuryr | 08:47 | |
*** devvesa has joined #openstack-kuryr | 09:18 | |
*** limao has quit IRC | 09:19 | |
vikasc | devvesa, ping | 09:20 |
*** pablochacin has joined #openstack-kuryr | 09:22 | |
*** limao has joined #openstack-kuryr | 09:24 | |
vikasc | apuimedo, ping | 09:25 |
vikasc | apuimedo, devvesa i want help in preparing /etc/cni/net.d/network.conf on kubelete node | 09:26 |
vikasc | { | 09:26 |
vikasc | "name": "kuryr-k8s-network", | 09:26 |
vikasc | "type": "kuryr", | 09:26 |
vikasc | "etcd_authority": "fed-master:2379", | 09:26 |
vikasc | "driver": { | 09:26 |
vikasc | "type": "kuryr-network" | 09:26 |
vikasc | }, | 09:26 |
vikasc | } | 09:26 |
openstackgerrit | janonymous proposed openstack/kuryr-libnetwork: trivial: nosetest .xml removal as testr is used now https://review.openstack.org/355812 | 09:30 |
*** yamamoto has joined #openstack-kuryr | 09:31 | |
janonymous | vikasc: can i help ? i have little idea of kubernetes though | 09:35 |
vikasc | janonymous, i would appreciate | 09:36 |
vikasc | :) | 09:36 |
janonymous | so, the above one is problem statement ..? | 09:37 |
vikasc | janonymous, i wanted to get my network.conf validated | 09:37 |
janonymous | Ohh, i will read and get back. :) | 09:39 |
irenab | vikasc: did you check the midonet kuryr fork to see the CNI config? | 09:41 |
vikasc | irenab, you mean config.py? | 09:41 |
*** jchhatbar has joined #openstack-kuryr | 09:41 | |
*** yamamoto has quit IRC | 09:41 | |
vikasc | kuryr/cni/driver.py this file i am putting at /opt/cni/bin | 09:42 |
vikasc | configured and restarted the kubelet with --network-plugin-dir and --network-plugin options | 09:43 |
irenab | vikasc: there shuld be the deployment guide, let me find it | 09:44 |
irenab | pablochacin: Can you please advise on it? | 09:44 |
*** jchhatbar has quit IRC | 09:44 | |
*** janki has quit IRC | 09:44 | |
pablochacin | sure, my pleasure | 09:44 |
vikasc | pablochacin, currently this is my network file in /etc/cni/net.d/ | 09:45 |
vikasc | { | 09:46 |
vikasc | "name": "kuryr-k8s-network", | 09:46 |
vikasc | "type": "kuryr", | 09:46 |
vikasc | "etcd_authority": "fed-master:2379", | 09:46 |
vikasc | "driver": { | 09:46 |
vikasc | "type": "kuryr-network" | 09:46 |
vikasc | } | 09:46 |
vikasc | } | 09:46 |
*** yamamoto has joined #openstack-kuryr | 09:46 | |
*** yamamoto has quit IRC | 09:46 | |
*** yamamoto has joined #openstack-kuryr | 09:48 | |
pablochacin | vikasc I'm just entering a meeting, I'll be back to you later. | 09:49 |
vikasc | pablochacin, sure | 09:49 |
*** limao has quit IRC | 10:08 | |
devvesa | vikas: We have the following on the Kubelet machine | 10:15 |
*** janki has joined #openstack-kuryr | 10:16 | |
devvesa | in the file /usr/libexec/kubernetes/kubelet-plugins/net/exec/kuryr.conf the following contents | 10:16 |
devvesa | { "name": "kuryr", "type": "kuryr" } | 10:16 |
devvesa | and the binary installed by midonet/kuryr should be on /opt/cni/bin/kuryr | 10:17 |
vikasc | devvesa, hw this binary will be installed on /opt/cni/bin/kuryr | 10:22 |
devvesa | and kubelet should run with `--network-plugin=cni` | 10:22 |
vikasc | devvesa, that i did | 10:22 |
vikasc | devvesa, how can i get "kuryr" binary | 10:23 |
vikasc | devvesa, Aug 16 15:50:32 fed-node kubelet[8843]: E0816 15:50:32.889178 8843 cni.go:167] Error adding network: could not find "." plugin | 10:23 |
devvesa | vikasc: It is installed by when you do `python setup.py install` on kuryr directory | 10:24 |
devvesa | vikasc: https://github.com/midonet/kuryr/blob/k8s/setup.cfg#L34-L36 | 10:24 |
vikasc | ohh | 10:24 |
devvesa | (please note we are using the k8s branch) | 10:24 |
*** yamamoto has quit IRC | 10:25 | |
vikasc | devvesa, thanks, understood | 10:26 |
devvesa | vikasc: I think the the CNI spec says that the conf files should be on /etc/cni/net.d, but kubernetes ignores this 'detail' and uses the /usr/libexec/...foo... directory | 10:27 |
vikasc | devvesa, i was thinking on same point | 10:27 |
vikasc | devvesa, thanks for confirming | 10:27 |
vikasc | :) | 10:27 |
vikasc | devvesa, it should work fine now | 10:28 |
vikasc | devvesa, let me try it out | 10:28 |
vikasc | devvesa, | 10:31 |
vikasc | byte-compiling /usr/lib/python2.7/site-packages/kuryr/tests/unit/test_aio_methods.py to test_aio_methods.pyc | 10:31 |
vikasc | File "/usr/lib/python2.7/site-packages/kuryr/tests/unit/test_aio_methods.py", line 174 | 10:31 |
vikasc | chunk = yield from response.read_chunk() | 10:31 |
vikasc | ^ | 10:31 |
vikasc | SyntaxError: invalid syntax | 10:31 |
vikasc | devvesa, i am using python2.7 | 10:31 |
devvesa | python 3.4 | 10:31 |
vikasc | ok | 10:31 |
devvesa | blame apuimedo, I am the most conservative guy on coding ever :) | 10:32 |
vikasc | hehe | 10:32 |
vikasc | devvesa, Error syncing pod 68f1c5ef-639e-11e6-94a6-08002778068c, skipping: failed to "SetupNetwork" for "nginx_default" with SetupNetworkError: "Failed to setup network for pod \"nginx_default(68f1c5ef-639e-11e6-94a6-08002778068c)\" using network plugins \"cni\": netplugin failed but error parsing its diagnostic message \"CNI aborted due to exception: HTTPConnectionPool(host='localhost', port=8080) | 10:47 |
vikasc | devvesa, nevermind | 10:48 |
devvesa | well, at least cni plugin is loaded :) | 10:48 |
vikasc | devvesa, yes. :) | 10:48 |
vikasc | devvesa, this is due to configuration error | 10:48 |
vikasc | devvesa, i think i can fix it | 10:48 |
devvesa | cool. ping me otherwise | 10:48 |
vikasc | devvesa, sure | 10:48 |
*** dingboopt has joined #openstack-kuryr | 11:02 | |
*** yamamoto has joined #openstack-kuryr | 11:03 | |
vikasc | devvesa, i provided configuration such as api_server details through env variables | 11:08 |
vikasc | devvesa, now when trying to create a pod, | 11:09 |
vikasc | E0816 16:36:22.659445 32025 cni.go:118] Error while adding to cni network: netplugin failed but error parsing its diagnostic message "CNI aborted due to exception: [Errno 2] No such file or directory: '/usr/lib/python3.5/site-packages/usr/libexec/kuryr/unbound'\n": | 11:09 |
vikasc | devvesa, i thought of setting pdb by running kubelet in foreground but breakpoint is not hitting | 11:09 |
vikasc | devvesa, i mean it hits the pdb line in code but does not give control | 11:10 |
devvesa | I think it is because of the bindir | 11:10 |
devvesa | configuration variable | 11:10 |
devvesa | https://github.com/midonet/kuryr/blob/k8s/kuryr/common/config.py#L32 | 11:11 |
vikasc | devvesa, thanks for pointer | 11:11 |
devvesa | it uses this $pybasedir | 11:11 |
vikasc | devvesa, make sense | 11:11 |
devvesa | bad news are there is no way to pass configuration explicitly to cni driver (since it is not a service and does not spawns, just a binary waiting for being called) | 11:11 |
vikasc | so just env variables | 11:12 |
devvesa | I propose you to modify the config.py and run the `python setup.py install` again | 11:12 |
vikasc | ? | 11:12 |
vikasc | i set env variables and rerun kubelet in foreground | 11:12 |
devvesa | but this particular attribute does not have env var, right? | 11:12 |
vikasc | ohh | 11:12 |
vikasc | i dint notice that :) | 11:13 |
vikasc | devvesa, will do as you suggested | 11:13 |
devvesa | I think you start suffering what I said in yesterday's meeting that "No ready for production and lot of changes needed" :) | 11:13 |
vikasc | devvesa, :) | 11:14 |
*** vikasc is now known as vikasc|brb | 11:16 | |
*** vikasc|brb is now known as vikasc | 11:18 | |
vikasc | devvesa, is there a way to hit pdb breakpoint in driver code? | 11:18 |
*** devvesa has quit IRC | 12:07 | |
*** janki is now known as janki|afk | 12:14 | |
*** devvesa has joined #openstack-kuryr | 12:20 | |
vikasc | devvesa, somehow binding:vif_type value is reaching "unbound" to driver | 12:22 |
vikasc | devvesa, even in raven logs, it is always showing "unbound" | 12:23 |
vikasc | devvesa, but if i do "neutron port-show <port-id>", there it shows "ovs" correctly | 12:23 |
*** diga__ has joined #openstack-kuryr | 12:24 | |
*** diga_ has quit IRC | 12:25 | |
*** diga has quit IRC | 12:27 | |
vikasc | devvesa, here are the raven logs, http://pastebin.com/wXnvxEsF | 12:28 |
devvesa | sorry. I was AFK, let me see | 12:28 |
vikasc | devvesa, binding:vif_type is always "unbound" | 12:28 |
vikasc | devvesa, no worries | 12:28 |
devvesa | uhm... the binding:vif_type is not the interface_driver attribute on Neutron? | 12:31 |
vikasc | devvesa, it is | 12:32 |
devvesa | And it is well configured? | 12:32 |
vikasc | devvesa, one of the port attributes | 12:32 |
vikasc | devvesa, neutron port-show <port-id> | 12:33 |
vikasc | shows "ovs" as value of this attribute | 12:33 |
vikasc | which is expected | 12:33 |
vikasc | but in raven logs it shows "unbound" | 12:33 |
*** yamamoto has quit IRC | 12:33 | |
vikasc | devvesa, and i guess same is passed to driver through annotations | 12:34 |
vikasc | devvesa, then in binding.py based on value of this attribute binding executable is picked | 12:34 |
vikasc | devvesa, there it is getting "unbound", which is the fallback script | 12:35 |
devvesa | yes. that's my guess | 12:35 |
devvesa | but I wonder why sin the annotatoin there is the unbound | 12:36 |
vikasc | devvesa, did you take a look at logs | 12:37 |
vikasc | devvesa, that might give some clue | 12:37 |
devvesa | Yes. Too much info | 12:37 |
devvesa | still digging in | 12:38 |
vikasc | devvesa, Can it be some issue while copying port attributes and framing json in raven code? | 12:38 |
vikasc | devvesa, sure | 12:38 |
vikasc | devvesa, i will also look. | 12:38 |
*** yamamoto has joined #openstack-kuryr | 12:39 | |
*** yamamoto has quit IRC | 12:43 | |
*** sdake has joined #openstack-kuryr | 12:46 | |
sdake | hey folks | 12:46 |
sdake | just a quick question - when will kuryr introduce keystone v3 support | 12:46 |
*** diga has joined #openstack-kuryr | 12:46 | |
sdake | we can't merge it into kolla atm because it lacks keystone v3 support (and kolla is keystone v3+ only) | 12:47 |
sdake | i'd like to see it merge this cycle | 12:47 |
sdake | the work is 99% done | 12:47 |
sdake | just neds config optiosn for keystone v3 ;) | 12:47 |
sdake | but the work on the kuryr end - don't know what status of that is | 12:47 |
devvesa | are you using ml2 with ovs, vikas? | 12:49 |
devvesa | sdake: gsagie may know the status. | 12:49 |
devvesa | apuimedo knows for sure, but I think today he is on PTO | 12:49 |
sdake | devvesa his geo is? | 12:49 |
sdake | (so I can determine when to ping him :) | 12:49 |
devvesa | Israel | 12:50 |
sdake | iirc he is in EMEA | 12:50 |
sdake | cool thanks | 12:50 |
sdake | i'll try later tonight before heading to bed | 12:50 |
sdake | or ask one of our emea cr's to ping him on topic | 12:50 |
devvesa | or you can send a mail... (In case you have not already did it) | 12:50 |
sdake | ya that will work [kuryr] is the tagline? | 12:51 |
devvesa | yup :) | 12:51 |
sdake | cool will do | 12:52 |
*** vikasc has quit IRC | 12:52 | |
sdake | email away | 12:56 |
sdake | devvesa thanks for the help :) | 12:56 |
sdake | that should hae just been an automatic for me :) | 12:57 |
*** irenab has quit IRC | 12:57 | |
sdake | struggling with m3 overload... | 12:57 |
*** yamamoto has joined #openstack-kuryr | 13:07 | |
*** yamamoto has quit IRC | 13:07 | |
*** vikasc has joined #openstack-kuryr | 13:08 | |
*** dingboopt has quit IRC | 13:08 | |
devvesa | sdake: anytime! | 13:10 |
*** diogogmt has joined #openstack-kuryr | 13:33 | |
*** diogogmt has quit IRC | 13:42 | |
*** banix has joined #openstack-kuryr | 13:58 | |
*** devvesa has quit IRC | 14:02 | |
*** devvesa has joined #openstack-kuryr | 14:06 | |
*** yamamoto has joined #openstack-kuryr | 14:07 | |
*** devvesa has quit IRC | 14:07 | |
*** devvesa has joined #openstack-kuryr | 14:08 | |
*** devvesa has quit IRC | 14:08 | |
*** devvesa has joined #openstack-kuryr | 14:09 | |
*** devvesa has quit IRC | 14:09 | |
*** devvesa has joined #openstack-kuryr | 14:09 | |
*** yamamoto has quit IRC | 14:13 | |
*** devvesa has quit IRC | 14:14 | |
*** devvesa has joined #openstack-kuryr | 14:14 | |
*** hongbin has joined #openstack-kuryr | 14:25 | |
*** banix has quit IRC | 14:30 | |
*** banix has joined #openstack-kuryr | 14:32 | |
*** devvesa has quit IRC | 14:34 | |
*** diogogmt has joined #openstack-kuryr | 14:37 | |
*** devvesa has joined #openstack-kuryr | 14:45 | |
*** gsagie_ has joined #openstack-kuryr | 14:57 | |
*** tonanhngo has joined #openstack-kuryr | 14:59 | |
*** oanson has quit IRC | 15:24 | |
*** janki|afk has quit IRC | 15:36 | |
*** diga has quit IRC | 15:37 | |
*** devvesa has quit IRC | 15:44 | |
*** sdake has quit IRC | 16:09 | |
*** pablochacin has quit IRC | 16:15 | |
*** gsagie_ has quit IRC | 16:22 | |
*** pablochacin has joined #openstack-kuryr | 16:44 | |
*** oanson has joined #openstack-kuryr | 17:09 | |
*** irenab has joined #openstack-kuryr | 17:09 | |
*** diga__ has quit IRC | 17:11 | |
*** shashank_hegde has joined #openstack-kuryr | 17:43 | |
*** oanson has quit IRC | 17:52 | |
*** sdake has joined #openstack-kuryr | 17:55 | |
*** sdake_ has joined #openstack-kuryr | 19:14 | |
*** sdake has quit IRC | 19:14 | |
*** sdake_ has quit IRC | 19:15 | |
*** sdake has joined #openstack-kuryr | 19:16 | |
*** pablochacin has quit IRC | 19:42 | |
apuimedo | sdake: I'm the one trying to get it finished | 20:48 |
sdake | apuimedo sweet | 20:49 |
sdake | apuimedo thanks for working on that ;) | 20:49 |
apuimedo | I have the support for working with keystone v2 and v3 via env vars | 20:49 |
apuimedo | now I need to fix the config based one | 20:49 |
apuimedo | it comes from using mostly env vars myself when doing containers | 20:50 |
apuimedo | instead of config options | 20:50 |
*** yamamoto has joined #openstack-kuryr | 21:08 | |
*** yamamoto has quit IRC | 21:15 | |
sdake | apuimedo cool that sounds like nottoo painful a problem to fix then | 21:24 |
sdake | since the had part is done | 21:24 |
apuimedo | right | 21:24 |
apuimedo | sdake: btw, the demonym for the people of the Kuryr land is Kuryrs :-) | 21:47 |
apuimedo | but kuryrians sounds good too :-) | 21:47 |
*** tonanhngo has quit IRC | 22:26 | |
*** sdake has quit IRC | 22:27 | |
*** sdake has joined #openstack-kuryr | 22:29 | |
*** banix has quit IRC | 22:31 | |
sdake | apuimedo just had to make somethign up :) | 22:33 |
apuimedo | ;-) | 22:33 |
*** limao has joined #openstack-kuryr | 22:38 | |
*** limao_ has joined #openstack-kuryr | 22:40 | |
*** vikasc has quit IRC | 22:41 | |
*** limao has quit IRC | 22:43 | |
*** yamamoto has joined #openstack-kuryr | 22:46 | |
*** vikasc has joined #openstack-kuryr | 22:54 | |
*** limao_ has quit IRC | 23:03 | |
*** limao has joined #openstack-kuryr | 23:04 | |
*** hongbin has quit IRC | 23:05 | |
openstackgerrit | Liping Mao proposed openstack/kuryr-libnetwork: RequestAddress when subnet has not been created https://review.openstack.org/352768 | 23:16 |
apuimedo | limao: what distro do you test on? | 23:17 |
limao | RHEL | 23:17 |
apuimedo | limao: you run devstack on that or you do a full installation? | 23:18 |
limao | # cat /etc/redhat-release | 23:18 |
limao | CentOS Linux release 7.2.1511 (Core) | 23:18 |
apuimedo | cool | 23:18 |
limao | I use packstack to install Mitaka aoi | 23:18 |
limao | and test kuryr with Mitaka stable branch | 23:18 |
apuimedo | that's saner than just going master on all :-) | 23:19 |
limao | [root@limao-kuryr kuryr_libnetwork]# docker info | 23:19 |
limao | Containers: 9 | 23:19 |
limao | Images: 46 | 23:19 |
limao | Server Version: 1.9.1 | 23:19 |
limao | Storage Driver: devicemapper | 23:19 |
limao | Pool Name: docker-253:1-268569388-pool | 23:19 |
limao | Pool Blocksize: 65.54 kB | 23:19 |
limao | Base Device Size: 107.4 GB | 23:19 |
limao | Backing Filesystem: | 23:19 |
limao | Data file: /dev/loop0 | 23:19 |
limao | Metadata file: /dev/loop1 | 23:19 |
limao | Data Space Used: 783.7 MB | 23:19 |
limao | Data Space Total: 107.4 GB | 23:19 |
limao | Data Space Available: 81.4 GB | 23:19 |
limao | Metadata Space Used: 1.987 MB | 23:20 |
limao | Metadata Space Total: 2.147 GB | 23:20 |
limao | Metadata Space Available: 2.145 GB | 23:20 |
limao | Udev Sync Supported: true | 23:20 |
limao | Deferred Removal Enabled: false | 23:20 |
limao | Deferred Deletion Enabled: false | 23:20 |
limao | Deferred Deleted Device Count: 0 | 23:20 |
limao | Data loop file: /var/lib/docker/devicemapper/devicemapper/data | 23:20 |
limao | Metadata loop file: /var/lib/docker/devicemapper/devicemapper/metadata | 23:20 |
limao | Library Version: 1.02.107-RHEL7 (2015-12-01) | 23:20 |
limao | Execution Driver: native-0.2 | 23:20 |
*** limao_ has joined #openstack-kuryr | 23:21 | |
*** limao has quit IRC | 23:24 | |
*** limao has joined #openstack-kuryr | 23:25 | |
*** tonanhngo has joined #openstack-kuryr | 23:27 | |
*** limao_ has quit IRC | 23:28 | |
*** tonanhngo has quit IRC | 23:29 | |
limao | apuimedo: Just a quick question, which mini docker version kuryr will support? 1.12? | 23:31 |
openstackgerrit | Liping Mao proposed openstack/kuryr-libnetwork: Fix hard-code listen ip "0.0.0.0" https://review.openstack.org/354563 | 23:38 |
apuimedo | limao: mini docker? | 23:38 |
limao | I mean which version will be supported by kuryr, kuryr support from 1.9(which is first production ready for libnetwork) or we need latest version of docker? | 23:40 |
apuimedo | for now the recommended version is 1.11.2 | 23:41 |
apuimedo | 1.12 comes with some changes and I was not able to test it yet | 23:41 |
*** limao_ has joined #openstack-kuryr | 23:43 | |
*** limao__ has joined #openstack-kuryr | 23:43 | |
*** limao_ has quit IRC | 23:44 | |
*** limao has quit IRC | 23:45 | |
*** limao__ is now known as limao | 23:45 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!