Wednesday, 2017-10-25

*** pmannidi has joined #openstack-kuryr00:10
*** jdavis has joined #openstack-kuryr00:34
*** jdavis has quit IRC00:39
*** ltomasbo has quit IRC01:04
*** ltomasbo has joined #openstack-kuryr01:06
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978101:08
*** ltomasbo has quit IRC01:12
*** ltomasbo has joined #openstack-kuryr01:20
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978101:22
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978101:27
*** salv-orlando has joined #openstack-kuryr01:28
*** caowei has joined #openstack-kuryr01:31
*** salv-orlando has quit IRC01:33
*** kiennt26 has joined #openstack-kuryr01:51
*** kiennt26 has quit IRC01:53
*** kiennt26 has joined #openstack-kuryr01:54
*** hongbin has joined #openstack-kuryr01:57
*** wangbo has joined #openstack-kuryr01:57
*** ltomasbo has quit IRC02:12
*** yamamoto has joined #openstack-kuryr02:14
*** ltomasbo has joined #openstack-kuryr02:30
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978102:58
*** caowei has quit IRC03:25
*** salv-orlando has joined #openstack-kuryr03:29
*** salv-orlando has quit IRC03:33
*** vikasc has joined #openstack-kuryr03:53
*** hongbin has quit IRC04:00
*** wangbo has quit IRC04:04
*** wangbo has joined #openstack-kuryr04:04
*** kiennt26 has quit IRC04:07
*** wangbo has quit IRC04:08
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978104:23
*** wangbo has joined #openstack-kuryr04:23
*** caowei has joined #openstack-kuryr04:24
*** wangbo has quit IRC04:52
*** wangbo has joined #openstack-kuryr05:00
*** wangbo has quit IRC05:00
*** wangbo has joined #openstack-kuryr05:03
*** janki has joined #openstack-kuryr05:05
*** wangbo has quit IRC05:06
*** wangbo has joined #openstack-kuryr05:09
*** wangbo_ has joined #openstack-kuryr05:14
*** wangbo has quit IRC05:15
*** salv-orlando has joined #openstack-kuryr05:18
*** yboaron has joined #openstack-kuryr05:22
*** wangbo_ has quit IRC05:29
*** wangbo_ has joined #openstack-kuryr05:37
*** wangbo_ has quit IRC05:43
*** wangbo has joined #openstack-kuryr05:50
*** wangbo has quit IRC05:56
*** wangbo has joined #openstack-kuryr05:57
*** wangbo has quit IRC06:01
*** kiennt26 has joined #openstack-kuryr06:07
*** wangbo has joined #openstack-kuryr06:09
*** wangbo has quit IRC06:10
*** gouthamr has quit IRC06:14
*** wangbo has joined #openstack-kuryr06:16
*** wangbo has quit IRC06:19
*** jchhatbar has joined #openstack-kuryr06:27
*** janki has quit IRC06:29
*** wangbo has joined #openstack-kuryr06:35
*** pcaruana has joined #openstack-kuryr06:39
*** wangbo has quit IRC06:40
*** salv-orlando has quit IRC06:44
*** salv-orlando has joined #openstack-kuryr06:45
*** jchhatbar is now known as janki06:47
*** salv-orlando has quit IRC06:49
*** salv-orlando has joined #openstack-kuryr06:49
*** yboaron has quit IRC07:17
*** wangbo has joined #openstack-kuryr07:17
*** vikasc has quit IRC07:28
*** salv-orlando has quit IRC07:51
*** salv-orlando has joined #openstack-kuryr07:52
*** salv-orlando has quit IRC07:56
*** wangbo has quit IRC07:57
*** wangbo has joined #openstack-kuryr07:58
*** salv-orlando has joined #openstack-kuryr08:05
*** apuimedo has joined #openstack-kuryr08:10
*** garyloug has joined #openstack-kuryr08:11
*** garyloug has quit IRC08:13
openstackgerritMerged openstack/kuryr-libnetwork master: Enable etcd3 in controller node only  https://review.openstack.org/51481508:15
*** yboaron has joined #openstack-kuryr08:16
*** garyloug has joined #openstack-kuryr08:18
*** wangbo has quit IRC08:32
*** wangbo has joined #openstack-kuryr08:36
*** jdavis has joined #openstack-kuryr08:37
*** jdavis has quit IRC08:42
dulekapuimedo: Hi, do you have 5 minutes to discuss CNI daemon?08:51
*** pmannidi has quit IRC08:59
openstackgerritDaniel Mellado proposed openstack/kuryr-tempest-plugin master: [WIP] Add scenario test manager  https://review.openstack.org/51089608:59
*** yamamoto has quit IRC09:05
*** yamamoto has joined #openstack-kuryr09:12
apuimedodulek: I do now09:47
apuimedosorry for the delay09:47
dulekapuimedo: No problem. I'll briefly explain what I've did yesterday, so we can discuss that at the call.09:48
apuimedook09:48
dulekapuimedo: I've switched the daemon to cotyledon and flask (first choice, I can switch that if we have anyone who has preference).09:48
*** yamamoto has quit IRC09:49
apuimedohow does it behave?09:49
dulekapuimedo: At least it works. :D09:49
dulekapuimedo: Fun part with pooled watcher is that I've started to get WATCH events *before* I've got CNI requests.09:49
apuimedo:-)09:49
dulekapuimedo: So I've rewritten the watcher to put (pod, vif) pairs into a registry.09:50
dulekapuimedo: And CNI daemon looks into the registry, waits a bit if pod isn't yet there, but once it is - all connecting is performed.09:50
dulekapuimedo: So currently it looks like that: I have 2 cotyledon services, one for watcher and one for HTTP server.09:51
dulekapuimedo: (cotyledon.service = process)09:51
apuimedoright09:51
dulekapuimedo: Those are connected through multiprocessing.Queue, so watcher can send (pod, vif) to the registry on the server side.09:51
dulekapuimedo: And server does what I've already explained - looks into the registry, waits a bit if pod isn't there yet.09:52
dulekHow does it sound to you from the design perspective?09:52
apuimedoso the watcher is watching on the host selector already?09:52
dulekapuimedo: Yup!09:52
apuimedothat's awesome09:53
apuimedoand on terminating we don't need to wait because we already have it in the registry09:53
apuimedocorrect?09:53
dulekapuimedo: I think I can imagine corner cases.09:53
dulekapuimedo: But 99.99% of the time pod should be there.09:54
dulekapuimedo: To fight the problem of pods being deleted before kuryr wires them, I think I can watch on_delete as well and update registry with some sentinel.09:55
apuimedowell, the corner case09:55
apuimedois only that we terminate before we bind09:56
apuimedoand in that case, I think that what we should so is just cancel the "wait for a bit when adding to network"09:56
apuimedoright09:56
apuimedothe http server works in threads I suppose09:57
apuimedoright?09:57
dulekWatcher is a child process, HTTP server is another child process with threads for: 1. reading from multiprocessing.Queue; 2. serving requests.09:58
dulekapuimedo: Another corner case - I can imagine HTTP process dying (e.g. OOM), so in-memory registry is lost. Then it's being restarted by cotyledon, but has no registry.09:58
dulekapuimedo: We should probably make watcher reissue whole GET from time to time.09:59
apuimedodulek: should we mmap that maybe?09:59
apuimedoor just somehow request a refresh?09:59
dulekapuimedo: mmap sounds like a hammer solution. Not that I don't like it. ;)10:00
apuimedo:-)10:00
*** yboaron_ has joined #openstack-kuryr10:00
dulekapuimedo: If we could hare parent process memory with children, that would be best probably.10:01
*** dulek has left #openstack-kuryr10:01
*** dulek has joined #openstack-kuryr10:01
duleks/hare/share10:01
apuimedobluejeans is loading ultra slow for me10:01
dulekapuimedo: As watcher only writes, http server only reads, we should be safe.10:01
apuimedoright10:02
dulekapuimedo: Works for me.10:02
apuimedoI'll kill -9 it10:02
apuimedoand try again10:02
*** yboaron has quit IRC10:03
openstackgerritDaniel Mellado proposed openstack/kuryr-tempest-plugin master: [WIP] Add scenario test manager  https://review.openstack.org/51089610:06
*** kiennt26 has quit IRC10:07
*** salv-orlando has quit IRC10:32
*** salv-orlando has joined #openstack-kuryr10:33
*** pcaruana has quit IRC10:37
*** yboaron_ has quit IRC10:39
*** yamamoto has joined #openstack-kuryr10:49
*** wangbo has quit IRC10:54
*** yamamoto has quit IRC11:01
*** yboaron_ has joined #openstack-kuryr11:07
*** caowei has quit IRC11:09
*** yamamoto has joined #openstack-kuryr11:14
*** atoth has joined #openstack-kuryr11:19
*** wangbo has joined #openstack-kuryr11:32
*** pcaruana has joined #openstack-kuryr11:43
*** wangbo has quit IRC11:54
*** wangbo has joined #openstack-kuryr12:01
*** yamamoto has quit IRC12:02
*** pcaruana has quit IRC12:03
*** pcaruana has joined #openstack-kuryr12:04
*** yboaron__ has joined #openstack-kuryr12:18
*** yboaron_ has quit IRC12:20
*** jdavis has joined #openstack-kuryr12:22
*** kiennt26 has joined #openstack-kuryr12:27
*** jdavis has quit IRC12:43
*** wangbo_ has joined #openstack-kuryr12:44
*** wangbo has quit IRC12:46
*** wangbo__ has joined #openstack-kuryr12:49
*** wangbo_ has quit IRC12:51
*** yamamoto has joined #openstack-kuryr13:02
*** yamamoto has quit IRC13:12
*** wangbo__ has quit IRC13:17
*** kiennt26 has quit IRC13:38
openstackgerritAntoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: add openshift support  https://review.openstack.org/49793313:50
yboaron__apuimedo, just started devstack stacking with your updated patch , I'll update14:03
*** hongbin has joined #openstack-kuryr14:08
openstackgerritDaniel Mellado proposed openstack/kuryr-tempest-plugin master: Add scenario test manager  https://review.openstack.org/51089614:18
*** salv-orlando has quit IRC14:21
*** salv-orlando has joined #openstack-kuryr14:22
apuimedoyboaron__: me too14:22
apuimedoI stacked it to troubleshoot the issue actually xD14:23
apuimedoI only rebased it xD14:23
*** salv-orlando has quit IRC14:26
yboaron__apuimedo, yeppp, ...  stack failed : https://pastebin.com/7e1vm1Y814:28
apuimedoI'll fix asap14:29
openstackgerritDaniel Mellado proposed openstack/kuryr-tempest-plugin master: Add scenario test manager  https://review.openstack.org/51089614:40
*** gouthamr has joined #openstack-kuryr14:41
apuimedoyboaron__: where did you create it?14:43
apuimedoin rdocloud?14:43
yboaron__apuimedo, yes in RDO cloud14:55
apuimedomeh....15:02
apuimedoRDO cloud with devstack-heat is no longer working for me15:02
*** premsankar has joined #openstack-kuryr15:03
yboaron__apuimedo, I must leave , will be in touch later or tomorrow15:05
apuimedook15:05
*** yboaron__ has quit IRC15:09
*** pcaruana has quit IRC15:49
*** apuimedo has quit IRC15:59
*** salv-orlando has joined #openstack-kuryr16:00
*** janki has quit IRC16:09
*** garyloug has quit IRC17:02
*** salv-orlando has quit IRC17:55
*** salv-orlando has joined #openstack-kuryr17:56
*** salv-orlando has quit IRC18:00
*** premsankar has quit IRC18:32
*** atoth has quit IRC18:46
*** salv-orlando has joined #openstack-kuryr18:55
*** salv-orlando has quit IRC19:33
*** salv-orlando has joined #openstack-kuryr19:35
*** atoth has joined #openstack-kuryr19:41
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: CNI split - introducing CNI daemon  https://review.openstack.org/51518619:48
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: CNI split - introducing CNI daemon  https://review.openstack.org/51518619:49
openstackgerritMichał Dulko proposed openstack/kuryr-kubernetes master: DNM: Trying to run gate tests with CNI Daemon  https://review.openstack.org/50976519:52
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978121:17
*** kzaitsev_pi has quit IRC22:02
*** kzaitsev_pi has joined #openstack-kuryr22:04
*** kzaitsev_pi has quit IRC22:11
*** kzaitsev_pi has joined #openstack-kuryr22:13
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978122:35
*** pmannidi has joined #openstack-kuryr22:50
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978122:57
openstackgerritOpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements  https://review.openstack.org/50978123:00
*** hongbin has quit IRC23:05
*** gouthamr has quit IRC23:22
*** gouthamr has joined #openstack-kuryr23:22

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!