*** pmannidi has joined #openstack-kuryr | 00:10 | |
*** jdavis has joined #openstack-kuryr | 00:34 | |
*** jdavis has quit IRC | 00:39 | |
*** ltomasbo has quit IRC | 01:04 | |
*** ltomasbo has joined #openstack-kuryr | 01:06 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 01:08 |
---|---|---|
*** ltomasbo has quit IRC | 01:12 | |
*** ltomasbo has joined #openstack-kuryr | 01:20 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 01:22 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 01:27 |
*** salv-orlando has joined #openstack-kuryr | 01:28 | |
*** caowei has joined #openstack-kuryr | 01:31 | |
*** salv-orlando has quit IRC | 01:33 | |
*** kiennt26 has joined #openstack-kuryr | 01:51 | |
*** kiennt26 has quit IRC | 01:53 | |
*** kiennt26 has joined #openstack-kuryr | 01:54 | |
*** hongbin has joined #openstack-kuryr | 01:57 | |
*** wangbo has joined #openstack-kuryr | 01:57 | |
*** ltomasbo has quit IRC | 02:12 | |
*** yamamoto has joined #openstack-kuryr | 02:14 | |
*** ltomasbo has joined #openstack-kuryr | 02:30 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 02:58 |
*** caowei has quit IRC | 03:25 | |
*** salv-orlando has joined #openstack-kuryr | 03:29 | |
*** salv-orlando has quit IRC | 03:33 | |
*** vikasc has joined #openstack-kuryr | 03:53 | |
*** hongbin has quit IRC | 04:00 | |
*** wangbo has quit IRC | 04:04 | |
*** wangbo has joined #openstack-kuryr | 04:04 | |
*** kiennt26 has quit IRC | 04:07 | |
*** wangbo has quit IRC | 04:08 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 04:23 |
*** wangbo has joined #openstack-kuryr | 04:23 | |
*** caowei has joined #openstack-kuryr | 04:24 | |
*** wangbo has quit IRC | 04:52 | |
*** wangbo has joined #openstack-kuryr | 05:00 | |
*** wangbo has quit IRC | 05:00 | |
*** wangbo has joined #openstack-kuryr | 05:03 | |
*** janki has joined #openstack-kuryr | 05:05 | |
*** wangbo has quit IRC | 05:06 | |
*** wangbo has joined #openstack-kuryr | 05:09 | |
*** wangbo_ has joined #openstack-kuryr | 05:14 | |
*** wangbo has quit IRC | 05:15 | |
*** salv-orlando has joined #openstack-kuryr | 05:18 | |
*** yboaron has joined #openstack-kuryr | 05:22 | |
*** wangbo_ has quit IRC | 05:29 | |
*** wangbo_ has joined #openstack-kuryr | 05:37 | |
*** wangbo_ has quit IRC | 05:43 | |
*** wangbo has joined #openstack-kuryr | 05:50 | |
*** wangbo has quit IRC | 05:56 | |
*** wangbo has joined #openstack-kuryr | 05:57 | |
*** wangbo has quit IRC | 06:01 | |
*** kiennt26 has joined #openstack-kuryr | 06:07 | |
*** wangbo has joined #openstack-kuryr | 06:09 | |
*** wangbo has quit IRC | 06:10 | |
*** gouthamr has quit IRC | 06:14 | |
*** wangbo has joined #openstack-kuryr | 06:16 | |
*** wangbo has quit IRC | 06:19 | |
*** jchhatbar has joined #openstack-kuryr | 06:27 | |
*** janki has quit IRC | 06:29 | |
*** wangbo has joined #openstack-kuryr | 06:35 | |
*** pcaruana has joined #openstack-kuryr | 06:39 | |
*** wangbo has quit IRC | 06:40 | |
*** salv-orlando has quit IRC | 06:44 | |
*** salv-orlando has joined #openstack-kuryr | 06:45 | |
*** jchhatbar is now known as janki | 06:47 | |
*** salv-orlando has quit IRC | 06:49 | |
*** salv-orlando has joined #openstack-kuryr | 06:49 | |
*** yboaron has quit IRC | 07:17 | |
*** wangbo has joined #openstack-kuryr | 07:17 | |
*** vikasc has quit IRC | 07:28 | |
*** salv-orlando has quit IRC | 07:51 | |
*** salv-orlando has joined #openstack-kuryr | 07:52 | |
*** salv-orlando has quit IRC | 07:56 | |
*** wangbo has quit IRC | 07:57 | |
*** wangbo has joined #openstack-kuryr | 07:58 | |
*** salv-orlando has joined #openstack-kuryr | 08:05 | |
*** apuimedo has joined #openstack-kuryr | 08:10 | |
*** garyloug has joined #openstack-kuryr | 08:11 | |
*** garyloug has quit IRC | 08:13 | |
openstackgerrit | Merged openstack/kuryr-libnetwork master: Enable etcd3 in controller node only https://review.openstack.org/514815 | 08:15 |
*** yboaron has joined #openstack-kuryr | 08:16 | |
*** garyloug has joined #openstack-kuryr | 08:18 | |
*** wangbo has quit IRC | 08:32 | |
*** wangbo has joined #openstack-kuryr | 08:36 | |
*** jdavis has joined #openstack-kuryr | 08:37 | |
*** jdavis has quit IRC | 08:42 | |
dulek | apuimedo: Hi, do you have 5 minutes to discuss CNI daemon? | 08:51 |
*** pmannidi has quit IRC | 08:59 | |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-tempest-plugin master: [WIP] Add scenario test manager https://review.openstack.org/510896 | 08:59 |
*** yamamoto has quit IRC | 09:05 | |
*** yamamoto has joined #openstack-kuryr | 09:12 | |
apuimedo | dulek: I do now | 09:47 |
apuimedo | sorry for the delay | 09:47 |
dulek | apuimedo: No problem. I'll briefly explain what I've did yesterday, so we can discuss that at the call. | 09:48 |
apuimedo | ok | 09:48 |
dulek | apuimedo: I've switched the daemon to cotyledon and flask (first choice, I can switch that if we have anyone who has preference). | 09:48 |
*** yamamoto has quit IRC | 09:49 | |
apuimedo | how does it behave? | 09:49 |
dulek | apuimedo: At least it works. :D | 09:49 |
dulek | apuimedo: Fun part with pooled watcher is that I've started to get WATCH events *before* I've got CNI requests. | 09:49 |
apuimedo | :-) | 09:49 |
dulek | apuimedo: So I've rewritten the watcher to put (pod, vif) pairs into a registry. | 09:50 |
dulek | apuimedo: And CNI daemon looks into the registry, waits a bit if pod isn't yet there, but once it is - all connecting is performed. | 09:50 |
dulek | apuimedo: So currently it looks like that: I have 2 cotyledon services, one for watcher and one for HTTP server. | 09:51 |
dulek | apuimedo: (cotyledon.service = process) | 09:51 |
apuimedo | right | 09:51 |
dulek | apuimedo: Those are connected through multiprocessing.Queue, so watcher can send (pod, vif) to the registry on the server side. | 09:51 |
dulek | apuimedo: And server does what I've already explained - looks into the registry, waits a bit if pod isn't there yet. | 09:52 |
dulek | How does it sound to you from the design perspective? | 09:52 |
apuimedo | so the watcher is watching on the host selector already? | 09:52 |
dulek | apuimedo: Yup! | 09:52 |
apuimedo | that's awesome | 09:53 |
apuimedo | and on terminating we don't need to wait because we already have it in the registry | 09:53 |
apuimedo | correct? | 09:53 |
dulek | apuimedo: I think I can imagine corner cases. | 09:53 |
dulek | apuimedo: But 99.99% of the time pod should be there. | 09:54 |
dulek | apuimedo: To fight the problem of pods being deleted before kuryr wires them, I think I can watch on_delete as well and update registry with some sentinel. | 09:55 |
apuimedo | well, the corner case | 09:55 |
apuimedo | is only that we terminate before we bind | 09:56 |
apuimedo | and in that case, I think that what we should so is just cancel the "wait for a bit when adding to network" | 09:56 |
apuimedo | right | 09:56 |
apuimedo | the http server works in threads I suppose | 09:57 |
apuimedo | right? | 09:57 |
dulek | Watcher is a child process, HTTP server is another child process with threads for: 1. reading from multiprocessing.Queue; 2. serving requests. | 09:58 |
dulek | apuimedo: Another corner case - I can imagine HTTP process dying (e.g. OOM), so in-memory registry is lost. Then it's being restarted by cotyledon, but has no registry. | 09:58 |
dulek | apuimedo: We should probably make watcher reissue whole GET from time to time. | 09:59 |
apuimedo | dulek: should we mmap that maybe? | 09:59 |
apuimedo | or just somehow request a refresh? | 09:59 |
dulek | apuimedo: mmap sounds like a hammer solution. Not that I don't like it. ;) | 10:00 |
apuimedo | :-) | 10:00 |
*** yboaron_ has joined #openstack-kuryr | 10:00 | |
dulek | apuimedo: If we could hare parent process memory with children, that would be best probably. | 10:01 |
*** dulek has left #openstack-kuryr | 10:01 | |
*** dulek has joined #openstack-kuryr | 10:01 | |
dulek | s/hare/share | 10:01 |
apuimedo | bluejeans is loading ultra slow for me | 10:01 |
dulek | apuimedo: As watcher only writes, http server only reads, we should be safe. | 10:01 |
apuimedo | right | 10:02 |
dulek | apuimedo: Works for me. | 10:02 |
apuimedo | I'll kill -9 it | 10:02 |
apuimedo | and try again | 10:02 |
*** yboaron has quit IRC | 10:03 | |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-tempest-plugin master: [WIP] Add scenario test manager https://review.openstack.org/510896 | 10:06 |
*** kiennt26 has quit IRC | 10:07 | |
*** salv-orlando has quit IRC | 10:32 | |
*** salv-orlando has joined #openstack-kuryr | 10:33 | |
*** pcaruana has quit IRC | 10:37 | |
*** yboaron_ has quit IRC | 10:39 | |
*** yamamoto has joined #openstack-kuryr | 10:49 | |
*** wangbo has quit IRC | 10:54 | |
*** yamamoto has quit IRC | 11:01 | |
*** yboaron_ has joined #openstack-kuryr | 11:07 | |
*** caowei has quit IRC | 11:09 | |
*** yamamoto has joined #openstack-kuryr | 11:14 | |
*** atoth has joined #openstack-kuryr | 11:19 | |
*** wangbo has joined #openstack-kuryr | 11:32 | |
*** pcaruana has joined #openstack-kuryr | 11:43 | |
*** wangbo has quit IRC | 11:54 | |
*** wangbo has joined #openstack-kuryr | 12:01 | |
*** yamamoto has quit IRC | 12:02 | |
*** pcaruana has quit IRC | 12:03 | |
*** pcaruana has joined #openstack-kuryr | 12:04 | |
*** yboaron__ has joined #openstack-kuryr | 12:18 | |
*** yboaron_ has quit IRC | 12:20 | |
*** jdavis has joined #openstack-kuryr | 12:22 | |
*** kiennt26 has joined #openstack-kuryr | 12:27 | |
*** jdavis has quit IRC | 12:43 | |
*** wangbo_ has joined #openstack-kuryr | 12:44 | |
*** wangbo has quit IRC | 12:46 | |
*** wangbo__ has joined #openstack-kuryr | 12:49 | |
*** wangbo_ has quit IRC | 12:51 | |
*** yamamoto has joined #openstack-kuryr | 13:02 | |
*** yamamoto has quit IRC | 13:12 | |
*** wangbo__ has quit IRC | 13:17 | |
*** kiennt26 has quit IRC | 13:38 | |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: add openshift support https://review.openstack.org/497933 | 13:50 |
yboaron__ | apuimedo, just started devstack stacking with your updated patch , I'll update | 14:03 |
*** hongbin has joined #openstack-kuryr | 14:08 | |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-tempest-plugin master: Add scenario test manager https://review.openstack.org/510896 | 14:18 |
*** salv-orlando has quit IRC | 14:21 | |
*** salv-orlando has joined #openstack-kuryr | 14:22 | |
apuimedo | yboaron__: me too | 14:22 |
apuimedo | I stacked it to troubleshoot the issue actually xD | 14:23 |
apuimedo | I only rebased it xD | 14:23 |
*** salv-orlando has quit IRC | 14:26 | |
yboaron__ | apuimedo, yeppp, ... stack failed : https://pastebin.com/7e1vm1Y8 | 14:28 |
apuimedo | I'll fix asap | 14:29 |
openstackgerrit | Daniel Mellado proposed openstack/kuryr-tempest-plugin master: Add scenario test manager https://review.openstack.org/510896 | 14:40 |
*** gouthamr has joined #openstack-kuryr | 14:41 | |
apuimedo | yboaron__: where did you create it? | 14:43 |
apuimedo | in rdocloud? | 14:43 |
yboaron__ | apuimedo, yes in RDO cloud | 14:55 |
apuimedo | meh.... | 15:02 |
apuimedo | RDO cloud with devstack-heat is no longer working for me | 15:02 |
*** premsankar has joined #openstack-kuryr | 15:03 | |
yboaron__ | apuimedo, I must leave , will be in touch later or tomorrow | 15:05 |
apuimedo | ok | 15:05 |
*** yboaron__ has quit IRC | 15:09 | |
*** pcaruana has quit IRC | 15:49 | |
*** apuimedo has quit IRC | 15:59 | |
*** salv-orlando has joined #openstack-kuryr | 16:00 | |
*** janki has quit IRC | 16:09 | |
*** garyloug has quit IRC | 17:02 | |
*** salv-orlando has quit IRC | 17:55 | |
*** salv-orlando has joined #openstack-kuryr | 17:56 | |
*** salv-orlando has quit IRC | 18:00 | |
*** premsankar has quit IRC | 18:32 | |
*** atoth has quit IRC | 18:46 | |
*** salv-orlando has joined #openstack-kuryr | 18:55 | |
*** salv-orlando has quit IRC | 19:33 | |
*** salv-orlando has joined #openstack-kuryr | 19:35 | |
*** atoth has joined #openstack-kuryr | 19:41 | |
openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: CNI split - introducing CNI daemon https://review.openstack.org/515186 | 19:48 |
openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: CNI split - introducing CNI daemon https://review.openstack.org/515186 | 19:49 |
openstackgerrit | Michał Dulko proposed openstack/kuryr-kubernetes master: DNM: Trying to run gate tests with CNI Daemon https://review.openstack.org/509765 | 19:52 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 21:17 |
*** kzaitsev_pi has quit IRC | 22:02 | |
*** kzaitsev_pi has joined #openstack-kuryr | 22:04 | |
*** kzaitsev_pi has quit IRC | 22:11 | |
*** kzaitsev_pi has joined #openstack-kuryr | 22:13 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 22:35 |
*** pmannidi has joined #openstack-kuryr | 22:50 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 22:57 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr-kubernetes master: Updated from global requirements https://review.openstack.org/509781 | 23:00 |
*** hongbin has quit IRC | 23:05 | |
*** gouthamr has quit IRC | 23:22 | |
*** gouthamr has joined #openstack-kuryr | 23:22 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!