14:00:42 #startmeeting kuryr 14:00:45 Meeting started Mon Apr 1 14:00:42 2019 UTC and is due to finish in 60 minutes. The chair is dmellado. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:46 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:00:48 The meeting name has been set to 'kuryr' 14:00:53 Hi folks, who's here today for the meeting? 14:02:30 o/ 14:02:35 o/ 14:02:39 hi 14:03:38 hi! so, first of all, I've tagged kuryr-tempest-plugin for Stein 14:04:06 as well as created stable/stein branch, for which I've set 1.0.0 release after speaking with the foundation so we can follow the default release cadence now 14:04:17 congrats to all to finally arrive to 1.0.0 release 14:04:19 \o/ 14:05:36 then, second, the CI has been broken since today, although some folks have been expressing issues since Thu 14:05:59 since that it could be related to the k8s but so far tempest jobs are failing due to some issues on reaching k8s api 14:06:21 so be aware that your changes will probably fail for a while until we get to fix that 14:06:55 any topic from your side maysams aperevalov? 14:08:48 yes, one week ago I mention issue when we chaning to DPDK driver (binding problem). So it could be solved just by receiving pod resources. I wrote to openstack-kuryr, so dulek knows ;) 14:08:49 dmellado: I'm trying to work with dulek to find out what is problem with the test that is not passing the upstream k8s tests. If the problem is our implementation or the test is wrong 14:09:14 maysams: yeah, IIRC you told me that that specific test is even skipped on their side, isn't it? 14:09:34 dmellado: Yes, it's 14:09:58 it'd be interesting to get to know why it has been set to skipped 14:10:08 also do your have now issues with performance when creating/binding ports? 14:10:13 maybe there's a valid reason for that and we should just do the same 14:10:23 aperevalov: what kind of issues? 14:11:21 performance issues - I mean delay at port creation time or in the binding driver 14:13:14 aperevalov: I haven't seeing that but there's currently one patch for adding kuryr scenarios to rally 14:13:16 https://review.openstack.org/#/c/643562/ 14:13:24 not there yet, but it'd be useful to check that once merged 14:14:01 also I think we need to create blueprint regarding rebind linux kernel driver to uio/vfio. 14:16:03 aperevalov: feel free to create the blueprint and I'll take a look 14:16:16 regarding performance, since when? and how did you measure that? 14:18:08 it's not our metrics, we didn't measure yet, our collogues complain, but rarely. 14:18:59 aperevalov: I'd be interested in checking this, would you mind getting the setup details so we could reproduce? 14:19:32 they said, sometimes it takes about 30 seconds, since pod was applied till bind. So it could be bottleneck somewhere in our setup, I'm not sure it's in kuryr-kubernetes, but interesting did you faced that. 14:20:12 about to 30 seconds? 14:20:18 I saw some binding performance issues when using OVN. 14:20:27 dulek: up to 30 seconds? 14:20:32 dmellado, ok I'll try to gather more details. 14:20:40 It takes a lot until bound port becomes ACTIVE in Neutron API. 14:20:41 aperevalov: sure, thanks! 14:20:45 dmellado: 30-60 seconds. 14:21:21 dulek: that's just plain too much, what does OVN do on the meanwhile? 14:21:32 did you get to take a look at that by any chance? 14:22:38 dmellado: I fixed one issue in OVN, but seems like it wasn't related. 14:22:56 dmellado: So no, I don't know why it takes so long. 14:22:58 aperevalov: are you using ovn as a backend on your setup? 14:23:06 But it's easily reproducible, just run DevStack with OVN. 14:23:12 dulek: all right, I'll try to set up an environment and engage the ovn folks 14:23:22 seems like a critical issue from my side 14:23:25 no, we don't 14:24:30 in any case aperevalov, please check the setup details and we'll check ;) 14:25:02 dmellado, ok 14:29:33 all right folks, then thanks for attending, we'll be at #openstack-kuryr 14:29:36 #endmeeting