*** aojea has joined #openstack-kuryr | 00:06 | |
*** aojea has quit IRC | 00:10 | |
*** yamamoto has quit IRC | 00:10 | |
*** yamamoto has joined #openstack-kuryr | 00:11 | |
*** aojea has joined #openstack-kuryr | 00:15 | |
*** aojea has quit IRC | 00:19 | |
*** deep-book-gk_ has joined #openstack-kuryr | 00:20 | |
*** deep-book-gk_ has left #openstack-kuryr | 00:22 | |
*** aojea has joined #openstack-kuryr | 00:24 | |
*** aojea has quit IRC | 00:29 | |
*** yedongcan has joined #openstack-kuryr | 00:32 | |
*** aojea has joined #openstack-kuryr | 00:33 | |
*** aojea has quit IRC | 00:37 | |
*** kiennt has joined #openstack-kuryr | 00:40 | |
*** aojea has joined #openstack-kuryr | 00:42 | |
*** aojea has quit IRC | 00:47 | |
*** limao has joined #openstack-kuryr | 00:51 | |
*** aojea has joined #openstack-kuryr | 00:51 | |
*** aojea has quit IRC | 00:55 | |
*** aojea has joined #openstack-kuryr | 01:00 | |
*** aojea has quit IRC | 01:05 | |
*** aojea has joined #openstack-kuryr | 01:09 | |
*** aojea has quit IRC | 01:14 | |
*** aojea has joined #openstack-kuryr | 01:18 | |
*** aojea has quit IRC | 01:23 | |
*** aojea has joined #openstack-kuryr | 01:27 | |
*** aojea has quit IRC | 01:32 | |
openstackgerrit | howard lee proposed openstack/kuryr master: Optimize link address https://review.openstack.org/485485 | 01:35 |
---|---|---|
*** aojea has joined #openstack-kuryr | 01:36 | |
*** aojea has quit IRC | 01:41 | |
*** aojea has joined #openstack-kuryr | 01:46 | |
*** caowei has joined #openstack-kuryr | 01:50 | |
*** aojea has quit IRC | 01:50 | |
*** aojea has joined #openstack-kuryr | 01:55 | |
*** aojea has quit IRC | 01:59 | |
*** aojea has joined #openstack-kuryr | 02:04 | |
*** aojea has quit IRC | 02:08 | |
*** tonanhngo has quit IRC | 02:10 | |
openstackgerrit | howard lee proposed openstack/kuryr master: Optimize link address https://review.openstack.org/485485 | 02:10 |
*** aojea has joined #openstack-kuryr | 02:13 | |
*** aojea has quit IRC | 02:17 | |
*** mestery_ has joined #openstack-kuryr | 02:19 | |
*** mestery has quit IRC | 02:19 | |
*** mestery_ is now known as mestery | 02:20 | |
*** atoth has quit IRC | 02:20 | |
*** atoth has joined #openstack-kuryr | 02:20 | |
*** apuimedo has quit IRC | 02:21 | |
*** tonanhngo has joined #openstack-kuryr | 02:23 | |
*** apuimedo has joined #openstack-kuryr | 02:25 | |
*** tonanhngo has quit IRC | 02:28 | |
*** atoth has quit IRC | 02:28 | |
*** gouthamr has joined #openstack-kuryr | 02:31 | |
*** aojea has joined #openstack-kuryr | 02:40 | |
*** aojea has quit IRC | 02:45 | |
openstackgerrit | Hyunsun Moon proposed openstack/kuryr-libnetwork master: Return network options when AllocateNetwork called https://review.openstack.org/487258 | 02:46 |
*** aojea has joined #openstack-kuryr | 02:49 | |
*** aojea has quit IRC | 02:53 | |
*** aojea has joined #openstack-kuryr | 02:58 | |
*** aojea has quit IRC | 03:02 | |
*** aojea has joined #openstack-kuryr | 03:07 | |
*** aojea has quit IRC | 03:11 | |
*** aojea has joined #openstack-kuryr | 03:16 | |
*** aojea has quit IRC | 03:21 | |
*** aojea has joined #openstack-kuryr | 03:25 | |
*** aojea has quit IRC | 03:30 | |
*** aojea has joined #openstack-kuryr | 03:35 | |
*** aojea has quit IRC | 03:39 | |
*** aojea has joined #openstack-kuryr | 03:44 | |
*** limao has quit IRC | 03:48 | |
*** aojea has quit IRC | 03:48 | |
*** limao has joined #openstack-kuryr | 03:52 | |
*** aojea has joined #openstack-kuryr | 03:53 | |
*** aojea has quit IRC | 03:57 | |
*** limao has quit IRC | 03:57 | |
*** tonanhngo has joined #openstack-kuryr | 04:02 | |
*** tonanhngo has quit IRC | 04:07 | |
*** yboaron has joined #openstack-kuryr | 04:18 | |
vikasc | apuimedo, irenab https://review.openstack.org/#/c/466675/ | 04:20 |
*** tonanhngo has joined #openstack-kuryr | 04:45 | |
*** janki has joined #openstack-kuryr | 04:48 | |
*** limao has joined #openstack-kuryr | 04:49 | |
*** tonanhngo has quit IRC | 04:49 | |
*** limao has quit IRC | 04:54 | |
*** gouthamr has quit IRC | 05:00 | |
*** limao has joined #openstack-kuryr | 05:01 | |
*** yedongcan has quit IRC | 05:08 | |
*** yedongcan has joined #openstack-kuryr | 05:09 | |
*** caowei has quit IRC | 05:10 | |
*** tonanhngo has joined #openstack-kuryr | 05:15 | |
*** tonanhngo has quit IRC | 05:20 | |
openstackgerrit | Jaivish Kothari(janonymous) proposed openstack/kuryr-kubernetes master: Systemd usage of kubernetes startup https://review.openstack.org/484754 | 05:28 |
*** aojea has joined #openstack-kuryr | 05:41 | |
*** kiennt has quit IRC | 05:42 | |
*** aojea has quit IRC | 05:46 | |
*** hyunsun has joined #openstack-kuryr | 05:50 | |
*** caowei has joined #openstack-kuryr | 05:53 | |
*** kiennt has joined #openstack-kuryr | 06:00 | |
*** aojea has joined #openstack-kuryr | 06:09 | |
*** tonanhngo has joined #openstack-kuryr | 06:09 | |
janonymous | irnab: ^^ fixed gate issue | 06:11 |
janonymous | ops irenab: ^^ | 06:11 |
*** tonanhngo has quit IRC | 06:13 | |
*** aojea has quit IRC | 06:14 | |
*** aojea has joined #openstack-kuryr | 06:18 | |
*** limao has quit IRC | 06:20 | |
openstackgerrit | Hyunsun Moon proposed openstack/kuryr-libnetwork master: Return network options when AllocateNetwork called https://review.openstack.org/487258 | 06:20 |
*** limao has joined #openstack-kuryr | 06:20 | |
*** yedongcan has quit IRC | 06:22 | |
*** aojea has quit IRC | 06:23 | |
*** yedongcan has joined #openstack-kuryr | 06:24 | |
*** aojea has joined #openstack-kuryr | 06:27 | |
*** aojea has quit IRC | 06:32 | |
*** aojea has joined #openstack-kuryr | 06:36 | |
*** aojea has quit IRC | 06:41 | |
*** tonanhngo has joined #openstack-kuryr | 06:42 | |
*** aojea has joined #openstack-kuryr | 06:45 | |
*** tonanhngo has quit IRC | 06:46 | |
*** aojea has quit IRC | 06:50 | |
*** yamamoto has quit IRC | 06:54 | |
*** aojea has joined #openstack-kuryr | 06:54 | |
*** aojea has quit IRC | 06:59 | |
*** aojea has joined #openstack-kuryr | 07:03 | |
*** aojea has quit IRC | 07:08 | |
*** aojea has joined #openstack-kuryr | 07:13 | |
*** aojea has quit IRC | 07:14 | |
*** tonanhngo has joined #openstack-kuryr | 07:14 | |
*** aojea has joined #openstack-kuryr | 07:14 | |
*** tonanhngo_ has joined #openstack-kuryr | 07:17 | |
*** caowei_ has joined #openstack-kuryr | 07:18 | |
*** caowei has quit IRC | 07:18 | |
*** caowei_ is now known as caowei | 07:18 | |
*** tonanhngo has quit IRC | 07:19 | |
*** tonanhngo_ has quit IRC | 07:22 | |
apuimedo | dmellado: ping | 07:37 |
dmellado | apuimedo: pong | 07:37 |
apuimedo | https://review.openstack.org/#/c/486940/ | 07:37 |
apuimedo | I guess I'm the other "author" | 07:37 |
dmellado | oh, yeah, you're 'the other' | 07:38 |
dmellado | xD | 07:38 |
apuimedo | "He venido a hablar de mi libro" | 07:38 |
dmellado | I forgot yesterday to abandon that in favour of yours | 07:38 |
dmellado | so don't cry xD | 07:38 |
apuimedo | dmellado: I more was thinking you take over this stuff | 07:39 |
apuimedo | cause I think I don't know anymore what they want | 07:39 |
dmellado | but didn't Ajaeger messed up with the links? | 07:40 |
*** kural_ has joined #openstack-kuryr | 07:40 | |
apuimedo | dmellado: that's the point | 07:40 |
apuimedo | I'm confused | 07:40 |
apuimedo | xD | 07:40 |
*** kural_ has quit IRC | 07:40 | |
*** kural_ has joined #openstack-kuryr | 07:40 | |
*** kural has joined #openstack-kuryr | 07:40 | |
dmellado | I'm gonna reply, but my 2 cents he messed up xD | 07:41 |
dmellado | apuimedo: do you have a link handy to your patch? | 07:42 |
*** kural has quit IRC | 07:42 | |
*** kural_ has quit IRC | 07:42 | |
*** kural has joined #openstack-kuryr | 07:42 | |
*** kural_ has joined #openstack-kuryr | 07:42 | |
dmellado | apuimedo: in any case no worries, I'll take over and sync with andreas | 07:43 |
dmellado | but I'm pretty sure he put the wrong link xD | 07:43 |
*** dims has quit IRC | 07:45 | |
*** dims has joined #openstack-kuryr | 07:49 | |
*** egonzalez has joined #openstack-kuryr | 07:51 | |
*** yamamoto has joined #openstack-kuryr | 07:55 | |
apuimedo | dmellado: https://review.openstack.org/#/c/480983/ | 07:55 |
dmellado | apuimedo: I guess I'll rebase your patch onto mine and take over that | 07:57 |
apuimedo | ok | 07:57 |
apuimedo | sounds good | 07:57 |
apuimedo | thanks | 07:57 |
*** yamamoto has quit IRC | 08:02 | |
*** yedongcan has quit IRC | 08:09 | |
*** yedongcan has joined #openstack-kuryr | 08:10 | |
*** tonanhngo has joined #openstack-kuryr | 08:11 | |
*** tonanhngo has quit IRC | 08:16 | |
*** limao has quit IRC | 08:17 | |
*** limao has joined #openstack-kuryr | 08:18 | |
*** limao has quit IRC | 08:22 | |
*** hyunsun has quit IRC | 08:42 | |
*** limao has joined #openstack-kuryr | 08:46 | |
*** garyloug has joined #openstack-kuryr | 08:49 | |
ltomasbo | hi apuimedo | 08:54 |
apuimedo | ltomasbo: hi | 08:54 |
ltomasbo | I have a question about KURYR_CONFIGURE_NEUTRON_DEFAULTS and KURYR_CONFIGURE_BAREMETAL_KUBELET_IFACE | 08:54 |
ltomasbo | I'm trying to complete a nested deployment | 08:54 |
ltomasbo | so, no docker or kuberentes or kuryr on the undercloud | 08:54 |
ltomasbo | I set those to false | 08:54 |
ltomasbo | but then the installation is complaining about 2017-07-26 08:32:26.724 | ResourceNotFound: No Subnet found for k8s-service-subnet | 08:55 |
ltomasbo | even if we don't want to configure the neutron info into the kuryr.conf, we should still create the k8s-service-subnet, right? | 08:56 |
apuimedo | ltomasbo: nope | 09:00 |
apuimedo | well actually | 09:00 |
apuimedo | there's two ways | 09:00 |
apuimedo | one, use a pre-existing one (you can change the expected name) | 09:00 |
apuimedo | two, teach devstack to create the services network | 09:01 |
apuimedo | (cause right now it does not when it is in keystone override mode) | 09:01 |
*** yboaron_ has joined #openstack-kuryr | 09:01 | |
ltomasbo | apuimedo, I'm not talking about the heat-devstack tool you created | 09:01 |
ltomasbo | just followed the current kuryr documentation | 09:01 |
ltomasbo | for the nested case and I think it is broken | 09:02 |
apuimedo | ltomasbo: oh, it may be | 09:02 |
apuimedo | I only ever use it with my script | 09:02 |
apuimedo | so the docs may be wrong/outdated | 09:02 |
ltomasbo | if you deploy the undercloud with local.conf.pod-in-vm.undercloud.sample | 09:02 |
ltomasbo | and then the overcloud with the local.conf.pod-in-vm.overcloud.sample | 09:02 |
apuimedo | irenab: ping | 09:03 |
ltomasbo | the second installation will fail as there is no k8s-service-subnet | 09:03 |
irenab | apuimedo, hi | 09:03 |
ltomasbo | and kuryr_configure_neutron_defaults is false | 09:03 |
apuimedo | irenab: I'd like to merge the network addon patch | 09:03 |
irenab | I didn't have a time to verify. Did you> | 09:03 |
irenab | ? | 09:03 |
apuimedo | I'm doing it now | 09:03 |
*** yboaron has quit IRC | 09:04 | |
irenab | ltomasbo, I think you are correct | 09:04 |
irenab | apuimedo, cool | 09:04 |
apuimedo | ltomasbo: so your expectation would be that the overcloud devstack creates the k8s-service-network and subnet, is that right? | 09:05 |
*** tonanhngo has joined #openstack-kuryr | 09:05 | |
ltomasbo | apuimedo, perhaps not for a real deployment | 09:06 |
ltomasbo | but for the devstack one | 09:06 |
ltomasbo | yep, I believe so | 09:06 |
irenab | apuimedo, not sure its correct. If you are not running kuryr in the undercloud, I think overcloud should create it | 09:06 |
apuimedo | irenab: do you agree? | 09:06 |
apuimedo | very well then | 09:06 |
apuimedo | ltomasbo: file a bug and I can patch it | 09:06 |
irenab | and remove it once unstack is invoked | 09:06 |
apuimedo | or feel free to | 09:06 |
apuimedo | ltomasbo: irenab: this devstack plugin is starting to get complicated :P | 09:07 |
irenab | I am failing to run only worker node kuryr devstack | 09:07 |
ltomasbo | apuimedo, I'll moving part of the CONFIGURE_NEUTRON_DEFAULTS | 09:07 |
ltomasbo | to create the k8s_service_subnet but not configure the kuryr.conf | 09:07 |
apuimedo | irenab: how did you go about it? | 09:07 |
ltomasbo | I'll create the patch and the bug | 09:07 |
apuimedo | ltomasbo: great | 09:07 |
irenab | apuimedo, was rying to add kuryr-kuberentes to stop it later, but it conflicts with some created stuff by the master node | 09:08 |
irenab | but somehow kubelet and docker services are not running if kuryr-kubernetes is not enabled | 09:09 |
apuimedo | irenab: can you paste the local.overcloud.worker.conf ? | 09:10 |
*** tonanhngo has quit IRC | 09:10 | |
irenab | a min | 09:10 |
apuimedo | thanks | 09:12 |
irenab | https://pastebin.com/p46SZDRJ | 09:13 |
* irenab out for lunch | 09:14 | |
apuimedo | irenab: enjoy your lunch | 09:14 |
apuimedo | irenab: I'll push the network addon containers to dockerhub now so you don't need to build them to verify | 09:15 |
*** limao has quit IRC | 09:21 | |
*** yamamoto has joined #openstack-kuryr | 09:24 | |
apuimedo | irenab: vikasc: built and pushed to dockerhub kuryr/cni:a50bf74d and kuryr/controller:a50bf74d | 09:27 |
vikasc | apuimedo, thanks! | 09:29 |
dmellado | apuimedo: could you pls abandon your change 480963 | 09:29 |
dmellado | ? | 09:29 |
*** aojea has quit IRC | 09:32 | |
*** aojea has joined #openstack-kuryr | 09:32 | |
*** yamamoto has quit IRC | 09:35 | |
*** yamamoto has joined #openstack-kuryr | 09:45 | |
apuimedo | dmellado: sure | 09:47 |
dmellado | Initial experimental multinode gate set up, let's see how broke is this xD | 09:47 |
apuimedo | dmellado: you mean this one? https://review.openstack.org/#/c/480983/ ? | 09:47 |
apuimedo | dmellado: I see something for zuul v3 got enabled today | 09:48 |
dmellado | yep, drop that one pls | 09:48 |
apuimedo | dmellado: gladly | 09:48 |
apuimedo | done | 09:48 |
dmellado | \o/ | 09:51 |
*** aojea has quit IRC | 09:57 | |
*** aojea has joined #openstack-kuryr | 09:59 | |
*** kiennt has quit IRC | 10:05 | |
dmellado | apuimedo: ping | 10:06 |
dmellado | do you know from where are we taking the parameter $NET_ID here? https://github.com/openstack/kuryr-kubernetes/blob/master/devstack/plugin.sh#L195 | 10:06 |
dmellado | ltomasbo: ^^ | 10:07 |
ltomasbo | that is what I'm trying to figure out | 10:08 |
ltomasbo | I though we were creating the net and the subnet for the k8s-service-subnet | 10:08 |
ltomasbo | but I didn't find where we create the net for that subnet | 10:09 |
apuimedo | dmellado: I think it is from devstack lib/neutron | 10:17 |
apuimedo | ltomasbo: my patch creates a new net for it | 10:17 |
dmellado | apuimedo: that's what I assumed, but there are several declarations of that within lib/neutron | 10:17 |
apuimedo | I don't like multiple subnet networks | 10:17 |
apuimedo | https://review.openstack.org/#/c/486134/ | 10:17 |
apuimedo | dmellado: ltomasbo: do you mind if I change ^^ to create also a pod net for the pod subnet? | 10:18 |
apuimedo | I don't like reusing the private neutron default subnet that much | 10:18 |
dmellado | apuimedo: go for it | 10:18 |
apuimedo | okey dokey | 10:19 |
ltomasbo | ahh, ok, so you were using the default private network and then just adding subnets? | 10:21 |
apuimedo | no me | 10:22 |
apuimedo | I think this was done by somebody else | 10:22 |
ltomasbo | apuimedo, thanks! I'll take a look | 10:22 |
ltomasbo | apuimedo, and yes, I agree with the pod net | 10:23 |
apuimedo | good | 10:23 |
*** caowei has quit IRC | 10:24 | |
*** tonanhngo has joined #openstack-kuryr | 10:28 | |
irenab | dmellado, I think the network is created as part of the neutron devstsck part | 10:30 |
apuimedo | irenab: yeah... But I don't like it | 10:31 |
apuimedo | I'd rather have our own network | 10:32 |
apuimedo | s/network/networks | 10:32 |
apuimedo | / | 10:32 |
irenab | apuimedo, agree | 10:32 |
apuimedo | I'll send a patch for that in a little bit | 10:32 |
apuimedo | irenab: did you see I sent you the dockerhub name of vikas' container so you have easier verification? | 10:32 |
irenab | apuimedo, maybe we need kuryr project as well | 10:32 |
apuimedo | We should try to merge this week | 10:32 |
apuimedo | irenab: dmellado: ltomasbo: if you all agree, I make a kuryr project as well | 10:33 |
irenab | apuimedo, missed it, can you resend? | 10:33 |
apuimedo | kzaitsev_ws: ^^ | 10:33 |
apuimedo | irenab: vikasc: built and pushed to dockerhub kuryr/cni:a50bf74d and kuryr/controller:a50bf74d | 10:33 |
irenab | ok | 10:34 |
kzaitsev_ws | which part do I start reading with? =) | 10:34 |
kzaitsev_ws | dockerhub images? =) | 10:35 |
dmellado | kzaitsev_ws: heh, from bottom to top, I guess xD | 10:38 |
apuimedo | kzaitsev_ws: no, about devstack own project and nets instead of reusing neutron created ones | 10:38 |
kzaitsev_ws | ah ok. | 10:38 |
*** rwallner has joined #openstack-kuryr | 10:44 | |
irenab | apuimedo, dmellado : do you have some time to chat about multi node devstack? tomorrow is also fine, if you cannot today | 10:48 |
dmellado | irenab: sure | 10:48 |
irenab | for now we have everything under the condition that kuryr-kubernetes is enabled | 10:48 |
dmellado | it seems a li'l bit havoc as zuul v3 is ongoing and code doesn't match docs, not even in-code ones | 10:49 |
dmellado | but I've put an experimental multi-node gate to check that | 10:49 |
*** yedongcan has left #openstack-kuryr | 10:49 | |
dmellado | https://review.openstack.org/#/c/487343/ | 10:49 |
irenab | dmellado, what services are deployed on worker node? | 10:49 |
dmellado | irenab: ^^ | 10:49 |
dmellado | that's waht I'm trying to check | 10:49 |
dmellado | how can I distribute services there | 10:50 |
dmellado | my idea would be to use this new deployments that are advertised | 10:50 |
dmellado | let me get the link for you and I'll ellaborate | 10:50 |
apuimedo | irenab: I do, yeah | 10:50 |
apuimedo | irenab: can you file a bug? | 10:50 |
irenab | I just see that with current plugin.sh, if kuryr-kubernetes is not enabled, nothing is deployed | 10:51 |
apuimedo | like "devstack should allow to multi_Host and only kubelet service enabled | 10:51 |
irenab | apuimedo, sure | 10:51 |
irenab | in few mins | 10:51 |
apuimedo | thanks | 10:51 |
apuimedo | so that we only deploy kubelet and cni | 10:51 |
irenab | I wanted to chat about the options to fix it, but we can take it to the white bourd of the bug | 10:51 |
irenab | and docker | 10:51 |
apuimedo | irenab: we can discuss and add to the bug/bp | 10:52 |
dmellado | https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L404-L413 | 10:53 |
dmellado | irenab: ^^ | 10:53 |
dmellado | I was thinking about having an aiopcpu or ctrlpcpu but those aren't ready yet | 10:53 |
dmellado | again, waiting for zuulv3 | 10:53 |
dmellado | I also made the gate experimental as I'm not really sure on how to distrubute servies | 10:53 |
dmellado | asked on #openstack-infra but still waiting on the reply | 10:54 |
dmellado | yuval: maybe you'd know this? | 10:54 |
irenab | dmellado, I just wanted to have multi node to play with nested scenario and then realised that we have only monilitic style deployment | 10:54 |
* yuval jumping into context | 10:54 | |
dmellado | irenab: overall, my 'high level' idea would be to have the compute on the 2nd node so we could spawn a vm which would host kuryr+pods | 10:55 |
dmellado | without being capped to 8 gigs | 10:55 |
*** roeyc has joined #openstack-kuryr | 10:57 | |
yuval | dmellado: not really familiar with multi node gate jobs | 10:57 |
apuimedo | dmellado: you are very ambitious | 10:57 |
ltomasbo | dmellado, apuimedo: I see the problem is with the subnetpool, for a baremetal one, it gets information about the subnet-pool, and uses this to create the k8s-service-subnet at the private network | 10:57 |
apuimedo | xD | 10:57 |
dmellado | apuimedo: xD | 10:57 |
ltomasbo | but for the nested, it gets no information about the subnet-pool, nor about the private network | 10:57 |
dmellado | irenab: apuimedo in any case let's wait for that patch to be reviewed and let's modify things as we go ;) | 10:57 |
apuimedo | ltomasbo: well, the pool will not be defined, so it gets it from settings | 10:57 |
dmellado | yuval: thanks in any case! | 10:58 |
yuval | dmellado: have you seen that there is a 'multinode' value for DEVSTACK_GATE_TOPOLOGY as well? Not documented in the comment, but exists throughout devstack-vm-gate.sh | 10:58 |
ltomasbo | apuimedo, as SUBNETPOOL_V4_ID is not set, then it tried to use KURYR_K8S_CLUSTER_IP_RANGE | 10:59 |
dmellado | yuval: that's the one I used for my patch, as it's the 'current' 'legacy' one | 10:59 |
dmellado | devstack has quite a few if DEVSTACK_GATE_TOPOLOGY==multinode things around | 10:59 |
dmellado | and nothing about aiopcpu and so | 10:59 |
dmellado | which seems to be just 'to be coming' features along with ZuulV3 | 10:59 |
apuimedo | ltomasbo: right, and kuryr_k8s_cluster_ip_range should be well set | 11:00 |
apuimedo | in local.conf | 11:00 |
irenab | dmellado, seems that in addition to what you are trying to do, we need to make sure that we have proper way to deploy and configure relevant services | 11:00 |
yuval | both ctrlpcpu and aiopcpu appear nowhere in devstack-vm-gate.sh | 11:00 |
ltomasbo | apuimedo, yep, but you don't have any network for it | 11:01 |
dmellado | irenab: that's on my todo on how to do this | 11:01 |
ltomasbo | so, we need your patch: https://review.openstack.org/#/c/486134/5/devstack/plugin.sh | 11:01 |
dmellado | I was looking to see if there's another project that curretly do that | 11:01 |
apuimedo | ltomasbo: that depends | 11:01 |
apuimedo | :P | 11:01 |
ltomasbo | to create the service_net_id | 11:01 |
apuimedo | if you manually (or heat) created it | 11:01 |
apuimedo | ltomasbo: I'll make it more robust | 11:01 |
kzaitsev_ws | sorry for being slow. was writing a bunch of emails. I like the idea of having our own separate networks. Who knows what actually happens in neutron default ones. reading on. | 11:02 |
apuimedo | but it's difficult to test all the possibilities | 11:02 |
ltomasbo | apuimedo, other option is to force the SUBNETPOOL_V4_ID | 11:02 |
ltomasbo | by also having it defined in kuryr, instead of the KURYR_K8S_CLUSTER_IP_RANGE | 11:02 |
apuimedo | ltomasbo: yeah, yeah. I'm on it | 11:02 |
ltomasbo | something like: | 11:03 |
apuimedo | I'll allow the use to specify | 11:03 |
ltomasbo | if [ -z $SUBNETPOOL_V4_ID ] then | 11:03 |
ltomasbo | local service_subnetpool=$KURYR_K8S_SUBNETPOOL_V4 | 11:03 |
irenab | apuimedo, dmellado https://bugs.launchpad.net/kuryr-kubernetes/+bug/1706576 | 11:04 |
openstack | Launchpad bug 1706576 in kuryr-kubernetes "devstack does not support multi node scenario" [Undecided,New] | 11:04 |
ltomasbo | apuimedo, ohh, so you are working on this? | 11:04 |
dmellado | irenab: I'll take that and have a look in parallel with the gate owrk | 11:04 |
dmellado | work | 11:05 |
irenab | dmellado, thanks! | 11:05 |
janonymous | irenab: apuimedo : i have a doubt about patch : #484754 | 11:05 |
ltomasbo | dmellado, irenab: Ohh, I remember I hit that one too some time ago | 11:05 |
ltomasbo | completely forgot about it | 11:05 |
irenab | ltomasbo, , how did you deploy worker nodes? | 11:05 |
dmellado | ltomasbo: did you have some workaround | 11:06 |
dmellado | ? | 11:06 |
apuimedo | janonymous: which? | 11:06 |
dmellado | if so, feel free to submit a patch | 11:06 |
ltomasbo | yep, I modified the devstack/plugin.sh | 11:06 |
janonymous | apuimedo: though it places the command correctly but on systemctl restart commands it is not able to execute command of docker run again | 11:06 |
janonymous | http://paste.openstack.org/show/616563/ | 11:07 |
yuval | dmellado: seems like both aiopcpu and ctrlpcpi never had conditions about them in devstack-vm-gate.sh | 11:07 |
yuval | dmellado: git rev-list --all | xargs git grep ctrlpcpu | grep -v "one node will" | 11:07 |
yuval | dmellado: git rev-list --all | xargs git grep aiopcpu | grep -v "one node will" | 11:07 |
dmellado | yuval: yeah, I'm asking at #openstack-infra but my 2 cents is that those are there as a part of the migration to zuulv3 | 11:07 |
dmellado | I'll sit down with the infra team at the PTG and check... | 11:07 |
ltomasbo | it was a quick workaround regarding the main if for the kuryr-kubernetes at that file | 11:07 |
apuimedo | janonymous: right | 11:07 |
apuimedo | you did it wrong | 11:07 |
apuimedo | :P | 11:07 |
apuimedo | let me comment on it | 11:08 |
apuimedo | I missed it before | 11:08 |
janonymous | :P :) | 11:08 |
irenab | ltomasbo, any advise before I hit the same issues you had? | 11:08 |
yuval | dmellado: the comment was added in 2014 (commit 560e8512bc16d30598fc62d8f22561ca5bf722c5), I don't think it has something to do with zuul 3 | 11:08 |
dmellado | huh, well, zuulv3 has been 'there' for a long time but I doubt that it has been that much xD | 11:09 |
dmellado | maybe just some 'dead' proposal? | 11:09 |
ltomasbo | my problem was that, unless you include kuryr-kubernetes, nothing is installed/configure | 11:09 |
ltomasbo | irenab, ^ | 11:09 |
yuval | dmellado: probably | 11:09 |
irenab | ltomasbo, already got to this phase | 11:10 |
ltomasbo | irenab, so I remove the first if | 11:10 |
ltomasbo | but not in a proper way | 11:10 |
irenab | ltomasbo, but once you include kuryr-k8s, it hits the 'already created' stuff by the master node | 11:10 |
ltomasbo | irenab, you are having problems with the compute node? | 11:11 |
dmellado | yuval: I'll ask clarkb later, as he wrote that part | 11:11 |
ltomasbo | irenab, I removed that if, but also skipped some of the steps, I mainly install kubelet and kuryr-cni | 11:11 |
ltomasbo | and that was it | 11:11 |
ltomasbo | (I think) | 11:11 |
irenab | ltomasbo, with the devstack of second VM (compute to host worker node) | 11:12 |
irenab | so you removed https://github.com/openstack/kuryr-kubernetes/blob/master/devstack/plugin.sh#L532 | 11:12 |
* dmellado goes for a quick errand, bbiab | 11:12 | |
apuimedo | janonymous: https://review.openstack.org/#/c/484754/2 | 11:12 |
apuimedo | probably the second option is simpler | 11:12 |
apuimedo | see if it helps | 11:12 |
yuval | dmellado: have you seen the ironic multi node jobs? | 11:13 |
ltomasbo | irenab, I'm not sure now (as it was some time ago) I finally removed that, or just moved L535-537 before that if | 11:13 |
*** tonanhngo has quit IRC | 11:13 | |
ltomasbo | irenab, I mean, I moved the is_service_enabled kuryr-kubernetes checking to the other ifs, for the post-config and extra steps | 11:14 |
irenab | ltomasbo, | 11:14 |
ltomasbo | but installing the kubelet/cni regardless of the kuryr-kubernetes | 11:14 |
irenab | I see | 11:14 |
apuimedo | janonymous: instead of docker run and then stop, maybe "docker create" will be better | 11:15 |
irenab | ltomasbo, did you manage to solve the ODL/OVN trunk port status issue? | 11:15 |
ltomasbo | irenab, I think now the odl trunk port support is fixed | 11:24 |
janonymous | apuimedo: can we still see the logs in option a) | 11:24 |
ltomasbo | not from kuryr perspective, since there was a bug in ODL related to trunk ports | 11:24 |
ltomasbo | irenab, https://bugs.opendaylight.org/show_bug.cgi?id=8880 | 11:24 |
openstack | bugs.opendaylight.org bug 8880 in General "Trunk ports flows are not created for subports" [Normal,Waiting_for_review] - Assigned to vishal.thapar | 11:24 |
ltomasbo | I'm testing that and it seems to work | 11:24 |
irenab | ltomasbo, same with DF, child port was never moved to Active | 11:24 |
ltomasbo | but the problem with the subports being down is still there | 11:25 |
ltomasbo | I've been digging into the process and saw that OVN actually sets the status to up | 11:25 |
irenab | now there is a fix: https://review.openstack.org/487305 | 11:25 |
apuimedo | janonymous: mmm good point | 11:25 |
apuimedo | let me check | 11:25 |
ltomasbo | but then, there is a ovs transaction that sets parent port to '' | 11:26 |
irenab | ltomasbo, interesting | 11:26 |
ltomasbo | as it tries to get that information from neutron port (which does not have it) | 11:26 |
apuimedo | janonymous: for that you'd have to do "docker start --attach $name | 11:26 |
ltomasbo | then OVN lost the information about the parent, which was the reason to set it to up | 11:26 |
ltomasbo | so, it sets it to down again | 11:26 |
irenab | ltomasbo, seems strange, status is not something that shoudl arive from neutron | 11:26 |
ltomasbo | there are a couple of problems | 11:27 |
ltomasbo | one of them (at least in OVN) is that the ports does not have a host | 11:27 |
ltomasbo | as they are not directly linked to br-int | 11:27 |
janonymous | apuimedo: ohkay thanks!, i will spin a vm with that option to test locally | 11:27 |
ltomasbo | therefore, there are some checkings that avoid setting status to up | 11:27 |
ltomasbo | as the port is not 'bound' | 11:27 |
irenab | in DF we just decided to reflect the parent port status | 11:28 |
ltomasbo | we tried to remove that if for a while, and see that ovn was actually setting the subport to up | 11:28 |
apuimedo | janonymous: thanks | 11:28 |
ltomasbo | but then, there is a txn that sets some infromation in the ovsdb | 11:28 |
janonymous | apuimedo: :) | 11:29 |
ltomasbo | but it tries to get the parent information from the port status from neutron, which is missing, so it sets it to [] | 11:29 |
irenab | I think DF and OVN probably should have similar treatment of the child port | 11:29 |
ltomasbo | and when that happens, the port goes to down again in ovn | 11:29 |
ltomasbo | yep | 11:29 |
irenab | race condition? | 11:29 |
ltomasbo | what I saw if that trunk port support, related to port status is mainly missing | 11:30 |
ltomasbo | they did not take care of it at networking-odl and it is kind of broken | 11:30 |
ltomasbo | they were relying in some --binding-profile information in neutron | 11:30 |
ltomasbo | to get the parent port of a port, and the vlan_id | 11:30 |
irenab | seems per-trunk option | 11:30 |
ltomasbo | yep, I'll try to get some patches soon for this | 11:32 |
ltomasbo | same in odl | 11:32 |
ltomasbo | but for odl first I needed to get the trunk properly working | 11:32 |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: Use separate nets and project for kuryr https://review.openstack.org/486134 | 11:41 |
apuimedo | irenab: ltomasbo: dmellado: I need to verify this one manually still | 11:42 |
apuimedo | but look into the direction | 11:42 |
apuimedo | to see if it helps for what you were asking | 11:42 |
ltomasbo | I'll check right away | 11:43 |
apuimedo | thanks | 11:43 |
irenab | apuimedo, will check as well | 11:45 |
ltomasbo | apuimedo, L195 here https://review.openstack.org/#/c/486134/6/devstack/plugin.sh | 11:45 |
ltomasbo | for the nested case, we will need to always include kuryr_neutron_default_subnetpool_id, right? | 11:46 |
ltomasbo | as subnetpool_v4_id is not known | 11:46 |
ltomasbo | apuimedo, well, I'll do the review on the gerrit :D | 11:47 |
apuimedo | irenab: please, see the answer to your comments on https://review.openstack.org/#/c/466675/15 | 11:48 |
apuimedo | ltomasbo: that's right | 11:48 |
apuimedo | you should check a subnetpoolid from the undercloud and put it in your local.conf | 11:48 |
apuimedo | I feel like I'm only doing devstack lately | 11:51 |
apuimedo | xd | 11:51 |
*** tonanhngo has joined #openstack-kuryr | 11:54 | |
*** yamamoto has quit IRC | 11:57 | |
*** tonanhngo has quit IRC | 11:58 | |
*** tonanhngo has joined #openstack-kuryr | 11:58 | |
*** tonanhngo has quit IRC | 12:02 | |
*** yboaron_ has quit IRC | 12:07 | |
irenab | apuimedo, regarding vikasc patch, maybe worth to put devstack related instructions somewhere | 12:11 |
kzaitsev_ws | w | 12:11 |
*** atoth has joined #openstack-kuryr | 12:11 | |
ltomasbo | irenab, ++++1 on that | 12:13 |
*** yamamoto has joined #openstack-kuryr | 12:13 | |
*** yboaron_ has joined #openstack-kuryr | 12:22 | |
apuimedo | that's legitimate | 12:25 |
*** kzaitsev_ws has quit IRC | 12:41 | |
*** kzaitsev_ws has joined #openstack-kuryr | 12:42 | |
*** jerms has joined #openstack-kuryr | 12:47 | |
*** yamamoto has quit IRC | 12:54 | |
*** alraddarla has joined #openstack-kuryr | 13:08 | |
*** yamamoto has joined #openstack-kuryr | 13:09 | |
*** alraddarla has quit IRC | 13:27 | |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: Use separate nets and project for kuryr https://review.openstack.org/486134 | 13:49 |
dmellado | heh, again vikas and documentation? xD | 14:05 |
apuimedo | dmellado: no, no | 14:07 |
apuimedo | just lack of polish between devstack usages and implementation/documentation | 14:07 |
apuimedo | I think vikasc document on pod-in-vm was fine at the time it was merged, but more use cases and changes have appeared | 14:08 |
*** gouthamr has joined #openstack-kuryr | 14:12 | |
*** janki has quit IRC | 14:23 | |
*** yamamoto has quit IRC | 14:24 | |
*** limao has joined #openstack-kuryr | 14:24 | |
*** aojea has quit IRC | 14:31 | |
*** yboaron_ has quit IRC | 14:34 | |
openstackgerrit | Merged openstack/kuryr master: Update the documentation link for doc migration https://review.openstack.org/486523 | 14:38 |
*** jerms has quit IRC | 14:46 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kuryr master: Updated from global requirements https://review.openstack.org/485310 | 14:46 |
*** jerms has joined #openstack-kuryr | 14:54 | |
*** jerms has quit IRC | 14:54 | |
*** roeyc has quit IRC | 15:00 | |
openstackgerrit | Liping Mao proposed openstack/kuryr-libnetwork master: Fix Rally test case error. https://review.openstack.org/487476 | 15:12 |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: Use separate nets and project for kuryr https://review.openstack.org/486134 | 15:13 |
apuimedo | ltomasbo: I added the router as a configuration | 15:19 |
apuimedo | ltomasbo: which conf do you want me to put in the local.conf samples? | 15:20 |
*** limao has quit IRC | 15:21 | |
ltomasbo | apuimedo, great! | 15:23 |
*** limao has joined #openstack-kuryr | 15:23 | |
ltomasbo | I will test it | 15:23 |
ltomasbo | maybe in the local.conf for the overcloud you should add a note about those fields | 15:24 |
*** yamamoto has joined #openstack-kuryr | 15:24 | |
ltomasbo | stating they need to be filed with proper data, either that or in the documentation (or both) | 15:24 |
apuimedo | ltomasbo: A commented note I think could be useful | 15:26 |
ltomasbo | I agree | 15:26 |
ltomasbo | also, we need to change the checking about configure_neutron_defaults | 15:27 |
*** limao has quit IRC | 15:27 | |
ltomasbo | to ensure these actions are triggered in the nested environment | 15:27 |
ltomasbo | perhaps that is not even needed, as we will nave the info about the pod_subnet, pod_sq, service_subnet, right? | 15:28 |
ltomasbo | apuimedo, ^^ | 15:28 |
ltomasbo | so, it just need to be set to false? | 15:29 |
apuimedo | right | 15:30 |
apuimedo | ltomasbo: you'll need to specify the router | 15:30 |
apuimedo | and the pool | 15:30 |
*** limao has joined #openstack-kuryr | 15:30 | |
apuimedo | (if you don't specify the subnets, that is | 15:30 |
ltomasbo | I'll check this | 15:31 |
ltomasbo | thanks! I'm booting a VM, I'll paste my comments in the patch if it works! | 15:31 |
apuimedo | I'm checking the code now | 15:31 |
apuimedo | ltomasbo: I'm more interested in the case when it doesn't work | 15:32 |
ltomasbo | I'll let you know both ways... | 15:32 |
*** yamamoto has quit IRC | 15:36 | |
*** jerms has joined #openstack-kuryr | 15:39 | |
apuimedo | ltomasbo: I'm considering changing how we do the overcloud devstack config in the documentation | 15:41 |
*** aojea has joined #openstack-kuryr | 15:42 | |
ltomasbo | apuimedo, we need to do that, as it is not working right now | 15:42 |
*** limao_ has joined #openstack-kuryr | 15:44 | |
apuimedo | ltomasbo: what I meant is to get rid of local.conf.undercloud.sample | 15:46 |
apuimedo | you would just stack a default devstack with neutron-lbaasv2 | 15:46 |
*** aojea has quit IRC | 15:46 | |
apuimedo | so no kuryr-kubernetes plugin on the undercloud | 15:46 |
apuimedo | and then on the overcloud | 15:47 |
apuimedo | we do the net/subnet creation | 15:47 |
apuimedo | ltomasbo: wdyt? | 15:47 |
ltomasbo | yep, that is pretty much what I did in my deployment | 15:48 |
ltomasbo | apuimedo, ^^ | 15:48 |
apuimedo | ok then | 15:48 |
*** limao has quit IRC | 15:48 | |
apuimedo | ltomasbo: but in a follow-up patch | 15:50 |
ltomasbo | I'm fine with that too | 15:51 |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: Move to devstack-plugin-container https://review.openstack.org/474238 | 15:53 |
*** jermz has joined #openstack-kuryr | 15:56 | |
*** kzaitsev_ws has quit IRC | 16:02 | |
*** limao_ has quit IRC | 16:05 | |
*** limao has joined #openstack-kuryr | 16:06 | |
openstackgerrit | Liping Mao proposed openstack/kuryr-libnetwork master: Fix Rally test case error. https://review.openstack.org/487476 | 16:09 |
ltomasbo | apuimedo, note you also need to enable nova for the undercloud | 16:12 |
*** roeyc has joined #openstack-kuryr | 16:16 | |
apuimedo | ltomasbo: what do you mean? | 16:19 |
apuimedo | in the current undercloud we leave the default service, that means nova is there, isn't it? | 16:19 |
ltomasbo | sure sure | 16:19 |
ltomasbo | as you said you will only leave lbaasv2 | 16:19 |
ltomasbo | just wondering if you were thinking about having enabled_service="" | 16:20 |
apuimedo | ltomasbo: no, no. I meant nothing of kuryr | 16:25 |
ltomasbo | great! | 16:25 |
*** limao has quit IRC | 16:26 | |
*** limao has joined #openstack-kuryr | 16:27 | |
*** jerms has quit IRC | 16:28 | |
*** jermz has quit IRC | 16:28 | |
apuimedo | ltomasbo: did it work? | 16:30 |
ltomasbo | I was in a call, and the stack crashed, so I'm restacking | 16:31 |
ltomasbo | I'll let you know. I think it should work | 16:31 |
apuimedo | ok | 16:33 |
*** roeyc has quit IRC | 16:35 | |
*** roeyc has joined #openstack-kuryr | 16:35 | |
*** roeyc has quit IRC | 16:37 | |
*** limao has quit IRC | 16:47 | |
*** roeyc has joined #openstack-kuryr | 16:49 | |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: allow overriding keystone config https://review.openstack.org/487517 | 16:53 |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: do not delete service ipallocation pool https://review.openstack.org/487518 | 16:53 |
*** garyloug has quit IRC | 16:57 | |
*** aojea has joined #openstack-kuryr | 16:58 | |
*** egonzalez has quit IRC | 17:00 | |
*** roeyc has quit IRC | 17:01 | |
*** aojea has quit IRC | 17:02 | |
*** roeyc has joined #openstack-kuryr | 17:04 | |
*** roeyc has quit IRC | 17:04 | |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: do not delete service ipallocation pool https://review.openstack.org/487518 | 17:11 |
*** jerms has joined #openstack-kuryr | 17:12 | |
*** alraddarla has joined #openstack-kuryr | 17:24 | |
*** alraddarla has left #openstack-kuryr | 17:24 | |
*** aojea has joined #openstack-kuryr | 17:31 | |
*** aojea has quit IRC | 17:32 | |
*** aojea has joined #openstack-kuryr | 17:34 | |
*** aojea has quit IRC | 17:47 | |
*** yamamoto has joined #openstack-kuryr | 18:09 | |
*** yamamoto has quit IRC | 18:13 | |
*** aojea has joined #openstack-kuryr | 18:16 | |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: do not delete service ipallocation pool https://review.openstack.org/487518 | 18:18 |
*** kural_ has quit IRC | 18:30 | |
*** kural has quit IRC | 18:30 | |
*** aojea has quit IRC | 18:30 | |
*** aojea has joined #openstack-kuryr | 18:56 | |
*** aojea has quit IRC | 19:01 | |
*** atoth has quit IRC | 19:26 | |
*** yboaron_ has joined #openstack-kuryr | 19:29 | |
*** rwallner has quit IRC | 20:00 | |
*** rwallner_ has joined #openstack-kuryr | 20:04 | |
*** rwallner_ has quit IRC | 20:09 | |
*** gouthamr has quit IRC | 20:26 | |
*** gouthamr has joined #openstack-kuryr | 20:27 | |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: do not delete service ipallocation pool https://review.openstack.org/487518 | 20:44 |
*** aojea has joined #openstack-kuryr | 20:45 | |
*** tonanhngo has joined #openstack-kuryr | 21:01 | |
*** tonanhngo has quit IRC | 21:05 | |
*** rwallner has joined #openstack-kuryr | 21:15 | |
*** yamamoto_ has joined #openstack-kuryr | 21:19 | |
*** rwallner has quit IRC | 21:19 | |
*** yamamoto_ has quit IRC | 21:21 | |
*** yboaron_ has quit IRC | 22:08 | |
*** lihi has quit IRC | 22:13 | |
*** lihi has joined #openstack-kuryr | 22:14 | |
*** aojea has quit IRC | 22:23 | |
*** gouthamr has quit IRC | 22:28 | |
*** gouthamr has joined #openstack-kuryr | 22:42 | |
*** tonanhngo has joined #openstack-kuryr | 22:49 | |
*** tonanhngo has quit IRC | 22:53 | |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: do not delete service ipallocation pool https://review.openstack.org/487518 | 23:03 |
*** yamamoto has joined #openstack-kuryr | 23:10 | |
*** yamamoto has quit IRC | 23:37 | |
openstackgerrit | Antoni Segura Puimedon proposed openstack/kuryr-kubernetes master: devstack: do not delete service ipallocation pool https://review.openstack.org/487518 | 23:46 |
*** yamamoto has joined #openstack-kuryr | 23:51 | |
*** yamamoto_ has joined #openstack-kuryr | 23:55 | |
*** yamamoto has quit IRC | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!