| *** cbrumm has quit IRC | 00:39 | |
| *** cbrumm has joined #openstack-containers | 00:41 | |
| *** openstackgerrit has joined #openstack-containers | 00:52 | |
| openstackgerrit | JangwonLee proposed openstack/magnum master: Add prometheus-monitoring namespace https://review.openstack.org/600905 | 00:52 |
|---|---|---|
| *** ricolin has joined #openstack-containers | 01:33 | |
| *** dave-mccowan has quit IRC | 01:42 | |
| *** dave-mccowan has joined #openstack-containers | 02:00 | |
| *** ramishra has joined #openstack-containers | 02:18 | |
| *** dave-mccowan has quit IRC | 02:20 | |
| *** hongbin has joined #openstack-containers | 02:37 | |
| *** flwang has joined #openstack-containers | 02:42 | |
| *** ykarel|away has joined #openstack-containers | 03:01 | |
| *** lbragstad has quit IRC | 03:04 | |
| openstackgerrit | Merged openstack/magnum-ui master: When selecting a image for cluster, many invalid images are shown. If a project has a lot of images, options can be quite long, and cause wrong selctiong by mistake. So I add a filter after fetching images, now images that has "os_distro" property and it' https://review.openstack.org/599235 | 03:07 |
| *** ykarel|away has quit IRC | 03:07 | |
| *** lbragstad has joined #openstack-containers | 03:12 | |
| *** ricolin has quit IRC | 03:13 | |
| *** ricolin has joined #openstack-containers | 03:15 | |
| *** hongbin has quit IRC | 03:25 | |
| *** lbragstad has quit IRC | 03:48 | |
| *** udesale has joined #openstack-containers | 03:53 | |
| *** ricolin has quit IRC | 04:03 | |
| *** ykarel|away has joined #openstack-containers | 04:08 | |
| *** ykarel|away has quit IRC | 04:34 | |
| *** ykarel|away has joined #openstack-containers | 04:53 | |
| *** ykarel|away is now known as ykarel | 04:55 | |
| *** mvpnitesh has joined #openstack-containers | 05:18 | |
| *** belmoreira has joined #openstack-containers | 05:30 | |
| *** janki has joined #openstack-containers | 06:08 | |
| *** rcernin has quit IRC | 07:03 | |
| *** serlex has joined #openstack-containers | 07:05 | |
| *** ykarel is now known as ykarel|lunch | 07:31 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/magnum-ui master: Imported Translations from Zanata https://review.openstack.org/603311 | 08:00 |
| *** mattgo has joined #openstack-containers | 08:04 | |
| *** mvpnitesh has quit IRC | 08:06 | |
| *** belmoreira has quit IRC | 08:15 | |
| *** ykarel|lunch is now known as ykarel | 08:25 | |
| *** lbragstad has joined #openstack-containers | 08:59 | |
| *** belmoreira has joined #openstack-containers | 09:04 | |
| *** belmoreira has quit IRC | 09:10 | |
| *** belmoreira has joined #openstack-containers | 09:11 | |
| *** mvpnitesh has joined #openstack-containers | 09:14 | |
| *** keystonerc_admin has joined #openstack-containers | 09:38 | |
| keystonerc_admin | Anybody know what's happening about Kubernetes cloud-provider-openstack? | 09:40 |
| keystonerc_admin | It seems to have been extracted from controller manager and doesn't look like it's been containerized yet | 09:44 |
| *** mattgo has quit IRC | 09:50 | |
| *** ykarel is now known as ykarel|away | 09:50 | |
| *** ykarel|away is now known as ykarel|afk | 09:51 | |
| brtknr | meeting today? | 09:57 |
| brtknr | strigazi: ? | 09:58 |
| *** flwang1 has joined #openstack-containers | 10:01 | |
| flwang1 | strigazi: around for sync? | 10:01 |
| *** udesale has quit IRC | 10:47 | |
| brtknr | flwang1: strigazi: do you guys know how to bring a magnum cluster out of "UPDATE FAILED" state? | 10:50 |
| flwang1 | how did you do the update? | 10:50 |
| brtknr | openstack coe cluster update cluster replace nodes=3 | 10:51 |
| brtknr | unfortunately a colleague who did not create the cluster tried to update and it failed because the key verification failed | 10:52 |
| brtknr | now i was able to update its state via heat but magnum still reports update failed state | 10:52 |
| brtknr | this is in queens | 10:53 |
| *** ykarel|afk is now known as ykarel | 11:00 | |
| strigazi | flwang1: I'm in a 1h meeting, it ends in ~55 | 11:03 |
| strigazi | flwang1: I can chat a bit here | 11:04 |
| strigazi | brtknr: yes, we will have a meeting today | 11:09 |
| strigazi | brtknr: https://wiki.openstack.org/wiki/Meetings/Containers | 11:10 |
| strigazi | flwang1: flwang ^^ | 11:12 |
| brtknr | strigazi: does this patch address "UPDATED FAILED" clusters? https://review.openstack.org/#/c/600806/ | 11:27 |
| *** mattgo has joined #openstack-containers | 11:30 | |
| *** mvpnitesh has quit IRC | 11:39 | |
| strigazi | brtknr: yes | 11:44 |
| strigazi | brtknr: almost all of the cases | 11:45 |
| *** dave-mccowan has joined #openstack-containers | 12:23 | |
| *** dave-mccowan has quit IRC | 12:28 | |
| brtknr | strigazi: so this patch will attempt to update a cluster if it is already in a "UPDATE FAILED" state? | 12:47 |
| *** salmankhan has joined #openstack-containers | 13:10 | |
| *** flwang1 has quit IRC | 13:47 | |
| *** lbragstad has quit IRC | 13:53 | |
| *** lbragstad has joined #openstack-containers | 13:54 | |
| *** ykarel is now known as ykarel|away | 14:16 | |
| *** zul has joined #openstack-containers | 14:28 | |
| *** ykarel|away has quit IRC | 14:36 | |
| *** hongbin has joined #openstack-containers | 14:46 | |
| *** ramishra has quit IRC | 15:07 | |
| *** zul has quit IRC | 15:08 | |
| *** belmoreira has quit IRC | 15:15 | |
| *** zul has joined #openstack-containers | 15:19 | |
| *** serlex has quit IRC | 15:42 | |
| *** mattgo has quit IRC | 15:59 | |
| *** ykarel|away has joined #openstack-containers | 16:10 | |
| keystonerc_admin | I want to containerize k8s cloud-provider-openstack. Can anyone point me in the right direction? | 16:11 |
| *** salmankhan has quit IRC | 17:10 | |
| *** jchhatbar has joined #openstack-containers | 17:14 | |
| *** errantekarmico has joined #openstack-containers | 17:16 | |
| *** janki has quit IRC | 17:17 | |
| *** jchhatbar has quit IRC | 17:40 | |
| *** ykarel|away has quit IRC | 18:10 | |
| *** errantekarmico has quit IRC | 18:40 | |
| *** errantekarmico has joined #openstack-containers | 18:40 | |
| *** errantekarmico has quit IRC | 18:43 | |
| *** errantekarmico has joined #openstack-containers | 18:44 | |
| *** ricolin has joined #openstack-containers | 18:46 | |
| *** errantekarmico has quit IRC | 19:00 | |
| *** errantekarmico has joined #openstack-containers | 19:01 | |
| *** errantekarmico has quit IRC | 19:03 | |
| *** errantekarmico has joined #openstack-containers | 19:03 | |
| *** errantekarmico has quit IRC | 19:06 | |
| *** errantekarmico has joined #openstack-containers | 19:07 | |
| *** errantekarmico has quit IRC | 19:08 | |
| *** errantekarmico has joined #openstack-containers | 19:09 | |
| *** errantekarmico has quit IRC | 19:14 | |
| *** errantekarmico has joined #openstack-containers | 19:20 | |
| *** errantekarmico has quit IRC | 19:24 | |
| *** errantekarmico has joined #openstack-containers | 19:24 | |
| *** errantekarmico has quit IRC | 19:35 | |
| *** errantekarmico has joined #openstack-containers | 19:35 | |
| *** errantekarmico has quit IRC | 19:38 | |
| *** errantekarmico has joined #openstack-containers | 19:39 | |
| *** oikiki has joined #openstack-containers | 19:48 | |
| *** dave-mccowan has joined #openstack-containers | 20:07 | |
| *** errantekarmico has quit IRC | 20:13 | |
| imdigitaljim | https://github.com/kubernetes/cloud-provider-openstack/blob/master/Makefile#L190 | 20:56 |
| strigazi | keystonerc_admin: ^^ | 20:57 |
| strigazi | #startmeeting containers | 21:00 |
| openstack | Meeting started Tue Sep 18 21:00:43 2018 UTC and is due to finish in 60 minutes. The chair is strigazi. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: containers)" | 21:00 | |
| openstack | The meeting name has been set to 'containers' | 21:00 |
| strigazi | #topic Roll Call | 21:01 |
| *** openstack changes topic to "Roll Call (Meeting topic: containers)" | 21:01 | |
| strigazi | o/ | 21:01 |
| colin- | hello | 21:01 |
| cbrumm | o/ | 21:01 |
| imdigitaljim | o/ | 21:01 |
| strigazi | Let's go diretly to stories/ideas, no more bps :) | 21:02 |
| strigazi | #topic Stories/Ideas | 21:02 |
| *** openstack changes topic to "Stories/Ideas (Meeting topic: containers)" | 21:02 | |
| strigazi | What I would like more review is on : Fix cluster update command https://storyboard.openstack.org/#!/story/1722573 Patch in review: https://review.openstack.org/#/c/600806/ | 21:03 |
| strigazi | To unblock cluster-updates | 21:03 |
| cbrumm | we'll get some eyes on it | 21:04 |
| strigazi | plus we need a patch to be able to fix clusters in UPDATE_FAILED | 21:04 |
| strigazi | I can do it, I'll ping you | 21:04 |
| strigazi | In heat at least you can do stack update and go back in a good state | 21:05 |
| strigazi | #action strigazi to push a patch for allowing cluster-update on UPDATE_FAILED clusters | 21:05 |
| strigazi | I would also like to ask for review on making flannel self hosted: | 21:06 |
| strigazi | https://review.openstack.org/#/c/597150/ | 21:06 |
| imdigitaljim | oh awesome! | 21:06 |
| imdigitaljim | that will make managing CNI a little cleaner :D | 21:07 |
| cbrumm | we'll check that out too | 21:07 |
| strigazi | Laste week we rebooted hypervisors for l1tf and many nodes didn't have network | 21:07 |
| imdigitaljim | strigazi: i had been working on some changes that would be good to add to https://review.openstack.org/#/c/585420/ | 21:07 |
| strigazi | imdigitaljim: I'll strip the patch from the controller manager container, and just have CI code + git mv the container agent | 21:08 |
| strigazi | other changes can be added on top | 21:08 |
| strigazi | You can push a patch with this one as dependency | 21:08 |
| strigazi | imdigitaljim: The changes are for containers or the ci? | 21:09 |
| imdigitaljim | some additional changes for the containers | 21:09 |
| imdigitaljim | sorry some additional containers* | 21:09 |
| imdigitaljim | and only a couple changes | 21:10 |
| imdigitaljim | I have a latest (3.3.9) minimal etcd container | 21:10 |
| strigazi | if they are not for the CI let's do them ina follow-up patch | 21:10 |
| imdigitaljim | and a heat-container-agent using alpine as its base | 21:10 |
| imdigitaljim | sounds good | 21:10 |
| strigazi | imdigitaljim: sounds good, based on quai.io? | 21:10 |
| imdigitaljim | the etcd is | 21:11 |
| strigazi | for etcd ^^ | 21:11 |
| imdigitaljim | FROM quay.io/coreos/etcd:$ETCD_VERSION | 21:11 |
| strigazi | cool | 21:11 |
| strigazi | 3.3.x cleans the log of the api server | 21:11 |
| imdigitaljim | :) | 21:11 |
| imdigitaljim | and its much smalelr | 21:11 |
| strigazi | from blah blah compacted blah blah | 21:12 |
| imdigitaljim | I've also finalized the calico update to latest | 21:12 |
| imdigitaljim | on our side, i'll get it all updated soon | 21:13 |
| imdigitaljim | had a slow ramp-up since our trip :] | 21:13 |
| strigazi | :) | 21:13 |
| strigazi | oh, right, can you also update the no-keypair option? | 21:14 |
| strigazi | I'll also update the patch to pass the actual public key as a string | 21:14 |
| flwang | sorry for the late | 21:15 |
| strigazi | not a keypair object, to allow cluster updates | 21:15 |
| strigazi | flwang: welcome | 21:15 |
| strigazi | Since flwang is here, | 21:16 |
| imdigitaljim | https://review.openstack.org/#/c/590443/ | 21:16 |
| imdigitaljim | this one/ | 21:16 |
| imdigitaljim | ? | 21:16 |
| imdigitaljim | flwang: hi! o/ | 21:16 |
| strigazi | imdigitaljim: oh, I thought it was in conflict, looks good | 21:16 |
| strigazi | yes this one | 21:16 |
| flwang | imdigitaljim: strigazi: i'm keen to know the output of Blizzard visiting to CERN ;) | 21:16 |
| strigazi | flwang: we missed you :) | 21:17 |
| imdigitaljim | strigazi: i think going into the next couple weeks ill be looking into the in-place upgrade mechanism as well | 21:18 |
| imdigitaljim | flwang: ^ | 21:18 |
| strigazi | cool | 21:18 |
| imdigitaljim | did you have any new updates to that? | 21:19 |
| strigazi | flwang: eandersson might have a fix for the UTs for the cluster healing cmd | 21:19 |
| colin- | strigazi, flwang are you guys using Designate? is anyone else who might be lurking using it? just curious | 21:19 |
| strigazi | flwang: we just need to test if it works in an actual py36 env | 21:19 |
| strigazi | imdigitaljim: not much, we can sync tmr if you can | 21:20 |
| imdigitaljim | yeah sounds good! | 21:20 |
| flwang | strigazi: yep, i saw that | 21:20 |
| strigazi | colin-: we have our own DNS, many years old :) | 21:21 |
| flwang | i will test it in with both UT and run it in a py36 env | 21:21 |
| imdigitaljim | also ill rebase/update the previous PRs with some new changes, such as starting to use config file instead of flags to move forward from deprecation | 21:21 |
| flwang | colin-: no, we haven't enabled Designate, but it's on our roadmap | 21:21 |
| eandersson | I wish we knew someone on the Designate team | 21:21 |
| colin- | ok | 21:21 |
| imdigitaljim | and kube-proxy daemonset most likely | 21:21 |
| strigazi | imdigitaljim: sounds good, I would do proxy first | 21:22 |
| strigazi | imdigitaljim: flwang in calico, can you tell easily which pods dont' have network? | 21:24 |
| strigazi | imdigitaljim: flwang with the l1tf reboots, the nodes were up, they had ips but not network acccess | 21:24 |
| flwang | strigazi: what do you mean don't have network? there is a calico command can help you understand the network status of each pod | 21:25 |
| imdigitaljim | yeah | 21:25 |
| flwang | i had a blog but i didn't have time to finish it :( shame on me | 21:25 |
| strigazi | flwang: ping each other | 21:25 |
| imdigitaljim | and you can generally see that the daemonset on the nodes isnt coming online | 21:25 |
| imdigitaljim | you can see which nodes are having issues | 21:25 |
| strigazi | well, in our case, flannel was up, the pods too but they couldn't connect to each other | 21:26 |
| flwang | strigazi: yep, sure, the debug process with calico is fairly normal like general network debug | 21:26 |
| strigazi | ok, I was looking for a heartbeat or smth | 21:26 |
| flwang | 1. make sure pod can talk to local node, 2. make sure the node can talk each other | 21:26 |
| flwang | need some iptables knowledge | 21:27 |
| strigazi | yes, but it is a bit manual. I was doing this exacltly | 21:27 |
| flwang | due to involving the network policy | 21:27 |
| flwang | strigazi: yep, not sure if there is a fully automated way to debug it, but given it's normal process, we could probably write a script | 21:28 |
| flwang | we're deploying magnum into prod in catalyst cloud this week, so pls forgive my latency for upstream work | 21:29 |
| strigazi | no prob | 21:29 |
| colin- | gl :) | 21:29 |
| imdigitaljim | yeah gl! | 21:29 |
| cbrumm | go flwang! | 21:29 |
| eandersson | \o/ | 21:29 |
| flwang | cross finger for me :D | 21:30 |
| strigazi | keep us posted :) | 21:30 |
| flwang | sure | 21:30 |
| flwang | ah, i do have a question | 21:30 |
| strigazi | if heat is going well, magnum will go well too | 21:30 |
| flwang | based on the code, magnum doesn't support rotate certs for k8s | 21:30 |
| strigazi | no, it doesn't | 21:30 |
| flwang | but we're showing the menu on magnum-ui | 21:30 |
| flwang | shouldn't we drop it until we can really support it | 21:31 |
| strigazi | I think if you change the policy, it will hide | 21:31 |
| strigazi | not 100% sure | 21:31 |
| flwang | strigazi: good point, will try | 21:31 |
| strigazi | I can ask tmr in our team | 21:32 |
| flwang | https://ibb.co/cFxT4z | 21:33 |
| flwang | that's the dashboard we're using in catalyst cloud | 21:33 |
| strigazi | it looks cool | 21:34 |
| strigazi | are you in the openstack passport program, not sure how it is called | 21:34 |
| flwang | strigazi: we're | 21:34 |
| strigazi | uses will see magnum there? | 21:35 |
| flwang | strigazi: yes, for sure, but not now | 21:35 |
| strigazi | nice | 21:35 |
| flwang | probably next couple of weeks | 21:35 |
| strigazi | very cool | 21:35 |
| flwang | https://catalystcloud.nz/services/paas/catalyst-kubernetes-service/ | 21:35 |
| flwang | we're using the vanilla upstream Magnum now | 21:36 |
| flwang | and we'd like to stick on that as much as we can | 21:36 |
| flwang | we'd like to upstream whatever can benefit others | 21:36 |
| strigazi | :) | 21:36 |
| strigazi | It seems we are covered, anything else to discuss? | 21:38 |
| flwang | no | 21:39 |
| flwang | im good | 21:39 |
| imdigitaljim | no all set here :) | 21:39 |
| flwang | ah, one small thing | 21:39 |
| flwang | i can manage to get the ds work for keystone auth | 21:39 |
| flwang | i will propose new patch set early next week | 21:39 |
| strigazi | +1 | 21:40 |
| strigazi | Thanks for joining imdigitaljim flwang cbrumm colin- eandersson | 21:41 |
| eandersson | Anytime! | 21:41 |
| flwang | strigazi: thank you | 21:41 |
| strigazi | #endmeeting | 21:41 |
| *** openstack changes topic to "OpenStack Containers Team" | 21:41 | |
| openstack | Meeting ended Tue Sep 18 21:41:32 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:41 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-09-18-21.00.html | 21:41 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-09-18-21.00.txt | 21:41 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-09-18-21.00.log.html | 21:41 |
| colin- | ttyl | 21:44 |
| *** oikiki has quit IRC | 21:47 | |
| *** ricolin has quit IRC | 22:13 | |
| *** ekarmic has joined #openstack-containers | 22:30 | |
| *** rcernin has joined #openstack-containers | 22:47 | |
| *** janki has joined #openstack-containers | 22:47 | |
| *** ekarmic has quit IRC | 22:47 | |
| *** errantekarmico has joined #openstack-containers | 22:48 | |
| *** hongbin has quit IRC | 23:03 | |
| eandersson | btw flwang gotta love me a minor mystery :D | 23:21 |
| eandersson | Took me longer than it should have to figure out that unit-test bug. | 23:22 |
| flwang | eandersson: thank you for the comments | 23:25 |
| flwang | i'm going to upload a new patchset to test and test it locally to see if it's fully working | 23:25 |
| openstackgerrit | Feilong Wang proposed openstack/magnum master: [k8s] Update cluster health status by native API https://review.openstack.org/572897 | 23:39 |
| *** errantekarmico has quit IRC | 23:40 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!