| brtknr | jakeyip: if you don’t mind trying train-stable-3 and reporting back, that would be great | 00:21 |
|---|---|---|
| brtknr | Please add a comment to this story https://storyboard.openstack.org/#!/story/2007264 | 00:25 |
| brtknr | I am trying to merge the stable tag into new train release | 00:25 |
| jakeyip | brtknr: sure. may I ask what OS are you using? | 00:49 |
| *** ricolin has joined #openstack-containers | 02:01 | |
| *** rcernin has quit IRC | 02:49 | |
| *** rcernin has joined #openstack-containers | 02:55 | |
| *** rcernin has quit IRC | 03:08 | |
| *** rcernin has joined #openstack-containers | 03:50 | |
| *** ykarel|away is now known as ykarel | 04:08 | |
| *** vishalmanchanda has joined #openstack-containers | 04:42 | |
| *** threestrands has joined #openstack-containers | 05:27 | |
| *** threestrands has quit IRC | 05:33 | |
| *** udesale has joined #openstack-containers | 05:33 | |
| brtknr | jakeyip: im using both fcos and fatomic | 05:48 |
| *** nikparasyr has joined #openstack-containers | 06:15 | |
| *** ttsiouts has joined #openstack-containers | 07:13 | |
| *** rcernin has quit IRC | 07:47 | |
| *** flwang1 has joined #openstack-containers | 07:48 | |
| *** ttsiouts has quit IRC | 07:49 | |
| *** ttsiouts has joined #openstack-containers | 07:57 | |
| *** ykarel is now known as ykarel|lunch | 08:13 | |
| *** ramishra has quit IRC | 08:17 | |
| *** k_mouza has joined #openstack-containers | 08:31 | |
| *** k_mouza has quit IRC | 08:35 | |
| *** flwang1 has quit IRC | 08:54 | |
| *** flwang1 has joined #openstack-containers | 08:56 | |
| flwang1 | brtknr: strigazi: around for meeting today? | 08:57 |
| brtknr | flwang1: hello | 08:57 |
| flwang1 | brtknr: how are you? my friend | 08:57 |
| brtknr | flwang1: very well thanks, and yourself? | 08:58 |
| flwang1 | very good | 08:59 |
| flwang1 | except the news that 2 cases confirmed yesterday :( | 08:59 |
| flwang1 | from UK | 08:59 |
| brtknr | oh dear! | 08:59 |
| flwang1 | #startmeeting magnum | 09:00 |
| openstack | Meeting started Wed Jun 17 09:00:37 2020 UTC and is due to finish in 60 minutes. The chair is flwang1. Information about MeetBot at http://wiki.debian.org/MeetBot. | 09:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 09:00 |
| *** openstack changes topic to " (Meeting topic: magnum)" | 09:00 | |
| openstack | The meeting name has been set to 'magnum' | 09:00 |
| flwang1 | #topic roll call | 09:00 |
| *** openstack changes topic to "roll call (Meeting topic: magnum)" | 09:00 | |
| flwang1 | o/ | 09:00 |
| flwang1 | seems only you and me, brtknr | 09:00 |
| flwang1 | strigazi: jakeyip: | 09:01 |
| brtknr | o. | 09:01 |
| brtknr | o/ | 09:01 |
| flwang1 | brtknr: i don't have much topics for today | 09:01 |
| jakeyip | o/ | 09:02 |
| brtknr | nor me really, just wanted to bring to attention the releases | 09:02 |
| flwang1 | as long as I finish my internal k8s work, i will get the new api for get nodes of NG and master_lb_enabled for cluster creation done | 09:02 |
| flwang1 | brtknr: i think the train 9.4.0 is good for me | 09:02 |
| flwang1 | i need take a look the ussuri 10.1.0 | 09:02 |
| flwang1 | i'd like to make sure all the good patches have been backported | 09:03 |
| *** ykarel|lunch is now known as ykarel | 09:03 | |
| brtknr | flwang1: yeah i am in no rush for 10.1.0 but 9.4.0 is long overdue | 09:03 |
| flwang1 | brtknr: let's get it done | 09:03 |
| brtknr | but would like the last couple of patches to merge | 09:03 |
| flwang1 | to avoid release team tired to look after it | 09:03 |
| flwang1 | sure | 09:04 |
| flwang1 | i like your shebang patch | 09:05 |
| brtknr | flwang1: thanks | 09:06 |
| flwang1 | just one comment, is it only targeting remove the /usr/bin/bash line? | 09:06 |
| flwang1 | do you think it's a good idea to print the step for each script? | 09:06 |
| brtknr | both /bin/sh and /bin/bash | 09:06 |
| brtknr | flwang1: i have proposed a second patch to print step | 09:06 |
| flwang1 | fantastic | 09:07 |
| flwang1 | no problem | 09:07 |
| flwang1 | i will test it tomorrow | 09:07 |
| brtknr | https://review.opendev.org/#/c/735862/ | 09:07 |
| brtknr | the second patch also unsets options set in the beginning of the script | 09:07 |
| flwang1 | good | 09:07 |
| brtknr | we dont want strange unpredictable interaction between scripts | 09:07 |
| flwang1 | agree | 09:08 |
| flwang1 | btw, we have built a pipeline for hyperkube image | 09:09 |
| flwang1 | but i don't know how to implement it on openstack infra | 09:10 |
| flwang1 | i think that's one of the high priorities for our team | 09:10 |
| brtknr | flwang1: do you want to share it? | 09:11 |
| brtknr | Is it docker build? | 09:11 |
| flwang1 | brtknr: we still need sometime to polish it, but it can be shared for sure | 09:12 |
| brtknr | Ok | 09:13 |
| brtknr | flwang1: btw did you get a chance to look at this: https://review.opendev.org/#/c/735100/ | 09:13 |
| flwang1 | now the pipeline will create a VM and sync code to it, then run quick release to generate the hyperkbe image | 09:13 |
| flwang1 | then run kubeadm to start an allinone cluster and run sonobuoy to test it | 09:13 |
| flwang1 | sure, will review it | 09:14 |
| flwang1 | thanks for working on that | 09:14 |
| brtknr | flwang1: sorry what is the role of kubeadm here? | 09:15 |
| brtknr | to test the hyperkube image? | 09:15 |
| brtknr | are you building 1.19.x image? | 09:15 |
| flwang1 | yep, to test the hyperkube image | 09:15 |
| brtknr | ah ok | 09:16 |
| flwang1 | no, we're building v1.16.9 for testing, and will build v1.19.x in the near future | 09:16 |
| brtknr | Oh ok do you think the procedure for v1.19.x image will be the same? | 09:17 |
| flwang1 | it should be | 09:18 |
| flwang1 | i can't see why it doesn't work | 09:18 |
| brtknr | ok | 09:18 |
| flwang1 | i think the community just remove the hyperkube docker file building, they shouldn't change all the scripts to break things | 09:18 |
| brtknr | The alpha version of 1.19.x is already out | 09:19 |
| flwang1 | otherwise, they will get much more complains | 09:19 |
| brtknr | would be good if you could check quickly if the current docker file is compatible | 09:19 |
| flwang1 | good point, will do | 09:19 |
| brtknr | flwang1: thanks | 09:19 |
| brtknr | this is a rather annoying change | 09:20 |
| brtknr | i dont completely understand why they did it | 09:20 |
| brtknr | do you? | 09:20 |
| flwang1 | based on the issues, they think there are too many CVEs and the team don't want to maintain it anymore | 09:21 |
| flwang1 | but as strigazi said, k8s is such a big community | 09:23 |
| flwang1 | it's not responsible to leave this work to each org | 09:23 |
| flwang1 | to duplicate the effort | 09:23 |
| flwang1 | anything else you would like to discuss? | 09:24 |
| flwang1 | brtknr: can you please revisit https://review.opendev.org/#/c/733027/ ? | 09:25 |
| brtknr | lgtm thanks +2 from me | 09:26 |
| flwang1 | brtknr: thanks, i'm going to give it a ninjia approve based on the +2 from strigazi :) | 09:26 |
| brtknr | if you're sure... | 09:27 |
| flwang1 | btw, as for https://review.opendev.org/#/c/726017/ i'd like to understand how do you guys maintain templates | 09:27 |
| flwang1 | i'm working on k8s versions support policies, i'd like get some input if you don't mind | 09:28 |
| brtknr | flwang1: based on the discussion at PTG? | 09:29 |
| brtknr | where you can define upgrade path in templates? | 09:29 |
| flwang1 | yep, for example, how many versions you're supporting? | 09:30 |
| flwang1 | what happened if user's cluster are still on a version which has been deprecated? | 09:30 |
| *** born2bake has joined #openstack-containers | 09:31 | |
| brtknr | flwang1: we dont normally worry about this as most clusters are short-lived | 09:32 |
| brtknr | users create the cluster templates and clusters on demand | 09:32 |
| flwang1 | ah, right | 09:32 |
| flwang1 | ok | 09:32 |
| brtknr | flwang1: have you even thought about centos driver btw? | 09:34 |
| flwang1 | using centos as os? | 09:34 |
| brtknr | flwang1: yes | 09:35 |
| flwang1 | i think blizzard did that | 09:35 |
| flwang1 | but they didn't contribute it back | 09:35 |
| brtknr | flwang1: they never upstreamed the driver right? | 09:35 |
| flwang1 | yes | 09:35 |
| brtknr | i am working on a use case which requires centos driver | 09:36 |
| flwang1 | they shared some personal code piece IIRC | 09:36 |
| flwang1 | interesting | 09:36 |
| flwang1 | you can reach out them and see if they would like to upsteam | 09:36 |
| brtknr | because Mellanox OFED drivers cannot be easily installed on fedora atomic | 09:36 |
| brtknr | or fedora coreos | 09:36 |
| brtknr | so at the moment, i am using a kubespray cluster instead of Magnum | 09:37 |
| *** ramishra has joined #openstack-containers | 09:37 | |
| flwang1 | i see | 09:38 |
| flwang1 | anything else you would like to discuss? i'm going to offline now | 09:39 |
| brtknr | thats all from me | 09:39 |
| brtknr | I thought about something earlier but I cant remember it | 09:39 |
| jakeyip | I have something... thanks brtknr for pointing out hca issue | 09:40 |
| flwang1 | :) no worries, you can leave message any time or just drop an email to me | 09:40 |
| flwang1 | #endmeeting | 09:40 |
| *** openstack changes topic to "OpenStack Containers Team | Meeting: every Wednesday @ 9AM UTC | Agenda: https://etherpad.openstack.org/p/magnum-weekly-meeting" | 09:40 | |
| openstack | Meeting ended Wed Jun 17 09:40:33 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 09:40 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/magnum/2020/magnum.2020-06-17-09.00.html | 09:40 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/magnum/2020/magnum.2020-06-17-09.00.txt | 09:40 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/magnum/2020/magnum.2020-06-17-09.00.log.html | 09:40 |
| flwang1 | jakeyip: hello | 09:40 |
| brtknr | jakeyip: thanks for posting your feedback on gerrit | 09:40 |
| brtknr | glad train-stable-3 solved your problem :) | 09:41 |
| jakeyip | can we try to get it in? I find that it is very frustrating for ops when things break out of the box. | 09:41 |
| brtknr | flwang1: not sure if you're aware but the current version of ussuri-dev doesnt work on Train or Ussuri stable branches | 09:41 |
| flwang1 | jakeyip: when you say it doesn't work, do you mean the thread joining issue? | 09:42 |
| jakeyip | flwang1: I'm unsure of the exact issue, brtknr might know better | 09:43 |
| flwang1 | jakeyip: hmm... that's not the answer i'd like to know :D | 09:44 |
| brtknr | flwang1: no not thread joining issue, ussuri-dev comes with kubectl version 1.18.2 which requires KUBECONFIG to be present in the environment | 09:44 |
| flwang1 | right | 09:45 |
| brtknr | train-stable-3 and ussuri-stable-1 have kubernetes client v1.15.x which assumes that kubernetes is running on localhost so doesnt have this problem | 09:45 |
| flwang1 | that's very important information | 09:45 |
| jakeyip | I'm wondering what's the config that CI is running? And if me as an op can follow the recommended CI config for image and container versions so I don't have things breaking out of the box. | 09:45 |
| flwang1 | brtknr: how did we build the train-stable-3 to include the kubectl v1.15.x? | 09:47 |
| brtknr | flwang1: because it uses fedora:32 | 09:47 |
| brtknr | ussuri-dev is based on fedora:33 | 09:47 |
| flwang1 | ah, i remember now | 09:48 |
| jakeyip | ah that makes sense | 09:48 |
| jakeyip | is this fcoreos ? | 09:49 |
| brtknr | jakeyip: just the container base image | 09:49 |
| jakeyip | ok | 09:49 |
| brtknr | https://github.com/openstack/magnum/blob/master/dockerfiles/heat-container-agent/Dockerfile#L1 | 09:49 |
| brtknr | jakeyip: | 09:49 |
| jakeyip | cool thanks | 09:50 |
| flwang1 | ok, i have to go | 09:50 |
| flwang1 | ttyl | 09:50 |
| flwang1 | thank you for joining | 09:50 |
| jakeyip | what OS will train-stable-3 work with? I got it working with fa29 but not fcos31 | 09:50 |
| jakeyip | seeya flwang1 | 09:50 |
| brtknr | jakeyip: what error do you see with fcos31? | 09:51 |
| brtknr | are you using master? | 09:51 |
| brtknr | it should work with both | 09:51 |
| jakeyip | ignition error like `Ignition failed: config is not valid` | 09:53 |
| jakeyip | are you referring to magnum master? | 09:53 |
| jakeyip | `[0;1;31m[0merror at line 1 col 2: invalid character 'C' looking for beginning of value` | 09:54 |
| openstackgerrit | Merged openstack/magnum stable/train: resize: Send only nodes_to_remove and node_count https://review.opendev.org/735154 | 10:00 |
| jakeyip | I'm still trying to track it down... it seems like something broken in the worker node VM. This is the console log https://termbin.com/md8x | 10:07 |
| *** k_mouza has joined #openstack-containers | 10:20 | |
| *** ttsiouts has quit IRC | 10:22 | |
| *** ttsiouts has joined #openstack-containers | 10:23 | |
| *** ttsiouts has quit IRC | 10:27 | |
| *** ttsiouts has joined #openstack-containers | 11:02 | |
| *** k_mouza has quit IRC | 11:04 | |
| openstackgerrit | Merged openstack/magnum stable/ussuri: [fix] Use default_ng_worker.node_count for patches https://review.opendev.org/735243 | 11:06 |
| *** ttsiouts has quit IRC | 11:08 | |
| *** k_mouza has joined #openstack-containers | 11:08 | |
| brtknr | jakeyip: that does not look related to heat-container-agent at all | 11:16 |
| brtknr | jakeyip: what version of magnum/heat are you running? | 11:17 |
| *** nikparasyr has quit IRC | 11:19 | |
| *** ttsiouts has joined #openstack-containers | 11:25 | |
| *** ttsiouts has quit IRC | 11:26 | |
| *** ttsiouts has joined #openstack-containers | 11:26 | |
| openstackgerrit | Merged openstack/magnum master: Fix proxy issue for etcd and k8s https://review.opendev.org/733027 | 11:40 |
| *** ttsiouts has quit IRC | 12:16 | |
| *** ttsiouts has joined #openstack-containers | 12:16 | |
| *** ttsiouts has quit IRC | 12:21 | |
| *** ttsiouts has joined #openstack-containers | 12:25 | |
| *** jmlowe has quit IRC | 12:29 | |
| *** jmlowe has joined #openstack-containers | 12:32 | |
| *** nikparasyr has joined #openstack-containers | 12:39 | |
| openstackgerrit | Merged openstack/magnum stable/ussuri: More verbose logs for cluster ops https://review.opendev.org/735149 | 12:40 |
| *** ttsiouts has quit IRC | 13:18 | |
| *** ttsiouts has joined #openstack-containers | 13:19 | |
| *** ttsiouts has quit IRC | 13:19 | |
| *** ttsiouts has joined #openstack-containers | 13:19 | |
| *** udesale_ has joined #openstack-containers | 13:26 | |
| *** udesale has quit IRC | 13:28 | |
| *** ricolin has quit IRC | 13:40 | |
| *** kberger_ has joined #openstack-containers | 13:45 | |
| *** kberger_ has quit IRC | 13:46 | |
| *** kberger_ has joined #openstack-containers | 13:46 | |
| *** KeithMnemonic has quit IRC | 13:49 | |
| *** nikparasyr has quit IRC | 14:10 | |
| *** flwang1 has quit IRC | 14:12 | |
| *** ttsiouts has quit IRC | 14:16 | |
| *** ttsiouts has joined #openstack-containers | 14:17 | |
| *** ttsiouts has quit IRC | 14:21 | |
| *** ttsiouts has joined #openstack-containers | 14:22 | |
| *** ttsiouts has quit IRC | 15:01 | |
| *** ttsiouts has joined #openstack-containers | 15:01 | |
| *** ttsiouts has quit IRC | 15:06 | |
| *** ttsiouts has joined #openstack-containers | 15:17 | |
| *** ttsiouts has quit IRC | 15:33 | |
| *** ttsiouts has joined #openstack-containers | 15:33 | |
| *** ttsiouts has quit IRC | 15:38 | |
| *** udesale_ has quit IRC | 15:53 | |
| *** ykarel is now known as ykarel|away | 16:33 | |
| *** pcaruana has quit IRC | 17:03 | |
| *** pcaruana has joined #openstack-containers | 17:03 | |
| *** k_mouza has quit IRC | 17:16 | |
| *** k_mouza has joined #openstack-containers | 17:16 | |
| *** kberger_ has quit IRC | 17:20 | |
| *** k_mouza has quit IRC | 17:21 | |
| *** KeithMnemonic has joined #openstack-containers | 17:25 | |
| *** KeithMnemonic has quit IRC | 17:27 | |
| *** KeithMnemonic has joined #openstack-containers | 17:37 | |
| *** KeithMnemonic has quit IRC | 17:43 | |
| *** ttsiouts has joined #openstack-containers | 19:32 | |
| *** vishalmanchanda has quit IRC | 19:38 | |
| *** ttsiouts has quit IRC | 19:42 | |
| *** ttsiouts has joined #openstack-containers | 19:43 | |
| *** ttsiouts has quit IRC | 19:47 | |
| *** dtomasgu_ has joined #openstack-containers | 20:12 | |
| *** tobberydberg_ has joined #openstack-containers | 20:12 | |
| *** _ioni has joined #openstack-containers | 20:12 | |
| *** irclogbot_2 has quit IRC | 20:18 | |
| *** tobberydberg has quit IRC | 20:18 | |
| *** ioni has quit IRC | 20:18 | |
| *** mgoddard has quit IRC | 20:18 | |
| *** dtruong has quit IRC | 20:18 | |
| *** dtomasgu has quit IRC | 20:18 | |
| *** dtruong has joined #openstack-containers | 20:19 | |
| *** irclogbot_0 has joined #openstack-containers | 20:20 | |
| *** _ioni is now known as ioni | 20:26 | |
| *** lxkong has quit IRC | 20:35 | |
| *** PrinzElvis has quit IRC | 20:49 | |
| *** ttsiouts has joined #openstack-containers | 20:52 | |
| *** PrinzElvis has joined #openstack-containers | 20:52 | |
| *** ttsiouts has quit IRC | 20:57 | |
| *** PrinzElvis has quit IRC | 20:57 | |
| *** lxkong has joined #openstack-containers | 21:09 | |
| *** noonedeadpunk has quit IRC | 21:12 | |
| *** lxkong has quit IRC | 21:16 | |
| *** lxkong has joined #openstack-containers | 21:34 | |
| *** PrinzElvis has joined #openstack-containers | 21:35 | |
| *** k_mouza has joined #openstack-containers | 21:45 | |
| *** k_mouza has quit IRC | 21:49 | |
| *** born2bake has quit IRC | 22:22 | |
| *** rcernin has joined #openstack-containers | 22:42 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!