*** threestrands has joined #openstack-containers | 00:09 | |
openstackgerrit | Merged openstack/magnum stable/train: api: Do not guess based on name extension https://review.opendev.org/731175 | 00:55 |
---|---|---|
openstackgerrit | Merged openstack/magnum stable/stein: api: Do not guess based on name extension https://review.opendev.org/731176 | 00:55 |
openstackgerrit | Merged openstack/magnum stable/ussuri: [k8s] Expose autoscaler prometheus metrics https://review.opendev.org/731161 | 00:56 |
openstackgerrit | Merged openstack/magnum stable/ussuri: Scrape traefik and autoscaler metrics https://review.opendev.org/731162 | 00:57 |
openstackgerrit | Merged openstack/magnum stable/ussuri: Update prometheus monitoring chart and images https://review.opendev.org/731163 | 00:57 |
openstackgerrit | Merged openstack/magnum stable/ussuri: Scrape internal kubernetes components https://review.opendev.org/731164 | 00:57 |
openstackgerrit | Merged openstack/magnum stable/ussuri: [k8s] Use Helm v3 by default https://review.opendev.org/731165 | 00:58 |
*** rcernin has quit IRC | 00:58 | |
*** rcernin has joined #openstack-containers | 01:04 | |
*** k_mouza has joined #openstack-containers | 02:21 | |
*** k_mouza has quit IRC | 02:25 | |
*** rcernin has quit IRC | 03:01 | |
*** ricolin has joined #openstack-containers | 03:13 | |
*** rcernin has joined #openstack-containers | 03:15 | |
*** rcernin has quit IRC | 03:19 | |
*** rcernin has joined #openstack-containers | 03:19 | |
openstackgerrit | inspurericzhang proposed openstack/magnum-tempest-plugin master: Add py38 package metadata https://review.opendev.org/731410 | 03:39 |
*** threestrands has quit IRC | 03:49 | |
*** rcernin has quit IRC | 03:57 | |
*** rcernin has joined #openstack-containers | 04:16 | |
*** sapd1 has joined #openstack-containers | 04:19 | |
*** ykarel|away is now known as ykarel | 04:23 | |
*** rcernin has quit IRC | 04:48 | |
*** rcernin has joined #openstack-containers | 04:49 | |
*** udesale has joined #openstack-containers | 05:18 | |
*** ramishra has quit IRC | 05:50 | |
openstackgerrit | Merged openstack/magnum stable/ussuri: k8s: Add admin.conf kubeconfig https://review.opendev.org/731139 | 06:10 |
*** vishalmanchanda has joined #openstack-containers | 06:42 | |
*** yolanda has joined #openstack-containers | 06:43 | |
*** rcernin has quit IRC | 06:46 | |
*** belmoreira has joined #openstack-containers | 07:01 | |
*** ramishra has joined #openstack-containers | 07:20 | |
*** mgariepy has quit IRC | 07:32 | |
*** born2bake has joined #openstack-containers | 07:56 | |
*** rcernin has joined #openstack-containers | 08:10 | |
*** ykarel is now known as ykarel|lunch | 08:13 | |
*** ttsiouts has joined #openstack-containers | 08:15 | |
*** rcernin has quit IRC | 08:15 | |
*** flwang1 has joined #openstack-containers | 08:31 | |
flwang1 | brtknr: ping | 08:31 |
brtknr | flwang1: pong | 08:31 |
flwang1 | have you enabled barbican in your cloud? | 08:31 |
flwang1 | strigazi: ^ | 08:31 |
brtknr | yes in one of them for sure | 08:32 |
flwang1 | are you using it as key store for magnum? | 08:33 |
openstackgerrit | Feilong Wang proposed openstack/magnum master: [WIP] Suppor proxy for helm install https://review.opendev.org/731468 | 08:38 |
brtknr | flwang1: lemme check | 08:39 |
*** mgariepy has joined #openstack-containers | 08:52 | |
*** ykarel|lunch is now known as ykarel | 08:52 | |
*** ondrejburian has quit IRC | 08:57 | |
*** ramishra has quit IRC | 09:00 | |
*** ttsiouts has quit IRC | 09:01 | |
*** ttsiouts has joined #openstack-containers | 09:01 | |
*** ramishra has joined #openstack-containers | 09:02 | |
*** ramishra has quit IRC | 09:10 | |
*** rcernin has joined #openstack-containers | 09:11 | |
*** ramishra has joined #openstack-containers | 09:15 | |
*** rcernin has quit IRC | 09:24 | |
*** k_mouza has joined #openstack-containers | 09:29 | |
brtknr | so i see barbican is deployed but do not see any magnum related keys when i do "openstack secret list" | 09:31 |
*** ravsingh has joined #openstack-containers | 09:31 | |
brtknr | flwang1: ^ | 09:32 |
brtknr | flwang1: looks like on devstack it doesnt use barbican by default either | 09:32 |
flwang1 | brtknr: yep, to avoid depedency | 09:33 |
*** ravsingh has quit IRC | 09:39 | |
*** ramishra has quit IRC | 09:45 | |
*** ramishra has joined #openstack-containers | 09:49 | |
*** rcernin has joined #openstack-containers | 09:49 | |
*** ravsingh has joined #openstack-containers | 09:52 | |
*** rcernin has quit IRC | 09:54 | |
*** flwang1 has quit IRC | 10:00 | |
*** xinliang has joined #openstack-containers | 10:23 | |
*** k_mouza has quit IRC | 10:28 | |
born2bake | deployed k-a centos-binary-ussuri... created cluster in magnum - http://paste.openstack.org/show/794093 its failing due to store the certs. Barbican is up and running...is it k-a related? | 10:33 |
*** udesale_ has joined #openstack-containers | 10:34 | |
openstackgerrit | Bharat Kunwar proposed openstack/magnum-tempest-plugin master: Update test_create_cluster_with_node_count_0 https://review.opendev.org/709766 | 10:34 |
jakeyip | looks like the 500 error might be from barbican ? | 10:35 |
jakeyip | oh hi brtknr :) | 10:35 |
jakeyip | I just commented on that patch ^ | 10:35 |
brtknr | jakeyip: yes i saw | 10:36 |
*** udesale has quit IRC | 10:36 | |
brtknr | hence i remembered to rebase it | 10:37 |
born2bake | jakeyip but barbican is running ok :/ | 10:38 |
jakeyip | born2bake: if it was a 500 error in barbican, there should be a stacktrace or some hint on why it didn't like what magnum posted | 10:40 |
*** k_mouza has joined #openstack-containers | 10:41 | |
*** k_mouza has quit IRC | 10:41 | |
*** k_mouza has joined #openstack-containers | 10:41 | |
*** xinliang has quit IRC | 10:41 | |
born2bake | yeah I ve checked barbican logs...no errors there | 10:42 |
*** ttsiouts has quit IRC | 10:43 | |
jakeyip | born2bake: `ERROR barbicanclient.client [req-bf76b11a-1e6e-4ef3-99da-1abfec726953 - - - - -]` you might need DEBUG logs to see what barbicanclient is talking to then. Also try grepping that req-xxx ID in all your logs. | 10:46 |
*** ttsiouts has joined #openstack-containers | 11:12 | |
*** mgariepy has quit IRC | 11:38 | |
*** mgariepy has joined #openstack-containers | 11:38 | |
*** ramishra has quit IRC | 11:39 | |
*** ramishra has joined #openstack-containers | 11:42 | |
*** sapd1 has quit IRC | 11:45 | |
*** udesale_ has quit IRC | 11:58 | |
*** udesale_ has joined #openstack-containers | 11:59 | |
*** ttsiouts_ has joined #openstack-containers | 12:36 | |
*** ttsiouts has quit IRC | 12:36 | |
*** ravsingh has quit IRC | 12:38 | |
*** sapd1 has joined #openstack-containers | 13:20 | |
*** ykarel is now known as ykarel|away | 13:50 | |
*** ramishra has quit IRC | 13:53 | |
*** ttsiouts_ has quit IRC | 14:38 | |
*** ramishra has joined #openstack-containers | 14:44 | |
*** xinliang has joined #openstack-containers | 14:58 | |
*** ramishra has quit IRC | 15:01 | |
*** xinliang has quit IRC | 15:02 | |
*** ramishra has joined #openstack-containers | 15:02 | |
*** ttsiouts has joined #openstack-containers | 15:03 | |
*** ttsiouts has quit IRC | 15:13 | |
*** ttsiouts has joined #openstack-containers | 15:16 | |
*** sapd1 has quit IRC | 15:33 | |
*** LuckyClover has joined #openstack-containers | 15:33 | |
*** jmlowe has quit IRC | 15:34 | |
*** jmlowe has joined #openstack-containers | 15:37 | |
*** belmoreira has quit IRC | 15:42 | |
*** udesale_ has quit IRC | 15:50 | |
*** vishalmanchanda has quit IRC | 16:00 | |
*** sapd1 has joined #openstack-containers | 16:04 | |
*** vishalmanchanda has joined #openstack-containers | 16:16 | |
LuckyClover | Is anyone familiar with magnum in here? | 16:18 |
*** ttsiouts has quit IRC | 16:48 | |
*** ttsiouts has joined #openstack-containers | 16:51 | |
*** ttsiouts has quit IRC | 17:01 | |
*** ricolin has quit IRC | 17:22 | |
LuckyClover | If anyone has seen this issue before with Magnum, please let me know | 17:37 |
LuckyClover | http://paste.openstack.org/show/794117/ | 17:37 |
*** sapd1 has quit IRC | 17:59 | |
*** yolanda has quit IRC | 18:22 | |
*** aspiers has quit IRC | 18:31 | |
*** k_mouza has quit IRC | 18:38 | |
*** ttsiouts has joined #openstack-containers | 18:46 | |
*** ttsiouts has quit IRC | 18:48 | |
*** ttsiouts has joined #openstack-containers | 18:48 | |
*** vishalmanchanda has quit IRC | 19:10 | |
brtknr | LuckyClover: yes, you need to use heat_container_agent_tag=train-stable-2 | 19:45 |
brtknr | if you are using stable/train release, the default ussuri-dev tag does not currently work as it requires some additional patches | 19:47 |
brtknr | we are hoping to cut a new release in a few days | 19:47 |
brtknr | with the fix | 19:47 |
brtknr | hopefully by next week | 19:47 |
*** k_mouza has joined #openstack-containers | 20:38 | |
*** k_mouza has quit IRC | 20:43 | |
*** flwang1 has joined #openstack-containers | 20:57 | |
born2bake | brtknr I ve deployed ussuri release in k-a... same error with kube master env var... should I use train-stable-2 with ussuri as well? | 21:08 |
born2bake | also, is there any docs related to heat agent vars, labels etc? | 21:08 |
flwang1 | born2bake: what's the error you got? | 21:09 |
born2bake | same error - http://paste.openstack.org/show/794117/ ; I ve used brtknr terraform scripts https://github.com/stackhpc/magnum-terraform ; First error I ve got was related to virtio in coreos... magnum could not find /dev/disk/by-id on the machines. Thus, I ve re-uploaded coreos image with --property hw_rng_model=virtio flag and it passed through it. Now, I am getting same - http://paste.openstack.org/show/794117/ ; I thought maybe its | 21:11 |
born2bake | related to kube 18.3 version so trying to deploy 17.5 now. | 21:11 |
born2bake | flwang1 | 21:11 |
brtknr | born2bake: yes for now | 21:11 |
brtknr | we will make a new release in a few days with a fix | 21:11 |
born2bake | so is there any doc where I can check all labels, tags which can be used in magnum? | 21:12 |
brtknr | flwang1: what do you think about setting default heat_container_agent_tag=train-stable-2 in 9.4.0 | 21:12 |
brtknr | born2bake: yes google magnum user docs | 21:12 |
flwang1 | brtknr: patch stable/train directly? | 21:13 |
brtknr | but the issue you are seeing is undocumented | 21:13 |
brtknr | flwang1: thats right | 21:13 |
brtknr | so that we dont get unpredictable behaviour like this | 21:13 |
flwang1 | i'd like to understand current issue firstly | 21:13 |
brtknr | flwang1: it is because current stable/train and stable/ussuri releases are missing the admin.conf patch | 21:13 |
brtknr | ussuri-dev HCA usses kubectl version 1.18.2 which needs /etc/kubernetes/admin.conf that Spyros recently proposed | 21:14 |
flwang1 | missing the admin.conf to support v1.18.2+? | 21:14 |
brtknr | v1.18.x using HCA ussuri-dev because it container v1.18.2 client | 21:15 |
brtknr | v1.18.x using HCA ussuri-dev because it contains v1.18.2 client | 21:15 |
flwang1 | so it works for lower version, right? | 21:17 |
brtknr | flwang1: train-stable-2 works because it contains kubectl version 1.15 something | 21:17 |
brtknr | so works with 1.18.x serve | 21:17 |
brtknr | but 1.18.x client requires admin.conf | 21:18 |
flwang1 | brtknr: are we using ussuri-dev for train/stable now? | 21:18 |
brtknr | yes | 21:18 |
brtknr | it is the default value in the template | 21:18 |
flwang1 | brtknr: if so, we should change it anyway | 21:19 |
brtknr | yep | 21:19 |
brtknr | please propose a change | 21:20 |
brtknr | its bedtime here :) | 21:20 |
brtknr | also ussuri-stable for ussuri | 21:21 |
flwang1 | brtknr: do we hav a ussuri-stable now? | 21:25 |
flwang1 | ok, i will do | 21:25 |
brtknr | no we dont | 21:25 |
flwang1 | ok | 21:27 |
born2bake | flwang1 https://prnt.sc/spoahf - leases need to be added https://github.com/helm/charts/issues/20514 | 21:39 |
born2bake | cluster autoscaler is failing | 21:39 |
*** ttsiouts has quit IRC | 21:40 | |
flwang1 | born2bake: i think recently brtknr just fixed this | 21:40 |
flwang1 | born2bake: what's the autoscaler version you're using? | 21:40 |
born2bake | docker.io/openstackmagnum/cluster-autoscaler:v1.18.1 | 21:42 |
flwang1 | born2bake: and what's the magnum version you're using? | 21:45 |
*** threestrands has joined #openstack-containers | 21:45 | |
born2bake | its a bit hard to say since I am using kolla-ansible | 21:45 |
flwang1 | born2bake: i think the CA issue fixed by https://review.opendev.org/#/c/725534/ | 21:45 |
born2bake | but if go to container - cd magnum-base-source/ | 21:46 |
born2bake | (magnum-api)[magnum@zhavoronok /magnum-base-source]$ ls | 21:46 |
born2bake | magnum-10.0.0 | 21:46 |
flwang1 | 10.0.0 means stable/ussuri | 21:46 |
born2bake | okay, yeah I am using centos source ussuri images | 21:46 |
born2bake | Also, last time when I was testing magnum autoscaler and autohealing operators....they were failing, cloud provider was failing as well...therefore, once I will be ready to test em again...where can I upload errors/bug report? | 21:47 |
born2bake | https://prnt.sc/spofqj - csinode needs to be added as well though | 21:48 |
flwang1 | we have cherrypicked that but haven't released a 10.0.1 or things like that | 21:49 |
flwang1 | born2bake: storyboard | 21:50 |
flwang1 | https://storyboard.openstack.org/ | 21:50 |
born2bake | okay, will do. thank you | 21:50 |
flwang1 | thanks | 21:50 |
born2bake | flwang1 do you know by any chance if magnum can work in conjunction with https://github.com/openstack/kuryr-kubernetes ? | 21:53 |
flwang1 | born2bake: no, sorry, i didn't try that before | 21:54 |
*** ramishra has quit IRC | 22:32 | |
*** rcernin has joined #openstack-containers | 23:07 | |
*** flwang1 has quit IRC | 23:23 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!