Thursday, 2020-05-28

*** threestrands has joined #openstack-containers00:09
openstackgerritMerged openstack/magnum stable/train: api: Do not guess based on name extension  https://review.opendev.org/73117500:55
openstackgerritMerged openstack/magnum stable/stein: api: Do not guess based on name extension  https://review.opendev.org/73117600:55
openstackgerritMerged openstack/magnum stable/ussuri: [k8s] Expose autoscaler prometheus metrics  https://review.opendev.org/73116100:56
openstackgerritMerged openstack/magnum stable/ussuri: Scrape traefik and autoscaler metrics  https://review.opendev.org/73116200:57
openstackgerritMerged openstack/magnum stable/ussuri: Update prometheus monitoring chart and images  https://review.opendev.org/73116300:57
openstackgerritMerged openstack/magnum stable/ussuri: Scrape internal kubernetes components  https://review.opendev.org/73116400:57
openstackgerritMerged openstack/magnum stable/ussuri: [k8s] Use Helm v3 by default  https://review.opendev.org/73116500:58
*** rcernin has quit IRC00:58
*** rcernin has joined #openstack-containers01:04
*** k_mouza has joined #openstack-containers02:21
*** k_mouza has quit IRC02:25
*** rcernin has quit IRC03:01
*** ricolin has joined #openstack-containers03:13
*** rcernin has joined #openstack-containers03:15
*** rcernin has quit IRC03:19
*** rcernin has joined #openstack-containers03:19
openstackgerritinspurericzhang proposed openstack/magnum-tempest-plugin master: Add py38 package metadata  https://review.opendev.org/73141003:39
*** threestrands has quit IRC03:49
*** rcernin has quit IRC03:57
*** rcernin has joined #openstack-containers04:16
*** sapd1 has joined #openstack-containers04:19
*** ykarel|away is now known as ykarel04:23
*** rcernin has quit IRC04:48
*** rcernin has joined #openstack-containers04:49
*** udesale has joined #openstack-containers05:18
*** ramishra has quit IRC05:50
openstackgerritMerged openstack/magnum stable/ussuri: k8s: Add admin.conf kubeconfig  https://review.opendev.org/73113906:10
*** vishalmanchanda has joined #openstack-containers06:42
*** yolanda has joined #openstack-containers06:43
*** rcernin has quit IRC06:46
*** belmoreira has joined #openstack-containers07:01
*** ramishra has joined #openstack-containers07:20
*** mgariepy has quit IRC07:32
*** born2bake has joined #openstack-containers07:56
*** rcernin has joined #openstack-containers08:10
*** ykarel is now known as ykarel|lunch08:13
*** ttsiouts has joined #openstack-containers08:15
*** rcernin has quit IRC08:15
*** flwang1 has joined #openstack-containers08:31
flwang1brtknr: ping08:31
brtknrflwang1: pong08:31
flwang1have you enabled barbican in your cloud?08:31
flwang1strigazi: ^08:31
brtknryes in one of them for sure08:32
flwang1are you using it as key store for magnum?08:33
openstackgerritFeilong Wang proposed openstack/magnum master: [WIP] Suppor proxy for helm install  https://review.opendev.org/73146808:38
brtknrflwang1: lemme check08:39
*** mgariepy has joined #openstack-containers08:52
*** ykarel|lunch is now known as ykarel08:52
*** ondrejburian has quit IRC08:57
*** ramishra has quit IRC09:00
*** ttsiouts has quit IRC09:01
*** ttsiouts has joined #openstack-containers09:01
*** ramishra has joined #openstack-containers09:02
*** ramishra has quit IRC09:10
*** rcernin has joined #openstack-containers09:11
*** ramishra has joined #openstack-containers09:15
*** rcernin has quit IRC09:24
*** k_mouza has joined #openstack-containers09:29
brtknrso i see barbican is deployed but do not see any magnum related keys when i do "openstack secret list"09:31
*** ravsingh has joined #openstack-containers09:31
brtknrflwang1: ^09:32
brtknrflwang1: looks like on devstack it doesnt use barbican by default either09:32
flwang1brtknr: yep, to avoid depedency09:33
*** ravsingh has quit IRC09:39
*** ramishra has quit IRC09:45
*** ramishra has joined #openstack-containers09:49
*** rcernin has joined #openstack-containers09:49
*** ravsingh has joined #openstack-containers09:52
*** rcernin has quit IRC09:54
*** flwang1 has quit IRC10:00
*** xinliang has joined #openstack-containers10:23
*** k_mouza has quit IRC10:28
born2bake deployed k-a centos-binary-ussuri... created cluster in magnum - http://paste.openstack.org/show/794093 its failing due to store the certs. Barbican is up and running...is it k-a related?10:33
*** udesale_ has joined #openstack-containers10:34
openstackgerritBharat Kunwar proposed openstack/magnum-tempest-plugin master: Update test_create_cluster_with_node_count_0  https://review.opendev.org/70976610:34
jakeyiplooks like the 500 error might be from barbican ?10:35
jakeyipoh hi brtknr :)10:35
jakeyipI just commented on that patch ^10:35
brtknrjakeyip: yes i saw10:36
*** udesale has quit IRC10:36
brtknrhence i remembered to rebase it10:37
born2bakejakeyip but barbican is running ok :/10:38
jakeyipborn2bake: if it was a 500 error in barbican, there should be a stacktrace or some hint on why it didn't like what magnum posted10:40
*** k_mouza has joined #openstack-containers10:41
*** k_mouza has quit IRC10:41
*** k_mouza has joined #openstack-containers10:41
*** xinliang has quit IRC10:41
born2bakeyeah I ve checked barbican logs...no errors there10:42
*** ttsiouts has quit IRC10:43
jakeyipborn2bake: `ERROR barbicanclient.client [req-bf76b11a-1e6e-4ef3-99da-1abfec726953 - - - - -]` you might need DEBUG logs to see what barbicanclient is talking to then. Also try grepping that req-xxx ID in all your logs.10:46
*** ttsiouts has joined #openstack-containers11:12
*** mgariepy has quit IRC11:38
*** mgariepy has joined #openstack-containers11:38
*** ramishra has quit IRC11:39
*** ramishra has joined #openstack-containers11:42
*** sapd1 has quit IRC11:45
*** udesale_ has quit IRC11:58
*** udesale_ has joined #openstack-containers11:59
*** ttsiouts_ has joined #openstack-containers12:36
*** ttsiouts has quit IRC12:36
*** ravsingh has quit IRC12:38
*** sapd1 has joined #openstack-containers13:20
*** ykarel is now known as ykarel|away13:50
*** ramishra has quit IRC13:53
*** ttsiouts_ has quit IRC14:38
*** ramishra has joined #openstack-containers14:44
*** xinliang has joined #openstack-containers14:58
*** ramishra has quit IRC15:01
*** xinliang has quit IRC15:02
*** ramishra has joined #openstack-containers15:02
*** ttsiouts has joined #openstack-containers15:03
*** ttsiouts has quit IRC15:13
*** ttsiouts has joined #openstack-containers15:16
*** sapd1 has quit IRC15:33
*** LuckyClover has joined #openstack-containers15:33
*** jmlowe has quit IRC15:34
*** jmlowe has joined #openstack-containers15:37
*** belmoreira has quit IRC15:42
*** udesale_ has quit IRC15:50
*** vishalmanchanda has quit IRC16:00
*** sapd1 has joined #openstack-containers16:04
*** vishalmanchanda has joined #openstack-containers16:16
LuckyCloverIs anyone familiar with magnum in here?16:18
*** ttsiouts has quit IRC16:48
*** ttsiouts has joined #openstack-containers16:51
*** ttsiouts has quit IRC17:01
*** ricolin has quit IRC17:22
LuckyCloverIf anyone has seen this issue before with Magnum, please let me know17:37
LuckyCloverhttp://paste.openstack.org/show/794117/17:37
*** sapd1 has quit IRC17:59
*** yolanda has quit IRC18:22
*** aspiers has quit IRC18:31
*** k_mouza has quit IRC18:38
*** ttsiouts has joined #openstack-containers18:46
*** ttsiouts has quit IRC18:48
*** ttsiouts has joined #openstack-containers18:48
*** vishalmanchanda has quit IRC19:10
brtknrLuckyClover: yes, you need to use heat_container_agent_tag=train-stable-219:45
brtknrif you are using stable/train release, the default ussuri-dev tag does not currently work as it requires some additional patches19:47
brtknrwe are hoping to cut a new release in a few days19:47
brtknrwith the fix19:47
brtknrhopefully by next week19:47
*** k_mouza has joined #openstack-containers20:38
*** k_mouza has quit IRC20:43
*** flwang1 has joined #openstack-containers20:57
born2bakebrtknr I ve deployed ussuri release in k-a... same error with kube master env var... should I use train-stable-2 with ussuri as well?21:08
born2bakealso, is there any docs related to heat agent vars, labels etc?21:08
flwang1born2bake: what's the error you got?21:09
born2bakesame error - http://paste.openstack.org/show/794117/ ; I ve used brtknr terraform scripts https://github.com/stackhpc/magnum-terraform ; First error I ve got was related to virtio in coreos... magnum could not find /dev/disk/by-id on the machines. Thus, I ve re-uploaded coreos image with --property hw_rng_model=virtio flag and it passed through it. Now, I am getting same - http://paste.openstack.org/show/794117/ ; I thought maybe its21:11
born2bakerelated to kube 18.3 version so trying to deploy 17.5 now.21:11
born2bakeflwang121:11
brtknrborn2bake: yes for now21:11
brtknrwe will make a new release in a few days with a fix21:11
born2bakeso is there any doc where I can check all labels, tags which can be used in magnum?21:12
brtknrflwang1: what do you think about setting default heat_container_agent_tag=train-stable-2 in 9.4.021:12
brtknrborn2bake: yes google magnum user docs21:12
flwang1brtknr: patch stable/train directly?21:13
brtknrbut the issue you are seeing is undocumented21:13
brtknrflwang1: thats right21:13
brtknrso that we dont get unpredictable behaviour like this21:13
flwang1i'd like to understand current issue firstly21:13
brtknrflwang1: it is because current stable/train and stable/ussuri releases are missing the admin.conf patch21:13
brtknrussuri-dev HCA usses kubectl version 1.18.2 which needs /etc/kubernetes/admin.conf that Spyros recently proposed21:14
flwang1missing the admin.conf to support v1.18.2+?21:14
brtknrv1.18.x using HCA ussuri-dev because it container v1.18.2 client21:15
brtknrv1.18.x using HCA ussuri-dev because it contains v1.18.2 client21:15
flwang1so it works for lower version, right?21:17
brtknrflwang1: train-stable-2 works because it contains kubectl version 1.15 something21:17
brtknrso works with 1.18.x serve21:17
brtknrbut 1.18.x client requires admin.conf21:18
flwang1brtknr: are we using ussuri-dev for train/stable now?21:18
brtknryes21:18
brtknrit is the default value in the template21:18
flwang1brtknr: if so, we should change it anyway21:19
brtknryep21:19
brtknrplease propose a change21:20
brtknrits bedtime here :)21:20
brtknralso ussuri-stable for ussuri21:21
flwang1brtknr: do we hav a ussuri-stable now?21:25
flwang1ok, i will do21:25
brtknrno we dont21:25
flwang1ok21:27
born2bakeflwang1 https://prnt.sc/spoahf - leases need to be added https://github.com/helm/charts/issues/2051421:39
born2bakecluster autoscaler is failing21:39
*** ttsiouts has quit IRC21:40
flwang1born2bake: i think recently brtknr just fixed this21:40
flwang1born2bake: what's the autoscaler version you're using?21:40
born2bake docker.io/openstackmagnum/cluster-autoscaler:v1.18.121:42
flwang1born2bake: and what's the magnum version you're using?21:45
*** threestrands has joined #openstack-containers21:45
born2bakeits a bit hard to say since I am using kolla-ansible21:45
flwang1born2bake: i think the CA issue fixed by https://review.opendev.org/#/c/725534/21:45
born2bakebut if go to container - cd magnum-base-source/21:46
born2bake(magnum-api)[magnum@zhavoronok /magnum-base-source]$ ls21:46
born2bakemagnum-10.0.021:46
flwang110.0.0 means stable/ussuri21:46
born2bakeokay, yeah I am using centos source ussuri images21:46
born2bakeAlso, last time when I was testing magnum autoscaler and autohealing operators....they were failing, cloud provider was failing as well...therefore, once I will be ready to test em again...where can I upload errors/bug report?21:47
born2bakehttps://prnt.sc/spofqj - csinode needs to be added as well though21:48
flwang1we have cherrypicked that but haven't released a 10.0.1 or things like that21:49
flwang1born2bake: storyboard21:50
flwang1https://storyboard.openstack.org/21:50
born2bakeokay, will do. thank you21:50
flwang1thanks21:50
born2bakeflwang1 do you know by any chance if magnum can work in conjunction with https://github.com/openstack/kuryr-kubernetes ?21:53
flwang1born2bake: no, sorry, i didn't try that before21:54
*** ramishra has quit IRC22:32
*** rcernin has joined #openstack-containers23:07
*** flwang1 has quit IRC23:23

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!