Friday, 2018-12-14

*** PagliaccisCloud has quit IRC00:21
openstackgerritLingxian Kong proposed openstack/magnum master: k8s: move towards signaled deployments in parent  https://review.openstack.org/62372400:39
*** hongbin has quit IRC01:29
openstackgerritLingxian Kong proposed openstack/magnum master: Release note for cluster pre-delete  https://review.openstack.org/62513801:52
openstackgerritFeilong Wang proposed openstack/magnum master: k8s_fedora: Use external kubernetes/cloud-provider-openstack  https://review.openstack.org/57747702:15
*** munimeha1 has quit IRC02:25
*** dave-mccowan has joined #openstack-containers02:38
openstackgerritFeilong Wang proposed openstack/magnum master: Allow cluster template being renamed  https://review.openstack.org/60917402:38
*** itlinux has joined #openstack-containers02:39
*** hongbin has joined #openstack-containers03:14
*** hongbin has quit IRC03:15
*** hongbin has joined #openstack-containers03:16
*** ricolin has joined #openstack-containers03:39
*** ramishra has joined #openstack-containers03:49
*** lbragstad has joined #openstack-containers03:50
*** lbragstad has quit IRC03:51
*** dave-mccowan has quit IRC04:03
*** udesale has joined #openstack-containers04:10
*** lbragstad has joined #openstack-containers04:13
*** ykarel|away has joined #openstack-containers04:24
*** hongbin has quit IRC04:34
*** PagliaccisCloud has joined #openstack-containers04:44
*** ricolin has quit IRC04:45
*** ricolin has joined #openstack-containers05:12
*** zufar_ has joined #openstack-containers06:03
zufar_brtknr: I am fix this issue by installing magnum manual. i try to install via ansible get that error.06:04
*** zufar has quit IRC06:06
*** zufar_ has left #openstack-containers06:06
*** zufar_ has joined #openstack-containers06:06
zufar_Hi, I am trying to create cluster template on magnum, but its get this error `Cluster type (vm, Unset, swarm) not supported (HTTP 400)`. My image have os_distro properties installed. full log : http://paste.opensuse.org/view//6239224306:07
*** ykarel|away is now known as ykarel06:11
ykarelzufar_, i think some issue with glanceclient, try with image id instead of image name06:11
*** lpetrut has joined #openstack-containers06:13
zufar_ykarel: I am using image id to create cluster template, but still same error.06:30
zufar_no error with glance. this is the lof from magnum-api, 2018-12-14 13:05:03.326 18396 INFO werkzeug [req-812819a0-aa36-4691-bffa-4c0fe4c15e8d 65e6540249f041eb84a1f45b413869da a6194998e8bd47f99ae77efe2e86facf default - -] 10.111.111.10 - - [14/Dec/2018 13:05:03] "POST /v1/clustertemplates HTTP/1.1" 400 -06:31
ykarelzufar_, and u have os_distro property set in that image06:32
ykarelhmm just checked logs, u have set: properties       | os_distro='fedora-atomic'06:33
ykarelcan u check conductor logs as well06:36
*** mkuf has quit IRC06:40
*** mkuf has joined #openstack-containers06:41
*** mkuf has quit IRC06:51
*** mkuf has joined #openstack-containers06:52
mkufbrtknr: the heat resources look like this http://paste.openstack.org/show/8ZiD9uWdYtiR08VinjbL07:01
mkufflwang: current issue is, that the master gets deployed, cloudinit and wc-notify are successful but no minions get spawned.07:01
*** rcernin has quit IRC07:03
*** PagliaccisCloud has quit IRC07:12
*** pcaruana has joined #openstack-containers07:12
strigaziflwang: mnaser for now, CERN is not up for using ubuntu. I won't be able to help you. We are looking to the upcoming Fedora CoreOS.07:27
strigaziflwang: mnaser Well I can help with the code, but we won't run the same thing as you.07:38
*** jonaspaulo has joined #openstack-containers07:53
*** lpetrut has quit IRC07:58
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: add body for delete_namespaced_service in k8s  https://review.openstack.org/62517008:03
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: use default admission_control_list values  https://review.openstack.org/62517108:04
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: use default admission_control_list values  https://review.openstack.org/62517108:04
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: add body for delete_namespaced_service in k8s  https://review.openstack.org/62517008:06
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: use default admission_control_list values  https://review.openstack.org/62517108:07
openstackgerritMerged openstack/magnum stable/rocky: functional: retrieve cluster to get stack_id  https://review.openstack.org/62472309:04
jakeyipzufar_: there's a typo in your image? `fedora-atomic-lates` instead of `fedora-atomic-latest`09:43
*** ttsiouts has joined #openstack-containers09:45
zufar_jakeyip, hm yes typo. but I am trying with image id and its same09:48
*** ykarel is now known as ykarel|lunch10:00
*** shrasool has joined #openstack-containers10:15
*** mcegiel has joined #openstack-containers10:21
mcegielHi. I have a question related to Magnum architecture.10:25
mcegielBy default Magnum creates router with SNAT and allocates Floating IPs ( –external-network is mandatory parameter)10:25
mcegielWhat about environments where SNAT is disabled and routing is used between external and internal networks ?10:25
mcegielIn such situation Floating IPs are not needed10:26
mcegielI have created internal, external network and router with SNAT=disabled, then I have deployed cluster and in result Magnum allocated Floating IPs10:27
strigazimcegiel: would --floating-ip-disabled work for you?10:29
mcegiellet me check10:30
*** ykarel|lunch is now known as ykarel10:32
zufar_jakeyip, i dont understand this, are magnum only support fedora-atomic-latest name for images?10:34
*** salmankhan has joined #openstack-containers10:34
jakeyipzufar_: what does `openstack image-show fedora-atomic-latest` say?10:44
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: use vexxhost-specific nodes with nested virt  https://review.openstack.org/62472910:45
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: add body for delete_namespaced_service in k8s  https://review.openstack.org/62517010:45
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: add body for delete_namespaced_service in k8s  https://review.openstack.org/62517010:46
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: add body for delete_namespaced_service in k8s  https://review.openstack.org/62517010:47
openstackgerritSpyros Trigazis proposed openstack/magnum stable/rocky: functional: use default admission_control_list values  https://review.openstack.org/62517110:47
jakeyipzufar_: you need os_distro='fedora-atomic' set for the image10:48
zufar_jakeyip: i create image with incorrect name (from guide) with os_distro='fedora-atomic'. when I try to create the cluster template, it give error like i mention before.10:57
zufar_after i delete and recreate with correct image name, I can create the cluster10:57
*** PagliaccisCloud has joined #openstack-containers10:59
jakeyipzufar_: hm, no idea. image name shouldn't matter11:08
zufar_jakeyip, thank you no problem as long the magnum work. but i have problem when creating swarm cluster, the heat stack is stuck on `create-in-progress`.11:13
zufar_anyone know where the instance is deploy? i try using magnum user but got nothing11:13
zufar_sorry, the vm is in the user. I miss that11:15
jakeyipzufar_: you can take a look at which resources failed `openstack stack resource list -n 5 <stack_id>`11:15
*** shrasool has quit IRC11:16
*** ricolin has quit IRC12:04
*** ttsiouts has quit IRC12:05
*** ttsiouts has joined #openstack-containers12:05
*** salmankhan has quit IRC12:06
*** salmankhan has joined #openstack-containers12:09
*** ttsiouts has quit IRC12:10
*** udesale has quit IRC12:11
*** ttsiouts has joined #openstack-containers12:16
*** pcaruana has quit IRC12:21
*** pcaruana has joined #openstack-containers12:22
*** pcaruana is now known as pcaruana|intw|12:25
openstackgerritLingxian Kong proposed openstack/magnum master: [WIP][k8s] Cluster creation speedup  https://review.openstack.org/62372412:34
mcegielstrigazi: the --floating-ip-disabled helped, thx12:41
*** ykarel has quit IRC13:00
*** ykarel has joined #openstack-containers13:01
*** dave-mccowan has joined #openstack-containers13:09
*** dave-mccowan has quit IRC13:15
*** ykarel is now known as ykarel|afk13:29
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542013:37
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542013:41
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542013:47
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542013:56
*** ykarel|afk is now known as ykarel14:00
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542014:01
*** pcaruana|intw| has quit IRC14:05
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542014:06
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542014:15
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542014:24
strigazifungi: hello, I'm trying to use secrets in a job, but I miss smth. I can't figure it out since some time. can you have a look? https://review.openstack.org/#/c/585420/2514:26
*** udesale has joined #openstack-containers14:27
*** pcaruana has joined #openstack-containers14:31
*** dave-mccowan has joined #openstack-containers14:32
fungistrigazi: you'll have to be more specific. that change you linked is something like 2k added lines14:39
fungino offense, but i don't have time to read through the whole diff14:39
fungii see you have a secret encrypted in .zuul.yaml there14:40
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542014:41
fungilet me know when you're done pushing new patchsets. if your question is about the zuul syntax errors i can help you interpret whichever one is current then14:43
*** dave-mccowan has quit IRC14:43
*** jmlowe has quit IRC14:48
*** mcegiel has left #openstack-containers14:50
strigazifungi: I had asked in #zuul. The issue was that I named a part of the job "publish". I couldn't interpret what extra keys not allowed @ data['publish'] meant14:50
strigazithis is the fix https://review.openstack.org/#/c/585420/23..27/.zuul.yaml14:52
fungiokay, glad you worked it out14:52
*** jmlowe has joined #openstack-containers15:04
*** zul has joined #openstack-containers15:04
*** ivve has joined #openstack-containers15:05
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542015:29
*** ivve has quit IRC15:34
openstackgerritSpyros Trigazis proposed openstack/magnum master: WIP: build images in the ci  https://review.openstack.org/58542015:55
openstackgerritSpyros Trigazis proposed openstack/magnum master: Build images in the ci  https://review.openstack.org/58542015:57
brtknrstrigazi: what an amazing week for Magnum! So many cool things happening!16:01
*** PagliaccisCloud has quit IRC16:15
*** pcaruana has quit IRC16:20
*** ivve has joined #openstack-containers16:24
*** jmlowe has quit IRC16:27
brtknrstrigazi: have you tested Magnum on FA29 btw? We're hitting this issue: https://bugzilla.redhat.com/show_bug.cgi?id=157294416:34
openstackbugzilla.redhat.com bug 1572944 in kernel "4.16.4-200.fc27.x86_64 takes minutes to finish crng init on some systems" [Unspecified,Closed: errata] - Assigned to kernel-maint16:34
*** ricolin has joined #openstack-containers16:39
strigazibrtknr: yeap, solved it with adding entropy from the hypervisor16:43
strigazibrtknr: I tried to release f29 in our cloud but due to some networking issue we stopped the release16:44
strigazibrtknr: https://github.com/openstack/glance/blob/master/doc/source/admin/useful-image-properties.rst check the hw_rng_model16:45
strigazithis ^^ for images16:45
strigazifor flavors you want: https://github.com/openstack/nova/blob/stable/rocky/doc/source/user/flavors.rst --property hw_rng:allowed=True16:47
strigazibrtknr: ^^16:47
*** belmoreira has quit IRC16:47
brtknryankcrime: ^^16:47
brtknr:) thanks strigazi16:47
brtknrstrigazi: have a great weekend!16:48
strigazibrtknr: you too, see you16:48
*** ykarel is now known as ykarel|away16:55
*** salmankhan has quit IRC16:56
*** salmankhan has joined #openstack-containers16:57
*** jonaspaulo has quit IRC17:02
*** ttsiouts has quit IRC17:02
*** udesale has quit IRC17:07
*** PagliaccisCloud has joined #openstack-containers17:15
yankcrimethanks strigazi - that definitely improved the boot time17:23
*** ricolin has quit IRC17:28
yankcrimeweirdly just setting it on the flavor halved the boot time, more or less - 17 down to 8 minutes17:36
yankcrimejust setting the property on the image, sorry17:36
yankcrimesetting the properties for both the flavor and the image totally solved the slow boot issue17:36
yankcrimenow boots in 15 seconds which is a lot better :)17:37
brtknryankcrime: nice work!17:39
yankcrimebrtknr: thank strigazi ;)17:41
*** zufar_ has quit IRC17:43
*** PagliaccisCloud has quit IRC17:43
*** ykarel|away has quit IRC18:02
*** itlinux has quit IRC18:13
*** itlinux has joined #openstack-containers18:13
openstackgerritMerged openstack/magnum master: Build images in the ci  https://review.openstack.org/58542018:17
*** salmankhan has quit IRC18:57
*** hongbin has joined #openstack-containers19:18
*** ttsiouts has joined #openstack-containers19:28
*** jmlowe has joined #openstack-containers19:32
*** flwang1 has joined #openstack-containers19:48
flwang1strigazi: around?19:48
*** ttsiouts has quit IRC20:04
*** ttsiouts has joined #openstack-containers20:04
*** jento has quit IRC20:21
strigaziflwang1: i'm here20:25
flwang1strigazi: as for the external cloud provider patch, i only tested with lb20:26
strigaziflwang1: me too20:27
flwang1what's your error with pvc/cinder?20:27
strigaziflwang1: it wasn't pvc20:27
flwang1so what do you mean doesn't work with cinder?20:27
strigaziflwang1: it was this example https://docs.openstack.org/magnum/latest/user/index.html#using-cinder-in-kubernetes20:28
flwang1strigazi: ah, that's static manually mount way20:28
flwang1but i think it's same issue20:28
flwang1can you see any error in ccm?20:29
strigaziThe occm pod doesn't show anything only the kubelet20:29
strigaziI can create again20:30
flwang1my env in in my workstation, and my vpn is down now :( so i can't test it now20:31
flwang1i'm wondering if we need some extra config in kube_openstack_config or for config in the yaml to create occm20:32
flwang1can you enable high log level for the occm?20:32
flwang1i saw you're using -v 220:33
strigazi> 2 would show more?20:33
strigaziI'm building a cluster20:33
*** ttsiouts has quit IRC20:33
flwang1let's set it as 8 or 920:35
strigaziflwang1: with really minor changes we can take lxkong and mnaser's patch to speedup cluster creation. lgtm20:45
flwang1strigazi: i haven't got time to test it, did it work for you?20:48
flwang1with that patch, will those script run in parallel?20:49
strigaziboth vms are created in almost parallel, minion and master are configured in parallel20:50
flwang1cool20:51
flwang1lxkong told me there is a 'bug' in heat-container-agent, those scripts/services on k8s can't be created in parallel20:51
flwang1if we can fix that, the performance could be improve a bit more20:52
strigazinot sure if it is a bug, but doing many kubectl create -f in parallel won't helo that match I guess20:53
strigazinothing in occm logs20:53
strigazi-v 920:53
flwang1hmm...20:55
flwang1how did you check the log of occm?20:55
flwang1did you do 'kubectl logs -v 9 occm'20:56
strigazithat is what i mean, yes20:57
flwang1ok, i will test it again on Monday20:57
strigazinot sure if it works, I think people are using cinder-csi for volume20:58
*** ttsiouts has joined #openstack-containers21:03
flwang1strigazi: what do you mean? you mean there is bug or it's not supported totally?21:09
strigaziflwang1: well the code is there: https://github.com/kubernetes/cloud-provider-openstack/tree/v0.2.0/pkg/cloudprovider/providers/openstack21:10
flwang1sorry, i have to go now21:11
flwang1it's Sat here :)21:11
flwang1i will test it next Monday21:11
flwang1will you work next week?21:12
strigaziMon, Tue and Wed21:13
colin-glad to see convo about this, was at sig-cloud-provider meetings at kubecon this week and this was a popular topic (moving the providers from k8s/k8s to external by next year)21:29
strigazicolin-: do you know if occm works for cinder volumes? do you use it or you use csi?21:32
colin-with the in-tree provider or with external?21:35
*** flwang1 has quit IRC21:35
strigaziexternal21:35
strigazicolin-: with in-tree worked last I time I checked.21:36
colin-i'm not sure, the clusters i have up right now are using the in-tree21:36
colin-and that's been my experience too (save for a case where a VM resoruce being deleted may have orphaned a volume or two, not sure if that was reproduceable)21:36
*** munimeha1 has joined #openstack-containers21:39
strigazi#3621:41
openstackgerritSpyros Trigazis proposed openstack/magnum master: Don not log the login command  https://review.openstack.org/62535121:43
openstackgerritSpyros Trigazis proposed openstack/magnum master: Don not log the login command  https://review.openstack.org/62535121:47
*** ttsiouts has quit IRC22:00
*** ttsiouts has joined #openstack-containers22:07
*** ttsiouts has quit IRC22:19
*** ivve has quit IRC22:29
openstackgerritMerged openstack/magnum master: functional: bump flavor specs  https://review.openstack.org/62391322:30
eanderssonbtw minor but when you have time can you guys take a look at https://review.openstack.org/#/c/614034/22:35
eanderssonJust trying to clean up devstack22:35
*** lbragstad has quit IRC23:08
*** munimeha1 has quit IRC23:09
*** lbragstad has joined #openstack-containers23:16
*** lbragstad has quit IRC23:22
*** PagliaccisCloud has joined #openstack-containers23:29

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!