Tuesday, 2020-06-30

*** mgariepy has quit IRC01:29
*** mgariepy has joined #openstack-containers01:43
*** ricolin has joined #openstack-containers02:01
*** ricolin has quit IRC02:01
*** mnasiadka has quit IRC02:36
*** Open10K8S has quit IRC02:37
*** Open10K8S has joined #openstack-containers02:37
*** mnasiadka has joined #openstack-containers02:38
openstackgerritFeilong Wang proposed openstack/magnum master: Fix gate  https://review.opendev.org/73853502:50
*** hongbin has joined #openstack-containers03:03
*** hongbin has quit IRC03:13
openstackgerritMerged openstack/magnum stable/ussuri: [K8S] Delete all related load balancers before deleting cluster  https://review.opendev.org/73818503:31
*** rcernin has quit IRC03:38
*** rcernin has joined #openstack-containers03:47
*** udesale has joined #openstack-containers03:52
*** ramishra has quit IRC03:53
*** ykarel|away is now known as ykarel04:19
*** vishalmanchanda has joined #openstack-containers04:41
*** ramishra has joined #openstack-containers06:00
*** rcernin has quit IRC07:07
*** rcernin has joined #openstack-containers07:09
*** rcernin has quit IRC07:23
*** yolanda has joined #openstack-containers07:26
*** k_mouza has joined #openstack-containers07:29
*** born2bake has joined #openstack-containers07:46
*** ttsiouts has joined #openstack-containers07:51
*** nikparasyr has joined #openstack-containers08:24
*** ykarel is now known as ykarel|lunch08:25
*** ioni has quit IRC08:38
*** ioni has joined #openstack-containers08:51
openstackgerritBharat Kunwar proposed openstack/magnum stable/ussuri: Fix ServerAddressOutputMapping for private clusters  https://review.opendev.org/73818409:44
*** ykarel|lunch is now known as ykarel09:49
*** mgariepy has quit IRC10:04
*** livelace has joined #openstack-containers10:05
*** livelace has quit IRC10:19
*** livelace has joined #openstack-containers10:39
*** livelace has quit IRC10:41
*** udesale_ has joined #openstack-containers11:04
*** udesale has quit IRC11:06
*** livelace has joined #openstack-containers12:14
*** mgariepy has joined #openstack-containers12:15
openstackgerritBharat Kunwar proposed openstack/magnum master: [ci] Fix gate  https://review.opendev.org/73771312:28
openstackgerritBharat Kunwar proposed openstack/magnum master: [ci] Fix gate  https://review.opendev.org/73771312:47
ykarelbrtknr, wrt ^^ may be u need to call ensure-pip role due to movement of new nodepool images without pip12:50
ykarelnot sure if u aware about those12:50
brtknrykarel: thanks for the info, although im going to try package: python3-docker to see if that works first12:50
brtknras only need 1 thing12:50
ykarelbrtknr, ack if that works12:51
*** ricolin has joined #openstack-containers12:55
*** ricolin_ has joined #openstack-containers13:00
*** ricolin has quit IRC13:03
openstackgerritBharat Kunwar proposed openstack/magnum master: [ci] Fix gate by installing python3-docker  https://review.opendev.org/73771313:03
brtknrykarel: looks like it worked :)13:04
ykarelbrtknr, cool13:04
openstackgerritBharat Kunwar proposed openstack/magnum master: [fix] Append v3/v1 to auth_url/magnum_url if discovery fails  https://review.opendev.org/73829013:38
*** livelace has quit IRC13:53
*** livelace has joined #openstack-containers14:03
*** nikparasyr has left #openstack-containers14:38
*** k_mouza has quit IRC14:47
*** ykarel is now known as ykarel|away14:48
*** k_mouza has joined #openstack-containers14:56
*** livelace has quit IRC14:57
guilhermesphi there! ive been seeing something curious to my magnum deployment, which was working and passed conformance tests. Suddenly clusters started to time out and kube_master creation is stuck. Kubelet logs bellow15:18
guilhermesphttps://www.irccloud.com/pastebin/vfDIS2x0/15:18
guilhermespdoes anyone experienced that before? we are running heat and magnum ussuri15:19
*** mgoddard has quit IRC15:28
*** vishalmanchanda has quit IRC15:30
*** mgariepy has quit IRC15:34
*** mgoddard has joined #openstack-containers15:35
brtknrguilhermesp: not see that before16:04
brtknrare you running tip of stable/ussuri branch?16:04
*** mgariepy has joined #openstack-containers16:12
guilhermespyep we are running https://docs.openstack.org/releasenotes/magnum/ussuri.html#relnotes-10-0-0-stable-ussuri16:13
guilhermesptried newer coreos image ( fedora-coreos-32.20200601.3.0-openstack.x86_64 ) and both calico and flannel16:14
guilhermespthat's my cluster template16:14
guilhermesphttps://www.irccloud.com/pastebin/2ajbR8PH/16:14
Open10K8Sbrtknr: guilhermesp: seems cni is not installed OR the path is different?16:23
Open10K8Sbefore some k8s versions has a small problem with cni such as not auto installation16:24
Open10K8SSo the workaround was separate installation before the k8s cluster install16:24
*** mgariepy has quit IRC16:27
*** udesale_ has quit IRC16:39
*** mgariepy has joined #openstack-containers16:41
*** k_mouza has quit IRC17:18
*** xakaitetoia has joined #openstack-containers17:41
*** ricolin_ has quit IRC17:53
*** jmlowe has quit IRC18:19
-openstackstatus- NOTICE: Due to a flood of connections from random prefixes, we have temporarily blocked all AS4837 (China Unicom) source addresses from access to the Git service at opendev.org while we investigate further options.18:22
*** jmlowe has joined #openstack-containers18:24
*** xakaitetoia has quit IRC18:42
guilhermesp additionally, that keeps looping in heat-config logs18:58
guilhermesphttps://www.irccloud.com/pastebin/DRmI81aV/18:58
*** yolanda has quit IRC19:05
brtknrguilhermesp: which heat container agent tag are you using?19:55
*** dave-mccowan has quit IRC19:55
brtknrTry with ussuri-stable-119:55
brtknrthis is the default in new ussuri release19:56
brtknrdue soon!19:56
*** dave-mccowan has joined #openstack-containers19:58
guilhermespussuri-dev brtknr20:00
guilhermespyeah i was digging here and found out that https://github.com/openstack/magnum/blob/1f6df6fb4c825e6589eb43a2c0eb366b4d114628/magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-master.sh#L28 is the issue now20:00
guilhermespcoz it tries to get the status of NetworkManager20:00
guilhermespwhich in heat-conf logs seems to be20:00
guilhermesphttps://www.irccloud.com/pastebin/UxbgZ3XH/20:01
guilhermespso it skips the condition and doesnt create the necessary files under NetworkManager20:01
guilhermespbut yeah i will try changing the tag20:01
guilhermespmaybe we can set that in the cluster template?20:01
guilhermespas a label20:01
guilhermespthat's what Ive got "by default"20:02
guilhermesphttps://www.irccloud.com/pastebin/G5oLWzkr/20:02
*** noonedeadpunk has quit IRC20:02
brtknrI know this issue, it’s related to heat container agent tag20:03
*** noonedeadpunk has joined #openstack-containers20:03
brtknrwe will have a fix for it in the new ussuri release20:03
guilhermesphuuuuum20:05
guilhermespis there a workaround? like setting labels to templates20:05
guilhermespi guess yeah we could set that label https://docs.openstack.org/magnum/latest/user/#heat-container-agent-tag20:08
guilhermespok let me test with this heat_container_agent_tag=latest20:11
*** yolanda has joined #openstack-containers20:11
Open10K8Sbrtknr: ussuri-stable-1?20:18
* guilhermesp tries ussuri-stable-120:26
*** ttsiouts has quit IRC20:27
guilhermespsounds good, seems master is created already20:27
*** ttsiouts has joined #openstack-containers20:28
Open10K8Sguilhermesp: cool cool20:31
guilhermespso brtknr i guess the fix for next ussuri release is to push to correct heat container agent tag?20:32
*** ttsiouts has quit IRC20:32
brtknrguilhermesp: correct20:38
brtknrAnd some other fixes too20:39
guilhermespnice, thanks for point that out brtknr !20:57
openstackgerritOleksandr Kozachenko proposed openstack/magnum-tempest-plugin master: Set the default ussuri heat_container_agent_tag to ussuri-stable-1  https://review.opendev.org/73869821:05
*** andrein has quit IRC21:14
*** andrein has joined #openstack-containers21:15
*** rcernin has joined #openstack-containers22:39
*** rcernin has quit IRC22:48
*** rcernin has joined #openstack-containers22:49
*** born2bake has quit IRC22:52

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!