| *** salmankhan has quit IRC | 00:07 | |
| *** Jack_Iv has joined #openstack-containers | 00:14 | |
| *** Jack_Iv has quit IRC | 00:19 | |
| *** masber has quit IRC | 00:21 | |
| *** crazymozart1 has joined #openstack-containers | 00:27 | |
| *** adisky_ has quit IRC | 00:29 | |
| *** crazymozart has quit IRC | 00:30 | |
| *** adrian_otto has joined #openstack-containers | 00:33 | |
| *** ssbarnea has quit IRC | 00:33 | |
| *** tonanhngo has quit IRC | 00:33 | |
| *** Jack_Iv has joined #openstack-containers | 00:35 | |
| *** yuanying_ has joined #openstack-containers | 00:38 | |
| *** Jack_Iv has quit IRC | 00:40 | |
| *** tonanhngo has joined #openstack-containers | 00:41 | |
| *** yuanying_ has quit IRC | 00:42 | |
| *** tonanhngo has quit IRC | 00:45 | |
| *** tonanhngo has joined #openstack-containers | 00:47 | |
| *** EricGonczer_ has joined #openstack-containers | 00:51 | |
| *** tonanhngo has quit IRC | 00:52 | |
| *** flwang1 has joined #openstack-containers | 00:55 | |
| flwang1 | adrian_otto: ping any luck you're around? | 00:56 |
|---|---|---|
| *** EricGonczer_ has quit IRC | 00:56 | |
| *** EricGonczer_ has joined #openstack-containers | 00:56 | |
| *** adrian_otto has quit IRC | 00:59 | |
| *** kevinz has joined #openstack-containers | 01:08 | |
| jaeman | yatinkarel, I succeded to create k8s cluster based on coreos as well as fedora-atomic. Thank you. | 01:28 |
| *** masber has joined #openstack-containers | 01:29 | |
| jaeman | I have another question. I can not find any log in /var/log/containers of master. Do I need any configuration to lease log? | 01:30 |
| jaeman | Sorry. Do I need any configuration to leave log? | 01:30 |
| jaeman | I can not see the log on only fedora atomic, not on coreos. | 01:34 |
| *** ricolin has joined #openstack-containers | 01:35 | |
| *** Jack_Iv has joined #openstack-containers | 01:36 | |
| *** dave-mccowan has quit IRC | 01:37 | |
| *** dave-mccowan has joined #openstack-containers | 01:39 | |
| *** Jack_Iv has quit IRC | 01:40 | |
| *** ianychoi has quit IRC | 01:48 | |
| *** masber has quit IRC | 01:49 | |
| *** mmotiani has joined #openstack-containers | 01:51 | |
| *** masber has joined #openstack-containers | 01:53 | |
| *** ianychoi has joined #openstack-containers | 01:54 | |
| *** hieulq has quit IRC | 01:56 | |
| *** hieulq has joined #openstack-containers | 01:59 | |
| *** swatson has quit IRC | 02:03 | |
| *** dave-mcc_ has joined #openstack-containers | 02:08 | |
| *** Drago has quit IRC | 02:10 | |
| *** dave-mccowan has quit IRC | 02:10 | |
| *** dave-mccowan has joined #openstack-containers | 02:13 | |
| *** dave-mcc_ has quit IRC | 02:16 | |
| *** hongbin has joined #openstack-containers | 02:23 | |
| *** ramishra has joined #openstack-containers | 02:30 | |
| firl | any charmers know why my load balancer as a service might not be showing up in openstack-dashboard? I enabled it to true, I am on xenial-newton | 02:30 |
| *** wangbo has quit IRC | 02:32 | |
| *** Jack_Iv has joined #openstack-containers | 02:36 | |
| *** hieulq has quit IRC | 02:39 | |
| *** hieulq has joined #openstack-containers | 02:41 | |
| *** Jack_Iv has quit IRC | 02:41 | |
| *** eliqiao has joined #openstack-containers | 02:43 | |
| *** masber has quit IRC | 02:56 | |
| yatinkarel | jaeman, what sort of logs exist in /var/log/containers? pod logs you can get using kubectl logs. | 03:21 |
| *** hongbin has quit IRC | 03:37 | |
| *** Jack_Iv has joined #openstack-containers | 03:37 | |
| *** Jack_Iv has quit IRC | 03:42 | |
| *** masber has joined #openstack-containers | 03:48 | |
| yatinkarel | jmlowe_, what's your environment: magnum version, how did you setup magnum? | 03:49 |
| *** dave-mccowan has quit IRC | 03:50 | |
| *** hieulq has quit IRC | 03:50 | |
| *** hieulq has joined #openstack-containers | 03:53 | |
| *** fragatin_ has joined #openstack-containers | 03:54 | |
| *** fragatina has quit IRC | 03:55 | |
| *** fragatin_ has quit IRC | 03:59 | |
| jaeman | yatinkarel, yes I can get log from 'kubectl logs ...'. If some want to load monitoring system like ELK, he have to know where log is gathered. | 04:04 |
| *** flwang1 has quit IRC | 04:10 | |
| *** NikhilS has joined #openstack-containers | 04:19 | |
| yatinkarel | jaeman, Ok then you can file a bug by describing the requirement, any relevant links for the feature. Then Team can look and consider this. | 04:19 |
| *** adisky_ has joined #openstack-containers | 04:20 | |
| *** yee379 has quit IRC | 04:30 | |
| *** yee37914 has joined #openstack-containers | 04:31 | |
| *** Drago1 has joined #openstack-containers | 04:38 | |
| *** masber has quit IRC | 04:40 | |
| *** fragatina has joined #openstack-containers | 04:49 | |
| *** yatinkarel has quit IRC | 04:55 | |
| *** Jeffrey4l_ has quit IRC | 04:55 | |
| *** Jeffrey4l has joined #openstack-containers | 04:56 | |
| *** EricGonczer_ has quit IRC | 05:01 | |
| *** Jack_Iv has joined #openstack-containers | 05:02 | |
| *** yatinkarel has joined #openstack-containers | 05:06 | |
| *** Jack_Iv has quit IRC | 05:06 | |
| *** EricGonczer_ has joined #openstack-containers | 05:23 | |
| *** Jack_Iv has joined #openstack-containers | 05:23 | |
| *** Jack_Iv has quit IRC | 05:28 | |
| *** zenirc369 has joined #openstack-containers | 05:45 | |
| openstackgerrit | Duan Jiong proposed openstack/magnum master: Fix some reST field lists in docstrings https://review.openstack.org/448903 | 05:48 |
| *** EricGonczer_ has quit IRC | 05:51 | |
| *** Jack_Iv has joined #openstack-containers | 05:58 | |
| *** zenirc369 has quit IRC | 06:01 | |
| *** askb_ has joined #openstack-containers | 06:08 | |
| *** kbyrne_ has joined #openstack-containers | 06:09 | |
| *** Jack_Iv has quit IRC | 06:10 | |
| *** Jack_Iv has joined #openstack-containers | 06:12 | |
| *** kbyrne has quit IRC | 06:13 | |
| *** askb has quit IRC | 06:13 | |
| *** kbyrne_ is now known as kbyrne | 06:13 | |
| *** zenirc369 has joined #openstack-containers | 06:14 | |
| *** masber has joined #openstack-containers | 06:22 | |
| *** fragatina has quit IRC | 06:39 | |
| *** masber has quit IRC | 06:39 | |
| *** yatink has joined #openstack-containers | 06:45 | |
| *** hishh has joined #openstack-containers | 07:04 | |
| *** Drago1 has quit IRC | 07:06 | |
| *** Jack_Iv has quit IRC | 07:10 | |
| *** Jack_Iv has joined #openstack-containers | 07:10 | |
| *** ssbarnea has joined #openstack-containers | 07:20 | |
| *** janki has joined #openstack-containers | 07:24 | |
| *** janki has quit IRC | 07:27 | |
| *** janki has joined #openstack-containers | 07:27 | |
| *** hishh has quit IRC | 07:31 | |
| *** ssbarnea_ has joined #openstack-containers | 07:31 | |
| jaeman | yatinkarel, Thanks. I will create a bug for the requirement. I have another question. I and my colleages wish to use k8s-ironic driver to provision k8s cluster on baremetal. But, I don't know if it is available or not and how to configure to use that. | 07:33 |
| *** ssbarnea has quit IRC | 07:34 | |
| *** Jack_Iv has quit IRC | 07:40 | |
| *** Jack_Iv has joined #openstack-containers | 07:40 | |
| yatinkarel | jaeman, yes it's available | 07:41 |
| yatinkarel | jaeman, i am also trying to use fedora ironic using devstack + ironic + magnum setup, but ironic setup of mine is not working | 07:42 |
| yatinkarel | fedora ironic --> k8s fedora ironic | 07:42 |
| *** askb_ has quit IRC | 07:43 | |
| *** amoralej|off is now known as amoralej | 07:43 | |
| *** Serlex has joined #openstack-containers | 07:52 | |
| *** askb has joined #openstack-containers | 08:00 | |
| *** askb has quit IRC | 08:02 | |
| *** askb has joined #openstack-containers | 08:04 | |
| *** zenirc369 has quit IRC | 08:04 | |
| *** janki is now known as janki|lunch | 08:04 | |
| *** pcaruana has joined #openstack-containers | 08:06 | |
| jaeman | yatinkarel, you said that 'devstack + ironic + magnum' is available but not working. Does that mean I can try to that but there are some bugs? And also is there any manual to setup such system? Otherwise, do I need only ironic service which can control baremetal well? | 08:11 |
| *** dschultz has quit IRC | 08:14 | |
| *** dschultz has joined #openstack-containers | 08:16 | |
| *** hishh has joined #openstack-containers | 08:16 | |
| yatinkarel | jaeman, 'devstack + ironic + magnum' is available but it's not working for me. You can try the setup. | 08:16 |
| *** zenirc369 has joined #openstack-containers | 08:17 | |
| yatinkarel | Currently magnum doesn't have doc for doing the setup. | 08:18 |
| jaeman | yatinkarel, yeah, I will try that on my machines. Thank you | 08:18 |
| *** mjura has joined #openstack-containers | 08:19 | |
| yatinkarel | you can extract some info from: magnum/magnum/tests/contrib/gate_hook.sh | 08:19 |
| yatinkarel | If you succeed please let me know as well:) | 08:20 |
| *** mjura has quit IRC | 08:20 | |
| *** mjura has joined #openstack-containers | 08:20 | |
| *** Administrator_ has quit IRC | 08:20 | |
| jaeman | yatinkarel, sure : ) | 08:20 |
| yatinkarel | jaeman, my local.conf: http://paste.openstack.org/show/603872/ | 08:21 |
| *** Administrator_ has joined #openstack-containers | 08:21 | |
| jaeman | yatinkarel, thank you so much. It's really helpful to us. | 08:25 |
| yatinkarel | strigazi, ping | 08:25 |
| *** jaeman has quit IRC | 08:28 | |
| *** jaeman has joined #openstack-containers | 08:33 | |
| *** dsariel_ has quit IRC | 08:34 | |
| strigazi | yatinkarel hi | 08:40 |
| yatinkarel | strigazi, have you tried devstack + ironic + magnum setup | 08:42 |
| yatinkarel | locally | 08:42 |
| strigazi | yes, but not recently | 08:42 |
| jaeman | Hi, strigazi. I am about to try setup k8s cluster using k8s_fedora_ironic_v1. Do you have any tip for that like cluster-template info. | 08:43 |
| yatinkarel | strigazi, actually i was trying and my vm is going into ERROR state and ironic node goes to clean failed state | 08:43 |
| yatinkarel | when checked VM console log i am getting: 52:54:00:f0:c1:54 using virtio-net on PCI00:04.0 (open) | 08:44 |
| yatinkarel | <yatinkarel> [Link:up, TX:0 TXE:0 RX:0 RXE:0] | 08:44 |
| yatinkarel | Configuring (net0 52:54:00:f0:c1:54).................. Error 0x040ee119 (http:// | 08:44 |
| yatinkarel | From this it looks like The VM is not able to get IP from DHCP | 08:44 |
| strigazi | Were you able to create an instance on ironic without magnum? | 08:45 |
| yatinkarel | strigazi, No | 08:45 |
| yatinkarel | i also tried just ironic with devstack then also same error | 08:45 |
| strigazi | This process should work https://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#deploying-ironic-with-devstack | 08:46 |
| yatinkarel | strigazi, i tried this only | 08:46 |
| *** ricolin has quit IRC | 08:46 | |
| strigazi | Here is my local conf at the time: http://paste.openstack.org/show/584025/ | 08:48 |
| strigazi | yatinkarel ^^ | 08:48 |
| yatinkarel | strigazi, i am using this: http://paste.openstack.org/show/603872/ | 08:49 |
| strigazi | jaeman You need to pass a fixed_network and a fixed_subnet. Also try with both flavor master/node to be baremetal | 08:49 |
| *** ricolin has joined #openstack-containers | 08:49 | |
| yatinkarel | strigazi, looks like i am using same as yours. | 08:50 |
| strigazi | yes, looks ok | 08:50 |
| strigazi | I think you need to be able to use ironic only first and then try with magnum | 08:50 |
| yatinkarel | strigazi, i also tried that but faced same error | 08:51 |
| strigazi | yatinkarel I'll try too today and see how it goes | 08:52 |
| yatinkarel | strigazi, Ok Thanks try with this only https://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#deploying-ironic-with-devstack | 08:52 |
| *** dsariel has joined #openstack-containers | 09:00 | |
| *** openstackgerrit has quit IRC | 09:03 | |
| *** janki|lunch is now known as janki | 09:08 | |
| *** salmankhan has joined #openstack-containers | 09:49 | |
| *** manikanta_tadi has joined #openstack-containers | 09:53 | |
| *** salmankhan has quit IRC | 09:53 | |
| *** salmankhan has joined #openstack-containers | 09:55 | |
| *** flwang1 has joined #openstack-containers | 09:56 | |
| *** Jack_Iv has quit IRC | 10:11 | |
| *** kevinz has quit IRC | 10:31 | |
| *** Jack_Iv has joined #openstack-containers | 10:35 | |
| *** openstackgerrit has joined #openstack-containers | 10:36 | |
| openstackgerrit | Spyros Trigazis proposed openstack/magnum master: IGNORE: Tests ci https://review.openstack.org/443002 | 10:36 |
| openstackgerrit | yatin proposed openstack/magnum master: Update Steps for creating dib images https://review.openstack.org/449063 | 10:54 |
| *** EricGonczer_ has joined #openstack-containers | 10:54 | |
| *** salmankhan has quit IRC | 10:57 | |
| *** salmankhan has joined #openstack-containers | 10:58 | |
| *** salmankhan has quit IRC | 11:02 | |
| *** salmankhan has joined #openstack-containers | 11:04 | |
| *** EricGonczer_ has quit IRC | 11:14 | |
| openstackgerrit | yatin proposed openstack/magnum master: Fix CoreOS cluster creation and heat notify https://review.openstack.org/445934 | 11:14 |
| openstackgerrit | yatin proposed openstack/magnum master: Add kube dashboard and remove kube ui https://review.openstack.org/441046 | 11:15 |
| openstackgerrit | yatin proposed openstack/magnum master: [k8s_coreos] Add kubernetes dashboard https://review.openstack.org/449073 | 11:15 |
| *** manikanta_tadi has quit IRC | 11:15 | |
| *** tovin07 has quit IRC | 11:19 | |
| *** jmlowe_ has quit IRC | 11:22 | |
| *** masber has joined #openstack-containers | 11:33 | |
| *** mmotiani has quit IRC | 11:36 | |
| *** Jack_Iv has quit IRC | 11:41 | |
| *** Jack_Iv has joined #openstack-containers | 11:41 | |
| *** EricGonczer_ has joined #openstack-containers | 11:42 | |
| *** yatink has quit IRC | 11:44 | |
| *** Jack_Iv has quit IRC | 11:45 | |
| openstackgerrit | yuanpeng proposed openstack/magnum master: Remove log translations https://review.openstack.org/447868 | 11:53 |
| *** salmankhan has quit IRC | 11:54 | |
| *** Jack_Iv has joined #openstack-containers | 11:58 | |
| *** salmankhan has joined #openstack-containers | 12:02 | |
| *** askb has quit IRC | 12:05 | |
| *** EricGonczer_ has quit IRC | 12:06 | |
| *** salmankhan has quit IRC | 12:08 | |
| *** salmankhan has joined #openstack-containers | 12:08 | |
| *** flwang1 has quit IRC | 12:39 | |
| *** catintheroof has joined #openstack-containers | 12:44 | |
| *** yuanying_ has joined #openstack-containers | 12:53 | |
| *** dave-mccowan has joined #openstack-containers | 12:54 | |
| *** belmoreira has joined #openstack-containers | 12:55 | |
| *** ssbarnea_ has quit IRC | 12:55 | |
| *** catintheroof has quit IRC | 13:03 | |
| *** amoralej is now known as amoralej|lunch | 13:07 | |
| *** ssbarnea has joined #openstack-containers | 13:11 | |
| *** yatink has joined #openstack-containers | 13:19 | |
| *** jmlowe has joined #openstack-containers | 13:28 | |
| *** Serlex has quit IRC | 13:29 | |
| jmlowe | yatinkarel: ocata from the rdo packages 4.1.0 | 13:30 |
| *** janki has quit IRC | 13:45 | |
| yatinkarel | jmlowe, can you login to master node and share output of /etc/sysconfig/heat-params | 13:58 |
| *** NikhilS has quit IRC | 13:59 | |
| *** hongbin has joined #openstack-containers | 14:02 | |
| *** Serlex has joined #openstack-containers | 14:04 | |
| jmlowe | the master node is never created | 14:05 |
| jmlowe | as far as I can tell kube_master_init goes init_complete and kube-master is waiting in init_complete for that to finish before it starts | 14:06 |
| jmlowe | http://paste.openstack.org/show/603932/ | 14:06 |
| *** Jack_Iv has quit IRC | 14:07 | |
| *** Jack_Iv has joined #openstack-containers | 14:07 | |
| jmlowe | I can't find any dependency that is holding up kube_master_init | 14:10 |
| *** Jack_Iv has quit IRC | 14:12 | |
| yatinkarel | jmlowe, apart from magnum other services(heat) is running properly? | 14:14 |
| *** fragatina has joined #openstack-containers | 14:14 | |
| jmlowe | yes, I can even deploy a docker swarm with magnum no problem | 14:14 |
| jmlowe | only k8s is giving me trouble | 14:15 |
| yatinkarel | Ohk | 14:15 |
| yatinkarel | if swarm is working then setup is Ok. Have you tried recreating the k8s-cluster | 14:16 |
| yatinkarel | can you share the cluster-template command that you used to create swarm-cluster and k8s-cluster? | 14:17 |
| *** Jack_Iv has joined #openstack-containers | 14:18 | |
| *** jasond has joined #openstack-containers | 14:21 | |
| jmlowe | http://paste.openstack.org/show/603933/ | 14:22 |
| *** amoralej|lunch is now known as amoralej | 14:22 | |
| *** Jack_Iv has quit IRC | 14:24 | |
| strigazi | jmlowe can you check the etcd version? | 14:24 |
| strigazi | is it 3.0.17? | 14:24 |
| strigazi | if yes try with Fedora-Atomic-25-20170205 | 14:24 |
| strigazi | which has etcd 3.0.15 | 14:24 |
| jmlowe | it doesn't attempt a nova boot, so how would the etcd version be relevant? | 14:25 |
| strigazi | it doesn't boot? ok you far from this then. | 14:26 |
| yatinkarel | strigazi, and jmlowe is also able to create swarm cluster | 14:26 |
| yatinkarel | but issue in k8s cluster | 14:26 |
| strigazi | fyi we use Fedora-Atomic-25-20170205 | 14:26 |
| jmlowe | it seems to get stuck for some reason right before issuing the nova boot | 14:27 |
| yatinkarel | jmlowe, is cinder volume created | 14:27 |
| jmlowe | I think it was, deleting a retrying | 14:28 |
| yatinkarel | can you try without cinder | 14:28 |
| jmlowe | yes | 14:29 |
| *** adisky_ has quit IRC | 14:29 | |
| jmlowe | so no volume driver specified | 14:30 |
| yatinkarel | while creating cluster templalte don't pass --docker-volume-size | 14:30 |
| jmlowe | ah, so without cinder completed | 14:34 |
| jmlowe | I need to take a real hard look at cinder then | 14:34 |
| yatinkarel | jmlowe, yes | 14:34 |
| jmlowe | hmm, so I'm thinking I had some old broken stuff and the rpm upgrade from newton to ocata didn't work correctly | 14:41 |
| jmlowe | after removing and reinstalling I don't have trouble with cinder enabled masters, still waiting on minions to come up but it's a definite improvement | 14:42 |
| openstackgerrit | Spyros Trigazis proposed openstack/magnum master: IGNORE: Tests ci https://review.openstack.org/443002 | 14:43 |
| yatinkarel | jmlowe, the swarm cluster you created was also after the upgrade | 14:44 |
| jmlowe | yes | 14:44 |
| yatinkarel | and did you specified --docker-volume-size for swarm cluster | 14:45 |
| *** kevinz has joined #openstack-containers | 14:46 | |
| jmlowe | not sure, followed the install guide test | 14:46 |
| jmlowe | https://docs.openstack.org/project-install-guide/container-infrastructure-management/draft/launch-instance.html | 14:46 |
| jmlowe | looks like no | 14:47 |
| jmlowe | interesting, so this time it looks like the master was created but hung on minions | 14:47 |
| jmlowe | http://paste.openstack.org/show/603940/ | 14:48 |
| strigazi | docker_volume_size is not passed in the url you just sent | 14:50 |
| jmlowe | correct | 14:50 |
| jmlowe | so that wasn't quite as good of a test as I had initially thought | 14:50 |
| yatinkarel | jmlowe, any update on the status, or it still stucked | 14:52 |
| jmlowe | still stuck on minions stack | 14:53 |
| *** fungusakafungus has joined #openstack-containers | 14:54 | |
| yatinkarel | nova boot? | 14:55 |
| *** kevinz has quit IRC | 14:55 | |
| jmlowe | specifically kube_minion_init http://paste.openstack.org/show/603942/ | 14:56 |
| jmlowe | the multipart mime with all ofthe software configs | 14:57 |
| jmlowe | just before nova boot | 14:57 |
| jmlowe | it's almost as if there is some bug in heat where the multipart mime doesn't always get notified about the softwareconfig status changes | 15:00 |
| *** belmorei_ has joined #openstack-containers | 15:01 | |
| jmlowe | my read of the template is that the multipart mime should go "create complete" once the software configs go "create complete" allowing it to proceed to the kube-minion nova boot | 15:02 |
| *** belmoreira has quit IRC | 15:02 | |
| jmlowe | and that doesn't seem to be happening | 15:02 |
| yatink | jmlowe, i am not sure about this. | 15:03 |
| *** adrian_otto has joined #openstack-containers | 15:03 | |
| yatink | strigazi, do you have some idea | 15:04 |
| jmlowe | yeah, so there is this "DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed" at the same time as the last update for heat resources in the heat engine log | 15:04 |
| strigazi | looking | 15:05 |
| jmlowe | I think I need to start looking at the oslo db and heat engine | 15:07 |
| *** dimtruck is now known as zz_dimtruck | 15:07 | |
| jmlowe | oh, some googling is turning up stuff about heat db access not actually being thread safe | 15:09 |
| jmlowe | the software configs being such a quick resource to create would mean that the chances of multiple heat engine workers trying to update the db at the same time would be greatly increased | 15:10 |
| jmlowe | https://bugs.launchpad.net/heat/+bug/1499669 | 15:11 |
| openstack | Launchpad bug 1499669 in heat mitaka "Heat stucks in DELETE_IN_PROGRESS for some input data" [High,Fix committed] - Assigned to Zane Bitter (zaneb) | 15:11 |
| strigazi | I'm not sure. You run heat in mitaka? (shouldn't matter though) | 15:12 |
| jmlowe | newton for heat | 15:12 |
| jmlowe | still reading the bug | 15:13 |
| *** john5223 has joined #openstack-containers | 15:14 | |
| jmlowe | really wondering if this bug is actually the same as my problem https://bugs.launchpad.net/magnum/+bug/1541964 | 15:15 |
| openstack | Launchpad bug 1541964 in Magnum "K8s bay creation intermittently timing out" [Critical,In progress] - Assigned to Eli Qiao (taget-9) | 15:15 |
| strigazi | I don't think so | 15:15 |
| *** zz_dimtruck is now known as dimtruck | 15:17 | |
| adrian_otto | flwang: you were trying to find me earlier? | 15:26 |
| *** Drago2 has joined #openstack-containers | 15:30 | |
| *** mmotiani has joined #openstack-containers | 15:38 | |
| *** dsariel has quit IRC | 15:45 | |
| *** dimtruck is now known as zz_dimtruck | 15:48 | |
| *** swatson has joined #openstack-containers | 15:51 | |
| adrian_otto | yatink: yt? | 15:53 |
| *** amoralej is now known as amoralej|brb | 15:54 | |
| *** yuanying_ has quit IRC | 15:55 | |
| *** belmorei_ has quit IRC | 15:59 | |
| *** zz_dimtruck is now known as dimtruck | 16:00 | |
| *** jmckind has joined #openstack-containers | 16:00 | |
| yatink | adrian_otto, hi | 16:04 |
| *** jmlowe has quit IRC | 16:04 | |
| adrian_otto | yatink: It was a question about a review vote. I just asked it in the review stream a moment ago, regarding the translations. | 16:05 |
| yatink | yatink, ok checking | 16:05 |
| *** yuanying_ has joined #openstack-containers | 16:06 | |
| *** belmoreira has joined #openstack-containers | 16:10 | |
| *** yuanying_ has quit IRC | 16:12 | |
| *** belmoreira has quit IRC | 16:13 | |
| yatink | adrian_otto, replied | 16:14 |
| adrian_otto | yatink: tx! | 16:15 |
| *** amoralej|brb is now known as amoralej | 16:41 | |
| *** vijendar has joined #openstack-containers | 16:42 | |
| *** yuanying_ has joined #openstack-containers | 16:42 | |
| *** ramishra has quit IRC | 16:43 | |
| *** adrian_otto1 has joined #openstack-containers | 16:47 | |
| *** adrian_otto has quit IRC | 16:49 | |
| *** fungusakafungus has quit IRC | 17:01 | |
| *** mjura has quit IRC | 17:05 | |
| *** EricGonczer_ has joined #openstack-containers | 17:05 | |
| *** catintheroof has joined #openstack-containers | 17:07 | |
| *** pbandark has joined #openstack-containers | 17:13 | |
| *** hishh has quit IRC | 17:13 | |
| *** pcaruana has quit IRC | 17:14 | |
| *** fragatina has quit IRC | 17:24 | |
| *** tonanhngo has joined #openstack-containers | 17:30 | |
| *** jmlowe has joined #openstack-containers | 17:31 | |
| *** jmlowe has quit IRC | 17:34 | |
| *** jmlowe has joined #openstack-containers | 17:37 | |
| *** salmankhan has quit IRC | 17:40 | |
| *** salmankhan has joined #openstack-containers | 17:41 | |
| *** Serlex has quit IRC | 17:45 | |
| *** fragatina has joined #openstack-containers | 17:45 | |
| *** adrian_otto1 has quit IRC | 17:52 | |
| *** yuanying_ has quit IRC | 17:53 | |
| *** adrian_otto has joined #openstack-containers | 17:56 | |
| jmlowe | ha, so I'm really pretty sure now that I've had lunch and knocked heat engine down to 1 worker that there is a heat concurrency bug keeping magnum clusters from successfully deploying | 17:58 |
| *** yatink has quit IRC | 17:59 | |
| jmlowe | strigazi: why would you say bug 1541964 isn't related to a heat concurrency bug that seems to miss a state change in a resource causing the stack creation to timeout and never progress? | 18:01 |
| openstack | bug 1541964 in Magnum "K8s bay creation intermittently timing out" [Critical,In progress] https://launchpad.net/bugs/1541964 - Assigned to Eli Qiao (taget-9) | 18:01 |
| *** catintheroof has quit IRC | 18:07 | |
| strigazi | jmlowe This bug was related to the ci performance and with no clear indication on what is failing. After using smaller flavor it was working. We have 6 heat engines (newton), never had this problem before | 18:08 |
| strigazi | jmlowe Did you create a k8s cluster after all? | 18:09 |
| strigazi | YOu still see the DBAPIError in heat? | 18:09 |
| jmlowe | no db error and successful creation after I go down to one heat engine worker | 18:10 |
| strigazi | Is it easy to go to 2 again? | 18:11 |
| strigazi | TO see if it will happen again | 18:11 |
| jmlowe | relatively | 18:11 |
| jmlowe | default was 32 workers, not entirely sure where the tipping point is | 18:12 |
| strigazi | oh, workers. I though heat-engine instances | 18:13 |
| jmlowe | conf line is num_engine_workers | 18:13 |
| jmlowe | winds up being expressed as distinct heat-engine processes | 18:14 |
| jmlowe | starting cluster with two heat engine workers .... | 18:15 |
| *** pbandark has quit IRC | 18:16 | |
| *** adrian_otto has quit IRC | 18:16 | |
| *** adrian_otto has joined #openstack-containers | 18:16 | |
| jmlowe | well, I triggered the db error "DBAPIError: (sqlalchemy.exc.ResourceClosedError) This Connection is closed" | 18:16 |
| strigazi | jmlowe Can disable convergence and restart heat? | 18:18 |
| *** jmlowe has quit IRC | 18:19 | |
| *** yuanying_ has joined #openstack-containers | 18:20 | |
| *** jmlowe has joined #openstack-containers | 18:20 | |
| jmlowe | it was off | 18:24 |
| jmlowe | default is convergence_engine = flase | 18:24 |
| jmlowe | nm, looking at an older config file, default really is convergence_engine = true | 18:27 |
| strigazi | jmlowe sounds more like a heat issue. I would ask at #heat too | 18:31 |
| jmlowe | yeah, it definitely is a heat problem | 18:32 |
| strigazi | jmlowe Not 100% sure :) (I don't have something in mind) but the heat team can surely help | 18:33 |
| strigazi | Let me know if you find something | 18:33 |
| jmlowe | I installed as mitaka (I think) now up to newton, so I'm reviewing my config vs install guide to make sure I'm not missing something there | 18:34 |
| strigazi | jmlowe ok | 18:34 |
| *** jmlowe has quit IRC | 18:43 | |
| *** jmlowe has joined #openstack-containers | 18:45 | |
| *** yuanying_ has quit IRC | 18:53 | |
| *** yuanying_ has joined #openstack-containers | 19:12 | |
| *** Jack_Iv has joined #openstack-containers | 19:14 | |
| *** jmlowe has quit IRC | 19:16 | |
| *** jmlowe has joined #openstack-containers | 19:17 | |
| *** salmankhan has quit IRC | 19:21 | |
| *** adrian_otto has quit IRC | 19:24 | |
| *** adrian_otto has joined #openstack-containers | 19:26 | |
| *** fragatina has quit IRC | 19:27 | |
| *** adrian_otto has quit IRC | 19:34 | |
| *** jmlowe has quit IRC | 19:35 | |
| *** jmlowe has joined #openstack-containers | 19:36 | |
| *** zenirc369 has quit IRC | 19:40 | |
| *** amoralej is now known as amoralej|off | 19:46 | |
| *** mjura has joined #openstack-containers | 19:58 | |
| *** Jack_Iv has quit IRC | 20:03 | |
| *** Jack_Iv has joined #openstack-containers | 20:04 | |
| *** Jack_Iv has quit IRC | 20:04 | |
| *** belmoreira has joined #openstack-containers | 20:07 | |
| *** belmoreira has quit IRC | 20:07 | |
| *** fragatina has joined #openstack-containers | 20:09 | |
| *** fragatina has quit IRC | 20:10 | |
| *** fragatina has joined #openstack-containers | 20:10 | |
| *** jmlowe has quit IRC | 20:11 | |
| *** jmlowe has joined #openstack-containers | 20:12 | |
| openstackgerrit | Vijendar Komalla proposed openstack/magnum master: Add an option to verify CA https://review.openstack.org/447143 | 20:13 |
| openstackgerrit | Vijendar Komalla proposed openstack/magnum master: Add an option to verify CA https://review.openstack.org/447686 | 20:13 |
| openstackgerrit | Vijendar Komalla proposed openstack/magnum master: Add verify_ca field to cluster template https://review.openstack.org/447687 | 20:13 |
| openstackgerrit | Vijendar Komalla proposed openstack/magnum master: Add an option to verify CA https://review.openstack.org/447685 | 20:13 |
| *** askb has joined #openstack-containers | 20:17 | |
| *** mjura has quit IRC | 20:23 | |
| *** vijendar has quit IRC | 20:31 | |
| jmlowe | digging into the heat bugs, things are not in good shape in terms of concurrent engines | 20:34 |
| *** jmlowe has quit IRC | 20:36 | |
| *** jmlowe has joined #openstack-containers | 20:37 | |
| *** mtanino has joined #openstack-containers | 20:45 | |
| *** jmlowe has quit IRC | 20:49 | |
| *** mtanino has quit IRC | 20:56 | |
| *** Drago has joined #openstack-containers | 20:56 | |
| *** Drago1 has joined #openstack-containers | 20:57 | |
| *** Drago has quit IRC | 20:57 | |
| *** Drago2 has quit IRC | 20:57 | |
| *** adrian_otto has joined #openstack-containers | 20:58 | |
| *** jmckind has quit IRC | 20:59 | |
| *** yuanying_ has quit IRC | 21:06 | |
| *** yuanying_ has joined #openstack-containers | 21:06 | |
| *** yuanying_ has quit IRC | 21:06 | |
| *** yuanying_ has joined #openstack-containers | 21:06 | |
| *** yuanying_ has quit IRC | 21:07 | |
| *** dimtruck is now known as zz_dimtruck | 21:07 | |
| *** flwang1 has joined #openstack-containers | 21:09 | |
| *** jmlowe has joined #openstack-containers | 21:13 | |
| *** mtanino has joined #openstack-containers | 21:16 | |
| *** flwang2 has joined #openstack-containers | 21:25 | |
| *** flwang1 has quit IRC | 21:25 | |
| *** pbandark has joined #openstack-containers | 21:34 | |
| *** zz_dimtruck is now known as dimtruck | 21:36 | |
| *** mtanino has quit IRC | 21:36 | |
| *** salmankhan has joined #openstack-containers | 21:37 | |
| *** adrian_otto has quit IRC | 21:47 | |
| *** jasond has quit IRC | 22:16 | |
| *** dave-mcc_ has joined #openstack-containers | 22:33 | |
| *** dave-mccowan has quit IRC | 22:36 | |
| *** dave-mccowan has joined #openstack-containers | 22:37 | |
| *** dave-mcc_ has quit IRC | 22:40 | |
| *** tonanhngo has quit IRC | 22:51 | |
| *** tonanhngo has joined #openstack-containers | 22:58 | |
| *** tonanhngo has quit IRC | 23:02 | |
| *** salmankhan has quit IRC | 23:03 | |
| *** swatson has quit IRC | 23:10 | |
| *** catintheroof has joined #openstack-containers | 23:13 | |
| *** yuanying_ has joined #openstack-containers | 23:19 | |
| *** catintheroof has quit IRC | 23:20 | |
| *** catintheroof has joined #openstack-containers | 23:21 | |
| *** yuanying_ has quit IRC | 23:23 | |
| *** pbandark has quit IRC | 23:31 | |
| *** catintheroof has quit IRC | 23:33 | |
| *** catintheroof has joined #openstack-containers | 23:38 | |
| *** hongbin has quit IRC | 23:38 | |
| *** adrian_otto has joined #openstack-containers | 23:42 | |
| *** vishwanathj has quit IRC | 23:43 | |
| *** catintheroof has quit IRC | 23:45 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!