Tuesday, 2019-04-23

*** Sravan has joined #openstack-kolla00:14
*** Sravan has quit IRC00:23
*** Sravan has joined #openstack-kolla00:26
*** Sravan has quit IRC00:34
*** masber has joined #openstack-kolla00:44
masbergood morning, I depoloyed opentack using kolla with central logging enabled. Now kibana is asking me to "Configure an index pattern" what should I put here?00:44
*** whoami-rajat has joined #openstack-kolla01:01
*** Sravan has joined #openstack-kolla01:45
*** Sravan has quit IRC01:50
*** unicell has quit IRC02:01
*** unicell has joined #openstack-kolla02:28
*** unicell has quit IRC02:28
*** Sravan has joined #openstack-kolla02:36
*** openstackgerrit has joined #openstack-kolla02:39
openstackgerritjacky06 proposed openstack/kolla master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65467702:39
openstackgerritjacky06 proposed openstack/kolla-cli master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65467802:40
*** Sravan has quit IRC02:59
*** hongbin has joined #openstack-kolla03:10
*** dteselkin has quit IRC03:12
*** zhangfei has joined #openstack-kolla03:39
*** zhangfei has quit IRC03:40
*** zhangfei has joined #openstack-kolla03:41
*** Sravan has joined #openstack-kolla03:55
*** Sravan has quit IRC04:05
*** Sravan has joined #openstack-kolla04:15
*** Sravan has quit IRC04:18
*** Sravan has joined #openstack-kolla04:21
*** Sravan has quit IRC04:27
*** Sravan has joined #openstack-kolla04:27
*** Sravan has quit IRC04:30
*** hongbin has quit IRC04:33
*** Sravan has joined #openstack-kolla04:34
*** Sravan has quit IRC04:40
*** zhangfei has quit IRC04:43
*** shyamb has joined #openstack-kolla05:15
*** shyamb has quit IRC05:23
*** shyamb has joined #openstack-kolla05:23
openstackgerritzhongshengping proposed openstack/kolla-ansible master: Move to opendev  https://review.opendev.org/65439705:29
openstackgerritzhongshengping proposed openstack/kolla master: Move to opendev  https://review.opendev.org/65439605:30
*** Luzi has joined #openstack-kolla05:36
*** ivve has joined #openstack-kolla05:38
*** Chaserjim has quit IRC05:42
openstackgerritMerged openstack/kolla-ansible master: Remove placement migration code  https://review.opendev.org/65085605:51
openstackgerritMerged openstack/kolla-ansible master: Do some Train TODOs  https://review.opendev.org/65085706:02
*** pcaruana has joined #openstack-kolla06:06
*** lemko has joined #openstack-kolla06:15
*** dpawlik has joined #openstack-kolla06:18
*** dteselkin has joined #openstack-kolla06:21
*** dciabrin has joined #openstack-kolla06:35
*** shyamb has quit IRC06:49
*** zhangfei has joined #openstack-kolla06:51
*** shyamb has joined #openstack-kolla07:01
*** unicell has joined #openstack-kolla07:04
mnasiadkamorning07:06
*** zhangfei has quit IRC07:15
*** zhangfei has joined #openstack-kolla07:15
*** tosky has joined #openstack-kolla07:17
*** shyamb has quit IRC07:30
*** ileixe has joined #openstack-kolla07:33
ileixeHi forks. I have an simple question about kolla-ansible. Anybody knows the implementation would be appreciated.07:35
ileixeHow kolla-ansible assure dependencies between services? For exmpale register keystone service should be later than keystone deploy itself.07:36
ileixeI dig the codes but I could not find the related codes.07:37
*** gfidente has joined #openstack-kolla07:40
*** shyamb has joined #openstack-kolla07:40
*** unicell has quit IRC07:45
*** hamzaachi has joined #openstack-kolla07:46
*** andrein has joined #openstack-kolla07:51
*** shyamb has quit IRC07:51
*** shyamb has joined #openstack-kolla07:52
*** shyamb has quit IRC07:56
*** luksky has joined #openstack-kolla07:59
*** dteselkin has quit IRC08:03
*** dteselkin has joined #openstack-kolla08:03
*** dougsz has joined #openstack-kolla08:08
*** gfidente has quit IRC08:12
egonzalezileixe https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/keystone/tasks/register.yml08:23
egonzalezkeystone is already deployed at this time08:23
ileixeYes that's what I need08:24
ileixeHow we know keystone is already deployed?08:24
egonzalezbecause the task register.yml is after the container have start08:24
egonzalezhttps://github.com/openstack/kolla-ansible/blob/master/ansible/roles/keystone/tasks/deploy.yml08:24
ileixeBut that's only for keystone08:24
ileixeHow about other's registration?08:25
ileixelike nova neturon etc...08:25
egonzalezyou should have keystone enabled in globals, or provide an existing keystone deployment url and auth08:25
ileixeYes, what I wonder is in the keystone enabled.08:26
egonzaleznova doesnt care if keystone is deployed/enabled or not, just need an auth url and password08:26
egonzalezthat depends on your architecture, may be kolla-ansible deployed (keystone is enabled by default) or external08:27
ileixeSo if there is a problem which delays keystone provision, will nova's registration fail?08:27
egonzalezkeystone is always deployed before any other openstack service, if keystone role finish is working fine08:27
egonzalezbeucase itself is registering services in keystone08:28
egonzalezhere is the order of services https://github.com/openstack/kolla-ansible/blob/master/ansible/site.yml#L12408:28
ileixeUm... do you assume that role plays serially?08:28
ileixeI think kolla_serial can be none 008:29
egonzalezwont work in other way, at least for some services that need to be orchestarted as databases and upgrades08:29
ileixeAh okay I understand.08:30
ileixeThank you for enlightment!08:30
egonzalezyou may enable serial, but i would not do it without reading all the services code08:31
egonzalezfor example mariadb doesnt work as requires other nodes to be ready before moving on08:31
egonzalezand some upgrades too as keystone08:32
ileixeYes, actually we do manage all kind of dependencies for our provisioning code08:33
ileixeI wonder how kolla handle it08:33
ileixebecuase it always make a troublesome problem.08:34
*** shyamb has joined #openstack-kolla08:44
*** k_mouza has joined #openstack-kolla08:45
*** yankcrime has joined #openstack-kolla08:55
*** jbadiapa has joined #openstack-kolla09:02
*** gfidente has joined #openstack-kolla09:20
ivveanyone here gotten magnum to work in stein?09:20
ivve(meaning successfully deploy a working k8s cluster)09:22
*** shyamb has quit IRC09:31
*** happyhemant has joined #openstack-kolla09:33
openstackgerritwangwei proposed openstack/kolla-ansible master: Support ceph device classes feature  https://review.opendev.org/61089609:44
*** lemko has quit IRC09:44
*** gfidente has quit IRC09:46
*** shyamb has joined #openstack-kolla09:53
*** gfidente has joined #openstack-kolla10:00
*** threestrands has quit IRC10:15
*** gfidente has quit IRC10:32
*** shyamb has quit IRC10:35
*** shyamb has joined #openstack-kolla10:36
*** sshnaidm|afk is now known as sshnaidm10:40
*** rgogunskiy has joined #openstack-kolla11:02
*** rafaelweingartne has joined #openstack-kolla11:05
*** shyamb has quit IRC11:05
*** zhangfei has quit IRC11:32
*** shyamb has joined #openstack-kolla11:41
*** lemko has joined #openstack-kolla11:49
*** shyamb has quit IRC12:06
*** mchlumsky has joined #openstack-kolla12:06
*** shyamb has joined #openstack-kolla12:16
*** jbadiapa has quit IRC12:22
*** gfidente has joined #openstack-kolla12:28
*** gfidente has quit IRC12:34
*** mchlumsky has quit IRC12:38
*** mchlumsky has joined #openstack-kolla12:38
*** gfidente has joined #openstack-kolla12:40
*** mjturek has joined #openstack-kolla13:01
*** gfidente has quit IRC13:01
*** baha has joined #openstack-kolla13:01
*** ktibi has joined #openstack-kolla13:02
*** shyamb has quit IRC13:03
*** shyamb has joined #openstack-kolla13:04
*** mjturek has quit IRC13:12
*** jbadiapa has joined #openstack-kolla13:15
*** goldyfruit has joined #openstack-kolla13:15
*** redrobot has joined #openstack-kolla13:24
*** sshnaidm is now known as sshnaidm|afk13:26
*** ktibi has quit IRC13:32
*** skramaja has joined #openstack-kolla13:33
*** skramaja has quit IRC13:47
*** mjturek has joined #openstack-kolla13:50
*** shyamb has quit IRC13:52
*** sshnaidm|afk is now known as sshnaidm13:55
*** ktibi has joined #openstack-kolla14:03
*** yan0s has joined #openstack-kolla14:06
*** Luzi has quit IRC14:06
*** Chaserjim has joined #openstack-kolla14:20
*** obre has quit IRC14:28
*** obre has joined #openstack-kolla14:29
*** yan0s has quit IRC14:30
*** baha has quit IRC14:46
*** luksky has quit IRC14:54
*** baha has joined #openstack-kolla14:57
*** ktibi has quit IRC15:08
*** ktibi has joined #openstack-kolla15:09
*** engel75 has quit IRC15:12
*** ktibi has quit IRC15:12
*** ktibi has joined #openstack-kolla15:12
*** ktibi_ has joined #openstack-kolla15:21
*** ktibi has quit IRC15:25
*** Chaserjim has quit IRC15:28
*** Chaserjim has joined #openstack-kolla15:28
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: WIP: Test monasca in CI  https://review.opendev.org/64989315:29
*** ktibi_ has quit IRC15:32
*** ktibi_ has joined #openstack-kolla15:33
*** ktibi_ has quit IRC15:39
*** ktibi_ has joined #openstack-kolla15:40
*** k_mouza has quit IRC15:47
*** ktibi_ has quit IRC15:48
*** sshnaidm is now known as sshnaidm|afk15:54
*** k_mouza has joined #openstack-kolla15:56
*** dave-mccowan has joined #openstack-kolla15:58
*** k_mouza has quit IRC16:01
*** rafaelweingartne has quit IRC16:06
*** dave-mccowan has quit IRC16:07
*** unicell has joined #openstack-kolla16:10
*** jbadiapa has quit IRC16:11
*** Chaserjim has quit IRC16:30
*** Chaserjim has joined #openstack-kolla16:30
*** whoami-rajat has quit IRC16:30
*** itlinux has joined #openstack-kolla16:30
*** unicell has quit IRC16:31
*** whoami-rajat has joined #openstack-kolla16:39
*** Sravan has joined #openstack-kolla16:41
*** noVNC has joined #openstack-kolla16:41
*** tosky has quit IRC16:46
*** altlogbot_0 has quit IRC16:50
*** baha_ has joined #openstack-kolla16:51
*** baha has quit IRC16:52
*** altlogbot_1 has joined #openstack-kolla16:55
*** dougsz has quit IRC16:59
*** baha_ is now known as baha17:01
*** k_mouza has joined #openstack-kolla17:05
*** jbadiapa has joined #openstack-kolla17:05
*** hamzaachi has quit IRC17:07
*** hamzaachi has joined #openstack-kolla17:09
*** ivve has quit IRC17:10
*** luksky has joined #openstack-kolla17:16
*** andrein has quit IRC17:33
*** Talion has joined #openstack-kolla17:41
*** Sravan has quit IRC17:52
*** Sravan has joined #openstack-kolla17:54
*** Sravan has quit IRC18:07
*** Sravan has joined #openstack-kolla18:08
*** Sravan has quit IRC18:09
*** ivve has joined #openstack-kolla18:10
*** Sravan has joined #openstack-kolla18:14
*** k_mouza has quit IRC18:14
*** Sravan has quit IRC18:17
*** lemko has quit IRC18:17
*** JamesBenson has joined #openstack-kolla18:17
*** shyamb has joined #openstack-kolla18:17
*** Sravan has joined #openstack-kolla18:20
*** andrein has joined #openstack-kolla18:32
noVNCsup18:33
*** shyamb has quit IRC18:34
*** Sravan_ has joined #openstack-kolla18:36
*** Sravan has quit IRC18:39
*** lvdombrkr has joined #openstack-kolla18:44
lvdombrkrhello folks18:44
*** k_mouza has joined #openstack-kolla18:45
lvdombrkri had issue]18:45
lvdombrkrthat few of my instances are paused18:45
lvdombrkrpower state - paused, status active18:46
*** happyhemant has quit IRC18:48
lvdombrkrin compute logs i see:18:49
lvdombrkr2019-04-20 07:55:05.527 6 INFO nova.compute.manager [req-3fe7699d-eb68-4f51-be7b-b287bf210267 - - - - -] [instance: b229904c-bb6f-4c7f-9dbe-ce57dbc6db64] VM Paused (Lifecycle Event) 2019-04-20 07:55:05.754 6 INFO nova.compute.manager [req-3fe7699d-eb68-4f51-be7b-b287bf210267 - - - - -] [instance: b229904c-bb6f-4c7f-9dbe-ce57dbc6db64] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state18:49
lvdombrkrnothing more18:49
lvdombrkrany ideas?18:49
*** JamesBen_ has joined #openstack-kolla18:53
*** JamesBenson has quit IRC18:53
*** hamzaachi has quit IRC19:00
lvdombrkrfolks anyone here?19:03
*** Sravan_ has quit IRC19:04
noVNCsup lvdombrkr19:06
*** Sravan has joined #openstack-kolla19:07
lvdombrkrnoVNC : any ideas about my issue19:08
lvdombrkr?19:08
*** Sravan has quit IRC19:08
noVNCdo you have the libvirt.log ?19:08
noVNClibvirtd.log19:08
-openstackstatus- NOTICE: the zuul scheduler is being restarted now in order to address a memory utilization problem; changes under test will be reenqueued automatically19:09
*** Sravan has joined #openstack-kolla19:09
noVNCthis is running on centos or ubuntu?19:09
lvdombrkrnovnc : no errors on libvirt logs19:10
lvdombrkrand no any clues19:10
lvdombrkrcentos19:10
noVNC/var/log/kolla/libvirt/libvirtd.log on compute node19:11
lvdombrkrnoVNC : yes i checked, but no errors19:14
lvdombrkrlast log record 13.0419:14
lvdombrkrbut isntance was paused 20.0419:15
noVNChow many compute nodes?19:15
lvdombrkrnoVNC: just one19:16
lvdombrkr3 controllers + 1 compute19:16
noVNCphysical environment ?19:17
lvdombrkrnoVNC, controllers on VMs, compute physical19:19
lvdombrkrstorage backend nfs19:19
lvdombrkrnetapp nfs19:19
*** JamesBen_ has quit IRC19:20
*** JamesBenson has joined #openstack-kolla19:20
noVNClvdombrkr, https://bugzilla.redhat.com/show_bug.cgi?id=124529819:22
openstackbugzilla.redhat.com bug 1245298 in instack-undercloud "Undercloud keeps shutting down instances after their recovering from failure." [Urgent,Closed: errata] - Assigned to jslagle19:23
lvdombrkrnoVNC: thanks but i think my and issue on bugiezila19:27
lvdombrkrare different19:27
noVNChow much ram do you have on compute?19:28
noVNChow many vms you run there?19:28
lvdombrkrnoVNC: 160gb, 140 are free19:29
lvdombrkrritght now aprox 20 vms19:29
lvdombrkrand just two are paused19:29
lvdombrkras i mentioned19:29
*** igordc has joined #openstack-kolla19:29
lvdombrkrpower state pauzed19:29
lvdombrkrstatus active19:30
lvdombrkri dont have any clues19:30
noVNCnova reset-state --active vmname19:30
noVNCdid you try this19:31
lvdombrkrnoVNC: i resumed instances19:31
lvdombrkrbut question is19:31
*** JamesBenson has quit IRC19:31
lvdombrkrwhy/who paused19:31
lvdombrkrits not me19:31
lvdombrkrand not users19:31
lvdombrkrin server log19:32
lvdombrkrthere is no records19:32
*** Sravan has quit IRC19:32
*** JamesBenson has joined #openstack-kolla19:32
lvdombrkrthat someone pause it19:32
lvdombrkrbut in reallity it was paused19:32
lvdombrkrtwo VMs was paused19:32
lvdombrkrnot all19:32
noVNCweird19:33
noVNCmaybe something on this particual VM19:34
noVNCis running linux?19:34
noVNCwin?19:34
lvdombrkrnoVNC : centos 7.519:35
noVNCmmmm19:37
noVNCaddmore ram to this vm19:37
noVNCtrial and error ;)19:37
*** JamesBenson has quit IRC19:37
lvdombrkron nova logs related to this vm see just this:19:39
lvdombrkr2019-04-20 07:56:14.268 6 INFO nova.compute.manager [req-3fe7699d-eb68-4f51-be7b-b287bf210267 - - - - -] [instance: e8c66982-d512-4c48-8c33-637088cc6ba3] VM Paused (Lifecycle Event) 2019-04-20 07:56:14.544 6 INFO nova.compute.manager [req-3fe7699d-eb68-4f51-be7b-b287bf210267 - - - - -] [instance: e8c66982-d512-4c48-8c33-637088cc6ba3] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state19:39
lvdombrkrthats all19:39
noVNCwhich version of openstack is this?19:40
lvdombrkrnoVNC: its rocky19:41
*** hamzaachi has joined #openstack-kolla19:43
noVNClvdombrkr, ok19:44
*** igordc has quit IRC20:10
*** andrein has quit IRC20:14
*** igordc has joined #openstack-kolla20:14
*** noVNC has quit IRC20:14
*** igordc has quit IRC20:15
*** lvdombrkr has quit IRC20:19
*** andrein has joined #openstack-kolla20:22
*** pcaruana has quit IRC20:32
*** Sravan has joined #openstack-kolla20:48
*** k_mouza has quit IRC20:52
*** mjturek has quit IRC21:12
*** baha has quit IRC21:17
*** igordc has joined #openstack-kolla21:19
*** Talion has quit IRC21:20
*** tosky has joined #openstack-kolla21:28
*** whoami-rajat has quit IRC21:40
*** Sravan has quit IRC22:02
*** hamzaachi has quit IRC22:08
*** Sravan has joined #openstack-kolla22:09
*** andrein has quit IRC22:33
*** tonyb has joined #openstack-kolla22:41
*** luksky has quit IRC22:43
openstackgerritJohn Hinman proposed openstack/kolla-ansible master: WIP. Fixes for ovs-vsctl.sh, add scripts for starting ovsdpdk-db and ovs-vswitchd with option for ODL.  https://review.opendev.org/65526423:00
*** tosky has quit IRC23:13
*** gmann is now known as gmann_afk23:17
*** igordc has quit IRC23:32
*** mgkwill has joined #openstack-kolla23:45
*** Sravan has quit IRC23:53
mgkwillHas anyone kolla-ansible reconfigured with instances running?  Or restarted nova_compute which instances running? My compute nodes are staying in state=down - I can't figure out a way to bring them back up23:56
mgkwillrelated.. has anyone had ceph not flush and evict after deploying with kolla using cache tiers?23:58
*** goldyfruit has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!