| *** rlandy has quit IRC | 00:00 | |
| *** pchavva has quit IRC | 00:02 | |
| *** yolanda_ has joined #tripleo | 00:06 | |
| *** mcornea has quit IRC | 00:07 | |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config master: [WIP] Add Policy Based Routing Support to os-net-config https://review.openstack.org/575712 | 00:08 |
|---|---|---|
| *** mjturek has quit IRC | 00:08 | |
| *** rh-jelabarre has joined #tripleo | 00:08 | |
| *** yolanda__ has quit IRC | 00:09 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 00:10 |
| *** dciabrin_ has quit IRC | 00:22 | |
| *** kbyrne has quit IRC | 00:34 | |
| *** kbyrne has joined #tripleo | 00:35 | |
| *** edmondsw has quit IRC | 00:37 | |
| *** invsblduck has quit IRC | 00:37 | |
| *** invsblduck has joined #tripleo | 00:37 | |
| *** dxiri has quit IRC | 00:56 | |
| *** lblanchard has joined #tripleo | 01:05 | |
| *** mdnadeem has joined #tripleo | 01:05 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 01:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Use ACL instead of docker group for mistral https://review.openstack.org/577946 | 01:15 |
| *** Petersingh has joined #tripleo | 01:18 | |
| *** fzdarsky_ has joined #tripleo | 01:28 | |
| *** fzdarsky has quit IRC | 01:32 | |
| *** mrsoul_ has joined #tripleo | 01:45 | |
| *** mschuppert has quit IRC | 01:48 | |
| *** yamahata has quit IRC | 01:51 | |
| *** stendulker has joined #tripleo | 01:51 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add support for NodeDataLookup for Ceph deployment https://review.openstack.org/577956 | 01:57 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add support for NodeDataLookup for Ceph deployment https://review.openstack.org/577956 | 02:02 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: set container variables when needed https://review.openstack.org/576904 | 02:03 |
| *** itlinux has joined #tripleo | 02:05 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Use ACL instead of docker group for mistral https://review.openstack.org/577946 | 02:05 |
| *** stendulker has quit IRC | 02:06 | |
| *** dciabrin_ has joined #tripleo | 02:06 | |
| *** atarlov has joined #tripleo | 02:07 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 02:10 |
| openstackgerrit | Merged openstack/tripleo-ui master: Revert "Remove 'Refresh results' button on the nodes page" https://review.openstack.org/567911 | 02:10 |
| *** atarlov has quit IRC | 02:11 | |
| *** mdnadeem has quit IRC | 02:15 | |
| *** mdnadeem has joined #tripleo | 02:29 | |
| *** lblanchard has quit IRC | 02:32 | |
| *** psachin` has joined #tripleo | 02:43 | |
| *** bkopilov has quit IRC | 02:43 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP: use the tq ansible.cfg for the undercloud install https://review.openstack.org/577960 | 02:53 |
| *** bkopilov has joined #tripleo | 02:57 | |
| *** skramaja has joined #tripleo | 02:59 | |
| *** jaganathan has joined #tripleo | 03:00 | |
| *** rh-jelabarre has quit IRC | 03:06 | |
| *** lblanchard has joined #tripleo | 03:08 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 03:10 |
| *** yolanda__ has joined #tripleo | 03:15 | |
| *** yolanda_ has quit IRC | 03:18 | |
| *** pdeore has joined #tripleo | 03:23 | |
| *** yolanda__ has quit IRC | 03:23 | |
| *** khyr0n has joined #tripleo | 03:29 | |
| *** yolanda__ has joined #tripleo | 03:29 | |
| *** yolanda_ has joined #tripleo | 03:34 | |
| *** noama has joined #tripleo | 03:34 | |
| *** yolanda__ has quit IRC | 03:36 | |
| *** yamahata has joined #tripleo | 03:38 | |
| *** psahoo has joined #tripleo | 03:41 | |
| *** ramishra has joined #tripleo | 03:41 | |
| *** yolanda__ has joined #tripleo | 03:44 | |
| *** yolanda_ has quit IRC | 03:45 | |
| *** Petersingh is now known as Petersingh|afk | 03:47 | |
| *** agopi has quit IRC | 03:49 | |
| *** agopi has joined #tripleo | 03:49 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add support for NodeDataLookup for Ceph deployment https://review.openstack.org/577956 | 03:52 |
| *** lblanchard has quit IRC | 03:56 | |
| *** ratailor has joined #tripleo | 04:02 | |
| *** yolanda_ has joined #tripleo | 04:03 | |
| *** yolanda__ has quit IRC | 04:06 | |
| *** yolanda has joined #tripleo | 04:08 | |
| *** yolanda_ has quit IRC | 04:09 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 04:10 |
| *** yolanda_ has joined #tripleo | 04:10 | |
| *** agopi has quit IRC | 04:13 | |
| *** yolanda has quit IRC | 04:13 | |
| *** hamzy has quit IRC | 04:17 | |
| *** hamzy has joined #tripleo | 04:18 | |
| *** stendulker has joined #tripleo | 04:18 | |
| *** hamzy has quit IRC | 04:22 | |
| *** psahoo has quit IRC | 04:35 | |
| *** hamzy has joined #tripleo | 04:36 | |
| *** Petersingh|afk is now known as Petersingh | 04:37 | |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-heat-templates master: [WIP] Fixes Instance Name Template https://review.openstack.org/577869 | 04:41 |
| openstackgerrit | Pranali Deore proposed openstack/tripleo-heat-templates master: Moving glance mount nfs block to puppet glance-api template https://review.openstack.org/576043 | 04:42 |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-heat-templates master: [WIP] Fixes Instance Name Template https://review.openstack.org/577869 | 04:49 |
| *** psahoo has joined #tripleo | 04:50 | |
| *** skramaja_ has joined #tripleo | 04:50 | |
| *** skramaja has quit IRC | 04:51 | |
| *** janki has joined #tripleo | 04:54 | |
| *** owalsh_ has joined #tripleo | 05:06 | |
| *** ccamacho has quit IRC | 05:06 | |
| *** slaweq has joined #tripleo | 05:07 | |
| *** slaweq has quit IRC | 05:07 | |
| *** jaganathan_ has joined #tripleo | 05:09 | |
| *** jchhatbar has joined #tripleo | 05:09 | |
| *** owalsh has quit IRC | 05:09 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 05:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| *** numans has quit IRC | 05:11 | |
| *** jaganathan has quit IRC | 05:13 | |
| *** numans has joined #tripleo | 05:13 | |
| *** janki has quit IRC | 05:13 | |
| *** atarlov has joined #tripleo | 05:15 | |
| *** lifeless has joined #tripleo | 05:16 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Use ACL instead of docker group for mistral https://review.openstack.org/577946 | 05:16 |
| *** strigazi has quit IRC | 05:17 | |
| *** strigazi has joined #tripleo | 05:19 | |
| *** ykarel has joined #tripleo | 05:20 | |
| *** cshastri has joined #tripleo | 05:22 | |
| *** ratailor_ has joined #tripleo | 05:23 | |
| *** strigazi_ has joined #tripleo | 05:24 | |
| *** aufi has joined #tripleo | 05:26 | |
| *** ratailor has quit IRC | 05:27 | |
| *** strigazi has quit IRC | 05:27 | |
| *** yprokule has joined #tripleo | 05:29 | |
| *** waleedm has joined #tripleo | 05:30 | |
| *** cshastri has quit IRC | 05:31 | |
| *** skramaja has joined #tripleo | 05:34 | |
| *** aufi has quit IRC | 05:34 | |
| *** skramaja_ has quit IRC | 05:34 | |
| *** quiquell has joined #tripleo | 05:35 | |
| *** matbu has joined #tripleo | 05:35 | |
| *** psahoo has quit IRC | 05:36 | |
| *** owalsh_ has quit IRC | 05:40 | |
| *** owalsh has joined #tripleo | 05:40 | |
| *** stendulker_ has joined #tripleo | 05:42 | |
| *** udesale has joined #tripleo | 05:44 | |
| *** stendulker has quit IRC | 05:46 | |
| *** cshastri has joined #tripleo | 05:47 | |
| quiquell | Hello there to move undercloud idempotency to different job | 05:47 |
| quiquell | https://review.openstack.org/#/c/577809/ | 05:47 |
| quiquell | So we fix fs002 upload job | 05:48 |
| *** bogdando has joined #tripleo | 05:49 | |
| quiquell | bogdando: Good morning | 05:49 |
| quiquell | bogdando: Moving uc indempotency https://review.openstack.org/#/c/577809/ | 05:49 |
| quiquell | to another job | 05:49 |
| quiquell | it's missing a +2 and +1w | 05:49 |
| *** psahoo has joined #tripleo | 05:51 | |
| *** ksambor has joined #tripleo | 05:53 | |
| bogdando | quiquell: morning, ok | 05:53 |
| *** atarlov has quit IRC | 05:54 | |
| *** atarlov has joined #tripleo | 05:54 | |
| quiquell | bogdando: We will have fs020 job to check it, but at least the periodic upload is unblock | 05:55 |
| bogdando | jaosorior, mandre, jistr, mwhahaha: hi, PTAL https://review.openstack.org/#/c/576498/ | 05:55 |
| *** atarlov has quit IRC | 05:58 | |
| *** openstackgerrit has quit IRC | 06:04 | |
| *** jcoufal has joined #tripleo | 06:04 | |
| *** agurenko has joined #tripleo | 06:08 | |
| *** ccamacho has joined #tripleo | 06:09 | |
| *** paramite has joined #tripleo | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 06:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778637 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1778637 in tripleo "mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2: MismatchError: [u'aodh.alarm_create'," [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 06:10 |
| *** saneax has joined #tripleo | 06:12 | |
| *** slaweq has joined #tripleo | 06:13 | |
| *** karthiks has joined #tripleo | 06:15 | |
| quiquell | EmilienM: Are you there ? | 06:16 |
| *** yolanda__ has joined #tripleo | 06:21 | |
| *** nyechiel has joined #tripleo | 06:22 | |
| *** dparkes has joined #tripleo | 06:23 | |
| *** yolanda_ has quit IRC | 06:24 | |
| *** cshastri has quit IRC | 06:25 | |
| *** lvdombrkr has joined #tripleo | 06:26 | |
| *** pgadiya has joined #tripleo | 06:30 | |
| *** openstackgerrit has joined #tripleo | 06:31 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-docs master: Added missing information regarding containerized undercloud and ironic https://review.openstack.org/573196 | 06:31 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: use the tq ansible.cfg for the undercloud install https://review.openstack.org/575535 | 06:37 |
| *** cshastri has joined #tripleo | 06:38 | |
| *** psachin` has quit IRC | 06:45 | |
| *** psachin` has joined #tripleo | 06:48 | |
| Tengu | small question: is there any way to deactivate a service through tripleo? For example, if we activated ceilometer, is there some way to deactivate it without redeploying from zero? | 06:51 |
| Tengu | damn. of course ceilometer is probably the only example we actually can deactivate post-deploy -.- https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/disable_telemetry.html | 06:54 |
| *** Petersingh is now known as Petersingh|afk | 06:54 | |
| *** stendulker has joined #tripleo | 06:57 | |
| *** gkadam has joined #tripleo | 06:58 | |
| *** Haresh has joined #tripleo | 06:59 | |
| *** noam has joined #tripleo | 07:01 | |
| *** stendulker_ has quit IRC | 07:02 | |
| *** noama has quit IRC | 07:04 | |
| *** slaweq has quit IRC | 07:06 | |
| *** rcernin has quit IRC | 07:08 | |
| Tengu | dtantsur|afk: heya! care to have a look again on my doc update? https://review.openstack.org/#/c/573196/ - it should be OK now :). | 07:09 |
| *** shardy has joined #tripleo | 07:10 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778637 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 07:10 |
| openstack | Launchpad bug 1778637 in tripleo "mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2: MismatchError: [u'aodh.alarm_create'," [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:10 |
| *** slaweq has joined #tripleo | 07:10 | |
| *** Petersingh|afk is now known as Petersingh | 07:10 | |
| *** tesseract has joined #tripleo | 07:14 | |
| *** slaweq has quit IRC | 07:15 | |
| *** quiquell is now known as quique|rover|afk | 07:16 | |
| *** zoli is now known as zoli|wfh | 07:16 | |
| *** zoli|wfh is now known as zoli | 07:16 | |
| *** pcaruana has joined #tripleo | 07:20 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: filter available role by tags https://review.openstack.org/576814 | 07:20 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Add workflow to get available plans https://review.openstack.org/577127 | 07:20 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Add workflow to select sample plan https://review.openstack.org/577840 | 07:20 |
| bogdando | shardy: hi. may I have a +2 https://review.openstack.org/#/c/576498/ ? :) | 07:22 |
| *** pgadiya has joined #tripleo | 07:22 | |
| bogdando | rebased and all green | 07:22 |
| bogdando | jaosorior: ^^ perchance? | 07:22 |
| *** kopecmartin has joined #tripleo | 07:23 | |
| shardy | bogdando: ack added to my list | 07:24 |
| *** florianf has joined #tripleo | 07:24 | |
| bogdando | thanks! | 07:24 |
| *** florianf has quit IRC | 07:25 | |
| *** florianf has joined #tripleo | 07:26 | |
| *** amoralej|off is now known as amoralej | 07:28 | |
| *** yamahata has quit IRC | 07:30 | |
| *** aufi has joined #tripleo | 07:36 | |
| *** aufi has quit IRC | 07:36 | |
| *** nyechiel_ has joined #tripleo | 07:36 | |
| mandre | bogdando: nice change | 07:36 |
| *** aufi has joined #tripleo | 07:36 | |
| *** nyechiel has quit IRC | 07:36 | |
| bogdando | thanks mandre | 07:37 |
| *** aufi_ has joined #tripleo | 07:39 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/578012 | 07:39 |
| *** tosky has joined #tripleo | 07:41 | |
| *** hjensas has quit IRC | 07:41 | |
| *** quique|rover|afk is now known as quiquell|rover | 07:42 | |
| *** aufi has quit IRC | 07:42 | |
| *** ffiore has joined #tripleo | 07:42 | |
| *** pdeore has quit IRC | 07:43 | |
| *** jpena|off is now known as jpena | 07:44 | |
| *** pdeore has joined #tripleo | 07:44 | |
| *** noam__ has joined #tripleo | 07:45 | |
| *** noam has quit IRC | 07:46 | |
| *** pdeore has quit IRC | 07:46 | |
| *** lvdombrkr has quit IRC | 07:47 | |
| *** Petersingh is now known as Petersingh|lunch | 07:48 | |
| *** lvdombrkr has joined #tripleo | 07:48 | |
| *** avivgt has joined #tripleo | 07:49 | |
| *** pdeore has joined #tripleo | 07:51 | |
| *** pdeore has joined #tripleo | 07:51 | |
| *** pmannidi has quit IRC | 07:51 | |
| *** lvdombrkr89 has joined #tripleo | 07:56 | |
| *** stendulker has quit IRC | 07:57 | |
| *** stendulker has joined #tripleo | 07:57 | |
| *** lvdombrkr has quit IRC | 07:58 | |
| *** holser_ has joined #tripleo | 08:01 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/puppet-tripleo master: Allow custom --bip CIDR for docker options https://review.openstack.org/578018 | 08:03 |
| Tengu | jaosorior: heya! care to give another look to https://review.openstack.org/#/c/572761/ ? :) | 08:04 |
| jaosorior | Tengu: sure! | 08:04 |
| Tengu | thank you :) | 08:04 |
| *** jpich has joined #tripleo | 08:05 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Verify the Swift container exists with a small utility workflow https://review.openstack.org/528213 | 08:05 |
| Tengu | do you have any review on your own? | 08:05 |
| *** slaweq has joined #tripleo | 08:05 | |
| jaosorior | nothing fully working yet :D | 08:07 |
| Tengu | ok :) | 08:08 |
| *** gfidente has joined #tripleo | 08:08 | |
| *** gfidente has quit IRC | 08:08 | |
| *** gfidente has joined #tripleo | 08:08 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778637 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 08:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 08:10 |
| openstack | Launchpad bug 1778637 in tripleo "mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2: MismatchError: [u'aodh.alarm_create'," [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
| *** noam__ has quit IRC | 08:13 | |
| *** akrivoka has joined #tripleo | 08:14 | |
| *** slaweq has quit IRC | 08:15 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/ansible-role-container-registry master: Allow custom --bip CIDR for docker options https://review.openstack.org/578022 | 08:16 |
| *** hjensas has joined #tripleo | 08:20 | |
| *** saneax has quit IRC | 08:20 | |
| *** pblaho has joined #tripleo | 08:21 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Add memory and swap info into collect-logs collect task https://review.openstack.org/578023 | 08:25 |
| *** ffiore has quit IRC | 08:26 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Verify the Swift container exists with a small utility workflow https://review.openstack.org/528213 | 08:27 |
| *** saneax has joined #tripleo | 08:29 | |
| *** psahoo has quit IRC | 08:33 | |
| *** ffiore has joined #tripleo | 08:34 | |
| *** verdurin has quit IRC | 08:37 | |
| *** shardy has quit IRC | 08:38 | |
| *** psachin` is now known as psachin | 08:39 | |
| *** jaosorior has quit IRC | 08:39 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common master: Add new undeploy_plan workflow https://review.openstack.org/566246 | 08:39 |
| *** verdurin has joined #tripleo | 08:41 | |
| *** jcoufal has quit IRC | 08:43 | |
| *** shardy has joined #tripleo | 08:43 | |
| *** gkadam_ has joined #tripleo | 08:44 | |
| *** gkadam has quit IRC | 08:45 | |
| *** gkadam_ has quit IRC | 08:45 | |
| *** gkadam_ has joined #tripleo | 08:45 | |
| *** gkadam__ has joined #tripleo | 08:48 | |
| *** psahoo has joined #tripleo | 08:48 | |
| *** derekh has joined #tripleo | 08:49 | |
| *** Petersingh|lunch is now known as Petersingh | 08:50 | |
| *** gkadam_ has quit IRC | 08:51 | |
| shardy | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/workflows/plan_management.py#L81 | 08:54 |
| shardy | jtomasek: Hey is tripleo.plan_management.v1.create_deployment_plan the same workflow used by the UI to create the deployment plan? | 08:55 |
| shardy | I'm trying to figure out if create_default_deployment plan is used anywhere, as it's marked deprecated since pike | 08:55 |
| shardy | https://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L41 | 08:56 |
| jtomasek | shardy: yes, I'll check to be exactly sure | 08:56 |
| shardy | d0ugal: ^^ | 08:56 |
| shardy | IIRC we created a default deployment plan in the undercloud install, so I'll need to check how that is done | 08:56 |
| shardy | context is I need to ensure we create a default plan-environment ref comments in https://review.openstack.org/#/c/574753/ | 08:56 |
| jtomasek | shardy: create_default_deployment_plan replaced by create_deployment_plan but yeah, please check if it is not used in udnercloud install any more | 08:56 |
| shardy | so I need to know which workflows should trigger that | 08:56 |
| shardy | jtomasek: ack, I'll do some grepping and push a patch removing it provided it's unused | 08:57 |
| jtomasek | shardy: GUI uses tripleo.plan_management.v1.create_deployment_plan | 08:57 |
| *** brault has quit IRC | 08:57 | |
| jtomasek | so it is ok | 08:57 |
| shardy | Ok instack undercloud seems to do the same although some tests still reference the old workflow | 08:58 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Remove the OVS-DPDK deprecated parameters https://review.openstack.org/566239 | 08:58 |
| shardy | q | 08:58 |
| shardy | oops | 08:58 |
| jtomasek | shardy: I am going to try to work on UI part to integrate your new workflows. I just need to finish undeploy workflow to finalize config-download work | 08:59 |
| jpich | I think it stopped being used in undercloud install with https://bugs.launchpad.net/tripleo/+bug/1718429 , plan was to remove it... eventually... :-) Hopefully nothing new started calling to it since then | 08:59 |
| openstack | Launchpad bug 1718429 in tripleo "instack-undercloud uses deprecated create_default_deployment_plan workflow" [High,Fix released] - Assigned to Ana Krivokapić (akrivoka) | 08:59 |
| shardy | jtomasek: great! I think what I've pushed so far should work, but I'm going to add creating the default plan from plan-samples/openstack today | 09:00 |
| *** dparkes has quit IRC | 09:00 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: DO NOT MERGE: Test boot params in the config-download https://review.openstack.org/566241 | 09:00 |
| shardy | after that I think we should be in good shape on the workflows side, but any feedback is very welcome :) | 09:00 |
| jtomasek | shardy: ok | 09:00 |
| shardy | jpich: ack thanks for confirming, I'll push a patch removing it and see what CI says ;) | 09:00 |
| jpich | Sounds good! :) | 09:01 |
| *** jchhatbar is now known as janki | 09:01 | |
| janki | jistr, hey | 09:01 |
| *** salmankhan has joined #tripleo | 09:01 | |
| jistr | janki: hi | 09:02 |
| janki | jistr, new bug - https://bugs.launchpad.net/tripleo/+bug/1778668 | 09:02 |
| openstack | Launchpad bug 1778668 in tripleo "using tripleo_role_name in queens breaks update" [Critical,Confirmed] - Assigned to Janki Chhatbar (jankihchhatbar) | 09:02 |
| jistr | janki: ouch, i didn't correct the variable name when backporting. I'll post a fix right away. We just need to use role_name instead as the rest of the Queens templates | 09:03 |
| janki | jistr, how to push a patch only for queens and not master? | 09:03 |
| quiquell|rover | janki: Depends on the project you are changing | 09:04 |
| janki | quiquell|rover, how about THT? | 09:05 |
| jistr | janki: it's possible by checking out the stable/queens branch and working from there. The .gitreview file is set up so that it automatically posts reviews against stable/queens | 09:05 |
| jistr | https://github.com/openstack/tripleo-heat-templates/blob/stable/queens/.gitreview#L5 | 09:05 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Remove create_default_deployment_plan workflow https://review.openstack.org/578041 | 09:05 |
| jistr | janki: i see you assigned the bug to yourself, do you want to post the fix? | 09:05 |
| janki | jistr, I don't mind if you want to push. Its a very minor change. just changing a name | 09:06 |
| jistr | janki: yea. i also don't mind either way :D | 09:08 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow custom --bip CIDR for docker options https://review.openstack.org/578042 | 09:08 |
| janki | jistr, I have an ODL log related patch that needs to be pushed to only queens. I will combine them. sounds good? | 09:08 |
| shardy | janki: please use separate patches if possible | 09:09 |
| jistr | janki: i'd rather not combine into a single commit, but they can be done both in a single chain | 09:09 |
| *** shardy has quit IRC | 09:10 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778637 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 09:10 |
| janki | shardy, jistr ohk will do separately. both are very small changes but then ohk... | 09:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 09:10 |
| openstack | Launchpad bug 1778637 in tripleo "mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2: MismatchError: [u'aodh.alarm_create'," [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
| jistr | janki: ack thanks, feel free to add me as a reviewer | 09:10 |
| janki | jistr, ack. | 09:11 |
| *** brault has joined #tripleo | 09:13 | |
| *** shardy has joined #tripleo | 09:13 | |
| *** slaweq has joined #tripleo | 09:15 | |
| openstackgerrit | Vishal Thapar proposed openstack/tripleo-heat-templates master: Enable QoS for ODL Driver https://review.openstack.org/572245 | 09:16 |
| *** lifeless has quit IRC | 09:16 | |
| *** dtantsur|afk is now known as dtantsur | 09:18 | |
| *** cylopez has joined #tripleo | 09:19 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates stable/queens: Use role_name instead of tripleo_role_name https://review.openstack.org/578044 | 09:19 |
| janki | jistr, ^. added you as reviewer | 09:20 |
| *** ykarel_ has joined #tripleo | 09:20 | |
| *** psahoo has quit IRC | 09:21 | |
| jistr | janki: +2 thanks! i'll link the patch from downstream BZ too | 09:21 |
| janki | jistr, ack. add me to cc plz. and we need to make sure that these changes go into z stream | 09:22 |
| *** stendulker_ has joined #tripleo | 09:22 | |
| *** ykarel_ is now known as ykarel|away | 09:22 | |
| *** ykarel has quit IRC | 09:23 | |
| *** slaweq has quit IRC | 09:23 | |
| *** ratailor__ has joined #tripleo | 09:24 | |
| jistr | janki: done. Re z stream, yup that's why i added it, it's on the same BZ with the patch that caused the breakage :) | 09:24 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: QDR for metrics collection purposes https://review.openstack.org/572312 | 09:25 |
| *** ykarel|away has quit IRC | 09:25 | |
| *** stendulker has quit IRC | 09:26 | |
| *** ratailor_ has quit IRC | 09:26 | |
| *** nyechiel has joined #tripleo | 09:27 | |
| *** nyechiel_ has quit IRC | 09:27 | |
| janki | jistr, thanks. in case you are in review mood - https://review.openstack.org/#/c/577831/, https://review.openstack.org/#/c/577834/ | 09:28 |
| jistr | janki: ah yea that's what we talked about yesterday, nice, +2'd both | 09:30 |
| janki | jistr, thanks :) | 09:30 |
| *** psahoo has joined #tripleo | 09:33 | |
| jtomasek | d0ugal: what do you thing about this change https://review.openstack.org/#/c/566246/7 (see my last comment)? | 09:38 |
| quiquell|rover | Where can I see timestamps for differnt task run at openstack tripleo container image prepare ? | 09:42 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: ceilometer: deprecation cleanup https://review.openstack.org/577797 | 09:45 |
| openstackgerrit | Yong Huang proposed openstack/tripleo-heat-templates master: storage_vnx_pool_name is incorrect for VNX cinder driver. https://review.openstack.org/573488 | 09:45 |
| *** strigazi_ is now known as strigazi | 09:47 | |
| shardy | quiquell|rover: arent all the log lines prefixed with a timestamp? | 09:49 |
| shardy | e.g http://logs.openstack.org/41/574741/1/check/tripleo-ci-centos-7-containers-multinode/549c6fa/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 09:49 |
| *** yolanda_ has joined #tripleo | 09:50 | |
| quiquell|rover | shardy: Yest but it just a one liner, I did want to see what happend inside docker | 09:50 |
| quiquell|rover | shardy: Found the docker log: http://logs.openstack.org/32/576632/2/gate/tripleo-ci-centos-7-scenario007-multinode-oooq-container/2e96f4d/logs/undercloud/home/zuul/docker_journalctl.log.txt.gz | 09:50 |
| shardy | quiquell|rover: ah I see | 09:51 |
| openstackgerrit | Merged openstack/tripleo-docs master: Document how to use a composable network with Ironic in Overcloud https://review.openstack.org/570437 | 09:52 |
| *** yolanda__ has quit IRC | 09:53 | |
| *** dparkes has joined #tripleo | 09:54 | |
| janki | jistr, shardy skramaja workflow plz https://review.openstack.org/#/c/577834/ | 09:54 |
| shardy | janki: we need to wait for the depends-on to merge | 09:54 |
| shardy | well that's why I didn't approve it, I can if you like but it won't merge yet | 09:55 |
| janki | shardy, ahh. ohk. and I also need to cherry-pick them. so should I cherry pick after both of them are merged or when each of them are merged? | 09:56 |
| shardy | janki: wait until both have merged before cherry picking because Depends-On is not branch aware | 09:56 |
| *** dxiri has joined #tripleo | 09:56 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Disable ssl certificate validation in tempest https://review.openstack.org/578052 | 09:56 |
| janki | shardy, I would prefer +1 for worklfow and let it merge whenever it wants. it would be autmotic right - when depends-on merges, if it has proper votes, it will merge | 09:57 |
| janki | shardy, ack. | 09:57 |
| sri_ | shardy: I've stopped overcloud create with Ctrl+c , after that when i am trying to create a overcloud i am getting this error "Object GET failed: https://10.1.6.11:13808/v1/AUTH_79e1665e2ee848bdaa2042d85993d38d/overcloud/plan-environment.yaml 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1> any idea ? | 09:57 |
| shardy | sri_: is the previous deploy still in progress? | 10:00 |
| shardy | ctrl-c doesn't stop it | 10:00 |
| sri_ | shardy: no | 10:00 |
| shardy | sri_: I'd try doing openstack overcloud plan delete <plan name> | 10:01 |
| shardy | sounds like perhaps there was an error during plan creation or something | 10:01 |
| *** dxiri has quit IRC | 10:01 | |
| sri_ | shardy: it seems "openstack overcloud plan delete overcloud" fixed that error | 10:02 |
| sri_ | shardy: thanks | 10:02 |
| shardy | sri_: np | 10:02 |
| shardy | Anyone know where the rdocloud job logs are stored? | 10:05 |
| shardy | e.g https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/16975/ | 10:05 |
| shardy | the link from each job just links back to the status page... | 10:06 |
| shardy | d0ugal: ^^ both ovb jobs failed during the undercloud install, so perhaps the failure was loading the workbooks - did the rebased patch work locally? | 10:06 |
| * shardy not tried it yet | 10:06 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 10:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778637 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 10:10 |
| openstack | Launchpad bug 1778637 in tripleo "mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2: MismatchError: [u'aodh.alarm_create'," [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-docs master: Document containers system config options https://review.openstack.org/578056 | 10:11 |
| shardy | Ok yeah it's broken | 10:11 |
| ccamacho | quiquell|rover around? | 10:11 |
| ccamacho | man can you check https://review.openstack.org/#/c/568273 ? | 10:11 |
| ccamacho | on stable/pike jobs for RDO Third Party CI are broken | 10:12 |
| *** nyechiel_ has joined #tripleo | 10:12 | |
| *** nyechiel has quit IRC | 10:12 | |
| ccamacho | weshay|ruck ^ | 10:12 |
| *** zoli is now known as zoli|lunch | 10:14 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-docs master: Document containers system config options https://review.openstack.org/578056 | 10:17 |
| *** nyechiel has joined #tripleo | 10:17 | |
| *** jchhatbar has joined #tripleo | 10:17 | |
| *** nyechiel_ has quit IRC | 10:17 | |
| *** dciabrin_ has quit IRC | 10:17 | |
| *** gvrangan has joined #tripleo | 10:18 | |
| *** jaganathan_ has quit IRC | 10:19 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-docs master: Document containers system config options https://review.openstack.org/578056 | 10:19 |
| *** janki has quit IRC | 10:19 | |
| *** jaganathan_ has joined #tripleo | 10:19 | |
| *** Petersingh is now known as Petersingh|afk | 10:19 | |
| *** numans has quit IRC | 10:20 | |
| *** Petersingh|afk has quit IRC | 10:20 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-docs master: Document containers system config options https://review.openstack.org/578056 | 10:21 |
| *** dciabrin has joined #tripleo | 10:21 | |
| *** numans has joined #tripleo | 10:25 | |
| *** jcoufal has joined #tripleo | 10:27 | |
| *** jaosorior has joined #tripleo | 10:29 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:30 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add support for NodeDataLookup for Ceph deployment https://review.openstack.org/577956 | 10:31 |
| *** maufart__ has joined #tripleo | 10:34 | |
| *** ffiore has quit IRC | 10:34 | |
| *** stendulker has joined #tripleo | 10:34 | |
| *** ffiore has joined #tripleo | 10:35 | |
| *** gvrangan has quit IRC | 10:35 | |
| *** aufi_ has quit IRC | 10:36 | |
| *** stendulker_ has quit IRC | 10:38 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add support for NodeDataLookup for Ceph deployment https://review.openstack.org/577956 | 10:39 |
| *** nyechiel has quit IRC | 10:40 | |
| d0ugal | shardy: strange, I thought I fixed it in my most recent update. I'll check it over again. | 10:41 |
| d0ugal | shardy: thanks for looking into it | 10:41 |
| *** morazi has quit IRC | 10:42 | |
| d0ugal | therve: did you see the comment here? https://review.openstack.org/#/c/572807/4/workbooks/stack.yaml | 10:45 |
| therve | d0ugal: Yes will answer | 10:45 |
| d0ugal | therve: thanks! | 10:47 |
| *** slaweq has joined #tripleo | 10:48 | |
| quiquell|rover | Are we using /etc/ansible.cfg when running http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/v1/tripleo_deploy.py#n643 ? | 10:49 |
| *** gvrangan has joined #tripleo | 10:57 | |
| *** mdnadeem has quit IRC | 10:59 | |
| *** invsblduck has quit IRC | 11:00 | |
| ccamacho | is there anyone around from the CI squad? | 11:01 |
| ccamacho | I have this https://review.openstack.org/#/c/568273 failing on the RDO third party jobs, kind of critical for the upgrade CLI | 11:01 |
| *** lblanchard has joined #tripleo | 11:01 | |
| *** jpena is now known as jpena|lunch | 11:03 | |
| ccamacho | the issue it's unrelated to the review https://paste.fedoraproject.org/paste/OHLK~lAIcejkbBGdhtsJNg | 11:06 |
| quiquell|rover | ccamacho: Hello | 11:09 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Verify the Swift container exists with a small utility workflow https://review.openstack.org/528213 | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 11:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778637 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 11:10 |
| quiquell|rover | ccamacho: the OVB jobs have issues with git | 11:10 |
| openstack | Launchpad bug 1778637 in tripleo "mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2: MismatchError: [u'aodh.alarm_create'," [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
| quiquell|rover | ccamacho: asking at RDO about the git issue | 11:11 |
| *** lblanchard has quit IRC | 11:13 | |
| *** stendulker has quit IRC | 11:15 | |
| *** ffiore has quit IRC | 11:18 | |
| *** pchavva has joined #tripleo | 11:22 | |
| *** slaweq has quit IRC | 11:23 | |
| *** bfournie has quit IRC | 11:26 | |
| *** bfournie has joined #tripleo | 11:26 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: use the tq ansible.cfg for the undercloud install https://review.openstack.org/577960 | 11:27 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs master: Developer docs for updates https://review.openstack.org/578069 | 11:29 |
| *** bfournie has quit IRC | 11:30 | |
| *** udesale has quit IRC | 11:33 | |
| *** atoth has joined #tripleo | 11:38 | |
| *** zoli|lunch is now known as zoli|wfh | 11:38 | |
| *** zoli|wfh is now known as zoli | 11:38 | |
| *** rh-jelabarre has joined #tripleo | 11:38 | |
| *** anande has joined #tripleo | 11:45 | |
| *** derekh has quit IRC | 11:47 | |
| *** ansmith has quit IRC | 11:48 | |
| anande | hi guys, any idea where I can check the blacklisted indexes of failed scaleout nodes in heat db ? | 11:49 |
| anande | osp-newton | 11:49 |
| *** derekh has joined #tripleo | 11:49 | |
| *** nyechiel has joined #tripleo | 11:49 | |
| anande | I see 'nova list' omits some indexes as compared to 'ironic node-list' upon a failed scale-out | 11:50 |
| *** morazi has joined #tripleo | 11:55 | |
| *** aufi_ has joined #tripleo | 11:58 | |
| *** amoralej is now known as amoralej|lunch | 11:59 | |
| *** bfournie has joined #tripleo | 11:59 | |
| *** asbishop has joined #tripleo | 11:59 | |
| *** maufart__ has quit IRC | 12:00 | |
| *** liverpooler has joined #tripleo | 12:04 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Adds check for python-virtualenv with error message https://review.openstack.org/578081 | 12:06 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778637 | 12:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 12:10 |
| openstack | Launchpad bug 1778637 in tripleo "mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2: MismatchError: [u'aodh.alarm_create'," [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:10 |
| *** ffiore has joined #tripleo | 12:11 | |
| weshay|ruck | ccamacho, so we test w/ no-ops every few hours.. pike ovb looks ok to me atm https://review.openstack.org/#/c/564285 | 12:11 |
| *** cylopez has left #tripleo | 12:12 | |
| *** raildo has joined #tripleo | 12:12 | |
| weshay|ruck | quiquell|rover, which job did you find 1778040 | 12:12 |
| *** shardy_ has joined #tripleo | 12:12 | |
| quiquell|rover | weshay|ruck: Hello | 12:12 |
| weshay|ruck | hey.. /me grabs coffee let's chat in 3min | 12:13 |
| shardy_ | jistr: Hey can you remember why we needed hostvars.raw_get for the openshift integration? | 12:13 |
| shardy_ | jistr: I know there was a reason, but I can't remember what it was ;) | 12:13 |
| quiquell|rover | weshay|ruck: https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/49b2fe5/undercloud/home/jenkins/overcloud_image_build.log.txt.gz#_2018-06-25_04_38_04 | 12:13 |
| quiquell|rover | It's in the bug | 12:13 |
| *** jpena|lunch is now known as jpena | 12:14 | |
| *** shardy has quit IRC | 12:15 | |
| *** shardy_ is now known as shardy | 12:15 | |
| ccamacho | weshay|ruck I tried to find clues for fixing it but.. now idea | 12:15 |
| ccamacho | **no idea | 12:16 |
| *** Haresh has quit IRC | 12:16 | |
| weshay|ruck | ccamacho, ok.. will take a closer look. | 12:18 |
| ccamacho | thanks! | 12:18 |
| weshay|ruck | ccamacho, just to make it fun.. paul is migrating that env from zuulv2 -> v3 atm.. not sure what the state of that is | 12:20 |
| *** dprince has joined #tripleo | 12:20 | |
| *** fultonj has joined #tripleo | 12:21 | |
| *** dprince has quit IRC | 12:21 | |
| quiquell|rover | weshay|ruck, ccamacho: RDO guys just told me that git clone fails somet imes at RDO, but zuul v3 will mitigate that | 12:21 |
| *** ratailor__ has quit IRC | 12:21 | |
| *** dprince has joined #tripleo | 12:22 | |
| jistr | shardy: IMO it was some bug, it broke when i tried normal hostvars['...']. It may be related to some jinja processing perhaps, i think raw_get skips any of that. But i don't know the root cause there and i think i didn't know it at the time either :) | 12:22 |
| shardy | jistr: ah Ok no worries, flaper87 was asking about it | 12:23 |
| *** trown|outtypewww is now known as trown | 12:24 | |
| *** slaweq has joined #tripleo | 12:25 | |
| weshay|ruck | quiquell|rover, k.. join my blue | 12:25 |
| flaper87 | jistr: shardy roger, thanks! Asking 'cause I'm refactoring that part of the code in the openshift templates and was wondering whether I could change that or not | 12:25 |
| jistr | flaper87: you can try :P i mean it *should* be working AFAICT, but it wasn't at the time | 12:26 |
| quiquell|rover | weshay|ruck: ack | 12:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Update capabilities-map https://review.openstack.org/562135 | 12:26 |
| *** slaweq has quit IRC | 12:29 | |
| *** Haresh has joined #tripleo | 12:29 | |
| *** rlandy has joined #tripleo | 12:30 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Track fake stack updates for standalone/UC deploy https://review.openstack.org/578088 | 12:31 |
| bogdando | shardy, mwhahaha, dprince: PTAL ^^ | 12:32 |
| bogdando | slagle: hi, ^^ please | 12:33 |
| *** ohochman has joined #tripleo | 12:35 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix non-HA rabbitmq user password updates https://review.openstack.org/577785 | 12:35 |
| openstackgerrit | Merged openstack/tripleo-docs master: Docs adjustment for adding --xattrs to the UC backup/restore https://review.openstack.org/577407 | 12:37 |
| *** skramaja has quit IRC | 12:40 | |
| *** jcoufal has quit IRC | 12:42 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Improve nova statedir ownership logic https://review.openstack.org/577855 | 12:47 |
| weshay|ruck | rfolco_, please retest https://review.openstack.org/#/c/576990/ | 12:51 |
| rfolco_ | weshay|ruck, context please | 12:52 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Improve nova statedir ownership logic https://review.openstack.org/577855 | 12:53 |
| *** cdearborn has joined #tripleo | 12:54 | |
| *** dmacpher has quit IRC | 12:55 | |
| weshay|ruck | rfolco_, sorry.. that was for quiquell|rover | 12:55 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add note about standalone being only in master https://review.openstack.org/576887 | 12:56 |
| *** edmondsw has joined #tripleo | 12:58 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common master: Add new undeploy_plan workflow https://review.openstack.org/566246 | 12:59 |
| *** fultonj has quit IRC | 13:00 | |
| Tengu | see you tomorrow :). | 13:02 |
| *** marrusl has joined #tripleo | 13:02 | |
| weshay|ruck | mwhahaha, are you slammed.. I've tested https://review.openstack.org/#/c/576875/ twice now w/ results you will not be happy about | 13:03 |
| mwhahaha | weshay|ruck: wat | 13:04 |
| weshay|ruck | mwhahaha, it's in the gate atm waiting.. so we still have time to kill it | 13:04 |
| mwhahaha | weshay|ruck: it's merged? | 13:04 |
| * weshay|ruck gets the updates from the bug.. no | 13:04 | |
| mwhahaha | weshay|ruck: i think you pasted the wrong patch | 13:04 |
| weshay|ruck | no it's not merged.. getting a "unknown workflow error", ironic missing permissions on pxe driver.. | 13:05 |
| mwhahaha | weshay|ruck: did you mean https://review.openstack.org/#/c/576990/ | 13:05 |
| weshay|ruck | ah ya | 13:05 |
| weshay|ruck | https://review.openstack.org/#/c/576990/ | 13:05 |
| weshay|ruck | the errors may be unrelated | 13:05 |
| weshay|ruck | I have a live recreate though | 13:05 |
| mwhahaha | got logs? | 13:06 |
| weshay|ruck | mwhahaha, last two comments in https://bugs.launchpad.net/tripleo/+bug/1777939 | 13:06 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 13:06 |
| mwhahaha | that's unrelated | 13:07 |
| mwhahaha | weshay|ruck: so did we recently switch whatever this job is to use the containerized undercloud? | 13:07 |
| mwhahaha | weshay|ruck: because this wasn't a problem previously | 13:07 |
| *** tcw has quit IRC | 13:07 | |
| *** tcw1 has joined #tripleo | 13:07 | |
| weshay|ruck | ya I think so | 13:07 |
| mwhahaha | i'd rather see us revert that change so we can fix these issues | 13:07 |
| *** quiquell|rover is now known as quique|rover|lch | 13:08 | |
| *** fultonj has joined #tripleo | 13:08 | |
| mwhahaha | bogdando: -^ have you seen that ipxe failure from the bug? didn't we have that in fs35 | 13:08 |
| bogdando | mwhahaha: nope | 13:09 |
| bogdando | 'Unhandled workflow error' looks new to me | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 13:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:10 |
| *** ansmith has joined #tripleo | 13:10 | |
| bogdando | mwhahaha: the patch is yet to be merged | 13:10 |
| bogdando | nothing to revert prolly | 13:10 |
| dtantsur | warning: the change removing the pxe_ipmitool and agent_ipmitool drivers has been proposed, tripleo seems to be ready, but just in case.. | 13:10 |
| mwhahaha | bogdando: the idemptoency problem is fine | 13:10 |
| mwhahaha | weshay|ruck: so let's find the change that switched fs02 to containerized and rever that plz | 13:11 |
| weshay|ruck | k | 13:11 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: [DNM] Add local network-environment file for fs001 https://review.openstack.org/577230 | 13:11 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Removing options in configure-tempest https://review.openstack.org/570159 | 13:11 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Always deploy NTP https://review.openstack.org/577252 | 13:11 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Fall back to puppet-ntp defaults https://review.openstack.org/577254 | 13:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Enable heat-ui plugin for horizon by default https://review.openstack.org/564419 | 13:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable Ansible error handling per role https://review.openstack.org/576685 | 13:11 |
| bogdando | mwhahaha: fs02 or 35? | 13:12 |
| mwhahaha | bogdando: fs02 thats this job | 13:12 |
| mwhahaha | this only shows up in promotion (which is a problem in itself) | 13:12 |
| bogdando | mwhahaha: hm, we reverted fs02 https://review.openstack.org/#/c/575330/ that's to re-rerevert (not merged) | 13:13 |
| weshay|ruck | mwhahaha, hrm.. that's not it.. it changed 6 months ago https://github.com/openstack/tripleo-quickstart/commit/be95de74e1ae690369515d80d26fd82015c88cfc | 13:13 |
| mwhahaha | weshay|ruck: so is this fs002? why is it containerized | 13:13 |
| weshay|ruck | and I haven't landed https://review.openstack.org/#/c/576987/ | 13:13 |
| weshay|ruck | mwhahaha, it doesn't have to be | 13:13 |
| *** mcornea has joined #tripleo | 13:13 | |
| bogdando | https://review.openstack.org/#/c/576987/ yeah, so nothing to containerize UC in fs002 | 13:13 |
| weshay|ruck | I can try w/ that off | 13:13 |
| *** mjturek has joined #tripleo | 13:14 | |
| mwhahaha | weshay|ruck: ok wait let's try and figure out wtf the situation is. too many things | 13:14 |
| mwhahaha | weshay|ruck: so we've fixed the idempotency thing, but this is the new packages right? | 13:14 |
| weshay|ruck | aye | 13:14 |
| bogdando | ninja switch had happened to fs02 :D | 13:14 |
| mwhahaha | so it's likely an ironic change is broken introspection then? | 13:14 |
| weshay|ruck | so we have two errors during prep-images | 13:15 |
| mwhahaha | weshay|ruck: so i see auth erros to zaqar | 13:15 |
| weshay|ruck | 1. the idempotency issue w/ the amqp user/passwd | 13:15 |
| mwhahaha | 2018-06-26 13:15:13.378 7 ERROR mistral.executors.default_executor ActionException: ZaqarAction.queue_post failed: Error response from Zaqar. Code: 401. Text: {"error": {"message": "The request you have made requires authentication.", "code": 401, "title": "Unauthorized"}}. | 13:15 |
| weshay|ruck | 2. now the "unhandled workflow error" and permission denied on the ironic driver | 13:15 |
| mwhahaha | so i think the workflow error is the zaqar auth problem | 13:16 |
| mwhahaha | permission denined might not be a thing but let's work on the workflow error first | 13:16 |
| mwhahaha | therve: anything change in mistral/zaqar auth recently? | 13:16 |
| *** anande has quit IRC | 13:16 | |
| d0ugal | not on the Mistral side afaik | 13:17 |
| weshay|ruck | quique|rover|lch, ok.. don't worry about the fs002 recreate.. I think we have enough info ^ | 13:17 |
| weshay|ruck | quique|rover|lch, focus on the ara work for now | 13:17 |
| dprince | mwhahaha: could it be that Ironic/Keystone integration is broken? | 13:18 |
| therve | mwhahaha: Looking | 13:18 |
| dprince | or misconfiguring | 13:18 |
| mwhahaha | dprince: no in this case it's mistral/zaqar | 13:18 |
| shardy | d0ugal: hey can you check you're happy with https://review.openstack.org/#/c/576814 when you get time, I've tested it with/without tags and I think it's ready | 13:18 |
| shardy | be good to avoid another rebase if possible as CI is greeen :) | 13:18 |
| weshay|ruck | quique|rover|lch, your first patch should just assume the multinode/ovb workflow.. don't worry about getting it in tripleo for now | 13:18 |
| weshay|ruck | not yet | 13:18 |
| mwhahaha | in zaqar 2018-06-26 13:03:39.408 18 WARNING keystonemiddleware.auth_token [req-008e7070-558a-4fdc-ab43-1ed04eef45ef - - - - -] Authorization failed for token: InvalidToken | 13:18 |
| d0ugal | shardy: will do. | 13:19 |
| mwhahaha | so it was working then just stops | 13:19 |
| therve | mwhahaha: Do you have a build link? | 13:19 |
| mwhahaha | therve: puppet-zaqar-13.1.1-0.20180621212733.07f131e.el7.noarch | 13:20 |
| therve | mwhahaha: ? | 13:20 |
| mwhahaha | err sorry wrong copy paste | 13:21 |
| mwhahaha | https://trunk.rdoproject.org/centos7/91/fb/91fbd6d2b8ac87b70418db81d5d23660c064e2dd_d581a04a/ | 13:21 |
| mwhahaha | openstack-zaqar-7.0.0-0.20180623135038.935fef1.el7.noarch | 13:21 |
| therve | mwhahaha: Sorry I meant some CI logs | 13:22 |
| mwhahaha | oh no i'm in an actual system poking at it | 13:22 |
| mwhahaha | let me share | 13:22 |
| therve | Ah | 13:22 |
| *** dtantsur is now known as dtantsur|brb | 13:22 | |
| *** gvrangan has quit IRC | 13:24 | |
| openstackgerrit | Andy Smith proposed openstack/puppet-tripleo master: Add messaging notification transport url https://review.openstack.org/578105 | 13:27 |
| d0ugal | shardy: LGTM | 13:28 |
| *** quique|rover|lch is now known as quiquell|rover | 13:29 | |
| *** vpickard_ is now known as vpickard | 13:30 | |
| *** udesale has joined #tripleo | 13:31 | |
| toure | d0ugal apetrich could you take a quick look thanks... -> https://review.openstack.org/#/c/563701 | 13:32 |
| weshay|ruck | ccamacho, I think you are just hitting infra issues in rdo atm.. see rdo-list | 13:32 |
| therve | mwhahaha: Do you know what this ssl bs might be about? | 13:32 |
| mwhahaha | therve: no i was just wodnering if the ssl cert got regenerated or something and is causing problems | 13:32 |
| apetrich | toure, just a moment I think that we might have a problem with mistral ci | 13:32 |
| quiquell|rover | weshay|ruck: ack | 13:32 |
| toure | apetrich ack | 13:33 |
| apetrich | toure, and I'm chasing it | 13:33 |
| weshay|ruck | quiquell|rover, we just can't merge it w/o some sort of switch to turn it off outside of multinode and ovb | 13:33 |
| toure | understood | 13:33 |
| weshay|ruck | but it will be a good test drive | 13:33 |
| d0ugal | apetrich: I got it, I actually reviewed it yesterday and forgot to vote. LGTM | 13:33 |
| mwhahaha | jaosorior: ever seen rror: [('PEM routines', 'PEM_read_bio', 'no start line'), ('SSL routines', 'SSL_CTX_use_PrivateKey_file', 'PEM lib')] | 13:33 |
| apetrich | d0ugal, oh cool | 13:33 |
| ccamacho | weshay|ruck since may 15th? | 13:34 |
| *** agopi has joined #tripleo | 13:34 | |
| apetrich | d0ugal, yeah mistral tox is failing locally. I have a patch for it | 13:34 |
| ccamacho | Ill dig on the mailing lists thanks!!!! | 13:34 |
| *** agopi has quit IRC | 13:34 | |
| weshay|ruck | ccamacho, no.. just the latest failure | 13:35 |
| weshay|ruck | I can look at the older failures as well | 13:35 |
| therve | mwhahaha: Why is there running processes if it's containerized? | 13:36 |
| mwhahaha | therve: they show up as processes even if container'd | 13:36 |
| therve | Magic | 13:36 |
| jaosorior | mwhahaha: I haven't seen it, but it kinda sounds like the PEM file is badly formatted | 13:37 |
| quiquell|rover | weshay|ruck: This is what we get http://logs.openstack.org/60/577960/2/check/tripleo-ci-centos-7-undercloud-containers/7f49be7/logs/ara_oooq_root/ | 13:37 |
| mwhahaha | jaosorior: where do we keep those | 13:37 |
| weshay|ruck | ccamacho, huh.. really odd | 13:37 |
| therve | mwhahaha: Can we try to restart zaqar? | 13:37 |
| mwhahaha | therve: i did | 13:37 |
| jaosorior | mwhahaha: depends on where it came from, was it autogenerated or not? also, what threw that error? | 13:38 |
| therve | Hum | 13:38 |
| mwhahaha | jaosorior: autogenerated i think | 13:38 |
| mwhahaha | jaosorior: openstack queue list threw it | 13:38 |
| mwhahaha | jaosorior: when trying to talk to zaqar i think | 13:38 |
| jaosorior | can you pass the logs? | 13:38 |
| mwhahaha | no, but you can join the tmate fun | 13:38 |
| *** sanjay__u has quit IRC | 13:38 | |
| jaosorior | mwhahaha: I can't :/ I gotta go in 5 min | 13:38 |
| mwhahaha | booo | 13:38 |
| weshay|ruck | hrm.. june12 8:54 results are more sane.. ccamacho | 13:38 |
| mwhahaha | jaosorior: this is containerized undercloud | 13:39 |
| weshay|ruck | ccamacho, full 3rd party pass on the 14th | 13:39 |
| therve | mwhahaha: Restart haproxy? It's the thing doing ssl termination right? | 13:39 |
| mwhahaha | hmm why are we partially ssling this | 13:39 |
| * mwhahaha sighs | 13:39 | |
| ccamacho | weshay|ruck I mean it's failing since May 15th but might be nested issues one over the other, I'll try to keep an eye on it | 13:40 |
| * ccamacho crying lonely at my desk | 13:40 | |
| weshay|ruck | heh.. ccamacho /me asking in #rdo | 13:41 |
| mwhahaha | jaosorior: so it's like it's trying to use ssl on the non-ssl enpoint maybe? | 13:42 |
| jaosorior | mwhahaha: usually that's another exception. But it could be | 13:42 |
| mwhahaha | jaosorior: isn't it all supposed to be SSL'd, only some stuff is | 13:42 |
| *** agopi has joined #tripleo | 13:43 | |
| jaosorior | mwhahaha: only public endpoints | 13:43 |
| mwhahaha | hmm k | 13:44 |
| jaosorior | mwhahaha: we also can't SSL everything (for instance, ironic) | 13:44 |
| jaosorior | * ironic-conductor | 13:44 |
| therve | mwhahaha: Not websocket | 13:46 |
| *** rh-jelabarre has quit IRC | 13:46 | |
| mwhahaha | therve: was it that one? | 13:46 |
| therve | mwhahaha: Should be | 13:46 |
| jaosorior | seems that the client is trying to use the wrong endpoint | 13:46 |
| jaosorior | for some reason | 13:46 |
| *** ffiore_ has joined #tripleo | 13:46 | |
| *** ffiore has quit IRC | 13:47 | |
| therve | mwhahaha: I can build the request | 13:47 |
| jaosorior | or wait | 13:47 |
| jaosorior | no | 13:47 |
| jaosorior | actually it isn't | 13:47 |
| *** jaganathan_ has quit IRC | 13:51 | |
| mwhahaha | maybe we need to restart mistral | 13:51 |
| therve | Yeah | 13:52 |
| * d0ugal read that as rewrite mistral | 13:52 | |
| therve | Thought that is weird that the CLI doesn't work | 13:52 |
| mwhahaha | yea that's kinda concerning :D | 13:53 |
| *** lblanchard has joined #tripleo | 13:53 | |
| therve | Let's set that aside for a moment :) | 13:53 |
| quiquell|rover | weshay|ruck: 1,5 hours deploying undercloud | 13:53 |
| weshay|ruck | quiquell|rover, I saw something like that as well | 13:54 |
| weshay|ruck | not sure if I believe that though | 13:54 |
| jaosorior | mwhahaha: might it be a discovery issue? | 13:54 |
| mwhahaha | jaosorior: for the client that might be the problem, the auth issue seems to be different | 13:54 |
| weshay|ruck | quiquell|rover, talking about http://logs.openstack.org/60/577960/2/check/tripleo-ci-centos-7-undercloud-containers/7f49be7/ ? | 13:54 |
| weshay|ruck | quiquell|rover, WOOT http://logs.openstack.org/60/577960/2/check/tripleo-ci-centos-7-undercloud-containers/7f49be7/logs/ara_oooq_root/ | 13:55 |
| quiquell|rover | weshay|ruck: nope, just one of the latest gate fails http://logs.openstack.org/53/576053/2/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/e5ff0e1/logs/ara_oooq/ | 13:55 |
| mwhahaha | interesting | 13:56 |
| mwhahaha | so mistral isn't getting a new token? | 13:56 |
| therve | mwhahaha: event engine? | 13:56 |
| weshay|ruck | mwhahaha, fyi profiling the ansible driven undercloud ^ | 13:56 |
| weshay|ruck | http://logs.openstack.org/60/577960/2/check/tripleo-ci-centos-7-undercloud-containers/7f49be7/logs/ara_oooq_root/ <---- | 13:56 |
| therve | mwhahaha: api maybe too | 13:56 |
| mwhahaha | well it stopped during the executor/engine restarts | 13:56 |
| therve | mwhahaha: The cron is in the api | 13:56 |
| therve | Yes because that's what executes, not the trigger | 13:57 |
| bnemec | So am I good to recheck patches right now? | 13:57 |
| therve | Meh | 13:57 |
| bnemec | I had a lot of failures last night, none of which seem to be related or related to this discussion. | 13:57 |
| mwhahaha | bnemec: yea i think we've had some merges today so it should be ok | 13:58 |
| bnemec | mwhahaha: Okay, thanks. | 13:58 |
| *** amoralej|lunch is now known as amoralej | 13:58 | |
| therve | What's calling that though | 13:59 |
| jaosorior | brb | 13:59 |
| mwhahaha | d0ugal: when mistral runs a workflow and tries to send a message to zaqar when does it refresh the token? | 13:59 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: prevent upgrade from baremetal to containers with NFS backend https://review.openstack.org/577907 | 13:59 |
| mwhahaha | jaosorior: thanks i don't think it's ssl at the moment | 13:59 |
| d0ugal | mwhahaha: probably not. | 13:59 |
| d0ugal | mwhahaha: but let me dig into the code, do we think it has expired? | 13:59 |
| *** jaosorior has quit IRC | 13:59 | |
| mwhahaha | d0ugal: yes | 13:59 |
| d0ugal | mwhahaha: How long has the workflow been running? | 13:59 |
| d0ugal | Mistral workflows are limited by the Keystone token expiration | 14:00 |
| mwhahaha | d0ugal: so this might have been going all night | 14:00 |
| mwhahaha | i don't know when weshay|ruck started this | 14:00 |
| d0ugal | mwhahaha: right, that would explain it | 14:00 |
| mwhahaha | but it's kinda a problem for it to keep going when it's erroring | 14:00 |
| weshay|ruck | mwhahaha, that recreate? last night | 14:01 |
| d0ugal | mwhahaha: keep going? Which workflow is it? | 14:01 |
| d0ugal | mwhahaha: oh, I guess the introspection one? | 14:01 |
| *** jchhatbar is now known as janki | 14:01 | |
| mwhahaha | d0ugal: yea | 14:01 |
| mwhahaha | d0ugal: so tripleo.messaging.v1.send is failing | 14:01 |
| d0ugal | mwhahaha: right, so there is a loop in that workflow - I guess it is getting stuck in it. | 14:01 |
| mwhahaha | yea there needs to be a cap on that loop | 14:01 |
| mwhahaha | anyway | 14:01 |
| d0ugal | There should be, but I guess that is failing due to the token failure | 14:02 |
| mwhahaha | so that explaisn the zaqar errors, so we need to fix the introspection thing | 14:02 |
| d0ugal | Yeah, can you open a bug? | 14:02 |
| mwhahaha | anyway meeting time | 14:02 |
| mwhahaha | yea i will afte rmeeting | 14:02 |
| d0ugal | o/ | 14:02 |
| d0ugal | Thanks | 14:02 |
| mwhahaha | #startmeeting tripleo | 14:02 |
| mwhahaha | #topic agenda | 14:02 |
| mwhahaha | * Review past action items | 14:02 |
| mwhahaha | * One off agenda items | 14:02 |
| mwhahaha | * Squad status | 14:02 |
| mwhahaha | * Bugs & Blueprints | 14:02 |
| mwhahaha | * Projects releases or stable backports | 14:02 |
| mwhahaha | * Specs | 14:02 |
| openstack | Meeting started Tue Jun 26 14:02:34 2018 UTC and is due to finish in 60 minutes. The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:02 |
| mwhahaha | * open discussion | 14:02 |
| mwhahaha | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:02 |
| mwhahaha | Hi everyone! who is around today? | 14:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:02 |
| *** openstack changes topic to " (Meeting topic: tripleo)" | 14:02 | |
| openstack | The meeting name has been set to 'tripleo' | 14:02 |
| fultonj | o/ | 14:02 |
| *** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:02 | |
| matbu | o/ | 14:02 |
| marios | o/ | 14:02 |
| chem | o/ | 14:02 |
| rfolco_ | o/ | 14:02 |
| panda | o/ | 14:02 |
| Tengu | o/ | 14:03 |
| shardy | o/ | 14:03 |
| asbishop | o/ | 14:03 |
| *** rfolco_ is now known as rfolco | 14:03 | |
| *** rh-jelabarre has joined #tripleo | 14:03 | |
| d0ugal | o/ | 14:03 |
| myoung | o/ | 14:03 |
| jtomasek | o/ | 14:04 |
| mwhahaha | #topic review past action items | 14:04 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:04 | |
| mwhahaha | None! | 14:04 |
| *** rpioso|afk is now known as rpioso | 14:04 | |
| mwhahaha | #topic review past action items | 14:05 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:05 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:05 | |
| mwhahaha | err | 14:05 |
| mwhahaha | #undo | 14:05 |
| openstack | Removing item from minutes: #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:05 |
| mwhahaha | #undo | 14:05 |
| openstack | Removing item from minutes: #topic review past action items | 14:05 |
| mwhahaha | #topic one off agenda items | 14:05 |
| *** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:05 | |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:05 |
| mwhahaha | doesn't appear to be any | 14:05 |
| dpeacock | o/ | 14:05 |
| mwhahaha | does anyone have anything they would like to raise? | 14:05 |
| mwhahaha | sounds like nope, let's keep moving then | 14:06 |
| mwhahaha | #topic Squad status | 14:06 |
| mwhahaha | ci | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:06 |
| mwhahaha | upgrade | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:06 |
| mwhahaha | containers | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:06 |
| *** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:06 | |
| mwhahaha | config-download | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-config-download-squad-status | 14:06 |
| mwhahaha | integration | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:06 |
| mwhahaha | ui/cli | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:06 |
| mwhahaha | validations | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:06 |
| mwhahaha | networking | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-networking-squad-status | 14:06 |
| mwhahaha | workflows | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 14:06 |
| mwhahaha | security | 14:06 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-security-squad | 14:06 |
| mwhahaha | are there any specific status items that folks would like to highlight? | 14:07 |
| shardy | I wanted to check, should we track the openshift integration status on the -integration-squad status, as mostly that's ceph related atm? | 14:07 |
| mwhahaha | shardy: yea that'd be a good spot for it | 14:08 |
| shardy | I think the various integrations kind of diverged this cycle, but many interfaces/requirements are still common | 14:08 |
| shardy | mwhahaha: ack, thanks, I'll add the workflow and other bits we're working on there then | 14:08 |
| fultonj | shardy: +1 | 14:08 |
| fultonj | gfidente: ^ fyi | 14:09 |
| mwhahaha | as for CI stuff, master promotions are blocked up so we need to clear that out | 14:09 |
| *** psahoo has quit IRC | 14:09 | |
| mwhahaha | currently I think it's 11days | 14:09 |
| *** artom has joined #tripleo | 14:09 | |
| *** hjensas has quit IRC | 14:09 | |
| mwhahaha | I think the check/gate is generally OK right now, we've been hitting some upstream timeouts from what i've seen | 14:09 |
| *** cshastri has quit IRC | 14:10 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 14:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 14:10 |
| mwhahaha | I think that's mostly it for status stuff | 14:10 |
| mwhahaha | #topic bugs & blueprints | 14:10 |
| mwhahaha | #link https://launchpad.net/tripleo/+milestone/rocky-3 | 14:10 |
| mwhahaha | For Rocky we currently have 54 (-1) blueprints and about 722 (-2) open Launchpad bugs. 722 rocky-3, 0 stein-1. 102 (-2) open Storyboard bugs. | 14:10 |
| mwhahaha | #link https://storyboard.openstack.org/#!/project_group/76 | 14:10 |
| *** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:10 | |
| mwhahaha | m3 is coming up in about a month | 14:11 |
| gfidente | shardy I think it is yes | 14:11 |
| mwhahaha | so if your feature isn't mostly landed, think about moving it to stein | 14:11 |
| gfidente | shardy though I'd be so happy to make openshift into that considering from tripleo perspective we share things | 14:11 |
| shardy | gfidente: thanks, for now I'll just add the openshift in-progress items to the Rocky list | 14:12 |
| *** pradk_ has joined #tripleo | 14:12 | |
| shardy | we can revisit next cycle but I agree we share a lot of interfaces so it'd be good to work together | 14:13 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add support for NodeDataLookup for Ceph deployment https://review.openstack.org/577956 | 14:13 |
| gfidente | ^^ speaking of which, dump into host_vars the per-uuid data | 14:13 |
| mwhahaha | i recall there being an issue with the uuid data and docker-puppet, not sure if it was ever resolved | 14:14 |
| mwhahaha | for normal deployments | 14:14 |
| mwhahaha | anyway | 14:14 |
| mwhahaha | any other bugs/blueprints folks would like to talk about? | 14:14 |
| gfidente | mwhahaha we can check with slagle I think | 14:14 |
| shardy | I wanted to ask for help looking at https://review.openstack.org/#/q/status:open+project:openstack/tripleo-common+branch:master+topic:plan_role_tags | 14:15 |
| shardy | it's coming a bit late unfortunately but it'll make management of non-openstack deployments much nicer in future | 14:15 |
| shardy | trying to get some incremental improvements ready for Rocky, then we can continue next cycle | 14:15 |
| mwhahaha | sounds good | 14:16 |
| *** pradk_ has quit IRC | 14:16 | |
| mwhahaha | moving on | 14:16 |
| mwhahaha | #topic projects releases or stable backports | 14:16 |
| *** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:16 | |
| mwhahaha | so as I said earlier, Rocky M3 is in about a month | 14:17 |
| mwhahaha | so get your features in | 14:17 |
| mwhahaha | I think we'll do a queens/pike/ocata release next week or the week after | 14:17 |
| mwhahaha | Newton has been EOL'd | 14:17 |
| mwhahaha | any questions? | 14:17 |
| *** slaweq has joined #tripleo | 14:17 | |
| *** cylopez has joined #tripleo | 14:18 | |
| mwhahaha | #topic specs | 14:19 |
| mwhahaha | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:19 |
| *** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:19 | |
| mwhahaha | It's a bit late for rocky specs, but if you have some for stein now is the time to post them | 14:19 |
| mwhahaha | take a look at some of the WIP ones to provide early feed back | 14:20 |
| Tengu | mwhahaha: like the one for priv escalation and sudo ? | 14:20 |
| mwhahaha | yea | 14:20 |
| mwhahaha | #topic open discussion | 14:20 |
| *** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:20 | |
| mwhahaha | anything else? | 14:20 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Adds check for python-virtualenv with error message https://review.openstack.org/578081 | 14:21 |
| dpeacock | I'd like to get some feedback on https://review.openstack.org/#/c/577397/ please | 14:21 |
| mwhahaha | alright thanks everyone | 14:22 |
| mwhahaha | #endmeeting | 14:23 |
| *** openstack changes topic to "Welcome to Rocky. CI status: GREENish (maybe) | https://docs.openstack.org/tripleo-docs/latest" | 14:23 | |
| openstack | Meeting ended Tue Jun 26 14:23:00 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:23 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-06-26-14.02.html | 14:23 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-06-26-14.02.txt | 14:23 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-06-26-14.02.log.html | 14:23 |
| trozet | beagles, chem: can you tell me how OVS restart is done when OVS package is updated during a OOO update/upgrade? Is it done by the RPM? Is there an ansible task to restart it? | 14:24 |
| trozet | marios^ | 14:24 |
| chem | trozet: which version ? | 14:24 |
| chem | trozet: which version of osp | 14:25 |
| trozet | chem: 13 and later | 14:25 |
| honza | jtomasek: i'm looking at your patch to upgrade react to 16.4.1 --- did they simply make the context api officially supported in 16.3? Because it still builds fine with the old version... | 14:25 |
| marios | trozet: i didn't think we manually restart it, in fact we go to lengths to prevent the restart (you need to reboot to get new kernel/ovs), or i missed something chem? | 14:26 |
| marios | trozet: go to lengths like manually installing the package (rpm -U) with --nopostun --notriggerun e.g. | 14:26 |
| chem | trozet: well as marios said we try to avoid ovs restart with a special handling | 14:27 |
| jtomasek | honza: yes, I believe it was available in older versions but there were some bugs fixed in 16.4 | 14:27 |
| jtomasek | honza: so I played it safe | 14:27 |
| marios | trozet: e.g. here https://github.com/openstack/tripleo-heat-templates/blob/8a36325573b6a2c020939472626390b7d14fd54c/puppet/services/openvswitch.yaml#L185-L190 | 14:27 |
| marios | trozet: so the answer to your question then is "we don't " (i.e. relies on operator to restart post upgrade) | 14:28 |
| *** psachin has quit IRC | 14:28 | |
| chem | trozet https://github.com/openstack/tripleo-heat-templates/blob/stable/queens/puppet/services/openvswitch.yaml#L191..L195 | 14:28 |
| honza | jtomasek: perfect, i just wanted to double check, thanks | 14:28 |
| chem | trozet: marios I highlighted the associated conditional that create the special handling | 14:29 |
| *** itlinux has quit IRC | 14:29 | |
| marios | chem: yeah me too just before you :) | 14:29 |
| marios | chem: :D | 14:29 |
| trozet | chem, marios: oh now i remember this | 14:29 |
| *** agurenko has quit IRC | 14:29 | |
| trozet | chem, marios: thanks guys this answers my question | 14:29 |
| chem | marios: I did it on Queens, your is just random master | 14:29 |
| marios | chem: haha right | 14:29 |
| marios | sorry | 14:29 |
| marios | LD | 14:29 |
| chem | marios: it's ok | 14:30 |
| marios | np trozet | 14:30 |
| trozet | marios, chem: for opendaylight-ovs we inherit the base openvswitch service template you listed. We used to stop OVS for an ODL specific reason, but now I'm thinking we shouldn't do that and just inherit what you guys wrote for your update/upgrade tasks | 14:32 |
| sri_ | shardy, quick question "--control-scale 5" is this valid ? when i tried this i get an error "{u'errors': [u'Not enough baremetal nodes - available: 5, requested: 6']" | 14:32 |
| trozet | https://review.openstack.org/#/c/576210/2/puppet/services/opendaylight-ovs.yaml | 14:32 |
| *** quiquell|rover is now known as quiquell|off | 14:34 | |
| *** avivgt has quit IRC | 14:34 | |
| *** ccamacho has quit IRC | 14:35 | |
| *** ccamacho has joined #tripleo | 14:35 | |
| *** jabadia has joined #tripleo | 14:38 | |
| shardy | sri_: Sounds like you don't have enough nodes in the available state to scale up or deploy - I assume you have at least 1 controller? | 14:38 |
| shardy | sri_: check openstack baremetal node list | 14:39 |
| sri_ | shardy, I do have 5 nodes | 14:39 |
| jabadia | /msg NickServ identify (W311ow) | 14:39 |
| shardy | sri_: available: 5, requested: 6 | 14:39 |
| shardy | you're requesting 5 compute nodes | 14:39 |
| sri_ | shardy, I dont understand where is 6 coming from | 14:39 |
| shardy | how many controller nodes? | 14:39 |
| shardy | sri_: by default you must have 1 controller | 14:40 |
| *** jabadia has left #tripleo | 14:40 | |
| sri_ | shardy, this is new deployment | 14:41 |
| *** rh-jelabarre has quit IRC | 14:41 | |
| shardy | sri_: sorry I misread, you're probably trying to deploy 5 controllers and 1 compute then | 14:41 |
| shardy | the default compute count is 1 | 14:41 |
| shardy | note that we don't support 5 controllers, so it may or may not work | 14:41 |
| shardy | we support/test either 1 or 3 | 14:41 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs master: Developer docs for updates https://review.openstack.org/578069 | 14:42 |
| shardy | I misread and thought you said --compute-scale 5 | 14:42 |
| sri_ | shardy, i see, it worked when the count was 3 but when i change to 5 it's failing with that error | 14:43 |
| shardy | sri_: when you deployed 3 did it also deploy 1 compute? | 14:43 |
| shardy | the default compute count is 1 | 14:43 |
| *** dxiri has joined #tripleo | 14:43 | |
| mwhahaha | d0ugal: https://bugs.launchpad.net/tripleo/+bug/1778742 | 14:43 |
| sri_ | shardy, I have a custom role with all-in-one | 14:43 |
| openstack | Launchpad bug 1778742 in tripleo "tripleo.messaging.v1.send continues to retry forever even if it gets an auth error" [High,Triaged] | 14:43 |
| shardy | sri_: sure, but have you set ComputeCount: 0 somewhere, or passed a roles_data.yaml without any Compute role in it? | 14:44 |
| shardy | fwiw I don't think 5 all-in-one nodes is an advisable topology so it'd be good to understand the requirements here | 14:44 |
| sri_ | shardy, http://paste.openstack.org/show/724318/ | 14:45 |
| *** dtantsur|brb is now known as dtantsur | 14:45 | |
| *** jcoufal has joined #tripleo | 14:46 | |
| shardy | sri_: creat_overcloud.sh isn't using your custom roles_data AFAICS? | 14:46 |
| shardy | no -r option | 14:46 |
| sri_ | shardy, I replace with role_data.yaml in default location | 14:47 |
| shardy | hmm that should work but I'd try with -r and/or plan delete before you start to be sure | 14:47 |
| *** avivgt has joined #tripleo | 14:48 | |
| shardy | also you could check the nova-scheduler logs on the undercloud to figure out why it's looking for 6 nodes | 14:48 |
| sri_ | shardy, yes your right about 5 allinone , it was kinda of experiment, we have 5 high performance nodes we just want utilize them fully | 14:49 |
| sri_ | shardy, Ok i will try that | 14:49 |
| *** karthiks has quit IRC | 14:51 | |
| *** saneax has quit IRC | 14:52 | |
| panda | where I can find the latest requirements for undercloud memory ? I can find a 16G but it's updated to 2016 | 14:54 |
| shardy | panda: I think for real deployments 16G is still a good minimum, for VM testing where you don't deploy much the quickstart default of 12G works OK | 14:55 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Set ODL API restart policy to unless-stopped https://review.openstack.org/575111 | 14:55 |
| mwhahaha | panda: it's all dependent on the overcloud being deployed. 16g should be sufficient | 14:56 |
| shardy | any less and you're likely to start swapping or OOMing IME | 14:56 |
| *** ffiore_ has quit IRC | 14:57 | |
| *** pdeore has quit IRC | 14:58 | |
| panda | shardy., mwhahaha: ok, thanks. | 14:58 |
| sri_ | shardy, it seems deleting plans and using -r roles_data fix that issue | 15:04 |
| sri_ | shardy, thanks :) | 15:04 |
| *** ffiore_ has joined #tripleo | 15:04 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Refactor service client getters https://review.openstack.org/578127 | 15:05 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 15:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:10 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP][DNM] test to gather zuul inventory informations https://review.openstack.org/576879 | 15:10 |
| *** vpickard has quit IRC | 15:11 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Improve nova statedir ownership logic https://review.openstack.org/577855 | 15:12 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: prevent upgrade from baremetal to containers with NFS backend https://review.openstack.org/577907 | 15:12 |
| *** janki has quit IRC | 15:13 | |
| *** vpickard has joined #tripleo | 15:14 | |
| *** ccamacho has quit IRC | 15:15 | |
| *** itlinux has joined #tripleo | 15:16 | |
| *** waleedm has quit IRC | 15:18 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: prevent upgrade from baremetal to containers with NFS backend https://review.openstack.org/577907 | 15:19 |
| *** cylopez has quit IRC | 15:22 | |
| *** dciabrin has quit IRC | 15:22 | |
| weshay|ruck | mwhahaha, anything come out of that mistral/zaqar issue? | 15:23 |
| mwhahaha | weshay|ruck: it's likely a sideeffect of the failed introspection | 15:24 |
| mwhahaha | weshay|ruck: not related to the problem but is a separate issue to be tracked elsewhere | 15:24 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Let's tempestconf tool handle swift related conf https://review.openstack.org/573220 | 15:24 |
| mwhahaha | weshay|ruck: so we need to go back to understand aby the introspection failed | 15:24 |
| mwhahaha | s/aby/why | 15:24 |
| *** avivgt has quit IRC | 15:26 | |
| *** aufi_ has quit IRC | 15:26 | |
| *** khyr0n has quit IRC | 15:26 | |
| *** dparkes has quit IRC | 15:28 | |
| *** dciabrin has joined #tripleo | 15:28 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: [WIP] Native ZuulV3 TripleO CI job https://review.openstack.org/576956 | 15:31 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Enable ARA for the undercloud install https://review.openstack.org/577960 | 15:32 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Enable ARA for the undercloud install https://review.openstack.org/577960 | 15:33 |
| weshay|ruck | mwhahaha, hrm.. | 15:34 |
| *** yprokule has quit IRC | 15:34 | |
| weshay|ruck | mwhahaha, I suppose I could try w/o containers as well | 15:35 |
| mwhahaha | weshay|ruck: where was the error for introspection kicked off? | 15:36 |
| weshay|ruck | mwhahaha, kicked off.. I noticed in the images_prep log | 15:37 |
| weshay|ruck | you on the box? | 15:37 |
| mwhahaha | yea | 15:37 |
| mwhahaha | d0ugal: is there a way to kill a workflow that's stuck in running? | 15:38 |
| d0ugal | mwhahaha: mistral execution-delete | 15:39 |
| d0ugal | or "openstack workflow execution delete" maybe | 15:39 |
| mwhahaha | d0ugal: Only completed executions can be deleted. Execution 50ee3bfb-d58e-4206-bab1-722ce0a884e3 is in RUNNING state | 15:39 |
| d0ugal | mwhahaha: --force | 15:40 |
| mwhahaha | sudo make me a sandwich | 15:41 |
| d0ugal | apetrich: ^ we should maybe add that as a tip to the output. | 15:41 |
| *** pcaruana has quit IRC | 15:42 | |
| *** cylopez has joined #tripleo | 15:42 | |
| mwhahaha | heh timedout | 15:43 |
| d0ugal | really, that is strange | 15:43 |
| d0ugal | mwhahaha: I guess your execution must be *huge* if it has been running that long | 15:43 |
| mwhahaha | yea | 15:43 |
| d0ugal | mwhahaha: A nasty work around is to restart Mistral | 15:44 |
| *** stendulker has joined #tripleo | 15:44 | |
| d0ugal | mwhahaha: but the catch is that the execution will have stopped, but it will still show as "RUNNING" | 15:44 |
| *** ksambor has quit IRC | 15:44 | |
| d0ugal | :) | 15:44 |
| mwhahaha | :D | 15:44 |
| *** mrunge_ has joined #tripleo | 15:44 | |
| *** trown has quit IRC | 15:44 | |
| d0ugal | mwhahaha: actually, a better solution | 15:44 |
| *** ramishra has quit IRC | 15:44 | |
| d0ugal | mwhahaha: mistral execution-update ID -s CANCELLED | 15:44 |
| d0ugal | THat is really the correct way to do it | 15:44 |
| mwhahaha | it eventually removed | 15:45 |
| mwhahaha | the 2nd time it couldnt' find it | 15:45 |
| d0ugal | oh okay, I was just warming up. I had at least 2 more ways to remove it. | 15:45 |
| mwhahaha | it's likely the haproxy timeout options are right | 15:45 |
| mwhahaha | cause it did a 504 gateway timeout | 15:45 |
| d0ugal | cool | 15:45 |
| *** mrunge has quit IRC | 15:45 | |
| mwhahaha | we might want to tune those up, i think they were defaulted to 60 seconds | 15:45 |
| *** trown|brb has joined #tripleo | 15:46 | |
| *** bogdando has quit IRC | 15:46 | |
| openstackgerrit | Martin Kopec proposed openstack/tripleo-docs master: Added Tempest Documentation for Tripleo https://review.openstack.org/565161 | 15:50 |
| *** ykarel|away has joined #tripleo | 15:51 | |
| mwhahaha | weshay|ruck: so i'm rerunning it now, we'll see what happens. I've got to run for a bit (kid eye dr), i'll check it when i get back | 15:51 |
| mwhahaha | weshay|ruck: it might be a container starting issue | 15:51 |
| *** cylopez has left #tripleo | 15:52 | |
| *** lvdombrkr89 has quit IRC | 15:52 | |
| *** ffiore_ has quit IRC | 15:53 | |
| weshay|ruck | mwhahaha, k.. thanks man! | 15:53 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 16:00 |
| *** hamzy has quit IRC | 16:00 | |
| *** khyr0n has joined #tripleo | 16:02 | |
| *** ykarel|away is now known as ykarel | 16:03 | |
| *** udesale has quit IRC | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 16:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 16:10 |
| *** trown|brb is now known as trown | 16:12 | |
| openstackgerrit | Miguel Angel Ajo proposed openstack/tripleo-quickstart master: Remove workaround that breaks Intel(R) Xeon(R) Gold 5120 CPU @ 2.20GHz https://review.openstack.org/578142 | 16:12 |
| weshay|ruck | matbu, question for you when you have a sec | 16:18 |
| *** gvrangan has joined #tripleo | 16:20 | |
| *** stendulker has quit IRC | 16:21 | |
| openstackgerrit | Toure Dunnon proposed openstack/tripleo-common master: Create get_flattened_parameters workflow https://review.openstack.org/558883 | 16:23 |
| *** gvrangan has quit IRC | 16:25 | |
| *** dprince has quit IRC | 16:27 | |
| *** jpich has quit IRC | 16:28 | |
| *** dprince has joined #tripleo | 16:32 | |
| *** janki has joined #tripleo | 16:39 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-common master: WIP, configure ARA for the overcloud deployment https://review.openstack.org/578150 | 16:40 |
| *** tesseract has quit IRC | 16:40 | |
| *** aufi_ has joined #tripleo | 16:43 | |
| *** ramishra has joined #tripleo | 16:49 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: [WIP] Native ZuulV3 TripleO CI job https://review.openstack.org/576956 | 16:51 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Filter qrouter containers from images validation script https://review.openstack.org/577890 | 16:52 |
| *** yamahata has joined #tripleo | 16:57 | |
| *** derekh has quit IRC | 16:58 | |
| *** ramishra has quit IRC | 16:58 | |
| *** hjensas has joined #tripleo | 16:59 | |
| *** hjensas has quit IRC | 16:59 | |
| *** hjensas has joined #tripleo | 16:59 | |
| *** panda is now known as panda|off | 17:01 | |
| *** zoli is now known as zoli|gone | 17:09 | |
| *** zoli|gone is now known as zoli | 17:09 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 17:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 17:10 |
| *** salmankhan has quit IRC | 17:11 | |
| *** Haresh has quit IRC | 17:13 | |
| *** dtantsur is now known as dtantsur|afk | 17:15 | |
| *** cylopez has joined #tripleo | 17:18 | |
| *** invsblduck has joined #tripleo | 17:19 | |
| *** jcoufal has quit IRC | 17:22 | |
| *** cylopez has quit IRC | 17:26 | |
| *** cylopez has joined #tripleo | 17:26 | |
| *** lblanchard has quit IRC | 17:27 | |
| *** cylopez1 has joined #tripleo | 17:28 | |
| *** cylopez has quit IRC | 17:31 | |
| *** holser_ has quit IRC | 17:39 | |
| *** slaweq has quit IRC | 17:40 | |
| *** cylopez1 has quit IRC | 17:41 | |
| *** cylopez has joined #tripleo | 17:42 | |
| *** ykarel has quit IRC | 17:44 | |
| openstackgerrit | Martin Kopec proposed openstack/tripleo-docs master: Added Tempest Documentation for Tripleo https://review.openstack.org/565161 | 17:45 |
| *** kopecmartin has quit IRC | 17:46 | |
| *** khyr0n has quit IRC | 17:48 | |
| *** jpena is now known as jpena|off | 17:49 | |
| *** hamzy has joined #tripleo | 17:50 | |
| *** gvrangan has joined #tripleo | 17:54 | |
| *** aufi_ has quit IRC | 17:54 | |
| *** amoralej is now known as amoralej|off | 17:56 | |
| mwhahaha | weshay|ruck: ok so it looks like introspection is failing again | 17:58 |
| * mwhahaha will dive deeper | 17:58 | |
| * weshay|ruck looks | 17:59 | |
| *** agurenko has joined #tripleo | 18:01 | |
| *** trown has quit IRC | 18:05 | |
| mwhahaha | it seems like it's the introspeciton workflow failing because of messaging | 18:06 |
| mwhahaha | but i'm not sure what's wrong | 18:06 |
| *** gfidente has quit IRC | 18:08 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common master: Add new undeploy_plan workflow https://review.openstack.org/566246 | 18:10 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 18:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 18:10 |
| openstackgerrit | Andy Smith proposed openstack/puppet-tripleo master: Add messaging notification transport url https://review.openstack.org/578105 | 18:11 |
| *** jaosorior has joined #tripleo | 18:13 | |
| *** dprince has quit IRC | 18:14 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Enable collectd to connect to metrics QDR https://review.openstack.org/576057 | 18:22 |
| *** trown has joined #tripleo | 18:23 | |
| *** gvrangan has quit IRC | 18:25 | |
| *** dprince has joined #tripleo | 18:26 | |
| *** dmellado has quit IRC | 18:32 | |
| *** gouthamr has quit IRC | 18:32 | |
| *** cylopez has quit IRC | 18:33 | |
| *** stevebaker has quit IRC | 18:33 | |
| *** slaweq has joined #tripleo | 18:34 | |
| weshay|ruck | mwhahaha, we may have lost that env... | 18:39 |
| weshay|ruck | rdo-cloud just went boom | 18:39 |
| *** paramite has quit IRC | 18:40 | |
| *** weshay|ruck changes topic to "Welcome to Rocky. CI status: RED RDO-Cloud is down | https://docs.openstack.org/tripleo-docs/latest" | 18:40 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: [WIP] Native ZuulV3 TripleO CI job https://review.openstack.org/576956 | 18:43 |
| *** florianf is now known as florianf|afk | 18:45 | |
| mwhahaha | weshay|ruck: glorious | 18:49 |
| *** lblanchard has joined #tripleo | 18:51 | |
| *** cdearborn_ has joined #tripleo | 18:52 | |
| *** atoth has quit IRC | 18:53 | |
| *** cdearborn has quit IRC | 18:54 | |
| *** jcoufal has joined #tripleo | 18:56 | |
| *** jcoufal has quit IRC | 18:56 | |
| openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: Drop example in config file comments https://review.openstack.org/578172 | 19:02 |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Drop example in config file comments https://review.openstack.org/578173 | 19:02 |
| *** janki has quit IRC | 19:04 | |
| *** yolanda__ has joined #tripleo | 19:04 | |
| *** yolanda_ has quit IRC | 19:07 | |
| *** yolanda_ has joined #tripleo | 19:09 | |
| *** sshnaidm has quit IRC | 19:09 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 19:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 19:10 |
| weshay|ruck | mwhahaha, at what point do we clear the gate? | 19:10 |
| mwhahaha | weshay|ruck: are we actively failing in the gate for something? | 19:11 |
| weshay|ruck | well.. the only failing job atm is http://logs.openstack.org/58/571958/2/gate/tripleo-ci-centos-7-containers-multinode/763b88f/job-output.txt.gz#_2018-06-26_17_04_05_056289 | 19:12 |
| weshay|ruck | that old issue and timeouts | 19:12 |
| weshay|ruck | so we could clear.. merge the patch that profiles the undercloud install | 19:12 |
| weshay|ruck | mwhahaha, maybe we can work together on the ara for the overcloud in an outtage | 19:12 |
| weshay|ruck | bring things back online.. | 19:12 |
| *** yolanda__ has quit IRC | 19:12 | |
| mwhahaha | weshay|ruck: so that failure is an upstream infra failure | 19:13 |
| weshay|ruck | at least then we'd know what was killing us | 19:13 |
| mwhahaha | weshay|ruck: we need to poke them to point out the nodepool ping tests are failing | 19:13 |
| mwhahaha | in the case of that failure it's vexxhost http://logs.openstack.org/58/571958/2/gate/tripleo-ci-centos-7-containers-multinode/763b88f/logs/devstack-gate-setup-host.txt | 19:13 |
| weshay|ruck | mwhahaha, https://review.openstack.org/#/c/577960/ | 19:13 |
| mwhahaha | mnaser: -^ | 19:13 |
| weshay|ruck | https://review.openstack.org/#/c/578150/ | 19:13 |
| weshay|ruck | the only way to move forward on timeouts afaict.. is to have http://logs.openstack.org/60/577960/4/check/tripleo-ci-centos-7-undercloud-containers/2d3a05e/logs/ara_oooq_root/ | 19:14 |
| mwhahaha | not sure we want to have ARA in the deployment | 19:14 |
| mwhahaha | we need to make that more configurable | 19:15 |
| *** lblanchard has quit IRC | 19:15 | |
| weshay|ruck | mwhahaha, ya.. noted that.. just for WIP atm | 19:15 |
| *** yolanda__ has joined #tripleo | 19:15 | |
| weshay|ruck | want to see it work first | 19:15 |
| *** slaweq has quit IRC | 19:15 | |
| weshay|ruck | mwhahaha, the level of nesting in playbooks is unclear to me exactly | 19:15 |
| weshay|ruck | I think we have overcloud playbooks run from the undercloud and also on the overcloud nodes w/ localhost | 19:16 |
| mwhahaha | yea ara doesn't necessarily fit with how we execute things in the deployment | 19:16 |
| *** yolanda_ has quit IRC | 19:18 | |
| weshay|ruck | mwhahaha, either way.. we can collect it.. have graphana grab it later and we can see trends at least | 19:18 |
| *** holser_ has joined #tripleo | 19:20 | |
| *** holser_ has quit IRC | 19:20 | |
| *** dxiri has quit IRC | 19:22 | |
| *** slaweq has joined #tripleo | 19:24 | |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Allow fast forward upgrade of custom roles https://review.openstack.org/577520 | 19:26 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Update standalone role for a cloud https://review.openstack.org/575862 | 19:26 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: standalone run a post config to generate a clouds.yaml https://review.openstack.org/575597 | 19:26 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Allow fast forward upgrade of custom roles https://review.openstack.org/578178 | 19:28 |
| *** dprince has quit IRC | 19:30 | |
| weshay|ruck | mwhahaha, if we abandon https://review.openstack.org/571958 and restore it.. I think the gate will not reset | 19:37 |
| mwhahaha | weshay|ruck: you can just leave it | 19:38 |
| weshay|ruck | ok | 19:38 |
| mwhahaha | weshay|ruck: you're right but if the top job fails it'll get pulled back in and restarted | 19:38 |
| mwhahaha | so when they branch off like that it's best to just leave it because they might get pulled back in on a gate reset | 19:38 |
| *** agopi is now known as agopi|brb | 19:40 | |
| *** dhill_ has quit IRC | 19:42 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: Run undercloud fs003 job only https://review.openstack.org/576979 | 19:43 |
| *** agopi|brb has quit IRC | 19:45 | |
| mnaser | mwhahaha: sorry for that failure. does it seem like the mirrors server is having an issue in that case | 19:46 |
| * mwhahaha wonders if we need to tune the upstream ping timeout | 19:47 | |
| mnaser | (as a provider): i don't control that vm | 19:47 |
| mnaser | though there is plenty of throughput for it to handle the traffic. let alone icmp | 19:47 |
| mwhahaha | but icmp is lower priority right? | 19:48 |
| * mwhahaha tries to recall his networking experiance | 19:48 | |
| mnaser | usually yes, but you're talking layer 2 so there is no routers that are ignoring icmp at that state | 19:49 |
| mnaser | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=64894&rra_id=all | 19:49 |
| mnaser | there does seem to be a big spike at the same time of the failure | 19:49 |
| *** lblanchard has joined #tripleo | 19:49 | |
| mnaser | im not sure if that is megabytes or megabits per second | 19:49 |
| weshay|ruck | I blame netflix | 19:49 |
| openstackgerrit | Martin Kopec proposed openstack/tripleo-docs master: Added Tempest Documentation for Tripleo https://review.openstack.org/565161 | 19:50 |
| mnaser | if it's bytes, that port is fully saturated at that point.. we're working on upgrading all of our infra to do 10g public networking | 19:50 |
| *** sshnaidm has joined #tripleo | 19:50 | |
| *** agurenko has quit IRC | 19:51 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: Test cross project depends-on gerrit url https://review.openstack.org/578185 | 19:51 |
| mwhahaha | the timeout was at 17:04 which was lower traffic | 19:51 |
| mwhahaha | so wasn't that | 19:51 |
| mnaser | also it looks like bits per second | 19:51 |
| mwhahaha | the spike in traffic was at 18:04 | 19:52 |
| mnaser | yeah you're right | 19:52 |
| *** slaweq has quit IRC | 19:52 | |
| mnaser | i still wanna figure out why or what's going on | 19:52 |
| mnaser | i know how frustrating it is to have a job fail on something silly when your jobs have long runtimes | 19:52 |
| mwhahaha | :D | 19:52 |
| mwhahaha | maybe step 1 is increase it from 1 packet | 19:53 |
| * mwhahaha goes and looks for the nodepool setup stuff | 19:53 | |
| mnaser | yeah i think giving it a bit more space/timeout would probably be productive.. i ping'd infra to gather some more info from them | 19:53 |
| *** gouthamr has joined #tripleo | 19:54 | |
| *** marrusl has quit IRC | 19:55 | |
| *** marrusl has joined #tripleo | 19:56 | |
| *** zul has joined #tripleo | 19:56 | |
| *** pchavva has quit IRC | 19:57 | |
| *** waleedm has joined #tripleo | 19:58 | |
| *** liverpooler has quit IRC | 19:59 | |
| mwhahaha | oh look there's an elastic recheck for it | 19:59 |
| mwhahaha | http://status.openstack.org/elastic-recheck/#1694501 | 19:59 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: [WIP][DNM] test to gather zuul inventory informations https://review.openstack.org/576879 | 20:04 |
| *** dxiri has joined #tripleo | 20:05 | |
| mwhahaha | hmm it's supposed to retry 20 times | 20:06 |
| mwhahaha | https://github.com/openstack-infra/devstack-gate/blob/975054cdcde517268c787e0f92f6b688997c4945/playbooks/roles/network_sanity_check/tasks/ping_check.yaml#L4 | 20:06 |
| mwhahaha | https://github.com/openstack-infra/devstack-gate/blob/ce56c6704ed9fdd733ceef185557c70a0b2caaaf/playbooks/devstack_gate_vars.yaml#L4 | 20:06 |
| *** dhill_ has joined #tripleo | 20:08 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 20:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 20:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 20:10 |
| *** noama has joined #tripleo | 20:18 | |
| *** gouthamr has quit IRC | 20:19 | |
| *** raildo has quit IRC | 20:20 | |
| *** gouthamr has joined #tripleo | 20:22 | |
| *** khyr0n has joined #tripleo | 20:24 | |
| *** gouthamr_ has joined #tripleo | 20:29 | |
| *** gouthamr has quit IRC | 20:29 | |
| *** gouthamr_ is now known as gouthamr | 20:29 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: trivialfix:fix a typo https://review.openstack.org/572316 | 20:30 |
| *** jcoufal has joined #tripleo | 20:32 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare https://review.openstack.org/573476 | 20:37 |
| *** morazi has quit IRC | 20:40 | |
| *** ansmith has quit IRC | 20:41 | |
| *** akrivoka has quit IRC | 20:41 | |
| itlinux | hello guys, I just wanted to check out the UI, I get the https up and I see the logo but the admin cannot login using the openstack credentals it says it cannot contact keystone. Any tips? Thanks | 20:42 |
| *** jcoufal has quit IRC | 20:45 | |
| *** hamzy has quit IRC | 20:47 | |
| *** atarlov has joined #tripleo | 20:49 | |
| *** stevebaker has joined #tripleo | 20:52 | |
| *** waleedm has quit IRC | 21:00 | |
| *** trown is now known as trown|outtypewww | 21:01 | |
| *** zul has quit IRC | 21:02 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 21:10 |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 21:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 21:10 |
| *** mjturek has quit IRC | 21:11 | |
| *** yolanda_ has joined #tripleo | 21:12 | |
| *** asbishop is now known as abishop | 21:14 | |
| *** yolanda__ has quit IRC | 21:14 | |
| *** khyr0n has quit IRC | 21:15 | |
| openstackgerrit | Oliver Walsh proposed openstack/instack-undercloud stable/ocata: Fix regression in undercloud upgrade cell_v2 setup https://review.openstack.org/578207 | 21:15 |
| *** zaneb has quit IRC | 21:17 | |
| *** abishop has quit IRC | 21:19 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud"" https://review.openstack.org/575330 | 21:20 |
| *** cmurphy_vacation is now known as cmurphy | 21:22 | |
| *** gouthamr has quit IRC | 21:25 | |
| *** gouthamr has joined #tripleo | 21:26 | |
| *** noama has quit IRC | 21:28 | |
| *** zaneb has joined #tripleo | 21:29 | |
| openstackgerrit | Oliver Walsh proposed openstack/instack-undercloud stable/ocata: Fix regression in undercloud upgrade cell_v2 setup https://review.openstack.org/578207 | 21:30 |
| *** vpickard is now known as vpickard_ | 21:30 | |
| *** bfournie has quit IRC | 21:31 | |
| *** numans_ has joined #tripleo | 21:34 | |
| openstackgerrit | Oliver Walsh proposed openstack/instack-undercloud stable/ocata: Fix regression in undercloud upgrade cell_v2 setup https://review.openstack.org/578207 | 21:35 |
| *** numans has quit IRC | 21:37 | |
| *** lifeless has joined #tripleo | 21:38 | |
| *** rcernin has joined #tripleo | 21:47 | |
| *** pradk has quit IRC | 21:49 | |
| *** itlinux has quit IRC | 21:54 | |
| *** Wisch has joined #tripleo | 21:55 | |
| *** myoung is now known as myoung|off | 21:56 | |
| *** afazekas has quit IRC | 21:56 | |
| *** cdearborn_ has quit IRC | 21:56 | |
| *** afazekas has joined #tripleo | 21:59 | |
| openstackgerrit | Oliver Walsh proposed openstack/diskimage-builder master: Add new modprobe element https://review.openstack.org/577170 | 22:00 |
| openstackgerrit | Oliver Walsh proposed openstack/diskimage-builder master: Add DIB element to blacklist nouveau https://review.openstack.org/571777 | 22:00 |
| *** edmondsw has quit IRC | 22:04 | |
| *** edmondsw has joined #tripleo | 22:07 | |
| *** yolanda__ has joined #tripleo | 22:07 | |
| *** agopi has joined #tripleo | 22:07 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 22:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 22:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 22:10 |
| *** yolanda_ has quit IRC | 22:10 | |
| *** edmondsw has quit IRC | 22:11 | |
| openstackgerrit | Oliver Walsh proposed openstack/diskimage-builder master: WIP: Add DIB element to install NVIDIA GPU drivers https://review.openstack.org/573223 | 22:12 |
| Wisch | Question for you fine folks | 22:13 |
| Wisch | Is there a way to get tripleo::profile::base::database::mysql tasks to re-run on a stack update? | 22:14 |
| Wisch | testing a Pike environment with a base deployment, then a stack update to add on Octavia, but the database and octavia user aren't being created on the update | 22:14 |
| *** atarlov has quit IRC | 22:16 | |
| *** atarlov has joined #tripleo | 22:16 | |
| mwhahaha | It should run on an update as we reapply stuff (I think) | 22:17 |
| Wisch | @mwhahaha in my test environment it is making it on to step 4(3?) and failing when attempting to run the octavia db_sync | 22:18 |
| * mwhahaha shrugs | 22:18 | |
| mwhahaha | I think there was a bug about the MySQL init task for containers | 22:19 |
| mwhahaha | It may not have been backported to Pike yet | 22:19 |
| *** atarlov has quit IRC | 22:20 | |
| *** yolanda_ has joined #tripleo | 22:21 | |
| mwhahaha | Wisch: might be https://review.openstack.org/#/c/574263/ | 22:21 |
| *** yolanda__ has quit IRC | 22:24 | |
| Wisch | reading.. | 22:24 |
| *** bnemec has quit IRC | 22:29 | |
| *** bnemec has joined #tripleo | 22:35 | |
| *** ansmith has joined #tripleo | 22:35 | |
| Wisch | @mwhahaha thanks for the tip, I manually applied this change, running stack update now: https://review.openstack.org/#/c/567816/ | 22:36 |
| *** threestrands has joined #tripleo | 22:38 | |
| *** threestrands has quit IRC | 22:38 | |
| *** threestrands has joined #tripleo | 22:38 | |
| *** dsneddon has quit IRC | 22:39 | |
| *** dsneddon has joined #tripleo | 22:41 | |
| *** rlandy has quit IRC | 22:49 | |
| *** dsneddon has quit IRC | 22:50 | |
| *** atarlov has joined #tripleo | 22:53 | |
| *** hjensas is now known as hjensas|afk | 22:54 | |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Switch the undercloud to be containerized by default https://review.openstack.org/576218 | 23:08 |
| *** tosky has quit IRC | 23:08 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 23:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 23:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 23:10 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Switch the undercloud to be containerized by default https://review.openstack.org/576218 | 23:12 |
| *** dsneddon has joined #tripleo | 23:22 | |
| *** owalsh_ has joined #tripleo | 23:25 | |
| *** owalsh- has joined #tripleo | 23:25 | |
| *** owalsh| has joined #tripleo | 23:26 | |
| *** owalsh^ has joined #tripleo | 23:27 | |
| *** owalsh has quit IRC | 23:29 | |
| *** owalsh_ has quit IRC | 23:29 | |
| *** owalsh- has quit IRC | 23:31 | |
| *** owalsh| has quit IRC | 23:31 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/pike: Always run mysql init bundle https://review.openstack.org/578229 | 23:32 |
| *** mjturek has joined #tripleo | 23:35 | |
| *** owalsh has joined #tripleo | 23:36 | |
| *** rpioso is now known as rpioso|afk | 23:36 | |
| *** owalsh^ has quit IRC | 23:36 | |
| *** Wisch has left #tripleo | 23:43 | |
| *** owalsh_ has joined #tripleo | 23:46 | |
| *** mcornea has quit IRC | 23:48 | |
| *** owalsh has quit IRC | 23:49 | |
| *** mjturek has quit IRC | 23:54 | |
| *** atarlov has quit IRC | 23:55 | |
| *** owalsh has joined #tripleo | 23:57 | |
| *** mjturek has joined #tripleo | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!