Friday, 2017-05-26

openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027700:00
openstackgerritMerged openstack/paunch master: Add --ipc support  https://review.openstack.org/46812400:00
*** morazi has quit IRC00:02
*** itlinux has joined #tripleo00:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019500:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037300:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]00:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)00:10
*** atheurer has quit IRC00:10
openstackgerritSteve Baker proposed openstack/puppet-tripleo master: Ensure hiera step value is an integer  https://review.openstack.org/46655600:19
*** atheurer has joined #tripleo00:21
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use networkx for digraph  https://review.openstack.org/46741900:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Adding unit testing for configuration  https://review.openstack.org/46695900:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add a more generic tree->graph parser  https://review.openstack.org/46541700:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move create_graph into config.py  https://review.openstack.org/46822400:41
*** itlinux has quit IRC00:42
*** karthiks has quit IRC00:53
*** dixiaoli has joined #tripleo00:56
*** karthiks has joined #tripleo00:57
*** rlandy has quit IRC01:05
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019501:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037301:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)01:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]01:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)01:10
*** dixiaoli has quit IRC01:14
*** itlinux has joined #tripleo01:34
*** itlinux has quit IRC01:38
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019502:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037302:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)02:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]02:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)02:10
*** tzumainn has quit IRC02:25
*** dmacpher has joined #tripleo02:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: [WIP] Deploy Ceph using ceph-ansible via external workflow  https://review.openstack.org/46506602:35
*** gvrangan has joined #tripleo02:40
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides a list of per-service ctlplane IPs to the workflows env  https://review.openstack.org/46768202:41
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: [WIP] Deploy Ceph using ceph-ansible via external workflow  https://review.openstack.org/46506602:45
*** gvrangan has quit IRC02:47
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Upgrade gnocchi without skip-storage  https://review.openstack.org/46816502:51
*** gvrangan has joined #tripleo02:52
*** pmannidi has joined #tripleo03:06
*** gvrangan has quit IRC03:07
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019503:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037303:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]03:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)03:10
*** pradk has quit IRC03:11
*** gvrangan has joined #tripleo03:12
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides a list of per-service ctlplane IPs to the workflows env  https://review.openstack.org/46768203:12
*** gvrangan has quit IRC03:16
*** psahoo has joined #tripleo03:34
*** gvrangan has joined #tripleo03:35
*** gvrangan has quit IRC03:38
*** skramaja has joined #tripleo03:56
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019504:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037304:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)04:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]04:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)04:10
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides a list of per-service ctlplane IPs to the workflows env  https://review.openstack.org/46768204:11
*** ykarel has joined #tripleo04:21
*** mdnadeem has joined #tripleo04:27
*** gfidente has quit IRC04:55
*** ramishra has joined #tripleo05:01
*** janki has joined #tripleo05:04
*** prateek has joined #tripleo05:07
*** prateek has quit IRC05:07
*** prateek has joined #tripleo05:08
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019505:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013205:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037305:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]05:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)05:10
*** jaganathan has quit IRC05:12
*** jaganathan has joined #tripleo05:13
*** jaganathan has quit IRC05:18
*** prateek has quit IRC05:18
*** ratailor has joined #tripleo05:28
*** yprokule has joined #tripleo05:29
*** yolanda has joined #tripleo05:32
*** iranzo has joined #tripleo05:34
*** iranzo has joined #tripleo05:34
*** lmiccini has joined #tripleo05:42
*** pcaruana has joined #tripleo05:43
*** dj_ has joined #tripleo05:49
dj_Hi, I want to configure multi nic bonding.05:50
dj_I am working on RHOSP10 and created custom networks05:50
dj_I am using heat template specified under network/config/bond-with-vlans05:51
*** dparkes has joined #tripleo05:51
*** jaganathan has joined #tripleo05:51
dj_The bond mode used is balance-tcp other_config:lacp-time=fast lacp=passive05:52
dj_can anyone suggest is there any other configuration or template change need for bonding05:53
dj_At the switch level, lacp has been enabled05:53
*** prateek has joined #tripleo06:08
openstackgerritSaravanan KR proposed openstack/tripleo-common master: WIP: Move passwords from mistral environment to swift environment  https://review.openstack.org/46790906:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019506:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037306:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]06:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)06:10
*** rcernin has joined #tripleo06:10
*** udesale has joined #tripleo06:12
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Modify PreNetworkConfig config inline with role-specific parameters  https://review.openstack.org/44705106:12
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Enable DPDK on boot using PreNetworkConfig  https://review.openstack.org/46749006:12
*** ebarrera|OoO has joined #tripleo06:14
*** ebarrera|OoO has quit IRC06:16
*** ebarrera has joined #tripleo06:16
*** jprovazn has joined #tripleo06:21
openstackgerritMartin AndrĂ© proposed openstack/puppet-tripleo master: Restart docker after changing storage driver  https://review.openstack.org/46820106:24
*** matbu|dayoff is now known as matbu06:25
*** karthiks has quit IRC06:28
yolandahi bnemec , thanks for your feedback. I added some comments so you can give me more advice depending on it06:39
yolandaas the image generated by diskimage-builder has a fixed size, it will be the same specifying the sizes on percentages or absolute numbers, because what will be used anyway is the fixed disk image size. The idea is to ship at least some image that works, and customers could resize on production depending on their disks06:40
skramajad0ugal: if you have few mins, i wanted to discuss regarding https://review.openstack.org/#/c/456469/, where we need your eyes..06:41
yolandait is important to have these partitions/volumes for security, and we have some use cases of people already using it, with some workarounds06:41
openstackgerritMerged openstack/diskimage-builder master: Adding unit testing for configuration  https://review.openstack.org/46695906:45
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Support arbitrary nat network order  https://review.openstack.org/46257106:48
d0ugalskramaja: sure!06:58
d0ugalskramaja: do you want me just to review it?06:59
skramajad0ugal: there are a series of patches which we are planning for deriving heat parameters from the introspection data.06:59
d0ugalright06:59
*** cylopez has joined #tripleo06:59
skramajad0ugal: yes, i wan to set the background for it. because ther are few more coming soon.07:00
d0ugalskramaja: k07:00
skramajad0ugal: there will be 3 sublevel workflows from the main workflow.07:00
skramajad0ugal: and the main workflow will have loop for to run the sub workflows for each role.07:01
skramajad0ugal: the way we capture the parameters is kind of something which we would want to know if this is right approch.07:02
skramajad0ugal: the way we caputre messages for failures i meant.07:02
d0ugalRight07:02
d0ugalthat can be a bit tricky07:03
skramajad0ugal: if you want to know more about how the final workflow will look like, here is the sample -https://review.openstack.org/#/c/450022/1/workbooks/derive_params.yaml07:03
skramajad0ugal: this is abandoned. but just created for discussing with the team.07:03
*** dmacpher has quit IRC07:04
skramajad0ugal: jaganathan and abishop are the main developers working it.07:05
d0ugalskramaja: cool, thanks07:05
d0ugalskramaja: I see part 1 and 2 - are there other patches I should review at the same time now?07:05
*** dj_ has quit IRC07:06
skramajad0ugal: there are the base patches which are ready as of now.07:06
d0ugalskramaja: k, I'll start going through them :)07:06
*** jaosorior has joined #tripleo07:06
skramajad0ugal: the following patches will be specific to features - dpdk and hci. which are not yet ready.07:06
skramajad0ugal: i will update you when those are in good shape.07:06
*** shardy has joined #tripleo07:07
*** pgadiya has joined #tripleo07:07
skramajad0ugal: and thanks for you batch introspection workflow, where we learn few things and implemented in our workflows.07:07
d0ugalGreat, happy to help :)07:07
*** bogdando has joined #tripleo07:07
*** jlinkes has joined #tripleo07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037307:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)07:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]07:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)07:10
*** pgadiya has quit IRC07:10
*** karthiks has joined #tripleo07:10
*** suuuper has joined #tripleo07:10
*** ratailor has quit IRC07:12
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Support arbitrary nat network order  https://review.openstack.org/46257107:14
*** ratailor has joined #tripleo07:14
*** athomas has joined #tripleo07:18
*** ratailor has quit IRC07:22
*** ratailor has joined #tripleo07:24
*** egonzalez has joined #tripleo07:27
bogdandohello folks07:29
bogdandolet's merge https://review.openstack.org/#/c/468097/ please07:29
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Do not merge: Test Featureset 021  https://review.openstack.org/46547607:29
*** jpena|off is now known as jpena07:33
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Do not merge - Testing featureset020  https://review.openstack.org/46500307:39
*** sri_ has joined #tripleo07:41
*** pmannidi has quit IRC07:43
*** amoralej|off is now known as amoralej07:45
*** bkopilov has quit IRC07:47
sri_Hello there ! I've setup my undercloud of our cloud i want to test with vms and VirtualBMC , I have a couple of physical server  that don't suport IPMI so inside those server's I have launch a kvm virtual machine in bridge network, using VirtualBMC and IPMI tool I can power and and off the virtual machine after that I loaded the that node into ironic , but Ironic not able to get the power state of that vm07:47
*** paramite has joined #tripleo07:48
*** openstackgerrit has quit IRC07:48
*** openstackgerrit has joined #tripleo07:48
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Disable recommended package installations for zypper-minimal  https://review.openstack.org/46830007:48
*** aufi has joined #tripleo07:52
*** sshnaidm is now known as sshnaidm|off07:55
*** karthiks has quit IRC07:59
*** zzzeek has quit IRC08:00
*** zzzeek has joined #tripleo08:00
*** karimb has joined #tripleo08:01
*** tvignaud_pto has quit IRC08:02
*** zoli|gone is now known as zoli08:02
*** jpich has joined #tripleo08:03
sri_Hello there ! I've setup my undercloud for overcloud i want to test with vms and VirtualBMC , I have a couple of physical server  that don't suport IPMI so inside those server's I have launch a kvm virtual machine in bridge network, using VirtualBMC and IPMI tool I can power on and off the virtual machine after that I loaded the that node into ironic , but Ironic not able to get the power state of that vm any help ?08:03
*** gfidente has joined #tripleo08:04
*** gfidente has quit IRC08:04
*** gfidente has joined #tripleo08:04
*** dbecker has joined #tripleo08:06
shardysri_: how can a VM running on a machine power it on?08:06
gfidentemorning08:07
sri_@shardy I use VirtualBMC08:07
shardysri_: previously I've used the fake_pxe driver which works OK, IIRC the ramdisk shuts the machine down then you have to manually power it on again08:08
sri_@shardy using this command I can power on and off the vm (192.168.15.12 is my server where I am running vms ) ipmitool -I lanplus -U admin -P password -H 192.168.15.12 -p 6230 power on08:09
shardysri_: Ah you're running VMs on the host, not trying to control the power state of the baremetal box08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019508:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037308:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]08:10
sri_@shardy Yes08:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)08:10
shardysri_: dtantsur|afk may be able to help when he's around08:10
sri_@shardy Thanks08:11
d0ugalskramaja: how will this workflow be called? by t-h-t?08:11
skramajad0ugal: from the tripleoclient.08:12
d0ugalskramaja: aha, so it will be an optional step that users can do to automatically populate these parameters?08:12
skramajad0ugal: https://review.openstack.org/#/c/457874/2/environments/derive-params/plan_environment_derive_params.yaml08:12
skramajad0ugal: yes, it will be optional. we will have it configure in the plan-environement.08:13
*** karthiks has joined #tripleo08:13
skramajad0ugal: a new option -p will be added for overcloud deploy and overcloud plan create (possibliy)08:13
skramajad0ugal: based on the workflow specified in the plan-environment, the workflows will be invoked.08:14
d0ugalskramaja: right, makes sense. thanks08:14
d0ugalskramaja: so I guess the plan create workflow will eventually trigger this workflow if it is turned on?08:14
skramajad0ugal: i have to update the above patch based on the discussion we had on it. which will change the parameter passing a bit.08:14
d0ugalskramaja: i.e. we could have a flag like we do for password generation: https://github.com/openstack/tripleo-common/blob/master/workbooks/plan_management.yaml#L1508:15
*** tvignaud_pto has joined #tripleo08:15
skramajad0ugal: coupling it with workflow itself, there is a drawback. if users want to change the workflow parameter and then derive it, we want to provide an option. thats the reason we will invoke directly from client.08:16
d0ugalskramaja: okay, makes sense.08:16
d0ugalskramaja: I guess we need to make sure the GUI knows about it too then :)08:16
skramajad0ugal: like UI can provide the list of derived parameters to user for approval.08:16
skramajad0ugal: yes we discussed (with jtomasek) it in the above patch on how we should make it available to UI08:17
skramajad0ugal: there are some things which are not taken care in the first pass, like exposing the workflow parameters and its possible values to UI.08:18
*** lucas-afk is now known as lucasagomes08:18
d0ugalskramaja: right, that's fine. thanks08:18
* d0ugal is slowly catching up08:18
*** sshnaidm|off has quit IRC08:18
skramajathanks08:18
*** skramaja is now known as skramaja_afk08:19
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Create ansible playbook via upgrade tasks for manual upgrade  https://review.openstack.org/44422408:28
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Create ansible playbook via upgrade tasks for manual upgrade  https://review.openstack.org/44422408:29
*** masco has joined #tripleo08:32
shardyhttps://review.openstack.org/#/c/465449/ https://review.openstack.org/#/c/465560/08:36
shardyIf anyone can please review those I'd appreciate it08:36
*** skramaja_afk is now known as skramaja08:36
*** masco has quit IRC08:37
*** derekh has joined #tripleo08:38
openstackgerritBogdan Dobrelya proposed openstack/tripleo-specs master: Best practices for logging of containerized services  https://review.openstack.org/46290008:38
*** eck` is now known as eck`gone08:41
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: [NO MERGE] test multinode containers  https://review.openstack.org/46710008:44
sri_@shardy: is there any other way I can test Overcloud without BMC hardware support ?08:45
*** ckyriakidou has joined #tripleo08:45
*** ubijtsa has joined #tripleo08:47
*** ubijtsa has joined #tripleo08:47
shardysri_: have you tried tripleo-quickstart?  I will set up VMs on a single host including the virtualbmc stuff08:47
*** ubijtsa is now known as assassin08:48
shardysri_: or if you want to use baremetal you can use fake_pxe08:48
openstackgerritMerged openstack/tripleo-heat-templates master: Align optional services with optional services-docker  https://review.openstack.org/46809708:49
shardyhttps://docs.openstack.org/developer/tripleo-quickstart/08:49
skramajawould be happy to hear feedback on role-specific params doc - https://review.openstack.org/#/c/465028/08:52
sri_@shardy : Yep I tested tripleo-quickstart.08:53
*** masco has joined #tripleo08:54
openstackgerritRajat Sharma proposed openstack/tripleo-common master: Use assertIsNone instead of assertEqual(None, ***)  https://review.openstack.org/46831808:55
sri_@shardy: If I run all my vms in single server it's works fine , undercloud and overcloud, Right now I have five physical server In one of the server I install the undercloud If my hardware suports IPMI everything would fine but It dont suport IPMI that's I was trying the way I am doing08:57
*** hewbrocca_afk is now known as hewbrocca08:59
sri_@Shardy I will look into fake_pxe , I have one question if i use fake_pxe I don't need to setup OS in my physical server ?09:01
shardysri_: Yes Ironic can pxe boot the nodes and deploy the OS image on them, but you would need a separate provisioning network, e.g two nics on the undercloud09:07
shardyI have done it with a laptop undercloud, use the ethernet connected to an old switch as the provisioning lan09:08
shardyand the wireless as the public interface09:08
shardysri_: there are other ways to use multiple hosts for testing, but they're not really well documented09:08
shardye.g some folks run a local OVB environment, where you deploy tripleo on openstack, and the VMs act as baremetal09:09
shardyAlso I know mhenkel did this which is an alternative approach:09:09
shardyhttps://github.com/michaelhenkel/tripleo-fabric-ansible09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013209:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037309:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)09:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]09:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)09:10
sri_@shardy: thank you very much09:11
shardysri_: https://docs.openstack.org/developer/tripleo-docs/environments/virtualbmc.html has details about virtualbmc, and I think your approach of running VMs on multiple hosts with it should work09:11
shardyI've just not tried that myself09:12
sri_@shardy : I following the same doc's  https://docs.openstack.org/developer/tripleo-docs/environments/virtualbmc.html , I will try with fake_pxe.09:13
sri_I can register the node into Ironic but it's not  getting power state ``` (undercloud) [stack@undercloud ~]$ ironic node-list +--------------------------------------+------+---------------+-------------+--------------------+-------------+ | UUID                                 | Name | Instance UUID | Power State | Provisioning State | Maintenance | +--------------------------------------+------+---------------+-------------+---------09:14
sri_745e02a1-4fd6-41f4-b6fa-99160fa6c4ee | test | None          | None        | enroll             | False09:15
shardysri_: I assume you've opened ports in the firewall etc to enable the undercloud to connect to the virtualbmc on the other nodes?09:18
sri_@shardy : Yes I did09:20
sri_I can run the IPMI management commnds from undercloud , It's talking to vms09:22
shardysri_: ack, need dtantsur|afk to advise on debug steps then I think, sounds like you're pretty close to having it working :)09:23
*** masco has quit IRC09:27
sri_@shardy: I will try to talk to dtantsur|afk ,i really appreciate your help.09:28
*** zoli is now known as zoli|lunch09:29
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Providing parameters specific to a workflow via plan-environment  https://review.openstack.org/45787409:39
*** salmankhan has joined #tripleo09:42
*** mcornea has joined #tripleo10:05
bogdandofolks, my overcloud deployment on openstack pre-provisioned nodes journey continues, and now I have this blocker "Failed to find action [action_name=tripleo.plan.list]" https://pastebin.com/XVwGgs5d any help with missing extras role included to my play?10:06
bogdandoit seems it wants a deployment plan?10:06
bogdandowhat creates it normally before/in the process of doing "openstack deploy overcloud", for quickstart?10:07
bogdandomy play is here https://github.com/bogdando/oooq-warp/blob/master/oooq-traas-over.yaml (WIP, ugly a little bit)10:08
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/46796710:08
bogdandoand, a "featureset" https://github.com/bogdando/oooq-warp/blob/master/vars/overcloud-traas.yaml10:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019510:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013210:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037310:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]10:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)10:10
*** panda|bbl is now known as panda10:11
*** salmankhan has quit IRC10:17
*** milan has joined #tripleo10:21
*** masco has joined #tripleo10:23
*** masco has quit IRC10:24
*** rook has quit IRC10:27
*** sai has quit IRC10:27
*** lucasagomes has quit IRC10:27
*** lucasagomes has joined #tripleo10:29
*** sai has joined #tripleo10:30
*** rook has joined #tripleo10:30
*** jkilpatr has quit IRC10:30
*** rook is now known as Guest766710:30
*** pkovar has joined #tripleo10:31
*** milan has quit IRC10:39
*** lucasagomes has quit IRC10:41
*** Guest7667 has quit IRC10:41
*** sai has quit IRC10:42
ebarreraping tripleo, FYI bug reported by the customer when deploying with linux bonding LACP OSP11 https://bugzilla.redhat.com/show_bug.cgi?id=145586510:42
openstackbugzilla.redhat.com bug 1455865 in openstack-tripleo-heat-templates "Deployment on OSP11 with linux bonding fails" [Unspecified,New] - Assigned to emacchi10:42
*** sshnaidm|off has joined #tripleo10:43
*** zoli|lunch is now known as zoli10:47
*** cylopez has quit IRC10:51
*** jkilpatr has joined #tripleo10:52
*** adarazs is now known as adarazs_lunch10:53
*** rook_ has joined #tripleo10:53
*** lucasagomes has joined #tripleo10:54
*** dtantsur|afk is now known as dtantsur10:55
*** sai has joined #tripleo10:56
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: Derive Params (part 1): Initial workflow to start  https://review.openstack.org/45646910:56
dtantsursri_: nodes in "enroll" state do not get power state updated automatically. did you try any power actions with ironic? or did you try moving nodes to manageable state?10:58
*** eck`gone is now known as eck`11:02
*** shardy has quit IRC11:03
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: Derive Params (part 1): Initial workflow to start  https://review.openstack.org/45646911:04
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019511:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013211:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037311:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)11:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]11:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)11:10
*** ansmith has quit IRC11:10
*** rwsu has quit IRC11:11
*** rhallisey has joined #tripleo11:13
sri_dtantsur_: I try to set power state from Ironic , It's not doing anything11:14
sri_(undercloud) [stack@undercloud ~]$ ironic node-set-power-state test on11:14
dtantsursri_: errors in logs? anything in node's last_error field?11:14
gfidenteflaper87 which version of ansible added support for inventory in yaml format?11:15
*** lucasagomes is now known as lucas-hungry11:17
sri_dtantsur_: tail /var/log/ironic/ironic-conductor.log11:17
sri_[root@undercloud stack]# tail /var/log/ironic/ironic-conductor.log  2017-05-26 08:13:39.415 24350 DEBUG ironic.conductor.task_manager [req-ca62a503-4649-4806-ad2a-d56173a41331 - - - - -] Successfully released shared lock for power state sync on node 745e02a1-4fd6-41f4-b6fa-99160fa6c4ee (lock was held 0.02 sec) release_resources /usr/lib/python2.7/site-packages/ironic/conductor/task_manager.py:352 2017-05-26 08:13:39.498 24350 DEBUG fu11:17
sri_2017-05-26 08:14:39.375 24350 DEBUG futurist.periodics [-] Submitting periodic callback 'ironic.conductor.manager.ConductorManager._sync_power_states' _process_scheduled /usr/lib/python2.7/site-packages/futurist/periodics.py:63911:17
sri_2017-05-26 08:14:39.414 24350 DEBUG ironic.conductor.task_manager [req-ca62a503-4649-4806-ad2a-d56173a41331 - - - - -] Attempting to get shared lock on node 745e02a1-4fd6-41f4-b6fa-99160fa6c4ee (for power state sync) __init__ /usr/lib/python2.7/site-packages/ironic/conductor/task_manager.py:22511:18
sri_2017-05-26 08:14:39.435 24350 DEBUG ironic.conductor.task_manager [req-ca62a503-4649-4806-ad2a-d56173a41331 - - - - -] Successfully released shared lock for power state sync on node 745e02a1-4fd6-41f4-b6fa-99160fa6c4ee (lock was held 0.02 sec) release_resources /usr/lib/python2.7/site-packages/ironic/conductor/task_manager.py:352 2017-05-26 08:14:39.500 24350 DEBUG futurist.periodics [-] Submitting periodic callback 'ironic.drivers.mo11:18
dtantsurcould you please look for *errors*?11:18
sri_clear11:21
dtantsursri_: ok, please try moving the node to "manageable" state. that will either succeed or fail with populating last_error11:23
yolandahi bnemec , when you are around can you ping me, so we can talk about https://review.openstack.org/#/c/449122/ ?11:24
sri_dtantsur_: NodeLocked: Node 745e02a1-4fd6-41f4-b6fa-99160fa6c4ee is locked by host localhost.localdomain, please retry after the current operation is completed.  format_exception /usr/lib/python2.7/site-packages/wsme/api.py:22211:24
sri_localhost.localdomain where I am running my vms11:24
dtantsurok, so it seems that your node vBMC takes too long to respond. I suspect it's not reachable11:24
sri_I can talk to Vbmc using ipmimanagent tool11:25
sri_i can power on or off11:25
*** udesale has quit IRC11:25
*** rwsu has joined #tripleo11:27
dtantsurRDO Cloud is a community facing semi-public [2] cloud that is primarily used for:11:29
dtantsur    Development and testing of RDO and RHOSP distributions11:29
dtantsurwut?11:29
dtantsurwhat the hell is in my paste buffer?11:29
dtantsurok, let's try again11:30
dtantsursri_: from a different machine? because it seems like the machine where ironic is cannot do it11:30
sri_dtantsur_: Yes it's different machine11:30
dtantsursri_: so, the first step is to make sure you can use the same ipmitool command that ironic uses from the same machine where ironic is11:31
sri_dtantsur_: I can run this form my undercloud it's talking powering on vm ipmitool -I lanplus -U admin -P password -H 192.168.15.12 -p 6230 power on11:33
dtantsursri_: make sure it's the same command ironic uses (you can check in the logs, grepping by 'ipmitool'). there is a difference in how it passes the password, but everything else should be the same11:34
*** skramaja has quit IRC11:37
*** bfournie has quit IRC11:37
sri_dtantsur_: I think I know the problem IPMImanagement tool trying to talk to different ip address11:38
dtantsursri_: then please check pm_addr fields in your instackenv.json (or directly check ipmi_address on nodes)11:39
sri_Yes I am doing it now11:39
*** abishop has joined #tripleo11:41
sri_@dtantsur_: it's worked , thanks11:46
*** cylopez has joined #tripleo11:47
*** adarazs_lunch is now known as adarazs11:48
dtantsurcool11:52
*** dprince has joined #tripleo11:53
*** morazi has joined #tripleo11:54
rnoriegaHi!! does anybody have a cycle for a review¿? https://review.openstack.org/#/c/467124/11:56
rnoriegait's very simple. Just a env file to point BGPVPN service plugin to networking-odl11:56
openstackgerritLukas Bezdicka proposed openstack/tripleo-common stable/newton: Fix Swift ring deployment and Newton to Ocata upgrades  https://review.openstack.org/46838911:57
openstackgerritAlan Bishop proposed openstack/tripleo-common master: Derive Params (part 2): Get services and feature list  https://review.openstack.org/45647111:57
radezdtantsur: ping, hey there, I tried to use the enable_ipxe = false both with and without setting the node boot_mode to uefi and linking ipxe.efi or pxelinux.0 to the grub image12:00
openstackgerritJaganathan Palanisamy proposed openstack/python-tripleoclient master: WIP: Optional override of the plan environment file  https://review.openstack.org/46839012:00
radezboth ways I only got the ipxe cfg generated. any ideas what I might be missing?12:01
*** d0ugal has quit IRC12:02
openstackgerritJaganathan Palanisamy proposed openstack/python-tripleoclient master: WIP: Optional override of the plan environment file  https://review.openstack.org/46839012:03
*** jobcespedes has quit IRC12:04
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Containerized nova-compute working with Deployed Server  https://review.openstack.org/46839112:04
radezdtantsur: oh, actually , I see the config in the hash dir doesn't start with #!ipxe now? but grub doesn't like that config file12:05
*** noslzzp has joined #tripleo12:05
dtantsurwhat exactly it does not like?12:05
radezhttps://paste.fedoraproject.org/paste/2NeEsyzdDrO6INHvL80lxV5M1UNdIGYhyRLivL9gydE=12:06
radeztop is from the console, bottom is the config file12:06
radezalso had to hardcode configfile d2dde084-f0ab-4a1c-afb5-db3f9552e852/config12:08
dtantsurradez: I suspect it's not a grub file, lemme double-check12:08
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: [NO MERGE] test multinode containers  https://review.openstack.org/46710012:08
radezinto grub.conf, the ip.conf file didn't get genereated12:08
dtantsurradez: did you set UEFI capability on the flavor as well?12:08
radezdtantsur: this is with uefi turned off, If I turn it on it generates ipxe config files12:09
dtantsurradez: even with enable_ipxe=false? Oo (please double-check in ironic.conf)12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019512:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013212:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037312:10
*** ooolpbot has quit IRC12:10
radezyes even with enable_ipxe=false12:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]12:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)12:10
radezdtantsur: I double checked ironic.conf too12:10
*** ansmith has joined #tripleo12:11
*** bfournie has joined #tripleo12:14
* dtantsur is confused now..12:15
dtantsurare you sure these are iPXE files?12:15
radezdtantsur: if you have the time we can get on a bjs and tmux to the box to fiddle with it12:16
dtantsurnot today, unfortunately. I'm not feeling well, and I'm afraid I'm going to be useless..12:16
radeznp12:16
dtantsurradez: could you please send me, if you can, the detailed breakdown of what you've tried doing? I'm going to reflect on it a bit, check the source code, etc12:17
radezdtantsur: you bet, I'll make sure I can dupicate the results and put it into and email to you today12:17
dtantsurthanks!12:17
radezthx for your help, I hope you feel better12:17
*** pradk has joined #tripleo12:18
*** d0ugal has joined #tripleo12:19
*** cylopez has quit IRC12:19
bogdandosigh... something is deeply broken to my undercloud:12:19
bogdandosudo docker exec -it mistral_engine python -c 'import tripleo_common.actions.plans'12:19
bogdando(ImportError: No module named tripleo_common.actions.plans)12:19
jaosoriorbandini: Is there any way that I can know if a controller is binding to the VIP? at a certain point?12:20
*** sshnaidm|off has quit IRC12:20
jaosoriordciabrin: ^^12:21
bogdandofolks, how come I got this error? https://github.com/openstack/tripleo-common/blob/master/container-images/tripleo_kolla_template_overrides.j2#L9-L10 ...12:23
bogdandoI deploy with default images12:23
bogdandoand there is no tripleo_common in the mistral_engine container :/12:24
*** d0ugal has quit IRC12:24
openstackgerritJulie Pichon proposed openstack/tripleo-common master: Parse roles from roles_data.yaml directly  https://review.openstack.org/46767812:25
*** thrash|g0ne is now known as thrash12:25
jaosoriorbogdando: is the library actually there? what does the openstack-tripleo-common-container-base actually install? seems like what you really need is openstack-tripleo-common12:25
bogdandojaosorior: it seems I posted bad lines, here it is for mistral https://github.com/openstack/tripleo-common/blob/master/container-images/tripleo_kolla_template_overrides.j2#L1412:26
bogdandoand #1512:27
jaosoriorbogdando: go into the image and verify if the library is actually there.12:27
*** dciabrin has quit IRC12:27
jaosoriorbogdando: just to rule out an error in the python path12:27
bogdandojaosorior: nope, it's not12:29
bogdandoso it seems I've got a wrong build of containers, somehow12:30
bogdandoalso, at my env there is still devicemapper docker and local registry didn't function :/12:30
bogdandobut those are minor issues...12:30
*** lucas-hungry is now known as lucasagomes12:31
*** jpena is now known as jpena|lunch12:33
jaosoriorbogdando: make sure that you use the containers-default-parameters.yaml environment generated by oooq12:33
jaosoriorbogdando: and that you set that up after the docker environment12:33
jaosoriorbogdando: docker.yaml overrides the registry, I had that issue before.12:33
*** trown|outtypewww is now known as trown12:34
bogdandojaosorior: yeah, I have it in the home dir12:34
*** ecerquei has joined #tripleo12:35
bogdandoMy custom play and featureset vars:12:35
bogdandohttps://github.com/bogdando/oooq-warp/blob/master/oooq-traas-under.yaml12:35
bogdandohttps://github.com/bogdando/oooq-warp/blob/master/vars/undercloud-traas.yaml12:35
bogdandoI have commented custom registry in docker.yaml. It comes from recent fixes IIRC12:36
trownpanda: adarazs mind looking at https://review.openstack.org/#/q/topic:bug/1680195 the quickstart patch with the depends-on actually has ovb-ha-oooq job passing on it which is much better than http://tripleo.org/cistatus.html12:37
adarazstrown: oh right, sorry. I didn't have time to +2 them yesterday :/12:37
*** rlandy has joined #tripleo12:37
bogdandojaosorior: but yeah, my logged undercloud deploy cmd is missing the containers-default-parameters.yaml12:38
*** d0ugal has joined #tripleo12:38
bogdandothanks!12:38
trownadarazs: no worries I had the THT patch a bit wrong until very late your time last night :)12:38
bogdandonot sure why it installed bad containers w/o tripleo_common for mistral tho12:38
*** ccamacho is now known as ccamacho|lunch12:38
adarazstrown: I'm not sure I'm supposed to +2 THT patches, even though we're just adding files, so it can't really hurt.12:39
bogdandojaosorior: oh, the containers-default-parameters.yaml is used with only overcloud deploy, right?12:40
*** artom has quit IRC12:41
jaosoriorbogdando: no idea dude12:42
jaosoriorbogdando: I haven't used undercloud deploy yet12:42
jaosoriorbut maybe next week I'll need to play around with it12:42
jaosoriorbogdando: I will unfortunately poke you a lot :D12:42
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Handle upgrading cinder-volume under pacemaker  https://review.openstack.org/46728012:42
bogdandojaosorior: haha, you're welcome12:43
jaosorioranybody with some HA knowledge that can help?12:44
bogdandojaosorior: I'm afraid though that going the tripleo-ci devmode/containers multinode path would be easier, faster, all but simple to understand =)12:45
jaosoriorbogdando: what do you mean?12:46
bogdandojaosorior: so I took an opposite road, the simple to understand and use, not easy to deploy something, yet! )12:46
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: TEST ONLY: Check telemetry container upgrades  https://review.openstack.org/46762112:46
bogdandojaosorior: I mean that deploying with 'undercloud deploy' much easier with tripleo-ci scripts and featuresets12:47
bogdandothan trying only ansible plays and custom vars12:47
bogdando(and the latter is exactly that I'm trying so far)12:47
bogdandogood news, undercloud deploy - my way doing it - works for me, locally libvirt and at RDO cloud12:48
jaosoriorbogdando: nice12:48
jaosoriorso, what I'll try to do is add a new containerized service to the undercloud12:48
bogdandobad news, overcloud deploy looks so far away yet12:48
jaosoriorso lets see12:49
*** dtantsur is now known as dtantsur|brb12:49
bogdandojaosorior: so yeah, poke me if you want deploy it using quickstart roles. And I will help with that I've learnt so far12:50
bogdandobut if you prefer tripleo-ci.sh or quickstart.sh, I couldn't help much12:50
adarazscould somebody who's qualified to +2 THT changes take a look at this simple addition? https://review.openstack.org/46803112:51
adarazsit's to disable telemetry.12:51
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: ovb playbook: add task to delete overcloud  https://review.openstack.org/46374012:53
bogdandojaosorior: I have deployed my containers from12:53
bogdandodocker_registry_mirror = http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org:8081/registry-1.docker12:53
bogdandoso is it a bad path?..12:54
jaosoriorbogdando: no idea dude, depends on what you wanted to do :)12:54
jaosoriorbogdando: so first of all, I have no clue if that path works12:54
trownbnemec: mind looking at  https://review.openstack.org/#/c/468031/ again... it actually works now :P12:54
bogdandoum, deploy containers12:54
jaosoriorbogdando: second of all, if you wanted to deploy from a local registry, then that's not what you wanted12:54
bogdandofrom fastest mirror12:54
bogdandojaosorior: errr, so those two shall not be used simultaneously : undercloud_docker_registry_mirror and DockerNamespace from containers-default-parameters.yaml?12:57
adarazstrown: seems like we got our 2x+2, I see the ovb-updates failing on it, but I assume it's irrelevant, so you can +w if you're confident about waiving that.12:57
*** lblanchard has joined #tripleo12:57
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool  https://review.openstack.org/42334012:57
*** Goneri has joined #tripleo12:58
pandado we already have project-config files in single project, ready for zuul v3 ?12:58
*** lblanchard has quit IRC12:59
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: create history for the overcloud deploy command  https://review.openstack.org/44661713:01
*** karthiks has quit IRC13:01
*** gvrangan has joined #tripleo13:02
*** chlong has joined #tripleo13:06
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Container-specific variants of scenarios 001-004  https://review.openstack.org/46594613:08
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019513:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013213:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037313:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]13:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)13:10
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: [NO MERGE] testing container scenarios  https://review.openstack.org/46669913:10
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: [NO MERGE] testing container upgrade scenarios  https://review.openstack.org/46629013:10
*** psahoo has quit IRC13:10
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: create history for the overcloud deploy command  https://review.openstack.org/44661713:11
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: Create configuration for periodic jobs in featureset002  https://review.openstack.org/46373913:12
mcorneajistr: hey! I've just did an undercloud upgrade attempt and hit this bug: https://bugs.launchpad.net/tripleo/+bug/1693790  Does it look familiar to you?13:12
openstackLaunchpad bug 1693790 in tripleo "Ocata -> Pike undercloud upgrade fails: Reason: object.__new__(thread.lock) is not safe, use thread.lock.__new__()" [Critical,New]13:12
trownadarazs: ya we only touch featureset001... maybe I should also add it to the updates featureset though... we can do that in a follow-up if it really does help ha maybe?13:12
*** trown is now known as trown|brb13:13
adarazstrown|brb: yeah, let's do it in another change.13:13
*** karthiks has joined #tripleo13:13
*** rhallisey has quit IRC13:13
*** pchavva has joined #tripleo13:14
jistrmcornea: hi! it doesn't look familiar unfortunately... there's no mention of locking in instack-undercloud or tripleo-common it seems, i guess the problem must be coming from some dependency. Is there a stack trace somewhere to be found?13:15
*** trown|brb is now known as trown13:15
mcorneajistr: looking, install-undercloud.log  looks pretty much clean13:16
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Replace swiftclient with openstackclient  https://review.openstack.org/46780013:18
*** shardy has joined #tripleo13:18
jaosoriorIs there a way to know from within the node that a certain node is a controller or not?13:20
jaosoriorlike a hiera setting or something? or do I have to rely on pacemaker being set13:21
*** sshnaidm|off has joined #tripleo13:22
*** prateek has quit IRC13:22
*** tzumainn has joined #tripleo13:24
*** lblanchard has joined #tripleo13:25
*** karthiks has quit IRC13:26
mcorneajistr: looks like other hit it during installation and the output contains the trace: https://bugs.launchpad.net/tripleo/+bug/168786713:26
openstackLaunchpad bug 1687867 in tripleo "undercloud install failed due to TypeError thread.lock" [Medium,Triaged]13:26
*** toure|gone is now known as toure13:27
jistrmcornea: wow it looks like it's within Python itself, in copy.deepcopy(). Weird..13:28
mcorneajistr: yeah, looks so. I'm wondering why we're not always seeing it13:30
*** salmankhan has joined #tripleo13:30
bogdandohm, the mirror.regionone.tripleo-test-cloud-rh1.openstack.org:8081/registry-1.docker requires auth13:30
bogdandofolks, do we have some nearest to RDO cloud mirror w/o auth, or auth creds? How CI uses it?.. I see no creds around13:31
jaosoriorjistr, mcornea: oh, that's related to passing the keystone session object to mistral13:31
jaosoriorjistr, mcornea: However, we shouldn't be passing that session object to mistralclient in ocata, that was introduced in pike.13:32
jaosoriorjistr, mcornea: So it seems to me that it's a newer tripleoclient (pike), using an older mistralclient library13:32
bogdandodprince, shardy: ^^13:32
yolandahi, i have a customer hitting that error on a deploy on osp10: ResourceFailure: OverLimit: resources.Controller.resources[0].resources.Controller: Request is too large13:33
yolandawhat does this mean, it talks about the size of the template? or some memory/disk resource?13:33
pandamatbu: hey, should this part https://github.com/ansible/ansible-modules-extras/blob/devel/cloud/openstack/os_stack.py#L174 fail, or return False ?13:34
bogdandomandre shardy dprince jistr: ^^ folks, I'm lost with docker images sources, could you share how do you deploy? which mirror? or local registry? if local, what is the source you pull from? docker.io container bad images, like mistral engine w/o tripleo_common libs, so it was built w/o tripleo overrides... sigh13:34
bogdandoif a mirror, then wich one? the mirror.regionone.tripleo-test-cloud-rh1.openstack.org:8081/registry-1.docker requires auth, for example13:35
bogdandoor do you build kolla images all the time and start local registry?13:35
mwhahahabogdando: it's probably ip limited13:35
mwhahahato just CI hosts13:35
* mwhahaha is unsure what that is used for however13:35
jistrbogdando: i use docker.io/tripleoupstream -- those should be built with the tripleo-common overrides, unless there was some mishap13:35
bogdandojistr: thanks! I'll try that13:35
jistrbogdando: those mirrors are for CI only AFAIK13:36
*** amoralej is now known as amoralej|lunch13:37
jistrbogdando: docker.io/tripleoupstream is the default, so everything should work without overriding any sources or image names13:38
bogdandojistr: yeah, I can see I have it on my env. But there is no mistral packages overrides :/13:38
*** udesale has joined #tripleo13:39
yolandashardy, do you know about that problem?13:39
bogdandoso mistral_engine has no openstack-tripleo-common pkg13:39
mandrebogdando: the images from tripleoupstream docker hub are the ones we use in CI, they were built with our override file otherwise CI wouldn't work at al13:39
bogdandostrange things13:39
*** salmankhan has quit IRC13:40
shardyyolanda: there is a post body limit configurable in heat.conf, it's set pretty high though so I wonder are they passing some huge ExtraConfig templates or something?13:40
yolandayes, i think this may be the problem. They passed me the templates and extraconfig is huge...13:41
shardyhttps://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L18913:42
shardyyolanda: ^^ that's the value we set it to, it could be increased, but FWIW we originally set a limit because of an eventlet bug which triggered with very large requests13:42
shardythat may no longer be an issue with things running under httpd13:42
shardyyolanda: if they have huge scripts inlined in the templates, I'd perhaps suggest they add them to the image13:43
shardye.g via virt-customize or installing from a side-repo during deployment13:44
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: create history for the overcloud deploy command  https://review.openstack.org/44661713:44
*** jerrygb has joined #tripleo13:45
*** jerrygb has quit IRC13:45
*** jerrygb has joined #tripleo13:45
*** jpena|lunch is now known as jpena13:45
yolandashardy, let me look at their templates closely13:46
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Re-enable introspection on rdocloud  https://review.openstack.org/46778513:47
*** salmankhan has joined #tripleo13:47
openstackgerritJiri Stransky proposed openstack/instack-undercloud master: Log exception tracebacks  https://review.openstack.org/46842613:49
jistrmcornea: at least next time we'd get the traceback in the log ^13:49
bogdandomandre:13:50
bogdandodocker pull tripleoupstream/centos-binary-mistral-engine13:50
bogdandosudo docker run tripleoupstream/centos-binary-mistral-engine python -c 'import tripleo_common.actions.plans'13:50
bogdandosudo docker run tripleoupstream/centos-binary-mistral-engine rpm -q openstack-tripleo-common13:50
bogdando¯\_(ăƒ„)_/¯13:50
*** milan has joined #tripleo13:52
bogdandoso is this ignored https://github.com/openstack/tripleo-common/blob/fedca4702287d9adb65b6dd61157ff07b1b2a949/container-images/tripleo_kolla_template_overrides.j2#L14-L15 ? a bug? but how on earth CI passes jobs?..13:52
mandrebogdando: so maybe it's not needed after all :) IIRC that was for the undercloud13:53
bogdandomandre: I feel very confused now13:53
*** owalsh_ has joined #tripleo13:53
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: collect-logs: add README for log files  https://review.openstack.org/45631713:53
bogdandohow tripleo_kolla_template_overrides works then?13:54
*** salmankhan has quit IRC13:54
*** ykarel_ has joined #tripleo13:54
*** egafford has joined #tripleo13:55
*** owalsh has quit IRC13:55
bogdandoisn't undercloud/overcloud container builds are the same?13:56
bogdandoI suppose they must be the same13:56
*** salmankhan has joined #tripleo13:56
*** ykarel has quit IRC13:56
bogdandomandre: do you know why those are different http://codesearch.openstack.org/?q=mistral_engine_packages&i=nope&files=&repos= like foo_packages vs foo_packages_append?13:59
*** gvrangan has quit IRC13:59
bogdandotrying to figure out kolla magic13:59
*** karimb has quit IRC14:00
*** dtantsur|brb is now known as dtantsur14:00
mandrebogdando: the 'kolla magic' is explained at https://docs.openstack.org/developer/kolla/image-building.html#package-customisation14:01
*** udesale has quit IRC14:02
bogdandoI have a wild guess it never worked =)14:04
*** ykarel__ has joined #tripleo14:04
*** jaganathan has quit IRC14:05
mandredprince: the mistral-api and mistral-executor images pushed last week on the dockerhub are missing the tripleo-common package, how it is possible?14:05
*** ccamacho|lunch is now known as ccamacho14:06
dprincemandre: perhaps I cherry-picked the wrong version of steve's patch to add it back14:06
mandredprince: and how is not containerized undercloud CI not failing?14:06
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add stack deploy status output for failed deploy debugging  https://review.openstack.org/46842914:06
dprincemandre: those packages are functional requirements for a working undercloud only14:06
*** owalsh_ is now known as owalsh14:07
mandredprince: ahh I see, they aren't really tested in CI14:07
dprincemandre: perhaps not, although I think undercloud_post.sh uses MIstral API so I would expect failures there14:07
*** ykarel_ has quit IRC14:07
dprincemandre: did we land steve's patch yet?14:07
* dprince checks14:07
mandredprince: the override file was modified about at the same time, but we would have the tripleo-common package either in the base image or in the mistral ones, but it should have been there14:08
openstackgerritMerged openstack/tripleo-heat-templates master: Add ignore_projects to filter gnocchi events  https://review.openstack.org/46726914:08
mandredprince: maybe you had a conflict while cherry picking14:08
dprincemandre: yeah, I can rebuild again now. The patch is landed so no need to cherry pick it14:09
mandredprince: wait a sec before rebuilding, I think we have more override file changes pending14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019514:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013214:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037314:10
*** ooolpbot has quit IRC14:10
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add a telemetry_args variable to deploy_args list  https://review.openstack.org/46803814:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]14:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)14:10
dprincemandre: ack, might as well land them all ?14:10
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: quickstart transition: add promotion logic  https://review.openstack.org/44546714:10
mandredprince: https://review.openstack.org/#/c/466288/14:10
mandrethat's all I could find14:10
*** karimb has joined #tripleo14:11
*** gbarros has quit IRC14:11
*** dparkes has quit IRC14:13
bogdandodprince, mandre: I'm running a local mistral build with kolla and a dummy override for mistral_packages_*append* magic14:13
bogdandoI wonder how it works, there is nothing like mutating foo_packages into foo_packages_append14:14
bogdandoand dockerfiles use only foo_package | default (cutsom...)14:14
bogdandoso how _append comes to not being appended, that's a real magic :)14:14
bogdandoI mean, look, there is no mistral_package_append here https://github.com/openstack/kolla/blob/master/docker/mistral/mistral-engine/Dockerfile.j2#L1414:15
bogdandomistral_engine_packages_append*14:15
dprincebogdando: I've not seen that but perhaps there is a bug here14:16
bogdandooh yeah, likely. testing locally14:16
*** artom has joined #tripleo14:18
*** kbyrne has joined #tripleo14:19
*** ramishra has quit IRC14:21
bogdandoI think that _append magic is working somehow for kolla, this just can't be otherwise14:23
bogdandowell, building...14:23
bogdandoyeah, I found that magic )14:26
*** suuuper has quit IRC14:26
bogdandomandre, dprince: https://github.com/openstack/kolla/blob/master/kolla/template/filters.py#L23-L2414:28
bogdandoso this works, happili we have just a tripleo_common overrides issue with propagating it to docker.io/tripleoupstream14:28
bogdandohappily*14:28
dprincebogdando: rebuilding now, and I'll upload them when they finish14:28
radezdtantsur: ping, I think I found the silver bullet, I had to set this in the ironic.conf file and bounce ironic-conductor14:28
radezuefi_pxe_config_template = $pybasedir/drivers/modules/pxe_grub_config.template14:28
*** cylopez has joined #tripleo14:29
dtantsurradez: oh yeah, this is needed14:29
dtantsurisn't it covered by the install-guide?14:29
radezthe $ip.conf file showed up and the config file changed to grub to when uefi is enabled14:29
radeznope14:29
dtantsuroh14:29
ansiwenshardy: since I added the bug to the commit message as you asked for, the scenario002-multinode-upgrades job is broken. :-/ do you have an idea what is going on there? (ERROR: HEAT-E99001 Service zaqar is not available for resource type OS::Zaqar::Queue, reason: zaqar messaging endpoint is not in service catalog.)14:29
radezhttps://docs.openstack.org/project-install-guide/baremetal/draft/configure-pxe.html#pxe-uefi-setup14:29
radezmissing there :)14:29
radezdtantsur: the other thing that I needed to do was to update that template14:29
ansiwenshardy: I just realized I didn't try a rebase yet... maybe I should do that14:29
radezlinuxefi was not a command14:29
radezI had to change it to linux and it booted and provisioned14:30
*** cylopez has quit IRC14:30
dtantsurradez: what was the value of uefi_pxe_config_template for you? and which release are you using?14:30
*** ebarrera_ has joined #tripleo14:30
radezdtantsur: I'm on ocata and the value was the ipxe template14:30
*** cylopez has joined #tripleo14:30
dtantsurradez: oh, you're right. this is my fault actually: we hardcode it to ipxe because pxe+uefi does not work out-of-box. sigh..14:31
dtantsurlinuxefi, hmmm14:31
*** amoralej|lunch is now known as amoralej14:31
radezso probably need a doc update for that14:31
radezlinuxefi I'm not sure if that's valid somewhere else14:31
radezbut it's not in grub2aa64.efi14:32
*** pchavva has quit IRC14:32
dtantsurradez: we're using non-default values in tripleo, this is why upstream ironic docs did not quite work for you14:32
radezdtantsur: would you like me to put in a patch for the docs?14:32
radeznp, glad there's an explaination for why things didn't work :)14:33
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates stable/ocata: Add parameter Ec2ApiExternalNetwork for VPCs  https://review.openstack.org/46254214:33
*** cylopez has quit IRC14:33
dtantsurradez: if you could capture your experience in the tripleo docs, that would be awesome14:33
dtantsurwe don't have tripleo-specific UEFI docs yet, hence it's hard every time14:33
radezyou bet, are you aware of why linuxefi is inthere?14:33
radezis there a place that's valid?14:33
openstackgerritDan Prince proposed openstack/tripleo-common master: kolla template overrides for pacemaker HA containers  https://review.openstack.org/45617414:33
*** pchavva has joined #tripleo14:33
dprincebandini: I removed the WIP on this.14:34
dprincebandini: lets land it14:34
dprincebandini: https://review.openstack.org/#/c/456174/14:34
dprincemandre: ^^^14:34
dprincebandini: we can adjust it again next week once the repo lands I think14:35
dprincebandini: I think it is fine as is to move ahead14:35
*** cylopez has joined #tripleo14:35
pradkdprince, could you review these please https://review.openstack.org/#/c/465734/ and https://review.openstack.org/#/c/466306/14:40
mandredprince: agreed, it's a lot worse to have to cherry pick when building images than pulling from a non official source14:40
*** ratailor has quit IRC14:40
mcorneajistr: jaosorior so on a 2nd run of the undercloud upgrade it completed just fine, no errors14:40
jaosoriormcornea: probably cause of updated packages14:41
dtantsurradez: I'll check that14:41
mcorneajaosorior: yep, I believe so14:41
radezdtantsur: cool thx14:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: [newton-only)] Force EnablePackageInstall to true on multinode jobs  https://review.openstack.org/46843914:42
dprincepradk: commented, in general +2. One comment on syncing up with the new (unlanded) bootstrap_host_exec commands here I0c864ca093ea476248b619d8c88477ef0b64e2eb14:43
pradkdprince, cool, i'll update accordingly, thx14:43
*** salmankhan has quit IRC14:44
*** bogdando has quit IRC14:45
dprincepradk: Use arrays for cmds I think. Stevebaker commented on that in my patch. Fwiw what I did seems to functionally work just fine in the bootstrap_host_exec patch but I'm going to update them all to be arrays14:45
pradkok14:45
dprincepradk: also, you'll need to user: root, and then 'su' to drop privs for the user. This grants access to the hieradata14:45
dprincepradk: a bit more complex, but seemed to be the most practical way forward on those to guard the db_syncs in an HA setup so they only execute on 1 node14:46
dtantsurradez: I see confusing information: https://forums.opensuse.org/showthread.php/501075-error-cannot-find-commands-linuxefi-or-initrdefi14:46
dtantsur"If you want secure-boot, you must use "linuxefi" and "initrdefi""14:47
dtantsurthis is why we have it. I wonder why your grub does not have it..14:47
*** ramishra has joined #tripleo14:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ceilometer-expirer: remove the crontab during upgrade  https://review.openstack.org/46609614:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ceilometer-expirer: remove the crontab during upgrade  https://review.openstack.org/46609614:47
radezdtantsur: hm, yea I think it said it wasn't a valid command14:48
radezlemme check again14:48
openstackgerritMerged openstack/puppet-tripleo master: Pass mistral::api service_name from t-h-t  https://review.openstack.org/46023714:48
dtantsurradez: I wonder if it's something not supported by aarch version of grub14:48
*** bogdando has joined #tripleo14:49
*** hewbrocca is now known as hewbrocca_afk14:49
radezdtantsur: or the way that forum reads it looks like it's reading an efi partition, which those are not doing using a direct boot?14:49
dtantsurEmilienM: to be fair, I'm not sure I'm the right person to approve the release management doc, but dunno14:50
radezdtantsur:  I think you may be right... it just says14:51
radezerror: can't find command `linuxefi'.14:51
radezerror: can't find command `initrdefi'.14:51
EmilienMdtantsur: you're ptl, imho you have more than enough exp on this thing14:52
EmilienMdtantsur: please go ahead14:52
dtantsurok, lemme finish one thing here14:52
EmilienMthx14:52
*** masco has joined #tripleo14:54
*** suuuper has joined #tripleo14:54
*** ebarrera_ has quit IRC14:54
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Ability to enable/disable debug mode per OpenStack service  https://review.openstack.org/46769814:54
*** salmankhan has joined #tripleo14:56
*** dciabrin has joined #tripleo14:57
*** yprokule has quit IRC14:58
*** florianf has joined #tripleo14:58
*** jerrygb has quit IRC15:03
radezdtantsur: so the arm guys say... linuxefi is specific to x86 because it can do bios or efi15:03
fultonjflaper87: do you have an example in a mistral workflow of how you used AnsiblePlaybookAction's inventory argument?15:04
*** rcernin has quit IRC15:04
*** d0ugal has quit IRC15:04
radezdtantsur: aarch is exclusivly uefi so there is no need to distingush between the two so it's just linux15:04
*** jerrygb has joined #tripleo15:04
radezdtantsur: unfortunatly that creates an inconsistency that will need to be taken into account in the templates :/15:04
jistrmandre, panda: alright! green "normal deployment" container job on multinode https://review.openstack.org/#/c/467100/  -- i hacked it a bit though, there's one additional bind mount i had to add to nova compute. ATM i have no idea how come we don't hit the same issue in OVB jobs.15:04
dtantsurradez: oh, this is good to know. I wonder if we need a new configuration file in ironic tree, and to document its use15:04
dtantsurradez: btw your testing of non-x86 architectures is *extremely* valuable for us15:05
jistrmandre, panda: so there still needs to be further investigation & cleanup15:05
radezdtantsur: the template works, if you can conditionalize the linux/efi based on arch then you don't need another template15:05
radezdtantsur: lots of folks are really excited about the arm testing :)15:05
*** mdnadeem has quit IRC15:06
radezdtantsur: is that something you'd like me to try and generate a patch for too?15:06
dtantsurradez: mind filing a bug against ironic in launchpad about this template inconsistency? oh, and a patch would be awesome.15:06
radezdtantsur: yup, may not happen till next week, but I'll make it happen15:07
dtantsurthanks a lot15:07
dtantsurwe need to make sure that your findings do not disappear :)15:07
radezsure thing, super glad to be making progess on this15:07
radezdon't worry, they won't!15:07
*** janki has quit IRC15:08
*** rhallisey has joined #tripleo15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019515:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013215:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037315:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]15:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)15:10
*** atheurer has quit IRC15:12
*** karthiks has joined #tripleo15:12
*** masco has quit IRC15:15
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements master: Add overcloud-secure element  https://review.openstack.org/44912215:18
*** d0ugal has joined #tripleo15:19
mwhahahapradk: is http://logs.openstack.org/31/468031/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/25cb669/console.html#_2017-05-26_01_48_12_363772 a side effect of https://bugs.launchpad.net/tripleo/+bug/169362115:19
openstackLaunchpad bug 1693621 in tripleo "gnocchi api fails to start on one controller" [High,In progress] - Assigned to Pradeep Kilambi (pkilambi)15:19
openstackgerritMerged openstack-infra/tripleo-ci master: Don't maintain stable scenario env in upgrade CI  https://review.openstack.org/46797315:20
*** ykarel__ has quit IRC15:21
pradkmwhahaha, i think so yea.. see the gnocchi logs .. see the same error http://logs.openstack.org/31/468031/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/25cb669/logs/overcloud-controller-0/var/log/gnocchi/app.txt.gz15:22
mwhahahapradk: so what changed 3 days ago15:23
mwhahahapradk: because this wasn't happening until 3 days ago15:23
pradkthey added new storage sack initializsation logic in gnocchi upgrade15:23
pradkupstream15:23
* mwhahaha facepalms15:23
*** karthiks has quit IRC15:23
pradkmwhahaha, this seems to resolve it https://review.openstack.org/#/c/468165/15:23
mwhahahapradk: nope http://logs.openstack.org/65/468165/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/9e280b0/console.html#_2017-05-26_04_32_52_92998615:24
pradkmwhahaha, well the non updates one.. but yea seems like updates is still failing15:24
mwhahahak i'm going to create another bug for the updates15:24
pradkperhaps because the hiera data still stays after update?15:24
mwhahahabecause it's completely broke15:24
pradkideally we should move gnocchi api to later step .. but i saw your coments yesterday15:25
mwhahahapradk: yea but you could use the stack action if you only want to trigger something on install vs update15:25
numansI am trying "openstack undercloud deploy" for containerized undercloud and I am getting this error all the time - Unable to establish connection to http://127.0.0.1:8006/v1/admin/stacks/undercloud/a5cb6f9f-9beb-408f-a25e-d1604214cba9/events?marker=54d215fd-0ea9-4615:26
numans03-a27d-34a590431501&nested_depth=6&sort_dir=asc: ('Connection aborted.', BadStatusLine("''",))15:26
numansError response from daemon: No such container: heat_all15:26
*** limao has joined #tripleo15:26
numansAny pointers on what I might be doing wrong ?15:26
mwhahahanumans: undercloud deploy is an experimental feature, but seems to indicate the container is not there. are you meaning to be working on a containerized undercloud?15:27
pradkmwhahaha, so in updates job.. what happens to existing hiera settings? wont get get overridden after update?15:27
mwhahahapradk: i'm not sure which hiera option are you using?15:27
pradkmwhahaha, we just dont want --skip-storage passed in ... but seems ike it is in updates case15:27
openstackgerritMerged openstack/diskimage-builder master: Add a more generic tree->graph parser  https://review.openstack.org/46541715:27
pradkmwhahaha, this https://review.openstack.org/#/c/468165/2/puppet/services/gnocchi-base.yaml15:27
mwhahahapradk: https://github.com/openstack/puppet-tripleo/commit/76931e535c69ab437c4710dc749bc363f4533ea5#diff-1bde45d44e7b2805b32018344045550f example on triggering on stack_action == 'UPDATE'15:27
numansmwhahaha, yes15:28
openstackgerritMerged openstack/tripleo-common master: Move openstack-tripleo-common to mistral base image  https://review.openstack.org/46628815:28
*** nyechiel has joined #tripleo15:28
numansmwhahaha, i am working on containerizing OVN15:28
numansfor testing i am using undercloud deploy.15:28
pandajistr: great thanks! I'm still a bit confused about what jobs need to be created for containers15:28
mwhahahapradk: i think it should get cleared up but you could also try ''15:28
mwhahahapradk: do we not capture the heiradata in ci?15:29
pradkhmm i still see it here http://logs.openstack.org/31/468031/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/25cb669/logs/overcloud-controller-0/var/log/host_info.txt.gz15:30
pradkgrep fro skip-storage15:30
pradkfor*15:30
mwhahahapradk: yea it's in the hieradata still15:30
pradkthats why15:30
mwhahahapradk: maybe ci is not properly using the new stuff?15:30
pradkupdate is just updating the packaging right? vs upgrade which does a full puppet apply?15:31
pradkor it does both15:31
mwhahahaupdate should rerun stack update15:31
pradkthat should update the tht i would think yea15:31
pandajistr: for example, you continue to say "normal job" but I see composable_scenario: multinode-container-upgrade.yaml15:31
*** salmankhan has quit IRC15:32
pandajistr: also, how much is this different from scenarioXXX sets ? can we call multinode-container-upgrade "scenario010" or something ?15:32
pradkmwhahaha, https://review.openstack.org/#/c/468165/ is the right fix i think.. i just dont know what in addition we need for updates to take effect15:32
openstackgerritMerged openstack/tripleo-heat-templates master: Add heat environment for disabling all telemetry services  https://review.openstack.org/46803115:32
mwhahahapradk: ok we'll i created a new bug for the upgrades job15:33
mwhahahaso since it's broken i'll merge that one15:33
mwhahahapradk: actually do you want to try setting it to '' instead?15:33
pradkok15:33
pradkinstead of removing?15:33
mwhahahapradk: yea but let me look at the logs first15:33
pradki can try15:34
pradkok15:34
*** aufi has quit IRC15:34
jistrpanda: right, it shouldn't be called multinode-container-upgrade, it should simply be multinode-container.yaml, or multinode-nonha.yaml. It's the normal multinode.yaml but Pacemaker is removed.15:34
*** egonzalez has quit IRC15:35
jistrpanda: so i consider this to be "normal job" https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode.yaml15:35
jistrpanda: and the one i'm using is the same except pcmk as i've said above15:35
openstackgerritMerged openstack/tripleo-quickstart master: Disable telemetry services in featureset001  https://review.openstack.org/46803915:35
*** iranzo has quit IRC15:35
numansmwhahaha, it fails at Step 3 though15:36
*** karthiks has joined #tripleo15:36
mwhahahanumans: yea not sure, it sounds like the heat container goes away or something15:36
mwhahahapradk: yea i'd try setting it to ''15:36
numansmwhahaha, ok. thanks. i will try to debug15:36
pradkmwhahaha, yep lemme push one sec15:37
*** nyechiel has quit IRC15:37
pandajistr: ok so this effectively obsolete my change. I'll review it now.15:37
jistrpanda: it's not yet ready to be merged, but i'd be grateful for early feedback15:38
jistrthanks :)15:38
openstackgerritMerged openstack/tripleo-docs master: First draft of TripleO Release Management document  https://review.openstack.org/45976415:38
bnemecyolanda: I commented on the review.  If you add a README explaining the status of the feature I'm good with it going in.15:39
yolandacool15:39
yolandai'm also worried about the final disk image size, the generated image with that config is more than 12G15:40
yolandai'm trying to run a virt-sparsify to see if that helps15:40
openstackgerritMerged openstack/tripleo-heat-templates master: Store role_data in an OS::Heat::Value resource  https://review.openstack.org/46544915:41
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: TEST: upgrade without skip-storage  https://review.openstack.org/46816515:43
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Upgrade gnocchi without skip-storage  https://review.openstack.org/46816515:44
*** salmankhan has joined #tripleo15:45
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add stack deploy status output for failed deploy debugging  https://review.openstack.org/46842915:46
*** janki has joined #tripleo15:46
*** florianf has quit IRC15:46
*** jlinkes has quit IRC15:47
yolandamm, sparsify didn't work , it even increased the size. bnemec , as it's using xfs filesystem, i cannot even use zerofree. Do you know another alternative for shrinking size on xfs?15:48
*** dtantsur is now known as dtantsur|afk15:48
*** masco has joined #tripleo15:49
*** bogdando has quit IRC15:49
*** salmankhan has quit IRC15:50
bnemecyolanda: It's a full disk image.  I'm not sure how you would shrink it.  I suppose qcow2 might have some magic that could make it smaller, but it's going to have to be expanded back to raw before deployment anyway.15:50
yolandathe problem i see is that for a 16G image, even if that's empty, diskimage-builder generates a 12G qcow2 file. As opposite as the 5G file that is generated without that partitioning system15:51
yolandadiskimage-builder runs zerofree by default but it only works on ext filesystems, so is not helping us15:51
openstackgerritJulie Pichon proposed openstack/python-tripleoclient master: Use Swift to store Plan environment  https://review.openstack.org/45384115:51
openstackgerrityolanda.robla proposed openstack/tripleo-common master: Add creation of security hardened images  https://review.openstack.org/44852815:56
mandrejistr: so what's the story with virtlogd?15:57
openstackgerrityolanda.robla proposed openstack/tripleo-common master: Add creation of security hardened images  https://review.openstack.org/44852815:57
*** sshnaidm|off has quit IRC15:57
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027716:00
*** jprovazn has quit IRC16:00
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Fix sshd service in docker environment  https://review.openstack.org/46845516:00
jistrmandre: apparently we keep using the host virtlogd (already the current state). Unlike in overcloud-full, on multinode it's not present because we start with empty machines.16:02
jistrmandre: so i had to install it and start it. That's all expected and fine.16:02
jistrmandre: what's not so expected is that i also had to bind mount /var/log/libvirt/qemu to make things work16:03
mandrejistr: ohh I see, in the ovb job for some reason virtlogd is already available?16:03
jistrmandre: yes, it's installed and started16:03
mandrejistr: would it help to containerize virtlogd?16:03
jistrmandre: but the bind mount keeps me puzzled16:03
jistrmandre: probably... i'm not sure why we kept the one from host. i saw it introduced in a commit by dprince and you i think16:04
jistri mean, if it's just that we didn't containerize it yet, or if it's that there's some actual reason to keep it non-containerized16:05
mandrejistr: virtlogd is a new dependency of libvirt 2.0 that we never got around containerizing iirc16:06
*** lmiccini has quit IRC16:06
dprincemandre: yes, it sounds like we might should containerize this one16:06
jistrdprince, mandre: might be good to make the job working first with non-containerized virtlogd though. One thing at a time :)16:07
dprincejistr: sure, wfm16:07
mandrejistr: hmm for the bind mount, it may have to do with qemu settings16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013216:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037316:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383016:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)16:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]16:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)16:10
openstackLaunchpad bug 1693830 in tripleo "ovb-upgrade job fails with gnocchi upgrade command timeout" [Critical,Triaged]16:10
jistrmandre: yea i suspected something like that... but why the difference between multinode and ovb?16:10
jistrmandre: ah perhaps the overcloud-full image ships a not-completely-standard config for virtlogd...16:11
jistrbut just guessing...16:11
ansiwenmandre: you seem to be one of the last tripleo people adding a kolla image, could you give me advice how to create the Dockerfile.j2 and extend_start.sh? The Kolla documentation is sparse somehow.16:12
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Add sshd service to containerized compute role  https://review.openstack.org/46845516:12
*** salmankhan has joined #tripleo16:13
*** lucasagomes is now known as lucas-afk16:14
mandrejistr: hmmm... looks like we don't generate a libvirtd/qemu.conf file, strange16:14
mandreI think we used to16:14
*** japestinho has joined #tripleo16:14
mandreansiwen: right, it might be easier to look at an example, let me find you one16:14
ansiwenowalsh: what's wrong with the ssh_known_hosts?16:15
*** mcornea has quit IRC16:15
ansiwenmandre: yeah, I was looking at other services, but I can't tell from the examples, which parts are mandatory and which not16:15
owalsh ansiwen: nothing, split it out16:15
ansiwenowalsh: ok, I se16:15
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add rhn repo support to repo-setup role  https://review.openstack.org/45334516:16
*** jpich has quit IRC16:16
mandreansiwen: it depends what your service does, and if there are binary packages available or not16:16
mandreansiwen: maybe you should just go ahead and push your patch to kolla16:17
*** dprince has quit IRC16:17
mandreansiwen: tacker is a relatively simple image, https://github.com/openstack/kolla/tree/master/docker/tacker16:18
hjensasIf I need to get the undercloud host_id, e.g the undercloud hostname into THT as a parameter to a resource. How could I do that?16:18
ansiwenmandre: there are "binary" packages (well, it's python), but is a source option mandatory for example? and does source mean from pip or from git?16:18
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Map /etc/ssh/ssh_known_hosts to all containers  https://review.openstack.org/46846116:20
mandreansiwen: source means pip install a source tree, either a tarball from tarballss.o.o or a git checkout, it's usually a good idea to make it available for your image for openstack services16:22
mandrefor infra services, not so much16:22
*** limao has quit IRC16:22
*** dtrainor_ has joined #tripleo16:24
*** dtrainor has quit IRC16:25
ansiwenok, for example, a *-archive directory is ADDed, which doesn't exists, so kolla is creating that I presume, but with which name and which data?16:25
mandrejistr: your issue reminds me of https://bugs.launchpad.net/tripleo/+bug/165211916:26
openstackLaunchpad bug 1652119 in tripleo "Containerized compute node broken after update to libvirtd update" [Medium,Fix released] - Assigned to Martin André (mandre)16:26
*** cylopez has quit IRC16:26
jistrmandre: i actually came across that when i was googling earlier today :) I guess the next step could be to compare the libvirt configs on the bare metal hosts, ovb vs. multinode. I think that the in-container configs should always end up being the same on ovb and multinode.16:28
ansiwenmandre: forgot to mention your name in my answer above ^^^16:28
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Run the nova-compute container as the nova user  https://review.openstack.org/46846616:30
jistrmandre: well... neither that is a 100% certainty actually. Multinode in general has quite a bunch of multinode-specific environment files.16:30
mandreansiwen: right, that archive is automatically created by the kolla-build tool at build time16:30
mandreansiwen: https://docs.openstack.org/developer/kolla/image-building.html#plugin-functionality16:31
*** ramishra has quit IRC16:31
ansiwenmandre: thanks!16:31
jistranyway...16:33
* jistr -> weekend16:33
jistrhave a nice weekend all!16:33
*** salmankhan has quit IRC16:35
mandrejistr: oh that reminds me, it's the weekend for me too :) have a nice one16:36
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add stack deploy status output for failed deploy debugging  https://review.openstack.org/46842916:37
pradkmandre, clarifying your comment on "dont forget to bind mount /etc/puppet" .. i dont see that being done in this patch? https://review.openstack.org/#/c/465551/416:38
pradkor am i missing something?16:38
*** zoli is now known as zoli|gone16:39
*** kbyrne has quit IRC16:39
gfidentejistr you toooooooooooooooooo16:40
gfidentemarios yeah you're included16:40
gfidenteall the others, no16:40
gfidenteobviously16:40
gfidente:D16:40
gfidenteby guys16:40
*** ckyriakidou has quit IRC16:41
*** ramishra has joined #tripleo16:41
*** gfidente has quit IRC16:42
*** kbyrne has joined #tripleo16:42
openstackgerritMerged openstack/tripleo-quickstart-extras master: Re-enable introspection on rdocloud  https://review.openstack.org/46778516:43
*** ebarrera has quit IRC16:45
*** ebarrera has joined #tripleo16:45
*** masco has quit IRC16:47
*** jaosorior has quit IRC16:49
*** ansmith has quit IRC16:52
*** trown is now known as trown|lunch16:52
*** nyechiel has joined #tripleo16:53
*** ramishra has quit IRC16:53
openstackgerritMerged openstack/tripleo-heat-templates master: Add RoleNetHostnameMap output  https://review.openstack.org/46556016:56
ansiwenmandre: that doesn't explain how the tacker-archive folder is created. I assume it takes the name "tacker" from $SOURCES in kolla/common/config.py, and appends -archive? You might think, why I care: annoyingly ec2-api is sometimes spelled ec2-api and sometimes ec2api, so I have to exactly know, which of the both I have to use where...16:56
openstackgerritMerged openstack/tripleo-quickstart master: Featureset 021 Install oooq and execute tempest  https://review.openstack.org/46501616:56
*** derekh has quit IRC16:58
*** itlinux has joined #tripleo16:58
*** florianf has joined #tripleo16:58
mandreansiwen: that should be the name of your container image, and it should match what you put in kolla/common/config.py17:02
*** jaganathan has joined #tripleo17:03
openstackgerritMerged openstack/puppet-tripleo master: Move ceilometer upgrade step out of base  https://review.openstack.org/46775017:04
mandrein other words, you're the one chosing the name17:04
*** jpena is now known as jpena|off17:05
ansiwenmandre: I was aware of that, just wasn't sure where I am chosing it. ;-) but I think I got it now. It assumes the image name is used as directory name under docker/* and in $SOURCES as identifyer, and also uses it for the *-archive name17:06
*** sshnaidm|off has joined #tripleo17:07
*** ebarrera has quit IRC17:07
ansiwenmandre: I'm bugged by questions like: can I write block ec2api_header or ec2_api_header, or does it have to be ec2-api_header... excuse my asperger-style-obsession ;-)17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019517:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013217:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037317:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383017:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]17:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)17:10
openstackLaunchpad bug 1693830 in tripleo "ovb-upgrade job fails with gnocchi upgrade command timeout" [Critical,Triaged]17:10
*** athomas has quit IRC17:12
*** florianf has quit IRC17:14
*** ipsecguy has quit IRC17:15
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add stack deploy status output for failed deploy debugging  https://review.openstack.org/46842917:15
*** ipsecguy has joined #tripleo17:15
*** jaganathan has quit IRC17:19
*** pblaho has quit IRC17:21
*** bfournie1 has joined #tripleo17:25
*** bfournie has quit IRC17:25
ansiwenmandre: I'm also not clear how it is determined how to start a service in the container... how is CMD set for instance?17:26
*** bfournie has joined #tripleo17:31
*** bfournie1 has quit IRC17:33
*** dprince has joined #tripleo17:34
*** gvrangan has joined #tripleo17:34
*** bfournie1 has joined #tripleo17:34
*** dparkes has joined #tripleo17:35
*** bfournie has quit IRC17:36
*** itlinux_ has joined #tripleo17:38
*** itlinux has quit IRC17:42
*** Goneri has quit IRC17:46
*** suuuper has quit IRC17:48
*** yamahata has joined #tripleo17:50
*** hexo has quit IRC17:50
*** itlinux_ has quit IRC17:53
*** pkovar has quit IRC17:54
*** trown|lunch is now known as trown17:56
*** bnemec is now known as beekneemech17:57
*** jaganathan has joined #tripleo17:57
*** karimb has quit IRC17:57
*** hexo_ has joined #tripleo17:59
*** pcaruana has quit IRC18:00
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: [newton-only)] Force EnablePackageInstall to true on multinode jobs  https://review.openstack.org/46843918:08
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019518:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013218:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037318:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383018:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]18:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)18:10
openstackLaunchpad bug 1693830 in tripleo "ovb-upgrade job fails with gnocchi upgrade command timeout" [Critical,Triaged]18:10
*** jaganathan has quit IRC18:14
*** japestinho has quit IRC18:20
*** dsneddon_pto is now known as dsneddon18:25
*** limao has joined #tripleo18:27
*** jaganathan has joined #tripleo18:27
*** pchavva has quit IRC18:27
*** sri_ has quit IRC18:30
*** limao has quit IRC18:32
openstackgerritMerged openstack/tripleo-common master: kolla template overrides for pacemaker HA containers  https://review.openstack.org/45617418:36
dsneddonshardy, Thanks for rebasing the rendered network-isolation patch, I had planned on doing that this week, but then I broke my foot and missed a couple of days.18:38
dsneddonshardy, I want to either discuss with you the further changes that are needed, or maybe we can work off of an Etherpad?18:38
dsneddonshardy, So I hope we can do that braindump next week.18:39
*** janki has quit IRC18:43
*** artom_ has joined #tripleo18:52
*** artom has quit IRC18:54
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add DeployedServerEnvironmentOutput  https://review.openstack.org/46139918:55
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add VipMap output  https://review.openstack.org/46013818:55
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add split-stack environments  https://review.openstack.org/45990018:55
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add DeploymentSwiftDataMap parameter  https://review.openstack.org/45944018:55
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add os-collect-config data as an output  https://review.openstack.org/45864118:55
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Server blacklist support  https://review.openstack.org/46473318:57
*** amoralej is now known as amoralej|off18:59
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add a minimal network isolation config  https://review.openstack.org/46574119:00
*** bfournie1 is now known as bfournie19:00
*** dciabrin has quit IRC19:01
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE: Add test commit to check gate triggers  https://review.openstack.org/40381819:05
dmsimardSlower, dprince, jschluet, myoung: as per discussed: http://lists.openstack.org/pipermail/openstack-dev/2017-May/117579.html19:07
dprincedmsimard: ack, thanks19:08
myoungdmsimard: ditto thx19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019519:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013219:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037319:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383019:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)19:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]19:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)19:10
openstackLaunchpad bug 1693830 in tripleo "ovb-upgrade job fails with gnocchi upgrade command timeout" [Critical,Triaged]19:10
*** dciabrin has joined #tripleo19:11
*** Goneri has joined #tripleo19:14
*** artom_ is now known as arotm19:17
*** arotm is now known as artom19:17
jschluetdmsimard: ack thanks19:22
Slowerdmsimard: cool thx19:28
*** artom has quit IRC19:30
*** jaganathan has quit IRC19:35
*** gvrangan has quit IRC19:35
*** jaganathan has joined #tripleo19:36
*** jaganathan has quit IRC19:41
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add stack deploy status output for failed deploy debugging  https://review.openstack.org/46842919:45
*** ebarrera_ has joined #tripleo19:46
*** jkilpatr has quit IRC19:49
*** noslzzp has quit IRC19:49
*** egafford has quit IRC19:52
*** panda is now known as panda|travel19:57
*** ffiore has joined #tripleo20:02
*** thrash is now known as thrash|g0ne20:02
openstackgerritAlan Bishop proposed openstack/tripleo-common master: Derive Params (part 2): Get services and feature list  https://review.openstack.org/45647120:02
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Move config out of parameter YAML file  https://review.openstack.org/46324220:03
*** lblanchard has quit IRC20:06
*** jkilpatr has joined #tripleo20:08
openstackgerritMerged openstack/tripleo-quickstart master: Add repo-setup role from -extras, use it to inject repos into images  https://review.openstack.org/45628620:09
openstackgerritMerged openstack/tripleo-quickstart-extras master: Remove repo-setup role, being added to tripleo-quickstart  https://review.openstack.org/45628820:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019520:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013220:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037320:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383020:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]20:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)20:10
openstackLaunchpad bug 1693830 in tripleo "ovb-upgrade job fails with gnocchi upgrade command timeout" [Critical,Triaged]20:10
*** milan has quit IRC20:10
*** milan has joined #tripleo20:13
*** milan has quit IRC20:25
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: CI test - never merge  https://review.openstack.org/46100020:25
*** abishop has quit IRC20:31
*** milan has joined #tripleo20:34
*** ffiore has quit IRC20:34
*** milan has quit IRC20:41
*** salmankhan has joined #tripleo20:43
*** d0ugal has quit IRC20:46
*** rbowen has quit IRC20:51
*** sshnaidm|off has quit IRC20:53
*** ecerquei_ has joined #tripleo20:56
*** bfournie has quit IRC20:58
*** ecerquei has quit IRC20:59
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add a minimal network isolation config  https://review.openstack.org/46574121:00
*** dprince has quit IRC21:01
*** trown is now known as trown|outtypewww21:03
*** artom has joined #tripleo21:04
*** jayg is now known as jayg|g0n321:04
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE: Add test commit to check gate triggers  https://review.openstack.org/40381821:04
*** iranzo has joined #tripleo21:08
*** iranzo has joined #tripleo21:08
openstackgerritAlex Schultz proposed openstack/tripleo-repos master: Add docs structure  https://review.openstack.org/46854421:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019521:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013221:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037321:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383021:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]21:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)21:10
openstackLaunchpad bug 1693830 in tripleo "ovb-upgrade job fails with gnocchi upgrade command timeout" [Critical,Triaged]21:10
*** ecerquei_ has quit IRC21:12
*** milan has joined #tripleo21:13
*** iranzo has quit IRC21:14
*** dbecker has quit IRC21:15
*** nyechiel has quit IRC21:17
*** nyechiel has joined #tripleo21:18
openstackgerritAlex Schultz proposed openstack/tripleo-repos master: Add docs structure  https://review.openstack.org/46854421:22
*** milan has quit IRC21:24
*** nyechiel has quit IRC21:26
*** nyechiel_ has joined #tripleo21:27
*** dbecker has joined #tripleo21:28
openstackgerritAlex Schultz proposed openstack/tripleo-repos master: Add docs structure  https://review.openstack.org/46854421:31
*** nyechiel_ has quit IRC21:32
*** bfournie has joined #tripleo21:32
*** bfournie has quit IRC21:33
*** milan has joined #tripleo21:33
*** dbecker has quit IRC21:33
*** bfournie has joined #tripleo21:34
*** morazi has quit IRC21:37
*** milan has quit IRC21:39
*** nyechiel_ has joined #tripleo21:41
*** nyechiel_ has quit IRC21:45
*** rlandy has quit IRC21:53
*** nyechiel_ has joined #tripleo21:55
*** nyechiel_ has quit IRC22:01
*** apevec has joined #tripleo22:07
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019522:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013222:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383022:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]22:10
openstackLaunchpad bug 1693830 in tripleo "ovb-upgrade job fails with gnocchi upgrade command timeout" [Critical,Triaged]22:10
apevecwhich one of ^ is blocking ooo periodic ?22:11
apeveccurrent-tripleo is 5 days old22:12
*** nyechiel_ has joined #tripleo22:13
*** milan has joined #tripleo22:13
openstackgerritSteve Baker proposed openstack/puppet-tripleo master: Restart docker after changing storage driver  https://review.openstack.org/46820122:14
*** nyechiel_ has quit IRC22:18
*** nyechiel_ has joined #tripleo22:20
*** milan has quit IRC22:25
*** nyechiel_ has quit IRC22:26
openstackgerritAlex Schultz proposed openstack/tripleo-repos master: Add docs structure  https://review.openstack.org/46854422:30
*** milan has joined #tripleo22:33
*** milan has quit IRC22:40
*** ipsecguy has quit IRC22:41
*** ipsecguy has joined #tripleo22:41
*** salmankhan has quit IRC22:44
*** gbarros has joined #tripleo22:49
*** salmankhan has joined #tripleo22:55
*** salmankhan has quit IRC22:59
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019523:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013223:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383023:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]23:10
openstackLaunchpad bug 1693830 in tripleo "ovb-upgrade job fails with gnocchi upgrade command timeout" [Critical,Triaged]23:10
*** chlong has quit IRC23:10
*** milan has joined #tripleo23:14
*** yamahata has quit IRC23:18
*** rhallisey has quit IRC23:19
*** toure is now known as toure|gone23:20
*** ebarrera_ has quit IRC23:22
*** milan has quit IRC23:24
*** yamahata has joined #tripleo23:32
*** milan has joined #tripleo23:33
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Allow depending on changes we dont actually build  https://review.openstack.org/45332623:37
*** milan has quit IRC23:39
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Allow depending on changes we dont actually build  https://review.openstack.org/45332623:40
*** gbarros has quit IRC23:44
hjensasWhere in the world are we storing https://github.com/openstack/tripleo-heat-templates/blob/master/tools/process-templates.py#L64 ? I am trying to insert a pdb breakpoint/additional logging/print for debug but my change does nothing. Are we caching this somewhere where Mistral picks it up?23:44
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Allow depending on changes we dont actually build  https://review.openstack.org/45332623:46
hjensasso the one in the templates are for testing only, I guess I need changes in tripleo-common/blob/master/tripleo_common/actions/templates.py ...23:48
mwhahahahjensas: for deployments we actually run https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/templates.py23:49
mwhahahaso yea that's the one you would want to debug23:49
mwhahahajust remember to restart mistral to pickp your changes23:49
hjensasmwhahaha: ah, I did touch the one in common before without luck. It's the mistral restart then. Thanks!23:50
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Allow depending on changes we dont actually build  https://review.openstack.org/45332623:50
mwhahahahjensas: i think you just need to restart the executor but it doesn't hurt to systemctl restart openstack-mistral*23:50
hjensasmwhahaha: much better. thanks. :)23:53
*** milan has joined #tripleo23:53
*** milan has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!