Thursday, 2017-05-25

openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027700:00
*** pchavva has quit IRC00:00
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019500:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037300:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317400:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]00:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)00:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]00:10
*** yamahata has quit IRC00:11
*** rlandy has quit IRC00:16
*** bfournie has joined #tripleo00:21
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: [DO_NOT_MERGE] test service_workflow_tasks  https://review.openstack.org/46506600:28
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides a list of per-service network IPs to the workflows env  https://review.openstack.org/46768200:28
gfidenteleaving for tonight tripleo00:31
*** gfidente has quit IRC00:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Ability to enable/disable debug mode per OpenStack service  https://review.openstack.org/46769800:44
*** yamahata has joined #tripleo00:47
*** fragatina has joined #tripleo00:54
*** yamahata has quit IRC00:55
*** noslzzp has quit IRC00:58
*** tzumainn has quit IRC01:02
*** noslzzp has joined #tripleo01:07
*** noslzzp has quit IRC01:08
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019501:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037301:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317401:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]01:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)01:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]01:10
*** noslzzp has joined #tripleo01:14
*** owalsh_ has joined #tripleo01:19
*** dmacpher has quit IRC01:22
*** owalsh has quit IRC01:22
*** owalsh_ is now known as owalsh01:23
*** fragatina has quit IRC01:24
*** pkovar has quit IRC01:30
*** links has joined #tripleo01:30
*** ihrachys has quit IRC01:48
*** gbarros has quit IRC02:06
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019502:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037302:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317402:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]02:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)02:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]02:10
*** ramishra has joined #tripleo02:14
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: Ignore cp failures to config-data  https://review.openstack.org/46782502:28
*** jaganathan has quit IRC02:29
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Create and use plugin/node abstract classes  https://review.openstack.org/46782602:32
*** itlinux has joined #tripleo02:37
*** jaganathan has joined #tripleo02:42
*** gbarros has joined #tripleo02:47
*** ihrachys has joined #tripleo02:49
*** ihrachys has quit IRC02:50
*** dmacpher has joined #tripleo02:56
*** itlinux has quit IRC03:03
*** noslzzp has quit IRC03:06
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019503:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037303:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317403:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]03:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]03:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)03:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]03:10
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: docker-puppet.py bind mount /etc/puppet/ readonly  https://review.openstack.org/46523203:27
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: WIP Replace NO_ARCHIVE block with single call to rsync  https://review.openstack.org/46580203:27
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: Don't mount all of config-data /etc, /etc/httpd  https://review.openstack.org/46784603:27
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: WIP Use docker diff to capture only changed files  https://review.openstack.org/46784703:27
*** jobcespedes has joined #tripleo03:27
jobcespedesHello03:28
jobcespedesI was trying to rsync several sources to create an internal mirror server for tripleo and its images, but had no success, any pointers on how would you create one for internal use? thanks03:29
*** hamzy has joined #tripleo03:31
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: WIP Replace NO_ARCHIVE block with single call to rsync  https://review.openstack.org/46580203:32
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: WIP Use docker diff to capture only changed files  https://review.openstack.org/46784703:32
*** psahoo has joined #tripleo03:34
*** ykarel has joined #tripleo04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019504:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037304:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317404:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]04:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)04:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]04:10
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] Add Introspection status to Nodes  https://review.openstack.org/46787204:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Produce API documentation  https://review.openstack.org/46787304:15
*** nyechiel has joined #tripleo04:16
*** jaganathan has quit IRC04:18
*** gbarros has quit IRC04:23
*** skramaja has joined #tripleo04:25
*** jaganathan has joined #tripleo04:32
*** janki has joined #tripleo04:32
*** nyechiel has quit IRC04:44
*** jtomasek has quit IRC04:46
*** karthiks has joined #tripleo05:00
*** jaganathan has quit IRC05:08
*** jaganathan has joined #tripleo05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019505:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013205:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037305:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317405:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]05:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)05:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]05:10
*** udesale has joined #tripleo05:17
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use networkx for digraph  https://review.openstack.org/46741905:22
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Create and use plugin/node abstract classes  https://review.openstack.org/46782605:22
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Produce API documentation  https://review.openstack.org/46787305:22
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Adding unit testing for configuration  https://review.openstack.org/46695905:22
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add a more generic tree->graph parser  https://review.openstack.org/46541705:22
*** ratailor has joined #tripleo05:24
*** rwsu has joined #tripleo05:27
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Modify PreNetworkConfig config inline with role-specific parameters  https://review.openstack.org/44705105:34
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Enable DPDK on boot using PreNetworkConfig  https://review.openstack.org/46749005:34
*** prateek has joined #tripleo05:40
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Modify PreNetworkConfig config inline with role-specific parameters  https://review.openstack.org/44705105:42
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Enable DPDK on boot using PreNetworkConfig  https://review.openstack.org/46749005:42
*** iranzo has joined #tripleo05:53
ratailorHi05:53
ratailorI am following http://hardysteven.blogspot.in/2016/08/tripleo-deploy-artifacts-and-puppet.html article to test puppet-nova changes, Could anybody help me..05:53
ratailorHow can I deploy overcloud nodes after running "upload-puppet-modules -d puppet-module" command.05:54
ratailorIt has created a tarball, upload tarball to swift, got a tempurl and created heat env file which references to tarball location.05:54
*** jaganathan has quit IRC05:55
ratailorNow how can I deploy overcloud with these changes ?05:55
*** yprokule has joined #tripleo06:05
*** jaganathan has joined #tripleo06:07
*** masco has joined #tripleo06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019506:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037306:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317406:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]06:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)06:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]06:10
*** jprovazn has joined #tripleo06:14
*** rcernin has joined #tripleo06:18
*** jaganathan has quit IRC06:18
*** jaganathan has joined #tripleo06:19
*** ebarrera has joined #tripleo06:19
*** pcaruana has joined #tripleo06:20
*** ebarrera has quit IRC06:22
*** ebarrera has joined #tripleo06:23
ratailorcould anybody help regarding my question above ?06:27
*** mdnadeem has joined #tripleo06:27
*** mcornea has joined #tripleo06:40
*** pgadiya has joined #tripleo06:40
*** pgadiya has quit IRC06:41
*** dparkes has joined #tripleo06:43
*** jobcespedes has quit IRC06:45
*** zoli|gone is now known as zoli|wfh06:46
openstackgerritSaravanan KR proposed openstack/tripleo-common master: WIP: Move passwords from mistral environment to swift environment  https://review.openstack.org/46790906:50
*** bugzy_ has joined #tripleo06:53
*** jlinkes has joined #tripleo06:54
*** bugzy has quit IRC06:55
*** bogdando has joined #tripleo06:58
*** agurenko has joined #tripleo07:00
*** dmacpher has quit IRC07:01
*** aufi has joined #tripleo07:08
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037307:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317407:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]07:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]07:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)07:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]07:10
*** shardy has joined #tripleo07:10
*** dixiaoli has joined #tripleo07:13
*** matbu is now known as matbu|dayoff07:13
*** ffiore has joined #tripleo07:17
*** yprokule_ has joined #tripleo07:20
*** yprokule has quit IRC07:22
*** yprokule_ is now known as yprokule07:22
*** suuuper has joined #tripleo07:29
*** pkovar has joined #tripleo07:31
*** dsariel has joined #tripleo07:34
openstackgerritBartosz Stopa proposed openstack/tripleo-heat-templates master: Add support for linuxbridge agent  https://review.openstack.org/45793807:34
*** jpich has joined #tripleo07:35
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Make DockerImageUploader work with missing tags  https://review.openstack.org/45874307:36
*** dtantsur|afk is now known as dtantsur07:38
*** fragatina has joined #tripleo07:38
*** karimb has joined #tripleo07:41
*** fragatina has quit IRC07:44
*** egonzalez has joined #tripleo07:44
*** zoli|wfh is now known as zoli|afk07:52
*** skramaja has quit IRC07:52
*** amoralej|off is now known as amoralej07:56
bogdandofolks, do you know why "overcloud deploy" command complains with "public endpoint for baremetal service not found"?07:57
bogdandoand which is the place containing this code?07:57
*** tvignaud_pto has quit IRC07:58
*** jpena|off is now known as jpena07:58
bogdandoI suppose, not all deployment cases assume provisioning infra running undercloud07:58
bogdandoit seems need to be fixed!07:58
bogdandoditto to the "public endpoint for object-storage service not found" complaint07:58
shardybogdando: swift and ironic are dependencies for TripleO, why aren't they running on the undercloud?07:59
bogdandoshardy: why they must?07:59
bogdandoI'm trying to understand that dependency07:59
bogdandoit seems obsoleted by composable roles epoch07:59
*** zzzeek has quit IRC08:00
shardybogdando: we store templates (a "plan") in swift and the j2 templating etc happens via mistral and is written to swift08:00
*** aufi has quit IRC08:00
bogdandobasically, this https://bugs.launchpad.net/tripleo/+bug/169343508:00
openstackLaunchpad bug 1693435 in tripleo "[CI] Compose undercloud and overcloud services/roles, pull docker images for only changes under test" [High,Triaged]08:00
bogdandoyeah, that understandable. But baremetal?08:00
shardybogdando: it is (in recent versions) possible to skip the ironic dependency and use pre-provisioned nodes, but I suspect there's some historical code somewhere which expects it08:01
shardyprobably in tripleoclient where we had (or perhaps still have) some pre-deploy validations08:01
bogdandoright, so that's my question, looking for a place to fix... is it a python-tripleoclient?08:01
shardybogdando: that's my guess but it's hard to be sure without seeing the error08:01
shardyperhaps re-run with --debug and see the backtrace?08:02
*** zzzeek has joined #tripleo08:02
bogdandoshardy: https://pastebin.com/RTVQP13808:03
shardybogdando: doesn't your bug describe the test scenarios we already have in CI?08:03
openstackgerritMerged openstack/diskimage-builder master: Produce API documentation  https://review.openstack.org/46787308:03
bogdandoperhaps partially08:03
shardywe already trigger certain scenarios based on what templates a patch changes08:03
bogdandothe thing is to analyze changes under test08:03
bogdandothen compose services08:03
bogdandoand roles08:04
bogdandoand shrink CI scope of jobs08:04
shardybogdando: I think we already do it, it's just static not dynamically generating scenarios08:04
shardyIMHO that is easier to understand when it fails08:04
shardythan a job with a dynamically constructed mix of services08:04
bogdandoI'm not sure, I can see all openstack services logs in ci jobs08:04
*** fragatina has joined #tripleo08:05
bogdandoanother benefit is one needs no to add temporary hacks for his changes  on review to include CI testing for disabled / optional services08:05
bogdandoCI will do that for him ,by composing deployment to contain those08:06
shardybogdando: https://github.com/openstack/tripleo-heat-templates#service-testing-matrix08:06
bogdandodo you remember folks adding everything to the undercloud roles just to test it as needed?08:06
bogdandoending up having everything deployed undercloud in the end :)08:06
shardybogdando: they should just ensure their service is covered by one of the CI scenarios08:07
shardybogdando: the issue is we don't yet have scenario jobs running on container CI08:07
shardyI think jistr has been looking at it08:07
bogdandowell, I think static scenarios or dynamic, is only implementation detail. that is a missing thing tho08:07
shardyyes it is missing for containers08:07
shardywe need that exact same matrix we test for baremetal tested also for containers (deployment and upgrade)08:08
*** lucas-pto is now known as lucasagomes08:08
bogdandoshardy: an example http://logs.openstack.org/30/467430/1/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/fd24a59/logs/overcloud-controller-0/var/log/08:09
bogdandowhy we want ceph and all openstack things to test this change?08:09
shardybogdando: the issue is we don't yet have scenario jobs running on container CI08:09
bogdandonote, my example is not containers related job08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019508:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037308:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317408:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]08:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)08:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]08:10
shardyyou seem to want something more minimal, which we could also discuss, but that implies more scenarios08:10
shardybogdando: yeah the non scenario jobs enable a different matrix of testing:08:10
shardyhttps://github.com/openstack-infra/tripleo-ci/blob/master/README.rst#feature-testing-matrix08:11
bogdandoso I believe the bug is valid and there is lots of room to improve08:11
shardybogdando: sure there's always room to improve, I'm just explaining why we have the current jobs08:11
shardybogdando: with your approach we could have e.g ceph get broken by an external dependency and we wouldn't know until a periodic promotion failed08:12
shardywe get broken by non-tripleo things almost every day, so that is a consideration08:12
bogdandoshardy: I'm not sure changes to t-h-t could impact ceph08:13
*** hewbrocca_afk is now known as hewbrocca08:13
bogdandounless doing something very evil, like changing kernel service defaults (yeah, I brought a bad example)08:13
*** gfidente has joined #tripleo08:14
bogdandoand unless the changes done for puppet/services/ceph-osd.yaml or the like ofc08:14
shardybogdando: Ok let me put it another way - what if we don't land a tht patch to ceph-osd.yaml for two months08:15
shardyand in that time, something outside of TripleO causes our ceph deployment to break08:15
shardythat happens, all the time08:15
*** tvignaud_pto has joined #tripleo08:15
bogdandoshardy: hm, I can't see how external to patch changes are related to the patch scope08:16
bogdandoperhaps external regressions need to be caught by periodic checkups08:17
bogdandoit is ok to piggyback patches with spotting such failures, but I'm not sure it is :)08:17
shardybogdando: yes that also already happens https://etherpad.openstack.org/p/tripleo-ci-status08:18
bogdandofailures unrelated to patches*08:18
shardyhttps://dashboards.rdoproject.org/rdo-dev08:18
gfidenteoh sorry joined late08:18
gfidentehopefully ceph-osd is only an example :D08:18
bogdandoI will not argue though, I know not much wrt tripleo CI08:18
bogdandojust thoughts for the #deployment-time hackaton :)08:19
bogdandorandom thoughts mostly08:19
gfidenteshardy I just had to copy/paste your yaql to pass the per-service IPs08:19
bogdandohttp://lists.openstack.org/pipermail/openstack-dev/2017-May/117263.html08:19
gfidenteshardy it works fine, I've pushed a change for that now :D08:20
shardybogdando: sure, its a good idea, I'm just saying it will mean external regressions get caught later, e.g the promotion pipeline and periodic jobs would be much less stable if we test less per commit08:20
gfidenteand good morning #tripleo08:20
bogdandoshardy: right, there is blocking for devs vs unblocking pattern08:20
bogdandothe blocking is to piggiback on their patches08:21
bogdandounblocking is to "detect external regressions get caught later, be periodic jobs"08:21
*** zoli|afk is now known as zoli|wfh08:22
bogdandothe only benefit for blocking is: we never merge unrelated patches unless a regression resolved08:23
shardybogdando: Sure, I get it - but if you follow https://etherpad.openstack.org/p/tripleo-ci-status for a few weeks, you'll understand why making that promotion more buggy may be unpopular ;)08:23
bogdandoby the price of dev team velocity etc. May be it is a good thing, I don't know08:23
bogdandoshardy: I see :)08:24
shardybogdando: sure, if you accept that at any time your trunk builds are probably broken08:24
shardyfor some subset of your features08:24
*** pkovar has quit IRC08:24
*** panda|bbl is now known as panda08:25
* shardy notes the etherpad stuff has actually moved to trello, but you get the point08:25
*** aufi has joined #tripleo08:25
bogdandoshardy: I'll set my bug to opinion then allowing it to rest in the peace08:25
shardybogdando: sure, but you can leave it open if you prefer, I'll add a comment and others may have different opinions/ideas08:27
bogdandook08:27
* bogdando notes that building testing matrixes and pipelining them in promoted chain has a strange and nerdish joy08:29
*** athomas has joined #tripleo08:29
*** yprokule_ has joined #tripleo08:35
*** yprokule has quit IRC08:38
*** yprokule_ is now known as yprokule08:38
*** dbecker has joined #tripleo08:38
*** agurenko has quit IRC08:45
*** agurenko has joined #tripleo08:46
*** ebarrera has quit IRC08:51
*** ebarrera has joined #tripleo08:51
dtantsurbogdando: making Ironic dependency optional is going to be a huuuuge challenge08:57
openstackgerritMerged openstack/tripleo-common master: Replace assertRaisesRegexp with assertRaisesRegex  https://review.openstack.org/46748408:57
bogdandodtantsur: yeah, I can see this now after a 10 min deep into the tripleoclient :(08:57
openstackgerritMerged openstack/python-tripleoclient master: Fix 'introspection bulk status' when some nodes were never introspected  https://review.openstack.org/46354908:57
dtantsurit's not impossible, but we need to replace simple thing like client_manager.baremetal with a smart detection like "oh, sorry, you disabled ironic, so FEATURE_NAME is not available for you"08:58
openstackgerritMerged openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/46255908:58
bogdandodtantsur: I thought to add a param like '--pre-provisioned'08:58
dtantsurbogdando: and that's only tripleoclient ;) there is much more in tripleo-common08:58
bogdandothen make all baremetal logic involved to depend on it, seems not easy tho08:58
bogdandooh my08:58
dtantsurnot easy at all08:58
bogdandookay, let's just keep deployin' it!08:59
bogdando:D08:59
dtantsurbogdando: if you want an exercise for lightening the undercloud, you can think about making Nova and Glance optional. We use nearly no features of these two, and we actually work around the Nova scheduler in some scenarios.08:59
bogdandodtantsur: good point! thanks09:00
dtantsurit's not going to be easy either, but is worth exploring too09:00
shardyCan I get reviews for https://review.openstack.org/#/c/465449/ and https://review.openstack.org/#/c/465560 please?09:00
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient stable/ocata: Fix 'introspection bulk status' when some nodes were never introspected  https://review.openstack.org/46793509:00
*** ckyriakidou has joined #tripleo09:00
bogdandoI'll add that to the bug https://bugs.launchpad.net/tripleo/+bug/169344809:00
openstackLaunchpad bug 1693448 in tripleo "Undercloud baremetal services contstraint should be removed from tripleoclient" [Medium,Triaged]09:00
shardydtantsur: +1 I'd like to see nova replaced with a mistral workflow that deploys nodes directly via ironic09:00
dtantsuryep. and ironic can also fetch images from an HTTP location, so no need for glance really..09:01
shardyI started a patch doing that but never completed it09:01
dtantsurshardy: maybe you can hand your patch to bogdando for researching?09:01
bogdandoshardy: ;)09:01
shardydtantsur: interesting - with the move to containers the image used becomes much less interesting, so we could consider moving away from glance09:01
bogdandoI'm learning code base, so why not09:01
bogdandothat gives me a reason to spend some time on it09:02
shardyhttps://review.openstack.org/#/c/313048/ is the patch09:02
bogdandothanks! shardy09:02
dtantsurbogdando: another easy win: make ironic-inspector optional. it's also a hard dependency now, but it's not AS hard as ironic, and with removing it you only lose introspection.09:02
bogdandoand dtantsur, that was a valuable input. Let's work hard to make the #deployment-time effort happen :)09:02
shardyIt has some problems and review comments which I never found time to address09:02
dtantsurbogdando: sure :) ping me if you need any information about ironic and/or ironic-inspector09:03
bogdandohttps://bugs.launchpad.net/tripleo/+bug/1693448 nice , eh?09:06
openstackLaunchpad bug 1693448 in tripleo "Undercloud baremetal/nova/glance services contstraints should be altered to non-mandatory for the tripleoclient and tripleo-common logic" [Medium,Triaged]09:06
*** salmankhan has joined #tripleo09:06
*** derekh has joined #tripleo09:09
dtantsurbogdando: nice indeed. maybe it's worth emphasizing that we want to provide a reasonable user experience without some of these services09:09
*** aufi has quit IRC09:09
dtantsurand we can think of removing Nova and Glance completely, not just making them optional09:09
bogdandoindeed09:09
* dtantsur left a new comment on shardy's patch09:10
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013209:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037309:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317409:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]09:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]09:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)09:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]09:10
*** pmannidi__ has quit IRC09:10
*** aufi has joined #tripleo09:11
shardydtantsur: is there anywhere a reference of the ironic CLI commands you could run to deploy a node without nova?09:11
dtantsurlemme think..09:11
shardydtantsur: I think my patch stalled because I didn't quite understand the exact workflow, particularly around networking, so it was hard to debug and translate it into mistral09:12
EmilienMgood morning09:12
d0ugalshardy: do you know how much work would be needed to finish the nova replacement?09:12
* EmilienM just landed in homeland09:12
d0ugaloh, it looks like you just answrered that :D09:12
shardyd0ugal: well the hard part is fixing my broken patch I just linked ;)09:12
d0ugalMorning EmilienM!09:12
shardyd0ugal: when we have that, wiring it in via t-h-t probably wouldn't be that hard09:12
d0ugalshardy: haha, sure - I guess I was trying to measure how broken it was :)09:12
shardyusing the new CustomResource interface gfidente has been working on09:12
shardyEmilienM: o/09:13
EmilienMshardy, d0ugal: hey folks09:13
dtantsurshardy, d0ugal: look what I've found http://docs.ansible.com/ansible/os_ironic_node_module.html09:14
hewbroccawut wut wut09:14
d0ugaldtantsur: neat - so t-h-t -> Mistral -> Ansible?09:14
dtantsur\o/09:14
dtantsurand everything in containers! awesome, no?09:15
shardylol09:15
d0ugalawesome09:15
EmilienMdprince and I were wondering if using shade in TripleO was really what we wanted09:15
d0ugalMistral is turning into a pretty nice glue09:15
EmilienMshardy highlighted the fact that Ansible modules for OpenStack are based on shade09:15
dtantsuryep09:15
EmilienMso we would have to implement new modules if we wouldn't want to use shade09:15
EmilienMjust FYI09:15
shardydtantsur: thanks, will check that out, but for TripleO I really think a native mistral workflow would be better09:16
EmilienMI'm in favor of re-using what already exist09:16
dtantsurshardy: your patch is close, needs some polishing mostly. maybe also config_drive support09:16
EmilienMbut we need to keep that in mind, shade is really special (the use case is really about multiprovider)09:16
dtantsurshardy: we can see how this workflow is implemeted and.. ahemm.. cargo-cult it :)09:16
shardydtantsur: yup absolutely, it could provide some inspriration ;)09:16
shardyyeah all of the ansible native openstack modules depend on shade09:17
d0ugalWhy don't we want shade?09:17
d0ugalI don't know much about it.09:17
dtantsurd0ugal: http://inaugust.com/talks/everything-you-ever-wanted.html#/09:18
shardyd0ugal: I think the concern from dprince was the level of complexity required to handle multiple public clouds etc09:18
EmilienMyes that ^09:18
shardywe just need a clean interface to run a workflow on exactly one cloud09:18
shardymistral already gives us a nice way to do that09:19
EmilienMon the other hand, TripleO clouds are using standard APIs, etc, I don't think we would fall in complicated use cases09:19
d0ugaltrue, makes sense09:19
d0ugalthanks09:19
dtantsuranyway, share does not seem to support vif attach/detach API that we need to use nowadays09:20
dtantsurso I guess fixing shardy's patch is a way to go. Addressing the comments should be mostly enough, we only need to figure out config drive building on top of that.09:21
EmilienMdtantsur: you mean neutron port attach into an instance?09:22
dtantsurEmilienM: attaching VIF to Ironic port (which ends up in Ironic attaching Neutron port)09:22
EmilienMindeed I don't see it09:22
dtantsurthis is api-ref, it's dead easy: https://developer.openstack.org/api-ref/baremetal/#attach-a-vif-to-a-node09:23
dtantsurbogdando, d0ugal, if any of you wants to continue that patch, I can provide assistance with understanding/debugging ironic :)09:24
*** aufi has quit IRC09:24
EmilienMI think shade use case is "get me a network"09:24
EmilienMso users don't have to make a choice09:25
d0ugaldtantsur: thanks, I'd really like to - but I need to clear off a few things first, so we shall see.09:25
EmilienMwhich is again, aligned with the mission of shade I guess09:25
dtantsuryep09:25
EmilienMdtantsur: I would be curious to ask Monty what he thinks, it's worth asking09:26
dtantsur++09:26
shardyOk I restored https://review.openstack.org/#/c/313048/09:33
shardyIf anyone wants to push an update feel free, otherwise I'll try to take another look next week09:34
*** udesale has quit IRC09:34
openstackgerritMerged openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/46732009:34
sshnaidm|afkarxcruz, ping09:35
*** sshnaidm|afk is now known as sshnaidm09:35
sshnaidmEmilienM, hi, is it ok now? https://review.openstack.org/#/c/467620/09:39
*** udesale has joined #tripleo09:39
EmilienMsshnaidm: it's better, thanks09:40
EmilienMsshnaidm: commit messages are crucial if we want more reviewers. People need to understand what patches are doing09:40
sshnaidmEmilienM, sure09:40
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Ability to enable/disable debug mode per OpenStack service  https://review.openstack.org/46769809:41
EmilienMsshnaidm: https://review.openstack.org/#/c/467648/09:42
openstackgerritBartosz Stopa proposed openstack/tripleo-heat-templates master: Add support for linuxbridge agent  https://review.openstack.org/45793809:43
*** anshul has joined #tripleo09:45
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Make network-isolation environment rendered for all roles  https://review.openstack.org/40992009:46
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: Derive Params (part 1): Initial workflow to start  https://review.openstack.org/45646909:46
EmilienMI'm sad to announce our upgrade jobs on stable/ocata are red09:47
*** udesale has quit IRC09:48
EmilienMd0ugal: maybe you can help on this one: http://logs.openstack.org/50/463050/6/check/gate-tripleo-ci-centos-7-scenario003-multinode-upgrades/0c60435/console.html#_2017-05-24_23_05_07_00562009:48
EmilienMd0ugal: I sounds familiar to me this one09:48
d0ugalEmilienM: looking.09:49
d0ugalEmilienM: has it been renamed to "workflow"?09:49
arxcruzsshnaidm: pong09:50
d0ugalI kinda hope not, but I did see discussions about it09:50
arxcruzsshnaidm: it's holiday here today :)09:50
sshnaidmarxcruz, oh, sorry09:50
EmilienMd0ugal: I'm looking, we should have the endpoint09:50
sshnaidmarxcruz, just fyi, nothing blocks tempest job now09:51
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: Derive Params (part 1): Initial workflow to start  https://review.openstack.org/45646909:51
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: collect-logs: add README for log files  https://review.openstack.org/45631709:52
arxcruzsshnaidm: cool, thanks :)09:52
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: collect-logs: add README for log files  https://review.openstack.org/45631709:52
*** udesale has joined #tripleo09:53
*** anshul has quit IRC09:53
EmilienMthe error with Mistral is confirmed in heat engine: http://logs.openstack.org/50/463050/6/check/gate-tripleo-ci-centos-7-scenario003-multinode-upgrades/0c60435/logs/subnode-2/var/log/heat/heat-engine.txt.gz#_2017-05-24_23_05_06_99509:56
EmilienMI think I know why09:56
EmilienMI'm pretty sure Mistral is not deployed after the upgrade09:56
d0ugalEmilienM: I was just gonna say, I don't even see any Mistral logs.09:56
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/46796709:57
EmilienMso we didn't deploy Mistral in scenario003 in Newton09:57
EmilienMbut we added it in Ocata09:57
EmilienMpreviously, upgrade jobs were adding the service09:57
EmilienMbut I suspect a recent change in tripleo stopped doing that09:57
d0ugalright09:57
EmilienMthough we run the pingtest from ocata09:57
EmilienMI'm pretty sure it's because of https://review.openstack.org/#/c/462570/09:58
shardyhttps://review.openstack.org/#/c/464667/ is also related09:58
*** aufi has joined #tripleo09:59
shardyI deliberately maintain the same scenario, so we just test upgrading, not adding services09:59
shardyif that's not what we want, we could remove the L376 copy10:00
EmilienMshardy: what do we want? adding services or keep the same?10:00
EmilienMI personally like the idea of adding new services10:00
shardyEmilienM: IMO an upgrade job should deploy services, then upgrade them10:00
EmilienMbut I agree it might be complicated to maintain10:00
EmilienMthough in reality adding services can happen10:00
*** pkovar has joined #tripleo10:00
shardyEmilienM: I did it like this because I thought we were always deploying the same scenario10:00
shardyif that's not the case and it's broken CI, we can remove that cp and just add things10:01
shardyprovided it works10:01
EmilienMthe problem is that right nøw the pingtest used is not the stable one but the one from the upgraded version10:01
shardyI was worried about things like new servies requiring additional packages10:01
shardywhich won't be included when we do the pre-upgrade node bootstrap10:01
shardyEmilienM: ack, can we fix that so it runs the stable pingtest?10:02
*** adarazs is now known as adarazs_lunch10:02
EmilienMshardy: well, we add them with the upgrade tasks10:03
EmilienMshardy: remember we made it working when we released Ocata10:03
EmilienMby deploying new packages in the upgrade tasks10:03
shardyEmilienM: ah, OK, maybe we just remove the cp then10:03
shardysec I'll push a patch10:03
EmilienMif you're ok with that10:04
*** anshul has joined #tripleo10:04
EmilienMshardy: I'll check your patch with https://review.openstack.org/#/c/463050/10:05
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci master: Don't maintain stable scenario env in upgrade CI  https://review.openstack.org/46797310:07
*** apetrich_ has quit IRC10:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Ocata upgrades testing - DNM  https://review.openstack.org/46305010:08
EmilienMshardy: thx10:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019510:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013210:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037310:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317410:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]10:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)10:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]10:10
*** zoli|wfh is now known as zoli|lunch10:12
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use networkx for digraph  https://review.openstack.org/46741910:19
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Create and use plugin/node abstract classes  https://review.openstack.org/46782610:19
*** udesale has quit IRC10:23
*** udesale has joined #tripleo10:23
*** oidgar has joined #tripleo10:29
*** milan has joined #tripleo10:36
*** milan has left #tripleo10:36
*** milan has quit IRC10:36
openstackgerritMerged openstack/tripleo-heat-templates master: Enable mistral to run under mod_wsgi  https://review.openstack.org/45850410:38
*** dixiaoli has quit IRC10:39
*** salmankhan has quit IRC10:48
*** lucasagomes is now known as lucas-hungry10:48
*** salmankhan has joined #tripleo10:54
*** jkilpatr has quit IRC10:57
*** adarazs_lunch is now known as adarazs11:01
*** skramaja has joined #tripleo11:04
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019511:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013211:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037311:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317411:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]11:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)11:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]11:10
*** rhallisey has joined #tripleo11:12
*** jkilpatr has joined #tripleo11:14
yolandahi, what is the recommended way to delete a stack on newton? is enough with stack stack delete, or also we need to delete the mistral plan?11:16
*** ecerquei_ has quit IRC11:16
shardyyolanda: the overcloud delete command deletes the stack and the plan, so I'd do that to be sure you're starting from a clean environment11:19
dtantsurTIL11:19
* dtantsur always used 'openstack stack delete'11:19
shardydtantsur: in most cases that is enough, but there have been a few obscure cases where deleting the plan fixed problems11:20
shardyhttps://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_delete.py#L9511:20
yolandacool, thx11:21
*** ffiore has quit IRC11:21
dtantsurI see11:21
yolandadtantsur, we learned new things :)11:22
*** anshul has quit IRC11:22
dtantsurevery day, every single day :)11:22
yolandajoy!11:22
shardyIs anyone else having issues with undercloud deploy on t-h-t trunk?11:23
shardyI'm seeing an error from the base heat-engine make_url11:24
shardybut the CI job looks ok...11:24
openstackgerritMatthias Runge proposed openstack/tripleo-quickstart master: Adjust handling of autostart  https://review.openstack.org/46756411:25
*** jpena is now known as jpena|lunch11:26
*** prateek has quit IRC11:28
*** amoralej is now known as amoralej|lunch11:28
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient stable/newton: Fix 'introspection bulk status' when some nodes were never introspected  https://review.openstack.org/46800211:33
*** michapma has joined #tripleo11:36
*** nyechiel has joined #tripleo11:40
*** ebarrera has quit IRC11:42
*** ebarrera has joined #tripleo11:42
*** jtomasek has joined #tripleo11:46
gfidenteshardy I was about to rerun oooq11:47
gfidentebut that uses heat from promotion right?11:48
*** pradk has joined #tripleo11:48
shardygfidente: yes, you can upgrade it on the undercloud after it's deployed though11:48
gfidenteshardy ok wait11:49
*** thrash|g0ne is now known as thrash11:49
*** abishop has joined #tripleo11:49
gfidenteshardy http://trunk.rdoproject.org/centos7/current/openstack-heat-engine-9.0.0-0.20170525085504.1efd0b4.el7.centos.noarch.rpm ?11:51
shardygfidente: no I think you'll get current-tripleo11:52
gfidenteshardy no that's from /current/ dated 25th11:53
gfidenteisn't it latest build regardless of promotion?11:53
*** zoli|lunch is now known as zoli|wfh11:53
shardygfidente: yes I was just saying quickstart shouldn't install heat from that repo11:54
sshnaidmfyi https://bugs.launchpad.net/tripleo/+bug/169348911:54
openstackLaunchpad bug 1693489 in tripleo "Scenario 002 job fails in overcloud deployment with mongodb_node_ips error" [Critical,Triaged]11:54
gfidenteah sure I upgrade it11:54
*** lucas-hungry is now known as lucasagomes11:55
sshnaidmpradk, is it the solution of ^^ https://review.openstack.org/#/c/467353/11:55
gfidenteshardy seems up and working for me, something in particular I should look at?11:58
gfidentenote that I upgraded heat only11:59
*** rook is now known as rook-pto11:59
*** udesale has quit IRC11:59
shardygfidente: Ah, thanks but I'm debugging already, it may be specific to the container deployment11:59
*** rook-pto is now known as rook11:59
*** udesale has joined #tripleo11:59
*** udesale has quit IRC11:59
*** nyechiel has quit IRC11:59
*** apetrich_ has joined #tripleo12:00
*** jkilpatr has quit IRC12:00
*** jkilpatr has joined #tripleo12:01
pradksshnaidm, yea12:01
*** ratailor has quit IRC12:04
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Include mongodb in scenario002 job  https://review.openstack.org/46735312:05
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019512:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013212:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037312:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169317412:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]12:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)12:10
openstackLaunchpad bug 1693174 in tripleo "CI: ovb-ha jobs fail because of lack of memory" [Critical,Triaged]12:10
*** nyechiel has joined #tripleo12:12
*** rbrady-afk is now known as rbrady12:13
*** masco has quit IRC12:13
mariosbandini: \o/ " Sample environment generator" https://review.openstack.org/#/c/253638/13 I855f33a61bba5337d844555a7c41b633b3327f7a  tripleo-heat-templates12:14
mariosbandini: woops :( wrong paste12:14
mariosbandini: \o/ https://review.openstack.org/#/c/463985/ :)12:14
* bandini claims innocence12:14
* bandini looks12:14
mariosbandini: the job passed12:14
bandiniMERGE ALL THE THINGS!12:15
mariosapevec added comment on the bug " Sample environment generator" https://review.openstack.org/#/c/253638/13 I855f33a61bba5337d844555a7c41b633b3327f7a  tripleo-heat-templates12:15
mariosbandini: damn it with this paste. /me abandons irc bai https://bugs.launchpad.net/tripleo/+bug/1690373 comment #17 from apevec and yeah shipit!12:16
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)12:16
*** jkilpatr has quit IRC12:16
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP cinder-volume bundle for HA deployments  https://review.openstack.org/46774912:16
bandinieheheh12:16
bandinimarios: nice!12:16
*** dsariel has quit IRC12:16
bandiniso our theory was indeed correct12:16
mariosbandini: ack nice work ... the take away for me is 'the answer is probably in the logs even if you are sure it isn't'12:17
*** atoth has joined #tripleo12:17
marioss/probably/always12:17
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Containerize Redis for HA  https://review.openstack.org/46495812:19
*** nyechiel has quit IRC12:19
bandinimarios: that was an iffy one!12:19
*** pchavva has joined #tripleo12:19
sshnaidmdoes anybody know what is puppet-watcher ??12:21
sshnaidmEmilienM, ^^12:21
*** prateek has joined #tripleo12:21
EmilienMa puppet module to deploy watcher12:22
sshnaidmI wonder why gate job tries to build it..12:23
*** karthiks has quit IRC12:24
sshnaidmfor merging my patch https://review.openstack.org/#/c/467620 zuul collected 16(!) changes: http://logs.openstack.org/20/467620/2/gate/gate-tripleo-ci-centos-7-nonha-multinode-oooq/93cb247/console.html#_2017-05-25_10_12_46_95425012:25
*** ecerquei_ has joined #tripleo12:28
*** salmankhan has quit IRC12:29
*** dprince has joined #tripleo12:31
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Puppet module to deploy MySQL bundle for HA  https://review.openstack.org/45534512:31
mwhahahasshnaidm: there was a bug that it would get built.if in the zuul change list12:34
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Puppet module to deploy Redis bundle for HA  https://review.openstack.org/46495112:34
mwhahahasshnaidm: I thought we fixed it by using -s with findpkg12:35
*** ansmith has joined #tripleo12:35
mwhahahasshnaidm: https://review.openstack.org/#/c/465751/ was supposed to fix that12:37
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Puppet module to deploy HAProxy bundle for HA  https://review.openstack.org/45883212:37
mwhahahasshnaidm: the problem is that in zuul the changes get passed in even if not related because they are in the same queue so we end up building unnecessary things because of what's getting merged. Especially in the gate12:39
sshnaidmmwhahaha, I see.. seems like it didn't help12:39
*** ffiore has joined #tripleo12:39
sshnaidmmwhahaha, yeah, that's right, just didn't see so many changes at once12:39
*** rlandy has joined #tripleo12:40
openstackgerritBartosz Stopa proposed openstack/tripleo-heat-templates master: Add support for linuxbridge agent  https://review.openstack.org/45793812:40
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Puppet module to deploy RabbitMQ bundle for HA  https://review.openstack.org/45518912:41
mwhahahasshnaidm: happens alot when the gate gets backed up. Anyway it's related to the findpkg thing. If you recheck it'll pass if there's nothing getting merged in puppet-watcher12:41
sshnaidmmwhahaha, if this is only problem with puppet-watcher I'll add it to exclude list12:42
sshnaidmmwhahaha, but interesting why -s doesn't work12:42
mwhahahaRight now it's just watcher12:42
mwhahahaWe need to fix that bit of code cause this is why we would get failures for puppet-openstack-integration12:43
*** jkilpatr has joined #tripleo12:43
mwhahahaI think12:44
mwhahahaAnyway an exclude would work for now12:44
*** pkovar has quit IRC12:47
shardydprince: Hey when running the undercloud installer, I'm seeing the endpoint_map in the local t-h-t get truncated, I can't see anywhere that touches that file, but can you advise if we do anything with it?12:49
*** jpena|lunch is now known as jpena12:51
*** pkovar has joined #tripleo12:52
dprinceshardy: thinking...12:53
dprinceshardy: my processor is a bit slow these days :)12:53
shardydprince: it's weird, I chmod 444'd it and it still gets truncated12:53
shardyI'll add an audit rule and hopefully track down what does it12:54
*** morazi has joined #tripleo12:54
*** links has quit IRC12:54
amoralej|lunchsshnaidm, new version of python2-idna is pushed, that should fix the memory issues12:54
*** amoralej|lunch is now known as amoralej12:54
dprinceshardy: I don't think we do anything special for this. Only thing we add that would directly affect the endpoint_map is the --local-ip bit12:54
sshnaidmamoralej|lunch, great, thanks12:54
amoraleji'll remove the tags from the LP12:54
shardydprince: Ok thanks, just wanted to sanity check, will keep digging12:54
dprinceshardy: you aren't passing in like a ginormous local-ip are you?12:54
sshnaidmamoralej, I'd like just to see one job passes before closing it12:55
sshnaidmamoralej, we need ensure it resolved12:55
amoralejyeah, i'm not closing it so far, only removing the alert12:55
amoralejok?12:55
sshnaidmamoralej, sure12:55
amoralejlet me know what do you observe12:55
shardydprince: No, my only customization is some t-h-t changes and running with --heat-native12:55
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: WIP: Fix upgrading cinder-volume under pacemaker  https://review.openstack.org/46728012:56
dprinceshardy: sounds good12:56
*** dsariel has joined #tripleo12:56
*** liverpooler has joined #tripleo12:56
*** trown|outtypewww is now known as trown12:57
*** jchhatbar has joined #tripleo12:58
*** janki has quit IRC12:58
*** gvrangan has joined #tripleo12:58
*** jmelvin has joined #tripleo12:58
gvrangantrozet, Hi12:58
gvrangantrozet, I have successfuly deployed control and compute nodes12:59
gvrangantrozet, I do not have Redhat Openstack Platform12:59
sshnaidmtrown, hi12:59
*** Goneri has joined #tripleo12:59
gvrangantrozet, How do I deploy Opendaylight?12:59
*** eck`gone is now known as eck`12:59
sshnaidmtrown, do you work on disabling telemetry in jobs?12:59
trownsshnaidm: I wasnt... but I can13:00
sshnaidmtrown, sorry, I misunderstood then13:00
sshnaidmtrown, I think it would be great, though13:01
sshnaidmboth from ha and ovb updates, we anyway don't test it at all13:03
*** psahoo has quit IRC13:03
*** thrash is now known as thrash|biab13:03
*** noslzzp has joined #tripleo13:04
trownsshnaidm: so I guess we need to add a config option to quickstart for it, then add that to featureset001?13:04
sshnaidmtrown, yep, it would be best13:05
sshnaidmtrown, seems like it should be telemetry_args for overcloud pre-deploy, right?13:06
*** chlong has quit IRC13:06
sshnaidmor it could be switched off in easier way13:06
trownsshnaidm: I think we just create a disable-telemetry environment in tht https://github.com/openstack/tripleo-heat-templates/tree/master/environments and then add option in quickstart to include it13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019513:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013213:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037313:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,Triaged]13:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]13:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)13:10
sshnaidmtrown, yep, looks great13:10
trownsshnaidm: ok, working on some patches13:10
sshnaidmphew, only 3 alerts13:10
adarazssshnaidm, trown: are you expecting to get rid of the out of memory errors by disabling telemetry?13:11
trownadarazs: that is the idea ya13:11
adarazsgood. :)13:12
sshnaidmadarazs, we have already fixed python-idna by amoralej13:12
sshnaidmadarazs, but it's still will help us a lot13:12
sshnaidmanyway it didn't work when I looked at it last time13:13
*** jchhatbar is now known as janki13:15
*** tzumainn has joined #tripleo13:16
*** atoth has quit IRC13:17
*** atoth has joined #tripleo13:18
*** ccamacho|out has quit IRC13:18
*** atoth has quit IRC13:18
*** atoth has joined #tripleo13:19
trownpanko is telemetry?13:21
trownah yep13:21
sshnaidmgnocchi too13:22
sshnaidmeverything that looks like a italian food13:22
*** dhill_ has quit IRC13:24
adarazsheh13:24
*** fragatina has quit IRC13:25
*** dixiaoli has joined #tripleo13:26
trownpanko is japenese though13:26
trownjapanese even13:26
*** salmankhan has joined #tripleo13:27
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Add heat environment for disabling all telemetry services  https://review.openstack.org/46803113:28
*** dixiaoli has quit IRC13:28
*** thrash|biab is now known as thrash13:29
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add interactive prompt to recreate venv in case last run failed  https://review.openstack.org/46767913:32
*** prateek has quit IRC13:33
*** lblanchard has joined #tripleo13:33
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP cinder-volume bundle for HA deployments  https://review.openstack.org/46774913:33
*** dsariel has quit IRC13:34
*** yamahata has joined #tripleo13:39
*** fzdarsky has joined #tripleo13:39
adarazsEmilienM, rbrady, trown, sshnaidm, weshay, hrybacki, panda, rlandy, bkero, arxcruz, bogdando: CI Squad meeting in 50 minutes folks! https://etherpad.openstack.org/p/tripleo-ci-squad-meeting -- add topics (prefixed with your nick) if desired.13:40
*** ebarrera_ has joined #tripleo13:41
*** AzazeL_ has quit IRC13:41
rlandyadarazs: thanks adding an item13:42
*** adarazs is now known as adarazs_afk13:42
*** egafford has joined #tripleo13:43
*** gbarros has joined #tripleo13:44
*** lblanchard has quit IRC13:45
*** lblanchard has joined #tripleo13:46
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Add a telemetry_args variable to deploy_args list  https://review.openstack.org/46803813:46
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Disable telemetry services in featureset001  https://review.openstack.org/46803913:48
trownsshnaidm: ok I think this is everything https://review.openstack.org/#/q/topic:bug/168019513:48
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Disable telemetry services in featureset001  https://review.openstack.org/46803913:49
sshnaidmtrown, https://review.openstack.org/#/c/468039/1/quickstart-extras-requirements.txt13:49
trownsshnaidm: ya just fixed that13:49
trownpesky requirements file13:49
*** gbarros has quit IRC13:50
trozetgvrangan: hi13:50
*** michapma has quit IRC13:51
gvrangantrozet, Hi Tim13:51
*** ebarrera_ has quit IRC13:51
gvranganWithyout RHOSP, how do I install ODL to the controller node13:51
gvranganI tried overcloud deploy with environment/neutron-opendaylight.yml13:52
gvranganbut failed many times13:52
*** agurenko has quit IRC13:54
*** thrash is now known as thrash|biab13:55
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Exclude puppet-watcher from building role  https://review.openstack.org/46804113:55
sshnaidmadarazs_afk, trown ^^13:56
sshnaidmmwhahaha, ^^13:56
*** pchavva has quit IRC13:57
*** pchavva has joined #tripleo13:58
*** janki has quit IRC14:02
*** yamahata has quit IRC14:02
*** bugzy_ is now known as bugzy14:03
sshnaidmmwhahaha, this is surprising http://paste.openstack.org/show/610643/ so we don't need to use -s14:05
*** gvrangan has quit IRC14:06
*** apetrich_ has quit IRC14:06
*** apetrich has joined #tripleo14:06
*** ccamacho has joined #tripleo14:07
*** egafford has left #tripleo14:08
*** fzdarsky has quit IRC14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019514:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013214:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037314:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)14:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]14:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)14:10
*** akuznetsov has joined #tripleo14:14
*** jtomasek has quit IRC14:16
mnaserdsneddon around?14:18
*** fzdarsky has joined #tripleo14:19
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: preparing infra servers in RDO cloud  https://review.openstack.org/46804714:20
*** flepied has quit IRC14:22
*** udesale has joined #tripleo14:23
*** udesale has quit IRC14:23
*** udesale has joined #tripleo14:24
*** dsariel has joined #tripleo14:26
*** chlong has joined #tripleo14:27
*** thrash|biab is now known as thrash14:29
*** tbonds has quit IRC14:32
adarazs_afkrbrady, sshnaidm, weshay, hrybacki, bkero, arxcruz, bogdando: CI Squad meeting \o/14:32
*** adarazs_afk is now known as adarazs14:32
*** tbonds has joined #tripleo14:34
EmilienMshardy: your patch helped, but some upgrade jobs are still exiting badly, like http://logs.openstack.org/50/463050/7/check/gate-tripleo-ci-centos-7-scenario002-multinode-upgrades/d9e05fc/console.html#_2017-05-25_13_02_16_705428 while upgrade seems to fail. It sounds like timeout?14:36
*** dtantsur is now known as dtantsur|brb14:36
*** ykarel has quit IRC14:38
*** ykarel has joined #tripleo14:38
pradkEmilienM, mwhahaha, can we get this in https://review.openstack.org/#/c/467353/ .. unblocks scenario002 gate14:38
EmilienMsure14:38
EmilienMmwhahaha is on pto I'll look at it14:39
pradkhe  just +2'ed  ;)14:40
EmilienMpradk: wait14:42
EmilienMMay 25 14:24:12 centos-7-2-node-rax-ord-8986772-593649 os-collect-config: #033[1;31mError: Evaluation Error: Error while evaluating a Function Call, Could not find data item mongodb_node_ips in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/zaqar.pp:40:42 on node centos-7-2-node-rax-ord-8986772-593649.localdomain#033[0m14:42
EmilienMhttp://logs.openstack.org/53/467353/4/check/gate-tripleo-ci-centos-7-scenario002-multinode-upgrades-nv/0dcdfa9/logs/subnode-2/var/log/messages14:42
EmilienMit makes the upgrade job failing but I think I know why14:42
EmilienMit's actually fixed by your bug, but we miss https://review.openstack.org/#/c/467973/114:43
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: [NO MERGE] test multinode containers  https://review.openstack.org/46710014:43
EmilienMI'll approve your patch but keep an eye on it in case it added another issue. I'm currently working on upgrade jobs, most of them are failing14:43
pradkok14:43
*** udesale has quit IRC14:48
EmilienMlarsks: I'm having issues in upgrade jobs between newton and ocata, when I add collectd on the overcloud during the upgrade14:48
EmilienMMay 25 12:35:43 centos-7-2-node-rax-ord-8985255-593536 os-collect-config: May 25 12:28:02 centos-7-2-node-rax-ord-8985255-593536 collectd[369851]: plugin_load: Could not find plugin "virt" in /usr/lib64/collectd14:48
EmilienMhttp://logs.openstack.org/50/463050/7/check/gate-tripleo-ci-centos-7-scenario001-multinode-upgrades/743af25/logs/subnode-2/var/log/messages14:48
EmilienMlarsks: I'm investigating but if you have any clue, plz let me know14:48
larsksEmilienM: not off the top of my head, but that sounds like maybe a packaging issue? Assuming things were working before the upgrade, I'm not sure why the virt plugin would disappear...14:49
*** karthiks has joined #tripleo14:49
* larsks goes to look at logs14:50
EmilienMlarsks: I've seen that before, where a bunch of collect packages were removed14:50
EmilienMlarsks: I think I know why, I have a theory14:51
larsksEmilienM: ?? I was just going to say that it I explict Package[collectd-virt]/ensure in the log, so I am double confused...14:52
EmilienMlarsks: ansible deployed collectd with ansible during upgrade but puppet didn't run yet so collectd probably miss a package for the virt plugin14:52
larsksAh, I see the errors:14:52
larsksWarning: [norpm] Attempting to install collectd-virt but it will not be installed14:52
mwhahahaHey my warning was actually helpful :D14:53
EmilienMweird, in multinode jobs should install packages14:53
EmilienMmwhahaha: indeed14:53
larsksEmilienM: also, if this was an upgrade, why wasn't it already installed? Or if it was, how did it get removed?14:54
EmilienMlarsks: it's an upgrade from newton14:54
EmilienMlarsks: we didn't have collectd on newton14:55
larsksAh, right.14:55
larsksSo really it's just a question of why puppet isn't installing packages when you expect it to...14:55
*** akuznetsov has quit IRC14:57
*** salmankhan has quit IRC14:59
*** oidgar has quit IRC14:59
*** ecerquei has joined #tripleo15:01
*** ecerquei_ has quit IRC15:01
*** trozet has quit IRC15:02
*** salmankhan has joined #tripleo15:03
*** trozet has joined #tripleo15:04
*** fragatina has joined #tripleo15:06
openstackgerritMerged openstack/tripleo-heat-templates master: Remove duplicate PreConfig definition  https://review.openstack.org/46761815:06
*** ecerquei has quit IRC15:08
*** shardy has quit IRC15:09
*** apetrich has quit IRC15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019515:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013215:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037315:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)15:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]15:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)15:10
*** derekh has quit IRC15:10
*** apetrich has joined #tripleo15:12
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: toci_gate_test-orig.sh: add missing OVERCLOUD_DEPLOY_ARGS on ocata jobs  https://review.openstack.org/46806215:21
EmilienMlarsks: I'm trying something15:22
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Ocata upgrades testing - DNM  https://review.openstack.org/46305015:22
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP cinder-volume bundle for HA deployments  https://review.openstack.org/46774915:23
*** axisys has left #tripleo15:27
*** dparkes has quit IRC15:28
*** apetrich has quit IRC15:29
*** panda is now known as panda|bbl15:30
* adarazs off15:35
*** pcaruana has quit IRC15:38
*** shardy has joined #tripleo15:39
*** pcaruana has joined #tripleo15:39
*** skramaja has quit IRC15:43
*** leifmadsen has quit IRC15:45
*** ecerquei has joined #tripleo15:46
*** lucasagomes is now known as lucas-afk15:47
*** leifmadsen has joined #tripleo15:49
*** dtantsur|brb is now known as dtantsur15:49
*** pkovar has quit IRC15:54
*** ffiore_ has joined #tripleo15:55
*** ffiore has quit IRC15:55
*** salmankhan has quit IRC15:56
*** mdnadeem has quit IRC15:59
*** AzazeL_ has joined #tripleo15:59
*** ykarel has quit IRC16:00
*** salmankhan has joined #tripleo16:00
*** egonzalez has quit IRC16:05
*** Goneri has quit IRC16:07
*** Goneri has joined #tripleo16:07
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013216:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037316:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)16:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]16:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)16:10
*** flepied has joined #tripleo16:11
*** oidgar has joined #tripleo16:17
*** jpich has quit IRC16:17
*** aufi has quit IRC16:18
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: Derive Params (part 1): Initial workflow to start  https://review.openstack.org/45646916:19
openstackgerritMerged openstack/tripleo-heat-templates master: Include mongodb in scenario002 job  https://review.openstack.org/46735316:19
*** jlinkes has quit IRC16:19
openstackgerritMerged openstack-infra/tripleo-ci master: Fix issues in OVB preparement servers scripts  https://review.openstack.org/46762016:19
*** hewbrocca is now known as hewbrocca_afk16:22
*** suuuper has quit IRC16:22
*** pchavva has quit IRC16:24
*** ffiore_ has quit IRC16:24
*** shardy has quit IRC16:28
*** ramishra has quit IRC16:29
*** ebarrera has quit IRC16:30
*** pcaruana has quit IRC16:30
*** ebarrera has joined #tripleo16:30
*** pcaruana has joined #tripleo16:30
*** b00tcat has quit IRC16:31
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Align optional services with optional services-docker  https://review.openstack.org/46809716:32
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: [NO MERGE] test multinode containers  https://review.openstack.org/46710016:33
honzaAny ideas why reloading the tripleo-common python package on the undercloud (as per the README) would leave out some actions?  Several are now listed but e.g. tripleo.plan.list isn't.16:36
*** nyechiel has joined #tripleo16:38
*** yprokule has quit IRC16:39
*** udesale has joined #tripleo16:39
*** rcernin has quit IRC16:40
*** bogdando has quit IRC16:43
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Add ignore_projects to filter gnocchi events  https://review.openstack.org/46726916:44
*** egafford has joined #tripleo16:45
*** mcornea has quit IRC16:48
*** prateek has joined #tripleo16:49
*** oidgar has quit IRC16:49
*** jtomasek has joined #tripleo16:53
*** ssingh99 has joined #tripleo17:02
*** dtantsur is now known as dtantsur|afk17:03
*** ssingh99 has left #tripleo17:04
*** gvrangan has joined #tripleo17:05
*** ssingh has joined #tripleo17:06
*** trown is now known as trown|lunch17:08
gvrangantrozet: Hi17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019517:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013217:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037317:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]17:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)17:10
ssinghHi17:11
ssinghneed some help on creating tripleo template17:11
ssinghI would like to run a few scripts on overcloud servers17:12
ssinghany pointers where i could get some help from?17:12
ssinghtripleo documentation is overwhelming, and i tend to get lost in them :(17:13
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Add neutron-midonet sample environment  https://review.openstack.org/46610217:13
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Support config dir for env generator input files  https://review.openstack.org/46564717:13
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Add storage sample environments  https://review.openstack.org/46610317:13
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Sample environment generator  https://review.openstack.org/25363817:13
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Add nested sample environments for inject-trust-anchor  https://review.openstack.org/46564817:13
*** salmankhan has quit IRC17:13
*** ckyriakidou has quit IRC17:15
*** udesale has quit IRC17:20
*** gvrangan has quit IRC17:22
ssinghcan any expert help, please17:22
*** gvrangan has joined #tripleo17:24
*** ansmith has quit IRC17:24
*** jpena is now known as jpena|off17:26
ssingh@Emilien, could you please help by point me to a sample template which can be used to just execute a set of commands on an overcloud server?17:26
*** gvrangan has quit IRC17:28
*** ssingh has quit IRC17:30
openstackgerritNuman Siddique proposed openstack/puppet-tripleo master: Pacemaker support for OVN DB servers  https://review.openstack.org/37227417:31
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: Pacemaker HA suport for OVN DB servers  https://review.openstack.org/43676717:39
*** ansmith has joined #tripleo17:42
*** dhill_ has joined #tripleo17:45
*** gvrangan has joined #tripleo17:45
*** fragatina has quit IRC17:47
*** Goneri has quit IRC17:48
*** gvrangan has quit IRC17:48
*** fzdarsky has quit IRC17:51
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: DNM: Test openSUSE 42.3 image builds  https://review.openstack.org/46811517:51
*** amoralej is now known as amoralej|off17:52
openstackgerritMerged openstack/instack-undercloud stable/newton: Remove any left-over tuskar packages on upgrade  https://review.openstack.org/46679717:57
*** ebarrera has quit IRC18:05
*** ebarrera has joined #tripleo18:06
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019518:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013218:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037318:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]18:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)18:10
bnemecWow, patience grasshopper.18:16
bnemec15 minutes is a bit short to bail after asking a question.  Especially around lunch time.18:16
bnemecIn case anyone else has the same question: https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/extra_config.html18:17
*** ebarrera is now known as ebarrera|OoO18:17
*** fzdarsky has joined #tripleo18:24
*** fragatina has joined #tripleo18:28
Slowerstevebaker: around?18:28
*** zoli|wfh is now known as zoli|afk18:29
*** fzdarsky has quit IRC18:29
*** fragatina has quit IRC18:30
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: Derive Params (part 1): Initial workflow to start  https://review.openstack.org/45646918:30
*** fragatina has joined #tripleo18:30
*** trown|lunch is now known as trown18:31
openstackgerritDan Prince proposed openstack/paunch master: Add --ipc support  https://review.openstack.org/46812418:32
*** fragatina has quit IRC18:36
dprinceSlower: we need this to make LVM work in Cinder-Volume https://review.openstack.org/#/c/468124/18:38
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: DNM: Test openSUSE 42.3 image builds  https://review.openstack.org/46811518:40
*** Goneri has joined #tripleo18:44
Slowerdprince: mmm, right18:45
Slowerdprince: is that all that's needed then? :)18:45
dprinceSlower: I needed it to create a volume using the Cinder lvm volume18:46
dprinceSlower: yeah, we won't actually need this patch if you are using HA Cinder Volume via pacemaker though18:49
Slowerit's still fine to add it18:49
Slowerno harm there18:49
dprinceSlower: they way we drive the pacemaker stuff just inlines the --ipc-host18:49
dprinceSlower: https://review.openstack.org/#/c/467749/4/manifests/profile/pacemaker/cinder/volume_bundle.pp18:49
SlowerI see18:50
dprinceSlower: this is the first service I've seen using --ipc=host18:50
Slowerya me too18:50
dprinceSlower: Kolla is setting ipc_host for iscsid, and we aren't yet. I'm not sure it is needed there18:51
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Add $STACK_NAME input var  https://review.openstack.org/46713718:51
*** dtrainor has quit IRC18:52
SlowerI'll look and see if I can find the patch that added it18:52
*** dtrainor has joined #tripleo18:52
Slowerand cinder and multipathd18:55
*** jobewan has joined #tripleo18:57
*** eck` is now known as eck`gone19:03
openstackgerritMerged openstack/python-tripleoclient stable/newton: Add Constraints support  https://review.openstack.org/42154119:05
*** dsneddon is now known as dsneddon_pto19:06
Slowerdprince: sounds like it avoids you having to mount /run:/run19:08
Slowerbut I'd guess it would allow other IPC's to work too19:08
Slowerprobably would have solved that libpq or whatever it was called issue with pacemaker too19:08
*** pcaruana has quit IRC19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019519:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013219:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037319:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]19:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)19:10
*** dsariel has quit IRC19:11
Sloweractually that was a different issue19:12
Slowerdprince: https://review.openstack.org/#/c/291285/19:12
*** morazi has quit IRC19:13
*** jtomasek_ has joined #tripleo19:17
*** ebarrera_ has joined #tripleo19:25
sshnaidmrlandy, Isn't step_introspection false by default?19:25
sshnaidmrlandy, I mean - is it enough to remove it or we should set it to true explicitly?19:27
rlandysshnaidm: it's set to true in ovb settings19:27
sshnaidmrlandy, ok19:27
rlandyI was overriding it just for rdocloud19:27
rlandyiow - qeos7 still ran introspection19:28
sshnaidmrlandy, ack19:29
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: drop deprecated map-services/packages from zypper element  https://review.openstack.org/45478619:32
*** apetrich has joined #tripleo19:33
radezdtantsur|afk: I'll ping you tomorrow, enable_ipxe=false with boot_mode=uefi made the node boot ipxe.efi. I symlinked grubaa64.efi to ipxe.efi to force it19:34
radezdtantsur|afk: the docs indicated that I should have the grub.conf file have the node look for {ip19:35
radez{ip}.conf but that file wasn't being created.19:35
*** ansmith has quit IRC19:35
*** trown is now known as trown|brb19:38
*** dbecker has quit IRC19:39
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: DNM: Test openSUSE 42.3 image builds  https://review.openstack.org/46811519:39
*** trown|brb is now known as trown19:40
*** apetrich has quit IRC19:42
*** gbarros has joined #tripleo19:42
*** jmelvin has quit IRC19:43
openstackgerritMerged openstack/tripleo-quickstart-extras master: overcloud-delete: role test  https://review.openstack.org/46373619:47
*** funzo has quit IRC19:48
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Add heat environment for disabling all telemetry services  https://review.openstack.org/46803119:49
*** funzo has joined #tripleo19:49
*** Vijayendra has quit IRC19:49
*** Vijayendra has joined #tripleo19:54
*** eck`gone is now known as eck`19:54
*** lblanchard has quit IRC19:55
*** apetrich has joined #tripleo19:55
*** ansmith has joined #tripleo19:57
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: WIP: Fix upgrading cinder-volume under pacemaker  https://review.openstack.org/46728019:57
*** nyechiel has quit IRC20:03
*** iranzo_ has joined #tripleo20:07
*** morazi has joined #tripleo20:09
*** yamahata has joined #tripleo20:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019520:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013220:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037320:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)20:10
*** iranzo has quit IRC20:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]20:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)20:10
pradkcan i request reviews on https://review.openstack.org/#/c/467269/20:10
pradkmwhahaha, did you get a chance to test https://review.openstack.org/#/c/467750/20:11
*** ecerquei has quit IRC20:13
*** jprovazn has quit IRC20:13
*** chlong has quit IRC20:15
*** iranzo_ has quit IRC20:17
*** ebarrera|OoO has quit IRC20:22
openstackgerritIhar Hrachyshka proposed openstack/tripleo-heat-templates master: Enable arp_accept for all interfaces  https://review.openstack.org/46743020:24
*** jmelvin has joined #tripleo20:26
mwhahahapradk: yea it worked20:26
pradkcool20:28
openstackgerritDavid Moreau Simard proposed openstack-infra/tripleo-ci master: gzip the ARA report after generating it  https://review.openstack.org/46815620:29
*** jkilpatr has quit IRC20:29
openstackgerritDavid Moreau Simard proposed openstack/tripleo-quickstart master: gzip the ARA report after generating it  https://review.openstack.org/46815820:31
*** karimb has quit IRC20:32
*** chlong has joined #tripleo20:33
*** jmelvin has quit IRC20:37
*** chlong has quit IRC20:37
*** chlong has joined #tripleo20:38
*** kbyrne has quit IRC20:38
*** ansmith has quit IRC20:42
*** yamahata has quit IRC20:45
*** zoli|afk is now known as zoli|gone20:46
*** athomas has quit IRC20:46
*** yolanda has quit IRC20:49
*** jkilpatr has joined #tripleo20:49
*** yamahata has joined #tripleo20:50
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: DNM: Test openSUSE 42.3 image builds  https://review.openstack.org/46811520:54
openstackgerritAlan Bishop proposed openstack/tripleo-common master: Derive Params (part 2): Get services and feature list  https://review.openstack.org/45647120:57
*** trown is now known as trown|outtypewww20:59
stevebakerSlower: hey21:00
*** fragatina has joined #tripleo21:00
*** jtomasek_ has quit IRC21:04
*** prateek has quit IRC21:05
*** itlinux has joined #tripleo21:05
*** fzdarsky has joined #tripleo21:05
*** morazi has quit IRC21:07
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013221:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037321:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)21:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]21:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)21:10
*** dprince has quit IRC21:10
*** chlong has quit IRC21:11
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: TEST: upgrade without skip-storage  https://review.openstack.org/46816521:17
*** abishop has quit IRC21:17
openstackgerritGiulio Fidente proposed openstack/tripleo-quickstart-extras master: Collect workflow lists and execution lists in host_info  https://review.openstack.org/46816721:18
*** yamahata has quit IRC21:18
*** morazi has joined #tripleo21:21
*** jobcespedes has joined #tripleo21:23
gfidentestevebaker hey not sure if you have opinions on https://review.openstack.org/#/c/466312/ ?21:27
stevebakergfidente: I think that file is really only for kolla images, ceph-ansible is self-contained enough that it can manage its own image names21:29
gfidentestevebaker aren't those loaded into undercloud docker registry?21:30
*** jmelvin has joined #tripleo21:31
stevebakergfidente: yes, but that file has multiple uses, it also drives image building for kolla-build, we'd need to add logic for ignoring some entries during image building21:31
gfidenteah that I didn't know21:32
gfidenteI guess there isn't yet an entrypoint to load an external image into registry?21:32
gfidente(only)21:32
*** jmelvin has quit IRC21:38
*** fzdarsky has quit IRC21:39
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Allows use of Mistral workflows during deployment steps  https://review.openstack.org/46332421:42
*** itlinux has quit IRC21:42
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: drop deprecated map-services/packages from zypper element  https://review.openstack.org/45478621:43
AzazeL_Hello all, jidar answered me before but was wondering if anyone has tried tripleo on a different o.s. besides rh and centos.. say like oracle linux?  They provide an openstack-kolla version but they are a year behind and I also prefer the tripleO environment for redeploying the overclouds.  Any info or direction?  Thanks.21:45
jidarI did answer that!21:46
*** noslzzp has quit IRC21:47
*** fragatina has quit IRC21:48
AzazeL_and much appreciated ;)21:48
*** egafford has quit IRC21:51
pradkmwhahaha, we need to revisit this https://review.openstack.org/#/c/456293/ .. gnocchi api is currently broken as it comes up too early :(21:55
pradktracking it here https://bugs.launchpad.net/tripleo/+bug/169362121:55
openstackLaunchpad bug 1693621 in tripleo "gnocchi api fails to start on one controller" [High,New] - Assigned to Pradeep Kilambi (pkilambi)21:55
pradkwe have to move gnocchi api to a later step and ensure gnocchi-upgarde is run with storage before starting api21:56
stevebakergfidente: not yet, it wouldn't be a large change to the tripleo-common image build logic to ignore some entries though22:01
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Test openSUSE 42.2/42.3 image builds  https://review.openstack.org/46811522:08
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019522:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013222:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037322:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]22:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)22:10
*** ebarrera_ has quit IRC22:12
*** thrash is now known as thrash|g0ne22:13
mwhahahapradk: the problem is we can't move it since it's in Apache. By having it in a later step it causes service restarts22:13
*** atheurer has quit IRC22:13
mwhahahapradk: so either it needs to be on its own server or not in apache22:13
jobcespedesHI, I'm testing a tripleo newton deployment using single-nic-vlans. However the default route ends being on controlplane network and not on external network after a successfully deployment.22:19
jobcespedeshttps://unsee.cc/birageso/22:19
jobcespedesAny help would be appreciated22:19
*** itlinux has joined #tripleo22:22
*** Goneri has quit IRC22:26
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Drop support for Ubuntu precise  https://review.openstack.org/46818622:28
bfourniejobcespedes: can you provide the specific template files you used in the deployment, e.g. network-environment.yaml, controller.yaml, compute.yaml? thanks22:44
jobcespedesopenstack overcloud deploy --templates /usr/share/openstack-tripleo-heat-templates --libvirt-type qemu --control-flavor control --compute-flavor compute --ceph-storage-flavor oooq_ceph --block-storage-flavor oooq_blockstorage --swift-storage-flavor oooq_objectstorage --timeout 90 -e /home/stack/cloud-names.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml -e /22:48
jobcespedesusr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml -e /home/stack/network-environment.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml --validation-warnings-fatal --control-scale 3 --compute-scale 1 --ntp-server 163.178.88.2,192.168.153.11,8.8.22:48
jobcespedes8.822:48
jobcespedesOnly two of them are custom files:22:49
jobcespedes"/home/stack/cloud-names.yaml"22:49
jobcespedes"/home/stack/network-environment.yaml"22:49
jobcespedeshttps://pastebin.com/yqyRyAH9 -> "/home/stack/network-environment.yaml"22:50
jobcespedes4 VMs are hosted in ESXi. I'm testing portgroup (4095) in promiscous mode for br-ex. After deployment each node has conectivity with external router, but it's not configure in the deplyment process22:54
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Move glance::api::show_multiple_locations within GlanceApi  https://review.openstack.org/46819322:55
jobcespedesEach controller node, I meant22:55
*** jobewan has quit IRC22:55
*** ansmith has joined #tripleo22:58
bfourniethanks jobcespedes, looking through the custom env file it looks OK, although I don't understand why the "ExternalNetValueSpecs" was added23:00
jobcespedesIt was an attemp to overcome the issue without knowing the cause. I wanted to add --router:external=True parameter to that network23:02
jobcespedesJust in case23:03
bfourniejobcespedes: if you remove that setting does it change the router that is used?  In the default single-nic-vlans/controller.yaml the routes param is set to default:true for ExternalInterfaceDefaultRoute, so this should override the ControlPlane route23:04
*** itlinux has quit IRC23:07
jobcespedesNop =(, same problem. I first tried without it and then added it, same result.23:08
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019523:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013223:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169037323:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]23:10
openstackLaunchpad bug 1690373 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq broken" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)23:10
openstackgerritSteve Baker proposed openstack/puppet-tripleo master: Restart docker after changing storage driver  https://review.openstack.org/46820123:14
*** rhallisey has quit IRC23:15
jobcespedesbfournie: Do you know a way to trace when single-nic-vlans/controller.yaml is applied? The option default:true would change ifcfg interface file or just add that route? Route 169.254.169.254/32 is present, but I think it was added using dhcp in the controlplane network23:19
bfourniejobcespedes: in /etc/sysconfig/network-scripts/ there are route-xxx files that are generated by os-net-config23:24
bfourniejobcespedes: 169.254.169.254 is defined in the controller.yaml file for single-nic-vlans23:25
*** rhallisey has joined #tripleo23:28
jobcespedesI saw that; but suspected the other way because I saw the dhcp info in /var/log/cloud-init.log23:29
jobcespedesI'm going to check routes-xxx files and single-nic-vlans/controller.yaml releate files and scripts. Thanks for the help23:30
bfourniejobcespedes: one thing… you have "NeutronExternalNetworkBridge": ""23:31
bfournieit should be NeutronExternalNetworkBridge: "''"23:31
jobcespedesWow, I wouln't have seen that, thanks23:32
bfourniejobcespedes: note the '' within quotes. Not sure if that is what is causing problem but I've seen issues if the default bridge is not configured with '' inside quotes23:32
jobcespedesI'm also wondering if I need to use "defroute: no" for other interfaces in controller role. I'm going to test changing NeutronExternalNetworkBridge: "”" first23:33
*** atheurer has joined #tripleo23:34
bfourniejobcespedes: you should not have to set that for the other interfaces23:34
*** rhallisey has quit IRC23:36
jobcespedesOk, thanks23:37
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: [WIP] Deploy Ceph using ceph-ansible via external workflow  https://review.openstack.org/46506623:37
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides a list of per-service network IPs to the workflows env  https://review.openstack.org/46768223:37
bfourniejobcespedes: if it helps, here is the route table on my controller and the template files I used - http://pastebin.test.redhat.com/488092. This is on ocata so the nic-config files are slightly different due the run-os-net-config script but basically the same. I used 2 nics - control plane on one and all other networks on second23:42
jobcespedesbfournie: Thanks, I really appreciate it. I don't have access to pastebin.test.redhat.com, though =P23:48
bfourniejobcespedes: whoops sorry about :-$, one sec23:52
bfourniejobcespedes: http://paste.openstack.org/show/610692/23:53
jobcespedesbfournie: =)23:54
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Add heat environment for disabling all telemetry services  https://review.openstack.org/46803123:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!