Friday, 2017-06-30

*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016700:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136200:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)00:10
openstackgerritMerged openstack/tripleo-quickstart master: restrict bashate to files in repository  https://review.openstack.org/44156600:15
*** karimb has quit IRC00:19
*** rlandy is now known as rlandy|bbl00:25
*** ecerquei has joined #tripleo00:26
*** ecerquei_ has joined #tripleo00:28
*** fpan has joined #tripleo00:29
*** isq has joined #tripleo00:31
*** ecerquei has quit IRC00:32
*** atheurer has quit IRC00:43
*** jmelvin has quit IRC00:57
*** dmacpher-afk has quit IRC01:02
openstackgerritMerged openstack/tripleo-heat-templates master: Remove ceilometer upgrade from other ceilometer containers  https://review.openstack.org/47855401:08
openstackgerritMerged openstack/tripleo-heat-templates master: Add release note for generated sample environments  https://review.openstack.org/47592201:08
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016701:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136201:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]01:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)01:10
*** jkilpatr has quit IRC01:11
*** jkilpatr has joined #tripleo01:24
*** yamahata has quit IRC01:29
*** thrash is now known as thrash|g0ne01:39
*** ecerquei_ has quit IRC01:49
*** pliu has joined #tripleo01:50
*** artom has joined #tripleo01:56
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources  https://review.openstack.org/47381702:00
*** liupe__ has joined #tripleo02:02
*** pliu has quit IRC02:05
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016702:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136202:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]02:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)02:10
*** jkilpatr has quit IRC02:12
*** tzumainn has quit IRC02:12
*** rlandy|bbl is now known as rlandy02:42
*** dixiaoli has joined #tripleo02:46
*** eck` is now known as eck`gone02:55
*** dixiaoli has quit IRC02:57
openstackgerritMerged openstack/tripleo-heat-templates master: Add README to ci/environments directory  https://review.openstack.org/47824903:00
*** pchavva has joined #tripleo03:02
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016703:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136203:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)03:10
*** udesale has joined #tripleo03:20
*** jaganathan has joined #tripleo03:25
*** pliu has joined #tripleo03:37
*** dsariel has quit IRC03:39
*** liupe__ has quit IRC03:40
*** rlandy has quit IRC03:41
*** noslzzp has quit IRC03:41
*** pchavva has quit IRC03:47
openstackgerritMerged openstack/tripleo-heat-templates master: Add detach to docker-toool  https://review.openstack.org/47238403:52
*** ansmith has quit IRC04:02
*** dpawar has joined #tripleo04:07
*** udesale has quit IRC04:08
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016704:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136204:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)04:10
openstackgerritMerged openstack/tripleo-heat-templates master: Add missing xinetd/rsync container for Swift  https://review.openstack.org/47137004:12
*** StevenK_ is now known as StevenK04:13
*** ansmith has joined #tripleo04:15
*** skramaja has joined #tripleo04:23
*** achadha has joined #tripleo04:25
*** ykarel has joined #tripleo04:27
*** paramite has joined #tripleo04:29
achadhaGuys, what is the role of neutron on Undercloud (i'm on Newton)04:29
achadha?04:29
*** udesale has joined #tripleo04:29
dpawarmwhahaha: while testing my patches i am getting errors with command 'openstack deploy --templates' any idea what is wrong here? http://paste.openstack.org/show/614074/04:32
*** oanson has quit IRC04:53
*** dparkes has quit IRC05:00
*** dpawar has quit IRC05:02
*** tdasilva has quit IRC05:04
*** bfournie1 has joined #tripleo05:08
*** ykarel has quit IRC05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016705:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136205:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]05:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)05:10
*** bfournie has quit IRC05:11
*** ratailor has joined #tripleo05:11
*** prateek has joined #tripleo05:13
*** jaganathan has quit IRC05:13
*** ansmith has quit IRC05:28
*** tdasilva has joined #tripleo05:29
*** dpawar has joined #tripleo05:33
*** dpawar has quit IRC05:35
*** dpawar has joined #tripleo05:36
*** udesale has quit IRC05:41
*** lmiccini has joined #tripleo05:44
*** yprokule has joined #tripleo05:44
*** rcernin has joined #tripleo05:45
*** mandre|away is now known as mandre05:47
*** pgadiya has joined #tripleo05:48
*** achadha has quit IRC05:50
*** achadha has joined #tripleo05:51
*** iranzo has joined #tripleo05:51
*** iranzo has joined #tripleo05:51
*** ffiore has joined #tripleo05:52
*** achadha has quit IRC05:55
*** ffiore has joined #tripleo05:55
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Remove enable_vbmc from tripleo-ui check  https://review.openstack.org/47816005:58
*** dparkes has joined #tripleo06:01
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Copy only generated puppet files into the container  https://review.openstack.org/47615306:03
*** links has quit IRC06:07
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016706:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136206:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]06:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)06:10
*** cschwede has joined #tripleo06:10
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata  https://review.openstack.org/47760606:12
*** dmanchad has joined #tripleo06:14
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Bind mount needed cert for haproxy  https://review.openstack.org/47385406:15
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Allow volumes in puppet_config containers spec  https://review.openstack.org/47821506:15
*** jpena|off is now known as jpena06:18
*** links has joined #tripleo06:21
*** jprovazn has joined #tripleo06:21
*** udesale has joined #tripleo06:26
*** dmanchado has joined #tripleo06:29
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: DONT MERGE - Test for I6a53a56c534f24cb514d8aeb8cec3d7865b93448  https://review.openstack.org/46920106:31
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Fix typo in config_volume  https://review.openstack.org/47577906:31
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Ensure boostrap_host_exec runs as root  https://review.openstack.org/47853006:35
*** ccamacho has quit IRC06:38
*** ccamacho has joined #tripleo06:38
*** yamahata has joined #tripleo06:42
*** pcaruana has joined #tripleo06:45
*** ffiore has quit IRC06:46
*** flepied has quit IRC06:47
*** ebarrera has joined #tripleo07:02
*** achadha has joined #tripleo07:03
*** jaganathan has joined #tripleo07:03
openstackgerritSaravanan KR proposed openstack/python-tripleoclient master: Avoid empty print during validation workflow execution  https://review.openstack.org/47918707:05
*** shardy has joined #tripleo07:05
shardyMorning all07:06
jaosoriormorning dude07:06
shardycan I get a +A for https://review.openstack.org/#/c/478999/ please, fixes the upgrade CI07:06
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Make containerized nova-api run with httpd  https://review.openstack.org/47536607:06
*** achadha has quit IRC07:06
*** achadha has joined #tripleo07:06
shardythanks jaosorior07:07
*** jlinkes has joined #tripleo07:07
shardyhttps://review.openstack.org/#/c/478982/ and https://review.openstack.org/#/c/478622/ are also ready for review if anyone has a moment07:08
*** aufi has joined #tripleo07:08
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016707:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136207:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)07:10
*** tesseract has joined #tripleo07:14
*** jpich has joined #tripleo07:14
skramajashardy: have a query, we generally create nic configs by copying from the network/config folder and modify based on the lab requirement. it is alwalys required to change the run-os-net-config.sh file path to the actual07:19
skramajashardy: like https://github.com/krsacme/tht-dpdk/blob/master/osp12_ref/nic-configs/computeovsdpdk.yaml#L9607:20
*** f13o has joined #tripleo07:20
skramajashardy: is this the way forward?07:20
skramajashardy: where as the samples will looke like https://github.com/openstack/tripleo-heat-templates/blob/master/network/config/multiple-nics/compute.yaml#L8707:21
shardyskramaja: yes I think so - that can be a relative or absolute path, or a URL07:21
shardyskramaja: e.g if you copy the entire --templates tree, the relative path will still work07:21
shardybut if you only copy the nic templates, changing to an absolute path makes sense07:21
shardyskramaja: there are other ways we could do it, but the idea is the script can be easily modified if required07:22
shardye.g to add os-net-config mappings, or whatever07:22
*** bogdando has joined #tripleo07:22
shardythe previous element based approach didn't have the path problem, but it was inconvenient to make any changes to how os-net-config was run07:23
shardyand there was no error path when it failed07:23
skramajashardy: thanks for the details. i agree. i just see that every user is hitting with this problem and chaning it. because users generally have nic configs outside (atleas thats what i have see with few customers)07:24
*** ykarel has joined #tripleo07:24
shardyskramaja: ack - maybe it's something we can cover better in the docs?07:24
*** shardy is now known as shardy_afk07:24
dsneddonshardy, It might be something we can parameterize and default, so it only has to be changed in one place.07:25
skramajadsneddon: that would be good..07:25
skramajadsneddon: will check if i can do that.07:26
skramajashardy_afk: ^07:26
*** yamahata has quit IRC07:29
*** matbu_ is now known as matbu07:29
*** ffiore has joined #tripleo07:31
*** egonzalez has joined #tripleo07:37
*** dtantsur|afk is now known as dtantsur07:42
*** f13o has quit IRC07:49
*** amoralej|off is now known as amoralej07:51
*** achadha has quit IRC07:52
*** mcornea has joined #tripleo07:52
*** achadha has joined #tripleo07:52
*** achadha has quit IRC07:57
*** flepied has joined #tripleo07:58
*** zzzeek has quit IRC08:00
*** zzzeek has joined #tripleo08:02
*** athomas has joined #tripleo08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016708:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136208:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]08:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)08:10
*** f13o has joined #tripleo08:11
*** shardy_afk is now known as shardy08:12
shardyskramaja, dsneddon: yeah that's a good idea, but we'll have to check if a get_param will work in a get_file08:12
shardyI suspect the heatclient code may not handle that atm08:13
dsneddonshardy, I kind of expected that, which is why I thought this was a future thing, if at all.08:13
shardydsneddon: yeah, the other option would be some global j2 variable, e.g from plan-environment08:13
shardybut again that would require some changes to make it work08:13
shardyHey dsneddon while you're here, can you please review https://review.openstack.org/#/c/469853/08:14
dsneddonshardy, Yeah, probably best to document the changes and recommend that people put the NIC configs inside their template directory for relative paths08:14
shardydsneddon: also, I'll rebase https://review.openstack.org/#/c/469854 later - I was thinking we need to convert the built in roles to role.role.j2.yaml so they'll work with custom networks08:15
shardydsneddon: if I go ahead and do that, will it duplicate anything you have in progress?08:15
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata  https://review.openstack.org/47760608:15
*** ccamacho has quit IRC08:15
*** ccamacho has joined #tripleo08:15
*** PhilSliderS is now known as PhilS_08:15
dsneddonshardy, No, I hadn't gotten to that yet, although I planned the same thing08:16
shardydsneddon: Ok I can take a pass at it later, and perhaps we can sync up next week to work out what remains to be done08:16
skramajadsneddon: its always good to keep the nic configs outside, that way upgrading would be easier, when the wholte templates is easier. modifying int the templates folder makes upgrades preparation painful08:16
dsneddonskramaja, Yeah, good point. Up to this point we have been recommending they be separate, that's a good reason to keep it that way08:17
shardyskramaja, dsneddon: we could just move tht/network/scripts under tht/network/config?08:17
skramajawe should have the doc for now, rather that everyone hitting it and corregint it.08:17
shardyand document cp -r tht/network/config ?08:17
shardythen the relative path would work08:17
ccamachoshardy please can you +2 this revert from bnemec https://review.openstack.org/#/c/479063/ it fixes the issue08:18
shardyand any coupling between the script and templates would be handled08:18
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata  https://review.openstack.org/47760608:18
skramajashardy: do you mean copying the file in each configs like single-nic-vlans, bond-with-vlans?08:19
shardyskramaja: no I mean copy it to tht/network/config/scripts08:19
skramajaor modifying the relative to ../run_os_net... instead of the curent?08:19
skramajaok08:19
shardythen the path will be ../scripts/foo08:19
shardyfolks could then cp -r all the examples, and remove those they don't need08:20
skramajashardy: in which case we need copy the scripts folder along with doc.08:20
shardyskramaja: yeah08:20
shardyif that helps I'm happy to move the script08:20
*** PhilS_ is now known as Arilotan08:20
shardyccamacho: Do we know why the undercloud upgrade job is still failing on the revert?08:20
skramajashardy: this should be better, than the current one.08:20
ccamachoyes08:21
shardyit's also got a looong line in the commit message, but I guess that's not a blocker ;)08:21
ccamachoshardy for the ipmi check, Im checking it here https://review.openstack.org/#/c/477606/08:21
ccamachoi got the job green a few days ago08:21
ccamachoso08:21
* ccamacho cross fingers to have it working back today08:22
dsneddonshardy, I have been thinking that eventually we could have one or two NIC templates per deployment, but use conditionals to decide which interfaces to configure, like: {{ if 'internal_api' in role.networks }} <interface> {{ endif }}08:22
shardydsneddon: yeah, I was thinking the same, and we render the individual templates per role08:22
*** gfidente has joined #tripleo08:22
shardysimilar to what we do with role.role.j2.yaml for the main role template08:23
shardynic-config.role.j2.yaml08:23
dsneddonshardy, I'm going to have to turn in soon, but if there is anything you want me to take care of shoot me an email.08:24
shardydsneddon: sure, will do, but lets perhaps chat early next week so we can work together on the various remaining changes08:24
gfidenteshardy morning, so wdyt about https://review.openstack.org/#/c/479016/ ? it's slowing things down but seems to do what is necessary08:24
dsneddonshardy, Sounds good, I'll have more time next week than I did this week.08:24
gfidentedsneddon shardy ^^ is the above for the dynamic networks?08:25
*** sri_ has joined #tripleo08:25
dsneddongfidente, https://blueprints.launchpad.net/tripleo/+spec/composable-networks08:25
shardygfidente: I'm confused why we need this, isn't it the same issue we fixed in https://review.openstack.org/#/c/419588/ ?08:25
gfidentedsneddon ah cool can I lurk into the call ?08:25
gfidentemaybe I can help staying in sync?08:26
shardytherve: maybe you can help us understand this - gfidente landed a patch and we're seeing similar issues to those fixed in https://review.openstack.org/#/c/419588/08:26
gfidentewith reviews08:26
ccamachoshardy also the N->O gate is fixed now https://review.openstack.org/#/c/477608/08:26
dsneddongfidente, The more the merrier08:26
ccamachowe just need to merge the revert and the fix in tripleoci08:26
shardygfidente: do we have any CI failure showing the problem, or heat logs from local tests?08:26
ccamachoxD08:26
gfidenteshardy yeah exactly that's the thing08:26
shardygfidente: Ok, so I'm wondering why it's broken again08:26
shardygfidente: can you create a minimal reproducer and raise another heat bug?08:26
gfidenteshardy I think if we land your patch which fixed the stack_name property, we could start seeing this08:27
gfidenteshardy remember we had this intermittently when trying to remove the conditions from the upgrade steps?08:27
shardygfidente: I'm confused why the multinode-uprade job worked on my patch tho?08:27
shardygfidente: is it because we don't have any zero length roles perhaps?08:27
shardygfidente: No it wasn't intermittent AFAIK - there was a bug, therve fixed it08:28
gfidenteshardy well I remember the issue and we applied the fix and it worked for newly created stacks08:28
gfidenteit's always on upgrade which this is seen08:28
shardygfidente: Ok, so it could be a new bug08:29
shardygfidente: but note https://review.openstack.org/#/c/478999/ passed the upgrade job, so it'd be good to understand why08:29
shardygfidente: how does ExternalResource behave if you pass it an empty workflow?08:29
shardywill it just COMPLETE quickly without calling mistral?08:29
sri_shardy: Hi I am trying to deploy overcloud with HA  , But I am running into this error , this is log for placement api https://pastebin.com/kWiN34qM ,08:29
gfidenteyeah08:29
shardyif so then I guess the conditions aren't so important08:29
openstackgerritMerged openstack/puppet-tripleo master: Zaqar: support configurable backends  https://review.openstack.org/47755408:35
openstackgerritMerged openstack/tripleo-heat-templates master: Add stack_name/ctlplane_service_ips into post-upgrade.j2.yaml  https://review.openstack.org/47899908:35
openstackgerritMerged openstack/tripleo-heat-templates master: Force mtime for tar used in container config md5sums  https://review.openstack.org/47898208:36
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources  https://review.openstack.org/47381708:39
bogdandofolks, those tripleo elements and image build magic, how those provisioning requirements are supposed to work for deployed-server/multinode? Then we build no overcloud images, just install overcloud on to VMs running vanilla OS?08:41
bogdandoslagle: ^^ do you know some details by a chance?08:41
bogdandoever it supposed to work at all? :_08:42
bogdandoeither*08:42
bogdandodo mistral workflows install those for pre-provisioned?08:44
therveshardy, Is there a opened bug?08:44
dpawarHi can someone pickup review of  https://review.openstack.org/#/c/475765/  and https://review.openstack.org/#/c/475765/ ?08:48
dpawarhttps://review.openstack.org/#/c/475765/ has alrady got a +2 need one more08:49
shardytherve: not yet - I think gfidente is going to try to create a reproducer and raise one08:50
shardyI just wanted to check nothing related/obvious changed since your fix landed08:51
shardyas I've not been following heat commits that closely :(08:51
therveYeah lots of stuff happened around that area08:52
shardybogdando: there is a bootstrap script which installs the required things onto a vanilla node/image08:52
*** salmankhan has joined #tripleo08:52
bogdandoshardy: how does this work end to end? when a user runs openstack overcloud deploy?08:52
*** tvignaud has quit IRC08:52
shardytherve: Ok, cool, maybe we can try re-running the original reproducer, I'll give it a try08:52
therveshardy, It happens with tht trunk, on upgrades, iiuc?08:53
gfidentetherve not with tht trunk no, we have a job which passed08:54
thervegfidente, Ah so it's one of your patch?08:54
shardywell we have some conflicting reports from CI and local testing which need further investigation08:54
shardythe CI pass included the patch from gfidente, but that failed locally for mcornea08:55
mcorneashardy: it worked fine with a fresh deployment08:55
gfidentesorry guys I am confused, the CI job which passed did not include the fix08:56
shardybogdando: https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/deployed_server.html08:56
shardybogdando: that describes it - basically you configure the repos on the nodes, and install the heat-agents manually08:56
gfidentetherve shardy https://review.openstack.org/#/c/478999/ this passed upgrade08:56
shardythen overcloud-deploy does the rest08:56
shardybogdando: including running the ./deployed-server/deployed-server-bootstrap-centos.yaml08:56
thervegfidente, Yeah that's what shardy said, it failed local testing08:56
shardygfidente: yeah, that included the conditions, which did not work for mcornea08:57
shardygfidente: the main difference there, I think, is the roles_data, e.g we have some zero-length roles08:57
gfidentetherve shardy ok sorry I thought "patch" you meant the change to remove the conditions08:57
shardyso we might try to reproduce locally with a custom roles_data08:57
bogdandoshardy:  I see, thanks. Although that bootstrap part looked to me *too* brief to be in parity with all those things that elements do08:57
bogdandoshardy: and tracking down oooq logic, it uses noop instead of bootstrap, for multinode jobs. So not sure how things got installed there, still08:58
gfidentemcornea though, were you upgrading only the overcloud or did you upgrade heat on the undercloud as well?08:58
bogdandoI may be wrong tho08:58
shardybogdando: in CI IIRC we run the bootstrap on the nodepool nodes manually08:58
shardyor at least we used to, not sure since oooq changes08:58
*** Vijayendra has quit IRC08:59
mcorneagfidente: so I first upgraded the undercloud which upgrades heat, then applied the tht patches and then started the overcloud upgrade08:59
shardybogdando: it's entirely possible there are things in the image build that can now be removed08:59
bogdandoshardy: okay, got it. So to finish my pre-provisioned overcloud deploy journey, perhaps I had to manually finish my custom bootstrap centos script to put all missing bits there from tripleo elements?..08:59
*** ckyriakidou has joined #tripleo09:00
shardybogdando: no, I'm saying there's probably stuff we don't need from triple elements09:00
shardythere are a ton of those elements that are legacy and no longer needed09:00
*** lmiccini has quit IRC09:00
mcorneashardy: dciabrin just fyi, I filed https://bugs.launchpad.net/tripleo/+bug/1701485 for the issue that I'm currently hitting while upgrading a pacemaker enabled environment09:00
openstackLaunchpad bug 1701485 in tripleo "Ocata -> Pike pacemaker enabled overcloud fails during db_syncs because /var/lib/mysql/ is not accessible by mysql" [Critical,New]09:00
shardyI started removing them, but many still remain, and may even be built into overcloud-full but not used09:00
bogdandoshardy: I see. So anyway, that's that I do now, trying to deploy with a minimalistic provisioning requirements, ignoring all those elements things09:01
bogdandoI hope that works :)09:01
shardybogdando: yeah, I'd follow the docs as a first step09:01
* shardy shows optimism that docs will work ;)09:01
*** lmiccini has joined #tripleo09:01
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras master: Add check on download_overcloud_templates_rpm to trigger custom-tht  https://review.openstack.org/47921209:02
bogdandoshardy: yeah, those docs is that I read all the time :) It says nothing about tripleo elements parity tho09:02
shardybogdando: yeah, that's because tripleo-*elements are almost all legacy09:03
bogdandoshardy: thank you, the things are getting more clear now, one more learning step done ! :)09:04
shardybogdando: FWIW https://github.com/openstack/tripleo-image-elements/commit/c653eaee1c4091701e8da0f2c6f193e7126d8c49 removed ~15k LOC of elements09:04
*** pblaho has joined #tripleo09:04
shardythere are several remaining that are referenced in overcloud-full, but may not actually be needed09:05
shardyI just haven't had time to test/confirm which ones can be safely removed09:05
*** anshul has joined #tripleo09:05
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud master: Remove nova cell leftover of undercloud upgrade from N->O.  https://review.openstack.org/47921309:06
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud master: Remove nova cell leftover of undercloud upgrade from N->O.  https://review.openstack.org/47921309:07
*** tvignaud has joined #tripleo09:10
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016709:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136209:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)09:10
gfidenteshardy therve so we had this same problem on upgrade steps09:11
gfidentelook at https://review.openstack.org/#/c/453238/ and https://review.openstack.org/#/c/463577/09:11
gfidentethose conditions have been added/removed a few times09:11
gfidenteI think the issue we're seeing with the workflows is the same09:11
gfidentemaybe it isn't intermittent but it's not manifesting simply by adding or removing the conditions themselves09:12
thervegfidente, So https://bugs.launchpad.net/tripleo/+bug/1689553 ?09:12
openstackLaunchpad bug 1689553 in tripleo "The specified reference "ControllerUpgradeBatch_Step2" (in ControllerUpgradeConfig_Step0) is incorrect." [High,Fix released] - Assigned to Jiří Stránský (jistr)09:12
gfidentetherve that is tracking the old one though09:13
therveRight09:13
mandreansiwen: looks like there is a dependency missing in the openstack-ec2-api rpm, http://logs.openstack.org/01/469201/12/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/72f8a75/logs/overcloud-controller-0/var/log/containers/ec2_api_metadata/ec2api.log.txt.gz09:13
gfidentetherve the new one started after merging https://review.openstack.org/#/c/463324/09:13
mcorneashardy: jistr I noticed that during upgrade all existing packages on the host get upgraded. Since we're moving the openstack services to containers would it make sense to uninstall the packages in the upgrade steps to avoid the delays introduced by pulling those updates from network and installing them?09:14
thervegfidente, Right but the consequences look the same09:14
gfidentewith a similar problem so the proposed workaround was https://review.openstack.org/#/c/479016/09:14
*** AbhishekKane has joined #tripleo09:14
gfidenteyeah but then we got CI passing without this last one workaround, so it's unclear how to reproduce it even09:14
jistr( the tracking bug for reverting that semi-revert is this https://bugs.launchpad.net/tripleo/+bug/1689850 )09:14
openstackLaunchpad bug 1689850 in tripleo "Conditional depends_on in upgrade_steps template doesn't work" [Medium,Triaged]09:14
therveYeah, I don't get what's different in CI from manual testing09:15
shardymcornea: yeah we could do that, or even yum erase the service packages09:15
mcorneashardy: yep, I'll raise a bug for this09:15
shardymcornea: for the first-pass though we left the host packages alone, as it'd make reverting back to baremetal easier, if needed09:15
shardymcornea: the tricky part is calculating exactly what packages to remove, e.g if some services are left running on the host09:16
shardyfor Pike at least, we expect to support hybrid environments where e.g neutron/cinder and a few other bits may sometimes run on the host vs containers09:17
shardymcornea: I guess we could add upgrade_tasks to each docker/services/* template to yum remove only the packages for that service09:18
mcorneashardy: I assume yum can take care of that, like not removing dependecies of services which remain installed09:18
mcorneashardy: yeah, that's waht I had in mind09:18
*** milan has joined #tripleo09:18
shardymcornea: yeah but you still need to give yum a list of packages09:18
shardycurrently we don't have that list anywhere09:18
shardyonly yum -y update09:18
shardymcornea: cool, yeah if someone can do the work to figure out the exact packages then upgrade_tasks should work fine I think09:19
jistrshardy, mcornea: yea definitely worth tracking, though i wonder if it would make sense to remove the packages with 1 release delay, exactly so that we don't pull the rug from below operators if they need to revert (if only temporarily) for whatever reason09:19
shardymaybe we can add a parameter to make it optional09:19
AbhishekKaneshardy: Hey Steve. I had added you as a reviewer to https://review.openstack.org/#/c/475765/7  https://review.openstack.org/#/c/475762/11. If you remember, I had pinged you coulpe of days back about it.09:19
shardyjistr: yeah that's what I was thinking, we should at least provide a paramter to enable leaving the packages09:19
shardyor perhaps do that by default09:20
thervegfidente, Is it possible that the condition error happened after another first failure?09:20
mcorneaI'll take a look at the packages list09:20
therveThat would explain why CI didn't catch it09:20
shardyAbhishekKane: yes thanks for the reminder09:20
AbhishekKanethanks!09:21
gfidentetherve I think that is possible yes, I tried a stack update where in the newer templates I had some new resources, some of which using conditions and disabled and it worked09:21
thervegfidente, If that's so that may be some issue with the backup stack09:21
gfidenteso yes it is possible this was only seen downstream when trying a stack update after an initial, different, issue09:21
gfidenteI believe mcornea was in fact updating from a different initial failure09:22
mcorneagfidente: therve yes, that's correct. I was updating from a failure09:23
therveOK that's something I can test I think09:23
therveThe obvious fix is to switch to convergence09:23
therve </joke>09:24
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175909:27
*** tosky has joined #tripleo09:28
shardytherve: hah, we can definitely discuss that if it fixes the problem, but I think we decided it was safer to wait until early Queens and aim to do it then09:30
therveshardy, Yeah. Way to late in the cycle to do that09:30
shardywe also have a bunch of OS:Heat::Value workaround for performance (slow outputs) which I suspect we can remove when we do move to convergence09:30
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260709:33
bogdandowrt https://bugs.launchpad.net/tripleo/+bug/1701485 does sosreport allow to get the commit shas used to deploy?09:36
openstackLaunchpad bug 1701485 in tripleo "Ocata -> Pike pacemaker enabled overcloud fails during db_syncs because /var/lib/mysql/ is not accessible by mysql" [Critical,New]09:36
bogdandolike from the installed packages perhaps?09:36
bogdandoI think it was fixed by the recent run bootstrap from root patch, wanted to double check09:37
bogdandooh, its pending https://review.openstack.org/#/c/478530/09:39
bogdandomandre, jistr: so I marked that bug as a dup of https://bugs.launchpad.net/tripleo/+bug/1697917, thoughts?09:40
jaganathand0ugal, Hi, Fixed your comments https://review.openstack.org/#/c/469596/, can you please look into it09:40
openstackLaunchpad bug 1697917 in tripleo "Sahara-engine container non functional" [Critical,In progress] - Assigned to Martin André (mandre)09:40
d0ugaljaganathan: sure09:40
jaganathand0ugal, thanks09:41
shardybogdando: yes when deploing from delorean rpm -qa shows you the installed versions09:42
bogdandoshardy: just wanted to make sure the names carry commits sha info09:43
*** links has quit IRC09:44
shardybogdando: they do, it's a partial hash added as part of the dlrn build09:44
*** udesale has quit IRC09:44
shardyyou can check it easily enough :)09:44
bogdandoshardy: thanks!09:44
jaosoriormandre: any idea what went wrong here https://review.openstack.org/#/c/475366/ ?09:46
bogdandofolks, could we merge https://review.openstack.org/#/c/455730/ ? that's a huge step forward for composable roles/services!09:47
bogdandojistr: kudos! :)09:47
jistrheh thanks :)09:47
jistrit depends on https://review.openstack.org/#/c/455719/09:48
bogdandoyeah, and the dependency https://review.openstack.org/#/c/455719/ ofc09:48
shardyjistr: will we use that for any jobs with net-iso?09:49
shardyjistr: if we do, we'll need to add networks since https://review.openstack.org/#/c/409920/09:49
shardyotherwise lgtm09:49
*** akrivoka has joined #tripleo09:50
jistrjaosorior: sorry can you remove +A on https://review.openstack.org/#/c/455730/ ?  The CI results may be stale. The other one (into OOOQ) should be ok +A'd.09:51
jistrjaosorior: re what shardy posted above ^09:51
bogdandojistr: ;(09:51
bogdandocould we keep at least w+1 for https://review.openstack.org/#/c/455719/ ? jistr?09:52
*** salmankhan has quit IRC09:52
jistrbogdando: yea i think that should be fine. By default it doesn't do anything..09:53
*** salmankhan has joined #tripleo09:54
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Reintroduce containerized Cinder  https://review.openstack.org/47900109:57
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Allow modprobing from cinder-volume container  https://review.openstack.org/47923809:57
*** dpawar_ has joined #tripleo09:58
openstackgerritKarthik S proposed openstack/tripleo-heat-templates master: Provide DPDK nic configs and add multiqueue config  https://review.openstack.org/47453309:59
*** ebarrera has quit IRC10:00
*** ebarrera has joined #tripleo10:00
*** links has joined #tripleo10:00
*** dtantsur is now known as dtantsur|bbl10:02
*** ebarrera_ has joined #tripleo10:03
*** dpawar_ has quit IRC10:04
shardymandre: hey when you get a moment could you please check https://bugs.launchpad.net/tripleo/+bug/170148510:04
openstackLaunchpad bug 1697917 in tripleo "duplicate for #1701485 Sahara-engine container non functional" [Critical,In progress] - Assigned to Martin André (mandre)10:04
shardydidn't we have a patch to align uids?10:04
* shardy initially thought https://review.openstack.org/#/c/478530 might fix it, but it seems a different issue?10:06
*** asbishop has joined #tripleo10:06
*** liupe__ has joined #tripleo10:08
*** karthiks has quit IRC10:08
*** jprovazn has quit IRC10:08
*** ebarrera_ has quit IRC10:09
*** ebarrera has quit IRC10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016710:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136210:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]10:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)10:10
*** pliu has quit IRC10:11
*** ckyriakidou has quit IRC10:12
*** liupe__ has quit IRC10:12
*** sai has quit IRC10:13
*** sai has joined #tripleo10:13
*** ebarrera has joined #tripleo10:13
*** ckyriakidou has joined #tripleo10:20
jaosoriorAlright folks10:20
jaosoriorI'm off for three weeks10:20
jaosoriorHave a good weekend everyone!10:21
adarazsjaosorior: have fun :)10:21
shardyenjoy jaosorior10:22
gfidentejaosorior that is10:25
gfidentelike10:25
gfidenteend of school10:25
*** ebarrera_ has joined #tripleo10:26
gfidentefor us staying obviously10:26
jaosoriorBlol10:27
jaosorioralright, now I'm off10:28
*** jaosorior has quit IRC10:28
*** fandrieu has joined #tripleo10:42
sri_Hey everybody I have 6 nodes in my overcloud cluster , I name three of them controller-0 to controoler- 2 other three as compute nodes , next I created flavor's compute and control next I tag them with profile's ("openstack falvor set --property "cpu_arch"="x86_64" --property "capabilities:boot_option"="local" --propety "capabilites:profile"="compute" compute ")  next I tag nodes with Profile ("openstack node-update compute1 add prope10:42
sri_ute,boot_option:local'") when I run the "openstack overcloud deploy --control-scale 1 --compute-scale 1 " I except it will start one controller(node name) and one computer(Node name) nodes but it will staring two controller(node names) then I will make one node as compute and one node as controllr I dont know what I am doing wrong here10:43
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Filter null values from roles data  https://review.openstack.org/47925410:44
sri_compute and controller has different hardware profiles10:44
shardysri_: are you setting the flavors anywhere?  The default is the generic "baremetal"10:45
shardyso you either need to add --control-flavor control and --compute-flavor compute10:46
yolandahi shardy, i'm having an issue with heat in 9->10 upgrade, it seems to be totally stuck. Is there any way to clean up? i remember you showed me once some command for removing hooks10:46
shardyor a -e env.yaml containing OvercloudControlFlavor: control and OvercloudComputeFlavor: compute10:46
yolandashardy, failure is https://bugzilla.redhat.com/show_bug.cgi?id=146672510:47
openstackbugzilla.redhat.com bug 1466725 in openstack-tripleo "M->N upgrade being stuck on major-upgrade-ceilometer-wsgi-mitaka-newton.yaml" [Unspecified,New] - Assigned to jslagle10:47
shardyyolanda: there is heat hook-clear which can be used to manually remove any stale hooks10:48
*** jkilpatr has joined #tripleo10:48
yolandamm, heat hook-poll overcloud shows nothing :(10:49
*** gkadam has joined #tripleo10:50
sri_shardy: I have compute and control flavor's I tag the nodes with flavor but I am not passing flavor's while deploying overcloud10:50
sri_shardy:  openstack overcloud deploy --templates -e /usr/share/openstack-tripleo-heat-templates/environments/enable-swap.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml --libvirt-type qemu --control-scale 1 --compute-scale 1 --ntp-server 192.168.15.1110:51
shardysri_: Ok that is probably your problem10:53
sri_shardy: I thought  I've allready tag the node's with profile I dont need to pass the flavor10:55
shardysri_: no, you need to pass the flavor, maybe that needs to be more clearly stated in the docs?10:56
shardythe default flavor is "baremetal" which will match any node10:56
sri_shardy: I am passing the flavor this time I will let you know if I run into any errors thanks10:57
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Tolerate network errors in pingtest retry logic  https://review.openstack.org/47925610:57
Arilotanhello, I'm a trying to deploy Ocata without a Storage Mgmt subnet but the deploy fails, the overcloud's controller node there is an error in manifests/keepalived.pp at this function interface_for_ip($storage_mgmt_virtual_ip)10:58
ArilotanI modified my env file to assign OS::Heat::None to OS::TripleO::Network::StorageMgmt, OS::TripleO::Network::Ports::StorageMgmtVipPort etc. Am I missing something?10:58
sri_shardy: thanks11:01
shardyArilotan: you probably also need to reset the VIP resource to the noop template:11:01
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L9211:01
*** ratailor has quit IRC11:02
*** pkovar has joined #tripleo11:03
Arilotanok, I will look into that. Thanks11:06
ccamachoHey shardy, this is the fix in tripleo-ci https://review.openstack.org/#/c/477606/11 already working the UC upgrades11:09
gfidenteshardy as a side effect, https://review.openstack.org/#/c/479016/ is causing heat to go to mistral at every step eventually11:10
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016711:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136211:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)11:10
gfidenteso I noticed this in the underloud containers job11:10
*** thrash|g0ne is now known as thrash11:10
gfidenteConnectFailure: resources.WorkflowTasks_Step1: Unable to establish connection to http://127.0.0.1:3535811:10
gfidenteis mistral in the undercloud-containers?11:10
*** karimb has joined #tripleo11:12
*** thrash has quit IRC11:18
openstackgerritMerged openstack/tripleo-heat-templates master: Add a docker-ha.yaml environment file for containerized HA deployments  https://review.openstack.org/47138411:18
*** thrash has joined #tripleo11:18
*** thrash has joined #tripleo11:18
*** fandrieu has quit IRC11:18
*** pradk has joined #tripleo11:23
sri_shardy: when I pass the flavor it's throwing errors like flavor has no profile ? I do have set profile to flavor ---> logs https://pastebin.com/Um7N63Jr11:25
openstackgerritMerged openstack/puppet-tripleo master: Merge the nova HAproxy TLS options  https://review.openstack.org/47861711:27
sri_shardy: it's look's like a bug It's been reported https://bugs.launchpad.net/tripleo/+bug/168626011:29
openstackLaunchpad bug 1686260 in tripleo "If many properties are set in trunk, overcloud installation will fail to detect the profile" [Medium,Triaged]11:29
*** salmankhan has quit IRC11:33
dmsimardsshnaidm|off: fyi https://review.openstack.org/#/c/479264/ it'll be out today11:33
*** jpena is now known as jpena|lunch11:33
openstackgerritArundhati Surpur proposed openstack/tripleo-heat-templates master: Drop MANIFEST.in - it's not needed by pbr  https://review.openstack.org/47926611:35
honzajpich: re: the weird timestamp issue --- any idea where to start looking?  this works correctly on my machine :(11:38
openstackgerritMerged openstack/tripleo-quickstart-extras master: Support composable roles for deploying overcloud  https://review.openstack.org/45571911:41
skramajaEmilienM: shardy: could you take a look at https://review.openstack.org/#/c/478163/ - This patch runs ovs with qemu group permission for dpdk so that vhost ports are accessible. this is temprovary until we have proper ovs solution11:43
*** salmankhan has joined #tripleo11:44
*** sri_ has quit IRC11:44
*** ccamacho is now known as ccamacho|lunch11:46
honzajpich: i think i found it11:47
*** gkadam has quit IRC11:49
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Add GUI logging workflows  https://review.openstack.org/46919611:50
*** dmanchad has quit IRC11:52
*** dmanchado is now known as dmanchad11:52
*** dtantsur|bbl is now known as dtantsur11:54
*** sri_ has joined #tripleo11:55
*** ebarrera has quit IRC11:55
*** ebarrera has joined #tripleo11:56
*** morazi has joined #tripleo11:57
*** ebarrera_ has quit IRC11:59
*** ebarrera_ has joined #tripleo12:00
*** noslzzp has joined #tripleo12:02
*** flepied has quit IRC12:03
*** karimb has quit IRC12:06
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016712:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136212:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]12:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)12:10
*** dpivonka has quit IRC12:10
*** liverpooler has joined #tripleo12:13
*** rlandy has joined #tripleo12:16
openstackgerritSaravanan KR proposed openstack/python-tripleoclient master: Added a warning log to list the deprecated parameters in the plan  https://review.openstack.org/47927712:18
*** skramaja has quit IRC12:18
*** sbrzozow has joined #tripleo12:18
*** pgadiya has quit IRC12:19
*** fandrieu has joined #tripleo12:20
mandrejistr, shardy: hi! what's your though on https://bugs.launchpad.net/tripleo/+bug/1701485?12:20
openstackLaunchpad bug 1697917 in tripleo "duplicate for #1701485 Sahara-engine container non functional" [Critical,In progress] - Assigned to Martin André (mandre)12:20
*** karimb has joined #tripleo12:21
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates master: Add Mistral event engine  https://review.openstack.org/46297512:22
*** flepied has joined #tripleo12:23
*** vpickard has joined #tripleo12:23
openstackgerritBrad P. Crochet proposed openstack/tripleo-puppet-elements master: Add mistral event engine package to the controller image  https://review.openstack.org/47222512:23
*** dpivonka has joined #tripleo12:25
jistrmandre, shardy, mcornea: i think we should probably check what are the actual ownerships/permissions on the files that couldn't be accessed, and also what user mysql runs as. To me it looks like this shouldn't be happening, which is when i resort to double-checking the assumptions... :)12:26
*** f13o has quit IRC12:26
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/47811912:27
mcorneajistr: I recall mysql was running as mysql user but the ownership for /var/lib/mysql was 42434 42434 4096 Jun 29 22:23 /var/lib/mysql/12:27
shardymandre: yeah this is what I was asking about earlier, I also don't think it is a duplicate12:28
jistrmcornea: also depends whether it was the mysql user with uid 42434 or with the bare metal UID12:28
jistr+1 on not being duplicate12:28
* shardy removed duplicate12:29
mandremcornea: 42434 maps to the mysql user inside the container, https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L75612:29
*** jpena|lunch is now known as jpena12:29
*** bfournie1 has quit IRC12:29
mcorneamandre: jistr ok, but mysql was not running inside the container at that point but it was still running as the galera pacemaker resource12:30
jistrok, that's the issue then12:30
mcorneaI guess it failed to start the container12:30
mcornea Master/Slave Set: galera-master [galera] (unmanaged)12:30
mcornea     galera (ocf::heartbeat:galera): Master overcloud-controller-0 (unmanaged)12:30
mandremcornea, jistr: ok, so it seems we "fix" the uid/gid a bit too soon then12:30
jistrat the db sync point it should already be running from container i think12:30
jpichhonza: Yay, glad you found it :)12:30
shardymandre, jistr: there was https://review.openstack.org/#/c/475222/ from stevebaker which I thought aimed to fix a similar issue12:31
mcorneaand  Docker container: galera-bundle [192.168.0.1:8787/tripleoupstream/centos-binary-mariadb:latest] (unmanaged)12:31
mcornea   galera-bundle-docker-0 (ocf::heartbeat:docker): Stopped (unmanaged)12:31
shardybut that was abandoned12:31
dciabrinjistr, mcornea mandre the name of the resource changes from ocata to pike, so we also need to delete the old pacemaker resource before restarting the new one12:31
jistrshardy: yea we discussed that on scrum, the conclusion seemed to go in the direction that we shouldn't rely on the UIDs being the same in container/BM12:32
shardydciabrin: Ok so that is specific to the upgrade to containers, right?12:32
shardywe may need to copy puppet/services/pacemaker.yaml in that case to allow for container specific upgrade_tasks12:33
dciabrinshadower, a container-specific migration step is required12:33
jistrdciabrin: ++ makes sense12:33
shardydciabrin: Ok, I'd suggest we copy puppet/pacemaker.yaml to docker/pacemaker.yaml, and make a note that it runs on baremetal but contains logic specific to the container architecture12:34
mandreshardy: stevebaker's approach wouldn't work because I think we can't make any assumption on the uid/gid of users created by rdo packages12:34
shardythen we can add whatever container specific upgrade/update tasks are needed without changing the baremetal template12:34
mandreshardy: some packages have fixed uid/gid but AFAIK they're trying to move away from doing that12:34
shardymandre: Ok so we have to set it explicitly12:34
jistrshardy, dciabrin: shouldn't that go to something like docker/pacemaker/mysql.yaml rather?12:34
dciabrinshardy oh btw I re-deployed ha overcloud yesterday and it worked for me. does yours still break today?12:34
*** ykarel is now known as ykarel|away12:35
dciabrinjistr, shardy agreed, this is probably role-specific at this point, so not in pacemaker.yaml12:35
shardyjistr: ah, yeah if it's just the DB resource I guess12:35
shardybut same approach applies I think12:35
shardydciabrin: not re-tested w/HA today but will try to get to it later12:36
dciabrinshardy, ack12:36
jistryea the problem is the upgrade_tasks here https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/database/mysql.yaml#L184-L18712:36
shardyOk cool, then we can change them fairly easily :)12:36
jistrthey're taken from non-pacemaker variant12:36
jistryea12:36
shardyCan I get a second reviewer for https://review.openstack.org/#/c/476238 please?12:38
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow  https://review.openstack.org/46506612:39
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: [DO_NOT_MERGE] Test ceph-ansible in CI  https://review.openstack.org/47928812:39
shardyand https://review.openstack.org/#/c/478622/12:39
*** ecerquei has joined #tripleo12:40
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: DPDK and Host derive parameters workflows  https://review.openstack.org/46898912:41
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras master: Add check on download_overcloud_templates_rpm to trigger custom-tht  https://review.openstack.org/47921212:46
*** jmelvin has joined #tripleo12:46
*** jaganathan has quit IRC12:48
*** panda|off is now known as panda12:51
*** axisys has quit IRC12:51
*** cylopez has joined #tripleo12:52
pradkanyon, do we have any services in tripleo using gunicorn or uwsgi?12:52
*** cylopez has quit IRC12:52
pradkanyone*12:53
*** pchavva has joined #tripleo12:54
*** lblanchard has joined #tripleo12:54
*** lblanchard has quit IRC12:55
*** zoli is now known as zoli|lunch12:55
*** sri_ has quit IRC12:56
*** pkovar has quit IRC12:57
mandreshardy, beagles: do you know if we have plans to have ovn containers in pike?12:59
mandreif yes, can we merge https://review.openstack.org/#/c/474944/?12:59
shardymandre: I believe so13:01
shardyalthough I suspect many environments will have third-party networking pieces so they will have to stay on the host13:01
mandreshardy: indeed, but they should still be available as tech preview, right?13:02
*** dprince has joined #tripleo13:02
*** vpickard has quit IRC13:03
shardymandre: yeah I think it's good to land the patch, approved13:03
shardymandre: https://review.openstack.org/#/c/468860/ is the related t-h-t patch13:03
mandreshardy: I believe the only other container image pending merge for pike is the novajoin images, but I'm not too concerned for this one as IIUC this is a service for the undercloud only13:04
shardynumans: is ^^ ready for review, or is it still under development?13:04
shardysorry it looks like it's not seen much review attention so far..13:04
*** axisys has joined #tripleo13:04
flaper87hey folks, quick question about oooq featuresets. What's the best way to add extra environment files to the overcloud deploy step? https://review.openstack.org/#/c/478510/6/config/general_config/featureset025.yml13:05
*** toure|gone is now known as toure13:05
flaper87I've added extra_args to that patch but that didn't seem to work13:05
*** bfournie has joined #tripleo13:06
flaper87panda: weshay ^ ?13:06
*** sbrzozow has quit IRC13:06
*** dpivonka has quit IRC13:07
*** sbrzozow has joined #tripleo13:08
pandaflaper87: featureset activate features, not configurations. where you can put an extra_arg really depends on what you need to add13:08
weshaypanda, extra_args: >-13:08
weshay   -e {{ overcloud_templates_path }}/environments/kubernetes.yaml13:08
weshayso I would suspect extra_args is defined in config/environments but let's look at the test results13:09
flaper87weshay: http://logs.openstack.org/59/471759/6/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/e245138/13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016713:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136213:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)13:10
*** fandrieu has quit IRC13:11
*** spredzy has quit IRC13:12
flaper87weshay: I was expecting to see the environment file appended to the overcloud deploy command but I think I completely misunderstood the meaning of extra_Args13:12
flaper87:D13:12
weshayflaper87, ya.. it did not end up in http://logs.openstack.org/59/471759/6/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/e245138/logs/undercloud/home/jenkins/overcloud-deploy.sh.txt.gz13:14
flaper87yup13:14
weshaymultiple convs.. still helping just slow13:14
flaper87weshay: no worries13:14
flaper87:D13:14
flaper87weshay: did I misunderstood the use of extra_args or is there something else going on?13:14
* flaper87 greps extra_args everywhere13:15
pandaflaper87: how are you testing scenario006 ?13:15
weshayflaper87, https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/testenv/multinode.yml#L413:15
weshayflaper87, it's overridden by the env file13:16
*** tzumainn has joined #tripleo13:16
flaper87panda: you gotta be more specific than that. Not sure if it's obvious that I don't know much about how the TripleO CI w/ quickstart works :)13:16
flaper87weshay: oh, that's why13:17
weshayflaper87, probably want to create a new arg section for the deployment in https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/defaults/main.yml#L95-L11513:17
weshayor use one of those13:17
flaper87weshay: I can use container_args13:17
flaper87but then it'll be overriden, lemme check13:17
weshayopenshift_args?13:18
dprincemandre: a bit of a panic on this one. But I now see why you changed the exec (to support the unit tests) https://review.openstack.org/#/c/478530/413:18
flaper87weshay: I wanted to avoid creating a new one, I guess I'll have to13:18
flaper87coe_args13:18
dprincemandre: still, why are you changing the db_sync line? That wasn't strictly required here was it?13:19
flaper87weshay: although it's still under the containers group13:19
flaper87oh well13:19
weshayok13:19
weshaypanda, do we want to create env_args13:19
shardyhmm, dciabrin FYI HA deployments still fail for me, docker_puppet_tasks fails on step113:20
weshayso that when folks use extra_args in the deployment13:20
weshaythe env does not secretly override it?13:20
weshayflaper87, panda ^13:20
toskydprince: is the question just for addition in keystone, not the change in sahara-api.yaml?13:20
dprincetosky: yes, all keystone13:20
dciabrinshardy, hmm, weird, containers are created at step2 :/13:20
toskyack13:20
mandredprince: this is to make it consistent with other containers wehre the bootstrap_host_exec needs to run as root13:20
*** links has quit IRC13:20
*** ccamacho|lunch is now known as ccamacho13:20
*** dpivonka has joined #tripleo13:21
shardydciabrin: yeah, there may be an issue with docker on the host, investigating13:21
mandredprince: the keystone container already runs as root as it's the default user on the image, but I think it's better to be explicit here13:21
mandreplus it helps with the validation wher we don't have to treat keystone as a special case13:22
*** lucas-afk is now known as lucasagomes13:22
pandaweshay: env_args is generic enough that this situation will present itself againg, but yeah, any official variable file should use its own set of _args13:22
flaper87weshay: would something like this be ok? http://paste.openstack.org/show/614184/13:22
*** zaneb has joined #tripleo13:22
dprincemandre: so you are saying be explcit for root only in the case we use bootstrap_host_exec. I see13:22
flaper87weshay: should probably put it at the bottom to give precedence to the ones set manually13:22
*** jkilpatr has quit IRC13:22
weshaypanda, ah... so you are saying flaper87 was just lazy :P13:23
dprincemandre: sorry, I haven't actually had tea yet. Re-approved. Just wanted to review since I wrote this one13:23
weshayflaper87, that looks good to me :)13:23
flaper87weshay: I'm italian, I'm always lazy. That being said, I don't know much about quickstart so I'm trying to understand the best practices13:23
weshayflaper87, I kid :)13:23
flaper87and, now that I know container_args is a thing, I'd totally like to use this13:24
flaper87weshay: hahahah, I know, I know13:24
*** pkovar has joined #tripleo13:24
weshay:)13:24
pandaflaper87: put a containers_args: "" in overcloud-deploy/defaults/main.yml. We like explicit defaults.13:24
pandaflaper87: oh, I see what you mean there13:25
openstackgerritFlavio Percoco proposed openstack/tripleo-quickstart-extras master: WIP: Don't override container_args if it's set manually  https://review.openstack.org/47930513:26
flaper87I guess I could just completely override the container_args var in my featureset13:26
* flaper87 shrugs13:26
pandaThat's it. I'll present an RFE for queen to make the overcloud command line less arbitrary.13:26
pandaflaper87: that's the safest solution, until someone overrides you override13:27
*** eck`gone is now known as eck`13:27
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Adding periodic tripleo tempest job in promotion  https://review.openstack.org/47930713:27
*** dparkes has quit IRC13:27
flaper87panda: but wouldn't the set_facts task override whatever I put in the featureset ?13:27
openstackgerritFlavio Percoco proposed openstack/tripleo-quickstart master: Add featureset25 for scenario006  https://review.openstack.org/47851013:29
pandaflaper87: unfortunately, facts have less precedence over variables, set_fact is not a way to override already defined variables.13:30
*** gkadam has joined #tripleo13:31
flaper87panda: gotcha, I guess I'll do that13:31
*** jcoufal has joined #tripleo13:33
openstackgerritFlavio Percoco proposed openstack/tripleo-quickstart master: Add featureset25 for scenario006  https://review.openstack.org/47851013:34
*** jkilpatr has joined #tripleo13:35
*** achadha has joined #tripleo13:35
thervegfidente, mcornea: I'm kind of stuck. If I could have some logs of a failing build, or an env with the issue, that would help13:36
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Adding real time bug verification  https://review.openstack.org/47419713:40
*** achadha has quit IRC13:40
mcorneatherve: I'll try to get a reproducing env13:41
openstackgerritMerged openstack/tripleo-heat-templates master: scenario001: containerize services for CI  https://review.openstack.org/47669313:43
gfidentemcornea++ thanks I suppose you need the patch from shardy to make sure it doesn't break on the other issue, but not the submission I posted to see if it is really necessary13:43
gfidentethanks13:43
gfidentejistr flaper87 my take to configure ceph in the openstack clients13:44
gfidentewould be to make CephClient a base resource of the services which need it13:44
gfidenteso that if it isn't disabled it emits the necessary puppet-ceph params13:44
gfidentethen we mount in the container /etc/ceph too13:44
gfidenteand include the puppet ceph client profile13:44
openstackgerritMerged openstack/tripleo-puppet-elements master: Install python-docker-py in the baremetal image  https://review.openstack.org/47865913:44
gfidentesounds like a plan?13:44
openstackgerritMerged openstack/tripleo-heat-templates master: Ensure boostrap_host_exec runs as root  https://review.openstack.org/47853013:44
gfidenteand we can use the same CephClient for both containerized and noncontainerized13:45
mcorneagfidente: yep, sounds good13:46
jistrgfidente: yea i think that's good.  cc mandre dprince13:46
*** pblaho has quit IRC13:48
mandregfidente: sounds good to me, I think dciabrin wanted to do the same thing with mysql client13:49
gfidenteright sharing pain is cool13:49
gfidenteok I'll try something locally, so I can break CI next week again13:49
mandregfidente: haha no pain no gain :)13:51
gfidentebut it's cool13:51
gfidentewhen it works13:52
gfidenteI remember saying this before13:52
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260714:00
jistrshardy: hmm it actually passed all the needed CI... https://review.openstack.org/#/c/455730/14:02
bogdandoplease merge https://review.openstack.org/#/c/465498/ :)14:03
jistrshardy: i'll take a closer look momentarily14:03
openstackgerritJohn Eckersberg proposed openstack/tripleo-heat-templates master: WIP docker qdr  https://review.openstack.org/47904914:04
*** dmacpher has joined #tripleo14:04
openstackgerritMerged openstack/tripleo-heat-templates master: cisco nexus: keep OVS on the Compute  https://review.openstack.org/47623814:04
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/47811914:07
*** jkilpatr has quit IRC14:07
*** jkilpatr has joined #tripleo14:07
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016714:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136214:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]14:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)14:10
*** ebarrera_ has quit IRC14:12
*** Vijayendra has joined #tripleo14:13
*** ebarrera_ has joined #tripleo14:13
openstackgerritBen Nemec proposed openstack/python-tripleoclient master: Call undercloud pre-upgrade hook  https://review.openstack.org/47908214:15
openstackgerritBen Nemec proposed openstack/python-tripleoclient master: Revert "Call undercloud install function directly"  https://review.openstack.org/47906314:15
*** jkilpatr has quit IRC14:15
rookradez: https://review.openstack.org/#/c/454123/ could you give it a look?14:16
*** fandrieu has joined #tripleo14:16
jristmwhahaha, weshay: sleeping weather?14:18
weshayjrist, ssshhh.. I'm sleeping14:19
jristweshay: mountain biking weather?14:19
weshayaye14:19
*** Vijayendra has quit IRC14:23
*** mcornea has quit IRC14:28
*** jkilpatr has joined #tripleo14:29
shardyjistr: ack, happy to land it if we're confident it doesn't break CI, but I guess we'll want to add the networks at some point, or have a different version for oooq net-iso jobs14:30
*** zoli|lunch is now known as zoli|wfh14:31
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Default OVB variable  https://review.openstack.org/47553314:36
*** jtomasek has quit IRC14:37
gfidenteshardy actually, this looks fine with composable networks right? https://review.openstack.org/#/c/476602/19/overcloud.j2.yaml14:40
*** egonzalez has quit IRC14:40
gfidenteI don't see issues at least, is there something hidden?14:40
gfidentewe'd just change the network j2 templates to emit the subnet like https://review.openstack.org/#/c/476602/19/network/management_v6.yaml14:41
*** jkilpatr has quit IRC14:42
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175914:43
*** dpawar has quit IRC14:45
*** dtantsur is now known as dtantsur|bbl14:45
*** trozet has joined #tripleo14:54
*** yprokule has quit IRC14:54
*** flepied has quit IRC15:00
*** ckyriakidou has quit IRC15:01
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart master: WIP: Integrate devmode into quickstart.sh  https://review.openstack.org/47934115:02
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373115:03
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357615:03
shardygfidente: yes I think that looks reasonable15:04
gfidenteshardy ack, wanted to make sure it's not cause of troubles15:04
*** b00tcat has quit IRC15:04
trozetdoes anyone know if new checks were added to CI recently checking if heat parameter definitions were consistent across the templates for THT?15:05
shardytrozet: yes15:05
shardyhttps://github.com/openstack/tripleo-heat-templates/commit/f572b764f18cb3c6b54e24c1015a7e4dfcefd65f15:06
trozetshardy: ok, why is that in merge/post gate, that should be ran when patch is first submitted...or did I just catch it because my patch was approved and the CI job was added right before my patch tried to jenkins +215:06
*** atheurer has joined #tripleo15:06
shardytrozet: ^^15:06
shardytrozet: I'd check the timestamps, did you just get unlucky and have the check run happen before that landed?15:07
*** karimb has quit IRC15:07
*** dtrainor_ has joined #tripleo15:07
trozetshardy: well on that odl container patch, i see it under "jenkins gate", which I think is the merge/post jobs right? https://review.openstack.org/#/c/466920/15:07
trozetshardy: oh wait i see it did fail on recheck15:08
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras master: Add check on download_overcloud_templates_rpm to trigger custom-tht  https://review.openstack.org/47921215:08
trozetshardy: in pre-gate15:08
trozetshardy: so yeah my patch must have been caught in the middle of the update.  So looks like that job is failing for everyone then.  Were hte pep8 failures already fixed by another patch and I can rebase?15:09
openstackgerritAndrewToth proposed openstack/tripleo-heat-templates master: Enable Neutron LBaaS Integration  https://review.openstack.org/31393315:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016715:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136215:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)15:10
trozetshardy: answered my own question I guess I see some patches passed the pep8 yesterday, so will try rebase15:10
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Adds docker OpenDaylight  https://review.openstack.org/46692015:10
shardytrozet: yeah I think rebase on current trunk should fix it15:10
trozetshardy: ty, can you please set workflow again on ^^?15:11
*** rcernin has quit IRC15:11
atothshardy, undated https://review.openstack.org/#/c/313933/ per your comments, it's funny, I know at some point in my dev of this I had all those aux files (ie roles data and overcloud resource reg) filled out. I must have had to start over for some reason :-)15:12
shardytrozet: lets let the check jobs run to confirm it's fine, I'll approve after15:12
trozetshardy: ok sounds good15:12
atothEmilienM, beagles, shardy  https://review.openstack.org/#/c/313933/ ready for review (again)15:13
*** akrivoka has quit IRC15:15
shardyatoth: you need to update the individual roles under roles/* and regenerate roles_data via tripleoclient15:16
shardysec let me link a review which shows how15:16
*** rbowen has quit IRC15:16
atothshardy, oh so roles_data should not be hand edited, good thing to know :-)15:17
*** prateek has quit IRC15:18
*** aufi has quit IRC15:18
shardyatoth: commented - yeah it's a pretty new thing, that file should be generated via tripleoclient now15:19
shardycomposable roles are now more composable ;)15:19
atothshardy question, see a lot of overlap in services for the controller and networker roles, I know not everyone deploys with the networker role, so should I also add the service to both roles?15:21
*** anshul has quit IRC15:22
shardyatoth: if it makes sense to run it on a standalone networker node then yes15:22
*** amoralej is now known as amoralej|off15:22
bogdandoshardy: back to the elements vs pre-provisioned topic, my overcloud deploy fails with  "os-net-config: command not found" :-o15:22
shardythere is overlap atm, we've not yet implemented a way to de-duplicate15:22
bogdandoso I'm wondering how to draw the line for real provision requirements15:23
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/deployed-server/deployed-server-bootstrap-centos.sh#L915:23
shardybogdando: if you're using the documented steps I think it should get installed there15:23
bogdandooh, it seems I shouldn't have noop'ed it15:24
*** akrivoka has joined #tripleo15:24
atothshardy, it needs top run where ever neutron server runs :-)15:25
*** ramishra has quit IRC15:25
bogdandoshardy: IIRC, I was confused by this http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/v1/undercloud_deploy.py#n35715:26
bogdandothat brought me here https://github.com/bogdando/oooq-warp/blob/master/vars/overcloud-traas.yaml#L22 ...15:27
bogdandoand was wrong :)15:27
bogdandoso I all I need it's put the line 29 instead, shardy: thanks!15:28
atothshardy, should I leave the update in the role_data file as well (seeing as it will be overwritten by the tripleo-client call so shouldn't have a negative impact anyway)?15:29
*** ffiore has quit IRC15:29
*** jpena is now known as jpena|off15:31
openstackgerritJohn Eckersberg proposed openstack/tripleo-heat-templates master: WIP docker qdr  https://review.openstack.org/47904915:34
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Add networks to multinode role data  https://review.openstack.org/47935315:35
shardyatoth: yeah tripleoclient will overwrite it if you use the command I pasted on the review15:36
shardybogdando: yeah undercloud deploy is a special case of deployed server I think15:37
shardyperhaps we could align the approaches in future15:37
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Add /root/.cache/image-create to cleanup role  https://review.openstack.org/47935615:37
openstackgerritAndrewToth proposed openstack/tripleo-heat-templates master: Enable Neutron LBaaS Integration  https://review.openstack.org/31393315:38
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Add /root/.cache/image-create to cleanup role  https://review.openstack.org/47935615:38
*** milan has quit IRC15:41
*** lmiccini has quit IRC15:43
*** dsneddon is now known as dsneddon_afk15:45
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Allow modprobing from cinder-volume container  https://review.openstack.org/47923815:45
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Reintroduce containerized Cinder  https://review.openstack.org/47900115:45
*** karimb has joined #tripleo15:47
*** yamahata has joined #tripleo15:49
*** jlinkes has quit IRC15:49
*** jkilpatr has joined #tripleo15:53
atothEmilienM, beagles, shardy  https://review.openstack.org/#/c/313933/ ready for review (again again)15:56
*** dtantsur|bbl is now known as dtantsur15:57
*** jpich has quit IRC15:58
bogdandofolks, python-tripleoclient tox fails for me with instack_undercloud is missing, what is wrong?..16:02
bogdandorefreshing from test-requirements doesn't help16:02
bogdandod0ugal: ^^ ?16:02
d0ugalbogdando: it should be there. https://github.com/openstack/python-tripleoclient/blob/master/requirements.txt#L1816:03
bogdandoah, just requirements, not test16:03
bogdandothanks!16:03
d0ugalnp16:04
*** noslzzp has quit IRC16:04
*** cschwede has quit IRC16:07
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP: test gate for devmode  https://review.openstack.org/47282616:08
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016716:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136216:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]16:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)16:10
*** jkilpatr has quit IRC16:11
*** tesseract has quit IRC16:11
*** jkilpatr has joined #tripleo16:11
bogdandookay, next thing for my faily overcloud is that http://git.openstack.org/cgit/openstack/tripleo-image-elements/tree/elements/os-net-config/os-refresh-config/configure.d/20-os-net-config tries to ping metadata IP at my "lightweight UC" running w/o nova at all16:12
bogdandoam I missing something?16:12
bogdandoor is it this one that fails ? .. http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/network/scripts/run-os-net-config.sh16:12
bogdando(fails the same step overcloud.ControllerDeployedServer.0.NetworkDeployment, still, just a little bit further now)16:13
bogdandoIIUC, it shouldn't try to check nova metadata service for my case, right?16:14
bogdandoseems something bad in my config for EC2MetadataIp , and https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/deployed_server.html ... again16:15
* bogdando sigh16:15
*** ykarel|away is now known as ykarel16:16
bogdando"ControlPlaneDefaultRoute and EC2MetadataIp are not necessarily meaningful parameters depending on the network architecture in use with deployed servers. However, they still must be specified as they are required parameters for the template interface." ... and still checked if functional haha16:16
*** atheurer has quit IRC16:17
bogdandogoing offline now, would be grateful if anyone replied to me be email... thank folks16:18
bogdandohave a nice week-end16:18
*** ebarrera_ has quit IRC16:20
slagleall you have to do is specify a pingable IP address or modify your nic config templates to not require those parameters16:20
*** ebarrera has quit IRC16:21
*** jistr is now known as jistr|off16:21
Slowerpanda: ok script should be ready now16:21
*** bogdando has quit IRC16:23
pandaSlower: thanks! I'll start testing it next thing16:27
*** achadha has joined #tripleo16:28
*** gfidente has quit IRC16:30
*** achadha has quit IRC16:33
*** achadha has joined #tripleo16:35
*** ykarel has quit IRC16:36
*** shardy has quit IRC16:37
*** dtantsur is now known as dtantsur|afk16:40
*** trozet has quit IRC16:41
*** flepied has joined #tripleo16:51
*** gkadam has quit IRC16:57
*** paramite has quit IRC16:58
*** zaneb has quit IRC16:58
dtantsur|afkquit17:00
Slowergotta do the /disco!17:02
*** zoli|wfh is now known as zoli17:03
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Add support for nova live/cold-migration with containers  https://review.openstack.org/47195617:04
mandredtantsur|afk: https://cdn.meme.am/instances/500x/60905477/tony-horton-you-cant-quit-me-that-easily.jpg17:05
openstackgerritMerged openstack/tripleo-quickstart master: update bm/ovb jobs to use --environment  https://review.openstack.org/47827317:07
*** artom has quit IRC17:07
openstackgerritMerged openstack/tripleo-common master: Fix files actions run() method  https://review.openstack.org/47890817:08
openstackgerritMerged openstack/tripleo-common master: Add Mistral workbook to call ceph-ansible to install Ceph  https://review.openstack.org/46964417:08
*** zaneb has joined #tripleo17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016717:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136217:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)17:10
*** athomas has quit IRC17:13
*** timothyb89 has quit IRC17:16
*** timothyb89 has joined #tripleo17:17
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: New environment file to configure containers.  https://review.openstack.org/47862517:19
openstackgerritMartin André proposed openstack/tripleo-common master: Add ironic-inspector image  https://review.openstack.org/47937617:22
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Use a single configuration file for specifying docker containers.  https://review.openstack.org/47862817:23
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector  https://review.openstack.org/45782217:24
*** spredzy has joined #tripleo17:30
*** rbowen has joined #tripleo17:34
*** rbowen has quit IRC17:34
*** rbowen has joined #tripleo17:34
*** zaneb has quit IRC17:35
openstackgerritMartin André proposed openstack/tripleo-common master: Add OVN container images  https://review.openstack.org/47494417:35
*** pchavva has quit IRC17:35
*** flepied has quit IRC17:36
*** achadha has quit IRC17:38
*** achadha has joined #tripleo17:38
*** pcaruana has quit IRC17:42
*** achadha has quit IRC17:42
openstackgerritMerged openstack/instack-undercloud master: Updated from global requirements  https://review.openstack.org/47793517:43
*** tosky has quit IRC17:44
*** ykarel has joined #tripleo17:46
*** zaneb has joined #tripleo17:48
*** rbowen has quit IRC17:50
*** rbowen has joined #tripleo17:50
*** salmankhan has quit IRC18:03
*** trozet has joined #tripleo18:04
*** pkovar has quit IRC18:05
*** achadha has joined #tripleo18:07
*** tosky has joined #tripleo18:08
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016718:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136218:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]18:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)18:10
*** rasca has quit IRC18:18
*** hamzy has joined #tripleo18:18
*** zaneb has quit IRC18:20
*** iranzo has quit IRC18:22
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: New environment file to configure containers.  https://review.openstack.org/47862518:27
*** jpena|off is now known as jpena18:29
*** dsneddon_afk is now known as dsneddon18:32
*** yamahata has quit IRC18:36
*** zaneb has joined #tripleo18:38
*** idlemind has quit IRC18:43
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Remove DockerNamespace references  https://review.openstack.org/47939818:44
*** idlemind has joined #tripleo18:47
openstackgerritDan Prince proposed openstack-infra/tripleo-ci master: Add a new docker centos Heat environment  https://review.openstack.org/47939918:47
*** jpena is now known as jpena|away18:48
openstackgerritDan Prince proposed openstack/tripleo-quickstart-extras master: Add a new docker centos Heat environment  https://review.openstack.org/47940018:50
*** rhallisey has quit IRC18:51
openstackgerritDan Prince proposed openstack/tripleo-quickstart-extras master: Add a new docker centos Heat environment  https://review.openstack.org/47940018:54
openstackgerritDan Prince proposed openstack-infra/tripleo-ci master: Add a new docker centos Heat environment  https://review.openstack.org/47939918:55
openstackgerritBen Nemec proposed openstack/python-tripleoclient master: Call undercloud pre-upgrade hook  https://review.openstack.org/47908218:57
*** dparkes has joined #tripleo19:07
*** idlemind has quit IRC19:07
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata  https://review.openstack.org/47760619:07
*** idlemind has joined #tripleo19:08
openstackgerritAna Krivokapic proposed openstack/tripleo-ui master: PlanList and PlanCard updates  https://review.openstack.org/47694219:08
openstackgerritAna Krivokapic proposed openstack/tripleo-ui master: Remove CurrentPlanReducer  https://review.openstack.org/47693919:08
openstackgerritAna Krivokapic proposed openstack/tripleo-ui master: Plans routing refactor  https://review.openstack.org/47690419:08
openstackgerritAna Krivokapic proposed openstack/tripleo-ui master: Add plan description to plan cards  https://review.openstack.org/47940419:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016719:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136219:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress]19:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)19:10
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Disable network validation in multinode jobs  https://review.openstack.org/47940619:10
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata  https://review.openstack.org/47760619:11
*** yamahata has joined #tripleo19:12
*** akrivoka has quit IRC19:14
*** lblanchard has joined #tripleo19:18
*** Tyrantelf has joined #tripleo19:22
*** Tyrantelf_ has quit IRC19:22
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Use a single configuration file for specifying docker containers.  https://review.openstack.org/47862819:25
*** larstobi has quit IRC19:25
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Remove DockerNamespace references  https://review.openstack.org/47939819:26
*** larstobi has joined #tripleo19:27
*** atheurer has joined #tripleo19:30
*** jmelvin has quit IRC19:38
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Remove DockerNamespace references  https://review.openstack.org/47939819:50
openstackgerritMerged openstack/tripleo-heat-templates master: Make NovaWorkers descriptions consistent  https://review.openstack.org/47769619:52
*** atheurer_ has joined #tripleo19:55
*** atheurer has quit IRC19:56
openstackgerritDan Prince proposed openstack/puppet-tripleo master: Add insecure_registry_address to docker profile  https://review.openstack.org/47941220:01
openstackgerritDan Prince proposed openstack/puppet-tripleo master: Add insecure_registry_address to docker profile  https://review.openstack.org/47941220:02
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Remove DockerNamespace references  https://review.openstack.org/47939820:03
*** dparkes has quit IRC20:03
*** sbrzozow has quit IRC20:04
*** jmelvin has joined #tripleo20:04
*** jmelvin has quit IRC20:05
*** jmelvin has joined #tripleo20:06
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/47869920:06
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/47811920:06
*** liverpooler has quit IRC20:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016720:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136220:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)20:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)20:10
*** salmankhan has joined #tripleo20:12
*** rhallisey has joined #tripleo20:16
*** salmankhan has quit IRC20:16
achadhaguys, I see that we create neutron-ports (undercloud) for only the overcloud-VIP's (not for the physical IPs). What is the reason for that?20:18
*** eck` is now known as eck`gone20:25
*** rasca has joined #tripleo20:30
*** atheurer_ has quit IRC20:31
*** atheurer has joined #tripleo20:40
*** lblanchard has quit IRC20:46
*** bfournie has quit IRC20:47
*** rbrady has quit IRC20:56
*** rbrady has joined #tripleo20:58
*** asbishop has quit IRC21:08
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow  https://review.openstack.org/46506621:10
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property  https://review.openstack.org/47660221:10
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: [WIP] Add support for installing Ceph MDS via ceph-ansible  https://review.openstack.org/47942621:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016721:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170136221:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)21:10
openstackLaunchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec)21:10
*** eck`gone is now known as eck`21:10
*** atheurer has quit IRC21:11
*** atheurer has joined #tripleo21:11
*** atheurer has quit IRC21:11
*** atheurer has joined #tripleo21:18
*** flepied has joined #tripleo21:18
*** dprince has quit IRC21:19
*** flepied has quit IRC21:23
*** atheurer has quit IRC21:23
*** flepied has joined #tripleo21:29
*** trozet has quit IRC21:32
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Disable network validation in multinode jobs  https://review.openstack.org/47940621:34
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Disable network validation in multinode jobs  https://review.openstack.org/47940621:35
bnemecI hate when you forget to add a new file to git. :-)21:35
*** jpena|away is now known as jpena|off21:36
openstackgerritMerged openstack/tripleo-quickstart-extras master: Use templated network-environment file for OVB  https://review.openstack.org/47478121:40
openstackgerritMerged openstack/tripleo-heat-templates master: Fix typo in config_volume  https://review.openstack.org/47577921:40
*** jmelvin has quit IRC21:43
*** trozet has joined #tripleo21:46
openstackgerritMerged openstack-infra/tripleo-ci master: Specify custom role data for multinode jobs  https://review.openstack.org/45573021:47
openstackgerritMerged openstack/python-tripleoclient master: Revert "Call undercloud install function directly"  https://review.openstack.org/47906321:47
openstackgerritMerged openstack/tripleo-heat-templates master: Re-enable default for RoleParameters  https://review.openstack.org/47821321:48
*** trozet has quit IRC21:54
*** morazi has quit IRC21:56
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260722:00
*** jayg is now known as jayg|g0n322:03
*** dmanchad has quit IRC22:05
*** rhallisey has quit IRC22:05
*** dmanchad has joined #tripleo22:05
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016722:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)22:10
*** achadha_ has joined #tripleo22:18
*** achadha has quit IRC22:21
*** achadha_ has quit IRC22:22
*** rbowen has quit IRC22:23
*** bfournie has joined #tripleo22:41
*** bfournie has quit IRC22:42
*** achadha has joined #tripleo22:44
*** rlandy has quit IRC22:45
openstackgerritDan Sneddon proposed openstack/tripleo-common master: Pass all network data to render network/port templates  https://review.openstack.org/47668222:46
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Render isolated network templates using jinja2  https://review.openstack.org/47561222:46
*** achadha has quit IRC22:49
*** ebarrera_ has joined #tripleo22:55
*** dmacpher has quit IRC22:55
*** achadha has joined #tripleo22:57
*** dmacpher has joined #tripleo23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168016723:10
openstackLaunchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec)23:10
*** ooolpbot has quit IRC23:10
*** ebarrera_ has quit IRC23:18
*** tosky has quit IRC23:20
*** achadha has quit IRC23:43
*** achadha has joined #tripleo23:43
*** achadha has quit IRC23:48
*** achadha has joined #tripleo23:50
*** achadha has quit IRC23:55
*** achadha has joined #tripleo23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!