Tuesday, 2016-07-05

*** saneax is now known as saneax_AFK00:05
*** tzumainn has quit IRC00:11
*** Rodrigo_BR has quit IRC00:19
*** Goneri has quit IRC00:21
*** fragatina has joined #tripleo00:23
*** saneax_AFK is now known as saneax00:25
*** fragatina has quit IRC00:27
*** yamahata has quit IRC00:28
*** limao has joined #tripleo00:37
*** numans has joined #tripleo00:47
*** rook- has quit IRC01:04
*** dmacpher has joined #tripleo01:10
*** fragatina has joined #tripleo01:24
*** fragatina has quit IRC01:29
*** fzdarsky_ has joined #tripleo01:33
*** fzdarsky has quit IRC01:36
*** ramishra has joined #tripleo02:12
*** limao has quit IRC02:17
*** limao has joined #tripleo02:18
*** limao_ has joined #tripleo02:20
*** limao has quit IRC02:24
*** fragatina has joined #tripleo02:24
*** fragatina has quit IRC02:29
*** ramishra has quit IRC02:56
*** coolsvap has joined #tripleo02:59
*** ramishra has joined #tripleo03:04
*** rcernin has joined #tripleo03:08
*** ramishra has quit IRC03:20
*** ramishra has joined #tripleo03:22
*** fragatina has joined #tripleo03:25
*** limao_ has quit IRC03:27
*** limao has joined #tripleo03:30
*** fragatina has quit IRC03:30
*** limao has quit IRC03:35
*** dmacpher has quit IRC03:52
*** limao has joined #tripleo03:54
*** ramishra has quit IRC03:59
*** ramishra has joined #tripleo04:00
*** numans has quit IRC04:03
*** limao has quit IRC04:07
*** saneax is now known as saneax_AFK04:07
*** shivrao has joined #tripleo04:13
*** fragatina has joined #tripleo04:26
*** limao has joined #tripleo04:31
*** fragatina has quit IRC04:32
*** shivrao has quit IRC04:50
*** shivrao has joined #tripleo04:53
*** dsariel has joined #tripleo04:54
*** dmacpher has joined #tripleo05:05
*** apetrich has quit IRC05:09
*** apetrich has joined #tripleo05:10
*** skramaja has joined #tripleo05:22
*** numans has joined #tripleo05:27
*** fragatina has joined #tripleo05:28
*** fragatina has quit IRC05:32
*** itamarl has joined #tripleo05:33
*** coolsvap has quit IRC05:42
*** coolsvap has joined #tripleo05:52
*** tremble has joined #tripleo05:57
*** oshvartz has joined #tripleo05:57
*** rcernin has quit IRC06:01
*** shivrao has quit IRC06:06
*** saneax_AFK is now known as saneax06:10
*** florianf has joined #tripleo06:19
*** coolsvap has quit IRC06:20
*** coolsvap has joined #tripleo06:21
*** coolsvap has quit IRC06:25
*** coolsvap has joined #tripleo06:25
*** hogepodge has quit IRC06:25
*** hogepodge has joined #tripleo06:27
*** fragatina has joined #tripleo06:28
*** masco has joined #tripleo06:30
*** rcernin has joined #tripleo06:32
*** fragatina has quit IRC06:33
ccamacho|afkGood morning!!!06:36
*** ccamacho|afk is now known as ccamacho06:36
mariosi'll have the same coffee ccamacho had please06:38
marioso/06:38
*** fzdarsky_ has quit IRC06:40
*** anshul has joined #tripleo06:40
ccamachomarios jeejje good morning man! :)06:40
*** dciabrin has joined #tripleo06:40
*** pcaruana has joined #tripleo06:46
*** devvesa has joined #tripleo06:59
*** tesseract- has joined #tripleo07:09
*** fragatina has joined #tripleo07:10
*** jpena|off is now known as jpena07:15
*** liverpooler has joined #tripleo07:15
*** jpich has joined #tripleo07:16
*** limao has quit IRC07:17
*** limao has joined #tripleo07:18
*** fragatina has quit IRC07:18
*** fragatina has joined #tripleo07:19
*** apetrich has quit IRC07:24
*** akuznetsov has joined #tripleo07:30
*** ifarkas has joined #tripleo07:32
*** apetrich has joined #tripleo07:38
*** dmacpher has quit IRC07:42
*** rasca has quit IRC07:46
*** rasca has joined #tripleo07:47
*** dmacpher has joined #tripleo07:50
*** chlong has quit IRC07:52
*** akuznetsov has quit IRC07:52
*** dmacpher has quit IRC07:55
*** rasca has quit IRC07:58
*** rasca has joined #tripleo08:00
*** chlong has joined #tripleo08:04
*** osp has quit IRC08:08
*** chem` has joined #tripleo08:10
*** shardy has joined #tripleo08:12
*** derekh has joined #tripleo08:15
*** akrivoka has joined #tripleo08:19
*** osp has joined #tripleo08:22
openstackgerritSteven Hardy proposed openstack/tripleo-docs: Composable services within roles Tutorial  https://review.openstack.org/31151208:26
openstackgerritSteven Hardy proposed openstack/tripleo-docs: Composable services within roles Tutorial  https://review.openstack.org/31151208:28
openstackgerritSteven Hardy proposed openstack/tripleo-docs: Composable services within roles Tutorial  https://review.openstack.org/31151208:30
*** lucas|afk is now known as lucasagomes08:31
openstackgerritSteven Hardy proposed openstack/tripleo-docs: Composable services within roles Tutorial  https://review.openstack.org/31151208:33
openstackgerritSteven Hardy proposed openstack/tripleo-docs: Composable services within roles Tutorial  https://review.openstack.org/31151208:36
shardyccamacho: 'morning - I just re-reviewed ^^ and made a few minor changes for remaining nits08:37
shardyI hope that's OK with you - I think we can land this now if you're happy with my adjustments08:38
ccamachoHey shardy! thanks a lot, was reading them. For me it is perfect :)08:38
shardyCool, it was very minor stuff but it seemed easier to just change them rather than make a bunch more comments :)08:38
*** oshvartz has quit IRC08:39
ccamachonice!08:39
*** yolanda has quit IRC08:41
*** yolanda has joined #tripleo08:42
*** ccamacho is now known as ccamacho|afk08:42
*** electrofelix has joined #tripleo08:44
*** oshvartz has joined #tripleo08:47
*** fzdarsky_ has joined #tripleo08:49
karthiksEmilienM, reg the review https://review.openstack.org/#/c/337264/1/puppet/services/nova-scheduler.yaml, if i set false as default, then i get the error "Value must be a comma-delimited list string: 'bool' object has no attribute 'split'"08:51
shardykarthiks: the type is defined as comma_delimited_list, so you'll have to pass a string, not a yaml boolean08:54
shardye.g "false"08:54
shardyalternatively you can pass a yaml list08:55
shardypossibly heat should cast that internally - IIRC it does for "string" paramter types, but evidently not for comma_delimited_list08:56
karthikswill check with "false" as default.08:56
karthiksshadower, ^^08:56
karthiksshardy, ^^08:56
shardyIt's weird that you'd have a "list of filters" parameter that defaults to "false" ?08:57
shardycan't nova/puppet-nova handle an empty list?08:57
karthikspuppet-nova expects a boolean when the list is not provided08:58
shardythat sounds like a puppet-nova bug to me, but I guess you've already discussed it with EmilienM08:59
karthiksyes EmilienM  suggested to set the default value to false and abandon the other review09:00
*** athomas has joined #tripleo09:00
shardykarthiks: Yeah, looking now, I have a different opinion so will comment on the review and we can chat with EmilienM later09:01
karthikssure shardy09:01
shardythe puppet abstractions should not expose weird stuff like nova expecting a boolean for a list of filters IMO09:01
shardymaybe there's a good reason why it needs to be like that tho09:02
shardycommented09:05
*** ccamacho|afk is now known as ccamacho09:06
*** fzdarsky_ has quit IRC09:07
karthiksok.  will wait for comments from EmilienM on this09:07
*** akuznetsov has joined #tripleo09:07
shardykarthiks: thanks, sorry for the lack of clear consensus09:09
*** akuznetsov has quit IRC09:11
karthiksshardy,  thanks for the comments :)09:11
*** fzdarsky has joined #tripleo09:13
openstackgerritMerged openstack/instack-undercloud: Update Gemfile to work in gate  https://review.openstack.org/33726909:14
openstackgerritMerged openstack/os-net-config: Add support for OVS patch ports  https://review.openstack.org/32953909:15
*** osp has quit IRC09:16
*** sshnaidm has quit IRC09:17
*** yolanda has quit IRC09:21
*** masco has left #tripleo09:22
*** yolanda has joined #tripleo09:22
*** sambetts|afk is now known as sambetts09:27
*** osp has joined #tripleo09:28
openstackgerritMerged openstack/tripleo-heat-templates: Remove depends_on: Networks from ControllerServiceChain  https://review.openstack.org/33615009:32
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: Customize "supported_pci_vendor_devs" for SR-IOV  https://review.openstack.org/32773509:34
openstackgerritMerged openstack/python-tripleoclient: Allow 'openstack baremetal configure boot' to guess the root device  https://review.openstack.org/30779909:34
*** yolanda has quit IRC09:43
*** yolanda has joined #tripleo09:45
*** jpich has quit IRC09:54
*** jpich has joined #tripleo09:54
openstackgerritMerged openstack/tripleo-heat-templates: Replace NodeConfigIdentifiers with DeployIdentifier  https://review.openstack.org/31561609:56
*** limao has quit IRC09:56
*** fzdarsky is now known as fzdarsky|lunch09:56
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Combine BootstrapNodeDeployment with AllNodesDeployment  https://review.openstack.org/33734609:59
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: WIP prototyping fully composable/custom roles  https://review.openstack.org/31567909:59
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Move AllNodesDeployments into jinja template loop  https://review.openstack.org/33726709:59
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Move AllNodesValidationDeployments into jinja template loop  https://review.openstack.org/33758709:59
*** fzdarsky|lunch has quit IRC10:01
*** akuznetsov has joined #tripleo10:08
openstackgerrityolanda.robla proposed openstack/tripleo-quickstart: Update overcloud dns servers  https://review.openstack.org/33758810:10
*** bootsha has joined #tripleo10:11
yolandatrown, when you are online ^10:11
*** akuznetsov has quit IRC10:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add Sahara services to ControllerServices list  https://review.openstack.org/33611910:12
*** sshnaidm has joined #tripleo10:22
*** bfournie has joined #tripleo10:38
*** bootsha has quit IRC10:44
openstackgerritChris Jones proposed openstack/tripleo-heat-templates: Increase RabbitMQ maximum file descriptors.  https://review.openstack.org/33760710:48
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Horizon service - tripleo-heat-templates  https://review.openstack.org/33549910:49
openstackgerritChris Jones proposed openstack/tripleo-heat-templates: Increase RabbitMQ maximum file descriptors.  https://review.openstack.org/33760710:49
*** rodrigods has quit IRC10:51
*** rodrigods has joined #tripleo10:51
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add Sahara services to ControllerServices list  https://review.openstack.org/33611910:52
*** yolanda has quit IRC10:52
*** yolanda has joined #tripleo10:56
*** apetrich has quit IRC10:58
*** dsariel has quit IRC11:03
*** apetrich has joined #tripleo11:03
*** akuznetsov has joined #tripleo11:09
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds action for template processing  https://review.openstack.org/33761511:10
hewbroccaderekh shardy you guys reckon we're ready for this CI rack move?11:12
hewbroccaNg Is it not the case that RabbitMQ max file descriptors are already parameterized somewhere?11:13
hewbroccaI may be out of my mind, but I thought we had already fought that battle once...11:13
derekhhewbrocca: shardy The patch to stop running CI on rh1 just got approved https://review.openstack.org/#/c/337573/11:13
hewbroccaWell, there it is then11:13
* hewbrocca hopes it works :)11:13
*** akuznetsov has quit IRC11:13
hewbroccaderekh nice work getting that ready BTW11:13
* derekh crosses fingers11:14
derekhhewbrocca: thanks11:14
Nghewbrocca: not as far as I know, but I could very well be wrong11:16
* hewbrocca can't remember11:18
hewbroccagfidente would know but he does not appear to be online11:18
hewbroccamarios ^^^ you know?11:18
marioshewbrocca: reading back11:18
marioshewbrocca: yeah pretty sure they are sec (and yes we've had to change them before)11:19
openstackgerritDerek Higgins proposed openstack/tripleo-quickstart: Switch image downloads to files hosted on rh2  https://review.openstack.org/33762011:19
derekhtrown: ^11:21
marioshewbrocca: found this... is this what you mean? https://review.openstack.org/#/c/332127/11:21
mariosbut not sure since is Ng review... /me reads back again11:21
sshnaidmderekh, hi, can you please review/merge tempest patch? https://review.openstack.org/#/c/331997/ thanks11:21
marioshewbrocca: so yes they are parameterised and ng is increasing the default11:22
sshnaidmderekh, as I see there no critical problems with CI? I saw problems with upgrades, filed a bug: https://bugs.launchpad.net/tripleo/+bug/1599048 , I'll see if I can solve this11:22
openstackLaunchpad bug 1599048 in tripleo "CI upgrades job fail because of memory shortage" [High,New]11:22
hewbroccaOh, well by all means then :)11:22
marioshewbrocca: we've had various 'limit isn't enough' issues, like number of open_files for galera  in the past. but I'm not sure what i'm looking for :)11:23
hewbroccaNo problem bumping the default up, I just wondered when I looked at the review if we had somehow missed allowing a parameter for that value11:23
*** weshay has joined #tripleo11:25
derekhsshnaidm: ok, in the next few hours the upgrades job will only exist as an experimental job on the tripleo-ci repository, we'll need to solve multi nics on rh1 if we want it to work though11:26
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds action for template processing  https://review.openstack.org/33761511:26
derekhsshnaidm: basically we are now down to a subset of the CI we run, only the new ovb-ha job11:27
sshnaidmderekh, you mean the only ovb-ha job runs and checks patch now? (on rh2)11:28
derekhsshnaidm: correct, rh1 is going away for a period of time http://lists.openstack.org/pipermail/openstack-dev/2016-July/098616.html11:29
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates: Add support for deploying RGW on controllers. (Composable)  https://review.openstack.org/28902711:33
*** yolanda has quit IRC11:35
slaglehey tripleo, please review this infra patch: https://review.openstack.org/#/c/326095/11:35
slaglethe tripleo-ci patch also needs some feedback, https://review.openstack.org/#/c/324777/, although that is less important, b/c once the job is there, we can run it against the ci patch before it merges11:36
*** dsariel has joined #tripleo11:46
*** lucasagomes is now known as lucas|hungry11:48
*** ccamacho is now known as ccamacho|lunch11:53
sshnaidmderekh, is there anything I can help with these movements?11:57
derekhsshnaidm: I'll set up some quota now to help reproduce any problems on rh2, once thats done you can see if you can reproduce jobs on it to debug any problems that come up12:01
sshnaidmderekh, cool12:01
*** jdob has joined #tripleo12:03
*** rhallisey has joined #tripleo12:06
*** akuznetsov has joined #tripleo12:10
*** yolanda has joined #tripleo12:11
*** chlong has quit IRC12:12
EmilienMkarthiks, shardy: looking again12:12
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [WIP] Update to use quintupleo  https://review.openstack.org/33630912:13
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Make ovb testenv more user friendly  https://review.openstack.org/33763712:13
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Mistral services  https://review.openstack.org/32343612:14
openstackgerritMerged openstack/instack-undercloud: Maintain quotes if present at end of secure_path  https://review.openstack.org/33646912:14
*** akuznetsov has quit IRC12:15
*** fzdarsky has joined #tripleo12:17
EmilienMshardy: what about transforming false into undef in https://github.com/openstack/puppet-nova/blob/master/manifests/scheduler/filter.pp#L7912:18
*** openstackgerrit has quit IRC12:19
*** openstackgerrit has joined #tripleo12:19
*** rhallisey has quit IRC12:19
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Create kernel profile  https://review.openstack.org/33735812:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add kernel service  https://review.openstack.org/33735912:20
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168212:21
*** _prad_ has joined #tripleo12:21
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Update ci report script to only include rh2 jobs  https://review.openstack.org/33764112:21
*** limao has joined #tripleo12:21
EmilienMshardy: can you +a https://review.openstack.org/#/c/337320/ please?12:21
*** jpena is now known as jpena|lunch12:21
* shardy back from lunch12:22
shardyEmilienM: yup transforming it to either undef or an empty list makes sense to me12:22
*** morazi has quit IRC12:23
shardyI don't see why "an array of filters" should default to a boolean12:23
EmilienMshardy: sure thing, I'm doing it now12:23
*** rhallisey has joined #tripleo12:23
EmilienMshardy: though it's the same result btw12:23
shardyEmilienM: thanks!  That should be more consistent with the heat interface :)12:23
EmilienMin the code we check the param and the if checks undef or false12:23
EmilienMhttps://github.com/openstack/puppet-nova/blob/master/manifests/scheduler/filter.pp#L10012:24
*** limao has quit IRC12:24
shardyEmilienM: but what if we pass an empty array via hiera?12:24
*** limao_ has joined #tripleo12:24
shardywill that have the same effect as undef?12:24
EmilienMno12:24
EmilienMI'll use os_service_default12:24
shardyEmilienM: that is the problem, we're defining a list parameter in heat, and a reasonable default for that is probably an empty list12:25
openstackgerritMerged openstack/tripleo-quickstart: Switch image downloads to files hosted on rh2  https://review.openstack.org/33762012:25
EmilienMshardy: let me try with an empty list12:25
EmilienMin puppet-nova12:25
saneaxEmilienM, when a list/array is expected, and that list is empty, will os_service_default translate to an empty line12:26
EmilienMsaneax: $::os_servie_default is a Puppet fact, that will do nothing for the parameter12:27
trownthanks derekh12:27
EmilienMso if you set it by default, Puppet won't try to set the parameter in the .conf12:27
*** dprince has joined #tripleo12:27
EmilienMof course you can override it to something and Puppet will set something12:27
EmilienMhttp://docs.openstack.org/developer/puppet-openstack-guide/coding-style.html#config-file-defaults-and-parameters12:28
*** limao_ has quit IRC12:28
*** fpan has joined #tripleo12:30
openstackgerritMerged openstack/tripleo-heat-templates: volume: deploy snmp using composable role  https://review.openstack.org/33732012:30
karthiksEmilienM, shardy Thanks for providing clarity.12:31
EmilienMkarthiks: I'm working on a patch now in puppet-nova12:32
EmilienMkarthiks: so you'll be able to give either undef or an empty list12:33
*** jdob has quit IRC12:33
saneaxtrown, I am repeatedly stuck at overcloud deploy with this error https://paste.fedoraproject.org/388026/14677208/12:34
karthikscan we give undef as default in THT , while a list is expected ?12:34
openstackgerritMerged openstack/tripleo-heat-templates: overcloud_volume: cleanup unused Puppet code  https://review.openstack.org/33732412:34
karthiksEmilienM, ^^12:34
saneaxtrown, idea is to deploy with master to test the composable roles locally12:34
saneaxEmilienM, I think I also hit the same problem as karthiks in review https://review.openstack.org/#/c/333465/12:35
trownsaneax: k, that looks like something is mismatched between puppet-tripleo and tripleo-heat-templates, could you provide how you deployed?12:35
saneaxEmilienM, the expectation is a list $physical_device_mappings   = [], if its empty, we should not right the config parameter12:36
saneaxif I give the default as os_service_default, it still rights a empty key in the config12:37
trownsaneax: I am guessing you are testing some composable role change when hitting that? ie, do you hit that issue without modifying the quickstart image?12:37
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates: Move nova constraints to tripleo-puppet.  https://review.openstack.org/33207112:37
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Move nova constraint, and refactor its declaration  https://review.openstack.org/33206912:38
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Fix retrieval of hostname fact based on network.  https://review.openstack.org/33273612:38
saneaxtrown, ./quickstart.sh -n --config config/general_config/devmode.yml --release master-tripleo --tags all -w $HOME/workspace/exenv $VIRTHOST12:38
*** _prad_ is now known as _\prad12:38
saneaxso, on the first go, there is nothing except the master12:38
*** _\prad has quit IRC12:38
*** chem` is now known as chem12:39
saneaxover the overcloud deploy is over, I intend to add our code and test it12:39
saneaxs/over/after/12:39
trownsaneax: ah ok, devmode is still pretty new, there is likely a bug then, I plan to demo that on thursday so I will take a look12:40
saneaxok trown12:40
saneaxI guess composable roles is not there in mitaka stable?12:41
saneaxis there any other way we can test composable roles?12:41
trownsaneax: it is not, but there is an RDO master image you could develop against12:41
trownsaneax: just don't use devmode config, and use --release master12:41
saneaxOK12:42
*** jdob has joined #tripleo12:42
saneaxtrying now, trown, thanks12:42
trownthe RDO image is from Friday, so it is pretty recent12:42
*** chlong has joined #tripleo12:43
*** pradk- has joined #tripleo12:43
*** jdob1 has joined #tripleo12:43
saneaxtrown, trying this - ./quickstart.sh -n  --release master --tags all -w $HOME/workspace/exenv $VIRTHOST12:43
trownsaneax: looks right12:44
*** rlandy has joined #tripleo12:46
*** chem` has joined #tripleo12:49
*** lucas|hungry is now known as lucasagomes12:50
*** chem has quit IRC12:53
EmilienMkarthiks, shardy: I didn't write tests but is it what you're looking for ? https://review.openstack.org/33765312:54
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Add environment file to enable DVR  https://review.openstack.org/33214712:55
karthiksyes EmilienM12:58
saneaxEmilienM, I had used empty() function earlier, and it was flagged down - https://review.openstack.org/#/c/333465/2/manifests/agents/ml2/sriov.pp12:58
EmilienMI'll review your patch12:59
EmilienMwe need to use empty to check if it's not an empty array12:59
openstackgerritMerged openstack/puppet-pacemaker: Remove 12.04 from metadata  https://review.openstack.org/33576212:59
*** bfournie has quit IRC12:59
EmilienMsaneax: done13:00
yolandahi trown, thanks for the +2. I also saw that google nameservers in tripleo-heat-templates and elements. Do you think it makes sense to update as well?13:00
*** noslzzp has joined #tripleo13:01
*** bfournie has joined #tripleo13:01
*** jcoufal has joined #tripleo13:02
saneaxthanks EmilienM13:02
*** bfournie has quit IRC13:03
trownyolanda: not sure. I wonder if the default of routing DNS through the undercloud makes less sense in the non-virt case13:04
trownyolanda: for the virt case it makes total sense13:04
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: neutron: remove tenant MTU configuration options  https://review.openstack.org/32592613:05
*** julim has joined #tripleo13:05
*** yolanda has quit IRC13:05
*** jayg|g0n3 is now known as jayg13:06
*** yolanda has joined #tripleo13:07
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Remove tripleo-jobs.py  https://review.openstack.org/33765713:09
derekhAll jobs have now moved off of RH1, can we merge this so that the ci reporting page is uptodate, https://review.openstack.org/#/c/337641/13:10
*** noslzzp has quit IRC13:10
EmilienMderekh: +213:11
hewbroccait's a whole new world of OVB13:11
*** noslzzp has joined #tripleo13:11
* hewbrocca marvels13:11
openstackgerritMerged openstack-infra/tripleo-ci: Update ci report script to only include rh2 jobs  https://review.openstack.org/33764113:11
shardytrown: for non-virt I don't think routing anything via the undercloud makes sense, or it becomes a single point of failure?13:12
shardydepending on the undercloud for developer virt setups seems OK tho13:13
*** morazi has joined #tripleo13:13
*** ccamacho|lunch is now known as ccamacho13:13
trownshardy: k, that is my thought as well, yolanda ^13:14
*** jdob has quit IRC13:17
EmilienMcan we review https://review.openstack.org/#/c/337200/ please, doing some cleanup for composable services13:19
openstackgerritMerged openstack/tripleo-quickstart: Fix release argument to quickstart.sh  https://review.openstack.org/33725313:20
yolandatrown, shardy , so it's assumed that there is external access on baremetal setup ?13:27
trownyolanda: or that the deployer puts their internal DNS in13:27
trownyolanda: which we cant have a reasonable default for13:28
*** chem` has quit IRC13:28
*** chem` has joined #tripleo13:28
trownyolanda: I think in a production env, that is something that is almost always replaced with internal DNS13:28
yolandatrown, so in that case, it may be a responsability of the installer, to override that google defaults?13:30
trownyolanda: right via an extra environment file13:32
yolandak, understood13:33
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Skip internal undercloud post install tasks when the external role is call  https://review.openstack.org/33657513:33
*** jpena|lunch is now known as jpena13:34
*** links has joined #tripleo13:38
*** lblanchard has joined #tripleo13:39
*** snecklifter has joined #tripleo13:39
*** Goneri has joined #tripleo13:40
snecklifterHi tripleo folks, hopefully a simple question, I need to change cinder to use keystone v313:41
snecklifterCurrently using Mitaka release and auth_uri ends with /v2.013:42
snecklifterAm using HA/pacemaker13:42
trownsaneax: fyi, I ran `bash quickstart.sh --no-clone --config config/general_config/devmode.yml -t all -R master-tripleo --working-dir $WORKSPACE $VIRTHOST` with a fresh checkout of tripleo-quickstart and it completed successfully13:42
trownpanda++ ^13:42
snecklifterI can't see where (if anywhere) to change in t-h-t13:43
*** ayoung has joined #tripleo13:43
*** links has quit IRC13:45
saneaxok trown I will checkout afresh and see13:45
saneaxmy checkout is from 07/0113:45
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Add error handler to FileReader  https://review.openstack.org/33766813:46
trownsaneax: ok, definitely merged one fix this morning because image location changed13:46
openstackgerritBrad P. Crochet proposed openstack/tripleo-docs: Switch docs to use tripleo-build-images  https://review.openstack.org/33766913:46
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI  https://review.openstack.org/33631213:47
*** oshvartz has quit IRC13:47
*** jtomasek_ has joined #tripleo13:48
*** r-mibu has quit IRC13:48
*** r-mibu has joined #tripleo13:49
EmilienMpradk: I'm working on ceilo patches now13:49
saneaxthanks trown will check and revert13:50
ccamachoHey guys! any available for checking https://review.openstack.org/#/c/336904/  ? Simple patch for adding my blog to plated in tripleo.org13:51
openstackgerritMerged openstack/tripleo-quickstart: quickstart.sh fails due to missing redhat-rpm-config  https://review.openstack.org/33691813:51
ccamachos/plated/planet/13:51
pradkcan i get a +A on this please https://review.openstack.org/#/c/329692/13:52
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Deprecate 'overcloud image build' command  https://review.openstack.org/33767613:54
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI  https://review.openstack.org/33631213:55
openstackgerritMerged openstack-infra/tripleo-ci: Add Carlos Camacho to TripleO blogs feed  https://review.openstack.org/33690413:55
*** links has joined #tripleo13:55
EmilienMweekly meeting in 4 min13:57
pandaEmilienM: which team ?13:58
pandaEmilienM: sorry, nevermind13:58
*** links has quit IRC13:59
EmilienMpanda: https://wiki.openstack.org/wiki/Meetings/TripleO13:59
trown53336714:02
trown97086314:02
beaglesyubikey ftw14:02
slagletokens for all!14:02
*** fultonj has joined #tripleo14:02
openstackgerritRicardo Carrillo Cruz proposed openstack/diskimage-builder: Revert "Pre-install pip/virtualenv packages"  https://review.openstack.org/33767714:03
openstackgerritMerged openstack/tripleo-heat-templates: Use create-legacy-resource-types during gnocchi-upgrade  https://review.openstack.org/32969214:05
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Configure ceilometer to default mongodb backend  https://review.openstack.org/33669914:09
openstackgerritRicardo Carrillo Cruz proposed openstack/diskimage-builder: Revert "Pre-install pip/virtualenv packages"  https://review.openstack.org/33768614:12
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349814:13
trown:)14:14
ccamachohey thrash, I'm testing your composable zaqar submissions but I think they are not synced, may I rebase them?14:19
thrashccamacho: go for it.14:20
ccamachothrash thanks!14:20
thrashccamacho: I rebased the tht one this morning14:20
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Add zaqar profiles  https://review.openstack.org/33168114:21
ccamachothrash yeahp, the puppet-tripleo was quite old14:21
thrashccamacho: ack14:22
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: Add missing i18n marker on some help strings  https://review.openstack.org/33769314:22
*** limao has joined #tripleo14:24
hewbroccayou're not really international until your yubikey spits czech characters14:25
hewbroccajust saying14:25
*** lucasagomes has quit IRC14:25
openstackgerritMichele Baldessari proposed openstack/tripleo-docs: Upgrade documentation  https://review.openstack.org/30898514:27
*** lucasagomes has joined #tripleo14:31
*** noslzzp has quit IRC14:35
*** myoung has quit IRC14:37
*** myoung has joined #tripleo14:37
*** mgould has quit IRC14:38
*** mgould has joined #tripleo14:38
*** noslzzp has joined #tripleo14:40
*** itamarl has quit IRC14:40
openstackgerritBrent Eagles proposed openstack-infra/tripleo-ci: Exit with non-zero status on create and update errors  https://review.openstack.org/31935214:41
*** jtomasek_ has quit IRC14:41
openstackgerritMerged openstack/instack-undercloud: Update Gemfile to work in gate  https://review.openstack.org/33613014:42
*** chem` is now known as chem14:53
*** akshai has joined #tripleo14:53
*** apetrich has quit IRC14:54
*** dprince has quit IRC14:57
*** dprince has joined #tripleo14:58
sshnaidmdprince, could you please review/merge the tempest patch in your time? https://review.openstack.org/#/c/331997/  it shouldn't affect anything except of non-working tempest now15:07
*** apetrich has joined #tripleo15:08
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Use create-legacy-resource-types during gnocchi-upgrade  https://review.openstack.org/33772015:11
*** skramaja has quit IRC15:15
*** Guest73915 has quit IRC15:15
*** wfoster has quit IRC15:15
*** anshul has quit IRC15:15
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Deprecate 'overcloud image build' command  https://review.openstack.org/33767615:23
*** yolanda has quit IRC15:28
shardymarios: commented on https://review.openstack.org/#/c/336472/ - it'd be good if we can get agreement so that can land15:28
shardyI agree with gfidente and will be +2 if the parameter names are revised15:29
*** saneax is now known as saneax_AFK15:30
mariosack thanks shardy gfidente i will revisit tomorrow morning appreciated15:30
*** yolanda has joined #tripleo15:30
*** osp has quit IRC15:30
shardymarios: thanks, we also need to sort the nits re https://review.openstack.org/#/c/332889/ so it can land for n215:32
*** openstackgerrit has quit IRC15:33
*** openstackgerrit has joined #tripleo15:33
*** dprince has quit IRC15:35
*** dprince has joined #tripleo15:36
mariosshardy: ack15:36
mariosshardy: as i said, unfortunately i've been pulled into some priority (to) mitaka upgrades work but that one should be easy to move along with revisit tomorrow too15:37
mariossocial: any updates on the packaging nit there (https://review.openstack.org/#/c/332889/ )15:38
*** sshnaidm is now known as sshnaidm|afk15:38
*** chem has quit IRC15:39
shardymarios: Yeah, understood, I'm just trying to burn down the long list of stuff for n-2 ;)15:39
shardyI'll have to defer everything that doesn't land very soon15:39
shardywhich is worrying given the amount of incomplete stuff :(15:39
mariosshardy: yeah thanks appreciate the reviews/nudges15:40
*** chem has joined #tripleo15:41
*** rook- has joined #tripleo15:41
openstackgerritMerged openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/33625315:42
*** sshnaidm|afk has quit IRC15:43
*** limao has quit IRC15:43
*** osp has joined #tripleo15:45
yolandatrown, suddenly i'm getting that error on oooq with undercloud: http://paste.openstack.org/show/526027/15:46
trownyolanda: hmm is that during introspection?15:48
yolandado you know what can be causing it? i was wondering about disk space, but i have plenty of it15:48
trownnot seen that15:48
yolandaon Prepare undercloud for deploy15:48
trownya introspection runs in there15:48
yolandaon undercloud-post-install.sh15:48
*** tremble has quit IRC15:49
trownyolanda: are you using tripleo-ci image (devmode)?15:49
derekhyolanda: trown just a hunch, is the swift proxy services being killed by the OOM manager?15:49
yolandai can't see any logs on /var/log/swift15:49
trownyolanda: you could look in the journal15:50
derekhyolanda:  sudo journalctl | grep -i memory15:50
shardyThis change to add a timeout to o-r-c needs another reviewer : https://review.openstack.org/#/c/334254/15:51
yolandaderekh, nothing related. Just some warnings in keystone15:52
derekhyolanda: ok15:52
yolandaalso i did a ps from swift processes and they are running15:53
EmilienMshardy: also https://review.openstack.org/#/c/333641/15:53
trownyolanda: what about glance? it seems the error is from glance_store15:53
trownyolanda: workaround could be disabling introspection, though I am curious why that is happening15:54
yolandatrown, in glance i just see that error i pasted you15:54
trownyolanda: could set https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/ha.yml#L30 via a "--extra-vars introspect=false"15:54
shardyEmilienM: Ah, yup, thanks15:55
trownyolanda: it is set to true on minimal config for CI purposes, but it is totally useless in a virt environment15:55
*** yolanda has quit IRC15:55
derekh[root@undercloud-undercloud-7be7u2y6y5cz ~]# uptime15:56
derekh 15:25:40 up 851 days, 18:47,  1 user,  load average: 0.12, 0.29, 0.4815:56
derekh[root@undercloud-undercloud-7be7u2y6y5cz ~]# shutdown  # <-- bye bye rh115:56
trownwow15:56
trownso close to 3 years15:56
trownok maybe not, but well over 215:56
*** yolanda has joined #tripleo15:56
yolandatrown, ok, going to try15:57
openstackgerritMerged openstack/os-refresh-config: Functional test which executes os-refresh-config  https://review.openstack.org/33364115:58
openstackgerritMerged openstack/os-refresh-config: Implement a --timeout for killing stalled scripts  https://review.openstack.org/33425415:58
shardymarios: there are 4 n-2 targetted undercloud upgrade related bugs all referencing the same fix15:59
*** dsneddon has joined #tripleo16:00
shardymarios: can we close three of them as duplicates and reword the title of the remaining one to reflect that opm was the problem?16:00
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI  https://review.openstack.org/33631216:00
trownyolanda: could check the log from the post install too to make sure it is actually introspection that is failing (though I think that is all that is using swift): /home/stack/undercloud_post_install.log16:00
*** sambetts is now known as sambetts|afk16:01
mariosshardy: no objections will you or should i go ahead?16:01
*** bfournie has joined #tripleo16:01
yolandatrown, i just trashed the environment16:02
shardymarios: if you can that would be good, as you'll probably do a more accurate description being the person who raised them :)16:02
shardythanks!16:02
mariosshardy: ack16:02
trownyolanda: k, no worries, I am 90% sure the only thing that touches swift in post install is introspection16:02
*** trown is now known as trown|lunch16:03
*** strigazi has joined #tripleo16:03
strigaziguys you didn't end your meeting16:04
shardystrigazi: really, I certainly tried to, sec16:04
derekhstrigazi: its the bgpvpn meeting that is running16:04
*** osp has quit IRC16:05
strigaziah, ok16:05
shardy14:52:34 <shardy> #endmeeting16:05
shardyhttp://eavesdrop.openstack.org/meetings/tripleo/2016/tripleo.2016-07-05-14.00.log.txt16:05
*** strigazi has left #tripleo16:08
*** Tristitia has quit IRC16:10
EmilienMFYI infra is having troubles with RAX network https://review.openstack.org/#/c/337513/16:10
shardyYeah I saw that in some failed CI results earlier16:11
*** akshai has quit IRC16:11
*** ifarkas has quit IRC16:14
*** osp has joined #tripleo16:18
*** shivrao has joined #tripleo16:18
openstackgerritSteven Hardy proposed openstack/puppet-tripleo: Fix sahara pacemaker profile  https://review.openstack.org/33775216:19
derekhdprince: slagle bnemec rh1 is now down and ready to be shipped, the datacenter side are looking for contacts should questions arise when they arrive in the new data center, probably tomorrow or thursday16:20
derekhdprince: slagle bnemec is it ok to add ye to the email thread as extra contacts should I not be around16:20
thrashshardy: I already fixed that in https://review.openstack.org/#/c/327721/16:20
bnemecderekh: Yeah16:20
mariosshardy: done https://bugs.launchpad.net/tripleo/+bug/159373616:21
openstackLaunchpad bug 1593736 in tripleo "stable/mitaka to newton undercloud upgrade fails with various errors related to o-p-m packaging" [Medium,In progress] - Assigned to Marios Andreou (marios-b)16:21
dprincederekh: ack, fine w/ me16:21
bnemecderekh: BTW, it looked like there was an issue with jobs not getting testenvs on Friday in rh2.  Did that go away on its own or did you have to do something to fix it?16:22
thrashshardy: but since bug.. :P16:23
derekhbnemec: I noticed it too, its looked like the interface-attach command was failing, but it then started working (not sure why)16:23
thrashshardy: I'll link to the bug.16:23
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add Sahara services to ControllerServices list  https://review.openstack.org/33611916:24
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: need additional clean up for oooq_pool  https://review.openstack.org/33777216:24
shardythrash: thanks, I hadn't spotted that16:24
derekhbnemec: I've manually added a patch to the testenv to get some extra debug info should it happen again, I'll push the patch up in a minute16:24
shardyI added a Depends-On to https://review.openstack.org/336119 so we can test it16:24
bnemecderekh: Okay, it wasn't clear to me what was going on and I was afraid to poke at anything too much right before I left on a 3 day weekend. :-)16:24
openstackgerritBrad P. Crochet proposed openstack/puppet-tripleo: Split Sahara pacemaker roles into separate services  https://review.openstack.org/32772116:25
derekhbnemec: yup, makes sense16:25
*** jpich has quit IRC16:26
thrashshardy: +116:26
thrashshardy: I will run a test with your patch and mine.16:26
*** yolanda has quit IRC16:28
shardythrash: thanks, sounds good16:28
thrashsoon as I fix my undercloud. :/16:28
*** sshnaidm|afk has joined #tripleo16:28
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Log stderr when creating and destroying envs  https://review.openstack.org/33777516:28
*** dsariel has quit IRC16:29
derekhbnemec: ^^16:29
derekhbnemec: the output of the create/destroy scripts is in /var/log/testenv-worker.log16:29
derekhbnemec: but it didn't have stdout, so I couldn't see what the error was16:29
bnemecderekh: Cool, thanks.  Should be very helpful.16:30
derekhbnemec: with that patch we seem to be getting stderr for the create script, but not the destroy script, not sure why16:30
*** athomas has quit IRC16:30
bnemecAll I was seeing Friday was ERROR - Created subnet.16:30
bnemecWhich is...not an error. :-)16:30
*** yolanda has joined #tripleo16:31
*** shivrao_ has joined #tripleo16:31
derekhbnemec: also there is a cron job on the te-broker that update all the scripts every hour, I've disabled it so I wouldn't stomp over my local tmp patch16:31
*** rcernin has quit IRC16:31
*** tesseract- has quit IRC16:33
bnemecderekh: Okay.  Out of curiosity, how do you get on the te-broker vm?  I ended up having to create another vm with a password set and uploaded my ssh key to it so I could ssh to the private address of te-broker.16:33
*** pcaruana has quit IRC16:33
bnemecI think key forwarding wasn't working because I had to use ip netns to ssh to the private interface.16:33
*** hogepodge has quit IRC16:34
*** shivrao has quit IRC16:34
*** shivrao_ is now known as shivrao16:34
derekhbnemec: what I normally do is ssh to a VM with a FIP the from there the ssh key forwarding works16:39
*** shivrao has quit IRC16:39
derekhbnemec: but I have a VM with a  FIP hand because I was trying to reproduce some things on RH216:39
derekhbnemec: now the mirror-server has a FIP so you could use that as a jump hosts16:39
bnemecderekh: Ah, yep, makes sense.16:40
derekhbnemec: 8.43.87.24116:40
derekhbnemec: or we could just create a small jump host on as the admin user specifically for things like this16:41
*** hogepodge has joined #tripleo16:41
*** chem has quit IRC16:41
*** chem has joined #tripleo16:41
bnemecderekh: Yeah, no sense eating up another floating ip when we have an instance we can use already though.16:42
derekhbnemec: ok16:42
bnemecIf it hadn't been Friday I probably would have figured that out myself. :-)16:42
derekh;-)16:43
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Remove config_identifier from all_nodes extraconfig examples  https://review.openstack.org/33778416:46
*** lucasagomes is now known as lucas|afk16:48
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Convert AllNodesExtraConfig to OS::Heat::None  https://review.openstack.org/33778716:49
*** hogepodge has quit IRC16:50
*** jpena is now known as jpena|off16:51
*** tbonds has joined #tripleo16:54
*** tbonds has quit IRC16:55
*** tbonds has joined #tripleo16:56
*** masco has joined #tripleo16:56
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Horizon service - tripleo-heat-templates  https://review.openstack.org/33549916:59
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Horizon service - tripleo-heat-templates  https://review.openstack.org/33549917:00
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Composable Horizon service - puppet-tripleo  https://review.openstack.org/33550617:01
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Log stderr when creating and destroying envs  https://review.openstack.org/33777517:01
openstackgerritGael Chamoulaud proposed openstack/tripleo-heat-templates: Ensure the Heat Domain creation before starting heat-engine service  https://review.openstack.org/33165217:01
*** ayoung has quit IRC17:02
openstackgerritGael Chamoulaud proposed openstack/tripleo-heat-templates: Ensure the Heat Domain creation before starting heat-engine service  https://review.openstack.org/33165217:02
*** hogepodge has joined #tripleo17:02
*** masco has quit IRC17:04
yolandatrown, oooq failed the same with introspect=false17:05
*** yolanda has quit IRC17:09
*** derekh has quit IRC17:10
*** devvesa has quit IRC17:11
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: need additional clean up for oooq_pool  https://review.openstack.org/33777217:15
*** rcernin has joined #tripleo17:16
*** hogepodge has quit IRC17:17
*** bnemec has quit IRC17:19
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: Make virt pool creation more robust and less susceptible to failures  https://review.openstack.org/33777217:21
EmilienMshardy: about https://etherpad.openstack.org/p/tripleo-ci-mentoring17:23
EmilienMcan I volunteer to previous dates?17:23
EmilienMit seems like you started from 18th17:23
*** hogepodge has joined #tripleo17:23
shardyEmilienM: sure, but I'm assuming everyone will be busy next week as it's a release week17:24
EmilienMok17:24
EmilienMI'll put my name anyway17:24
shardykk, thanks :)17:24
EmilienMshardy: even if I'm busy, I'll find some time to help17:25
openstackgerritSteven Hardy proposed openstack/puppet-tripleo: Add swift ringbuilder profile  https://review.openstack.org/33780317:25
*** ccamacho has quit IRC17:26
*** bnemec has joined #tripleo17:27
weshaysshnaidm|afk, panda fyi https://etherpad.openstack.org/p/tripleo-ci-mentoring17:27
*** trown|lunch is now known as trown17:27
openstackgerritDan Sneddon proposed openstack/os-net-config: Add support for Infiniband interfaces  https://review.openstack.org/30503917:27
*** hogepodge has quit IRC17:28
*** mgould is now known as mgould|afk17:30
openstackgerritBen Nemec proposed openstack/instack-undercloud: Generate TLS endpoints if autogenerate cert is set  https://review.openstack.org/33312117:30
pandaweshay: thanks, looking17:30
*** shardy has quit IRC17:31
*** electrofelix has quit IRC17:32
*** fragatina has quit IRC17:34
*** rajinir has joined #tripleo17:36
*** hogepodge has joined #tripleo17:36
*** shivrao has joined #tripleo17:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349817:46
openstackgerritMerged openstack/tripleo-heat-templates: pacemaker: don't override Service resource for Nova & Neutron  https://review.openstack.org/33720017:48
EmilienMpradk: rebasing 31841317:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Gnocchi composable roles  https://review.openstack.org/31841317:53
*** hogepodge has quit IRC17:55
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349817:55
*** noslzzp has quit IRC17:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove pacemaker/neutron-ovs-agent service  https://review.openstack.org/33726017:57
*** noslzzp has joined #tripleo17:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: compute: deploy composable neutron service  https://review.openstack.org/33123417:58
*** noslzzp has quit IRC18:00
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo: Add gnocchi profiles  https://review.openstack.org/31552718:11
*** chem has quit IRC18:15
-openstackstatus- NOTICE: Job instability resulting from a block storage connectivity error on mirror.iad.rax.openstack.org has been corrected; jobs running in rax-iad should be more reliable again.18:15
*** ayoung has joined #tripleo18:16
*** chem has joined #tripleo18:17
EmilienMbnemec, slagle: can you look https://review.openstack.org/#/c/330785/ and give feedback please?18:17
EmilienMI need to know before continuing my work18:18
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config: Updated from global requirements  https://review.openstack.org/33233418:18
slagleEmilienM: i'll look18:20
EmilienMthx!18:20
slagleEmilienM: is the duplication of the integer in the rule label intentional?18:24
slagle10018:24
EmilienMslagle: yes, because we already set the rules in THT right now so I wouldn't use the same id18:25
EmilienMif we want/need, we can change the ID later once we'll clean THT18:25
*** hogepodge has joined #tripleo18:26
slagleEmilienM: i guess i might like to see it done as a migration18:27
slaglemove the 111 rule for keystone out of the hieradata in tht18:27
slaglecreate them via puppet-tripleo instead18:27
slaglebut, it doesnt matter much i suppose18:27
slaglewe wont know these new rules are working if we also dont remove them from tht18:28
slaglethat being said, none of it is covered by CI, so we dont really know either way right now18:28
EmilienMright, there is 2 approaches here, 1) create rules in puppet-tripleo and cleanup THT later 2) add rule by rule in puppet-tripleo and cleanup THT, using Depends-On18:29
EmilienMslagle: it is covered by CI18:29
EmilienMslagle: firewall is enabled by default now, bnemec enabled it a few days ago18:29
slagleoh, that's right18:30
EmilienMeither method works for me18:31
EmilienMI just want to know your feedback before I continue with 1)18:31
slagleyea, me as well :)18:31
slagleEmilienM: overall, i like the idea of keeping the rules alongside the profiles18:31
slaglemuch more reusable18:31
EmilienMexactly18:31
*** oneswig has joined #tripleo18:35
openstackgerritBrent Eagles proposed openstack-infra/tripleo-ci: Exit with non-zero status on create and update errors  https://review.openstack.org/31935218:47
*** hogepodge has quit IRC18:53
*** dtrainor has quit IRC18:56
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: deploy composable firewall rules for Keystone & HAproxy  https://review.openstack.org/33078518:56
EmilienMslagle: see https://review.openstack.org/#/c/330785/7/manifests/haproxy/endpoint.pp18:56
*** dtrainor has joined #tripleo18:56
EmilienMslagle: so we don't have to write all rules when a service is enabled for haproxy18:56
EmilienMslagle: it will do it beside other things like haproxy binds, etc18:57
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: deploy composable firewall rules for Keystone & HAproxy  https://review.openstack.org/33078518:57
EmilienMfixing lint18:57
*** hogepodge has joined #tripleo19:00
*** florianf has quit IRC19:09
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Move THT clone to undercloud post install  https://review.openstack.org/33782419:10
trownpanda: mind checking out ^, I know we can do the same thing via dlrn, but for t-h-t dlrn is a bit more than we need19:11
openstackgerritMerged openstack/diskimage-builder: Add new posix element.  https://review.openstack.org/29474819:13
*** oneswig has quit IRC19:14
EmilienMslagle: your project-config patch landed, we should have the experimental job in place soon if not now19:18
EmilienMslagle: I think you'll need to rebase https://review.openstack.org/#/c/222772/ or recheck, CI was broken that day19:18
slagleyea; i saw19:18
pandatrown: looking19:19
jeckersb`any quick way to increase the timeout for db migrations?19:19
*** jeckersb` is now known as jeckersb19:19
jeckersbi keep bumping against the timeout for nova/neutron when trying to install the undercloud via quickstart19:19
*** julim has quit IRC19:19
trownjeckersb: what is timing out? I have not seen that19:20
jeckersbError: /Stage[main]/Nova::Db::Sync/Exec[nova-db-sync]: Failed to call refresh: Command exceeded timeout19:21
jeckersbas well as...19:21
jeckersbError: /Stage[main]/Neutron::Db::Sync/Exec[neutron-db-sync]: Failed to call refresh: Command exceeded timeout19:21
trownjeckersb: hmm, and if you manually try to run the db syncs they succeed?19:22
*** chem` has joined #tripleo19:22
trownI am wondering if they are not actually just failing19:22
slagleEmilienM: fyi, for now i have that tripleo-ci patch not using pacemaker19:23
slagleEmilienM: i'm testing with your patches, but i've hit another issue :/19:23
EmilienMslagle: ok, it's a good first step19:23
EmilienMslagle: can you paste me logs?19:23
slaglelooks like there is an ordering problem between nova-compute and nova-conductor19:23
EmilienMah19:23
slaglenova-compute won't start w/o nova-conductor19:23
EmilienMwe need compute after conductor19:23
EmilienMright19:23
slagleso the whole puppet run just hangs19:23
EmilienMok let me fix it19:23
EmilienMslagle: I like you testing this scenario, thx again19:24
slaglenp, thx for all the fixes19:24
jeckersbtrown: nova seems to succeed...19:24
* jeckersb tries neutron19:24
*** chem has quit IRC19:25
jeckersbyeah19:25
jeckersbboth return 0 with minimal output very fast19:25
jeckersbi am assuming that means they eventually succeeded the first time19:25
trownick... EmilienM do you know off the top of your head if there is anything exposed from puppet to control dbsync timeout? (dont go looking if not I can figure it out)19:25
jeckersbbut puppet didn't wait around long enough19:25
jeckersbtrown: i took a look and i don't see anything obvious19:26
EmilienMtrown: there is not19:26
EmilienMtrown: what is your issue?19:26
jeckersbunless there's some global Exec { timeout=>xx } somewhere19:26
*** hogepodge has quit IRC19:27
trownEmilienM: no worries, I will troubleshoot with jeckersb, you have a lot going on :)19:27
EmilienMusually, if dbsync fails, it's due to 2 reasons :19:27
trownjeckersb: what quickstart invocation are you using on what hardware?19:27
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Spec for changing the block device handling: local loop  https://review.openstack.org/33783319:27
EmilienM1) *.conf file does not contain database_connection parameter19:27
EmilienM2) or mysql is not ready19:28
EmilienMdepending of your trace19:28
EmilienMyou can easily find why in the trace (access denied VS service not available)19:28
jeckersbtrown: just doing ./quickstart.sh $VIRTHOST, pointing it at my mini-dell19:28
trownwow... that should totally not fail...19:28
trownjeckersb: your mini dell has 32G RAM ya?19:29
jeckersbthings that should never fail will always fail when i touch it19:29
jeckersbit is my curse19:29
jeckersbtrown: yep19:29
*** hogepodge has joined #tripleo19:29
trownjeckersb: ya I say that, because that is what I run against multiple times a day19:29
EmilienMslagle: I see another potential bug when pacemaker will be enabled19:29
jeckersbit knows i am sitting nearby so it is misbehaving19:29
EmilienMslagle: nova conductor is started at step 5 (with pacemaker) but nova compute at step 419:29
trownhmmm19:29
EmilienMI need to change that19:30
trownjeckersb: and you dont have any other VMs on that virthost?19:31
jeckersbtrown: nope19:31
jeckersbtrown: let me try to just reboot the whole thing19:32
trownjeckersb: the only thing that would make sense is resource contention19:32
*** coolsvap has quit IRC19:32
jeckersbmaybe i have done something dumb to it along the way19:32
jeckersbecho suck > /proc/sys/performance19:32
* jeckersb shrugs19:32
trownjeckersb: ya, you could also make sure you have master of quickstart, in the off chance you are hitting some already fixed bug... but I dont recall ever having things fail there19:33
jeckersbtrown: i'm already using master19:33
jeckersbbleeding edge or death!19:33
EmilienMslagle: ok I found more things, /me workign on it19:33
jeckersb(or usually both at the same time)19:34
trownya, bleeding edges do often lead to death19:34
trownor at least MRSA19:34
jeckersbhaha19:37
jeckersbtrown: oh also aside it always fails for me with...19:42
jeckersbFAILED! => {"changed": true, "cmd": ["virsh", "pool-define", "/home/stack/.quickstart/volume_pool.xml"], "delta": "0:00:00.250021", "end": "2016-07-05 15:39:33.930092", "failed": true, "rc": 1, "start": "2016-07-05 15:39:33.680071", "stderr": "error: Failed to define pool from /home/stack/.quickstart/volume_pool.xml\nerror: operation failed: pool 'oooq_pool' already exists with uuid19:42
jeckersb6d1f125b-b222-4499-a270-194ca92c2a49", "stdout": "", "stdout_lines": [], "warnings": []}19:42
jeckersbi've just been commenting that task out and it seems to work fine without it?19:42
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: make sure we start nova-compute after nova-conductor  https://review.openstack.org/33783919:42
EmilienMslagle: ^ can you test it?19:42
*** hogepodge has quit IRC19:43
slagleyep i will19:43
trownjeckersb: ya, I think https://review.openstack.org/#/c/337772/ will resolve that19:43
* jeckersb tests19:44
*** hogepodge has joined #tripleo19:44
trownjeckersb: testing that out now, and I will merge it, because lars is on PTO for another week19:44
*** julim has joined #tripleo19:45
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable midonet for neutron  https://review.openstack.org/33338719:47
trownweshay: you put the note that lars needs to review that before we merge it ^ any reason other than he knows that libvirt stuff better than any of us?19:48
trownweshay: he is on PTO for another week, so I think I would like to just fix it and worry about fixing it better later if needed19:48
* jeckersb puts on his lars mask19:49
jeckersb"approved!"19:49
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Move THT clone to undercloud post install  https://review.openstack.org/33782419:49
*** dprince has quit IRC19:50
jeckersbtrown: in other news, my db syncs didn't time out this time19:51
jeckersbso, progress!19:51
trownwell we've got that going for us :)19:51
jeckersbi saw it timeout on introspection once too19:51
jeckersblet's see if that works...19:52
jeckersbyep worked19:54
* jeckersb cheers19:54
* jeckersb celebrates with a la croix19:54
trownballer19:55
*** lblanchard has quit IRC19:55
openstackgerritRicardo Carrillo Cruz proposed openstack/diskimage-builder: Revert "Pre-install pip/virtualenv packages"  https://review.openstack.org/33768619:58
EmilienMcan someone review https://review.openstack.org/#/c/337359/ and its dependency?20:11
EmilienMslagle: maybe ^ since we did sysctl & kmod together iirc20:11
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Move THT clone to undercloud post install  https://review.openstack.org/33782420:12
openstackgerritBen Nemec proposed openstack/diskimage-builder: Revert "Pre-install pip/virtualenv packages"  https://review.openstack.org/33768620:13
weshaytrown, what ever you think20:16
trownweshay: cool, thanks for fixing that, it was annoying me quite a bit today :)20:16
*** jcoufal_ has joined #tripleo20:17
weshaynp20:17
*** jcoufal_ has quit IRC20:17
*** penick has joined #tripleo20:18
*** jcoufal has quit IRC20:20
EmilienMpradk: see -1 on https://review.openstack.org/#/c/337720/20:21
EmilienMpradk: could it be in packaging20:22
pradkEmilienM, weird this worked fine on master, hmm i'll take a look20:22
EmilienM?20:22
pradkEmilienM, thats what i'm thinking .. but i'll know more once i see what the traceback is20:23
openstackgerritMerged openstack/tripleo-quickstart: Make virt pool creation more robust and less susceptible to failures  https://review.openstack.org/33777220:24
EmilienMpradk: I think we can see the trace20:24
EmilienMa sec20:24
*** fragatina has joined #tripleo20:25
EmilienMoh we can't20:25
EmilienMwhat?20:25
EmilienMlogs don't exist20:25
openstackgerritMerged openstack/tripleo-quickstart: Update overcloud dns servers  https://review.openstack.org/33758820:26
openstackgerritMerged openstack/puppet-tripleo: Split Heat pacemaker roles into separate services  https://review.openstack.org/32770820:27
EmilienMit looks like ovb jobs on stable/mitaka don't get logs20:27
EmilienMactually nowhere, even on master20:27
*** hogepodge has quit IRC20:29
slaglefirst gate-tripleo-ci-centos-7-nonha-multinode is queued in the experimental queue...20:31
*** hogepodge has joined #tripleo20:31
openstackgerritMerged openstack/tripleo-quickstart: Skip internal undercloud post install tasks when the external role is call  https://review.openstack.org/33657520:32
EmilienMw00t20:33
openstackgerritMerged openstack/tripleo-heat-templates: Split Heat pacemaker roles into separate services  https://review.openstack.org/32770920:33
EmilienMslagle: on ovb, where is overcloudrc?20:36
EmilienMit seems like it's not in /home/jenkins/overcloudrc20:36
EmilienMhttp://logs.openstack.org/20/337720/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/3ea0eb9/console.html#_2016-07-05_17_56_34_25016620:36
EmilienMit was in source /home/stack/overcloudrc before20:38
slagleEmilienM: it will be in whatever the cwd is when the deploy command is run20:39
slaglei would have figured that is the home dir20:39
slaglebut maybe it's $WORKSPACE?20:39
EmilienMin /home/jenkins/workspace/gate-tripleo-ci-centos-7-ovb-ha ?20:40
EmilienMmhh20:40
slaglenot sure...whatever $WORKSPACE is defined as20:40
EmilienMit was not here before20:40
EmilienMfrom a working job: http://logs.openstack.org/77/324777/27/check-tripleo/gate-tripleo-ci-centos-7-ha/f7f59be/console.html#_2016-07-04_19_17_04_78365620:40
EmilienM2016-07-04 19:17:04.783656 | + source /home/stack/overcloudrc20:40
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Make su use a login shell when collecting logs  https://review.openstack.org/33785920:45
bnemecEmilienM: ^ May help with the log collection issue.20:45
*** hogepodge has quit IRC20:45
bnemecI feel like overcloudrc should be ending up in /home/stack too.20:45
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Split Sahara pacemaker roles into separate services  https://review.openstack.org/32772220:47
EmilienMbnemec: thanks!20:47
*** hogepodge has joined #tripleo20:47
bnemecThe problem may be that postci is running as the jenkins user now where before it was always stack.20:47
*** pradk- has quit IRC20:49
ayoungok...so, if I have tripleo setup, but no external network defined...where do I go next?20:49
ayoungah...found it20:50
pradkEmilienM, yep its packaging issue.. rdo mitaka has 2.0.3 .. should be 2.1 which is where the above create-legacy-resource-types option is added20:51
bnemecEmilienM: Actually, I see the pingtest is also using /home/jenkins/overcloudrc.  The problem in your log is probably that the deploy didn't complete so no overcloudrc was generated.20:51
EmilienMpradk: ok20:51
*** penick has quit IRC20:51
EmilienMbnemec: it was not obvious, I'll submit a patch for that20:52
EmilienMfor debug20:52
bnemecEmilienM: Yeah, sounds good.20:52
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Fix Ceilometer profiles  https://review.openstack.org/33669920:56
*** trown is now known as trown|outtypewww20:56
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349820:57
*** fultonj has quit IRC20:57
*** panda is now known as panda|Zz20:57
*** rhallisey has quit IRC21:00
*** rhallisey has joined #tripleo21:01
EmilienMbnemec: yeah I think your patch can help because it seems like it can't find overcloudrc while it can find stackrc21:02
*** Goneri has quit IRC21:02
stevebakerEmilienM: thanks for approving that orc timeout change. When is it worth doing a recheck on https://review.openstack.org/#/c/337385/ ?21:04
EmilienMstevebaker: now21:04
stevebakerrecheck!21:04
*** rhallisey has quit IRC21:05
*** hogepodge has quit IRC21:09
*** hogepodge has joined #tripleo21:14
*** wfoster has joined #tripleo21:16
*** chem` has quit IRC21:16
EmilienMthrash: so we want pacemaker managing new services?21:16
EmilienMie mistral, zaqar21:16
*** rook has joined #tripleo21:17
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: Add Adapter Teaming Support to os-net-config  https://review.openstack.org/33788621:17
*** rook is now known as Guest8895321:17
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: Add Adapter Teaming Support to os-net-config  https://review.openstack.org/33788621:19
*** fragatina has quit IRC21:19
*** penick has joined #tripleo21:21
*** jaimguer_ has joined #tripleo21:22
*** jaimguer_ has joined #tripleo21:25
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: Add Adapter Teaming Support to os-net-config  https://review.openstack.org/33788621:27
*** jaimguer_ has quit IRC21:27
*** jaimguer_ has joined #tripleo21:28
*** penick has quit IRC21:34
*** jaimguer_ has quit IRC21:36
slagleEmilienM: successful aio pingtest w/pacemaker with your latest patch :)21:36
*** jaimguer_ has joined #tripleo21:37
*** jaimguer_ has quit IRC21:37
*** jaimguer_ has joined #tripleo21:41
openstackgerritMerged openstack/diskimage-builder: Revert "Pre-install pip/virtualenv packages"  https://review.openstack.org/33768621:42
*** jeckersb is now known as jeckersb_gone21:51
EmilienMslagle: w00t! this is awesome!21:58
*** jaimguer_ has quit IRC22:02
*** jaimguer_ has joined #tripleo22:03
socialmarios: it should be fixed in RDO already22:10
socialmarios: sorry there is public holiday in Czech Republic22:10
*** pradk has quit IRC22:10
*** jaimguer_ has joined #tripleo22:11
openstackgerritBen Nemec proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277422:12
openstackgerritBen Nemec proposed openstack/instack-undercloud: Generate TLS endpoints if autogenerate cert is set  https://review.openstack.org/33312122:12
openstackgerritBen Nemec proposed openstack/instack-undercloud: Properly set undercloud_service_certificate when file exists  https://review.openstack.org/33790422:12
*** jaimguer_ has joined #tripleo22:14
*** jaimguer_ has quit IRC22:15
*** jaimguer_ has joined #tripleo22:18
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add 1.18.1 releasenotes  https://review.openstack.org/33790722:18
*** jaimguer_ has quit IRC22:23
*** jaimguer_ has joined #tripleo22:24
*** jaimguer_ has joined #tripleo22:25
*** jaimguer_ has quit IRC22:28
*** jayg is now known as jayg|g0n322:31
*** jaimguer_ has joined #tripleo22:37
*** jaimguer_ has joined #tripleo22:40
*** jaimguer_ has joined #tripleo22:41
*** akrivoka has quit IRC22:42
*** jaimguer_ has joined #tripleo22:43
*** jaimguer_ has joined #tripleo22:45
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: Add Adapter Teaming Support to os-net-config  https://review.openstack.org/33788622:45
*** jaimguer_ has quit IRC22:45
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: Add Adapter Teaming Support to os-net-config  https://review.openstack.org/33788622:46
*** rlandy has quit IRC22:48
*** rhallisey has joined #tripleo22:50
*** jaimguer_ has joined #tripleo22:54
thrashEmilienM: I guess we don't... I had already done it... Want me to remove that?22:57
*** jaimguer_ has joined #tripleo22:58
*** jaimguer_ has quit IRC22:58
*** shivrao has quit IRC23:02
*** dprince has joined #tripleo23:04
*** jaimguer_ has joined #tripleo23:15
*** saneax_AFK is now known as saneax23:16
*** jaimguer_ has quit IRC23:16
*** jaimguer_ has joined #tripleo23:18
*** rcernin has quit IRC23:18
*** dprince has quit IRC23:22
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: Add Adapter Teaming Support to os-net-config  https://review.openstack.org/33788623:23
*** jaimguer_ has joined #tripleo23:25
openstackgerritMerged openstack/diskimage-builder: Add 1.18.1 releasenotes  https://review.openstack.org/33790723:26
*** Goneri has joined #tripleo23:26
*** jaimguer_ has quit IRC23:27
*** jaimguer_ has joined #tripleo23:29
EmilienMthrash: probably23:31
*** jaimguer_ has quit IRC23:31
openstackgerritStephanie Miller proposed openstack/diskimage-builder: Fix proliant-tools dependencies  https://review.openstack.org/33791823:31
*** jaimguer_ has joined #tripleo23:34
*** jaimguer_ has quit IRC23:42
*** shivrao has joined #tripleo23:46
*** jaimguer_ has joined #tripleo23:55
*** Goneri has quit IRC23:57
*** rasca_ has joined #tripleo23:59
*** rasca has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!