Friday, 2016-07-08

*** chlong has quit IRC00:05
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates: Add support for deploying RGW on controllers. (Composable)  https://review.openstack.org/28902700:07
*** rook has quit IRC00:10
*** dbecker has joined #tripleo00:11
*** david-lyle has joined #tripleo00:14
*** dmacpher has joined #tripleo00:17
*** limao has joined #tripleo00:33
*** irrelepand|zZ has quit IRC00:36
*** weshay has quit IRC00:38
*** shivrao has quit IRC00:39
*** rajinir has quit IRC00:45
*** david-lyle has quit IRC00:46
*** shivrao has joined #tripleo00:51
*** ramishra has quit IRC00:52
*** ramishra has joined #tripleo00:55
*** david-lyle has joined #tripleo01:13
*** ramishra has quit IRC01:16
*** david-lyle has quit IRC01:18
*** ramishra has joined #tripleo01:18
*** chlong has joined #tripleo01:26
*** chlong has quit IRC02:08
*** chlong has joined #tripleo02:13
*** chlong has quit IRC02:17
*** Goneri has joined #tripleo02:21
*** yamahata has quit IRC02:55
*** bfournie has quit IRC03:01
*** vmud213 has joined #tripleo03:47
*** coolsvap has joined #tripleo03:48
*** myoung has quit IRC03:48
*** myoung has joined #tripleo03:48
*** numans has joined #tripleo03:50
*** yamahata has joined #tripleo03:54
*** rlandy has quit IRC04:02
*** Goneri has quit IRC04:03
*** chlong has joined #tripleo04:20
*** links has joined #tripleo04:24
*** masco has joined #tripleo04:56
*** vmud213 has quit IRC05:29
*** vmud213 has joined #tripleo05:29
*** ramishra has quit IRC05:30
*** ramishra has joined #tripleo05:31
*** chandankumar has joined #tripleo05:40
*** aufi has joined #tripleo05:43
*** dsariel has joined #tripleo05:58
*** fragatina has joined #tripleo06:01
*** fragatin_ has joined #tripleo06:02
*** fragatina has quit IRC06:05
*** rcernin has joined #tripleo06:09
*** tremble has joined #tripleo06:16
*** tremble has joined #tripleo06:16
*** dsariel has quit IRC06:21
*** pgadiya has joined #tripleo06:24
*** saneax_AFK is now known as saneax06:33
*** jprovazn has joined #tripleo06:33
saneaxGM folks06:33
*** apetrich has joined #tripleo06:37
*** devvesa has joined #tripleo06:39
*** chlong has quit IRC06:42
*** pcaruana has joined #tripleo06:51
openstackgerritAdriano Petrich proposed openstack/tripleo-quickstart: inject debug options on the under/overcloud images  https://review.openstack.org/32999906:54
ccamachoo/06:55
*** fzdarsky has joined #tripleo06:57
*** tesseract- has joined #tripleo07:00
*** jprovazn has quit IRC07:02
matbuo/07:07
*** ifarkas has joined #tripleo07:09
*** mcornea has joined #tripleo07:10
*** panda has joined #tripleo07:16
ccamachoHappy Friday all! :)07:17
*** tremble has quit IRC07:20
*** tremble has joined #tripleo07:22
*** akuznetsov has joined #tripleo07:31
*** pino|work_ is now known as pino|work07:31
*** shardy has joined #tripleo07:34
*** ebarrera has joined #tripleo07:34
*** akuznets_ has joined #tripleo07:37
*** akuznetsov has quit IRC07:38
*** amoralej|off is now known as amoralej07:40
*** lucas|afk is now known as lucasagomes07:43
*** florianf has joined #tripleo07:44
*** jpich has joined #tripleo07:44
*** shivrao_ has joined #tripleo07:49
*** athomas has joined #tripleo07:51
*** dbecker has quit IRC07:52
*** shivrao has quit IRC07:52
*** shivrao_ is now known as shivrao07:52
*** dmacpher has quit IRC07:54
*** gfidente has joined #tripleo07:54
*** dbecker has joined #tripleo07:55
*** rcernin has quit IRC08:02
snecklifterccamacho: right back at ya! :)08:04
d0ugalMorning!08:06
*** shivrao has quit IRC08:08
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Move neutron::db data within service template  https://review.openstack.org/33543808:16
ccamachoshardy morning!!! quick question I have (I think) applied all the changes for this submission https://review.openstack.org/#/c/318413/  the puppet-tripleo part is already landed, passing CI and +2ed08:17
ccamachowhen have some time can you check it? ^08:18
shardymarios: Hey g'morning ^^ I fixed the commit title in that patch, looks otherwise good to me08:18
*** akuznets_ has quit IRC08:18
shardyccamacho: morning! looking08:18
ccamachoshardy thanks! :)08:19
shardyccamacho: one question, have you deployed that locally, and done some basic sanity checks to ensure gnocchi is working?08:19
shardyWe don't have any CI coverage of that service atm08:20
ccamachommm shardy, I have deployed it locally and the service is working, but hold on please then. Ill speak with pradk as he knows better about the service, Ill ask him for a list of tests, and once I have the results Ill post them in the submission. I think is better in that way08:22
*** jprovazn has joined #tripleo08:22
*** rcernin has joined #tripleo08:22
ccamachoshardy just to be 100% sure08:22
openstackgerritChris Jones proposed openstack/tripleo-heat-templates: Increase RabbitMQ maximum file descriptors.  https://review.openstack.org/33760708:23
shardyccamacho: The tests probably don't need to be exhaustive, I'm just thinking source the overcloud credentials and run gnocchi resource list or something08:24
shardywhich should prove all the services are working, and the connection to the DB08:24
shardywe should probably add something to CI that does that (not only for gnocchi)08:24
shardyhttp://gnocchi.xyz/gnocchiclient/shell.html has some client usage info08:25
ccamachoshardy,Ill  put some comments in the submission :) and also think about something to add to CI :P08:25
ccamachothanks for the feedback08:25
*** ccamacho is now known as ccamacho|afk08:27
*** derekh has joined #tripleo08:27
*** chem has joined #tripleo08:30
mariosshardy: thanks, gfidente said there was something more he neede dfirst08:31
mariosshardy: (for the whole 'move the db data' series)08:32
mariosshardy: i *think* this https://review.openstack.org/#/c/338847/  but may be worth waiting08:32
mariosfor gfidente08:32
derekhshardy: so rh1 is in its new home, I did some poking about on it last night and all the basic bits seem to be ok, I'm going to have the spend the day verifying everything to sign off that all is good08:36
shardyderekh: good news! :)08:36
shardyderekh: so what's the plan, are you going to OVB it, or stick with the previous setup?08:36
derekhshardy: which means next week, the earlier the better we need to decide  origional system vs. OVB08:36
gfidentehey guys08:36
gfidentemorning08:36
derekhshardy: this is what I'd like to do08:37
shardyderekh: I think the new ovb CI is working well, so I'm +1 on switching everything to that08:37
shardyI'm assuming rh1 isn't now co-located with the rh2 ovb cloud?08:37
derekhshardy: the failure rate of the OVB based jobs has been higher then those on the old system (it mightn't seem so because we havn't hit any regression this week....except for one right now)08:38
derekhshardy: these two patches are aimed at reducing the failure rate, hopefully https://review.openstack.org/#/c/339019/ and https://review.openstack.org/#/c/338886/08:38
derekhshardy: I'd like to land them and see if it improves,08:39
derekhshardy: either way I'm still leaning the direction of OVB but it would be nice to have the teething problems sorted out before we commit08:39
derekhshardy: I *think* rh2 is in RDU but I'm not sure08:39
gfidentemarios, I moved all the series to depend on https://review.openstack.org/#/c/338847/08:40
gfidenteunfortunately we don't have ipv6 anymore either08:40
gfidenteso it's not testing the actual change08:40
shardyderekh: I was wondering if an option was to just add capacity to the current working rh2 setup08:40
gfidentebut the problem where the brackets around ipv6 addresses which is sorted in that submission so I think it's safe08:40
shardyby pulling nodes out of rh1 incrementally08:40
mariosgfidente: i see thanks (missed the https://review.openstack.org/gitweb?p=openstack/tripleo-heat-templates.git;a=shortlog;h=cdcc2d0b3b53e6514f26f6eea1a27d2f792854ba shortlog_08:42
mariosgfidente: i +2 on the mysql endpoint i think can land08:42
derekhshardy: afraid not, even if it was in the same DC , they carefully plan space for things like that out in advance, and the rh1 hosts have 10G ethernet rh2 is 1G, different switching HW08:42
shardyderekh: ack, I figured that was probably the case, just thinking aloud08:42
shardyI guess there are advantages to having completely isolated setups anyway08:43
mariosgfidente: i mean, are you sure pymysql works w/out the brackets there?08:43
*** electrofelix has joined #tripleo08:43
mariosgfidente: cos yeah if we're not sure about that then it shouldn't land  :) and you should change the commit08:43
gfidentemarios, for ipv6?08:43
*** tosky has joined #tripleo08:44
gfidentethe problem was exactly that we *had* the brackets08:44
mariosgfidente: i am trying to clarify what you meant 11:40 < gfidente> but the problem where the brackets around ipv6 addresses which is sorted in that submission so I think it's safe08:44
mariosgfidente: right OK08:44
gfidentebut let me test it locally08:44
gfidentewait wait08:44
gfidentebecause it's like knowing it didn't work but not that it actually does08:44
mariosgfidente: ack08:44
*** stendulker has joined #tripleo08:45
derekhshardy: all that aside, the nonha job is failing, mitaka regressed yesterday and is now failing, and there is some problem with liberty08:45
derekhshardy: in fact the only job that currently is working is the HA job08:45
derekhshardy: thats all nothing to do with OVB, just life ;-)08:46
derekhshardy: I gotta do stuff on rh1 today but will look into the liberty problem08:47
shardyderekh: Yeah, clearly everything had been going too smoothly, it's about time everything broke horribly I guess ;)08:47
shardyderekh: ack, thanks, there's a mail to openstack-dev re liberty which may or may not be related (looks like a missing puppet module I think)08:48
derekhshardy: exactly08:48
derekhshardy: looking08:48
shardyI'll see if I can reproduce the nonha failure locally08:48
derekhshardy: nonha at least looks broken to me, there has been a lot of failures in a row http://tripleo.org/cistatus.html08:49
shardyccamacho|afk: patch looks good to me, if we can confirm gnocchi is working by some basic local tests I think we can land it08:50
shardyccamacho|afk: FWIW I do agree with gfidente re the yaml anchors, I'm not sure they're really needed, but we can fix that in a followup patch08:51
openstackgerritMerged openstack/tripleo-heat-templates: Merge pacemaker_master/sync_db conditionals  https://review.openstack.org/33730208:52
shardySyntax error at 'fernet'; expected ')' at /etc/puppet/modules/keystone/manifests/init.pp:70708:52
shardyActually that looks like an error with the patch08:53
gfidentewhere?08:53
gfidentewas it me?08:53
gfidente^_^08:53
gfidenteshardy, when you have 5 mins can you check if this makes sense08:54
gfidentehttps://review.openstack.org/#/c/339160/08:54
gfidenteI think I'll need to play a bit with the services output but we need to dump multiple times same key to use stuff like hiera_merge or hiera_array08:54
shardygfidente: but we need config_settings to be a mapping that's deployed via hiera?08:56
shardynot a string?08:57
gfidenteehm08:58
shardyI guess I'll have to see how you resolve this in the hieradata08:58
gfidenteso if I use the pipe08:58
gfidentein config_settings08:59
gfidentewouldn't that keep the format we want?08:59
gfidenteI think it's the same that is happening in step_config08:59
gfidenteI'll play with it locally and try to update only when I have it working09:02
gfidenteif at all09:02
bandiniappreciate any puppet experts chiming in here: https://bugs.launchpad.net/puppet-tripleo/+bug/1600149 ;)09:03
openstackLaunchpad bug 1600149 in puppet-tripleo "tripleo::profile::base classes that need to sync db do not work with multiple controllers" [Undecided,New]09:03
*** fzdarsky is now known as fzdarsky|afk09:04
*** sambetts|afk is now known as sambetts09:05
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Fix retrieval of hostname fact based on network.  https://review.openstack.org/33273609:05
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates: Move nova constraints to tripleo-puppet.  https://review.openstack.org/33207109:05
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Move nova constraint, and refactor its declaration  https://review.openstack.org/33206909:05
shardygfidente: ServiceConfigSettings is a json parameter (mapping) that is mapped directly into hieradata key/value pairs, e.g here:09:06
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller.yaml#L76709:07
shardyatm I don't see how the list_join output will work with that09:07
*** devvesa has quit IRC09:07
shardystep_config is different, because it just joins all the manifiest fragments together into one long string09:07
gfidenteah right09:08
gfidenteand if we do map merge there we'd be merging the keys again anyway09:08
gfidentebandini, sounds correct, I think we pretty much need to move the logic from the pacemaker roles in the base roles09:08
gfidentebandini, because that logic applies to pacemaker and non-pacemaker scenarios indeed09:09
gfidenteso we cleanup the call in ::pacemaker:: and move it in ::base::09:09
gfidentebandini, quite a big quest09:10
gfidentewe can do like we did for the puppet BZ09:10
bandinigfidente: ah cool. so Ng and I were not too far off in our ramblings09:10
Ng\o/09:10
gfidentelet me comment on the bug and push a single change09:11
bandinigfidente: but the bug is only in tripleo-puppet, would you prefer if we did this one component at the time? i.e. one review per component? all partially fixing the lp bug I assume09:11
bandinigfidente: oh thank you sir!09:11
gfidentety09:12
gfidente:(09:12
*** sanjayu has joined #tripleo09:12
*** hanchao has quit IRC09:16
*** limao has quit IRC09:17
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Implement $sync_db logic into base profile  https://review.openstack.org/33942309:18
gfidentedoh I can't triage https://bugs.launchpad.net/puppet-tripleo/+bug/160014909:19
openstackLaunchpad bug 1600149 in puppet-tripleo "tripleo::profile::base classes that need to sync db do not work with multiple controllers" [Undecided,Confirmed]09:19
gfidenteI think I am not into some launchpad group to do that09:19
gfidentewhich is not nice09:19
derekhsshnaidm|afk: if you look at the images available on rh2 now you'll see devstack-gate-2016070709:21
shardygfidente: you're already in https://launchpad.net/~tripleo-drivers09:21
derekhsshnaidm|afk: this is as close to the image infra use for the undercloud that I can get,09:22
gfidenteshardy, I think it's some puppet group09:22
shardygfidente: Oh, that's owned by puppet-tripleo09:22
derekhsshnaidm|afk: if you use it instead of CentOS-7-x86_64-GenericCloud  you shouldn't need to install pip any longer09:22
gfidentebandini, so your change is fine indeed09:22
shardywe'll have to chat with Emilien, that should probably move and be owned by tripleo-drivers09:22
gfidentebandini, if you want to keep a single change that is cool as well09:22
gfidentebut I'd add the cleanup of the pacemaker version09:23
gfidentesec I'll update the cinder "version"09:23
shardytbh I'm not sure we really need a separate LP org for puppet-tripleo09:23
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Implement $sync_db logic into base profile  https://review.openstack.org/33942309:24
gfidentebandini, Ng in between you and me09:25
gfidentewhere you hoping for somebody to take care of this or are you going to maintain your submission up?09:26
gfidente*were09:26
shardyHmm, anyone seen this from re-running an undercloud install with DIB_INSTALLTYPE_puppet_modules set to source?09:26
shardyhttp://paste.openstack.org/show/528561/09:27
*** sanjayu has quit IRC09:27
shardyfatal: ambiguous argument 'fetch_stable/hammer': unknown revision or path not in the working tree.09:27
shardywhen checking out puppet-ceph09:27
*** ccamacho|afk is now known as ccamacho09:27
shardyI guess we actually don't need to build from source anymore, we can just point to the RDO trunk for puppet-*09:27
*** sanjayu has joined #tripleo09:28
*** bootsha has joined #tripleo09:29
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds parameters actions  https://review.openstack.org/29868209:30
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds parameters actions  https://review.openstack.org/29868209:31
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds action for template processing  https://review.openstack.org/33761509:31
*** athomas has quit IRC09:31
*** coolsvap has quit IRC09:32
openstackgerritDougal Matthews proposed openstack/tripleo-common: Add Plan Deletion  https://review.openstack.org/29993709:32
*** coolsvap has joined #tripleo09:33
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds Plan List Action  https://review.openstack.org/30022109:34
*** bootsha has quit IRC09:34
*** sanjayu has quit IRC09:37
*** sanjayu has joined #tripleo09:37
*** coolsvap has quit IRC09:38
*** athomas has joined #tripleo09:38
shardyCan I please get a second reviewer to check https://review.openstack.org/#/c/332036/09:42
shardyone-line patch, would be good to land it for n-209:42
*** sanjayu has quit IRC09:42
*** sanjayu has joined #tripleo09:42
shardy(actually, 5 lines including a new parameter :)09:42
*** sanjayu has quit IRC09:45
*** mgould|afk is now known as mgould09:45
*** sanjayu has joined #tripleo09:45
openstackgerritMarios Andreou proposed openstack/python-tripleoclient: Adds ManilaPassword to the tripleoclient  https://review.openstack.org/33943709:46
openstackgerritMerged openstack/tripleo-heat-templates: Parametrize and increase default of swift-proxy node_timeout  https://review.openstack.org/33203609:47
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Enable Manila integration - as a composable controller service  https://review.openstack.org/18813709:48
derekhjistr: shardy: marios the swift docs say if your increasing the value of that parameter you need to decrease "recoverable_node_timeout"09:53
derekhjistr: shardy: marios also I reckon the problem on virtual envs may just have been that there was a single vCPU and as a result only one swift-object worker and it could only server one request at a time09:55
shardyderekh: Hmm, interesting, thanks09:56
mariosderekh: ack thanks- are we setting that at all (recoverable_node_timeout) can't quickly grep it10:00
derekhmarios: nope, we're not, so its defaulted to the value of node_timeout10:00
mariosderekh: i see... :/ do yo uthink we should wait and see or pre-emtpivly decrease. and to what?10:01
mariosderekh: i mean see if it causes issues10:01
*** akrivoka has joined #tripleo10:01
mariosderekh: the to what was mostly rhetorical i mean - is the right value here same as the other right values we use (empirically, timeouts etc)10:02
derekhmarios: Off the top of my head, I think it makes sense to reduce the recoverable back to ten10:04
derekhmarios: but I think in general, some of these values are defaulted to what is suitable in a production deplotment10:05
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Merge pacemaker_master/sync_db conditionals  https://review.openstack.org/33944410:06
derekhmarios: it probably makes sense not to touch them at all, and just change the defaults for dev envs, some kinds of a dev env override file10:06
derekhmarios: I mean if we keep changing defaults so they work in a virtual environment, we'll end up producing a product optimized for developers10:08
matbumarios: hi man, can you take a look at this review : https://review.openstack.org/33887910:08
mariosmatbu: o/ hey, i was sure i did10:09
mariosmatbu: forgot to publish comment :)10:09
matbumarios: no pb :)10:10
matbumarios: i tested it yesterday, all upgrade passed with it10:10
mariosmatbu: ack great man thanks10:13
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Repurpose KeystoneWorkers add keystone::wsgi::apache::threads  https://review.openstack.org/33647210:14
gfidentemarios, https://review.openstack.org/#/c/335429/510:14
gfidentesee new comments10:15
mariosgfidente: ack thanks, but next time sry i really must context switch10:15
*** rcernin has quit IRC10:15
gfidenteyeah I won't ping you anymore10:15
mariosgfidente: that is a lie fidente10:15
gfidenteenjoy your isolation10:16
marioslol10:16
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Update overcloud passwords on update command  https://review.openstack.org/33821310:23
gfidented0ugal, ^^ so there I am creating some tripleo-overcloud-passwords in setUp()10:25
gfidenteand checking the AdminToken didn't change on update10:25
bandinigfidente: sorry for the late response, had to run an errand. I think we can push it ourselves we probably need a bit of high-level guidance10:25
gfidenteI read that as +210:25
gfidentebandini, which is fine10:25
gfidentecommented on the submission10:25
gfidentethanks! :)10:25
bandinigfidente: you are made of awesome! thanks10:26
gfidentewhat10:26
gfidentebandini, don't pretend10:26
gfidente:P10:26
gfidented0ugal, so my point is that overcloud_update will go through generate_passwords after setUp10:26
bandinigfidente: eheh am dead serious ;)10:26
gfidented0ugal, so if we generate the password in setUp and compare it after take_action, if it didn't change we're behaving correctly10:27
gfidented0ugal, makes sense?10:27
d0ugalgfidente: Sounds good! Checking the code.10:27
*** devvesa has joined #tripleo10:28
d0ugalgfidente: +2, I am happy if CI is happy :)10:30
gfidenteok thans10:31
*** leanderthal|afk is now known as leanderthal10:40
openstackgerritDougal Matthews proposed openstack/tripleo-common: Refactor template processing  https://review.openstack.org/33946110:43
yolandatrown, are these install instructions accurate? https://github.com/redhat-openstack/ansible-role-tripleo-image-build10:44
*** ebalduf has joined #tripleo10:44
yolandai hit some problems when installing with ansible-galaxy, i ended doing manually10:44
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Remove rdo-release from the centos CI image  https://review.openstack.org/33946310:46
derekhCan I get a second review of these please https://review.openstack.org/#/c/339019/ and https://review.openstack.org/#/c/338886/10:48
*** florianf has quit IRC10:49
derekhshardy: I believe I have a fix for the stable jobs https://review.openstack.org/#/c/339463/10:49
openstackgerritMerged openstack-infra/tripleo-ci: Assign testenv 1 greater then what is required  https://review.openstack.org/33901910:53
gfidented0ugal, so the CI error is due to parallelism I think10:56
gfidenteI just hit locally as well10:56
gfidenteand in another attempt it passed10:56
d0ugalgfidente: I'll try locally10:56
gfidentewe can't really customize the path of tripleo-overcloud-passwords though10:56
gfidentenot sure if we can tell testtools to not run the tests in that class in parallel?10:57
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Remove rdo-release from the centos CI image  https://review.openstack.org/33946310:57
shardyderekh: thanks, fixed a typo but lgtm10:57
gfidented0ugal, locally sometimes it passes sometimes it fails10:58
gfidented0ugal, sometimes its test_update_out failing, sometimes it's test_update_answersfile10:59
d0ugalgfidente: hmm, it fails every time for me.11:01
gfidentewith that same error?11:01
gfidentefor me even when it fails the error isn't always the same11:01
d0ugalgfidente: no, the error changes lol11:02
d0ugalgfidente: what magic is this11:02
gfidenteyeah I think it depends on *when* addCleanup is removing the previously created tripleo-overcloud-passwords11:02
d0ugalgfidente: we can customise the file path, I'll do it11:03
gfidenteideally we should probably provide a temp path for the passwords file11:03
d0ugalYeah, doing that.11:03
*** florianf has joined #tripleo11:03
gfidentethough we can customize the path in setup11:03
d0ugalgfidente: Happy for me to update it?11:03
gfidentebut how do you make sure to pass it when it's called by overcloud_update ?11:03
gfidenteyes totally happy if you want to!11:03
d0ugalgfidente: Yeah, I am not sure about that bit yet11:04
d0ugalgfidente: I guess this is the problem with testing it indirectly like this.11:04
gfidenteyeah11:04
*** stendulker has quit IRC11:05
gfidenteI tried to reproduce a real scenario11:07
gfidentewhere the file exists already11:07
gfidentethough alternatively we write an actual unit test for generate_overcloud_passwords11:07
*** rcernin has joined #tripleo11:08
gfidenteand mock a fake tripleo-overcloud-passwords in overcloud_update11:08
*** ebalduf has quit IRC11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160018211:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1600182 in tripleo "AttributeError: 'module' object has no attribute 'PortOpt'" [Critical,Triaged] - Assigned to Derek Higgins (derekh)11:10
dtantsurhi folks! could you please approve a simple refactoring https://review.openstack.org/336053 ? 1x +2, passed CI11:11
*** tremble has quit IRC11:14
*** tremble has joined #tripleo11:16
gfidented0ugal, so setupClass should do what we need11:21
*** pkovar has joined #tripleo11:24
*** coolsvap has joined #tripleo11:24
d0ugalgfidente: oh, cool. I didn't know about that one11:25
d0ugalgfidente: I to take the dog for a walk before she gets mad, so if you want to do that change, go for it11:25
d0ugalgfidente: otherwise I can try after lunch11:25
EmilienMgood morning!11:26
openstackgerritJames Slagle proposed openstack/instack-undercloud: DO NOT MERGE - TEST  https://review.openstack.org/33920611:29
*** weshay has joined #tripleo11:31
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Enable Manila integration - as a composable controller service  https://review.openstack.org/18813711:32
openstackgerritMarios Andreou proposed openstack/python-tripleoclient: Adds ManilaPassword to the tripleoclient  https://review.openstack.org/33943711:32
*** pino|work has quit IRC11:44
ccamachomorning EmilienM!11:44
*** hewbrocca is now known as hewbrocca-afk11:44
*** ccamacho is now known as ccamacho|lunch11:44
*** bfournie has joined #tripleo11:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349811:47
*** numans has quit IRC11:48
*** hewbrocca-afk is now known as hewbrocca11:48
*** lucasagomes is now known as lucas-hungr11:51
*** lucas-hungr is now known as lucas-hungry11:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Ceilometer Compute Agent composable service  https://review.openstack.org/33180211:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: services/ceilometer: switch to polling agent  https://review.openstack.org/33250411:51
*** fzdarsky|afk is now known as fzdarsky11:53
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates: Add StepConfig to docker compute-post.yaml  https://review.openstack.org/33049211:55
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles  https://review.openstack.org/33065911:55
*** tremble has quit IRC12:02
*** tremble has joined #tripleo12:03
openstackgerritJames Slagle proposed openstack/instack-undercloud: DO NOT MERGE - TEST  https://review.openstack.org/33920612:04
slagleEmilienM: hey, wondering if you can look at a puppet error i'm getting in the multinode CI job12:05
EmilienMslagle: sure thing12:05
EmilienMshow me logs12:05
slagleEmilienM: this is the error: http://logs.openstack.org/77/324777/41/experimental/gate-tripleo-ci-centos-7-nonha-multinode/3141c3d/console.html#_2016-07-08_11_49_28_81909212:05
slagleEmilienM: the odd thing is that the value is in the hieradata12:06
EmilienMhttps://github.com/openstack/puppet-swift/blob/master/manifests/init.pp#L6312:06
slagleEmilienM: if you scroll up, i've added a bunch of debug output before the puppet apply12:06
EmilienMok, let me dig more12:06
slagleand you can see that the value is indeed there12:06
EmilienMslagle: timestamp?12:06
EmilienM2016-07-08 11:49:18.817342 | + hiera swift::swift_hash_path_prefix12:07
EmilienMright, it's 179614d8f02a2d8d2fb8681d750df6e7ec2395ec12:07
slagleEmilienM: http://logs.openstack.org/77/324777/41/experimental/gate-tripleo-ci-centos-7-nonha-multinode/3141c3d/console.html#_2016-07-08_11_49_18_81770312:07
slagleyea12:07
EmilienMok gotcha, let me see now12:07
slaglesince this is running on infra centos nodes, i'm wondering if it's maybe something to do with puppet/hiera package versions?12:08
slagleor some other misconfiguration12:08
flaper87EmilienM: https://review.openstack.org/#/c/330492/ it's green now12:08
flaper87EmilienM: oh wait, not the upgrade job12:08
flaper87well, I don't even see it12:08
flaper87:P12:08
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160018212:10
openstackLaunchpad bug 1600182 in tripleo "AttributeError: 'module' object has no attribute 'PortOpt'" [Critical,Triaged] - Assigned to Derek Higgins (derekh)12:10
*** ooolpbot has quit IRC12:10
EmilienMslagle: the version of hiera is good12:10
EmilienMslagle: http://logs.openstack.org/77/324777/41/experimental/gate-tripleo-ci-centos-7-nonha-multinode/3141c3d/console.html#_2016-07-08_11_48_59_86246712:13
EmilienMslagle: this is for the undercloud?12:14
EmilienMjust to make sure12:14
*** numans has joined #tripleo12:14
slagleEmilienM: yes, the undercloud on the infra spawned jenkins centos7 node12:14
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Update overcloud passwords on update command  https://review.openstack.org/33821312:15
EmilienMit must be something with infra right12:15
slagleEmilienM: yes, somehow the node is configured i guess12:16
slaglei just don't know what else to check12:16
*** dprince has joined #tripleo12:16
EmilienMhiera-1.3.4-5.el7.noarch is good, let me check all the things12:17
EmilienMit must be something with pre-installed puppet and wrong config that we don't overwrite probably12:17
EmilienMslagle: why first puppet run works?12:19
EmilienMhttp://logs.openstack.org/77/324777/41/experimental/gate-tripleo-ci-centos-7-nonha-multinode/3141c3d/console.html#_2016-07-08_11_49_03_60396912:19
slagleEmilienM: the first puppet run doesn't need any hiera12:19
slagleit just does a yum update and configures os-net-config12:19
*** pradk has joined #tripleo12:20
openstackgerritBrad P. Crochet proposed openstack/puppet-tripleo: Split Sahara pacemaker roles into separate services  https://review.openstack.org/32772112:22
EmilienMhiera config looks good, I'm wondering about puppet config12:22
slagle/etc/puppet/puppet.conf?12:23
slaglei didnt think to check that12:23
slaglei can add it to the debug12:23
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Split Sahara pacemaker roles into separate services  https://review.openstack.org/32772212:23
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Add Sahara services to ControllerServices list  https://review.openstack.org/33611912:23
slagleor it might be in the logs, let me check12:23
EmilienMpuppet-3.6.2-3.el7.noarch is good12:24
saneaxslagle, can we try to bracket the and - ie change if ($swift_hash_path_prefix == undef and $swift_hash_path_suffix == undef) -->  if ($swift_hash_path_prefix and $swift_hash_path_suffix)12:24
saneaxmaybe the and is doing something that is not obvious12:24
slagleEmilienM: here it is: http://paste.openstack.org/show/528582/12:25
*** trown|outtypewww is now known as trown12:25
slagleEmilienM: i think you're right...that's quite a bit different than our typical puppet.conf12:25
EmilienMI noticed you don't run puppet-prepare-node builder (see in project-config/jenkins/jobs/macros.yaml)12:26
EmilienMwe run it in our puppet jobs to cleanup all infra stuff12:26
EmilienMlet me see your layout12:26
slagleah, yea, we likely need that12:26
*** fultonj has joined #tripleo12:26
*** rodrigods has quit IRC12:27
*** rodrigods has joined #tripleo12:27
slagleEmilienM: the layout being tripleo.yaml from nodepoool?12:27
EmilienMslagle: yes but before patching it I want to make sure it will help12:28
EmilienMa sec12:28
slaglek12:28
EmilienMslagle: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/macros.yaml#L327-L32912:28
EmilienMcan you try to run this before running puppet?12:28
*** jayg|g0n3 is now known as jayg12:30
EmilienMslagle: I'm wondering if cleaning up puppet/hiera will help us to start our jobs with clean packages12:31
EmilienMI know infra is doing config for puppet, etc, see puppet.conf12:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Pass MysqlVirtualIP without brackets to EndpointMap  https://review.openstack.org/33884712:31
*** jcoufal has joined #tripleo12:32
*** lblanchard has joined #tripleo12:33
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Move keystone::db data within service template  https://review.openstack.org/33542912:34
gfidented0ugal, think I sorted it, passed tests now12:35
slagleEmilienM: yes, i'll try12:35
slaglei'll just add it to the debug for now12:35
weshaymatbu, hey there.. so for liberty -> mitaka do we need even a higher time out or is the current timeout working.  The card is now closed so I'm not sure12:35
EmilienMslagle: right and if it works, we might need to patch JJB12:36
EmilienMgfidente: https://review.openstack.org/#/c/339160/ is failing12:37
gfidenteEmilienM, yeah it's more complicated than it seemed12:37
EmilienMdprince, shardy: any chance to get your feedback on ^ ? it's blocking us for composable firewall / sysctl rules12:37
gfidentewe can't do it that way12:37
*** ebalduf has joined #tripleo12:37
dprinceEmilienM, gfidente: don't do it :)12:40
EmilienMdprince: so we can't use hiera_hash merging :(12:41
dprinceEmilienM, gfidente: lets find another mechanism I think. merge_map was written explicitly to be able to merge these types of configs... and using list_join instead isn't going to work I think12:41
gfidentedprince, the other day I was thinking about scenarios for the global config12:41
EmilienMgfidente: can you review https://review.openstack.org/#/c/333387/ please?12:41
dprinceEmilienM: we'll figure this out12:41
EmilienMdprince: still failing on https://review.openstack.org/#/c/338315/12:42
EmilienMdprince: http://logs.openstack.org/15/338315/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/275ea95/logs/postci.txt.gz#_2016-07-07_20_34_54_00012:42
gfidentedprince, the thing I forgot about the endpoints is that the puppet parameter to create the endpoint might be deployed on a node where there isn't the pcmk resource12:42
EmilienMgfidente: keystone endpoints?12:42
dprinceEmilienM: I will look at it in a bit12:43
*** jeckersb is now known as jeckersb_gone12:43
openstackgerritJames Slagle proposed openstack/instack-undercloud: DO NOT MERGE - TEST  https://review.openstack.org/33920612:44
*** egafford has joined #tripleo12:44
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477712:44
openstackgerritMerged openstack/tripleo-quickstart: quickstart.sh command line argument fixes  https://review.openstack.org/33276212:45
openstackgerritMerged openstack/tripleo-quickstart: Improve --help output of quickstart.sh  https://review.openstack.org/33279612:45
gfidentedprince, though I think map_merge is taking last value of a key12:46
gfidenteit seems the intended behaviour12:46
*** rlandy has joined #tripleo12:46
gfidentewhat's the thing with behavior vs behaviour btw you native english speakers? is there one more correct than the other?12:47
hewbroccagfidente: it depends on whether you are subservient to the Queen12:47
hewbroccaor whether you have boldly struck out on your own12:47
hewbroccainventing your own spellings as you go along12:48
gfidentethe second for me12:48
hewbroccaThe good news is, English spelling is so screwy no one has a leg to stand on12:48
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Resize undercloud image(call virt-resize)-fails  https://review.openstack.org/33687512:49
dprincegfidente: map_merge is working correctly. But I think we need a different mechanism than this12:49
gfidenteyeah I mean it's doing what it was expected to12:50
gfidentethanks hewbrocca :)12:50
*** numans has quit IRC12:50
*** ebalduf has quit IRC12:51
openstackgerritMerged openstack/tripleo-quickstart: Prepare tempest if running it  https://review.openstack.org/32908212:51
hewbroccatrown: Did you get ayoung sorted out yesterday?12:52
*** amoralej is now known as amoralej|lunch12:53
*** maeca1 has joined #tripleo12:53
*** lucas-hungry is now known as lucasagomes12:53
trownhewbrocca: ayoung can be sorted? I think he might be an unsortable data structure, at least not sortable in O(n)12:54
hewbroccaLOL12:54
honzashardy: dprince: did you guys have any further thoughts on the network diagram blueprint?12:56
trownhewbrocca: it is still WIP... it is not in scope of quickstart to deploy an IPA VM, but plugability of playbooks/roles should allow us to get there all the same12:56
*** vmud213 has quit IRC12:57
*** vmud213 has joined #tripleo12:58
shardyhonza: what feedback are you looking for?  I think it's a good idea provided you don't parse the heat templates directly12:58
*** chandankumar has quit IRC12:58
shardyhonza: So I'd say go ahead and do it :)12:58
shardyhonza: one issue we have is the current UI effort is not well integrate with upstream TripleO yet12:59
shardyso it's tricky asking for feedback when many of us haven't yet tried it12:59
*** rhallisey has joined #tripleo12:59
honzashardy: by directly, do you mean just using pyyaml and parsing the file?  I was going to use Heat where possible.12:59
shardyI'd very much welcome some initial patches which integrate the UI with the undercloud and make it available by default, but I know we've got some dependencies on mistral API stuff to land first12:59
shardyhonza: Yeah, I think you definitely should not parse the yam directly13:00
shardyinstead we should look at feeding the templates into heat and having it generate a stack-preview13:00
honzashardy: the feedback i was looking for is "does this make sense from a technical POV?" and "am i missing something?"13:00
shardythen you can generate the diagram from that13:00
shardyhonza: I think it does, network configuration is one of the more complex aspects of TripleO, so anything we can do to help with visualizing that configuration has to be a good thing13:01
shardymy main concern is that we do it in a way that's well integrated with the rest of tripleo and not highly coupled to the templates13:01
shardyhonza: e.g, if I was doing this, the first step I'd take is probably to build something that can take a heat preview and generate a dot file or something from the output13:02
shardysome stuff related to that landed in python-heatclient recently so you may want to check it out13:03
honzashardy: TIL about stack-preview13:03
openstackgerritJames Slagle proposed openstack/instack-undercloud: DO NOT MERGE - TEST  https://review.openstack.org/33920613:03
shardyhonza: what would be bad IMHO is if we implement everything related to generating the network topology "model", e.g what is going to be displayed in data format, in a tripleo-ui specific way13:04
*** coolsvap has quit IRC13:04
thrashgfidente: No idea why that sahara patch failed... It's working fine locally.13:04
d0ugalshardy: Given the importance (I think) of the Mistral transition and the UI integration - maybe we should call it out each meeting briefly (status update, to make sure it isn't blocked and get more eyes on it to help it integrate)13:04
honzashardy: makes sense13:04
shardyit'd be cool if we could build some more general preview/validation workflows that then are used to enable the visual part of it13:04
d0ugalgfidente: Did you manage to sort the tests out?13:04
d0ugalgfidente: sorry, I got quite distracted.13:04
gfidented0ugal, yep passed the tests13:05
d0ugalgfidente: Great13:05
gfidenteI'm mocking generate_overcloud_passwords with a temporary filepath13:05
*** sanjayu is now known as sanjayu|AFK13:05
shardyd0ugal: Yeah that's a good idea13:05
*** chem is now known as chem|away13:05
shardyI definitely think we need to improve the feedback loop between the Ux efforts and the broader TripleO community, so hopefully that will help13:06
d0ugalshardy: although, with the UI meetup next week I guess not many of us will be able to attend :)13:06
*** tremble has quit IRC13:06
honzashardy: wait, i was hoping to avoid having to create a stack in order to generate the diagram --- stack-preview seems to require one13:06
shardyhonza: No, stack-preview creates a dummy stack in memory then returns a bunch of data13:07
shardyall the arguments are the same as for a create, but it doesn't actually create anything13:07
derekhanybody wanna merge this, its the first liberty pass we've had on rh2 https://review.openstack.org/#/c/339463/13:07
*** tremble has joined #tripleo13:07
derekhI'll work on mitaka next13:07
dtantsurfolks, I have a Very Serious Question13:07
honzashardy: ugh, i'm going to read some more about this, sorry13:07
dtantsurdoes anyone work on tripleo support for https://github.com/openstack/ailuropoda/ ?13:08
d0ugallol13:08
dtantsurI think that's a key to our success13:08
dtantsurhewbrocca, ^^^13:08
shardyhonza: No worries, I've got $meetings this afternoon, but I'm happy to discuss it in more detail and help with examples on Monday13:08
* hewbrocca looks13:08
* d0ugal waits13:09
openstackgerritChris Jones proposed openstack/tripleo-heat-templates: Increase RabbitMQ maximum file descriptors.  https://review.openstack.org/33760713:09
shardyhonza: I can probably help wire in a mistral action that runs a stack preview for a given plan13:09
openstackgerritDan Prince proposed openstack/puppet-tripleo: Use include for base neutron profile  https://review.openstack.org/33954413:09
shardythat, I think, may give the data you need, then we can have some transformation that extracts the network data13:09
dprinceEmilienM: I think this may fix the CI error https://review.openstack.org/#/c/339544/13:10
dprinceEmilienM: FWIW I had only tested it locally without pacemaker.13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160018213:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1600182 in tripleo "AttributeError: 'module' object has no attribute 'PortOpt'" [Critical,Triaged] - Assigned to Derek Higgins (derekh)13:10
EmilienMdprince: ok let"s see how it's going13:10
hewbroccadtantsur: I have no idea how we have not yet integrated that13:10
* dtantsur neither13:10
shardydtantsur: lol13:10
openstackgerritMerged openstack-infra/tripleo-ci: Remove rdo-release from the centos CI image  https://review.openstack.org/33946313:10
shardy*that* is the power of the big tent13:10
shardymore valuable openstack projects :)13:11
derekhtrown: thanks13:11
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable OpenContrail compute plugin  https://review.openstack.org/33848013:11
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Neutron Core Compute Plugin  https://review.openstack.org/33831513:11
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Midonet for Neutron  https://review.openstack.org/33338713:11
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Nuage Compute Plugin  https://review.openstack.org/33847713:11
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Plumgrid compute plugin  https://review.openstack.org/33847913:11
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Midonet compute plugin  https://review.openstack.org/33847813:11
gfidentedprince, EmilienM what's the CI error?13:11
trowndtantsur: need to create a puppet module for it first13:11
dtantsurtrown, oh true13:11
EmilienMgfidente: dprince's patches for neutron13:11
shardypuppet-sadpanda13:11
EmilienMgfidente: what he just pushed ^13:11
derekhtrown: btw, we had a promote last night, so the instack image is now longer  at http://8.43.87.241/builds/current-tripleo/13:12
trownhow do we have that repo in openstack namespace... big tent is a bit too big maybe13:12
derekhEmilienM: ^^ you wanted it by friday ;-)13:12
*** coolsvap has joined #tripleo13:12
trownderekh: ah thanks for the heads up, I am working on using overcloud image (with minor conversion)13:12
dtantsurtrown, maybe it's a "hello world" project for people to start their services.. dunno really13:13
EmilienMderekh: w00t !13:13
derekhtrown: want me to put the old instack image in there for the moment?13:13
trownderekh: that would be awesome13:13
EmilienMderekh: thanks, I'll prepare the release on Monday13:13
trownderekh: tripleo-quickstart "devmode" will be broken without it until we have some other mechanism in place13:14
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds action for template processing  https://review.openstack.org/33761513:14
shardyderekh: good news re the promote :)13:14
shardyEmilienM: ping me on Monday and we can sync up re the release13:15
shardythere are some bugs I was hoping we'd land but I guess I'll just defer them if we've got a clean promote to base the release on13:15
EmilienMshardy: I'll ping you first time for me13:15
*** links has quit IRC13:15
shardyEmilienM: sounds good, thanks!13:15
derekhtrown: done, let me know if you want me to do it again, as it will vanish after the next promote13:16
derekhshardy: thanks, that our first promote on rh2, although I'd be lieing if I said it wasn't helped along a little13:16
mandredprince: we need to chat about https://review.openstack.org/#/c/322893/ :)13:16
trownderekh: ya, hoping to get something working today, but would it be possible to have a temporary line in the promote cron that does that copy?13:16
derekhtrown: ok, I'll jimmy rig something in13:17
trownderekh: thanks, the quickstart code that uses it overwrites all the repos anyways, so it should continue to work... it will just be less and less efficient over time as more and more packages will get updated13:19
trownderekh: but hopefully I can get the overcloud conversion method working before that is a concern13:20
dprincemandre: sure13:20
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Mistral services  https://review.openstack.org/32343613:22
openstackgerrityolanda.robla proposed openstack/tripleo-quickstart: TEMPORARY: add missing req files  https://review.openstack.org/33688513:22
*** pgadiya has quit IRC13:22
yolandatrown, did i interpret your comment correctly? ^13:22
trownyolanda: perfect! Now we can run the full deploy CI to confirm that tempest is indeed working again with that patch13:24
trownyolanda: thanks!13:24
yolandagreat13:24
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Copy a old instack qcow image into current-tripleo  https://review.openstack.org/33955113:25
derekhtrown: ^13:25
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168213:27
derekhcan somebody else take a quick look at https://review.openstack.org/#/c/339551 , very trivial13:28
EmilienMderekh: +A13:29
openstackgerritMerged openstack-infra/tripleo-ci: Copy a old instack qcow image into current-tripleo  https://review.openstack.org/33955113:29
derekhEmilienM: ty13:29
slagleEmilienM: looks like remove those packages fixes the issue13:31
*** cdearborn has joined #tripleo13:31
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Include bulk in swift proxy pipeline  https://review.openstack.org/33955313:31
*** abehl has joined #tripleo13:32
EmilienMslagle: cool13:32
EmilienMslagle: can I patch jjb?13:32
mandredprince: so... I think there is a bit of misunderstanding about what problem we're trying to solve in this patch13:33
slagleEmilienM: I think i'm going to patch it on the tripleo-ci side13:34
ccamacho|lunchtrash, around? I'm playing/checking/fighting with the zaqar submission, mmm all my deployments with the same result (An error saying that there is an evil tab hidden I don't know where..) But, I have commented and tested almost each line and the deployment finish when commenting the zaqar endpoint related code, I will see if I managed to find the nit there.13:34
*** ccamacho|lunch is now known as ccamacho13:34
mandredprince: I'm not sure I understand what you're proposing with the mistral remote exec workflow13:34
EmilienMslagle: mhh okidoc!13:34
dtantsurfolks, is anybody fixing broken curl commands on http://tripleo.org/installation/installation.html#updating-undercloud-components ?13:34
dtantsurat least -L flag is required to follow the current redirects13:34
derekhdtantsur: https://review.openstack.org/#/c/339010/13:34
dtantsurawesome, I'll try it13:35
dprincemandre: I was suggesting we use that to upload the ssh_public key to the nodes13:36
dprincemandre: but the ssh_public key shouldn't live or get created on the undercloud. It should be specified by the end user13:36
dprincemandre: essentially, I'm against any sort of "setting up camp" on the undercloud13:37
dprincegfidente, EmilienM: working on a quick example patch for the firewall stuff. Sec and I'll post it to see if you buy this idea...13:37
dtantsurfolks, have you seen this on master:13:38
dtantsurERROR (Forbidden): Policy doesn't allow os_compute_api:servers:detail to be performed. (HTTP 403) (Request-ID: req-ed49aa4c-a7cb-48f2-bd8f-200992143daa)13:38
dtantsurthat's if you just try nova list13:38
* dtantsur will retry openstack undercloud install13:39
dprincedtantsur: haven't seen it. perhaps something changed in policy.json w/ Nova?13:39
openstackgerritChris Jones proposed openstack/tripleo-heat-templates: Increase RabbitMQ maximum file descriptors.  https://review.openstack.org/33955613:39
mandredprince: do we agree the undercloud will run the mistral validation workflow?13:39
dprincemandre: yes, of course it can13:41
dprincemandre: the trick here is building an abstraction that isn't hard coded to Ansible13:41
dprincemandre: Ansible isn't TripleO13:41
dprincemandre: Puppet isn't TripleO13:41
openstackgerritMerged openstack/tripleo-docs: Use centos.org URLs instead of redirecting  https://review.openstack.org/33901013:41
dtantsurwe need to use heat templates for it!13:42
* dtantsur ducks13:42
dprincemandre: TripleO can use these things... but we need to be careful not to hard code the underlying tooling13:42
dprincemandre: I think you'll need a custom mistral action for this probably, also possibly storing any playbooks you'd like in Swift13:42
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477713:42
dprincemandre: then an end user can call it via an API and run the validations. Or the UI can do it.13:43
mandredprince: idk, that seem overcomplicated13:45
mandredprince: what benefit would you get by storing the validations in swift?13:46
*** jeckersb_gone is now known as jeckersb13:46
mandredprince: hmmm, that was a stupid question in fact13:47
dprincemandre: I was thinking we'd use the same mechanism for running them regardless if the end user specifies them or they are installed automatically via an undercloud13:47
dprincemandre: similar to what we are going to do with t-h-t13:48
*** cdearborn has quit IRC13:48
dprincemandre: and we've supported rolling out the puppet-modules.tar.gz like this for quite a while already too13:48
mandredprince: yeah, i see your point about swift13:48
mandredprince: but the ssh key still puzzles me13:48
dprincemandre: just keep it as a parameter for the workflow in Mistral to run all this13:49
*** r-mibu has quit IRC13:49
dprincemandre: it will be specified, or stored in the Mistral environment I think13:49
*** r-mibu has joined #tripleo13:49
dprincemandre: that way you avoid having to store in on disk in the undercloud13:49
mandredprince: sure, I can make it a parameter13:49
dprincemandre: it'll be fun to implement this I think ;)13:49
dprincemandre: or it could be... just depends on what you like doing I guess13:50
openstackgerritDerek Higgins proposed openstack/tripleo-docs: Remove details about install master tripleo packages  https://review.openstack.org/33956113:50
openstackgerritDerek Higgins proposed openstack/tripleo-docs: Remove details about installing master tripleo packages  https://review.openstack.org/33956113:51
dtantsurderekh, why is that ^^ btw?13:51
*** tzumainn has joined #tripleo13:52
derekhdtantsur: why what? why remove what I'm proposing we remove?13:52
dtantsurit's going to make development substantially harder13:52
*** tzumainn has quit IRC13:52
dtantsuryep13:52
*** tzumainn has joined #tripleo13:53
dtantsur(or rather: I'll have to figure out this command myself every time I work on tripleo)13:53
derekhdtantsur: because ever night we run a periodic job, we ensure it works, thats what tripleo users who want master should be using13:53
dtantsurwhy? tripleo packages are already tested13:53
dtantsurand this will block them every time nova/ironic/whatever break us13:54
derekhdtantsur: noe, it a pin, if its broke the pin wont update13:54
derekh*no,13:54
derekhdtantsur: so we can't get blocked13:54
dtantsurright, and this is the problem13:54
dtantsuryes we can, we won't get new puppet-ironic/whatever which already passed CI13:55
sshnaidm|afkderekh, dprince, bnemec, EmilienM,  hi folks, can we please merge this today? https://review.openstack.org/#/c/339118/  thanks!13:55
dtantsurwhich may be fine for mere users, but a pain for developers13:55
*** Goneri has joined #tripleo13:55
dtantsurand I'd argue mere users should stick to stable branches13:55
derekhdtantsur: so if your a dev and you want master of everything you should be using tripleo.sh to set up your repositories13:55
dtantsurtripleo.sh used to be CI-only, did it become our public thing?13:56
derekhdtantsur: it was never ci only, its a tool for devs, that we started using in CI13:56
dtantsurif so, please update your patch with something like what you just said13:56
EmilienMsshnaidm|afk: I'll recheck, ci is not green.13:56
*** tremble has quit IRC13:56
EmilienMwell, we can land it I think13:57
dtantsur"If as a developer you need access to the latest tripleo packages, use `...` instead"13:57
dtantsurderekh, ^^^13:57
hrybackiayoung: heads up: https://review.gerrithub.io/#/c/283325/13:57
dtantsur(sorry if we already have it there)13:57
*** chandankumar has joined #tripleo13:57
hrybackiayoung: happy to describe how we integrate roles like ^^ into the deployment process of quickstart when you have time to test it13:57
openstackgerritBrad P. Crochet proposed openstack/tripleo-docs: Switch docs to use tripleo-build-images  https://review.openstack.org/33766913:58
dtantsurdprince, I suspect 'openstack undercloud install' got stuck on the same error..13:58
dtantsurwait, now it's keystone Oo13:58
derekhdtantsur: looking about where to best put it13:59
dtantsurderekh, that's why we should not recommend users use master >_<13:59
dtantsurbut that's an unrelated topic13:59
*** amoralej|lunch is now known as amoralej13:59
*** tremble has joined #tripleo14:00
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Use $USER instead of jenkins in CI scripts  https://review.openstack.org/33956514:01
sshnaidm|afkEmilienM, thanks!14:01
*** vmud213 has quit IRC14:01
sshnaidm|afkderekh, wdyt  https://review.openstack.org/339565 ?14:01
thrashccamacho: you pinged trash, not thrash. :)14:01
thrashccamacho: I'm reading it now14:01
hewbroccaone man'S thrash is another man's treasure...14:01
dtantsurlol14:02
thrashhewbrocca: >_<14:02
derekhsshnaidm|afk: lgtm14:02
derekhsshnaidm|afk: if we are sticking with the OVB jobs that probably wont be needed any longer14:03
ccamachothrash, sorry man :(  :P To many similar nicks!14:03
thrashccamacho: lol14:03
sshnaidm|afkderekh, why?14:03
thrashccamacho: no worries... just didn't want you to think I was completely ignoring.14:03
ccamachohewbrocca++14:03
sshnaidm|afkderekh, uh, you mean ssh keys14:03
ccamachothrash np :)14:03
*** shadower has joined #tripleo14:04
yolandawoot, ci passed :)14:04
hewbrocca!!!14:04
openstackhewbrocca: Error: "!!" is not a valid command.14:04
hewbroccapff openstack who asked you14:05
* dtantsur runs keystone-manage manually14:05
* dtantsur would REALLY advise against using tripleo master, no matter which set of repos, by mere users14:05
sshnaidm|afkderekh, btw, if we need to do something on CI in Sunday, when load will be low - you can assign it to me14:05
derekhsshnaidm|afk: yes, I meant the ssh keys14:07
derekhsshnaidm|afk: good to know, I can't think of anything in particular for this sunday (unless jobs are failing )14:08
ayounghrybacki, that is truely awesome.  Thank you very much14:09
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Gnocchi composable roles  https://review.openstack.org/31841314:09
derekhsshnaidm|afk: but we may at some stage in the future want to work on deploying a large deployment on a sunday or something14:09
thrashccamacho: testing the latest rev of the zaqar role. will let you know if I see what you're seeing14:09
ayounghrybacki, wish you had talked to me about repo naming, first, but its good enough14:09
derekhsshnaidm|afk: like weekly deploy 100 overcloud nodes to gather metrics etc.. so that might be a good thing to start soon14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160018214:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1600182 in tripleo "AttributeError: 'module' object has no attribute 'PortOpt'" [Critical,Triaged] - Assigned to Derek Higgins (derekh)14:10
*** alop has joined #tripleo14:10
hrybackiayoung: alas I had no hand in the naming of said repo14:10
ccamachothrash, ack, In my case all the times with the same error as I commented on patchset 9 and only managed to pass (the service wont work but at least is installed) when removing the endpoint code in THT14:11
*** mbound has joined #tripleo14:11
dtantsurFailed to restart mongodb.service: Unit mongodb.service failed to load: No such file or directory14:11
dtantsurdo we use mongo in tripleo?14:11
dtantsur(and WHY GOD WHY??)14:12
hrybackiayoung the task was issued to the team of porting your work to a role, I volunteered as I enjoy working with you -- the repo was created before I ever know this was a thing :P14:12
hewbroccaCeilo backend, right<14:12
hewbrocca?14:12
hewbroccagod help us14:12
*** snecklifter has quit IRC14:12
hewbrocca#shouldausedpostgres14:12
EmilienMdtantsur: for ceilometer14:12
EmilienMit's the default backend14:13
dtantsurEmilienM, OMG, ok. then we should restart "mongod" service, not "mongodb"14:13
*** derekh is now known as derekh_gone_to_g14:13
dtantsuror was it my mistake, lemme double-check14:13
dtantsurI love the error message: "Failed to start High-performance, schema-free document-oriented database."14:13
dtantsurit sounds awesome14:14
gfidentesounds mongo14:14
gfidentepoor mongo14:14
trownayoung: hrybacki, we could pretty easily rename the repo, it is not being used yet14:15
dtantsur"ERROR: Insufficient free space for journal files" dear TripleO, Y U EATZ AL ZE SPACE??14:15
ayoungtrown, cool.  I just might suggest pulling tripleo out of the name, as the role itself is pretty generic, and could be used in other cases14:15
* dtantsur will better find some snack14:16
ayoungtrown, it comes from our rippowam repo, which was doing a few different things.14:16
EmilienMyeah, mongo should be removed one day14:16
EmilienMit should be deployed on dedicated nodes imho14:16
hewbroccatripleo nom nom *urrp*14:16
EmilienMto be really effective14:16
jidarEmilienM: totally agree14:16
jidarisn't there a project aiming to replace mongo as the ceilometer db?14:17
dtantsursrsly, this is a test machine with next to nothing happening, and I have 128M free of 29G14:17
EmilienMjidar: ceilo suggest mysql afik14:17
jidar:/14:17
jidarno I mean, like a stats specific db format14:17
EmilienMpradk: plans on this^?14:17
pradkthats gnocchi14:18
jidaris gnocchi any better on performance (like say how write heavy mongo is)14:18
pradkgnocchi is the alternate metric backend for ceilometer14:18
dtantsurdo we have an option of disabling both ceilometer and mongo?14:18
pradkjidar, much better as its a time serie db14:18
jidarright, that needs to happen yesterday imho14:19
*** tremble has quit IRC14:19
pradkjidar, well it did as gnocchi has been there since liberty upstream14:19
openstackgerritDougal Matthews proposed openstack/tripleo-common: Remove execution_id from the workflows  https://review.openstack.org/33200314:19
jidarosp8 does this by default? or is it an option or..?14:19
pradkjidar, if its in osp.. its included starting mitaka14:20
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: WIP: Who said we can't use ansible  https://review.openstack.org/33957714:20
trownayoung: so just "anible-role-ipa", I hate naming things, so I will just put whatever you tell me :)14:20
jidarright on14:20
pradkjidar, its in tech preview for osp814:20
dtantsurand of course swift has eaten 8.5G14:20
*** tremble has joined #tripleo14:20
jidarthe thing I'm looking at is I do lots of installs where it's 3 controllers without any other hardware for db and those stats start killing the controllers once we hit 30 compute nodes or so14:21
gfidentepradk, are you telling that with gnocchi going to mysql we can remove mongodb?14:22
pradkgfidente, never said that :)14:22
pradkgnocchi doesnt use mongo14:22
gfidentewhat would we miss?14:22
pradkceilometer does14:23
thrashgfidente: zaqar14:23
gfidenteoh and zaqar right14:23
pradkgnocchi is laternate backend for *metrics* only14:23
pradkalternate*14:23
pradkwe still need mongo for events14:23
pradkwhich should change in newton/ocata where events move to mysql14:23
pradkthen we can get rid of mongo .. hopefully good riddance :)14:24
pradknot sure about zaqar though14:24
*** masco has quit IRC14:24
hewbroccahopefully yes14:24
thrashccamacho: I think your problem may be that you don't have an image with zaqar already installed?14:26
*** lblanchard has quit IRC14:26
*** lblanchard has joined #tripleo14:26
ccamachohey pradk! I have posted the last (I hope) patch for the gnocchi submission. Can you check my tests results to check that the service is working properly?  (https://review.openstack.org/#/c/318413/)14:26
thrashccamacho: check for that first.14:26
*** r2bit has joined #tripleo14:27
ccamachothrash you mean in the overcloud images? to have the puppet code to install it?14:27
thrashccamacho: yes.14:27
thrashccamacho: when did you last build your overcloud images?14:28
ccamachommm :( nope I even have created from scratch the images using puppet submission.. 1 hour ago :(14:28
ccamachothrash ^14:28
thrashccamacho: ok... so not likely then.14:28
thrashccamacho: I ended up with a different error.14:29
thrashtrying to track it down.14:29
ccamachowhich error?14:29
thrashCould not find dependency User[zaqar] for Exec[zaqar-manage db_sync] at /etc/puppet/modules/zaqar/manifests/db/sync.pp:1114:29
ccamachoCreate failed on ControllerLoadBalancerDeployment_Step1?14:29
ccamachoaaa ok, not that one, I'll re-deploy the last changes to check it, hopefully will work :)14:30
thrashccamacho: Currently failing step 314:30
openstackgerritEmilien Macchi proposed openstack/tripleo-puppet-elements: Revert "bump puppet-ceph to stable/hammer"  https://review.openstack.org/33958414:30
ccamachoThat's really good then14:30
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Do not merge - Deploy Ceph Jewel  https://review.openstack.org/33958614:33
ayoungtrown, we can leave it as is.  The big thing to resolve is "where" are we putting the IPA server14:34
openstackgerritMerged openstack/tripleo-heat-templates: Add StepConfig to docker compute-post.yaml  https://review.openstack.org/33049214:34
dtantsurtrown, quick question on quickstart: how friendly is it towards unrelated vms on the same host machine?14:36
EmilienMgfidente, dprince, shardy: when you guys have time, can you look ceilometer services again? passing CI, and upgrade is ok for me https://review.openstack.org/#/c/333498/14:40
openstackgerritDimitri Savineau proposed openstack/tripleo-heat-templates: xinetd: bind only on mysql network  https://review.openstack.org/33959014:40
trowndtantsur: it is very nice to them, it will bring them drinks and snacks14:42
trowndtantsur: in all seriousness though, it will only try to teardown what it is setup to build14:42
EmilienMdprince: I'm going to rebase your patches for puppet-tripleo, because order won't work for your THT patches14:42
EmilienMdprince: let me fix it14:42
trowndtantsur: I run my IRC bouncer from a VM on the same box I run quickstart on14:42
dtantsurtrown, awesome. I have a couple of things on the same machine. my IRC bouncer is right on the host, for example :)14:43
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Add new midonet_agent profile.  https://review.openstack.org/33331914:43
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal registration  https://review.openstack.org/32261214:43
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal introspection  https://review.openstack.org/32778014:43
*** dmsimard is now known as dmsimard|afk14:44
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Midonet for Neutron  https://review.openstack.org/33338714:44
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Neutron Core Compute Plugin  https://review.openstack.org/33831514:44
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Neutron Core Compute Plugin  https://review.openstack.org/33831514:44
dtantsurtrown, now I guess I have to manually kill vms created by instack-virt-setup and their networks/disks/etc, right?14:44
gfidenteI'd like to merge this one https://review.openstack.org/#/c/33349814:45
*** links has joined #tripleo14:45
gfidentespeak now or live with it! :)14:45
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Add new nuage agent profile.  https://review.openstack.org/33826314:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Nuage Compute Plugin  https://review.openstack.org/33847714:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Midonet compute plugin  https://review.openstack.org/33847814:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Plumgrid compute plugin  https://review.openstack.org/33847914:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable OpenContrail compute plugin  https://review.openstack.org/33848014:45
trowndtantsur: ya, probably best... quickstart will put vms under a non-root user too, so it wouldnt find the root ones14:46
EmilienMdprince: ok now order is good and it will pick the patches we need14:46
gfidenteEmilienM, unfortunately we don't have upgrade job anymore though14:46
EmilienMgfidente: right14:46
gfidentebut14:46
EmilienMthat's why we need to be careful with it14:46
EmilienMI tested it but another testing would be great14:46
dtantsurtrown, the final question: there used to be limitations on running quickstart on localhost, is it still true?14:46
dprinceEmilienM: you missed a patch.14:46
EmilienMdprince: which one?14:47
dprinceEmilienM: https://review.openstack.org/#/c/333387/14:47
dprinceEmilienM: my patch series had that too14:47
EmilienMno it's good14:47
EmilienMI wanted to rebase everything on top of https://review.openstack.org/#/c/339544/14:47
dprinceEmilienM: why did you rebase/change the order?14:47
EmilienMbecause zuul cloner won't have picked https://review.openstack.org/#/c/339544/14:47
EmilienMyou need to rebase all puppet-tripleo patches on https://review.openstack.org/#/c/339544/14:48
EmilienMand in THT, you can pick one commit on top its ok14:48
EmilienMbut not before14:48
EmilienMI think it's fine by now14:48
*** tremble has quit IRC14:48
*** pino|work has joined #tripleo14:48
trowndtantsur: it works... though not in the way I would like it to work. Ideally running against localhost will use an ansible local connection and not SSH, but that path has been hard to keep working for $REASONS. You can run it against 127.0.0.2 to trick ansible into using ssh. Note this requires being able to `ssh root@127.0.0.2` without password.14:49
gfidenteactually I spotted an issue we'll have with ipv6 as well14:49
EmilienMgfidente: in ceilo?14:49
* dtantsur tries14:50
gfidenteyeah the CI jobs were nice man14:50
gfidentebut I'd still prefer to merge this14:50
gfidenteand follow-up14:50
*** rajinir has joined #tripleo14:51
*** tremble has joined #tripleo14:51
EmilienMdprince, gfidente: the ceilo patch depends on https://review.openstack.org/#/c/336699/ please <----14:51
ccamachothrash might be possible that "%{hiera('mysql_virtual_ip')}" wasn't returning anything? I think there was the issue..14:54
*** links has quit IRC14:54
EmilienMgfidente: also https://review.openstack.org/#/c/332483/ please14:54
EmilienMgfidente: I'll use it later in my ceilo work14:54
thrashccamacho: I've changed that in the latest rev14:55
ccamachoyeahp and It passed where it was failing  :) , just wanted to understand that line14:57
*** sambetts is now known as sambetts|afk14:57
*** ebarrera has quit IRC15:01
*** skramaja has quit IRC15:02
*** derekh_gone_to_g is now known as derekh15:04
*** gfidente has quit IRC15:04
dprincejistr: hi, so your idea here is what we need I think. But I'm wondering if rather than manifest_entry we could just call this 'service_name'15:06
dprincejistr: https://review.openstack.org/#/c/313544/8/puppet/services/keystone.yaml15:06
socialdprince: I think jistr will be off for next 3 days15:06
dprincesocial: gotcha, thanks15:07
*** gfidente has joined #tripleo15:11
*** chem|away is now known as chem15:11
*** saneax is now known as saneax_AFK15:12
*** jprovazn has quit IRC15:12
*** devvesa has quit IRC15:13
*** pcaruana has quit IRC15:13
EmilienMpradk: when you got time, can you see my questions on https://review.openstack.org/#/c/332504/ please?15:18
derekhslagle: does this screw you over with the multinode job? https://review.openstack.org/#/c/338886/15:20
slaglederekh: it shouldn't; we should be able to setup the vxlan bridges with any private subnet15:22
derekhslagle: also I meant to mention to you earlier, that I also saw upexpected things with puppet when trying to install the undercloud on the ci slave15:23
derekhslagle: so I zapped it all away http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack_ovb.sh#n4215:23
slaglederekh: heh, yea, i added something similar to my patch as well15:24
derekhslagle: I figured starting with no puppet is closer to what user would be doing15:24
slagleyep15:25
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: WIP: Who said we can't use ansible  https://review.openstack.org/33957715:25
pradkEmilienM, sure15:26
*** tesseract- has quit IRC15:27
*** sambetts|afk is now known as sambetts15:28
dtantsurtrown, they only problem with running quickstart on my laptop is that I can't put it inside tmux, close the lid and go away :)15:29
trowndtantsur: ya, that is precicely the issue15:29
trowndtantsur: the 127.0.0.2 trick works though15:29
pradkEmilienM, replied15:30
EmilienMpradk: thx15:30
*** mcornea has quit IRC15:31
*** ifarkas has quit IRC15:32
*** leanderthal is now known as leanderthal|afk15:33
EmilienMpradk: what about pacemaker?15:34
EmilienMpradk: we don't have it on compute nodes15:34
pradkEmilienM, can we expose those central/compute flags in pacemaker class and set them from here15:35
pradkEmilienM, cleanest would be to make the polling agents themselves composable15:36
EmilienMit's going to collapse if compute agent is on same node as other controller services15:36
EmilienMcleanest thing is to drop pacemaker resources for ceilo agent central15:36
EmilienMand we're good15:36
EmilienMisn't supposed to be HA with coordination?15:36
EmilienMbandini: is dropping ceilo agent central from pacemaker in our plans?15:37
*** panda is now known as panda|afk15:38
* bandini reads back15:38
bandiniEmilienM: yes it is not in the NG HA architecture. aka unless it is an active passive service it should run under systemd only15:41
*** rasca has quit IRC15:41
EmilienMbandini: it's an active / active service, and coordinated with Redis clustering15:42
dtantsurtrown, "This script will output instructions at the end to access the deployed undercloud. " it did not :)15:42
bandiniEmilienM: then, unless there are special requirements, it should just run via systemd and point to redis (which still runs via pacemaker)15:43
bandinidoes that answer your question?15:44
EmilienMbandini: yes perfectly, thank you15:44
bandiniack :)15:45
*** abehl has quit IRC15:45
trowndtantsur: ya noticed that during the demo yesterday... want to do me a favor and file a bug at launchpad.net/tripleo-quickstart?15:46
dtantsursure15:46
dtantsurhttps://bugs.launchpad.net/tripleo-quickstart/+bug/160027915:47
openstackLaunchpad bug 1600279 in tripleo-quickstart "quickstart.sh should output information on connecting to undercloud" [Undecided,New]15:47
trowndtantsur: if you did not provide any --working-dir argument, then `ssh $HOME/.quickstart/ssh.config.ansible undercloud` will get you to the undercloud15:49
trowndtantsur: and if you did, replace $HOME/.quickstart with whatever you used15:49
dtantsuryeah.. now I wonder how to run my ansible playbooks on it...15:49
dtantsurthis does not work: ansible-playbook configure.yml -i undercloud, --ssh-common-args "-F ~/.quickstart/ssh.config.ansible"15:49
dtantsuroh, it just didn't like ~/15:50
trowndtantsur: does your configure.yml need to run before installing the undercloud or importing nodes? quickstart stops later than that by default, but it can be changed with tags15:52
dtantsurtrown, it's just my personal tooling for configuring various things: https://github.com/dtantsur/config/blob/master/configure.yml :)15:52
dtantsurnothing openstack-related at all15:52
trownoh neat15:53
*** weshay is now known as weshay_afk15:54
trownthat vim youcompleteme plugin looks pretty useful, never tried taht15:56
dtantsuryeah, it's nice15:56
*** abehl has joined #tripleo15:58
derekhWe got 6 test env workers (out of 15) doing a good impression of sleeping beauty16:03
derekhCan somebody take a look at this to prevent the problem https://review.openstack.org/#/c/338394/16:04
shardyderekh: +2, feel free to merge if you're confident we can ignore the ci failures16:09
openstackgerritMerged openstack-infra/tripleo-ci: Remove sleeps if testenv create/destroy fails  https://review.openstack.org/33839416:09
derekhshardy: thanks, ci doesn't touch anything in that directory16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028116:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]16:10
EmilienMderekh: nice spot ^16:12
EmilienMtrown: about the bug ^ we need mitaka promotion or something16:12
trownEmilienM: tripleo-ci uses current for stable16:13
derekhEmilienM: thanks, I havn't done anything about it though, I'll leave it to ye guys ;-)16:13
trownso promotion wont fix anything on stable16:13
trownEmilienM: but that same issue is preventing promotion16:14
trownEmilienM: I think it might have been https://github.com/openstack/neutron/commit/873ae308d02e1f3d4be53405b1d56960d9cb456516:14
trownah ya, derek mentioned that in the bug16:15
openstackgerritStephanie Miller proposed openstack/diskimage-builder: Make Fedora 24 the default  https://review.openstack.org/33968116:15
derekhEmilienM: trown maybe we're just not packaging an api subdir or something http://paste.openstack.org/show/528620/16:17
*** rcernin has quit IRC16:18
trownderekh: it is being discussed in #rdo16:19
trownseems like a bad backport upstream because " [12:13:19] <amoralej> neutron_lib in stable/mitaka doesn't provides neutron_lib.api"16:19
derekhtrown: ok16:19
amoraleji'm about to open the bug in lp16:19
*** osp has quit IRC16:20
trownamoralej++ https://bugs.launchpad.net/tripleo/+bug/1600281 is the tripleo bug, could just add neutron to that16:20
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]16:20
amoralejthanks trown!16:20
*** pcaruana has joined #tripleo16:21
*** mgould is now known as mgould|afk16:23
*** yamahata has quit IRC16:25
derekhDoes mitaka not install cronjobs to purge old DB entries?16:26
trowndo we even have that on master?16:29
derekhtrown: I was sure I saw reviews for it a long time ago16:30
derekhtrown: or maybe it was just in the puppet modules16:31
*** pcaruana has quit IRC16:31
EmilienMderekh: not in neutron16:31
EmilienMderekh: only in nova & heat afik16:31
EmilienMand not overcloud iirc16:32
*** lucasagomes is now known as lucas|afk16:32
*** shivrao_ has joined #tripleo16:32
shardydprince, rbrady: Hey so I got to the bottom of my problems testing mistral based tripleoclient16:32
shardyIt looks like there are two problems:16:33
*** maeca1 has quit IRC16:33
derekhEmilienM: ok16:33
rbradyshardy: problems?16:33
shardy1 - If a mistral workflow execution fails, we don't post any error back to tripleoclient, so it just hangs forever on the websocket16:33
shardy2 - there seems to be a packaging issue, because the new actions aren't included in openstack-tripleo-common?16:33
dprinceshardy: yes, we have ideas to fix this16:33
shardyThe root cause is I'm missing action_name=tripleo.register_or_update_nodes, which just makes things hang16:34
shardyit wasn't until I dug into mistral that I realized what the issue was16:34
shardyrbrady: Yeah, I've been trying to test https://review.openstack.org/#/c/322612/ locally16:36
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Update overcloud passwords on update command  https://review.openstack.org/33821316:37
openstackgerritgreghaynes proposed openstack/diskimage-builder: Create smart caching around debootstrap  https://review.openstack.org/33970316:37
*** dtantsur is now known as dtantsur|afk16:38
*** gfidente has quit IRC16:38
derekhOne week into using RH2 we've burned through 7432 instances and about 1000 heat stacks16:39
hewbroccago us!16:39
shardyHmm, rebuilding tripleo-common locally with delorean appears to get the actions, but the version from delorean-current doesn't have them16:40
shardymaybe my repos are messed up16:40
hewbroccashardy: hey I wonder how much faster CI would go if we upgraded the heat-engine with all sbaker's performance improvements16:40
hewbroccaActually I dunno if Heat is really the bottleneck here...16:40
shardyhewbrocca: We should already have most of them I think, provided we promoted the current-tripleo pin recently16:41
hewbroccaxlnt16:41
shardymostly they help with very large stacks tho, so not so much impact on CI16:41
shardyit all helps tho I guess :)16:41
hewbroccaWhat OpenStack is the base cloud running, Mitaka?16:41
derekhhewbrocca: yup, RDO mitaka16:41
shardyAh, yeah, so that won't have the heat fixes16:42
derekhhewbrocca: creating the ovb stack is less then a minute of the overall time16:42
shardyif it's lots of small stacks it probably doesn't matter much tho16:42
hewbroccaOK, so not that big a deal16:42
hewbroccaright16:42
*** tzumainn has quit IRC16:42
derekhhewbrocca: and most of that is probably spent waiting for instances to spawn16:42
shardyrbrady: what do I run to update the mistral actions after upgrading tripleo-common?16:45
shardyI see 98-undercloud-setup updates the workflows, but what registers the actions?16:45
shardymistral action-list | grep tripleo gives me nothing atm16:45
openstackgerritgreghaynes proposed openstack/diskimage-builder: Create smart caching around debootstrap  https://review.openstack.org/33970316:45
rbradyshardy: see commands at bottom of https://github.com/openstack/tripleo-common/blob/master/README.rst16:46
shardyrbrady: what runs those during an undercloud upgrade?16:46
shardydo we need to add them to 98-undercloud-setup or puppet?16:46
rbradyshardy: I think they need to be added somewhere.16:47
shardyHow does this pass CI if the packages/puppet don't set this up?16:47
*** jdob has quit IRC16:48
shardyOk so sudo mistral-db-manage populate is all I need to read the packaged actions16:48
shardythanks!16:48
rbradyshardy: it's run on install.  doesn't update run same script for instack-undercloud package?16:48
shardyrbrady: where's it run?  I don't see anything in 98-undercloud-setup or rpm -q --scripts16:50
shardypossibly I'm missing something, I didn't re-run the whole undercloud install after upgrading tripleo-common16:51
rbradyshardy: https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.pp#L49616:52
shardyrbrady: aha, thanks16:52
shardyIt might be nice if we moved things so all the mistral init stuff happens in one place16:53
*** derekh has quit IRC16:53
*** tosky has quit IRC16:53
shardyyay, RUNNING sub-workflow :)16:53
shardythanks rbrady!16:54
rbradyshardy: np16:54
*** dmsimard|afk is now known as dmsimard16:54
shardyhrm, they all comleted but tripleoclient is still hung on the websocket16:55
*** tremble has quit IRC16:55
*** yamahata has joined #tripleo16:57
shardyOk restarting zaqar fixes that16:57
shardyAll this looks OK but I think the error paths need some more work..16:58
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477717:02
*** trown is now known as trown|lunch17:03
*** jprovazn has joined #tripleo17:05
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028117:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]17:10
*** egafford has quit IRC17:13
*** egafford1 has joined #tripleo17:13
*** shivrao_ has quit IRC17:13
*** rcernin has joined #tripleo17:20
*** rcernin has quit IRC17:20
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: [WIP] Add 'openstack overcloud node import' command  https://review.openstack.org/33972717:20
*** chandankumar has quit IRC17:22
*** weshay_afk has quit IRC17:22
*** rcernin has joined #tripleo17:24
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add backports and updates to debootstrap cache  https://review.openstack.org/33973017:26
*** abehl has quit IRC17:31
*** aufi has quit IRC17:33
*** jpich has quit IRC17:33
*** Goneri has quit IRC17:41
*** abehl has joined #tripleo17:44
*** pkovar has quit IRC17:44
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers  https://review.openstack.org/22277217:45
*** chandankumar has joined #tripleo17:50
*** dprince has quit IRC17:50
*** amoralej is now known as amoralej|off17:52
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add backports and updates to debootstrap cache  https://review.openstack.org/33973017:55
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477717:56
*** Goneri has joined #tripleo17:57
*** mbound has quit IRC17:59
*** shivrao has joined #tripleo18:01
*** hewbrocca is now known as hewbrocca-afk18:01
*** abehl has quit IRC18:02
*** Goneri has quit IRC18:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028118:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]18:10
*** rhallisey has quit IRC18:12
*** akshai has joined #tripleo18:13
*** abehl has joined #tripleo18:14
*** akshai__ has joined #tripleo18:15
*** akshai_ has quit IRC18:15
*** jprovazn has quit IRC18:15
*** jprovazn has joined #tripleo18:15
*** akrivoka has quit IRC18:17
*** akshai has quit IRC18:18
*** Goneri has joined #tripleo18:21
*** trown|lunch is now known as trown18:22
*** electrofelix has quit IRC18:33
*** fragatin_ has quit IRC18:34
*** fragatina has joined #tripleo18:35
*** pcaruana has joined #tripleo18:37
radezanyone know where I can find logs to troubleshoot why a machine doesn't power cycle when I deploy?18:43
radezit introspects fine if I execute introspection manually18:43
radezI checked the ironic logs but there wasn't anything interesting in them18:44
slagleironic-conductor.log would be the most likely place to look really18:46
slagleother than that, you could check out the node itself18:47
slaglesometimes ipmi controllers get stuck, or idracs don't respond, etc18:47
slagledepending on what power driver you're using, try grepping the ironic logs for the command associated with that driver18:48
slaglee.g., for ipmi, grep for ipmitool18:48
slaglefind the command it ran for the misbehaving node, and try running it manually18:49
radezkk thx slagle18:49
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477718:52
*** mbound has joined #tripleo18:59
*** jdob has joined #tripleo19:01
*** jprovazn has quit IRC19:04
*** mbound has quit IRC19:04
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028119:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]19:10
*** derekh has joined #tripleo19:15
openstackgerritJames Slagle proposed openstack/instack-undercloud: Make Ironic httpd port configurable via hiera  https://review.openstack.org/33977719:16
EmilienMany chance to get review on https://review.openstack.org/#/c/333319/ and https://review.openstack.org/#/c/339544/ please ?19:16
EmilienMslagle: nice spot on https://review.openstack.org/#/c/339777/ o_O19:17
openstackgerritJames Slagle proposed openstack/instack-undercloud: Make Ironic httpd port configurable via hiera  https://review.openstack.org/33977719:17
*** lblanchard has quit IRC19:21
openstackgerritBen Nemec proposed openstack/tripleo-docs: Group advanced topics by type  https://review.openstack.org/33523219:23
derekhslagle: I'm going to make the infra images public now on rh2, then I'll figure out what magic options are needed to boot them, so glean does its thing19:23
slaglederekh: alrighty19:23
*** lblanchard has joined #tripleo19:23
ayoungjmiu, so I was able to run the FreeIPA server on the undercloud node, but getting there was ugggggleeeeeeey19:27
openstackgerritMerged openstack/puppet-tripleo: Use include for base neutron profile  https://review.openstack.org/33954419:28
slaglederekh: fyi, i submitted https://review.openstack.org/339777 as well so we can stop killing the telnet server19:29
openstackgerritMerged openstack/puppet-tripleo: Add new midonet_agent profile.  https://review.openstack.org/33331919:29
slaglewill need a corresponding tripleo-ci patch to set some additional hiera19:29
ayounghttp://adam.younglogic.com/2016/07/merge-freeipa-undercloud-apache/19:30
openstackgerritMerged openstack/puppet-tripleo: Fix Ceilometer profiles  https://review.openstack.org/33669919:30
*** fzdarsky is now known as fzdarsky|afk19:30
openstackgerritMerged openstack/tripleo-heat-templates: Composable Midonet for Neutron  https://review.openstack.org/33338719:37
derekhslagle: cool, nice one19:39
jmiuhow 'ugggggleeeeeeey' is it?19:39
jmiuayoung: oh, i see the link. although19:39
jmiuayoung: isn't it bad, since we're establishing a (sort of) dependency on undercloud from overcloud?19:40
derekhslagle: ok, the tripleo-user tenant can now see the infra generated images, and we have a cronjob on the undercloud setting them every hour to public19:40
derekhslagle: I'll let you know once I get one booted and ssh'd into19:40
ayoungjmiu, so,  not really.  The underneeds to be available only to affect changes19:40
ayounganything that is an IPA client will only depend on the undercloud to be up if we do Kerberos.  If we are doing X509, then it only needs to be up to issue new certs19:41
ayoungjmiu, I see this as one of several potential solutions. Having IPA on a separate node, like you are investigating, works best as along term solution, but might not be practical for a resource constrained developer19:42
ayoungI see 2 use cases for IPA:  1. user a pre-existing one and 2. I don't have one, and I need to install a cluster19:43
openstackgerritBen Nemec proposed openstack/python-tripleoclient: Deprecate fedora-user image type  https://review.openstack.org/33177319:43
ayounginstalling IPA on an external node covers the second use case, and will make it clear how to solve the first one in a similar manner19:43
jmiuayoung: ah, ok.19:45
*** Goneri has quit IRC19:45
openstackgerritBen Nemec proposed openstack/tripleo-docs: Add Liberty and Mitaka admonitions and use them  https://review.openstack.org/33080219:52
*** fzdarsky|afk has quit IRC19:56
*** rhallisey has joined #tripleo19:57
*** shivrao has quit IRC20:01
*** shivrao has joined #tripleo20:04
*** jeckersb is now known as jeckersb_gone20:05
*** chandankumar has quit IRC20:07
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028120:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]20:10
*** mbound has joined #tripleo20:11
*** dprince has joined #tripleo20:14
*** mbound has quit IRC20:15
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477720:33
*** jeckersb_gone is now known as jeckersb20:40
*** jayg is now known as jayg|g0n320:40
*** shardy has quit IRC20:44
*** jdob has quit IRC20:45
*** trown is now known as trown|outtypewww20:49
EmilienMif someone can approve this one: https://review.openstack.org/#/c/338263/20:50
*** rcernin has quit IRC20:52
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477720:57
openstackgerritBen Nemec proposed openstack/diskimage-builder: Generalize logic for skipping final image generation  https://review.openstack.org/33404221:00
openstackgerritBen Nemec proposed openstack/diskimage-builder: Don't create an ironic-agent image just to delete it  https://review.openstack.org/33982021:00
openstackgerritMerged openstack/puppet-tripleo: Add new nuage agent profile.  https://review.openstack.org/33826321:02
openstackgerritJames Slagle proposed openstack/instack-undercloud: Make Ironic httpd port configurable via hiera  https://review.openstack.org/33977721:06
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028121:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]21:10
openstackgerritDan Prince proposed openstack/instack-undercloud: Introduce 'enable_validations' option  https://review.openstack.org/32289321:13
*** dsneddon has quit IRC21:14
*** fultonj has quit IRC21:17
*** florianf has quit IRC21:19
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477721:36
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add backports and updates to debootstrap cache  https://review.openstack.org/33973021:36
*** lblanchard has quit IRC21:44
openstackgerritgreghaynes proposed openstack/diskimage-builder: Make baseline-tools use pkg-map  https://review.openstack.org/33983421:48
*** dprince has quit IRC21:53
*** pradk has quit IRC21:54
*** akshai has joined #tripleo21:54
*** ayoung has quit IRC21:55
*** myoung is now known as myoung|afk21:56
*** akshai__ has quit IRC21:56
*** isq has quit IRC21:58
*** isq has joined #tripleo21:58
*** pradk has joined #tripleo22:00
*** myoung|afk has quit IRC22:08
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028122:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]22:10
*** derekh has quit IRC22:10
*** davidlenwell has quit IRC22:12
*** rbrady has quit IRC22:16
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Gnocchi composable roles  https://review.openstack.org/31841322:18
*** yamahata has quit IRC22:18
*** davidlenwell has joined #tripleo22:22
*** ChanServ sets mode: +v davidlenwell22:22
*** rbrady has joined #tripleo22:29
*** Goneri has joined #tripleo22:29
*** thrash is now known as thrash|wknd22:32
*** alop has quit IRC22:35
*** pradk has quit IRC22:39
*** rlandy has quit IRC22:44
*** derekh has joined #tripleo22:46
openstackgerritDan Sneddon proposed openstack/os-net-config: Add adapter teaming support using teamd for ifcfg-systems  https://review.openstack.org/33985422:50
derekhslagle: once these merge I we should be able to use the image nodepool uploads to rh2 https://review.openstack.org/#/c/339855/ https://review.openstack.org/#/c/339856/22:53
*** egafford1 has quit IRC23:04
*** egafford has joined #tripleo23:05
*** egafford has left #tripleo23:06
*** derekh has quit IRC23:07
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028123:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]23:10
*** ebalduf has joined #tripleo23:10
*** saneax_AFK is now known as saneax23:12
openstackgerritDan Sneddon proposed openstack/os-net-config: Add adapter teaming support using teamd for ifcfg-systems  https://review.openstack.org/33985423:23
*** rhallisey has quit IRC23:27
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477723:30
*** jcoufal has quit IRC23:36
*** greghaynes has quit IRC23:46
*** Goneri has quit IRC23:54
*** greghaynes has joined #tripleo23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!