Friday, 2016-08-05

*** bana_k has quit IRC00:17
*** sarath has quit IRC00:19
*** bana_k has joined #tripleo00:19
*** limao has joined #tripleo00:25
*** chlong has quit IRC00:32
*** mburned is now known as mburned_out00:34
*** r-mibu has quit IRC00:35
*** r-mibu has joined #tripleo00:40
*** dmacpher has joined #tripleo00:43
*** rhallisey has joined #tripleo00:43
*** maeca1 has quit IRC00:47
*** bana_k has quit IRC00:50
*** tbonds has joined #tripleo01:03
*** ayoung has joined #tripleo01:07
*** jcoufal has joined #tripleo01:13
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: tripleo update job testing - do not merge  https://review.openstack.org/35138901:25
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699501:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355601:52
*** fzdarsky_ has joined #tripleo01:56
*** fzdarsky has quit IRC01:59
*** rhallisey has quit IRC02:05
*** myoung is now known as myoung|afk02:06
*** yamahata has quit IRC02:07
*** mburned_out is now known as mburned02:08
*** myoung|afk is now known as myoung02:10
*** fragatina has joined #tripleo02:12
*** ebalduf has quit IRC02:17
*** maeca1 has joined #tripleo02:22
*** fragatina has quit IRC02:27
*** julim has joined #tripleo02:28
*** yamahata has joined #tripleo02:49
*** rasca has quit IRC02:50
*** rasca has joined #tripleo02:50
*** bana_k has joined #tripleo03:04
*** ebalduf has joined #tripleo03:15
*** yamahata has quit IRC03:18
*** liverpooler has quit IRC03:20
*** ayoung is now known as ayoung_ZZZzzz03:26
*** julim has quit IRC03:31
*** dmacpher has quit IRC03:48
*** chlong has joined #tripleo03:49
*** dmacpher has joined #tripleo03:50
*** jdob has quit IRC04:01
*** jcoufal has quit IRC04:02
*** rlandy has quit IRC04:08
*** numans has joined #tripleo04:16
*** fragatina has joined #tripleo04:27
*** fragatina has quit IRC04:31
*** limao has quit IRC04:31
*** limao has joined #tripleo04:32
*** dhill_ has quit IRC04:38
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Enable SSL for ironic inspector  https://review.openstack.org/33264104:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Refactor endpoint env variable population  https://review.openstack.org/35039604:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Revert "glance: disable swift backend"  https://review.openstack.org/34984304:44
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add zaqar API endpoint in HAProxy  https://review.openstack.org/35105204:44
*** jaosorior has joined #tripleo04:45
openstackgerritMerged openstack/tripleo-heat-templates: Move per-role *SchedulerHints parameters into role templates  https://review.openstack.org/34726204:51
*** jaosorior has quit IRC04:51
*** jaosorior has joined #tripleo04:52
*** jaosorior has quit IRC04:54
*** jaosorior has joined #tripleo04:55
*** jaosorior has quit IRC05:14
*** jaosorior has joined #tripleo05:15
*** dmacpher has quit IRC05:15
*** maeca1 has quit IRC05:17
*** jaosorior has quit IRC05:17
*** dmacpher has joined #tripleo05:18
*** jaosorior has joined #tripleo05:18
*** rcernin has joined #tripleo05:31
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-docs: Document using CA certificate instead of self-signed  https://review.openstack.org/35148905:35
*** links has joined #tripleo05:36
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-docs: Document using CA certificate instead of self-signed  https://review.openstack.org/35148905:38
*** radek_ has joined #tripleo05:38
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-docs: Document using CA certificate instead of self-signed  https://review.openstack.org/35148905:40
*** limao_ has joined #tripleo05:42
*** limao has quit IRC05:45
*** mcornea has joined #tripleo05:47
*** pgadiya has joined #tripleo05:57
*** chem has joined #tripleo06:00
*** chlong has quit IRC06:08
*** aufi has joined #tripleo06:09
*** coolsvap has joined #tripleo06:14
jaosoriormarios: I've been seeing a lot of "Error registering nodes" stuff lately. Any idea what's up?06:20
d0ugalMorning06:23
jaosoriord0ugal: Hey dude, what's up?06:24
d0ugaljaosorior: Just waking up :)06:24
mariosjaosorior: not seen that mate but haven't deployed master in a while06:29
jaosoriormarios: Been seeing it in CI06:29
*** chlong has joined #tripleo06:40
*** dculik has joined #tripleo06:41
*** dculik is now known as dculik|06:41
*** dculik| is now known as dculik06:41
*** jtomasek has joined #tripleo06:44
*** ebalduf has quit IRC06:50
*** chlong has quit IRC06:52
d0ugaljaosorior: Do you have a link to one with that error?06:53
jaosoriord0ugal https://review.openstack.org/#/c/350396/06:57
jaosoriord0ugal also https://review.openstack.org/#/c/349843/06:57
d0ugaljaosorior: hrm, interesting. Seems to be an Ironic thing.06:59
d0ugalI've never hit a locked node before.06:59
*** radek_ is now known as radeks07:05
*** radeks has quit IRC07:10
*** radeks has joined #tripleo07:12
*** saneax_AFK is now known as saneax07:12
*** paramite has joined #tripleo07:14
*** bana_k has quit IRC07:21
*** panda|zz is now known as panda07:24
*** jpena|off is now known as jpena07:26
*** ebarrera has joined #tripleo07:32
*** gfidente has joined #tripleo07:32
*** flaper87 has joined #tripleo07:36
*** flaper87 is now known as Guest7354807:36
*** jpich has joined #tripleo07:39
*** dmacpher has quit IRC07:43
*** shardy has joined #tripleo07:55
*** dtantsur|afk is now known as dtantsur07:56
jaosoriorAnybody has time to review some doc change? https://review.openstack.org/#/c/351489/07:56
mariosjaosorior: ack in a bit07:57
*** ohamada has joined #tripleo07:58
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Reflect what the certificate generation options actually do  https://review.openstack.org/35155208:00
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Update help text for certificate generation options  https://review.openstack.org/35155208:01
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: parameters  https://review.openstack.org/35155408:03
*** openstackgerrit has quit IRC08:03
*** openstackgerrit has joined #tripleo08:03
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Use inline-source-map to enable source maps in karma tests  https://review.openstack.org/35155708:08
*** pkovar has joined #tripleo08:09
*** leanderthal|afk is now known as leanderthal08:09
*** radeks has quit IRC08:11
*** jaosorior has quit IRC08:13
*** stendulker has joined #tripleo08:14
*** shardy has quit IRC08:14
*** jaosorior has joined #tripleo08:14
*** shardy has joined #tripleo08:14
*** tesseract- has joined #tripleo08:16
*** Goneri has joined #tripleo08:16
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Add enable_proxy_headers_parsing option for keystone and glance  https://review.openstack.org/35156208:18
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/tripleo-quickstart: [WIP] undercloud reboot  https://review.openstack.org/35048908:20
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add passing of X-Forwarded-Proto to Glance API endpoint  https://review.openstack.org/35156808:24
jaosoriormarios: Which was the nit?08:27
openstackgerritMarek Aufart proposed openstack/tripleo-docs: Add note with boot config image options  https://review.openstack.org/33607808:27
*** lucas|dinner is now known as lucasagomes08:28
*** chem has quit IRC08:30
*** chem has joined #tripleo08:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: [WIP] Parameters listing and updating  https://review.openstack.org/35155408:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Environments Listing and Updating using Mistral Actions  https://review.openstack.org/35058608:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Stop Validation  https://review.openstack.org/33656108:31
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Triggering validations and messaging  https://review.openstack.org/33656008:31
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: List Validations and Validation results  https://review.openstack.org/33477008:31
*** d0ugal has quit IRC08:32
*** chem has quit IRC08:32
*** d0ugal has joined #tripleo08:33
mariosjaosorior: "this purposes"08:33
openstackgerritMerged openstack/tripleo-docs: Document using CA certificate instead of self-signed  https://review.openstack.org/35148908:33
*** d0ugal has quit IRC08:33
*** d0ugal has joined #tripleo08:33
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-docs: Fix nit in SSL documentation  https://review.openstack.org/35157508:35
jaosoriormarios: Done ^^08:35
mariosheh sry, should have let you fix the first one :)08:36
d0ugaljtomasek: Thanks for your comment on https://review.openstack.org/#/c/351111/ - I think that sounds like a reasonable plan.08:36
d0ugaljtomasek: fwiw, I never expected that patch to land, I just wanted something to unblock the testing. Thinking about it properly now.08:37
d0ugalshardy: I'd be interested in your input on ^08:37
*** Guest73548 is now known as flaper8708:39
*** flaper87 is now known as Guest7864108:39
jtomasekd0ugal: yeah, after the discussion yesterday, things are changed a bit though. question is the UpdatePlan action. According to the discussion the client should interact directly with swift to upload files to container08:39
*** jbadiapa has joined #tripleo08:39
jtomasekd0ugal: IOW GUI won't probably be able to use such mistral action unless that action is going to accept json in format {[filename: filecontent, ...]}08:40
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Enable TLS for Zaqar API  https://review.openstack.org/35157608:42
jtomasekd0ugal: so in your specific usecase CLI client would get files to swift container by directly calling swift api and then run update_capabilities action to enable those for deployment08:42
*** Guest78641 has quit IRC08:44
shardyd0ugal, jtomasek: Yeah the requirements for the CLI and UI are a little different, but I think the workflow is basically the same08:47
shardye.g I've already been modifying plans just by pushing changes directly via swiftclient08:48
shardythat's one of the nice things about using swift for the plan storage08:48
shardyI guess we can wrap that in an action to update the plan if it will be helpful08:48
shardymaybe add some validation as part of that process etc08:48
jtomasekwrapping it in action would be nice (since we could put it in a workflow), but there is that problem of GUI not being able to supply files to mistral api call08:50
shardyjtomasek: so, are you saying that all environments should only be available via the capabilities map?08:50
shardyin https://review.openstack.org/#/c/35111108:51
shardyI don't really see that as specific to backwards compatibilty, it's just a reflection of how heat (and thus TripleO) works08:51
jtomasekshardy: no, no, capabilities-map is used only for listing08:52
shardyjtomasek: Ok, so it's just about being able to may any modification to the plan08:52
shardyI'm +1 on some means to do UpdatePlan, but we do need a way to also update the mistral environment that contains the list of environments08:53
shardysince that is the list that gets passed to heat08:53
shardymaybe an update plan action could take a list of environment_files, and also references to the files (not necesarily only environment files) that are to be updated/added08:54
d0ugaljtomasek: The action I wrote accepts JSON at the moment.08:54
shardythat fits quite well with the underlying heat API calls08:54
jtomasekshardy: yeah as I described in the review, to suport -e <some_environment> in deploy command, you need to perform 2 things - upload that file to swift container and enable that environment for deployment08:54
shardyjtomasek: yeah, but -e <some_environment> might also require adding some new templates, not only the environment file08:55
shardyI think I get it now08:55
jtomasekenabling environment happens using update_capabilities action (the action name is confusing. it should be called update_environments)08:55
d0ugaljtomasek: Do we also need to add it to the capabilities map for the GUI? or will it discover enabled environments?08:55
jtomasekd0ugal: currently not, get_capabilities (action taking care of listing environments) lists only environments listed in capabilities-map. we'd need to udpate it to also add an additional group of environments that are in the plan but not listed in capabilities map08:56
shardyOr, we could update capabilities map with references to user environments08:57
jtomasekshardy: you mean changing the capabilities-map.yaml directly in container?08:57
shardyjtomasek: yes, that seems like it would be one option08:58
shardyor generate another file that can easily be merged with the initial capabilities-map08:58
shardyI suppose it doesn't matter if we store it or genrate that data in an action08:59
*** pkovar has quit IRC08:59
jtomasekshardy: hm, only thing is that in general we've been avoiding to manipulate template files08:59
jtomasekshardy: capabilities-map is only a helper thing, so I'd try to avoid basing logic on it because it will be harder to remove it after environment metadata are implemented09:00
shardyOk, I'm just trying to think of ways we can minimise the impact on the UI09:00
jtomasekshardy: from that POW appending the 'User provided' 'Topic' to the output of capabilities map in get_capabilities action seems simplest solution to me09:01
*** chem has joined #tripleo09:02
jtomasekand when environment metadata is implemented, then the get_capabilities will be totally simple (or even replaced by direct Heat api call)09:03
jtomasekwhich matches the goal of replacing the standalone actions by OpenStack apis calls if possible09:04
d0ugalso get_capabilities merges the user-envs and the capabilities map?09:04
d0ugalmerges them in the response I mean, not in swift.09:04
jtomasekd0ugal: currently it goes throught capabilities map and creates json response that matches the capabilities-map structure (topic > environment_group > environment)09:05
jtomasekd0ugal: so we need to update it so, that it will append one more 'Topic' which will include environments which have path of 'user-envinronments/<environment-name>.yaml09:06
d0ugaljtomasek: Sounds good.09:06
jtomasekhaving the environment metadata would be so cool:)09:07
shardyYeah, the discussion on that has been slow - I'll see if I can revive it, perhaps we can at least get descriptions added for newton09:08
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Enable TLS for Zaqar API  https://review.openstack.org/35157609:08
jtomasekshardy: I thing the biggest part would be implement heat api call that would return list of environments with its 'meta' in json. right?09:09
jtomasekshardy: with that in place, what is in 'meta' section is kind of relevant09:09
shardyjtomasek: well, it's tricky - I don't think a generic metadata key will be accepted by the heat community09:11
jtomasekshardy: I see09:11
shardywe can start by adding a description, but the difficult part will be expressing the "requires" stuff09:11
shardyI proposed a spec which would help with that, but some folks in the community weren't very supportive about it09:12
shardyhttps://github.com/openstack/heat-specs/blob/master/specs/mitaka/resource-capabilities.rst09:12
shardyI'd suggest we try to break the requirements down and approach it step by step09:12
shardydescription, then grouping, then dependencies09:12
jtomasekshardy: ok, makes sense. Label and description would be ideal start...09:13
shardyjtomasek: ack, I'll see if I can push some patches that add the description as I think that idea was basically accepted09:15
*** Goneri has quit IRC09:15
d0ugaljtomasek, shardy - I am a bit unsure how to proceed. get_capabilities will return the user envs too, that is fine. but are we having clients manually add envs? or am I keeping something similar to the action I wrote?09:16
d0ugaland they don't need to be added to the capabilities map, right?09:17
*** Ryjedo_ has joined #tripleo09:17
d0ugalJust trying to summarise the above discussion.09:17
shardyd0ugal: my understanding is that your current patch needs to be extended to also allow updating the plan to add template files09:17
*** Ryjedo has quit IRC09:17
*** Ryjedo_ is now known as Ryjedo09:17
shardybecause sometimes adding an environment will mean it references new template files09:17
shardyjtomasek: would that address your concerns?09:18
*** Goneri has joined #tripleo09:18
shardyand maybe it does become named UpdatePlanAction or something09:18
jtomasekshardy: yeah, I meant to make that action more generic so it handles any file input (templates and environments)09:19
d0ugalOkay, cool, happy to do that.09:19
d0ugalshardy: Would it just accept "files"? How would I know which are environments?09:20
shardyd0ugal: Yeah I think it needs to accept a map of files09:20
shardyand also a list of environment_files09:21
d0ugalwhich refers to that map? cool09:21
shardyso you know which are to be added to the environment list in the mistral environment09:21
shardyyeah09:21
d0ugalshardy: How do you add extra templates with the CLI now?09:21
shardythat's basically exactly how the heat API works09:21
shardyd0ugal: tripleoclient calls some heatclient code (same stuff we use in the process templates action)09:21
shardywhich walks the environment and files, then adds all files to a big "files" map, that is then passed in to the heat API09:22
openstackgerritHonza Pokorny proposed openstack/tripleo-common: Add node tagging workflow  https://review.openstack.org/33213209:23
d0ugalshardy: ah, of course. I forgot you could reference templates that way. thanks09:23
d0ugalOkay, so I still need to call the template processing in the CLI09:23
shardywe have to mirror that process, because we're duplicating the local files in swift before doing that templates heatclient pass09:23
shardyHmm09:24
shardyyeah, but if you're going to do that then it almost makes more sense to resolve all the local files, then upload the lot to the plan09:25
* shardy needs to have some tea and thing about this09:25
shardydo whatever works for now, we can always optimize later09:25
*** abehl has joined #tripleo09:30
d0ugalshardy: I think we need to run it locally for bacwards compat, otherwise users will give us an env and we will be missing the templates.09:30
shardyyeah09:31
*** jbadiapa has quit IRC09:31
shardyMy point was you don't need an UpdatePlan action if you do that09:31
shardyyou just upload everything when you create the plan09:31
d0ugalshardy: right, that is a good point.09:35
d0ugalIn my head this was all "after plan creation" but it might be easier to switch it around09:36
*** saneax is now known as saneax_AFK09:39
*** flaper87 has joined #tripleo09:40
*** flaper87 has joined #tripleo09:40
*** mgould|afk is now known as mgould09:40
*** limao_ has quit IRC09:41
*** jbadiapa has joined #tripleo09:45
*** amoralej is now known as amoralej|brb09:46
*** saneax_AFK is now known as saneax09:48
*** jbadiapa has quit IRC09:54
*** jcoufal has joined #tripleo10:00
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Fix parameters and headers inconsistency in the puppet manifests.  https://review.openstack.org/35162510:02
*** amoralej|brb is now known as amoralej10:06
*** akrivoka has joined #tripleo10:23
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Fix parameters and headers inconsistency in the puppet manifests.  https://review.openstack.org/35162510:25
*** Goneri has quit IRC10:29
*** Goneri has joined #tripleo10:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Support arbitrary attributes for the Ceph pools  https://review.openstack.org/34679610:34
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Remove the obsolete rebuild-inventory role  https://review.openstack.org/34891710:34
jaosoriorHey guys, quick CR just updating some help text from a command option https://review.openstack.org/#/c/351552/10:35
jaosoriorBy the way10:38
jaosoriordo people need reviews?10:38
shardyjaosorior: Yes https://review.openstack.org/#/c/347263/ https://review.openstack.org/#/c/347264 are passing CI and ready to land I think10:41
*** ebarrera has quit IRC10:42
shardythere are a couple more in that chain which are ready for review, but I need to recheck until green10:42
*** tosky has joined #tripleo10:43
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Fix parameters and headers inconsistency in the puppet manifests.  https://review.openstack.org/35162510:44
jaosoriorshardy: Aren't the flavors used by tripleoclient somewhere? https://review.openstack.org/#/c/347265/310:44
*** ebarrera has joined #tripleo10:45
shardyjaosorior: Yes, which is why I maintained the parameter names in the role templates10:45
openstackgerritMerged openstack/instack-undercloud: Update help text for certificate generation options  https://review.openstack.org/35155210:45
shardywe pass everything via parameter_defaults, so it should be backwards compatible10:45
openstackgerritMerged openstack/tripleo-heat-templates: Remove KeyName parameter from overcloud template  https://review.openstack.org/34726310:46
gfidentedo you guys know how to cope with dlrn errors? http://logs.openstack.org/12/348412/8/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/37de8f2/console.html#_2016-08-05_10_27_35_38122810:47
openstackgerritMerged openstack/tripleo-heat-templates: Move *Image parameters into role templates  https://review.openstack.org/34726410:47
gfidentelooks like it can't build python-tripleoclient now?10:47
jaosoriorshardy: Thanks, now I noticed that10:48
gfidentelooks like we don't collect those logs from the runs?10:51
jaosoriorgfidente: there are logs somewhere AFAIK10:52
jaosoriorI'll try to build python-tripleoclient in a bit10:52
jaosoriorshardy: Is the undercloud deploy supposed to be idempotent? For some reason after updating the undercloud I'm unable to deploy the overcloud10:53
gfidentejaosorior, oh I mean I can try myself10:53
jaosoriorseems that something in ironic changes10:53
jaosorioror it seems that the nodes get mis-configured somehow...10:53
gfidentejaosorior, found logs in delorean_repos.tar.gz10:54
jaosoriorgfidente: Yep, couldn't build python-tripleoclient10:56
gfidenteright so looks like this https://review.rdoproject.org/r/#/c/1756/510:56
gfidenteadded some dependencies which are unavailable when building10:56
jaosorior:(10:57
gfidentewhich makes things more complicated10:57
gfidenteI am not sure why some of those should be missing and in which repo10:57
jaosoriorgfidente: Might be time to ask in #rdo10:57
gfidentejaosorior, ack let's go10:57
shardyjaosorior: yes it should be idempotent, in theory at least10:57
jaosoriorshardy: For some reason when I run the latest undercloud in delorean-current. The ssh keys for the ironic pxe driver are no longer usable10:59
jaosoriorAll the nodes go into maintenance mode10:59
lucasagomesbnemec, hi there, in the tripleo deep dive about the undercloud from yesterday you posted a link in the chat about building packages from changes in the review (was that it?) do you have this link handy there?10:59
* lucasagomes will update the etherpad with the link as well11:00
shardyjaosorior: are you pulling everything from delorean-current, or just the normal whitelist?11:00
jaosoriorshardy: Normal whitelist11:01
*** jcoufal has quit IRC11:01
shardyHmm, OK - I pulled updates and ran undercloud install yesterday and all worked fine11:01
jaosoriorshardy: basically did this11:01
jaosorior./tripleo-ci/scripts/tripleo.sh --repo-setup11:01
jaosoriorsudo yum update -y11:01
jaosorior./tripleo-ci/scripts/tripleo.sh --undercloud11:01
*** aqkhan_ has joined #tripleo11:02
shardyjaosorior: I previously ran into problems doing exactly that because puppet didn't db_sync when you do the yum update outside of puppet11:02
shardyI think that is fixed now tho, and probably not related to the pxe thing11:02
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Enable TLS for Zaqar API  https://review.openstack.org/35157611:02
*** tremble has joined #tripleo11:04
*** stendulker has quit IRC11:04
*** rhallisey has joined #tripleo11:07
jaosoriorshardy: Nevermind I think I figured out the problem and it isn't the undercloud install11:10
jaosoriorshardy: Is there a way to pass extra hieradata to the undercloud install?11:10
*** lucasagomes is now known as lucas-hungry11:11
shardyjaosorior: yes, slagle described it in detail during yesterdays undercloud deep dive11:12
jaosoriorshardy: I wasn't there :(11:12
shardyit was recorded11:12
jaosoriorah11:12
jaosoriornice!11:12
shardyjaosorior: tl;dr point hieradata_override in undercloud.conf at a local yaml file11:13
* social pokes EmilienM with https://review.openstack.org/#/c/334881/11 :/11:17
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart: Configure Undercloud VM to start at virthost boot.  https://review.openstack.org/35166511:17
ccamachojaosorior https://www.youtube.com/watch?v=h32z6Nq8Byg11:17
jaosoriorccamacho: O11:18
jaosoriorthanks dude11:18
jaosoriorwatching it now11:18
*** fultonj has joined #tripleo11:19
jtomasekhonza: thanks for a quick update on that deploy indicator patch, now we need forianf to ack it:)11:24
*** florianf has joined #tripleo11:27
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: Add sriov_numvfs in THT  https://review.openstack.org/34535211:28
*** limao has joined #tripleo11:29
*** limao has quit IRC11:32
*** tbonds has quit IRC11:33
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: provide vhostuser-socket-dir to vswitch::dpdk  https://review.openstack.org/35166911:37
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: WIP: provide vhostuser-socket-dir to vswitch::dpdk  https://review.openstack.org/35166911:39
*** liverpooler has joined #tripleo11:41
ccamachoGuys when having some time mind to review https://review.openstack.org/#/c/351625/ its a long but trivial submission cleaning up a little bit puppet-tripleo profiles, removing unneeded spaces, ordering and removing non used parameters (no logic modified)..11:41
*** liverpooler has quit IRC11:46
*** paramite has quit IRC11:46
EmilienMhello11:48
EmilienMsocial: ok will look today11:49
*** morazi has joined #tripleo11:49
openstackgerritMerged openstack/tripleo-ui: Add visual indicator that a deploy was requested  https://review.openstack.org/33912011:51
*** masco has quit IRC11:55
*** bfournie has quit IRC11:55
slaglebandini: hey, having some trouble with galera starting in an HA setup. it seems the initial promote always fails: http://paste.openstack.org/show/550410/11:56
slaglebandini: i can't seem to find the root cause of the error anywhere. any thoughts?11:56
dciabrinslagle, the galera ra will probably log more info in journalctl.11:58
*** weshay has joined #tripleo11:59
slagledciabrin: yea i see some access denied errors for the root user trying to connect to the db, during the promote attempt i assume11:59
dciabrinslagle, did the error occur after an upgrade, or is it a fresh install?12:00
slagledciabrin: it's a new install. but i may have introduced some entropy trying to debug the initial failure12:02
slaglei tried to start galera manually after pacemaker failed a few times12:02
*** Goneri has quit IRC12:03
slagleso i probably need to rebuild this env and see if it reproduces12:03
slagleyea pacemaker is no longer picking the same initial master it was originally12:06
socialEmilienM: thanks12:06
slaglemaybe b/c i accidentally ran the bootstrap on a different node?12:06
* slagle -> rebuilds12:07
*** rodrigods has quit IRC12:07
*** rodrigods has joined #tripleo12:08
*** saneax is now known as saneax_AFK12:08
dciabrinslagle, it might be a side effect of https://bugs.launchpad.net/tripleo/+bug/1581677, ping me if you reproduce12:09
openstackLaunchpad bug 1581677 in tripleo "Galera access rules need to be tightened" [High,Fix released] - Assigned to Michele Baldessari (michele)12:09
*** amoralej is now known as amoralej|lunch12:09
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Fix parameters and headers inconsistency in the puppet manifests.  https://review.openstack.org/35162512:10
*** radeks has joined #tripleo12:12
*** julim has joined #tripleo12:12
openstackgerritJavier Peña proposed openstack-infra/tripleo-ci: Set --dev option for dlrn execution instead of env var  https://review.openstack.org/35168212:13
shadowerhey folks, can I have reviews on these validations? https://review.openstack.org/#/c/351196/ https://review.openstack.org/#/c/351179/ https://review.openstack.org/#/c/351224/ https://review.openstack.org/#/c/351248/ ?12:13
shadowerthey're all very simple12:13
*** dprince has joined #tripleo12:13
shadowerand have a +2 already12:13
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Persist ironic configuration changes  https://review.openstack.org/35168312:13
*** jpena is now known as jpena|lunch12:13
*** Goneri has joined #tripleo12:14
gfidenteshadower, the vcpus I am not sure how it is calculated but I assume it's counting in sockets/cores/ht ?12:16
shadowergfidente: yeah12:16
gfidenteack :)12:16
*** saneax_AFK is now known as saneax12:16
*** lmiccini_ has joined #tripleo12:17
*** lmiccini has quit IRC12:17
*** pradk has joined #tripleo12:18
gfidenteshadower, / and it's taking the integer part only ?12:19
shadowergfidente: the disk space?12:19
gfidenteyep12:19
shadowergfidente: yeah. I think it can be  enhanced in the future, but this seems to be working fine for now12:20
gfidenteI think it's fine taking the integer part only12:20
gfidenteactually wanted to 'make sure' it wasn't printing some float on the console :P12:20
*** jayg|g0n3 is now known as jayg12:20
shadowerright12:21
openstackgerritMerged openstack/tripleo-validations: Validation to verify the undercloud RAM reqs  https://review.openstack.org/35117912:22
dtantsurshadower, commented, 40G disk space sounds unrealistic12:23
dtantsurI usually run out of 50G disk created by instack-virt-setup in a week as soon as I start hacking on images :)12:23
ansiwencan anyone tell me how to run the beaker tests locally? especially at which ruby file I have to point it? is there a "main" test file?12:23
shadowerdtantsur: this is what I was going by: https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux_OpenStack_Platform/7/html/Director_Installation_and_Usage/sect-Undercloud_Requirements.html12:23
shadowernot sure how accurate that is, though12:24
dtantsurshadower, I really wonder if somebody actually validated them by trying deploying a real HA cloud and managing it for some time...12:24
jaosoriorEmilienM: Can you recheck https://review.openstack.org/#/c/351562/ currently I can't do it in hiera due to the fact that we don't always deploy HAProxy12:24
dtantsurmaybe it's more of a developer problem ofc12:24
EmilienMdude how can you read a review I did 3s ago12:24
shadowerdtantsur: yeah that's a good question. Though I'd like to have that value sourced from somewhere if possible12:24
*** lucas-hungry is now known as lucasagomes12:24
shadowerdtantsur: tripleo.org says 60GB12:24
jaosoriorlol12:25
EmilienMjaosorior: is it a big deal if we set the param and haproxy is not installed?12:25
jaosoriorEmilienM: Yeah, someone might send bogus data to the middleware12:25
jaosoriorusually we have HAProxy to set proper parameters for X-Forwarded-Proto12:25
dtantsurshadower, 60G is what I would go for.. but I think we should somehow stop inventing these numbers and ask what field folks actually encounter. Your patch is still better than nothing, don't get me wrong please :)12:25
EmilienMjaosorior: +212:26
dtantsurhowever, I think it's not possible for someone to end up with 40G disk in year 2016 anyway12:26
EmilienMjaosorior: what is your secret?12:26
jaosoriorEmilienM: I intend to make HAProxy default in the undercloud in the near future. so then we can get rid of that logic.12:26
shadowerdtantsur: I absolutely agree on getting reliable numbers. Kind of hoped that the ones referenced in the docs would be that :-)12:26
jaosoriorEmilienM: caffeine12:26
EmilienMjaosorior: no, for review12:26
jaosoriorlol, it's still caffeine :P\12:27
jaosoriorEmilienM: I get mail notifications by gerrit. So I just saw that you had reviewed a patch from mine and quickly gave it a read12:28
*** tzumainn has joined #tripleo12:28
jaosoriorEmilienM: Can you check this one out too? https://review.openstack.org/#/c/351052/12:28
EmilienMjaosorior: sure12:29
jaosoriorEmilienM: duuuude, you saw that the volume encryption scenario patch is all green? :D12:29
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Validation to verify the undercloud CPU reqs  https://review.openstack.org/35119612:29
gfidenteguys, easy and green https://review.openstack.org/#/c/340286/ pls :)12:29
EmilienMjaosorior: yes, we can now enable it in tripleo ;)12:29
*** ramishra has quit IRC12:31
*** radeks has quit IRC12:32
ansiwenEmilienM: when you have time, I'd need some assistance with the beaker tests for puppet-ec2api12:32
EmilienMansiwen: sure, what do you need?12:32
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Validation to verify undercloud disk size reqs  https://review.openstack.org/35122412:32
*** ramishra has joined #tripleo12:32
ansiwenEmilienM: first I need to know how to run the beaker tests locally, and then I would need a pointer to an example how to implement them and which are needed12:33
EmilienMansiwen: the goal of acceptance is to test the module, and from what I look in https://github.com/openstack/puppet-ec2api/blob/master/spec/acceptance/basic_ec2api_spec.rb we don't test all the ec2api services12:33
ansiwenEmilienM: I have beaker installed12:33
EmilienMansiwen: http://docs.openstack.org/developer/puppet-openstack-guide/testing.html#functional-tests12:33
ansiwenEmilienM: so, should this work: `beaker --log-level debug --hosts ./acceptance/nodesets/centos-70-x64.yml --tests ./acceptance/basic_ec2api_spec.rb`12:34
*** tbonds has joined #tripleo12:34
EmilienMansiwen: no, we use rspec to run it12:34
EmilienMansiwen: I hope you don't mismatch beaker from redhat and beaker from puppet12:35
ansiwenEmilienM: no :-)12:35
EmilienMgood :)12:35
EmilienMansiwen: just follow the doc ^ and let me know if it doesn't work12:35
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Validation to check the undercloud processes  https://review.openstack.org/35124812:35
* dtantsur actually assumed these are the same beakers >_<12:35
ansiwenEmilienM: I got this line from https://github.com/puppetlabs/beaker/blob/master/docs/tutorials/the_command_line.md12:36
*** jdob has joined #tripleo12:36
ansiwenEmilienM: this bash script I can run on my laptop? or do I need a certain environment for that?12:37
EmilienMI use a VM12:38
openstackgerritLukas Bezdicka proposed openstack/instack-undercloud: Use ironic::inspector::ipxe class to setup iPXE  https://review.openstack.org/34598012:38
openstackgerritLukas Bezdicka proposed openstack/instack-undercloud: Update puppet dependancies before running puppet  https://review.openstack.org/32826412:38
openstackgerritLukas Bezdicka proposed openstack/instack-undercloud: Call systemctl-daemon-reload only if necessary  https://review.openstack.org/32722712:38
ansiwenEmilienM: because the normal beaker command creates a VM with vagrant12:38
EmilienMif you look at our doc12:39
EmilienMyou have all the procudre12:39
EmilienMprocedure, just follow it12:39
beagleshas anybody seen an HA CI run of THT pass lately?12:39
EmilienMyou execute it within a VM12:39
EmilienMbeagles: http://tripleo.org/cistatus.html12:39
jaosoriorbeagles: Actually, yeah12:39
EmilienMlatest run is 7:48 AM12:39
EmilienM(for me, so 1h ago)12:39
jaosoriorbut it is indeed unfortunate that it's quite flaky12:40
openstackgerritMerged openstack/puppet-tripleo: Configure Ceph/OSD after Ceph/Mon when on same node  https://review.openstack.org/34028612:40
beaglesEmilienM, do all of these repo's CI's use the same version of packages?12:40
* Jokke_ loves the irony on that12:41
beagleswell.. whatever is promoted that is12:41
beaglesI'm wondering if a recent neutron patch is contributing to the flakiness12:41
EmilienMbeagles: it uses delorean12:41
EmilienMbeagles: https://dashboards.rdoproject.org/rdo-dev12:41
EmilienMETOOMANYDASHBOARDS12:41
beaglesEmilienM, okay so everything should roughly be equivalent :)12:41
beaglesjust testing my assumptions I guess12:42
EmilienMtripleo is currently testing 2 days ago12:42
beaglesyeah, this patch was merged last week I think, so I think we'd have it12:42
*** rlandy has joined #tripleo12:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Persist ironic configuration changes  https://review.openstack.org/35168312:45
*** radeks has joined #tripleo12:46
socialEmilienM: after dropping ipxe element I'd like to drop undercloud-install element which means moving provisioning to puppet, objections?12:48
*** Goneri has quit IRC12:48
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Generate CephX keys via generate_overcloud_passwords  https://review.openstack.org/34841212:50
EmilienMsocial: not at all12:50
*** lblanchard has joined #tripleo12:52
*** jcoufal has joined #tripleo12:52
*** ccamacho is now known as ccamacho|lunch12:53
jaosoriorI'm off, have a good weekend everyone!12:54
*** jaosorior has quit IRC12:54
*** paramite has joined #tripleo12:59
*** Goneri has joined #tripleo13:03
*** saneax is now known as saneax_AFK13:03
openstackgerritMerged openstack/tripleo-validations: Validation to verify the undercloud CPU reqs  https://review.openstack.org/35119613:04
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Add 'ceph status' and tripleo-overcloud-passwords to host_info  https://review.openstack.org/34886213:05
EmilienMsocial: why does it fail CI?13:09
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Add 'ceph status' and tripleo-overcloud-passwords to host_info  https://review.openstack.org/34886213:09
EmilienMsocial: have you tested it?13:10
*** saneax_AFK is now known as saneax13:12
openstackgerritBrad P. Crochet proposed openstack/tripleo-docs: Switch docs to use tripleo-build-images  https://review.openstack.org/33766913:13
beagleshrmm.. I think this neutron patch https://review.openstack.org/#/c/347708/ might be causing us grief13:13
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates: Availability monitoring agents support  https://review.openstack.org/25478813:14
openstackgerritMerged openstack/puppet-tripleo: Fix mistral profile steps  https://review.openstack.org/34334613:15
*** lmiccini has joined #tripleo13:15
EmilienMI'm about to approve a blueprint, https://review.openstack.org/#/c/349737/ that has a positive agreement, feel free to raise your voice now before it lands :)13:17
hewbroccabeagles: WHAT you must be joking13:17
*** lmiccini_ has quit IRC13:18
beagleshewbrocca, if only :s13:18
beaglesI've looked at a few CI failures - they are failing at pingtest, claiming that HA ports can't be created because not enough agents are available and the logs are peppered with dead agent reports.13:19
*** amoralej|lunch is now known as amoralej13:20
beaglesAFAICT, the current neutron agent rpc updates have gone from being exponential back off to single shot timeout13:20
beaglesI'm looking into concocting a test config to test the hypothesis in the gate13:21
*** saneax is now known as saneax_AFK13:24
hewbroccabeagles: well good luck13:24
socialEmilienM: it won't work without https://review.openstack.org/#/c/345980/13:24
*** dculik has quit IRC13:24
EmilienMso you're doing backward incompatible change?13:24
*** jpena|lunch is now known as jpena13:25
socialEmilienM: no, issue is that the ipxe element is running after puppet and just reverts to old config and breaks apache13:25
EmilienMmy point here is that puppet-ironic needs to be backward compatible13:25
EmilienMso until all CI jobs are green, you won't get positive review, it works for all Puppet modules13:26
socialEmilienM: hmm I could do ugly hack in puppet-apache13:26
socialbut that would make it unmergeable13:26
socialEmilienM: issue is instack-undercloud uses Listen in ipxe.conf13:27
*** egafford has joined #tripleo13:27
socialEmilienM: which causes the Listen to be in ports.conf and ipxe.conf. Idea for workaround?13:27
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Fix parameters and headers inconsistency in the puppet manifests.  https://review.openstack.org/35162513:29
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Disable mistral services by default.  https://review.openstack.org/34940813:31
openstackgerritJavier Peña proposed openstack-infra/tripleo-ci: Set --use-public option for dlrn execution instead of env var  https://review.openstack.org/35168213:32
*** ccamacho|lunch is now known as ccamacho13:33
beaglesooo13:34
*** jeckersb_gone is now known as jeckersb13:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355613:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove static hieradata  https://review.openstack.org/35174113:35
beaglesEmilienM, seeing a lot of truncated hostnames in the overcloud neutron.conf files - e.g. host=overcloud-controller-1. instead of overcloud-controller-1.localdomain13:35
beaglesthoughts on what is causing that?13:36
beaglesor is that by design and I missed the memo ;)13:36
EmilienMit sounds like facter/fqdn/hostname related13:36
EmilienMundercloud or overcloud?13:36
beaglesovercloud, on the controller nodes13:36
beaglesthe compute nodes seem to be okay13:37
beaglesor node I guess13:37
EmilienMcan I see it?13:38
socialEmilienM: I have idea, maybe it won't have to be that ugly :/13:39
beaglesEmilienM, this build shows it http://logs.openstack.org/56/333556/47/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/cd88fae/logs/13:40
EmilienMk let me look13:40
*** maeca1 has joined #tripleo13:41
beaglesEmilienM, there are a couple of others  that seem to be doing the same thing13:41
beaglesEmilienM, noticed it when looking at possible timeout/healthcheck issues13:41
openstackgerritMerged openstack/tripleo-specs: Undercloud Upgrade  https://review.openstack.org/34973713:42
EmilienMweird13:42
EmilienMbeagles: ok I see it now finding why13:43
EmilienMit looks like a DHCP thing on ovb jobs, where compute node gets the right config but not the controller13:45
EmilienMresolv.conf are different between controller & compute13:45
EmilienMthe compute has "search openstacklocal" but not the controller13:45
EmilienMI am not familiar enough with rh1/rh2 and ovb jobs but it seems like a networking problem here13:45
beaglesEmilienM, ack, I guess derek would've been the guy to ping on this?13:48
*** Tristitia has quit IRC13:49
hewbroccabeagles: he's on PTO, but sshnaidm and panda know a bit about the CI setup13:50
*** Tristit1a has joined #tripleo13:51
* panda reading13:51
beaglesthanks hewbrocca!13:51
slaglei dont think ovb would have anything to do with this13:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Update cinder-api with new authtoken parameters  https://review.openstack.org/35175113:51
EmilienMayoung_ZZZzzz, dprince: fyi ^13:52
slagleeven with ovb, all overcloud nodes get dhcp from the undercloud13:52
slaglenot from the hosting cloud (rh1/rh2)13:52
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: TEST DO NOT MERGE: checking agent report intervals  https://review.openstack.org/35175213:52
EmilienMdprince: you probably missed that but we're moving authtoken parameters in puppet modules to support Keystone V3 consistently13:52
slaglewhat do we call that cloud? :) the "ether" cloud13:52
EmilienMslagle: resolv.conf is different though, on the 2 nodes13:53
dprinceEmilienM: +213:53
EmilienMdprince: I'll do all other services in a single patch later, just wanted to bring this one up so people are aware about this change.13:53
dprinceEmilienM: again, lots of patches. Might be nice to see these in chunks?13:53
dprinceEmilienM: you knew I'd ask ;)13:53
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Disable the Mon/OSD/Client resources in puppet-ceph-external  https://review.openstack.org/35175313:55
slagleEmilienM: in this job? http://logs.openstack.org/56/333556/47/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/cd88fae/13:56
slagleEmilienM: which 2 nodes?13:56
EmilienMslagle: controller1 and compute13:56
EmilienMthey have different resolv.conf13:56
slagleEmilienM: not in the files i downloaded13:57
slaglethey are the same13:57
EmilienMok let me look again13:57
EmilienMyou're right, I did a mistake when I looked13:58
pradkcan anyone tell me why i would see "No valid host was found" locally when i try to deploy oc13:58
slagledtantsur: maybe you can help! ^13:59
EmilienMslagle: my bad13:59
dtantsuroh13:59
slagledtantsur: sorry, you know i'm a troll13:59
dtantsurlol, yeah13:59
dtantsurpradk, tons of reasons. we have a troubleshooting guide on it, lemme find13:59
pabelangerslagle: do you mind reviewing the syntax on 351278 when time permits13:59
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Disable the Mon/OSD/Client resources in puppet-ceph-external  https://review.openstack.org/35175313:59
dtantsurpradk, http://tripleo.org/troubleshooting/troubleshooting.html#no-valid-host-found-error13:59
slaglepabelanger: yea i'll have a look14:00
pradkdtantsur, thanks.. weirdly i'm only seeing this since yesterday. This was working fine before14:00
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add release files for testing images  https://review.openstack.org/35175914:00
gfidenteshardy, feedback on https://review.openstack.org/#/c/351753/2/puppet/services/ceph-base.yaml ?14:01
gfidentewe could also set an empty default in the puppet-ceph-external.yaml environment14:01
gfidentebut it'd break compat with previous customized environment files14:02
dtantsurfolks, a stupid (maybe) question here: when I build images locally, which repos does it use?14:02
dtantsur(maybe this new tripleo-image-build tool is the answer actually...)14:02
*** openstackgerrit has quit IRC14:03
*** openstackgerrit has joined #tripleo14:03
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Validation to verify undercloud disk size reqs  https://review.openstack.org/35122414:05
shardydtantsur: if you build them via tripleo.sh --overcloud-images it uses the undercloud node repo setup, unless you export a different REPO_PREFIX14:05
dtantsurcool, that's what I need probably14:06
dtantsurshardy, speaking of debugability, I'm thinking of a deployment command change that detects "no valid host found" and outputs the link to the troubleshooting guide :)14:06
shardydtantsur: Yeah, there's a bunch of common failure modes which we should handle better14:07
*** Tristit1a is now known as Tristitia14:07
shardydtantsur: FWIW openstack stack failures list was supposed to be an attempt to better surface the underlying broken resource/reason14:07
dtantsurand of course my dream is outputting the puppet stderr from a failed node right in the deployment command14:07
dtantsuryeah, I need to try14:07
shardywe don't yet run that by default on deploy failure, but I'm planning to make it do that14:08
shardydtantsur: that is exactly what that command does14:08
dtantsurshardy, do we have its output in the CI on failures?14:08
shardydtantsur: not yet, it's pretty new14:08
shardydtantsur: we have the same data in postci logs though14:08
shardybecause we do deployment-show on any broken deployment14:08
dtantsurpostci logs are pretty confusing. the puppet failure is one string with \n\t etc14:08
shardyyeah, the heat command formats it better14:09
*** lmiccini has quit IRC14:09
dtantsurreally good to know. look, some of my concerns are already addressed :)14:09
shardyCool, it's good to have these discussions, I just prefer to stick to specifics which we can actually iterate on and improve :)14:10
openstackgerritMerged openstack/tripleo-specs: Add policy on when a core can self-approve their own patch  https://review.openstack.org/34970214:10
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Restore CephAdminKey and CephMonKey default  https://review.openstack.org/35176314:11
slagledtantsur: shardy : fyi, i just had a stack create fail. the stack failures list is awesome: http://paste.openstack.org/show/550605/14:11
*** coolsvap has quit IRC14:11
dtantsurwowwowwowwow!! I'm totally sold :)14:12
shardyslagle: nice!  Yeah I really like it, will push a patch that runs it by default when a deploy fails14:13
shardystevebaker++14:13
dprinceYeah, stevebaker had that posted for awhile too. We should've landed it sooner14:13
*** jaosorior has joined #tripleo14:17
openstackgerritMerged openstack/instack-undercloud: Add enable_proxy_headers_parsing option for keystone and glance  https://review.openstack.org/35156214:17
beaglesdoes-not-suck14:18
*** lmiccini has joined #tripleo14:19
*** cdearborn has joined #tripleo14:21
thrashanybody have an idea how I can check why a set of patches are refusing to have CI runs?14:23
thrashthey don't even seem to get queued...14:23
pabelangerthrash: which?14:23
thrashpabelanger: last in the series is: https://review.openstack.org/#/c/336642/214:24
pabelangerpanda: larsks: adarazs:  do you have time to review: https://review.openstack.org/#/c/349083 and https://review.openstack.org/#/c/349084? they move tripleo-quickstart into using sphinxdocs for documentation14:24
*** pgadiya has quit IRC14:25
*** jeckersb is now known as jeckersb_gone14:26
pabelangerthrash: checking14:26
pandapabelanger: ah yes, I can give my +2 now14:27
adarazslarsks: Just to make sure: we don't have any automatic documentation building in place that needs to get adjusted before we submit this, right?14:27
adarazsmeaning the docs -> doc change14:27
thrashpabelanger: danke14:27
larsksadarazs: we don't right now.14:27
adarazsall right.14:27
*** jeckersb_gone is now known as jeckersb14:29
pabelangerpanda: adarazs: larsks: here is the openstack-infra change to enable doc jobs in the gate: https://review.openstack.org/#/c/349087/14:30
pabelangerI need to fix the -1 still14:30
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart: Splits the post steps from tripleo/undercloud  https://review.openstack.org/35177214:32
adarazspabelanger: do you want to fix those small issues in https://review.openstack.org/349084 ?14:36
adarazsor do it in a followup patch.14:36
*** Goneri has quit IRC14:36
pabelangeradarazs: ya, I was hoping to do small patches. And follow up with other docs after this one14:37
pabelangerthrash: I suspect something changed in zuul to skip running the jobs you are expecting, still debugging the problem14:38
adarazspanda: you can submit https://review.openstack.org/349083 and https://review.openstack.org/349084 if you +2 the doc dir change.14:38
*** pgadiya has joined #tripleo14:39
thrashpabelanger: cool. thanks14:39
bnemeclucasagomes: I'll give you the link to my blog post about it: http://blog.nemebean.com/content/test-rpm-builds-proposed-changes-tripleo14:40
bnemecIt explains a little more about what is being built and such.14:40
lucasagomesbnemec, that works too :-)14:41
lucasagomesthanks a lot14:41
EmilienMdtantsur, lucasagomes: fyi, I abandon https://review.openstack.org/#/c/349301/14:41
EmilienMfeel free to re-enable it later and find why it's only working in devstack14:42
*** ebalduf has joined #tripleo14:42
lucasagomesEmilienM, fair enough, yeah it's on my list to dig into it14:42
*** ramishra_ has joined #tripleo14:42
*** ayoung_ZZZzzz is now known as ayoung14:42
lucasagomesjust didn't have time yet14:42
dtantsurack14:42
* lucasagomes checked on devstack only 14:42
ayoung"Puppet OpenStack modules are moving to a new class to configure Keystone authtoken parameters, so we can more easily enable Keystone v3 from a single interface. It's consistent across all modules and does support both Keystone v2 and v3 parameters."14:43
ayoungEmilienM, sweet, sweet music to my eyes14:43
*** ramishra has quit IRC14:45
*** radeks has quit IRC14:46
*** fragatina has joined #tripleo14:46
*** fragatin_ has joined #tripleo14:48
openstackgerritPaul Belanger proposed openstack/tripleo-common: Change image names to match what the rest of the system expects  https://review.openstack.org/33664214:48
EmilienMayoung: you like?14:49
EmilienMlucasagomes: no worries14:49
ayoungEmilienM, I like the concept of us getting smaller, reusable classes for Keystone's diostributed functionality.14:49
ayoungEmilienM, I think that is exactly the right approach, just like we have Auth token itself already in a library.14:50
*** lmiccini_ has joined #tripleo14:51
*** fragatina has quit IRC14:51
*** jeckersb is now known as jeckersb_gone14:54
*** lmiccini has quit IRC14:54
bnemecThe net-iso patch has passed all of the CI jobs collectively, and the most recent failure was an OOM: https://review.openstack.org/#/c/343017/14:55
bnemecIt would be good to get that re-enabled.14:55
openstackgerritMerged openstack/tripleo-quickstart: Rename docs folder to doc  https://review.openstack.org/34908314:57
larskspwd14:58
larskswell that won't work here...14:58
openstackgerritPaul Belanger proposed openstack/tripleo-common: Do not merge  https://review.openstack.org/35178514:59
EmilienMbnemec: nice work15:00
shardybnemec: was ui-settings.pickle checked in by mistake?15:00
dtantsuramoralej, hi, around?15:01
bnemecshardy: No, that's from the tool that was used to generate the templates.  I left it so they can be edited in the tool if need be.15:01
amoralejhi dtantsur15:01
amoralejyes, i'm here15:01
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add dlrn-gate-testing job type for roles-deploy.sh  https://review.openstack.org/35175915:01
dtantsuramoralej, not sure if you've seen my ping, probably a bit too early for you. do you still plan to work on https://review.openstack.org/339457 ?15:02
openstackgerritPaul Belanger proposed openstack/tripleo-common: Remove the delorean-repo element from CentOS images  https://review.openstack.org/33652415:02
*** jeckersb_gone is now known as jeckersb15:02
amoralejyes, i just came back from a sick leave today and was cleaning up my inbox dtantsur15:02
shardybnemec: Ok, thanks, not familiar with the format ;)15:02
dtantsuramoralej, cool, thanks! I hope you feel better now15:03
amoralejbut, i'll try to do it today15:03
shardywould be good if it added a comment/header saying what it's for15:03
bnemecshardy: I'm actually working on a demo video of the tool.15:03
amoralejhopefully yes, thanks dtantsur!15:03
bnemecWell, it's a pickle file.  I'm not sure you can add comments.15:03
bnemecI guess I could dump out a readme in the template directory.15:04
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add dlrn-gate-testing job type for roles-deploy.sh  https://review.openstack.org/35175915:04
bnemecThat might not be a bad idea anyway.15:04
*** d0ugal has quit IRC15:05
openstackgerritThiago da Silva proposed openstack/tripleo-quickstart: fix link in the readme file  https://review.openstack.org/35178715:05
shardybnemec: Yeah I meant the tool could learn to load a file skipping comments then unpickle the remainder as a string15:05
shardya readme would probably be fine too15:05
shardybnemec: +2, if you're satisfied the mitaka error can be ignored feel free to approve15:06
bnemecshardy: It's an oom, so it's definitely not related, and it passed on the previous run.15:06
bnemecI've actually seen a few ooms lately.15:06
*** aufi has quit IRC15:07
bnemecOn stable branch jobs too, which is a little weird since we aren't adding things there.15:07
shardyYeah, our ram usage has crept up again :(15:07
*** shardy is now known as shardy_afk15:07
*** dhill_ has joined #tripleo15:09
*** dhill_ has quit IRC15:10
*** dhill_ has joined #tripleo15:10
*** fragatin_ has quit IRC15:10
rlandyslagle: hi - in order to allow quickstart to run on ovb and avoid duplicating code, I need to split the undercloud post-install.yml from tripleo/undercloud. Considering this review https://review.openstack.org/#/c/351259/ (and associated blueprint), where do you think tripleo-quickstart should end? ie: should the post-install.yml steps be included? (https://github.com/openstack/tripleo-quickstart/blob/master/roles/tripleo/under15:12
rlandycloud/tasks/post-install.yml)15:12
*** jistr is now known as jistr|mtg15:14
*** d0ugal has joined #tripleo15:18
openstackgerritDimitri Savineau proposed openstack/puppet-tripleo: xinetd: bind only on mysql network  https://review.openstack.org/35179515:18
pabelangerany know the IRC handle of Brad P Crochet?: https://review.openstack.org/#/c/337669/515:19
jaosoriorpabelanger: it's thrash15:20
thrashlol15:20
pabelangerjaosorior: thanks15:21
pabelangerthrash: I think that is you issue15:21
pabelangerthrash: if you remove that depends-on, it should work15:21
pabelangerI say should be cause that is the only thing we can see15:21
thrashahhh15:21
thrashpabelanger: thanks for tlooking.15:21
*** tesseract- has quit IRC15:21
pabelangerthrash: sure, I'll wait for you to upload the patch and confirm15:21
*** radeks has joined #tripleo15:22
*** dsariel has joined #tripleo15:23
openstackgerritBrad P. Crochet proposed openstack/tripleo-docs: Switch docs to use tripleo-build-images  https://review.openstack.org/33766915:24
*** hewbrocca is now known as hewbrocca-afk15:24
*** rcernin has quit IRC15:26
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Change image names to match what the rest of the system expects  https://review.openstack.org/33664215:26
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Remove epel element from base yaml ramdisk agent image  https://review.openstack.org/33655115:26
*** ebarrera has quit IRC15:27
pabelangerthrash: that looks better15:30
*** ebarrera has joined #tripleo15:33
openstackgerritMerged openstack/tripleo-quickstart: Initial support for sphinxdoc  https://review.openstack.org/34908415:33
ansiwenEmilienM: ok, I managed to let the tests run, but they fail :-/15:33
*** links has quit IRC15:33
ansiwenEmilienM: Error: Puppet::Parser::AST::Resource failed with error ArgumentError: Could not find declared class ::ec2api::keystone::auth at /tmp/apply_manifest.pp.c3JfS6:10 on node localhost.redhat.com15:34
thrashpabelanger: awesome thanks15:34
lucasagomesEmilienM, i've setup a node with tripleo-quickstart and applied that wsgi patch, it seems to be working (I could create a node)15:35
EmilienMlucasagomes: mhh15:35
lucasagomesEmilienM, you wanna take a look ? Pm me ur pub key15:35
EmilienMlucasagomes: I trust you15:35
EmilienMit just fails in CI15:35
lucasagomesEmilienM, I wonder what is going on on that job15:36
lucasagomesI will recheck that patch to see ok?15:36
lucasagomesthe messages there seems to be related to RPC as well, so I'm a bit confused15:36
EmilienMansiwen: it works in CI, maybe you can look how it's done http://logs.openstack.org/69/350369/2/gate/gate-puppet-ec2api-puppet-beaker-rspec-centos-7/d66c538/console.html#_2016-08-05_09_06_13_78404015:37
ansiwenEmilienM: I pulled again, and there was a change regarding keystone... let's see15:38
ansiwenEmilienM: I will run it again first15:38
EmilienMansiwen: ok, nevermind beaker now. can you at least review https://github.com/openstack/puppet-ec2api/tree/master/manifests and tells if we have all we need?15:38
EmilienMI'll take care of beaker & testing15:38
EmilienMis there tempest tests for ec2api?15:38
openstackgerritLucas Alvares Gomes proposed openstack/instack-undercloud: Revert "Revert "Deploy and Upgrade Ironic to run in mod_wsgi""  https://review.openstack.org/35180315:38
lucasagomesjust a test ^15:39
* lucasagomes marks as WIP15:39
EmilienMansiwen: yes there is https://github.com/openstack/ec2-api/tree/master/ec2api/tests/functional/scenario15:39
EmilienMso we need to get our Puppet CI deploying ec2 api and running tempest15:40
*** ebarrera has quit IRC15:40
ansiwenEmilienM: ok15:41
ansiwenEmilienM: is this what is done as beaker tests, or are you talking about something else now?15:41
*** beagles is now known as beagles_food15:42
ansiwenEmilienM: so, will beaker run tempest?15:42
*** karthiks is now known as karthiks|afk15:43
*** HenryG has quit IRC15:43
EmilienMansiwen: no it's manifests15:43
EmilienMansiwen: no it won't15:43
*** HenryG has joined #tripleo15:43
EmilienMansiwen: I need to leave now for a while I'll come later15:44
ansiwenhow is this done for nova api?15:44
EmilienMansiwen: please look in logs I pasted, you can see what beajer does15:44
EmilienMbeaker*15:44
EmilienMansiwen: look http://docs.openstack.org/developer/puppet-openstack-guide/testing.html15:45
EmilienMansiwen: and http://docs.openstack.org/developer/puppet-openstack-guide/ci.html15:45
EmilienMansiwen: beaker tests will execute https://github.com/openstack/puppet-ec2api/blob/master/spec/acceptance/basic_ec2api_spec.rb15:45
EmilienMansiwen: just compile a puppet catalog, and deploy ec2api like it's in the manifest, ^15:46
EmilienMansiwen: I  need to go now, ttyl15:46
ansiwenEmilienM: ok15:46
*** pgadiya has quit IRC15:48
*** florianf has quit IRC15:48
*** florianf has joined #tripleo15:49
*** florianf has quit IRC15:53
*** abehl has quit IRC15:54
*** dsariel has quit IRC15:55
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates: Availability monitoring agents support  https://review.openstack.org/25478815:57
bnemecHey, so I realized this morning that we never restarted the te-broker after we bumped the number of testenvs for rh1.15:58
bnemecThis means we were only spinning up 20 workers for the 80 envs available.15:59
ansiwenEmilienM: in my case it looks very similar, but compiling the catalog fails: https://bpaste.net/show/a52698be115815:59
bnemecWhich is why a whole bunch of patches failed to get testenvs this morning.15:59
bnemecI restarted the broker, but that killed all of the existing jobs.15:59
ansiwenEmilienM: I also have to go now, but you can leave me messages here, I will read later15:59
bnemecI'm trying to recheck everything, but if your patch failed on a testenv problem, feel free to recheck.  It should work now.15:59
openstackgerritSteven Hardy proposed openstack/puppet-tripleo: Remove keystone PKI cert generation  https://review.openstack.org/35055416:01
openstackgerritSteven Hardy proposed openstack/puppet-tripleo: Remove keystone PKI cert generation  https://review.openstack.org/35055416:03
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Remove keystone PKI related parameters  https://review.openstack.org/35055616:03
*** pcaruana has quit IRC16:05
*** beagles_food is now known as beagles16:07
*** dtantsur is now known as dtantsur|afk16:08
*** fragatina has joined #tripleo16:08
*** fragatina has quit IRC16:09
jtomasekrbrady: I've talked about the getParameters action with rbrady and here is the outline on how should the acion parse the heat validate response: https://etherpad.openstack.org/p/IkiWgtDrqc16:11
jtomasek(with shardy_afk I mean:)16:11
jtomasekrbrady: I still need to finish it but it should (hopefully) give you an idea16:12
*** jeckersb is now known as jeckersb_gone16:12
*** shardy_afk is now known as shardy16:12
*** jeckersb_gone is now known as jeckersb16:12
*** amoralej is now known as amoralej|off16:13
*** bana_k has joined #tripleo16:13
dtrainorwhat's a reasonable period of time to wait for a node to be in a 'wait call-back' state?  I'm waiting on a deployment here, and best I can tell, the deployment is waiting for this node to do.... something.16:14
dtrainorSo far though I have no failed resources, so that part is good.16:14
shardydtrainor: if you can, check the node primary console16:14
shardyquite often that happens when the node failed to boot the deployment ramdisk16:15
rbradyjtomasek: not sure if it matters but the paste truncates the output16:15
shardywhich can happen for a variety of reasons16:15
dtrainorok16:15
dtrainorunderstood.16:15
gfidentebnemec, that thing works locally maybe the password file isn't in /opt/stack?16:15
gfidentecause it depends on cwd where we run tripleo.sh I think16:16
rbradyjtomasek, shardy: also not sure about items marked with TBD16:16
*** mcornea has quit IRC16:17
*** tremble has quit IRC16:17
jtomasekrbrady: the tbd parts are what I need to finish (in terms of defining how to extract those from the heat response)16:17
shardyrbrady: basically we just need to add some optional filtering of the validate response we get from heat16:17
dtrainorit has a login, with a hostname of overcloud-controller-2.  some HID events from the DRAC connecting a keyboard, but nothing that talks of the deployment.  gonna try to pxeboot it again i think16:18
rbradyshardy: it appears there is also data transformation or at least returning a different structure as a result16:18
shardyrbrady: yeah, based on some knowledge of the template interfaces we'll extract the per-role, per-service and global parameters16:19
shardyand expose them in a way categorized thus16:19
shardyprobably same for network related parameters16:20
dtrainorah i don't think ironic was waiting for it to do anything, it just booted in to the os that was previously installed16:20
shardyrbrady: FWIW I think getting the deployment workflow done should take priority over this, so we can continue the discussion around the exact format while that gets done16:20
bnemecgfidente: You run deployments out of /opt/stack locally?  And it works? :-)16:20
rbradyshardy: ack16:21
gfidentebnemec, totally, from /home/stack yes16:22
bnemecgfidente: /home/stack != /opt/stack16:22
bnemecI suspect in CI it's probably /home/jenkins because we run on the slave now.16:23
gfidentethough when I tried using ~stack in previous patchset it failed16:23
gfidenteso maybe I had to do ~jenkins ?16:23
shardygfidente: Hey, re https://review.openstack.org/#/c/342900/ - you want me to add a NoBrackets entry to the EndpointMap for every service, right?16:23
bnemecProbably16:23
shardyThat whole thing is kinda ugly :(16:23
*** fragatina has joined #tripleo16:24
bnemecHmm, that reminds me I need to rebase https://review.openstack.org/#/c/348037/16:24
gfidenteshardy, right the problem is we need both bracketed and non bracketed version of same IPv616:25
gfidentewhich come from netipmap and netipurimap16:25
gfidentedidn't you want to combine those too to use map_replace?16:25
shardygfidente: ack - I can definitely do that, and I've rebased on https://review.openstack.org/#/c/345510/ so I'll only need to pass net_ip_map16:26
gfidentenice16:26
gfidente:)16:26
shardygfidente: Yeah, I think I'll do that, then modify the endpoint generation to make a NoBrackets output for everything16:26
shardyperhaps later we can figure a cleaner way to do that, e.g with some str_replace template or something16:26
*** rasca has quit IRC16:27
rbradyshardy, jtomasek: I've updated the bp to link to your etherpad https://blueprints.launchpad.net/tripleo/+spec/add-parameters-actions16:27
jtomasekrbrady: thanks16:27
*** rwsu has quit IRC16:28
*** coolsvap has joined #tripleo16:29
*** myoung has quit IRC16:29
rookis there a RFE to have openstack baremetal introspection start <uuid> to return something vs a "\n"16:30
*** myoung has joined #tripleo16:30
rookie - "Started Introspection on node : UUID" or "Unable to find node <UUID>16:30
*** ohamada has quit IRC16:30
*** snecklifter has joined #tripleo16:31
*** rwsu has joined #tripleo16:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Disable the Mon/OSD/Client resources in puppet-ceph-external  https://review.openstack.org/35175316:31
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Add 'ceph status' and tripleo-overcloud-passwords to host_info  https://review.openstack.org/34886216:32
*** paramite has quit IRC16:33
snecklifterhello, ive got a problem on mitaka where cloud-init starts before the network link is up, any ideas16:33
snecklifteri've got portfast enabled on switch ports16:33
snecklifterits only a matter of seconds but it means the build fails16:34
shardysnecklifter: can you pass a user_data script that spins waiting for e.g the nova metadata server IP to be accessible?16:34
shardyhttp://docs.openstack.org/developer/tripleo-docs/advanced_deployment/extra_config.html#firstboot-extra-configuration16:35
sneckliftershardy: yeah, basically deploying a modification of that template, best way to put in a wait condition on the metadata server?16:36
*** lucasagomes is now known as lucas|dinner16:36
shardysnecklifter: if that doesn't run early enough, you might be able to inject a boothook into the image16:36
*** jpich has quit IRC16:36
snecklifterboothook?16:37
shardyhttps://cloudinit.readthedocs.io/en/latest/topics/format.html#cloud-boothook16:37
*** ebarrera has joined #tripleo16:39
snecklifterok, thanks, i think the timing is ok, putting in a dependency on the metadata server would be fine, just not sure how to achieve that16:39
dtrainorThe UI guys are looking for ways to come up with an accurate visual indicator of a deployment's progress.  Considering how nested resources work and how we haven't seen a way to get a tally or a total for which to base a progress off of, I wnated to ask if anyone has any suggestions as to how one might go about ultimately ending up with a % progress indicator for a deployment.16:41
shardydtrainor: we apply puppet in six steps, so when those steps are aligned for all roles (not yet) we could use the current step as a pretty good indicator16:42
shardyfor now I'd probably just compare the total number of resources with those that have gone COMPLETE16:43
dtrainorthat could work. can i expect to query heat for this information?16:43
*** cdearborn has quit IRC16:43
dtrainoryes, that's what i had suggested16:43
dtrainorthough i understand that may lead to any numbers derived from that to cause this indicator to "bounce" as more resources are introduced and executed16:43
dtrainorlblanchard, ping16:43
*** bana_k has quit IRC16:44
lblancharddtrainor: hey!16:44
shardydtrainor: possibly, a way to avoid that would be to only look at the resources in overcloud.yaml, not nested stacks16:44
dtrainorthank you shardy.  trying to get some ideas for lblanchard16:44
dtrainoroh that's a good idea.16:44
shardythat would make the measure much coarser, but still fairly useful16:44
dtrainorsure.16:44
*** d0ugal has quit IRC16:44
shardydtrainor: that would also be a much less expensive API call if you're going to do it repeatedly16:45
dtrainorwhen we have more information of and development on roles in the future we can get much more granular with the process for a better indicator, but i'd be happy with a six-step indicator at this point16:45
dtrainoragreed :)16:45
lblanchard+1!16:46
dtrainoris that something we can work with lblanchard?16:48
lblancharddtrainor: definitely16:50
dtrainorthank you for the time shardy, this helps a lot.16:52
shardynp16:52
*** fragatin_ has joined #tripleo16:53
*** fragatina has quit IRC16:55
jtomasekshardy, dtrainor: it would be nice to get input data for this as zaqar messages from deployment workflow (which is afaik totally doable)16:56
* jtomasek takes note to review deployment workflow16:56
dtrainoroh yeah16:56
pabelangerslagle: bnemec: http://grafana.openstack.org/dashboard/db/nodepool-tripleo-test-cloud should better help to monitor tripleo-test-cloud-rh1 resources16:57
shardyhttp://docs.openstack.org/developer/heat/template_guide/environment.html#retrieving-events16:57
shardyjtomasek: actually you could even get the event data directly from heat ^^16:57
shardyif you know the number of resources in the stack, you could just listen for the appropriate number of COMPLETE events16:58
*** jpena is now known as jpena|off16:58
*** numans has quit IRC17:00
*** bandini has quit IRC17:03
slaglepabelanger: very nice17:05
pabelangerslagle: has some historical data for the last 6 months too17:06
pabelangerprovides a simple interface to check the status of the cloud17:06
*** bana_k has joined #tripleo17:07
*** d0ugal has joined #tripleo17:12
sneckliftershardy: is there any way to make the firstboot config wait until the network link is actually up?17:16
sneckliftershouldn't it do this anyway?17:17
snecklifteri added a sleep command which has worked around my issue17:17
shardysnecklifter: Like I said earlier, I'd write a script that waits until the link is up17:18
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: allow RHEL virthosts to use an updated ipxe-roms-qemu  https://review.openstack.org/34801717:18
shardylike, a loop trying to ping the metadata server IP instead of a sleep17:18
*** Tristitia has quit IRC17:18
jidaryay new shardy post :)17:21
*** electrofelix has quit IRC17:21
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: allow RHEL virthosts to use an updated ipxe-roms-qemu  https://review.openstack.org/34801717:23
*** Tristitia has joined #tripleo17:26
*** tosky has quit IRC17:27
jmiu_jidar: nice to know *brings up blog*17:27
*** radeks has quit IRC17:27
shardysnecklifter: FWIW this is what I had in mind http://paste.openstack.org/show/550659/17:29
jidarjmiu_: the blog posts by slagle are pretty good too, especially in conjunction with the shardy posts http://www.anstack.com/blog/2016/08/01/tripleo-deep-dive-session-4.html17:30
shardyI'm sure there are several other ways you could achieve the same thing17:30
jidarheh, both of you guys have saved me so much time debugging these templates17:30
jidarthat while loop most of all17:30
*** pradk has quit IRC17:30
shardygood to hear the posts have been helpful :)17:31
jmiu_YES THEY HAVE BEEN17:31
* jmiu_ calms down17:31
jmiu_thank you so much17:31
*** akrivoka has quit IRC17:32
jidarsomebody mentioned by newton releases will be a few weeks out of mainline releases, and that rdo/ironic/tripleo were all big tent as of newton17:32
jidar(or something along those lines)17:33
jidardoes that mean effectively we'll be skipping osp9?17:33
*** pradk has joined #tripleo17:33
jidaror at the very least osp9 will be very closely followed by osp1017:34
*** yamahata has joined #tripleo17:36
bnemecjidar: This is not the channel to discuss OSP in.17:36
bnemecEspecially not future release plans.17:36
jidarfair enough17:38
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart: Add documentation for add-on roles  https://review.openstack.org/34673317:39
*** cdearborn has joined #tripleo17:41
*** Tristitia has quit IRC17:44
ccamachoguys Im out, have a nice weekend!!17:44
*** abehl has joined #tripleo17:45
*** cdearborn has quit IRC17:46
*** cdearborn has joined #tripleo17:46
*** leanderthal is now known as leanderthal|afk17:47
*** Tristitia has joined #tripleo17:51
*** fragatin_ has quit IRC17:52
*** fragatina has joined #tripleo17:53
openstackgerritMiles Gould proposed openstack/instack-undercloud: Ironic: Configure iPXE to work with UEFI  https://review.openstack.org/35062717:54
*** weshay has quit IRC17:58
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Convert EndpointMap to not require per-service VIP parameters  https://review.openstack.org/34290017:59
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Allow map_replace substitution of network names  https://review.openstack.org/34551017:59
*** sarath has joined #tripleo17:59
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-quickstart: remove erroneously placed 'set -x'  https://review.openstack.org/35186818:00
*** weshay has joined #tripleo18:01
bnemecHmm, I wonder if a problem got introduced in one of our deps.18:02
bnemecI'm seeing a number of undercloud install failures with: "ImportError: No module named osc_lib (tried 26, for a total of 170 seconds)"18:02
bnemecAppears to be coming from gnocchiclient.18:02
*** shardy is now known as shardy_afk18:03
openstackgerritMiles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package  https://review.openstack.org/34421418:04
*** mgould is now known as mgould|afk18:05
*** ebarrera has quit IRC18:21
pradkcan we get this in https://review.openstack.org/#/c/333556/ passing ci now18:25
gfidentehave good weekend tripleo18:34
*** gfidente has quit IRC18:36
*** dhill_ has quit IRC18:54
trozetdsneddon: yo18:54
*** dhill_ has joined #tripleo18:58
*** jaosorior has quit IRC19:04
*** tbonds has quit IRC19:19
openstackgerritMerged openstack-infra/tripleo-ci: Don't run undercloud idempotent on tempest jobs  https://review.openstack.org/35106619:23
bnemecAh, the gnocchiclient thing appears to only be happening on Mitaka.  Methinks somebody backported something naughty.19:27
*** penick has joined #tripleo19:32
*** penick_ has joined #tripleo19:33
*** penick has quit IRC19:36
*** penick_ is now known as penick19:36
pabelangerslagle: bnemec: EmilienM: Do we have time to discuss 351278 this afternoon or should I wait until the weekly meeting?19:47
slaglepabelanger: i can19:47
slaglei only had a chance to look briefly earlier today19:48
slaglegoing into the experimental queue, i'm fine with it19:48
slaglei would like to understand the direction a little more and what the goals are, and i'd like to see the method more closely aligned with tripleo-ci (eventually)19:48
slaglebut i dont know that any of that has to hold it up19:48
*** gfidente has joined #tripleo19:50
pabelangerYes, I've started work on write a document outlining of of the goals I'd like to see happen.  Even have some discussions around them.  I wanted to get a few POCs in place, since I find looking at code and results easier to understand then just a start document.  I suspect it will eventually turn into a spec for voting and give me tasks to work on for Ocata19:51
pabelangerbut right now, I'm not proposing replacing any current existing tripleo-ci functionality, this is simply experimental POC work.19:51
*** bana_k has quit IRC19:55
slagleyea, understood. like i said, i'm good with it. i'll have another look20:02
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Revert "We don't need to set a default for the CephX keys and cluster FSID"  https://review.openstack.org/35176320:02
openstackgerritBrent Eagles proposed openstack/puppet-tripleo: Add base profile for Octavia services  https://review.openstack.org/35189820:04
EmilienMbeagles: woot ^20:05
EmilienMgfidente: can you explain *why* do you revert a patch in the commit message?20:05
beaglesEmilienM, yeah.. I've been battling a bunch of unrelated crap this week.. now digging in for a proper push20:05
EmilienMoh, saw a comment, is it related about upgrade?20:05
EmilienMbeagles: let me know if you need help :)20:06
beaglesEmilienM, thanks man... I will :)20:06
EmilienMweshay: have you looked my email on openstack-dev ML about upgrade?20:07
* weshay looks20:07
*** cdearborn has quit IRC20:08
weshayEmilienM, I've been tracking the work ya..20:08
*** cdearborn has joined #tripleo20:08
EmilienMweshay: does RDO CI already has CI jobs that do upgrades from Mitaka to Newton?20:09
weshayEmilienM, ya20:09
EmilienMok, so I'll need your help20:09
weshayk20:09
weshayEmilienM, what do you need?20:09
EmilienMall I need now is, where can I read the code that do the upgrades20:09
EmilienMI want to read scripts and CI jobs definition20:10
weshayEmilienM, most everything is here, minus some setup that may not be relevant to your deployment https://github.com/redhat-openstack/ansible-role-tripleo-overcloud-upgrade/blob/master/templates/major-upgrade-overcloud.sh.j220:11
weshayEmilienM, I think matbu|pto may have a review out on tripleo.sh for it20:11
* weshay looks20:11
EmilienMexcellent20:11
gfidenteEmilienM, it20:11
weshayEmilienM, https://review.openstack.org/#/c/323750/20:11
EmilienMoh wow20:12
gfidenteEmilienM, yeah upgrades20:12
EmilienMcan I take over it?20:12
EmilienMhe's on PTO and patch has no activity since 2w20:12
weshayEmilienM, he's back monday, ack from me.. but contact him monday20:12
weshaybut go ahead20:12
weshayhe's been on pto for two weeks20:12
EmilienMok, we can work on it together20:13
EmilienMand I can certainly wait20:13
weshayack20:13
EmilienMI won't take over20:13
weshayEmilienM, you can..20:13
*** sarath has quit IRC20:13
EmilienMcool, I'll first look how you do in RDO CI20:13
weshayEmilienM, just update him20:13
EmilienMexcellent20:13
EmilienMthx !20:13
weshaynp20:13
weshayanyone have a good command to debug os-net-config in /var/log/messages w/ jq?20:14
weshayEmilienM, job runs here.. on periodic https://ci.centos.org/view/rdo/view/tripleo-periodic/job/tripleo-quickstart-upgrade-major-mitaka-to-master/20:16
weshayfor rdo20:16
slagleweshay: debug what with jq?20:16
slagleweshay: what are you trying to do20:16
weshayslagle, just get debug info re: os-net-config that doesn't look ugly20:16
weshayugly is ok too, but just toying around w/ it20:17
slagleweshay: oh just the config it is using that is printed in json?20:17
weshayya20:17
slaglethat should be the same as is under /etc/os-net-config20:17
weshayah indeed20:17
weshaythanks20:17
slagleyw20:20
*** jayg is now known as jayg|g0n320:22
*** beagles is now known as beagles_bl8r20:22
EmilienMweshay: ack thx for your help20:22
weshaynp20:22
*** shardy_afk is now known as shardy20:38
EmilienMcan someone approve the *last* composable role please, aodh20:38
EmilienMhttps://review.openstack.org/#/c/332854/ and https://review.openstack.org/#/c/333556/20:38
shardyEmilienM: Hey, if you get a moment, can you pls check https://review.openstack.org/#/c/350556/20:38
shardyI fixed the puppet-tripleo patch, so CI is all green now20:39
*** zaneb has quit IRC20:39
EmilienMshardy: +2 on both patches20:39
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Add packaging spec and config files  https://review.openstack.org/34493220:39
EmilienMshardy: excellent work !20:39
shardyEmilienM: thanks!20:39
shardylooking at the aodh patches now20:39
EmilienMshardy: I saw some little things in aodh that I will take care right after20:40
EmilienMbut overall its ready I think20:40
shardywe seem to be calculating sync_db in a few places where it's not really needed20:41
shardythat might be something to clean up later20:42
EmilienMyeah exactly20:42
*** jeckersb is now known as jeckersb_gone20:46
EmilienMshardy: excellent blog post: http://hardysteven.blogspot.ca/2016/08/tripleo-composable-services-101.html20:47
shardyEmilienM: thanks!  Hopefully folks will find it useful20:47
EmilienMshardy: can you remove +A on https://review.openstack.org/#/c/333556/ please?20:47
shardywhen I have more time I'll refactor most of the info into a docs patch20:47
EmilienMotherwise it will never merge20:47
EmilienMI'll +A when puppet tripleo will merge20:47
EmilienMshardy: it is super useful20:47
shardydone20:48
EmilienMshardy: for aodh, I'm already working on the follow-up to clean things20:48
EmilienMshardy: I also sent https://review.openstack.org/351914 wrt the upgrade discussion20:48
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Reinstall python-requests in bootstrap script  https://review.openstack.org/35052120:50
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Make $TRIPLEO_ROOT overrideable  https://review.openstack.org/35053920:50
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Raise ping test count after multinode setup  https://review.openstack.org/35191620:50
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Fix resetting /etc/hosts  https://review.openstack.org/35191720:50
pandahey, when I found that a bug posted on tripleo is instead specific of a particular package, what should I do ? close, reassign to other project ? it's a problem with packaging ...20:50
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Availability monitoring agents support  https://review.openstack.org/25478820:51
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Convert EndpointMap to not require per-service VIP parameters  https://review.openstack.org/34290020:52
*** zaneb has joined #tripleo20:52
shardypanda: I'd raise a bug against the packaging but leave the tripleo bug open until we confirm the fix (assuming it's impacting tripleo)20:53
openstackgerritMerged openstack/tripleo-heat-templates: Remove the ControllerCount constraint  https://review.openstack.org/34564920:53
*** beagles_bl8r is now known as beagles20:54
pandashardy: I proposed a change without raising a bug, it was a trivial fix, is it ok to link the review to the bug20:54
shardypanda: Yup, that sounds fine, thanks!20:55
beaglesdprince, EmilienM, shardy: any chance to give this a go before it goes back to rebase line  ;) https://review.openstack.org/#/c/332147/20:55
openstackgerritMerged openstack/puppet-tripleo: Implement aodh profiles  https://review.openstack.org/33285420:56
shardybeagles: +220:57
dprincebeagles: +A20:57
beaglesshardy: merci bien!20:57
beaglesdprince, and you as well.. now let's see what "the wheel says"20:58
*** jdob has quit IRC20:58
shardyHave a good weekend all, back on Tuesday as on PTO Monday20:58
beaglescheers20:58
pandashardy: thanks, bye!20:58
*** shardy has quit IRC20:58
*** [1]cdearborn has joined #tripleo21:01
openstackgerritMerged openstack/tripleo-heat-templates: Add environment file to enable DVR  https://review.openstack.org/33214721:02
*** pradk has quit IRC21:03
dsneddontrozet, Sorry I missed you, here now.21:05
openstackgerritMerged openstack/puppet-tripleo: Remove keystone PKI cert generation  https://review.openstack.org/35055421:05
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355621:06
*** rbrady is now known as rbrady-afk21:07
*** tbonds has joined #tripleo21:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161041121:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1610411 in tripleo "Mitaka jobs broken my gnocchiclient move to osc-lib" [Critical,Triaged]21:10
*** dprince has quit IRC21:12
*** lblanchard has quit IRC21:16
*** cdearborn has quit IRC21:17
*** bana_k has joined #tripleo21:21
*** fzdarsky_ has quit IRC21:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove static hieradata  https://review.openstack.org/35174121:31
bnemecUgh, "broken my".  Who wrote that crap?21:36
*** bnemec is now known as beekneemech21:36
* beekneemech hides21:36
EmilienMbeekneemech: what?21:37
slagleyou have to say it in a super mario bros accent, and it sounds just fine21:37
beekneemechEmilienM: The bug I opened.21:37
beekneemechslagle: lol21:37
beekneemechEverything sounds fine when said in a Mario accent. :-)21:38
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699521:46
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement non-ovb overcloud update job - Newton -> Newton  https://review.openstack.org/35133021:46
*** [1]cdearborn has quit IRC21:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Rework the pacemaker_common_functions for M..N upgrades  https://review.openstack.org/32102721:52
*** fultonj has quit IRC21:53
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Rework the pacemaker_common_functions for M..N upgrades  https://review.openstack.org/32102721:54
slagleEmilienM: i think i'm close to multinode HA21:54
slagleEmilienM: got all the way up to step 521:54
EmilienMslagle: where do you test?21:54
EmilienMin infra,21:55
EmilienM?21:55
EmilienMalso, what is your number of nodes?21:55
slagle421:55
EmilienM:-o21:55
EmilienMwhat is the failure?21:55
slagleneed to add Core service to the environment file21:56
EmilienMslagle: would you like to initiate an experimental job in osinfra?21:56
EmilienMAFIK nobody is using 4 ndoes21:56
EmilienMiirc max is now 221:57
*** morazi has quit IRC21:58
slagleEmilienM: when I'm ready, i will21:59
*** tdasilva has quit IRC21:59
*** rlandy has quit IRC22:00
*** jcoufal_ has joined #tripleo22:00
EmilienMslagle: I'm wondering if infra will accept it22:00
slagledunno.22:01
slagleguess we'll find out22:01
EmilienMpabelanger: do you think infra will accept to create a 4 nodes job?22:01
*** weshay has quit IRC22:02
pabelangerEmilienM: you can propose it, see what they say. We only have 2 node jobs right now22:03
*** jcoufal has quit IRC22:04
pabelangerEmilienM: biggest issue to you'll likely run into is networking issue22:04
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add Major upgrade function to the tripleo ci script  https://review.openstack.org/32375022:04
EmilienMpabelanger: why?22:05
pabelangerwell, if there is a problem with networking the data isn't exposed to you and it will require an infra-root to look at it22:06
EmilienMI'm chatting on infra chan22:06
*** panda is now known as panda|zz22:06
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161041122:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1610411 in tripleo "Mitaka jobs broken by gnocchiclient move to osc-lib" [Critical,Triaged]22:10
pabelangerpropose it, see what clarkb says22:10
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: upgrades job is renamed to updates  https://review.openstack.org/35193722:12
*** milan has quit IRC22:12
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699522:14
*** jcoufal_ has quit IRC22:15
*** thrash is now known as thrash|wknd22:16
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton  https://review.openstack.org/35133022:17
*** jcoufal has joined #tripleo22:20
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton  https://review.openstack.org/35133022:20
*** yamahata has quit IRC22:21
*** maeca1 has quit IRC22:21
*** gfidente has quit IRC22:22
*** yamahata has joined #tripleo22:27
*** tdasilva has joined #tripleo22:27
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699522:30
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375022:34
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Add conditional check for tripleo-test-cloud-rh1  https://review.openstack.org/34698522:35
*** jcoufal has quit IRC22:35
*** jcoufal has joined #tripleo22:40
EmilienMslagle: if you have time before the week end please +1/-1 https://review.openstack.org/#/c/351914/22:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Update cinder-api with new authtoken parameters  https://review.openstack.org/35175122:51
openstackgerritMerged openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355623:00
*** yamahata has quit IRC23:04
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161041123:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1610411 in tripleo "Mitaka jobs broken by gnocchiclient move to osc-lib" [Critical,Triaged]23:10
*** rhallisey has quit IRC23:13
openstackgerritMerged openstack/tripleo-heat-templates: Remove keystone PKI related parameters  https://review.openstack.org/35055623:18
*** jcoufal has quit IRC23:30
*** jcoufal has joined #tripleo23:41
*** dtrainor has quit IRC23:41
*** dtrainor has joined #tripleo23:41
*** myoung is now known as myoung|afk23:46

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!