Wednesday, 2016-11-30

*** ctayal has quit IRC00:02
*** mburned is now known as mburned_out00:10
*** penick_ has quit IRC00:16
*** dmarlin has quit IRC00:17
*** liverpooler has quit IRC00:32
*** lblanchard has joined #tripleo00:32
openstackgerritMerged openstack/instack-undercloud: Changed author and author-email  https://review.openstack.org/39936700:33
openstackgerritMerged openstack/python-tripleoclient: Clean up image exceptions  https://review.openstack.org/40440800:33
*** numans has quit IRC00:37
*** limao has joined #tripleo00:37
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Improve checksum performance for images  https://review.openstack.org/40031100:48
*** flepied has joined #tripleo00:58
openstackgerritMerged openstack/python-tripleoclient: Exit before post-deploy code if we are updating the plan only  https://review.openstack.org/40202501:00
openstackgerritMerged openstack/python-tripleoclient: Updated from global requirements  https://review.openstack.org/40091101:00
openstackgerritMerged openstack/puppet-tripleo: pacemaker: create Mysql_user once Galera is ready (puppet4)  https://review.openstack.org/40443701:00
*** nyechiel has joined #tripleo01:13
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: deployment updates for containerized compute  https://review.openstack.org/40098601:14
*** rajinir has quit IRC01:16
*** dmacpher has quit IRC01:20
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: config for containerized-compute  https://review.openstack.org/39334801:27
rookmwhahaha should the # of workers be 1/2 the cores or 1/2 one socket?01:41
mwhahahaIt uses processor count so cores01:43
mwhahahaAnd it's count/401:43
rookahh ok mwhahaha01:43
rookmwhahaha: how did you come up with /401:45
*** nyechiel has quit IRC01:46
mwhahahaAsk pradk01:47
*** dhill_ has quit IRC01:48
*** dhill__ has joined #tripleo01:48
mwhahaharook: so these are defaults and not necessarily the most optimized possible settings. The goal is to not do stupid stuff by default. Any tunings should be handled outside of the defaults01:49
rookthe /4th is not a default.01:51
mwhahahaTrying to come up with a single formula for all services is probably not realistic so we started with a conservative approach. If we need to adjust please provided data for an alternative01:51
rooka default is based on cores... I don't see a good reason to /4 -- but I am happy to review data you guys have01:51
rookto suggest otherwise.01:51
rookmwhahaha: yeah, I am running against trunk01:51
*** Goneri has quit IRC01:52
mwhahahaFor keystone, gnocchi and other services we found our formula to be a better alternative to the python cores only default01:52
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: WIP: Create a demo Mistral workflow for Tendlr integration  https://review.openstack.org/40449901:52
mwhahahaAlso things like Solaris where cores are in the hundreds makes that a non starter01:53
mwhahahaThe formula is is a min of 2 with a sliding scale of cores/4 to a max of 801:53
mwhahahaWe can adjust it to /2 with a max of 16 if you find that to work better01:54
rookmwhahaha ill get some data.01:54
mwhahahaBut I have yet to see additional data to indicate something better01:54
rookmwhahaha will be on the back burner during some other things01:54
rookmwhahaha it would be good to know what and how you tested01:55
rookie, using Rally at a single concurrency and times, or multiple01:55
rookand what scenarios01:55
rookanyway, its late here.01:55
rooktahnks mwhahaha01:55
mwhahahaK01:56
rook*thanks01:56
*** ccamacho has quit IRC01:57
thrashEmilienM: thanks. I'll look at it tomorrow.02:00
*** thrash is now known as thrash|g0ne02:02
*** chem has quit IRC02:02
*** ccamacho has joined #tripleo02:02
*** chem has joined #tripleo02:04
*** ctayal has joined #tripleo02:09
*** lblanchard has quit IRC02:22
*** bana_k has quit IRC02:24
*** TSCHAK has quit IRC02:26
*** dsneddon_ has quit IRC02:32
*** dsneddon_ has joined #tripleo02:35
*** dmacpher has joined #tripleo02:39
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: WIP: Create a demo Mistral workflow for Tendlr integration  https://review.openstack.org/40449902:42
*** fzdarsky_ has joined #tripleo02:42
*** fzdarsky has quit IRC02:46
*** ctayal has quit IRC02:48
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Fix grammar  https://review.openstack.org/40444202:49
*** flepied has quit IRC02:59
*** achadha has quit IRC03:01
*** achadha has joined #tripleo03:01
*** ayoung has joined #tripleo03:02
*** achadha has quit IRC03:06
*** achadha has joined #tripleo03:08
*** pmannidi has quit IRC03:09
*** achadha has quit IRC03:12
*** links has joined #tripleo03:28
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore  https://review.openstack.org/36544903:30
openstackgerritMerged openstack/instack-undercloud: Fix package update cases  https://review.openstack.org/40095603:37
openstackgerritIan Wienand proposed openstack/diskimage-builder: Improve checksum performance for images  https://review.openstack.org/40031103:43
*** dmacpher has quit IRC03:47
*** achadha has joined #tripleo03:48
*** achadha has quit IRC03:53
*** achadha has joined #tripleo04:02
*** dmacpher has joined #tripleo04:04
*** dsneddon_ has quit IRC04:06
*** numans has joined #tripleo04:06
*** bana_k has joined #tripleo04:14
openstackgerritIan Wienand proposed openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225304:16
openstackgerritMerged openstack/diskimage-builder: Fix a typo  https://review.openstack.org/39934104:20
*** bana_k has quit IRC04:24
*** misty-cloud has joined #tripleo04:27
*** sudipto has joined #tripleo04:31
*** sudipto_ has joined #tripleo04:31
*** prateek has joined #tripleo04:31
openstackgerritMerged openstack/tripleo-heat-templates: Fix grammar  https://review.openstack.org/40444204:33
*** yamahata has quit IRC04:35
*** Vijayendra_ has joined #tripleo04:36
*** pmannidi has joined #tripleo04:39
*** dsneddon_ has joined #tripleo04:46
*** achadha has quit IRC04:48
*** achadha has joined #tripleo04:50
*** dsneddo__ has joined #tripleo04:51
*** misty-cloud has quit IRC04:51
*** rlandy|fallout has quit IRC04:51
*** udesale has joined #tripleo04:51
*** misty-cloud has joined #tripleo04:51
*** achadha_ has joined #tripleo04:52
*** dsneddon_ has quit IRC04:52
*** prateek has quit IRC04:53
*** sudipto_ has quit IRC04:54
*** sudipto has quit IRC04:54
*** dsneddo__ has quit IRC04:54
*** prateek has joined #tripleo04:54
*** achadha has quit IRC04:55
*** dsneddon_ has joined #tripleo04:56
*** ola has joined #tripleo04:58
*** ola is now known as Guest934704:58
*** yprokule has joined #tripleo05:05
*** dsneddo__ has joined #tripleo05:06
openstackgerritMerged openstack/diskimage-builder: Improve checksum performance for images  https://review.openstack.org/40031105:07
*** dsneddon_ has quit IRC05:07
*** masco has joined #tripleo05:07
*** ramishra has quit IRC05:16
*** Guest9347 has quit IRC05:17
*** ramishra has joined #tripleo05:18
*** saneax-_-|AFK is now known as saneax05:19
*** sudipto has joined #tripleo05:19
*** sudipto_ has joined #tripleo05:20
*** dsneddo__ has quit IRC05:23
*** iranzo has joined #tripleo05:24
*** iranzo has joined #tripleo05:24
*** dsneddon_ has joined #tripleo05:25
*** ctayal has joined #tripleo05:28
*** chandankumar|off is now known as chandankumar05:29
*** dsneddon_ has quit IRC05:30
*** dsneddo__ has joined #tripleo05:32
openstackgerritMerged openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225305:32
*** dsnedd___ has joined #tripleo05:35
*** dsneddo__ has quit IRC05:39
*** ctayal has quit IRC05:42
*** markmc has quit IRC05:42
*** markmc has joined #tripleo05:43
*** ctayal has joined #tripleo05:43
*** Vijayendra__ has joined #tripleo05:48
*** Vijayendra_ has quit IRC05:50
*** achadha_ has quit IRC05:52
*** pkovar has joined #tripleo05:59
*** abregman has joined #tripleo05:59
*** ctayal has quit IRC06:06
*** jaosorior has joined #tripleo06:06
*** dsnedd___ has quit IRC06:10
*** dsneddon_ has joined #tripleo06:17
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: debugging - do not merge  https://review.openstack.org/40456006:17
*** achadha has joined #tripleo06:21
*** yamahata has joined #tripleo06:26
*** dsneddo__ has joined #tripleo06:40
*** dsneddon_ has quit IRC06:43
*** dmacpher has quit IRC06:47
*** dsneddon has quit IRC06:48
*** dsneddo__ has quit IRC06:49
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Add option to set undercloud dns nameserver  https://review.openstack.org/40093706:49
*** chem has quit IRC06:53
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Use the overcloudrc generated in a Mistral action  https://review.openstack.org/39897506:55
openstackgerritDougal Matthews proposed openstack/tripleo-common: Only start the deploy if the Heat stack isn't already in progress  https://review.openstack.org/39656706:56
*** oshvartz has joined #tripleo06:58
openstackgerritMerged openstack/python-tripleoclient: Show team and repo badges on README  https://review.openstack.org/40258307:01
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Add option to set undercloud dns nameserver  https://review.openstack.org/40093707:02
*** bana_k has joined #tripleo07:05
jaosoriord0ugal: is there a timeout for the plan upload?07:06
*** lmiccini has joined #tripleo07:07
d0ugaljaosorior: not exactly - plan upload happens directly with swift. so there is no zaqar queue etc.07:07
d0ugaljaosorior: swiftclient may have some timeouts, so maybe - but nothing we add07:07
*** jaosorior has quit IRC07:08
* d0ugal waits for jaosorior to return07:08
*** jaosorior has joined #tripleo07:09
d0ugaljaosorior: not exactly - plan upload happens directly with swift. so there is no zaqar queue etc.07:09
*** aufi has joined #tripleo07:09
d0ugaljaosorior: swiftclient may have some timeouts, so maybe - but nothing we add07:09
jaosoriordamn flaky internet..07:09
jaosorioraah, alright07:09
jaosoriorgotta check that out then07:09
jaosoriorrecently saw a timeout there07:09
d0ugaljaosorior: but it depends what you mean by "plan upload" :)07:09
jaosoriorthat was the last thing in the tripleoclient log07:09
jaosoriortrying to reproduce it now07:09
d0ugaljaosorior: creating a plan is a series of three steps - you call a mistral action that creates the swift container, you upload the files directly to swift, you call a mistral workflow to process the files07:10
d0ugaljaosorior: only the last step has a timeout, as it is the only bit that uses zaqar for the response07:10
d0ugaljaosorior: Can you link me to the log?07:10
jaosoriord0ugal: http://logs.openstack.org/38/391738/47/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/ce04860/console.html#_2016-11-29_19_10_01_47335407:11
jaosoriord0ugal: and the problem is that since it didn't have a timeout, it just got killed by devstack and we got no more relevant logs back :/07:11
* d0ugal just remembered it is a public holiday here07:11
jaosoriord0ugal: ah, nice! what's celebrated?07:12
d0ugaljaosorior: St. Andrew's Day07:12
d0ugaljaosorior: I am going to guess that the files uploaded to swift and the workflow was triggered. Just looking at the logs.07:13
d0ugaloh, since it timed out the logs are missing?07:13
jaosoriord0ugal: yep07:14
d0ugaldammit! This is the worst :P07:14
jaosoriorindeed07:14
jaosoriorwell, it seems that it worked this time07:14
jaosoriornow I see 2016-11-30 07:13:58.977726 | Waiting for messages on queue '665e026c-61b8-42ea-86ab-138c84050154' with no timeout.07:15
d0ugaloh07:15
d0ugalMaybe I missed one.07:15
d0ugaljaosorior: that message coule mean the deploy has been started - we don't timeout that.07:18
jaosorior2016-11-30 07:13:20.217316 | Removing the current plan files07:18
jaosorior2016-11-30 07:13:31.874595 | Uploading new plan files07:18
jaosorior2016-11-30 07:13:43.194591 | Started Mistral Workflow tripleo.plan_management.v1.update_deployment_plan. Execution ID: 086f9cd4-0841-40c9-919d-fb09d094d16407:18
jaosorior2016-11-30 07:13:55.009823 | Plan updated07:18
jaosorior2016-11-30 07:13:55.334107 | Deploying templates in the directory /tmp/tripleoclient-K9WQ19/tripleo-heat-templates07:18
jaosorior2016-11-30 07:13:58.054448 | Started Mistral Workflow tripleo.deployment.v1.deploy_plan. Execution ID: 05e62ab5-d5c2-4fce-a85e-5a92e92aca5e07:18
jaosorior2016-11-30 07:13:58.977726 | Waiting for messages on queue '665e026c-61b8-42ea-86ab-138c84050154' with no timeout.07:18
jaosoriord0ugal: ^^07:18
d0ugaljaosorior: cool, so yeah, it is for the deploy07:19
jaosorioryay07:19
d0ugaljaosorior: that message is probably a bit noisy, alarming. I wonder if I should change it07:19
jaosoriorstrange I'm not seeing any heat events print out.07:19
d0ugaljaosorior: that is the start of the deploy workflow07:20
d0ugaljaosorior: so I would expect you to see Heat events soon...07:20
d0ugalbut yeah, that was 8 mins ago already :/07:20
jaosorioryep07:20
jaosoriorpretty strange07:20
jaosoriorbut I think I had seen issues with this before07:20
jaosoriorAFAIK the overcloud deploy does timeout nicely07:20
jaosoriorso some logs will be had07:20
*** rasca has joined #tripleo07:22
*** fzdarsky_ is now known as fzdarsky07:24
*** rcernin has joined #tripleo07:28
*** dciabrin|away is now known as dciabrin07:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Add option to set undercloud dns nameserver  https://review.openstack.org/40093707:29
d0ugaljaosorior: any Heat events yet?07:30
*** jprovazn has joined #tripleo07:31
d0ugaljaosorior: I am going to add a timeout to the deploy workflow - probably 6 mins again07:31
d0ugaljaosorior: it should be really fast, here it was about 25 seconds. http://logs.openstack.org/75/398975/9/check/gate-tripleo-ci-centos-7-nonha-multinode/de52a7c/console.html#_2016-11-29_18_08_46_92636707:31
d0ugal(just to pick a randon CI run)07:31
jaosoriord0ugal: no heat events07:31
*** mcornea has joined #tripleo07:32
openstackgerritChristian Schwede proposed openstack/puppet-tripleo: Set memcache_servers in /etc/swift/object-expirer.conf  https://review.openstack.org/40459807:33
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Add option to set undercloud dns nameserver  https://review.openstack.org/40093707:34
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Add a timeout when waiting for messages from the deploy workflow  https://review.openstack.org/40460107:35
d0ugaljaosorior: You might want to depend-on ^ for your next try07:35
*** florianf has joined #tripleo07:35
jaosoriornice07:36
jaosoriord0ugal: will do, thanks dude07:36
d0ugaljaosorior: no worries, it's quite alarming that this all fails so badly07:36
d0ugalWe really need to rewrite some of the CLI so that waiting for messages isn't a blocking operation. Then it could check the workflow status periodically07:38
d0ugalbut I've not had time to figure out how to do that yet...07:38
jaosoriord0ugal: well, partly it's my fault, the TLS everywhere job I'm testing changes the fqdn of the undercloud, and that's where I started stumbling with zaqar errors, since it autodetects its hostname on startup, so the first issue was that, that it was trying to send notifications to itself but it was failing.07:39
jaosoriorreally hitting some corner cases here07:39
d0ugalhah, nice07:40
d0ugalYou should write this up at the end, sounds like it could make a good war story :)07:40
jaosoriord0ugal: haha maybe when it's over07:40
d0ugalonce you have recovered!07:41
jaosoriord0ugal: I'm pretty sure I'm gonna hit selinux issues (again) when I finally get a proper overcloud deploy to start07:41
d0ugal:/07:41
jaosoriorit'll be fiiine07:42
jaosoriorat some point this has to work07:43
*** pmannidi has quit IRC07:43
*** bana_k has quit IRC07:45
*** achadha has quit IRC07:46
*** anshul has joined #tripleo07:49
*** sudipto has quit IRC07:50
*** sudipto_ has quit IRC07:50
*** dsariel has joined #tripleo07:51
*** leanderthal|afk is now known as leanderthal07:51
*** ealcaniz has joined #tripleo07:56
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Use the overcloudrc generated in a Mistral action  https://review.openstack.org/39897508:00
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: [WIP] overcloudrc command  https://review.openstack.org/40435408:00
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates: WIP -- Add pacemaker ansible module of composable upgrade  https://review.openstack.org/40339708:01
*** limao has quit IRC08:03
*** Vijayendra__ has quit IRC08:04
*** shardy has joined #tripleo08:04
*** artom_ has joined #tripleo08:04
*** artom_ has quit IRC08:05
*** artom_ has joined #tripleo08:05
*** links has quit IRC08:06
*** artom has quit IRC08:07
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Add option to set DNS name servers on the undercloud  https://review.openstack.org/40145208:09
*** dsneddon has joined #tripleo08:11
ccamachomorning guys!08:11
matbuccamacho: hello08:12
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: [WIP] overcloudrc command  https://review.openstack.org/40435408:12
d0ugalMorning!08:13
matbusshnaidm: hey, when you will be there, could you point me to an example of your oooq/tripleo-ci jobs ?08:13
jaosoriorccamacho: morning dude, how's it going?08:13
*** dsneddon_ has joined #tripleo08:14
jaosoriorshardy: in CI, do we have a timeout for the overcloud deploy? or does it just keep going until the job itself times out?08:15
ccamachojaosorior matbu , quick question, do you know in which cases I can have "hiera -c /etc/puppet/hiera.yaml bootstrap_nodeid" == nil   http://paste.openstack.org/show/590919/    Im running the upgrade but it hangs, because is not starting the pcs cluster08:16
ccamachoAnd I only have one controller08:16
ccamachoo/08:16
jaosoriorI actually don't know in which cases you could get that, AFAIK it shouldn't be nil08:17
*** jlinkes has joined #tripleo08:17
*** Vijayendra has joined #tripleo08:17
*** dsneddon has quit IRC08:17
jaosoriorccamacho: try sudo hiera bootstrap_nodeid08:17
matbuccamacho: jaosorior yep, i shouldn't, but it doesn't help you :)08:17
matbus/i/it/08:17
jaosoriorccamacho: might be a permissions issue08:18
matbuccamacho: i have one node and mine is overcloud-controller-008:18
shardyjaosorior: we do see OVERCLOUD_DEPLOY_TIMEOUT in toci_gate_test.sh08:18
*** links has joined #tripleo08:18
matbuccamacho: yep , try with sudo08:18
matbuccamacho: you are logged at heat-admin08:19
*** arxcruz has joined #tripleo08:19
sshnaidmmatbu, hi08:19
sshnaidmmatbu, it's two experimental jobs08:19
*** limao has joined #tripleo08:19
*** pgadiya has joined #tripleo08:19
sshnaidmmatbu, example run: https://review.openstack.org/#/c/403848/08:20
jaosoriorshardy: I see it now, thanks08:21
sshnaidmmatbu, any of ovb jobs there, i.e. http://logs.openstack.org/48/403848/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/c9e93c5/console.html08:21
sshnaidmmatbu, right now it's broken until this patch will be merged: https://review.openstack.org/#/c/403843/08:21
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: [WIP] overcloudrc command  https://review.openstack.org/40435408:22
*** jpena|off is now known as jpena08:22
sshnaidmbtw, jaosorior , shardy could you please merge fixes for quickstart job? https://review.openstack.org/#/c/403843/  thanks08:22
openstackgerritMerged openstack/tripleo-common: Fix invalid tests.  https://review.openstack.org/40418508:23
jaosoriorsshnaidm: it seems the oooq jobs are still failing in that CR08:24
ccamachomatbu jaosorior, yeahp, that made the trick,:)08:24
sshnaidmjaosorior, I run them here: https://review.openstack.org/#/c/40384808:24
jaosoriorsshnaidm: right, so I guess they are still running. Is it cool if we wait for the results of that CR?08:25
*** amoralej|off is now known as amoralej08:25
matbusshnaidm: ack thank you :)08:25
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: [WIP] overcloudrc command  https://review.openstack.org/40435408:25
sshnaidmjaosorior, I mean I ran them :) but no problem to recheck again08:26
*** cylopez has joined #tripleo08:26
jaosoriorsshnaidm: ah, I didn't see the oooq results there08:27
jaosoriorsshnaidm: aaah now I see08:27
jaosoriorhadn't seen that you run oooq instead of ovb there08:27
sshnaidmjaosorior, yeah, little trick there08:28
jaosoriorsshnaidm: done08:28
sshnaidmjaosorior, cool, thanks!08:29
jaosoriorshardy: I am trying to create a job and for some reason the overcloud deployment keeps timing out; I'm not sure what's causing that, could you help me out figuring it out? http://logs.openstack.org/38/391738/47/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/9bb4796/ really stuck here :/08:31
*** ebarrera has joined #tripleo08:31
*** dsneddon has joined #tripleo08:32
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: [WIP] overcloudrc command  https://review.openstack.org/40435408:32
*** dsneddon_ has quit IRC08:35
*** aufi has quit IRC08:37
*** aufi has joined #tripleo08:40
*** sudipto_ has joined #tripleo08:40
*** sudipto has joined #tripleo08:40
*** akrivoka has joined #tripleo08:42
*** tremble has joined #tripleo08:45
*** numans has quit IRC08:47
*** achadha has joined #tripleo08:47
*** tremble has quit IRC08:51
*** abregman is now known as abregman|mtg08:52
*** achadha has quit IRC08:52
shardyhttp://logs.openstack.org/38/391738/47/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/9bb4796/logs/undercloud/var/log/heat/heat-engine.txt.gz#_2016-11-30_08_21_23_31208:56
shardyjaosorior: looks like heat can't connect to rabbit08:56
shardyso it 's just got stuck08:56
jaosoriorshardy: but that happened way down the logs. could it have been that it timed out and the rabbit connection was closed?08:57
shardyjaosorior: well the timestamp says the first rabbit timeout happend about 1 minute after the stack create started08:58
shardyperhaps rabbit got OOM killed or something?08:58
*** b00tcat has joined #tripleo08:58
*** b00tcat has quit IRC08:58
*** b00tcat has joined #tripleo08:58
shardyHmm, can't see that happening08:59
shardyhttp://logs.openstack.org/38/391738/47/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/9bb4796/logs/undercloud/var/log/rabbitmq/rabbit@tripleo-centos-7-tripleo-test-cloud-rh1-5877384-sasl.txt.gz08:59
shardyThat has a bunch of crash reports in it08:59
*** numans has joined #tripleo09:00
shardylooks like a name lookup failure?09:00
jaosoriorshardy: name lookup failure?09:01
shardyjaosorior: well there's an nxdomain in the error09:01
shardyReason:     {badmatch,{error,nxdomain}}09:02
shardylooks dns-ish to me, but I guess you'll need to reproduce locally and see09:02
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173809:02
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: debugging - do not merge  https://review.openstack.org/40456009:02
jaosoriorshardy: haven't been able to reproduce it...09:03
jaosoriorshardy: but I do change the undercloud's fqdn after the undercloud install, which is the only variable I know of that I don't do in my local deployment09:03
jaosoriortrying to do that before the undercloud install, lets see if that works09:04
*** numans has quit IRC09:04
shardyjaosorior: aha, sounds like it's worth trying09:04
openstackgerritAparna proposed openstack/diskimage-builder: Update hpssacli to ssacli in proliant-tools element  https://review.openstack.org/39650409:05
openstackgerritAnshul Jain proposed openstack/diskimage-builder: DIB element to support cinder local attach/detach functionality  https://review.openstack.org/38588009:06
*** yprokule has quit IRC09:08
*** yamahata has quit IRC09:09
jaosoriorBy the way, adding encrypted volumes to the scenario tests, can someone check this out? https://review.openstack.org/#/c/404223/09:11
*** jaosorior is now known as jaosorior_lunch09:13
*** zoli|gone is now known as zoli|tng09:25
*** lucas-afk is now known as lucasagomes09:33
*** Vijayendra has quit IRC09:36
*** zoli|tng is now known as zoli|trng09:39
*** oshvartz has quit IRC09:40
*** oshvartz has joined #tripleo09:42
openstackgerrityolanda.robla proposed openstack/tripleo-quickstart: Always upload overcloud image when has been customized  https://review.openstack.org/39684909:47
openstackgerritvikrant proposed openstack/tripleo-validations: Fixes undercloud-tokenflush validation  https://review.openstack.org/40468809:48
*** yprokule has joined #tripleo09:49
*** paramite has joined #tripleo09:49
*** bkopilov_ has quit IRC09:49
*** Vijayendra has joined #tripleo09:54
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart: WIP: Update OOOQ to ansible 2.2  https://review.openstack.org/39819409:55
*** chem has joined #tripleo09:57
*** abregman|mtg is now known as abregman09:59
*** derekjhyang has joined #tripleo09:59
openstackgerritChristopher Brown proposed openstack/tripleo-docs: Remove WIP message  https://review.openstack.org/40469709:59
*** links has quit IRC10:05
*** achadha has joined #tripleo10:09
openstackgerritAlejandro Andreu proposed openstack/puppet-tripleo: Adds new tripleo::network::midonet::config class  https://review.openstack.org/40134210:12
*** milan has joined #tripleo10:13
openstackgerritAlejandro Andreu proposed openstack/puppet-tripleo: Adds new tripleo::network::midonet::mem class  https://review.openstack.org/40192810:14
openstackgerritAlejandro Andreu proposed openstack/puppet-tripleo: Adds new tripleo::network::midonet::mem class  https://review.openstack.org/40192810:15
openstackgerritAlejandro Andreu proposed openstack/puppet-tripleo: Adds class tripleo::network::midonet::gateway  https://review.openstack.org/40198310:15
*** jlinkes_ has joined #tripleo10:16
*** achadha has quit IRC10:16
*** brault has joined #tripleo10:17
*** andreaf has quit IRC10:17
*** milan has quit IRC10:18
*** andreaf has joined #tripleo10:18
openstackgerritAlejandro Andreu proposed openstack/puppet-tripleo: Adds tripleo::network::midonet::insights class  https://review.openstack.org/40206210:19
*** larstobi has quit IRC10:19
*** jlinkes has quit IRC10:19
*** brault_ has quit IRC10:19
*** rook has quit IRC10:19
*** jaosorior_lunch has quit IRC10:19
*** iranzo has quit IRC10:19
*** ayoung has quit IRC10:19
*** bnemec has quit IRC10:19
*** soc_off has quit IRC10:19
*** timothyb89 has quit IRC10:19
*** soc_off_ has joined #tripleo10:19
b00tcatsorry, rebasing a lot ^^^10:19
*** colonwq has quit IRC10:19
*** bswartz has quit IRC10:19
*** iranzo has joined #tripleo10:19
*** iranzo has joined #tripleo10:20
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras: Expose the tempest results to the top level of the collected logs  https://review.openstack.org/40471010:20
*** timothyb89 has joined #tripleo10:20
*** bnemec has joined #tripleo10:21
*** links has joined #tripleo10:21
*** limao_ has joined #tripleo10:25
*** vkmc has quit IRC10:25
*** limao has quit IRC10:25
*** rook has joined #tripleo10:26
*** rook is now known as Guest6827910:26
*** limao_ has quit IRC10:27
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173810:27
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: debugging - do not merge  https://review.openstack.org/40456010:27
*** vkmc has joined #tripleo10:27
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: [WIP] overcloudrc command  https://review.openstack.org/40435410:28
*** larstobi has joined #tripleo10:30
*** larstobi has quit IRC10:31
*** zoli|trng is now known as zoli|lunch10:31
*** jaosorior_lunch has joined #tripleo10:31
*** colonwq has joined #tripleo10:32
*** pcaruana has joined #tripleo10:35
*** derekh has joined #tripleo10:36
*** larstobi has joined #tripleo10:36
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173810:38
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: debugging - do not merge  https://review.openstack.org/40456010:38
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use command instead of env var for setting the hostname in the undercloud  https://review.openstack.org/40471710:38
*** jaosorior_lunch is now known as jaosorior10:41
*** Vijayendra has quit IRC10:42
*** Vijayendra has joined #tripleo10:43
*** nyechiel has joined #tripleo10:45
*** gfidente has joined #tripleo10:45
*** tosky has joined #tripleo10:45
*** apetrich has joined #tripleo10:48
jprovazngfidente: hi10:49
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Add debug to image builds  https://review.openstack.org/40472310:55
*** tremble has joined #tripleo10:57
*** tremble has joined #tripleo10:57
*** udesale has quit IRC10:57
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Add validation parameters to overcloud deploy  https://review.openstack.org/40472611:03
*** links has quit IRC11:07
*** links has joined #tripleo11:07
flaper87shardy: so, I think I've tracked the issue down (the one I mentioend yday about not being able to fetch the contents of my env file). I think heatclient is having troubles with relative paths and they were not entirely fixed by f13d36ae0114e159663ea2a3fa07260df9d9407d :/11:12
flaper87brb, lunch11:12
flaper87will keep poking later11:12
shardyflaper87: ugh, OK thanks for the update11:16
shardyflaper87: there's various nasty path mangling in tripleoclient which I'm hoping to remove in due course11:16
*** misty-cloud has quit IRC11:16
shardyflaper87: if you can ping me a reproducer I'll take a look later11:16
*** Vijayendra has quit IRC11:21
*** sudipto has quit IRC11:23
*** sudipto_ has quit IRC11:23
*** flepied has joined #tripleo11:23
openstackgerritMerged openstack/tripleo-heat-templates: Disable all repos during rhel registration  https://review.openstack.org/38123311:26
*** Vijayendra has joined #tripleo11:26
*** nyechiel has quit IRC11:27
*** tremble has quit IRC11:27
jaosoriorbandini: hey dude, could you check this one out? https://review.openstack.org/#/c/403518/311:28
openstackgerrityolanda.robla proposed openstack/tripleo-quickstart: Allow to consume external overcloud images  https://review.openstack.org/40473411:31
*** tremble has joined #tripleo11:31
*** tremble has quit IRC11:31
*** tremble has joined #tripleo11:31
openstackgerritAlejandro Andreu proposed openstack/puppet-tripleo: Adds tripleo::network::midonet::insights class  https://review.openstack.org/40206211:32
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Set validate_image_dir relative to working dir  https://review.openstack.org/40417911:33
openstackgerritDougal Matthews proposed openstack/tripleo-common: Move the overcloudrc generation from tripleoclient to a Mistral action  https://review.openstack.org/39721111:34
*** thrash|g0ne is now known as thrash11:34
*** jprovazn has quit IRC11:40
yolandahi , derekh or other people that know ci... i'm trying to see failures on http://logs.openstack.org/51/401251/13/check/gate-tripleo-ci-centos-7-nonha-multinode/a54816b/console.html#_2016-11-30_11_26_16_42195811:43
yolandai see error like http://logs.openstack.org/51/401251/13/check/gate-tripleo-ci-centos-7-nonha-multinode/a54816b/console.html#_2016-11-30_11_26_16_42195811:43
yolandahow shall these images be generated?11:43
yolandai just see code falls to "generate dummy overcloud image", that doesn't create those11:44
jaosoriorbandini: thanks dude11:45
yolandanah, i saw it's a red herring :(11:46
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Enable cinder-backup service  https://review.openstack.org/39658711:47
bandinijaosorior: for some reason I was 100% sure I reviewed that one yesterday11:48
jaosoriorbandini: it's cool, there were many CRs, sorry about that11:49
bandinijaosorior: thank you for that work ;)11:49
*** zoli|lunch is now known as zoli|trng11:49
yolandacan i get help debugging failure on http://logs.openstack.org/51/401251/13/check/gate-tripleo-ci-centos-7-nonha-multinode/a54816b/console.html ?11:50
yolandajust fails with 2016-11-30 11:29:55.234839 | 2016-11-30 11:29:47Z [overcloud.ControllerAllNodesValidationDeployment.0]: CREATE_FAILED  Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 111:51
yolandabut i don't have a clue about where to find the failures11:51
jaosorioryolanda: so, you gotta check the postci logs11:52
jaosoriorthose are more explicit about the failure11:52
jaosoriorso one directory above http://logs.openstack.org/51/401251/13/check/gate-tripleo-ci-centos-7-nonha-multinode/a54816b/11:52
jaosoriorthen go to logs11:52
jaosoriorand the file is postci.txt.gz11:52
yolandaoh11:52
yolandaok11:52
jaosorioryolanda: http://logs.openstack.org/51/401251/13/check/gate-tripleo-ci-centos-7-nonha-multinode/a54816b/logs/postci.txt.gz11:52
jaosorioryolanda: this is the issue http://logs.openstack.org/51/401251/13/check/gate-tripleo-ci-centos-7-nonha-multinode/a54816b/logs/postci.txt.gz#_2016-11-30_11_30_33_00011:52
yolanda ImportError: No module named ipaddr11:53
yolandaweird...11:53
yolandai have not done any changes for that11:53
jaosoriorvery weird indeed, seems that the image is missing packages11:53
*** misty-cloud has joined #tripleo11:53
yolandai'm trying to test dib feature/v2 branch11:54
yolandabut i thought it was not messing with packages11:54
jaosorioryolanda: I'm sorry, I'm not sure what that means11:54
yolandadiskimage-builder11:54
yolandathere is a new feature branch, called v211:54
jaosoriorI meant the feature/v2 branch11:54
yolandaand CI crashes on it11:54
jaosorioroh, right11:54
openstackgerritMerged openstack/tripleo-quickstart-extras: Only clone DLRN in role if needed  https://review.openstack.org/40204611:54
jaosoriorthought it was a specific version of dib or something of the sort11:54
jaosoriorok11:54
yolandai chained several patches to fix that, but this is a new problem11:54
yolandajaosorior, this job just uses a dummy image there, as far as i could see, right?11:55
yolandai saw it was falling on11:55
yolanda    # Create dummy overcloud-full image since there is no way (yet) to disable11:55
yolanda    # this constraint in the heat templates11:55
jaosorioryolanda: it does, since it's a multinode job11:58
yolandajaosorior, where are those packages installed and the real image generated then?11:58
jaosorioryolanda: I don't know11:58
yolanda:(11:58
jaosoriorBUT11:58
jaosoriorlets see if we can figure it out11:58
yolandathanks for giving a hand there, i'm so lost11:59
* jaosorior is usually lost as well11:59
jaosoriorlets see11:59
*** Vijayendra has quit IRC11:59
yolandaless than me :)11:59
jaosorioryolanda: so, the multinode job will attempt to spawn the overcloud node(s) in subnodes12:00
jaosorioryou can usually find the logs in such a way12:00
jaosoriorfor instance, for this job the multinode deployment is an all-in-one node that contains the overcloud services and the compute as well12:01
jaosoriorthat node is usually subnode-212:01
jaosoriorhere are the logs http://logs.openstack.org/51/401251/13/check/gate-tripleo-ci-centos-7-nonha-multinode/a54816b/logs/subnode-2/12:01
*** dsneddon has quit IRC12:01
yolandabut there are no image builds there as well12:01
jaosorioryolanda: do you know what package provides the ipaddr python module?12:01
jaosorioryolanda: I think the only jobs that are gonna get the image builds reflected are the ovb jobs12:02
yolandapython-ipaddr12:02
yolandaovb logs are super useful :)12:03
yolandahttp://logs.openstack.org/61/404161/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6b17776/console.html#_2016-11-30_11_51_09_79064412:03
yolandano clue about why dib fails there12:03
jaosoriordammit12:04
yolandai added a DIB_DEBUG_TRACE to see if i get more info, but seems the wrapper is just masking output from diskimage-builder12:04
jaosoriorthe logs are not very explicit http://logs.openstack.org/61/404161/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6b17776/logs/undercloud/var/log/image_build.txt.gz12:04
jaosorioryolanda: where did you add DIB_DEBUG_TRACE ?12:04
yolandahttps://review.openstack.org/#/c/404723/12:05
yolandanot sure if that's going to take effect12:05
jaosoriornot sure either12:05
yolandai rechecked to get that output again. But i think that wrapper has a problem, was nested in some python subprocess call, just capturing the exit code and not the output itself12:07
*** jtomasek has joined #tripleo12:07
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173812:07
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: debugging - do not merge  https://review.openstack.org/40456012:07
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Add Zaqar to scenario002  https://review.openstack.org/40473712:08
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart: Update OOOQ to ansible 2.2  https://review.openstack.org/39819412:10
*** adarazs is now known as adarazs_lunch12:12
flaper87shardy: tbh, the reproducer so far has been just running overcloud deploy with latest t-h-t and heatclient. It concatenates the base_path with the template path, which is a problem when the template path has '..' in it12:12
jaosorioryolanda: I think you're right, the wrapper disregards the actual environment variables12:12
yolandajaosorior, what do you recomend to debug that?12:13
jaosorioryolanda: this is where they're set https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L44912:13
jaosorioryolanda: I recommend we fix the wrapper12:13
jaosoriorlets see12:13
yolandaeven without DIB_DEBUG_TRACE, but a proper capture of the output, it will give some hints12:14
flaper87shardy: it might very well be that it's failing at getting the template base ur;12:14
*** achadha has joined #tripleo12:14
jaosoriorthrash: are you around?12:14
thrashjaosorior: yah. wassup?12:14
jaosoriorthrash: you did some work with the tripleoclient, on the dib image wrapper, right?12:15
thrashyes.12:15
thrashthe yaml one?12:15
thrashin general too.12:16
jaosoriorthrash: I'm not entirely sure which are we using in CI12:16
jaosoriorthrash: but the deal is that we need more output from it12:16
thrashI'm pretty sure it's the yaml version.12:16
thrashfrom... what? dib?12:16
jaosoriorthrash: yolanda is trying to set DIB_DEBUG_TRACE but that's not being taken into account12:16
jaosoriorthrash: and it seems that the dib output is being discarded12:16
thrashjaosorior: it would probably need to be set in the yaml itself.12:17
thrashwe pass a limited environment to dib.12:17
*** slagle has joined #tripleo12:17
thrashjaosorior: you should be able to just add another yaml file to the cli12:18
thrashjaosorior: one sec, I'll show you where...12:18
thrashjaosorior: https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L13412:18
thrashthose args...12:18
thrashyou could add '--config-file my_debug.yaml'12:19
yolandathrash, jaosorior , i could even ignore the DIB_DEBUG_TRACE flag, but i'd like to capture the real output of diskimage-builder12:19
*** misty-cloud has quit IRC12:19
yolandabecause it fails silently on CI12:19
*** jtomasek has quit IRC12:19
yolandathrash, look http://logs.openstack.org/61/404161/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6b17776/console.html#_2016-11-30_11_51_09_79064412:19
yolandaso you can see "returned non-zero exit status 1", but you cannot see the real failure12:19
*** achadha has quit IRC12:19
thrashyolanda: is that happening everywhere? Or just on this job?12:20
thrashyolanda: and that patch?12:20
*** nyechiel has joined #tripleo12:20
yolandathrash, i've seen that on ovb jobs12:20
yolandabut the other jobs are not calling disk-image-create directly12:20
thrashyolanda: ok... let me put together a test patch. One sec.12:21
yolandathanks12:21
jaosoriorthrash: also, one thing, is there a reason why we're using shell=True here https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L87 ?12:21
thrashjaosorior: that's not even used anymore.12:22
* jaosorior has no knowledge about the image building side12:22
thrashjaosorior: real call is here: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/image_builder.py#L9512:22
flaper87shardy: so,  it gets the env_base_url for a temp env file:///tmp/tripleoclient-bkEwZT/tripleo-heat-templates/env-docker-QRcd81.yaml12:23
flaper87not sure where that file is coming from but I'll figure it out12:24
*** limao has joined #tripleo12:24
*** flepied has quit IRC12:25
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Add Mistral to scenario003  https://review.openstack.org/40474312:25
*** mburned_out is now known as mburned12:26
*** nyechiel has quit IRC12:26
*** prateek has quit IRC12:28
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Add validation parameters to overcloud deploy  https://review.openstack.org/40472612:28
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add verify required and CA bundle to haproxy  https://review.openstack.org/39959112:28
*** nyechiel has joined #tripleo12:29
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: debugging - do not merge  https://review.openstack.org/40456012:29
*** pkovar has quit IRC12:32
*** links has quit IRC12:34
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add verify required and CA bundle to haproxy  https://review.openstack.org/39959112:34
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add verify required and CA bundle to haproxy  https://review.openstack.org/39959112:34
*** jtomasek has joined #tripleo12:35
EmilienMhi12:36
jaosoriorEmilienM: sup dude12:36
thrashjaosorior: yolanda oh frick... y'all look at overcloud-image-build.log?12:37
*** jrist has joined #tripleo12:37
*** jrist has joined #tripleo12:37
jaosoriorthrash: well, had checked this o ut http://logs.openstack.org/61/404161/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6b17776/logs/undercloud/var/log/image_build.txt.gz12:37
*** dsneddon has joined #tripleo12:38
thrashjaosorior: we must not be capturing it... https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L52412:39
thrashhmmm12:39
yolandathrash, yep, image-build just gives that empty output12:39
thrashmaybe that doesn't have enough... With the tee and all. :)12:39
thrashOk.. Back to what I was getting ready for debug. :)12:39
EmilienMthrash: can you review https://review.openstack.org/#/c/404223/ please?12:40
thrashEmilienM: ack12:40
*** bfournie has quit IRC12:40
jaosoriorthrash: so... where is this overcloud-image-build.log located usually? in the home dir?12:40
thrashjaosorior: that would be my guess...12:41
yolandathrash, looks as that file is not copied to logs12:41
*** flepied has joined #tripleo12:42
*** dsneddon has quit IRC12:42
*** jprovazn has joined #tripleo12:43
*** jkilpatr has joined #tripleo12:44
*** dsariel has quit IRC12:44
shardyflaper87: sounds like there's a problem here https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L17312:44
*** arxcruz has quit IRC12:44
shardyflaper87: that's where we rewrite the user environments to mangle paths to match the tmpdir12:45
flaper87shardy: yes, I think I just found it: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L179 this should be abs_rsr_path12:45
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: tempest tests  https://review.openstack.org/40434512:45
shardyflaper87: aha, good catch! :)12:45
*** ola has joined #tripleo12:45
shardyflaper87: apologies - I think that code is my fault, it was a late workaround for some blocker issues at newton GA - probably needs more/better tests12:46
*** ola is now known as Guest4974612:46
shardyI hope we can clean that entire mess up this cycle by moving the file resolution logic into heat12:46
flaper87shardy: no worries, just glad I found it, it was becoming too frustrating hahahaha12:46
shardyramishra has started looking into that12:46
flaper87I think there's one more fix to do, though. still not working perfectly12:46
shardyflaper87: we might want to add some different corner-case environment files to CI, even if they don't do anything - e.g relative/absolute paths etc12:47
EmilienMFYI, we updated puppet version in tripleo, we are now deploying Puppet 4.6 thanks to RDO packaging12:49
EmilienMwe fixed a last minute bug yesterday but everything should be fine now. Please let me know if you see some strange puppet things today :P12:49
*** amoralej is now known as amoralej|lunch12:50
*** Guest49746 has quit IRC12:50
*** ola_ has joined #tripleo12:50
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: TEST: DO NOT MERGE - Verbose output for image building  https://review.openstack.org/40475112:51
thrashyolanda: jaosorior ^^^^12:51
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Include logs in the undercloud's home directory  https://review.openstack.org/40475212:52
jaosoriorthrash: trying to include the logs ^^ seems they're missing12:52
jaosoriorEmilienM: which bug was it?12:52
thrashjaosorior: ack12:53
*** kaslcrof has joined #tripleo12:53
EmilienMjaosorior: https://review.openstack.org/#/c/404437/12:53
EmilienMjaosorior: took me 3 hours to find it :)12:53
jaosoriorEmilienM: wow, that's a tricky one12:53
*** lucasagomes is now known as lucas-hungry12:54
*** panda|off is now known as panda12:55
pradkcan i get another review on this please https://review.openstack.org/#/c/403766/12:55
*** milan has joined #tripleo12:55
*** jayg|g0n3 is now known as jayg12:56
flaper87shardy: nvm, the other problem was my fault. Using abs_rsr_path does fix the issue12:58
shardyflaper87: good news! :)12:58
pradkthx jaosorior !12:58
*** arxcruz has joined #tripleo12:58
flaper87shardy: will write a test and push a patch12:59
shardyflaper87: ack, sounds good - thanks for finding the problem13:00
flaper87shardy: it was either that or throwing my laptop out of the window13:01
shardylol :)13:01
*** athomas has joined #tripleo13:01
*** noslzzp has joined #tripleo13:03
*** jcoufal has joined #tripleo13:03
*** trown|outtypewww is now known as trown13:05
gfidenteshardy so I managed to get the parameters passed to a mistral workflow13:05
gfidente(heat parameters)13:05
gfidentebut not to trigger the workflow execution13:05
gfidenteI think I can get the alarm_url13:05
gfidentebut can I GET it from a heat resource?13:05
*** dmacpher has joined #tripleo13:06
*** adarazs_lunch is now known as adarazs13:06
*** athomas has quit IRC13:06
ccamachohey matbu, arounf13:06
ccamachoaround?13:06
matbuccamacho: yep13:06
ccamachoquick question, im hitting http://paste.openstack.org/show/590953/13:06
ccamachowhen upgrading newton to master13:07
ccamachothere is a bug related13:07
*** pkovar has joined #tripleo13:07
ccamachohttps://github.com/ibmdb/python-ibmdb/issues/16613:07
*** bkopilov has joined #tripleo13:08
matbuccamacho: hmm i didn't see that yet13:08
matbuccamacho: looks like the issue is closed13:09
ccamachoyeahp, im trying to get from yum logs if alembic was updated13:09
ccamachoand exclude it from the update13:09
ccamachoto see if makes some difference13:10
ccamachomatbu this is hard dude :P13:10
matbuccamacho: hehe13:10
matbuccamacho: i redeployed this mornign, cause my env was totally broken13:10
ccamachoso after I make that stuff work ill move the pcm resources to your patch :)13:10
matbuccamacho: but i'll check the package version13:10
openstackgerritFlavio Percoco proposed openstack/python-tripleoclient: e the absolute path for temp templates  https://review.openstack.org/40476213:11
ccamachoto see if we can make it :)13:11
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001: deploy Ceph  https://review.openstack.org/40446213:11
matbuccamacho: ack, did you check the current upgrade script ?13:11
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: gate-quickstart: force repo checkout  https://review.openstack.org/40423013:12
*** jkilpatr has quit IRC13:12
*** jtomasek has quit IRC13:12
ccamachomatbu yeahp the issue raise when executing https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/major_upgrade_controller_pacemaker_3.sh#L63  (From Ansible)13:12
matbuccamacho: it could be nice also to share an etherpad with notes and manual actions (or modification made in script)13:12
ccamachoyeahp yeahp Im creating notes to share about "how to test it"13:13
matbuccamacho: k, so currently, you push and execute the upgrade script ?13:13
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras: Enable cinder-backup service  https://review.openstack.org/40078713:13
*** dbecker has joined #tripleo13:14
*** bfournie has joined #tripleo13:14
ccamachoim pushing the scripts with ansible (from shardy submission),  but commenting it here (https://review.openstack.org/#/c/393448/15/puppet/services/neutron-api.yaml) for not executing it twice.13:14
ccamachomatbu^13:15
ccamachothere are some duplicated bit that we need to extract13:15
openstackgerritMerged openstack/tripleo-quickstart-extras: gate-quickstart: force repo checkout  https://review.openstack.org/40423013:15
*** dsariel has joined #tripleo13:16
matbuccamacho: ok, i think most the upgrade script are really specific to L to M and M to N13:16
matbuccamacho: im not sure we need to reuse all13:16
ccamachommm i see13:17
*** ola_ has quit IRC13:17
matbuccamacho: there is many workaround or speicific migration cases13:17
matbubut maybe we will have to deal with new cases13:17
matbuccamacho: for now i just make it "stupid", stop pcs, update services, update packages, start the cluster, check the status and make db sync13:18
*** sudipto_ has joined #tripleo13:18
*** sudipto has joined #tripleo13:18
ccamachoyeahp, but what im trying to get is the smallest HA deployment upgraded N -> O (master), and from that point we can add more cases13:19
*** athomas has joined #tripleo13:19
*** jkilpatr has joined #tripleo13:19
yolandajaosorior, added a comment13:20
openstackgerritFlavio Percoco proposed openstack/python-tripleoclient: Use the absolute path for temp templates  https://review.openstack.org/40476213:21
*** pgadiya has quit IRC13:25
*** fultonj has joined #tripleo13:28
jaosorioryolanda: I used /home/stack since that's the usual user we run the overcloud parts with.... and I'm not sure what user is logging in there to retrieve those logs (if it's root it wouldn't work)13:29
*** masco has quit IRC13:29
*** karthiks has quit IRC13:29
*** dtantsur|afk is now known as dtantsur13:29
*** rlandy has joined #tripleo13:30
yolandait may be a safe bet, i remember trying to change the /home/stack directory on undercloud at some point, and was failing totally13:31
jaosoriorEmilienM: weren't we gonna put ceph in scenario004?13:32
EmilienMjaosorior: scenario001 and 413:32
jaosoriorok13:32
EmilienMjaosorior: scenario001 for classic RBD scenario, and 4 for Rados Gateway13:33
*** links has joined #tripleo13:36
*** links has quit IRC13:36
*** achadha has joined #tripleo13:37
*** dtrainor has joined #tripleo13:37
ansiwenEmilienM: "Could not find class ::ec2api::db::mysql for overcloud-controller-0.localdomain" http://logs.openstack.org/34/398634/8/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/d6a61e8/logs/postci.txt.gz#_2016-11-29_15_05_26_00013:38
ansiwenEmilienM: what could be the reason for that? I have it included in puppet-tripleo-elements13:38
EmilienMansiwen: https://github.com/redhat-openstack/rdoinfo/blob/master/rdo.yml#L14813:39
EmilienMI don't see puppet-ec2api13:39
*** lblanchard has joined #tripleo13:39
EmilienMansiwen: tripleo-puppet-elements are not used anymore for puppet modules13:39
EmilienMansiwen: it's in RDO packaging13:39
ansiwenEmilienM: oh dear... obviously I didn't hear the news...13:39
ansiwenEmilienM: thanks!13:39
jaosoriorEmilienM: could you check these out? https://review.openstack.org/#/q/status:open+project:openstack/tripleo-heat-templates+branch:master+topic:rabbit-hostnames13:40
EmilienMjaosorior: looking13:41
*** achadha has quit IRC13:41
ansiwenEmilienM: but why does it work in CI then? is there a different mechanism?13:43
*** michchap_alt has joined #tripleo13:43
*** jcoufal_ has joined #tripleo13:44
EmilienMansiwen: ec2api works in tripleo CI?13:45
*** jeckersb is now known as jeckersb_gone13:45
EmilienMansiwen: where do you see the service running?13:45
*** karthiks has joined #tripleo13:45
ansiwenEmilienM: no, in openstack puppet ci13:45
ansiwenEmilienM: we deplay it there and have the tempest run13:45
EmilienMansiwen: puppet openstack ci doesn't deploy puppet modules with RPM but with r10k13:46
EmilienMansiwen: https://github.com/openstack/puppet-openstack-integration/blob/master/Puppetfile13:46
ansiwenEmilienM: I see...13:46
*** jtomasek has joined #tripleo13:47
*** jcoufal has quit IRC13:47
*** oshvartz has quit IRC13:47
*** jpena is now known as jpena|lunch13:48
*** rbrady-afk is now known as rbrady13:48
yolandahi jaosorior , looking at your patch results. I guess we won't see anything until ovb jobs finish?13:49
*** lucas-hungry is now known as lucasagomes13:51
ansiwenEmilienM: and why does puppet-panko not appear in that file? I thought it has been merged already?13:51
EmilienMansiwen: https://github.com/openstack/puppet-openstack-integration/blob/master/Puppetfile#L108-L11013:51
EmilienMit is in that file13:51
jaosorioryolanda: correct13:51
ansiwenEmilienM: no, I mean in the rdo.yml13:52
EmilienMansiwen: because we need to add it13:52
EmilienMpradk: ^ fyi13:52
EmilienMpradk: if you want panko deployed in tripleo, we need to add puppet-panko in RDO13:52
ansiwenEmilienM: I see ^_^13:53
EmilienMansiwen: easy right? (lol)13:53
pradkah thought i did that with panko.. will do now13:54
ansiwenEmilienM, pradk, so come puppet-projects are just with a "conf: rpmfactory-puppet" element, some have upstream: and tags: elements. What do I have to do for ec2-api?13:56
EmilienMansiwen: better to ask on #rdo what is the best13:56
ansiwenEmilienM: I'll do, thanks13:56
ansiwenpradk: while I'm at it I can also add panko13:57
pradkhttps://review.rdoproject.org/r/393913:57
pradkansiwen, i just pushed13:57
pradkthx though13:57
ansiwenpradk: so, that's it? nothing else needed?13:58
*** rodrigods is now known as rodrigods_13:58
openstackgerritLucas Alvares Gomes proposed openstack/tripleo-quickstart: VirtualBMC support for tripleo-quickstart  https://review.openstack.org/39970413:58
ansiwenpradk: no "upatream:" or so?13:58
*** hrybacki is now known as hrybacki|mtg14:00
*** numans has joined #tripleo14:00
openstackgerritBabu Shanmugam proposed openstack/tripleo-heat-templates: OVN bridge mappings for tripleo  https://review.openstack.org/40229314:01
openstackgerritBabu Shanmugam proposed openstack/tripleo-heat-templates: OVN plugin configuration fixes  https://review.openstack.org/39767414:01
*** karthiks has quit IRC14:02
*** ealcaniz has quit IRC14:02
*** abregman is now known as abregman|mtg14:02
slagleshardy: hey, one of the things i'm trying to do for the split stack phase 2 work is move away from having to use admin creds on the deployed servers14:03
slagleshardy: i've switched the software config transport to be POLL_SERVER_HEAT, but i'm still not sure how to get the generated keystone creds out of Heat14:04
*** ola has joined #tripleo14:04
*** ola is now known as Guest6322814:04
*** pkovar has quit IRC14:04
shardyslagle: it's the same as with the CFN credentials, e.g you get them from the metadata for the dummy server after the stack is created14:06
shardyhttps://etherpad.openstack.org/p/noop-softwareconfig14:07
shardyslagle: the only difference is we put a username and randomly generated password (and the heat/keystone endpoint) in there instead of the CFN URL14:07
shardyslagle: the other option is to use the swift transport (which is what we use by default now) then you get a tempurl14:08
shardystill need to create the stack before the credentials exist tho14:08
shardybbiab, appointment14:09
slagleshardy: for some reason resource metadata is empty in my stack14:09
shardyslagle: make sure it's the metadata for the dummy resource, not the dummy stack14:09
shardyslagle: sorry, will ping you in a bit, need to drop off for a few mins14:09
*** shardy has quit IRC14:09
thrashjaosorior: yolanda think I found a bug in the environment extension. Fixing it.14:10
*** Guest63228 has quit IRC14:10
*** Vijayendra has joined #tripleo14:11
*** amoralej|lunch is now known as amoralej14:11
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173814:12
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: debugging - do not merge  https://review.openstack.org/40456014:12
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use command instead of env var for setting the hostname in the undercloud  https://review.openstack.org/40471714:12
*** Goneri has joined #tripleo14:14
*** kjw3 has joined #tripleo14:18
*** karthiks has joined #tripleo14:19
*** bswartz has joined #tripleo14:19
*** ohamada has joined #tripleo14:20
d0ugalpanda: btw, the backport has been released https://pypi.python.org/pypi/python-mistralclient/2.1.214:21
pandad0ugal: \o/14:21
pandad0ugal: thanks.14:22
openstackgerritLucas Alvares Gomes proposed openstack/tripleo-quickstart: VirtualBMC support for tripleo-quickstart  https://review.openstack.org/39970414:22
openstackgerritMerged openstack/tripleo-quickstart-extras: Set validate_image_dir relative to working dir  https://review.openstack.org/40417914:22
d0ugalpanda: so I guess something can be reverted now?14:23
*** [1]cdearborn has joined #tripleo14:24
*** pradk has quit IRC14:24
*** dsneddon has joined #tripleo14:26
*** rhallisey has joined #tripleo14:26
*** pkovar has joined #tripleo14:29
*** ayoung has joined #tripleo14:29
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: deployment updates for containerized compute  https://review.openstack.org/40098614:30
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: add the containers prep role to the quickstart-extras  https://review.openstack.org/40098314:30
*** rodrigods_ is now known as rodrigods14:31
*** dsneddon has quit IRC14:31
*** sudipto_ has quit IRC14:35
*** sudipto has quit IRC14:35
yolandajaosorior, i'm looking at some ovb logs for your job, for example http://logs.openstack.org/52/404752/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha-mitaka/0eb3ec6/14:37
yolandaand i don't see image build logs there as well14:37
*** jeckersb_gone is now known as jeckersb14:38
*** yprokule_ has joined #tripleo14:38
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Replace hardcoded stack user by ansible_user  https://review.openstack.org/40480014:39
*** yprokule has quit IRC14:39
*** yprokule_ is now known as yprokule14:39
jaosorioryolanda: not sure if they'll be available for mitaka14:41
jaosorioryolanda: we gotta wait for the newton/master jobs14:41
yolandaagh14:41
yolandai was too impatient14:41
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173814:43
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: debugging - do not merge  https://review.openstack.org/40456014:43
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use command instead of env var for setting the hostname in the undercloud  https://review.openstack.org/40471714:43
*** jpena|lunch is now known as jpena14:44
thrashyolanda: got a bug I'm fixing14:46
d0ugalthrash: https://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L40-L4614:46
d0ugalthrash: that waiting loop may be useful for you14:46
thrashd0ugal: cool. I'll look at that.14:46
*** tremble has quit IRC14:48
*** tremble has joined #tripleo14:51
*** kjw3 has quit IRC14:52
*** chlong has joined #tripleo14:54
*** ohamada has quit IRC14:56
*** ohamada has joined #tripleo14:56
*** jaosorior has quit IRC14:57
*** saneax is now known as saneax-_-|AFK14:58
*** achadha has joined #tripleo14:59
*** prateek has joined #tripleo14:59
*** jaosorior has joined #tripleo14:59
*** udesale has joined #tripleo15:00
yolandajaosorior, i am looking at http://logs.openstack.org/52/404752/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/d9c1851/15:04
yolandaand no logs15:04
*** achadha has quit IRC15:04
*** hrybacki|mtg is now known as hrybacki15:04
*** shardy has joined #tripleo15:05
yolandaah.. may be on the tar, sorry i overlooked15:05
yolandamm no, the image build is for the undercloud15:06
jaosoriorno logs indeed15:06
*** Guest69699 has quit IRC15:06
*** Guest69699 has joined #tripleo15:06
jaosoriordammit15:06
yolandathey may be in another place, not home/stack?15:08
jaosoriorsshnaidm, panda hey guys, any idea where I could find the logs relevant to the image build?15:09
shardyslagle: back, did you find your missing metadata?15:09
slagleshardy: yes!15:09
slagleshardy: your last comment helped me :)15:09
shardyslagle: cool, sorry I had to drop off abruptly15:09
sshnaidmjaosorior, I think we have problem with it now..15:10
slaglei had to go one nested stack deeper then i do when using the cfn transport15:10
slagleat least, that's where the metadata was15:10
*** prateek has quit IRC15:10
shardyslagle: Hmm, it should be in the same place, has anything about how you define the dummy server also changed?15:10
shardywe always update the metadata for the "server" resource, only in this case it's not an actual server15:11
sshnaidmjaosorior, it was before in: logs/undercloud/var/log/image_build.txt.gz15:11
shardystill, good that you found it15:11
yolandasshnaidm, but these logs are not really useful15:11
yolandathey just say diskimage builder failed, but without any real output15:11
sshnaidmyolanda, exactly15:11
sshnaidmit happened after some last changes15:11
yolandaugh15:12
slagleshardy: everyting else is the same...15:12
slagleshardy: i just wasn't looking deep enough15:12
sshnaidmyolanda, jaosorior I think this file is not collected in logs, let me fix it: https://github.com/openstack-infra/tripleo-ci/blob/2159b2fc5166c5f934ad5b51fce1af1f40f2acda/scripts/tripleo.sh#L524-L52415:14
shardyslagle: ack, cool well good to hear you got past it15:14
yolandasshnaidm, yep, i think that this was the intention of jaosorior patch15:15
yolandabut is not on /home/stack?15:15
sshnaidmyolanda, but anyway, it has "tee -a" so all output should have went to image_build.txt..15:15
slagleshardy: yea, i got the username/password now, but os-collect-config is still getting an unauthorized15:15
slagleshardy: i'm looking into that now15:16
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Don't rely on overcloudrc  https://review.openstack.org/40080015:16
slagleERROR: You are not authorized to use this action.15:16
*** anshul has quit IRC15:16
sshnaidmyolanda, in upstream ci we collect only /var/log, $workspace/logs and /etc.15:16
*** ealcaniz has joined #tripleo15:17
*** sudipto has joined #tripleo15:17
*** sudipto_ has joined #tripleo15:17
slaglei updated the project_id as well. hmm15:17
yolandasshnaidm, but look at jaosorior patch https://review.openstack.org/#/c/404734/1/roles/libvirt/setup/undercloud/tasks/main.yml15:17
yolandaoh, bad link15:17
yolandahttps://review.openstack.org/#/c/404752/1/scripts/common_functions.sh15:17
yolandait shall have been collected on undercloud.tar.xz...15:18
sshnaidmyolanda, it should be jenkins, not stack15:19
*** mburned is now known as mburned_out15:19
*** dprince has joined #tripleo15:21
yolandaah, that explains15:21
yolandajaosorior ^15:21
sshnaidmyolanda, although we have "tee" there, so it should be in image_builder.txt too, I'm afraid it may be something in additional args for tripleoclient (just guess)15:22
ccamachomatbu now getting this after the nova upgrade "ConfigFileValueError: Value for option osapi_compute_workers is not valid: Should be greater than or equal to 1" :P I remember this issue from before.. Now hitting it with the upgrade15:23
matbuccamacho: hehe welcome in upgrade :)15:24
*** jeckersb is now known as jeckersb_gone15:25
*** pradk has joined #tripleo15:27
*** dhill__ has quit IRC15:27
*** dhill_ has joined #tripleo15:27
*** limao has quit IRC15:27
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: WIP: Prepare build-test role for usage in upstream  https://review.openstack.org/40482315:28
tbarronjprovazn: as we discussed, https://bugs.launchpad.net/tripleo/+bug/1646147 is all yours15:28
openstackLaunchpad bug 1646147 in tripleo "deploy of manila with external ceph fails to update ceph.conf" [Undecided,New]15:28
*** jeckersb_gone is now known as jeckersb15:28
*** Guest69699 is now known as assassin15:29
*** liverpooler has joined #tripleo15:30
*** jlinkes_ has quit IRC15:30
*** jlinkes_ has joined #tripleo15:30
*** ayoung has quit IRC15:30
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483115:30
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: updates: enable ssl  https://review.openstack.org/40293015:32
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: updates: fix condition that adds correct DEPLOY_ARGS  https://review.openstack.org/40374415:32
matbuEmilienM: ^ first draft15:32
jprovazntbarron, ack, thanks for checking15:32
matbuEmilienM: and the switch for project-config:  https://review.openstack.org/40481215:32
fpandprince: ping15:33
EmilienMmatbu: commented15:33
EmilienMmatbu: you're super fast :D15:33
*** pblaho has quit IRC15:34
fpandprince: would it be ok to backport ping_retry function to stable/mitaka, https://review.openstack.org/#/c/302386/15:34
*** ealcaniz has quit IRC15:34
EmilienMmatbu: both patches are commented15:34
matbuEmilienM: hehe thanks too fast i forgot mysql :)15:34
*** pblaho has joined #tripleo15:34
dprincefpan: fine with me15:35
gfidentetbarron you need to enable the external ceph support too15:35
gfidentecan I comment on the bug?15:35
thrashdprince: on the paths... i'm really just following the lead of others... https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario003-multinode.yaml#L4-L515:35
thrashdprince: there a reason we shouldn't be?15:35
*** abregman|mtg is now known as abregman15:36
fpandprince: cool, thanks. seeing some deployment failures with mitaka because of gw ping15:36
openstackgerritFeng Pan proposed openstack/tripleo-heat-templates: Add ping_retry function  https://review.openstack.org/40483515:36
dprincethrash: well, I never execute heat templates from my undercloud15:36
dprincethrash: so that patch doesn't exist for me15:36
dprincethrash: just means I have to customize those environments if I ever wanted to use them15:37
thrashdprince: I don't have a good argument the other way, TBH.15:37
thrash:D15:37
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483115:38
thrashSo I'm fine with changing it to be relative.15:38
matbuEmilienM: ok, updated both, we need to merged project-config before triggering the experimental i guess ?15:38
EmilienMmatbu: yes15:38
thrashdprince: and yet you +2 this: https://review.openstack.org/#/c/404743/ :D15:39
thrashlol15:39
dprincethrash: yeah, that one slipped through the cracks man :)15:39
matbuEmilienM: k, i'm curious to see it running15:39
thrashhehe15:39
thrashdprince: I'll change the zaqar one.15:39
dprincethrash: yep, may as well change them all at once15:39
EmilienMmatbu: me too15:40
thrashdprince: I'll do a follow-on for the scenario00215:40
EmilienMamoralej, shardy: can we close https://bugs.launchpad.net/tripleo/+bug/1638908 now?15:40
openstackLaunchpad bug 1638908 in tripleo-quickstart "Overcloud deployment fails in minimal configuration with ('Connection aborted.', BadStatusLine("''",))" [Undecided,In progress] - Assigned to Alfredo Moralejo (amoralej)15:40
dprincethrash: anyways, I'm glad to see this stuff getting extra tested so I'm an easy +2 besides this issue15:40
thrashI mean 00315:40
fultonjIf I create a custom role, then should I be able to delete node in a deployment with that role using `openstack overcloud node delete --stack $ID ... -r ... $node_id` ?15:40
fultonjshardy: ^ ?15:40
shardyfultonj: as far as I know yes, but you shouldn't need the -r15:41
shardyfultonj: disclaimer, I've not tested it, bugs are possible15:41
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Add Zaqar to scenario002  https://review.openstack.org/40473715:41
fultonjshardy: when i use the -r i get openstack overcloud node delete: error: unrecognized arguments: -r15:41
shardyfultonj: yep, that's because you don't need to pass the roles_data to that command15:42
shardyit's only used for the plan create or deploy commands15:42
fultonjshardy: so I take it that your recomendation to do the node delete without the -r but to include all of the other templates with -e.15:42
shardyfultonj: I don't think you even need those tbh15:42
shardyjust the stack and node id15:42
mwhahahahey folks, could I get additional reviews on https://review.openstack.org/#/c/383950/ as it's been sitting for some time15:42
shardyIIRC the docs need updating as it's no longer needed to pass all the -e arguments15:43
*** zoli|trng is now known as zoli15:43
*** zoli is now known as zoliXXL15:43
shardymwhahaha: ack, will do15:44
fultonjshardy: ok, the methods i mentioned so far failed, so my next step is to test with `openstack overcloud node delete --stack $ID $node_id`15:44
shardyfultonj: ack, IIRC that's all I passed last time I tested this15:44
shardybut I've not tried with custom roles15:45
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Include logs in the undercloud's home directory  https://review.openstack.org/40475215:45
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Make scenario template paths relative  https://review.openstack.org/40484015:45
fultonjshardy: i was able to delete the custom FooNode simply by reducing the FooNodeCount15:45
thrashdprince: ^^^15:45
fultonjshardy: is this a side-effect and not a recommended method?15:45
thrashfultonj: yes15:45
thrashfultonj: if you went from 2 -> 1, for instance, it would pick a random node. Probably not what you want.15:46
jaosorioryolanda: sorry, I was on a meeting. So we're sure that the user is jenkins then?15:46
shardythrash: actually it will pick the oldest node first IIRC15:46
thrashshardy: practically random. :)15:46
yolandai just amended with that , to see if that worked15:46
shardyso it may do what you want, but it won't use RemovalPolicies, so when you scale up you'll get another (potentially different) "2" node15:47
thrashshardy: that makes sense, but no one should really count on that behaviour15:47
dprincethrash: +215:47
openstackgerritMerged openstack/tripleo-specs: Changed the home-page link  https://review.openstack.org/38259115:47
shardythe advantage of node delete is that you never get a "2" node again, so on scale up you'd get "3" instead15:47
shardythrash: yeah - well heat has done that for some time but I agree it's probably a bad thing to rely on15:47
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras: Add role extras-common  https://review.openstack.org/40484215:47
shardythrash: there's also now the option to mark a resource unhealthy, which is a different way to make it get deleted on update15:48
shardyso we have a few options here15:48
fultonjshardy: how many of those options are in Newton?15:49
yolandajaosorior, cross fingers15:50
shardyfultonj: all of them15:50
*** rhallisey has quit IRC15:51
shardyfultonj: if node delete doesn't work though, that's a bug so I'd say stick with that and lets figure out what's wrong15:51
thrashshardy: +115:51
fultonjshardy: thrash ok, thanks. i will test node delete as we discussed and file a bug if necessary15:51
shardyfultonj: ack, sounds good, thanks!15:52
*** chandankumar is now known as chandankumar|off15:52
*** rhallisey has joined #tripleo15:52
*** ealcaniz has joined #tripleo15:52
*** abregman has quit IRC15:53
*** mburned_out is now known as mburned15:54
*** abregman has joined #tripleo15:55
*** Vijayendra has quit IRC15:56
*** mburned is now known as mburned_out15:57
*** mburned_out is now known as mburned15:58
*** jaosorior has quit IRC15:58
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras: ssl: set IPv6 as certificate CN when necessary  https://review.openstack.org/40215215:58
openstackgerritMerged openstack/tripleo-heat-templates: Apply os-net-config with a script instead of element  https://review.openstack.org/27145015:58
*** mburned is now known as mburned_out15:59
openstackgerritMerged openstack/tripleo-ui: Parameters listing updates  https://review.openstack.org/40372615:59
openstackgerritMerged openstack/tripleo-ui: Show team and repo badges on README  https://review.openstack.org/40319415:59
openstackgerritMerged openstack-infra/tripleo-ci: Fix tripleo quickstart role names  https://review.openstack.org/40384316:00
tbarrongfidente: ack, please do comment16:00
openstackgerritMerged openstack/tripleo-ui: Relax JSON input validation  https://review.openstack.org/40363416:00
openstackgerritMerged openstack/tripleo-heat-templates: Test encrypted volumes in scenario002  https://review.openstack.org/40422316:00
*** dsneddon has joined #tripleo16:01
openstackgerritMerged openstack/tripleo-common: Add panko to generated passwords  https://review.openstack.org/40376616:01
*** mburned_out is now known as mburned16:02
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: scenario001: deploy Ceph  https://review.openstack.org/40446216:02
*** rcernin has quit IRC16:02
*** chlong has quit IRC16:03
*** mburned is now known as mburned_out16:03
amoralejEmilienM, about https://bugs.launchpad.net/tripleo/+bug/1638908, https://review.openstack.org/399619 is not merged yet and https://review.openstack.org/#/c/402081/  is not in any tagged release16:04
openstackLaunchpad bug 1638908 in tripleo-quickstart "Overcloud deployment fails in minimal configuration with ('Connection aborted.', BadStatusLine("''",))" [Undecided,In progress] - Assigned to Alfredo Moralejo (amoralej)16:04
amoralejso we couldn't test it yet16:04
EmilienMamoralej: ack16:04
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: deployment updates for containerized compute  https://review.openstack.org/40098616:06
*** mburned_out is now known as mburned16:06
gfidentetbarron though we're working with jprovazn to have ceph-mds https://review.openstack.org/#/q/status:open+topic:bug/1644784 so we won't need extceph for manila16:10
tbarrongfidente: some customers will want to deploy that way though.  The deploy of mds is much appreciated though!! - for one thing it will enable much easier testing.16:11
openstackgerritMerged openstack/tripleo-heat-templates: get-occ-config.sh replace deprecated heat commands  https://review.openstack.org/40345516:11
gfidentetbarron ack16:12
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Environment is a dict, which can't use 'extend'  https://review.openstack.org/40485316:12
gfidentetbarron, EmilienM is setting up some scenarios so that we test the overcloud with different configurations16:12
*** ebarrera has quit IRC16:12
gfidentemaybe we can make some space for manila/cephfs somewhere in the future there16:13
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: TEST: DO NOT MERGE - Verbose output for image building  https://review.openstack.org/40475116:13
EmilienMgfidente: yes !16:13
tbarrongfidente: yeah, i kinda promised EmilienM that we'd help on that16:13
gfidenteok so at least we know what we need to do :)16:13
gfidente:P16:13
*** dsneddon_ has joined #tripleo16:14
*** ealcaniz has quit IRC16:15
openstackgerritMerged openstack/tripleo-puppet-elements: Add ceph-mds to the overcloud-controller element  https://review.openstack.org/40363616:16
openstackgerritMerged openstack/tripleo-heat-templates: Add Mistral to scenario003  https://review.openstack.org/40474316:16
openstackgerritMerged openstack/tripleo-incubator: Changed the home-page link  https://review.openstack.org/38260216:16
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras: Add overcloud delete role  https://review.openstack.org/40222816:17
*** bana_k has joined #tripleo16:17
*** chlong has joined #tripleo16:18
*** leanderthal is now known as leanderthal|afk16:18
*** dsneddon_ has quit IRC16:19
*** rajinir has joined #tripleo16:19
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras: prep-network: add support to IPv6 topology  https://review.openstack.org/40083716:20
dprinceshardy: CI failure on this one says 'OSError: [Errno 8] Exec format error': https://review.openstack.org/#/c/400252/16:21
dprinceshardy: wierd thing is I've tried it locally several times and it works fine for me...16:22
dprinceshardy: I'm wondering if one of the env variables is getting overwritten by something else16:22
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Hiera optimization: use a new hiera hook  https://review.openstack.org/38475716:23
*** yamahata has joined #tripleo16:25
openstackgerritMerged openstack/tripleo-puppet-elements: Show team and repo badges on README  https://review.openstack.org/40319216:26
*** dmarlin has joined #tripleo16:27
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test with scheduler hints  https://review.openstack.org/37804016:28
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add feature testing matrix to readme  https://review.openstack.org/39926916:28
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add support for testing predictable placement  https://review.openstack.org/37801416:28
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test hostname map  https://review.openstack.org/37801716:28
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart: Undercloud: added idempotency and sanity checks  https://review.openstack.org/40221816:30
shardydprince: Hmm, which job are you looking at?  The multinode one is failing to start mariadb?16:30
shardyI guess that's a side-effect but I don't see the error you mention16:31
dprinceshardy: I was looking at ovb16:31
dprinceshardy: yeah, mariadb likely fails due to hosts not getting written perhaps16:31
*** aufi has quit IRC16:31
dprinceshardy: http://logs.openstack.org/52/400252/8/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/842f2ae/logs/overcloud-controller-0/var/log/messages16:32
dprinceshardy: The 'Exec format' error shows there...16:32
dprinceshardy: the script as a shebang on it and all. so I'm a bit perplexed by this one16:32
*** yprokule_ has joined #tripleo16:33
*** yprokule has quit IRC16:34
*** yprokule_ is now known as yprokule16:34
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add environment parameter to collect-logs.sh  https://review.openstack.org/40486316:39
slagleshardy: i think i may have figured out my "access forbidden issue". access_allowed_handlers is empty in stack.py, and afaict, only register_access_allowed_handler populates that from nova/server.py, which obviously won't happen in this case16:40
yolandaugh, so i rechecked jaosorio patchsed, changing from /home/stack to /home/jenkins, and now i get  echo 'ERROR: the main setup script run by this job failed - exit code: 137'16:40
yolandano more detailed error16:40
yolandasshnaidm, ^16:40
sshnaidmyolanda, looking..16:40
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement scenario004 with Ceph Rados Gateway scenario  https://review.openstack.org/40445816:41
sshnaidmyolanda, where is the logs?16:41
yolandahttp://logs.openstack.org/52/404752/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/9482243/16:42
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras: Remove packages in the requirements file so they are reinstalled.  https://review.openstack.org/40486716:42
sshnaidmyolanda, it's infra problem, not related to patch16:42
sshnaidmyolanda, I mean it's ovb infra problem :)16:42
yolandaok...16:43
yolandaknown issue?16:43
shardydprince: Hmm, strange - can you check the script in /usr/lib/heat-config/heat-config-script?16:43
sshnaidmyolanda, it means that ovb stack hasn't been created, need to check why16:43
shardyit should still be there, perhaps it's mangled somehow?16:43
sshnaidmyolanda, I think you can recheck16:43
*** jkilpatr has quit IRC16:43
shardyslagle: aha, right, let's think of the best way around that one16:44
*** bana_k has quit IRC16:44
dprinceshardy: yep. I'll add debugging there I guess since I'm not hitting it16:44
shardydprince: Oh, yeah, sorry forgot you couldn't reproduce16:44
yolandaok16:44
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Add Zaqar to scenario002  https://review.openstack.org/40473716:45
*** jcoufal_ has quit IRC16:47
shardyslagle: I guess the options are patch heat to add a conditional disabling access_allowed in stack.py, or add another server subclass in tripleo-common which overrides the methods that actually interact with nova16:47
shardye.g we could register OS::TripleO::DummyServer based on a subclass in tripleo-common, similar to the one we have now which ignores updates16:48
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Configure /etc/hosts via os-collect-config script  https://review.openstack.org/40025216:48
ccamachomatbu here are the issues that Im hitting with the upgrades https://etherpad.openstack.org/p/upstream-newton-to-ocata-upgrades16:48
slagleshardy: would the swift temp url transport see this same behavior?16:48
slaglemaybe i should just try that first16:48
shardyslagle: No I don't think it would16:48
slaglek, will try. that might be the easiest thing for now16:49
shardykk16:49
*** ebarrera has joined #tripleo16:49
matbuccamacho: k i'm hitting the same on neutron: https://paste.fedoraproject.org/494211/05245981/16:50
matbuccamacho: lets keep this etherpad to track all things16:50
*** trown is now known as trown|lunch16:52
matbuccamacho: ha k lol, this is really the same stack trace that i have pasted ^ :) sorry16:52
mwhahahathe python-networking-cisco module is broken16:53
mwhahahaso you can work around it by removing it before running16:53
mwhahahathere's a bug that amoralej created but it's just sitting16:53
mwhahahahttps://bugs.launchpad.net/networking-cisco/+bug/164131116:53
openstackLaunchpad bug 1641311 in networking-cisco "neutron-db-manage fails after https://review.openstack.org/#/c/394201/" [High,Confirmed]16:53
mwhahahamatbu: ccamacho -^16:54
matbumwhahaha: ha great thanks16:54
ccamachomatbu at least the issue is reproducible xD16:54
mwhahahahttps://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L19316:54
mwhahahabecause we force install it -^16:54
*** abregman has quit IRC16:54
mwhahahai wasted half a day on it yesterday16:55
* mwhahaha cries16:55
*** tosky has quit IRC16:57
* ccamacho same man :( http://img06.deviantart.net/d392/i/2012/190/9/4/francella_meme___oh_god_just_kill_me_right_now_by_foreverzerodragon-d56mytj.jpg16:58
amoralejmwhahaha, i thought cisco pkg was remove from tripleo images in https://review.openstack.org/#/c/397959/16:58
*** lmiccini has quit IRC16:58
mwhahahanot if you build via openstack overcloud image16:59
mwhahahasee https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L19316:59
amoralejtoo many ways of building images....16:59
*** jkilpatr has joined #tripleo16:59
*** tosky has joined #tripleo16:59
*** ccamacho is now known as ccamacho|afk16:59
mwhahahai don't think oooq uses that, i think it uses the other method16:59
mwhahahasoooo yea16:59
amoralejyes16:59
amoralejthat's how it has been passing rdo-ci since then17:00
mwhahahaso we need to also remove it from overcloud_image.py if that's the correct method forward17:00
amoralejunless until cisco maintainers fix it17:01
mwhahahai don't even know what it's for17:01
*** panda is now known as panda|bbl17:01
amoraleji don't think is a good idea to install all packages in overcloud image, even if we are not actually testing it17:01
*** mcornea has quit IRC17:01
amoralejthat should be in a cisco CI17:01
mwhahahabut we do need a better way to define those packages outside of .py and a .yaml17:01
amoralejyes17:01
*** achadha has joined #tripleo17:02
*** achadha has quit IRC17:02
*** TSCHAK has joined #tripleo17:03
*** achadha has joined #tripleo17:03
*** bana_k has joined #tripleo17:04
openstackgerritMerged openstack/puppet-tripleo: Use FQDNs for the services' RabbitMQ configuration  https://review.openstack.org/40351817:05
openstackgerritMerged openstack/puppet-tripleo: Use FQDNs for RabbitMQ's cluster configuration  https://review.openstack.org/40354017:06
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Remove yum-plugin-priorities hack  https://review.openstack.org/39733117:08
*** sanagikoki has joined #tripleo17:08
*** dsariel has quit IRC17:09
*** b00tcat has quit IRC17:11
openstackgerritMerged openstack/os-collect-config: Remove discover from test-requirements  https://review.openstack.org/34585217:12
*** iranzo has quit IRC17:13
openstackgerritMerged openstack/tripleo-image-elements: Include lsb_release in the hosts element since it's used there.  https://review.openstack.org/40408817:14
*** zoliXXL is now known as zoli|gone17:14
*** numans has quit IRC17:17
*** rhallisey has quit IRC17:18
*** nyechiel has quit IRC17:18
*** rhallisey has joined #tripleo17:18
*** chlong has quit IRC17:21
*** pcaruana has quit IRC17:23
*** yprokule has quit IRC17:24
*** jlinkes_ has quit IRC17:24
*** bana_k has quit IRC17:24
openstackgerritTomas Sedovic proposed openstack/tripleo-docs: Add tripleo-validations user documentation  https://review.openstack.org/39619717:25
openstackgerritMiles Gould proposed openstack/diskimage-builder: Update hpssacli to ssacli in proliant-tools element  https://review.openstack.org/39650417:26
openstackgerritMiles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package  https://review.openstack.org/34421417:26
*** florianf has quit IRC17:28
*** jcoufal has joined #tripleo17:28
openstackgerritAlex Schultz proposed openstack/python-tripleoclient: Remove python-networking-cisco from image build  https://review.openstack.org/40489017:29
*** rodrigods is now known as rodrigods_17:31
*** chlong has joined #tripleo17:34
*** shardy has quit IRC17:35
*** saibarspeis has joined #tripleo17:35
*** penick has joined #tripleo17:36
*** tremble has quit IRC17:37
*** dtantsur is now known as dtantsur|afk17:37
*** udesale has quit IRC17:38
openstackgerritKoki Sanagi proposed openstack/tripleo-heat-templates: Add THT for networking-fujitsu  https://review.openstack.org/40489317:38
*** tremble has joined #tripleo17:39
*** saibarspeis has quit IRC17:40
EmilienMgfidente: sounds like it worked, now I have to figure Gnocchi17:42
EmilienMhttp://logs.openstack.org/62/404462/3/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/fcc2a9e/console.html#_2016-11-30_17_01_42_90707117:42
EmilienMI'll look after lunch17:42
*** achadha has quit IRC17:42
*** milan has quit IRC17:44
*** myoung is now known as myoung|lunch17:46
beaglespradk, is it a "thing" for the ceilometer meter and event dispatcher to be different values?17:46
beaglespradk, ie. likely to happen, valid config, etc.17:46
pradkbeagles, yes17:47
beaglespradk, ok cool thanks17:47
*** myoung|lunch is now known as myoung17:47
*** derekh has quit IRC17:47
*** lucasagomes is now known as lucas-afk17:48
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Added CeilometerEventDispatcher heat parameter  https://review.openstack.org/39693817:48
openstackgerritAlex Schultz proposed openstack/python-tripleoclient: Remove python-networking-cisco from image build  https://review.openstack.org/40489017:48
*** myoung is now known as myoung|lunch17:49
*** yamahata has quit IRC17:51
openstackgerritKoki Sanagi proposed openstack/tripleo-heat-templates: Add THT for networking-fujitsu  https://review.openstack.org/40489717:54
openstackgerritMerged openstack/os-apply-config: Add __ne__ built-in function  https://review.openstack.org/38710717:54
*** ctayal has joined #tripleo17:55
*** dciabrin is now known as dciabrin|away17:55
*** nyechiel has joined #tripleo17:59
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Configure /etc/hosts via os-collect-config script  https://review.openstack.org/40025218:02
*** dsneddon_ has joined #tripleo18:02
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: TEST: DO NOT MERGE - Verbose output for image building  https://review.openstack.org/40475118:03
beaglespradk, lol good thing you're watching :)18:04
pradk:)18:04
beagles(re: gnocchi events mitaka)18:04
gfidenteEmilienM cool18:04
*** numans has joined #tripleo18:04
pradkEmilienM, so i have a question on gnocchi on undercloud18:04
pradkshould we just default the backend to file instead of swift18:04
pradkEmilienM, to keep the foot print smaller?18:05
*** penick has quit IRC18:05
pradkconsidering the issues we saw with gnocchi + swift on overcloud .. i'm wondering if thats worth it on undercloud18:05
*** sudipto_ has quit IRC18:06
*** sudipto has quit IRC18:06
*** dsneddon_ has quit IRC18:07
pradkswift on its own had to be tweaked quite a bit to handle gnocchi18:07
*** tremble has quit IRC18:10
*** penick has joined #tripleo18:11
EmilienMpradk: file is good as we don't have HA on undercloud now18:11
gfidentepradk actually while you're around :)18:12
pradkEmilienM, yea i agree18:12
gfidentethis job is failing when creating the pingtest stack http://logs.openstack.org/62/404462/3/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/fcc2a9e/console.html18:12
pradkgfidente, looking18:12
*** dmacpher is now known as dmacpher-afk18:12
gfidentethe gnocchi logs should be http://logs.openstack.org/62/404462/3/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/fcc2a9e/logs/subnode-2/var/log/gnocchi/18:12
gfidentecan you spot what went wrong? I don't see any error in the logs18:12
EmilienMresources.gnocchi_res_alarm: Resource 0476a3a2-b765-48e9-89e3-fb4b882c1b0b does not exist (HTTP 404)18:13
EmilienMyeah I'm also looking :/18:13
EmilienMwe see the error in Aodh too http://logs.openstack.org/62/404462/3/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/fcc2a9e/logs/subnode-2/var/log/aodh/app.txt.gz#_2016-11-30_17_01_36_20518:13
*** achadha has joined #tripleo18:14
gfidenteah aodh18:14
gfidentethanks18:14
pradklooks like the resource doesnt exists18:14
pradk0476a3a2-b765-48e9-89e3-fb4b882c1b0b18:14
pradkyea gnocchi alarms are a type of aodh alarms18:14
gfidenteso aodh is just a consumer there?18:15
EmilienMpradk: note: the pingtest without ceph18:16
EmilienMso it works fine with file backend I guess18:16
pradkgfidente, alarm is created in aodh and evaluated based on data it gathers from gnocchi18:16
*** ayoung has joined #tripleo18:16
*** achadha_ has joined #tripleo18:16
pradkhmm so just with ceph?18:16
pradklemme poke around18:17
*** achadha has quit IRC18:17
*** achadha_ has quit IRC18:17
EmilienMpradk: yes, see https://review.openstack.org/#/c/404462/3/ci/environments/scenario001-multinode.yaml18:17
matbuccamacho|afk: hey man Stack overcloud UPDATE_COMPLETE  :) I was going to drink a beer and then ... (but tbh, i'm not sure it's really a working upgrade)18:17
EmilienMpradk:   GnocchiBackend: 'file'18:17
ccamacho|afkmatbu!!!  http://paste.openstack.org/show/590995/18:17
ccamacho|afkfuck yeah!!!18:17
*** achadha has joined #tripleo18:17
ccamacho|afkajajja18:17
EmilienMlol18:17
ccamacho|afkI mean, there are some services not starting but the approach works, tomorrow Ill glue all the N -> O and add your ansible module xD18:18
EmilienMgfidente: we can start without gnocchi/rbd now18:20
*** jkilpatr has quit IRC18:21
gfidenteEmilienM yes I guess that is fine18:23
gfidentethough the ovb job should be using it for gnocchi too18:23
gfidenteI actually wasn't even able to find the error causing the resource to fail18:24
gfidentenot sure if pradk found anything18:24
gfidentebut I would try just one last recheck before giving up18:24
*** jkilpatr has joined #tripleo18:24
pradkgfidente, nothing standing out yet .. did gnocchi-upgrade run with or without skip-storage.. do we know?18:25
EmilienMgfidente: are you sure ovb job runs gnocchi with rbd backend?18:25
EmilienMgfidente: you don't run any gnocchi pingtest for ovb :)18:26
EmilienMso we can't certify it works18:26
gfidenteah that's not good18:26
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement scenario004 with Ceph Rados Gateway scenario  https://review.openstack.org/40445818:26
gfidenteas that means we've a problem in the stable release18:27
gfidente:(18:27
Guest68279mwhahaha: heya - could you share the data for determining the # of workers? didn't know if there was a link to this work.18:27
*** Guest68279 is now known as rook18:27
EmilienMgfidente: I don't know. pradk: did you test gnocchi+rbd outside CI?18:28
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Prepare build-test role for usage in upstream  https://review.openstack.org/40482318:28
mwhahaharook: so the numbers were primarily chosen based on feed back from other groups, for example https://review.openstack.org/#/c/297342/ has a discussion in the reviews on optimal numbers for keystone18:28
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Fix unbound variable in standalone ping test  https://review.openstack.org/40491418:28
rookyup mwhahaha akrzos is on my team... we were talking about this today.18:29
rookAlex Krzos akrzos who started that discussion18:29
gfidenteEmilienM but pingtest_template seems empty to me18:30
mwhahahabut that being said, i had similar stuff over in fuel land, let me get bugs18:30
pradkEmilienM, gfidente, http://logs.openstack.org/62/404462/3/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/fcc2a9e/console.html#_2016-11-30_17_01_38_95629918:30
gfidenteso I assume it's using the standard pingtest template for the scenario too, no?18:30
mwhahaharook: https://review.openstack.org/#/c/311079/18:30
*** bana_k has joined #tripleo18:31
mwhahaharook: so overall, the 'defaults' from python have generally been bad. the puppet is an attempt to adjust down the defaults. but like i keep saying they defaults are not optimized. never are so if there is tuning to be had it should be done on a case by case basis and we need to provide a better way for users to consume tuned numbers18:31
EmilienMpradk: http://logs.openstack.org/62/404462/3/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/fcc2a9e/console.html#_2016-11-30_17_01_41_69220018:31
*** arxcruz has quit IRC18:32
mwhahaharook: so my recommendation is to stop obessing about os_workers unless you have another formula that works across the board that will address basic memory consumption and conneciton limit issues for all services and focus on specific tunings that could be consumed via THT18:32
pradkEmilienM, yea so the resource doesnt exist in gnocchi.. my suspision is we need to initialize storage and we arent18:32
rookmwhahaha i agree - I just thought there was data backing the decision vs. just discussions.18:32
pradkEmilienM, does this work with swift?18:32
gfidenteEmilienM oh no I see the variable is set based on multinode env18:32
gfidentecool18:33
mwhahaharook: we had raw numbers for fuel but I no longer have them so we attempted to take the work started over there and apply it upstream18:33
rookmwhahaha it is less about obessing(sp?) and more about being able to discuss data, which seems lacking.18:33
EmilienMpradk: I didn't check18:33
*** arxcruz has joined #tripleo18:33
mwhahahathe data was not published in a public forum so I can't provide the history18:33
rookmwhahaha ok, cool... if there was a method to the testing, that would be great...18:34
gfidentepradk how are we supposed to initialize storage?18:34
*** yamahata has joined #tripleo18:34
*** ebarrera has quit IRC18:34
gfidentepradk fwiw I think you can download the gnocchi.conf with the ceph settings here http://logs.openstack.org/62/404462/3/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/fcc2a9e/logs/subnode-2/etc/gnocchi/gnocchi.conf.txt.gz18:35
pradkgfidente, when gnocchi-upgrade run it does it unless we pass skip-storage.. but my swift works fine, so i would expect ceph to follow that18:35
*** kbyrne has quit IRC18:35
pradkgfidente, looking at conf, one sec18:35
gfidentepradk sounds like we need to track this down with a bug18:36
gfidentemaybe for the scenario we can start with file18:36
gfidentewdyt?18:36
*** jpena is now known as jpena|off18:37
pradkgfidente, yea sounds good to me.. i'll do a deploy with ceph tonight and see if i can reproduce it locally18:37
pradkgfidente, this is working in newton for sure as we did a validation with qe last week and gnocchi alarms work18:38
*** kbyrne has joined #tripleo18:38
pradkgfidente, assume there is no way to hop on this ci node and check whats in gnocchi?18:39
*** trown|lunch is now known as trown18:39
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Don't run on 127.0.0.* hosts  https://review.openstack.org/40492018:44
*** myoung|lunch is now known as myoung18:45
*** amoralej is now known as amoralej|off18:47
*** rodrigods_ is now known as rodrigods18:49
*** fzdarsky is now known as fzdarsky|afk18:50
openstackgerritMerged openstack/tripleo-specs: Enable Oslo.Messaging Dual Backends  https://review.openstack.org/39674018:54
thrashyolanda: any idea what the error was with image building in the first place? Was it on a specific patch?18:55
thrashyolanda: looks like it's working in general on the ovb-ha job.18:55
*** tosky has quit IRC18:56
*** penick has quit IRC18:57
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Support multiple meter dispatchers in ceilometer config  https://review.openstack.org/40492419:01
*** penick has joined #tripleo19:01
yolandathrash, this one for example https://review.openstack.org/#/c/404161/19:02
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Add gnocchi support on undercloud  https://review.openstack.org/39299219:04
*** pkovar has quit IRC19:04
*** egafford has quit IRC19:05
*** cylopez has quit IRC19:05
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Hiera optimization: use a new hiera hook  https://review.openstack.org/38475719:06
dprincetrown: mind giving this a quick review https://review.rdoproject.org/r/#/c/3947/119:08
trowndprince: sure19:08
EmilienMdprince: +219:09
dprinceEmilienM: ack, thanks. This will help unblock me a bit19:09
dprincetrown: while you are at it this would be handy to have too https://review.openstack.org/#/c/392615/19:10
dprincetrown: passing CI...19:10
trownhehe... "There is a new hiera hook in town"19:10
*** saneax-_-|AFK is now known as saneax19:12
openstackgerritMerged openstack/tripleo-heat-templates: Add Neutron network type and VLAN ranges to network-environment.yaml  https://review.openstack.org/39232519:15
openstackgerritCharlie Llewellyn proposed openstack/tripleo-heat-templates: Add retry to RHEL registration  https://review.openstack.org/38652919:15
*** snecklifter has joined #tripleo19:17
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Configure /etc/hosts via os-collect-config script  https://review.openstack.org/40025219:24
*** SpamapS has quit IRC19:26
*** dciabrin|away has quit IRC19:27
*** dciabrin|away has joined #tripleo19:28
dprincetrown: https://review.openstack.org/#/c/392559/ please?19:28
dprinceoh, there is a fixup in the commit message19:29
openstackgerritDan Prince proposed openstack/tripleo-puppet-elements: Move nova.conf truncation into separate element  https://review.openstack.org/39255919:29
dprincebeagles, EmilienM: again ^^^ just a commit msg update19:29
*** akrivoka has quit IRC19:30
bnemecCan we merge https://review.openstack.org/#/c/403744/ ?19:34
trowndprince: how does that install.d bit work today?19:34
bnemecIt passed all the jobs on the previous patch set and the only change was the commit message.19:34
dprincebnemec: +A19:35
bnemecdprince: Thanks19:35
trowndprince: nevermind read up to sbaker's comment19:35
trowndprince: makes sense now19:35
dprincetrown: ck19:36
dprincea-ck19:36
trowndprince: do we want to remove os-refresh-config from element-deps then?19:36
openstackgerritKoki Sanagi proposed openstack/puppet-tripleo: Add networking-fujitsu support  https://review.openstack.org/40493819:37
dprincetrown: we want to move away from installing os-refresh-config scripts via the "magic" os-refresh-config directory19:38
dprincetrown: we'll still use os-refresh-config and all, but we'll directly install the scripts via install.d package stuff19:38
dprincetrown: all of this is moving us away from image-element crufty-ness19:38
dprincetrown: and eventually even instack, etc.19:39
*** jprovazn has quit IRC19:39
dprinceif I don't get any reviews on https://review.openstack.org/#/c/342486/ soon I'm just going to land it myself19:41
*** SpamapS has joined #tripleo19:41
dprincealmost 5 months of no core reviews and I'm not breaking anything19:42
trowndprince: ok that part makes sense, so eventually we would get rid of the install.d part in the os-refresh-config element? and/or move it out of t-i-e?19:42
dprincetrown: I think eventually the idea is that we'll install os-refresh-config (the package) but not require anything in tripleo-image-elements19:43
dprincetrown: right now we rely on the tripleo-image-elements os-refresh-config element to move element scripts around for us19:43
trowndprince: ah ok, then we can remove it from element-deps19:43
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Remove yum-plugin-priorities hack  https://review.openstack.org/39733119:43
dprincetrown: eventually, yes19:44
trowngot it19:44
*** anshul has joined #tripleo19:46
openstackgerritMerged openstack/tripleo-quickstart: main script: Use zuul cloner if present to fetch an pip install extras  https://review.openstack.org/40377619:51
*** achadha_ has joined #tripleo19:51
openstackgerritBen Kero proposed openstack/tripleo-quickstart-extras: overcloud-deploy: add variable for hypervisor_wait  https://review.openstack.org/40494319:52
*** anshul has quit IRC19:53
*** achadha has quit IRC19:54
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras: Add introspection with retries option  https://review.openstack.org/40367719:57
gfidenteEmilienM mind if I give a recheck there, just to make sure?20:07
EmilienMgfidente: where?20:07
gfidentescenario20:07
*** achadha has joined #tripleo20:08
*** achadha has quit IRC20:08
EmilienMgfidente: sure thing20:08
*** achadha has joined #tripleo20:09
stevebakermorning20:09
*** achadha_ has quit IRC20:09
EmilienMstevebaker: o/20:09
EmilienMgfidente: otherwise I'll use file backend for gnocchi20:09
openstackgerritMerged openstack/tripleo-quickstart: Always upload overcloud image when has been customized  https://review.openstack.org/39684920:09
*** achadha_ has joined #tripleo20:10
stevebakertrown, dprince: I'm slowly working towards all orc scripts being installed by RPMs, not elements - this is the next step https://review.openstack.org/#/c/386326/20:10
*** dsariel has joined #tripleo20:11
stevebakertrown: and anything left over can be installed by some install.d shell20:11
dprincestevebaker: ack, I like it20:11
matbuccamacho|afk: great :)20:12
gfidenteEmilienM yes if it fails again20:13
*** achadha has quit IRC20:13
gfidentedprince trying, https://review.openstack.org/#/c/342486/5/os_collect_config/zaqar.py20:13
EmilienMgfidente: ack20:13
gfidenteon line118 the timeout is the ttl set on line 90 ?20:13
dprincegfidente: no, that is the queue timeout. Socket timeout would be separate I think20:14
*** achadha_ has quit IRC20:15
gfidenteoh it's the socket timeot20:15
dprincegfidente: sorry, I may hve mis-read your question. The timeout on line 90 is just the queue timeout20:16
gfidentedprince ok I was trying to understand what happens after the timeout20:16
dprincegfidente: which relates to how long zaqar will subscribe you to that queue20:16
dprincegfidente: if it times out os-collect-config runs again. Totally safe I think since we always re-check the message queue again on each os-collect-config iteration20:17
gfidenteso do I get it right this will rise an ex20:17
gfidenteexit and rerun20:17
dprincegfidente: exactly20:17
gfidenteah cool, thanks20:18
openstackgerritKoki Sanagi proposed openstack/puppet-tripleo: Add networking-fujitsu support to puppet-tripleo  https://review.openstack.org/40493820:21
*** panda|bbl is now known as panda20:21
*** hjensas has joined #tripleo20:22
*** hjensas has quit IRC20:22
*** hjensas has joined #tripleo20:22
slaglestevebaker: hey, i'm trying to move away from having to using admin creds when using the deploued-server template20:22
slagleassuming POLL_TEMP_URL is the software config transport...can I query heat to tell me what the temp url actually is?20:23
slaglei dont see it in the resource metadata20:23
*** nyechiel has quit IRC20:24
stevebakerslagle: yeah, I've been thinking about this too. I think the only option is to implement something properly in heat, something like a OS::Heat::DeployedServer which is a drop-in replacement for OS::Nova::Server20:26
*** paramite has quit IRC20:26
slaglestevebaker: ok, yea that might be the only option i guess20:26
stevebakerslagle: there may be another way, now that I actually have deployed-server working for me I'll have a proper look20:27
slagleearlier i tried to use POLL_SERVER_HEAT, but discovered that there were no access_allowed_handlers registered so occ was getting a forbidden error20:27
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates: Use transient hostname for deployed servers  https://review.openstack.org/40495420:27
slagleturns out those get registered in nova/server.py in heat20:28
*** jcoufal has quit IRC20:28
dprinceslagle, stevebaker: I might prefer an in-heat version of deployed-server I think20:28
slagleso now i was trying to use POLL_TEMP_URL..but getting stuck again20:28
stevebakeryeah, there is a lot of logic in nova/server.py to build the occ bootstrap data, that needs to be exposed some other way20:28
dprinceslagle, stevebaker: I tried to switch you over to apply-config (which uses proper signalling) and hit a race condition in the implementation I think https://review.openstack.org/#/c/396171/20:29
stevebakerslagle: any chance undercloud can have an ironic *and* fake drivers set up now?20:29
* dprince was considering trying no signalling for this20:29
slaglestevebaker: you mean mixing the 2?20:29
stevebakerslagle: yeah20:30
slaglenot sure if that would work with deployed-server20:30
*** saneax is now known as saneax-_-|AFK20:30
stevebakeryou wouldn't need deployed server at all if some of your servers were fake nova, just something equivalent to get-occ-config.sh20:31
stevebakerdprince: what is racing do you know?20:31
dprincestevebaker: If I try to rely on heat-config signals instead of 99-refresh-config it hangs20:32
dprincestevebaker: the signel is never recieved and it hangs20:32
slaglestevebaker: yea, that would probably work20:32
openstackgerritMerged openstack/tripleo-puppet-elements: Disable old hiera.yaml o-a-c script  https://review.openstack.org/39261520:32
*** ohamada has quit IRC20:32
stevebakerdprince: hmm, now that I actually have a working environment, I'll try it out20:33
stevebakerslagle: so is nova capable of having different drivers on one host now?20:34
dprincestevebaker: I was guessing that no_signal might fix it perhaps. hacky though20:34
slaglestevebaker: not that i know, that would have to be on the ironic side20:34
slagleironic configures the driver per node, and has a fake driver20:34
dprinceslagle: I personally would prefer the in-heat option as relying on Ironic,Nova is a whole bunch of extra requirements20:35
stevebakerdprince: remember that execution order of hook scripts is determined by the name property of the deployment resource. If you're not setting a name explicitly then you can't be sure of execution order20:36
*** dbecker has quit IRC20:36
dprinceslagle: it wouldn't be ideal for the undercloud installation case at all which also would rely on a deployed server mechanism20:36
slagledprince: right..both are kind of viable options depending on the use case20:36
slagleif you want a "heat only" solution, deployed-server is for that20:36
openstackgerritGiulio Fidente proposed openstack/tripleo-docs: Document how to quiesce and delete a cephstorage node  https://review.openstack.org/40443420:36
dprincestevebaker: so set name on the InstanceIdDeployment then?20:37
stevebakeryes, a heat-only solution would be good20:37
*** rcernin has joined #tripleo20:37
dprincestevebaker: I haven't tried that. I did try adding the explicit depends on to the HostEntryDeployment. But that seemed to have no effect20:38
stevebakerdprince: its just something to keep in mind - it may have no bearing to this situation20:38
slaglestevebaker: would it make sense to refactor the nova/server.py class into a base class with all the nova api calls in a nova specific subclass in heat?20:38
dprincestevebaker: it is related to the fact that all of the heat "hooks" run at os-refresh-config 50 or so20:38
dprincestevebaker: so the metadata shows up much later than it did before20:38
slaglestevebaker: i can start looking into that if you think it makes sense20:38
stevebakerslagle: yeah, or a subclass of Server which makes no nova calls20:39
slagleok, will have a look20:39
*** ctayal has quit IRC20:40
*** rodrigods is now known as rodrigods_20:41
stevebakerslagle: actually, I think break out the occ logic into utility functions and have a minimal OS::Heat::DeployedServer resource which exposes the resulting deployment data. If the user needs something which behaves like a OS::Nova::Server resource they can to a deployed-server style template with the parameters/outputs needed to pretend to be their OS::Nova::Server20:42
*** egafford has joined #tripleo20:42
dprinceslagle: you are tring this to avoid the admin credentials for CI jobs then?20:43
dprinceslagle: I like this idea, just trying to understand your use case...20:43
slagledprince: more or less, yea20:43
slaglegetting away from admin creds was just the first thing i tried to tackle to make progress towards a true split stack20:44
slaglei thought it would be easy'ish :)20:44
slaglebut my end goal overall is split stack20:45
slagleand trying to make deployed-server more fit for production20:45
dprinceslagle: well, FWIW the undercloud installer case I'm using it just fine without get-occ-data.sh and I consider that production enough20:46
dprinceslagle: but I have a different mechanism in place for the stack-id etc.20:47
slagledprince: i havent looked at that in a little while, but how are you configuring occ?20:47
stevebakerslagle: is there any CI job which is OVB with deployed-server?20:47
slaglestevebaker: no20:48
*** achadha has joined #tripleo20:48
stevebakerslagle: how about a CI job with deployed-server?20:48
slaglestevebaker: yes, the multinode jobs20:48
dprinceslagle: I exec it manually rather than have it run via systemd. And I create the stack each time, so the stack is essentially ephemeral20:48
dprinceslagle: you could do the same thing with and Ansible o-c-c runner20:49
dprinceslagle: and then you'd have a split stack I think20:49
slaglestevebaker: nonha-multinode, and all the scenario jobs20:49
stevebakerslagle: ok, my dev env is now OVB+deployed-server - maybe this can become more common in the future20:49
dprinceslagle: line 67 here https://review.openstack.org/#/c/351351/7/tripleoclient/v1/undercloud_deploy.py20:50
dprinceslagle: I've got a much newer version locally but still polishing it up a bit20:51
slagledprince: yea, was just looking at that20:51
slaglei think using admin is fine there for the undercloud install20:51
slaglebut i dont want to have to do that on overcloud nodes20:52
*** arxcruz has quit IRC20:52
dprinceslagle: right, well if the stack is ephemeral I think we could probably configure heat with some other user too20:52
dprinceslagle: you just need a user you can pre-create so you can trick out the signalling20:52
stevebakerslagle: there are resources to create keystone users - if there was just a way to allow that user to call heat on that stack20:53
*** liverpooler has quit IRC20:54
*** nyechiel has joined #tripleo20:58
openstackgerritMerged openstack-infra/tripleo-ci: updates: fix condition that adds correct DEPLOY_ARGS  https://review.openstack.org/40374421:00
*** ctayal has joined #tripleo21:00
*** ctayal has quit IRC21:00
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Make pep8 task run template generation  https://review.openstack.org/39441521:02
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add local template generation tox task  https://review.openstack.org/39441021:02
openstackgerritChristian Schwede proposed openstack/puppet-tripleo: Include swift::storage::loopbacks class  https://review.openstack.org/40496721:03
*** dprince has quit IRC21:03
*** gfidente has quit IRC21:07
*** jayg is now known as jayg|g0n321:09
*** ctayal has joined #tripleo21:10
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Always use cached images in updates job  https://review.openstack.org/38671321:12
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Temporarily disable ceph in the updates job  https://review.openstack.org/39728821:12
*** ctayal has quit IRC21:13
*** amoralej|off is now known as amoralej21:21
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement scenario004 with Ceph Rados Gateway scenario  https://review.openstack.org/40445821:21
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras: Use generic cloud image for undercloud  https://review.openstack.org/40154821:23
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001: deploy Ceph  https://review.openstack.org/40446221:24
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Environment is a dict, which can't use 'extend'  https://review.openstack.org/40485321:25
*** owalsh has quit IRC21:32
*** owalsh_ has joined #tripleo21:33
*** ctayal has joined #tripleo21:36
*** owalsh__ has joined #tripleo21:37
*** jkilpatr has quit IRC21:38
*** dsneddon_ has joined #tripleo21:39
*** owalsh__ is now known as owalsh21:39
*** owalsh_ has quit IRC21:39
*** rhallisey has quit IRC21:42
*** dsneddon_ has quit IRC21:43
openstackgerritMerged openstack/tripleo-common: Build overcloud with overcloud-agent element  https://review.openstack.org/38632621:48
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test with scheduler hints  https://review.openstack.org/37804021:48
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add feature testing matrix to readme  https://review.openstack.org/39926921:48
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Add gnocchi support on undercloud  https://review.openstack.org/39299221:49
*** jtomasek has quit IRC21:51
*** dtrainor has quit IRC21:52
*** ctayal has quit IRC21:54
*** cdearborn has joined #tripleo21:59
*** jrist has quit IRC22:01
*** [1]cdearborn has quit IRC22:01
openstackgerritMerged openstack/tripleo-puppet-elements: Move nova.conf truncation into separate element  https://review.openstack.org/39255922:01
*** lblanchard has quit IRC22:01
*** jrist has joined #tripleo22:02
*** jrist has joined #tripleo22:02
*** ctayal has joined #tripleo22:05
*** jrist has quit IRC22:07
*** dbecker has joined #tripleo22:08
*** trown is now known as trown|outtypewww22:10
*** bfournie has quit IRC22:10
*** bfournie has joined #tripleo22:11
*** bfournie has quit IRC22:11
*** penick has quit IRC22:12
*** pblaho` has joined #tripleo22:14
*** bfournie has joined #tripleo22:16
*** pblaho has quit IRC22:16
*** ctayal has quit IRC22:18
*** rasca has quit IRC22:20
openstackgerritSteve Baker proposed openstack/tripleo-common: Represent dib elements as a list  https://review.openstack.org/40224922:21
*** TSCHAK has quit IRC22:21
*** amoralej is now known as amoralej|off22:22
*** lblanchard has joined #tripleo22:23
*** Goneri has quit IRC22:25
*** jeckersb is now known as jeckersb_gone22:31
openstackgerritDan Prince proposed openstack/tripleo-common: Drop use of hosts element.  https://review.openstack.org/40025322:34
*** ctayal has joined #tripleo22:35
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Deployed server: switch to apply-config hook  https://review.openstack.org/39617122:36
openstackgerritAlex Schultz proposed openstack/python-tripleoclient: Add overcloud support report command  https://review.openstack.org/40500122:36
openstackgerritAlex Schultz proposed openstack/python-tripleoclient: Add overcloud support report command  https://review.openstack.org/40500122:37
*** fultonj has quit IRC22:38
*** mnaser has quit IRC22:41
*** jrist has joined #tripleo22:42
*** lblanchard has quit IRC22:42
openstackgerritAlex Schultz proposed openstack/tripleo-common: Add support workflows  https://review.openstack.org/40500222:43
*** cdearborn has quit IRC22:48
*** mnaser has joined #tripleo22:50
*** achadha_ has joined #tripleo22:57
*** noslzzp has quit IRC22:57
*** achadha has quit IRC22:57
*** athomas has quit IRC22:58
*** flepied has quit IRC23:01
*** achadha_ has quit IRC23:01
*** dbecker has quit IRC23:02
*** nyechiel has quit IRC23:02
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement scenario004 with Ceph Rados Gateway scenario  https://review.openstack.org/40445823:12
openstackgerritOpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements  https://review.openstack.org/40090723:13
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/40077623:16
*** panda is now known as panda|Zz23:16
*** chlong has quit IRC23:22
*** ctayal has quit IRC23:24
*** pmannidi has joined #tripleo23:25
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras: Use generic cloud image for undercloud  https://review.openstack.org/40154823:25
*** rcernin has quit IRC23:26
*** dsneddon_ has joined #tripleo23:27
*** jcoufal has joined #tripleo23:29
*** dsneddon_ has quit IRC23:31
*** apetrich has quit IRC23:32
*** apetrich has joined #tripleo23:32
*** penick has joined #tripleo23:38
*** Goneri has joined #tripleo23:40
*** penick_ has joined #tripleo23:42
*** pradk has quit IRC23:43
*** penick has quit IRC23:43
*** penick_ is now known as penick23:43
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Hiera optimization: use a new hiera hook  https://review.openstack.org/38475723:45
*** jkilpatr has joined #tripleo23:46
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Make pep8 task run template generation  https://review.openstack.org/39441523:47
*** ctayal has joined #tripleo23:51
openstackgerritMerged openstack/tripleo-common: Environment is a dict, which can't use 'extend'  https://review.openstack.org/40485323:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!