Tuesday, 2016-02-23

*** ayoung has joined #tripleo00:01
openstackgerritMerged openstack/diskimage-builder: Rework functional test runner  https://review.openstack.org/27656300:28
*** lblanchard has joined #tripleo00:47
*** dmacpher has joined #tripleo00:56
*** saneax is now known as saneax_AFK01:00
*** eil397 has quit IRC01:05
*** dcain has joined #tripleo01:08
jidaranybody know why if I earlier included a puppet file that failed to compile during the `openstack overcloud deploy` and later removed it, my deployments still fail with reference to a newly dropped .pp file along the lines of the fact the pp file failed to compile?01:09
jidar`Error: Could not parse for environment production: Syntax error at 'and' at /var/lib/heat-config/heat-config-puppet/4c862636-5707-4606-b8bc-5528554bc78f.pp:2`01:09
jidarI can verify that that file stats to a few minutes ago along with my deployment01:10
*** dcain1 has joined #tripleo01:18
*** dcain has quit IRC01:21
*** penick has quit IRC01:23
*** rlandy has quit IRC01:34
*** tiswanso has quit IRC01:35
*** shivrao has quit IRC01:50
*** tiswanso has joined #tripleo02:01
*** rhallisey has quit IRC02:18
*** ron___ has quit IRC02:20
*** rlandy has joined #tripleo02:53
*** rlandy has quit IRC02:56
*** dcain has joined #tripleo03:16
*** yuanying_ has joined #tripleo03:16
*** tzumainn has quit IRC03:16
*** dcain1 has quit IRC03:19
*** lblanchard has quit IRC03:19
*** yuanying has quit IRC03:19
*** yuanying_ has quit IRC03:20
*** dcain1 has joined #tripleo03:28
*** dcain has quit IRC03:31
*** yamahata has quit IRC03:34
*** panda has quit IRC03:37
*** panda has joined #tripleo03:38
*** links has joined #tripleo04:03
*** anande has joined #tripleo04:06
*** yuanying has joined #tripleo04:08
*** Marga_ has quit IRC04:12
openstackgerritSteve Baker proposed openstack/instack-undercloud: Override OS::Nova::Server for user_data updates  https://review.openstack.org/28337904:19
*** anande has quit IRC04:26
*** Marga__ has joined #tripleo04:28
*** Marga__ has quit IRC04:32
*** shivrao has joined #tripleo04:36
*** masco has joined #tripleo04:37
*** shivrao_ has joined #tripleo04:39
*** shivrao has quit IRC04:40
*** shivrao_ is now known as shivrao04:40
*** xinwu has quit IRC04:41
*** tiswanso has quit IRC04:43
*** anande has joined #tripleo04:55
*** anande has quit IRC04:57
*** anande has joined #tripleo04:57
*** anande has quit IRC04:57
*** shivrao has quit IRC05:04
*** coolsvap|away has quit IRC05:06
*** shivrao has joined #tripleo05:11
*** Marga_ has joined #tripleo05:12
*** shivrao has quit IRC05:13
*** shivrao has joined #tripleo05:13
*** Marga_ has quit IRC05:16
*** Marga_ has joined #tripleo05:23
*** dcain1 has quit IRC05:24
openstackgerritimain proposed openstack/tripleo-common: WIP: Only copy network configs from system to container once.  https://review.openstack.org/28338905:30
*** Marga_ has quit IRC05:33
*** Marga_ has joined #tripleo05:33
*** jtomasek has joined #tripleo05:51
*** saneax_AFK is now known as saneax05:54
*** xinwu has joined #tripleo06:06
*** mburned is now known as mburned_out06:35
*** jaosorior has joined #tripleo06:37
*** jprovazn has joined #tripleo06:43
*** dmacpher has quit IRC06:45
*** george_goh has joined #tripleo06:55
george_gohHi, I'm getting an 'error 0 TFTP Aborted' error when I do a baremetal introspection. It gets allocated the right IP via DHCP, and then it seems to boot the undi image, which tries DHCP again. At this point it times out. Any ideas?06:59
*** shivrao has quit IRC07:07
*** leanderthal|afk is now known as leanderthal07:08
*** jtomasek has quit IRC07:15
*** liverpooler has joined #tripleo07:17
*** liverpooler has quit IRC07:17
*** liverpooler has joined #tripleo07:17
*** yamahata has joined #tripleo07:21
*** hjensas has quit IRC07:38
*** sshnaidm has quit IRC07:42
*** mikelk has joined #tripleo07:43
*** shivrao has joined #tripleo07:46
*** jaosorior has quit IRC07:50
*** dshulyak has joined #tripleo07:57
*** pcaruana has joined #tripleo07:59
*** jaosorior has joined #tripleo08:05
*** fgimenez has joined #tripleo08:06
*** pcaruana is now known as pcaruana|afk|08:08
*** pcaruana|afk| is now known as pcaruana08:08
*** aufi has joined #tripleo08:10
*** Oku_OS has quit IRC08:13
*** rdopiera has joined #tripleo08:14
*** paramite has joined #tripleo08:14
jaosoriormarios: Hey dude, got time to check this out? https://review.openstack.org/#/c/283074/08:22
mariosjaosorior: will do in a bit, just finishing up some other reviews and have to run an errand08:22
*** ifarkas has joined #tripleo08:26
jaosoriormarios: thanks dude08:28
jaosoriormarios: How's it going over there?08:28
leanderthalgeorge_goh, i'm not a baremetal person, but if you don't figure it out / get an answer in the next hour, ask again - a lot of EMEA people are just now coming online08:29
*** oshvartz has joined #tripleo08:31
*** shivrao has quit IRC08:33
openstackgerritK Rain Leander proposed openstack/tripleo-docs: Initial RHEL reference needs to be spelled out per Red Hat branding  https://review.openstack.org/28344208:37
leanderthalsecond review submitted! (is my enthusiasm contagious?  is it?)08:39
hewbroccaMorning everyone08:43
jaosoriorMorning hewbrocca08:44
leanderthalmorning hewbrocca08:44
jaosoriorhewbrocca: how's life?08:44
hewbroccaPretty good, all things considered08:44
hewbroccaYou guys got SSL all landed in Mitaka?08:44
jaosorioryou mean stable/liberty?08:44
jaosorioror master?08:45
hewbroccaMaster first :)08:45
jaosoriorIt's all in master08:45
hewbrocca*excellent*08:45
hewbroccahow about liberty?08:45
jaosoriorstable/liberty I suspect there are some patches missing reviews08:45
hewbroccaWell, if that's all there is, that's great to hear08:45
jaosoriornone from my side, but I think there were some still08:45
hewbroccajaosorior: In that case, are you looking forward to writing blueprints for Newton?08:46
jaosoriorhewbrocca: I already wrote one08:46
jaosoriorhewbrocca: https://review.openstack.org/#/c/282307/08:46
jaosoriorand these are the patches missing for stable/liberty: https://review.openstack.org/#/c/281991/  https://review.openstack.org/#/c/266469/  https://review.openstack.org/#/c/265922/08:47
jaosoriorwith two apparently missing from master, now that I see08:47
jaosoriordocumentation: https://review.openstack.org/#/c/265006/08:47
jaosoriorand ceilometer: https://review.openstack.org/#/c/267660/08:48
*** jistr has joined #tripleo08:49
jaosoriorhewbrocca: But yeah, this spec https://review.openstack.org/#/c/282307/ aims to enable ssl everywhere by adding support for a CA (potentially FreeIPA) and handling the certs with certmonger. bnemec and the guys from Identity have been giving awesome feedback08:49
leanderthaljaosorior++08:50
leanderthalthanks for the review!08:50
jaosoriorleanderthal: It's all good :D08:51
leanderthalwhat is the workflow check? is that manual or automated?08:51
jaosoriorleanderthal: Manual08:51
leanderthaland who needs to do that? a specific maintainer?08:52
jaosoriorleanderthal: So basically. Once two core-reviewers give you a +2 on that patch and you get the verified checkmark, then a core-reviewer can give you a +1 in workflow, which basically means it will be merged08:52
leanderthalso this one [https://review.openstack.org/#/c/283043/] from yesterday still needs a +2 from a core reviewer, yes?08:53
leanderthalor just the +1 in workflow?08:54
jaosoriorleanderthal: It does08:54
leanderthalok, cool08:54
leanderthalthanks for the clarification. i'm writing up a post for simplification08:55
leanderthaloh, thanks for the +1 on that one as well!08:55
jaosoriorleanderthal: haha no biggie, it was a small change, so it was a quick review.08:55
leanderthal:-D08:55
leanderthalstart with the small changes.  work up to the big ones. then scripts.08:56
jaosoriorleanderthal: But yeah, it's not so clear always, since some projects have different rules for merging. AFAIK some just need one core +2 and then the +1 workflow would come.08:56
leanderthalfair enough.08:56
jaosoriorleanderthal: Here is common that the second core approving the patch will give both the +2 review and +1 workflow08:57
leanderthalthat makes sense08:57
jaosoriorand in Barbican it used to be the case that we needed three cores minimum to approve a patch. But that has changed ever since08:57
leanderthalah, okay08:57
jaosoriorpeople disliked how slowly we approved stuff in Barbican :P08:57
hewbroccajaosorior: that's great08:58
leanderthalit would seem to take more time the more core approvals you need, yes08:58
hewbroccare the spec08:58
hewbroccaand the patches08:58
hewbroccaare all those just waiting for review, then?08:58
jaosoriorhewbrocca: yes. now that I wrote you that message with the exact patches I'll try poking people today. They're not too big patches. And hopefully I can bring up the spec to next week's tripleo meeting.08:58
*** xinwu has quit IRC09:00
hewbroccajaosorior: excellent09:01
leanderthaljaosorior, when is the tripleo meeting?  i'd like to join, if possible.09:04
jaosoriorleanderthal: Every Tuesday09:05
jaosoriorleandertha: https://wiki.openstack.org/wiki/Meetings/TripleO09:05
jaosorior* leanderthal09:06
leanderthalcool; thanks09:06
*** gmoro has quit IRC09:09
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Add meta notify=true to rabbitmq resource  https://review.openstack.org/28346109:09
*** sshnaidm has joined #tripleo09:16
*** dtantsur|afk is now known as dtantsur09:18
*** jtomasek has joined #tripleo09:18
leanderthalthx jistr :-)09:25
jistrnp :) i'm now not sure if we have full CI running on tripleo-docs. If not, i'll +A too. /me checks that09:26
jistrjust tripleo-docs job on docs repo. +A09:26
*** lucas-dinner is now known as lucasagomes09:27
leanderthaljistr, you kickass. now the review says 'needs verified'; what is the next step?09:28
jistrleanderthal: gate job should get kicked off any minute (the same as the tripleo-jobs check job) and if that passes (i think it will) then the patch gets merged automatically09:29
jistrwe should see gerritbot announcing it here soon09:29
leanderthalwoah.09:29
leanderthaljistr, i'm a little light headed09:29
jistr:D09:30
openstackgerritMerged openstack/tripleo-docs: Correct grammatical error plural 'foundations' to singular  https://review.openstack.org/28304309:31
leanderthalyou guys.09:31
leanderthalmy first change to openstack tripleo is merged09:31
leanderthalBEER FOR EVERYONE09:31
leanderthalhewbrocca, i'm going to need to get an expense approved...  just beer for everyone.  that's cool, right?09:32
*** nico_auv has joined #tripleo09:37
dtantsurlol09:41
* dtantsur will remind about free beer the next time leanderthal is in Brno09:42
leanderthaldtantsur, this is happening.09:42
*** derekh has joined #tripleo09:44
*** mgould has joined #tripleo09:44
*** mikelk has quit IRC09:45
*** mikelk has joined #tripleo09:45
george_gohHi, I've got a couple of ceph node with 2 RAID controllers - sometimes during deploy, I get a 'failed to mount /dev/sda' error. I've tried to use root_device hints, but it seems to only work sometimes (which leads me to believe it's not being picked up)09:47
george_gohWhen I boot up using a rescue disk, the disk in question is sometimes /dev/sda, and other times /dev/sdk, depending on the order the RAID controllers get detected in the kernel09:47
george_gohany help please?09:48
*** tosky has joined #tripleo09:51
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Introduce update/upgrade workflow  https://review.openstack.org/27135809:52
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Add resources for major upgrade in Pacemaker scenario  https://review.openstack.org/25327609:52
openstackgerritMerged openstack/puppet-pacemaker: Fixes for lint compliance and working specs.  https://review.openstack.org/28068309:57
jistrwhoa, puppet-pacemaker under openstack, and it has some spec code inside09:58
jistrEmilienM: i see you folks are rockin it09:59
*** mcornea has joined #tripleo10:03
*** gfidente has joined #tripleo10:07
*** gfidente has quit IRC10:07
*** gfidente has joined #tripleo10:07
bandinijistr: Děkuji10:11
jistrbandini: prego10:12
bandinilol10:12
bandinijistr: I have no clue about liberty + downstream workflows there. Do have any docs/etherpad around for that? (or do you have an existing bz which was fixed upstream then 8 then 7 that I can look at?)10:13
bandinis/Do/Do we/10:13
bandiniI need more coffee10:13
jistrbandini: e.g. https://review.openstack.org/#/q/Iffa0a77852729786b69945c1e72bc90ad57ce3bb,n,z10:15
jistrbandini: once your patch gets merged into master, you can rebase it on top of stable/liberty upstream and do another `git review` to submit it against stable/liberty. It will automatically be submitted against stable/liberty because the .gitreview file in stable/liberty branch has an additional line here https://github.com/openstack/tripleo-heat-templates/blob/stable/liberty/.gitreview#L510:18
*** electrofelix has joined #tripleo10:18
jistrbandini: as for stable/liberty -> downstream, i think we'd pull it in with other changes from stable/liberty, so you don't have to worry about that10:19
jistrbandini: sorry, i meant cherry-pick it on top of stable/liberty, not rebase10:20
bandinijistr: perfect, thanks. yes I assumed cherry-pick10:20
gfidenteand that is cherry-pick -x or there will be a rush in -1 your port10:23
gfidenteahahaha10:24
gfidentebandini, I was looking with trown|outtypewww the other day into a strange failure of the galera resource agent with mariadb1010:25
gfidentehave you ever tried that?10:26
*** aufi has quit IRC10:28
*** aufi has joined #tripleo10:29
bandinigfidente: am in a call right now. want to drop me the details over PM?10:30
gfidentebandini, I think trown|outtypewww knows more than me at this point, we can ping him later today10:32
bandiniyessir10:32
gfidentetks10:33
*** jtomasek_ has joined #tripleo10:36
*** Oku_OS has joined #tripleo10:52
*** marcusvrn_ has joined #tripleo10:56
*** hjensas has joined #tripleo11:02
*** hjensas has quit IRC11:02
*** hjensas has joined #tripleo11:02
*** hjensas has quit IRC11:04
*** hjensas has joined #tripleo11:05
*** dshulyak has quit IRC11:06
*** mburned_out is now known as mburned11:08
*** rasca has quit IRC11:14
*** mgould has quit IRC11:14
*** rasca has joined #tripleo11:15
*** mcornea has quit IRC11:17
*** dtantsur is now known as dtantsur|brb11:18
*** dshulyak has joined #tripleo11:25
*** mcornea has joined #tripleo11:30
*** mgould has joined #tripleo11:30
*** panda has quit IRC11:38
*** panda has joined #tripleo11:38
*** masco has quit IRC11:58
gfidenteanyone spares +A on this 4 patch series for stable? https://review.openstack.org/#/c/264872/212:02
jistrgfidente: can you +2 the first one? i'll do that too... it's somehow questionable who's +2 should be there since i did the backport and you did the rebase, so if we both give +2, i think that covers it :D12:10
jistroh, "not current"12:11
jistrneeds a rebase again12:11
* jistr does that12:11
gfidenteenjoy :)12:12
*** jcoufal has joined #tripleo12:12
gfidentemburned, rebased it already12:12
gfidentettyl12:14
openstackgerritMerged openstack/tripleo-heat-templates: Enable Dell Storage Center iscsi Backends in Cinder  https://review.openstack.org/26487212:15
*** lucasagomes is now known as lucas-hungry12:16
jistroh i see, i'm still getting confused by the new gerrit interface12:18
openstackgerritMerged openstack/tripleo-heat-templates: Update Dell Storage Center api port setting  https://review.openstack.org/28325612:18
openstackgerritMerged openstack/tripleo-heat-templates: Remove deleted Nova rows  https://review.openstack.org/27907612:18
openstackgerritMerged openstack/tripleo-heat-templates: Remove deleted Cinder rows  https://review.openstack.org/27907712:18
openstackgerritMerged openstack/tripleo-heat-templates: Switch for Keystone DB cron job  https://review.openstack.org/27907812:21
*** rhallisey has joined #tripleo12:26
*** pino|work has quit IRC12:27
jaosoriorhey guys, can someone check these patches out? https://review.openstack.org/#/c/265006/ https://review.openstack.org/#/c/267660/ they've been missing reviews for a while and are needed to finish SSL support12:27
*** pino|work has joined #tripleo12:32
*** mcornea has quit IRC12:36
*** mcornea has joined #tripleo12:37
*** links has quit IRC12:38
*** mbound has joined #tripleo12:41
*** r-mibu has quit IRC12:42
*** r-mibu has joined #tripleo12:43
*** dprince has joined #tripleo12:45
*** dtantsur|brb is now known as dtantsur12:46
openstackgerritMerged openstack/tripleo-heat-templates: Add extra config yaml files for big switch agents.  https://review.openstack.org/27192212:46
*** mbound_ has joined #tripleo12:46
*** masterbound has joined #tripleo12:48
*** ryansb has quit IRC12:48
*** mbound has quit IRC12:49
*** mbound has joined #tripleo12:49
*** mbound_ has quit IRC12:51
*** ryansb has joined #tripleo12:51
*** ryansb has quit IRC12:51
*** ryansb has joined #tripleo12:51
*** masterbound has quit IRC12:53
*** dtantsur is now known as dtantsur|brb12:56
*** rlandy has joined #tripleo12:57
*** trown|outtypewww is now known as trown13:00
*** mkovacik has joined #tripleo13:06
*** jayg|g0n3 is now known as jayg13:16
*** mandre has quit IRC13:16
*** mandre has joined #tripleo13:17
trownderekh: is the comment on 4 in the etherpad you?13:18
trown"Another possibility"13:18
derekhtrown: yup13:20
derekhtrown: new stack redeploying at the moment to test13:20
trownderekh: cool, that jives with my finding as well13:20
*** aufi has quit IRC13:20
trownIt looks like that THT patch is missing some stuff in the endpoint map13:21
derekhtrown: what I think we're missing http://paste.openstack.org/show/487888/13:21
derekhtrown: yup13:21
trownyep, I am trying with that as well, and ... "tripleo.sh -- Overcloud pingtest, SUCCESS"13:21
trownwoot13:21
derekhtrown: sweet, lets update the patch and recheck13:22
trownon it13:22
*** links has joined #tripleo13:23
*** lucas-hungry is now known as lucasagomes13:26
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates: Nova Neutron configuration now uses keystone v3 endpoint  https://review.openstack.org/27918413:26
*** athomas has quit IRC13:32
*** thrash|g0ne is now known as thrash13:37
*** pradk has joined #tripleo13:38
*** dmacpher has joined #tripleo13:41
*** mbound has quit IRC13:42
*** athomas has joined #tripleo13:43
derekhtrown: patch works for me also13:44
derekhtripleo.sh -- Overcloud pingtest, SUCCESS13:44
openstackgerritK Rain Leander proposed openstack/tripleo-docs: Removed reference to SpinalStack to prevent confusion  https://review.openstack.org/28358213:46
trownderekh: sweet, maybe we can get delorean promoted today... that would make my week13:47
*** pradk has joined #tripleo13:50
*** mbound has joined #tripleo13:57
*** julim has joined #tripleo13:57
gfidentemeeting time! :)14:00
dprincegfidente: yes14:00
*** dtantsur|brb is now known as dtantsur14:01
*** pcaruana has quit IRC14:02
*** lblanchard has joined #tripleo14:04
*** dcain has joined #tripleo14:08
*** jaosorior has quit IRC14:11
*** jaosorior has joined #tripleo14:12
openstackgerritMerged openstack/puppet-tripleo: Make haproxy balancer default options configurable  https://review.openstack.org/26721114:14
*** saneax is now known as saneax_AFK14:20
*** tiswanso has joined #tripleo14:20
*** weshay has joined #tripleo14:20
*** tzumainn has joined #tripleo14:23
openstackgerritMerged openstack/tripleo-heat-templates: Fix cinder error when CinderNfsMountOptions option is absent  https://review.openstack.org/28121414:24
*** NobodyCa1 has joined #tripleo14:25
*** mbound_ has joined #tripleo14:29
*** links has quit IRC14:30
*** links has joined #tripleo14:30
*** mbound has quit IRC14:30
openstackgerritMerged openstack/puppet-tripleo: Use HAProxy 'transparent' bind option for compat with IPv6  https://review.openstack.org/26721214:32
*** Goneri has joined #tripleo14:32
*** NobodyCa1 has quit IRC14:33
*** julim_ has joined #tripleo14:34
*** julim has quit IRC14:35
openstackgerritJiri Stransky proposed openstack/tripleo-common: Allow updating images via `tripleo.sh --overcloud-images`  https://review.openstack.org/28360714:42
*** mbound_ has quit IRC14:43
*** tosky has quit IRC14:46
*** ayoung has quit IRC14:46
*** tosky has joined #tripleo14:47
*** dmsimard is now known as dmsimard|afk14:48
*** rpothier has joined #tripleo14:57
openstackgerritMerged openstack-infra/tripleo-ci: Increase undercloud swap to 2 GB  https://review.openstack.org/28246215:00
trowndprince: ya, there is already a concept of package lists for the image build part of tripleo-quickstart, it would be a super simple patch for the image consuming part15:02
trownthere are ~5 packages installed for that15:02
*** tiswanso_ has joined #tripleo15:05
openstackgerritBen Nemec proposed openstack/puppet-tripleo: Handle redirects for Horizon  https://review.openstack.org/28199115:07
*** links has quit IRC15:07
*** tiswanso has quit IRC15:07
*** mkovacik_ has joined #tripleo15:13
*** tiswanso_ has quit IRC15:14
*** mbound has joined #tripleo15:14
*** tiswanso has joined #tripleo15:14
*** mkovacik has quit IRC15:16
*** pcaruana has joined #tripleo15:18
*** pcaruana has quit IRC15:20
jaosoriorbnemec: was that just a rebase? or did something more change? ^^15:20
*** pcaruana has joined #tripleo15:21
bnemecjaosorior: Rebase15:21
*** pcaruana|afk| has joined #tripleo15:21
jaosoriorguys, any +A for this? https://review.openstack.org/#/c/267660/ it has been there for a while, but even a recent recheck passed the gates :D15:23
bnemecI would, but technically it's still my patch. :-)15:24
jaosoriorthanks slagle :D15:27
slaglenp15:27
slaglebnemec: you could have :), given my previous +2 was on there15:27
jaosoriorbnemec: awww yeah. I think that was the last one missing on master besides the documentation15:27
slaglebut i added it back :)15:28
bnemecslagle: Ah, that's true.15:28
bnemecjaosorior: Yeah, the CI job is even passing.15:28
jaosoriorbenemec Awwww yiiiis :D15:28
derekhbnemec: I'm looking at a swift-proxy process on logs that got killed by the OOM15:28
bnemec*Proposed CI job15:28
jaosorior*bnemec15:28
derekhFeb 23 14:46:10 instack.localdomain kernel: Killed process 17617 (swift-proxy-ser) total-vm:1396876kB, anon-rss:1142140kB, file-rss:1136kB15:28
derekhIts using 1.4G of RAM15:28
bnemecderekh: Yep, that was the reason for the extra swap.15:28
bnemecWhoa15:28
*** ron___ has joined #tripleo15:28
*** pcaruana|afk| has quit IRC15:29
jaosoriorbnemec: well,now we just need to get these three in liberty https://review.openstack.org/#/c/281991/ https://review.openstack.org/#/c/266469/ https://review.openstack.org/#/c/265922/15:29
bnemecderekh: That's actually the reason for https://review.openstack.org/#/c/282508/15:29
bnemecWill make it easier to find stuff like that.15:29
jistri noticed it today locally too, swift-proxy eating about 1GB RAM for me15:29
openstackgerritMerged openstack/os-cloud-config: Enable ssl for ceilometer  https://review.openstack.org/26766015:29
derekhbnemec: ack, I added top a while back should also give that info15:29
derekhbnemec: and afazekas was adding stats also15:30
bnemecderekh: Is that in host_info?15:30
jistrweird thing is, after i restarted it, it's been at 40 MBs for quite a while now15:30
* derekh thinks swift is holding the entire mage in RAM15:30
derekhbnemec: should be one sec15:30
*** sshnaidm has quit IRC15:30
bnemecSounds like it.15:30
*** paramite is now known as paramite|afk15:33
*** mbound has quit IRC15:34
derekhbnemec: yup, its in host_info but didn't work, here is the patch to fix it15:35
derekhbnemec: https://review.openstack.org/#/c/273452/15:35
derekhbnemec: although I like how the ps command gives you a tree15:35
bnemecderekh: Yeah, the top output is easier to read though.  Might be worth just doing both.15:36
*** pcaruana has quit IRC15:37
derekhbnemec: yup15:37
bnemecderekh: I think you just +2'd your patch instead. :-)15:38
derekhbnemec: yup, I undid it again15:38
*** ccamacho has joined #tripleo15:40
*** sshnaidm has joined #tripleo15:45
*** dshulyak has quit IRC15:47
*** pcaruana has joined #tripleo15:49
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Use the class param to configure Cinder 'host' setting  https://review.openstack.org/28233215:54
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Set 'host' globally in Cinder instead of per-backend basis  https://review.openstack.org/27908015:54
derekhtrown: nonha and ceph job passed, Ha failed OOM killed swift-proxy,15:55
trownderekh: I had local ha pass15:55
derekhtrown: that should be helped by the bump in swap that bnemec just merged15:56
trownderekh: ok, could you do recheck? I am in meeting15:56
*** paramite|afk is now known as paramite15:56
derekhtrown: ack15:56
*** rpothier has left #tripleo15:56
*** oshvartz has quit IRC15:57
openstackgerritDerek Higgins proposed openstack/tripleo-common: DO NOT MERGE test current with master puppet-nova  https://review.openstack.org/27855315:57
*** julim_ has quit IRC16:01
*** julim has joined #tripleo16:02
*** aufi has joined #tripleo16:04
*** dmacpher is now known as dmacpher-afk16:07
*** dtantsur is now known as dtantsur|brb16:07
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Redirect undercloud install output to file  https://review.openstack.org/28253116:08
*** xinwu has joined #tripleo16:09
*** dshulyak has joined #tripleo16:10
openstackgerritxin wu proposed openstack/tripleo-heat-templates: Add extra config yaml files for big switch agents.  https://review.openstack.org/28049616:12
openstackgerritRyota MIBU proposed openstack/os-cloud-config: add aodh and gnocchi to keystone service list  https://review.openstack.org/27211016:14
*** rbrady has quit IRC16:15
*** aufi has quit IRC16:16
*** leanderthal is now known as leanderthal|afk16:20
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Optionally skip Keystone post-deployment initialization  https://review.openstack.org/25026816:21
*** rbrady has joined #tripleo16:22
*** tiswanso has quit IRC16:23
*** tiswanso has joined #tripleo16:24
*** yamahata has quit IRC16:25
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Source undercloud environment variable from a file  https://review.openstack.org/27566716:26
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file  https://review.openstack.org/27566816:26
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Use timeout to check for services status  https://review.openstack.org/28110916:30
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Split pacemaker common check_service function out of _restart.sh  https://review.openstack.org/28111016:30
*** jprovazn has quit IRC16:39
*** dtantsur|brb is now known as dtantsur16:42
*** sshnaidm has quit IRC16:43
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Permits configuration of Cinder enabled_backend via hieradata  https://review.openstack.org/26953416:43
*** xinwu has quit IRC16:44
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Increase default netdev_max_backlog to 10x  https://review.openstack.org/27760116:45
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Allow the deployer to pick a predefined IP for VIPs  https://review.openstack.org/27631616:46
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Introduce update/upgrade workflow  https://review.openstack.org/27135816:50
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Add resources for major upgrade in Pacemaker scenario  https://review.openstack.org/25327616:50
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Add UpgradeLevelNovaCompute parameter  https://review.openstack.org/28368516:50
*** jistr has quit IRC16:51
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Set notification driver for nova to send  https://review.openstack.org/28368616:52
*** tiswanso has quit IRC16:57
*** yamahata has joined #tripleo16:57
*** tiswanso has joined #tripleo16:58
*** sshnaidm has joined #tripleo16:58
*** rdopiera has quit IRC16:58
dtantsurfolks, does HA job work now on master and/or liberty?17:01
dtantsurtrown, maybe you know ^^17:01
trowndtantsur: for some definition of work... yes17:02
*** trozet_ has joined #tripleo17:02
trowndtantsur: ie it is not totally broken... but we still see random fails with OOM killed processes17:02
trownthat is for master btw... I would assume liberty is the same though17:03
* dtantsur tries rechecking things17:03
*** mikelk has quit IRC17:05
dtantsuralso folks, please review a small patch fixing an issue with profile validation: https://review.openstack.org/#/c/278925/ it's been around for 11 days w/o review, and the gate passed17:05
*** ifarkas has quit IRC17:07
*** fgimenez has quit IRC17:09
openstackgerritDerek Higgins proposed openstack/tripleo-common: Reuse puppet modules already downloaded  https://review.openstack.org/28369917:09
*** xinwu has joined #tripleo17:09
*** rwsu has quit IRC17:13
*** tiswanso has quit IRC17:13
*** rwsu has joined #tripleo17:14
*** tiswanso has joined #tripleo17:14
*** penick has joined #tripleo17:14
*** xinwu has quit IRC17:15
*** jtomasek has quit IRC17:22
gfidentedprince, hey a question about the ::osfamily in the hiera hierarchy17:24
gfidenteI think it'd be useful to make osfamily preveal on the heat metadata, but currently it's heat prevealing17:24
gfidenteit'd be useful instead to override the iscsi helper on rh-like distros to lioadm while keeping the default to tgtadm in the templates17:25
gfidentewe'de need to move it up in the list though, see https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller.yaml#L120017:25
gfidentehave opinions on that?17:25
gfidenteideally I'd move it after 'extraconfig'17:26
derekhdprince: trown gotta run, I've added +2's to the patch that need to be merged assuming HA passes17:27
trownderekh: awesome, thanks!17:27
derekhtrown: if they merge have you access to the delorean box to update the current-tripleo link?17:28
trownI have had multiple local runs pass17:28
derekhtrown: or can you ping somebody in #rdo17:28
trownderekh: hmm, they moved it maybe not... I know who to ping though17:28
derekhtrown: probably jpena17:28
trownyep17:28
*** ayoung has joined #tripleo17:29
derekhtrown: opps, I thought you were asking me17:29
derekhtrown: ok, ttyl,17:29
*** derekh has quit IRC17:30
*** trozet_ is now known as trozet17:31
ayoungCool news.  I was able to run Keystone on port 80 along side Horizon, so that you don't need to port forward two different ports.  I bet we could do that across the board.17:32
*** sshnaidm has quit IRC17:32
*** mkovacik_ has quit IRC17:32
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Move ::osfamily up in the hiera hierarchy, after extraconfig  https://review.openstack.org/28371217:35
*** akuznetsov has joined #tripleo17:38
*** trown is now known as trown|lunch17:39
*** ayoung has quit IRC17:39
*** ayoung has joined #tripleo17:40
*** rlandy has quit IRC17:41
openstackgerritMerged openstack/tripleo-heat-templates: Enable TLS in loadbalancer if cert path is detected  https://review.openstack.org/26646917:44
openstackgerritMerged openstack/tripleo-heat-templates: Configure keystone public_endpoint  https://review.openstack.org/26592217:44
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Forcibly clear parameters now passed as parameter_defaults  https://review.openstack.org/25667017:44
*** xinwu has joined #tripleo17:45
*** rlandy has joined #tripleo17:49
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Aodh services, replacing Ceilometer Alarm  https://review.openstack.org/24140817:54
*** akuznetsov has quit IRC17:57
*** akuznetsov has joined #tripleo17:57
*** akuznetsov has quit IRC17:57
*** shivrao has joined #tripleo18:02
*** lucasagomes is now known as lucas-dinner18:04
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Gnocchi as a Ceilometer metrics storage backend  https://review.openstack.org/25203218:08
*** mgould has quit IRC18:13
*** oshvartz has joined #tripleo18:15
*** dtantsur is now known as dtantsur|afk18:17
dprincegfidente: I think what you suggest for osfamily seems resonable18:21
gfidentedprince, hey thanks18:22
gfidentedprince, on a slightly different topic, I also tried messing up with the hiera merge behaviour a little here https://review.openstack.org/#/c/281822/18:23
gfidentebut the automatic data binding does not give the change to use hiera_array or hiera_merge so that won't apply18:23
gfidente*hiera_hash18:24
*** sshnaidm has joined #tripleo18:24
*** gfidente has quit IRC18:28
*** trown|lunch is now known as trown18:32
*** rlandy has quit IRC18:33
*** rlandy has joined #tripleo18:38
*** tosky has quit IRC18:39
*** julim has quit IRC18:42
*** julim has joined #tripleo18:44
*** athomas has quit IRC18:56
*** jaosorior has quit IRC18:59
*** tiswanso has quit IRC19:02
*** tiswanso has joined #tripleo19:03
*** electrofelix has quit IRC19:07
*** penick has quit IRC19:16
*** penick has joined #tripleo19:17
*** dshulyak has quit IRC19:17
*** athomas has joined #tripleo19:19
*** nico_auv has quit IRC19:20
*** paramite has quit IRC19:30
*** panda has quit IRC19:37
*** panda has joined #tripleo19:38
*** Marga_ has quit IRC19:38
*** eil397 has joined #tripleo19:43
*** tiswanso has quit IRC19:46
*** tiswanso has joined #tripleo19:48
*** akuznetsov has joined #tripleo19:54
ayoungSo..say I want another virtual machine, right next to the one used for the overcloud controller.  Is there an easy way to provision this?19:54
trownayoung: you used instack-virt-setup and are wanting to create a new fake baremetal VM? or?20:00
ayoungtrown, yes20:01
trownit is not very simple...20:01
ayoungtrown, basically, if I had not already run an overcloud install, I would clone the controller/compute node VM and use that20:01
trownwell even if you did that, you would need to register the new fake bms with ironic20:02
*** dshulyak has joined #tripleo20:02
*** Goneri has quit IRC20:03
trownayoung: it is probably more work to do that, than it is to just rebuild the environment20:03
ayoungtrown, ugh...not right now it isn't20:03
ayoungI'm using that environment on a proof of concept of something, and would rather not tear it down20:04
trownk, well there is not feature in instack-virt-setup for that20:04
trownI would be into adding something like that to tripleo-quickstart, but that doesnt help you now20:05
slagleyea the tooling sucks for this20:05
slaglehere's what you could do though20:06
slaglecopy one of the existing baremetal domain xml's20:06
slagleedit that, remove the uuid, and randomize the mac address(es), give it a new name too by incremeting the integer at the end20:06
slaglevirsh define that new xml20:06
slagleqemu-img create a blank qcow2 disk for it (edit the disk name in the xml too)20:07
slaglethen you just need to register the node in ironic20:07
slaglethat's what i do anyway20:07
trownya and for registering the node in ironic, you could just modify the previous instackenv.json, the key in there would be the same for the new node20:09
slagleright, when you edit that, it's copy/paste an existing node definition, edit the mac20:09
*** tiswanso has quit IRC20:13
ayoungslagle, isn't the real issue the qcow?  I mean, I know how to make a VM, I just figured there was some base image to start with I could use20:13
ayoungtripleo by default generates images, no?20:13
*** penick has quit IRC20:14
ayoungbut you can also download from a central store, I believe, which would work for  me here20:14
trownayoung: ironic takes care of that20:14
slagleit uses images, but the initial disk for the vm's is blank20:14
slaglethe only vm that has an initial disk with any content is the undercloud20:15
ayoungtrown, slagle so, if I create a new VM (I have virt-manager to the machine) and attach it to the same networks as the controller node, I can use ironic to provisioN?20:15
slagleyes, it just needs a blank disk20:15
trownayoung: ya you will need to register it like you did the other nodes, which involves making a new instackenv.json20:15
trownslagle: is os-cloud-config smart enough to feed it an old instackenv.json, with just an extra entry, or will you end up with multiple ironic nodes pointing to single pieces of "hardware"20:17
slagletrown: the first, you can use it iteratively to just define new nodes20:18
trownoh cool20:18
ayoungtrown, Ok, I can create the image as a PXE bootable.  Will Ironic do anything with this, or just ignore it to start?20:28
ayoungI guess I could try it and find out...20:28
ayoungOK PXE seemed to work20:30
*** flwang has quit IRC20:31
*** tiswanso has joined #tripleo20:33
*** akuznetsov has quit IRC20:34
*** dcain has quit IRC20:34
*** dcain has joined #tripleo20:37
*** akuznetsov has joined #tripleo20:37
*** akuznetsov has quit IRC20:38
*** rbrady is now known as rbrady-run20:40
ayoungOK...so, I have a PXE booted node, but it does not show up in Ironic...what now?  What doc explains this?20:43
ayoungits not on the server list in the tripleo undercloud, but I would not expect it to be20:43
*** akuznetsov has joined #tripleo20:46
*** penick has joined #tripleo20:47
ayoungslagle, I create a new PXE bootable VM and attached it to the BRBM network.  WHen I powered it on, it got an IP Address and installed via PXE.  DOes nothing register "hey, we've got a new instance" here?20:47
trownayoung: that is what I was referring to with instackenv.json20:49
trownhttp://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_deployment_cli.html#register-nodes20:49
ayoungtrown, seems strange to have to do that...ironic should be more useful than that I would think...boot the node, and then enroll it.20:51
trownwhelp... its not20:51
*** jtomasek_ has quit IRC20:51
ayoungtrown, maybe it is hurting me that I worked on PXE boot autoprovisioning systems in a past life and I really want it to work this way20:52
*** akuznetsov has quit IRC20:53
*** leanderthal|afk is now known as leanderthal20:55
*** mcornea has quit IRC20:56
*** dmsimard|afk is now known as dmsimard20:57
*** leanderthal is now known as leanderthal|afk20:59
ayoungso, the instackenv.json does not match the vm I have running, the Mac addres and IP addrs are different21:02
dmsimardSo we have two +2 on https://review.openstack.org/#/c/278134/ ? What do we need for +A ? CI ?21:02
slagleayoung: i think what you're asking for is node discovery21:03
ayoungslagle, oh yes please21:03
slagleplug a node into the provisioning network, boot it, the inventory system discovers it and knows about it21:03
dmsimardtrown: thanks for fixing https://review.openstack.org/#/c/279184/21:03
ayoungslagle, does that exist?21:03
slagleayoung: ironic doesn't have that, and it's been religiously rejected21:03
slagleway too much back story to get into :)21:03
trowndmsimard: we need the gate to pass here https://review.openstack.org/#/c/278553/721:03
ayoungslagle, HERETICS!21:04
*** leifmadsen has quit IRC21:04
dmsimardtrown: ok21:04
slagleayoung: needless to say, it has "introspection" it can "discover" attributes about nodes it already knows about21:04
trowndmsimard: those patches require some gate fanagling... I am watching that patch though21:04
slagleayoung: this is why ironic-discoverd had to get renamed to ironic-inspector21:04
ayoungslagle, If I speak ill of this, will I be insulting anyone in the current discussion?21:04
ayoungthis is the single saddest thing I've heard since they shot Bambi's Mom.21:05
*** leifmadsen has joined #tripleo21:05
slaglei dont know if anyone would be insulted :)21:05
ayoungOK...so how do I enroll an existing VM...er Baremetal machine?21:06
slaglei just know that discovery has been deemed out of scope for ironic21:06
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Enable Manila integration  https://review.openstack.org/18813721:06
openstackgerritMerged openstack/tripleo-heat-templates: Fixed typo in Dell Equallogic Cinder settings  https://review.openstack.org/27899021:06
ayoungIf I take instackenv.json, change them name and modify the mac address to match the booted vm,21:07
ayounghmmm, would need the IP address, which I don't have21:07
trownayoung: the ip there is the power management IP21:07
trownayoung: in this case the libvirt hypervisor21:07
ayoungtrown, ah, so in my case..the physical machine21:08
trownayoung: it just requires changing mac21:08
ayoungso leave the IP in place21:08
ayoungok...let me try21:08
trownIP should be the same for all the nodes21:08
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Add integration with NetApp Manila driver  https://review.openstack.org/18813821:08
ayoungthere are two macs in there:21:08
ayoungtwo nodes...do I just delete the second node?21:09
trownayoung: slagle says it should work even if you have previously defined nodes in that file21:09
trownI have not tried that part, but he is pretty smart :p21:10
slaglewell i didn't write it21:12
slaglepeople have told me it works21:12
* slagle -> cya21:12
trownhehe21:12
EmilienMlol21:12
*** dcain has quit IRC21:13
trownayoung: I am interested to know in any case if that works or not21:13
*** dcain has joined #tripleo21:13
ayoungtrown, OK I'm at this stage:21:14
ayoungopenstack baremetal import --json idm.json21:14
ayoung$ openstack baremetal list  ... shows21:14
ayoung4d7f0463-32ec-4f5a-9f70-f40ac1e7a1c3 | None | None                                 | power off   | available          | False21:14
ayoungVM tried to reboot, got no bootable device found...21:15
trownayoung: plus your deployed nodes ya?21:15
ayoungtrown, I create a VM using virt-manager21:15
ayoungset up for PXE21:15
trownayoung: ya, once it is registered in ironic it wont get dhcp until you actually deploy to it21:16
trownayoung: which I suppose I should have asked from the start... what is your end goal here? I assumed scaling out computes, but maybe that is not right21:16
ayoungtrown, so, now?   baremetal introspection start21:16
ayoungtrown, no21:16
ayoungtrown, I need to set up an LDAP server for Federation testing21:17
ayoungWill run FreeIPA and Keycloak21:17
trownumm... and you have heat templates for this or?21:17
ayoungtrown, not yet21:17
ayoungtrown, first is by hand, then develop all that21:17
ayoungwe did make it work with Packstack and Ansible last summer, so we know the steps21:18
ayoungbut this is comparable to a customer having an existing Identity management system, and wanting to use it with their overcloud21:18
trownso I probably steered you wrong with ironic... while it is possible to now just nova boot an image on to that ironic node, it is unneeded complexity for what you want21:18
ayoungnah, I like learning this anyway21:19
ayoungand you disabused me of at least one dangerous notion21:19
ayoungplust, yes, we are going to Heatify all this eventually21:19
trownayoung: ok, well you can deploy to that ironic node by doing `nova boot --flavor baremetal --image $image --key-name $key $vmname`21:21
ayoungtrown, would image be overcloud-full21:22
trownayoung: you man need to do `openstack baremetal configure boot` first actually, that sets the node to boot from the disk after it is deployed instead of PXE every time21:22
trownayoung: yep21:22
ayoungI ran21:23
ayoungopenstack baremetal configure boot21:23
trowncool21:23
ayoungok...let me try that21:23
ayoungopenstack server create works too, right?21:23
ayoungI try to use the CLI commands, Keystoen V3 and all...21:23
trownI dont see why not, I just know the nova commands off the top of my head21:23
ayoungopenstack server create  --flavor baremetal --image overcloud-full --key-name default idm21:24
ayoungok returned ok21:24
trownseems reasonable21:24
ayoung4d7f0463-32ec-4f5a-9f70-f40ac1e7a1c3 | None | db5028e1-4988-4654-8d48-d6ede2d1870d | power on    | wait call-back     | False21:25
ayoungPXE seems to be happening21:25
*** trozet has quit IRC21:25
trownyep this is where ironic does its iscsi magic21:25
openstackgerritBen Nemec proposed openstack/python-tripleoclient: Refresh node power state at start of loop  https://review.openstack.org/28380921:25
ayoungwhaddaya know!  It woiked!21:25
ayoungdb5028e1-4988-4654-8d48-d6ede2d1870d | idm                     | ERROR  |21:26
ayoungOK maybe not21:26
trownhehe21:26
ayoungguest not running...21:26
* trown slinks off21:26
trownjk21:26
ayoung {u'message': u'No valid host was found. There are not enough hosts available.',21:27
trownyou want to look in the nova logs, scheduler in particular21:27
trownto find which filter returned 0 hosts21:27
*** penick has quit IRC21:28
ayoungFilter RamFilter returned 0 hosts21:28
ayoungOver commited?21:28
ayounglet me kill the vm and make it smaller21:29
trownis that the first filter that returned 0 hosts? and how much ram did you give the VM21:29
trownit would not be that the VM was too small21:29
trownthe other way around21:29
trownI think the baremetal flavor looks for 4G21:30
*** rhallisey has quit IRC21:32
*** dprince has quit IRC21:36
*** dcain has left #tripleo21:38
openstackgerritJohn Trowbridge proposed openstack/tripleo-common: Move delorean pin  https://review.openstack.org/27855321:43
openstackgerritJohn Trowbridge proposed openstack/tripleo-common: Move delorean pin  https://review.openstack.org/27855321:44
openstackgerritJohn Trowbridge proposed openstack/tripleo-common: Move delorean pin  https://review.openstack.org/27855321:45
ayoung2016-02-23 21:45:29.061 20785 DEBUG nova.scheduler.filters.ram_filter [req-313fdc22-aae2-44b2-9ceb-05c1a9ba6db3 789eaa25a2f3407bab33982cebc58dd0 91680b78999e484c8ccb4425eec20edb - - -] (instack.localdomain, 1e1121:47
ayoung0e29-1750-4c05-9fbe-f58a8a795390) ram:2048 disk:40960 io_ops:0 instances:0 does not have 4096 MB usable ram before overcommit, it only has 2048 MB. host_passes /usr/lib/python2.7/site-packages/nova/scheduler/fil21:47
ayoungters/ram_filter.py:4521:47
ayounggah21:47
ayoung409621:48
ayoungbutttt21:48
ayoungnever updated the json21:48
trownah ya, you want to update the node in ironic to have 4096, you could just delete it from ironic, fix the json and re-import21:53
trownor you could figure out the ironic command to update the properties21:54
*** jayg is now known as jayg|g0n321:54
ayoungwasn't sure, so I kept recreating the VM.  I need to script that eventually, but for now, I'll hand jam it...21:54
ayoungits in build status as we squeak21:54
ayoungtrown, no go...seemed to fail Ram FIlter again, but I suspect the failure was before that21:57
*** julim has quit IRC21:58
*** penick has joined #tripleo21:59
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Set /64 cidr_netmask for pcmk VIPs when IPv6  https://review.openstack.org/26764722:00
*** ccamacho has quit IRC22:00
ayoungtrown, seemse to be the retry filter that is removing the new host from the running22:03
ayoungStarting with 3 host(s)  and ends with 2...the 2 that are already running the undercloud22:03
ayoungovercloud22:03
trownhmm, the retry filter would only kick in if the node failed to deploy more than the configured number of retries22:05
trownI think 3 by default22:05
trownthe error is probably higher up in the log22:05
trownI gotta run... good luck22:05
*** trown is now known as trown|outtypewww22:05
*** ron___ has quit IRC22:10
*** lblanchard has quit IRC22:11
openstackgerritSteve Baker proposed openstack/tripleo-common: Override OS::Nova::Server for user_data updates  https://review.openstack.org/28383222:17
*** dshulyak has quit IRC22:24
*** tiswanso has quit IRC22:37
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Remove start-delay=10s for the Nova resources monitor  https://review.openstack.org/28384022:39
*** Erming_ has joined #tripleo22:48
Erming_Hello22:49
Erming_ I am using the undercloud built by trown's qcow2 image, and try to deploy an overcloud in a virtual environment. All looks well except it finally reports 'no valid host' error.22:49
Erming_I am wondering, if I need do something extra for the virtual environment deployment? as the following instructions are baremetal related:  http://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_deployment_cli.html#upload-images22:50
ayoungErming_, how big is the Machine that your are running on?22:51
Erming_16 core and 128Gmem22:51
*** rhallisey has joined #tripleo22:51
Erming_ayoung: how can I check if the resouce on the host is run out or not?22:52
ayoungErming_, your machine is too small22:52
ayoungjust kidding22:52
ayoungwow22:52
ayoungErming_, warning you now, I am a total Neophyte here22:52
Erming_ayoung: Normally masters always say like this.22:53
ayoungErming_, how did you set up the undercloud?  Using http://docs.openstack.org/developer/tripleo-docs/environments/environments.html22:53
ayoungErming_, I'm, a Keystone developer22:53
ayoungI just am working on tripleo to get Federation support in.  I'm not giving you false modesty22:54
Erming_I use trown's undercloud qcow2 for the convenience22:54
ayoungErming_, it just so happens that I am debugging something comparable for my own work....22:54
Erming_https://www.rdoproject.org/rdo-manager/22:54
ayoungErming_, it took me a while to get something to run successfully.  So, do you have the two VMs that are supposed to be the Controller and compute node created?22:55
ayoungI'd really recommend starting with http://docs.openstack.org/developer/tripleo-docs/environments/environments.html  if you have not22:56
Erming_I have already 5 VMs created, 3 controller nodes, 1 compute, 1 ceph   they are running. but just nova reported ' no valid host'22:56
Erming_I have tried all kinds of versions. trust me. the one you showed was the earliest one.22:56
ayoungErming_, ok, so look in the scheduler log and see what filters failed22:58
*** sshnaidm has quit IRC22:58
*** leanderthal|afk has quit IRC22:58
*** psanchez has quit IRC22:58
*** leifmadsen has quit IRC22:58
*** pradk has quit IRC22:58
*** mandre has quit IRC22:58
*** yuanying has quit IRC22:58
*** eil397 has quit IRC22:58
*** yamahata has quit IRC22:58
*** pcaruana has quit IRC22:58
*** trown|outtypewww has quit IRC22:58
*** dhellmann has quit IRC22:58
*** mburned has quit IRC22:58
*** SlickNik has quit IRC22:58
*** marios has quit IRC22:58
*** shinobu__ has quit IRC22:58
*** rhallisey has quit IRC22:58
*** athomas has quit IRC22:58
*** shivrao has quit IRC22:58
*** ayoung has quit IRC22:58
*** rwsu has quit IRC22:58
*** rbrady-run has quit IRC22:58
*** weshay has quit IRC22:58
*** dmacpher-afk has quit IRC22:58
*** r-mibu has quit IRC22:58
*** marcusvrn_ has quit IRC22:58
*** saneax_AFK has quit IRC22:58
*** greghaynes has quit IRC22:58
*** Guest51435 has quit IRC22:58
*** hewbrocca has quit IRC22:58
*** davidlenwell has quit IRC22:58
*** lifeless has quit IRC22:58
*** igorbelikov has quit IRC22:58
*** nijaba has quit IRC22:58
*** jidar has quit IRC22:58
*** tzumainn has quit IRC22:58
*** rasca has quit IRC22:58
*** chlong_ has quit IRC22:58
*** larstobi has quit IRC22:58
*** Ng has quit IRC22:58
*** patrickeast has quit IRC22:58
*** zigo has quit IRC22:58
*** Erming_ has quit IRC22:58
*** Hunner has quit IRC22:58
*** dobson has quit IRC22:58
*** cinerama has quit IRC22:58
*** ianw has quit IRC22:58
*** Tristitia has quit IRC22:58
*** jroll has quit IRC22:58
*** zaneb has quit IRC22:58
*** dsneddon has quit IRC22:58
*** SpamapS has quit IRC22:58
*** jdob has quit IRC22:58
*** dmsimard has quit IRC22:58
*** rickflare has quit IRC22:58
*** bandini has quit IRC22:58
*** wendar has quit IRC22:58
*** eggmaste` has quit IRC22:58
*** rhefner has quit IRC22:58
*** CaptTofu___ has quit IRC22:58
*** EmilienM has quit IRC22:58
*** adam_g has quit IRC22:58
*** andreaf has quit IRC22:58
*** gus has quit IRC22:58
*** Slower has quit IRC22:58
*** jayg|g0n3 has quit IRC22:58
*** NobodyCam has quit IRC22:58
*** kbyrne has quit IRC22:58
*** ramishra has quit IRC22:58
*** al has quit IRC22:58
*** penick has quit IRC22:58
*** panda has quit IRC22:58
*** d0ugal has quit IRC22:58
*** jcooley has quit IRC22:58
*** apetrich has quit IRC22:58
*** hoobaman has quit IRC22:58
*** slagle has quit IRC22:58
*** mordred has quit IRC22:58
*** HenryG has quit IRC22:58
*** rlandy has quit IRC22:58
*** Oku_OS has quit IRC22:58
*** Nakato has quit IRC22:58
*** isq_ has quit IRC22:58
*** cwolferh has quit IRC22:58
*** onovy has quit IRC22:58
*** pblaho has quit IRC22:58
*** lucas-dinner has quit IRC22:58
*** bswartz has quit IRC22:58
*** afazekas has quit IRC22:58
*** pleia2 has quit IRC22:58
*** michchap has quit IRC22:58
*** stevebaker has quit IRC22:58
*** george_goh has quit IRC22:58
*** hjensas has quit IRC22:58
*** jpeeler has quit IRC22:58
*** lynxman has quit IRC22:58
*** crinkle has quit IRC22:58
*** bhunter has quit IRC22:58
*** StevenK has quit IRC22:58
*** dtantsur|afk has quit IRC22:58
*** ChanServ has quit IRC22:58
*** StevenK has joined #tripleo23:01
*** bhunter has joined #tripleo23:01
*** crinkle has joined #tripleo23:01
*** lynxman has joined #tripleo23:01
*** jpeeler has joined #tripleo23:01
*** hjensas has joined #tripleo23:01
*** marios has joined #tripleo23:01
*** SlickNik has joined #tripleo23:01
*** mburned has joined #tripleo23:01
*** dhellmann has joined #tripleo23:01
*** trown|outtypewww has joined #tripleo23:01
*** pcaruana has joined #tripleo23:01
*** yamahata has joined #tripleo23:01
*** eil397 has joined #tripleo23:01
*** leanderthal|afk has joined #tripleo23:01
*** sshnaidm has joined #tripleo23:01
*** jidar has joined #tripleo23:01
*** nijaba has joined #tripleo23:01
*** igorbelikov has joined #tripleo23:01
*** lifeless has joined #tripleo23:01
*** davidlenwell has joined #tripleo23:01
*** hewbrocca has joined #tripleo23:01
*** Guest51435 has joined #tripleo23:01
*** greghaynes has joined #tripleo23:01
*** saneax_AFK has joined #tripleo23:01
*** marcusvrn_ has joined #tripleo23:01
*** r-mibu has joined #tripleo23:01
*** dmacpher-afk has joined #tripleo23:01
*** weshay has joined #tripleo23:01
*** rbrady-run has joined #tripleo23:01
*** rwsu has joined #tripleo23:01
*** ayoung has joined #tripleo23:01
*** shivrao has joined #tripleo23:01
*** athomas has joined #tripleo23:01
*** rhallisey has joined #tripleo23:01
*** al has joined #tripleo23:01
*** ramishra has joined #tripleo23:01
*** kbyrne has joined #tripleo23:01
*** NobodyCam has joined #tripleo23:01
*** jayg|g0n3 has joined #tripleo23:01
*** Slower has joined #tripleo23:01
*** gus has joined #tripleo23:01
*** andreaf has joined #tripleo23:01
*** adam_g has joined #tripleo23:01
*** EmilienM has joined #tripleo23:01
*** CaptTofu___ has joined #tripleo23:01
*** rhefner has joined #tripleo23:01
*** asimov.freenode.net sets mode: +v davidlenwell23:01
*** eggmaste` has joined #tripleo23:01
*** wendar has joined #tripleo23:01
*** Erming_ has joined #tripleo23:01
*** tzumainn has joined #tripleo23:01
*** rasca has joined #tripleo23:01
*** chlong_ has joined #tripleo23:01
*** larstobi has joined #tripleo23:01
*** Ng has joined #tripleo23:01
*** patrickeast has joined #tripleo23:01
*** zigo has joined #tripleo23:01
*** Hunner has joined #tripleo23:01
*** dobson has joined #tripleo23:01
*** cinerama has joined #tripleo23:01
*** ianw has joined #tripleo23:01
*** Tristitia has joined #tripleo23:01
*** jroll has joined #tripleo23:01
*** zaneb has joined #tripleo23:01
*** dsneddon has joined #tripleo23:01
*** asimov.freenode.net sets mode: +v Ng23:01
*** psanchez has joined #tripleo23:01
*** leifmadsen has joined #tripleo23:02
*** pradk has joined #tripleo23:02
*** mandre has joined #tripleo23:02
*** yuanying has joined #tripleo23:02
*** rickflare2 has joined #tripleo23:02
*** dtantsur|afk has joined #tripleo23:02
*** rlandy has joined #tripleo23:03
*** Oku_OS has joined #tripleo23:03
*** george_goh has joined #tripleo23:03
*** Nakato has joined #tripleo23:03
*** isq_ has joined #tripleo23:03
*** cwolferh has joined #tripleo23:03
*** onovy has joined #tripleo23:03
*** pblaho has joined #tripleo23:03
*** lucas-dinner has joined #tripleo23:03
*** bswartz has joined #tripleo23:03
*** afazekas has joined #tripleo23:03
*** pleia2 has joined #tripleo23:03
*** michchap has joined #tripleo23:03
*** stevebaker has joined #tripleo23:03
*** d0ugal has joined #tripleo23:03
*** jcooley has joined #tripleo23:03
*** apetrich has joined #tripleo23:03
*** hoobaman has joined #tripleo23:03
*** slagle has joined #tripleo23:03
*** mordred has joined #tripleo23:03
*** HenryG has joined #tripleo23:03
*** shinobu__ has joined #tripleo23:03
*** penick has joined #tripleo23:03
*** panda has joined #tripleo23:03
*** bandini_ has joined #tripleo23:03
*** Ng has quit IRC23:04
*** ChanServ has joined #tripleo23:06
*** asimov.freenode.net sets mode: +o ChanServ23:06
*** SpamapS has joined #tripleo23:06
*** jdob has joined #tripleo23:06
*** dmsimard has joined #tripleo23:06
*** rickflare has joined #tripleo23:06
*** bandini has joined #tripleo23:06
*** sshnaidm has quit IRC23:06
*** leanderthal|afk has quit IRC23:06
*** rickflare has quit IRC23:07
*** rickflare2 is now known as rickflare23:07
*** bandini has quit IRC23:07
*** SpamapS has quit IRC23:07
*** dmsimard has quit IRC23:07
*** dmsimard1 has joined #tripleo23:07
*** dmsimard1 is now known as dmsimard23:07
*** SpamapS has joined #tripleo23:09
*** Marga_ has joined #tripleo23:09
*** sshnaidm has joined #tripleo23:11
*** leanderthal|afk has joined #tripleo23:11
*** trozet has joined #tripleo23:12
jidaroh god why is a file converted into json and executed from there23:12
* jidar cries23:12
ayoungjidar, easier to Cargo cult23:13
*** sshnaidm has quit IRC23:13
*** leanderthal|afk has quit IRC23:13
jidarI don't know what that means23:13
jidarbut my deployments are failing because of a previous failed puppet run, and come to find out it's executing a .json file as if it were a .pp file when the referenced pp file doesn't even exist and I'm not calling out the pp file to run at all23:14
jidarits madness23:14
*** sshnaidm has joined #tripleo23:15
*** leanderthal|afk has joined #tripleo23:15
*** Marga_ has quit IRC23:15
*** Marga_ has joined #tripleo23:16
*** saneax_AFK is now known as saneax23:17
*** bandini_ has quit IRC23:18
*** bandini_ has joined #tripleo23:18
Erming_Now I believe that the error is because: undercloud is going to create an instance to use a node that has already an instance. LOOKs something wrong in my openstack overcloud deployment command.23:18
Erming_In trown's original instackenv.json, there are 5 nodes specified.23:18
Erming_I didn't change it, and I issued this command:23:19
Erming_openstack overcloud deploy --templates --control-scale 3 -e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml --ntp-server pool.ntp.org  --ceph-storage-scale 1 --templates -e /usr/share/openstack-tripleo-heat-templates/environments/storage-environment.yaml  --libvirt-type qemu23:19
Erming_the 5 nodes in the instackenv.json did have 3 controls, and 1 compute, and 1 ceph, why it went wrong?23:20
openstackgerritPradeep Kilambi proposed openstack/python-tripleoclient: Aodh integration  https://review.openstack.org/28385723:22
*** egafford has quit IRC23:25
ayoungErming_, so, I just found my problem was that I made the disk too small23:27
Erming_?23:27
ayoungand now ComputeCapabilitiesFilter returned 0 host23:28
ayoungErming_, its all magic to me.23:28
Erming_ayoung: could be also my issue?23:29
ayoungErming_, I run this to debug23:29
ayoungsudo grep returned /var/log/nova/nova-scheduler.log23:29
ayoungand that shows how many hosts each filter returns23:29
ayoungdepending on that I have been learning where to look next23:29
ayoungthis last one is new to me23:29
Erming_ayoung: could it be tight root space on host?23:29
ayoungErming_, Oh yes,23:30
ayoungall of the VMs go in /var23:30
ayoungis that mounted on / and that is a small partition?23:30
ayoungI had that issue...23:30
ayoungErming_, http://adam.younglogic.com/2016/01/resize-disks-centos-7/23:30
Erming_only 92G.23:30
ayoungthat would do it.  40 GB per node23:31
ayoungand one node deployed23:31
ayoungErming_, did your install put everything into /home?23:32
Erming_ayoung: yes. could really be this fault.  I am not sure if it's /home23:32
ayoungdf -h23:32
Erming_just  the default23:32
Erming_http://fpaste.org/328134/14562703/23:32
Erming_ayoung: looks that I need attach /cloud to /, or resize if it's doable23:33
ayoungresize is doable. Read my blog23:33
ayoung/dev/mapper/centos_cirrus-cloud  356G   52G  305G  15% /cloud23:34
ayoungErming_, what is in /cloud?23:34
Erming_ayoung: hope so. I will try. but how can you judge it's /home or /var or else?23:34
ayoungErming_, df -h shows you/  In your case, you have /cloud somehow23:35
ayoungthat is nonstandard23:35
ayoungdid you do that during the install, thinkging you would put the vms in there?23:35
Erming_yes23:35
Erming_exactly23:35
ayoungok,  get rid of that, and expand /dev/mapper/centos_cirrus-root23:35
ayoungyou can resize using the steps I laid out23:36
Erming_I linked ls /var/lib/libvirt/images/ to it. Just for storing images now.23:36
ayounglvremove /dev/mapper/centos_cirrus-cloud23:36
Erming_do I need move data  out at first?23:37
Erming_just to confirm23:37
ayoung 92G   9%23:37
ayoungso you look ok23:37
ayoungUm... you probably would lose your undercloud if you do this23:37
Erming_No I mean all the images I put in /cloud23:37
ayounglets not jump to conclusions....23:37
*** panda has quit IRC23:37
ayoungyeah, you will lose all data if you ran lvremove /dev/mapper/centos_cirrus-cloud23:38
Erming_no, I linked all of them to /var/lib/libvirt/images/ so now can just move the images there.23:38
ayounglinked?23:38
Erming_ln -s23:38
Erming_ln -s /var/lib/libvirt/images/ /cloud/vms23:38
*** panda has joined #tripleo23:38
Erming_so easy for me isn't it23:38
ayoungif you have enough space on / then yeah, you should be able to move them to /var/lib/libvirt/images/23:39
ayoungYou probably want to bring down the vms first23:39
Erming_yes. exactly. I will do. Thank you so much finding out this for me!23:39
Erming_ayoung: sometimes before, I did lvremove and lvresize, it caused failure of the whole filesystem.23:40
Erming_ayoung: so I am a bit scared indeed.23:40
Erming_was on CentOS 6.23:41
ayoungErming_, this is precision guesswork23:41
Erming_Did you have the same issue?23:41
ayoungI am not saying any of this will actually solve your problem, just that I had a similar issue, but smaller disks23:41
Erming_no I meant lvremove/resize issue23:42
*** Ng has joined #tripleo23:42
*** ChanServ sets mode: +v Ng23:42
ayoungErming_, if you hose the system...this is just a new deployment, right?  You are just trying to get it right for now?23:42
Erming_ayoung: yes. whatever, I will try. thanks!23:42
Erming_ayoung: looks it might not the disk issue as the newly created 5 images/vms all on /cloud23:47
Erming_ayoung: see the bottom 5 files:  v23:49
Erming_http://fpaste.org/328142/71357145/23:49
ayoung4.7G23:49
ayoungthat might be a minimal size and they can't expand?  I don't know...I'm getting23:50
ayoungmy own set of failures...23:50
ayoungand now I have to go be a dad for a while23:50
Erming_ayoung: sorry I am wrong. those are the images to produce the VMs, different. VMs could be using / space. so still disk issue.23:55
Erming_ayoung: thanks. me too. picking up baby from daycare. Thanks!23:56
openstackgerritPradeep Kilambi proposed openstack/python-tripleoclient: Aodh integration  https://review.openstack.org/28385723:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!