Tuesday, 2014-06-24

SpamapSright, you would say "this_is_a_network_node: true" not "sysctl.net.ipv4.ip_forward: 1"00:00
greghaynesso, I think you would still need to support a runtime sysctl-set-value, right?00:03
* greghaynes is not wondering if https://review.openstack.org/#/c/101784/1 needs to be smart-ish and detect if its build or runtime00:03
*** ddieterly has joined #tripleo00:11
*** ddieterly has quit IRC00:12
*** ddieterly has joined #tripleo00:12
*** yamahata has quit IRC00:13
*** Penick has quit IRC00:14
*** jerryz has joined #tripleo00:15
*** ddieterly has quit IRC00:17
jerryzlifeless: is there an updated tutorial to play tripleo, deploying seed, under, overcloud?00:17
kevinbentonlifeless: is there a way to turn debug logs back on for neutron so i can see what’s going on in this patch? https://review.openstack.org/#/c/101447/00:17
greghayneskevinbenton: check out the ExtraConfig parameter in overcloud.yaml00:20
greghaynesneutron.conf supports adding options via that00:20
*** rlandy has quit IRC00:21
*** matsuhashi has joined #tripleo00:21
*** nati_ueno has joined #tripleo00:23
kevinbentonso what’s the process of doing that for a specific neutron patch?00:24
kevinbentongreghaynes: ^^00:25
*** eghobo has quit IRC00:26
tchaypojerryz: are you asking about a video? I'm not aware of such a thing00:31
tchaypobut http://docs.openstack.org/developer/tripleo-incubator/devtest.html (generated from devtest.sh) essentially does that in text00:31
jerryztchaypo: not necessarily a video. doc.o.o or something00:31
jerryztchaypo: thanks. so the devtest scripts is the literally the procedures.00:34
tchaypoit's *a* procedure00:34
tchaypoI'd expect that if you're doing your own deployment you'll probably find parts of the procedure that don't quite do what you need00:34
tchaypobut our scripts aim to be "small pieces, loosely joined" so it should be easy for you to tweak pieces to get a procedure that suits you00:35
jerryztchaypo: got you00:35
tchaypobut running through the devtest scripts first should, in theory, give you an introduction to the bits and how they fit together, and give you a starting point for your own deployment00:35
jerryztchaypo: what automation or CM tool do you use to deploy your CD overcloud?00:36
jerryztchaypo: devtest looks devstack kind of thing to me.00:37
tchaypogood question, I should know the answer to that00:38
tchaypofor CI we use jenkins and zuul, and they drive a slightly modified process - our CI infra has a few things that don'00:39
lifelessjerryz: we do use devtest, because it deploys production ready - we keep moving stuff out of it and into stable repos as time goes by00:39
tchaypot change much preconfigured00:39
lifelessSpamapS: greghaynes FWIW e20084f21aa80e47ce219b5cc050ec2a57ab3fea00:39
tchaypoThe slight-modified devtest.sh we use for CI is at http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_devtest.sh - but that's CI, not CD00:40
lifelessgreghaynes: kevinbenton is looking into the thing that broke overcloud gre networking00:40
* jerryz reading00:41
lifelessjerryz: tchaypo: meeet each other - jerryz is bringing up the huawei region00:41
kevinbentonlifeless: dprince mentioned in the patch that the heat auth errors were normal00:41
tchaypojerryz: oh hey, you're my new favorite person!00:41
lifelessSpamapS: 101305 is ready for +A00:42
kevinbentonlifeless: so i need to figure out how it’s still breaking but for some reason all of the logging is gone now00:42
lifelesskevinbenton: righto so thats because we run defaults :)00:42
jerryztchaypo: nice to talk to you. going to have questions bugging you.00:43
lifelesskevinbenton: the review that we were using for this had a patch set to make everything default to debug, we don't have a generic knob for CI to say 'this run should be debug', but it sounds like a super useful thing to have00:43
*** e0ne has joined #tripleo00:45
openstackgerritA change was merged to openstack/tripleo-image-elements: Enable ip nonlocal binds  https://review.openstack.org/10130500:45
jerryzlifeless: sounds a potential zuul parameter to me.00:46
clarkbwe run all tests as debug00:47
clarkbdo you guys not do that?00:47
greghaynesclarkb: we dont00:47
*** e0ne has quit IRC00:48
lifelessclarkb: part of running defaults00:48
tchaypoDear cores - after yesterday's adventure, https://review.openstack.org/#/c/92749/ is back to having one +2 and a couple of +1s; the only change from the last time it had 3 +2s is that I've merged it with some changes gfidente made. Your attention would be appreciated00:48
jerryzclarkb: a knob would be great or just debug open for rechecks. that would also reduce log volumes00:48
lifelessclarkb: it means we get to show devs what their logging /actually is like/00:48
clarkblifeless: we do that by only indexing > debug00:49
clarkbso if you want to take advantage of tooling you need sufficient logging00:49
lifelesstchaypo: one +2.00:49
lifelessclarkb: we'd need to run non-default to do that.00:50
lifelessclarkb: which violates a fairly important principle.00:50
lifelessclarkb: we'd welcome a change to the defaults :)00:50
clarkbwell defaults shouldn't be debug00:51
clarkbbut imo you should always test with debug00:51
jerryzclarkb, lifeless: missed e-r part that rely on debug mode, never mind00:51
clarkbbecause well testing00:51
lifelessclarkb: depends what you're testing00:51
lifelessclarkb: if you can't analyse the fault remotely with the logs we get, the logs are insufficient, because thats production too00:51
clarkbI agree00:51
clarkbbut you have to have a realistic approach to the problem00:52
lifelessclarkb: we do :)00:52
tchaypolifeless: yes, that's all it has now. It had three but then I had to rebase..00:54
greghayneskevinbenton: https://review.openstack.org/#/c/100374/ is the "debug all the things" patch00:54
greghaynesthat is one way to do it00:55
SpamapSIMO there's just no good guidelines for what should be DEBUG and would should be INFO00:55
SpamapSso people throw everything in DEBUG00:55
lifelesstchaypo: ah yeup. anyhow -100:55
lifelessSpamapS: there is a doc now on the wiki.00:55
SpamapSoh good00:56
lifelessSpamapS: the big issue IMO is that most devs are not ops.00:56
lifelessanyhow, I have to write this up. excuse me.00:56
greghaynesReasons its good for us to do !debug00:56
greghayneskevinbenton: the passthrough config is another way, if youre wanting something more permanent I would look into doing passthrough config, but for debugging editing the config like in the debug all the things patch might be easiest00:57
*** dkehn has joined #tripleo00:57
lifelessgreghaynes: wht kevinbenton needs is his Neutron patch run in debug mode.00:58
*** yamahata has joined #tripleo00:58
greghayneskevinbenton: diskimage-builder/elements/source-repositories/README.md has some info on how to do a build with a specific ref, basically DIB_REPOREF_neutron=refs/..., and then you can edit the neutron.conf in triple-image-elements similar to review 100374 to enable debugging01:01
greghaynesif I understand what youre trying to do this time :p01:01
lifelessgreghaynes: in CI:)01:02
* greghaynes finds example01:02
lifelessgreghaynes: since I very much doubt kevinbenton has the activation energy to get setup on TripleO dev right now.01:02
greghayneshaha, that fair01:02
*** chuckC has quit IRC01:02
lifelessgreghaynes: I suspect a toci patch to fiddle things is probably the most viable route01:03
lifelessgreghaynes: e.g. to bring in the neutron patch01:03
*** eghobo has joined #tripleo01:05
*** eghobo has quit IRC01:05
*** eghobo has joined #tripleo01:05
*** morganfainberg has quit IRC01:07
*** morganfainberg_Z is now known as morganfainberg01:07
*** ddieterly has joined #tripleo01:08
*** bthurber has quit IRC01:11
openstackgerritGregory Haynes proposed a change to openstack-infra/tripleo-ci: Testing using a specific patch from neutron in CI  https://review.openstack.org/10207301:13
tchaypoCould we achieve that witht he usual reverts mechanism01:20
greghaynessee that patch ^01:20
greghaynesI *think* that might work ;)01:20
tchaypoI was thinking of the temprevert section above. But you're right, we're not trying to revert anything here, we're trying to pin a particular change.01:22
openstackgerritGiulio Fidente proposed a change to openstack/tripleo-incubator: Move user's group membership setup in separate script  https://review.openstack.org/9395401:23
tchaypoI was going to say that I'd like to see a comment on the line above, as we do in the temprevert section, explaining why this line is here01:27
tchaypobut then the demon on my other shoulder told me "nonsense, that's what git blame is for"01:27
tchayposo now I'm not sure which to listen to01:27
greghaynesthat shouldnt ever be merged01:27
tchaypothat'd be why it's W:-101:28
tchaypohttps://wiki.openstack.org/w/index.php?title=TripleO&diff=0&oldid=56304 has made me aware that in our page we link to github repos rather than git.openstack01:29
tchaypoThat seems... contrary to my expectations..01:29
SpamapSlifeless: https://etherpad.openstack.org/p/tripleo-heat-chunking-plan01:31
* tchaypo kicks off a run to test https://review.openstack.org/#/c/101438/301:31
greghaynesoh great, CI fail due to cloud sha being invalid01:32
StevenKgreghaynes: Haha. We should totally find the youtube clip of Fry doing that01:32
*** cwolferh has quit IRC01:34
*** cwolferh has joined #tripleo01:34
StevenKThere we go.01:34
StevenKtchaypo: www.youtube.com/watch?v=xhy7dXWjpAA01:35
StevenKArgh. Mirror sync: universe/p/percona-xtradb-cluster-5.5 last seen01:35
gfidenteStevenK, at 3.36 localtime, that was hard01:36
gfidentehit me so badly I wanted to go to sleep crying for not having fixed much01:37
* gfidente salute everyone01:38
*** gfidente has quit IRC01:38
*** chuckC has joined #tripleo01:43
*** nosnos has joined #tripleo01:44
*** e0ne has joined #tripleo01:45
lifelessSpamapS: some quick thoughts there.01:45
SpamapSlifeless: yes they were some quick thoughts01:46
lifelessSpamapS: mine, I meant :)01:46
*** eguz has joined #tripleo01:46
*** e0ne has quit IRC01:46
SpamapSlifeless: the idea of not changing merge.py has crossed my mind.01:47
*** e0ne has joined #tripleo01:47
SpamapSlifeless: and agree the the all hosts I/O may be generally useful.01:48
*** eghobo has quit IRC01:50
*** eguz has quit IRC01:51
*** e0ne has quit IRC01:52
SpamapSlifeless: ty.. I will work backwards anyway and so I might find that I can just manually write the binding document and call make overcloud.yaml as you suggest.01:52
*** nati_ueno has quit IRC01:53
lifelessgreghaynes: next HA review plox01:57
StevenKlifeless: I'm waiting to see if you open the sprint with "Welcome, thanks for coming. HA ALL THE THINGS!"01:58
lifelesss/.*/\1 NOW/01:58
StevenKlifeless: I was pondering ALL THE THINGS RIGHT NOW, but didn't want to make you seem needy :-P01:59
openstackgerritlifeless proposed a change to openstack/tripleo-specs: TripleO and backwards compatibility  https://review.openstack.org/10208101:59
*** jp_at_hp has quit IRC01:59
lifelessnow, I need someone to express strong support for ^ right now, to set the tone up right02:00
lifelessalso I need food02:00
lifelessso, -> that.02:00
lifelessSpamapS: ^02:00
greghayneslooks like the two I wanted failed CI :/02:00
lifelessthe nova thing?02:02
greghaynesThat too, but https://review.openstack.org/#/c/83883/ and the patch it depends on02:02
greghayneson, no, not the nova thing02:04
greghaynesone is dns fail and the other might be legit02:05
openstackgerritClint 'SpamapS' Byrum proposed a change to openstack/tripleo-heat-templates: Add outputs and inputs for all hosts  https://review.openstack.org/10208202:09
SpamapSlifeless: hrm. ControlVirtualIP complicates things. :-P02:13
SpamapSactually hm.. maybe I don't need to do an overcloud.yaml CONTROLSCALE=0 .. I should be able to just use nova-compute-instance.yaml02:14
*** ddieterly has quit IRC02:15
tchaypolifeless: so just to check that I'm on the right track - I'm currently trying to verify that the change in https://review.openstack.org/#/c/101438/3 does what I expect (create a new VIP on the overcloud control nodes), then I'm going to do another change to make haproxy listen on that vip as well02:16
tchaypolifeless: is that roughly what you were thinking?02:17
openstackgerritClint 'SpamapS' Byrum proposed a change to openstack/tripleo-heat-templates: Add ControlVirtualIP as an overcloud output  https://review.openstack.org/10208502:18
*** morazi has quit IRC02:23
*** mestery has quit IRC02:31
*** mestery has joined #tripleo02:31
tchaypoSpamapS: this seems relevant to my interests02:33
*** pcrews has quit IRC02:34
tchaypoSpamapS: in 101438 I'm adding a new VIP to be used for things that want to be accessible from outside the cluster. I'm guessing I should add it as an output too?02:34
tchaypoIf I understand heat correctly, an "output" can be used as "input" elsewhere in the template, right?02:34
tchaypoSo I'd be adding it as an output so that eg the bit of the heat template that sets up haproxy could consume it, is what I'm thinking02:36
*** killer_prince is now known as lazy_prince02:42
*** lazy_prince is now known as killer_prince02:42
lifelesstchaypo: sounds like it02:42
lifelesstchaypo: I don't think clints work is relevant to your work02:43
* tchaypo does some reading about heat02:43
lifelesstchaypo: outputs are for inspecting output of the template-as-progra02:43
tchaypohow do you do that inspection?02:43
*** killer_prince is now known as lazy_prince02:43
tchaypolooking at https://review.openstack.org/#/c/10084802:45
*** lazy_prince is now known as killer_prince02:45
*** e0ne has joined #tripleo02:45
tchaypoif I'm understanding correctly - the fn:getatt says to look in "NovaCompute0" for the attribute "networks"; then the fn::select picks out just the attribute of networks called ctlplane; then the fn::select picks out just the 0th element of ctlplane02:45
tchaypois that roughtly right?02:46
*** e0ne has quit IRC02:49
*** ddieterly has joined #tripleo02:49
*** mestery_ has joined #tripleo02:52
*** nosnos has quit IRC02:54
*** ddieterly has quit IRC02:54
*** nosnos has joined #tripleo02:54
*** mestery has quit IRC02:55
*** nosnos has quit IRC02:59
*** untriaged-bot has joined #tripleo03:00
untriaged-botUntriaged bugs so far:03:00
uvirtbotLaunchpad bug 1332458 in diskimage-builder "Not able to build armhf or arm64 images on amd64 arch systems." [Undecided,New]03:00
uvirtbotLaunchpad bug 1332521 in diskimage-builder "failed to remove `/tmp/image.A2aupYJb/mnt/tmp/in_target.d': Device or resource busy" [Undecided,New]03:00
*** untriaged-bot has quit IRC03:00
lifelesstchaypo: that review doesn't have outputs03:00
tchaypo100848? I know, I'm haring off on a tangent looking at heat template changes to learn more about it03:01
tchaypoFn::Join seems pretty simple. OS::Heat::RandomString looks handy.03:02
*** vinsh has joined #tripleo03:02
*** e0ne has joined #tripleo03:02
tchaypoWhen you use ref: to do a lookup... I'm going to have to figure out the scoping rules later.03:03
*** nosnos has joined #tripleo03:05
tchaypookay steamophiles, the next "community choice" group has only one correct answer - it's the group with kerbal space program at -40% and simcity4 for $503:07
*** e0ne has quit IRC03:07
*** akuznetsov has joined #tripleo03:11
*** ddieterly has joined #tripleo03:11
SpamapStchaypo: in the REST API to get the outputs you fetch the stack03:13
fabbionelifeless: ping03:15
SpamapStchaypo: ugh.. that is a choice that leads to me never leaving the house for 3 weeks.03:15
*** ddieterly has quit IRC03:16
tchaypoSpamapS: sounds good, right?03:16
tchaypoWhen I'm using the command-line client and I "heat stack-show undercloud" and there's one part of the output that has a list of key:value pairs - those are the outputs?03:17
SpamapStchaypo: I can't even begin to tell you how poisonous that would be to my life. ;)03:17
tchaypoI can't build anything today03:17
tchaypo+ heat stack-create -e /home/polleyj/.cache/tripleo/undercloud-env.json -t 360 -f /home/polleyj/.cache/tripleo/tripleo-heat-templates/undercloud-vm-ironic.yaml undercloud03:17
tchaypoERROR: The Parameter (PowerManager) was not defined in template.03:17
* SpamapS is a recovering gamaholic03:17
tchaypoplease tell me I'm not the only one seeing that..03:18
SpamapSyou're not the only one seeing that03:18
* SpamapS lies03:18
*** matsuhashi has quit IRC03:18
*** matsuhashi has joined #tripleo03:19
mordredSpamapS: you were addicted to gama ?03:21
*** matsuhashi has quit IRC03:24
*** ramishra has joined #tripleo03:27
lifelessfabbione: pong03:29
lifelesstchaypo: you've got a non-ironic parameter in your heat env03:30
lifelesstchaypo: and heat no like that03:30
tchaypoand importantly03:31
tchaypo~/.devtestrc has USE_IRONIC=103:31
* greghaynes is sad https://review.openstack.org/#/c/93104/ got abandoned03:31
greghaynesgiven that its needed for HA and the one it was abandoned for looks not close to mergable03:31
* tchaypo turns that off and tries again03:32
*** nosnos has quit IRC03:34
*** nosnos has joined #tripleo03:35
*** ramishra_ has joined #tripleo03:37
*** eghobo has joined #tripleo03:38
*** ramishra has quit IRC03:38
*** nosnos has quit IRC03:39
*** e0ne has joined #tripleo03:45
greghaynestchaypo: likely caused by changing that parameter without rm'ing your -env.json03:47
greghaynesI have been meaning to write up a bug report for that03:47
*** jml has quit IRC03:47
*** CaptTofu_ has quit IRC03:48
lifelessok, offlineish03:48
*** e0ne has quit IRC03:48
*** michchap has quit IRC03:52
*** michchap has joined #tripleo03:52
*** jml has joined #tripleo03:55
*** GheRivero has quit IRC04:04
*** davidlenwell_ has joined #tripleo04:04
*** GheRivero has joined #tripleo04:04
*** davidlenwell has quit IRC04:05
*** SlickNik has quit IRC04:05
*** SlickNik has joined #tripleo04:06
*** matsuhashi has joined #tripleo04:10
*** ddieterly has joined #tripleo04:11
*** ddieterly has quit IRC04:16
*** nosnos has joined #tripleo04:19
*** killer_prince is now known as lazy_prince04:24
*** e0ne has joined #tripleo04:25
kevinbentonlifeless, greghaynes: sorry, I had to leave in a rush earlier for a meeting04:29
kevinbentonlifeless, greghaynes: what was the consensus on the best way to have the CI test my neutron patch on tripleo with debug enabled?04:29
*** e0ne has quit IRC04:30
greghayneskevinbenton: once our CI is unwedged from a new trusty image I think https://review.openstack.org/#/c/102073/ will work04:37
kevinbentongreghaynes: cool. what does unwedged mean in this context?04:38
greghayneskevinbenton: a new trusty cloudimg got released, I think were caching one (but not both) of the image or sha256sums... so we keep failing tests with invalid sha04:40
*** lazy_prince has quit IRC04:41
*** morganfainberg_L has joined #tripleo04:41
kevinbentongreghaynes: oh okay. is this something that will clear up soon or should I check back tomorrow?04:41
lifelessI think I can clear it up, will take a minute04:42
kevinbentonlifeless: cool. thanks04:42
lifelessthere is a patchset which does cache-busting requests04:42
lifelessif I can find it... doesn't look like its merged04:46
lifelessso thats rechecking now04:46
lifelessin a few minutes re-run greghaynes's one. It will be behind the other and should DTRT :)04:47
StevenKkevinbenton: Do The Right Thing04:49
*** pcrews has joined #tripleo04:49
kevinbentonoooh, a new acronym :-)04:50
lifelessNg: ^ might want to finish that patch off :> in your copious spare time04:51
*** rakesh_hs4 has joined #tripleo04:57
*** nati_ueno has joined #tripleo04:58
*** eghobo has quit IRC05:00
*** eghobo has joined #tripleo05:01
*** CaptTofu_ has joined #tripleo05:01
*** bmahalakshmi has joined #tripleo05:02
*** cwolferh has quit IRC05:06
*** CaptTofu_ has quit IRC05:06
*** ajc_ has joined #tripleo05:07
kevinbentonlifeless: do you have a link to some logs from a recent job that passed? I want to compare some outputs05:07
*** lazy_prince has joined #tripleo05:09
*** ddieterly has joined #tripleo05:11
*** ddieterly has quit IRC05:16
openstackgerritTzu-Mainn Chen proposed a change to openstack/tuskar-ui: Separate Overcloud into plan and stack  https://review.openstack.org/10210605:16
*** lazy_prince is now known as killer_prince05:22
*** amitpp has joined #tripleo05:29
*** rwsu has quit IRC05:41
*** gcha has quit IRC05:49
*** morganfainberg_L has quit IRC05:51
*** rdopieralski has joined #tripleo06:02
*** robsparker has quit IRC06:04
*** ddieterly has joined #tripleo06:11
tchaypoThat moment when people insist you remove the "as of $DATE we support" from your patch, so you do, then people say "this should say "as of $DATE""06:12
tchaypoThat other moment when you realise you have nested ""s06:12
*** dshulyak_ has joined #tripleo06:15
*** killer_prince is now known as lazy_prince06:15
*** ddieterly has quit IRC06:16
*** ddieterly has joined #tripleo06:16
*** ddieterly has quit IRC06:21
tchaypooh wait06:22
tchaypoeasycount is produced by the AEC, not by a third party?06:22
tchaypofuck this "commercial in confidence" shit then. that's a fucking crock.06:22
openstackgerritJames Polley proposed a change to openstack/tripleo-incubator: Add details of which OS releases are tested in CI  https://review.openstack.org/9274906:25
StevenKtchaypo: AEC is a commision, so has no commercial interests, right?06:25
* tchaypo forgot to switch windows06:26
tchaypoStevenK: incorrect, they run elections for profit06:26
tchaypoaccording to latest post on linux-aus, total of like 1.5 million in profit each year, compared with 160 million to run a federal election06:26
StevenKAll elections, or the state/federal ones are not for profit?06:26
*** mrunge has joined #tripleo06:28
*** jang has joined #tripleo06:30
*** jml has quit IRC06:31
*** jml has joined #tripleo06:33
*** gcha has joined #tripleo06:38
*** gfidente has joined #tripleo06:44
*** ramishra_ has quit IRC06:44
*** ramishra has joined #tripleo06:46
StevenKWoo, progress.06:46
tchaypothe state and federal ones are not for profit06:46
StevenKMy setup-neutron in os-cloud-config can create nets.06:46
tchaypothey're required by law to run some of the union elections; not sure if they're for profit or not06:46
*** CaptTofu_ has joined #tripleo06:49
gfidenteguys, still there?06:50
gfidenteI left you a while back06:50
tchaypogfidente: welcome back06:51
tchaypogfidente: i hope you got some sleep06:51
gfidenteI did!06:51
tchaypogfidente: but your comment made me cry.06:51
gfidentehave to buy some cofee though06:51
tchaypoyou don't have coffee supplies at home?06:51
tchaypo... are you at home?06:51
gfidentethose are finished06:51
tchaypospeaking of supplies at home, i need to contact my dealer06:51
gfidentetchaypo, you mean the comment on which distro version we support?06:52
tchaypoyeah, the comment suggestiong we should have "as of $DATE ..."06:52
tchayponot your fault, it's how i wanted it, but consensus seems to be that it's better without06:52
gfidentewait let me check the reviews :)06:53
gfidenteI wanted to ask though if you know anything about SHA failing for the ubuntu images?06:53
tchaypopatchset 8 is where it changed :)06:53
tchaypooh, i think greghaynes said something about that06:53
*** ifarkas has joined #tripleo06:53
*** CaptTofu_ has quit IRC06:54
gfidentetchaypo, oh I saw the comments on patch 806:56
gfidenteI think I can be happy if we use Currently too :)06:57
*** eguz has joined #tripleo06:59
tchaypogfidente: if you have a momeny, I'd appreciate a review on https://review.openstack.org/#/c/97657/507:01
tchaypobnemec and i both feel it's too early to be breaking backwards compatibility,07:02
*** eghobo has quit IRC07:03
tchaypobut we were involved in putting the code in its current state, maybe we're being too conservative07:04
*** eguz has quit IRC07:05
gfidentetchaypo, breaking backwards means you're not sourcing the file07:09
gfidentebut script is not overwriting the passwords anyway07:10
*** openstackgerrit has quit IRC07:10
tchayponot sourcing the file in $PWD; sure; but that only breaks people who were using devtest before my patch in march, and had password files created somewhere else, and are used to using them07:10
tchaypohis script doesn't overwrite the passwords; t:q07:11
gfidenteso the thing is that I think we should make the passwords customizable07:11
tchaypobnemec tweaked the scripts so that for any password already in the file it will be left untouched, but any new passwords added to the script will be appended to the file07:12
gfidenteyep which I think is great07:12
tchayposo calling it on an exisitng file will touch nothing, but when we have changes such as the recent one that added a ceilometer password, they get added to existing files07:12
*** pblaho has joined #tripleo07:13
gfidenteso I am of the idea that this is an actual feature, not only something good for compatibility07:13
gfidentebut I'd make it more explicit07:13
* tchaypo waits for your comment on review07:14
gfidenteI'd write the file in a location which the user can customize, but keep the change07:14
gfidenteok sorry07:14
gfidentecommenting there07:14
tchaypoand have $TRIPLEO_ROOT be the default location?07:14
tchaypoI can get behind that. It means that existing devs with existing files will have to, just once, move their files into $TRIPLEO_ROOT, or export something in their ~/.devtestrc07:15
*** nati_ueno has quit IRC07:15
gfidenteyes I understand that, but in its current state it is sort of 'hidden' while I think it is a good feature to have07:16
tchaypo+1 also07:18
tchaypoif I can type07:18
tchaypoin other news it's time for me to head pubwards07:18
*** jcoufal has joined #tripleo07:21
*** beekneemech has joined #tripleo07:32
*** bnemec has quit IRC07:32
*** pblaho is now known as pblaho|afk07:34
*** dshulyak_ has quit IRC07:36
*** jprovazn has joined #tripleo07:37
*** andreaf has joined #tripleo07:39
*** jtomasek has joined #tripleo07:45
*** pblaho|afk is now known as pblaho07:52
*** jp_at_hp has joined #tripleo08:05
*** amitpp has quit IRC08:12
*** fandi has joined #tripleo08:14
*** akrivoka has joined #tripleo08:19
*** dtantsur|afk is now known as dtantsur08:24
*** bogdando has quit IRC08:29
*** ramishra has quit IRC08:30
*** ramishra has joined #tripleo08:32
*** jcoufal has quit IRC08:33
*** jcoufal has joined #tripleo08:34
*** athomas has joined #tripleo08:34
*** CaptTofu_ has joined #tripleo08:38
*** ramishra has quit IRC08:38
*** CaptTofu_ has quit IRC08:42
*** martyntaylor has joined #tripleo08:42
*** martyntaylor has quit IRC08:46
*** martyntaylor has joined #tripleo08:50
*** pblaho is now known as pblaho|afk08:59
*** untriaged-bot has joined #tripleo09:00
untriaged-botUntriaged bugs so far:09:00
uvirtbotLaunchpad bug 1332458 in diskimage-builder "Not able to build armhf or arm64 images on amd64 arch systems." [Undecided,New]09:00
uvirtbotLaunchpad bug 1332521 in diskimage-builder "failed to remove `/tmp/image.A2aupYJb/mnt/tmp/in_target.d': Device or resource busy" [Undecided,New]09:00
*** untriaged-bot has quit IRC09:00
*** pblaho|afk is now known as pblaho09:08
*** e0ne has joined #tripleo09:10
*** akrivoka has quit IRC09:11
*** pelix has joined #tripleo09:16
*** ramishra has joined #tripleo09:23
* Ng hopes his neighbour's kids continue to practice their basic violin at this volume all day, it's extremely soothing to hear someone violate a shrill musical instrument when you've managed about 3 hours of sleep09:23
Nghang on, nope, that's not right at all ;)09:24
*** rdopieralski has quit IRC09:24
*** ramishra has quit IRC09:28
StevenKNg: Sarah is learning the violin, and it sounds rather lovely when she practises :-)09:31
NgStevenK: she's not 6 and physically incapable of playing a violin nicely :)09:31
NgI now feel bad for all the people I annoyed when I was learning violin as a little kid :)09:32
StevenKNg: When are you buying a quarter size violin for your eldest as payback? :-)09:33
NgStevenK: never, I will encourage my kids to learn things that can be trivially electronicsised and thus played with headphones ;)09:33
Ngpiano, drums, that sort of thing09:33
StevenKElectronic violins also exist09:33
Ngthey do indeed, but I'm not sure there are cheap ones09:34
Ngbut it's a lot of years since I was into violin09:34
StevenKMusical instrument and cheap and diametrically opposed concepts.09:35
StevenKs/cheap and/cheap are/09:35
*** akrivoka has joined #tripleo09:35
NgI'm not sure I agree, cheap keyboards aren't unplayable, and the cheap electronic drumkits are really surprisingly good these days09:35
Ngwhen I was taking drum lessons, they were thousands of pounds, but you can get an entirely acceptable kit for under £200 now09:36
StevenKOne of the friends of the family had a cheap electronic drumkit when I was growing up, and it was utterly terrible.09:37
NgI'm actually hoping I can get the kids into drumming, because I really miss playing and this house is the first time in a couple of decades that I've legitimately had space to own a kit :)09:38
StevenKIt's London, lies. :-P09:38
NgStevenK: well once the kids are a bit older, I can start taking over their play room with more suitable toys :D09:39
Nggames consoles, drumkits09:39
Ngprogrammable lego!09:39
Ngchemistry sets!09:40
*** bmahalakshmi has quit IRC09:41
StevenKOooh, what could possibly go wrong09:41
*** amitpp has joined #tripleo09:41
NgRike will hate it, but I will claim that all of the above are good for the kids ;)09:41
StevenKHow do you get Copper Sulfate stains out of the carpet? :-P09:42
*** bmahalakshmi has joined #tripleo09:43
NgStevenK: easy, we don't have carpet on that floor of the house ;)09:44
StevenKNg: Tiles, floorboards, *shiver* lino?09:44
NgStevenK: the funky interlocking boards09:44
Ngone continuous, smooth surface across four rooms and a hallway \o/09:45
gfidenteso I have my son (who is 3) playing a lot with a kalimba and the kaossilator09:45
StevenKGive it 5 to 7 years, and it probably won't be so smooth09:45
gfidenteI'm not sure the kaossilator was a good move09:46
NgStevenK: probably true :)09:46
Nggfidente: ♥ kalimbas09:46
StevenKdict can't spell anything with those two words09:46
gfidenteNg, indeed it is a very nice sounding thing and he enjoys the sound it makes09:47
gfidentethe kaossilator instead, drives us all crazy09:47
Nggfidente: I think I shall get one for my 3 year old :)09:47
*** openstackgerrit has joined #tripleo09:47
gfidenteyeah they make a really nice sound09:47
gfidenteand are kind of "easy" to use09:48
*** dtantsur is now known as dtantsur|lunch09:50
openstackgerritChris Jones proposed a change to openstack/diskimage-builder: Last ditch effort to correct a wrong shasum.  https://review.openstack.org/8808409:53
*** fandi has quit IRC09:54
*** rcarrillocruz has joined #tripleo10:00
*** rcarrill` has quit IRC10:03
*** hewbrocca has joined #tripleo10:05
*** athomas has quit IRC10:14
*** nosnos has quit IRC10:19
gfidenteguys, regarding the overcloud networking, I noticed instances get by default a float on the same ctlplane we use for undercloud/overcloud interconnection10:19
*** nosnos has joined #tripleo10:19
gfidenteI'm not sure if this is customizable though, is it possible to avoid that? anyone has a pointer to the relevant settings?10:20
*** athomas has joined #tripleo10:23
*** matsuhashi has quit IRC10:23
*** matsuhashi has joined #tripleo10:24
*** nosnos has quit IRC10:24
*** amitpp has quit IRC10:24
*** CaptTofu_ has joined #tripleo10:26
*** matsuhashi has quit IRC10:28
openstackgerritJan Provaznik proposed a change to openstack/tripleo-image-elements: Check if stunnel.connect_ip is set  https://review.openstack.org/10217710:29
*** CaptTofu_ has quit IRC10:31
*** e0ne has quit IRC10:33
*** markmc has joined #tripleo10:33
*** pblaho is now known as pblaho|afk10:41
openstackgerritLadislav Smola proposed a change to openstack/tripleo-image-elements: Allowing to optionally run sensors-detect  https://review.openstack.org/10218210:47
openstackgerritJan Provaznik proposed a change to openstack/tripleo-heat-templates: Add parameters for setting up keystone keys/certs in undercloud  https://review.openstack.org/10218310:56
openstackgerritJan Provaznik proposed a change to openstack/tripleo-incubator: Generate overcloud keystone keys/certs  https://review.openstack.org/9510110:57
openstackgerritA change was merged to openstack/tripleo-incubator: Require and set mode 0600 on heat env caches  https://review.openstack.org/10099411:00
*** e0ne has joined #tripleo11:01
*** jprovazn has quit IRC11:07
*** rdopieralski has joined #tripleo11:11
TheJuliagood morning11:15
*** xuhaiwei has quit IRC11:16
*** yamahata has quit IRC11:18
lazy_princeplease review https://review.openstack.org/#/c/79289/ (Adds local storage Boot support on PXE failures). It has under gone multiple review and is now ready for merge..11:21
*** bmahalakshmi has quit IRC11:26
openstackgerritTomas Sedovic proposed a change to openstack/tripleo-specs: Remove merge.py from TripleO Heat Templates  https://review.openstack.org/9793911:28
*** bmahalakshmi has joined #tripleo11:29
*** jprovazn has joined #tripleo11:31
*** pblaho|afk is now known as pblaho11:36
*** bmahalakshmi has quit IRC11:43
*** bmahalakshmi has joined #tripleo11:44
*** ddieterly has joined #tripleo11:50
*** e0ne_ has joined #tripleo11:53
openstackgerritEndre Karlson proposed a change to openstack/tripleo-image-elements: Hosts element: Use 'markers' for updating hosts  https://review.openstack.org/10219811:54
ekarlsolifeless: greghaynes and who else it concerned ^11:55
*** e0ne has quit IRC11:56
*** weshay has joined #tripleo11:57
*** ramishra has joined #tripleo11:59
*** CaptTofu_ has joined #tripleo11:59
*** morazi has joined #tripleo12:00
*** rakesh_hs4 has quit IRC12:01
*** jdob has joined #tripleo12:01
*** rlandy has joined #tripleo12:07
*** ddieterly has quit IRC12:16
*** dprince has joined #tripleo12:19
*** dtantsur|lunch is now known as dtantsur12:20
*** bmahalakshmi has quit IRC12:21
openstackgerritEndre Karlson proposed a change to openstack/tripleo-image-elements: Hosts element: Use 'markers' for updating hosts  https://review.openstack.org/10219812:31
*** edmund1 has joined #tripleo12:36
*** dshulyak_ has joined #tripleo12:39
pblahod0ugal: ping12:46
d0ugalpblaho: hey12:46
pblahod0ugal: hi12:47
pblahowill you be ok if I do +A on https://review.openstack.org/#/c/94523/ if gates pass?12:47
d0ugalpblaho: sure12:48
d0ugalpblaho: my suggestion was only minor, which is why I went with a +1 still :)12:48
pblahod0ugal: ok... I was just asking ...12:48
pblahod0ugal: yeah...12:48
* pblaho hopes gates will be ok12:49
*** ajc_ has quit IRC12:50
gfidentedid we fix the ubuntu SHA mismatch? am I safe to recheck?12:53
*** dshulyak_ has quit IRC12:56
*** julim has joined #tripleo12:59
*** ddieterly has joined #tripleo12:59
*** sseago has quit IRC12:59
*** sseago_ has joined #tripleo12:59
*** Matt1 has joined #tripleo13:00
*** lazy_prince has quit IRC13:13
*** andreaf has quit IRC13:13
*** sseago__ has joined #tripleo13:20
*** sseago_ has quit IRC13:20
*** pblaho_ has joined #tripleo13:30
*** pblaho has quit IRC13:30
*** casanch1 has joined #tripleo13:31
*** ramishra has quit IRC13:38
*** ramishra has joined #tripleo13:39
*** ramishra has quit IRC13:39
*** ramishra has joined #tripleo13:39
*** pblaho__ has joined #tripleo13:41
*** pblaho__ is now known as pblaho13:41
*** mestery_ is now known as mestery13:42
*** pblaho_ has quit IRC13:45
*** pblaho is now known as pblaho|afk13:52
*** martyntaylor has left #tripleo13:56
*** pblaho|afk is now known as pblaho13:57
*** pblaho has quit IRC13:58
*** beekneemech is now known as bnemec14:04
jdoblifeless: are you traveling right now? isn't it like the middle of the night where you are?14:08
jdobalso, morning :)14:08
*** edmund1 has quit IRC14:12
openstackgerritAlexis Lee proposed a change to openstack/tripleo-incubator: Wait longer for BM node registration  https://review.openstack.org/10224814:16
lifelessjdob: I'm in sunnyvale right now14:16
jdobahh, that makes more sense :)14:16
openstackgerritAlexis Lee proposed a change to openstack/tripleo-incubator: Wait longer for BM node registration  https://review.openstack.org/10224814:17
*** cwolferh has joined #tripleo14:30
*** killer_prince has joined #tripleo14:33
*** andreaf has joined #tripleo14:37
openstackgerritPhil Neal proposed a change to openstack/tripleo-incubator: Fix Ceilometer undercloud endpoint registration when UI not specified  https://review.openstack.org/10201814:40
*** killer_prince has quit IRC14:40
openstackgerritAlexis Lee proposed a change to openstack/tripleo-incubator: Wait longer for BM node registration  https://review.openstack.org/10224814:44
*** killer_prince has joined #tripleo14:44
*** jprovazn is now known as jprovazn_afk14:46
openstackgerritPhil Neal proposed a change to openstack/tripleo-incubator: Fix Ceilometer undercloud endpoint registration when UI not specified  https://review.openstack.org/10201814:52
openstackgerritPhil Neal proposed a change to openstack/tripleo-incubator: Fix Ceilometer undercloud endpoint registration  https://review.openstack.org/10201814:53
*** bthurber has joined #tripleo14:54
*** morganfainberg_L has joined #tripleo14:58
*** andrearosa has quit IRC14:59
*** nati_ueno has joined #tripleo15:00
*** untriaged-bot has joined #tripleo15:00
untriaged-botUntriaged bugs so far:15:00
uvirtbotLaunchpad bug 1332458 in diskimage-builder "Not able to build armhf or arm64 images on amd64 arch systems." [Undecided,New]15:00
uvirtbotLaunchpad bug 1333649 in tripleo "/etc/hosts entries written by hosts element doesn't survive reboot" [Undecided,In progress]15:00
*** untriaged-bot has quit IRC15:00
uvirtbotLaunchpad bug 1332521 in diskimage-builder "failed to remove `/tmp/image.A2aupYJb/mnt/tmp/in_target.d': Device or resource busy" [Undecided,New]15:00
*** chuckC has quit IRC15:01
*** marun has joined #tripleo15:01
*** casanch1 has quit IRC15:11
*** jcoufal has quit IRC15:11
*** ramishra has quit IRC15:19
*** ramishra has joined #tripleo15:30
gfidenteall, are there plans to switch from mysql-binary to the distro packaged versions of mysql and/or mariadb?15:32
*** marun has quit IRC15:33
*** marun has joined #tripleo15:37
gfidentelifeless ^^ ?15:40
lifelessgfidente: I think you can do a build like that if you want to, there's certainly been patch sets up to permit that15:41
gfidentelifeless, yeah I've seen elements for packaged mariadb as well15:42
gfidentebut is there a plan to switch per default?15:43
lifelessI don't think so15:45
lifelesspercona pacakges aren't available everywhere yet15:45
gfidentegot it, thanks15:46
*** ramishra has quit IRC15:49
*** ramishra has joined #tripleo15:50
*** chuckC has joined #tripleo15:52
openstackgerritKevin Benton proposed a change to openstack-infra/tripleo-ci: Testing using a specific patch from neutron in CI  https://review.openstack.org/10207315:53
*** eghobo has joined #tripleo15:53
*** eghobo has quit IRC15:53
*** ramishra has quit IRC15:54
*** eghobo has joined #tripleo15:55
*** jtomasek has quit IRC15:55
kevinbentonlifeless: shouldn’t this line be gone now? https://github.com/openstack-infra/tripleo-ci/blob/master/toci_devtest.sh#L3515:56
*** yamahata has joined #tripleo15:59
lifelesskevinbenton: ah - the code for that checks the commit # and merge logic, but yes, lets remove it15:59
kevinbentonlifeless: does that code affect jobs run by ‘check experimental'?16:00
lifelesskevinbenton: everything but is has some smarts.16:00
openstackgerritlifeless proposed a change to openstack-infra/tripleo-ci: Unrevert Neutron's ovs-agent patch  https://review.openstack.org/10228116:01
vinshre-un-revert. ;)16:01
lifelesskevinbenton: you can however rebase your test patch on top of ^ to ensure you're not affected by it16:01
*** eghobo has quit IRC16:01
lifelessIhave a call now, sorry16:01
*** ramishra has joined #tripleo16:01
*** eghobo has joined #tripleo16:01
kevinbentonlifeless: no prob. i just commented it out on mine16:01
*** martyntaylor has joined #tripleo16:07
*** martyntaylor has quit IRC16:11
*** dtantsur is now known as dtantsur|afk16:16
*** nati_ueno has quit IRC16:17
*** e0ne_ has quit IRC16:18
*** andreaf has quit IRC16:18
*** andreaf has joined #tripleo16:19
*** rdopieralski has quit IRC16:31
*** martyntaylor has joined #tripleo16:31
*** martyntaylor has left #tripleo16:32
*** yjiang5 is now known as yjiang5_away16:33
openstackgerritA change was merged to openstack/tripleo-incubator: Allow use of dib-utils  https://review.openstack.org/10000316:39
*** jcoufal has joined #tripleo16:41
*** noslzzp has quit IRC16:42
*** noslzzp has joined #tripleo16:43
openstackgerritA change was merged to openstack/diskimage-builder: avoid failure if /lib/firmware doesn't exist  https://review.openstack.org/10002616:46
*** ramishra has quit IRC16:49
*** rcarrill` has joined #tripleo16:51
*** rcarrillocruz has quit IRC16:51
*** yjiang5_away is now known as yjiang516:51
*** pelix has quit IRC16:54
*** athomas has quit IRC16:56
*** ramishra has joined #tripleo16:56
*** dshulyak_ has joined #tripleo16:58
*** mrunge has quit IRC17:02
*** dtantsur|afk is now known as dtantsur17:06
openstackgerritEndre Karlson proposed a change to openstack/tripleo-image-elements: Allow ha_mode to be set.  https://review.openstack.org/10229217:07
openstackgerritA change was merged to openstack/tripleo-image-elements: Switch from upstart to os-refresh-config for MySQL server-id's  https://review.openstack.org/9303917:12
openstackgerritEndre Karlson proposed a change to openstack/tripleo-image-elements: Hosts element: Use 'markers' for updating hosts  https://review.openstack.org/10219817:12
*** akrivoka has quit IRC17:15
openstackgerritA change was merged to openstack/tripleo-image-elements: Do not use cat in sysctl-set-value  https://review.openstack.org/10111617:18
*** martyntaylor1 has joined #tripleo17:21
greghaynesjprovazn_afk: you seee my note on https://review.openstack.org/#/c/93104/ ?17:25
*** rwsu has joined #tripleo17:25
*** nealph has quit IRC17:26
ekarlsogreghaynes: u got time to signoff to changes ? ;917:27
greghaynesreferring to 102198?17:27
ekarlsoyah, for one17:28
greghaynesI have it open :)17:28
ekarlsohttps://review.openstack.org/#/c/102292/ this also17:29
ekarlsoshould fix issues with healing upon partitioning17:29
greghaynesooo nice17:30
greghaynesaye, testing my awk fu17:32
ccrouchjp_at_hp: have you had any joy with https://bugs.launchpad.net/tripleo/+bug/1318750 ?17:35
uvirtbotLaunchpad bug 1318750 in tripleo "overcloud create failing; "Command output matched '(CREATE|UPDATE)_FAILED'" (dup-of: 1317923)" [Critical,In progress]17:35
uvirtbotLaunchpad bug 1317923 in tripleo "tripleo failing to come up - baremetal configuration broked" [Critical,Fix released]17:35
*** openstackgerrit has quit IRC17:35
ccrouchi'm having an issue with an authentication failure from nova baremetal to one of the nodes and I came across that bug17:36
ccrouchwhich has the same error in the attached log snippet, not sure its related17:36
*** openstackgerrit has joined #tripleo17:36
*** akuznetsov has quit IRC17:37
*** e0ne has joined #tripleo17:38
*** jprovazn_afk has quit IRC17:40
*** e0ne has quit IRC17:40
*** andreaf has quit IRC17:40
*** ramishra has quit IRC17:40
*** e0ne has joined #tripleo17:42
lifelessgreghaynes: morning :)17:43
lifelessgreghaynes: next HA patch ?17:43
jangooh. potentially good news. Think we've got a fix for eventlet.17:44
jangmind you, I've said that about six times now.17:44
lifelessjang: yay17:44
lifelessjang: noo17:44
jangbut I think we caught the bug that's actually been killing us17:44
greghayneslifeless: hrm, youre running me dry as for ones that have passed CI17:45
lifelessdumdumdummmmmmm duuuum!17:47
*** jp_at_hp has quit IRC17:47
greghaynesPXE deploy failed?17:49
*** mrunge has joined #tripleo17:49
greghaynesHavent seen that one before17:49
greghayneshuh, no such file or directory <iscsi target>17:50
greghayneslifeless: Theres two that *should* pass CI soon and are needed, ill ping when done17:53
lifelessgreghaynes: same here - logs.openstack.org/35/96235/6/check-tripleo/check-tripleo-undercloud-precise/323ebb2/logs/seed_logs/nova-compute.txt.gz17:53
lifelessapparently the seeds are 2G VMs, which will be hitting the adm64 footprint limit17:54
*** Penick has joined #tripleo17:54
lifelessNg: ping17:55
lifelessNg: is there an hp2 bastion now? network folk want to put the network into final configuration17:56
*** jcoufal has quit IRC17:56
*** yjiang5 is now known as yjiang5_away17:57
lifelessgreghaynes: check the output of free in the host state17:57
lifeless             total       used       free     shared    buffers     cached17:57
lifelessMem:          2.0G       1.6G       387M       448K        13M        78M17:57
lifeless-/+ buffers/cache:       1.5G       478M17:57
lifelessSwap:           0B         0B         0B17:57
lifelesstight but not impossible17:58
lifelessI'd be a lot happier if that was a 4G VM17:58
lifelessdprince: hey - so - suggestions on how to deploy/fix that?17:58
lifelessdprince: I'm still not entirely familiar with the layout within rh117:59
ekarlsoany chance to get some views on https://review.openstack.org/#/c/102292/ ?17:59
lifelessgreghaynes: filing a bug ?17:59
jangRight. That github repo may have the latest and greatest in. It's chock full of debug crap but there's the gem of a working eventlet in there, we think. Proving it out with ironic and tidying it back up for shoving upstream, for tomorrow.18:00
openstackgerritEndre Karlson proposed a change to openstack/tripleo-image-elements: Hosts element: Use 'markers' for updating hosts  https://review.openstack.org/10219818:00
lifelessjang: did you get a suggestion in reply to your mail? or you just kept plugging at the issue ?18:01
greghaynesoh, bnemec might have already18:03
uvirtbotLaunchpad bug 1316350 in tripleo "Deployment failure due to missing iscsi target" [Medium,Triaged]18:03
openstackgerritHaneef Ali proposed a change to openstack/tripleo-image-elements: Configure keystone with apache  https://review.openstack.org/10230418:06
janglifeless: jsut kept plugging at it. My first patch had "moved" the problem, we kept on with it until we'd plugged every leak.18:10
jangnow we jsut need to figure out what the minimal invasive patch is.18:10
openstackgerritA change was merged to openstack/os-collect-config: Updated from global requirements  https://review.openstack.org/9623418:11
jangI swear, though, coroutines are actually _harder_ to grok than straight up continuations. It'd be a hell of a lot simpler to recast eventlet atop that as an abstraction.18:11
ekarlsois it my patch that makes it bork or someone elses http://logs.openstack.org/92/102292/1/check-tripleo/check-tripleo-ironic-seed-precise/1368845/console.html ?18:12
lifelessjang: funnily enough, thats been said before :)18:13
lifelessekarlso: seed didn't come up proplerly; what was your patch changing ?18:14
lifelesscould be it :>18:15
lifelessekarlso: you can check if the config came up properly18:15
ekarlsolifeless: where ?18:15
lifelessekarlso: in the logs tgz18:17
greghayneslifeless: how bad of form would it be to un-abandon https://review.openstack.org/#/c/93104/18:17
greghaynesseems like it was already 2x+2 whish is why I want to18:17
ekarlsooh, wrong config format : p18:17
dprincelifeless: are you requesting that we increase the size of the seed VMs?18:18
*** echohead has joined #tripleo18:18
dprincelifeless: I'd have to do the match... but like we spoke yesterday the intent was to be able to save space and use a 2 Gig seed for CI (I think)18:19
lifelessdprince: or if we needed to go to i386, that we do that. I would rather 4G seeds though - because we IO thrash if the BM deploy nodes are too small18:19
dprincelifeless: how urgently is this needed?18:19
lifelessdprince: but right now we have 2G seed and amd64 nodes, that fails intermittently in my tests - we're too close to the RAM ceiling18:20
dprincelifeless: The cost is we'll have less capicity on the RH rack I think18:20
dprincelifeless: of course we can do it, but we'll be running even less jobs.18:21
dprincelifeless: I'd like to see us bring on more nodes first, I suppose and hold off on sending anything which breaks the seeds in this regard until we do18:22
dprincelifeless: which patch in particular are you concerned about?18:22
lifelessdprince: what about 3G ndoes w/i386 ?18:22
lifelesshttps://bugs.launchpad.net/tripleo/+bug/1316350 <- thinking that might be a low memory symptom18:23
uvirtbotLaunchpad bug 1316350 in tripleo "Deployment failure due to missing iscsi target" [Medium,Triaged]18:23
dprincelifeless: seems like a reasonable compromise but again I'll have to check the numbers18:23
*** martyntaylor1 has left #tripleo18:23
lifelessStevenK: where is your patch to fixup testenv creation metadata?18:24
lifelessStevenK: we should get that in to any rebuild dprince does18:24
lifelessdprince: if we do rebuild, I'd like to follow along in a screen session or something, to see how its down in that rack18:24
openstackgerritEndre Karlson proposed a change to openstack/tripleo-image-elements: Allow ha_mode to be set.  https://review.openstack.org/10229218:25
dprincelifeless: sure. I'm fine with that. Honestly this would be something nice to do in mid-July perhaps.18:25
lifelessdprince: do you mean at the sprint?18:26
dprincelifeless: we have good stability right now... I hate to rock the boat just because we think a small seed causes this iscsi failure though.18:26
lifelessdprince: some training for tripleo-cd-admins there would rock18:26
dprincelifeless: yes, the sprint18:26
dprincegreghaynes: not sure what you are +1'ing. We'll take it as a general amen, tripleO rocks sort of thing18:27
*** e0ne has quit IRC18:28
greghaynesyep, just trying to cheer the project along18:28
*** e0ne has joined #tripleo18:28
greghaynes+1 to cd-admins training though :)18:28
*** vinsh has quit IRC18:28
ekarlsogreghaynes: when u mean to compare the file, do a md5sum or so of the 2 hosts files ?18:29
greghaynesekarlso: I mean figure out if were actually going to modify it, and if so log what were going to change18:29
dprincegreghaynes/lifeless: I need this done before ssh access to the RH cloud will get fixed https://review.openstack.org/#/c/101576/18:29
greghaynesI could see that being useful for knowing what our hosts content was during a specific o-c-c run18:30
ekarlsogreghaynes: that sounds like doing more advanced stuff then the awk that's currently there :|18:30
dprinceThe gist is our guys don't like using a single account for access (for obvious security reasons)18:33
greghayneshehe, WCPGW with a single account and a ton of ssh keys18:33
dprinceAnd there isn't a reasonable way to map the keys to usernames/IRC names otherwise18:33
greghaynescp file, do awk, compare18:33
*** jp_at_hp has joined #tripleo18:34
lifelessgreghaynes: can you run the meeting today?\18:34
greghaynesIf its a bunch of work then im fine not doing it, seemed simple though18:34
greghayneslifeless: sure18:34
greghaynesdo youall have macros for all those #links things you do?18:34
greghaynesI notice youall spam lots quicly18:34
lifelessgreghaynes: see the wiki page18:35
lifelessdprince: so its basically fine18:35
lifelessdprince: I'm just struggling to remember how we get *those* keys into the admin 'default' keypair in the CI region underclouds, so that we have access to the overcloud18:36
dprincelifeless: So, in the case where the undercloud is the gateway/access node (i.e. what the HP rack did) I don't think there is an issue.18:39
dprincelifeless: in the case where there is a bastion there would need to be a second sync script to allow you to access the undercloud as well.18:39
dprincelifeless: I use port forwarding18:39
dprincelifeless: not port forwarding, ssh forwarding :)18:40
dprincelifeless: we can have more scripts for whatever. All I really care about initially is how we store these keys... and keeping them in files per user is a step in the right direction18:40
lifelessdprince: yep, like I say I'm fine with that. Its their use in the admin keypair that I'm trying to remember.18:41
lifelessdprince: how is that setup in the rh rack? or do you use the id_rsa of the user account the deploy is intiated from ?18:41
dprincelifeless: I don't think they are used there.18:42
dprincelifeless: at least they aren't on our rack18:42
ekarlsogreghaynes: would doing a diff be sufficient ? ; )18:42
lifelessso in the hp1 region I had it up so we can all ssh directly in as heat-admin@ci-overcloud....18:42
lifelessusing our own keys18:42
greghaynesekarlso: totally18:42
dprincelifeless: that is fine. But in our region everything is configured off of a seed host. As TripleO doesn't bootstrap that seed host I'd say lets just also have a script to sync things there too18:43
dprincelifeless: if someone wants to go directly from bastion to undercloud... that is fine too but I would rather consolidate things on the seed host as much as possible. As sort of an administration node18:44
lifelessdprince: FWIW I marked it +A about 3m back18:44
dprincelifeless: we're just talking here man, not trying to pressure you :)18:45
lifelessdprince: I know18:45
lifelessdprince: just letting you know since you need it18:45
lifelessdprince: I have to go do this PTL webinar now18:45
dprincelifeless: thanks, TTL18:45
openstackgerritA change was merged to openstack-infra/tripleo-ci: Revert "Try reverting Neutron ovs-agent change"  https://review.openstack.org/10151318:45
openstackgerritEndre Karlson proposed a change to openstack/tripleo-image-elements: Hosts element: Use 'markers' for updating hosts  https://review.openstack.org/10219818:47
ekarlsothere you go greghaynes18:47
SpamapSwe on alternate meeting time today?18:50
greghaynesoh, right18:50
greghayneslifeless: ^18:50
lifelessI thought it was original. Easy :)18:51
lifelesstchaypo: tag, you get to run the meeting :>18:51
SpamapSOh wow I didn't know there was an ical for the meetings18:55
greghaynesekarlso: reviewed your other RMQ patch18:56
greghaynesI didnt realise rmq had that config value, that makes me a lot happier18:57
*** jdob has quit IRC18:57
*** jdob has joined #tripleo18:58
*** jtomasek has joined #tripleo18:59
*** jcoufal has joined #tripleo18:59
ekarlsogreghaynes: i discovered it when testing it here by partitioning the cluster it doesn't autoheal19:01
*** morganfainberg_L has quit IRC19:01
*** morganfainberg_L has joined #tripleo19:01
*** morganfainberg_L has quit IRC19:02
*** morganfainberg_L has joined #tripleo19:02
*** yamahata__ has joined #tripleo19:02
jp_at_hpccrouch - that fix should be in the tripleo codebase already, as per https://bugs.launchpad.net/tripleo/+bug/131792319:02
uvirtbotLaunchpad bug 1317923 in tripleo "tripleo failing to come up - baremetal configuration broked" [Critical,Fix released]19:02
*** yamahata_ has quit IRC19:03
openstackgerritA change was merged to openstack/tripleo-incubator: Split ssh keys into files per user.  https://review.openstack.org/10157619:03
*** jp_at_hp has quit IRC19:03
*** vinsh has joined #tripleo19:08
*** jdob has quit IRC19:09
*** jdob has joined #tripleo19:09
*** jang1 has joined #tripleo19:12
*** mrunge has quit IRC19:12
jdobbnemec: did you submit a patch for the tox.ini yet, or did I misread your email and you're still working on it?19:21
ekarlsogreghaynes: what u want to call the ha_mode then ?19:21
bnemecjdob: https://review.openstack.org/#/c/102291/19:21
jdobah, crud, dib-utils isnt in my dashboard yet, that's why19:22
lifelessNg: are you watching the webcast, or is it your evil clone?19:22
*** killer_prince has quit IRC19:24
jdobthanks bnemec19:24
bnemecjdob: np19:25
*** dshulyak_ has quit IRC19:40
*** noslzzp has quit IRC19:41
kevinbentondprince: ping19:42
dprincekevinbenton: hi19:42
kevinbentondprince: would this have affected the tests for my neutron patch? https://review.openstack.org/10228119:43
kevinbentondprince: whoops https://review.openstack.org/#/c/101513/19:43
kevinbentonit would have removed one of the commits mine depended on if i understand it correctly19:44
dprincekevinbenton: oh, did you reference the same (already closed I thought) ticket?19:44
lifelessif you reference the ticket it doesn't apply the revery19:45
dprincekevinbenton: ah, yes. I think it might have.19:45
dprincekevinbenton: no, though. THe commit was different19:45
dprincekevinbenton: plus we'd see it in the logs19:45
kevinbentondprince: yeah, i see the id changed19:45
dprincekevinbenton: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_devtest.sh#n2019:46
openstackgerritJay Dobies proposed a change to openstack/tripleo-specs: Spec for Tuskar Juno Plan REST API changes  https://review.openstack.org/9472019:47
kevinbentondprince: well that looks for a bug number, right?19:47
kevinbentondprince: XXX isn’t exactly a valid bug :-)19:48
dprincekevinbenton: Correct, So this wouldn't have caused the problems.19:48
*** jcoufal has quit IRC19:49
ekarlsogreghaynes: when u mean a diff name it would rock my world with a suggestion :)19:49
dprincekevinbenton: FWIW, I tried your patch 4-5 times locally today (on real bare metal) and it works for me. So I think it may be a race that occurs only on smaller/virtual test environments.19:49
dprincekevinbenton: did you see my note about the GRE ports missing on the br-tun bridge?19:49
ekarlsoregards to https://review.openstack.org/#/c/102292/219:50
kevinbentondprince: yes, but that can be related to lots of things19:50
kevinbentondprince: without the debug logs for the vswitch agent there is nothing to work on19:51
kevinbentondprince: I was hoping it would be as easy as this, but it doesn’t seem so https://review.openstack.org/#/c/102073/2/heat-templates/testenv-workers.yaml19:54
*** jtomasek has quit IRC19:55
*** Penick has quit IRC19:58
devanandadprince: if you have a moment to look at https://review.openstack.org/#/c/99460/ -- looks like it is passing everything now20:00
dprincedevananda: ack, thanks. Glad to see that. let me re-review it in a minute20:01
dprincekevinbenton: left you some comments on 102073. You are on the right track... I think we just need two sets of DIB_REPOREF variables though20:02
dprincekevinbenton: one for your neutron patch (you've got that already). And another for a new tripleo-heat-templates branch which enables neutron debug logging. Alternately you could just hack the tripleo-image-elements neutron.conf file directly and reference that project/patch instead.20:03
*** Penick has joined #tripleo20:03
dprincekevinbenton: make sense? Once we have that you should essentially get the results you are looking for, ie. your neutron patch with debug logging enabled20:03
*** spzala has joined #tripleo20:04
*** e0ne has quit IRC20:05
*** e0ne has joined #tripleo20:06
*** e0ne has quit IRC20:08
*** jml has quit IRC20:09
dprincedevananda: 99460 is +A20:10
openstackgerritKevin Benton proposed a change to openstack-infra/tripleo-ci: Testing using a specific patch from neutron in CI  https://review.openstack.org/10207320:10
kevinbentondprince: like that? ^^20:10
kevinbentondprince: forgot to remove the debug: true20:10
devanandadprince: awesome, thanks20:10
*** dtantsur is now known as dtantsur|afk20:10
dprincekevinbenton: Hmmm, actually I led you on the wrong path. TripleO image elements isn't installed by DIB!!20:12
devanandalifeless: ^ scheduling fixes should be landing soon20:12
greghaynesekarlso: *shrug* why not just use the name of the config option in rabbit20:12
*** e0ne has joined #tripleo20:12
dprincekevinbenton: I'm not sure we have a good way of enabling neutron debugging at this time. What we really need is Zuul dependencies :(20:12
*** jml has joined #tripleo20:13
dprincekevinbenton: I think we might should an an option to the tripleo-incubator (the devtest scripts themselves) to enable DEBUG via an environment variable.20:14
kevinbentondprince: why not just debug by default in these projects? to keep the logs small?20:15
openstackgerritEndre Karlson proposed a change to openstack/tripleo-image-elements: Allow ha_mode to be set.  https://review.openstack.org/10229220:17
dprincekevinbenton: yes, keeps the logs small. Also, we want production defaults20:17
dprincekevinbenton: Would you like me to take this?20:18
greghaynesdprince: cant we use ExtraParams20:18
greghaynesto enable debugging20:18
kevinbentondprince: yes, i know nothing about tripleo so i’m in over my head20:18
greghaynesso export OVERCLOUD_EXTRA_CONFIG20:18
dprincegreghaynes: thanks, good idea20:19
* dprince double checks...20:19
greghaynesneutron.conf does support passthrough20:19
*** e0ne has quit IRC20:20
dprincegreghaynes: yes, it does. Are you up for wiring https://review.openstack.org/#/c/102073/3 up with that approach?20:20
*** e0ne has joined #tripleo20:20
dprincegreghaynes: if not I'll take your suggestions and see what works best20:21
dprincegreghaynes: thanks man :)20:21
dprincekevinbenton: cool, hopefully we'll get you debug info soon then20:22
*** dprince has quit IRC20:23
*** e0ne has quit IRC20:24
*** eguz has joined #tripleo20:26
*** davidlenwell_ is now known as davidlenwell20:28
*** eguz has quit IRC20:28
*** ChanServ sets mode: +v davidlenwell20:28
*** eguz has joined #tripleo20:28
openstackgerritGregory Haynes proposed a change to openstack-infra/tripleo-ci: Testing using a specific patch from neutron in CI  https://review.openstack.org/10207320:29
*** e0ne has joined #tripleo20:29
*** howleyt_ has joined #tripleo20:30
*** eghobo has quit IRC20:30
howleyt_Howdy, anyone around that could approve https://review.openstack.org/#/c/81920/  It has two +2's already.20:32
lifelessdevananda: huh?20:32
lifelesshowleyt_: not until we have CI ok20:32
greghaynesci looks like it passed20:32
lifelessoh gertty hadn't picked that up. cool20:33
openstackgerritA change was merged to openstack/tripleo-image-elements: Add keepalive option to rabbitmq config  https://review.openstack.org/8192020:33
lifelesshmm, no reviews on 102081 yet.20:35
devanandalifeless: scheduler bug in nova that wasn't picking up host stats from ironic -- the fix was just approved.20:36
devanandalifeless: once it lands, you may want to poke hp internal folks who were waiting for that20:36
SpamapSlifeless: how important do you think it will be that the chunking shim be able to take any and all heat CLI options and pass them along to the respective underlings?20:43
*** nati_ueno has joined #tripleo20:48
tchaypoThe meeting was the early one today?20:49
greghaynesunsure what early is for us20:50
greghaynesits 00:00 PST20:50
greghayneswhich is technically *very* early20:50
tchaypoIe 12 hours from now20:50
tchaypoThat'd be why  lifeless is declining to run sit today20:51
howleyt_greghaynes, lifeless: Thought I'd pounce when I saw the CI passing. Thanks.20:52
tchaypoI woke up, saw that he'd tagged me at 04:51, and thought I'd misjudged and slept through20:53
openstackgerritGregory Haynes proposed a change to openstack-infra/tripleo-ci: Testing using a specific patch from neutron in CI  https://review.openstack.org/10207320:56
greghaynesbnemec: thanks for the repolocation protip20:56
*** jdob has quit IRC20:58
*** untriaged-bot has joined #tripleo21:00
untriaged-botUntriaged bugs so far:21:00
uvirtbotLaunchpad bug 1332458 in diskimage-builder "Not able to build armhf or arm64 images on amd64 arch systems." [Undecided,New]21:00
uvirtbotLaunchpad bug 1333807 in tripleo "RabbitMQ cluster doesn't autoheal after a partition" [Undecided,New]21:00
uvirtbotLaunchpad bug 1333649 in tripleo "/etc/hosts entries written by hosts element doesn't survive reboot" [Undecided,In progress]21:00
*** untriaged-bot has quit IRC21:00
uvirtbotLaunchpad bug 1332521 in diskimage-builder "failed to remove `/tmp/image.A2aupYJb/mnt/tmp/in_target.d': Device or resource busy" [Undecided,New]21:00
*** nati_ueno has quit IRC21:02
*** nati_ueno has joined #tripleo21:02
greghaynesLooking for core on https://review.openstack.org/#/c/102177/21:03
lifelessdevananda: I don't know who's waiting for it - I just heard of it now21:04
greghayneslifeless: ^ HA patch that passed CI21:04
lifelessSpamapS: I think its very unimportant. Its not in a heat repo.21:04
openstackgerritA change was merged to openstack/tripleo-image-elements: Check if stunnel.connect_ip is set  https://review.openstack.org/10217721:06
*** julim has quit IRC21:08
*** cwolferh has quit IRC21:12
SpamapSlifeless: I got it working anyway. :-P21:15
SpamapSlifeless: should help this have minimal impact on the way everything works.21:15
SpamapSJust working on pointing it at a real Heat now21:15
greghayneslifeless: curious if youve read what happened on https://review.openstack.org/#/c/93104/21:21
greghaynesits needed for HA21:21
lifelessgreghaynes: i have not21:21
greghaynesgot abandoned when it was 2x +2 for a patch that seems pretty far from being merged21:21
lifelessgreghaynes: meetig, back soon21:21
lifelessgreghaynes: if you want it alive, I think you can do that or ping clarkb21:21
clarkbyou all can do it now21:22
clarkbCores have (un)abandon rights21:22
*** eguz has quit IRC21:22
greghaynesYep, hoping for at least a second opinion that im not missing something21:22
greghaynesI do see a restore change button :)21:22
clarkbthis is one of the new shiny gerrit 2.8 features21:22
*** nealph has joined #tripleo21:28
nealphlifeless: added you as a core reviewer on https://review.openstack.org/#/c/96527/. I think you have background on what's happening there...thanks again for working through the context with me21:29
*** jang has quit IRC21:31
*** eghobo has joined #tripleo21:32
*** eghobo has quit IRC21:36
*** e0ne has quit IRC21:36
*** eghobo has joined #tripleo21:36
lifelessnealph: whats wrong with it ?21:43
lifelessnealph: it looks like its passed CI and review21:43
lifelessgreghaynes: I don't think they are mutually exclusive, no? fixing up reset-db is fine, on the path to deleting it :)21:44
greghaynesYes, 93104 is just a subset of the other21:45
lifelessgreghaynes: so... you have the force, greg21:49
*** yjiang5_away is now known as yjiang521:51
lifelessgreghaynes: r11 is really quite different to r1021:51
greghaynesoh my, it is21:52
lifelessI'm not sure r11 will pass21:53
*** nati_ueno has quit IRC21:53
lifelesshave you looked at why it failed ?21:53
greghaynesIts been working for me21:53
ekarlsoYap greghaynes that pause_minority thing for fixes teh partitioning issue when a node comes up again, no manual intervention needed : p21:53
*** nati_ueno has joined #tripleo21:54
greghayneslifeless: pypi fail21:54
lifelessah kk21:54
greghaynesekarlso: w00t21:54
lifelesswell its rechecking now21:54
greghayneslifeless: when we switched to non-package install for mysql I think the data massaging part of that script became irrelevant21:55
ekarlsogreghaynes: also I tested the /etc/hosts fix, works like a charm : I21:55
ekarlsoNow I can reboot a node without the fear of it never coming back to the living : P21:56
*** jtomasek has joined #tripleo22:00
nealphlifeless: just lookin' for the +2/approval.22:01
*** jpeeler has quit IRC22:04
*** e0ne has joined #tripleo22:07
*** jtomasek has quit IRC22:07
*** e0ne_ has joined #tripleo22:09
*** e0ne has quit IRC22:12
*** e0ne_ has quit IRC22:12
*** nijaba has quit IRC22:13
*** nijaba has joined #tripleo22:15
*** nijaba has quit IRC22:15
*** nijaba has joined #tripleo22:15
openstackgerritLonggeek proposed a change to openstack/tripleo-image-elements: loading of package `pbr` will break setuptools in tripleo  https://review.openstack.org/10236722:16
jerryzlifeless: how does heat decide the number of nodes for compute and controller, and the role mapping to the nodes?22:26
*** markmc has quit IRC22:28
*** noslzzp has joined #tripleo22:31
*** yamahata has quit IRC22:35
*** nijaba_ has joined #tripleo22:36
*** nijaba has quit IRC22:36
*** nijaba_ has quit IRC22:45
*** boris-42 has quit IRC22:46
*** yamahata has joined #tripleo22:47
*** eghobo has quit IRC22:50
*** Penick has quit IRC22:51
*** nijaba has joined #tripleo22:51
*** howleyt_ has quit IRC22:54
*** Penick has joined #tripleo22:58
*** nijaba has quit IRC22:58
SpamapSjerryz: Heat does not decide23:00
SpamapSjerryz: we generate a template that has the number of nodes23:00
SpamapSjerryz: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/Makefile23:00
jerryzSpamapS: yeah, i see that. but how can i specify which is which23:01
*** boris-42 has joined #tripleo23:02
jerryzSpamapS: say, one BM node has larger storage, which is for cinder23:02
lifelessjerryz: you'd crete a flavor that matches that node size, and specify the right flavor for cinder nodes in the template23:03
lifelessjerryz: if this is for the tripleo region, I wouldn't bother - just run all the nodes the same size, and run all services on all of them23:03
lifelessjerryz: no need to super-optimise things23:03
*** chuckC has quit IRC23:04
jerryzlifeless: ok.  i see. that is at the time registering the BM node.23:06
kevinbentongreghaynes: hey, was the latest result set for this patch supposed to have debug info? https://review.openstack.org/#/c/102073/23:07
jerryzlifeless: but tripleO script itself just hardcodes to flavor baremetal23:07
greghayneskevinbenton: I just saw that, am testing now. Those logs look like it didnt have debug info set, right?23:08
lifelessjerryz: yes, we're very simple today23:08
kevinbentongreghaynes: yeah, doesn’t seem to23:08
*** yamahata has quit IRC23:08
*** e0ne has joined #tripleo23:09
jerryzlifeless: another question, how do you get the mac address of the real BM machines not VM simulators23:09
*** ddieterly has quit IRC23:09
kevinbentongreghaynes: should be able to see rpc messages in http://logs.openstack.org/73/102073/5/check-tripleo/check-tripleo-overcloud-f20/d704ad5/logs/overcloud-NovaCompute0-brah7pocqqon_logs/neutron-openvswitch-agent.txt.gz23:09
greghayneslol, I think it might be because I didnt capitalize default23:10
greghaynesin the config section23:10
*** Penick has quit IRC23:11
*** e0ne has quit IRC23:12
*** ifarkas has quit IRC23:13
lifelessjerryz: we pass it in with the IPMI details - in nodes.json23:16
greghaynesoh wait, it didnt set that at all23:18
*** Penick has joined #tripleo23:18
greghayneser, it didnt use the exta params to fill out the config file23:18
jerryzlifeless: i assume this nodes.json file needs lab admin's input, or some hardware discovery tool.23:20
openstackgerritChris Krelle proposed a change to openstack/diskimage-builder: update zypper element  https://review.openstack.org/10238223:20
openstackgerritChris Krelle proposed a change to openstack/diskimage-builder: update zypper element  https://review.openstack.org/10238223:21
greghayneshrm, looks like the extra config thing should have worked: http://logs.openstack.org/73/102073/5/check-tripleo/check-tripleo-overcloud-f20/d704ad5/console.html#_2014-06-24_21_53_43_55123:23
lifelessjerryz: lab admin yeah23:23
lifelessjerryz: you need IPMI credentials, can't discover that :)23:23
greghaynesok, yea, I think its a capitalization issue, retrying...23:24
*** eghobo has joined #tripleo23:24
openstackgerritGregory Haynes proposed a change to openstack-infra/tripleo-ci: Testing using a specific patch from neutron in CI  https://review.openstack.org/10207323:24
greghayneskevinbenton: http://logs.openstack.org/73/102073/5/check-tripleo/check-tripleo-overcloud-f20/d704ad5/logs/overcloud-controller0-ogh64dgoubfk_logs.tar.xz has /etc in it23:25
greghayneskevinbenton: so you can see at the bottom the value is being set23:25
*** eghobo has quit IRC23:25
*** eghobo has joined #tripleo23:25
*** morazi has quit IRC23:26
*** gfidente has quit IRC23:28
*** chuckC has joined #tripleo23:35
openstackgerritChris Krelle proposed a change to openstack/diskimage-builder: Ensure cache directory exists before use  https://review.openstack.org/10238623:36
greghayneshuh http://logs.openstack.org/54/93554/10/check-tripleo/check-tripleo-overcloud-f20/a44beb4/console.html#_2014-06-24_22_21_43_14523:37
greghaynesso close!23:37
SpamapSlifeless: ok, I've got something that _tries_ to work.. let me squash and push for review23:37
lifelessSpamapS: woo23:38
SpamapShave to run get kids now.. but I think I could have a chunked stack deploying tonight23:38
lifelessSpamapS: fantastico23:38
openstackgerritClint 'SpamapS' Byrum proposed a change to openstack/tripleo-incubator: Tool to tie disconnected stacks together  https://review.openstack.org/10238823:41
SpamapSabout half of those lines are, sadly, copy/paste from python-heatclient23:41
SpamapSno time to refactor it to expose its parsers and keystone-client-endpoint-determining goodness.23:42
ekarlsogreghaynes: I wonder if theres another issue now...23:43
greghaynesnah, im sure we fixed *all* the bugs :p23:44
ekarlsoso when nodes have been powered off and then powered back on w rmq I get: mkdir: cannot create directory ‘/var/run/rabbitmq’: Permission denied in logs :)23:44
ekarlsois /var/run wiped on boot or ?23:44
* SpamapS is out23:45
*** Penick has quit IRC23:45
greghaynessomething to note is that even if rabbitmq comes back, there is not much hope of galera coming back after a full cluster reboot23:45
greghaynesif you shut it all down at once23:45
greghaynesso not sure if that puts a damper on your plans23:45
jerryzlifeless: i see in devtest grizzly is used for overcloud. is there plan for icehouse?23:45
ekarlsogreghaynes: we're more checking up on how stuff behaves and what intervention is needed23:46
greghaynesok, just making sure you were aware23:46
greghaynesekarlso: unsure about the /var/run thing, I dont think we wipe it though23:47
greghaynesjerryz: huh? We use HEAD23:48
ekarlsogreghaynes: I'll check tmrw what happens then23:49
*** Penick has joined #tripleo23:52
*** yamahata has joined #tripleo23:57
*** xuhaiwei has joined #tripleo23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!