Friday, 2014-04-04

*** slagle has quit IRC00:03
*** newell_ has quit IRC00:08
*** e0ne has joined #tripleo00:16
*** CLOUDOUTAGE has joined #tripleo00:19
CLOUDOUTAGElifeless devananda Ng SpamapS jog0 GheRivero derekh dprince slagle  -- ci-overcloud currently down https://etherpad.openstack.org/p/cloud-outage00:19
*** CLOUDOUTAGE has quit IRC00:19
*** e0ne has quit IRC00:20
*** morazi has joined #tripleo00:28
*** weshay has joined #tripleo00:30
*** CaptTofu has joined #tripleo00:40
lifelessok finally off calls00:41
lifelessSpamapS: did you get anywhere ?00:41
lifelesson undercloud back00:44
lifelessWAT00:45
lifelessrmadison linux00:45
lifelessrmadison: you must have the liburi-perl package installed00:45
*** CLOUDOUTAGE has joined #tripleo00:50
CLOUDOUTAGElifeless devananda Ng SpamapS jog0 GheRivero derekh dprince slagle  -- ci-overcloud currently down https://etherpad.openstack.org/p/cloud-outage00:50
*** CLOUDOUTAGE has quit IRC00:50
SpamapSlifeless: I got home.. ;)00:50
lifelessovercloud is coming up atm00:51
SpamapSlifeless: ok so I'll return to making a mellanox update element00:51
lifelessSpamapS: yes-and-please-manually-apply-to-the-overcloud-and-undercloud.00:52
lifelessSpamapS: or get someone else to00:52
lifelessSpamapS: cause this is ridiculous00:52
SpamapSI can do it00:52
lifelesscool00:52
SpamapSit is actually pretty straight forward00:52
*** e0ne has joined #tripleo00:55
*** morazi has quit IRC00:56
*** morazi has joined #tripleo00:58
*** CaptTofu has quit IRC00:59
*** e0ne has quit IRC01:00
lifelesswow restarting horizon is slow01:01
lifelesswtf01:01
lifelessTHAT is a big chunk of waste time01:01
lifelesshypervisors checking in01:01
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/diskimage-builder: Add mellanox upstream element  https://review.openstack.org/8520801:02
SpamapS^^ untested01:02
tchaypo*rage* finally i have a working video card again. Thanks linux!01:03
SpamapStchaypo: you running Ubuntu 13.10 ?01:04
tchaypo14.0401:04
mordredtchaypo: boom!01:04
mordredtchaypo: me too - it's mostly operational01:04
tchaypoit's been working fine until yesterday I started getting huge black rectangles around certain UI elements01:05
*** slagle has joined #tripleo01:05
tchayporebooted, which fixed that problem, except then it didn't want to talk to the nvidea drivers any more.01:05
*** weshay has quit IRC01:05
SpamapSWow, surprising that 14.04 would have problems.. would have expected it would be the solution. Weird.01:05
StevenKtchaypo: Hm, I get small black rectangles near things on my laptop, but intel, not nvidia01:05
tchaypoended up having to completely purge them all, reboot, reinstall.. and even then it's still not loading the driver automatically, so i have to reboot, stop lightdm, modprobe, start lightdm...01:06
SpamapStchaypo: still, nvidia is banned in my house now.01:06
StevenKSpamapS: Oh?01:06
StevenKsteven@undermined:~% lspci | grep VGA01:06
StevenK01:00.0 VGA compatible controller: NVIDIA Corporation GF114 [GeForce GTX 560 Ti] (rev a1)01:06
* StevenK hugs his card01:06
StevenKOuch, it's hot01:06
SpamapSas I've said before, the most intensive game I play is TF2.. so I don't need all the whizbang insanity of 512MB dual-port PCIe.01:07
SpamapSintel graphics have fantastic support, are 100% open source on the driver, and work great.01:07
greghaynes512MB? thats so two years ago01:07
tchayposo. video issues fixed on laptop. /dev restored on devtest machine. Now I can start working again01:07
StevenKHeh, yes01:07
StevenKMy 560Ti is 1GB01:07
greghaynesHow else are you going to run TF2 on a 4k display01:08
StevenKRight. laptop now running -19, so I can purge -16 and friends01:08
SpamapSautoclean handles that mostly now01:10
greghaynesSpamapS: Ive added a FileInclude to the software-config patch for NovaComputeConfig in overcloud-source.yaml (is that sane?) but heat gets upset when I stack-create, have you run into this yet?01:10
SpamapSgreghaynes: upset? hrm? not sure01:11
mordredSpamapS: it grumps01:11
lifelessall hypervisors up01:12
greghaynesWell, mostly curious whether you actually tested the latest revision of that patch01:12
greghaynesor if my environment is borked for some reason01:12
SpamapSgreghaynes: I have gotten to a timing out overcloud, IIRC01:13
SpamapSgreghaynes: possible I didn't.. I have been highly distracted01:13
*** e0ne has joined #tripleo01:14
greghaynesok01:14
greghaynesalso \O/ new mobo that just arrived is DOA01:15
StevenKWhich new motherboard?01:15
greghayneshttp://www.newegg.com/Product/Product.aspx?Item=N82E1681318282101:15
SpamapSthe DOA one ;)01:15
greghaynesyes, that one01:15
lifeless40 lockenvs registered01:15
lifelessso far so good01:15
* StevenK stabs Trusty01:17
*** eghobo has joined #tripleo01:17
StevenKsteven@undermined:~% rmadison -s trusty-proposed cinnamon01:18
StevenK cinnamon | 1.7.4-2ubuntu6 | trusty-proposed/universe | source, amd64, arm64, armhf, i386, powerpc, ppc64el01:18
StevenKPPA it is, then01:18
*** e0ne has quit IRC01:19
SpamapSwait01:19
SpamapScinnamon?01:19
SpamapSjust admit defeat and run xfce already01:20
greghaynesOh, youve been talking to clarkb havent you?01:20
StevenKSpamapS: But xfce is UGLY01:20
*** CLOUDOUTAGE has joined #tripleo01:21
CLOUDOUTAGElifeless devananda Ng SpamapS jog0 GheRivero derekh dprince slagle  -- ci-overcloud currently down https://etherpad.openstack.org/p/cloud-outage01:21
*** CLOUDOUTAGE has quit IRC01:21
StevenKgreghaynes: No, cinnamon on my laptop is my wife's fault01:21
greghaynesI mean SpamapS re: xfce - clarkb has been trying to convert everyone lately01:22
clarkbits good stuff01:22
clarkbslap some xmonad over the top of it and you don't need anything else01:22
greghaynessee!01:22
lifelessSpamapS: so, mellanox on the control node?01:25
StevenKBleh01:26
StevenKStupid cinnamon PPA doesn't have trusty01:26
openstackgerritJames Polley proposed a change to openstack/tripleo-incubator: Minor tweaks to docs in _testenv.sh  https://review.openstack.org/8464001:27
*** nosnos has joined #tripleo01:33
Shrewslifeless: got time for a quick non-tripleo question?01:41
lifelessShrews: course01:42
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Setup nameservers in the default-net.  https://review.openstack.org/8521501:42
Shrewslifeless: you may not know, but... why would 'discover' report ERROR for tests that it finds?01:42
lifelessShrews: files that can't be imported01:43
Shrewshrm01:43
mordredShrews: lifeless knows all01:48
Shrewsi'm not immediately seeing anything special in these particular tests01:48
lifelessShrews: pastebin the evidence01:48
Shrewsdiscover starts spitting errors and just begins eating up all memory01:48
Shrewslifeless: this is partial output, but where things start going wrong: http://paste.openstack.org/show/7504501:50
lifelessok thats not discover01:51
lifelessthats execution time01:51
lifelessthe tests are failing01:51
Shrewsoh, perhaps i misunderstood what discover does then01:52
lifelessdiscover finds and then executes tests01:53
*** morazi has quit IRC01:55
Shrewsok01:55
*** eghobo has quit IRC01:56
Shrewsi thought it just found them01:56
* Shrews keeps hunting01:56
*** yamahata has joined #tripleo02:09
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: WIP: More automation for CI overcloud setup.  https://review.openstack.org/8521902:11
*** e0ne has joined #tripleo02:14
*** e0ne has quit IRC02:19
*** morganfainberg is now known as morganfainberg_Z02:22
*** eghobo has joined #tripleo02:28
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Make devtest_* accept options.  https://review.openstack.org/8522102:35
*** jp_at_hp1 has quit IRC02:42
*** eghobo has quit IRC02:47
*** matsuhas_ has joined #tripleo02:53
*** matsuhashi has quit IRC02:53
*** matsuhas_ has quit IRC02:54
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Make it possible to just build images.  https://review.openstack.org/8522202:54
*** matsuhashi has joined #tripleo02:56
*** untriaged-bot has joined #tripleo03:00
untriaged-botUntriaged bugs so far:03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130214803:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130069303:00
uvirtbotLaunchpad bug 1302148 in tripleo "error: Unable to add port vnet2 to OVS bridge br-ctlplane: Operation not permitted" [Undecided,New]03:00
uvirtbotLaunchpad bug 1300693 in tripleo "devtest.sh run leaves 3 default security groups" [Undecided,Incomplete]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/129048803:00
*** untriaged-bot has quit IRC03:00
uvirtbotLaunchpad bug 1290488 in tripleo "Baremetal: Invalid credentials" [Undecided,Incomplete]03:00
*** matsuhashi has quit IRC03:02
*** matsuhashi has joined #tripleo03:04
openstackgerritlifeless proposed a change to openstack/diskimage-builder: Permit cache-url to work with fifos.  https://review.openstack.org/8522403:05
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Use a cirros image as the end user image  https://review.openstack.org/8334703:09
*** theripper has joined #tripleo03:11
*** e0ne has joined #tripleo03:14
*** nosnos has quit IRC03:17
*** e0ne has quit IRC03:19
*** ramishra has joined #tripleo03:23
*** eghobo has joined #tripleo03:33
lifelessboom03:39
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Deploy overcloud images from seed  https://review.openstack.org/8512603:40
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Make it possible to just build images.  https://review.openstack.org/8522203:40
SpamapSgoes the dynamite?03:40
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/diskimage-builder: Add mellanox upstream element  https://review.openstack.org/8520803:40
SpamapSlifeless: ^^ that one actually builds.. :)03:41
lifelessSpamapS: \o/03:41
SpamapSlifeless: should I start at undercloud or overcloud?03:41
SpamapSundercloud should actually already have it03:41
SpamapSno n/m03:42
SpamapSthat was all ci-overcloud03:42
lifelessSpamapS: I would start at undercloud03:42
lifelessit should come up properly on reboot now - eni was broken03:43
lifeless169.154 is not 169.25403:43
StevenKSpamapS: Can I bug for a review of https://review.openstack.org/#/c/83267/ ?03:43
SpamapSStevenK: is it more important than our undercloud randomly losing network connectivity?03:44
StevenKIt's very nice watching all the +1's roll in, it doesn't get it closer to landing :-)03:44
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Deploy overcloud images from seed  https://review.openstack.org/8512603:44
StevenKSpamapS: Nope, but it's very small.03:44
SpamapSStevenK: ok, I'll look when I am waiting on reboots or something03:44
lifelessits also a dep / overlap with some galway stuff03:45
SpamapSok, undercloud modules updated w/ o rebooting03:55
SpamapSwill do ci-overcloud next.. however, screaming child out there.. :-P03:56
*** eghobo has quit IRC03:58
*** eghobo has joined #tripleo04:00
*** matsuhashi has quit IRC04:01
*** eghobo has quit IRC04:02
*** theripper has quit IRC04:02
* tchaypo hates today04:05
*** matsuhashi has joined #tripleo04:05
StevenKtchaypo: Oh?04:07
tchaypoi had stuff i wanted to do, but instead i spent half the day getting a working video driver. just left me with the grumps.04:09
tchaypoi took some time out for lunch and i fell a bit better, but *shrug*04:09
StevenKtchaypo: I spent a bunch of time trying to work out why I can't upgrade my laptop to trusty04:12
StevenKNow I'm building stuff04:12
StevenKSigh04:12
*** e0ne has joined #tripleo04:14
SpamapStchaypo: this is really something I am a bit dubious on. Canonical and Nvidia work pretty closely to make sure this doesn't happen.04:15
SpamapStchaypo: are you sure you didn't give up too quickly on the dumb / GUI methods?04:15
tchaypoSpamapS: not at all04:15
tchaypoSpamapS: i switched to a mac almost 10 years ago to avoid having to deal with things like this, and I've avoided linux on the desktop ever since.04:16
*** Rakesh5 has joined #tripleo04:16
tchaypomy knowledge of/patience with these tools is very low04:17
SpamapStchaypo: I've been running native Ubuntu on macs and random new-ish laptops for 3 years. Never once have I had issues like yours.04:17
SpamapStchaypo: I too made that switch around 2003 .. but I switched back in 2010. :)04:18
tchaypoI *am* pretty certain that my fumbling around made it worse before it got better.04:18
SpamapSYeah04:18
SpamapSdon't fumble04:18
SpamapSit's not like the old days04:18
tchayposo like04:18
SpamapSNvidia, intel, and ATI drivers "just work".04:18
SpamapSStevenK: you too.. why are you building?04:19
*** e0ne has quit IRC04:19
StevenKI've had Nvidia issues on a desktop, it would change random pixels to blue, and the longer the machine was on, the more pixels that would be blue. And using 3D would cause the machine to hard lock.04:19
tchaypoone of the first things I thought was that I must need to rebuild the nvidia driver for the new kernel04:19
SpamapShah yeah04:19
SpamapSfail04:19
tchaypoquick spot of googling and I end up at https://help.ubuntu.com/community/BinaryDriverHowto/Nvidia04:19
StevenKTurns out the GDDR RAM used on the card had a bad batch, so a lot of the cards were actually broken.04:19
StevenKSpamapS: Cinnamon.04:19
SpamapSHave not had an nvidia box since 12.04 was out, but back then the GUI just told you "your graphics are probably awful because you're not running the right driver. Want closed source drivers?"04:19
SpamapSStevenK: well then you have no excuse.04:20
SpamapSYou asked to be an outcast. ;)04:20
SpamapSBut good on you for sticking with ye olde gnome04:20
StevenKSpamapS: The cinnamon-stable PPA does not support Trusty, and the PPA description says "This PPA will not be receiving any new updates."04:20
*** nosnos has joined #tripleo04:20
StevenKSo, insert random swearing here.04:20
SpamapSStevenK: ---> xfce04:20
SpamapSdo it04:20
SpamapSbe happy04:20
StevenKBut xfce is UGLY04:21
SpamapSor accept our new unity overlords04:21
StevenKUnity can DIAF too04:21
* SpamapS for one welcomes them04:21
tchaypowhich starts with a list of drivers i might want to use, but says nothing about how to figure out which one I want; and then moves onto telling me to tinker with additional drivers in a place that doesn't exist in trusty04:21
StevenKI could just switch to e17 on the laptop too04:21
SpamapStchaypo: egads, don't listen to anything on help.ubuntu.com ;)04:21
tchaypoit tells me to "run nvidia-xconfig", but I didn't have that command available. It came back at some point and I don't know why - I'm fairly sure it wasn't related to installing a package04:22
SpamapShaha e17.. Ok now I know you're trolling me04:22
tchaypois there a better source?04:22
StevenKsteven@undermined:~% w | head -n 3 | tail -n 104:22
StevenKsteven   tty7     :0               00:25   14:57m 20:47   0.03s /usr/bin/enligh04:22
StevenKSpamapS: ^04:22
StevenKSpamapS: When wgrant was over here with lifeless, his comment was "Actual OMG, you weren't lying about running e17."04:25
SpamapSclint     tty7      :0         00:42  19:47m 21:25  4.10s /usr/bin/duke-nukem04:25
* tchaypo chortles04:25
StevenKSpamapS: Hah04:26
SpamapSStevenK: Are you a robert frost fan by any chance.. ;)04:26
StevenKNope04:26
SpamapStchaypo: so why didn't you try, say, apt-get install nvidia-319-updates ?04:26
tchaypos/319/331/04:27
tchaypobut I did do that.04:27
SpamapSoh 331 right I"m on 12.10 still04:27
SpamapSerr04:27
SpamapS13.1004:27
StevenKHeh04:27
StevenK12.10 is long dead04:27
SpamapSStevenK: except on our undercloud ;)04:28
* StevenK whimpers04:28
SpamapS"we'll update that... some day"04:28
tchaypoHow does the -updates package differ?04:29
StevenKOh. It doesn't die until this month04:29
tchaypoIn the end I had to purge that and install the original nvidia-331 package04:29
*** akuznetsov has joined #tripleo04:29
SpamapStchaypo: IIRC updates will update itself from nvidia for minor releases.04:30
SpamapSbut my info may be well out of date for that04:30
tchaypoIn the end what got me sorted was loading the module and restarting lightdm04:31
StevenKThe binary drivers do no such thing04:31
tchaypoI'm wondering if maybe that was the only problem I ever had04:31
StevenKtchaypo: X should load the module when it starts04:31
StevenKBut I've been using Nvidia on this machine since I installed it04:31
tchayposhould, yes.04:31
StevenKsteven@undermined:~% cat /var/log/installer/media-info04:32
StevenKUbuntu 10.10 "Maverick Meerkat" - Release amd64 (20101007)04:32
SpamapSnice I have a box here that made it from 10.10 to 12.1004:32
SpamapSit still "works" too, but battery is dead and fans run constantly...04:32
SpamapSMBP Unibody 1st gen.. I think it must be full of dust or something04:32
tchaypoin other news - for some reason i had the impression that the pypi element would create the cache under ~/.cache/image-create/pypi/mirror and populate it, but it wasn't doing that for me this morning04:33
StevenKsteven@ravaged:~$ grep RELEASE /var/log/installer/lsb-release04:33
StevenKDISTRIB_RELEASE=8.0404:33
StevenK:-)04:33
StevenKCurrently 12.04, will get 14.04 a few weeks after release04:33
*** killer_prince2 has joined #tripleo04:34
lifelessStevenK: I don't run e1704:37
SpamapSlifeless: ok ci-overcloud updated too04:37
SpamapSlifeless: had to bounce openvswitch-switch after the module reload04:37
StevenKlifeless: I meant wgrant commented04:37
lifelessStevenK: still confused04:38
lifelessStevenK: OH, that *you* run e17?04:38
StevenKlifeless: Right.04:38
StevenKCraige mocked me when I was out to dinner with him in Sydney saying e18 is the new hotness04:39
lifelessit is, the whole desktop is one binary now04:41
lifelessI hear he's working on making the browser be a .so04:41
lifeless /troll04:42
lifelessok so where was I04:42
lifelessright04:42
lifelessSpamapS: did you turn gro off after the reboot04:43
* lifeless puts that in eni04:44
lifelessdone04:45
SpamapSlifeless: no, just did now04:45
lifelessthat should get us some slaves04:45
SpamapSlifeless: curious though, what if we lowered MTU on the vms, wouldnt we be able to leave GRO on?04:45
lifelessSpamapS: perhaps04:46
*** killer_prince2 is now known as lazy_prince04:46
lifelessSpamapS: I've had inconsistent results with that04:47
tchaypoumm.04:47
lifelessmmmm?04:49
tchaypooh phew. the random prompt I just get from an apt-get update is from _setup, not _seed04:49
tchaypoi thought it was weird to get a prompt in the middle of building an image04:50
lifelessit would be indeed04:50
lifelessSpamapS: so - https://review.openstack.org/#/c/83267/ please :)04:50
tchaypoanyway, I think I have a simpler way to solve the problem rather than patching pip04:50
tchaypodrop a file called something like /opt/stack/extra-requirements-to-work-around-case-insensitive-silliness.txt, which for now just contains MarkupSafe; find the few places in t-i-e where we create a venv, and have each of those places pip -r that file04:51
*** cwolferh has quit IRC04:52
lifelesstchaypo: assuming MarkupSafe is the only problem04:52
lifelesstchaypo: has dstufft given further feedback ?04:52
tchaypoif it's not, it's simple enough to edit that file and re-run image-create04:52
lifelessthe downside is it will suck in the transitive closure of marksupsafe deps even if marksupsafe wouldn't be installed in a given venv04:55
tchaypofortunately it has no deps04:55
tchaypothat could be more of an issue for other things04:56
tchaypotaking a step back04:56
tchaypoas far as i can tell, "pip install --no-use-wheel -U pip" works for me - because it grabs the no-wheel version from the internet, not from /tmp/pypi04:57
tchayposince the whole reason we've got this issue that we don't want to hit the internet because it's flaky, I don't want to do that at image-create time; i think it should be done when we create the cache04:58
lifelesstchaypo: your mirror also has non-wheels05:00
lifelesstchaypo: you may not have configured both mirrors05:00
lifelesstchaypo: but there's no implication of internet use with the --no-use-wheel approach05:00
lifelesstchaypo: you can test using DIB_NO_PYPI_PIP=1 (IIRC - see the pypi element readme)05:01
*** cwolferh has joined #tripleo05:01
tchaypo07:02:04 0 0 polleyj@bill:~/.cache/image-create/pypi/mirror (master)$ ls pip05:03
tchaypoindex.html  pip-1.5.4-py2.py3-none-any.whl05:03
tchaypo07:02:06 0 0 polleyj@bill:~/.cache/image-create/pypi/mirror (master)$05:03
tchaypoyour mirror might have non-wheels, mine doesn't.05:03
lifelesstchaypo: how did you make your mirror ?05:03
lifelesstchaypo: do you have a subnet Ubuntu* ?05:03
lifelesss/net/dir/05:03
tchayporun-mirror -c pypi-mirror.yaml05:04
tchaypoyes; Ubuntu-14.04/pip/ also only has a wheel05:04
lifelessI believe that is absolutely meant to grab non-wheels05:04
lifelessthere was a bugfix about that recently05:04
tchaypoyep05:09
tchaypohttps://pypi.python.org/pypi/pypi-mirror/1.0.005:09
lifelessoh yeah05:09
tchaypolooks like it hasn't been released though05:09
lifelessdon't install that05:09
lifelessinstall git05:09
lifelesswhich the pypi README explicitly says to do :P05:09
lifeless'win 4805:09
tchaypowhich pypi readme?05:10
tchaypo*answers own question*05:10
tchaypohttps://github.com/openstack/diskimage-builder/blob/master/elements/pypi/README.md05:10
* tchaypo rebuilds mirror05:13
*** e0ne has joined #tripleo05:14
* StevenK stabs tchaypo for linking github URLs05:15
tchaypowhere's that script that shows the history of passed/failed checks?05:15
tchaypo*shrug* that's what you get when you ask the google.05:18
*** e0ne has quit IRC05:19
StevenKtchaypo: http://paste.openstack.org/show/69276/ ? :-)05:20
tchaypohere we go05:24
tchaypo http://goodsquishy.com/downloads/tripleo-jobs.html05:24
tchaypothere is totes deffo a problem with ironic-undercloud-precise05:24
* tchaypo looks at topic05:24
tchaypooh.05:25
StevenKtchaypo: lifeless sent a mail about ironic-undercloud-precise, too05:25
*** lifeless changes topic to " tripleo-cd running preserve-ephemeral WIP patches and https://review.openstack.org/#/c/62042/ | Using OpenStack to deploy OpenStack;meetings Tuesday 1900 UTC in #openstack-meeting-alt"05:26
* tchaypo can't see the mail05:26
lifeless[tripleo][ci] from me05:26
lifelesslast friday or so05:26
tchaypooh, that long ago05:26
tchaypothe one that said "don't rely on it for now"?05:26
StevenKRargh05:27
lifelesstchaypo: yes05:27
lifelessci has been down since so no fix05:27
tchaypostill nothing but wheels. hrm.05:28
*** CaptTofu has joined #tripleo05:29
openstackgerritSteve Kowalik proposed a change to openstack/tripleo-incubator: Pass the baremetal bridge to create-nodes  https://review.openstack.org/8326705:29
StevenKBleh, two +2s and a +A and then "This change was unable to be automatically merged with the current state of the repository."05:29
StevenKAround the merry-go-round again05:30
openstackgerritA change was merged to openstack/tripleo-incubator: Pass the baremetal bridge to create-nodes  https://review.openstack.org/8326705:34
tchaypo*headdesk**headdesk**headdesk*05:53
StevenKtchaypo?05:55
tchaypoIf I'm reading this correctly, run-mirror *will* download non-wheels of everything listed in the requirements.txt05:56
*** CaptTofu has quit IRC05:56
tchaypobut a very special set of things - pip, virtualenv, setuptools - get treated specially, in addition to all the things in the requirements.txts05:57
clarkbtchaypo: yes, there is an open bug05:57
clarkbtchaypo: please to fix05:57
tchaypothose things get upgraded, not installed, and the upgrade_format doesn't have --no-use-wheel05:57
tchayposo pip ends up in the mirror in wheel form only05:57
clarkbtchaypo: yes, and you need to reinstall them because if they are already installed pip goes meh05:57
tchaypoclarkb: I wish you'd told me I'was wrong05:58
clarkbyou aren't05:58
* clarkb finds bug05:58
tchaypodammit.05:58
clarkbtchaypo: https://bugs.launchpad.net/openstack-ci/+bug/129438105:58
tchayposorry, this is getting too far down the rbabbit hole05:58
uvirtbotLaunchpad bug 1294381 in openstack-ci "pypi-mirror does not pickup all necessary python packages" [Medium,Triaged]05:58
clarkbthe proposed fix there isn't the right fix05:58
clarkbbut I have plenty of words written out about how I think it should be fixed05:58
tchaypowhat I'm trying to do is provide a way for someone to get around pip case-insensitiveness for file:/// mirrors while we wait for my patch to pip to land05:59
tchaypoat this point, I'm pretty sure my suggestion of just finding all the places in t-i-e where we create a virtualenv and "pip install -r some-requirements.txt" is a simpler fix that lets me just move on.06:00
*** markmc has joined #tripleo06:00
clarkbtchaypo: its actually a simple fix to pypi-mirror06:00
clarkbI haven't written it beacuse at least 2 people appeared interested in writing it (I practically spelled it out in the bug though)06:00
clarkbat some point I will probably cave and just do it if no one beats me to it06:01
tchaypothere's a chance I'll get to it early monday; right now I have errands I need to go and run06:06
*** e0ne has joined #tripleo06:14
*** mrunge has joined #tripleo06:16
*** e0ne_ has joined #tripleo06:16
*** e0ne has quit IRC06:18
SpamapStchaypo: there are very few places we explicitly call pip ... os-svc-install encapsulates most of it06:36
*** jtomasek has joined #tripleo06:41
*** yamahata has quit IRC07:06
*** matsuhashi has quit IRC07:07
*** ifarkas has joined #tripleo07:16
*** divakar has joined #tripleo07:17
*** yamahata has joined #tripleo07:24
*** rdopieralski has joined #tripleo07:24
*** bauzas has joined #tripleo07:32
GheRiverook. morning all07:33
openstackgerritA change was merged to openstack/tuskar-ui: Catching 500 from heat during stack-create  https://review.openstack.org/8498807:34
openstackgerritRyan Moore proposed a change to openstack/tripleo-heat-templates: Set the glance_port as Heat configurable  https://review.openstack.org/8508107:34
rpodolyakamorning all07:39
mariosmorning07:43
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Encapsulate getting image for a deployment.  https://review.openstack.org/8513007:43
*** ramishra has quit IRC07:43
marioslifeless: q: do reviews in tuskar-ui count towards the statistics?07:44
*** jprovazn has joined #tripleo07:46
lifelessmarios: no, horizon now07:49
lifelessmarios: but tripleo-heat-templates does, as will os-cloud-config once I get the config update (reminds self to do that)07:49
marioslifeless: thanks. i suspected as much but wasn't sure. ok so i need to change my review routine07:50
lifelessmarios: horizon needs tripleo-ui added07:50
lifelesswill put that in the same patch07:50
lifelessmarios: ah the stats in my email include it, but shouldn't have.07:51
marioslifeless: right. i obviously knew it was under horizon but just didn't know what that meant for the review stats07:52
lifelesshttps://review.openstack.org/8526107:52
mariosthanks07:53
*** viktors has joined #tripleo07:53
*** petertoft has joined #tripleo07:56
*** e0ne_ has quit IRC08:01
*** e0ne has joined #tripleo08:02
*** matsuhashi has joined #tripleo08:04
*** martyntaylor has joined #tripleo08:04
*** d0ugal has joined #tripleo08:06
*** e0ne has quit IRC08:06
*** martyntaylor has quit IRC08:09
*** jistr has joined #tripleo08:10
*** derekh has joined #tripleo08:10
openstackgerritGonéri Le Bouder proposed a change to openstack/diskimage-builder: use sudo to create file in the chroot  https://review.openstack.org/8518308:13
openstackgerritGonéri Le Bouder proposed a change to openstack/diskimage-builder: debian: use sudo to create file in the chroot  https://review.openstack.org/8518308:14
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Read libvirt block_migration_flag from nova.conf  https://review.openstack.org/8465708:16
openstackgerritjan grant proposed a change to openstack/diskimage-builder: Hard-link multiple identical files.  https://review.openstack.org/8438408:17
*** hashar has joined #tripleo08:18
*** hashar_ has joined #tripleo08:21
*** hashar has quit IRC08:24
*** martyntaylor has joined #tripleo08:25
*** giulivo has joined #tripleo08:25
openstackgerritjan grant proposed a change to openstack/tripleo-image-elements: Ensure the (block) loop device is available.  https://review.openstack.org/8338308:26
*** lucasagomes has joined #tripleo08:26
*** gcha has joined #tripleo08:28
*** pblaho has joined #tripleo08:29
*** stevehuang has quit IRC08:34
*** akuznetsov has quit IRC08:34
*** stevehuang has joined #tripleo08:34
*** matsuhashi has quit IRC08:35
*** akuznetsov has joined #tripleo08:35
lifelesswe're down to only 5 hours behind. yay.08:36
shadowerlifeless: on reviews?08:37
*** athomas has joined #tripleo08:37
lifelessCI08:42
rcarrillocruzlifeless: morning sir, if you have a moment would you mind reviewing https://review.openstack.org/#/c/82763/ ? i put a more thorough commit message as you suggested08:43
openstackgerritA change was merged to openstack/tripleo-incubator: Make the baremetal-network configurable  https://review.openstack.org/8232708:46
*** matsuhashi has joined #tripleo08:53
openstackgerritGhe Rivero proposed a change to openstack/tripleo-incubator: Allow to set seed node cpus and memory  https://review.openstack.org/8407808:54
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Allow setting of cinder_ca_certificates_file  https://review.openstack.org/8526808:57
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Allow setting of cinder_ca_certificates_file  https://review.openstack.org/8526808:59
*** jp_at_hp has joined #tripleo09:01
*** untriaged-bot has joined #tripleo09:01
untriaged-botUntriaged bugs so far:09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130214809:01
uvirtbotLaunchpad bug 1302148 in tripleo "error: Unable to add port vnet2 to OVS bridge br-ctlplane: Operation not permitted" [Undecided,New]09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130069309:01
uvirtbotLaunchpad bug 1300693 in tripleo "devtest.sh run leaves 3 default security groups" [Undecided,Incomplete]09:01
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/129048809:01
uvirtbotLaunchpad bug 1290488 in tripleo "Baremetal: Invalid credentials" [Undecided,Incomplete]09:01
*** untriaged-bot has quit IRC09:01
*** tzumainn has quit IRC09:01
*** divakar has quit IRC09:01
*** tzumainn has joined #tripleo09:02
*** cwolferh has quit IRC09:03
*** tzumainn has quit IRC09:06
*** tzumainn has joined #tripleo09:06
openstackgerritGonéri Le Bouder proposed a change to openstack/diskimage-builder: check for a root.d element as soon as possible  https://review.openstack.org/8527109:07
openstackgerritGonéri Le Bouder proposed a change to openstack/diskimage-builder: raise an error if two element provide root  https://review.openstack.org/8527209:07
openstackgerritGonéri Le Bouder proposed a change to openstack/diskimage-builder: check element list during the start up  https://review.openstack.org/8518409:07
*** e0ne has joined #tripleo09:08
openstackgerritAndrea Rosa proposed a change to openstack/tripleo-heat-templates: Adding VNC params to over and undercloud metadata  https://review.openstack.org/8527309:10
openstackgerritAndrea Rosa proposed a change to openstack/tripleo-heat-templates: Adding VNC params to over and undercloud metadata  https://review.openstack.org/8527309:14
*** jprovazn has quit IRC09:17
*** hashar_ is now known as hashar09:17
openstackgerritA change was merged to openstack/tripleo-incubator: Allow set-source-vars to consume a git manifest  https://review.openstack.org/8061709:24
Gonerihi all, I opened a review regarding the indent rules in the bash code ( https://review.openstack.org/#/c/84960/ ) 2 spaces, seems to be the defacto standard from what I saw so far.09:29
GoneriDo you think such topic deserve a more formal discussion on the mailing list. Or the review, if fine?09:30
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Allow setting until_refresh  https://review.openstack.org/8527709:37
*** e0ne_ has joined #tripleo09:41
openstackgerritDougal Matthews proposed a change to openstack/tripleo-incubator: Register the Tuskar Service in the Undercloud  https://review.openstack.org/8505009:44
*** e0ne has quit IRC09:45
*** matsuhashi has quit IRC09:47
*** matsuhashi has joined #tripleo09:47
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Allow setting neutron_url_timeout  https://review.openstack.org/8528309:50
*** jprovazn has joined #tripleo09:53
lifelessrcarrillocruz: ok so09:56
lifelessrcarrillocruz: I think the thing missing is the description of the problem it causes09:57
lifelessrcarrillocruz: at the moment it doesn't describe any problem that its fixing:)09:58
shadowerandrearosa: sorry for the confusion. The "looks good" comment was meant as "looks good, but there are a few things to fix. Please see the comments inline."10:01
shadowerandrearosa: is that a bit clearer?10:01
andrearosashadower: I can't see any comments inline10:02
lifelessrcarrillocruz: and I'm glad I'm asking for this, because I believe the bug to be invalid - the behaviour it describes doesn't seem to happen anymore - we now upgrade things rather than just doing the install once10:02
shadowerandrearosa: turns out I'm an idiot10:02
shadowerandrearosa: I added them to the first patchset but then click the review button on the second one so they weren't published10:03
lifelessshadower: do we have a quotes page?10:03
shadowerlifeless: if we don't we should start one10:03
shadowerandrearosa: I'll fix it in a moment, sorry10:04
andrearosashadower::) np, thanks for reviewing it10:04
andrearosashadower: that was funny because "looks good" but -1. I thought "it's good no improvement but -1 now I am stuck"10:05
rcarrillocruzlifeless: if there's any error during setup-clienttools, the openstack-tools folder remains created... shouldn't we clean it up ? that's the purpose of the fix. I agree the initial bug description is invalid at this time, the install-dependencis does not run setup-clienttools only if the openstack-tools folder does not exist. But the cleanup should still happen, in case of any errors, no?10:07
lifelessrcarrillocruz: whats wrong with it being created and kept ?10:08
lifelessrcarrillocruz: like say I have a fully functional folder and an update fails. We're now deleting something that works.10:09
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Allow setting of wsgi_default_pool_size  https://review.openstack.org/8528510:09
shadowerandrearosa: okay the comments are now in. I had a few more about the trailing whitespace but you fixed that in the second patch already10:10
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Allow setting neutron_url_timeout  https://review.openstack.org/8528310:11
*** e0ne_ has quit IRC10:12
*** gcha has quit IRC10:12
*** e0ne has joined #tripleo10:12
andrearosashadower: thanks10:14
rcarrillocruzyeah ok, my rationale is about having setup-clieenttols atomic: if something fails, we have no folder at all, so if at a later time you go to the $BASE folder and you see there's not that folder you know you have to run it10:14
rcarrillocruzanyway, let me know if you want me to mark the bug as invalid10:14
rcarrillocruzand abandon the change10:14
*** akuznetsov has quit IRC10:15
lifelessrcarrillocruz: what about this10:15
lifelessrcarrillocruz: if there is no directory, then trap. Otherwise don't - we've previously succeeeded.10:15
rcarrillocruzgotcha, that way we have the atomicity10:16
rcarrillocruzthx, i will do that10:16
*** e0ne has quit IRC10:17
jp_at_hplifeless: is there anywhere stating what jobs are gating/non-gating for tripleo?  I just see people running rechecks if only ironic has failed, and if that's non-voting then there's not really a need, and the resources that consumes are probably better used for other things...10:18
lifelessjp_at_hp: http://lists.openstack.org/pipermail/openstack-dev/2014-March/031242.html10:19
jp_at_hplifeless: sure - and I saw a core comment on a review echoing that.  I wonder did some people not notice that on the mailing list :(10:20
lifelessI don't think there's an external ref10:21
lifelesswhat we should do is make the fedora and ironic-undercloud jobs be explictly tagged non-voting in zuul10:22
lifelessthat would make it clearer I think10:22
lifelessdown to 4 hours behind. So close to up to day10:22
lifelessjp_at_hp:  its too late for me but if you want to mail the list reminding people of this status, or comment on the reviews so they know - thats a good thing to do10:23
jp_at_hplifeless: that's a great idea, if it is explicit in the output.10:23
jp_at_hpsure - I'm glad I caught you.  I'll do what I can.10:23
*** matsuhashi has quit IRC10:23
*** matsuhashi has joined #tripleo10:30
GheRiverolifeless: anything I can step in before you go to enjoy the weekend?10:33
*** nosnos has quit IRC10:33
*** akuznetsov has joined #tripleo10:33
Gonerig10:34
lifelessGheRivero: yeah cool, gimme sec10:34
*** e0ne has joined #tripleo10:35
lifelessGheRivero: I pushed up a diskimage-builder tweak to make cache-url better10:35
lifelessGheRivero: and am mostly through reworking the patch sets10:35
*** akrivoka has joined #tripleo10:36
lifelessGheRivero: https://review.openstack.org/85130 <- I was just about to go through boot-seed-vm, devtest_ramdisk/devtest_undercloud/devtest_overcloud and make them use acquire-image10:36
lifelessGheRivero: and then start testing it all :)10:36
GheRiverosure10:36
*** e0ne_ has joined #tripleo10:37
lifelessGheRivero: I hope you like my rearrangment of things10:37
*** jistr has quit IRC10:37
lifelessGheRivero: one bit in specific to clal out - I want to decouple testenv layout from precise configurations - because CI doesn't know what test we're running10:37
lifelessGheRivero: thats why I dropped the delta to testenv for the no undercloud case10:38
*** matsuhashi has quit IRC10:38
GheRiverook. good to know10:39
*** nosnos has joined #tripleo10:39
*** e0ne has quit IRC10:40
*** matsuhas_ has joined #tripleo10:41
*** rlandy has joined #tripleo10:42
*** Rakesh5 has quit IRC10:43
GheRiverois the plumming for acquire-image in some patch?10:44
openstackgerritlifeless proposed a change to openstack/diskimage-builder: Permit cache-url to work with fifos.  https://review.openstack.org/8522410:44
lifelessGheRivero: I thought I pushed it to Iae40275bf94c644a552ace98805b75a6f2afcce110:44
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Deploy overcloud images from seed  https://review.openstack.org/8512610:45
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Make it possible to just build images.  https://review.openstack.org/8522210:45
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Make devtest_* accept options.  https://review.openstack.org/8522110:45
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Encapsulate getting image for a deployment.  https://review.openstack.org/8513010:45
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Setup nameservers in the default-net.  https://review.openstack.org/8521510:45
lifelessGheRivero: https://review.openstack.org/8513010:45
*** Rakesh5 has joined #tripleo10:45
GheRiverook got everything i need to work with10:45
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Always display at least 5% of the progress bar  https://review.openstack.org/8530410:45
lifelessGheRivero: I had 4 hours of meetinsg today - I have no idea if any of that stack works :)10:46
GheRiverolifeless: no problem. I will take it from here10:47
*** d0ugal has quit IRC10:51
*** matsuhas_ has quit IRC10:52
*** matsuhashi has joined #tripleo10:52
*** rlandy has quit IRC10:52
*** matsuhashi has quit IRC10:57
*** jistr has joined #tripleo10:58
*** hashar has quit IRC10:59
openstackgerritAna Krivokapic proposed a change to openstack/tuskar-ui: Enable sorting for the timestamp column  https://review.openstack.org/8025311:00
*** Rakesh6 has joined #tripleo11:01
*** Rakesh5 has quit IRC11:02
*** e0ne_ has quit IRC11:05
*** e0ne has joined #tripleo11:05
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Disable other dashboards  https://review.openstack.org/8530711:08
*** e0ne has quit IRC11:10
*** athomas has quit IRC11:18
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Remove project picker from the top bar  https://review.openstack.org/8531011:24
*** lucasagomes is now known as lucas-hungry11:27
*** petertoft has quit IRC11:29
akrivokardopieralski: commit msg FTW ^11:30
*** nosnos has quit IRC11:30
openstackgerritA change was merged to openstack/tuskar-ui: Missing import url  https://review.openstack.org/8507211:33
*** athomas has joined #tripleo11:33
openstackgerritA change was merged to openstack/tuskar-ui: Add missing Nodes heading  https://review.openstack.org/8511711:34
*** gcha has joined #tripleo11:34
openstackgerritA change was merged to openstack/tuskar-ui: Add node filter  https://review.openstack.org/8514611:34
rdopieralskiakrivoka: it's friday :P11:35
*** eghobo has joined #tripleo11:36
*** yamahata has quit IRC11:36
openstackgerritA change was merged to openstack/tuskar-ui: Modified deployment creation message  https://review.openstack.org/8516311:37
openstackgerritA change was merged to openstack/tuskar-ui: Fix test caching  https://review.openstack.org/8443611:37
akrivokardopieralski: testing https://review.openstack.org/#/c/85307, I'm getting NameError: name 'HORIZON_CONFIG' is not defined11:41
openstackgerritTzu-Mainn Chen proposed a change to openstack/tuskar-ui: Rename node profile to flavor  https://review.openstack.org/8511611:43
openstackgerritA change was merged to openstack/tuskar-ui: Hide non working scaling  https://review.openstack.org/8441311:45
openstackgerritGerry Drudy proposed a change to openstack/tripleo-image-elements: Add swift-get-nodes, swift-recon and swift-recon-cron  https://review.openstack.org/8468911:49
openstackgerritAlexis Lee proposed a change to openstack/tripleo-image-elements: Add script to check that scripts are executable  https://review.openstack.org/8531511:50
*** e0ne has joined #tripleo11:52
openstackgerritAlexis Lee proposed a change to openstack/tripleo-image-elements: Add script to check that scripts are executable  https://review.openstack.org/8531511:53
*** e0ne_ has joined #tripleo11:54
*** e0ne has quit IRC11:57
*** e0ne_ has quit IRC11:59
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Disable other dashboards  https://review.openstack.org/8530712:01
rdopieralskiakrivoka: I guess our example local_settings differs from horizon's12:01
rdopieralskiakrivoka: fixed12:01
akrivokardopieralski: yeah I guess we need to keep our local_settings in sync with horizon's... that's kind of... suboptimal :)12:03
rdopieralskiakrivoka: in J we can get rid of them completely12:04
rdopieralskiakrivoka: once we get TUSKAR_URL from keystone12:04
akrivokardopieralski: nice12:05
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Remove project picker from the top bar  https://review.openstack.org/8531012:06
*** mrunge has quit IRC12:07
*** dprince has joined #tripleo12:19
*** eghobo has quit IRC12:21
*** hashar has joined #tripleo12:24
*** weshay has joined #tripleo12:26
*** e0ne has joined #tripleo12:35
*** lblanchard has joined #tripleo12:35
openstackgerritTzu-Mainn Chen proposed a change to openstack/tuskar-ui: Clarified initialization message  https://review.openstack.org/8516612:37
dprincederekh: was to finally setup your squid yum rewriter today. Other than configure squid to use that what else do you do?12:40
dprincederekh: also, should we add this to the incubators squid instructions? (seems useful too me)12:40
*** lucas-hungry is now known as lucasagomes12:41
openstackgerritA change was merged to openstack/tuskar-ui: Enable sorting for the timestamp column  https://review.openstack.org/8025312:42
*** jdob has joined #tripleo12:44
openstackgerritA change was merged to openstack/tuskar-ui: Rename node profile to flavor  https://review.openstack.org/8511612:45
*** noslzzp has joined #tripleo12:46
*** d0ugal has joined #tripleo12:46
*** sballe has quit IRC12:46
*** sballe has joined #tripleo12:47
derekhdprince: you may want to change the yum mirror I hardcoded to something closer12:48
dprincederekh: yep, got that12:48
derekhdprince: yup, If you think its a benifet we can add it12:48
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Allow setting nova common configuration options  https://review.openstack.org/8467212:49
derekhdprince: although I did not that rpm's are being cached locally aswell so I'm not 100% sure how beneficial it is anymore12:49
dprincederekh: Yeah. I'm not seeing any hits yet on my seed build.12:50
dprincederekh: so once the squid rewriter is configured you should just need to set http_proxy, http_proxy env vars?12:50
derekhdprince: yup, proxy should work as normal except all rpm requests will be targetted at thew same mirror12:51
dprincederekh: yeah, my access log was still empty. :(. So I was thinking if we got this working we could use it in CI instead of hosting a mirror.12:52
*** CaptTofu has joined #tripleo12:52
dprincederekh: The mirrors content is quite big, and if we need to tear it down it may take hours to rebuild. If we used the squid approach the green field approach would be a bit faster to heal itself I think.12:53
derekhdprince: a good idea worth a shot,12:53
openstackgerritRyan Moore proposed a change to openstack/tripleo-image-elements: Allow setting of rpc_all configuration options  https://review.openstack.org/8505912:54
*** julim has joined #tripleo12:55
derekhdprince: btw, I notice one of the compute nodes on the rh rack is powered down, no idea why, when I tried to start it "nova start" never returned12:56
Ngmorning12:56
derekhdprince: I then noticed undercloud is nearly out of disk space12:56
openstackgerritDerek Higgins proposed a change to openstack/tripleo-image-elements: Disable the mysql slow query log  https://review.openstack.org/8533112:57
derekhdprince: 15G because of ^^12:57
dprincederekh: oh dear!12:57
derekhdprince: and 11G in keystone tokens12:57
derekhdprince: in the process of deleteing the keystone tokens at the moment, 1 day at a time12:58
derekhdidn't we have a script for that?12:59
dprincederekh: I seem to recall one, forget where it is though...12:59
*** morazi has joined #tripleo12:59
rpodolyakacleanup-keystone-tokens.sh from keystone element?13:01
rpodolyakait must be in cron already, though13:01
dprincederekh: 635M mysql-slow.log.gz13:01
derekhdprince: yup, I zipped it13:01
dprincederekh: okay. we can probably just nuke it outright.13:02
dprincederekh: I doubt there is anything unreproducable in our UC mysql logs13:02
derekhdprince: ok13:02
*** julim has quit IRC13:03
dprincederekh: we also set our root partions way to small and we are using "ephemeral" yet.13:03
dprincederekh: there should be a ton of space on the undercloud we could tap into....13:04
derekhdprince: ya we did13:04
derekhdprince: we could maount the other 3 drives?13:04
dprincederekh: as this is just the UC I'm not sure we'll need it so that we aren't logging like crazy13:04
derekhdprince: ok13:05
*** julim has joined #tripleo13:05
derekhrpodolyaka: found the script, its not installed on fedora13:06
derekh# percona-tookit is NOT supported on Fedora (retrieved 25-06-2013)13:07
dprincederekh: yeah, just a slight oversight when I was spinning it up. Lets roll with it for now and just keep an eye on it. Honestly, it sounds like having it smaller helped find an issue here anyways (the mysql logging issue)13:07
*** CaptTofu has quit IRC13:07
derekhdprince: yup, we may need space at some stage if we start storing multiple image version but if we do we can mount space13:08
dprincederekh: yep, sounds good13:08
derekhdprince: were going to need to add a cronjob "delete from token where expires <= TIMESTAMP;"13:09
* derekh will look into putting a fedora alternative in keystone/install.d/keystone-source-install/70-keystone13:11
*** d0ugal has quit IRC13:11
openstackgerritAndrea Rosa proposed a change to openstack/tripleo-image-elements: Adding libvirt options for injection and rescue  https://review.openstack.org/8533913:14
*** d0ugal has joined #tripleo13:15
dprincederekh: I left you feedback, but I'm wondering if log_queries_not_using_indexes=1 is the problem.13:16
*** CaptTofu has joined #tripleo13:17
*** mclaren has quit IRC13:17
*** sballe has quit IRC13:18
dprincederekh: we have a ton reasonably fast queries getting logged13:18
*** sballe has joined #tripleo13:18
*** john-n-seattle1 has joined #tripleo13:19
rcarrillocruzdprince: hi, re: https://review.openstack.org/#/c/84801/ , could you please tell me which fedora releases you know that work with devtest? i only have exposure with ubuntu testing....13:19
*** noslzzp_ has joined #tripleo13:19
*** noslzzp has quit IRC13:19
*** noslzzp_ is now known as noslzzp13:19
dprincercarrillocruz: Fedora 2013:20
dprincercarrillocruz: We've used Fedora 19 and Fedora 18 too. But may as well go with the latest... that is what I think pretty much everyone uses.13:21
rcarrillocruzyou think it's better to have a table showing a supported platforms matrix?13:24
dprincederekh: re the keystone cron job ack. I remember the lack of Percona on Fedora being the missing link in supporting cleanup-keystone-tokens.sh now13:25
rcarrillocruzin the README.md i mean13:25
dprincercarrillocruz: that would be fine too13:25
dprincercarrillocruz: just curious, did you try devtest with an unsupported distro and it didn't work?13:26
*** e0ne_ has joined #tripleo13:26
*** rlandy has joined #tripleo13:26
rcarrillocruzwell, yeah, thing is i filed a bug cos i was getting much grief with Ubuntu 12.04 and i was told on IRC that it wasn't supported13:27
rcarrillocruzbut then you and tchaypo suggested to extend the scope of the bug a bit, so i wonder what's the best way to document it13:28
*** matty_dubs|gone is now known as matty_dubs13:28
openstackgerritA change was merged to openstack/tuskar-ui: Clarified initialization message  https://review.openstack.org/8516613:28
rcarrillocruzi think i'll just start with ubuntu 12.04 , 13.10 and Fedora2013:28
openstackgerritA change was merged to openstack/tuskar-ui: Remove project picker from the top bar  https://review.openstack.org/8531013:28
dprincercarrillocruz: always going to be a moving target...13:28
rcarrillocruzothers may then open bugs against documentation to put new platforms known to work or not working, etc13:28
rcarrillocruzyeah, that's why i put in the readme 'go with the latest ubuntu'13:29
rcarrillocruzother than that, i can put 'use latest ubuntu and fedora, do not use 12.04'13:29
*** e0ne has quit IRC13:29
rcarrillocruzotherwise we'll have to file bugs against it everytime a new release is out13:29
rcarrillocruznot very nice tbh13:29
derekhdprince: I'll take another look at the log_queries_not_using_indexes thing and see if it helps13:30
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Disable other dashboards  https://review.openstack.org/8530713:36
*** john-n-seattle1 has left #tripleo13:39
*** d0ugal has quit IRC13:42
openstackgerritA change was merged to openstack/tuskar-ui: Always display at least 5% of the progress bar  https://review.openstack.org/8530413:49
openstackgerritMichael Kerrin proposed a change to openstack/tripleo-incubator: Updates should preserve ephemeral data  https://review.openstack.org/8535313:52
*** e0ne_ has quit IRC13:57
*** e0ne has joined #tripleo13:57
jp_at_hpCan I get some core attention on some changes please?13:58
jp_at_hpGheRivero: ^^^?13:58
jp_at_hphttps://review.openstack.org/#/c/84763/13:58
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Only route everything through the seed if...  https://review.openstack.org/8535513:58
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Don't hard code the baremetal seed IP in seedrc  https://review.openstack.org/8312613:58
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Write network configuration into seeds config.json  https://review.openstack.org/8312513:58
jp_at_hphttps://review.openstack.org/#/c/85009/13:59
*** e0ne has quit IRC14:02
geerdestadding ntp element and NtpServer=server.hp.com metadata to overcloud control image build keeps heat from finishing and ssh never works.  any ideas?14:06
openstackgerritA change was merged to openstack/tuskar-ui: Disable other dashboards  https://review.openstack.org/8530714:07
*** d0ugal_ has joined #tripleo14:07
openstackgerritRicardo Carrillo Cruz proposed a change to openstack/tripleo-incubator: Add 'Supported Platforms' section in README.md  https://review.openstack.org/8480114:10
rcarrillocruzdprince: just pushed a new patchset about the supported platforms section in the README.md . I've tried to put it in a way it doesn't put us in a situation we have to maintain the README for each release that goes in the wild, while giving some direction to new users about what to use14:11
*** derekh has quit IRC14:13
openstackgerritLadislav Smola proposed a change to openstack/tuskar-ui: Catching overcloud keystone exception  https://review.openstack.org/8536414:15
*** jdob_ has joined #tripleo14:16
*** d0ugal_ is now known as d0ugal14:18
openstackgerritLadislav Smola proposed a change to openstack/tuskar-ui: Catching overcloud keystone exception  https://review.openstack.org/8536514:18
*** d0ugal is now known as d0ugal_14:19
*** d0ugal_ is now known as d0ugal14:19
*** d0ugal has joined #tripleo14:19
openstackgerritjan grant proposed a change to openstack/diskimage-builder: Fake up the behaviour of uname inside the chroot  https://review.openstack.org/8536714:22
*** sdake_ has quit IRC14:25
*** sdake_ has joined #tripleo14:27
*** jdob_ has quit IRC14:30
openstackgerritLadislav Smola proposed a change to openstack/tuskar-ui: Undeploy in progress page  https://review.openstack.org/8537114:35
*** petertoft has joined #tripleo14:39
*** jistr is now known as jistr|biab14:40
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: SSH key and virtual_power_driver not used on H/W  https://review.openstack.org/8377014:40
*** hashar has quit IRC14:41
*** bauzas has quit IRC14:41
*** hashar has joined #tripleo14:41
*** mkerrin has quit IRC14:42
*** phschwartz has quit IRC14:44
*** phschwartz has joined #tripleo14:44
*** bnemec is now known as beekneemech14:45
openstackgerritAndrea Rosa proposed a change to openstack/tripleo-image-elements: Allow settings for metadata workers  https://review.openstack.org/8537814:51
*** phschwartz has quit IRC14:52
*** phschwartz has joined #tripleo14:52
*** yamahata has joined #tripleo14:55
*** lsmola_ has quit IRC14:56
*** untriaged-bot has joined #tripleo15:00
untriaged-botUntriaged bugs so far:15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130214815:00
uvirtbotLaunchpad bug 1302148 in tripleo "error: Unable to add port vnet2 to OVS bridge br-ctlplane: Operation not permitted" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130069315:00
uvirtbotLaunchpad bug 1300693 in tripleo "devtest.sh run leaves 3 default security groups" [Undecided,Incomplete]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130262915:00
uvirtbotLaunchpad bug 1302629 in tripleo "Network problems in user VM after overcloud-compute image update" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/129048815:00
uvirtbotLaunchpad bug 1290488 in tripleo "Baremetal: Invalid credentials" [Undecided,Incomplete]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130255915:00
*** untriaged-bot has quit IRC15:00
uvirtbotLaunchpad bug 1302559 in tripleo "After update of overcloud with new compute image user vm are unavailable" [Undecided,New]15:00
*** _ewindisch has joined #tripleo15:02
openstackgerritA change was merged to openstack-infra/tripleo-ci: No longer source undercloudrc  https://review.openstack.org/8325115:02
*** ewindisch has quit IRC15:04
*** _ewindisch is now known as ewindisch15:04
*** jang1 has joined #tripleo15:04
*** CaptTofu has quit IRC15:04
*** bauzas has joined #tripleo15:05
openstackgerrittherese-mchale proposed a change to openstack/tripleo-image-elements: Glance: make registry workers configurable  https://review.openstack.org/7892115:07
openstackgerritAna Krivokapic proposed a change to openstack/tuskar-ui: Improve deployment page  https://review.openstack.org/8470215:15
*** petertoft has quit IRC15:17
*** gcha has quit IRC15:17
*** hashar has quit IRC15:19
devanandag'morning, folks! question about flavor / resource consumption15:20
devanandahave ya'll noticed whether, on an inexact match of flavor<->node, does the scheduler consume 100% of the node's resources? or only what's in the flavor?15:20
*** ilives has quit IRC15:25
openstackgerritjan grant proposed a change to openstack/diskimage-builder: Parameterise PXE kernel and initrd selection  https://review.openstack.org/8339015:25
*** Rakesh6 has quit IRC15:33
openstackgerrittherese-mchale proposed a change to openstack/tripleo-image-elements: Glance: make registry workers configurable  https://review.openstack.org/7892115:34
*** ifarkas has quit IRC15:35
openstackgerrittherese-mchale proposed a change to openstack/tripleo-image-elements: Glance: make registry workers configurable  https://review.openstack.org/7892115:35
*** d0ugal has quit IRC15:38
*** rdopieralski has quit IRC15:41
*** jprovazn has quit IRC15:41
*** martyntaylor has left #tripleo15:42
*** bauzas has quit IRC15:46
*** giulivo has quit IRC15:52
openstackgerritAna Krivokapic proposed a change to openstack/tuskar-ui: Improve deployment page  https://review.openstack.org/8470215:52
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: SSH key and virtual_power_driver not used on H/W  https://review.openstack.org/8377015:53
*** jistr|biab is now known as jistr15:55
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: SSH key and virtual_power_driver not used on H/W  https://review.openstack.org/8377015:56
*** pblaho has quit IRC15:58
*** cwolferh has joined #tripleo16:03
*** eghobo has joined #tripleo16:04
*** viktors has quit IRC16:07
*** jang1 has quit IRC16:07
*** e0ne has joined #tripleo16:12
*** e0ne has quit IRC16:17
*** marun has quit IRC16:23
*** matty_dubs is now known as matty_dubs|lunch16:23
openstackgerritA change was merged to openstack/tripleo-image-elements: Enable unit testing  https://review.openstack.org/8388816:26
*** UtahDave has joined #tripleo16:29
*** markmc has quit IRC16:31
*** jp_at_hp1 has joined #tripleo16:31
*** jp_at_hp has quit IRC16:33
*** noslzzp has quit IRC16:35
*** jogo is now known as flashgordon16:46
*** newell_ has joined #tripleo16:49
openstackgerritGhe Rivero proposed a change to openstack/tripleo-incubator: Deploy overcloud images from seed  https://review.openstack.org/8512616:50
openstackgerritGhe Rivero proposed a change to openstack/tripleo-incubator: Make it possible to just build images.  https://review.openstack.org/8522216:50
openstackgerritGhe Rivero proposed a change to openstack/tripleo-incubator: Make devtest_* accept options.  https://review.openstack.org/8522116:50
openstackgerritGhe Rivero proposed a change to openstack/tripleo-incubator: Encapsulate getting image for a deployment.  https://review.openstack.org/8513016:50
openstackgerritJon-Paul Sullivan proposed a change to openstack/tripleo-incubator: Create a manifest of tools pulled  https://review.openstack.org/8541816:54
*** jistr is now known as jistr|afk16:58
*** akrivoka has quit IRC16:59
geerdestcan someone please approve https://review.openstack.org/#/c/84189/ ? it has 3 +2’s17:02
SpamapSgeerdest: and, most importantly, a recent CI pass :)17:07
SpamapSgreghaynes: btw, I see what you mean by "the latest software config thing doesn't work" now.. ;)17:07
SpamapSgreghaynes: http://logs.openstack.org/66/81666/11/check-tripleo/check-tripleo-overcloud-precise/9e44f74/console.html shows what you were talking about17:08
openstackgerritA change was merged to openstack/tripleo-incubator: Adding horizon element to undercloud  https://review.openstack.org/8418917:08
*** matty_dubs|lunch is now known as matty_dubs17:11
openstackgerritJon-Paul Sullivan proposed a change to openstack/tripleo-incubator: Create a manifest of tools pulled  https://review.openstack.org/8541817:18
SpamapSwtf ..17:18
SpamapSmellanox includes an upstart job in their debs which basically re-does the kernel's own module loading.. ?!?!17:19
SpamapSand then, so confused..17:19
SpamapSdoes the ifup?17:19
SpamapSwtf17:20
SpamapSwtf17:20
Shrewswhy the face?17:20
SpamapSEWTF17:21
*** jp_at_hp1 has quit IRC17:22
*** csd has quit IRC17:23
*** jang1 has joined #tripleo17:23
*** lucasagomes is now known as lucas-afk17:25
*** dprince has quit IRC17:25
*** lazy_prince has quit IRC17:32
*** CaptTofu has joined #tripleo17:36
*** akuznetsov has quit IRC17:40
*** CaptTofu has quit IRC17:42
*** CaptTofu has joined #tripleo17:42
*** morganfainberg_Z is now known as morganfainberg17:45
*** CaptTofu has quit IRC17:47
openstackgerritGhe Rivero proposed a change to openstack/tripleo-incubator: Deploy overcloud images from seed  https://review.openstack.org/8512617:47
openstackgerritGhe Rivero proposed a change to openstack/tripleo-incubator: Make it possible to just build images.  https://review.openstack.org/8522217:47
openstackgerritGhe Rivero proposed a change to openstack/tripleo-incubator: Encapsulate getting image for a deployment.  https://review.openstack.org/8513017:47
*** openstackgerrit has quit IRC18:01
*** openstackgerrit has joined #tripleo18:02
*** marun has joined #tripleo18:02
mordredSpamapS: it's Shrews fault I believe18:05
SpamapSalways18:05
greghaynesSpamapS: Yep18:09
*** morganfainberg is now known as morganfainberg_Z18:14
*** panda has quit IRC18:15
*** panda has joined #tripleo18:15
Shrewswho? wittle ol' me???18:17
SpamapSShrews: you're not ol'18:18
SpamapSmore like "nearly dead"18:18
Shrewsouch18:18
*** yamahata has quit IRC18:19
* Shrews pulls up video of SpamapS doing poor karaoke to post for the world to see and mock18:20
Shrewsactually, the one with the old guy doing "Baby Got Back" is much funnier18:21
SpamapSShrews: you only increase my glory :)18:21
SpamapSsadly all my best karaoke videos died along with my myspace profile18:22
*** julim has quit IRC18:27
openstackgerritA change was merged to openstack/tripleo-image-elements: Add unit tests for os-svc-daemon  https://review.openstack.org/8388918:32
*** jistr|afk has quit IRC18:32
openstackgerritNicholas Randon proposed a change to openstack/tripleo-incubator: SSH key and virtual_power_driver not used on H/W  https://review.openstack.org/8377018:35
*** morganfainberg_Z is now known as morganfainberg18:37
*** e0ne has joined #tripleo18:42
openstackgerritTrent Geerdes proposed a change to openstack/tripleo-heat-templates: Adding NTP to undercloud template  https://review.openstack.org/8544518:43
*** yamahata has joined #tripleo18:44
openstackgerritA change was merged to openstack/tripleo-image-elements: reset-db restarts mysql only when a change is made  https://review.openstack.org/8458018:46
ccrouchSpamapS: from earlier...18:52
ccrouch(12:07:11 PM) SpamapS: geerdest: and, most importantly, a recent CI pass :)18:52
ccrouchso the bar is atleast one of each "flavor" of seed/undercloud/overcloud jobs needs to pass?18:52
openstackgerritjohn Brooker proposed a change to openstack/tripleo-incubator: Allow baremetal-networks to be passed to devtest  https://review.openstack.org/8544618:56
*** rwsu has quit IRC18:57
*** noslzzp has joined #tripleo18:58
*** hashar has joined #tripleo19:03
*** e0ne has quit IRC19:05
*** e0ne has joined #tripleo19:06
*** e0ne has quit IRC19:09
SpamapSccrouch: no, all must pass19:12
SpamapSccrouch: except ironic undercloud19:12
ccrouchah ok, thanks19:13
*** rwsu has joined #tripleo19:13
ccrouchand that is getting fixed/turned off soon, I presume?19:13
lifelessdevananda: no?19:16
lifelessccrouch: fixed one hopes19:16
ccrouch:-), the presence of NOT_REGISTERED and FAILURE in a "passing" jenkins job just triggers my OCD19:21
ccrouchit might be clearer to see stuff turned off while its not working, given its failure doesnt appear to be a firedrill19:24
openstackgerritChris Krelle proposed a change to openstack/tripleo-image-elements: Fix ironic api and conductor logging  https://review.openstack.org/8545519:26
beekneemechccrouch: lifeless: I think someone had mentioned making the ironic-undercloud and f20 jobs non-voting.  Is there an infra change proposed to do that or are we thinking they will be working soon enough to not bother?19:27
NobodyCambeekneemech: I am working on the ironic undercloud issue19:30
beekneemechNobodyCam: Cool, so probably don't make that one non-voting?19:31
beekneemechDo we know how close the f20 test is to working?19:31
NobodyCamI do not know the f20 status :(19:32
lifelessbeekneemech: I'm not aware of one, but I haven't looked either19:33
lifelessNobodyCam: making it nonvoting will avoid confusing reviewers; it will still run and can still be worked on19:33
lifelessGheRivero: good evening!19:33
NobodyCamlifeless: yes!!! just wanted to let folks know it is being worked on. :)19:34
NobodyCamlifeless: speaking of.... :-p if you have a second https://review.openstack.org/85455 ... allows correct logging from ironic :)19:35
*** CaptTofu has joined #tripleo19:35
*** CaptTofu has quit IRC19:36
*** CaptTofu has joined #tripleo19:37
*** CaptTofu has quit IRC19:41
ccrouch(2:33:28 PM) lifeless: NobodyCam: making it nonvoting will avoid confusing reviewers; it will still run and can still be worked on19:41
ccrouch+1, its easier to shout at people then when stuff gets approved after a "bad" jenkins run :-)19:41
*** morganfainberg is now known as morganfainberg_Z19:42
*** sdake has quit IRC19:42
*** CaptTofu has joined #tripleo19:45
*** sdake has joined #tripleo19:47
*** sdake has quit IRC19:47
*** sdake has joined #tripleo19:47
*** dkehn_ has joined #tripleo19:50
*** noslzzp has quit IRC19:52
*** dkehnx has quit IRC19:54
*** eguz has joined #tripleo19:54
*** sballe has quit IRC19:57
*** sballe has joined #tripleo19:57
*** eghobo has quit IRC19:58
*** e0ne has joined #tripleo19:59
*** morganfainberg_Z is now known as morganfainberg20:00
beekneemechlifeless: ccrouch: NobodyCam: https://review.openstack.org/#/c/85468/20:03
ccrouchthanks beekneemech20:05
VinshOk ok ok.. I give in.  Where can I go to learn about heat template.. "functions?"  suppose I want to know all of the "Fn::GetAtt" choices available to me.  Thinking fore example of a file like "overcloud-source.yaml"20:05
VinshId like to be able to call out.. for example, in that file.. the ip address of nodes running keystone20:06
openstackgerritChris Krelle proposed a change to openstack/tripleo-image-elements: Add debug to ironic conf file. DO NOT MERGE  https://review.openstack.org/8510120:07
*** e0ne has quit IRC20:08
Vinshhappens to be the notCompute0 node in this case.. so "Fn::GetAtt: notCompute0, ip maybe?  Would there be an automated way of calling out nodes that run keystone or some service?20:08
*** bauzas has joined #tripleo20:08
*** e0ne has joined #tripleo20:08
Vinshsomething.. in the yaml like "fn get att :nodes with keytsone element: list of ips".  Maybe this has to be called out explicitly.20:10
*** e0ne has quit IRC20:12
openstackgerritJames Slagle proposed a change to openstack/tripleo-incubator: Install python-openstackclient  https://review.openstack.org/8547120:14
openstackgerritJames Slagle proposed a change to openstack/tripleo-incubator: Add init-heat-domain  https://review.openstack.org/8547220:14
openstackgerritJames Slagle proposed a change to openstack/tripleo-incubator: Update scripts to use init-heat-domain  https://review.openstack.org/8547320:14
openstackgerritJames Slagle proposed a change to openstack/tripleo-incubator: Use openstack client in init-keystone.  https://review.openstack.org/8547420:14
openstackgerritJames Slagle proposed a change to openstack/tripleo-incubator: Use openstack client in register-endpoint  https://review.openstack.org/8547520:14
lifelessVinsh: so that template is written for a topology where all notCompute run keystnoe20:15
lifelessVinsh: there isn't a dynamic mapping of service -> ndoe because nodes have fixed roles20:15
*** morganfainberg is now known as morganfainberg_Z20:15
lifelessVinsh: for APIs in particular though, we intend to inject a virtual IP and that is what would be referenced20:15
VinshYeah.. the context I am working on.. is enabling haproxy there.  where id want to point it at all of the keystone nodes... maybet that 1 to many notcompute nodes.20:16
*** CaptTofu has quit IRC20:16
*** CaptTofu has joined #tripleo20:16
Vinshgood point on the fixed roles thing20:16
lifelesscool so for that its just a map across notCompute20:17
VinshOk I follow you.  Makes sense.20:18
Vinshwhat setups the virtual IP for a service?  say there are 3 nodes running keystone.. ?20:18
Vinshdoes neutron or something make up a loadbalancer that puts all of the keystone targets across 3 nodes - behind one vip ?20:19
*** CaptTofu has quit IRC20:20
*** CaptTofu has joined #tripleo20:21
*** e0ne has joined #tripleo20:22
greghaynesVinsh: AIUI using VIPs for HA is on our list of things to do20:23
VinshIf the default overcloud-source.yaml was expanded to have 3 notcompute nodes. all running keystone... do you get 3 keystone api ips ?20:23
Vinshhow does trippleO handle this?20:24
*** CaptTofu has quit IRC20:24
greghaynesSo scaling is currently done in merge.py (in tripleo-heat-templates). How we elect a master via VIP is an unsoled problem20:25
lifelessfor the VIP20:25
lifelessheat will ask neutron for the IP20:25
lifelessand/or we may pass one/some in20:25
VinshOk, so neutron gives you an IP for a vip.. do you send neutron the ip of all 3 keystone servers to put behind that?20:26
Vinshsince they are all active20:26
lifelesswe don't have full services available from neutron on baremetal yet20:27
lifelessso for this its just allocating the IP for us20:27
lifelesswe pass pacemaking the VIP and haproxy the backend IPs20:27
lifelesspacemaker20:27
lifeless^ this is the intent20:27
VinshSo currently.. if I did expand to 3 notCompute nodes. all running keystone. id have 3 keytstone Ips to use20:28
Vinshis that currently the case ^ ?20:28
lifelessyes20:28
*** noslzzp has joined #tripleo20:28
Vinshcool. got that. this is clearing up some20:28
lifelessI've been promising greghaynes for two weeks I'd hack on this w/him20:29
lifelessand EPIC FAIL20:29
Vinshi'm plugging in the haproxy element right now into the overcloud20:29
greghaynesmuch ci, very explode20:29
Vinshso i'm trying to learn how this beast works as is.. and how it might go forward20:29
greghaynesVinsh: IMO the keystone doesnt need to be VIP'd, the haproxy does20:30
greghaynesso I dont think it should be an issue yet20:30
Vinshok, so back a level20:30
Vinshvip talks to multiple haproxy nodes20:30
Vinshthose nodes each talk to whatever keystone node (likely them self )20:31
jang1yup. Keep the moving parts to as small a vertical slice as possible.20:31
jang1the vip is floated over three nodes, with an HAProxy instance behind it20:31
jang1the HAProxy isntance is configured with three backends20:31
jang1... each of the service api endpoints.20:31
greghaynesVinsh: yes. so a pattern im used to is: run a haproxy on every node with $service, each haproxy knows about all nodes in the cluster and round robins between them20:31
greghaynesyep20:32
Vinshsounds like the current haproxy image element needs some additions to allow the "knows about all nodes in the cluster" part20:34
*** noslzzp has quit IRC20:35
greghaynesMaybe, its the same problem as galera and rabbit - both needed a list of ip's for the cluster20:35
greghaynesnot sure about the current state of haproxy element but might be an unsolved problem20:35
VinshI'm just making a scratch sheet of what i'm even trying to do here... this is helpful info for sure :)20:36
greghaynesthat should give you somewhere to look though. The rabbit code is merged for that and the galera patch is in review - both in tripleo-image-elements20:36
Vinshok cool20:37
*** noslzzp has joined #tripleo20:38
*** julim has joined #tripleo20:39
mordredgreghaynes: you could always make Vinsh port neutron-lbaas to bare-metal ...20:39
Vinshapt-get port nuetron. done.20:39
greghaynesSounds easy enough!20:39
VinshI see 6  neutron tripleo-image-elements20:42
lifelesshaproxy element should support all the needed config20:46
lifelessjust needs heat glue to map it20:46
*** jdob has quit IRC20:47
Vinshhow about the vip infront of haproxy nodes?20:47
lifelessCI down to 2 hours behind20:47
lifelessmuch win20:47
greghaynesI dont think it should need to really know about the vip20:47
*** hashar has quit IRC20:48
Vinshmy brain is coming from public cloud deployment-development.. many of everything everywhere -- many possible configurations of such done dynamically.  So i'm still learning how to think in the trippleO deploy context... right now its small scale but I immediately think ahead to the what-ifs of scale and breaking out services to individual nodes.  Thanks for the insight :)20:50
VinshGotta design now  - for then.20:51
lifelesspacemaker owns the VIP20:51
Vinsh*will own some day soon.. or DOES own?20:52
*** untriaged-bot has joined #tripleo21:00
untriaged-botUntriaged bugs so far:21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130262921:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/129048821:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130255921:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130069321:00
uvirtbotLaunchpad bug 1302629 in tripleo "Network problems in user VM after overcloud-compute image update" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130214821:00
uvirtbotLaunchpad bug 1290488 in tripleo "Baremetal: Invalid credentials" [Undecided,Incomplete]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/130276621:00
uvirtbotLaunchpad bug 1302559 in tripleo "After update of overcloud with new compute image user vm are unavailable" [Undecided,New]21:00
*** untriaged-bot has quit IRC21:00
uvirtbotLaunchpad bug 1300693 in tripleo "devtest.sh run leaves 3 default security groups" [Undecided,Incomplete]21:00
uvirtbotLaunchpad bug 1302148 in tripleo "error: Unable to add port vnet2 to OVS bridge br-ctlplane: Operation not permitted" [Undecided,New]21:00
uvirtbotLaunchpad bug 1302766 in tripleo "ntp element not working properly on overcloud" [Undecided,New]21:00
greghaynes\O/ new cloud images21:02
greghaynesactually that downloaded fast, I should stop complaining21:02
*** gilliard has quit IRC21:03
greghaynesargh, but testing 32bit means all my mirrors dont work :/21:03
*** gilliard has joined #tripleo21:04
*** matty_dubs is now known as matty_dubs|gone21:05
*** lblanchard has quit IRC21:07
*** e0ne has quit IRC21:07
*** e0ne has joined #tripleo21:08
*** jtomasek has quit IRC21:11
*** e0ne has quit IRC21:11
openstackgerritTrent Geerdes proposed a change to openstack/tripleo-image-elements: Enforce firewall in Debian distros  https://review.openstack.org/8549121:32
openstackgerritTrent Geerdes proposed a change to openstack/tripleo-image-elements: Enforce firewall in Debian distros  https://review.openstack.org/8549121:40
*** jrist is now known as jrist-afk21:41
*** jrist-afk is now known as jrist21:41
*** weshay has quit IRC21:45
jang1@spamaps dunno if you're here but we finally tracked down why the mellanox-upstream element wasn't working.21:46
jang1turns out that busybox's implementation of "depmod" leaves a _lot_ to be desired.21:46
jang1In particular, it doesn't use the default sort order.21:46
openstackgerritjohn Brooker proposed a change to openstack/tripleo-incubator: Update seed element to use custom baremetal-network  https://review.openstack.org/8549521:46
jang1The result: the ramdisk was loading the new mlx4_en and the old mlx_core to satisfy it, and failing to link the two.21:47
jang1I'm not quite sure why we run depmod from within the booted ramdisk, and not just during the image preparation stage.21:47
jang1(I think that's a bug)21:47
jang1In future, I think I'd like a machine with less memory and/or a disable-able POST to debug this on. The test cycle was hideously painful. Although once we found out what the problem was, it transpired we might've been able to make it break like that under kvm with sufficient prodding.21:49
*** e0ne has joined #tripleo21:51
openstackgerritjohn Brooker proposed a change to openstack/tripleo-incubator: Update seed element to use custom baremetal-network  https://review.openstack.org/8549521:57
*** jang1 has quit IRC21:59
lifelessjang: oooh nasty21:59
openstackgerritGregory Haynes proposed a change to openstack/tripleo-image-elements: Enable Galera clustering  https://review.openstack.org/8367522:00
VinshORLY22:02
Vinshbetter go see this one :)22:02
greghaynesjust a couple fixes22:03
*** CaptTofu has joined #tripleo22:03
greghayneswoo supporting multi distro multi arch22:03
Vinshgreghaynes, you reference on line 6 of xtradb-cluster.cnf.. "mysql.nodes"  Are those nodes defined in a heat template as such?22:06
*** CaptTofu has quit IRC22:08
greghaynesVinsh: yes22:10
Vinshwicked.22:10
greghaynesVinsh: https://review.openstack.org/#/c/83883/22:11
Vinshline 441 there is special.. is this yaml markup.. of mysql queries basically?22:12
Vinshthats the gist of heat right?22:12
Vinshmaking that connection as to what is being marked up22:13
greghaynesIts just heat / cloudformation routines22:13
greghaynesbasically just a simple join function22:13
Vinshthats what this "Fn join/ select" syntax is?22:13
greghaynesyes22:13
Vinshcool.. is there a site that explains some of those basics?22:13
greghaynessome things are taken right from cloudformation (you can google), others are heat specific22:14
greghaynesnot sure of one doc to rule them all22:14
VinshOk, googling :)22:14
Vinshlo and behold.. some "mirantis" slide sets on this very thing.22:16
*** eguz has quit IRC22:20
Vinshgreghaynes, back to your change.. this list of nodes as is for "mysql.nodes"  shows the one name "notCompute0"22:21
Vinshso only one node in that case.. for overcloud?22:21
*** eghobo has joined #tripleo22:21
Vinshthe "-notcompute0 - networks" returns only the ip ?22:22
Vinshwhen called as "{{mysql.nodes}}"22:23
greghaynesVinsh: the getattr with those args does. Theres onle one node because in theory merge.py performs the scaling for us22:24
greghaynesin practice this doesnt quite work for notCompute nodes yet22:24
Vinshok, understood. :)22:25
Vinshthis slide set claims "Configurable LoadBalancer (LBaas) for heat in havana"22:26
Vinshlooks like Sergey is on that.22:27
openstackgerritjohn Brooker proposed a change to openstack/tripleo-incubator: Update seed element to use custom baremetal-network  https://review.openstack.org/8549522:46
*** rlandy has quit IRC23:01
openstackgerritjohn Brooker proposed a change to openstack/tripleo-incubator: incloud CIDR can overlap custom baremetal-network  https://review.openstack.org/8551623:04
*** e0ne has quit IRC23:04
*** e0ne has joined #tripleo23:05
openstackgerritLoganathan Parthipan proposed a change to openstack/tripleo-incubator: Make libvirt volume pool configurable  https://review.openstack.org/8340923:06
*** e0ne has quit IRC23:09
*** UtahDave has left #tripleo23:16
*** bauzas has quit IRC23:22
openstackgerritjohn Brooker proposed a change to openstack/tripleo-incubator: Allow baremetal-networks to be passed to devtest  https://review.openstack.org/8544623:37
*** eghobo has quit IRC23:43
*** e0ne has joined #tripleo23:52
SpamapSjang: I'm here now, wasn't it that it mucks with modules from within a chroot?23:53
*** e0ne has quit IRC23:56
*** eghobo has joined #tripleo23:57
openstackgerritTrent Geerdes proposed a change to openstack/tripleo-image-elements: Enforce firewall in Debian distros  https://review.openstack.org/8549123:58
openstackgerritClint "SpamapS" Byrum proposed a change to openstack/diskimage-builder: Add mellanox upstream element  https://review.openstack.org/8520823:59
*** eghobo has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!