| *** geerdest_ has quit IRC | 00:03 | |
| *** matsuhashi has joined #tripleo | 00:07 | |
| *** yamahata has joined #tripleo | 00:08 | |
| *** pcrews has quit IRC | 00:11 | |
| tchaypo | notq: the "no distributions" error comes from pip, it's referring to packages from pypi rather than debian packages | 00:15 |
|---|---|---|
| notq | manaully pip install then? | 00:15 |
| tchaypo | I think this is probably a bug | 00:16 |
| notq | there's also this line "Some externally hosted files were ignored (use --allow-external keyring to allow)." | 00:16 |
| tchaypo | Although, checking https://pypi.python.org/pypi/keyring shows that the latest is version 3.7 | 00:16 |
| vinsh | fatal: unable to access 'http://git.openstack.org/openstack/requirements/': Failed to connect to 2001:4800:7813:516:3bc3:d7f6:ff04:aacb: Network is unreachable | 00:16 |
| tchaypo | so it sounds like maybe you're using some local mirror or cache that doesn't have that package | 00:16 |
| notq | this is a new clean install, doubt local mirror but can check | 00:17 |
| vinsh | funny.. I am trying to re-create my pypi-mirror | 00:17 |
| vinsh | and can't | 00:17 |
| tchaypo | notq: could you paste as much of the output as you still have into pastebin so we can take a look? | 00:17 |
| notq | sure, it's repeatable | 00:18 |
| notq | also says it stores it in pip.log, want me to just pastebin that? | 00:18 |
| tchaypo | If you can - but depending where this happens, that pip.log could be inside a diskimage-builder chroot that got destroyed as part of the cleanup | 00:19 |
| notq | ah, i'm a dork. i see the error in there. there are proxy errors, i bet something is wrong with pip using the proxy. | 00:19 |
| notq | is that the first pip call? | 00:19 |
| tchaypo | Probably - it sounds to me as though it's probably at the start of the pypi-mirror element (or is it the pypi element?), but it might be pull-tools | 00:20 |
| notq | yeah, i need to sort out how pip deals with proxies, and make sure it's working. | 00:20 |
| *** rwsu has joined #tripleo | 00:20 | |
| tchaypo | vinsh: is your problem reproducible? | 00:23 |
| vinsh | I think its just noise from the mirror job... it finally kept going. but I do see that on 2 machines right now | 00:24 |
| vinsh | http://paste.openstack.org/show/79499/ | 00:24 |
| vinsh | It clones.. begins to run. barks. then runs | 00:25 |
| *** matsuhashi has quit IRC | 00:28 | |
| vinsh | ya, the pypi-mirror is like an old lawn mower.. takes a few tries to get going all the way. and a few restarts throughout the job ;) | 00:30 |
| *** matsuhas_ has joined #tripleo | 00:31 | |
| *** chuckC has quit IRC | 00:32 | |
| openstackgerrit | Steve Baker proposed a change to openstack/os-collect-config: Only top-level some deployment configs https://review.openstack.org/91733 | 00:32 |
| *** TravT has quit IRC | 00:35 | |
| openstackgerrit | James Polley proposed a change to openstack/tripleo-incubator: Simplify creation/cleanup of testenvs https://review.openstack.org/92734 | 00:35 |
| mordred | vinsh: but it makes you feel like a proper man when you're done | 00:35 |
| vinsh | INDEED. | 00:35 |
| tchaypo | I stopped mowing the lawn at 17 - if I was doing it again it'd probably make me feel like a kid again | 00:36 |
| notq | can wget the url that pip can't get. http_proxy and https_proxy set. tried on the command line. tried a 2nd proxy. args. | 00:36 |
| tchaypo | notq: did you put something on pastebin? | 00:37 |
| vinsh | notq, I don't have all the history on what your trying.. but sounds similar to things I have hit.. are you trying to run the pip mirror job? | 00:37 |
| notq | tchaypo: no, cause it's clearly a pip/proxy issue. i can if you'd like though | 00:37 |
| vinsh | if so.. that seems to require sudo.. and sudo might not see the proxy set. | 00:37 |
| notq | global proxy | 00:37 |
| notq | i'll try to echo with sudo though and see | 00:38 |
| notq | yeah, it's there. | 00:38 |
| notq | and i tried it with the proxy on the command line for a pip install | 00:38 |
| tchaypo | notq: we might be able to spot a common issue | 00:38 |
| notq | ok, will do | 00:38 |
| *** matsuhas_ has quit IRC | 00:40 | |
| *** matsuhashi has joined #tripleo | 00:41 | |
| notq | http://pastebin.com/zhKykFXc | 00:42 |
| openstackgerrit | James Polley proposed a change to openstack/tripleo-incubator: Simplify creation/cleanup of testenvs https://review.openstack.org/92734 | 00:48 |
| vinsh | huh | 00:48 |
| vinsh | "No distributions at all found for keyring>=1.6.1,<2.0,>=2.1 (from python-openstackclient)" | 00:48 |
| vinsh | from your paste | 00:48 |
| vinsh | is that series of requirements even possible?! | 00:49 |
| StevenK | Yes | 00:49 |
| vinsh | does the , indicate or? | 00:50 |
| StevenK | vinsh: To the best of my knowledge, it will find the highest version on pypi and check against those rules. If not, goes back one version and checks again | 00:52 |
| greghaynes | both less than 2.0 and greater than 2.1? | 00:53 |
| vinsh | notq, usually.. when things get wonky like this.. its time to remove your cache. and do a git pull on tripleo-incubator | 00:55 |
| vinsh | You have some version of python-openstackcllient in cache that to me seems to have bogus requirements. | 00:56 |
| notq | the error is that with pip and a proxy. i am using a proxy, and pip doesn't work to install any package. shouldn't i assume it's that and get pip working first, or do you think it could be a caching error? | 00:57 |
| vinsh | from the paste you posted.. it appears to be downloading a bunch of stuff | 00:57 |
| vinsh | just fine | 00:57 |
| notq | yes, except from pip | 00:58 |
| notq | wget, git, etc work. pip doesn't. | 00:58 |
| vinsh | all of those items..above keyring.. | 00:58 |
| vinsh | are from pip | 00:58 |
| vinsh | right? | 00:58 |
| vinsh | such as lxml anyjason? | 00:58 |
| vinsh | I dunno. Strange case. | 00:59 |
| notq | are they? i tried to install a basic package and it failed. | 00:59 |
| notq | yeah, looks like it. okay. i'll follow. when you say remove cache, what exactly are you referring to? | 01:00 |
| vinsh | this would be in /home/notq/.cache tripleo image-create | 01:01 |
| vinsh | both of those dirs | 01:01 |
| *** sdake_ has quit IRC | 01:01 | |
| notq | .cache just contains a motd | 01:02 |
| vinsh | you said you had just cloned tripleo-incubator today? | 01:03 |
| vinsh | are on master? | 01:03 |
| notq | i just gloned it today | 01:03 |
| notq | following this http://docs.openstack.org/developer/tripleo-incubator/devtest.html | 01:04 |
| notq | not using the optional stable branch | 01:04 |
| vinsh | I am unsure as how to help :( | 01:05 |
| notq | it's repeatably stopping in the same place if i retry | 01:05 |
| notq | i could remove it, git pull, and try it again | 01:05 |
| vinsh | worth a try! | 01:05 |
| openstackgerrit | James Polley proposed a change to openstack/tripleo-incubator: Clean up any existing environment first https://review.openstack.org/92038 | 01:06 |
| *** mestery has quit IRC | 01:08 | |
| *** eghobo has quit IRC | 01:20 | |
| *** mestery has joined #tripleo | 01:25 | |
| *** shakamunyi has joined #tripleo | 01:26 | |
| *** ramishra has joined #tripleo | 01:27 | |
| *** sballe has quit IRC | 01:28 | |
| *** sballe has joined #tripleo | 01:29 | |
| *** newell_ has quit IRC | 01:29 | |
| tchaypo | notq: sorry, I haven't been following the conversation :( Do you know where the requirement for keychain is coming from? | 01:30 |
| tchaypo | s/chian/ring | 01:31 |
| tchaypo | s/chian/chain/ | 01:31 |
| notq | http://pastebin.com/zhKykFXc - the pastebin | 01:31 |
| notq | Downloading/unpacking keyring>=1.6.1,<2.0,>=2.1 (from python-openstackclient) | 01:31 |
| tchaypo | Huh. | 01:33 |
| tchaypo | https://git.openstack.org/cgit/openstack/python-openstackclient/tree/requirements.txt says that it just requires >=2.1 | 01:33 |
| *** mestery has quit IRC | 01:34 | |
| StevenK | Which agrees with global-requirements | 01:34 |
| tchaypo | but git blame tells me that line was last changed in dde02b8a on 2014-04-20 | 01:35 |
| tchaypo | and git show -r dde02b8a shows | 01:35 |
| tchaypo | -keyring>=1.6.1,<2.0,>=2.1 | 01:35 |
| tchaypo | +keyring>=2.1 | 01:35 |
| StevenK | tchaypo: Release of openstackclient versus git | 01:36 |
| tchaypo | yep. | 01:36 |
| StevenK | I bet dde02b8a isn't in the release | 01:36 |
| tchaypo | last release was 2014-03-01 | 01:36 |
| tchaypo | wheee | 01:36 |
| StevenK | I have python-keyring installed -- which fails that, as it's 1.6-1 | 01:37 |
| tchaypo | I'm trying to figure out what's installing python-openstackclient | 01:39 |
| StevenK | setup-clienttools | 01:39 |
| tchaypo | and that was added on april 4 | 01:40 |
| tchaypo | no that's wrong, let me try again: the change which added python-openstackclient was authored on april 4. I'm not sure when it merged. | 01:40 |
| tchaypo | https://review.openstack.org/#/c/85471/ - April 7, 7:22pm | 01:41 |
| tchaypo | which is why no-one has run into this, it only landed 12 hours ago | 01:42 |
| *** shakamunyi has quit IRC | 01:42 | |
| tchaypo | notq: at this point, my suggestion is that you raise a critical bug at https://launchpad.net/tripleo | 01:42 |
| StevenK | tchaypo: Uh? | 01:42 |
| StevenK | tchaypo: April 7 was over a month ago | 01:43 |
| tchaypo | dammit. | 01:43 |
| StevenK | It is May | 01:43 |
| tchaypo | Where did the year go? | 01:43 |
| tchaypo | etc etc | 01:43 |
| StevenK | Hah | 01:43 |
| notq | dpkg for python-keyring shows Version: 0.9.2-0ubuntu0.12.04.2 but says it's the newest version | 01:43 |
| StevenK | Ah, precise | 01:44 |
| tchaypo | notq: newest version of the ubuntu package. Those versions are set in stone when that release of the distro ships - they'll get backported bugfixes but won't increase to a new version | 01:44 |
| *** nosnos has joined #tripleo | 01:44 | |
| notq | should i be using a different ubuntu version? | 01:44 |
| tchaypo | so "newest version" means "newest version shortly before 2012-04" | 01:44 |
| StevenK | python-keyring | 1.6-1 | saucy | source, all | 01:45 |
| StevenK | python-keyring | 3.5-1 | trusty | source, all | 01:45 |
| tchaypo | Yes, tripleo is known to be borken on precise | 01:45 |
| StevenK | Heh, so something drastic happened | 01:45 |
| notq | ok, what version should i use? | 01:45 |
| StevenK | notq: Trusty, 14.04 | 01:45 |
| notq | thx. | 01:45 |
| notq | k, request in to have the server rebuilt. should get it tomorrow and can work through it again. | 01:47 |
| tchaypo | Sorry notq | 01:48 |
| tchaypo | https://review.openstack.org/#/c/84801/7/README.md added some notes about this | 01:48 |
| notq | no problem, just want to get this working. have a huge baremetal system i'd love to get deployed asap :) | 01:48 |
| *** mestery has joined #tripleo | 01:48 | |
| tchaypo | ... but I see that the version that eventually landed just says "Ubuntu or Fedora" | 01:48 |
| tchaypo | notq: out of curiousity - was that README.md something you'd run across? | 01:54 |
| tchaypo | In other words - if it had an explicit "Use trusty" notice, would you have seen it? | 01:54 |
| notq | http://docs.openstack.org/developer/tripleo-incubator/devtest.html would have helped to have that info | 01:55 |
| openstackgerrit | James Polley proposed a change to openstack/tripleo-incubator: Add details of which OS releases are tested in CI https://review.openstack.org/92749 | 01:56 |
| tchaypo | one moment while I add devtest.sh to that change | 01:56 |
| *** shakamunyi has joined #tripleo | 01:57 | |
| greghaynes | slagle: any idea whats up with the oslo error on https://review.openstack.org/#/c/91561/2 ? | 02:00 |
| notq | going to head out, i'll be back tomorrow for more fun :) | 02:00 |
| slagle | greghaynes: not really :/ | 02:01 |
| slagle | i was trying to selectively backport some stuff to the stable branches to fix some issues | 02:01 |
| slagle | possible we need some additional commits there to make those oslo tests work | 02:02 |
| openstackgerrit | James Polley proposed a change to openstack/tripleo-incubator: Add details of which OS releases are tested in CI https://review.openstack.org/92749 | 02:02 |
| greghaynes | yea, id definitely like to get those merged since it seems like our stable branches are less than functional without | 02:03 |
| tchaypo | I just wondered why I feel so hungry when it's still early morning. I'm going to take that as a sign I should be getting lunch. | 02:03 |
| slagle | greghaynes: indeed :). i was going to ask bnemec about it tomorrow | 02:03 |
| tchaypo | notq: Hopefully tomorrow you'll see something telling you that I pointed you at https://review.openstack.org/#/c/92749/ just after you left :) | 02:04 |
| *** sballe has quit IRC | 02:05 | |
| *** sballe has joined #tripleo | 02:06 | |
| *** geerdest_ has joined #tripleo | 02:07 | |
| *** geerdest_ has quit IRC | 02:07 | |
| openstackgerrit | Tim Potter proposed a change to openstack/diskimage-builder: Add documentation for DIB_* global image-build variables https://review.openstack.org/92752 | 02:08 |
| *** shakayumi has joined #tripleo | 02:15 | |
| *** rameshg87 has joined #tripleo | 02:16 | |
| tchaypo | notq: http://docs-draft.openstack.org/49/92749/2/check/gate-tripleo-incubator-docs/a269403/doc/build/html/devtest.html has the proposed change to devtest.html | 02:18 |
| *** shakamunyi has quit IRC | 02:19 | |
| *** rameshg87 has quit IRC | 02:21 | |
| *** chuckC has joined #tripleo | 02:34 | |
| lifeless | so where are we at | 02:42 |
| lifeless | greghaynes: whats the next HA patch needed? | 02:42 |
| *** mestery has quit IRC | 02:49 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Revert "Provide an override level for os-apply-config" https://review.openstack.org/91198 | 02:54 |
| greghaynes | lifeless: Theres a series of patches up for doing virtualip stuff - https://review.openstack.org/#/c/91346 https://review.openstack.org/#/c/89556/ https://review.openstack.org/#/c/91349 | 02:57 |
| greghaynes | looks I need to re-review some of those | 02:57 |
| greghaynes | then we need to go and switch the heat templates to use vip for varios services | 02:57 |
| greghaynes | then *in theory* merge.py for multi control nodes will "just work" in that multiple control nodes should start | 02:58 |
| *** untriaged-bot has joined #tripleo | 03:00 | |
| untriaged-bot | Untriaged bugs so far: | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316985 | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317117 | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314978 | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1315355 | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314922 | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316675 | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317056 | 03:00 |
| uvirtbot | Launchpad bug 1316985 in tripleo "set -eu may spuriously break dkms module" [Undecided,New] | 03:00 |
| *** untriaged-bot has quit IRC | 03:00 | |
| uvirtbot | Launchpad bug 1317117 in tripleo "Error when USE_CIRROS=1" [Undecided,New] | 03:00 |
| uvirtbot | Launchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New] | 03:00 |
| uvirtbot | Launchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New] | 03:00 |
| uvirtbot | Launchpad bug 1314922 in tripleo "ephemeral disk is mounted too late" [Undecided,New] | 03:00 |
| uvirtbot | Launchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress] | 03:00 |
| greghaynes | such bugs | 03:00 |
| uvirtbot | Launchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New] | 03:00 |
| StevenK | Niiiiice. I left the Firefox with the zuul tab open last night | 03:00 |
| *** shakayumi has quit IRC | 03:01 | |
| StevenK | So, about a minute ago Firefox was using 19G of RAM | 03:01 |
| greghaynes | id make a firefox os joke but its not as funny nowdays | 03:01 |
| StevenK | No, it just tends to make people sad. | 03:02 |
| *** dkehn_ has joined #tripleo | 03:12 | |
| *** dkehn has quit IRC | 03:15 | |
| *** dkehnx has quit IRC | 03:15 | |
| *** dkehn has joined #tripleo | 03:17 | |
| *** matsuhashi has quit IRC | 03:24 | |
| *** shakayumi has joined #tripleo | 03:30 | |
| *** TravT has joined #tripleo | 03:33 | |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Add NeutronControlPlaneID parameter https://review.openstack.org/91346 | 03:34 |
| lifeless | marios: btw with cross repo stuff | 03:34 |
| *** blamar has quit IRC | 03:35 | |
| StevenK | lifeless: Can you +A https://review.openstack.org/#/c/91520/ , it finally passed CI | 03:35 |
| lifeless | marios: typically CI will fail, which means theres no need to -2 to force sequencing control | 03:35 |
| *** eghobo has joined #tripleo | 03:35 | |
| StevenK | lifeless: I've got local changes for the CLI tool that I'm just throwing through devtest | 03:35 |
| StevenK | lifeless: Thanks | 03:36 |
| openstackgerrit | A change was merged to openstack/os-cloud-config: Perform PKI initialization for a Keystone host https://review.openstack.org/91520 | 03:36 |
| StevenK | lifeless: Nice catch, I've fixed the docs and the usage string. | 03:39 |
| *** nosnos has quit IRC | 03:41 | |
| * StevenK peers at os-cloud-config | 03:42 | |
| StevenK | I was expecting a version in setup.cfg | 03:43 |
| lifeless | versions are done from the git tag | 03:44 |
| lifeless | its pbr | 03:44 |
| StevenK | Right | 03:46 |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-incubator: Fix awk for grabbing cirros MD5 https://review.openstack.org/92764 | 03:46 |
| *** shakayumi has quit IRC | 04:08 | |
| *** blamar has joined #tripleo | 04:08 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-incubator: Fix awk for grabbing cirros MD5 https://review.openstack.org/92764 | 04:09 |
| *** tzumainn has quit IRC | 04:10 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-image-elements: Document config properties in haproxy element https://review.openstack.org/90829 | 04:15 |
| *** blamar has quit IRC | 04:16 | |
| *** blamar has joined #tripleo | 04:16 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-image-elements: Allow multiple binds per service in haproxy https://review.openstack.org/89925 | 04:18 |
| lifeless | stevebaker: I think we didn't quite connect on the mutual gating thing | 04:19 |
| lifeless | stevebaker: but! I may be misunderstanding teh details. | 04:22 |
| lifeless | stevebaker: so - I'm going to ask that we get a spec up. Then we can look at it from all angles independent of implementation | 04:23 |
| lifeless | stevebaker: if thats ok with you | 04:23 |
| *** mestery has joined #tripleo | 04:24 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-image-elements: Allow multiple binds per service in haproxy https://review.openstack.org/89925 | 04:24 |
| *** nosnos has joined #tripleo | 04:29 | |
| *** ramishra has quit IRC | 04:30 | |
| *** matsuhashi has joined #tripleo | 04:37 | |
| *** rcarrill` has quit IRC | 04:38 | |
| lifeless | bnemec: your spec, reviewed. Thanks! it looks great. | 04:43 |
| *** rcarrillocruz has joined #tripleo | 04:44 | |
| openstackgerrit | Steve Kowalik proposed a change to openstack/os-cloud-config: Add a init-keystone CLI https://review.openstack.org/91521 | 04:44 |
| *** lazy_prince has joined #tripleo | 04:47 | |
| openstackgerrit | Chris Jones proposed a change to openstack/diskimage-builder: Last ditch effort to correct a wrong shasum. https://review.openstack.org/88084 | 04:48 |
| *** Rakesh6 has joined #tripleo | 04:53 | |
| SpamapS | ooo we may have yet another box back for the hp region | 04:53 |
| *** eghobo has quit IRC | 04:58 | |
| *** eghobo has joined #tripleo | 04:59 | |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Add a flag to allow for serial console on the VMs https://review.openstack.org/86272 | 05:01 |
| *** akuznetsov has joined #tripleo | 05:08 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-heat-templates: Introduce configurable virtual ip in templates https://review.openstack.org/89556 | 05:13 |
| *** matsuhashi has quit IRC | 05:19 | |
| *** matsuhashi has joined #tripleo | 05:20 | |
| lifeless | SpamapS: \o/ | 05:22 |
| *** shakayumi has joined #tripleo | 05:52 | |
| *** rdopieralski has joined #tripleo | 05:54 | |
| *** rcarrill` has joined #tripleo | 05:56 | |
| *** shakayumi has quit IRC | 05:57 | |
| *** rcarrillocruz has quit IRC | 05:57 | |
| *** morganfainberg is now known as morganfainberg_Z | 06:05 | |
| *** saurabhs has left #tripleo | 06:07 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Create stub for build_sphinx https://review.openstack.org/88618 | 06:13 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Remove out of date CI docs https://review.openstack.org/88635 | 06:13 |
| marios | lifeless: yeah, jprovaznik pointed that out to me yesterday (cross repo stuff - gate tests would have failed) | 06:40 |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Pass NeutronControlPlaneID to heat stack-create https://review.openstack.org/91349 | 06:44 |
| *** shakayumi has joined #tripleo | 06:53 | |
| *** shakayumi has quit IRC | 06:58 | |
| greghaynes | marios: was waiting for tests on that one I think :) | 07:07 |
| marios | greghaynes: oh, you mean for "Pass NeutronControlPlaneID to" | 07:19 |
| GheRivero | morning all | 07:19 |
| dshulyak | morning | 07:20 |
| greghaynes | marios: yep. Not a big deal just thought id point it out | 07:22 |
| marios | greghaynes: yeah thanks. hope i didn't break $stuff :/ was actually surprised it hadn't been pushed yet (was waiting on your +A on the heat template one) | 07:23 |
| marios | greghaynes: though gate tests would have failed though no? | 07:23 |
| *** eghobo has quit IRC | 07:24 | |
| greghaynes | We dont gate on the tripleo tests | 07:24 |
| greghaynes | (I think) | 07:25 |
| marios | greghaynes: ah indeed - not yet right? | 07:25 |
| marios | greghaynes: yeah i think you're right - BUT, couple people said 'you didn't need to -2 because the tests would have failed' | 07:25 |
| marios | so not sure | 07:25 |
| greghaynes | haha, yea.. I think as a 'people probably wont +A if all the tripleo tests fail' but I agree its a bit fragile ATM ;) | 07:26 |
| marios | greghaynes: anyway thanks mate, i need to stop doing that (have done it before) | 07:26 |
| *** mrunge has joined #tripleo | 07:37 | |
| *** shakayumi has joined #tripleo | 07:54 | |
| *** matsuhashi has quit IRC | 07:54 | |
| lifeless | greghaynes: logical gate | 07:55 |
| *** e0ne has joined #tripleo | 07:55 | |
| lifeless | greghaynes: no +A with failed voting jobs | 07:55 |
| lifeless | greghaynes: including tripleo-* | 07:55 |
| *** matsuhashi has joined #tripleo | 07:55 | |
| marios | lifeless: i feel like this would be a good topic for 'open discussion' next tripleo meeting - what tests run where. eg. what i did (-2) was unnecessary and also unhelpful if others couldn't +2 it whilst I'm afk | 07:57 |
| lifeless | marios: sure | 07:57 |
| lifeless | marios: or in the reviews section of the meeting | 07:57 |
| marios | sure wherever, thanks | 07:57 |
| *** shakayumi has quit IRC | 07:58 | |
| smulcahy | I notice http://russellbryant.net/openstack-stats/tripleo-openreviews.html is no longer updated - does anyone know of another source of this info? | 08:01 |
| lifeless | there was a bug | 08:01 |
| lifeless | I believe its fixed now but possibly not deployed | 08:02 |
| *** andreaf has joined #tripleo | 08:07 | |
| *** derekh_ has joined #tripleo | 08:11 | |
| *** lucasagomes has joined #tripleo | 08:13 | |
| *** dkehn__ has joined #tripleo | 08:23 | |
| *** jcoufal has joined #tripleo | 08:24 | |
| *** dkehn__ has quit IRC | 08:24 | |
| *** dkehn_ has quit IRC | 08:25 | |
| *** dkehn has quit IRC | 08:25 | |
| *** dkehn__ has joined #tripleo | 08:25 | |
| *** dkehn has joined #tripleo | 08:27 | |
| *** jcoufal has quit IRC | 08:27 | |
| *** darraghb has joined #tripleo | 08:27 | |
| *** athomas has joined #tripleo | 08:36 | |
| *** dkehn_ has joined #tripleo | 08:38 | |
| *** jcoufal has joined #tripleo | 08:40 | |
| *** dkehn_ has quit IRC | 08:40 | |
| *** dkehn has quit IRC | 08:40 | |
| *** dkehn__ has quit IRC | 08:41 | |
| *** dkehn_ has joined #tripleo | 08:41 | |
| *** dkehn has joined #tripleo | 08:42 | |
| *** jcoufal has quit IRC | 08:45 | |
| *** jcoufal has joined #tripleo | 08:45 | |
| *** markmc has joined #tripleo | 08:48 | |
| *** martyntaylor has joined #tripleo | 08:50 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Nova: disable scheduler debugging. https://review.openstack.org/85756 | 08:53 |
| openstackgerrit | A change was merged to openstack/diskimage-builder: set -u and -o pipefail everywhere https://review.openstack.org/84868 | 08:53 |
| *** shakayumi has joined #tripleo | 08:54 | |
| *** shakayumi has quit IRC | 08:59 | |
| *** untriaged-bot has joined #tripleo | 09:00 | |
| untriaged-bot | Untriaged bugs so far: | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316985 | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314978 | 09:00 |
| uvirtbot | Launchpad bug 1316985 in tripleo "set -eu may spuriously break dkms module" [Critical,New] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1315355 | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316675 | 09:00 |
| uvirtbot | Launchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New] | 09:00 |
| uvirtbot | Launchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317056 | 09:00 |
| uvirtbot | Launchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress] | 09:00 |
| *** untriaged-bot has quit IRC | 09:00 | |
| uvirtbot | Launchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New] | 09:00 |
| *** e0ne has quit IRC | 09:03 | |
| *** e0ne has joined #tripleo | 09:04 | |
| *** rlandy has joined #tripleo | 09:08 | |
| *** jcoufal has quit IRC | 09:09 | |
| *** jcoufal has joined #tripleo | 09:09 | |
| *** rcarrillocruz has joined #tripleo | 09:09 | |
| *** hashar has joined #tripleo | 09:10 | |
| *** rcarrill` has quit IRC | 09:11 | |
| openstackgerrit | Yongli He proposed a change to openstack/tuskar: Exception message should not be localize https://review.openstack.org/76799 | 09:18 |
| *** hashar has quit IRC | 09:20 | |
| *** giulivo has joined #tripleo | 09:21 | |
| andrearosa | derekh_: you reviewed a change https://review.openstack.org/91536 I submitted a new patch since your last review if you could have a look at it again it'd be great. | 09:28 |
| derekh_ | andrearosa: would you believe I was just looking at it :-) | 09:29 |
| andrearosa | derekh_: excellent you are always a step ahead of me ;) | 09:31 |
| derekh_ | andrearosa: looks good, but you'll probably need to rebase, because this merged https://review.openstack.org/#/c/85756/1 | 09:31 |
| andrearosa | ok I'll rebase and remove the --debug for the schduler according to that change. Thanks! | 09:33 |
| *** tzumainn has joined #tripleo | 09:35 | |
| *** marun is now known as marun_afk | 09:35 | |
| openstackgerrit | Stuart McLaren proposed a change to openstack/tripleo-incubator: Simple fix for SSL param whitespace issue https://review.openstack.org/92801 | 09:41 |
| *** dkehn__ has joined #tripleo | 09:42 | |
| openstackgerrit | Ryan Moore proposed a change to openstack/tripleo-image-elements: Restructure the nova.conf to match documentation https://review.openstack.org/83821 | 09:43 |
| *** athomas has quit IRC | 09:45 | |
| *** dkehn_ has quit IRC | 09:45 | |
| *** shakayumi has joined #tripleo | 09:55 | |
| giulivo | tchaypo, lifeless thanks for looking into the TRIPLEO_ROOT change | 09:57 |
| giulivo | i'm trying to figure how to make a pointer to the doc in the "error" we print to the user | 09:57 |
| tchaypo | giulivo: thanks for working on it :) | 09:58 |
| *** petertoft has joined #tripleo | 09:58 | |
| *** e0ne has quit IRC | 09:59 | |
| giulivo | hi tchaypo, I'm really not sure how to point to the doc though; given it will be echoed to the shell I think I'm forced to hardlink it | 09:59 |
| tchaypo | giulivo: The best idea I had for that was to link to http://docs.openstack.org/developer/tripleo-incubator/devtest.html#initial-checkout | 09:59 |
| giulivo | or maybe there are better ways to do it? | 09:59 |
| tchaypo | but I don't like that idea much - there's no guarantee that the docs there will match the version that the user is running | 10:00 |
| *** athomas has joined #tripleo | 10:00 | |
| *** shakayumi has quit IRC | 10:00 | |
| giulivo | tchaypo, one more question | 10:01 |
| giulivo | shall we add a check for TRIPLEO_ROOT in devtest_setup anyway? is it intended to be run without sourcing _variables first? | 10:01 |
| tchaypo | My second-best idea is to suggest something like "Look for the 'Initial Checkout' heading in devtest.sh" | 10:01 |
| tchaypo | devtest_setup? I don't think so. What gave you that impression? | 10:02 |
| openstackgerrit | Andrea Rosa proposed a change to openstack/tripleo-image-elements: Allow nova to use different configuration files https://review.openstack.org/91536 | 10:03 |
| giulivo | tchaypo, there is a comment in the review about that | 10:03 |
| *** e0ne has joined #tripleo | 10:05 | |
| tchaypo | Ah, the one where I pointed out that if TRIPLEO_ROOT is unbound the script will abort. | 10:05 |
| giulivo | yeah I relly need to do some better verification before pushing next time | 10:07 |
| giulivo | how do you do that? | 10:07 |
| lifeless | giulivo: tchaypo: since we don't really cut releases of incubator, I think linking to the current docs is fine | 10:08 |
| *** e0ne has quit IRC | 10:08 | |
| lifeless | giulivo: setup.sh requires variables to be set first | 10:08 |
| *** e0ne has joined #tripleo | 10:08 | |
| openstackgerrit | Gerry Drudy proposed a change to openstack/tripleo-heat-templates: Configure passthrough in swift heat template https://review.openstack.org/92622 | 10:08 |
| giulivo | lifeless, yeah but I missed the unbound on ZUUL_REF anyway :( | 10:08 |
| tchaypo | giulivo: I think you have a point about TRIPLEO_ROOT; I think we can expect that to be set | 10:09 |
| tchaypo | but yeah, ZUUL_REF | 10:09 |
| giulivo | how do you do basic verification of code before submitting? | 10:09 |
| giulivo | this was easy but in geneal, if I were to do something less trivial, are there other options to just run it entirely on your dev station? | 10:10 |
| tchaypo | I have vim + syntastic for some basic syntax checks; it doesn't catch things like this, but it catches the really basic errors | 10:10 |
| tchaypo | but usually I just run it. | 10:10 |
| *** e0ne has quit IRC | 10:12 | |
| openstackgerrit | Gerry Drudy proposed a change to openstack/tripleo-image-elements: Configure passthrough in proxy-server.conf https://review.openstack.org/92628 | 10:15 |
| tchaypo | oh fantastic, the set -u changes landed | 10:17 |
| giulivo | tchaypo, looking at the setup script, I don't think we need to keep the "cd $TRIPLEO_ROOT" in the doc | 10:18 |
| giulivo | can I move it down below the "end" keyword? | 10:18 |
| openstackgerrit | Gerry Drudy proposed a change to openstack/tripleo-image-elements: Configure passthrough in proxy-server.conf https://review.openstack.org/92628 | 10:18 |
| giulivo | actually I'll remove it entirely | 10:20 |
| tchaypo | *reads script* | 10:20 |
| tchaypo | Okay, I have mixed feelings | 10:21 |
| tchaypo | I'm happy because I think you're right, I see no reason to do that cd - as far as I can tell all the commands it's calling should be in $PATH after devtest_variables.sh was sourced | 10:21 |
| tchaypo | minor qualm in that we're now moving to a situation where the user is going to get something like "install-dependencies: command not found", which isn't very helpful | 10:25 |
| tchaypo | but I think that's beyond the point where we can help the user | 10:25 |
| openstackgerrit | Gerry Drudy proposed a change to openstack/tripleo-heat-templates: Configure passthrough in swift heat template https://review.openstack.org/92622 | 10:26 |
| tchaypo | I think I'm just sensitive about that because it's what I've been thinking about lately. | 10:26 |
| giulivo | tchaypo, so I just ran it and works for me | 10:26 |
| *** matsuhashi has quit IRC | 10:27 | |
| giulivo | and also, if we had anything in the trace assuming we were in TRIPLEO_ROOT rather than just using TRIPLEO_ROOT I think it would be worth fixing | 10:27 |
| openstackgerrit | Gerry Drudy proposed a change to openstack/tripleo-image-elements: Configure passthrough in proxy-server.conf https://review.openstack.org/92628 | 10:27 |
| tchaypo | The thing that made me sad was spotting cleanup-env there. I've got a change open that will call cleanup-env non-optionally inside _testenv.sh, so now I have to think about whether my change makes sense | 10:28 |
| openstackgerrit | Stuart McLaren proposed a change to openstack/tripleo-incubator: Run the overcloud with an SSL enabled public IP https://review.openstack.org/85098 | 10:31 |
| openstackgerrit | Cian O'Driscoll proposed a change to openstack/diskimage-builder: Explicitly name element enable-serial-console https://review.openstack.org/92805 | 10:31 |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-incubator: Enforces TRIPLEO_ROOT to be set by the user https://review.openstack.org/92611 | 10:37 |
| openstackgerrit | Cian O'Driscoll proposed a change to openstack/diskimage-builder: Explicitly name element enable-serial-console https://review.openstack.org/92805 | 10:37 |
| *** matsuhashi has joined #tripleo | 10:40 | |
| *** e0ne has joined #tripleo | 10:43 | |
| tchaypo | I'm going to step away from the computer now and start winding down, but a privmsg should still reach me for the next few hours :) | 10:44 |
| *** e0ne has quit IRC | 10:44 | |
| *** e0ne has joined #tripleo | 10:45 | |
| *** e0ne_ has joined #tripleo | 10:47 | |
| *** e0ne has quit IRC | 10:47 | |
| *** corrigac has quit IRC | 10:48 | |
| *** lparth_ has joined #tripleo | 10:51 | |
| *** e0ne_ has quit IRC | 10:51 | |
| *** lazy_prince2 has joined #tripleo | 10:53 | |
| *** dtantsur_ has joined #tripleo | 10:54 | |
| *** lazy_prince has quit IRC | 10:55 | |
| *** antonym has quit IRC | 10:55 | |
| *** Matt3 has quit IRC | 10:55 | |
| *** lparth has quit IRC | 10:55 | |
| *** dtantsur has quit IRC | 10:55 | |
| *** dtantsur_ is now known as dtantsur | 10:55 | |
| *** spy1 has joined #tripleo | 10:55 | |
| *** Matt2 has joined #tripleo | 10:56 | |
| *** davidlenwell_ has joined #tripleo | 11:02 | |
| *** rcarrill` has joined #tripleo | 11:15 | |
| *** rcarrillocruz has quit IRC | 11:17 | |
| *** lazy_prince2 has quit IRC | 11:20 | |
| *** matsuhas_ has joined #tripleo | 11:22 | |
| *** matsuhashi has quit IRC | 11:23 | |
| *** jang has quit IRC | 11:23 | |
| *** geerdest has quit IRC | 11:23 | |
| *** funzo has quit IRC | 11:23 | |
| *** jml has quit IRC | 11:23 | |
| *** davidlenwell has quit IRC | 11:23 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Document config properties in haproxy element https://review.openstack.org/90829 | 11:26 |
| *** jml has joined #tripleo | 11:30 | |
| openstackgerrit | jan grant proposed a change to openstack/tripleo-image-elements: Ensure rabbitmq can be successfully restarted https://review.openstack.org/91809 | 11:39 |
| *** funzo has joined #tripleo | 11:40 | |
| *** e0ne has joined #tripleo | 11:42 | |
| *** e0ne_ has joined #tripleo | 11:44 | |
| *** e0ne has quit IRC | 11:44 | |
| *** geerdest has joined #tripleo | 11:47 | |
| *** e0ne_ has quit IRC | 11:49 | |
| *** morazi has joined #tripleo | 12:00 | |
| *** weshay has joined #tripleo | 12:02 | |
| *** tteggel has quit IRC | 12:04 | |
| *** Hazelesque has quit IRC | 12:04 | |
| *** blamar has quit IRC | 12:04 | |
| *** blamar has joined #tripleo | 12:04 | |
| *** e0ne has joined #tripleo | 12:07 | |
| *** e0ne has quit IRC | 12:07 | |
| *** e0ne has joined #tripleo | 12:07 | |
| *** blamar has quit IRC | 12:09 | |
| *** blamar has joined #tripleo | 12:09 | |
| *** e0ne has quit IRC | 12:09 | |
| openstackgerrit | Alexis Lee proposed a change to openstack/tripleo-specs: Control mechanism for os-apply-config https://review.openstack.org/92356 | 12:12 |
| openstackgerrit | jan grant proposed a change to openstack/tripleo-image-elements: Permit non-loopback guest access to Rabbit. https://review.openstack.org/92815 | 12:14 |
| *** tteggel has joined #tripleo | 12:18 | |
| *** Hazelesque has joined #tripleo | 12:18 | |
| Ng | morning | 12:23 |
| lxsli | Eyes please? https://review.openstack.org/#/c/91801/ | 12:25 |
| *** jdob has joined #tripleo | 12:26 | |
| *** julim has joined #tripleo | 12:33 | |
| openstackgerrit | Alexis Lee proposed a change to openstack/tripleo-incubator: Clean up heat env file code https://review.openstack.org/90983 | 12:35 |
| openstackgerrit | Dmitry Shulyak proposed a change to openstack/tripleo-image-elements: Remove hardcoded ports for api endpoints https://review.openstack.org/92550 | 12:37 |
| *** jdob has left #tripleo | 12:39 | |
| *** jdob has joined #tripleo | 12:39 | |
| *** dprince has joined #tripleo | 13:00 | |
| *** jcoufal has quit IRC | 13:00 | |
| *** ramishra has joined #tripleo | 13:01 | |
| openstackgerrit | Stuart McLaren proposed a change to openstack/tripleo-heat-templates: ssl: Add support for a CA Certificate https://review.openstack.org/85100 | 13:03 |
| *** e0ne has joined #tripleo | 13:04 | |
| *** e0ne has quit IRC | 13:05 | |
| *** e0ne has joined #tripleo | 13:06 | |
| *** cwolferh has joined #tripleo | 13:07 | |
| *** ramishra_ has joined #tripleo | 13:08 | |
| *** e0ne has quit IRC | 13:10 | |
| *** ramishra has quit IRC | 13:10 | |
| *** matty_dubs|gone is now known as matty_dubs | 13:12 | |
| *** sballe_ has joined #tripleo | 13:16 | |
| *** sballe has quit IRC | 13:17 | |
| dprince | derekh: in order for the Squid to be really useful we need this too https://review.openstack.org/#/c/92190/ | 13:19 |
| *** martyntaylor has quit IRC | 13:19 | |
| *** martyntaylor has joined #tripleo | 13:22 | |
| *** mrunge has quit IRC | 13:30 | |
| *** ramishra_ has quit IRC | 13:33 | |
| *** ramishra has joined #tripleo | 13:34 | |
| *** dkehn__ is now known as dkehnx | 13:35 | |
| *** Rakesh6 has quit IRC | 13:37 | |
| *** nosnos has quit IRC | 13:38 | |
| *** yamahata has quit IRC | 13:50 | |
| *** yamahata has joined #tripleo | 13:51 | |
| *** weshay has quit IRC | 13:53 | |
| *** weshay has joined #tripleo | 13:55 | |
| *** blamar has quit IRC | 14:05 | |
| *** julim has quit IRC | 14:06 | |
| *** blamar has joined #tripleo | 14:10 | |
| *** e0ne has joined #tripleo | 14:12 | |
| *** rdopieralski has quit IRC | 14:15 | |
| *** e0ne has quit IRC | 14:17 | |
| *** e0ne has joined #tripleo | 14:18 | |
| openstackgerrit | Coleman Corrigan proposed a change to openstack/diskimage-builder: Tidy base image with a truncate of /var/log files https://review.openstack.org/92839 | 14:18 |
| *** e0ne has quit IRC | 14:20 | |
| *** TravT has quit IRC | 14:21 | |
| *** ramishra_ has joined #tripleo | 14:24 | |
| *** ramishra has quit IRC | 14:25 | |
| *** ramishra_ has quit IRC | 14:26 | |
| *** ramishra has joined #tripleo | 14:33 | |
| openstackgerrit | sowmini proposed a change to openstack/tripleo-image-elements: Config updates for dhcp, metadata, l3_agent https://review.openstack.org/89644 | 14:34 |
| *** e0ne has joined #tripleo | 14:37 | |
| *** ramishra_ has joined #tripleo | 14:44 | |
| *** ramishra has quit IRC | 14:45 | |
| *** e0ne_ has joined #tripleo | 14:48 | |
| *** ramishra_ has quit IRC | 14:49 | |
| bnemec | greghaynes: slagle: I talked to Doug (the Oslo PTL) yesterday about those failures, and I think we're just going to disable those cross-test jobs for now. | 14:50 |
| bnemec | The jobs in TripleO got added before we realized that having a cross-test job for every project using oslotest wasn't going to scale well. :-) | 14:50 |
| *** e0ne has quit IRC | 14:51 | |
| bnemec | And we probably don't need cross-test jobs on stable branches anyway. | 14:51 |
| openstackgerrit | Coleman Corrigan proposed a change to openstack/diskimage-builder: Tidy base image with a truncate of /var/log files https://review.openstack.org/92839 | 14:51 |
| bnemec | We're going to discuss the cross-testing issue at summit and then we can re-enable it for these repos. | 14:51 |
| openstackgerrit | Coleman Corrigan proposed a change to openstack/diskimage-builder: Tidy base image with a truncate of /var/log files https://review.openstack.org/92839 | 14:56 |
| *** geerdest_ has joined #tripleo | 14:56 | |
| *** untriaged-bot has joined #tripleo | 15:00 | |
| untriaged-bot | Untriaged bugs so far: | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316985 | 15:00 |
| uvirtbot | Launchpad bug 1316985 in tripleo "set -eu may spuriously break dkms module" [Critical,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317446 | 15:00 |
| uvirtbot | Launchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314978 | 15:00 |
| uvirtbot | Launchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1315355 | 15:00 |
| uvirtbot | Launchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316675 | 15:00 |
| uvirtbot | Launchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317056 | 15:00 |
| uvirtbot | Launchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New] | 15:00 |
| *** untriaged-bot has quit IRC | 15:00 | |
| bnemec | smulcahy: lifeless: Russell just had a baby, so I'm guessing reviewstats isn't too high on his priority list right now. :-) | 15:00 |
| bnemec | I've added a sync of the stats I've been generating locally to my public web server: http://www.nemebean.com/reviewstats/ | 15:01 |
| openstackgerrit | Chris Jones proposed a change to openstack/tripleo-image-elements: Enable collectl on systemd OSes. https://review.openstack.org/92853 | 15:01 |
| bnemec | That way I don't have to keep sticking them in paste.o.o :-) | 15:01 |
| *** andreaf has quit IRC | 15:02 | |
| smulcahy | bnemec: cheers, I actually just noticed http://russellbryant.net/openstack-stats/README.txt - sounds like I need to download em and run em myself. And Gratz to Russell - I hope he enjoyed his sleep up to now :) | 15:02 |
| smulcahy | bnemec: thank you - http://www.nemebean.com/reviewstats/tripleo-open.html is very interesting, total open reviews was 200 the last time I saw it ... ouch | 15:04 |
| *** julim has joined #tripleo | 15:09 | |
| bnemec | smulcahy: Yeah, I think that readme is actually left over from a different issue with reviewstats. | 15:10 |
| *** e0ne_ has quit IRC | 15:10 | |
| bnemec | They were working fine, but then the Gerrit upgrade required some manual intervention. | 15:10 |
| *** csd has joined #tripleo | 15:11 | |
| *** nealph has joined #tripleo | 15:22 | |
| *** matsuhas_ has quit IRC | 15:25 | |
| *** matsuhashi has joined #tripleo | 15:25 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed a change to openstack/tripleo-incubator: Set MySQL Buffer Pool size low for testing https://review.openstack.org/92858 | 15:27 |
| bnemec | https://review.openstack.org/#/c/87039/ passed CI and would be nice to get in now so we don't break everyone's devtest the next time we add a password. :-) | 15:28 |
| *** eghobo has joined #tripleo | 15:30 | |
| *** matsuhashi has quit IRC | 15:31 | |
| slagle | +A'd | 15:32 |
| bnemec | slagle: Thanks! | 15:32 |
| slagle | it hopped on the A train | 15:32 |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Allow adding passwords in setup-*-passwords https://review.openstack.org/87039 | 15:32 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed a change to openstack/tripleo-heat-templates: Defer to element mysql.innodb_buffer_pool_size https://review.openstack.org/92859 | 15:35 |
| *** e0ne has joined #tripleo | 15:36 | |
| *** TravT has joined #tripleo | 15:40 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed a change to openstack/tripleo-image-elements: Raise innodb_buffer_pool_size to 2G https://review.openstack.org/92861 | 15:42 |
| *** martyntaylor has left #tripleo | 15:46 | |
| *** ramishra has joined #tripleo | 15:46 | |
| openstackgerrit | A change was merged to openstack/os-refresh-config: Updated from global requirements https://review.openstack.org/88727 | 15:48 |
| openstackgerrit | A change was merged to openstack/os-collect-config: Updated from global requirements https://review.openstack.org/89238 | 15:58 |
| *** ramishra has quit IRC | 15:59 | |
| *** marun_afk is now known as marun | 16:01 | |
| *** nealph has quit IRC | 16:01 | |
| *** spy1 is now known as antonym | 16:02 | |
| *** saurabhs has joined #tripleo | 16:03 | |
| *** pcrews has joined #tripleo | 16:05 | |
| andrearosa | I have a +2 It'd be good if some core reviewer is around for: https://review.openstack.org/91536 | 16:07 |
| *** markmc has quit IRC | 16:08 | |
| derekh_ | Looks like at least 4 TE hosts on R1 were dead, couldn't rebuild them (they went to error state), trying to add a second testenv stack | 16:09 |
| SpamapS | andrearosa: real quick, there's a _TINY_ nit pick in the commit message from me. | 16:12 |
| SpamapS | andrearosa: fix that and I'll +2 (and +A once CI passes. :) | 16:12 |
| andrearosa | cool thanls | 16:12 |
| andrearosa | thanks even | 16:12 |
| SpamapS | derekh_: yeah I think the PXE timeout is too low which is why rebuilds fail. | 16:13 |
| SpamapS | derekh_: my Nagios did email me about 3.5 hours ago about the TE's being down | 16:13 |
| SpamapS | derekh_: Most likely mellanox fail. Can we roll out trusty TE's? | 16:14 |
| openstackgerrit | Andrea Rosa proposed a change to openstack/tripleo-image-elements: Allow nova to use different configuration files https://review.openstack.org/91536 | 16:14 |
| derekh_ | SpamapS: I'm all for it, I thought we were going to roll out trusty overcloud, it would makes sense to do it all together | 16:14 |
| derekh_ | SpamapS: also would be nice to merge this first, it should fix the problem with TE loosing IP's | 16:15 |
| *** absubram has joined #tripleo | 16:17 | |
| SpamapS | andrearosa: cool. Thanks for the change, it's pretty cool. :) | 16:17 |
| SpamapS | derekh_: did you get lost looking for the link? | 16:17 |
| andrearosa | SpamapS: thank for the review | 16:18 |
| derekh_ | SpamapS: woops https://review.openstack.org/#/c/91333/ | 16:18 |
| absubram | hi.. I have a quick question about the tripleo/.devtestrc environment variables for devtest | 16:18 |
| *** chuckC has quit IRC | 16:18 | |
| absubram | what does the TRIPLEO_CLEANUP flag do? | 16:18 |
| absubram | I'm having an issue with devtest where it seems to timeout after 15s when trying to install the heat requirements.txt.. but then when it fails everything that got built up is all destroyed.. so I'm having a hard time debugging this problem | 16:19 |
| absubram | any suggestions? | 16:19 |
| SpamapS | derekh_: cool | 16:20 |
| *** andreaf has joined #tripleo | 16:21 | |
| SpamapS | absubram: IIRC, TRIPLEO_CLEANUP=0 will disable that, but some of the steps are not idempotent, so things may fail. | 16:21 |
| derekh_ | absubram: there is a env variable you can set that will drop you into a shell in the chroot if an error occurs, one sec | 16:21 |
| SpamapS | absubram: you can set USE_CACHE=1 to re-use the existing images that did succeed.. that will speed things up a lot. | 16:22 |
| SpamapS | break=after-error | 16:22 |
| SpamapS | thats a good one | 16:22 |
| derekh_ | absubram: SpamapS yup thats the one | 16:22 |
| absubram | SpamapS: ok great!.. thanks.. I do see that there is a temporary mounted directory created within /tmp | 16:22 |
| SpamapS | derekh_: testenvs all just came back up? | 16:22 |
| absubram | do you know if that's where pip also gets installed? I could just try and change the pip.conf file to increase the timeout too | 16:23 |
| SpamapS | derekh_: or did the IPs get reused? | 16:23 |
| derekh_ | SpamapS: still spawning, see testenv3 | 16:23 |
| SpamapS | its the ips. My nagios is still pinging the old hosts. :-P | 16:23 |
| derekh_ | SpamapS: not sure if the IP's are the same or not | 16:23 |
| absubram | SpamapS: thanks though! I'll try the USE_CACHE and break=after-error.. cheers | 16:23 |
| *** athomas has quit IRC | 16:24 | |
| derekh_ | SpamapS: I nova deleted the testenv hosts that were dead and brough up a second testenv stack with 4 hosts | 16:24 |
| SpamapS | derekh_: cool | 16:24 |
| SpamapS | derekh_: you can go bigger than 4 | 16:24 |
| SpamapS | or maybe we'll just wait for trusty :) | 16:24 |
| SpamapS | derekh_: I got pulled back off making ci-overcloud more reliable to attack some burning issues with TripleO and scaling. But we do have tons more boxes up and available and working now, so it shouldn't be hard to roll out trusty. | 16:25 |
| derekh_ | SpamapS: cool, I'll see how this goes and update the stack if needed, or wait for trusty | 16:25 |
| *** eghobo has quit IRC | 16:26 | |
| *** ramishra has joined #tripleo | 16:26 | |
| derekh_ | SpamapS: sweet, I can try it out tomorrow and see if it work on a single host, if all is good will replace the whole stack | 16:27 |
| SpamapS | derekh_: we should definitely look into why rebuilds seem to fail more than boots. | 16:27 |
| derekh_ | SpamapS: nova hypervisor-stats, says we have 30 nodes, do they have to be registered yet ? | 16:28 |
| derekh_ | SpamapS: yup, there shouldn't be any difference .... | 16:28 |
| SpamapS | derekh_: findbroken's can be nova deleted | 16:28 |
| *** eghobo has joined #tripleo | 16:28 | |
| derekh_ | SpamapS: I gotta run, those instances are still spawning | 16:29 |
| derekh_ | SpamapS: ok, will take one of them tomorrow and try trusty TE's out | 16:29 |
| SpamapS | derekh_: hm we should have more. I may not have added them back into baremetal yet. Anyway, until later. :) | 16:29 |
| *** derekh_ has quit IRC | 16:30 | |
| *** jang has joined #tripleo | 16:31 | |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-incubator: Enforces TRIPLEO_ROOT to be set by the user https://review.openstack.org/92611 | 16:33 |
| bnemec | giulivo: I'm still getting an unbound variable. Apparently bash doesn't short-circuit that variable reference. | 16:36 |
| giulivo | bnemec, I tested that | 16:37 |
| giulivo | let me try from devtest.sh | 16:37 |
| giulivo | bnemec, especially, it was like that before ... didn't change that pat | 16:39 |
| giulivo | *part | 16:39 |
| bnemec | With the latest commit I'm still seeing it: http://paste.openstack.org/show/79612/ | 16:39 |
| bnemec | Right, but this wasn't a problem before because we always set TRIPLEO_ROOT. | 16:39 |
| openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Defer to element mysql.innodb_buffer_pool_size https://review.openstack.org/92859 | 16:42 |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Set MySQL Buffer Pool size low for testing https://review.openstack.org/92858 | 16:42 |
| bnemec | ^That hadn't passed CI yet, had it? | 16:42 |
| bnemec | Either of them. | 16:42 |
| SpamapS | Ng: you're at it again | 16:43 |
| *** petertoft has quit IRC | 16:43 | |
| *** lucasagomes has quit IRC | 16:44 | |
| lxsli | check-tripleo gate is blocked? | 16:44 |
| Ng | one had | 16:44 |
| Ng | the other one, not so much :/ | 16:44 |
| SpamapS | The gate is slow, shouldn't be blocked | 16:45 |
| SpamapS | or rather, CI is slow | 16:45 |
| SpamapS | we really don't have a gate. ;) | 16:45 |
| lxsli | 92573 is saying 25hrs? | 16:46 |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-incubator: Enforces TRIPLEO_ROOT to be set by the user https://review.openstack.org/92611 | 16:46 |
| SpamapS | lxsli: we've had some resource issues. :-P | 16:46 |
| lxsli | heh ok I'll leave it alone | 16:46 |
| bnemec | We're still getting some pretty bad f20 starvation, aren't we? | 16:46 |
| giulivo | sorry for the additional patchset :( | 16:46 |
| SpamapS | new testenvs are coming online right now | 16:46 |
| SpamapS | which should help | 16:46 |
| giulivo | had to fix what bnemec said | 16:46 |
| SpamapS | giulivo: no apologies needed for fixing stuff :) | 16:48 |
| SpamapS | lxsli: I think 92573's testenv died in the middle of the f20 test.. so it will have to time out | 16:48 |
| *** davidlenwell_ is now known as davidlenwell | 16:49 | |
| openstackgerrit | Stuart McLaren proposed a change to openstack/tripleo-incubator: Run the overcloud with an SSL enabled public IP https://review.openstack.org/85098 | 16:49 |
| *** ChanServ sets mode: +v davidlenwell | 16:49 | |
| *** newell_ has joined #tripleo | 16:49 | |
| *** eghobo has quit IRC | 16:51 | |
| *** eghobo has joined #tripleo | 16:51 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Adding collectl element. https://review.openstack.org/91155 | 16:54 |
| *** epim has joined #tripleo | 16:54 | |
| *** e0ne has quit IRC | 17:00 | |
| *** chuckC has joined #tripleo | 17:01 | |
| *** geertj has joined #tripleo | 17:01 | |
| *** eguz has joined #tripleo | 17:03 | |
| *** eguz has quit IRC | 17:03 | |
| *** ramishra has quit IRC | 17:03 | |
| *** eghobo has quit IRC | 17:04 | |
| *** epim has quit IRC | 17:05 | |
| *** andreaf has quit IRC | 17:07 | |
| *** jang has quit IRC | 17:07 | |
| *** epim has joined #tripleo | 17:14 | |
| *** mestery_ has joined #tripleo | 17:14 | |
| *** epim has quit IRC | 17:14 | |
| *** mestery has quit IRC | 17:14 | |
| openstackgerrit | Saurabh Surana proposed a change to openstack/tripleo-image-elements: Provide a way to set user permission for rabbitmq users https://review.openstack.org/92659 | 17:15 |
| *** absubram has quit IRC | 17:15 | |
| *** mestery_ is now known as mestery | 17:16 | |
| openstackgerrit | Stuart McLaren proposed a change to openstack/tripleo-incubator: Run the overcloud with an SSL enabled public IP https://review.openstack.org/85098 | 17:20 |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-incubator: Enforces TRIPLEO_ROOT to be set by the user https://review.openstack.org/92611 | 17:25 |
| *** chuckC has quit IRC | 17:32 | |
| bnemec | Would anyone object to a mass abandon of the Glance config patches like https://review.openstack.org/#/c/76580/ ? | 17:38 |
| bnemec | They all look like things that need to be handled with passthrough, but I can't -2 because they're probably pushed as drafts. | 17:38 |
| bnemec | And they're cluttering up the open reviews list. | 17:39 |
| *** rcarrillocruz has joined #tripleo | 17:40 | |
| *** rcarrill` has quit IRC | 17:42 | |
| greghaynes | lifeless: Your comment on https://review.openstack.org/#/c/90134/3/elements/mysql/os-refresh-config/configure.d/51-mysql-init - Do you mean the problem should be solved via templating, not multiple configs? | 17:43 |
| greghaynes | or you simply just want it getting baked into the right location? | 17:44 |
| *** chuckC has joined #tripleo | 17:50 | |
| *** mestery has quit IRC | 17:55 | |
| adam_g | anyone know if the source to the script that generates http://goodsquishy.com/downloads/tripleo-jobs.html is around somewhere? | 17:55 |
| *** mestery has joined #tripleo | 17:55 | |
| openstackgerrit | A change was merged to openstack/tripleo-incubator: Add Ceilometer to control node by default https://review.openstack.org/89625 | 17:58 |
| openstackgerrit | Michael Tupitsyn proposed a change to openstack/tripleo-incubator: Handy utility to deep merge JSON strings https://review.openstack.org/92881 | 18:03 |
| *** epim has joined #tripleo | 18:07 | |
| *** davidlenwell has quit IRC | 18:07 | |
| *** davidlenwell has joined #tripleo | 18:09 | |
| *** ChanServ sets mode: +v davidlenwell | 18:09 | |
| *** Ng_ has joined #tripleo | 18:11 | |
| *** Ng_ has quit IRC | 18:12 | |
| *** epim has quit IRC | 18:13 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Make python2.6 tests a noop https://review.openstack.org/88645 | 18:14 |
| *** petertoft has joined #tripleo | 18:15 | |
| *** epim has joined #tripleo | 18:16 | |
| Ng | bnemec: I believe it is intended that we mass -2 the config patches that can be handled with passthrough | 18:17 |
| *** rcarrillocruz has quit IRC | 18:17 | |
| bnemec | adam_g: Check with derekh when he comes back online. I believe he has them. | 18:17 |
| *** rcarrillocruz has joined #tripleo | 18:17 | |
| bnemec | Ng: I can't -2 those though. | 18:17 |
| adam_g | bnemec, yeah, i cant seem to catch him. ill send an email | 18:17 |
| greghaynes | For HAing services - Should we make the HAProxy port the default port for the service, and then have the services listen on a non-standard port? Or should we do it the other way around? | 18:17 |
| bnemec | infra thinks because they were pushed as draft. | 18:17 |
| greghaynes | Im sort of thinking HAProxy should serve on the standard port... but just saw a patch up implying the other way | 18:18 |
| bnemec | greghaynes: I'm inclined to agree. HA is going to be our default configuration, right? | 18:18 |
| greghaynes | Yes | 18:19 |
| greghaynes | Seems better to not force non-default config onto the clients if we dont have to... | 18:19 |
| clarkb | greghaynes: if possible make all listen on the standard port. That requires a different interface for each though | 18:20 |
| greghaynes | yea, I think that wont fly though - we tend to bind on * so we dont need special smarts for adding/removing interfaces and poking the services | 18:21 |
| *** morganfainberg_Z is now known as morganfainberg | 18:22 | |
| Ng | I would go for HAProxy on the standard port and the services on a non-standard port | 18:22 |
| greghaynes | dshulyak: ^ | 18:22 |
| clarkb | greghaynes: yeah thats what I have done in the past. Then later you really wish they were on the same port | 18:22 |
| greghaynes | Yep, pay it now or pay it later ;) | 18:22 |
| *** darraghb has quit IRC | 18:27 | |
| *** Ng has quit IRC | 18:27 | |
| adam_g | keeping everything on standard ports lets you add/remove stuff from the request pipeline later without clients/keystone worrying about anything. ie, adding stunnel/apache in front of haproxy | 18:30 |
| *** Ng has joined #tripleo | 18:30 | |
| *** ChanServ sets mode: +v Ng | 18:30 | |
| *** eghobo has joined #tripleo | 18:32 | |
| *** dshulyak_ has joined #tripleo | 18:32 | |
| openstackgerrit | Trent Geerdes proposed a change to openstack/tripleo-incubator: Move most undercloud params to an environment file https://review.openstack.org/91717 | 18:41 |
| greghaynes | huh, asking nova for info on the see id barfing with: URL's project_id '07bdb21618d143418604d12296c45c66' doesn't match Context's project_id '.... | 18:49 |
| greghaynes | anyone seen this? | 18:49 |
| greghaynes | argh, s/see id/seed is/ | 18:49 |
| *** epim has quit IRC | 18:56 | |
| *** dshulyak_ has quit IRC | 18:59 | |
| openstackgerrit | Phil Neal proposed a change to openstack/tripleo-incubator: Updating ceilometer endpoint setup on overcloud deploy https://review.openstack.org/90132 | 19:00 |
| *** petertoft has quit IRC | 19:01 | |
| *** eghobo has quit IRC | 19:04 | |
| *** openstackgerrit has quit IRC | 19:04 | |
| *** openstackgerrit has joined #tripleo | 19:05 | |
| openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-incubator: Separate Heat BM and VM configs for Nova-BM. https://review.openstack.org/90033 | 19:06 |
| openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-incubator: Expose passthrough configuration in undercloud. https://review.openstack.org/91792 | 19:07 |
| openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-incubator: Choose whether to deploy/update using heat. https://review.openstack.org/92344 | 19:07 |
| openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-incubator: Allows user-specified PXE timeout for undercloud https://review.openstack.org/86605 | 19:07 |
| *** eghobo has joined #tripleo | 19:08 | |
| *** andreaf has joined #tripleo | 19:10 | |
| *** andreaf has quit IRC | 19:10 | |
| *** andreaf has joined #tripleo | 19:11 | |
| *** epim has joined #tripleo | 19:12 | |
| *** Ng has quit IRC | 19:12 | |
| *** eghobo has quit IRC | 19:27 | |
| *** Ng has joined #tripleo | 19:28 | |
| *** ChanServ sets mode: +v Ng | 19:28 | |
| *** Ng_ has joined #tripleo | 19:32 | |
| *** Ng has quit IRC | 19:32 | |
| *** Ng_ is now known as Ng | 19:33 | |
| *** ChanServ sets mode: +v Ng | 19:33 | |
| *** geertj has quit IRC | 19:35 | |
| bnemec | Ruh-roh, Percona file disappeared again? http://logs.openstack.org/58/92858/1/check-tripleo/check-tripleo-ironic-seed-precise/1e6c372/console.html | 19:35 |
| adam_g | bnemec, just hitting that myself | 19:37 |
| bnemec | greghaynes: ^ | 19:38 |
| bnemec | Should help clear out the CI queue quickly, at least. :-) | 19:38 |
| notq | just ran into that | 19:39 |
| notq | Server returned an unexpected response code. [404] | 19:39 |
| *** geertj has joined #tripleo | 19:40 | |
| lifeless | greghaynes: either would be better than templating and copying :) | 19:40 |
| notq | what can i do from here? | 19:40 |
| lifeless | bnemec: I dropped him a mail just in case he has a timeslice | 19:41 |
| *** eghobo has joined #tripleo | 19:44 | |
| bnemec | notq: Try exporting DIB_REPOLOCATION_xtradb_cluster=http://www.percona.com/redir/downloads/Percona-XtraDB-Cluster/LATEST/binary/linux/x86_64/Percona-XtraDB-Cluster-5.5.37-rel35.0-25.10.756.Linux.x86_64.tar.gz | 19:45 |
| bnemec | That's the file they just released today. | 19:45 |
| lifeless | bnemec: is there a patch up? | 19:45 |
| bnemec | lifeless: Not that I know of. I just saw this fail in CI a few minutes ago. | 19:45 |
| notq | any problems rerunning devtestundercloud? | 19:45 |
| bnemec | I'm not positive that's the right version to use either, but it's what I get if I strip off the filename from the url. | 19:46 |
| bnemec | lifeless: I guess I can propose that as a new path and if it's not right we aren't any more broken than right now. :-) | 19:47 |
| notq | haha | 19:47 |
| notq | i guess i'll just rerun it | 19:47 |
| bnemec | notq: Run with -c | 19:48 |
| bnemec | Then it won't rebuild images that it already has. | 19:48 |
| notq | thanks | 19:48 |
| greghaynes | :( | 19:49 |
| greghaynes | why does percona remove old packages | 19:50 |
| greghaynes | It kinda made sense with the ssl thing... but not this time | 19:50 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Ensure rabbitmq can be successfully restarted https://review.openstack.org/91809 | 19:51 |
| notq | with the export, i still get the error | 19:51 |
| *** d0ugal has quit IRC | 19:51 | |
| bnemec | greghaynes: I wonder if we should stop using the LATEST path. | 19:52 |
| greghaynes | ! right | 19:53 |
| openstack | greghaynes: Error: "right" is not a valid command. | 19:53 |
| greghaynes | haha | 19:53 |
| bnemec | I still see 5.5.34 available at http://www.percona.com/redir/downloads/Percona-XtraDB-Cluster/5.5.34-25.9/source/Percona-XtraDB-Cluster-5.5.34.tar.gz | 19:53 |
| notq | simple fix, makes sense, make it happen :) | 19:53 |
| lifeless | whyu was https://review.openstack.org/#/c/92858/ merged with out a CI result? | 19:53 |
| *** chuckC has quit IRC | 19:54 | |
| bnemec | lifeless: I asked the same thing. | 19:54 |
| lifeless | Ng: ^ | 19:54 |
| * greghaynes makes percona patch for this | 19:54 | |
| notq | greghaynes++ | 19:54 |
| * bnemec stops trying to figure out which path to use now that greghaynes is on the case | 19:55 | |
| notq | whatever the last version tested, the linteral link instead of latest | 19:55 |
| notq | :) | 19:55 |
| lifeless | SpamapS: ^ do you know ? | 19:56 |
| *** rcarrill` has joined #tripleo | 19:57 | |
| lifeless | GheRivero: ^ | 19:57 |
| lifeless | It also is a problematic implementation, we need to let folk choose buffers larger than 100M | 19:58 |
| *** marun is now known as maru_afk | 19:58 | |
| *** rcarrillocruz has quit IRC | 19:58 | |
| *** rcarrill` has left #tripleo | 19:58 | |
| SpamapS | lifeless: Ng forgot I think. | 19:59 |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-image-elements: Use version dir, not LATEST for percona d/l path https://review.openstack.org/92903 | 19:59 |
| SpamapS | lifeless: It's been 100M since the original patch to move it down to 100M was merged to tripleo-heat-templates | 20:00 |
| SpamapS | lifeless: and unconfigurable in devtest | 20:00 |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-image-elements: Use version dir, not LATEST for percona d/l path https://review.openstack.org/92903 | 20:01 |
| notq | do i just git pull again to get the new version, and continue my install? | 20:01 |
| lifeless | SpamapS: yeah | 20:01 |
| lifeless | SpamapS: problem is its still unconfigurable | 20:01 |
| greghaynes | notq: no, it needs to get merged (and firstly to pass tests/review) | 20:01 |
| lifeless | SpamapS: its on an arc to being configurable, which is good | 20:01 |
| greghaynes | notq: there is a command on that URL you can use to checkout that patch though | 20:02 |
| lifeless | I need to go wake C up, feed her and get her to kindy | 20:02 |
| notq | okay, i will try to figure that out :) | 20:02 |
| lifeless | SpamapS: do you want to iterate on the incubator patch while I do that? | 20:02 |
| SpamapS | lifeless: do what? | 20:04 |
| SpamapS | lifeless: the jobs all failed because Percona 404'd xtradb btw. | 20:04 |
| notq | i'm not understanding how to grab this. can i edit the files with your changes? | 20:04 |
| notq | oh i see, the download | 20:04 |
| notq | nevermind | 20:05 |
| *** jdob has quit IRC | 20:06 | |
| notq | it's a 1 line change, can i just edit the file and rerun? | 20:06 |
| bnemec | notq: That should work, yes. | 20:06 |
| *** julim has quit IRC | 20:08 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-image-elements: Use version dir, not LATEST for Percona d/l path https://review.openstack.org/92903 | 20:12 |
| notq | returned a 404. maybe i made a typo tho, checking. | 20:14 |
| *** eghobo has quit IRC | 20:16 | |
| *** geertj has quit IRC | 20:16 | |
| *** derekh_ has joined #tripleo | 20:18 | |
| greghaynes | notq: no, yorue right | 20:18 |
| greghaynes | borked | 20:18 |
| derekh_ | adam_g: Here is an version of the script (a little different then what I'm running now) https://review.openstack.org/#/c/81236/ | 20:18 |
| notq | no, it's working for me now | 20:18 |
| notq | i had a typo | 20:18 |
| derekh_ | adam_g: I'll get the most recent version and take out the hacks to generate http://goodsquishy.com/downloads/s_tripleo-jobs.html (unless you want a version with some hacky log parsing) | 20:20 |
| greghaynes | -> noms | 20:21 |
| * derekh_ is on the hunt for a new nick, some other derekh took mine | 20:21 | |
| greghaynes | 'therealderekh' | 20:21 |
| lifeless | SpamapS: its hardcoded in devtest_* now | 20:22 |
| lifeless | SpamapS: which for folk using those scripts means its still clamped at 100M with no override | 20:22 |
| derekh_ | greghaynes: good suggestion, I'll ponder it over the summit | 20:22 |
| lifeless | SpamapS: because they can't disable the passing of the parameter to heat. | 20:22 |
| derekh_ | I was sure I had it properly registered .... | 20:23 |
| notq | failed at sqlalchemy | 20:25 |
| notq | rerunning again to verify if it stays the same | 20:26 |
| openstackgerrit | Ed Bak proposed a change to openstack/tripleo-image-elements: Enable additional ml2_conf.ini configuration https://review.openstack.org/92908 | 20:29 |
| *** epim has quit IRC | 20:29 | |
| *** epim has joined #tripleo | 20:30 | |
| notq | Downloading/unpacking SQLAlchemy>=0.7.8,<=0.9.99 (from -r /opt/stack/heat/requirements.txt (line 28)) | 20:31 |
| notq | fails after that | 20:31 |
| notq | http://pastebin.com/qgZZzstz | 20:32 |
| *** scotty95747 has joined #tripleo | 20:32 | |
| greghaynes | What do we think of using an overcloud-env-source.json which we initialize overcloud-env.json from? This would let users pass the parameters (like the innodb buffer size) without adding yet another env var | 20:34 |
| *** scott-millward has quit IRC | 20:34 | |
| bnemec | slagle: greghaynes: re the cross-test failure on stable: https://review.openstack.org/#/c/92910 | 20:35 |
| greghaynes | ah, thats one way to make tests not fail ;) | 20:36 |
| SpamapS | lifeless: it was hard coded there before by not being specified (and thus deferring to the heat template default of 100) | 20:36 |
| * bnemec is an idiot | 20:38 | |
| SpamapS | lifeless: I'm saying, there's no regression, and the point of doing it was to get back to a production-ish default. I agree that we should evaluate making it configurable from devtest. | 20:38 |
| * bnemec just triggered a recheck even though the percona fix isn't in yet | 20:38 | |
| greghaynes | moar 404s! | 20:39 |
| SpamapS | greghaynes: we should ask them for a static redirect link. :) | 20:40 |
| greghaynes | ooo what would be nice | 20:40 |
| openstackgerrit | Trent Geerdes proposed a change to openstack/diskimage-builder: Adding -x to set parameters for more output https://review.openstack.org/91592 | 20:41 |
| SpamapS | greghaynes: YES... death to the env vars. | 20:44 |
| *** epim has quit IRC | 20:45 | |
| *** epim has joined #tripleo | 20:45 | |
| SpamapS | derekh_: did you see the errors on the testenvs? | 20:47 |
| SpamapS | never seen that before | 20:47 |
| derekh_ | SpamapS: ya, they had downloaded the deploy image so must have failed after that, I'll testcons into one of them to see what I can see | 20:48 |
| *** dprince has quit IRC | 20:48 | |
| adam_g | derekh_, awesome, thanks! | 20:49 |
| openstackgerrit | Haneef Ali proposed a change to openstack/tripleo-heat-templates: Add overcloud parameter to start keystone under Apache https://review.openstack.org/92912 | 20:49 |
| derekh_ | frickit their not in the nova_bm db | 20:49 |
| derekh_ | | fault | {u'message': u'Unknown auth strategy', u'code': 500, u'details': u' File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 259, in decorated_function | | 20:51 |
| derekh_ | Anybody know what causes that? ^^ | 20:52 |
| openstackgerrit | Ed Bak proposed a change to openstack/tripleo-image-elements: Change neutron-ovs-agent to use ml2_conf.ini https://review.openstack.org/92913 | 20:52 |
| *** epim has quit IRC | 20:57 | |
| *** untriaged-bot has joined #tripleo | 21:00 | |
| untriaged-bot | Untriaged bugs so far: | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316985 | 21:00 |
| uvirtbot | Launchpad bug 1316985 in tripleo "set -eu may spuriously break dkms module" [Critical,New] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317446 | 21:00 |
| uvirtbot | Launchpad bug 1317446 in tripleo "Whitespace in SSLCertificate param causes jq error" [Undecided,In progress] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1314978 | 21:00 |
| uvirtbot | Launchpad bug 1314978 in tripleo "Cloud vm not pingable after overcloud upgrade " [Undecided,New] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1315355 | 21:00 |
| uvirtbot | Launchpad bug 1315355 in tripleo "Upgrade of overcloud failed with "Connection to neutron failed: Maximum attempts reached"" [Undecided,New] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1316675 | 21:00 |
| uvirtbot | Launchpad bug 1316675 in tripleo "Saving a devtest VM results in error" [Undecided,In progress] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1317056 | 21:00 |
| uvirtbot | Launchpad bug 1317056 in tripleo "Guest VM FS corruption after compute host reboot" [Undecided,New] | 21:00 |
| *** untriaged-bot has quit IRC | 21:00 | |
| notq | any thoughts on my issue? http://pastebin.com/qgZZzstz | 21:02 |
| SpamapS | derekh_: they're not in the nova_bm db?? wha? | 21:03 |
| derekh_ | SpamapS InstanceDeployFailure: Timeout reached while waiting for PXE deploy of instance bd77a282-3d06-4860-a9eb-06aaa595470d | 21:03 |
| SpamapS | derekh_: oh you can't tell because they tried and failed.. they're not ssigned anymore. | 21:03 |
| derekh_ | SpamapS: ya, I can't figure out which host they were assigned to, | 21:04 |
| derekh_ | novs_bm db is no use | 21:04 |
| SpamapS | derekh_: nor is the log, oddly enough | 21:06 |
| *** eghobo has joined #tripleo | 21:06 | |
| SpamapS | seems like it would at least say "assigned instance X to host Y" | 21:06 |
| *** epim has joined #tripleo | 21:06 | |
| derekh_ | SpamapS: yup | 21:07 |
| SpamapS | derekh_: well they all failed, so the 4 not used == the problem | 21:07 |
| derekh_ | yup, ok, I'm thinking maybe I try again and find out while its running, I wont be around long enough to wait for the them to fail again, so can either kick them off for you / somebody else to watch or do it in the morning when I'm back | 21:09 |
| derekh_ | SpamapS: ^ either is good with me | 21:09 |
| * derekh_ wonders if we have a mysql bin log | 21:09 | |
| derekh_ | no bin log | 21:10 |
| *** ravikumar_hp has joined #tripleo | 21:11 | |
| SpamapS | binlog == luxury ;) | 21:16 |
| notq | it says "Storing debug log for failure in /root/.pip/pip.log" but that file doesn't exist | 21:16 |
| SpamapS | derekh_: so what do you want me to do, watch one of the assigned servers? | 21:16 |
| *** matty_dubs is now known as matty_dubs|gone | 21:18 | |
| derekh_ | SpamapS: basically what I would do is see what its doing in textcons while its deploying, I'll do it in the morning unless you want to now, I don't think testenv shortage is currently causing much of a problem so either is fine | 21:19 |
| SpamapS | derekh_: where is the testenv template located? | 21:20 |
| SpamapS | derekh_: and do you have an environment file? | 21:21 |
| lifeless | SpamapS: but before you could pass it in the env file | 21:21 |
| SpamapS | derekh_: we're going to get a lot of patches rechecked once 92903 lands.. :-P | 21:21 |
| lifeless | SpamapS: so it was configurable before and now isn't | 21:21 |
| derekh_ | SpamapS: I have a custom version to just deploy4 test envs | 21:22 |
| derekh_ | root@undercloud-notcompute-jws3awlsb2kh:/home/heat-admin# cd /opt/stack/ | 21:22 |
| bnemec | notq: It looks like a dns error. If I'm reading the error right, it isn't finding your configured proxy address. | 21:22 |
| derekh_ | root@undercloud-notcompute-jws3awlsb2kh:/opt/stack# ./tripleo-image-elements/elements/tripleo-cd/bin/deploy-testenv_ ./tripleo-image-elements/elements/tripleo-cd/configs/te_hp1rc | 21:22 |
| lifeless | SpamapS: regardless of whether its a regression or not, ghe's on-baremetal-test can't avoid this problem until we make it overridable again | 21:22 |
| derekh_ | SpamapS: ^ those 2 commands should do it | 21:22 |
| SpamapS | lifeless: ah, see I didn't even know that. | 21:23 |
| derekh_ | SpamapS: its basically what was used to build the existing testenv stack , just a little smaller | 21:23 |
| SpamapS | derekh_: ok ty.. will try to poke it later | 21:23 |
| derekh_ | SpamapS: ok | 21:23 |
| notq | bnemec: it worked on all the other packages, so what is different at this point. it repeatibly stops here. | 21:23 |
| lifeless | SpamapS: the heat environment file support allowed anyone to set any option we don't explicitly set | 21:24 |
| lifeless | SpamapS: by explicitly setting it to a hard coded value we prevent it being set at all | 21:24 |
| SpamapS | ok, missed that, as did our core reviewers | 21:24 |
| SpamapS | so let's just fix that. Simple enough right? | 21:24 |
| lifeless | right | 21:24 |
| SpamapS | something like "if not in env file already, set to X" ? | 21:24 |
| lifeless | or value-to-put-in-env=query-env || 100 | 21:25 |
| lifeless | same same | 21:25 |
| *** e0ne has joined #tripleo | 21:27 | |
| bnemec | notq: I don't know, I've never seen that error before. Can you pip install sqlalchemy standalone? That would tell you whether it's a general environment issue or only a problem during image builds. | 21:28 |
| derekh_ | Ironic seed has passed CI https://review.openstack.org/#/c/92903/ | 21:29 |
| notq | it installed just fine from root | 21:29 |
| *** derekh_ has quit IRC | 21:32 | |
| notq | it failed again in the same place | 21:34 |
| tchaypo | good morning everyone! | 21:35 |
| tchaypo | notq: the fact that it says it's storing the log in /root/.pip/pip.log makes me think this is happening inside the DIB chroot | 21:36 |
| tchaypo | once that error happens the chroot is cleaned up and the log goes away, and it only ever existed inside the chroot anyway, not the /root you were probably looking in | 21:37 |
| mordred | vinsh: you still work with the hp public cloud, right? | 21:37 |
| tchaypo | notq: see the section on debugging at https://pypi.python.org/pypi/diskimage-builder/0.0.1 - you can "export break=after-error", and then it will drop you into a shell *inside the chroot* after that failure, so you get a chance to look at the pip.log | 21:38 |
| tchaypo | notq: as soon as you leave the shell the chroot will be cleaned up | 21:38 |
| lifeless | SpamapS: sent a brief note about this feature to the dev list | 21:39 |
| *** giulivo has quit IRC | 21:39 | |
| lifeless | SpamapS: let me know if I didn't capture enough info | 21:39 |
| *** rlandy has quit IRC | 21:40 | |
| *** michchap has quit IRC | 21:40 | |
| notq | tchaypo: thanks, working through it | 21:41 |
| lifeless | GheRivero: hmm I nearly forgot about https://review.openstack.org/#/c/85130/ | 21:42 |
| vinsh | mordred, It is the lowest priority on my plate. I only do swift deployments for critical updates right now. all of my other focus is on working on HA and scaling the control nodes. | 21:42 |
| GheRivero | lifeless: I will catch up with it first time tomorrow, unless there is some volunteer for it :) | 21:43 |
| lifeless | GheRivero: I don't think its urgent | 21:43 |
| lifeless | GheRivero: just was reminded of it when I went to hack on this environment file interaction for the mysql cache setting | 21:44 |
| GheRivero | lifeless: ok. Anyway, I have some time between deployments... if only there were faster! | 21:44 |
| lifeless | so we should probably land https://review.openstack.org/#/c/92903/ now - the seed has passed | 21:44 |
| tchaypo | lifeless: "12 Factors of Business Success" - was that the book you mentioned? | 21:45 |
| lifeless | which means the url issue is fixed | 21:45 |
| bnemec | lifeless: +1 | 21:45 |
| lifeless | cores - thoughts ? ^ | 21:45 |
| tchaypo | lifeless: (I noted the "12 factors" bit but didn't catch the rest of the title) | 21:45 |
| GheRivero | do we have any update on https://bugs.launchpad.net/tripleo/+bug/1316475? | 21:45 |
| uvirtbot | Launchpad bug 1316475 in tripleo "trusty hang on first boot post deploy" [Critical,Triaged] | 21:45 |
| lifeless | tchaypo: what context was this? the 12 factor thing I have in my head is http://12factor.net/ | 21:45 |
| GheRivero | +1 to land the percone fix | 21:46 |
| lifeless | landing it | 21:46 |
| tchaypo | lifeless: ah, bingo. that makes more sense, thanks | 21:46 |
| tchaypo | lifeless: and the first thing is "Use a declarative format for setup automation". I'm on-board already. | 21:46 |
| *** andreaf_ has joined #tripleo | 21:51 | |
| lifeless | wendar: around? | 21:54 |
| *** andreaf has quit IRC | 21:54 | |
| lifeless | greghaynes: I closed tabs. doh. Next HA patch ? | 21:56 |
| greghaynes | https://review.openstack.org/#/c/89556/ needs to go in | 21:57 |
| *** epim has quit IRC | 21:57 | |
| lifeless | btw you have feedback on https://review.openstack.org/#/c/83296/ | 21:57 |
| greghaynes | Yep, just noticed that and the heat template need me to update | 21:57 |
| greghaynes | How does the number 30 sound to you? | 21:58 |
| lifeless | Perhaps a tad hi :) | 21:58 |
| lifeless | I was tinking 10-15 | 21:58 |
| greghaynes | ok | 21:58 |
| greghaynes | *shrug* its all free anyways | 21:59 |
| lifeless | big enough to do most topologies, not so big that its completely infeasible on current gen hardware | 21:59 |
| greghaynes | ah, fair enough | 21:59 |
| lifeless | greghaynes: not *entirely* - each deploy will consume COW space | 21:59 |
| lifeless | so 30 VM definitions, run around enough times to write 3G to each and you have 90G in qcow2 files | 21:59 |
| greghaynes | holy cow | 21:59 |
| *** epim has joined #tripleo | 22:01 | |
| notq | not much more detail in the pip.log, looks to be the same | 22:02 |
| *** cwolferh has quit IRC | 22:02 | |
| notq | http://pastebin.com/mywhpVBt | 22:02 |
| notq | and i installed it manually with pip as root just fine | 22:03 |
| *** epim has left #tripleo | 22:04 | |
| *** e0ne has quit IRC | 22:04 | |
| *** e0ne has joined #tripleo | 22:05 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-incubator: Set NODE_CNT to 15 and add OVERCLOUD_CONTROLSCALE https://review.openstack.org/83296 | 22:10 |
| greghaynes | oh crap, I missed an opportunity to make a commit string of "Turning NODE_CNT up to 11" | 22:11 |
| notq | :) | 22:11 |
| openstackgerrit | Tim Potter proposed a change to openstack/diskimage-builder: Add documentation for DIB_* global image-build variables https://review.openstack.org/92752 | 22:11 |
| openstackgerrit | Gregory Haynes proposed a change to openstack/tripleo-incubator: Set NODE_CNT to 15 and add OVERCLOUD_CONTROLSCALE https://review.openstack.org/83296 | 22:12 |
| adam_g | greghaynes, http://i.imgur.com/0oUUE45.jpg | 22:13 |
| greghaynes | haha, well done | 22:13 |
| *** chuckC has joined #tripleo | 22:14 | |
| nibalizer | adam_g: nice | 22:22 |
| *** eghobo has quit IRC | 22:29 | |
| *** eghobo has joined #tripleo | 22:29 | |
| wendar | lifeless: hi | 22:29 |
| lifeless | wendar: Hi :) - see privmsg | 22:32 |
| *** maru_afk is now known as marun | 22:32 | |
| *** ccrouch1 has quit IRC | 22:35 | |
| *** e0ne has quit IRC | 22:35 | |
| *** rbrady is now known as rbrady-biab | 22:41 | |
| tchaypo | notq: Maybe it's just your proxy being flaky? Are you using squid on localhost, or something else? | 22:45 |
| bnemec | Grr. https://review.openstack.org/#/c/92903/ is stuck waiting for everything ahead of it in Zuul to pass, even though there's no dependencies there. | 22:45 |
| * bnemec makes another note for the Oslo cross-test summit session | 22:45 | |
| lifeless | :) | 22:45 |
| lifeless | bnemec: you can ask infra to requeue things, which is there explicitly for such 'zomg everything is broken' situations | 22:51 |
| bnemec | Oh dear, what have I done now? https://review.openstack.org/#/c/77924/ :-( | 22:52 |
| greghaynes | whaaaa | 22:52 |
| tchaypo | niiiiice | 22:52 |
| greghaynes | bnemec: hey, I think your change was unable to be automatically merged | 22:53 |
| bnemec | greghaynes: I'm not sure, better try again just in case. :-) | 22:53 |
| bnemec | Nice 123 Gerrit spams in about 30 seconds. | 22:54 |
| * bnemec toddles off to infra | 22:54 | |
| notq | tchaypo, corporate proxy. if it was just being flakey, it wouldn't stop at the same spot each time. | 22:56 |
| tchaypo | notq: unless it was a very special kind of flakey | 22:56 |
| *** jesusaurus has joined #tripleo | 22:57 | |
| tchaypo | but that seems unlikely | 22:57 |
| notq | i can install it manaully via pip just fine | 22:57 |
| *** andreaf_ has quit IRC | 22:58 | |
| tchaypo | Are you using the pypi or pypi-mirror elements in your build? | 22:58 |
| tchaypo | If you were, you'd probably set them in DIB_COMMON_ELEMENTS | 22:59 |
| tchaypo | I think pypi is the element I was thinking of. https://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/pypi/README.md has instructions on getting it set up | 23:01 |
| tchaypo | it pre-caches all the packages you need under ~/.cache/image-create and then the installs come from there. It's faster, and it avoids hitting the proxy during the image build | 23:02 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Glance: Make quotas configurable https://review.openstack.org/77924 | 23:03 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Glance: Make API versions configurable https://review.openstack.org/76580 | 23:06 |
| greghaynes | bnemec: that is a pretty hilarious workaround | 23:06 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Glance: Make API versions configurable https://review.openstack.org/76580 | 23:09 |
| bnemec | Argh, not working for that change. | 23:09 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Glance: Make tcp_keepidle configurable for API https://review.openstack.org/77929 | 23:10 |
| notq | i am just following along here http://docs.openstack.org/developer/tripleo-incubator/devtest.html with no options changed. | 23:12 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Glance: Make API's registry parameters configurable https://review.openstack.org/77224 | 23:12 |
| notq | so you're saying i setup pypi to precache all the files | 23:12 |
| notq | ok, i can give it a try | 23:12 |
| SpamapS | time to fetch the kids | 23:13 |
| * SpamapS disappears | 23:13 | |
| notq | would it make sense just to skip this install if i've already done it manually, the sqlalchemy? | 23:14 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Glance: Make API versions configurable https://review.openstack.org/76580 | 23:14 |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Build raw image in separate tmpfs https://review.openstack.org/91545 | 23:15 |
| notq | i don't even quite understand what is failing. http://pastebin.com/mywhpVBt | 23:16 |
| notq | it chooses a version to use | 23:16 |
| notq | then says cleaning up, removing temp dir /opt/stack/venvs/openstack/build... | 23:16 |
| notq | then error name or service not known, so it's with that pull of the version from pip? | 23:16 |
| bnemec | Okay, giving up on this for tonight. | 23:17 |
| notq | i should probably do that as well, and try more tomorrow | 23:18 |
| bnemec | If someone wants to find Stuart and ask him to abandon the other patches that would be great. | 23:18 |
| bnemec | For the love of all things holy, DO NOT COMMENT though. | 23:18 |
| tchaypo | notq: have you seen https://etherpad.openstack.org/p/tripleo-newdev-notes ? | 23:19 |
| notq | no, reading | 23:20 |
| tchaypo | notq: I don't think installing sqlalchemy manually onto your system will help - this is trying to install it into the chroot as it's building the disk image. From inside the chroot it doesn't have access to your local system | 23:22 |
| tchaypo | the error doesn't make much sense to me either. I'm thinking that using pypi-mirror to pre-cache things might work around it, but I'm not sure what the actual problem is | 23:22 |
| *** marun is now known as maru_afk | 23:24 | |
| notq | it's the only option i have at the moment, so might as well roll with it | 23:24 |
| *** maru_afk has quit IRC | 23:25 | |
| *** marun has joined #tripleo | 23:25 | |
| *** marun has quit IRC | 23:26 | |
| *** marun has joined #tripleo | 23:27 | |
| *** eguz has joined #tripleo | 23:37 | |
| *** morganfainberg is now known as morganfainberg_Z | 23:38 | |
| *** eghobo has quit IRC | 23:42 | |
| *** morganfainberg_Z is now known as morganfainberg | 23:49 | |
| *** pcrews has quit IRC | 23:49 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
