| SpamapS | sendto(5, "\0REQ\0\0\0\1\0\0\0\6really", 18, MSG_NOSIGNAL, NULL, 0) = 18 | 00:00 |
|---|---|---|
| SpamapS | sendto(5, "\0REQ\0\0\0'\0\0\0\0", 12, MSG_NOSIGNAL, NULL, 0) = 12 | 00:00 |
| SpamapS | So that second packet is the one that fails | 00:00 |
| *** hrubi has joined #openstack-infra | 00:00 | |
| *** baoli has quit IRC | 00:00 | |
| greghaynes | actually, we can just parse the venv requirements thing in devstack into a big source-repositories file and let dib take care of the downloading | 00:00 |
| *** liusheng has quit IRC | 00:00 | |
| *** baoli has joined #openstack-infra | 00:00 | |
| *** liusheng has joined #openstack-infra | 00:00 | |
| *** r-daneel has joined #openstack-infra | 00:02 | |
| SpamapS | GEARMAN_COMMAND_GRAB_JOB_ALL, /* W->J -- */ | 00:06 |
| SpamapS | looks like gearman's protocol expanded since gear was written | 00:06 |
| SpamapS | After SUBMIT_JOB_EPOCH they added SUBMIT_REDUCE_JOB, SUBMIT_REDUCE_JOB_BACKGROUND, and GRAB_JOB_ALL | 00:07 |
| SpamapS | also JOB_ASSIGN_ALL, GET_STATUS_UNIQUE, and STATUS_RES_UNIQUE | 00:07 |
| *** tonytan4ever has quit IRC | 00:07 | |
| clarkb | SpamapS: http://gearman.org/protocol/ no they didnt :P | 00:08 |
| *** gokrokve has joined #openstack-infra | 00:08 | |
| clarkb | thats annoying :/ | 00:08 |
| SpamapS | clarkb: yeah it looks like a bunch of stuff has landed.. and for even more fun, they still call it "1.0" | 00:09 |
| SpamapS | map/reduce related looksl ike | 00:09 |
| *** angela-s has left #openstack-infra | 00:09 | |
| SpamapS | it looks quite poorly documented | 00:10 |
| SpamapS | but the C worker uses GRAB_JOB_ALL by default now | 00:10 |
| jogo | greghaynes: would using pypi-mirror mean we stop using bandersnatch? | 00:10 |
| * SpamapS realizes it is very late and his children probably miss him | 00:10 | |
| clarkb | SpamapS: thats amazingly broken | 00:10 |
| * SpamapS will bbl | 00:10 | |
| clarkb | SpamapS: also go get children | 00:10 |
| SpamapS | clarkb: yeah it's quite sad they'd land stuff w/o docs | 00:10 |
| SpamapS | I've been hunting down docs on the REDUCE stuff for a while now :-P | 00:11 |
| * SpamapS disappears | 00:11 | |
| clarkb | jogo: no | 00:11 |
| *** erlon has quit IRC | 00:11 | |
| clarkb | bandersnatch would be http://mirror.org/simple and wheels would be http://mirror.org/wheels/distro/release/arch or whatever | 00:11 |
| jogo | ohhh nice | 00:11 |
| greghaynes | jogo: yep, im just rsyncing over a bunch of wheels and then via the magic of pip extra-index-url we overloay that ontop of the bandersnatch mirror | 00:13 |
| greghaynes | (yep in reference to what clarkb said) | 00:13 |
| jroll | is everyone else getting dcc spam from BlackMustard ? | 00:13 |
| jogo | greghaynes: awesome! | 00:14 |
| dstufft | by the power of greysk--- extra-index-url! | 00:14 |
| clarkb | jroll: no | 00:14 |
| jroll | tons of people are in #freenode, might be worth banning him from openstack channels | 00:14 |
| *** banix has joined #openstack-infra | 00:14 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Add nodepool config-validation environment https://review.openstack.org/164901 | 00:16 |
| jogo | greghaynes: sounds surprisingly fairly straight forward :) | 00:16 |
| greghaynes | jogo: thats whats scary | 00:16 |
| clarkb | jroll: does /ignore cover that in your client? | 00:16 |
| clarkb | jroll: I would suggest you do that instead | 00:16 |
| jroll | clarkb: I can handle myself, just suggesting opportunistically as he seems to be going through channels hitting people with a dcc for SvcHost.exe | 00:17 |
| *** yamamoto has quit IRC | 00:18 | |
| *** yamamoto has joined #openstack-infra | 00:18 | |
| jroll | just from #freenode I've seen: ##econometrics, ##aws, ##c++-basic, ##infra-talk | 00:18 |
| *** amotoki has joined #openstack-infra | 00:19 | |
| *** ghostpl_ has quit IRC | 00:23 | |
| *** hdd has quit IRC | 00:24 | |
| fungi | fwiw i see that all the time from random spambots. they lurk in a channel then /msg or /dcc anybody they see active | 00:25 |
| *** dizquierdo has quit IRC | 00:25 | |
| fungi | it's been commonplace for a few years now | 00:25 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add nodepool config check https://review.openstack.org/164904 | 00:25 |
| fungi | ever since they realized that spamming in channels was a quick way to get squashed | 00:25 |
| *** emagana has quit IRC | 00:26 | |
| *** banix has quit IRC | 00:26 | |
| *** BlackMustard has quit IRC | 00:27 | |
| jogo | greghaynes: currently nova's pep8 job takes about 10 minutes at least 8 of those minutes are on installing things. On my local box where I have all the wheels pre-built it takes about | 00:28 |
| jogo | (t'ox -r -epep8' that is) | 00:28 |
| *** yamamoto has quit IRC | 00:28 | |
| *** juggler has joined #openstack-infra | 00:29 | |
| jogo | greghaynes: just under 2 minutes | 00:29 |
| *** koolhead17 has quit IRC | 00:30 | |
| greghaynes | jogo: tripleo was similar, which is why I have the local pypi-mirror install and like keeping it alive | 00:30 |
| jogo | hehe nice | 00:34 |
| lifeless | jogo: keystoneclient patch up | 00:36 |
| *** claudiub has quit IRC | 00:36 | |
| *** shashankhegde has joined #openstack-infra | 00:36 | |
| *** otter768 has joined #openstack-infra | 00:36 | |
| *** nanliu has joined #openstack-infra | 00:36 | |
| jogo | lifeless: link? | 00:37 |
| lifeless | jogo: its not really a big win though - 220ms down to 160ms. | 00:37 |
| *** r-daneel has quit IRC | 00:37 | |
| lifeless | jogo: https://review.openstack.org/#/c/164066/2 | 00:37 |
| jogo | ahh I see | 00:37 |
| *** signed8bit_ZZZzz is now known as signed8bit | 00:37 | |
| lifeless | its worth doing | 00:38 |
| lifeless | but its not the end of the story | 00:38 |
| jogo | right | 00:38 |
| jogo | so take a look at OSC | 00:38 |
| jogo | its even worse | 00:38 |
| lifeless | do I have to? | 00:38 |
| jogo | it loads all the clients every time I htink | 00:38 |
| jogo | lifeless: lol, if you want to be surprised at slow | 00:38 |
| *** reed has quit IRC | 00:39 | |
| openstackgerrit | Nan Liu proposed openstack-infra/puppet-elasticsearch: Use archive to fetch/checksum instead of wget. https://review.openstack.org/164908 | 00:39 |
| *** shashankhegde has quit IRC | 00:39 | |
| fungi | it loads all the clients every time you think? i guess i didn't notice since i don't think very often | 00:39 |
| jogo | fungi: I think so, have to double check. it certainly feels that way | 00:39 |
| *** xyang1 has quit IRC | 00:40 | |
| lifeless | jogo: been there, optimised that - seriously, very happy to share lessons learnt and so forth, but I am much more concerned about our server side effort atm - optimising the client side load experience is straight forward (if tedious) | 00:40 |
| jogo | fungi: https://bugs.launchpad.net/python-openstackclient/+bug/1431649/comments/1 | 00:40 |
| openstack | Launchpad bug 1431649 in python-keystoneclient "openstackclient is really slow" [Undecided,In progress] - Assigned to Robert Collins (lifeless) | 00:40 |
| *** otter768 has quit IRC | 00:40 | |
| lifeless | jogo: oh btw see the mailing list thread I started for a better timeit fragment | 00:41 |
| *** Longgeek has joined #openstack-infra | 00:41 | |
| *** stevemar has joined #openstack-infra | 00:43 | |
| jogo | I saw but haven't read it yet | 00:43 |
| jogo | will read it later tonight or tomorrow | 00:43 |
| *** JohnD has joined #openstack-infra | 00:44 | |
| *** kmartin has quit IRC | 00:47 | |
| *** achanda_ has quit IRC | 00:48 | |
| *** nanliu has quit IRC | 00:50 | |
| *** bdpayne has quit IRC | 00:50 | |
| *** salv-orlando has joined #openstack-infra | 00:50 | |
| *** ashleighfarnham has joined #openstack-infra | 00:51 | |
| *** JohnD has quit IRC | 00:52 | |
| *** sputnik13 has quit IRC | 00:52 | |
| *** banix has joined #openstack-infra | 00:56 | |
| *** Qiming has joined #openstack-infra | 00:56 | |
| *** ashleighfarnham has quit IRC | 00:57 | |
| *** Qiming_ has joined #openstack-infra | 00:57 | |
| *** yamamoto has joined #openstack-infra | 00:59 | |
| *** Qiming has quit IRC | 01:01 | |
| *** Longgeek has quit IRC | 01:01 | |
| *** Longgeek has joined #openstack-infra | 01:01 | |
| *** Qiming__ has joined #openstack-infra | 01:02 | |
| *** Qiming__ is now known as Qiming | 01:02 | |
| *** dmellado has quit IRC | 01:03 | |
| *** yolanda has quit IRC | 01:04 | |
| *** garyh has joined #openstack-infra | 01:05 | |
| *** Qiming_ has quit IRC | 01:05 | |
| *** JohnD has joined #openstack-infra | 01:07 | |
| *** ddieterly has quit IRC | 01:07 | |
| *** ddieterly has joined #openstack-infra | 01:08 | |
| *** woodster_ has quit IRC | 01:10 | |
| *** garyh has quit IRC | 01:10 | |
| *** tsg has joined #openstack-infra | 01:11 | |
| *** Qiming_ has joined #openstack-infra | 01:12 | |
| *** tnovacik_ has quit IRC | 01:12 | |
| *** Qiming has quit IRC | 01:15 | |
| *** tsg has quit IRC | 01:18 | |
| *** tiswanso has joined #openstack-infra | 01:19 | |
| *** funzo has quit IRC | 01:20 | |
| *** otter768 has joined #openstack-infra | 01:21 | |
| *** tiswanso_ has joined #openstack-infra | 01:25 | |
| *** yolanda has joined #openstack-infra | 01:25 | |
| *** dmellado has joined #openstack-infra | 01:26 | |
| *** dims has quit IRC | 01:26 | |
| *** tiswanso has quit IRC | 01:28 | |
| *** JohnD has quit IRC | 01:30 | |
| *** banix has quit IRC | 01:31 | |
| tchaypo | lifeless: do you mean "warning about __init__ importing modules - fast CLIs”? I haven’t seen any other mentions of timeit | 01:31 |
| *** liusheng has quit IRC | 01:31 | |
| *** JohnT has joined #openstack-infra | 01:32 | |
| tchaypo | oh, there’s the fragment | 01:32 |
| *** liusheng has joined #openstack-infra | 01:32 | |
| *** sputnik13 has joined #openstack-infra | 01:34 | |
| *** shashankhegde has joined #openstack-infra | 01:34 | |
| *** dmellado has quit IRC | 01:35 | |
| *** yolanda has quit IRC | 01:35 | |
| *** yolanda has joined #openstack-infra | 01:36 | |
| *** spzala has quit IRC | 01:38 | |
| *** yolanda has quit IRC | 01:41 | |
| *** Longgeek has quit IRC | 01:41 | |
| *** yolanda has joined #openstack-infra | 01:42 | |
| *** banix has joined #openstack-infra | 01:42 | |
| *** woodster_ has joined #openstack-infra | 01:43 | |
| lifeless | tchaypo: yes | 01:44 |
| *** sputnik13 has quit IRC | 01:44 | |
| *** mfink_ has joined #openstack-infra | 01:46 | |
| *** yolanda has quit IRC | 01:49 | |
| *** Longgeek has joined #openstack-infra | 01:49 | |
| asselin | anteaya, rhe00 mtreinish FYI, I wasn't impacted by the subunit2sql databases b/c I excluded them. I overwrite this file to an empty one: nodepool/elements/cache-devstack/install.d/99-cache-testrepository-db and I needed to use my own prepare_node.sh scripts (past tense b/c i'm fully dib now) | 01:51 |
| *** mfink_ has quit IRC | 01:52 | |
| *** mfink_ has joined #openstack-infra | 01:52 | |
| asselin | anteaya, rhe00 I should probably add some documentaiton on that. I only have it in the comments now: https://github.com/rasselin/os-ext-testing/blob/master/puppet/modules/os_ext_testing/manifests/master.pp#L289 | 01:52 |
| asselin | https://github.com/rasselin/os-ext-testing/blob/master/puppet/modules/os_ext_testing/manifests/master.pp#L308 | 01:52 |
| SpamapS | wow I've forgotten everything I knew about bzr | 01:53 |
| anteaya | asselin: thank you for following up on that | 01:54 |
| *** dims has joined #openstack-infra | 01:54 | |
| anteaya | asselin: I appreciate it | 01:54 |
| *** ddieterl_ has joined #openstack-infra | 01:54 | |
| *** tqtran has quit IRC | 01:54 | |
| *** ddieterly has quit IRC | 01:55 | |
| SpamapS | clarkb: btw, https://bugs.launchpad.net/gearmand/+bug/923463 | 01:55 |
| openstack | Launchpad bug 923463 in Gearman "GRAB_ALL undocumented and not supported by older versions of server" [Low,Confirmed] - Assigned to Brian Aker (brianaker) | 01:55 |
| SpamapS | clarkb: Found the commit where libgearman was broken to send that by default | 01:56 |
| SpamapS | http://paste.ubuntu.com/10613165/ | 01:56 |
| *** sputnik13 has joined #openstack-infra | 01:57 | |
| SpamapS | terrible commit message.. no idea why that warranted using undocumented protocol features | 01:57 |
| *** nanliu has joined #openstack-infra | 01:57 | |
| asselin | anteaya, there's a few dib files I had to exclude b/c they need access to openstack systems. I will try to document (the moving target). the good news is dib makes it very easy to exclude otherwise work-around. | 01:58 |
| anteaya | asselin: nice | 01:58 |
| *** baoli has quit IRC | 01:58 | |
| anteaya | asselin: it is good to have more background, thank you | 01:58 |
| *** baoli has joined #openstack-infra | 01:59 | |
| openstackgerrit | Nan Liu proposed openstack-infra/puppet-elasticsearch: Use archive to fetch/checksum instead of wget. https://review.openstack.org/164908 | 01:59 |
| anteaya | asselin: and thanks for all your work making your scripts consumable | 02:00 |
| *** yolanda has joined #openstack-infra | 02:00 | |
| *** bhunter71 has joined #openstack-infra | 02:01 | |
| *** ddieterly has joined #openstack-infra | 02:01 | |
| *** ddieterl_ has quit IRC | 02:01 | |
| *** dmellado has joined #openstack-infra | 02:01 | |
| *** dims has quit IRC | 02:03 | |
| *** mpopow has quit IRC | 02:03 | |
| *** ivar-laz_ has joined #openstack-infra | 02:06 | |
| *** yamahata has quit IRC | 02:07 | |
| *** Darkwan has joined #openstack-infra | 02:08 | |
| *** asselin_ has quit IRC | 02:08 | |
| *** ivar-lazzaro has quit IRC | 02:09 | |
| *** ivar-laz_ has quit IRC | 02:10 | |
| *** sputnik13 has quit IRC | 02:10 | |
| *** salv-orlando has quit IRC | 02:11 | |
| *** garyh has joined #openstack-infra | 02:11 | |
| *** Qiming_ is now known as Qiming | 02:12 | |
| *** patrickeast has quit IRC | 02:15 | |
| *** JohnT is now known as HomeLate | 02:16 | |
| *** HomeLate is now known as cjh- | 02:17 | |
| *** cjh- is now known as cjh_ | 02:19 | |
| SpamapS | clarkb: https://code.launchpad.net/~clint-fewbar/gearmand/document-protocol/+merge/253140 btw | 02:19 |
| SpamapS | jeblair: ^^ | 02:19 |
| *** dmorita has quit IRC | 02:19 | |
| *** cjh_ is now known as cjha | 02:19 | |
| *** dmorita has joined #openstack-infra | 02:19 | |
| SpamapS | jeblair: fyi C libgearman defaults to GRAB_JOB_ALL.. we can respond to it just fine with null reducers, and refuse SUBMIT_REDUCE_JOB's with a helpful error, something like "We don't support mapreduce" | 02:20 |
| SpamapS | and with that, I go to family time | 02:20 |
| *** garyh has quit IRC | 02:21 | |
| *** jyuso1 has joined #openstack-infra | 02:21 | |
| *** tsg has joined #openstack-infra | 02:23 | |
| *** baoli has quit IRC | 02:23 | |
| *** baoli has joined #openstack-infra | 02:24 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 02:24 | |
| *** dmorita has quit IRC | 02:24 | |
| *** unicell has quit IRC | 02:25 | |
| *** hdd has joined #openstack-infra | 02:27 | |
| *** coolsvap|afk is now known as coolsvap | 02:27 | |
| *** achanda has joined #openstack-infra | 02:27 | |
| *** sdake__ has quit IRC | 02:32 | |
| *** cjha is now known as kaneeni | 02:32 | |
| *** kaisers1 has joined #openstack-infra | 02:34 | |
| openstackgerrit | greghaynes proposed openstack-infra/project-config: WIP: Create jobs for a wheel mirror https://review.openstack.org/164927 | 02:35 |
| *** kaisers has quit IRC | 02:35 | |
| *** kaneeni is now known as somefag | 02:35 | |
| *** somefag has quit IRC | 02:35 | |
| *** JohnT has joined #openstack-infra | 02:36 | |
| nanliu | hmm, confused how this fails precise, but passes on other platforms: https://review.openstack.org/#/c/164908/2 | 02:36 |
| nanliu | I know it's missing the archive module, not sure if system-config is the right place to add it. | 02:37 |
| nibalizer | nanliu: it is | 02:38 |
| nibalizer | but i did | 02:38 |
| *** sputnik13 has joined #openstack-infra | 02:38 | |
| nibalizer | https://review.openstack.org/#/c/164355/ | 02:38 |
| *** krtaylor has quit IRC | 02:38 | |
| nibalizer | so you can put your change as dependent on mine with Depends-On: I91b7e35ef5e66c3538fd987d3857ec1af455beb1 at the bottom of your commit message | 02:38 |
| nanliu | nibalizer, that pr is for puppet-git | 02:38 |
| nibalizer | oh we need archive | 02:39 |
| nibalizer | wait dont we have arrchive? | 02:39 |
| nibalizer | https://review.openstack.org/#/c/164569/ | 02:39 |
| nanliu | but I have no idea how it's passing Jenkins on centos and trusty | 02:39 |
| nibalizer | well the thing about that is our testing is kindof fail | 02:39 |
| nibalizer | probably because we test node defs on their native platform | 02:40 |
| *** tsg has quit IRC | 02:40 | |
| nibalizer | so the only host that uses the module your change is in, is precise | 02:40 |
| nibalizer | http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n456 | 02:41 |
| nibalizer | that Node-OS: Precise means 'test this on precise only' | 02:41 |
| *** Ryan_Lane has quit IRC | 02:41 | |
| *** sputnik13 has quit IRC | 02:42 | |
| nanliu | ah, thanks for the tip and I'll add a license to puppet-git | 02:43 |
| *** sputnik13 has joined #openstack-infra | 02:43 | |
| nibalizer | ty ty | 02:44 |
| nibalizer | also i made a pr against puppet-git | 02:44 |
| nibalizer | probably not up to your standards but thats a needed feature | 02:44 |
| openstackgerrit | Nan Liu proposed openstack-infra/puppet-elasticsearch: Use archive to fetch/checksum instead of wget. https://review.openstack.org/164908 | 02:45 |
| *** shashankhegde has quit IRC | 02:49 | |
| *** krtaylor has joined #openstack-infra | 02:50 | |
| *** JohnT is now known as p1np01nt | 02:51 | |
| *** achanda has quit IRC | 02:52 | |
| *** shashankhegde has joined #openstack-infra | 02:54 | |
| *** gokrokve has quit IRC | 02:56 | |
| *** gokrokve has joined #openstack-infra | 02:57 | |
| *** gokrokve has quit IRC | 02:57 | |
| *** p1np01nt is now known as Exp1r3dP0ps1cle | 02:58 | |
| *** tonytan4ever has joined #openstack-infra | 02:58 | |
| *** Exp1r3dP0ps1cle is now known as d[-_-]b | 02:58 | |
| *** melwitt has quit IRC | 02:58 | |
| *** dkliban is now known as dkliban_afk | 03:00 | |
| *** d[-_-]b has quit IRC | 03:00 | |
| *** sputnik13 has quit IRC | 03:02 | |
| *** dims has joined #openstack-infra | 03:04 | |
| *** RalphWiggum has joined #openstack-infra | 03:08 | |
| *** RalphWiggum is now known as Guest80749 | 03:08 | |
| *** salv-orlando has joined #openstack-infra | 03:11 | |
| *** dims has quit IRC | 03:11 | |
| *** boris-42 has quit IRC | 03:12 | |
| *** spzala has joined #openstack-infra | 03:14 | |
| *** harlowja is now known as harlowja_away | 03:15 | |
| *** tiswanso_ has quit IRC | 03:17 | |
| *** banix has quit IRC | 03:18 | |
| *** banix has joined #openstack-infra | 03:19 | |
| *** otter768 has quit IRC | 03:20 | |
| *** garyh has joined #openstack-infra | 03:22 | |
| *** signed8b_ has joined #openstack-infra | 03:23 | |
| *** ddieterly has quit IRC | 03:25 | |
| *** gokrokve has joined #openstack-infra | 03:25 | |
| *** signed8bit has quit IRC | 03:26 | |
| *** gokrokve has quit IRC | 03:27 | |
| *** markvoelker has quit IRC | 03:29 | |
| *** ghostpl_ has joined #openstack-infra | 03:30 | |
| *** gokrokve has joined #openstack-infra | 03:31 | |
| *** garyh has quit IRC | 03:32 | |
| *** hdd has quit IRC | 03:33 | |
| *** dmellado has quit IRC | 03:33 | |
| *** shashankhegde has quit IRC | 03:34 | |
| openstackgerrit | greghaynes proposed openstack-infra/project-config: WIP: Create jobs for a wheel mirror https://review.openstack.org/164927 | 03:35 |
| *** ghostpl_ has quit IRC | 03:35 | |
| *** yolanda has quit IRC | 03:35 | |
| *** david-lyle is now known as david-lyle_afk | 03:35 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Promote lbaasv2 api job to both the lbaas and neutron check and gate https://review.openstack.org/164390 | 03:37 |
| *** Alexandra_ has joined #openstack-infra | 03:39 | |
| *** yolanda has joined #openstack-infra | 03:39 | |
| *** dmellado has joined #openstack-infra | 03:41 | |
| *** asettle has quit IRC | 03:41 | |
| *** tsg has joined #openstack-infra | 03:42 | |
| *** eharney has quit IRC | 03:46 | |
| *** coolsvap is now known as coolsvap|afk | 03:48 | |
| *** shashankhegde has joined #openstack-infra | 03:48 | |
| *** Alexandra_ is now known as asettle | 03:50 | |
| *** coolsvap|afk is now known as coolsvap | 03:55 | |
| *** Longgeek has quit IRC | 03:59 | |
| *** achanda has joined #openstack-infra | 04:01 | |
| *** baoli has quit IRC | 04:02 | |
| *** Guest80749 has quit IRC | 04:04 | |
| *** subscope_ has joined #openstack-infra | 04:04 | |
| *** RalphWiggum has joined #openstack-infra | 04:05 | |
| *** RalphWiggum is now known as Guest22117 | 04:05 | |
| *** banix has quit IRC | 04:11 | |
| *** spzala has quit IRC | 04:16 | |
| *** mrmartin has joined #openstack-infra | 04:17 | |
| Guest22117 | DCC SEND STARTKEYLOGGER 0 0 0 | 04:22 |
| *** Guest22117 has left #openstack-infra | 04:22 | |
| *** stevemar has quit IRC | 04:22 | |
| *** sarob has quit IRC | 04:22 | |
| *** stevemar has joined #openstack-infra | 04:23 | |
| *** salv-orlando has quit IRC | 04:23 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 04:24 | |
| *** ddieterly has joined #openstack-infra | 04:25 | |
| *** shashankhegde has quit IRC | 04:26 | |
| *** macjack has joined #openstack-infra | 04:26 | |
| *** macjack has quit IRC | 04:27 | |
| *** ddieterly has quit IRC | 04:31 | |
| *** ayoung has quit IRC | 04:32 | |
| *** garyh has joined #openstack-infra | 04:32 | |
| *** bhunter71 has quit IRC | 04:34 | |
| *** tsg has quit IRC | 04:35 | |
| *** baoli has joined #openstack-infra | 04:35 | |
| *** Tetris- has joined #openstack-infra | 04:37 | |
| *** Tetris- has left #openstack-infra | 04:38 | |
| *** baoli has quit IRC | 04:40 | |
| *** baoli has joined #openstack-infra | 04:40 | |
| *** baoli has quit IRC | 04:40 | |
| *** deepakcs has joined #openstack-infra | 04:41 | |
| *** oomichi has joined #openstack-infra | 04:41 | |
| *** oomichi has quit IRC | 04:41 | |
| *** garyh has quit IRC | 04:43 | |
| *** enikanorov has quit IRC | 04:43 | |
| *** enikanorov has joined #openstack-infra | 04:43 | |
| *** achanda has quit IRC | 04:46 | |
| *** achanda has joined #openstack-infra | 04:49 | |
| *** achanda has quit IRC | 04:49 | |
| *** dboik_ has quit IRC | 04:49 | |
| *** BharatK has joined #openstack-infra | 04:50 | |
| *** macjack has joined #openstack-infra | 04:51 | |
| *** sputnik13 has joined #openstack-infra | 04:55 | |
| *** Longgeek has joined #openstack-infra | 04:59 | |
| *** baoli has joined #openstack-infra | 05:01 | |
| *** baoli has quit IRC | 05:01 | |
| *** Longgeek has quit IRC | 05:04 | |
| *** emagana has joined #openstack-infra | 05:10 | |
| *** unicell has joined #openstack-infra | 05:13 | |
| *** rlucio has joined #openstack-infra | 05:14 | |
| *** gokrokve_ has joined #openstack-infra | 05:15 | |
| rlucio | hi guys, my ci jobs are failing with resource errors, anyone have a moment to assist? http://paste.openstack.org/show/192799/ | 05:18 |
| *** gokrokve has quit IRC | 05:18 | |
| *** gokrokve_ has quit IRC | 05:19 | |
| *** salv-orlando has joined #openstack-infra | 05:20 | |
| *** koolhead17 has joined #openstack-infra | 05:20 | |
| *** otter768 has joined #openstack-infra | 05:21 | |
| *** sarob has joined #openstack-infra | 05:23 | |
| *** otter768 has quit IRC | 05:26 | |
| *** ddieterly has joined #openstack-infra | 05:27 | |
| *** sarob has quit IRC | 05:29 | |
| *** ddieterly has quit IRC | 05:31 | |
| *** sabeen1 has quit IRC | 05:35 | |
| *** mrmartin has quit IRC | 05:35 | |
| *** unicell1 has joined #openstack-infra | 05:37 | |
| *** unicell has quit IRC | 05:37 | |
| BharatK | rlucio: I am expert in infra... But recently I deployed my CI. | 05:41 |
| BharatK | rlucio: resources means? | 05:41 |
| BharatK | rlucio: RAM or CPUs? | 05:41 |
| *** subscope_ has quit IRC | 05:43 | |
| rlucio | bharatk: ah i get the impression it is some sort of process limit | 05:44 |
| rlucio | bharatk: so maybe cpu? | 05:45 |
| rlucio | bharatk: lemme check the core count on the slave, 1 sec | 05:45 |
| BharatK | rlucio: You are running in upstream right? | 05:45 |
| BharatK | rlucio: Okay | 05:46 |
| BharatK | rlucio: In upstream we have 8 CPUs to the slave machine to run our job. | 05:46 |
| rlucio | bharatk: hmm, ok i think this is a 2 processors with 8 cores each | 05:47 |
| rlucio | xeon box | 05:47 |
| rlucio | bharatk: i mean, its not top end but its got more power than my desktop | 05:48 |
| rlucio | bharatk: do the jenkins jobs for ci create alot more threads for devstack than the vanilla config? | 05:48 |
| BharatK | rlucio: no not like that. | 05:49 |
| BharatK | rlucio: are you install devstack on your environment manually | 05:49 |
| rlucio | bharatk: not sure if you saw it but i pasted the dump here: http://paste.openstack.org/show/192799/ | 05:49 |
| *** yamahata has joined #openstack-infra | 05:49 | |
| BharatK | rlucio: Yeah I have seen that. | 05:49 |
| rlucio | bharatk: no, im using the jenkins job, devstack is installed by devstack-vm-gate.sh i think | 05:50 |
| rlucio | bharatk, its ubuntu 14.04 btw | 05:51 |
| BharatK | rlucio: Yes, but were you able to install devstack successfully manually on the same environment | 05:51 |
| *** nanliu has quit IRC | 05:51 | |
| rlucio | bharatk: i havent tried, i can certainly run it real quick if you think that is a useful exercise | 05:52 |
| BharatK | rlucio: Give me a movement. | 05:52 |
| *** mfink_ has quit IRC | 05:53 | |
| *** mfink_ has joined #openstack-infra | 05:53 | |
| BharatK | rlucio: yeah it is worth testing manually on the same environment. | 05:55 |
| BharatK | rlucio: I have few steps to run tempest tests also | 05:55 |
| BharatK | rlucio: But in your case devstack installation itself is failing. | 05:55 |
| BharatK | rlucio: It's good to try to install devstack manually on the same environment. | 05:56 |
| *** mfink__ has joined #openstack-infra | 05:56 | |
| rlucio | bharatk: ok i'll run it now.. btw i just checked my other slave, which is a differnt cpu config and it fails in the same place | 05:56 |
| rlucio | bharatk: maybe some sort of weird config issue? | 05:57 |
| *** mfink_ has quit IRC | 05:59 | |
| *** asettle has quit IRC | 05:59 | |
| BharatK | rlucio: yeah you are right. We can confirm it running devstack manually. | 05:59 |
| *** yamamoto has quit IRC | 06:01 | |
| BharatK | rlucio: There is some problem with environment configuration | 06:01 |
| *** Longgeek has joined #openstack-infra | 06:01 | |
| BharatK | rlucio: From the logs we can figure out that while executing "os.fork()" we got Resource temporarily unavailable | 06:01 |
| BharatK | rlucio: that means, http://stackoverflow.com/questions/13009632/getting-strange-behavior-from-terminal-and-iterm-bash-fork-resource-temporar | 06:02 |
| BharatK | rlucio: It cannot allocate sufficient memory to copy the parent's page tables and allocate a task structure for the child. | 06:02 |
| BharatK | It was not possible to create a new process because the caller's RLIMIT_NPROC resource limit was encountered. To exceed this limit, the process must have either the CAP_SYS_ADMIN or the CAP_SYS_RESOURCE capability. | 06:02 |
| *** baoli has joined #openstack-infra | 06:02 | |
| *** baoli has quit IRC | 06:06 | |
| rlucio | http://stackoverflow.com/questions/13009632/getting-strange-behavior-from-terminal-and-iterm-bash-fork-resource-temporar | 06:07 |
| rlucio | whoops | 06:07 |
| *** hichihara has quit IRC | 06:08 | |
| *** yfried_ has joined #openstack-infra | 06:11 | |
| *** tonytan4ever has quit IRC | 06:11 | |
| *** tonytan4ever has joined #openstack-infra | 06:11 | |
| rlucio | bharatk: yea i encountered similar info earlier.. seems silly though the box lists 82483544 kB of ram | 06:11 |
| rlucio | bharatk:bharatk: damn, devstack vanilla fails on some apache user not authorized error | 06:14 |
| rlucio | bharatk: while uploading images to glance | 06:15 |
| *** tonytan4ever has quit IRC | 06:15 | |
| *** mtanino has quit IRC | 06:21 | |
| *** sarob has joined #openstack-infra | 06:25 | |
| *** achanda has joined #openstack-infra | 06:26 | |
| *** ddieterly has joined #openstack-infra | 06:28 | |
| *** dboik has joined #openstack-infra | 06:29 | |
| BharatK | rlucio: oh... :( Give another try. | 06:30 |
| *** sarob has quit IRC | 06:30 | |
| *** baoli has joined #openstack-infra | 06:32 | |
| *** baoli has quit IRC | 06:32 | |
| *** ddieterly has quit IRC | 06:32 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/164956 | 06:33 |
| *** baoli has joined #openstack-infra | 06:33 | |
| *** baoli has quit IRC | 06:33 | |
| rlucio | bharatk: ok gimme a few min | 06:34 |
| *** signed8b_ has quit IRC | 06:34 | |
| *** Longgeek has quit IRC | 06:35 | |
| *** Longgeek has joined #openstack-infra | 06:35 | |
| *** ashishb has joined #openstack-infra | 06:39 | |
| openstackgerrit | Qiming Teng proposed openstack-infra/project-config: new-project: stackforge/python-senlinclient https://review.openstack.org/164963 | 06:41 |
| *** gokrokve has joined #openstack-infra | 06:41 | |
| *** amotoki has quit IRC | 06:43 | |
| *** sdake has joined #openstack-infra | 06:44 | |
| *** stevemar has quit IRC | 06:44 | |
| *** salv-orlando has quit IRC | 06:44 | |
| *** mrunge has joined #openstack-infra | 06:45 | |
| *** unicell1 has quit IRC | 06:47 | |
| *** sdake has quit IRC | 06:48 | |
| *** mrunge has quit IRC | 06:49 | |
| *** mrunge has joined #openstack-infra | 06:49 | |
| *** amotoki has joined #openstack-infra | 06:49 | |
| StevenK | pleia2: Update for meeting. I am still plugging away, trying to convince maven-release-plugin to build so maven-sortpom-plugin can build, so zanata-parent can. | 06:50 |
| *** unicell has joined #openstack-infra | 06:51 | |
| StevenK | [INFO] Error building POM (may not be this project's POM). | 06:52 |
| StevenK | Reason: POM 'org.apache.maven.plugins:maven-surefire-plugin' not found in repository: System is offline. | 06:52 |
| *** yamahata has quit IRC | 06:53 | |
| StevenK | Which is a lie, maven-surefire-plugin is in the repo. :-( | 06:53 |
| *** yamahata has joined #openstack-infra | 06:53 | |
| *** unicell has quit IRC | 06:58 | |
| *** garyh has joined #openstack-infra | 07:00 | |
| *** mrda is now known as mrda-away | 07:00 | |
| *** unicell has joined #openstack-infra | 07:02 | |
| *** gokrokve has quit IRC | 07:02 | |
| *** gokrokve has joined #openstack-infra | 07:02 | |
| *** markvoelker has joined #openstack-infra | 07:04 | |
| *** garyh has quit IRC | 07:05 | |
| *** gokrokve has quit IRC | 07:07 | |
| *** Hal has joined #openstack-infra | 07:08 | |
| *** Hal is now known as Guest68207 | 07:08 | |
| *** markvoelker has quit IRC | 07:08 | |
| *** Guest68207 has quit IRC | 07:12 | |
| *** emagana has quit IRC | 07:14 | |
| *** scheuran has joined #openstack-infra | 07:16 | |
| *** yamahata has quit IRC | 07:20 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Update pip-missing-reqs to pip-check-reqs https://review.openstack.org/164974 | 07:21 |
| *** yfried_ is now known as yfried|afk | 07:22 | |
| *** otter768 has joined #openstack-infra | 07:22 | |
| *** FingerPistol has joined #openstack-infra | 07:23 | |
| *** afazekas has joined #openstack-infra | 07:25 | |
| *** otter768 has quit IRC | 07:27 | |
| *** ddieterly has joined #openstack-infra | 07:28 | |
| *** FingerPistol has quit IRC | 07:29 | |
| *** yfried|afk is now known as yfried_ | 07:30 | |
| *** achanda has quit IRC | 07:31 | |
| *** ddieterly has quit IRC | 07:33 | |
| *** baoli has joined #openstack-infra | 07:34 | |
| *** AJaeger has joined #openstack-infra | 07:35 | |
| *** AJaeger has joined #openstack-infra | 07:35 | |
| *** AJaeger has quit IRC | 07:35 | |
| *** GumBall has joined #openstack-infra | 07:36 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Parameterize url to clone puppet modules https://review.openstack.org/163376 | 07:36 |
| *** baoli has quit IRC | 07:38 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/164956 | 07:39 |
| *** yfried_ is now known as yfried|afk | 07:41 | |
| *** mpavone has joined #openstack-infra | 07:41 | |
| *** rkukura_ has joined #openstack-infra | 07:45 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-graphite: Add ability to configure retention policy https://review.openstack.org/161679 | 07:46 |
| *** rkukura has quit IRC | 07:47 | |
| *** rkukura_ is now known as rkukura | 07:47 | |
| *** armax has quit IRC | 07:48 | |
| rlucio | bharatk: good news, we were on the right track, it was a file descriptor limit issue | 07:49 |
| BharatK | rlucio: Cool.... | 07:49 |
| rlucio | bharatk: ulimit -Hn showed 4096 file descriptors max for the user, which is too low | 07:50 |
| BharatK | rlucio: now you are able to run devstack, through jenkins right. | 07:50 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-cgit: Add configurable setting for MaxClients https://review.openstack.org/160885 | 07:50 |
| rlucio | bharatk: i edited /etc/security/limits.conf and upped the stack user's limits to 10k | 07:50 |
| BharatK | rlucio: oh great point. :) | 07:50 |
| rlucio | bharatk: well, one slave failed with an internal server error when trying to create and upload a disk image | 07:51 |
| BharatK | rlucio: what is the error you got? | 07:51 |
| rlucio | bharatk: the other slave failed with a fd limit error later on | 07:52 |
| rlucio | bharatk: guess 10k isnt enough! | 07:52 |
| BharatK | rlucio: Just now I ran devstack on ubuntu 14.04 | 07:53 |
| BharatK | rlucio: It ran successfully | 07:53 |
| BharatK | rlucio: there I executed "ulimit -Hu" | 07:54 |
| rlucio | bharatk: yea i actually just made a vm on my desktop and installed it there, seems to be working fine | 07:54 |
| BharatK | rlucio: I got "63718" | 07:54 |
| *** soren has joined #openstack-infra | 07:54 | |
| rlucio | bharatk: yea the article i found was saying for db servers or web servers you might need 100k + | 07:55 |
| BharatK | rlucio: Oh okay. I doubt I have the output is in K or M? | 07:55 |
| rlucio | bharatk: http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-files/ | 07:56 |
| BharatK | rlucio: That means here we need to check in start user. | 07:58 |
| BharatK | rlucio: *stack user | 07:58 |
| rlucio | bharatk: right | 08:00 |
| *** AJaeger has joined #openstack-infra | 08:00 | |
| rlucio | bharatk: by default the limit was 4096 on my boxes | 08:01 |
| AJaeger | fungi, something is wrong with check_irc_access.py. It should fail with exit(1) but does not - see http://logs.openstack.org/31/163331/4/check/gate-project-config-irc-access/1940784/console.html | 08:01 |
| *** AJaeger has quit IRC | 08:01 | |
| *** markus_z has joined #openstack-infra | 08:01 | |
| *** yfried|afk is now known as yfried_ | 08:01 | |
| *** oomichi_ has joined #openstack-infra | 08:02 | |
| BharatK | rlucio: Yeah but how can we set the ulimit for new users. I mean "stack" user | 08:02 |
| *** dtantsur|afk is now known as dtantsur | 08:03 | |
| *** HeOS has quit IRC | 08:03 | |
| rlucio | bharatk: you can add an entry for a specific user in /etc/security/limits.conf | 08:03 |
| *** tnovacik_ has joined #openstack-infra | 08:03 | |
| BharatK | rlucio: cool... is that working? | 08:04 |
| rlucio | bharatk: i added "stack soft nofile 80000 / stack hard nofile 100000" | 08:04 |
| rlucio | bharatk: just started a build with these new limits, i'll let you know when they finish | 08:04 |
| BharatK | rlucio: cool ... thanks. | 08:04 |
| *** asselin_ has joined #openstack-infra | 08:04 | |
| *** markvoelker has joined #openstack-infra | 08:05 | |
| *** garyh has joined #openstack-infra | 08:06 | |
| *** AJaeger has joined #openstack-infra | 08:07 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix logic for check_irc_access failure https://review.openstack.org/164979 | 08:08 |
| AJaeger | fungi: I found something ^ and would appreciate carefull review | 08:08 |
| *** AJaeger has quit IRC | 08:08 | |
| *** asselin_ has quit IRC | 08:09 | |
| *** markvoelker has quit IRC | 08:10 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix logic for check_irc_access failure https://review.openstack.org/164979 | 08:10 |
| *** ildikov has quit IRC | 08:11 | |
| *** yfried_ is now known as yfried|afk | 08:11 | |
| *** ashishb has quit IRC | 08:12 | |
| *** Ala has joined #openstack-infra | 08:13 | |
| GheRivero | morning all | 08:13 |
| *** macjack has quit IRC | 08:15 | |
| *** mfink__ has quit IRC | 08:15 | |
| *** garyh has quit IRC | 08:16 | |
| *** e0ne has joined #openstack-infra | 08:17 | |
| *** kaisers1 has quit IRC | 08:18 | |
| *** che-arne has quit IRC | 08:24 | |
| *** mfink_ has joined #openstack-infra | 08:26 | |
| *** yfried|afk is now known as yfried_ | 08:27 | |
| *** ashishb has joined #openstack-infra | 08:27 | |
| *** ivar-lazzaro has joined #openstack-infra | 08:28 | |
| *** ddieterly has joined #openstack-infra | 08:29 | |
| *** salv-orlando has joined #openstack-infra | 08:31 | |
| *** hashar has joined #openstack-infra | 08:31 | |
| *** ashishb has quit IRC | 08:32 | |
| *** ivar-lazzaro has quit IRC | 08:32 | |
| *** ddieterly has quit IRC | 08:34 | |
| *** baoli has joined #openstack-infra | 08:35 | |
| *** e0ne is now known as e0ne_ | 08:36 | |
| *** arxcruz has joined #openstack-infra | 08:36 | |
| *** tkelsey has joined #openstack-infra | 08:37 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Configure puppetmaster server from manifest https://review.openstack.org/164670 | 08:38 |
| *** ildikov has joined #openstack-infra | 08:39 | |
| *** arxcruz has quit IRC | 08:39 | |
| *** baoli has quit IRC | 08:39 | |
| *** nilasae has joined #openstack-infra | 08:41 | |
| *** yfried_ is now known as yfried|afk | 08:42 | |
| *** dims has joined #openstack-infra | 08:42 | |
| *** Hal has joined #openstack-infra | 08:44 | |
| *** Hal is now known as Guest24264 | 08:44 | |
| *** arxcruz has joined #openstack-infra | 08:44 | |
| *** jlanoux has joined #openstack-infra | 08:46 | |
| *** dims has quit IRC | 08:48 | |
| *** ashishb has joined #openstack-infra | 08:51 | |
| *** andreykurilin_ has joined #openstack-infra | 08:53 | |
| *** yfried|afk is now known as yfried_ | 08:55 | |
| *** boris-42 has joined #openstack-infra | 08:59 | |
| *** woodster_ has quit IRC | 09:00 | |
| *** Somay has joined #openstack-infra | 09:01 | |
| *** Somay has quit IRC | 09:03 | |
| *** jistr has joined #openstack-infra | 09:04 | |
| *** Somay has joined #openstack-infra | 09:04 | |
| *** mrunge_ has joined #openstack-infra | 09:04 | |
| *** jcoufal has joined #openstack-infra | 09:05 | |
| *** yfried_ is now known as yfried|afk | 09:05 | |
| *** markvoelker has joined #openstack-infra | 09:06 | |
| *** mrunge has quit IRC | 09:08 | |
| rlucio | bharatk: ok well, this is where i am stuck now, seen this before by chance? http://paste.openstack.org/show/192830/ | 09:09 |
| BharatK | rlucio: that is glance not configured well | 09:10 |
| BharatK | rlucio: do you have logs of this run | 09:10 |
| *** markvoelker has quit IRC | 09:11 | |
| BharatK | rlucio: look at glance logs once | 09:11 |
| *** skolekonov has joined #openstack-infra | 09:12 | |
| *** mpavone has quit IRC | 09:12 | |
| rlucio | bharatk: yea i have logs, one sec | 09:12 |
| BharatK | rlucio: okay | 09:12 |
| *** Somay has quit IRC | 09:13 | |
| BharatK | rlucio: it I am not wrong, that is ubuntu 14.04 right? | 09:13 |
| *** zz_johnthetubagu is now known as johnthetubaguy | 09:14 | |
| rlucio | bharatk: yes its 14.04 | 09:17 |
| *** garyh has joined #openstack-infra | 09:17 | |
| openstackgerrit | Christian Berendt proposed openstack-infra/project-config: Add new project faafo to Stackforge https://review.openstack.org/164668 | 09:17 |
| rlucio | bharatk: http://paste.openstack.org/show/192832/ | 09:17 |
| *** ghostpl_ has joined #openstack-infra | 09:18 | |
| *** GumBall has quit IRC | 09:18 | |
| BharatK | rlucio: are you using swift as glance backend | 09:18 |
| rlucio | bharatk: apparently yea | 09:19 |
| rlucio | bharatk: whatever the default is | 09:19 |
| BharatK | rlucio: I think default is not swift just a file | 09:19 |
| BharatK | rlucio: anyway can you send your localrc file? | 09:19 |
| rlucio | bharatk: http://paste.openstack.org/show/192833/ | 09:21 |
| *** salv-orlando has quit IRC | 09:21 | |
| *** salv-orlando has joined #openstack-infra | 09:21 | |
| rlucio | bharatk: yea... this is probably the core issue. isn't this autogenerated? | 09:22 |
| *** kaisers has joined #openstack-infra | 09:23 | |
| BharatK | rlucio: yeah this is auto generated. | 09:23 |
| *** otter768 has joined #openstack-infra | 09:23 | |
| BharatK | rlucio: anyway even swift should work. Can you paste swift logs? | 09:23 |
| BharatK | rlucio: just search for errors in swift logs. | 09:26 |
| *** yfried|afk is now known as yfried_ | 09:26 | |
| *** garyh has quit IRC | 09:27 | |
| *** mpavone has joined #openstack-infra | 09:27 | |
| *** otter768 has quit IRC | 09:27 | |
| *** sarob has joined #openstack-infra | 09:28 | |
| rlucio | bharatk: oh i put the errors in that previous paste, if you scroll down | 09:28 |
| rlucio | http://paste.openstack.org/show/192832/ | 09:29 |
| BharatK | rlucio: sorry I will see. | 09:29 |
| BharatK | rlucio: Same error | 09:29 |
| *** e0ne_ has quit IRC | 09:30 | |
| rlucio | bharatk: i thought i had read somewhere a while ago that you can get swift errors if your machine isn't up to snuff | 09:30 |
| BharatK | rlucio: Resource temporarily unavailable | 09:30 |
| *** ddieterly has joined #openstack-infra | 09:30 | |
| rlucio | bharatk: yea | 09:30 |
| BharatK | rlucio: in line # 71 you can find that... | 09:31 |
| BharatK | rlucio: check the ulimit of swift user | 09:31 |
| BharatK | rlucio: brb | 09:31 |
| rlucio | bharatk: ah interesting | 09:33 |
| *** sarob has quit IRC | 09:33 | |
| *** ddieterly has quit IRC | 09:34 | |
| *** yfried_ is now known as yfried|afk | 09:36 | |
| *** dizquierdo has joined #openstack-infra | 09:36 | |
| rlucio | bharatk: i changed ulimit from user to '*' so that is for all users | 09:38 |
| rlucio | bharatk: so all users should have 100k fd limit now | 09:39 |
| rlucio | bharatk: re-running again | 09:39 |
| *** ssam2 has joined #openstack-infra | 09:40 | |
| *** ZZelle has joined #openstack-infra | 09:43 | |
| *** jedimike has joined #openstack-infra | 09:45 | |
| *** markus_z has quit IRC | 09:47 | |
| *** scheuran has quit IRC | 09:47 | |
| *** mpavone has quit IRC | 09:47 | |
| *** markus_z has joined #openstack-infra | 09:47 | |
| *** mpavone has joined #openstack-infra | 09:48 | |
| *** andreykurilin_ has quit IRC | 09:48 | |
| *** dims has joined #openstack-infra | 09:50 | |
| rlucio | bharatk: bah same error /shrug | 09:54 |
| *** HeOS has joined #openstack-infra | 09:54 | |
| rlucio | bharatk: i gotta go for now, i'll look more into this later. thanks for all your help though | 09:54 |
| *** rlucio has quit IRC | 09:55 | |
| *** andreykurilin_ has joined #openstack-infra | 09:56 | |
| *** scheuran has joined #openstack-infra | 09:59 | |
| *** andreykurilin_ has quit IRC | 10:01 | |
| SergeyLukjanov | nibalizer, jeblair, sorry about merging https://review.openstack.org/#/c/164725/ it was looks like no disagreements ;) | 10:01 |
| SergeyLukjanov | nibalizer, jeblair, and fact that I hate arrow alignment in puppet was helping me to merge it :) | 10:02 |
| *** mpavone has quit IRC | 10:03 | |
| *** mpavone has joined #openstack-infra | 10:06 | |
| *** markvoelker has joined #openstack-infra | 10:07 | |
| *** claudiub has joined #openstack-infra | 10:08 | |
| *** Qiming has quit IRC | 10:11 | |
| *** markvoelker has quit IRC | 10:12 | |
| *** mfink_ has quit IRC | 10:13 | |
| *** teran has joined #openstack-infra | 10:13 | |
| *** yfried|afk is now known as yfried_ | 10:16 | |
| *** e0ne has joined #openstack-infra | 10:17 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled eslint:no-underscore-dangle https://review.openstack.org/161503 | 10:21 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled eslint:strict https://review.openstack.org/161504 | 10:21 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled eslint:no-console https://review.openstack.org/161505 | 10:21 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled eslint:space-unary-ops https://review.openstack.org/161506 | 10:22 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled eslint:consistent-return https://review.openstack.org/161507 | 10:22 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled eslint:no-shadow https://review.openstack.org/161508 | 10:23 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled eslint:space-infix-ops https://review.openstack.org/161509 | 10:24 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled eslint:no-use-before-define https://review.openstack.org/161510 | 10:24 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Added null check for story creator_id. https://review.openstack.org/164877 | 10:24 |
| *** yfried_ is now known as yfried|afk | 10:26 | |
| *** garyh has joined #openstack-infra | 10:28 | |
| *** rlandy has joined #openstack-infra | 10:29 | |
| *** sarob has joined #openstack-infra | 10:29 | |
| *** mrunge_ is now known as mrunge | 10:30 | |
| *** ddieterly has joined #openstack-infra | 10:31 | |
| *** achanda has joined #openstack-infra | 10:31 | |
| *** claudiub has quit IRC | 10:32 | |
| openstackgerrit | Julien Danjou proposed openstack-dev/pbr: Handle PEP426 markers https://review.openstack.org/165015 | 10:32 |
| *** pc_m has joined #openstack-infra | 10:33 | |
| *** sarob has quit IRC | 10:35 | |
| *** ddieterly has quit IRC | 10:35 | |
| *** achanda has quit IRC | 10:36 | |
| *** dtantsur is now known as dtantsur|brb | 10:37 | |
| *** _nadya_ has joined #openstack-infra | 10:37 | |
| *** garyh has quit IRC | 10:38 | |
| *** macjack has joined #openstack-infra | 10:38 | |
| *** e0ne is now known as e0ne_ | 10:40 | |
| *** e0ne_ is now known as e0ne | 10:44 | |
| *** Qiming has joined #openstack-infra | 10:47 | |
| *** coolsvap is now known as coolsvap|afk | 10:53 | |
| *** alex_xu has joined #openstack-infra | 10:55 | |
| alex_xu | ianw: Hi, are you around, could you let me know whether this https://review.openstack.org/#/c/160068/4 make sense to you? if not, I will update it. Thanks in advance! | 10:57 |
| *** Bsony has joined #openstack-infra | 11:00 | |
| *** Bsony has quit IRC | 11:00 | |
| *** Bsony has joined #openstack-infra | 11:01 | |
| openstackgerrit | Peter Hamilton proposed openstack/requirements: Update PyKMIP version in requirements https://review.openstack.org/164449 | 11:07 |
| *** e0ne is now known as e0ne_ | 11:08 | |
| *** Somay has joined #openstack-infra | 11:08 | |
| *** mfink_ has joined #openstack-infra | 11:08 | |
| *** markvoelker has joined #openstack-infra | 11:08 | |
| *** jedimike has quit IRC | 11:10 | |
| *** notnownikki has joined #openstack-infra | 11:10 | |
| *** ashishb has quit IRC | 11:12 | |
| *** imcsk8 has quit IRC | 11:14 | |
| *** markvoelker has quit IRC | 11:14 | |
| *** imcsk8 has joined #openstack-infra | 11:14 | |
| *** claudiub has joined #openstack-infra | 11:17 | |
| *** e0ne_ has quit IRC | 11:17 | |
| kaisers | Hello! Is it ok to ask general tempest question here or is there a better channel? | 11:19 |
| *** _nadya_ has quit IRC | 11:19 | |
| *** ominakov has joined #openstack-infra | 11:22 | |
| *** cdent has joined #openstack-infra | 11:22 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-user: Ensure home and home/.ssh folders are created https://review.openstack.org/165029 | 11:22 |
| *** otter768 has joined #openstack-infra | 11:24 | |
| *** e0ne has joined #openstack-infra | 11:27 | |
| *** ominakov has quit IRC | 11:28 | |
| *** otter768 has quit IRC | 11:28 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-user: Ensure home and home/.ssh folders are created https://review.openstack.org/165029 | 11:30 |
| *** sarob has joined #openstack-infra | 11:30 | |
| *** macjack has quit IRC | 11:30 | |
| *** sarob has quit IRC | 11:35 | |
| *** markvoelker has joined #openstack-infra | 11:38 | |
| *** mrmartin has joined #openstack-infra | 11:40 | |
| *** Qiming_ has joined #openstack-infra | 11:42 | |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Temp set saharaclient src juno job to non-voting https://review.openstack.org/165038 | 11:43 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-user: Ensure home and home/.ssh folders are created https://review.openstack.org/165029 | 11:43 |
| *** ldnunes has joined #openstack-infra | 11:44 | |
| openstackgerrit | Max Rasskazov proposed openstack-infra/jenkins-job-builder: Add support of multiple credentials for ssh-agent-credentials wrapper https://review.openstack.org/156681 | 11:45 |
| *** baoli has joined #openstack-infra | 11:45 | |
| *** Qiming has quit IRC | 11:46 | |
| *** mtanino has joined #openstack-infra | 11:46 | |
| *** baoli has quit IRC | 11:47 | |
| *** baoli has joined #openstack-infra | 11:47 | |
| *** deepakcs has quit IRC | 11:48 | |
| openstackgerrit | Jaroslav Henner proposed openstack-infra/jenkins-job-builder: Add checking of multijob phase condition. https://review.openstack.org/164669 | 11:49 |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added request statistic https://review.openstack.org/164696 | 11:49 |
| *** baoli has quit IRC | 11:50 | |
| *** koolhead17 has quit IRC | 11:51 | |
| *** ominakov has joined #openstack-infra | 11:57 | |
| *** Longgeek has quit IRC | 11:58 | |
| *** woodster_ has joined #openstack-infra | 11:59 | |
| *** amotoki has quit IRC | 11:59 | |
| *** e0ne is now known as e0ne_ | 12:00 | |
| *** dprince has joined #openstack-infra | 12:01 | |
| *** yamamoto has joined #openstack-infra | 12:04 | |
| *** coolsvap|afk is now known as coolsvap | 12:04 | |
| *** stevemar has joined #openstack-infra | 12:05 | |
| *** e0ne_ is now known as e0ne | 12:06 | |
| *** oomichi_ has quit IRC | 12:06 | |
| *** weshay has joined #openstack-infra | 12:08 | |
| *** ihrachyshka has joined #openstack-infra | 12:10 | |
| *** radez_g0n3 is now known as radez | 12:13 | |
| *** zz_dimtruck is now known as dimtruck | 12:14 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Branches, milestones and projects ids validation in tasks https://review.openstack.org/162126 | 12:14 |
| *** dkranz has quit IRC | 12:16 | |
| *** dims has quit IRC | 12:16 | |
| *** dims has joined #openstack-infra | 12:17 | |
| *** dtantsur|brb is now known as dtantsur | 12:18 | |
| Somay | hi clarkb : I have made the changes you mentioned here. https://review.openstack.org/#/c/163137/ Please review :) | 12:18 |
| *** bswartz has quit IRC | 12:19 | |
| *** jaypipes has joined #openstack-infra | 12:20 | |
| *** aysyd has joined #openstack-infra | 12:22 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added story types https://review.openstack.org/163412 | 12:23 |
| *** ominakov has quit IRC | 12:24 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added story types https://review.openstack.org/163412 | 12:25 |
| *** dimtruck is now known as zz_dimtruck | 12:25 | |
| *** _nadya_ has joined #openstack-infra | 12:25 | |
| *** jistr is now known as jistr|class | 12:26 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added story types https://review.openstack.org/163412 | 12:26 |
| *** salv-orlando has quit IRC | 12:30 | |
| *** sarob has joined #openstack-infra | 12:31 | |
| *** ddieterly has joined #openstack-infra | 12:32 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added request statistic https://review.openstack.org/164696 | 12:32 |
| *** adalbas has joined #openstack-infra | 12:32 | |
| *** ominakov has joined #openstack-infra | 12:35 | |
| *** spredzy is now known as spredzy|afk | 12:36 | |
| *** sarob has quit IRC | 12:36 | |
| *** ddieterly has quit IRC | 12:37 | |
| openstackgerrit | Peter Hamilton proposed openstack/requirements: Update PyKMIP version in requirements https://review.openstack.org/164449 | 12:38 |
| *** gordc has joined #openstack-infra | 12:39 | |
| *** adalbas has quit IRC | 12:41 | |
| *** ominakov_ has joined #openstack-infra | 12:43 | |
| *** ominakov has quit IRC | 12:45 | |
| *** banix has joined #openstack-infra | 12:48 | |
| *** dkliban_afk is now known as dkliban | 12:48 | |
| *** garyh has joined #openstack-infra | 12:49 | |
| openstackgerrit | Merged openstack-infra/shade: Fix up and document input parameters https://review.openstack.org/160184 | 12:50 |
| openstackgerrit | Merged openstack-infra/shade: Add support for keystone projects https://review.openstack.org/159941 | 12:52 |
| openstackgerrit | Teemu Patja proposed stackforge/python-jenkins: Add a get_nodes method https://review.openstack.org/163068 | 12:52 |
| openstackgerrit | Merged openstack-infra/shade: Small fixes found working on ansible modules https://review.openstack.org/162140 | 12:52 |
| openstackgerrit | Merged openstack-infra/shade: Disable dogpile.cache if cache_interval is None https://review.openstack.org/161963 | 12:52 |
| openstackgerrit | Merged openstack-infra/shade: Add basic unit test for shade.openstack_cloud https://review.openstack.org/159674 | 12:52 |
| openstackgerrit | Merged openstack-infra/shade: Handle image name for boot from volume https://review.openstack.org/164691 | 12:52 |
| *** adalbas has joined #openstack-infra | 12:53 | |
| *** nelsnels_ has quit IRC | 12:55 | |
| *** bswartz has joined #openstack-infra | 12:56 | |
| *** bknudson has quit IRC | 12:57 | |
| *** mriedem_away is now known as mriedem | 12:58 | |
| *** garyh has quit IRC | 12:59 | |
| cdent | sdague: could you be so kind as to lay your eyes upon: https://review.openstack.org/#/c/163865/ | 12:59 |
| *** _nadya_ has quit IRC | 12:59 | |
| sdague | approved | 12:59 |
| cdent | thanks | 13:00 |
| *** salv-orlando has joined #openstack-infra | 13:00 | |
| *** bknudson has joined #openstack-infra | 13:01 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Allow for passing cache class in as a parameter https://review.openstack.org/162148 | 13:01 |
| *** Qiming_ is now known as Qiming | 13:03 | |
| *** ChuckC has quit IRC | 13:04 | |
| *** ChuckC_ has joined #openstack-infra | 13:04 | |
| *** ddieterly has joined #openstack-infra | 13:05 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Restore query for horizon bug 1265057 https://review.openstack.org/165059 | 13:06 |
| openstack | bug 1265057 in grenade "gate/check-grenade-dsvm: Horizon front page not functioning!" [Undecided,Confirmed] https://launchpad.net/bugs/1265057 | 13:06 |
| *** ddieterly has quit IRC | 13:07 | |
| gordc | sdague: could you re-approve this as well? :) https://review.openstack.org/#/c/155473/ | 13:07 |
| *** ChuckC has joined #openstack-infra | 13:07 | |
| *** ChuckC_ has quit IRC | 13:07 | |
| sdague | mriedem: do you have a fix for the horizon thing? | 13:07 |
| mriedem | sdague: nope | 13:08 |
| mriedem | looking at recent commits | 13:08 |
| mriedem | https://github.com/openstack/horizon/commit/f9ceb2d86ab8d8adbfc28040071f7ac8a0731fb1 | 13:08 |
| mriedem | doug-fish: can you help here? ^ | 13:08 |
| mriedem | https://bugs.launchpad.net/horizon/+bug/1265057 | 13:08 |
| openstack | Launchpad bug 1265057 in grenade "gate/check-grenade-dsvm: Horizon front page not functioning!" [Undecided,Confirmed] | 13:08 |
| mriedem | http://logs.openstack.org/51/130151/8/check/check-devstack-dsvm-cells/6463df7/console.html#_2015-03-17_11_48_27_578 | 13:08 |
| *** julim has joined #openstack-infra | 13:09 | |
| sdague | when did that merge? | 13:09 |
| mriedem | yesterday | 13:09 |
| sdague | yeh, all the cells jobs are fail right now | 13:09 |
| sdague | ok, that explains things | 13:09 |
| doug-fish | mriedem: yeah, looking | 13:09 |
| *** amotoki has joined #openstack-infra | 13:09 | |
| mriedem | sdague: is there a reason why we run horizon in that cells devstack job? | 13:11 |
| openstackgerrit | Merged openstack-infra/project-config: Add functional test job for python-ceilometerclient https://review.openstack.org/163865 | 13:11 |
| dhellmann | mordred, lifeless: Can we sync up on the state of pbr today? We have a lot of unreleased changes in master that I'd like to understand and jd__ has started working on the pip requirements environment rules stuff there, too. | 13:11 |
| sdague | mriedem: because that cells job is terrible in all ways | 13:11 |
| *** dustins has joined #openstack-infra | 13:11 | |
| mriedem | sdague: well, it did find the problem with volumes in novaclient :) | 13:12 |
| mriedem | so it's not all bad | 13:12 |
| *** ChuckC has quit IRC | 13:12 | |
| *** tnovacik_ has quit IRC | 13:13 | |
| *** dkranz has joined #openstack-infra | 13:14 | |
| *** dboik has quit IRC | 13:14 | |
| *** dustins has quit IRC | 13:15 | |
| sdague | more importantly, why are we running any exercise in that cells job except the volumes one | 13:15 |
| *** yamamoto has quit IRC | 13:15 | |
| *** changbl has quit IRC | 13:16 | |
| sdague | I'm just going to start deleting exercises in devstack, no one should be using these for testing | 13:16 |
| mriedem | well, volumes and secgroups are probably about the only useful thing for that job, not sure what client-args is | 13:17 |
| mordred | dhellmann: yes please. I believe we need one more patch from lifeless (or someone) to fix master | 13:17 |
| mriedem | but we don't need to test sahara and swift and horizon for cells | 13:17 |
| dhellmann | mordred: ok, I wouldn't want to actually release at this point in the cycle so I'm mostly trying to understand where things stand. What's the missing patch? | 13:18 |
| sdague | mriedem: see... we have these actual tests, which are maintained, in this other project :) | 13:18 |
| mriedem | bah | 13:19 |
| sdague | devstack exercises are not tests, and shouldn't be used as such | 13:19 |
| *** liusheng has quit IRC | 13:19 | |
| *** liusheng has joined #openstack-infra | 13:19 | |
| mriedem | my only counterpoint would be that volumes thing | 13:19 |
| *** nelsnelson has joined #openstack-infra | 13:19 | |
| *** PaulMurray has joined #openstack-infra | 13:20 | |
| mriedem | that tempest wasn't tickling | 13:20 |
| *** tnovacik_ has joined #openstack-infra | 13:20 | |
| sdague | yeh, so that was discovered because we have 0 testing on the clients | 13:20 |
| sdague | which is it's own issue | 13:20 |
| *** peristeri has joined #openstack-infra | 13:20 | |
| *** nelsnelson has quit IRC | 13:22 | |
| *** banix has quit IRC | 13:22 | |
| mordred | dhellmann: it's the thign to make the semver stuff not break everything | 13:22 |
| *** yamamoto has joined #openstack-infra | 13:22 | |
| *** nelsnelson has joined #openstack-infra | 13:22 | |
| mordred | dhellmann: I've already forgotten what it is about the semver patches that broke everything - but I think it was that patch series being angry with people for having legacy things installed or something | 13:22 |
| mordred | dhellmann: I also agree - releasing now == bad | 13:23 |
| *** ayoung has joined #openstack-infra | 13:23 | |
| sdague | dhellmann: btw, until that cells / horizon thing is unwound, all the req patches are blocked | 13:23 |
| *** mtanino has quit IRC | 13:24 | |
| dhellmann | mordred: oh, right. I wonder if we should just revert that work and move it to a feature branch? It's not clear to me what the goal there was to begin with. | 13:24 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Restore query for horizon bug 1265057 https://review.openstack.org/165059 | 13:24 |
| openstack | bug 1265057 in grenade "gate/check-grenade-dsvm: Horizon front page not functioning!" [Undecided,Confirmed] https://launchpad.net/bugs/1265057 | 13:24 |
| dhellmann | sdague: ok, I don't know about the cells/horizon thing, do you think that's something I might be able to help with or are there folks already working it? | 13:24 |
| *** _shaps_ has joined #openstack-infra | 13:25 | |
| *** Somay has quit IRC | 13:25 | |
| *** otter768 has joined #openstack-infra | 13:25 | |
| sdague | so, honestly, right now this is my fix for it - Sean Dague proposed openstack-dev/devstack: remove horizon exercises https://review.openstack.org/165063 | 13:25 |
| mordred | dhellmann: I think the idea was that if there was another thing we needed to release and had to do it on the stable branch, that we'd revert, put semver in a feature branch and make the current stable branch master again | 13:25 |
| mordred | lifeless: any chance you'll have time to finish the semver work any time soon ^^ ? | 13:25 |
| *** sdake has joined #openstack-infra | 13:25 | |
| *** spredzy|afk is now known as spredzy | 13:25 | |
| sdague | but, I'm not going to babysit that, and people keep adding jobs to devstack, so my faith in that landing on first go are small | 13:26 |
| *** tnovacik_ has quit IRC | 13:26 | |
| dhellmann | sdague: seems reasonable | 13:26 |
| *** eharney has joined #openstack-infra | 13:27 | |
| *** alexpilotti has joined #openstack-infra | 13:27 | |
| *** sdake__ has joined #openstack-infra | 13:27 | |
| dhellmann | mordred, lifeless: ok. Now that we have the processes set for the other oslo libs, I want to start including pbr in our regular reviews. It's pretty inconvenient that master is unreleasable, because it ends up meaning no one wants to do anything with the lib because there's no point. :-/ | 13:27 |
| *** otter768 has quit IRC | 13:29 | |
| *** hashar has quit IRC | 13:29 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add 'rebuild' to shade https://review.openstack.org/161067 | 13:29 |
| *** hashar has joined #openstack-infra | 13:30 | |
| mordred | dhellmann: ++ totally agree | 13:30 |
| *** bhunter71 has joined #openstack-infra | 13:30 | |
| *** salv-orlando has quit IRC | 13:31 | |
| *** sdake has quit IRC | 13:31 | |
| *** kaisers has left #openstack-infra | 13:31 | |
| *** alexpilotti has quit IRC | 13:32 | |
| *** kaisers has joined #openstack-infra | 13:32 | |
| *** alexpilotti has joined #openstack-infra | 13:32 | |
| *** sarob has joined #openstack-infra | 13:32 | |
| dhellmann | mordred, lifeless : I wonder if some of the constraints checking would be better off in a stand-alone tool for suggesting a new tag to use for a project, instead of being enforced in pbr itself. | 13:32 |
| *** _nadya_ has joined #openstack-infra | 13:32 | |
| *** hdd has joined #openstack-infra | 13:33 | |
| mordred | dhellmann: I also believe I agree with that | 13:33 |
| *** ChuckC has joined #openstack-infra | 13:33 | |
| mordred | dhellmann: also, I just re-replied to the list - my first one was wrong | 13:33 |
| *** ociuhandu has joined #openstack-infra | 13:33 | |
| mordred | dhellmann: I think we do need to do the compat shim you suggested, because pbr doesn't (and can't) do stable releases | 13:33 |
| mordred | so tip of pbr really _must_ support existing stable versions of thigns in the field | 13:34 |
| mordred | which means we need to keep support for reading requirements-py* - but moving forward we should get the projects using markers instead | 13:34 |
| *** tiswanso has joined #openstack-infra | 13:35 | |
| *** dboik has joined #openstack-infra | 13:36 | |
| *** banix has joined #openstack-infra | 13:36 | |
| dhellmann | mordred: yeah that's another argument in favor of having pbr just "do what I tell you" and having these semver rules be applied by something else | 13:36 |
| *** LinuxJed_ has joined #openstack-infra | 13:36 | |
| dhellmann | openstack is all edge cases | 13:36 |
| *** ddieterly has joined #openstack-infra | 13:36 | |
| dhellmann | mordred: I'll start ML thread about fixing pbr master, since the time difference with lifeless is leaving him out of this conversation. | 13:37 |
| *** sarob has quit IRC | 13:38 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add 'rebuild' to shade https://review.openstack.org/161067 | 13:38 |
| *** tiswanso has quit IRC | 13:38 | |
| *** hdd has quit IRC | 13:38 | |
| *** tiswanso_ has joined #openstack-infra | 13:39 | |
| ZZelle | fungi, hi | 13:40 |
| mordred | dhellmann: sweet. thanks | 13:40 |
| *** prad has joined #openstack-infra | 13:42 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 13:43 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added events for tags https://review.openstack.org/165074 | 13:43 |
| *** yamamoto has quit IRC | 13:43 | |
| *** LinuxJedi has quit IRC | 13:44 | |
| *** claudiub has quit IRC | 13:44 | |
| *** LinuxJed_ is now known as LinuxJedi | 13:44 | |
| *** soren has quit IRC | 13:45 | |
| *** Somay has joined #openstack-infra | 13:45 | |
| dstufft | mordred: coutndown until pbr falls into postel's tarpit | 13:45 |
| dstufft | (like all the other packaging tools :V) | 13:46 |
| openstackgerrit | Merged openstack-infra/shade: Add methods to create and delete networks https://review.openstack.org/157923 | 13:47 |
| *** sdake has joined #openstack-infra | 13:48 | |
| mordred | dstufft: everything should go into the tarpits | 13:48 |
| mtreinish | clarkb: sort of, we've got a workaround to do the migration in a different way which shouldn't trigger the space issue: https://review.openstack.org/164838 | 13:50 |
| mtreinish | once that lands I'll push a bugfix release and we'll try again | 13:50 |
| mordred | mtreinish: is that patch working now? | 13:50 |
| *** zz_dimtruck is now known as dimtruck | 13:51 | |
| mtreinish | mordred: yeah, I got it to pass the migration unit tests, and I inspected it locally it looked fine | 13:51 |
| mordred | woot | 13:51 |
| *** zz_johnthetubagu is now known as johnthetubaguy | 13:51 | |
| *** sdake__ has quit IRC | 13:51 | |
| *** banix has quit IRC | 13:52 | |
| *** sabeen has joined #openstack-infra | 13:53 | |
| *** koolhead17 has joined #openstack-infra | 13:55 | |
| *** koolhead17 has quit IRC | 13:55 | |
| *** koolhead17 has joined #openstack-infra | 13:55 | |
| *** yamamoto has joined #openstack-infra | 13:56 | |
| *** Qiming has quit IRC | 13:56 | |
| *** Qiming has joined #openstack-infra | 13:56 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added request statistic https://review.openstack.org/164696 | 13:58 |
| *** amitgandhinz has joined #openstack-infra | 13:59 | |
| *** eharney has quit IRC | 13:59 | |
| *** garyh has joined #openstack-infra | 14:00 | |
| *** dboik_ has joined #openstack-infra | 14:00 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add 'rebuild' to shade https://review.openstack.org/161067 | 14:00 |
| *** gokrokve has joined #openstack-infra | 14:01 | |
| mtreinish | jeblair, mordred: btw, this was the patch from yesterday to run the migrations in the background: https://review.openstack.org/164736 | 14:03 |
| *** pblaho_ has joined #openstack-infra | 14:03 | |
| *** dboik has quit IRC | 14:03 | |
| *** r-daneel has joined #openstack-infra | 14:03 | |
| mtreinish | the only bit missing from the puppet before we push the new release is fixing the syntax error on the mysqldump (which unfortunately isn't printed in the failure output) | 14:03 |
| *** pblaho_ has quit IRC | 14:04 | |
| *** pblaho has quit IRC | 14:05 | |
| *** jistr|class is now known as jistr | 14:05 | |
| *** pblaho_ has joined #openstack-infra | 14:05 | |
| *** pblaho_ has quit IRC | 14:06 | |
| *** pblaho_ has joined #openstack-infra | 14:06 | |
| *** esker has joined #openstack-infra | 14:07 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:07 | |
| *** pblaho_ has quit IRC | 14:08 | |
| *** garyh has quit IRC | 14:09 | |
| *** mtanino has joined #openstack-infra | 14:10 | |
| *** nilasae has quit IRC | 14:10 | |
| *** pblaho__ has joined #openstack-infra | 14:10 | |
| *** salv-orlando has joined #openstack-infra | 14:11 | |
| *** salv-orlando has quit IRC | 14:11 | |
| *** salv-orlando has joined #openstack-infra | 14:11 | |
| *** che-arne has joined #openstack-infra | 14:11 | |
| *** tnovacik_ has joined #openstack-infra | 14:12 | |
| mkoderer | anteaya: ping | 14:12 |
| *** mrmartin has quit IRC | 14:12 | |
| openstackgerrit | Merged openstack-infra/system-config: Add instructions for vgcreate to sysadmin docs https://review.openstack.org/159681 | 14:14 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-user: Ensure home and home/.ssh folders are created https://review.openstack.org/165029 | 14:15 |
| *** kaisers has quit IRC | 14:16 | |
| *** hdd has joined #openstack-infra | 14:17 | |
| openstackgerrit | Merged openstack-infra/system-config: Update docs for bup user home in /opt/backups https://review.openstack.org/159933 | 14:17 |
| *** mattfarina has joined #openstack-infra | 14:18 | |
| openstackgerrit | Merged openstack-infra/system-config: Add changing to launch/ directory to a README https://review.openstack.org/159647 | 14:18 |
| mordred | mtreinish: looks great | 14:19 |
| pabelanger | morning, is there any etherpads that describe the ansible effort for -infra? | 14:20 |
| *** mfink_ has quit IRC | 14:21 | |
| *** BharatK has quit IRC | 14:22 | |
| *** wenlock has joined #openstack-infra | 14:22 | |
| fungi | ZZelle: what's up? | 14:23 |
| fungi | pabelanger: mordred said he'd whip up a spec | 14:23 |
| *** mfink_ has joined #openstack-infra | 14:24 | |
| pabelanger | fungi, okay, no rush. I was just checking to see if any thoughts had been written down | 14:24 |
| doug-fish | mriedem: do you know offhand where the code is for the test that is failing and resulting in https://bugs.launchpad.net/horizon/+bug/1265057 ? | 14:25 |
| openstack | Launchpad bug 1265057 in grenade "gate/check-grenade-dsvm: Horizon front page not functioning!" [Undecided,Confirmed] | 14:25 |
| doug-fish | pretty sure I know how to fix it | 14:26 |
| mriedem | doug-fish: devstack, but it's being removed https://review.openstack.org/#/c/165063/ | 14:26 |
| doug-fish | ah, well that's a way to fix it too | 14:26 |
| mriedem | we have the same test in tempest, so having it in the devstack exercises is pointless | 14:27 |
| doug-fish | I'm a bit surprised tempest isn't broken as well | 14:27 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Manage hiera.yaml on all hosts https://review.openstack.org/164870 | 14:28 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Set $group at node scope for hiera lookups https://review.openstack.org/164842 | 14:28 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Setup hiera lookups to do common,group,fqdn https://review.openstack.org/164845 | 14:28 |
| mordred | pabelanger: it's def on my todo list - hoping to get to it either today or tomorrow | 14:29 |
| alex_xu | ianw: good morning, are you around? hope to get your option on https://review.openstack.org/#/c/160068/ thanks in advance | 14:29 |
| openstackgerrit | Merged openstack-infra/system-config: Add configurable graphite url on zuul status https://review.openstack.org/162177 | 14:30 |
| openstackgerrit | Merged openstack-infra/system-config: grammar updates for gerrit documentation https://review.openstack.org/160185 | 14:30 |
| doug-fish | okay, I'm not surprised now that tempest is working urllib2 follows directs. curl doesn't (at least not without a flag) | 14:30 |
| openstackgerrit | Merged openstack-infra/system-config: Add requirement to get approval to post comments https://review.openstack.org/152550 | 14:30 |
| ZZelle | fungi, hi could you look at https://review.openstack.org/124410 ? | 14:30 |
| *** tsg has joined #openstack-infra | 14:30 | |
| pabelanger | mordred, sounds good | 14:30 |
| mordred | pabelanger: althoguh with the three patches of nibalizer's that I just re-pushed above - the story becomes kinda simple | 14:31 |
| *** timcline has joined #openstack-infra | 14:31 | |
| mordred | pabelanger: a) split current common.yaml into per-host or per-group files (with some things still in common.yaml) | 14:32 |
| mordred | pabelanger: b) have ansible start copying the hiera files that are for a given host as step one before it runs puppet on that host | 14:32 |
| mordred | pabelanger: c) switch to puppet apply, because now each host will have its own hiera info | 14:33 |
| *** zz_jgrimm is now known as jgrimm | 14:33 | |
| mordred | pabelanger: d) move from the puppet-cert ansible inventory to the openstack ansible inventory | 14:33 |
| mordred | I think that's it | 14:33 |
| *** sarob has joined #openstack-infra | 14:33 | |
| pabelanger | Ya, that is nice. | 14:34 |
| mordred | which I love, beacuse it's super simple transition and can be done stepwise | 14:34 |
| *** achanda has joined #openstack-infra | 14:34 | |
| *** garyh has joined #openstack-infra | 14:35 | |
| fungi | step z) once we have working dnssec somewhere, start having ansible check ssh host keys against sshfp records so we can finally stop relying on tofu | 14:36 |
| mordred | yah | 14:36 |
| *** _nadya_ has quit IRC | 14:37 | |
| mordred | fungi: well, step y) write an extension for nova which can do an ssh ping of a host from the nova-compute process to the hypervisor over the on-machine connection and return the ssh host key | 14:37 |
| mordred | fungi: and get our cloud providers to deploy it | 14:37 |
| openstackgerrit | Merged openstack-infra/system-config: Add the Gerrit replication plugin paramater 'defaultForceUpdate' https://review.openstack.org/155135 | 14:37 |
| *** emagana has joined #openstack-infra | 14:37 | |
| fungi | true. then we can just continue to trust the nova api endpoint, which we have to anyway | 14:38 |
| mordred | yup | 14:38 |
| *** sarob has quit IRC | 14:38 | |
| mordred | although I think the step would be "create server, query nova for hostkey, add hostkey to dns" | 14:38 |
| mordred | which would be killer cool | 14:38 |
| mordred | fungi: what does one need to do to openssh to get it to check sshfp records? | 14:39 |
| jroll | mordred: fungi: glyph did a big hacky thing recently to verify a cloud server's host keys securely | 14:39 |
| jroll | if you're interested I can maybe get him to do a writeup or something | 14:40 |
| *** kaisers has joined #openstack-infra | 14:40 | |
| mordred | jroll: yes - I would very much like to know what he did - because as of right now, I can not think of any path that would be valid | 14:40 |
| dstufft | ~DNSSEC~ | 14:40 |
| fungi | mordred: step one, have them served via dnssec-signed zones, step 2 have a local resolver which actually checks dnssec, step 3 turn on VerifyHostKeyDNS in your openssh client config | 14:40 |
| mordred | fungi: awesome. adding VerifyHostKeyDNS to ansible's openssh use should be easy | 14:41 |
| jroll | mordred: I'll poke him. when I say hacky I mean HACKY. but it seemed like it was workable | 14:41 |
| dstufft | you could create a SSH certificate too | 14:41 |
| dstufft | instead of DNSSEC which is kinda borken | 14:41 |
| fungi | true, that's an alternative. maintain a ca which is trusted by your openssh client and sign all the host keys with it, then have them provide that ceritficate on connect | 14:42 |
| mordred | we'd have to inject a cert on server create | 14:42 |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Run subunit2sql migrations in the background https://review.openstack.org/164736 | 14:43 |
| fungi | yeah, the trick there is distributing the certs to the servers and distributing the ca cert to the clients | 14:43 |
| fungi | as opposed to dns which solves the distribution problem | 14:43 |
| mordred | yup. I think I'm fine with just grabbing the host_key from the nova api when we create it | 14:43 |
| *** achanda has quit IRC | 14:43 | |
| *** baoli has joined #openstack-infra | 14:44 | |
| *** gokrokve_ has joined #openstack-infra | 14:44 | |
| dstufft | wouldn't that just be having whatever process is spinning up servers grab the host key from the nova API, ssh into the server with that host key, and signing the auto generated ssh key? | 14:44 |
| mordred | dstufft: yes. once the nova api can give us the host key | 14:45 |
| *** gokrokve has quit IRC | 14:45 | |
| dstufft | yea, I mean using the ssh certificates instead of DNSSEC, DNSSEC is kinda grody, it operates at a layer that things aren't really well equiped to deal with non-networking failures | 14:46 |
| fungi | i mean, we sort of still have the tofu problem with sshfp or certs as well (but only once globally though rather than once for every client) | 14:46 |
| *** _nadya_ has joined #openstack-infra | 14:46 | |
| fungi | that is until nova can tell us the host key fingerprint | 14:46 |
| dstufft | yea | 14:47 |
| fungi | right now we ask nova to boot us an instance, then we ssh into it to configure it. it's that step where the risk comes in | 14:48 |
| fungi | because our build tooling simply has to assume that the initial ssh it performs to that ip address is not subjected to a mitm attack | 14:48 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add 'rebuild' to shade https://review.openstack.org/161067 | 14:49 |
| fungi | perhaps that's something we could hack around via nova console, but that would be yucky | 14:49 |
| openstackgerrit | Sean Dague proposed openstack/requirements: Cap Oslo libraries for kilo https://review.openstack.org/162656 | 14:49 |
| mordred | fungi: yeah - I think writing a nova extension for M will be a nice thing there | 14:49 |
| dstufft | well | 14:49 |
| jeblair | sdague: so the devstack-dsvm-cells job is asymmetric (horizon does not run it). is horizon being completely removed from being tested in that job, or should we add it to horizon? | 14:50 |
| dstufft | doesn't nova have the ability to add user data when spawning a server? | 14:50 |
| mordred | dstufft: sure- but we don't use it really | 14:50 |
| mordred | dstufft: and I'd like to keep it that way | 14:50 |
| dstufft | you could use it to have the spawning process inject a freshly created SSH key | 14:50 |
| mordred | yes - we coudl - the problem is that it's a very brittle system and hard to debug when it breaks | 14:51 |
| sdague | jeblair: honestly, I personally think we should remove the job entirely. It was setup poorly from the start. | 14:51 |
| mordred | which is why we mostly avoid it | 14:51 |
| jeblair | sdague: is someone working on that? | 14:51 |
| sdague | not that I know of | 14:51 |
| *** spzala has joined #openstack-infra | 14:51 | |
| *** baoli has quit IRC | 14:51 | |
| dstufft | mordred: that's reasonable. Just an idea anyways :D | 14:51 |
| sdague | my current fix is to remove the horizon exercise | 14:52 |
| jeblair | sdague: okay. will that remove horizon from the test path? | 14:52 |
| sdague | yes | 14:52 |
| jeblair | okay, i won't propose any layout changes then | 14:52 |
| *** dimtruck is now known as zz_dimtruck | 14:53 | |
| *** baoli has joined #openstack-infra | 14:53 | |
| *** gokrokve_ has quit IRC | 14:53 | |
| *** gokrokve has joined #openstack-infra | 14:56 | |
| *** david-lyle_afk is now known as david-lyle | 14:57 | |
| *** nanliu has joined #openstack-infra | 14:58 | |
| *** mrmartin has joined #openstack-infra | 14:59 | |
| *** asselin_ has joined #openstack-infra | 15:00 | |
| *** kmartin has joined #openstack-infra | 15:00 | |
| *** SumitNaiksatam has joined #openstack-infra | 15:00 | |
| *** zz_dimtruck is now known as dimtruck | 15:03 | |
| *** julim has quit IRC | 15:04 | |
| *** jaypipes has quit IRC | 15:06 | |
| *** kgiusti has joined #openstack-infra | 15:06 | |
| *** erikmwil_ has joined #openstack-infra | 15:06 | |
| *** erikmwilson is now known as Guest78757 | 15:06 | |
| *** erikmwil_ is now known as erikmwilson | 15:06 | |
| *** erikmwilson_ has joined #openstack-infra | 15:06 | |
| *** soren has joined #openstack-infra | 15:06 | |
| *** tiswanso_ has quit IRC | 15:07 | |
| *** julim has joined #openstack-infra | 15:07 | |
| *** erikmwilson has quit IRC | 15:08 | |
| *** erikmwilson has joined #openstack-infra | 15:08 | |
| *** e0ne is now known as e0ne_ | 15:08 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Manage hiera.yaml on all hosts https://review.openstack.org/164870 | 15:09 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Set $group at node scope for hiera lookups https://review.openstack.org/164842 | 15:09 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Setup hiera lookups to do common,group,fqdn https://review.openstack.org/164845 | 15:09 |
| *** dhritishikhar has joined #openstack-infra | 15:13 | |
| *** banix has joined #openstack-infra | 15:13 | |
| *** yamamoto has quit IRC | 15:14 | |
| *** tiswanso has joined #openstack-infra | 15:14 | |
| *** tiswanso_ has joined #openstack-infra | 15:15 | |
| *** ominakov_ has quit IRC | 15:15 | |
| *** crc32 has joined #openstack-infra | 15:17 | |
| kaisers | Hi! Does anybody have a min to give me a hint or two on how best skip a tempest test (started via tox/testr)? | 15:17 |
| *** tiswanso has quit IRC | 15:18 | |
| *** eharney has joined #openstack-infra | 15:18 | |
| kaisers | I know i can select a test via regexp parameter, that works fine. But can i also exclude a single test by that method? | 15:18 |
| *** crc32 has quit IRC | 15:18 | |
| *** e0ne_ has quit IRC | 15:18 | |
| kaisers | As it is regexp, probably yes. :-D | 15:19 |
| *** crc32 has joined #openstack-infra | 15:19 | |
| *** ssam2 has quit IRC | 15:20 | |
| *** ssam2 has joined #openstack-infra | 15:20 | |
| *** e0ne has joined #openstack-infra | 15:24 | |
| *** dannywilson has joined #openstack-infra | 15:24 | |
| jeblair | kaisers: the folks in #openstack-qa might have an answer | 15:24 |
| *** weshay has quit IRC | 15:25 | |
| *** otter768 has joined #openstack-infra | 15:26 | |
| kaisers | jeblair: thanks, will try! :) | 15:26 |
| *** crc32 has quit IRC | 15:28 | |
| *** dimtruck is now known as zz_dimtruck | 15:29 | |
| *** otter768 has quit IRC | 15:30 | |
| *** zz_dimtruck is now known as dimtruck | 15:31 | |
| *** changbl has joined #openstack-infra | 15:32 | |
| anteaya | mkoderer: how can I help? | 15:33 |
| openstackgerrit | Michael Johnson proposed openstack-infra/git-review: Choose tracked branch for rebase when submitting https://review.openstack.org/158877 | 15:34 |
| hashar | jeblair: good morning :) I have a couple Zuul patches that could use your approval when you get some spare time :D | 15:34 |
| hashar | jeblair: one is a state change occuring before the actual operation is started ( https://review.openstack.org/#/c/128921/ ) | 15:34 |
| *** sarob has joined #openstack-infra | 15:34 | |
| hashar | jeblair: the other is some oddities with .git dirs that can be either files or directories ( https://review.openstack.org/#/c/123437/ ) | 15:35 |
| hashar | both have been running on wikimedia for a few months now | 15:35 |
| jeblair | hashar: thanks! today is meeting day, so it may not be today, but i'll try to review them soon. :) | 15:35 |
| *** dhritishikhar has quit IRC | 15:35 | |
| hashar | jeblair: also joshua has a bunch of Zuul refactoring changes that would be nice additions. | 15:36 |
| openstackgerrit | Michael Johnson proposed openstack-infra/git-review: Choose tracked branch for rebase when submitting https://review.openstack.org/158877 | 15:36 |
| hashar | jeblair: have good meetings! I just wanted to make sure the changes are under your radar | 15:36 |
| openstackgerrit | Dmitry Tantsur proposed openstack/requirements: Add ironic-discoverd to projects.txt https://review.openstack.org/156270 | 15:37 |
| *** tiswanso_ has quit IRC | 15:38 | |
| *** tiswanso has joined #openstack-infra | 15:39 | |
| anteaya | hashar: on your radar, under your radar means you don't see them, on your radar means you do | 15:39 |
| *** tiswanso has quit IRC | 15:39 | |
| *** yfried|afk is now known as yfried_ | 15:40 | |
| *** sarob has quit IRC | 15:40 | |
| hashar | anteaya: ahhh I always wondered why one said "under" that didn't make sense to me! | 15:40 |
| * hashar blushes | 15:40 | |
| anteaya | hashar: :) perfectly understandable | 15:40 |
| anteaya | I can't even speak another language well enough to make any sense let alone try an idiom | 15:40 |
| hashar | you should try :) | 15:41 |
| anteaya | ha ha ha | 15:41 |
| hashar | if you have a nice audience, you will be corrected till you are flawless! | 15:41 |
| anteaya | that is true | 15:41 |
| anteaya | the audience makes all the difference | 15:41 |
| anteaya | a buddy of mine used to hold open stage once a month, we had about 70 of the same people all the time | 15:42 |
| anteaya | everyone was so gentle kind and polite, some people became really good performers as a result of the support of the audience | 15:42 |
| anteaya | miss them | 15:42 |
| *** tsg has quit IRC | 15:43 | |
| *** Somay has quit IRC | 15:45 | |
| jeblair | mordred: i have reviewed your ansible puppet apply stack, however, i don't actually see how it will be used, particularly what the relationship is between "hiera_hostvars" and "hirea" and where those things will come from. | 15:46 |
| jeblair | mordred: i think there must be extra information in that conversation between you and clarkb that i did not read that didn't make it into the commit messages or comments | 15:46 |
| mordred | jeblair: yes - actually, ignore that whole stack | 15:46 |
| mordred | jeblair: pretty much the whole thing gets invalidated by yesterday's conversation | 15:46 |
| mordred | jeblair: I should have hit abandon - sorry for wasting your time | 15:46 |
| mordred | jeblair: the replacement will be WAY smaller and simpler | 15:47 |
| jeblair | mordred: okay, well, you still might want to read my -1. :) | 15:47 |
| mordred | jeblair: I will | 15:47 |
| mordred | jeblair: I'm sure it will be a fun -1 | 15:47 |
| jeblair | mordred: you don't have to abandon it (i mean, unless that's the right thing to do). | 15:48 |
| mordred | jeblair: I believe it will be the right thing to do for much of it - but I'll clean it up in just a jiff | 15:48 |
| jeblair | mordred: you marked it wip, i just thought you already had the replacement up. | 15:48 |
| mordred | jeblair: nope. not yet - although you should look at the nibalizer hiera patches - those are worth looking at | 15:49 |
| mordred | GheRivero: your fix for the ansible inventory private option - does that work for you with current shade and os-client-config? if so, it's a cleaner patch than my patch | 15:49 |
| anteaya | mordred: jeblair does post some of the most fun -1s | 15:49 |
| *** yfried_ is now known as yfried|afk | 15:50 | |
| *** yamahata has joined #openstack-infra | 15:50 | |
| GheRivero | mordred: no it doesn't. Needs a small tweak in shade. I was waiting for all your patches to land today and summit it. | 15:51 |
| mordred | I made this a little while ago: https://github.com/ansible/ansible/pull/10362/files ... but I think your approach may be cleaner | 15:51 |
| *** prad has quit IRC | 15:51 | |
| *** prad has joined #openstack-infra | 15:51 | |
| *** ajmiller has joined #openstack-infra | 15:52 | |
| openstackgerrit | Merged openstack-infra/os-loganalyze: Update regex for better HTML detection. https://review.openstack.org/164891 | 15:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Manage hiera.yaml on all hosts https://review.openstack.org/164870 | 15:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Set $group at node scope for hiera lookups https://review.openstack.org/164842 | 15:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Setup hiera lookups to do common,group,fqdn https://review.openstack.org/164845 | 15:52 |
| *** asselin_ has quit IRC | 15:52 | |
| dougwig | hello infra, good morning. i need a few cores to peek at a new gate job for lbaas and neutron (non-voting for this week), for the new lbaas v2 feature: https://review.openstack.org/#/c/164390/ | 15:52 |
| *** tiswanso has joined #openstack-infra | 15:53 | |
| *** tiswanso has quit IRC | 15:53 | |
| *** tiswanso has joined #openstack-infra | 15:53 | |
| *** unicell has quit IRC | 15:54 | |
| anteaya | dougwig: WIP pending the right hooks landing in neutron-lbaas | 15:54 |
| dougwig | ahh, they landed and i forgot to update. one sec. | 15:54 |
| anteaya | can you post a comment confirming this has happened with a link? | 15:54 |
| anteaya | thanks | 15:54 |
| anteaya | oh sorry that was the depends-on | 15:55 |
| anteaya | which I see has merged | 15:55 |
| jeblair | mordred, nibalizer: why does elasticsearch not have a $group? does it have no hiera info? | 15:55 |
| *** Qiming has quit IRC | 15:55 | |
| dougwig | also commented. | 15:55 |
| *** nilasae has joined #openstack-infra | 15:56 | |
| anteaya | dougwig: non-voting jobs don't go in the gate | 15:56 |
| mordred | jeblair: I just may have missed it | 15:56 |
| openstackgerrit | Ghe Rivero proposed openstack-infra/shade: Allow passing private option https://review.openstack.org/165119 | 15:56 |
| dougwig | anteaya: ok. | 15:56 |
| GheRivero | mordred: ^ that's the change needed in shade for ansible inventory to work with my patch | 15:57 |
| mordred | awesome | 15:57 |
| *** liusheng has quit IRC | 15:57 | |
| *** yfried|afk is now known as yfried_ | 15:57 | |
| *** liusheng has joined #openstack-infra | 15:58 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Promote lbaasv2 api job to both the lbaas and neutron check and gate https://review.openstack.org/164390 | 15:58 |
| dougwig | anteaya: thank you | 15:58 |
| anteaya | welcome | 15:59 |
| *** radez is now known as radez_g0n3 | 15:59 | |
| anteaya | I'll fix the commit message unless you want to, you can do it in the gui | 15:59 |
| anteaya | dougwig: ^ | 15:59 |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Promote lbaasv2 api job to both the lbaas and neutron check queue https://review.openstack.org/164390 | 16:00 |
| dougwig | anteaya: updated, thanks. | 16:00 |
| anteaya | thank you | 16:01 |
| anteaya | dougwig: you regressed | 16:01 |
| anteaya | you fixed the commit message and got the old patch back | 16:01 |
| anteaya | take a minute I'm not in a hurry | 16:01 |
| *** soren has quit IRC | 16:02 | |
| anteaya | I'm tired of being in a hurry | 16:02 |
| anteaya | and just as a public service announcement I would like to say that I think Tim Bell is one of the awesomest people I have ever had the pleasure to work with | 16:03 |
| dougwig | anteaya: that's odd, i used the gerrit link to edit the commit. can that revert the code? | 16:04 |
| dougwig | the commit message, i mean. | 16:04 |
| *** tonytan4ever has joined #openstack-infra | 16:04 | |
| *** ashleighfarnham has joined #openstack-infra | 16:05 | |
| *** ominakov has joined #openstack-infra | 16:05 | |
| anteaya | if you did git review -d 164390 you pull down the patchset to your working env | 16:05 |
| anteaya | if you used the gui in gerrit, well it depends what patchset you were looking at when you did it, but I do believe the gui shows the lastest patchset in the gui | 16:06 |
| *** Longgeek has joined #openstack-infra | 16:06 | |
| anteaya | so if you used the gui to edit the commit message for patchset 4 then yes, it is very odd if you ended up with code from patchset 3 in patchset 5 | 16:06 |
| *** kmartin has quit IRC | 16:06 | |
| *** amotoki has quit IRC | 16:06 | |
| *** yamamoto has joined #openstack-infra | 16:07 | |
| *** kmartin has joined #openstack-infra | 16:07 | |
| anteaya | but yes in patchset 5 the gate jobs are back which were removed in patchset 4 | 16:07 |
| anteaya | so I am confused | 16:07 |
| mrmartin | fungi: r u here? | 16:07 |
| dougwig | i might've needed a browser refresh, i'll bet. i'll fix as soon as the lbaas meeting is over. sorry about that, learned something new. | 16:07 |
| *** kaisers has quit IRC | 16:07 | |
| *** dalgaaf has joined #openstack-infra | 16:07 | |
| anteaya | dougwig: perhaps that was it | 16:08 |
| anteaya | if you had patchset 3 commit message in your gui and edited the commit message on that that would explain what I am looking at for patchset 5 | 16:08 |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Promote lbaasv2 api job to both the lbaas and neutron check queues https://review.openstack.org/164390 | 16:08 |
| *** BobH has joined #openstack-infra | 16:08 | |
| dougwig | anteaya: fixed | 16:09 |
| fungi | mrmartin: yeah, i'm here. what's up? | 16:09 |
| *** baoli has quit IRC | 16:09 | |
| fungi | or down, perhaps? | 16:09 |
| *** spredzy is now known as spredzy|afk | 16:09 | |
| mrmartin | fungi: I cannot attend to infra meeting today, but the ask site seems to be ok | 16:09 |
| *** dboik_ has quit IRC | 16:09 | |
| anteaya | dougwig: that is something I can support, well done | 16:09 |
| mrmartin | so we need to go on with testing, and when it gets a green light, we can continue the migration | 16:10 |
| mrmartin | so this part of the askbot task is accomplished nicely | 16:10 |
| *** Longgeek has quit IRC | 16:10 | |
| fungi | mrmartin: okay, great. we may not need to discuss scheduling the cut-over maintenance during the meeting since i can tackle that on my own as long as there are a few people around to test it out afterward | 16:10 |
| fungi | so we can just collectively figure out a time when it will be convenient so that you and others are around to make sure it looks good and don't need a rollback | 16:11 |
| mrmartin | I like to see at least 2weeks of test window, because it is a very visited site, and I like to avoid any issues we can with a proper testing | 16:11 |
| *** skolekonov has quit IRC | 16:11 | |
| pleia2 | good morning | 16:11 |
| anteaya | morning pleia2 | 16:12 |
| fungi | mrmartin: perfectly fine. if you need a database/files refresh from production into the replacement server in the next couple of weeks, let me know | 16:12 |
| mrmartin | fungi: thanks, the actual db is enough | 16:12 |
| *** ominakov has quit IRC | 16:13 | |
| pabelanger | I don't think it is, but does nodepool offer some sort of 2nd stage invoke for a script? Basically, trying see how I could reboot an image build, then have nodepool continue the image build before taking a snapshot | 16:13 |
| elarson | pleia2: fwiw, here is what I've done so far from the new project steps regarding setting up oslo.cache http://paste.openstack.org/show/192920/ | 16:13 |
| openstackgerrit | Tomas F proposed openstack-infra/jenkins-job-builder: Add combine-queued-commit support https://review.openstack.org/160829 | 16:13 |
| pabelanger | I'm going to say, it is not possible currently | 16:13 |
| *** yfried_ is now known as yfried|afk | 16:14 | |
| pleia2 | elarson: thanks, I'll pass this along to shelly_ | 16:14 |
| *** kaisers has joined #openstack-infra | 16:14 | |
| pabelanger | okay, ready-script might work | 16:15 |
| pleia2 | elarson: want to put this into an etherpad.openstack.org pad instead so it can be edited/noted? | 16:15 |
| elarson | sure | 16:15 |
| pabelanger | Wow, okay, I really need to re-read nodepool, there is also a reset script too | 16:15 |
| *** soren has joined #openstack-infra | 16:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Temp set saharaclient src juno job to non-voting https://review.openstack.org/165038 | 16:17 |
| *** esker has quit IRC | 16:17 | |
| zaro | morning | 16:17 |
| elarson | pleia2: https://etherpad.openstack.org/p/oslo.cache-setup-steps | 16:18 |
| anteaya | morning zaro | 16:18 |
| pleia2 | elarson: great, thanks! | 16:18 |
| dougwig | anteaya: ugh, i botched the grammar in that new commit message, but i'm guessing it's not worth churning jenkins over. | 16:19 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Update puppet-setproxy to belong to Gozer group https://review.openstack.org/164820 | 16:20 |
| *** sputnik13 has quit IRC | 16:20 | |
| yolanda | anteaya, thx for the review, fixed | 16:20 |
| anteaya | dougwig: not for me, it says the important things | 16:20 |
| anteaya | yolanda: thank you | 16:20 |
| yolanda | i just copied acl from another stackforge one, but you are right | 16:20 |
| anteaya | yolanda: figured as much, now if you needed it that is fine, I just wanted to ensure you had what you wanted | 16:20 |
| yolanda | now it looks fine to me | 16:21 |
| *** salv-orlando has quit IRC | 16:21 | |
| anteaya | yolanda: thanks I'll look again | 16:22 |
| mtreinish | fungi: any thoughts on: https://review.openstack.org/#/c/164838/ it's the mordred workaround for the db migration | 16:22 |
| yolanda | thx for the quick feedback | 16:23 |
| pabelanger | Ya, reset not what I expected in nodepool | 16:23 |
| pabelanger | really need some sort of 2 stage bootstrapServer function | 16:23 |
| anteaya | yolanda: sure | 16:23 |
| *** crc32 has joined #openstack-infra | 16:23 | |
| *** yfried|afk is now known as yfried_ | 16:24 | |
| pabelanger | jeblair, ^ regarding the purpose of the reset flag for images. Trying to understand its purpose | 16:24 |
| anteaya | yolanda: the only other thing is that right now you have release permissions given to the whole team, we usually prefer that those permissions are given to one person who is in a -release group, such as gozer-release in this case | 16:25 |
| anteaya | yolanda: do you want tagging permissions on all of core or just one person? | 16:25 |
| yolanda | well, honestly haven't thought about it, but it's ok for me to follow the general guidelines | 16:26 |
| jeblair | pabelanger: it sort of looks like it's not used? | 16:26 |
| anteaya | okay, I'll give you an inline comment, sorry I missed it the first time | 16:26 |
| pabelanger | jeblair, Yup, that is what I am seeing too | 16:26 |
| yolanda | anteaya, so i can amend and specify a different team there | 16:26 |
| anteaya | yes | 16:27 |
| jeblair | pabelanger: i think we can remove it :) it goes back to the initial commit; i may have copied something from devstack-gate, or it may have been an incomplete thought at the time. | 16:27 |
| yolanda | mm, although, just thinking... it will be fine for me to have release perms for that project, as i created. But we are created a generic gozer team, if we want to reuse for some other projects, release person should be different | 16:27 |
| *** jaypipes has joined #openstack-infra | 16:27 | |
| *** arxcruz has quit IRC | 16:27 | |
| anteaya | yolanda: your call, so if you don't want a release group say so in a comment | 16:28 |
| anteaya | it saves the next reviewer having to have the same conversation | 16:28 |
| yolanda | ok, i'll answer the review | 16:28 |
| anteaya | thanks | 16:28 |
| yolanda | thx for the guidance there, first time in these kind of commits | 16:28 |
| anteaya | sure | 16:28 |
| anteaya | thanks for being around to reply | 16:28 |
| pabelanger | jeblair, okay, I'll get a patch up to remove it. But curious what you think of some sort of 2 stage bootstrap process? For the purpose of rebooting between stages? | 16:28 |
| fungi | mtreinish: 164838 seems fine. any reason not to go ahead and approve? | 16:29 |
| *** Somay has joined #openstack-infra | 16:29 | |
| mtreinish | fungi: nope go for it, I'll push a release after it merges | 16:29 |
| mtreinish | which should trigger the migration to run again | 16:30 |
| *** unicell has joined #openstack-infra | 16:30 | |
| *** soren has quit IRC | 16:31 | |
| jeblair | pabelanger: BobBall was working on that, and may still have patches for it. i'm not sure if the DIB work would be an easier way to deal with that. | 16:31 |
| yolanda | anteaya, ok, answered | 16:31 |
| anteaya | so clarkb when you are around, I don't see any enable_swift patches to review, does that mean that this is working? | 16:31 |
| *** unicell1 has joined #openstack-infra | 16:31 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 16:31 | |
| clarkb | anteaya unsure this morning has been a bit crazy for me | 16:32 |
| jeblair | clarkb: i merged the os-loganalyze change | 16:32 |
| *** bdpayne has joined #openstack-infra | 16:32 | |
| clarkb | jeblair perfect we can check thatbwith nodepool coverage logs | 16:32 |
| anteaya | clarkb: you okay? | 16:32 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Remove unused 'reset' setting from images https://review.openstack.org/165136 | 16:33 |
| *** packet has joined #openstack-infra | 16:33 | |
| *** Bsony has quit IRC | 16:33 | |
| clarkb | anteaya yup, MIL had scheduled surgery early today but on our way to pick her up the car died, so just dealt with car, eating fast then back to hospital | 16:34 |
| *** GumBall has joined #openstack-infra | 16:34 | |
| anteaya | clarkb: oh go go | 16:34 |
| *** scheuran has quit IRC | 16:34 | |
| anteaya | clarkb: hope everything works out well | 16:34 |
| *** unicell has quit IRC | 16:35 | |
| anteaya | clarkb: just be offline | 16:35 |
| pabelanger | jeblair, perfect, thanks. Found the review, going to see what I can do to bring it back to life | 16:35 |
| *** sarob has joined #openstack-infra | 16:35 | |
| *** yamamoto has quit IRC | 16:36 | |
| jeblair | pabelanger: okay, let's have a discussion about whether it can be done with DIB instead before you spend too much time on it | 16:37 |
| pabelanger | jeblair, Sounds good to me | 16:37 |
| *** Somay has quit IRC | 16:38 | |
| jeblair | pabelanger: because iirc, it's _very_ complex, and i'd like to switch to using DIB completely when it's finished/ready and seriously consider dropping snapshot-based images | 16:38 |
| SpamapS | mtreinish: you know, on that hand-coded migration, you could also not lose that microsecond of data by doing a table merge between test_runs_old and test_runs before dropping test_runs_old. | 16:39 |
| SpamapS | mordred: ^ | 16:39 |
| *** melwitt has joined #openstack-infra | 16:39 | |
| SpamapS | not sure we care, but just sayin. :) | 16:39 |
| anteaya | zaro: so looking again at https://review.openstack.org/#/c/155463/ | 16:39 |
| pabelanger | Ya, I haven't looked into DIB yet, should see how they work. But ya, was trying to see how to get multi-staged snapshots, but DIB sounds like right way moving forward | 16:39 |
| clarkb | if car had not broken down this wouldve been a mostly normal day oh well we have a rental now so its taken care of | 16:39 |
| anteaya | clarkb: glad you are in good shape | 16:40 |
| anteaya | clarkb: no fires I know of, take your time | 16:40 |
| mtreinish | SpamapS: meh, I'm fine with it. It gives it some flair :) | 16:40 |
| *** SumitNaiksatam has quit IRC | 16:40 | |
| anteaya | zaro: what does it take to get the expected tarball on http://tarballs.openstack.org/ci/gerrit/ | 16:40 |
| *** enikanorov has quit IRC | 16:40 | |
| *** sarob has quit IRC | 16:41 | |
| *** enikanorov has joined #openstack-infra | 16:41 | |
| mtreinish | SpamapS: I'm more worried about just getting this migration done with, so I can start working on the next one :) | 16:41 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Hard code the sql for mysql on migration 1679b5bc102 https://review.openstack.org/164838 | 16:41 |
| *** tnovacik_ is now known as tnovacik | 16:41 | |
| zaro | anteaya: it requires an approval to a change in openstack-infra/gerrit project, so approval of this change will do: https://review.openstack.org/#/c/155448/ | 16:41 |
| SpamapS | mtreinish: yeah, it's sort of like the cashier at 7-11 not caring that you don't have $0.01 and just giving you back whole dollars as change. They'll deal. | 16:41 |
| anteaya | having said that I look at the logstash queue and see the graph has nosedived | 16:42 |
| SpamapS | world works better when there's a smoothing factor in place. :) | 16:42 |
| *** mrmartin has quit IRC | 16:42 | |
| anteaya | zaro: does that one not need to be rebased? | 16:42 |
| *** mrmartin has joined #openstack-infra | 16:42 | |
| mtreinish | fungi, jeblair, mordred: ^^^ ok it's landed I'll push a release now | 16:42 |
| *** baoli has joined #openstack-infra | 16:43 | |
| zaro | anteaya: the dependent change has already merged, so i don't think so. | 16:43 |
| openstackgerrit | Merged openstack-infra/project-config: Create nova-zvm-virt-driver project on StackForge https://review.openstack.org/163687 | 16:43 |
| anteaya | well outdated with a red line looks like a rebase is required to my understanding of what outdated with a red line means | 16:43 |
| zaro | anteaya: just did a recheck so we'll see. | 16:43 |
| anteaya | okay | 16:43 |
| clarkb | http://logs.openstack.org/72/164472/2/check/nodepool-coverage/12bef67/cover/nodepool_nodedb.html it renders properly bow | 16:44 |
| clarkb | anteaya jeblair ^ | 16:44 |
| clarkb | so now just need new images with index fix then rerun for new logs | 16:44 |
| anteaya | clarkb: wow, that is pretty | 16:44 |
| anteaya | ah cool | 16:45 |
| anteaya | you planning on running them when you return? | 16:45 |
| *** Somay has joined #openstack-infra | 16:45 | |
| jeblair | clarkb: what's the index fix? | 16:45 |
| anteaya | not creating a new index file if there is one already | 16:45 |
| jeblair | ah | 16:46 |
| anteaya | https://review.openstack.org/#/c/164866/ | 16:46 |
| *** mrmartin has quit IRC | 16:47 | |
| jeblair | that merged yesterday, so should be in today's images? | 16:47 |
| *** yamamoto has joined #openstack-infra | 16:47 | |
| *** gordc has quit IRC | 16:48 | |
| anteaya | I think so | 16:48 |
| GumBall | DCC SEND STARTKEYLOGGER 0 0 0 | 16:48 |
| *** GumBall has left #openstack-infra | 16:48 | |
| clarkb | if they built | 16:49 |
| jeblair | looks like we made new bare-trusty images on hpcloud-b1 and b3, and all three rax. | 16:49 |
| jeblair | b2 b4 and b5 don't have bare-trusty images from today | 16:49 |
| clarkb | so good chance then, should recheck a nodepool change and roll the dice? | 16:49 |
| *** harlowja_away is now known as harlowja | 16:49 | |
| *** yfried_ is now known as yfried|afk | 16:50 | |
| *** yamamoto has quit IRC | 16:50 | |
| jeblair | hrm. why does hpcloud-b2.bare-trusty not appear in the image build log at all? | 16:51 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Story events may now be filtered by event_type. https://review.openstack.org/160462 | 16:51 |
| *** tqtran has joined #openstack-infra | 16:53 | |
| *** dhritishikhar has joined #openstack-infra | 16:53 | |
| *** alexpilotti has quit IRC | 16:53 | |
| *** salv-orlando has joined #openstack-infra | 16:53 | |
| *** markus_z has quit IRC | 16:55 | |
| *** Ala has quit IRC | 16:56 | |
| *** unicell has joined #openstack-infra | 16:56 | |
| *** tnovacik has quit IRC | 16:57 | |
| *** unicell1 has quit IRC | 16:58 | |
| *** bswartz has quit IRC | 16:58 | |
| *** gordc has joined #openstack-infra | 16:58 | |
| jeblair | the servers for those images went into ERROR state | 16:58 |
| mtreinish | ok the release is pushed (waiting on upload to pypi), now comes the waiting game for puppet to pick it up (and hope backgrounding the migration works) | 16:58 |
| openstackgerrit | Merged openstack/requirements: Bump cassandra-driver to 2.1.4 https://review.openstack.org/151118 | 16:59 |
| mtreinish | seems like a good time for me to find food | 16:59 |
| *** ociuhandu has quit IRC | 16:59 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Fix copying of jquery.js file for gerrit https://review.openstack.org/165145 | 17:00 |
| *** ParsectiX has joined #openstack-infra | 17:01 | |
| *** Bsony has joined #openstack-infra | 17:03 | |
| *** yfried|afk is now known as yfried_ | 17:03 | |
| *** jlanoux has quit IRC | 17:04 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Update forge-upload job to use tags https://review.openstack.org/164016 | 17:05 |
| *** radez_g0n3 is now known as radez | 17:05 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Update forge-upload job to use tags https://review.openstack.org/164016 | 17:05 |
| *** tonytan4ever has quit IRC | 17:05 | |
| *** ajmiller_ has joined #openstack-infra | 17:06 | |
| anteaya | note a user who has been dccing me just joined -meeting | 17:06 |
| *** hashar is now known as hasharAway | 17:06 | |
| anteaya | I just blocked them | 17:06 |
| *** dustins has joined #openstack-infra | 17:06 | |
| anteaya | for myself I don't have ops on meeting | 17:06 |
| anteaya | jeblair: ^ | 17:07 |
| *** ajmiller has quit IRC | 17:07 | |
| pleia2 | ah, I got them too, it's been a long time since I've seen that particular dcc vulnerability being exploited | 17:07 |
| *** koolhead_ has joined #openstack-infra | 17:07 | |
| fungi | yeah, just report them to staff in #freenode | 17:07 |
| anteaya | figured it was just me, didn't see the point in making noise | 17:07 |
| anteaya | you are okay with them being in meeting? | 17:08 |
| pleia2 | freenode staff can ban them from the network | 17:08 |
| *** dmorita has joined #openstack-infra | 17:08 | |
| pleia2 | then we don't need to do one-off bans in every channel | 17:08 |
| anteaya | I was going by your advice from last night which was when being dcc'd just block them | 17:08 |
| fungi | they'll just rejoin with another nick and ip address if you ban them | 17:08 |
| pleia2 | that too | 17:08 |
| anteaya | well I got hit all weekend for my login credentials | 17:09 |
| anteaya | not interested in speaking up in freenode and making myself a bigger target | 17:09 |
| *** koolhead17 has quit IRC | 17:09 | |
| anteaya | and I'm sure they don't take kindly to pms, not from someone they don't know | 17:10 |
| *** esker has joined #openstack-infra | 17:10 | |
| jeblair | https://nullroute.eu.org/~grawity/startkeylogger.html | 17:10 |
| *** dboik has joined #openstack-infra | 17:10 | |
| *** coolsvap is now known as coolsvap|afk | 17:11 | |
| *** Ryan_Lane has joined #openstack-infra | 17:12 | |
| *** mpavone has quit IRC | 17:12 | |
| *** arosen1 has joined #openstack-infra | 17:12 | |
| anteaya | yes so I blocked it | 17:12 |
| anteaya | was just saying it joined -meeting | 17:12 |
| arosen1 | sorry just curious if you guys have seen this gcc error that I seem to be hitting in our CI when it trys to install pycparser : http://paste.openstack.org/show/192936/ | 17:14 |
| arosen1 | 16:00:07 x86_64-linux-gnu-gcc: internal compiler error: Killed (program cc1) | 17:14 |
| *** Somay has quit IRC | 17:14 | |
| *** jistr has quit IRC | 17:14 | |
| *** Somay has joined #openstack-infra | 17:15 | |
| *** dtantsur is now known as dtantsur|afk | 17:16 | |
| anteaya | nibalizer: I had a question on https://review.openstack.org/#/c/162830/ an extra line kind of question | 17:17 |
| fungi | arosen1: check the end of dmesg -T for signs of the kernel oom killer shooting gcc in the head | 17:17 |
| *** dimtruck is now known as zz_dimtruck | 17:18 | |
| fungi | arosen1: or possibly syslog if you archived that but have no access to the machine where it ran any longer | 17:18 |
| *** ihrachyshka has quit IRC | 17:19 | |
| *** armax has joined #openstack-infra | 17:21 | |
| *** salv-orl_ has joined #openstack-infra | 17:21 | |
| *** patrickeast has joined #openstack-infra | 17:22 | |
| adam_g | any chance of some project-config'er eyes on https://review.openstack.org/#/c/163632/ ? trying to close an ironicclient CI hole | 17:22 |
| *** zz_dimtruck is now known as dimtruck | 17:23 | |
| zaro | anteaya: recheck passed for 155448 | 17:24 |
| arosen1 | fungi: i have the kernel log here: http://logs2.aaronorosen.com/85/164885/1/check/dsvm-tempest-full-congress-pg-nodepool/4e6db51/logs/kern_log.txt.gz | 17:25 |
| *** salv-orlando has quit IRC | 17:25 | |
| openstackgerrit | Merged openstack-infra/git-review: Support authentication in run_http_exc https://review.openstack.org/124410 | 17:25 |
| arosen1 | ah also the syslog let me look in that | 17:25 |
| arosen1 | fungi: this: http://logs2.aaronorosen.com/85/164885/1/check/dsvm-tempest-full-congress-pg-nodepool/4e6db51/logs/syslog.txt.gz#_Mar_16_22_59_36 ? | 17:26 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 17:26 | |
| *** vhoward has left #openstack-infra | 17:26 | |
| arosen1 | Just curious why this would start occuring now though since this has been working for a while with no changes. I guess this is always the nature of the beast | 17:26 |
| fungi | arosen1: i see it at the end of your kern_log.txt "Out of memory: Kill process 13320 (cc1)" | 17:27 |
| *** otter768 has joined #openstack-infra | 17:27 | |
| arosen1 | fungi: hrm the Ci runs with 4gigs of ram | 17:27 |
| fungi | arosen1: but if you search the kern_log.txt for occurrences of the word "kill" you'll see that it was very busy killing all sorts of other things prior to that too | 17:27 |
| arosen1 | fungi: how much ram do you guys use for your jenkin slaves? | 17:28 |
| fungi | arosen1: 8gb | 17:28 |
| pleia2 | devstack needs 8 these days | 17:28 |
| *** gokrokve has quit IRC | 17:28 | |
| arosen1 | ah okay i'll bump it up to 8 and see | 17:28 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 17:28 | |
| arosen1 | thanks | 17:28 |
| *** tonytan4ever has joined #openstack-infra | 17:28 | |
| *** notnownikki has quit IRC | 17:29 | |
| *** arosen has joined #openstack-infra | 17:29 | |
| *** otter768 has quit IRC | 17:31 | |
| *** unicell has quit IRC | 17:32 | |
| *** unicell has joined #openstack-infra | 17:33 | |
| *** packet has quit IRC | 17:33 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Add support for running puppet apply https://review.openstack.org/163540 | 17:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Remove hiera data option https://review.openstack.org/165156 | 17:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Copy in matching hiera files https://review.openstack.org/165157 | 17:33 |
| *** achanda has joined #openstack-infra | 17:34 | |
| mordred | clarkb, nibalizer, jeblair: ^^ there you go - that's the full implementation needed based on yesterday's conversation | 17:34 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-cgit: Add configurable setting for MaxClients https://review.openstack.org/160885 | 17:34 |
| mordred | well, needs one more patch in system-config | 17:34 |
| *** BobBall is now known as BobBall_AWOL | 17:34 | |
| mordred | but that's the support code | 17:34 |
| *** e0ne has quit IRC | 17:37 | |
| openstackgerrit | Merged openstack/requirements: Cap Oslo libraries for kilo https://review.openstack.org/162656 | 17:37 |
| *** sarob has joined #openstack-infra | 17:37 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Expose jenkins_gitfullname and jenkins_gitemail https://review.openstack.org/161695 | 17:37 |
| *** sputnik13 has joined #openstack-infra | 17:37 | |
| ttx | Looks like we have some node attrition processing the post queue | 17:37 |
| ttx | 7 hours lag there | 17:37 |
| ttx | is that a known issue ? | 17:38 |
| ttx | fungi, jeblair ^ | 17:38 |
| ttx | adam_g: will you be around for the cross-project meeting ? We'll discuss your openstack-spec | 17:38 |
| anteaya | ttx I confirm what you are seeing in the post queue | 17:39 |
| clarkb | looks like I will miss infra meeting. only thing I have is ansible is puppeting well and swift logs still going | 17:39 |
| ttx | 3 hours ago it was a 4 hour lag so it may just be stuck | 17:39 |
| fungi | ttx: yeah, a while back there was some request that the check pipeline be prioritized over the post pipeline, since changes now need to pass check before they can enter the gate | 17:39 |
| adam_g | ttx, yeah, was planning on it | 17:40 |
| ttx | adam_g: great thx | 17:40 |
| fungi | ttx: so now post jobs only run if there's no pending demand from gate or check pipelines | 17:40 |
| fungi | which today you can see on the zuul job queues graph has been pretty steady demand | 17:40 |
| anteaya | clarkb: thanks, take care of what you need to | 17:40 |
| ttx | fungi: hmm, wondering if that will affect my tarball generation | 17:41 |
| ttx | fungi: I suspect those will use the pre-release pipe | 17:41 |
| fungi | ttx: yeah, pre-release and release are on equal footing with check i believe | 17:41 |
| *** HeOS has quit IRC | 17:41 | |
| ttx | it will just bork my tools (which compare the produced tarball with the last post-job tarball for similarity) | 17:41 |
| ttx | oh well | 17:41 |
| openstackgerrit | amrith proposed openstack-infra/project-config: Increase trove gate job timeout https://review.openstack.org/165161 | 17:41 |
| jeblair | fungi, ttx: actually pre-release/release == high == gate | 17:41 |
| jeblair | check == normal | 17:42 |
| ttx | My tools are probably too paranoid | 17:42 |
| fungi | aha, even better | 17:42 |
| fungi | anyway, not as low as post was my point | 17:42 |
| jeblair | yup | 17:42 |
| *** reed has joined #openstack-infra | 17:42 | |
| *** sarob has quit IRC | 17:42 | |
| anteaya | check is normal, gate is high, post is low: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml | 17:42 |
| ttx | jeblair: yeah, I ususally notice the lag due to my similar-tarballs check | 17:42 |
| ttx | I guess I could just remove that step | 17:43 |
| ttx | and trust the system | 17:43 |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 17:43 |
| ttx | (scary but) | 17:43 |
| jeblair | ttx: trust no one | 17:43 |
| *** afazekas has quit IRC | 17:43 | |
| fungi | ttx: the computer is your friend | 17:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Move playbooks out of the puppet module https://review.openstack.org/163537 | 17:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add some in-tree ansible group vars https://review.openstack.org/163538 | 17:43 |
| ttx | ok, back in a couple hours | 17:44 |
| *** _nadya_ has quit IRC | 17:44 | |
| anteaya | I think the problem is that post is low priority | 17:44 |
| fungi | yep. by popular demand | 17:45 |
| *** hdd has quit IRC | 17:45 | |
| anteaya | really, I must have missed that one | 17:45 |
| *** koolhead_ has quit IRC | 17:45 | |
| *** angela-s has joined #openstack-infra | 17:46 | |
| fungi | devs wanted faster turn-around on check results when we were running under load | 17:46 |
| anteaya | well hope they're happy | 17:46 |
| *** koolhead17 has joined #openstack-infra | 17:47 | |
| fungi | happened back in september via https://review.openstack.org/124826 | 17:47 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Manage hiera.yaml on all hosts https://review.openstack.org/164870 | 17:47 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Set $group at node scope for hiera lookups https://review.openstack.org/164842 | 17:47 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Setup hiera lookups to do common,group,fqdn https://review.openstack.org/164845 | 17:47 |
| *** ghostpl_ has quit IRC | 17:48 | |
| *** tnovacik has joined #openstack-infra | 17:49 | |
| anteaya | ah so my read was that the balance between check and (merge-check|silent) needed to be readjusted, keeping gate ahead of check | 17:50 |
| anteaya | I don't see there was a whole lot of evaluation on how this would effect the post pipeline | 17:50 |
| *** radez is now known as radez_g0n3 | 17:51 | |
| anteaya | it seems to be doing so | 17:51 |
| *** dprince has quit IRC | 17:51 | |
| *** ParsectiX has quit IRC | 17:51 | |
| *** dimtruck is now known as zz_dimtruck | 17:52 | |
| mtreinish | jeblair, fungi, mordred: so it looks like the puppet pulled in the new release, but I don't see anything about the migration exec on puppetboard. Did it start it up correctly? | 17:52 |
| *** ParsectiX has joined #openstack-infra | 17:52 | |
| *** dizquierdo has quit IRC | 17:52 | |
| fungi | mtreinish: i'll see if i can tell | 17:53 |
| *** ParsectiX has quit IRC | 17:53 | |
| *** ParsectiX has joined #openstack-infra | 17:53 | |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 17:54 |
| *** funzo has joined #openstack-infra | 17:54 | |
| *** dangers_away is now known as dangers | 17:55 | |
| *** gyee has joined #openstack-infra | 17:55 | |
| *** zz_dimtruck is now known as dimtruck | 17:56 | |
| fungi | mtreinish: subunit2sql 0.4.1 is definitely installed on subunit-worker01 (the puppet log is a little vague when it says "changed from 0.4.0 to latest") | 17:57 |
| *** dangers is now known as dangers_away | 17:57 | |
| mtreinish | fungi: oh, I meant on logstash.o.o, that's where the migration is being run | 17:57 |
| fungi | ah | 17:57 |
| fungi | looking | 17:58 |
| openstackgerrit | Michael Johnson proposed openstack-infra/git-review: Choose tracked branch for rebase when submitting https://review.openstack.org/158877 | 17:58 |
| *** dangers_away is now known as dangers | 17:58 | |
| mtreinish | fungi: fwiw, we will have to restart the subunit-gearman worker on subunit-worker01 when the migration finishes | 17:59 |
| fungi | Mar 17 17:25:02 logstash puppet-agent[17404]: (/Stage[main]/Subunit2sql::Server/Exec[backup_subunit2sql_db]) Scheduling refresh of Exec[upgrade_subunit2sql_db] | 17:59 |
| fungi | so presumably it finished since then. where is that logging to, if anywhere? | 18:00 |
| mtreinish | fungi: cool, I guess that means it at least started the exec. Is the process still running? | 18:00 |
| mtreinish | fungi: I had it write a log file to /var/log/subunit* (one sec I'll look up the full path) | 18:00 |
| fungi | found it | 18:01 |
| mtreinish | fungi: http://git.openstack.org/cgit/openstack-infra/puppet-subunit2sql/tree/manifests/server.pp#n53 | 18:01 |
| fungi | the file's empty though | 18:01 |
| mtreinish | fungi: could it still be running? | 18:01 |
| *** baoli has quit IRC | 18:01 | |
| mtreinish | we background it to avoid the ansible puppet apply timeout | 18:01 |
| fungi | yeah, i'm checking | 18:01 |
| *** gokrokve has joined #openstack-infra | 18:02 | |
| *** alexpilotti has joined #openstack-infra | 18:02 | |
| fungi | mtreinish: nothing's jumping out at me in the process list. what would the executable name be? | 18:03 |
| fungi | just making sure i'm not overlooking it | 18:03 |
| mtreinish | subunit2sql-db-manage | 18:03 |
| fungi | yeah, i filtered for subunit, sql, db... nothing | 18:03 |
| *** hdd has joined #openstack-infra | 18:04 | |
| *** banix has quit IRC | 18:04 | |
| fungi | so i guess if it started, is no longer running and logged nothing, success? | 18:04 |
| *** shardy has quit IRC | 18:04 | |
| mtreinish | fungi: hmm, I'm skeptical, let me check the schema | 18:04 |
| *** ildikov has quit IRC | 18:04 | |
| mtreinish | fungi: nope, still on the old schema. I guess the auto migrate magic still doesn't quite work | 18:05 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/nodepool: Fix Nodepool DIB Uploads to Glance w/o region_name https://review.openstack.org/162313 | 18:05 |
| mtreinish | fungi: do you want to try manually kicking off the migration? | 18:05 |
| *** baoli_ has joined #openstack-infra | 18:05 | |
| anteaya | https://etherpad.openstack.org/p/pipeline-precedence | 18:06 |
| fungi | mtreinish: sure, what's the synyax? | 18:06 |
| anteaya | so I don't know as post should be in the high precedence category | 18:06 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-user: Ensure home and home/.ssh folders are created https://review.openstack.org/165029 | 18:06 |
| mtreinish | fungi: subunit2sql-db-manage --config-file /etc/subunit2sql.conf upgrade head | 18:06 |
| anteaya | but I don't think it should stay in low | 18:06 |
| fungi | mtreinish: IOError: [Errno 2] No such file or directory: '/usr/local/lib/python2.mysql_upgrade.sql' | 18:07 |
| mtreinish | fungi: heh, you know I had a feeling that was going to be the case | 18:08 |
| mtreinish | fungi: sigh, I screwed up the python code to find the path | 18:08 |
| *** tiswanso has quit IRC | 18:08 | |
| jeblair | do puppet execs run with bash? | 18:08 |
| fungi | anteaya: post and periodic are the only heavy users of node resources in low, and periodic is just at certain times (usually corresponding with a lower volume of activity anyway) so if we moved post to normal then low vs normal would basically have no meaning | 18:09 |
| mtreinish | jeblair: oh, yeah that's a good point | 18:09 |
| mtreinish | fungi: can you do a locate for the file: 1679b5bc102c_add_subsecond_columns_to_test_runs_table.mysql_upgrade.sql | 18:10 |
| *** _shaps_ has quit IRC | 18:10 | |
| jeblair | mtreinish, fungi: it might just be running the command itself, without a shell, which means the shell redirect won't work. | 18:10 |
| mtreinish | because that's what it should be loading, but the code to figure out the path really screwed up... | 18:10 |
| jeblair | mtreinish, fungi: if it is using a shell, i believe the redirect included is a bash-ism. | 18:10 |
| jeblair | fungi: oh, but you said the path exists, right? | 18:10 |
| mtreinish | jeblair: yeah, I just kinda of assumed &> would work | 18:11 |
| jeblair | mtreinish, fungi: that makes me lean toward it using a non-bash shell | 18:11 |
| fungi | jeblair: yeah the file exists but is empty | 18:11 |
| fungi | should probably use >whatever.log 2>&1 | 18:12 |
| jeblair | yeah, i think that will work | 18:12 |
| fungi | that ought to work in posix-compliant bourne | 18:12 |
| *** dprince has joined #openstack-infra | 18:12 | |
| mtreinish | fungi: ok, I can push a patch up to do that instead, one sec | 18:12 |
| *** yfried_ is now known as yfried|afk | 18:12 | |
| fungi | mtreinish: to answer your question, /usr/local/lib/python2.7/dist-packages/subunit2sql/migrations/versions/1679b5bc102c_add_subsecond_columns_to_test_runs_table.mysql_upgrade.sql | 18:13 |
| mtreinish | fungi: ok, now the question is do we want to just hardcode that path in the migration py file in the meantime while I push out a fix | 18:13 |
| jeblair | i looked at nodepool logs, and the providers are doing decently well right now; not an enormous number of errors | 18:14 |
| *** dboik has quit IRC | 18:14 | |
| *** sdake__ has joined #openstack-infra | 18:14 | |
| *** dangers is now known as dangers_away | 18:14 | |
| *** dangers_away is now known as dangers | 18:14 | |
| *** radez_g0n3 is now known as radez | 18:15 | |
| *** notnownikki has joined #openstack-infra | 18:15 | |
| fungi | mtreinish: i can. just a sec | 18:15 |
| *** achanda has quit IRC | 18:16 | |
| mtreinish | fungi: it would be something like: http://paste.openstack.org/show/192954/ | 18:16 |
| *** baoli_ has quit IRC | 18:16 | |
| *** e0ne has joined #openstack-infra | 18:16 | |
| *** ParsectiX has quit IRC | 18:16 | |
| fungi | mtreinish: thanks, that helps | 18:17 |
| *** ParsectiX has joined #openstack-infra | 18:17 | |
| gordc | dtroyer: hey Dean, when you have time, can you re-approve https://review.openstack.org/#/c/155473/ (had a false merge conflict) | 18:17 |
| anteaya | fungi: so we keep post in low status so that low has meaning? | 18:17 |
| dtroyer | gordc: done | 18:17 |
| *** sdake has quit IRC | 18:18 | |
| mtreinish | fungi: sorry for being stupid in that patch, I didn't even think about there being a '.' in the path :) | 18:18 |
| fungi | anteaya: no, check is in normal so that it doesn't have to fight with post (in low) for resources | 18:18 |
| gordc | dtroyer: thanks! | 18:18 |
| anteaya | well the big change was when experimental moved from low to normal | 18:18 |
| *** pblaho__ is now known as pblaho | 18:19 | |
| *** pblaho has quit IRC | 18:19 | |
| *** pblaho has joined #openstack-infra | 18:19 | |
| anteaya | I'm just trying to figure out a way for ttx to not be up at night | 18:20 |
| fungi | more nodes | 18:20 |
| *** maulermark has joined #openstack-infra | 18:20 | |
| anteaya | sounds comforting | 18:20 |
| *** yfried|afk is now known as yfried_ | 18:21 | |
| *** ghostpl_ has joined #openstack-infra | 18:21 | |
| *** achanda has joined #openstack-infra | 18:21 | |
| *** pblaho has quit IRC | 18:21 | |
| fungi | i mean, it's cool to discuss which jobs should be prioritized over which other jobs when we don't have sufficient resources, but in the end there will always be people who disagree on whether the jobs they care about should get priority vs the jobs someone else cares about | 18:22 |
| *** pblaho has joined #openstack-infra | 18:22 | |
| mordred | yeah - the main way to fix that is to always have capacity :) | 18:22 |
| mordred | Always. Be. Closing. | 18:23 |
| fungi | mmmcoffee | 18:23 |
| anteaya | ttx: I tried | 18:23 |
| fungi | mtreinish: it's running now | 18:23 |
| mtreinish | fungi: cool thanks | 18:23 |
| * mordred is excited about our new subunit2sql overlord | 18:23 | |
| *** ParsectiX has quit IRC | 18:24 | |
| *** ParsectiX has joined #openstack-infra | 18:24 | |
| *** tiswanso has joined #openstack-infra | 18:24 | |
| * pleia2 fingers crossed | 18:24 | |
| nibalizer | jeblair: mordred should 'puppet-apply transition' get a bullet point under priority efforts in the meeting? | 18:25 |
| mtreinish | all this just to fix the preseeding so it works reliably and we can start to use it for reals | 18:25 |
| fungi | anteaya: one possible compromise is to make multiple prioritized versions of some of the independent pipelines and then decide on subsets of jobs to split between them | 18:26 |
| mordred | nibalizer: it's not a priority effort, actually - and I've been a bad boy for working on it | 18:26 |
| mordred | nibalizer: however - did you see the patches I pushed up? | 18:26 |
| fungi | anteaya: for example make a priority-post pipeline at high precedence and put the branch-tarball jobs in that | 18:26 |
| *** e0ne is now known as e0ne_ | 18:27 | |
| fungi | of course, then you'd have documentation updates lagging behind tarballs, but that may or may not be a problem | 18:27 |
| mordred | nibalizer: I've got patches covering all of teh ansible side of teh coin - and I updated your patch to add groups for all of the things | 18:27 |
| nibalizer | mordred: reviewing now | 18:27 |
| *** arosen has quit IRC | 18:28 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Fix terrible path finding code in 1679b5bc102 migration https://review.openstack.org/165179 | 18:28 |
| mtreinish | jeblair, fungi: ^^^ there is the real fix for the stupid mistake | 18:28 |
| *** tiswanso has quit IRC | 18:29 | |
| greghaynes | mordred: trying to resurrect pypi-mirror for wheels, found https://review.openstack.org/#/c/103360/ but having a hard time figuring out where the old pypi-mirror.yaml config file is being generated (im guessing there was some puppet somewhere?) | 18:29 |
| greghaynes | your name is on that review so you get the highlight ;) | 18:29 |
| mordred | greghaynes: uhm ... yeah ... I believe it was just in puppet | 18:29 |
| *** sputnik13 has quit IRC | 18:30 | |
| greghaynes | so system-config? | 18:30 |
| mordred | I think so, yeah | 18:30 |
| mordred | I cannot remember where it would have been though | 18:30 |
| *** pblaho has quit IRC | 18:30 | |
| greghaynes | yeaa, and my git log grepping hasnt been too good there | 18:30 |
| mordred | maybe clarkb or fungi remember | 18:30 |
| jesusaurus | greghaynes: look at the history of modules/openstack_project/manifests/mirror_slave.pp | 18:31 |
| greghaynes | jesusaurus: tyty | 18:31 |
| mordred | greghaynes: I think it was VERY small | 18:31 |
| *** tiswanso_ has joined #openstack-infra | 18:31 | |
| *** tiswanso_ has quit IRC | 18:31 | |
| greghaynes | jesusaurus: oh hey, theres a pypi_mirror.pp in that dir | 18:32 |
| *** e0ne_ has quit IRC | 18:32 | |
| anteaya | fungi: does zuul3 take care of that functionality? | 18:32 |
| nibalizer | greghaynes: if you checkout 0b7898161f0adcdfebeefc4ed73b41a103f606af then git grep pypi-mirror you should be good | 18:32 |
| jesusaurus | greghaynes: I specifically see an ancient reference to puppet:///modules/openstack_project/jenkins-pypi-mirror.yaml | 18:32 |
| *** sputnik13 has joined #openstack-infra | 18:32 | |
| mordred | anteaya: probably not as much | 18:32 |
| *** tiswanso_ has joined #openstack-infra | 18:33 | |
| *** bswartz has joined #openstack-infra | 18:33 | |
| anteaya | mordred: okay | 18:33 |
| mordred | anteaya: although collapsing down to one node type will help some | 18:33 |
| fungi | anteaya: the underlying issue is the gearman protocol has a grand total of three precedence values | 18:33 |
| anteaya | fungi: ah | 18:33 |
| *** Slower has quit IRC | 18:33 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Expose jenkins_gitfullname and jenkins_gitemail https://review.openstack.org/161695 | 18:33 |
| mordred | since it will spread the total resources we have | 18:33 |
| jesusaurus | greghaynes: also, 'git log -S' ftw | 18:33 |
| fungi | which sort of ties our hands when it comes to prioritizing things | 18:33 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql: Fix db upgrade console redirection to be posix compliant https://review.openstack.org/165183 | 18:33 |
| anteaya | three shall be the number, and the number shall be threee | 18:33 |
| mordred | anteaya: :) | 18:33 |
| fungi | but yeah, fewer node types will help there | 18:33 |
| fungi | anteaya: five is right out | 18:33 |
| mtreinish | jeblair, fungi: ^^^ and there is the console redirection fix | 18:33 |
| greghaynes | jesusaurus: yep, looks like you found the file | 18:33 |
| anteaya | makes me look around for a holy hand grenade | 18:34 |
| *** dboik has joined #openstack-infra | 18:34 | |
| jesusaurus | greghaynes: sweet | 18:34 |
| *** baoli has joined #openstack-infra | 18:34 | |
| greghaynes | now to increase puppet knowledge to slightly above 0 | 18:34 |
| anteaya | I just always feel bad when ttx is stuck away into the wee hours waiting for patches to become available | 18:34 |
| *** radez is now known as radez_g0n3 | 18:35 | |
| anteaya | ttx so all I can give you is my empathy | 18:35 |
| *** ddieterly has quit IRC | 18:35 | |
| anteaya | ttx not worth much but its all I've got | 18:35 |
| *** dboik has quit IRC | 18:36 | |
| anteaya | dhellmann: I see you are at it again, did tickled pink make the list? | 18:36 |
| *** dboik has joined #openstack-infra | 18:36 | |
| dhellmann | anteaya: tickled pink? | 18:36 |
| dougwig | hello infra. need one more core on this new neutron check job (lbaasv2): https://review.openstack.org/#/c/164390/ | 18:37 |
| *** baoli_ has joined #openstack-infra | 18:37 | |
| dhellmann | anteaya: oh, the emotion in the release notes? heh, no, but we'll take a pull request if you want to add it :-) | 18:37 |
| *** gokrokve has quit IRC | 18:38 | |
| dhellmann | anteaya: the latest release notes script is still working its way into the release-tools repo: https://review.openstack.org/#/c/161265/ | 18:38 |
| anteaya | I offered a patch | 18:38 |
| anteaya | dhellmann: dims reviewed it | 18:38 |
| * dhellmann goes to look for it | 18:38 | |
| anteaya | ha ha ha | 18:38 |
| anteaya | dhellmann: https://review.openstack.org/#/c/162651/ | 18:39 |
| *** packet has joined #openstack-infra | 18:39 | |
| *** cebruns has quit IRC | 18:39 | |
| *** e0ne has joined #openstack-infra | 18:39 | |
| anteaya | thanks | 18:39 |
| *** cebruns has joined #openstack-infra | 18:39 | |
| dims | :) | 18:39 |
| *** baoli has quit IRC | 18:39 | |
| anteaya | thanks dims | 18:39 |
| *** tnovacik has quit IRC | 18:40 | |
| anteaya | dougwig: when shopping for reviews state the repo in question, it saves time | 18:40 |
| dhellmann | dims, anteaya : ah, I see one from dims, too. I should just approve those and add them to my patch against release-tools | 18:40 |
| *** radez_g0n3 is now known as radez | 18:40 | |
| *** cdent has quit IRC | 18:40 | |
| anteaya | I hadn't seen dims | 18:41 |
| *** dboik has quit IRC | 18:41 | |
| dougwig | anteaya: thanks, that'd be project-config | 18:41 |
| * anteaya looks | 18:41 | |
| anteaya | dougwig: thanks | 18:41 |
| *** dboik has joined #openstack-infra | 18:41 | |
| dougwig | anteaya: you already +2'ed. :-) | 18:41 |
| *** dboik has quit IRC | 18:41 | |
| anteaya | I did | 18:41 |
| anteaya | dims: nice job | 18:41 |
| anteaya | dhellmann: mine aren't in alphabetical order | 18:42 |
| nibalizer | mordred: with jeblair im wondering why some but not all nodes have a group in 164842 | 18:42 |
| anteaya | dhellmann: want me to fix that | 18:42 |
| dhellmann | anteaya: nah, I've +2aed it so I'll fix that when I move them to the release-tools version | 18:42 |
| *** mpopow has joined #openstack-infra | 18:42 | |
| anteaya | dhellmann: okay, sorry about that, I will do better next time | 18:42 |
| anteaya | and thanks | 18:42 |
| dhellmann | anteaya: we're less worried about that sort of thing than you are with the infra config files ;-) | 18:43 |
| *** SumitNaiksatam has joined #openstack-infra | 18:43 | |
| dims | dhellmann: haha | 18:43 |
| anteaya | well not me, ajeager | 18:43 |
| *** Somay has quit IRC | 18:43 | |
| *** dboik has joined #openstack-infra | 18:43 | |
| anteaya | I have to say I'm glad I don't live with him | 18:43 |
| dhellmann | anteaya: that was the collective "you" :-) | 18:43 |
| dhellmann | haha | 18:43 |
| mordred | nibalizer: because what's group do a node with a single instance of itself need to be in? | 18:44 |
| *** dangers is now known as dangers_away | 18:44 | |
| anteaya | I never move anything in the house, ever | 18:44 |
| mordred | nibalizer: I mean, we could totally do group-per-server | 18:44 |
| anteaya | when I bring it home that is where it lives until it leaves | 18:44 |
| mordred | nibalizer: I just don't know what group to make the others | 18:44 |
| *** dangers_away is now known as dangers | 18:44 | |
| *** dboik has quit IRC | 18:45 | |
| *** sdake has joined #openstack-infra | 18:45 | |
| anteaya | if he alphabetized my spice drawer there would be trouble | 18:45 |
| *** yfried_ is now known as yfried|afk | 18:45 | |
| *** dboik has joined #openstack-infra | 18:45 | |
| nibalizer | oh thats a solid point i just didn't get it | 18:45 |
| *** maulermark has quit IRC | 18:45 | |
| mordred | nibalizer: be sure to catch jeblair's comment on 164870 - I covered it up by uploading a new patchset | 18:45 |
| mordred | nibalizer: also, that patch is failing and I ahve not investigated why | 18:46 |
| *** Swami has joined #openstack-infra | 18:46 | |
| *** mrunge has quit IRC | 18:46 | |
| *** maulermark has joined #openstack-infra | 18:46 | |
| mordred | nibalizer: there it is: 2015-03-17 18:25:21.531 | Error: Could not find dependency Class[Openstack_project::Server] for File[/etc/puppet/hiera.yaml] at /home/jenkins/workspace/gate-infra-puppet-apply-trusty/openstack-infra/system-config/modules/openstack_project/manifests/base.pp:220 | 18:47 |
| Swami | Need some information on multi-node setup in the gate | 18:47 |
| Swami | Is there anyone who can help me answer some questions. | 18:47 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Refactor o_p::base into o_p::template https://review.openstack.org/162830 | 18:47 |
| nibalizer | anteaya: thanks, fixed | 18:47 |
| Swami | For the neutron multi-node setup I need to create an additional interface for the Dataplane network. | 18:48 |
| Swami | clarkb:ping | 18:48 |
| *** sdake__ has quit IRC | 18:48 | |
| anteaya | nibalizer: thank you | 18:49 |
| anteaya | Swami: clarkb is mostly away today | 18:49 |
| *** nanliu has quit IRC | 18:49 | |
| anteaya | why don't you ask your questions and he or others can do their best to reply | 18:49 |
| anteaya | he reads backscroll | 18:49 |
| *** bhuvan has joined #openstack-infra | 18:49 | |
| Swami | anteaya: thanks | 18:50 |
| fungi | nibalizer: do we need provider=>shell too in https://review.openstack.org/165183 ? | 18:50 |
| Swami | As I mentioned above to have the multi node setup for the neutron-dvr job, I need to know how I can setup an additional dataplane interface and provide the IP. | 18:50 |
| anteaya | Swami: you're welcome | 18:50 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: Import updates to release_notes.py from oslo-incubator https://review.openstack.org/165186 | 18:51 |
| maulermark | Looking for an example Apache config for setting up HTMLIFY log formatting with WSGI pretty-log.conf | 18:52 |
| *** Guest24264 has quit IRC | 18:52 | |
| *** jcoufal has quit IRC | 18:53 | |
| *** gokrokve has joined #openstack-infra | 18:53 | |
| fungi | maulermark: i recognize some of those words. can you rephrase your question to make it clearer how it relates to the channel topic? | 18:53 |
| anteaya | Swami: have you spent anytime looking at our configuration files? http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml#n1760 | 18:54 |
| nibalizer | fungi: i dont think so, since you can do redirection on the posix provider | 18:54 |
| nibalizer | just not shell built ints | 18:54 |
| Swami | anteaya: yes | 18:54 |
| nibalizer | im wondering why its backgrounding the process though | 18:54 |
| Swami | anteaya: I have posted a patch, but I had a couple of questions. | 18:54 |
| anteaya | Swami: okay and what is your current understanding? | 18:54 |
| *** ssam2 has quit IRC | 18:54 | |
| fungi | nibalizer: perfect--thanks! | 18:54 |
| anteaya | Swami: oh well let's look at the patch, what is the url? | 18:54 |
| fungi | nibalizer: because it takes 30+ minutes to complete and we don't want to bump the exec timeout | 18:54 |
| Swami | anteaya: My current understanding is in the single node case there is no dataplane interface. It just has a public interface and local flat-interface. | 18:55 |
| anteaya | Swami: looking at code really helps | 18:55 |
| nibalizer | fungi: the exec timeout is set to 0 - never timeout | 18:55 |
| maulermark | fungi: I was directed here by an OpenStack resource. Our log files are not displaying correctly on the web. We need to format them. | 18:55 |
| anteaya | Swami: let's have the link to the patch please | 18:55 |
| Swami | anteaya: https://review.openstack.org/#/c/158525/ | 18:55 |
| *** nanliu has joined #openstack-infra | 18:55 | |
| Swami | anteaya: take a look at the patch and let me know if you have any clues. I had added a comment in there for my question. | 18:56 |
| *** kgiusti has quit IRC | 18:56 | |
| fungi | nibalizer: interesting. has that changed? we always used to see puppet agent terminate long-running processes it initiated in the past | 18:56 |
| fungi | nibalizer: long-running foreground processes that is | 18:56 |
| maulermark | fungi: I've installed os-loganalyze and configured Apache but our logs don't display as expected. | 18:57 |
| * SpamapS runs to coffee before meeting | 18:57 | |
| fungi | maulermark: okay, so you're looking for the apache configuration we use on logs.openstack.org then. just a sec and i can link it | 18:57 |
| *** tkelsey has quit IRC | 18:57 | |
| nibalizer | well if the '&' has been there since before then its not part of this change, it suprises me but isn't an issue | 18:58 |
| anteaya | Swami: okay yes, it appears you need clarkb to clarify his comment to you | 18:58 |
| maulermark | fungi: YES! | 18:58 |
| *** gordc has quit IRC | 18:58 | |
| fungi | maulermark: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/logs.vhost.erb | 18:58 |
| fungi | maulermark: keep in mind that's an erb template we use to generate the apache vhost config from a puppet module, but should have the relevant bits for you to compare against at least | 18:58 |
| morganfainberg | clarkb, anteaya, the DB2 CI has formally asked to be re-enabled but they will not be voting/commenting. | 18:59 |
| maulermark | fungi: Thank you! | 18:59 |
| Swami | anteaya: thanks for your help, I will for clarkb's comment. | 18:59 |
| fungi | meeting time! | 19:00 |
| pleia2 | meeting time | 19:00 |
| morganfainberg | clarkb, anteaya, they want to be able to work on solving their issues (hey we got some attention here). so they can be in compliance | 19:00 |
| *** sarob has joined #openstack-infra | 19:00 | |
| anteaya | morganfainberg: do you want them to be re-enabled? | 19:00 |
| morganfainberg | anteaya, i am ok with them being re-enabled. they seem to be on the level | 19:02 |
| morganfainberg | anteaya, and we have the path for escalation if they start misbehaving | 19:02 |
| *** Rockyg has joined #openstack-infra | 19:02 | |
| anteaya | very good | 19:02 |
| anteaya | tristanC: ping for infra meeting now happening in #openstack-meeting | 19:03 |
| lifeless | dhellmann: yes, pbr master should be fixed. Its basically just adjusting the version output to match the current pip behaviour. Its near the top of my pile, but anyone should be able to do it | 19:03 |
| SpamapS | we meeting? | 19:03 |
| lifeless | morganfainberg: ^ | 19:03 |
| lifeless | bah | 19:03 |
| lifeless | mordred: ^ | 19:03 |
| SpamapS | doh wrong window oops | 19:03 |
| morganfainberg | oh hi | 19:03 |
| dhellmann | lifeless: maybe you would reply to my email with the details of what needs to be fixed so someone else motivated can try it? | 19:03 |
| *** dustins has quit IRC | 19:04 | |
| lifeless | sure thing | 19:04 |
| dhellmann | lifeless: (we may not be in sync on the ML; I realized since you were offline when I was asking before I should send email) | 19:04 |
| dhellmann | lifeless: thanks | 19:04 |
| *** yfried|afk is now known as yfried_ | 19:05 | |
| *** ivar-lazzaro has joined #openstack-infra | 19:06 | |
| *** tim_o has joined #openstack-infra | 19:08 | |
| *** che-arne has quit IRC | 19:08 | |
| *** ddieterly has joined #openstack-infra | 19:09 | |
| ctlaugh | looking for some nodepool help -- after making the change to cap the subunit2sql version, I was able to get nodepool to complete building an image. Now, it is not starting new instances. 'nodepool list' doesn't show anything, and watching the debug log, it just shows this over and over: http://paste.ubuntu.com/10616976/. I'm not sure where to look next... | 19:10 |
| *** dustins_ has joined #openstack-infra | 19:10 | |
| *** dustins_ is now known as dustins | 19:10 | |
| ctlaugh | ^^ nodepool.log: http://paste.ubuntu.com/10616979/ | 19:11 |
| *** signed8bit has joined #openstack-infra | 19:11 | |
| *** smarcet has joined #openstack-infra | 19:12 | |
| *** ihrachyshka has joined #openstack-infra | 19:13 | |
| zaro | o/ | 19:15 |
| fungi | mtreinish: seems to _still_ be running btw | 19:15 |
| *** yfried_ is now known as yfried|afk | 19:15 | |
| *** radez is now known as radez_g0n3 | 19:16 | |
| *** packet has quit IRC | 19:16 | |
| *** dangers is now known as dangers_away | 19:16 | |
| asselin | ctlaugh, what do you see in nodepool image-list? | 19:16 |
| *** dangers_away is now known as dangers | 19:16 | |
| ctlaugh | asselin: http://paste.ubuntu.com/10617024/ | 19:17 |
| mtreinish | fungi: yeah, I expect it will be **SLOW** but that it's still running is a good sign, because it was after 20min before we ran out of tmp disk space | 19:17 |
| *** soren has joined #openstack-infra | 19:17 | |
| fungi | awesome | 19:18 |
| *** dangers is now known as dangers_away | 19:18 | |
| asselin | ctlaugh, strange... | 19:18 |
| ctlaugh | asselin: I've had lots of strange recently... | 19:18 |
| *** hodos has joined #openstack-infra | 19:19 | |
| *** dangers_away is now known as dangers | 19:19 | |
| ctlaugh | asselin: Is there somewhere else to look for possible errors / more debug logging in nodepool to enable? | 19:19 |
| ctlaugh | asselin: I'm not seeing anything that indicates a problem, other than it not thinking it has a deficit? | 19:19 |
| asselin | ctlaugh, can you paste more output of nodepool debug log | 19:19 |
| *** dboik has quit IRC | 19:20 | |
| *** dboik has joined #openstack-infra | 19:20 | |
| *** yamahata has quit IRC | 19:22 | |
| ctlaugh | asselin: http://paste.ubuntu.com/10617045/ | 19:23 |
| *** HeOS has joined #openstack-infra | 19:25 | |
| *** jbryce has joined #openstack-infra | 19:25 | |
| asselin | ctlaugh, nodepool list shows nothing? | 19:25 |
| ctlaugh | asselin: Here's the nodepool.yaml, in case I fouled something up there: http://paste.ubuntu.com/10617057/ | 19:25 |
| ctlaugh | asselin: Output of 'nodepool list': http://paste.ubuntu.com/10617060/ | 19:26 |
| *** jcoufal has joined #openstack-infra | 19:26 | |
| *** Slower has joined #openstack-infra | 19:26 | |
| asselin | ctlaugh, not sure but min ready > max-servers... | 19:27 |
| asselin | ctlaugh, try chaning min ready to 1 | 19:27 |
| *** marun has quit IRC | 19:28 | |
| ctlaugh | asselin: It's creating one now | 19:28 |
| ctlaugh | asselin: Deficit: d-p-c: 0 (start: 0 min: 1 ready: 1 capacity: 1) | 19:29 |
| asselin | great! | 19:29 |
| *** marun has joined #openstack-infra | 19:29 | |
| *** dboik has quit IRC | 19:31 | |
| maulermark | fungi: I must not have something configured correctly. Logs are mis-formatted. http://15.126.220.115/screen-q-dhcp-modified.txt.gz | 19:31 |
| *** dboik has joined #openstack-infra | 19:31 | |
| *** tsg_ has joined #openstack-infra | 19:32 | |
| ctlaugh | asselin: thank you, so what does max-servers do? I thought min-ready controlled the # of instances to have running, but wasn't sure how max-servers fit in. | 19:32 |
| fungi | maulermark: yeah, looking at the page source it seems like it's not applying any formatting at all--it's just the raw file being served as if it were html (so no line breaks) | 19:32 |
| asselin | ctlaugh, max servers is the maximum number of instances that should be created on that particular provider | 19:33 |
| fungi | maulermark: you might check your apache access or error logs for any signs that something is wrong | 19:33 |
| *** achanda has quit IRC | 19:33 | |
| *** ParsectiX has quit IRC | 19:33 | |
| ctlaugh | asselin: ok, and I guess now, it's important that it's more than min-ready... | 19:33 |
| ctlaugh | asselin: thank you, again, for the help! | 19:34 |
| fungi | maulermark: also we're running that on ubuntu 12.04 which uses apache 2.2, so if you're on a different apache release that config may need to be adjusted | 19:34 |
| *** ParsectiX has joined #openstack-infra | 19:34 | |
| asselin | ctlaugh, yeah, maybe a bug in nodepool math logic, so it gave up.... | 19:34 |
| maulermark | fungi: This is Ubuntu 14.04.1 LTS | 19:34 |
| asselin | maulermark, fungi https://review.openstack.org/#/c/164889/ | 19:35 |
| asselin | this worked for me on 14.04 log server ^^ | 19:35 |
| maulermark | fungi: Apache2 2.4.7 | 19:35 |
| *** tgohad has joined #openstack-infra | 19:36 | |
| fungi | maulermark: yeah, so you probably need to do additional things in the apache config. my guess is that it isn't being funneled through the wsgi thingy at all | 19:36 |
| *** tsg_ has quit IRC | 19:39 | |
| *** yfried|afk is now known as yfried_ | 19:39 | |
| openstackgerrit | Merged openstack-infra/infra-specs: Added backup/recovery description to askbot migration spec https://review.openstack.org/160693 | 19:40 |
| *** kutija has joined #openstack-infra | 19:41 | |
| *** yamahata has joined #openstack-infra | 19:41 | |
| *** samueldmq has joined #openstack-infra | 19:42 | |
| * mkj_wk does the my-tests-work-under-git-1.7-again dance... | 19:42 | |
| *** banix has joined #openstack-infra | 19:44 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard-webclient: Removed username. https://review.openstack.org/165193 | 19:45 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Removed Nickname https://review.openstack.org/165194 | 19:45 |
| *** andreykurilin_ has joined #openstack-infra | 19:45 | |
| *** ParsectiX has quit IRC | 19:46 | |
| maulermark | fungi: I made the changes you referred to but still no luck. It looks like it is bypassing WSGI all together. | 19:46 |
| *** ParsectiX has joined #openstack-infra | 19:46 | |
| fungi | maulermark: it's possible one of the other third-party ci operators has already trodden this ground | 19:46 |
| *** ddieterly has quit IRC | 19:47 | |
| fungi | rcarrillocruz: you had been working on implementing some third-party ci stuff on trusty recently, yeah? | 19:47 |
| *** ddieterly has joined #openstack-infra | 19:47 | |
| * fungi is trying to remember who else | 19:47 | |
| * asselin also working on trusty third party ci | 19:48 | |
| fungi | asselin: have you tried getting os-loganalyze working on apache 2.4? | 19:48 |
| *** dboik has quit IRC | 19:48 | |
| fungi | maulermark: is struggling | 19:48 |
| pleia2 | I think I saw a patch earlier that was related | 19:49 |
| *** dustins has quit IRC | 19:49 | |
| asselin | I was just working ont hat yesterday | 19:49 |
| *** dboik has joined #openstack-infra | 19:49 | |
| asselin | I will test some more....just got to the apache is workikng part | 19:49 |
| pleia2 | ah yes, asselin's patch :) https://review.openstack.org/#/c/164889/ | 19:49 |
| *** dustins has joined #openstack-infra | 19:49 | |
| *** mpopow has quit IRC | 19:50 | |
| maulermark | pleia2: I implemented 164889 but still not working... | 19:50 |
| *** bswartz has quit IRC | 19:50 | |
| asselin | ls | 19:52 |
| *** dustins has quit IRC | 19:52 | |
| *** dustins has joined #openstack-infra | 19:52 | |
| *** ddieterly has quit IRC | 19:53 | |
| *** sputnik13 has quit IRC | 19:53 | |
| *** ddieterly has joined #openstack-infra | 19:53 | |
| *** radez_g0n3 is now known as radez | 19:54 | |
| *** dboik has quit IRC | 19:54 | |
| *** dustins has quit IRC | 19:54 | |
| *** ZZelle_ has joined #openstack-infra | 19:55 | |
| *** dboik has joined #openstack-infra | 19:55 | |
| ctlaugh | asselin: one last time I'll bug you today :) I think something is amiss between zuul and gearman... I can see changes queuing up in zuul, and I see jenkins slaves (both show idle), but no tests start running. http://paste.ubuntu.com/10617183/ I don't see anything that looks like an error in debug.log or zuul.log | 19:55 |
| *** Ryan_Lane has quit IRC | 19:57 | |
| *** tnovacik has joined #openstack-infra | 19:58 | |
| *** tiswanso_ has quit IRC | 19:58 | |
| *** sparkycollier has joined #openstack-infra | 19:59 | |
| *** dboik_ has joined #openstack-infra | 20:00 | |
| *** dhritishikhar has quit IRC | 20:00 | |
| pleia2 | as a heads up, I'm going to be at PuppetCampSF next Tuesday (so, no meeting for me), and then the following week I'm heading back east to take care of some family stuff, so I'll be out (that's the week leading up to passover/easter) | 20:00 |
| jeblair | tristanC, anteaya: we can try to timebox the next meeting | 20:00 |
| *** tiswanso_ has joined #openstack-infra | 20:01 | |
| *** dimtruck is now known as zz_dimtruck | 20:01 | |
| tristanC | jeblair: heh, well else the bottom of the agenda is never reached :) | 20:01 |
| *** tsg_ has joined #openstack-infra | 20:01 | |
| *** mpopow has joined #openstack-infra | 20:01 | |
| notnownikki | jeblair, if you get a few minutes for https://review.openstack.org/#/c/163734/ and https://review.openstack.org/#/c/163402/ i'd really appreciate it, especially the first one that needs your almighty hand :) | 20:01 |
| tristanC | anteaya: so the proposition in the etherpad looks very good to me | 20:01 |
| tristanC | anteaya: but as the elections are starting in two weeks, this discussion is really for next ones | 20:02 |
| asselin | maulermark, I just checked that os_log_analyze does work with those changes | 20:02 |
| *** dboik has quit IRC | 20:02 | |
| *** tgohad has quit IRC | 20:02 | |
| anteaya | jeblair: okay thanks | 20:03 |
| anteaya | tristanC: thank you | 20:03 |
| maulermark | asselin: Thanks for confirming. | 20:03 |
| anteaya | tristanC: yes it will have to be, I had hoped we could use it this time, for no other reason but to help you and pleia2 as the mailing list if flooded | 20:03 |
| asselin | maulermark, here's what I did: https://github.com/rasselin/os-ext-testing/tree/logserver (see instructions at the bottom of the README)...but adjust to use the 14.04 patch | 20:04 |
| anteaya | tristanC: sorry I didn't do a better job helping you | 20:04 |
| *** samueldmq has quit IRC | 20:04 | |
| anteaya | I feel like I've left you with a big mess | 20:04 |
| pleia2 | you didn't make the mess :) | 20:04 |
| anteaya | and I wanted you to have some space to get comfortable | 20:04 |
| anteaya | no but I didn't clear the space | 20:04 |
| *** melwitt_ has joined #openstack-infra | 20:04 | |
| anteaya | which I had hoped I could | 20:04 |
| anteaya | no idea this would come up as fast as it did | 20:05 |
| anteaya | sorry | 20:05 |
| *** melwitt has quit IRC | 20:05 | |
| anteaya | I'll do what I'm allowed to do to help youo | 20:05 |
| *** melwitt_ is now known as melwitt | 20:05 | |
| *** carl_baldwin has joined #openstack-infra | 20:06 | |
| anteaya | pleia2: have you re-enabled a gerrit account yet? | 20:06 |
| asselin | maulermark, also check to see if the file is badly formatted in the source | 20:06 |
| tristanC | anteaya: afaik, the mailing list volume is ok, I use a "PTL Candidacy" in subject filter and my candidacies folder is still very manageable that way | 20:06 |
| anteaya | pleia2: because I would like account id 9751 re-enabled: http://paste.openstack.org/show/192969/ | 20:06 |
| *** dustins has joined #openstack-infra | 20:06 | |
| anteaya | pleia2: perhaps fungi can walk you through it | 20:06 |
| anteaya | tristanC: glad to hear it | 20:07 |
| *** jcoufal has quit IRC | 20:07 | |
| asselin | ctlaugh, not sure....I'd try to restart some of the services..... | 20:07 |
| fungi | pleia2: ossh -p 29418 review gerrit set-account --active 9751 | 20:08 |
| *** fifieldt has quit IRC | 20:08 | |
| fungi | er, my aliases crept in there | 20:08 |
| smarcet | fungi: hello, where i could preview this https://review.openstack.org/#/c/165199/? | 20:08 |
| fungi | pleia2: ssh -p 29418 review.openstack.org gerrit set-account --active 9751 | 20:08 |
| *** yfried_ is now known as yfried|afk | 20:08 | |
| pleia2 | sorry, was distracted | 20:09 |
| fungi | smarcet: we probably need to add docs jobs to the openstackid project first. checking | 20:09 |
| pleia2 | fungi, anteaya: done | 20:10 |
| smarcet | fungi: k tnx | 20:10 |
| anteaya | pleia2: thank you | 20:10 |
| anteaya | morganfainberg: ibm db2 ci is now activated, their behaviour is up to you, if they dont' meet the infra requirements and your expectations, tell me and they go dark again | 20:11 |
| *** hdd has quit IRC | 20:12 | |
| *** bswartz has joined #openstack-infra | 20:14 | |
| anteaya | I sent an email to -announce | 20:14 |
| *** unicell has quit IRC | 20:14 | |
| *** unicell has joined #openstack-infra | 20:14 | |
| *** ParsectiX has quit IRC | 20:15 | |
| *** ildikov has joined #openstack-infra | 20:15 | |
| *** yfried|afk is now known as yfried_ | 20:16 | |
| fungi | smarcet: it doesn't have the necessary jobs yet, but i'm writing a change to the project-config repo to add them now. it'll take a few minutes because i'm mostly trying to pay attention in the tc meeting which is going on right now | 20:18 |
| *** mrda-away is now known as mrda | 20:18 | |
| *** teran has quit IRC | 20:19 | |
| *** achanda has joined #openstack-infra | 20:19 | |
| *** whoops has joined #openstack-infra | 20:20 | |
| *** sdake__ has joined #openstack-infra | 20:21 | |
| *** fifieldt has joined #openstack-infra | 20:21 | |
| *** dboik_ has quit IRC | 20:22 | |
| smarcet | fungi: ok np, thx for your help :) | 20:22 |
| *** dboik has joined #openstack-infra | 20:22 | |
| *** dangers is now known as dangers_away | 20:22 | |
| *** dangers_away is now known as dangers | 20:22 | |
| *** hdd has joined #openstack-infra | 20:23 | |
| *** sputnik13 has joined #openstack-infra | 20:23 | |
| *** zz_dimtruck is now known as dimtruck | 20:24 | |
| *** sputnik13 has quit IRC | 20:24 | |
| *** sdake has quit IRC | 20:25 | |
| *** r-daneel has quit IRC | 20:25 | |
| *** dboik has quit IRC | 20:26 | |
| *** dboik has joined #openstack-infra | 20:26 | |
| *** julim has quit IRC | 20:27 | |
| *** sputnik13 has joined #openstack-infra | 20:29 | |
| *** sarob has quit IRC | 20:32 | |
| *** mpopow has quit IRC | 20:32 | |
| *** dboik has quit IRC | 20:35 | |
| *** dboik has joined #openstack-infra | 20:36 | |
| *** imcsk8 is now known as imcsk8|lunch | 20:38 | |
| *** dangers is now known as dangers_away | 20:39 | |
| *** dangers_away is now known as dangers | 20:39 | |
| *** dhritishikhar has joined #openstack-infra | 20:41 | |
| *** dprince has quit IRC | 20:41 | |
| *** Bsony has quit IRC | 20:42 | |
| *** boris-42 has quit IRC | 20:42 | |
| *** hasharAway is now known as hashar | 20:43 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 20:44 | |
| *** achanda has quit IRC | 20:44 | |
| *** _nadya_ has joined #openstack-infra | 20:45 | |
| *** achanda has joined #openstack-infra | 20:45 | |
| *** sdake has joined #openstack-infra | 20:45 | |
| mtreinish | fungi: is the migration still going? | 20:48 |
| fungi | mtreinish: yep | 20:48 |
| fungi | ERROR:jenkins_jobs.builder:Duplicate entry found: '{pipeline}-neutron-dsvm-api{b | 20:48 |
| *** dhritishikhar has quit IRC | 20:48 | |
| fungi | er, mispaste | 20:48 |
| fungi | ERROR:jenkins_jobs.builder:Duplicate entry found: '{pipeline}-neutron-dsvm-api{b | 20:48 |
| fungi | gah | 20:49 |
| * fungi curses his terminal | 20:49 | |
| *** dimtruck is now known as zz_dimtruck | 20:49 | |
| pleia2 | linux paste buffers :( | 20:49 |
| *** _nadya_ has quit IRC | 20:49 | |
| *** sdake__ has quit IRC | 20:49 | |
| fungi | well, i was intentionally pasting but had accidentally copied stray newlines where my terminal wrapped | 20:51 |
| anteaya | tristanC: so openstackclient just got added to project.yaml in the governance repo | 20:52 |
| anteaya | tristanC: so you need to find out if they are included in this round of ptl elections | 20:52 |
| *** hodos has quit IRC | 20:53 | |
| dtroyer | anteaya: fwiw, we've not had anyone step up to run before the proposal, so either way I don't expect much action there | 20:53 |
| anteaya | dtroyer: you darling you | 20:54 |
| *** Ryan_Lane has joined #openstack-infra | 20:54 | |
| *** mestery has quit IRC | 20:55 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/infra-specs: Add spec for puppet apply work https://review.openstack.org/165217 | 20:57 |
| *** carl_baldwin has quit IRC | 20:57 | |
| *** dkliban is now known as dkliban_afk | 20:58 | |
| greghaynes | A spec! | 20:58 |
| *** mestery has joined #openstack-infra | 20:59 | |
| *** alexpilotti has quit IRC | 21:00 | |
| stevemar | dtroyer will be osc ptl 4 life | 21:01 |
| *** sputnik13 has quit IRC | 21:01 | |
| mordred | greghaynes: look! I wrote a spec! | 21:01 |
| mordred | greghaynes: clarkb will be very confused that I've done such a thing | 21:01 |
| *** alexpilotti has joined #openstack-infra | 21:02 | |
| *** teran has joined #openstack-infra | 21:02 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 21:03 | |
| *** harlowja has quit IRC | 21:03 | |
| *** alexpilotti has quit IRC | 21:03 | |
| *** harlowja_ has joined #openstack-infra | 21:03 | |
| *** carl_baldwin has joined #openstack-infra | 21:04 | |
| *** skraynev has quit IRC | 21:04 | |
| *** alexpilotti has joined #openstack-infra | 21:06 | |
| *** skraynev has joined #openstack-infra | 21:06 | |
| *** zz_dimtruck is now known as dimtruck | 21:06 | |
| *** alexpilotti has quit IRC | 21:06 | |
| *** mpavone has joined #openstack-infra | 21:07 | |
| anteaya | stevemar: if all three of you are here, we could have a vote now | 21:07 |
| *** ddieterly has quit IRC | 21:08 | |
| *** ddieterly has joined #openstack-infra | 21:08 | |
| stevemar | anteaya, shouldn't be hard to wrangle all three of us up | 21:08 |
| *** sputnik13 has joined #openstack-infra | 21:08 | |
| stevemar | might want to wait til after x-project meeting for dhellmann | 21:09 |
| *** sputnik13 has quit IRC | 21:09 | |
| anteaya | stevemar: fair enough | 21:09 |
| *** carl_baldwin has quit IRC | 21:09 | |
| *** mmedvede has quit IRC | 21:11 | |
| *** carl_baldwin has joined #openstack-infra | 21:11 | |
| *** carl_baldwin has quit IRC | 21:12 | |
| *** dhp has quit IRC | 21:12 | |
| *** smarcet has quit IRC | 21:13 | |
| *** imcsk8|lunch is now known as imcsk8 | 21:14 | |
| *** aysyd has quit IRC | 21:14 | |
| anteaya | pleia2: so zaro needs this patch in before we upgrade our os for gerrit on saturday, it is a system-config patch: https://review.openstack.org/#/c/165145/ | 21:16 |
| *** esker has quit IRC | 21:16 | |
| *** ldnunes has quit IRC | 21:17 | |
| *** mmedvede has joined #openstack-infra | 21:18 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Removed Nickname https://review.openstack.org/165194 | 21:18 |
| *** BobH has quit IRC | 21:18 | |
| *** HeOS has quit IRC | 21:19 | |
| *** sparkycollier has quit IRC | 21:19 | |
| *** HeOS has joined #openstack-infra | 21:20 | |
| pleia2 | anteaya: I know, but I'm not too familiar with the javascript files in gerrit so it's going to take me a few minutes to review (it's in my queue) | 21:20 |
| anteaya | ah | 21:20 |
| anteaya | all it does is change the url to get the jquery file rather than the jquery.min file | 21:21 |
| anteaya | no actual js to review | 21:21 |
| greghaynes | mordred: Nice idea for that spec | 21:21 |
| openstackgerrit | Eric Larson proposed openstack-infra/project-config: Create oslo.cache project https://review.openstack.org/165224 | 21:21 |
| pleia2 | anteaya: yes, but I should probably make sure it exists at least :) | 21:21 |
| anteaya | yes yes that would be good | 21:21 |
| pleia2 | I'll try to get to it soon | 21:21 |
| *** rfolco has quit IRC | 21:22 | |
| anteaya | okay as you will, just trying to provide context | 21:22 |
| pleia2 | thanks | 21:22 |
| anteaya | I find commit messages sometimes to bear little relation to what the patch is actually doing | 21:23 |
| anteaya | and more what the dev was thinking about at the time | 21:23 |
| *** BobH_ has joined #openstack-infra | 21:24 | |
| reed | uhm, new gerrty doesn't like python ssl libs shipped with Ubuntu 14.10 | 21:24 |
| anteaya | mordred: if you actually care about the scaling election tools proposal: https://etherpad.openstack.org/p/scaling-election-tooling | 21:25 |
| *** tiswanso_ has quit IRC | 21:25 | |
| anteaya | reed: what are you seeing? | 21:25 |
| *** dimtruck is now known as zz_dimtruck | 21:26 | |
| *** dkranz has quit IRC | 21:26 | |
| reed | anteaya, InsecurePlatformWarning | 21:26 |
| *** dangers is now known as dangers_away | 21:26 | |
| reed | linking to https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning | 21:26 |
| *** dangers_away is now known as dangers | 21:27 | |
| *** carl_baldwin has joined #openstack-infra | 21:27 | |
| *** eharney has quit IRC | 21:27 | |
| anteaya | reed: well jeblair is in the cross-project meeting, I'll let him address it when he is free | 21:28 |
| *** otter768 has joined #openstack-infra | 21:29 | |
| reed | k | 21:29 |
| *** notnownikki has quit IRC | 21:29 | |
| *** zz_dimtruck is now known as dimtruck | 21:30 | |
| *** carl_baldwin has quit IRC | 21:31 | |
| anteaya | I rechecked this nodepool change as clarkb suggested to test swift logs: https://review.openstack.org/#/c/139704/ the logs I have a console output for all build on rax-drw, which jeblair said had the updated images | 21:31 |
| anteaya | so far, so good | 21:31 |
| anteaya | rax-dfw | 21:31 |
| anteaya | I'm going for a walk | 21:32 |
| *** otter768 has quit IRC | 21:33 | |
| mordred | anteaya: looking | 21:33 |
| *** hyakuhei has joined #openstack-infra | 21:33 | |
| openstackgerrit | Merged openstack-infra/subunit2sql: Fix terrible path finding code in 1679b5bc102 migration https://review.openstack.org/165179 | 21:34 |
| mordred | greghaynes: there are patches up in the puppet-apply topic that has most of that implemented already | 21:34 |
| mtreinish | fungi: ^^^ I guess I should hold off on pushing a release for until the current migration finishes | 21:34 |
| fungi | mtreinish: yeah, it's still going (or else it's hung--hard to know without attaching an strace from another shell, which i'll do in a sec) | 21:35 |
| fungi | anteaya: pleia2: zaro: fwiw you should consider that change against both precise and trusty. the distro-packaged jquery.min.js is not a symlink to jquery.js on precise | 21:36 |
| fungi | they are distinct | 21:37 |
| *** bhuvan has quit IRC | 21:37 | |
| fungi | that may be fine though, just pointing it out | 21:37 |
| *** pc_m has quit IRC | 21:37 | |
| anteaya | if we need it for our upgrade to trusty | 21:37 |
| anteaya | what is our usecase for making sure it works with precise? | 21:37 |
| mtreinish | fungi: heh, I'm sure it's still moving, it's looping over >67M rows | 21:37 |
| *** SwimmingDolphin has joined #openstack-infra | 21:37 | |
| openstackgerrit | Steve Baker proposed openstack-infra/project-config: Use ssh publisher for heat-templates-buildimages https://review.openstack.org/163233 | 21:38 |
| openstackgerrit | Steve Baker proposed openstack-infra/project-config: heat-dsvm-functional enable build pip mirror https://review.openstack.org/165227 | 21:38 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Replace the Gerrit WIP icon https://review.openstack.org/165228 | 21:39 |
| *** mattfarina has quit IRC | 21:39 | |
| *** signed8bit has quit IRC | 21:41 | |
| *** dangers is now known as dangers_away | 21:42 | |
| *** dangers_away is now known as dangers | 21:42 | |
| *** crc32 has quit IRC | 21:43 | |
| *** banix has quit IRC | 21:45 | |
| *** yfried_ is now known as yfried|afk | 21:45 | |
| tristanC | anteaya: I can't see any reason why not including them... | 21:46 |
| fungi | mtreinish: strace on the python process is waiting on a read(), but maybe that's just because all the work is happening on the trove side of things | 21:46 |
| *** dboik has quit IRC | 21:46 | |
| anteaya | tristanC: right it is your decision, yours and pleia2's | 21:46 |
| *** dboik has joined #openstack-infra | 21:46 | |
| anteaya | tristanC: I'm just letting you know their status has changed | 21:46 |
| *** LinuxJedi has quit IRC | 21:47 | |
| *** bhuvan has joined #openstack-infra | 21:47 | |
| clarkb | anteaya it totally worked http://logs.openstack.org/04/139704/3/check/nodepool-coverage/1f5cd29/cover/ thats cool | 21:47 |
| anteaya | clarkb: yay | 21:48 |
| anteaya | clarkb: where are you now? | 21:48 |
| anteaya | home or hospital? | 21:48 |
| tristanC | anteaya: thanks, that's very appreciated! | 21:48 |
| anteaya | tristanC: :) | 21:48 |
| clarkb | pharmacy | 21:48 |
| anteaya | clarkb: ah | 21:49 |
| clarkb | almost home | 21:49 |
| anteaya | lots of time then | 21:49 |
| anteaya | good | 21:49 |
| mtreinish | fungi: yeah it's probably just waiting on something on the db side | 21:49 |
| mtreinish | fungi: I think there is a mysql command you can run to see the status of things going on | 21:49 |
| anteaya | clarkb: so right now we have I think 3 images that didn't build | 21:49 |
| anteaya | clarkb: jeblair didn't know why yet | 21:49 |
| mtreinish | fungi: show processlist maybe? | 21:49 |
| anteaya | clarkb: and we are open to what the next steps are for swift logs | 21:49 |
| anteaya | after we get all the images building the way they are supposed to | 21:50 |
| clarkb | I think rollout to more jobs | 21:50 |
| *** SwimmingDolphin has quit IRC | 21:50 | |
| anteaya | have any in mind? | 21:50 |
| clarkb | probably dsvm jobs | 21:50 |
| harlowja_ | qq, anyone know why https://review.openstack.org/#/c/164836/ has a jenkins -1 but no errors (all green in the check list) | 21:50 |
| anteaya | cool | 21:50 |
| *** esker has joined #openstack-infra | 21:51 | |
| anteaya | clarkb: let's hear from jhesketh when he arrives what he wants to do next | 21:51 |
| mtreinish | harlowja_: it's the requirements check | 21:51 |
| anteaya | clarkb: I announced I'm going for a walk now, so I had better | 21:51 |
| harlowja_ | hmmm | 21:51 |
| clarkb | anteaya enjoy | 21:51 |
| mtreinish | harlowja_: you've got to hit toggle ci to see the message, the formatting is different so the js which makes the grid doesn't know what to do with it | 21:51 |
| *** soren has quit IRC | 21:52 | |
| *** mdenny has joined #openstack-infra | 21:52 | |
| *** gokrokve has quit IRC | 21:52 | |
| *** FreeCandy has joined #openstack-infra | 21:53 | |
| harlowja_ | toggle ci u say, how's that done | 21:53 |
| *** FreeCandy has quit IRC | 21:53 | |
| *** FreeCandy has joined #openstack-infra | 21:53 | |
| fungi | anteaya: the reason for making it work with precise is that it will totally have to if we approve it before the maintenance | 21:53 |
| *** FreeCandy has quit IRC | 21:53 | |
| *** FreeCandy has joined #openstack-infra | 21:54 | |
| *** FreeCandy has quit IRC | 21:54 | |
| mtreinish | harlowja_: there is a little button at the very bottom of the review | 21:54 |
| harlowja_ | oh | 21:54 |
| harlowja_ | durp | 21:54 |
| harlowja_ | thx | 21:54 |
| *** FreeCandy has joined #openstack-infra | 21:54 | |
| *** FreeCandy has quit IRC | 21:54 | |
| *** FreeCandy has joined #openstack-infra | 21:54 | |
| *** FreeCandy has quit IRC | 21:54 | |
| *** asettle has joined #openstack-infra | 21:55 | |
| pleia2 | jquery.js and jquery.min.js are very different files on our precise production instance (I've now mentioned this in the review) | 21:56 |
| *** esker has quit IRC | 21:56 | |
| *** esker has joined #openstack-infra | 21:56 | |
| mordred | pleia2: you mean that jquery.min.js is a different version of jquery? | 21:56 |
| *** LinuxJedi has joined #openstack-infra | 21:57 | |
| *** ChuckC has quit IRC | 21:57 | |
| pleia2 | mordred: no, I mean on the filesystem, there's a huge diff between jquery.js and jquery.min.js, merging https://review.openstack.org/#/c/165145/ will replace our currently served jquery.min.js with a new jquery.min.js-symlinked-to-jquery.js and I don't know what that'll do | 21:57 |
| mordred | oh my - why would we symlink jquery.min.js to jquery.js? | 21:58 |
| pleia2 | I don't know :) | 21:58 |
| pleia2 | the commit message could be clearer | 21:58 |
| mordred | jquery.min.js should be a minified version of jquery.js | 21:58 |
| zaro | yes, that's true | 21:59 |
| *** ayoung has quit IRC | 21:59 | |
| *** erikmwil_ has joined #openstack-infra | 21:59 | |
| *** erikmwilson is now known as Guest84604 | 21:59 | |
| *** erikmwil_ is now known as erikmwilson | 21:59 | |
| zaro | that should come from jquery package | 21:59 |
| mordred | but it shouldn't be symlink'd to jquery.js ... | 22:00 |
| *** CheeseBurga has joined #openstack-infra | 22:01 | |
| zaro | it looks like that's how it's setup on trusty | 22:02 |
| morganfainberg | dhellmann, so. what i was thinking was using some form of entry point to populate the version numbers based on loading in a file (like requirements.txt, but obviously just being like a .in file that gets converted) | 22:02 |
| mordred | WOW | 22:02 |
| mordred | ZOMG | 22:02 |
| mordred | debian is lying | 22:02 |
| mordred | pleia2, zaro: I'm angry at ubuntu | 22:02 |
| pleia2 | heh | 22:03 |
| mordred | zaro is right: lrwxrwxrwx 1 root root 9 Jul 5 2013 jquery.min.js -> jquery.js | 22:03 |
| *** dboik has quit IRC | 22:03 | |
| mordred | what the actual hell are they thinking? | 22:03 |
| pleia2 | it wasn't like that in precise | 22:03 |
| mordred | I mean, they are just lying | 22:03 |
| pleia2 | yeah | 22:03 |
| morganfainberg | dhellmann, i know it feels weird, but maybe that solves things for us in a straight-forward-ish way. publish a g-r package if something is wrong. new g-r is branch specific. | 22:03 |
| mordred | they have abdicated their position as people who correctly package software | 22:03 |
| zaro | ohh wait, there's also jquery.lit.js and jquery.pack.js which point to jquery.min.js | 22:03 |
| *** dboik has joined #openstack-infra | 22:03 | |
| morganfainberg | mordred, wow.. .min to full non minified... wtf. | 22:03 |
| zaro | so maybe i should change that to jquery.min.js | 22:03 |
| mordred | morganfainberg: right???? | 22:04 |
| * zaro will do now. | 22:04 | |
| mordred | zaro: I'm going to suggest that we not use the distro package | 22:04 |
| mordred | jeblair: ^^ I'm fomenting sedition | 22:04 |
| mordred | jeblair: and you and fungi may need to jump in | 22:04 |
| greghaynes | uhhh, distro package for jquery? | 22:04 |
| zaro | ohh wait, nope they all is sim linked to jquery.js | 22:05 |
| morganfainberg | dhellmann, i might stew on this some more and see if it really is wrong... but it would mean that no more proposal-bot reviews for requirements updates. | 22:05 |
| pleia2 | zaro: yeah, that's how I'm reading the info in the commit message, but on precise an actual jquery.min.js does exist and we're using it | 22:05 |
| jeblair | mordred: if you're volunteering to be jquery maintainer for us, cool. :) | 22:06 |
| *** yfried|afk is now known as yfried_ | 22:06 | |
| *** hashar has quit IRC | 22:06 | |
| mordred | jeblair: well, I believe the current maintainer has abdicated their responsibility | 22:06 |
| fungi | mordred: part of this is pain the javascript community brings on itself by insisting on using specific non-opensource minifiers and distributing the results, so the distros can't really ship minified versions in packages because they can't ensure that they can be rebuilt | 22:06 |
| pleia2 | zaro: I don't think we want to switch from using jquery.min.js to jquery.js on our current production gerrit server | 22:06 |
| mordred | fungi: that's fine ... but I think that the debian pacakge should use an open source minifier | 22:06 |
| mordred | or not ship a file called "jquery.min.js" | 22:07 |
| morganfainberg | mordred, ++ oh yes OSS minifier *or* .. damn it you typed faster than i did. | 22:07 |
| zaro | pleia2: hmm, do you have a suggestion? | 22:07 |
| morganfainberg | :P | 22:07 |
| fungi | mordred: yep. i think the latter since last i heard the open source minifiers produce broken jquery | 22:07 |
| greghaynes | oh, theres an amazing github bug thread about that | 22:07 |
| pleia2 | zaro: as fungi said, I think we need to make this change support both precise and trusty if it's going in before our migration | 22:07 |
| mordred | krotscheck: ^^ you know way more about this subject than I | 22:07 |
| zaro | i'm guessing install a package with jquery.min.js? | 22:07 |
| jeblair | mordred, zaro, fungi: so i think that zuul depends on a newer jquery | 22:07 |
| fungi | ideally they should help out the minifiers if they want to start relying on them | 22:08 |
| *** asettle has quit IRC | 22:08 | |
| mordred | fungi: ++ | 22:08 |
| jeblair | mordred, zaro, fungi: we may already have the necessary puppet to deal with that | 22:08 |
| mordred | jeblair: yes. I would like to investigate using the puppet we have for minifying things to minify things | 22:08 |
| mordred | jeblair: and zuul is already using yul minified jquery, yeah? | 22:08 |
| fungi | yeah. also fair to point out that review-dev running trusty is serving the non-minified jquery as jquery.min.js so it at least works i think? | 22:08 |
| *** mpavone has quit IRC | 22:09 | |
| pleia2 | fungi: yeah, I'm just concerned about current precise gerrit | 22:09 |
| *** harlowja_ has quit IRC | 22:09 | |
| jeblair | hrm... actually, it looks like it still uses packages | 22:09 |
| zaro | pleia2: supporting both doesn't mean we need to use jquery.min.js | 22:09 |
| mordred | *headdesk* | 22:09 |
| jeblair | i guess i remembered wrong | 22:09 |
| mordred | I really wish the distros woudl stop yelling at the javascript folks and instead work on figuring out how to provide valuable service | 22:10 |
| *** LinuxJedi has quit IRC | 22:10 | |
| jeblair | so we use yui-compressor on the jquery-visibility plugin | 22:10 |
| jeblair | fungi: but i'm guessing that would be broken for main jquery? | 22:10 |
| pleia2 | zaro: my concern is that this patch switches from using an actual jquery.min.js to turning jquery.min.js into a symlink to a totally different file at jquery.js, on our production instance of gerrit | 22:10 |
| pleia2 | maybe it'll be fine, but I don't know | 22:11 |
| *** Somay has joined #openstack-infra | 22:11 | |
| *** rlandy has quit IRC | 22:11 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/devstack-gate: Add KEEP_WORKSPACE_CACHE variable to devstack-vm-gate-wrap https://review.openstack.org/165234 | 22:11 |
| *** LinuxJedi has joined #openstack-infra | 22:11 | |
| *** harlowja has joined #openstack-infra | 22:11 | |
| *** nilasae has quit IRC | 22:12 | |
| fungi | jeblair: maybe. i honestly haven't tried and the last time it came up in discussions on debian-devel was roughly a year ago. so might have improved | 22:12 |
| pleia2 | (I didn't -1, just left a comment with this info) | 22:12 |
| zaro | pleia2: i think we've already decided that Gerrit 2.9 will _not_ be supported on precise so should this just go in after gerrit upgrade? | 22:12 |
| jeblair | zaro: i thought you said this had to go in before the upgrade? | 22:13 |
| zaro | that's pleia2 told me about the precies /trusty difference | 22:13 |
| zaro | with jquery | 22:13 |
| *** LinuxJed_ has joined #openstack-infra | 22:13 | |
| zaro | *that's/that's before | 22:14 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:14 | |
| *** angela-s has left #openstack-infra | 22:14 | |
| zaro | so i guess this should go in after upgrade? which will fix the toogle ci button | 22:14 |
| *** Rockyg has quit IRC | 22:15 | |
| pleia2 | zaro: also, can you mention in the commit message that it's fixing the toggle ci button? (I had no idea why this patch was going in) | 22:15 |
| zaro | ohh actually trusty upgrade will break jquery i guess. so this should go in after trusty upgrade | 22:15 |
| jeblair | zaro: the toggle ci button is broken? | 22:15 |
| *** yfried_ is now known as yfried|afk | 22:16 | |
| mtreinish | mordred: do you have any suggestions for ways to estimate how much longer the migration will take? | 22:16 |
| mordred | mtreinish: not good ones | 22:16 |
| zaro | it was broken on review-dev.o.o because toggle-ci needs jquery | 22:16 |
| *** dangers is now known as dangers_away | 22:16 | |
| jeblair | zaro: i thought fungi just said it was being served on review-dev | 22:16 |
| *** LinuxJedi has quit IRC | 22:16 | |
| *** dangers_away is now known as dangers | 22:16 | |
| zaro | i manually fixed it | 22:16 |
| pleia2 | ah | 22:16 |
| zaro | turned off puppet for now | 22:16 |
| jeblair | zaro: what did you do? | 22:16 |
| mtreinish | mordred: heh, fair enough | 22:17 |
| zaro | copied jquery.js to jquery.min.js | 22:17 |
| jeblair | zaro: where? | 22:17 |
| zaro | in cp /usr/share/javascript/jquery/jquery.js /home/gerrit2/review_site/static/jquery.min.js | 22:18 |
| *** hyakuhei has quit IRC | 22:18 | |
| jeblair | zaro: okay. i'm going to install yui-compressor and see if it produces a working jquery | 22:18 |
| zaro | turned off puppet to work onn changing the WIP icon as well | 22:18 |
| jeblair | zaro: what was there before you copied it? | 22:19 |
| jhesketh | Morning | 22:19 |
| zaro | a broken simlink | 22:19 |
| mordred | zaro: btw ... WIP icon ... AWESOME | 22:20 |
| mordred | zaro: best thing I've seen in days | 22:20 |
| pleia2 | hehe | 22:21 |
| zaro | :)) | 22:21 |
| *** jgrimm is now known as zz_jgrimm | 22:21 | |
| jeblair | zaro, fungi: yui-compressor -o jquery.min.js /usr/share/javascript/jquery/jquery.js | 22:22 |
| jeblair | zaro, fungi: that seems to work on review-dev | 22:22 |
| fungi | yeah, if yui-compressor generates a working minified jquery then puppeting an exec triggered from updates to that file should be fairly straightforward | 22:22 |
| jeblair | fungi: yeah, that sounds workable to me | 22:23 |
| *** nelsnelson has quit IRC | 22:23 | |
| fungi | and we can stick them straight into the directory gerrit expects if so, rather than bothering with a symlink there | 22:23 |
| jeblair | zaro: that make sense? | 22:23 |
| zaro | yep, will do | 22:23 |
| zaro | thanks | 22:23 |
| mordred | ++ | 22:23 |
| *** arosen has joined #openstack-infra | 22:23 | |
| mordred | yay! I produced positive results by being negative and grumpy | 22:23 |
| *** spzala has quit IRC | 22:24 | |
| mordred | this leads me to believe that I should be negative and grumpy more often | 22:24 |
| *** peristeri has quit IRC | 22:24 | |
| *** arosen has quit IRC | 22:24 | |
| pleia2 | oh great | 22:24 |
| *** harlowja has quit IRC | 22:24 | |
| greghaynes | I believe statisticians refer to this as 'overfitting' | 22:24 |
| *** harlowja_ has joined #openstack-infra | 22:24 | |
| * jeblair tries to distract mordred for the good of the team | 22:24 | |
| *** erikmwilson has quit IRC | 22:25 | |
| *** pfallenop has quit IRC | 22:25 | |
| *** sputnik13 has joined #openstack-infra | 22:28 | |
| *** crc32 has joined #openstack-infra | 22:29 | |
| *** timcline has quit IRC | 22:30 | |
| *** sputnik13 has quit IRC | 22:30 | |
| *** dangers is now known as dangers_away | 22:30 | |
| *** sputnik13 has joined #openstack-infra | 22:31 | |
| *** dangers_away is now known as dangers | 22:31 | |
| mtreinish | anteaya: if you get a sec we've got some patches in tempest which need https://review.openstack.org/#/c/164451/ before we can land them | 22:31 |
| *** adrian_otto has joined #openstack-infra | 22:33 | |
| *** unicell has quit IRC | 22:34 | |
| *** radez is now known as radez_g0n3 | 22:34 | |
| *** dustins has quit IRC | 22:34 | |
| *** unicell has joined #openstack-infra | 22:35 | |
| *** sambetts has quit IRC | 22:36 | |
| *** ddieterly has quit IRC | 22:36 | |
| *** e0ne has quit IRC | 22:36 | |
| greghaynes | nibalizer: in site.pp, is it sane to glob out a node 'foo' definition? I want node '*.wheelmirrors.openstack.org', for example? | 22:37 |
| *** whoops has quit IRC | 22:38 | |
| *** sambetts has joined #openstack-infra | 22:38 | |
| nibalizer | yep | 22:38 |
| *** andreykurilin_ has quit IRC | 22:38 | |
| crinkle | it uses regexes, not globbing | 22:38 |
| nibalizer | can also regex if you prefer | 22:38 |
| greghaynes | is that just node *.wheelmirrors.openstack.org { } | 22:38 |
| *** tnovacik has quit IRC | 22:39 | |
| crinkle | greghaynes: https://docs.puppetlabs.com/puppet/latest/reference/lang_node_definitions.html | 22:39 |
| nibalizer | clarkb: i thought it uses both | 22:39 |
| greghaynes | docs, what are these | 22:39 |
| nibalizer | for puppet? puppet doesn thave docs! | 22:40 |
| *** marun has quit IRC | 22:40 | |
| *** dimtruck is now known as zz_dimtruck | 22:40 | |
| *** amitgandhinz has quit IRC | 22:42 | |
| *** erikmwilson_ is now known as erikmwilson | 22:43 | |
| openstackgerrit | greghaynes proposed openstack-infra/system-config: Add wheel_mirror_slaves that use pypi-mirror https://review.openstack.org/165240 | 22:44 |
| greghaynes | nibalizer: crinkle ^ time to tell me how bad my first puppet code his | 22:45 |
| *** asettle has joined #openstack-infra | 22:45 | |
| stevemar | are spontaneous merge conflicts a thing now? | 22:45 |
| stevemar | https://review.openstack.org/#/c/158779/ | 22:46 |
| stevemar | ah the 'depends-on' commit was merged | 22:48 |
| *** tim_o has quit IRC | 22:50 | |
| *** stevemar has quit IRC | 22:52 | |
| *** adrian_otto has quit IRC | 22:53 | |
| *** reed has quit IRC | 22:53 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Fix jquery setup on Gerrit server. https://review.openstack.org/165145 | 22:53 |
| zaro | pleia2: ^ | 22:53 |
| *** tkelsey has joined #openstack-infra | 22:54 | |
| *** ajmiller__ has joined #openstack-infra | 22:55 | |
| greghaynes | Is it a problem that its going to exec every time we puppet that box? | 22:56 |
| greghaynes | sometimes those compression runs arent very quick | 22:56 |
| *** sgordon has quit IRC | 22:56 | |
| zaro | greghaynes: we don't puppet gerrit very often | 22:57 |
| greghaynes | ok | 22:58 |
| *** ajmiller_ has quit IRC | 22:58 | |
| *** sabeen has quit IRC | 22:58 | |
| *** mriedem is now known as mriedem_away | 22:59 | |
| *** tkelsey has quit IRC | 22:59 | |
| *** changbl has quit IRC | 22:59 | |
| *** rlucio has joined #openstack-infra | 23:02 | |
| SpamapS | danit | 23:04 |
| SpamapS | damnit | 23:04 |
| *** ociuhandu has joined #openstack-infra | 23:04 | |
| SpamapS | I've hit up arrow 3 times in a row with 'tox -epy27 -r' in the buffer instead of 'tox -epy27' | 23:04 |
| * SpamapS taps fingers as stuff compiles.. again | 23:04 | |
| nibalizer | zaro: puppet doesn't run on gerrit? | 23:06 |
| nibalizer | or it doesnt run every few mintues, its a manual thing? | 23:06 |
| *** emagana has quit IRC | 23:08 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Fix jquery setup on Gerrit server. https://review.openstack.org/165145 | 23:08 |
| *** dims has quit IRC | 23:09 | |
| mordred | SpamapS: :) | 23:09 |
| *** paul-- has quit IRC | 23:09 | |
| mtreinish | SpamapS: heh, I know how you feel, my stupid migration has been running for hours now... | 23:09 |
| zaro | nibalizer: yes it does, and i believe it updates at the same interval as the rest of the infra servers. | 23:10 |
| crinkle | greghaynes: it shouldn't run every time, because of the refreshonly | 23:10 |
| crinkle | you could add an unless or onlyif parameter but i think the refreshonly takes care of it | 23:10 |
| greghaynes | huh, how does it know when to refresh since it doesnt know what the compression output would be until it compresses | 23:11 |
| nibalizer | crinkle: i think greg was refering to this, which doesn't have any of the that https://review.openstack.org/#/c/165145/3/modules/openstack_project/manifests/gerrit.pp | 23:11 |
| nibalizer | unless im blind and its there and i dont see it | 23:11 |
| crinkle | oh i'm looking at something else | 23:11 |
| crinkle | nm | 23:11 |
| greghaynes | well, I dont think you can, you have to get clever and refresh when the source file changes | 23:11 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Check image-list output in cmd tests https://review.openstack.org/164356 | 23:12 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Indicate error when deleting an invalid snapshot https://review.openstack.org/164472 | 23:12 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Test snapshot image deletion command https://review.openstack.org/164473 | 23:12 |
| nibalizer | greghaynes: so thats what puppet usually does, you add refreshonly => true, and subscribe => File[$target_file], and then it will only run the command if puppet also changed $target_file | 23:12 |
| greghaynes | ah, well thar ya go | 23:13 |
| nibalizer | ofc that breaks down if the file isn't managed directly by puppet, a file form a packge or a component of a git repo or something | 23:13 |
| *** paul-- has joined #openstack-infra | 23:13 | |
| nibalizer | but in those cases you can just subscirbe => Package[foo], and sometimes you'll do work you didn' thave to do | 23:13 |
| nibalizer | how long does it take to do tha tcompression? | 23:14 |
| greghaynes | yea yea, its just the on update hook | 23:14 |
| nibalizer | by default puppet timeouts at 300 seconds | 23:14 |
| *** enikanorov has quit IRC | 23:14 | |
| *** enikanorov has joined #openstack-infra | 23:15 | |
| zaro | nibalizer: it's very fast | 23:15 |
| zaro | less than 5 secs | 23:16 |
| zaro | nibalizer: more precisely 2 secs | 23:16 |
| nibalizer | ah, no worries then :) | 23:16 |
| greghaynes | sweet | 23:16 |
| *** dims has joined #openstack-infra | 23:20 | |
| *** ihrachyshka has quit IRC | 23:21 | |
| *** maulermark has quit IRC | 23:23 | |
| ianw | greghaynes: 164356 is looking better, i think there's room to tighten it. personally i prefer the decorator to reduce a level of indenting, but whatever on that | 23:24 |
| *** dmorita has quit IRC | 23:26 | |
| *** dangers is now known as dangers_away | 23:26 | |
| *** ChuckC has joined #openstack-infra | 23:26 | |
| *** dangers_away is now known as dangers | 23:26 | |
| *** mfink_ has quit IRC | 23:28 | |
| openstackgerrit | Stephanie Miller proposed openstack-infra/puppet-zanata: Initial commit of Zanata-specific sections https://review.openstack.org/147947 | 23:28 |
| greghaynes | yea, thats a preference thing, unless its totally straightforward I try to avoid them because IMO its less straight forward than a context maanger and also with the default argument it gets funky | 23:29 |
| greghaynes | I am really +0 on that though so meh | 23:29 |
| *** dmorita has joined #openstack-infra | 23:30 | |
| *** wenlock has quit IRC | 23:30 | |
| *** hdd has quit IRC | 23:31 | |
| *** dangers is now known as dangers_away | 23:34 | |
| harlowja_ | so qq, i'm trying to get the newer requirement for debtcollector into oslo-incubator for a commit, but i am thinking the 26 checks are borked | 23:34 |
| harlowja_ | http://logs.openstack.org/36/164836/8/check/gate-oslo-incubator-python26/5f7bf62/console.html | 23:34 |
| *** dangers_away is now known as dangers | 23:34 | |
| harlowja_ | ''Expected version spec in', 'debtcollector~=0.3.0', 'at', '~=0.3.0'' | 23:35 |
| harlowja_ | any ideas from folks? | 23:35 |
| *** mfink_ has joined #openstack-infra | 23:35 | |
| harlowja_ | https://review.openstack.org/#/c/164836/ | 23:35 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Check image-list output in cmd tests https://review.openstack.org/164356 | 23:35 |
| *** Ryan_Lane has quit IRC | 23:35 | |
| harlowja_ | i tried debtcollector>=0.3.0 and that didn't work either, ha | 23:35 |
| harlowja_ | that borks with http://logs.openstack.org/36/164836/7/check/gate-oslo-incubator-requirements/03016de/console.html | 23:35 |
| harlowja_ | so maybe folks here have some idears | 23:35 |
| *** nelsnelson has joined #openstack-infra | 23:36 | |
| dstufft | ~= is new in pip 6 setuptools 8 | 23:37 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Indicate error when deleting an invalid snapshot https://review.openstack.org/164472 | 23:38 |
| harlowja_ | pew pew pew, will all 2.6 be dying soon? | 23:38 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Test snapshot image deletion command https://review.openstack.org/164473 | 23:38 |
| dstufft | pip 6 setuptools 8 supports Python 2.6 | 23:38 |
| dstufft | but if your venv doesn't have it then you can't use ~= | 23:38 |
| harlowja_ | hmmmm, something infra releated to make that happen? | 23:38 |
| *** crc32 has quit IRC | 23:39 | |
| *** nanliu has quit IRC | 23:39 | |
| dstufft | (I don't know what version you're using, just saying that error looks like your pip isn't new enough in that virtual environment) | 23:40 |
| *** bhunter71 has quit IRC | 23:40 | |
| *** Qiming has joined #openstack-infra | 23:40 | |
| *** bdpayne has quit IRC | 23:41 | |
| harlowja_ | ya, it would appear so; maybe new CI stuff is needed (not sure either) | 23:41 |
| *** Swami has quit IRC | 23:42 | |
| *** crc32 has joined #openstack-infra | 23:44 | |
| *** hdd has joined #openstack-infra | 23:45 | |
| *** banix has joined #openstack-infra | 23:46 | |
| *** ddieterly has joined #openstack-infra | 23:47 | |
| CheeseBurga | ChanServ openstackstatus __afazekas _qb aarefiev abramley achanda adalbas adam_g adreznec Adri2000 ajmiller__ alaski alazarev alex_xu ameade andreaf anteaya anthonyper antonym apmelton Apsu armax arosen1 asadoughi asettle ashleighfarnham asselin banix baoli_ bcourt begal-sop_ bhuvan bkero bknudson blitzrage bnemec BobBall_AWOL BobH_ bodepd | 23:47 |
| CheeseBurga | bookwar bradm briancline briancurtin bswartz btran camunoz cburgess cebruns charz CheeseBurga chlong chmouel ChuckC cinerama clarkb Clint cloudnull cody-somerville comstud coolsvap|afk crc32 crinkle cschwede ctlaugh ctracey cyeoh d0ugal d34dh0r53 dalgaaf dangers dank_ dannywilson dansmith Darkwan darvon david-lyle davidlenwell Daviey dboik | 23:47 |
| CheeseBurga | ddieterly devananda dguerri dhellmann dims DinaBelova dkehn dkliban_afk dmellado dmitryme dmorita dmsimard dolphm dosaboy doug-fish dougwig dstanek dstufft dtantsur|afk dteselkin dtroyer DuncanT dvorak edwarnicke ekarlso elarson EmilienM enikanorov enikanorov__ erikmwilson erw esheffield__ esker esmute fabo fifieldt filler flaper87 freerunner freyes | 23:47 |
| CheeseBurga | frickler frobware fungi funzo gaelL_ garyh GheRivero ghostpl ghostpl_ gibi gilliard gmann gnuoy gothicmindfood gpocentek grantbow greghaynes grue_pm gus gyee hamzy harlowja_ hdd Hefeweizen HenryG HeOS HeOS_ heyongli hockeynut hogepodge hrubi hughhalf hughsaunders Hunner ianw ianychoi igorbelikov ildikov ilyashakhat imcsk8 | 23:47 |
| CheeseBurga | isq ivar-lazzaro j^2 jamespage jamielennox JayF jaypipes jbryce jcooley jd__ jeblair jesusaurus jgriffith jhesketh jklare jkt jlvillal jogo JoshNang jpeeler jraim jroll juggler jvrbanac jyuso jyuso1 kaisers kashyap katyafervent kevinbenton Kiall kiseok7_ kmartin koolhead17 kragniz krotscheck krtaylor kutija laurelm lbragstad | 23:47 |
| CheeseBurga | lifeless LinuxJed_ liusheng loquacities lxsli mancdaz marcusvrn1 markmcclain markvan markvoelker martingc masayukig mattoliverau maurosr mdenny med_ melwitt mescanef_ mestery mfink mfink_ mgagne michchap mika mikal Mithrandir mjturek1 mkj_wk mkoderer mmedvede Mmike mordred morgabra morganfainberg mrda mriedem_away mrodden msuriar mtanino mtreinish | 23:47 |
| CheeseBurga | mugsie mwagner_lap mwhudson Nakato naotokl nelsnelson neoice Ng nibalizer niedbalski nijaba nikhil_k NikitaKonovalov niska nithyag__ NobodyCam notmyname ociuhandu odyssey4me ondergetekende_ openstack openstackgerrit otherwiseguy pabelanger patrickeast paul-- PaulMurray pcrews pczesno persia peterstac phschwartz pleia2 prad praveenkumar primeministerp ptoohill purp Qiming rackertom | 23:47 |
| CheeseBurga | radez_g0n3 raginbajin rainya rakhmerov rcarrillocruz redrobot rhe00 rkukura rlucio rm_work roaet_ rossella_s ruhe russellb rwsu ryanpetrello s0nea sabari salv-orl_ sambetts saper sbadia sc68cal schang sdague sdake sdake_ SergeyLukjanov SergK Shrews sigmavirus24_awa sileht simonmcc skraynev slagle SlickNik Slower Somay SotK SpamapS | 23:47 |
| CheeseBurga | spiffxp spiffxp- spredzy|afk sputnik13 sreshetnyak stevebaker StevenK SumitNaiksatam Svedrin sweston taron tchaypo teran TheJulia therve timfreund timrc tlbr tnurlygayanov toabctl tobiash tonytan4ever tqtran trey tristanC tsg_ tsufiev_ tteggel ttx ubuntu2 ujuc unicell viglesia1 vipul vishy Vivek vponomaryov wayneeseguin waynr wendar | 23:47 |
| CheeseBurga | willroberts_ wolsen woodster_ wznoinsk xianghui xnox yamahata yfried|afk yolanda zaro zhiyan zigo zigo_ zxiiro zz_avozza zz_dimtruck zz_ja zz_jgrimm zz_johnthetubagu ZZelle ZZelle_ | 23:47 |
| greghaynes | well, id ping ops but apparently this spammer has done it for us | 23:48 |
| tchaypo | *facepalm* | 23:48 |
| ianw | great, now i'm hungry | 23:48 |
| dstufft | I didn't get a ping | 23:48 |
| dstufft | :( | 23:48 |
| JayF | I just ping'd #freenode | 23:48 |
| dstufft | I feel left out | 23:48 |
| *** CheeseBurga has quit IRC | 23:48 | |
| tchaypo | buh-bye! | 23:48 |
| *** ghostpl_ has quit IRC | 23:49 | |
| *** tsg_ has quit IRC | 23:49 | |
| mattoliverau | And here I thought someone wanted to talk to me :p | 23:49 |
| mmedvede | hi everybody :) | 23:49 |
| taron | methinks it is time for me to get a separate highlight window again | 23:49 |
| *** ajmiller__ has quit IRC | 23:50 | |
| *** david-lyle is now known as david-lyle_afk | 23:50 | |
| *** oomichi has joined #openstack-infra | 23:51 | |
| *** ddieterly has quit IRC | 23:51 | |
| *** ayoung has joined #openstack-infra | 23:53 | |
| *** yamamoto has joined #openstack-infra | 23:53 | |
| *** ZZelle_ has quit IRC | 23:54 | |
| *** SumitNaiksatam has quit IRC | 23:56 | |
| *** ddieterly has joined #openstack-infra | 23:57 | |
| *** sgordon has joined #openstack-infra | 23:57 | |
| *** Qiming has quit IRC | 23:58 | |
| *** dboik_ has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!