| dstufft | hm | 00:00 |
|---|---|---|
| *** r-daneel has quit IRC | 00:01 | |
| fungi | aha! | 00:01 |
| fungi | so it turns out the openstackid.org cert is _not_ signed by the same key, even though i ordered it the same way through the same account | 00:02 |
| openstackgerrit | Steve Baker proposed openstack-infra/project-config: Use ssh publisher for heat-templates-buildimages https://review.openstack.org/163233 | 00:02 |
| fungi | for some reason namecheap used "COMODO RSA Domain Validation Secure Server CA" for that one as opposed to "PositiveSSL CA 2" on our others | 00:02 |
| fungi | i wonder if all the recent certs are signed with the same as openstackid.org and this is the first it's come to our attention | 00:04 |
| openstackgerrit | Donald Stufft proposed openstack-infra/puppet-openstackid: Use a set of secure ciphers optimizing for security and performance https://review.openstack.org/163228 | 00:04 |
| fungi | since that ca is sha2 instead of sha1 | 00:05 |
| dstufft | clarkb: there ^ dropped 3DES and expanded the commit message to give more details | 00:05 |
| fungi | checking other recent additions for confirmation | 00:05 |
| *** e0ne has quit IRC | 00:06 | |
| *** dteselkin has quit IRC | 00:08 | |
| *** katyafervent has quit IRC | 00:08 | |
| *** tsufiev_ has quit IRC | 00:08 | |
| *** rakhmerov has quit IRC | 00:08 | |
| *** marun has quit IRC | 00:09 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Remove duplicate code https://review.openstack.org/163234 | 00:09 |
| dstufft | fungi: oh, that makes sense, ssllabs complained about extra certs too | 00:10 |
| *** katyafervent has joined #openstack-infra | 00:10 | |
| *** hichihara has joined #openstack-infra | 00:10 | |
| fungi | dstufft: yep, just piecing together the correct chain so i can update this and the other four affected systems ordered since that changed | 00:10 |
| *** tsufiev_ has joined #openstack-infra | 00:14 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run nodepool coverage as a check job https://review.openstack.org/163237 | 00:14 |
| fungi | dstufft: cinerama: now works with openssl s_client -connect openstackid.org:https -CAfile /etc/ssl/certs/AddTrust_External_Root.pem | 00:15 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run nodepool coverage as a check job https://review.openstack.org/163237 | 00:15 |
| fungi | i've got puppet momentarily suspended with what i think is the correct chain installed on the server | 00:15 |
| fungi | assuming that looks good i'll update it in hiera | 00:15 |
| *** rakhmerov has joined #openstack-infra | 00:15 | |
| cinerama | fungi: cool | 00:16 |
| fungi | -CApath /etc/ssl/certs works too for my systems | 00:16 |
| fungi | cinerama: dstufft: thanks for spotting this. the ask and groups sites are currently also affected by the same problem, as are certs for two servers we haven't switched to https yet | 00:17 |
| *** dteselkin has joined #openstack-infra | 00:17 | |
| *** tsufiev_ has quit IRC | 00:17 | |
| *** rakhmerov has quit IRC | 00:17 | |
| *** dteselkin has quit IRC | 00:17 | |
| *** katyafervent has quit IRC | 00:17 | |
| anteaya | dhellmann: +A 161447 sorry that took so long | 00:18 |
| greghaynes | clarkb: haha, my test blows up pretty hard | 00:18 |
| anteaya | dhellmann: and sorry again to the incorrect review | 00:18 |
| anteaya | for | 00:18 |
| fungi | i need to remember to start manually validating certificate chains when we bring servers up | 00:18 |
| *** camunoz has joined #openstack-infra | 00:18 | |
| *** katyafervent has joined #openstack-infra | 00:18 | |
| dstufft | fungi: deploying certs is way harder than it should be | 00:18 |
| clarkb | greghaynes: perfect :) thats how my change ended up becoming 4 changes. it tickled the bugs and they needed fixing | 00:18 |
| *** achanda has quit IRC | 00:18 | |
| *** achanda has joined #openstack-infra | 00:18 | |
| *** sdake_ has joined #openstack-infra | 00:19 | |
| *** dims_ has joined #openstack-infra | 00:20 | |
| greghaynes | clarkb: goes into a polling loop and then eventually results in a sql deadlock | 00:20 |
| greghaynes | \O/ | 00:20 |
| clarkb | wow thats amazing | 00:20 |
| *** mtanino has quit IRC | 00:21 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: WIP: test nodepool upload failures https://review.openstack.org/163239 | 00:22 |
| greghaynes | need to AFK for a few but ^ if youre interested in seeing | 00:22 |
| *** dims has quit IRC | 00:22 | |
| *** dims_ has quit IRC | 00:22 | |
| *** dims has joined #openstack-infra | 00:23 | |
| *** achanda has quit IRC | 00:23 | |
| *** dteselkin has joined #openstack-infra | 00:24 | |
| *** gokrokve has quit IRC | 00:24 | |
| clarkb | greghaynes: oh ya I think you need to rebase onto my stack to get some of the fixes involved | 00:24 |
| clarkb | greghaynes: I would try that at least and see if it blows up less badly | 00:24 |
| *** katyafervent has quit IRC | 00:24 | |
| *** dteselkin has quit IRC | 00:24 | |
| *** ivar-lazzaro has quit IRC | 00:25 | |
| *** tsufiev_ has joined #openstack-infra | 00:25 | |
| *** rakhmerov has joined #openstack-infra | 00:26 | |
| *** katyafervent has joined #openstack-infra | 00:27 | |
| openstackgerrit | Merged openstack-infra/project-config: import aeromancer to stackforge https://review.openstack.org/161447 | 00:28 |
| clarkb | fyi new project creation is still broken until https://review.openstack.org/#/c/154300/ https://review.openstack.org/#/c/154305/ and https://review.openstack.org/#/c/159159/ get in | 00:29 |
| *** dteselkin has joined #openstack-infra | 00:30 | |
| clarkb | nibalizer: your gist makes me wish you used \t | 00:30 |
| *** claudiub has quit IRC | 00:30 | |
| nibalizer | what gist? | 00:31 |
| clarkb | oh ww but that package script thing | 00:31 |
| clarkb | I was very confused initially | 00:31 |
| nibalizer | oh that was just grosssss hax for the lulz | 00:31 |
| clarkb | jhesketh: re 163188 feel free to push new patchset and add a co authored by | 00:32 |
| clarkb | jhesketh: I am about to call it a day so happy if someone else continues to work on it | 00:33 |
| jhesketh | clarkb: will do | 00:33 |
| jhesketh | no worries :-) | 00:33 |
| clarkb | jhesketh: you will probably end up rewriting the whole thing and then just take authorship in git :) | 00:33 |
| *** david-lyle_afk has quit IRC | 00:34 | |
| clarkb | jhesketh: the reason I didn't initially put it in the payload was that data and headers are two different request.post parameters | 00:34 |
| clarkb | jhesketh: so I thought they were distinct, but you are right it would be nice to keep that data together to make the uploader not very opinionated | 00:34 |
| jhesketh | clarkb: I figure the headers will be part of the payload, so you can define individual headers for each file | 00:35 |
| jhesketh | maybe payload is the wrong term | 00:36 |
| clarkb | jhesketh: ya I get what you mean though | 00:36 |
| clarkb | jhesketh: its a file attribute not an uploader attribute | 00:36 |
| jhesketh | oh, but we have to do it for the X number of files we're uploading | 00:37 |
| *** garyh has quit IRC | 00:37 | |
| jhesketh | that's a little lame/trickier | 00:37 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Remove duplicate code https://review.openstack.org/163234 | 00:38 |
| clarkb | ya | 00:38 |
| fungi | after closer inspection of the hiera file, openstackid.org was the only one with an incorrect chain cert. the other four i've ordered since the transition had the correct (new) chains | 00:41 |
| clarkb | fungi: thank you for debugging | 00:41 |
| fungi | i've reenabled puppet on it, and https://www.ssllabs.com/ssltest/analyze.html?d=openstackid.org&latest seems happy now too | 00:43 |
| *** spzala has joined #openstack-infra | 00:43 | |
| *** sarob has joined #openstack-infra | 00:45 | |
| *** ghostpl_ has joined #openstack-infra | 00:47 | |
| *** yamamoto has quit IRC | 00:47 | |
| *** dboik has joined #openstack-infra | 00:47 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: WIP: test nodepool upload failures https://review.openstack.org/163239 | 00:49 |
| greghaynes | clarkb: ^ still goes boom | 00:49 |
| greghaynes | I can debug | 00:49 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/project-config: Test new zuul split layout https://review.openstack.org/163243 | 00:49 |
| *** tiswanso has joined #openstack-infra | 00:50 | |
| *** dboik_ has joined #openstack-infra | 00:52 | |
| *** tiswanso has quit IRC | 00:52 | |
| *** tiswanso has joined #openstack-infra | 00:53 | |
| *** zul has joined #openstack-infra | 00:54 | |
| *** wenlock has joined #openstack-infra | 00:54 | |
| *** dboik has quit IRC | 00:55 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Add fingerprint for bug 1430592 https://review.openstack.org/163245 | 00:55 |
| openstack | bug 1430592 in OpenStack-Gate "testtools-1.7.0 triggering pkg_resources.VersionConflict: (unittest2 0.5.1 (/usr/lib/python2.7/dist-packages), Requirement.parse('unittest2>=1.0.0'))" [Undecided,New] https://launchpad.net/bugs/1430592 | 00:55 |
| *** ghostpl_ has quit IRC | 00:55 | |
| anteaya | tristanC jeblair fungi clarkb pleia2 jhesketh jogo, anyone else interested in the election tooling discussion: https://etherpad.openstack.org/p/scaling-election-tooling ttx (though I know you are out) | 00:56 |
| *** wenlock has quit IRC | 00:59 | |
| *** bhuvan has quit IRC | 00:59 | |
| *** pblaho has quit IRC | 01:05 | |
| *** ivar-lazzaro has joined #openstack-infra | 01:09 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Add FindBugs plugin support https://review.openstack.org/153911 | 01:10 |
| *** ChuckC has quit IRC | 01:10 | |
| *** liusheng has quit IRC | 01:12 | |
| *** liusheng has joined #openstack-infra | 01:12 | |
| *** ddieterly has joined #openstack-infra | 01:14 | |
| *** ddieterl_ has joined #openstack-infra | 01:15 | |
| *** yamamoto has joined #openstack-infra | 01:15 | |
| *** zz_dimtruck is now known as dimtruck | 01:18 | |
| *** ddieterly has quit IRC | 01:19 | |
| pleia2 | anteaya: thanks! | 01:19 |
| anteaya | pleia2: :) | 01:20 |
| *** crc32 has joined #openstack-infra | 01:20 | |
| asselin | clarkb, mmedvede fyi, saw some patches to fix that issue in devstack. Only affecting icehouse & juno. master's fine. I had a different error for that branch. | 01:20 |
| *** crc32 has quit IRC | 01:20 | |
| lifeless | testtools 1.7.1 up which should have the fixed wheel :) | 01:21 |
| *** david-lyle_afk has joined #openstack-infra | 01:21 | |
| *** bhuvan has joined #openstack-infra | 01:21 | |
| *** hughhalf is now known as hugh_afk | 01:22 | |
| *** crc32 has joined #openstack-infra | 01:22 | |
| *** ivar-lazzaro has quit IRC | 01:25 | |
| *** dims has quit IRC | 01:28 | |
| *** unicell has quit IRC | 01:28 | |
| *** dims has joined #openstack-infra | 01:29 | |
| *** salv-orlando has quit IRC | 01:30 | |
| *** devlaps has joined #openstack-infra | 01:31 | |
| *** dims has quit IRC | 01:34 | |
| *** banix has quit IRC | 01:36 | |
| *** SumitNaiksatam has quit IRC | 01:39 | |
| *** dims has joined #openstack-infra | 01:40 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/project-config: Add puppet-openstackci project https://review.openstack.org/163255 | 01:41 |
| *** ChuckC has joined #openstack-infra | 01:42 | |
| *** macjack has joined #openstack-infra | 01:46 | |
| *** ChuckC has quit IRC | 01:46 | |
| *** ChuckC has joined #openstack-infra | 01:47 | |
| *** devlaps has quit IRC | 01:51 | |
| *** patrickeast has quit IRC | 01:51 | |
| *** rwsu is now known as rwsu-afk | 01:52 | |
| mtreinish | jeblair: ok sure, I was fine either way with ahving a cookiecutter for it. You could use cookiecutter to make a dir in the repo too, which is what I thought you were going to do | 01:53 |
| *** otter768 has joined #openstack-infra | 01:53 | |
| *** dims_ has joined #openstack-infra | 01:55 | |
| *** changbl has joined #openstack-infra | 01:56 | |
| *** Ryan_Lane has quit IRC | 01:58 | |
| *** dims has quit IRC | 01:58 | |
| *** otter768 has quit IRC | 01:58 | |
| *** woodster_ has quit IRC | 02:00 | |
| *** sdake_ has quit IRC | 02:04 | |
| *** sdake_ has joined #openstack-infra | 02:05 | |
| *** harlowja_ is now known as harlowja_away | 02:09 | |
| *** yamahata has quit IRC | 02:13 | |
| jeblair | mtreinish: oh, that might be a reason to keep doing it then. let's talk more tomorrow | 02:13 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add indexes to revision table https://review.openstack.org/163262 | 02:14 |
| jeblair | tchaypo: ^ that makes that part of the change sync much much much much much much much faster for me | 02:14 |
| mtreinish | jeblair: sure | 02:14 |
| * jeblair eods | 02:15 | |
| anteaya | night | 02:15 |
| *** sdake_ has quit IRC | 02:20 | |
| *** gokrokve has joined #openstack-infra | 02:26 | |
| *** coolsvap has joined #openstack-infra | 02:29 | |
| tchaypo | let me give it a try | 02:30 |
| *** salv-orlando has joined #openstack-infra | 02:31 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Refactor o_p::base into o_p::template https://review.openstack.org/162830 | 02:31 |
| *** nelsnelson has joined #openstack-infra | 02:33 | |
| *** david-lyle_afk has quit IRC | 02:36 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Default to a bogus rsa key on puppetmaster https://review.openstack.org/163267 | 02:36 |
| *** salv-orlando has quit IRC | 02:38 | |
| *** ghostpl_ has joined #openstack-infra | 02:39 | |
| *** mfink_ has joined #openstack-infra | 02:40 | |
| *** sdake_ has joined #openstack-infra | 02:41 | |
| *** ghostpl_ has quit IRC | 02:44 | |
| *** sdake_ has quit IRC | 02:45 | |
| *** spzala has quit IRC | 02:54 | |
| *** carl_baldwin has joined #openstack-infra | 02:56 | |
| *** hdd_ has quit IRC | 02:57 | |
| *** salv-orlando has joined #openstack-infra | 02:57 | |
| *** achanda has joined #openstack-infra | 02:58 | |
| *** banix has joined #openstack-infra | 03:01 | |
| *** dims_ has quit IRC | 03:02 | |
| *** armax has quit IRC | 03:09 | |
| *** salv-orlando has quit IRC | 03:10 | |
| *** achanda has quit IRC | 03:10 | |
| *** coolsvap is now known as coolsvap|afk | 03:15 | |
| *** mrda has joined #openstack-infra | 03:16 | |
| mrda | Hey infra - just to confirm, we don't log meeting rooms? (i.e. http://eavesdrop.openstack.org/meetings/openstack-meeting-3/2015/) and this is a deliberate choice? | 03:17 |
| mrda | Sorry - just found what I was looking for at http://eavesdrop.openstack.org/irclogs/%23openstack-meeting-3/ | 03:17 |
| *** armax has joined #openstack-infra | 03:17 | |
| *** david-lyle_afk has joined #openstack-infra | 03:17 | |
| *** resker has joined #openstack-infra | 03:18 | |
| mtreinish | mrda: the meetings are treated separately: http://eavesdrop.openstack.org/meetings/ | 03:18 |
| mrda | thanks mtreinish | 03:18 |
| *** ddieterl_ has quit IRC | 03:18 | |
| *** gokrokve has quit IRC | 03:18 | |
| *** ashleighfarnham has joined #openstack-infra | 03:20 | |
| *** armax has quit IRC | 03:20 | |
| *** esker has quit IRC | 03:21 | |
| *** coolsvap|afk is now known as coolsvap | 03:22 | |
| *** markvan has quit IRC | 03:28 | |
| *** mpopow_ has joined #openstack-infra | 03:32 | |
| *** mpopow_ has quit IRC | 03:32 | |
| *** markvan has joined #openstack-infra | 03:33 | |
| *** mpopow_ has joined #openstack-infra | 03:33 | |
| *** stevemar has quit IRC | 03:34 | |
| *** mpopow has quit IRC | 03:34 | |
| *** armax has joined #openstack-infra | 03:35 | |
| *** armax has quit IRC | 03:40 | |
| *** jgrimm is now known as zz_jgrimm | 03:40 | |
| *** mpopow_ has quit IRC | 03:46 | |
| *** mpopow_ has joined #openstack-infra | 03:46 | |
| *** zz_jgrimm is now known as jgrimm | 03:47 | |
| *** garyh has joined #openstack-infra | 03:49 | |
| *** tiswanso has quit IRC | 03:49 | |
| *** patrickeast has joined #openstack-infra | 03:53 | |
| *** mpopow_ has quit IRC | 03:53 | |
| *** otter768 has joined #openstack-infra | 03:54 | |
| *** dhritishikhar has joined #openstack-infra | 03:56 | |
| *** otter768 has quit IRC | 03:59 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Add option to set swift delete after header https://review.openstack.org/163188 | 03:59 |
| *** asselin_ has joined #openstack-infra | 04:01 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: zuul-swift-upload use logging for debug msgs https://review.openstack.org/163276 | 04:01 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Add option to set swift delete after header https://review.openstack.org/163188 | 04:03 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: zuul-swift-upload use logging for debug msgs https://review.openstack.org/163276 | 04:03 |
| *** dims has joined #openstack-infra | 04:03 | |
| *** markvan has quit IRC | 04:05 | |
| clarkb | jhesketh one comment on the delete after change | 04:06 |
| jhesketh | clarkb: I can't see the comment sorry? | 04:07 |
| *** achanda has joined #openstack-infra | 04:07 | |
| clarkb | ugh phone commenting | 04:07 |
| *** markvan has joined #openstack-infra | 04:07 | |
| clarkb | the delete_afters in swift_form_post() should be removed | 04:08 |
| jhesketh | heh, go to bed? | 04:08 |
| jhesketh | ah, missed that, thakns | 04:08 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Add option to set swift delete after header https://review.openstack.org/163188 | 04:09 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: zuul-swift-upload use logging for debug msgs https://review.openstack.org/163276 | 04:09 |
| *** garyh has quit IRC | 04:10 | |
| *** dims has quit IRC | 04:10 | |
| *** dimtruck is now known as zz_dimtruck | 04:10 | |
| *** BharatK has joined #openstack-infra | 04:14 | |
| *** miqui has quit IRC | 04:14 | |
| *** ujuc has joined #openstack-infra | 04:23 | |
| *** bhuvan has quit IRC | 04:24 | |
| *** ghostpl_ has joined #openstack-infra | 04:28 | |
| *** dhritishikhar has quit IRC | 04:33 | |
| *** ghostpl_ has quit IRC | 04:33 | |
| *** harlowja_at_home has joined #openstack-infra | 04:35 | |
| *** amotoki has joined #openstack-infra | 04:36 | |
| *** hdd_ has joined #openstack-infra | 04:38 | |
| *** crc32 has quit IRC | 04:39 | |
| *** unicell has joined #openstack-infra | 04:42 | |
| *** dboik_ has quit IRC | 04:42 | |
| *** dboik has joined #openstack-infra | 04:43 | |
| *** banix has quit IRC | 04:48 | |
| *** patrickeast has quit IRC | 04:48 | |
| *** ddieterly has joined #openstack-infra | 04:49 | |
| *** nelsnelson has quit IRC | 04:52 | |
| *** ddieterly has quit IRC | 04:53 | |
| *** salv-orlando has joined #openstack-infra | 04:57 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add unit test for create_server https://review.openstack.org/160155 | 04:58 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add basic unit test for shade.openstack_cloud https://review.openstack.org/159674 | 04:58 |
| *** carl_baldwin has quit IRC | 05:01 | |
| *** xyang1 has quit IRC | 05:02 | |
| *** bhuvan has joined #openstack-infra | 05:05 | |
| *** salv-orlando has quit IRC | 05:10 | |
| *** salv-orlando has joined #openstack-infra | 05:12 | |
| *** yfried|afk is now known as yfried_ | 05:14 | |
| *** salv-orlando has quit IRC | 05:16 | |
| *** Alexandra_ has joined #openstack-infra | 05:17 | |
| *** koolhead17 has joined #openstack-infra | 05:18 | |
| *** koolhead17 has quit IRC | 05:18 | |
| *** koolhead17 has joined #openstack-infra | 05:18 | |
| *** deepakcs has joined #openstack-infra | 05:18 | |
| *** dboik has quit IRC | 05:20 | |
| *** dhritishikhar has joined #openstack-infra | 05:20 | |
| *** dboik has joined #openstack-infra | 05:20 | |
| *** BharatK has left #openstack-infra | 05:25 | |
| openstackgerrit | Qiming Teng proposed openstack-infra/project-config: new-project: stackforge/senlin https://review.openstack.org/163292 | 05:25 |
| *** doug-fish has quit IRC | 05:28 | |
| *** yfried_ is now known as yfried|afk | 05:28 | |
| *** salv-orlando has joined #openstack-infra | 05:29 | |
| *** doug-fish has joined #openstack-infra | 05:29 | |
| *** achanda has quit IRC | 05:31 | |
| *** yfried|afk is now known as yfried_ | 05:31 | |
| *** salv-orlando has quit IRC | 05:34 | |
| *** achanda has joined #openstack-infra | 05:34 | |
| *** salv-orlando has joined #openstack-infra | 05:35 | |
| *** salv-orlando has quit IRC | 05:35 | |
| *** garyk has quit IRC | 05:35 | |
| *** unicell has quit IRC | 05:37 | |
| *** unicell has joined #openstack-infra | 05:37 | |
| *** koolhead_ has joined #openstack-infra | 05:38 | |
| *** koolhead17 has quit IRC | 05:40 | |
| *** salv-orlando has joined #openstack-infra | 05:41 | |
| *** mrmartin has joined #openstack-infra | 05:41 | |
| *** dhritishikhar has quit IRC | 05:42 | |
| *** salv-orlando has quit IRC | 05:45 | |
| *** achanda has quit IRC | 05:48 | |
| *** unicell has quit IRC | 05:48 | |
| *** unicell has joined #openstack-infra | 05:49 | |
| *** bnemec has quit IRC | 05:49 | |
| *** ddieterly has joined #openstack-infra | 05:50 | |
| *** bnemec has joined #openstack-infra | 05:52 | |
| *** achanda has joined #openstack-infra | 05:52 | |
| *** ddieterly has quit IRC | 05:54 | |
| *** otter768 has joined #openstack-infra | 05:55 | |
| *** achanda has quit IRC | 05:58 | |
| *** otter768 has quit IRC | 06:00 | |
| *** achanda has joined #openstack-infra | 06:01 | |
| *** dboik has quit IRC | 06:01 | |
| *** yfried_ is now known as yfried|afk | 06:01 | |
| *** jyuso1 has quit IRC | 06:01 | |
| *** camunoz has quit IRC | 06:03 | |
| *** salv-orlando has joined #openstack-infra | 06:04 | |
| *** camunoz has joined #openstack-infra | 06:05 | |
| *** BharatK has joined #openstack-infra | 06:06 | |
| *** yfried|afk is now known as yfried_ | 06:06 | |
| *** ashleighfarnham has quit IRC | 06:06 | |
| *** salv-orlando has quit IRC | 06:08 | |
| *** mrmartin has quit IRC | 06:08 | |
| *** harlowja_at_home has quit IRC | 06:11 | |
| *** Sukhdev has joined #openstack-infra | 06:12 | |
| *** punith has joined #openstack-infra | 06:13 | |
| *** achanda has quit IRC | 06:14 | |
| *** dmellado has quit IRC | 06:15 | |
| *** salv-orlando has joined #openstack-infra | 06:15 | |
| *** ghostpl_ has joined #openstack-infra | 06:17 | |
| *** dmellado has joined #openstack-infra | 06:19 | |
| openstackgerrit | Swati Sharma proposed openstack/requirements: Adding weasyprint to download Horizon reports in PDF format https://review.openstack.org/163304 | 06:19 |
| *** salv-orlando has quit IRC | 06:20 | |
| *** salv-orlando has joined #openstack-infra | 06:21 | |
| *** ghostpl_ has quit IRC | 06:21 | |
| *** yfried_ is now known as yfried|afk | 06:23 | |
| *** yfried|afk is now known as yfried_ | 06:26 | |
| *** salv-orlando has quit IRC | 06:26 | |
| *** salv-orlando has joined #openstack-infra | 06:27 | |
| *** andreykurilin_ has joined #openstack-infra | 06:28 | |
| *** kiseok7_ has quit IRC | 06:31 | |
| *** kiseok7_ has joined #openstack-infra | 06:32 | |
| *** salv-orlando has quit IRC | 06:32 | |
| *** Sukhdev has quit IRC | 06:33 | |
| *** Alexandra_ has quit IRC | 06:38 | |
| *** salv-orlando has joined #openstack-infra | 06:38 | |
| BharatK | ping AJaeger | 06:41 |
| *** salv-orlando has quit IRC | 06:43 | |
| *** resker has quit IRC | 06:49 | |
| *** esker has joined #openstack-infra | 06:50 | |
| *** ddieterly has joined #openstack-infra | 06:51 | |
| openstackgerrit | Sudheesh proposed openstack-infra/project-config: project config changes for openstack-docker cookbook https://review.openstack.org/163307 | 06:51 |
| *** ildikov has quit IRC | 06:51 | |
| *** ddieterly has quit IRC | 06:55 | |
| *** andreykurilin_ has quit IRC | 06:57 | |
| *** hdd_ has quit IRC | 06:57 | |
| *** kevinbenton has quit IRC | 06:59 | |
| *** HeOS has quit IRC | 07:00 | |
| AJaeger | morning, BharatK | 07:02 |
| *** garyk has joined #openstack-infra | 07:03 | |
| *** rlandy has joined #openstack-infra | 07:03 | |
| *** fdegir has joined #openstack-infra | 07:05 | |
| BharatK | AJaeger: Good Morning | 07:09 |
| BharatK | AJaeger: Regarding the patch https://review.openstack.org/#/c/161965/1 | 07:09 |
| AJaeger | yes? | 07:09 |
| BharatK | AJaeger: As per this patch it create jobs with name "gate-tempest-dsvm-full-sheepdog" and gate-tempest-dsvm-full-glusterfs | 07:10 |
| BharatK | AJaeger: But I want to add this job to check pipeline of Cinder's project | 07:10 |
| AJaeger | So, what's your problem? | 07:11 |
| BharatK | AJaeger: Having check makes more sense I guess, then having "gate-tempest-dsvm-full-glusterfs" | 07:11 |
| AJaeger | BharatK, that'S just naming, we're not consistent here. No need to change it | 07:12 |
| BharatK | AJaeger: http://paste.openstack.org/show/191511/ | 07:12 |
| BharatK | AJaeger: Please have a look at chat with Clark | 07:12 |
| deepakcs | AJaeger, the larger point being, some folks haev raised Q on why its caleld gate, when its non voting and only runs during check pipeline | 07:12 |
| deepakcs | AJaeger, so we were thinking to make it {pipeline} and jobs can specify gate/check as they like it. We want to call ours as check not gate | 07:13 |
| deepakcs | AJaeger, also sheepdog's job was with prefix check (before that patch) and the patch hardcodes it to gate ! | 07:14 |
| deepakcs | AJaeger, I would propose to make it a variable, which can then be controlled by individual jobs' wish, what say ? | 07:14 |
| AJaeger | Did you see my email regarding the -nv? | 07:14 |
| BharatK | AJaeger: Yeah I have seen that. | 07:15 |
| deepakcs | AJaeger, yes, but thats for voting/nv, how does that relate to this ? | 07:15 |
| AJaeger | it's something you should keep in mind when doing the changes ;) | 07:15 |
| sabari | ttx, dhellmann: we need https://review.openstack.org/#/c/163121/ for glance k3. Can you help us with the review ? | 07:16 |
| yolanda | jhesketh, saw your comments about that zuul param. We had this setting downstream for ages, i've always seen that there, and it looks it does nothing? do you remember having that zuul_override parameter at some time? | 07:16 |
| deepakcs | AJaeger, oh yes, i agree, but do u agree to make the variable {pipeline} instead of hardcodign it to gate for plugin template ? | 07:16 |
| *** che-arne has joined #openstack-infra | 07:16 | |
| AJaeger | deepakcs, check or gate is for me just naming, I don't really care. | 07:17 |
| deepakcs | AJaeger, technically check is before +2, gate is for the final check, so there is a diff and the name causes confusion if used incorrectly | 07:17 |
| *** ghostpl_ has joined #openstack-infra | 07:17 | |
| AJaeger | We'Re not consistent here at all ;(, see how all the infra jobs are named: https://review.openstack.org/#/c/163150/ | 07:18 |
| deepakcs | AJaeger, I know and ack the inconsistency, but i feel the job owners should be given the freedom to choose check/gate | 07:19 |
| AJaeger | deepakcs, yes, you're right on the naming but as long as there's no clear policy, I will not reject patches that add further gates. | 07:19 |
| AJaeger | deepakcs, then do it. I'm not blocking your patch - or do I? | 07:19 |
| deepakcs | AJaeger, no you are not, just wanted to discuss with you before BharatK sends the patch | 07:20 |
| AJaeger | Ah, now I see. | 07:20 |
| deepakcs | AJaeger, we just need the freedon to choose check Vs gate in the job name for each job | 07:20 |
| deepakcs | AJaeger, right now for devstack plugin jobs its hardcoded to gate-<name> | 07:20 |
| deepakcs | AJaeger, we want to change it to {pipeline}-<name> | 07:20 |
| deepakcs | AJaeger, and {pipeline} is defiend by the actual job template | 07:21 |
| *** punith has quit IRC | 07:21 | |
| *** tnovacik has joined #openstack-infra | 07:21 | |
| *** sarob has quit IRC | 07:22 | |
| *** ghostpl_ has quit IRC | 07:23 | |
| deepakcs | AJaeger, maybe its clear once BharatK sends a patch | 07:23 |
| AJaeger | deepakcs, go ahead and change it the way most projects setup with {pipeline} and {branch-designator} to allow usage of -nv as well, see for example how grenade-dsvm-ironic-sideways is setup in jenkins | 07:23 |
| *** scheuran has joined #openstack-infra | 07:25 | |
| *** yfried_ is now known as yfried|afk | 07:26 | |
| *** yfried|afk is now known as yfried_ | 07:26 | |
| *** michchap_ has joined #openstack-infra | 07:28 | |
| *** michchap has quit IRC | 07:28 | |
| deepakcs | AJaeger, cool, we will send the patch soon | 07:31 |
| *** hashar has joined #openstack-infra | 07:37 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Removed grunt:server https://review.openstack.org/163165 | 07:38 |
| *** che-arne has quit IRC | 07:39 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Added sane result set indicators. https://review.openstack.org/162265 | 07:42 |
| *** mrunge has joined #openstack-infra | 07:45 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Enabled eslint:no-use-before-define https://review.openstack.org/161510 | 07:46 |
| *** shardy has joined #openstack-infra | 07:48 | |
| *** che-arne has joined #openstack-infra | 07:49 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: Add neutron-aiopcpu-dvr experimental job https://review.openstack.org/163318 | 07:49 |
| *** ddieterly has joined #openstack-infra | 07:51 | |
| GheRivero | morning all | 07:52 |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Enabled eslint:space-infix-ops https://review.openstack.org/161509 | 07:53 |
| yolanda | hi | 07:53 |
| *** Somay has joined #openstack-infra | 07:54 | |
| *** coolsvap is now known as coolsvap|brb | 07:54 | |
| *** ddieterly has quit IRC | 07:56 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Enabled eslint:no-shadow https://review.openstack.org/161508 | 07:56 |
| *** otter768 has joined #openstack-infra | 07:56 | |
| *** mpaolino has joined #openstack-infra | 07:57 | |
| *** otter768 has quit IRC | 08:01 | |
| *** chlong has quit IRC | 08:01 | |
| *** gampel has quit IRC | 08:03 | |
| *** jcoufal has joined #openstack-infra | 08:04 | |
| *** markus_z has joined #openstack-infra | 08:04 | |
| *** salv-orlando has joined #openstack-infra | 08:05 | |
| *** Qiming has joined #openstack-infra | 08:06 | |
| openstackgerrit | Qiming Teng proposed openstack-infra/project-config: new-project: stackforge/senlin https://review.openstack.org/163292 | 08:06 |
| *** _shaps_ has joined #openstack-infra | 08:06 | |
| Qiming | AJaeger, thanks for the review, new patch submitted, ... hope addressed issues you pointed out | 08:07 |
| AJaeger | Qiming, thanks for the quick update. I'll review later. | 08:08 |
| AJaeger | Morning, GheRivero ! | 08:08 |
| openstackgerrit | Fatih Degirmenci proposed openstack-infra/jenkins-job-builder: Pass through git revision to triggered jobs https://review.openstack.org/163149 | 08:10 |
| *** e0ne has joined #openstack-infra | 08:11 | |
| *** koolhead_ has quit IRC | 08:12 | |
| *** _shaps_ has quit IRC | 08:13 | |
| *** salv-orlando has quit IRC | 08:15 | |
| *** mrodden has quit IRC | 08:18 | |
| *** ghostpl_ has joined #openstack-infra | 08:18 | |
| *** Somay has quit IRC | 08:18 | |
| openstackgerrit | Serg Melikyan proposed openstack-infra/project-config: Fix for gate-murano-congress-devstack-dsvm https://review.openstack.org/162971 | 08:19 |
| *** sarob has joined #openstack-infra | 08:22 | |
| *** HeOS has joined #openstack-infra | 08:23 | |
| openstackgerrit | Sumit Naiksatam proposed openstack-infra/project-config: Create experimental job for group-based-policy https://review.openstack.org/161511 | 08:23 |
| *** mrodden has joined #openstack-infra | 08:24 | |
| *** ghostpl_ has quit IRC | 08:25 | |
| *** mpaolino has quit IRC | 08:25 | |
| *** salv-orlando has joined #openstack-infra | 08:25 | |
| *** salv-orlando has quit IRC | 08:25 | |
| *** mpavone has joined #openstack-infra | 08:26 | |
| *** coolsvap|brb is now known as coolsvap | 08:26 | |
| *** sarob has quit IRC | 08:27 | |
| *** mrmartin has joined #openstack-infra | 08:28 | |
| *** mrmartin has quit IRC | 08:29 | |
| *** ildikov has joined #openstack-infra | 08:33 | |
| *** devvesa has joined #openstack-infra | 08:36 | |
| *** mpaolino has joined #openstack-infra | 08:38 | |
| *** arxcruz has joined #openstack-infra | 08:44 | |
| *** dizquierdo has joined #openstack-infra | 08:45 | |
| openstackgerrit | Teemu Patja proposed stackforge/python-jenkins: Add a get_nodes method. https://review.openstack.org/163068 | 08:47 |
| openstackgerrit | Teemu Patja proposed stackforge/python-jenkins: Add a get_nodes method https://review.openstack.org/163068 | 08:51 |
| *** ddieterly has joined #openstack-infra | 08:52 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Modifying devstack plugin job template https://review.openstack.org/163323 | 08:56 |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Adding 'check-tempest-dsvm-full-glusterfs' voting job https://review.openstack.org/163324 | 08:56 |
| *** ddieterly has quit IRC | 08:56 | |
| *** yfried_ is now known as yfried|pto | 09:01 | |
| *** jedimike has joined #openstack-infra | 09:03 | |
| *** ominakov_ has joined #openstack-infra | 09:04 | |
| *** mrmartin has joined #openstack-infra | 09:05 | |
| *** ssam2 has joined #openstack-infra | 09:05 | |
| *** jlanoux has joined #openstack-infra | 09:08 | |
| *** ujuc has quit IRC | 09:12 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-zuul: Add fetch_url parameters to zuul.conf https://review.openstack.org/162591 | 09:12 |
| *** Somay has joined #openstack-infra | 09:13 | |
| openstackgerrit | Martin Mágr proposed openstack-infra/project-config: Updated Packstack project https://review.openstack.org/163331 | 09:14 |
| *** afazekas_ has joined #openstack-infra | 09:16 | |
| *** mpaolino has quit IRC | 09:16 | |
| openstackgerrit | Martin Mágr proposed openstack-infra/project-config: puppet-openstack update https://review.openstack.org/163333 | 09:18 |
| *** ghostpl_ has joined #openstack-infra | 09:19 | |
| openstackgerrit | Martin Mágr proposed openstack-infra/project-config: puppet-openstack update https://review.openstack.org/163333 | 09:21 |
| *** mpaolino has joined #openstack-infra | 09:21 | |
| *** yfried|pto is now known as yfried|afk | 09:23 | |
| *** yfried|afk is now known as yfried|pto | 09:25 | |
| *** jistr has joined #openstack-infra | 09:25 | |
| *** hichihara has quit IRC | 09:25 | |
| *** e0ne has quit IRC | 09:27 | |
| *** kevinbenton has joined #openstack-infra | 09:27 | |
| *** ihrachyshka has joined #openstack-infra | 09:28 | |
| *** teran has quit IRC | 09:30 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 09:35 | |
| *** ghostpl_ has quit IRC | 09:35 | |
| *** ghostpl_ has joined #openstack-infra | 09:37 | |
| *** ihrachyshka has quit IRC | 09:37 | |
| *** ghostpl_ has quit IRC | 09:38 | |
| *** mpaolino has quit IRC | 09:38 | |
| *** ihrachyshka has joined #openstack-infra | 09:38 | |
| *** ghostpl_ has joined #openstack-infra | 09:41 | |
| *** salv-orlando has joined #openstack-infra | 09:44 | |
| *** _shaps_ has joined #openstack-infra | 09:45 | |
| *** ociuhandu has joined #openstack-infra | 09:45 | |
| *** claudiub has joined #openstack-infra | 09:45 | |
| *** teran has joined #openstack-infra | 09:46 | |
| *** salv-orlando has quit IRC | 09:46 | |
| *** mpaolino has joined #openstack-infra | 09:47 | |
| *** jistr has quit IRC | 09:50 | |
| *** _shaps_ has quit IRC | 09:50 | |
| *** ociuhandu has quit IRC | 09:50 | |
| *** teran has quit IRC | 09:51 | |
| *** jistr has joined #openstack-infra | 09:52 | |
| *** ociuhandu has joined #openstack-infra | 09:53 | |
| *** Qiming has quit IRC | 09:53 | |
| *** ddieterly has joined #openstack-infra | 09:53 | |
| *** yamamoto has quit IRC | 09:54 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack-infra/project-config: Ironic: Enable pxe_ipa-nv on ironic-python-agent https://review.openstack.org/163344 | 09:56 |
| *** ghostpl_ has quit IRC | 09:57 | |
| *** otter768 has joined #openstack-infra | 09:57 | |
| *** ddieterly has quit IRC | 09:58 | |
| *** bhuvan has quit IRC | 09:59 | |
| *** dizquierdo has quit IRC | 09:59 | |
| *** mfink_ has quit IRC | 10:01 | |
| Somay | Hello, can anyone review my patch here - https://review.openstack.org/#/c/163137/ | 10:01 |
| *** otter768 has quit IRC | 10:02 | |
| *** ghostpl_ has joined #openstack-infra | 10:03 | |
| *** deepakcs has quit IRC | 10:04 | |
| *** ghostpl_ has quit IRC | 10:06 | |
| *** jp_at_hp has joined #openstack-infra | 10:07 | |
| *** salv-orlando has joined #openstack-infra | 10:10 | |
| *** _nadya_ has joined #openstack-infra | 10:11 | |
| *** ghostpl_ has joined #openstack-infra | 10:11 | |
| *** ghostpl_ has quit IRC | 10:14 | |
| *** salv-orlando has quit IRC | 10:14 | |
| openstackgerrit | Teemu Patja proposed stackforge/python-jenkins: Add a get_nodes method https://review.openstack.org/163068 | 10:14 |
| *** salv-orl_ has joined #openstack-infra | 10:15 | |
| *** salv-orl_ has quit IRC | 10:15 | |
| *** e0ne has joined #openstack-infra | 10:16 | |
| *** dims has joined #openstack-infra | 10:18 | |
| *** yamamoto has joined #openstack-infra | 10:19 | |
| *** praveenkumar is now known as bloodbath | 10:22 | |
| mkoderer | hi folks, I have some issues with registering some of my team members | 10:23 |
| mkoderer | git review -s fails with "fatal: ICLA contributor agreement requires current contact information." | 10:23 |
| *** chlong has joined #openstack-infra | 10:23 | |
| mkoderer | but it's not possible to store the contact information .. we get a "Cannot store contact information" in gerrit | 10:24 |
| *** sarob has joined #openstack-infra | 10:24 | |
| *** tnovacik has quit IRC | 10:25 | |
| *** BobBall_AWOL is now known as BobBall | 10:26 | |
| *** sarob has quit IRC | 10:30 | |
| *** pc_m has joined #openstack-infra | 10:30 | |
| *** bloodbath is now known as praveenkumar | 10:31 | |
| *** che-arne has quit IRC | 10:31 | |
| *** _nadya_ has quit IRC | 10:31 | |
| *** che-arne has joined #openstack-infra | 10:31 | |
| *** teran has joined #openstack-infra | 10:37 | |
| *** jistr has quit IRC | 10:38 | |
| *** jistr has joined #openstack-infra | 10:39 | |
| *** vigneshvar has joined #openstack-infra | 10:40 | |
| *** kmartin has quit IRC | 10:41 | |
| tchaypo | I thought I remembered a feedback box on the website | 10:42 |
| *** koolhead17 has joined #openstack-infra | 10:42 | |
| tchaypo | if I could find it again I’d use it to report “a second pass just fot you” on https://www.openstack.org/summit/vancouver-2015/details-and-updates/ | 10:42 |
| *** teran has quit IRC | 10:42 | |
| *** koolhead_ has joined #openstack-infra | 10:42 | |
| *** koolhead17 has quit IRC | 10:42 | |
| *** kevinbenton has quit IRC | 10:45 | |
| *** teran has joined #openstack-infra | 10:46 | |
| *** mfink_ has joined #openstack-infra | 10:48 | |
| *** salv-orlando has joined #openstack-infra | 10:48 | |
| *** asselin has quit IRC | 10:52 | |
| *** hyakuhei has joined #openstack-infra | 10:54 | |
| *** ddieterly has joined #openstack-infra | 10:54 | |
| *** ociuhandu has quit IRC | 10:54 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Parameterize url to clone puppet modules https://review.openstack.org/163376 | 10:55 |
| hyakuhei | The security group has been loaned a pair of HSMs from HP to be used by various OpenStack projects (Anchor, Barbican, Castellan) we could probably rack them in our public cloud datacentre space but it would make more sense to get them setup with the rest of the OpenStack infrastructure - I’m not really sure who to talk to about the options/next steps? | 10:55 |
| *** ociuhandu has joined #openstack-infra | 10:56 | |
| *** bhuvan has joined #openstack-infra | 10:56 | |
| *** mrmartin has quit IRC | 10:57 | |
| *** ddieterly has quit IRC | 10:58 | |
| *** bhuvan has quit IRC | 11:01 | |
| *** claudiub has quit IRC | 11:01 | |
| mkoderer | ok https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ fixes the issue :) | 11:02 |
| *** dizquierdo has joined #openstack-infra | 11:05 | |
| *** ghostpl_ has joined #openstack-infra | 11:08 | |
| *** yamamoto has quit IRC | 11:08 | |
| *** che-arne has quit IRC | 11:12 | |
| *** claudiub has joined #openstack-infra | 11:12 | |
| *** che-arne has joined #openstack-infra | 11:13 | |
| *** ghostpl_ has quit IRC | 11:15 | |
| *** ghostpl_ has joined #openstack-infra | 11:15 | |
| *** tnovacik has joined #openstack-infra | 11:16 | |
| *** che-arne has quit IRC | 11:17 | |
| *** che-arne has joined #openstack-infra | 11:17 | |
| *** claudiub has quit IRC | 11:21 | |
| *** e0ne is now known as e0ne_ | 11:21 | |
| *** che-arne has quit IRC | 11:21 | |
| *** che-arne has joined #openstack-infra | 11:22 | |
| *** sarob has joined #openstack-infra | 11:25 | |
| *** e0ne_ is now known as e0ne | 11:26 | |
| *** che-arne has quit IRC | 11:27 | |
| *** tosky has joined #openstack-infra | 11:27 | |
| *** che-arne has joined #openstack-infra | 11:27 | |
| *** yamamoto has joined #openstack-infra | 11:29 | |
| *** dhritishikhar has joined #openstack-infra | 11:29 | |
| *** ldnunes has joined #openstack-infra | 11:30 | |
| *** sarob has quit IRC | 11:31 | |
| *** ghostpl_ has quit IRC | 11:32 | |
| *** ghostpl_ has joined #openstack-infra | 11:33 | |
| *** che-arne has quit IRC | 11:36 | |
| *** che-arne has joined #openstack-infra | 11:37 | |
| *** pelix has joined #openstack-infra | 11:39 | |
| *** dizquierdo has quit IRC | 11:39 | |
| *** dhritishikhar has quit IRC | 11:43 | |
| *** che-arne has quit IRC | 11:44 | |
| *** che-arne has joined #openstack-infra | 11:44 | |
| *** yamamoto has quit IRC | 11:46 | |
| jedimike | what's the git repo for the bandersnatch puppet module? | 11:47 |
| *** Ala has quit IRC | 11:49 | |
| *** mpaolino has quit IRC | 11:50 | |
| *** e0ne is now known as e0ne_ | 11:51 | |
| *** Ala has joined #openstack-infra | 11:51 | |
| *** ddieterly has joined #openstack-infra | 11:54 | |
| *** esker has quit IRC | 11:55 | |
| *** dizquierdo has joined #openstack-infra | 11:56 | |
| *** e0ne_ has quit IRC | 11:56 | |
| *** otter768 has joined #openstack-infra | 11:58 | |
| *** ddieterly has quit IRC | 11:59 | |
| *** otter768 has quit IRC | 12:02 | |
| *** mpaolino has joined #openstack-infra | 12:03 | |
| *** erlon has joined #openstack-infra | 12:04 | |
| *** mpaolino has quit IRC | 12:05 | |
| *** mpavone has quit IRC | 12:05 | |
| *** macjack has quit IRC | 12:07 | |
| *** vigneshvar has quit IRC | 12:07 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 12:11 | |
| *** markvoelker has joined #openstack-infra | 12:14 | |
| *** ghostpl_ has quit IRC | 12:17 | |
| mordred | jedimike: modules/openstack_project/manifests/pypi_mirror.pp | 12:18 |
| *** e0ne has joined #openstack-infra | 12:18 | |
| mordred | jedimike: in system-config | 12:18 |
| mordred | jedimike: it seems we did not split out a module for that | 12:18 |
| jedimike | mordred, so I just got daily snapshots with configurable retention policy working with bandersnatch, should I start a new module for it? | 12:19 |
| *** dprince has joined #openstack-infra | 12:20 | |
| *** aysyd has joined #openstack-infra | 12:21 | |
| *** mpavone has joined #openstack-infra | 12:21 | |
| *** ghostpl_ has joined #openstack-infra | 12:22 | |
| mordred | jedimike: yes. I think a new module for that would be the right choice | 12:23 |
| jedimike | mordred, great, we really need it for gozer. Snapshots were easy in the end, configure bandersnatch not to purge removed packages, and copy the simple index into a snapshot-${date} directory | 12:25 |
| jedimike | the retention policy just sets to keep the last n days of snapshots | 12:25 |
| *** sarob has joined #openstack-infra | 12:27 | |
| *** BharatK has quit IRC | 12:27 | |
| *** claudiub has joined #openstack-infra | 12:28 | |
| *** _shaps_ has joined #openstack-infra | 12:31 | |
| *** sarob has quit IRC | 12:31 | |
| *** dims has quit IRC | 12:33 | |
| *** pblaho has joined #openstack-infra | 12:34 | |
| *** jlanoux has quit IRC | 12:34 | |
| *** dims has joined #openstack-infra | 12:34 | |
| *** funzo has quit IRC | 12:35 | |
| *** adalbas has joined #openstack-infra | 12:36 | |
| openstackgerrit | Mike Heald proposed openstack-infra/project-config: Project for puppet-bandersnatch https://review.openstack.org/163402 | 12:36 |
| *** claudiub has quit IRC | 12:38 | |
| *** Somay has quit IRC | 12:39 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 12:39 | |
| *** dboik has joined #openstack-infra | 12:41 | |
| *** esker has joined #openstack-infra | 12:44 | |
| *** Somay has joined #openstack-infra | 12:46 | |
| *** esker has quit IRC | 12:47 | |
| *** baoli has joined #openstack-infra | 12:47 | |
| *** dboik has quit IRC | 12:49 | |
| *** esker has joined #openstack-infra | 12:50 | |
| *** esker has quit IRC | 12:51 | |
| *** yamamoto has joined #openstack-infra | 12:51 | |
| *** spredzy is now known as spredzy|Afk | 12:51 | |
| *** bswartz has quit IRC | 12:51 | |
| *** tnovacik has quit IRC | 12:52 | |
| *** baoli has quit IRC | 12:52 | |
| *** dkliban_afk is now known as dkliban | 12:52 | |
| *** baoli has joined #openstack-infra | 12:53 | |
| *** gordc has joined #openstack-infra | 12:53 | |
| *** ildikov has quit IRC | 12:57 | |
| *** tnovacik has joined #openstack-infra | 12:59 | |
| *** ddieterly has joined #openstack-infra | 13:01 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added story types https://review.openstack.org/163412 | 13:03 |
| *** hyakuhei has quit IRC | 13:03 | |
| *** mattfarina has joined #openstack-infra | 13:04 | |
| *** banix has joined #openstack-infra | 13:04 | |
| *** banix has quit IRC | 13:05 | |
| mrunge | hello, can please someone give me a helping hand? | 13:08 |
| mrunge | It's about https://review.openstack.org/#/c/155353/4 | 13:08 |
| mrunge | (raise cap for Django) | 13:08 |
| *** amotoki has quit IRC | 13:08 | |
| mrunge | that's the only change, jenkins complains afterwards about missing django_nose, which is listed in horizons test-requirements | 13:09 |
| mrunge | I'm just unsure, how to proceed from here and how to fix that. | 13:09 |
| *** esker has joined #openstack-infra | 13:10 | |
| *** ildikov has joined #openstack-infra | 13:11 | |
| *** banix has joined #openstack-infra | 13:13 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added story types https://review.openstack.org/163412 | 13:14 |
| *** amotoki has joined #openstack-infra | 13:15 | |
| *** jlanoux has joined #openstack-infra | 13:15 | |
| banix | jeblair: Any chance you can have a second look at https://review.openstack.org/#/c/162681/ | 13:15 |
| *** sdake_ has joined #openstack-infra | 13:15 | |
| *** tiswanso has joined #openstack-infra | 13:16 | |
| *** ildikov_ has joined #openstack-infra | 13:17 | |
| *** dboik has joined #openstack-infra | 13:17 | |
| *** tiswanso has quit IRC | 13:18 | |
| *** ildikov has quit IRC | 13:19 | |
| *** Longgeek has joined #openstack-infra | 13:19 | |
| *** tiswanso has joined #openstack-infra | 13:19 | |
| banix | any infra cores who could review: https://review.openstack.org/#/c/162681/ | 13:20 |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Tasks branches, milestones and projects ids https://review.openstack.org/162126 | 13:20 |
| *** cdent has joined #openstack-infra | 13:22 | |
| *** dustins has joined #openstack-infra | 13:22 | |
| *** banix has quit IRC | 13:22 | |
| *** bswartz has joined #openstack-infra | 13:25 | |
| *** peristeri has joined #openstack-infra | 13:25 | |
| fungi | mkoderer: are your associates still having trouble? see https://ask.openstack.org/question/35200 for troubleshooting suggestions | 13:25 |
| *** mriedem has joined #openstack-infra | 13:27 | |
| fungi | mkoderer: nevermind i see further down you sorted it out | 13:27 |
| *** sarob has joined #openstack-infra | 13:27 | |
| fungi | i need to link up those two questions in ask.o.o | 13:28 |
| fungi | it's too bad hyakuhei wandered off. i had already discussed his topic at a high level with someone else (mostly pointing out the challenges associated with that proposition) | 13:29 |
| *** banix has joined #openstack-infra | 13:29 | |
| *** garyh has joined #openstack-infra | 13:29 | |
| *** _nadya_ has joined #openstack-infra | 13:29 | |
| *** spredzy|Afk is now known as spredzy | 13:30 | |
| *** jcoufal has quit IRC | 13:31 | |
| *** jcoufal has joined #openstack-infra | 13:32 | |
| *** banix has quit IRC | 13:32 | |
| *** dboik has quit IRC | 13:32 | |
| *** sarob has quit IRC | 13:33 | |
| *** dboik has joined #openstack-infra | 13:33 | |
| *** dboik has quit IRC | 13:33 | |
| *** dboik has joined #openstack-infra | 13:34 | |
| *** gordc_ has joined #openstack-infra | 13:36 | |
| *** gordc has quit IRC | 13:42 | |
| mordred | fungi: I mean, yeah | 13:42 |
| mordred | fungi: even in a world where we have infra-cloud existing, it's still kinda problematic | 13:42 |
| *** tiswanso has quit IRC | 13:42 | |
| mordred | _until_ then it's impossible | 13:42 |
| *** Longgeek has quit IRC | 13:43 | |
| fungi | right, rob clark (hp, ossg ptl) e-mailed me yesterday asking who to get in touch with about it, and i laid out the challenges when i replied | 13:44 |
| fungi | mostly that we'd need the same hardware available in additional service providers, as a start, before we could really support something like that for a gating job | 13:45 |
| fungi | and i didn't even get into asking if it already had mainline kernel support | 13:46 |
| fungi | once someone from hp+barbican engaged us as a group, i figured we'd aim them at third-party testing | 13:47 |
| fungi | but wanted to see if any of the rest of the team had other suggestions | 13:47 |
| *** annegentle has joined #openstack-infra | 13:49 | |
| fungi | given that hsm/tpm hardware usually just has a defined api in the driver for interacting with it, i have to wonder why it's necessary to have the actual hardware present. seems like it wouldn't be tough to just mock if the goal is to test barbican itself | 13:49 |
| *** mrunge is now known as mrunge_bbl | 13:49 | |
| *** devvesa has quit IRC | 13:50 | |
| fungi | but i really don't have any details as to what they're trying to do with it | 13:50 |
| *** dkranz has joined #openstack-infra | 13:51 | |
| *** eharney has joined #openstack-infra | 13:55 | |
| *** Longgeek has joined #openstack-infra | 13:55 | |
| *** r-daneel has joined #openstack-infra | 13:55 | |
| *** e0ne has quit IRC | 13:57 | |
| *** e0ne has joined #openstack-infra | 13:57 | |
| *** changbl has quit IRC | 13:58 | |
| *** otter768 has joined #openstack-infra | 13:59 | |
| *** jgrimm is now known as zz_jgrimm | 14:00 | |
| *** gordc_ is now known as gordc | 14:00 | |
| *** fdegir has quit IRC | 14:00 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix for gate-murano-congress-devstack-dsvm https://review.openstack.org/162971 | 14:01 |
| *** fdegir has joined #openstack-infra | 14:01 | |
| *** otter768 has quit IRC | 14:03 | |
| *** ddieterly has quit IRC | 14:05 | |
| *** tsg_ has joined #openstack-infra | 14:05 | |
| *** tgohad has joined #openstack-infra | 14:05 | |
| *** tgohad has quit IRC | 14:05 | |
| *** ddieterl_ has joined #openstack-infra | 14:05 | |
| *** yamamoto has quit IRC | 14:05 | |
| *** yamamoto has joined #openstack-infra | 14:05 | |
| *** cody-somerville has joined #openstack-infra | 14:06 | |
| *** craigbr has joined #openstack-infra | 14:06 | |
| *** garyh has quit IRC | 14:06 | |
| *** nelsnelson has joined #openstack-infra | 14:06 | |
| openstackgerrit | Chris Dent proposed openstack/requirements: Update gabbi to 0.12.0 https://review.openstack.org/156253 | 14:07 |
| dhellmann | sabari: +2 | 14:07 |
| *** changbl has joined #openstack-infra | 14:09 | |
| *** che-arne has quit IRC | 14:10 | |
| *** che-arne has joined #openstack-infra | 14:10 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Modifying devstack plugin job template https://review.openstack.org/163323 | 14:11 |
| *** gokrokve has joined #openstack-infra | 14:13 | |
| *** ayoung is now known as ayoung_afk | 14:13 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Add FindBugs plugin support https://review.openstack.org/153911 | 14:14 |
| *** _shaps_ has quit IRC | 14:15 | |
| *** kgiusti has joined #openstack-infra | 14:20 | |
| *** hyakuhei has joined #openstack-infra | 14:20 | |
| *** salv-orlando has quit IRC | 14:23 | |
| *** timcline has joined #openstack-infra | 14:23 | |
| *** bknudson has joined #openstack-infra | 14:24 | |
| *** ildikov_ has quit IRC | 14:26 | |
| *** esker has quit IRC | 14:26 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:27 | |
| *** wenlock has joined #openstack-infra | 14:28 | |
| *** sarob has joined #openstack-infra | 14:29 | |
| *** timcline_ has joined #openstack-infra | 14:31 | |
| *** salv-orlando has joined #openstack-infra | 14:31 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Only sync parent commit once https://review.openstack.org/163451 | 14:31 |
| jeblair | tchaypo: ^ that should make a difference too | 14:32 |
| *** e0ne is now known as e0ne_ | 14:32 | |
| jeblair | fungi: i agree with everythng you said re hsm | 14:32 |
| fungi | jeblair: maybe someone from that group will stick around in irc long enough to actually hear it next time ;) | 14:33 |
| *** gokrokve_ has joined #openstack-infra | 14:33 | |
| *** banix has joined #openstack-infra | 14:33 | |
| *** sarob has quit IRC | 14:33 | |
| *** e0ne_ is now known as e0ne | 14:33 | |
| jeblair | it's okay, channel's logged | 14:34 |
| *** timcline has quit IRC | 14:34 | |
| *** eharney has quit IRC | 14:34 | |
| fungi | too true | 14:35 |
| *** Somay has quit IRC | 14:35 | |
| *** radez_g0n3 is now known as radez | 14:36 | |
| *** gokrokve has quit IRC | 14:36 | |
| *** mtanino has joined #openstack-infra | 14:36 | |
| jeblair | File "/home/corvus/git/venv/local/lib/python2.7/site-packages/requests/packages/urllib3/util/connection.py", line 87, in create_connection | 14:37 |
| jeblair | raise err | 14:37 |
| jeblair | ProtocolError: ('Connection aborted.', error(101, 'Network is unreachable')) | 14:37 |
| jeblair | so... | 14:37 |
| jeblair | requests.ProtocolError does not exist.... | 14:37 |
| jeblair | does that mean the ProtocolError returned to my app is something like requests.packages.urllib3.ProtocolError ? | 14:38 |
| *** esker has joined #openstack-infra | 14:38 | |
| clarkb | fungi https://github.com/PeterHuewe/tpm-emulator/blob/master/README | 14:38 |
| fungi | yeah, something like that | 14:39 |
| jeblair | requests.packages.urllib3.exceptions.ProtocolError | 14:40 |
| fungi | yeah, courtesy of "the vendoring" | 14:40 |
| fungi | because requests is calling its vendored urllib3 rather than whatever may be installed | 14:41 |
| clarkb | I think thats a requests bug as they are supposed to wrap all exceptions for you so the requests exception base class is base of everything | 14:41 |
| fungi | sigmavirus24 would know, if he's around | 14:41 |
| jeblair | clarkb: yeah, i was wondering if that was supposed to be invisible to me, or if the urllib3 api is part of the requests api... | 14:41 |
| sigmavirus24 | jeblair: what version? | 14:41 |
| jeblair | requests==2.4.3 | 14:42 |
| *** BharatK has joined #openstack-infra | 14:42 | |
| sigmavirus24 | Yeah that's fixed in newer ones | 14:42 |
| sigmavirus24 | urllib3 added a new exception in place of an old one without considering backwards compat so we missed it | 14:42 |
| fungi | gotta love that | 14:42 |
| jeblair | sigmavirus24: oh cool. do you know if that becomes a requests.ConnectionError ? | 14:42 |
| sigmavirus24 | It should | 14:42 |
| *** marcusvrn has joined #openstack-infra | 14:43 | |
| sigmavirus24 | jeblair: If I remember the bug correctly =) | 14:43 |
| *** mrmartin has joined #openstack-infra | 14:43 | |
| *** dboik_ has joined #openstack-infra | 14:43 | |
| *** ChuckC_ has joined #openstack-infra | 14:43 | |
| sigmavirus24 | fungi: why do you think Cory and I have become far more involved in urllib3? | 14:43 |
| jeblair | sigmavirus24: ok, so i should just need a version bump, thanks | 14:43 |
| fungi | heh | 14:43 |
| *** _shaps_ has joined #openstack-infra | 14:43 | |
| sigmavirus24 | It's my perpetual problem that I need to become further involved in the dependencies of the projects I maintain | 14:43 |
| fungi | speaking of... | 14:43 |
| fungi | hashar: who's managing the etherpad instance for wmf? | 14:44 |
| *** ChuckC has quit IRC | 14:44 | |
| jeblair | sigmavirus24: there is an end in sight! somewhere around the c compiler and assembler... | 14:44 |
| *** wenlock has quit IRC | 14:44 | |
| *** wenlock has joined #openstack-infra | 14:44 | |
| sigmavirus24 | jeblair: nah, will need to start working on the kernel with it's code of conflict now =P | 14:44 |
| fungi | hashar: i've volunteered to help etherpad upstream get cves for their security vulnerabilities and announce them in better ways than twitter and a blog, and was goign to see if anyone from wmf and/or mofo wanted to pitch in too | 14:44 |
| *** craigbr has quit IRC | 14:44 | |
| *** marcusvrn1 has quit IRC | 14:45 | |
| *** claudiub has joined #openstack-infra | 14:45 | |
| *** dboik has quit IRC | 14:46 | |
| *** tonytan4ever has joined #openstack-infra | 14:46 | |
| jeblair | fungi: that's awesome | 14:46 |
| jeblair | fungi: did you connect with them on irc or mail or...? | 14:47 |
| fungi | irc | 14:47 |
| fungi | and then via e-mail to confirm contact info | 14:47 |
| hashar | fungi: let me find :) | 14:47 |
| fungi | the primary contributor for etherpad is fairly active in #etherpad | 14:47 |
| fungi | on freenode | 14:47 |
| jeblair | there's also an #etherpad-lite-dev, know anything about it? | 14:48 |
| clarkb | any additional testing on etherpad-dev people want to do before I propose an update? | 14:48 |
| *** ChuckC_ has quit IRC | 14:49 | |
| jeblair | clarkb: it looked good to me | 14:49 |
| *** nelsnelson has quit IRC | 14:49 | |
| hashar | iirc there is a version that depends on libreoffice and whatever language, and another version which is a rewrite using nodejs | 14:49 |
| fungi | yeah, seems to be working fine | 14:49 |
| hashar | though dont quote me on that :) | 14:49 |
| *** nelsnelson has joined #openstack-infra | 14:50 | |
| clarkb | fungi ya I think #etherpad is not the one we use unless etherpad-lite moved in there | 14:50 |
| fungi | hashar: the etherpad-lite nodejs rewrite has basically supplanted the old google app thing | 14:50 |
| jeblair | i think they may have | 14:50 |
| jeblair | 14:47 -!- Topic for #etherpad: The Etherpad Foundation - Devs in #etherpad-lite-dev - http://etherpad.org | 14:50 |
| hashar | sounds good | 14:50 |
| fungi | clarkb: it's all one now apparently | 14:50 |
| clarkb | I see | 14:50 |
| jeblair | there is no etherpad but etherpad-lite | 14:51 |
| fungi | afaict the old etherpad is dead | 14:51 |
| *** _shaps_ has quit IRC | 14:52 | |
| *** carl_baldwin has joined #openstack-infra | 14:52 | |
| *** yfried|pto is now known as yfried|afk | 14:52 | |
| *** cody-somerville has quit IRC | 14:53 | |
| hashar | fungi: you can poke security@wikimedia.org which spams the appropriate persons. Add in "Alexandros Kosiaris <akosiaris@wikimedia.org>" who did our Debian package | 14:53 |
| fungi | hashar: thanks | 14:53 |
| *** funzo has joined #openstack-infra | 14:53 | |
| hashar | fungi: our package is obviously on our Gerrit https://gerrit.wikimedia.org/r/#/q/project:operations/debs/etherpad-lite,n,z | 14:53 |
| *** zz_jgrimm is now known as jgrimm | 14:55 | |
| hashar | meanwhile, I had an ugly debian package for Zuul :] Based on Paul Belanger work from last year | 14:55 |
| *** marcusvrn1 has joined #openstack-infra | 14:56 | |
| *** marcusvrn has quit IRC | 14:58 | |
| *** yfried|afk is now known as yfried|pto | 14:59 | |
| *** yamamoto has quit IRC | 15:00 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Deploy latest version of etherpad-lite https://review.openstack.org/163467 | 15:00 |
| *** dangers_away is now known as dangers | 15:00 | |
| clarkb | something like ^ I am not entirely sure if that will update the git repo properly :/ I really don't want to ensure => latest on a specific commit if I can avoid it | 15:00 |
| clarkb | I can construct a test case with puppet to test though | 15:01 |
| clarkb | hashar: do you know what node.js you run for that? | 15:02 |
| *** stevemar has joined #openstack-infra | 15:02 | |
| *** dannywilson has joined #openstack-infra | 15:02 | |
| *** dannywilson has quit IRC | 15:02 | |
| jeblair | clarkb: are you sure you don't want to ensure latest develop branch? | 15:03 |
| *** marcusvrn1 has quit IRC | 15:03 | |
| *** dannywilson has joined #openstack-infra | 15:03 | |
| jeblair | perhaps you don't want to risk an upgrade during a summit? | 15:03 |
| clarkb | jeblair: ya, I think we want latest develop on the -dev server then we can pick from that if things work | 15:03 |
| fungi | clarkb: any reason not to stick with 1.5.1? | 15:03 |
| hashar | clarkb: probably 0.8 from Precise. | 15:03 |
| *** eharney has joined #openstack-infra | 15:03 | |
| clarkb | jeblair: otherwise we may end up with broken during important times | 15:04 |
| clarkb | hashar: precise has 0.6 I thought? | 15:04 |
| clarkb | fungi: tested latest commit, if we want to test specific releases we can do that too | 15:04 |
| fungi | they do seem to be tagging releases with some regularity now https://github.com/ether/etherpad-lite/tags | 15:04 |
| *** jcoufal has quit IRC | 15:05 | |
| *** jcoufal has joined #openstack-infra | 15:05 | |
| clarkb | oddly git describe says we are on 1.5.0-stuff | 15:05 |
| jeblair | clarkb: an alternative would be to run develop always and freeze before summits and unfreeze after. but your process works for me, esp if they will start issuing cves. | 15:05 |
| fungi | but yeah, tracking develop tip seems fine too | 15:06 |
| fungi | and we have some control if we manually update the explicit commit | 15:06 |
| hashar | clarkb: yeah 0.6.12, but we have backported 0.8.x to Precise | 15:06 |
| clarkb | but 1.5.1 is merged into develop so likely just not tagged properly | 15:06 |
| clarkb | hashar: I see | 15:07 |
| *** banix has quit IRC | 15:07 | |
| *** armax has joined #openstack-infra | 15:07 | |
| *** fdegir1 has joined #openstack-infra | 15:08 | |
| *** marcusvrn has joined #openstack-infra | 15:09 | |
| ttx | sabari: done | 15:09 |
| *** craigbr has joined #openstack-infra | 15:09 | |
| *** fdegir has quit IRC | 15:09 | |
| *** vponomaryov has left #openstack-infra | 15:11 | |
| *** vponomaryov has joined #openstack-infra | 15:11 | |
| *** banix has joined #openstack-infra | 15:12 | |
| *** kmartin has joined #openstack-infra | 15:12 | |
| *** fdegir1 has quit IRC | 15:13 | |
| *** dizquierdo has quit IRC | 15:13 | |
| *** marcusvrn has quit IRC | 15:14 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Upgrade to requests 2.5.3 https://review.openstack.org/163473 | 15:14 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add a 30 second timeout for requests https://review.openstack.org/163474 | 15:14 |
| jeblair | i'm hoping that last change will help with gertty being hung on network traffic when you close your laptop and leave the conference wifi in the middle of a sync | 15:15 |
| *** ChuckC_ has joined #openstack-infra | 15:16 | |
| *** banix has quit IRC | 15:16 | |
| *** banix has joined #openstack-infra | 15:17 | |
| *** carl_baldwin has quit IRC | 15:18 | |
| *** bhuvan has joined #openstack-infra | 15:19 | |
| *** teran has quit IRC | 15:20 | |
| *** teran has joined #openstack-infra | 15:20 | |
| *** craigbr has quit IRC | 15:21 | |
| fungi | that almost sounds like a bug you've experienced personally ;) | 15:21 |
| *** tiswanso has joined #openstack-infra | 15:21 | |
| *** craigbr has joined #openstack-infra | 15:23 | |
| *** zz_dimtruck is now known as dimtruck | 15:24 | |
| *** _shaps_ has joined #openstack-infra | 15:25 | |
| *** dizquierdo has joined #openstack-infra | 15:25 | |
| *** ujuc has joined #openstack-infra | 15:25 | |
| *** gokrokve_ has quit IRC | 15:27 | |
| *** hogepodge has quit IRC | 15:28 | |
| *** david-lyle_afk is now known as david-lyle | 15:28 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Overdue update for the ironic project group https://review.openstack.org/159680 | 15:29 |
| *** sarob has joined #openstack-infra | 15:30 | |
| *** mtanino is now known as mtanino_away | 15:30 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Deactivate jpeeler from Heat core https://review.openstack.org/160200 | 15:30 |
| *** garyh has joined #openstack-infra | 15:31 | |
| *** unicell1 has joined #openstack-infra | 15:35 | |
| *** ildikov_ has joined #openstack-infra | 15:35 | |
| *** cody-somerville has joined #openstack-infra | 15:35 | |
| *** cody-somerville has quit IRC | 15:35 | |
| *** cody-somerville has joined #openstack-infra | 15:35 | |
| *** sarob has quit IRC | 15:36 | |
| *** unicell has quit IRC | 15:36 | |
| *** maune has quit IRC | 15:37 | |
| *** Sukhdev has joined #openstack-infra | 15:37 | |
| *** che-arne has quit IRC | 15:38 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run nodepool-coverage as a check job https://review.openstack.org/163237 | 15:38 |
| *** mpaolino has joined #openstack-infra | 15:38 | |
| *** mpaolino has quit IRC | 15:39 | |
| *** dannywilson has quit IRC | 15:40 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/zuul: Add a dequeue command https://review.openstack.org/95035 | 15:40 |
| *** rfolco_ has joined #openstack-infra | 15:41 | |
| *** mpaolino has joined #openstack-infra | 15:41 | |
| *** deepakcs has joined #openstack-infra | 15:41 | |
| fungi | dstufft: mrmartin: see results of testing https://review.openstack.org/163228 at https://www.ssllabs.com/ssltest/analyze.html?d=openstackid.org | 15:41 |
| *** afazekas_ has quit IRC | 15:42 | |
| *** ashleighfarnham has joined #openstack-infra | 15:42 | |
| fungi | dstufft: mrmartin: so ie<11 and windows phone up to 8.1 are broken. no idea if we care? | 15:43 |
| *** rfolco has quit IRC | 15:44 | |
| *** Longgeek has quit IRC | 15:45 | |
| *** marcusvrn has joined #openstack-infra | 15:45 | |
| *** dboik_ has quit IRC | 15:47 | |
| *** marcusvrn1 has joined #openstack-infra | 15:47 | |
| *** dboik has joined #openstack-infra | 15:47 | |
| *** tosky has quit IRC | 15:48 | |
| *** mpaolino has quit IRC | 15:49 | |
| *** marcusvrn has quit IRC | 15:49 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Display times in local tz https://review.openstack.org/163494 | 15:50 |
| *** tosky has joined #openstack-infra | 15:52 | |
| *** unicell1 has quit IRC | 15:52 | |
| *** marcusvrn has joined #openstack-infra | 15:52 | |
| jeblair | fungi: ^ i don't think that change will affect you since your local tz is set to utc. but i added an option for people like me (possible set size of 1) who have their clocks set to government issued timezones but still want gerrit times displayed in utc (the current behavior) | 15:53 |
| fungi | jeblair: i'll take it for a spin anyway | 15:53 |
| *** marcusvrn1 has quit IRC | 15:54 | |
| *** coolsvap is now known as coolsvap|afk | 15:54 | |
| mrmartin | fungi: what is broken? the output of openstackid.org ? | 15:55 |
| *** rwsu-afk is now known as rwsu | 15:55 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/zuul: Add a dequeue command https://review.openstack.org/95035 | 15:55 |
| *** hdd_ has joined #openstack-infra | 15:55 | |
| *** armax has quit IRC | 15:55 | |
| *** armax has joined #openstack-infra | 15:55 | |
| fungi | mrmartin: if we permanently implement dstufft's hardening proposal in 163228 then internet explorer before 11 won't work with openstackid.org (for lack of ssl agreement in https), and internet explorer on windows phone before 8.1 similarly | 15:57 |
| fungi | mrmartin: so basically asking for input weighing the cost vs benefit | 15:57 |
| mrmartin | fungi: and what you suggest? We need to apply this ssl patch for groups portal too | 15:57 |
| anteaya | ihrachyshka: you submitting to the third-party-announce mailing list yesterday and I replied to you and asked for two changes in the submission, are you going to resubmit | 15:58 |
| anteaya | submitted | 15:58 |
| fungi | mrmartin: i have a feeling very few people using our services use internet explorer, so not supporting fairly old internet explorer releases seems like an acceptable compromise to me, but i haven't actually analyzed browser strings in our apache access logs to find out. i should probably do that now | 15:59 |
| openstackgerrit | Merged openstack/requirements: Bump glance_store to latest version https://review.openstack.org/163121 | 15:59 |
| mrmartin | fungi, give minute, I have access some google analytics | 15:59 |
| ihrachyshka | anteaya, hm? I haven't seen anything... | 15:59 |
| *** otter768 has joined #openstack-infra | 16:00 | |
| *** katyafervent is now known as katyafervent_awa | 16:00 | |
| *** yamahata has joined #openstack-infra | 16:00 | |
| ihrachyshka | anteaya, was it smth in public? | 16:00 |
| *** ashleighfarnham has quit IRC | 16:00 | |
| mrmartin | we have 41% for IE | 16:00 |
| openstackgerrit | Merged openstack-infra/project-config: Set experimental pipeline precedence to 'normal' https://review.openstack.org/163101 | 16:00 |
| *** patrickeast has joined #openstack-infra | 16:00 | |
| fungi | mrmartin: any feeling for what ie versions? like 10 and older? | 16:01 |
| *** purp_away has quit IRC | 16:01 | |
| mrmartin | and just 25% of Internet Explorer traffic is < 11 | 16:01 |
| mrmartin | so not | 16:01 |
| mrmartin | so just the 25% is Internet Explorer 11 | 16:01 |
| *** purp_2 has joined #openstack-infra | 16:01 | |
| mrmartin | it means, around 30% is using IE < v11 | 16:01 |
| anteaya | ihrachyshka: I rejected you post and left you a reply | 16:02 |
| hashar | fungi: mediawiki has a concept of browser grades. http://www.mediawiki.org/wiki/Compatibility Full support is IE 8+ | 16:02 |
| anteaya | my expectation is that you recieve a reply | 16:02 |
| *** hyakuhei has quit IRC | 16:02 | |
| *** purp_2 is now known as purp | 16:02 | |
| dstufft | fungi: hm | 16:02 |
| dstufft | futhat's not right | 16:02 |
| hashar | fungi: we deprecated support for IE 6 / IE 7 in the last release. (that is from a top 10 website) | 16:03 |
| *** sarob has joined #openstack-infra | 16:03 | |
| mrmartin | yeah, but if the ssl patch broke under IE11, i guess it's a problem | 16:03 |
| dstufft | precise should have all of those ciphers (at least openssl ciphers did) | 16:03 |
| ihrachyshka | anteaya, have you? http://lists.openstack.org/pipermail/third-party-announce/2015-March/000168.html | 16:03 |
| dstufft | one moment | 16:03 |
| anteaya | well I did | 16:04 |
| *** katyafervent_awa is now known as katyafervent | 16:04 | |
| anteaya | I did't approve it | 16:04 |
| openstackgerrit | Assaf Muller proposed openstack/requirements: Pin pylint to 1.4.1 https://review.openstack.org/163506 | 16:04 |
| *** otter768 has quit IRC | 16:04 | |
| anteaya | since in my reply I pointed out that the top paragraph didn't accurately convey the purpose of the mailing list | 16:04 |
| *** thedodd has joined #openstack-infra | 16:04 | |
| anteaya | which third party people get very very confused about | 16:04 |
| anteaya | so your characterization didn't help | 16:04 |
| dstufft | fungi: oh, it's apache2's fault >:[ | 16:05 |
| anteaya | so I had asked you to change or delete it | 16:05 |
| dstufft | apache2 on precise didn't have ECDHE | 16:05 |
| fungi | yeah, that's fairly new for apache (2.4.x iirc) | 16:05 |
| *** hyakuhei has joined #openstack-infra | 16:05 | |
| mrmartin | so, upgrade everything to trusty? | 16:05 |
| *** jlanoux has quit IRC | 16:06 | |
| fungi | eventually sure | 16:06 |
| fungi | for now, we can probably scale back that change to remove fewer options | 16:06 |
| dstufft | lemme see what non ECDHE ciphers those support | 16:06 |
| anteaya | ihrachyshka: it isn't a list where third party people hang out | 16:07 |
| hashar | wikimedia has worked on the ssl ciphersuite already. I can probably find you some ciphers chains that works for us | 16:07 |
| anteaya | ihrachyshka: it is a list for announcement pertainent to third party operators from infra | 16:07 |
| dstufft | ok, it supports AES+128 | 16:07 |
| dstufft | so just need to add those in | 16:07 |
| dstufft | patch incoming | 16:08 |
| ihrachyshka | anteaya, ok, is there any problem beyond wording? the email was probably approved, since it's in archives, so I guess we don't revert it for wording reasons. | 16:08 |
| fungi | anteaya: ihrachyshka: right, we encourage third-party ci operators to subscribe to that ml so that they can be reached en masse, since we doubt they pay attention to higher-volume lists like openstack-dev | 16:08 |
| clarkb | sdague: where do I put that xml file with the custom cpu model? I am digging in libvirt docs and not finding much | 16:09 |
| anteaya | they don't pay attention to anything | 16:09 |
| dstufft | fungi: oh did you apply the patch w/o merging? | 16:09 |
| fungi | dstufft: temporarily by hand yes | 16:09 |
| *** cody-somerville has quit IRC | 16:09 | |
| *** marun has joined #openstack-infra | 16:09 | |
| ihrachyshka | fungi, ok, so is there any problem that requires an *action* from me (not just regret due to apparently bad wording)? | 16:10 |
| fungi | anteaya: ihrachyshka: but i wouldn't say it's only for infra to contact them, just that the infra team has had the most frequent need to do so | 16:10 |
| hashar | ah cipher suite we use: http://git.wikimedia.org/blob/operations%2Fpuppet.git/8cee69479c2502745374150ca559ca21e18318d5/modules%2Fwmflib%2Flib%2Fpuppet%2Fparser%2Ffunctions%2Fssl_ciphersuite.rb#L49 | 16:10 |
| *** enikanorov__ has joined #openstack-infra | 16:10 | |
| anteaya | ihrachyshka: the nature of the post is fine, the contextulization of why it is there is misleading | 16:10 |
| *** enikanorov has quit IRC | 16:10 | |
| anteaya | and I have found any pothole in the road collects quite a few who then expect to be dug out | 16:11 |
| *** ominakov_ has quit IRC | 16:11 | |
| *** ashleighfarnham has joined #openstack-infra | 16:11 | |
| *** ominakov_ has joined #openstack-infra | 16:11 | |
| anteaya | and they expect infra to do the digging | 16:11 |
| dstufft | fungi: ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:RSA+AESGCM:RSA+AES:!AES256:!aNULL:!eNULL:!MD5:!DSS:!PSK:!SRP | 16:11 |
| ihrachyshka | anteaya, then that's the problem, their attitude. | 16:11 |
| dstufft | fungi: can you try that? | 16:11 |
| *** mescanef_ has joined #openstack-infra | 16:12 | |
| clarkb | sdague: it looks like virsh can list them but not define them? | 16:12 |
| anteaya | ihrachyshka: if you can change that I'll buy you beer | 16:12 |
| anteaya | ihrachyshka: I've been working on that for over a year | 16:12 |
| anteaya | ihrachyshka: you have a magic wand that does the job and the job is all yours | 16:12 |
| *** rossella_s has quit IRC | 16:12 | |
| fungi | dstufft: thanks, i'm retesting now with that in place | 16:12 |
| anteaya | fungi: and yes that is fair, but it also isn't for the world | 16:12 |
| hashar | dstufft: i commented on your change with some links https://review.openstack.org/#/c/163228/2/templates/vhost.erb,unified | 16:13 |
| fungi | anteaya: agreed, hence the moderation | 16:13 |
| *** jvrbanac has quit IRC | 16:13 | |
| *** erikmwilson has quit IRC | 16:13 | |
| *** markmcclain has quit IRC | 16:13 | |
| *** jlk has quit IRC | 16:13 | |
| *** d34dh0r53 has quit IRC | 16:13 | |
| *** Ng has quit IRC | 16:13 | |
| *** mescanef has quit IRC | 16:13 | |
| *** briancurtin has quit IRC | 16:13 | |
| *** sdake__ has joined #openstack-infra | 16:13 | |
| *** esheffield__ has joined #openstack-infra | 16:13 | |
| anteaya | ihrachyshka: my current strategy is to be very careful in word usage around them, so that when they fall down and flail they can ask for help but we are not obliged to dig them out | 16:14 |
| *** matt__ has joined #openstack-infra | 16:14 | |
| *** wendar_ has joined #openstack-infra | 16:14 | |
| *** marcusvrn has quit IRC | 16:14 | |
| *** comstud has quit IRC | 16:14 | |
| *** freyes has quit IRC | 16:14 | |
| *** esheffield_ has quit IRC | 16:14 | |
| *** ttx has quit IRC | 16:14 | |
| *** lbragstad has quit IRC | 16:14 | |
| *** stevebaker has quit IRC | 16:14 | |
| *** odyssey4me has quit IRC | 16:14 | |
| *** jroll has quit IRC | 16:14 | |
| *** edwarnicke has quit IRC | 16:14 | |
| *** mpavone has quit IRC | 16:14 | |
| *** marcusvrn has joined #openstack-infra | 16:14 | |
| anteaya | their interpretation of words is not my interpretation | 16:14 |
| *** AJaeger has quit IRC | 16:14 | |
| *** Nakato has quit IRC | 16:14 | |
| *** cyeoh has quit IRC | 16:14 | |
| *** wendar has quit IRC | 16:14 | |
| *** mattoliverau has quit IRC | 16:14 | |
| *** rainya has quit IRC | 16:14 | |
| *** gus has quit IRC | 16:14 | |
| *** russellb has quit IRC | 16:14 | |
| *** dolphm has quit IRC | 16:14 | |
| *** zigo_ has quit IRC | 16:14 | |
| *** zigo_ has joined #openstack-infra | 16:14 | |
| anteaya | but through observation I have learned how they think | 16:14 |
| *** asselin_ has quit IRC | 16:14 | |
| dstufft | hashar: thanks, I'm pretty familar with what supports what ciphers browser wise, I just don't use apache2 to terminate TLS so I didn't think to check whether apache2 supported ECDHE or not | 16:15 |
| fungi | dstufft: mrmartin: yep, that works better. now we only lose internet explorer on windows xp as originally proposed | 16:15 |
| *** erikmwilson has joined #openstack-infra | 16:15 | |
| *** russellb has joined #openstack-infra | 16:15 | |
| *** d34dh0r53 has joined #openstack-infra | 16:15 | |
| *** markmcclain has joined #openstack-infra | 16:15 | |
| mrmartin | ok, I don't care XP, it is EOL | 16:15 |
| *** jlk has joined #openstack-infra | 16:15 | |
| *** jlk has joined #openstack-infra | 16:15 | |
| *** dolphm has joined #openstack-infra | 16:15 | |
| *** jroll has joined #openstack-infra | 16:15 | |
| hashar | dstufft: wikimedia uses nginx as SSL terminator iirc, seems the function take care of it. | 16:15 |
| *** rainya has joined #openstack-infra | 16:15 | |
| *** asselin_ has joined #openstack-infra | 16:15 | |
| *** lbragstad has joined #openstack-infra | 16:15 | |
| clarkb | jogo: do you know where to dump the xml to define a custom cpu model? | 16:15 |
| *** comstud has joined #openstack-infra | 16:15 | |
| fungi | if people really want to run windows xp they can install a browser which isn't ie 8 | 16:15 |
| hashar | dstufft: I dont have much knowledge about it though :/ | 16:15 |
| *** cyeoh has joined #openstack-infra | 16:16 | |
| clarkb | jogo: I am trying to write the change to use amd64 with migration testing | 16:16 |
| *** bdpayne has joined #openstack-infra | 16:16 | |
| ihrachyshka | anteaya, I probably miss a lot of context around 3 party people, so I still don't see any actionable items my side to improve the email. maybe you can just reply to the thread to correct anything that is wrong there? | 16:16 |
| *** stevebaker has joined #openstack-infra | 16:16 | |
| *** Nakato has joined #openstack-infra | 16:16 | |
| *** gus has joined #openstack-infra | 16:16 | |
| clarkb | all of the libvirt docs I have are for the VMs not the cpu models itself | 16:16 |
| *** ttx has joined #openstack-infra | 16:16 | |
| *** odyssey4me has joined #openstack-infra | 16:16 | |
| *** scheuran has quit IRC | 16:16 | |
| *** jvrbanac has joined #openstack-infra | 16:16 | |
| *** jroll has quit IRC | 16:16 | |
| *** jroll has joined #openstack-infra | 16:16 | |
| *** AJaeger has joined #openstack-infra | 16:16 | |
| *** AJaeger has joined #openstack-infra | 16:16 | |
| *** rossella_s has joined #openstack-infra | 16:16 | |
| *** hashar is now known as hasharOut | 16:16 | |
| *** freyes has joined #openstack-infra | 16:17 | |
| *** sdake_ has quit IRC | 16:17 | |
| fungi | dstufft: were you going to update 163228 to that string, or should i? | 16:17 |
| dstufft | fungi: I'll update the patch, FWIW i recommend either geting onto trusty, or using something other than apache to terminate SSL | 16:17 |
| dstufft | not having ECDHE slows things not, DHE is a lot slower to handshake than ECDHE | 16:17 |
| fungi | dstufft: yeah, both good ideas, but this is an excellent interim improvement | 16:18 |
| dstufft | plus you lose the guarentee of PFS with the updated cipher string | 16:18 |
| anteaya | ihrachyshka: what I am saying is that in future please be aware that the third party folks have their own unique interpretation of how they view the world | 16:18 |
| *** annegentle has quit IRC | 16:18 | |
| clarkb | unfortunately danpb's blog also suggests throwing it on the VM directly | 16:18 |
| anteaya | ihrachyshka: and to avoid them heading here to fix things they don't understand perhaps a brief conversation between you and infra might be helpful | 16:19 |
| clarkb | maybe I am lookig in the wrong place and I need nova to put it on the VM for us | 16:19 |
| *** briancurtin has joined #openstack-infra | 16:19 | |
| anteaya | ihrachyshka: fixing the email now just makes it worse, if there is any fallout I'll address it | 16:19 |
| *** cody-somerville has joined #openstack-infra | 16:19 | |
| ihrachyshka | anteaya, ack, will do (reach infra next time0 | 16:19 |
| anteaya | ihrachyshka: thank you | 16:20 |
| *** rlandy has quit IRC | 16:20 | |
| *** Ng has joined #openstack-infra | 16:20 | |
| *** tnovacik has quit IRC | 16:20 | |
| dstufft | fungi: fwiw Apache2 doesn't support configurable dh params either, which means DHE is limited to 1024 bits (it's better to have 2048 bits, but jumping to 2048 bits means you lose java 6u45, again, dunno if you care) - here's show support for ciphers when using trusty and haproxy -> https://www.ssllabs.com/ssltest/analyze.html?d=hg.python.org | 16:20 |
| *** sarob has quit IRC | 16:21 | |
| dstufft | (that's basically the best possible config for security that doesn't lose massives amounts of compatability) | 16:21 |
| fungi | dstufft: excellent reference--thanks | 16:21 |
| *** tnovacik has joined #openstack-infra | 16:22 | |
| *** edwarnicke has joined #openstack-infra | 16:22 | |
| *** marcusvrn1 has joined #openstack-infra | 16:22 | |
| *** sarob has joined #openstack-infra | 16:22 | |
| clarkb | isn't java6 also EOL? | 16:22 |
| *** marcusvrn has quit IRC | 16:23 | |
| openstackgerrit | Donald Stufft proposed openstack-infra/puppet-openstackid: Use a set of secure ciphers optimizing for security and performance https://review.openstack.org/163228 | 16:23 |
| dstufft | clarkb: I believe so yes, I personally don't care about support for java6, but it doesn't really matter unless you stop using apache2 to terminate TLS since apache2 doesn't support adjustable DH params | 16:24 |
| *** gokrokve has joined #openstack-infra | 16:25 | |
| *** marcusvrn has joined #openstack-infra | 16:25 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Try to calculate common CPU feature set https://review.openstack.org/163514 | 16:26 |
| dstufft | fungi: oh, I added a SSLHonorCipherOrder onto that patch too | 16:26 |
| *** esker has quit IRC | 16:26 | |
| *** tiswanso has quit IRC | 16:26 | |
| *** MarkAtwood has joined #openstack-infra | 16:26 | |
| dstufft | fungi: that'll make it so that the servers' preference for order is used instead of the client, so that we negioate the strongest supported cipher, not just whatever the client put first | 16:26 |
| clarkb | jogo: sdague ^ that won't work as is because it doesn't communicate to kvm/libvirt/qemu/nova what the cpu model is but I think it has the general shape of the thing | 16:26 |
| *** SumitNaiksatam has joined #openstack-infra | 16:27 | |
| *** tiswanso has joined #openstack-infra | 16:27 | |
| fungi | dstufft: sounds great--thanks! | 16:27 |
| *** marcusvrn1 has quit IRC | 16:27 | |
| *** dboik_ has joined #openstack-infra | 16:27 | |
| *** gokrokve has quit IRC | 16:27 | |
| fungi | dstufft: the additional comment is very helpful there too | 16:27 |
| dstufft | (for better or worse, I know some things about TLS) | 16:27 |
| *** emagana has quit IRC | 16:28 | |
| clarkb | dstufft: sure, its just odd that so much care goes into supporting platforms which are unsupported by their authors | 16:28 |
| zaro | morning | 16:28 |
| dstufft | I use HAProxy to terminate TLS on the PFS infra, <3 dynamic record size | 16:28 |
| fungi | dstufft: yeah, i know far more than i wish i did ;) | 16:28 |
| *** emagana has joined #openstack-infra | 16:28 | |
| dstufft | start with a small record size to optimize for TTFB, and thne it scales up the record size as data is transfered on the connection to maximize for throughput | 16:29 |
| *** dboik has quit IRC | 16:31 | |
| *** hodos has joined #openstack-infra | 16:31 | |
| anteaya | morning zaro | 16:31 |
| *** gokrokve_ has joined #openstack-infra | 16:31 | |
| hodos | does any1 have problem with nodepool cycling with message: No current image for | 16:31 |
| hodos | and doing nothing | 16:31 |
| *** spredzy is now known as spredzy|afk | 16:32 | |
| *** mtanino_away has quit IRC | 16:32 | |
| *** emagana has quit IRC | 16:33 | |
| clarkb | hodos: check if you have building images `nodepool image-list` | 16:33 |
| clarkb | hodos: if there are no available images then no nodes can be built and you will have to wait for building to complete (and possibly fix broken image builds) | 16:33 |
| *** sdake_ has joined #openstack-infra | 16:33 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Upgrade to requests 2.5.3 https://review.openstack.org/163473 | 16:34 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add a 30 second timeout for requests https://review.openstack.org/163474 | 16:34 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Display times in local tz https://review.openstack.org/163494 | 16:34 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Only sync parent commit once https://review.openstack.org/163451 | 16:34 |
| dstufft | fungi: oh, and the WEAK on those ciphers in ssllabs is, I beleive, entirely because the DH params are only 1024 bit. The ciphers themselves are perfectly fine. | 16:34 |
| *** tonytan4ever has quit IRC | 16:34 | |
| fungi | yeah, i figured as much | 16:35 |
| hodos | clarkb: yes, it says 'building' for the image i need. but the age of the state is 5 hours | 16:37 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Upgrade to requests 2.5.3 https://review.openstack.org/163473 | 16:37 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add a 30 second timeout for requests https://review.openstack.org/163474 | 16:37 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Display times in local tz https://review.openstack.org/163494 | 16:37 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Only sync parent commit once https://review.openstack.org/163451 | 16:37 |
| *** sdake__ has quit IRC | 16:37 | |
| clarkb | hodos: I would check the image build log and dig into why its not building | 16:38 |
| hodos | clarkb: thanks, i'll try to rebuild | 16:39 |
| *** unicell has joined #openstack-infra | 16:40 | |
| openstackgerrit | James E. Blair proposed openstack-infra/gear: Add SSL functional test https://review.openstack.org/143235 | 16:40 |
| *** dizquierdo has quit IRC | 16:41 | |
| openstackgerrit | Merged openstack-infra/system-config: Enable logging of #openstack-nova https://review.openstack.org/156979 | 16:43 |
| *** ayoung_afk is now known as ayoung | 16:44 | |
| *** hyakuhei has quit IRC | 16:45 | |
| *** Longgeek has joined #openstack-infra | 16:45 | |
| *** weshay has quit IRC | 16:45 | |
| jeblair | sdague, fungi, clarkb: I just approved 161796; once it lands, we can land 161797 but it has no reviews | 16:45 |
| *** weshay has joined #openstack-infra | 16:46 | |
| anteaya | fungi: have you had a chance to formulate any thoughts on my proposal to scale the self-nomination process for elections? | 16:46 |
| *** craigbr has quit IRC | 16:46 | |
| anteaya | tristanC ttx: https://etherpad.openstack.org/p/scaling-election-tooling | 16:47 |
| *** hyakuhei has joined #openstack-infra | 16:47 | |
| jeblair | mtreinish: i was thinking that the trove tempest job could now be reduced to running only trove-relevant tests. do you agree? if so, how do i go about doing that? | 16:47 |
| anteaya | fungi: I see you are in the etherpad which is what prompted my question | 16:47 |
| *** yfried|pto is now known as yfried|afk | 16:47 | |
| clarkb | jeblair: you are removing trove from devstack enabled services on all branches and running the new test on all branches as voting. Do we expect icehouse and juno to work that way? | 16:48 |
| *** asselin__ has joined #openstack-infra | 16:48 | |
| *** carl_baldwin has joined #openstack-infra | 16:48 | |
| jeblair | clarkb: i believe they do now (which makes sense to me as trove has been around for a while) | 16:49 |
| openstackgerrit | Merged openstack-infra/project-config: Fix propose-project-config-update job https://review.openstack.org/163135 | 16:49 |
| *** hyakuhei has quit IRC | 16:50 | |
| *** hyakuhei has joined #openstack-infra | 16:51 | |
| *** craigbr has joined #openstack-infra | 16:51 | |
| *** sabeen has joined #openstack-infra | 16:51 | |
| mtreinish | jeblair: from the jjb job definition just set the DEVSTACK_GATE_TEMPEST_REGEX="database" that will run all the tests that are tagged as using trove (with the "database" tag) | 16:51 |
| fungi | jeblair: sdague: do we need SlickNik to acknowledge 161797 before approving? | 16:51 |
| *** andreykurilin_ has joined #openstack-infra | 16:51 | |
| mtreinish | jeblair: fwiw there are only like 5 tests | 16:52 |
| *** asselin_ has quit IRC | 16:52 | |
| fungi | anteaya: i pulled it up but haven't really looked closely yet. barely treading water today (so better than the previous two days at least!) | 16:52 |
| jeblair | fungi: it wouldn't hurt, though i believe he's signed off on the general process so i don't think we need to block on it. but we should keep him in the loop. | 16:52 |
| *** craigbr has quit IRC | 16:53 | |
| fungi | jeblair: cool, i'll go ahead and approve | 16:53 |
| jogo | clarkb: thanks, not sure where to dump the xml for a custom CPU | 16:53 |
| *** tqtran_ has joined #openstack-infra | 16:53 | |
| *** melwitt has joined #openstack-infra | 16:53 | |
| fungi | but SlickNik ^ if you're around, keep in mind that's now separately tested | 16:53 |
| *** craigbr has joined #openstack-infra | 16:53 | |
| *** MarkAtwood has quit IRC | 16:53 | |
| *** openstack has joined #openstack-infra | 16:56 | |
| mtreinish | jeblair: heh, it's exactly 5 trove tests in tempest: http://paste.openstack.org/show/191643/ | 16:56 |
| openstackgerrit | Merged openstack-infra/project-config: Make trove tempest job voting https://review.openstack.org/161796 | 16:56 |
| *** andreykurilin_ has quit IRC | 16:56 | |
| mtreinish | or I can't count... | 16:57 |
| *** Ryan_Lane has joined #openstack-infra | 16:57 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-ansible: Set default hash behavior to merge https://review.openstack.org/163517 | 16:57 |
| SlickNik | fungi: Thanks — yup, I'm good with 161797. jeblair and I had discussed it earlier, and I agree that it makes sense from the perspective of all the big tent discussions we've been having. | 16:59 |
| *** patrickeast has quit IRC | 17:00 | |
| jeblair | SlickNik: i'm about to propose changes to ramp-down the devstack-gate tests run in trove so it's only the trove tempest tests, and you're not runinng all the base layer tests | 17:00 |
| jeblair | should speed things up for you | 17:00 |
| *** thingee has joined #openstack-infra | 17:02 | |
| openstackgerrit | Chris Dent proposed openstack/requirements: Update gabbi to 0.12.0 https://review.openstack.org/156253 | 17:02 |
| *** Longgeek has quit IRC | 17:02 | |
| *** mwagner_lap has quit IRC | 17:03 | |
| SlickNik | jeblair: Awesome — thanks for your help with this! | 17:03 |
| *** salv-orlando has quit IRC | 17:03 | |
| *** tonytan4ever has joined #openstack-infra | 17:05 | |
| *** thingee has quit IRC | 17:05 | |
| *** radez is now known as radez_g0n3 | 17:05 | |
| *** garyk has quit IRC | 17:06 | |
| *** dannywilson has joined #openstack-infra | 17:06 | |
| *** yfried|afk is now known as yfried|pto | 17:06 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Add non-voting trove tempest job https://review.openstack.org/163521 | 17:08 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Make trove-only tempest job voting https://review.openstack.org/163522 | 17:08 |
| jeblair | SlickNik, mtreinish: ^ | 17:08 |
| jeblair | that should be the end of it | 17:08 |
| *** esker has joined #openstack-infra | 17:08 | |
| *** SumitNaiksatam has quit IRC | 17:09 | |
| *** tonytan4ever has quit IRC | 17:10 | |
| *** ivar-lazzaro has joined #openstack-infra | 17:10 | |
| *** ivar-lazzaro has quit IRC | 17:11 | |
| *** ivar-lazzaro has joined #openstack-infra | 17:11 | |
| *** ivar-lazzaro has quit IRC | 17:12 | |
| *** tonytan4ever has joined #openstack-infra | 17:12 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add unit test for create_server https://review.openstack.org/160155 | 17:13 |
| *** dannywilson has quit IRC | 17:13 | |
| *** ivar-lazzaro has joined #openstack-infra | 17:13 | |
| anteaya | where are we currently pointing people who could benefit from some information about how to write clear and useful git commit messages? | 17:13 |
| *** bswartz has quit IRC | 17:13 | |
| anteaya | I'm looking on the wiki, can't find the page I expect and recall vaguely a mention it was moved but I'm unsure where | 17:13 |
| mtreinish | anteaya: https://wiki.openstack.org/wiki/GitCommitMessages ? | 17:13 |
| *** harlowja_away is now known as harlowja_ | 17:14 | |
| mtreinish | anteaya: I have it bookmarked because I leave it in review comments a lot | 17:14 |
| *** dimtruck is now known as zz_dimtruck | 17:14 | |
| *** mgagne_PHL is now known as mgagne | 17:14 | |
| anteaya | mtreinish: thanks search didn't find it | 17:14 |
| jeblair | anteaya: http://docs.openstack.org/infra/manual/developers.html#committing-a-change links to that page | 17:14 |
| *** bswartz has joined #openstack-infra | 17:16 | |
| *** jlk has left #openstack-infra | 17:16 | |
| anteaya | jeblair: ah thank you, I had thought it was in the manual | 17:17 |
| clarkb | pleia2: cinerama comments on the zanata puppet change. overall looks good just a few minor things | 17:17 |
| *** zz_dimtruck is now known as dimtruck | 17:17 | |
| *** ihrachyshka has quit IRC | 17:18 | |
| *** sarob has quit IRC | 17:18 | |
| *** e0ne is now known as e0ne_ | 17:18 | |
| *** Somay has joined #openstack-infra | 17:20 | |
| *** resker has joined #openstack-infra | 17:20 | |
| *** Somay has quit IRC | 17:21 | |
| *** sarob has joined #openstack-infra | 17:21 | |
| *** cody-somerville has quit IRC | 17:21 | |
| *** chlong has quit IRC | 17:21 | |
| *** _shaps_ has quit IRC | 17:22 | |
| banix | jeblair, any other infra cores who could review: https://review.openstack.org/#/c/162681/ | 17:22 |
| *** asselin__ has quit IRC | 17:22 | |
| *** markus_z has quit IRC | 17:23 | |
| *** esker has quit IRC | 17:24 | |
| clarkb | it would be good if we could fix the race in new project additions | 17:25 |
| *** Hefeweizen has quit IRC | 17:25 | |
| *** sarob has quit IRC | 17:26 | |
| fungi | clarkb: agreed, i'll review that patch trio next | 17:27 |
| *** MarkAtwood has joined #openstack-infra | 17:27 | |
| *** dimtruck is now known as zz_dimtruck | 17:27 | |
| *** sputnik13 has joined #openstack-infra | 17:28 | |
| *** wendar_ is now known as wendar | 17:28 | |
| *** e0ne_ has quit IRC | 17:29 | |
| *** e0ne has joined #openstack-infra | 17:30 | |
| *** bhuvan has quit IRC | 17:30 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Modifying devstack plugin job template https://review.openstack.org/163323 | 17:30 |
| *** tsg_ has quit IRC | 17:31 | |
| *** sarob has joined #openstack-infra | 17:32 | |
| greghaynes | clarkb: Expected behavior question for this test - do we want nodepool to eventually give up on uploading an image if it keeps failing? | 17:32 |
| *** SumitNaiksatam has joined #openstack-infra | 17:32 | |
| anteaya | fungi: do you have a patch number for the start of it, I can too | 17:32 |
| fungi | jhesketh: https://review.openstack.org/154300 looks good to me, so i'm going to assume the reason SergeyLukjanov didn't approve it when he +2'd is that he wasn't expecting to be around to babysit it | 17:33 |
| fungi | anteaya: it's patches to several projects. 154300, 154305 and 159159 | 17:33 |
| fungi | though actually 154300 doesn't look immediately related | 17:34 |
| fungi | clarkb: what was the relevance to that one? you mentioned those three together yesterday | 17:34 |
| *** Hefeweizen has joined #openstack-infra | 17:35 | |
| anteaya | fungi: thank you | 17:35 |
| mordred | clarkb, fungi: I have a typo fix to push up for that - one sec | 17:35 |
| *** ssam2 has quit IRC | 17:36 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Pass in a ref for the project_config repo https://review.openstack.org/154305 | 17:36 |
| mriedem | anyone notice this yet? https://pypi.python.org/pypi/pysaml2 | 17:36 |
| mordred | clarkb, fungi ^^ | 17:36 |
| mriedem | oops http://logs.openstack.org/98/163298/1/gate/gate-grenade-dsvm/8023874/logs/grenade.sh.txt.gz#_2015-03-11_08_05_47_035 | 17:36 |
| mordred | clarkb, fungi: oh! nevermind - my bad - it's the patch in the other repo that had the typoe | 17:37 |
| *** kmartin has quit IRC | 17:37 | |
| openstackgerrit | Merged openstack-infra/project-config: Add networking-ibm project to StackForge https://review.openstack.org/162681 | 17:37 |
| *** Sukhdev has quit IRC | 17:37 | |
| fungi | mordred: cool, hadn't gotten to that one yet | 17:38 |
| *** asselin has joined #openstack-infra | 17:38 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Add ability to run puppet with passed-in data https://review.openstack.org/159159 | 17:39 |
| mordred | fungi, clarkb ^^ that one | 17:39 |
| fungi | mordred: oh, _that_ one | 17:39 |
| mordred | (there was a "defaults" instead of "default" that I noticed while doing something else) | 17:39 |
| fungi | i just approved it, so will rereview now | 17:39 |
| *** BharatK has quit IRC | 17:39 | |
| *** cdent has quit IRC | 17:39 | |
| fungi | mordred: ahh, yeah, great catch. i totally didn't spot that | 17:40 |
| *** kmartin has joined #openstack-infra | 17:40 | |
| mordred | fungi: me neither | 17:40 |
| mordred | fungi: I actually didn't see it until a follow up patch where I was adding another entry below it :) | 17:40 |
| clarkb | greghaynes no I think it should make a new one and try try again | 17:40 |
| *** zz_dimtruck is now known as dimtruck | 17:40 | |
| clarkb | greghaynes important thing is other provider supplies nodes despite the error | 17:41 |
| greghaynes | clarkb: yep, theres some bugs with that too | 17:41 |
| *** e0ne has quit IRC | 17:41 | |
| *** annegentle has joined #openstack-infra | 17:41 | |
| mordred | patch bomb incoming ... | 17:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Move playbooks out of the puppet module https://review.openstack.org/163537 | 17:42 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Start passing in data from puppetmaster hiera https://review.openstack.org/163538 | 17:42 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Add ability to filter hiera data https://review.openstack.org/163539 | 17:42 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Add support for running puppet apply https://review.openstack.org/163540 | 17:42 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Add an option to pass in local hieradata https://review.openstack.org/163541 | 17:42 |
| *** devlaps has joined #openstack-infra | 17:42 | |
| clarkb | fungi 154300 is how puppet knows what ref to use otherwise it will still be master | 17:42 |
| mordred | clarkb, fungi: ^^ the above set is not done/ready - but I wanted to get some stuff out of my brain | 17:43 |
| mordred | I'm going to WIP the bottom commit in each thign | 17:43 |
| fungi | clarkb: after reviewing 154305 i now see where 154300 fits in | 17:43 |
| fungi | clarkb: yep | 17:43 |
| *** ajmiller has joined #openstack-infra | 17:44 | |
| timrc | SpamapS, I've changed your zuul dequeue patch quite a bit... I'm not sure if that was in a good way or a bad way... but well at least my tests pass, so assuming those are correct, maybe the dequeue cli logic is too :) https://review.openstack.org/#/c/95035/ | 17:44 |
| fungi | and the check for undef on that fact makes it a soft dependency | 17:44 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/project-config: Add puppet-openstackci project https://review.openstack.org/163255 | 17:44 |
| clarkb | fungi yup | 17:44 |
| *** xgerman has joined #openstack-infra | 17:44 | |
| *** ujuc has quit IRC | 17:45 | |
| fungi | i initially got confused trying to figure out if you'd missed a crd relationship between that and one of the other patches, but looks like they can land in arbitrary order | 17:45 |
| timrc | I kind of want to add a cross-project-dependency dequeue test as well. I haven't looked at the underlying dequeue tests to see if that one is already covered at a more fundamental layer. | 17:45 |
| clarkb | timrc its covered in the scheduler tests | 17:45 |
| timrc | clarkb, Well there ya go. | 17:46 |
| openstackgerrit | Merged openstack-infra/puppet-project_config: Provide way to specify repo ref https://review.openstack.org/154300 | 17:46 |
| *** MarkAtwood has quit IRC | 17:46 | |
| ajmiller | Hi. I have a patch to neutron-lbaas that looks like it has had all of the appropriate reviews and approvals, but it hasn't gone into the zuul queue for merge. Can someone here have a look? It is https://review.openstack.org/#/c/160625/ | 17:46 |
| ttx | anteaya: reading | 17:46 |
| fungi | clarkb: if you want to reapprove 159159 after mordred's typo fix, i think we're all set with the others now | 17:46 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add fingerprint for bug 1430592 https://review.openstack.org/163245 | 17:47 |
| openstack | bug 1430592 in devstack "testtools-1.7.0 triggering pkg_resources.VersionConflict: (unittest2 0.5.1 (/usr/lib/python2.7/dist-packages), Requirement.parse('unittest2>=1.0.0'))" [Undecided,In progress] https://launchpad.net/bugs/1430592 - Assigned to Ian Wienand (iwienand) | 17:47 |
| anteaya | ttx thanks | 17:47 |
| *** ryanpetrello has quit IRC | 17:47 | |
| clarkb | fungi thanks though I wrote a decent chunk of 159159 myself | 17:48 |
| anteaya | fungi: is patchset 4 of 159159 just do to a rebase in the stack/ | 17:48 |
| anteaya | ? | 17:48 |
| clarkb | also about to do another round of doctor stuff so midday is looking bad for me | 17:48 |
| clarkb | I can push 159159 in after | 17:48 |
| *** yfried|pto is now known as yfried|afk | 17:48 | |
| *** bhuvan has joined #openstack-infra | 17:48 | |
| *** mwagner_lap has joined #openstack-infra | 17:48 | |
| ttx | anteaya: see my comment on the etherpad | 17:49 |
| anteaya | ttx thanks | 17:49 |
| fungi | anteaya: it's a typo fix | 17:49 |
| anteaya | fungi: ah thanks | 17:49 |
| fungi | anteaya: mordred removed a stray s to turn defaults into default | 17:49 |
| fungi | clarkb: okay, i'll just reapprove 159159 with only my +2 | 17:50 |
| *** sarob has quit IRC | 17:51 | |
| anteaya | fungi: good eye and thanks | 17:51 |
| *** ryanpetrello has joined #openstack-infra | 17:52 | |
| fungi | ajmiller: the way cross repo "depends on" works right now, i think that change didn't automatically enqueue into the gate when the changes it depends on got approved, since it was approved first. reapproving it or leaving a recheck comment will get it moving | 17:52 |
| *** mtanino has joined #openstack-infra | 17:52 | |
| ajmiller | Ah, OK. I'll do a recheck, thanks! | 17:52 |
| *** jp_at_hp has quit IRC | 17:52 | |
| *** ominakov_ has quit IRC | 17:52 | |
| *** sarob has joined #openstack-infra | 17:53 | |
| *** ominakov_ has joined #openstack-infra | 17:53 | |
| *** cody-somerville has joined #openstack-infra | 17:53 | |
| anteaya | ttx responded | 17:53 |
| *** achanda has joined #openstack-infra | 17:54 | |
| ajmiller | fungi. I did the recheck, its in the check queue now, so it should be on its way to merging... Thanks again.. | 17:54 |
| *** _nadya_ has quit IRC | 17:54 | |
| *** claudiub has quit IRC | 17:57 | |
| anteaya | fungi mordred line 94 https://review.openstack.org/#/c/159159/4/library/puppet should that be O_CREATE? | 17:57 |
| anteaya | is that a missing E? | 17:57 |
| anteaya | I grepped and couldn't find another instance of it | 17:58 |
| anteaya | found it: https://docs.python.org/3.3/library/os.html#os.O_CREAT | 17:59 |
| fungi | anteaya: it's correct | 18:00 |
| *** marcusvrn has quit IRC | 18:00 | |
| *** radez_g0n3 is now known as radez | 18:00 | |
| *** otter768 has joined #openstack-infra | 18:01 | |
| fungi | anteaya: you can also test it yourself if in doubt... http://paste.openstack.org/show/191657/ | 18:01 |
| SpamapS | interesting.. | 18:01 |
| SpamapS | the C gearmand has map/reduce optimizations now | 18:01 |
| anteaya | thanks | 18:01 |
| *** Longgeek has joined #openstack-infra | 18:02 | |
| fungi | SpamapS: for distributing work to stuff like hadoop? | 18:02 |
| SpamapS | Which I believe allow it to rapidly take results from mappers and submit them to reducers without an intermediate step of sending to the original client | 18:02 |
| SpamapS | fungi: no, for being a much simpler Hadoop. :) | 18:02 |
| dstufft | gotta save all those bytes and make identifiers super short, who cares if you can't actually read them | 18:02 |
| fungi | SpamapS: yeah, that was the other possibility i was considering. neat! | 18:02 |
| SpamapS | but it might work well as a pub/sub mechanism | 18:03 |
| *** reed has joined #openstack-infra | 18:03 | |
| *** reed has quit IRC | 18:03 | |
| *** reed has joined #openstack-infra | 18:03 | |
| fungi | dstufft: even more amusing, it's a const, so the name is optimized out anyway | 18:03 |
| SpamapS | seeing the operators talk about how awful rabbit is has renewed my interest in making a gearman comms backend for OpenStack. :) | 18:03 |
| fungi | SpamapS: even from the summary and ensuiing thread i got the impression everyone was using rabbit because it sucked the least of the available options | 18:04 |
| *** salv-orlando has joined #openstack-infra | 18:04 | |
| *** stevemar has quit IRC | 18:04 | |
| SpamapS | fungi: exactly | 18:04 |
| SpamapS | go figure.. the one that is tested in the gate is the one that sucks the least. | 18:05 |
| fungi | i liked the "everyone had a cron job to restart all the things" | 18:05 |
| *** stevemar has joined #openstack-infra | 18:05 | |
| SpamapS | fungi: Distributed Windows | 18:05 |
| *** emagana has joined #openstack-infra | 18:05 | |
| *** HeOS has quit IRC | 18:06 | |
| fungi | SpamapS: ooh! right we could switch to msmq | 18:06 |
| *** otter768 has quit IRC | 18:06 | |
| fungi | i bet in comes with built-in jobs to reboot its consumers | 18:06 |
| *** craigbr has quit IRC | 18:06 | |
| *** woodster_ has joined #openstack-infra | 18:07 | |
| SpamapS | fungi: even better, they just reboot themselves. :) | 18:07 |
| fungi | oh, yep | 18:07 |
| *** Longgeek has quit IRC | 18:09 | |
| *** Ala has quit IRC | 18:09 | |
| *** spzala has joined #openstack-infra | 18:09 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Run ironicclient functional tests as STACK_USER https://review.openstack.org/163552 | 18:10 |
| *** carl_baldwin has quit IRC | 18:10 | |
| clarkb | greghaynes: also, not sure if I was clear above, you shouldn't explicitly retry to rebuild/reupload the image. Instead the next iteration of the run loop should checkformissingimages() then try again | 18:14 |
| *** salv-orlando has quit IRC | 18:14 | |
| clarkb | greghaynes: so I think you just need to ensure that checkformissingimages doesn't short circuit if a single image upload fails, it should move to the next image and try that and so on. Then any that failed would get tried again on the next ieration through the main run loop | 18:15 |
| greghaynes | clarkb: Gotcha | 18:15 |
| greghaynes | that is exactly what its not doing ATM :) | 18:15 |
| *** BobBall is now known as BobBall_AWOL | 18:16 | |
| *** marcusvrn has joined #openstack-infra | 18:16 | |
| *** vigneshvar has joined #openstack-infra | 18:16 | |
| *** gyee has joined #openstack-infra | 18:17 | |
| *** krisgan has joined #openstack-infra | 18:17 | |
| *** marcusvrn has quit IRC | 18:19 | |
| pc_m | clarkb: anteaya: Could one of you kindly review https://review.openstack.org/#/c/163133/? Taking experimental job and making non-voting in check queue. | 18:19 |
| clarkb | greghaynes I figured it would be a good thing to test :) | 18:20 |
| clarkb | greghaynes the coverage reports point out a bunch of other exceptional cases we should be testing too | 18:21 |
| clarkb | pc_m so you got it to run the correct tests? | 18:22 |
| pc_m | clarkb: Yes, verified that current job and new job run tests in the correct directories | 18:23 |
| pc_m | clarkb: (common, openswan) and (common, strongswan). | 18:23 |
| *** ghostpl_ has quit IRC | 18:23 | |
| pc_m | clarkb: Also verified that devstack installed strongswan and correct device driver was selected. | 18:24 |
| clarkb | awesome | 18:24 |
| *** ominakov_ has quit IRC | 18:24 | |
| jeblair | clarkb: what do you want to do with 155458 and parent? | 18:24 |
| clarkb | jeblair I was hoping parent would merge then I can rebase 155458 | 18:26 |
| jeblair | clarkb: okay, i'll review testing changes first then get back to parent | 18:26 |
| clarkb | mostly didnt want to rebase entire thing unless necessary particularly if there are comments on 155458 but not on parent | 18:27 |
| clarkb | thanks | 18:27 |
| anteaya | AJaeger: did you want to revisit your review on https://review.openstack.org/#/c/163292/2 | 18:28 |
| anteaya | AJaeger: you have +2's a patch for a stackforge job that uses docs.o.o? | 18:28 |
| anteaya | even though your comment caught it | 18:28 |
| greghaynes | clarkb: haha, I found the source of my confusion - if a snapshot image is not built we build it then upload. if a dib image is not built then it is built and not uploaded and we wait to go around the polling loop again to upload | 18:28 |
| anteaya | AJaeger: I'll -1 in the meantime | 18:29 |
| greghaynes | hence my confusion on "why does this even work!?" - the snapshot image always gets uploaded first and I was trying to make the dib image fail to upload first | 18:29 |
| *** bknudson has quit IRC | 18:30 | |
| openstackgerrit | Merged openstack-infra/project-config: VPNaaS make new functional test non-voting https://review.openstack.org/163133 | 18:31 |
| *** dhritishikhar has quit IRC | 18:32 | |
| *** dkranz has quit IRC | 18:32 | |
| *** dkranz has joined #openstack-infra | 18:32 | |
| *** carl_baldwin has joined #openstack-infra | 18:32 | |
| *** jcoufal has quit IRC | 18:32 | |
| *** dhritishikhar has joined #openstack-infra | 18:34 | |
| *** jaypipes is now known as jaypipes-afk | 18:34 | |
| *** marcusvrn has joined #openstack-infra | 18:34 | |
| *** AJaeger_ has joined #openstack-infra | 18:34 | |
| *** vigneshvar has quit IRC | 18:35 | |
| *** hdd_ has quit IRC | 18:36 | |
| anteaya | shouldn't we change the mode of project-config scripts via puppet, rather than using a patch? https://review.openstack.org/#/c/162070/3 | 18:37 |
| anteaya | looking at Make check_irc_access.py script executable. | 18:37 |
| *** tsg_ has joined #openstack-infra | 18:37 | |
| AJaeger_ | anteaya: I really prefer to have it executable in git - so that I can execute it locally without problems ;) | 18:38 |
| nibalizer | anteaya: i agree with AJaeger_ | 18:38 |
| AJaeger_ | anteaya: for jenkins it's not a problem, we invoke with "python SCRIPT" | 18:39 |
| AJaeger_ | But running it locally, I'm for the short form ;) | 18:39 |
| nibalizer | well let me say this, if we're doing it where we bring down the repo, then run the file from the repo, then the permission bits should be in git | 18:39 |
| anteaya | I can understand the need to run it locally | 18:39 |
| nibalizer | if puppet was pulling the file from git.openstack or copying it out of the git repo and putting it somewhere (like /etc/init.d/) then I would ensure permission bits in puppet | 18:39 |
| anteaya | are we setting ourselves up for puppet overwriting file permissions it doesn't know about? | 18:40 |
| SpamapS | wow typing 'tox -egenconfig' in nova's home dir takes a long time. | 18:40 |
| nibalizer | i dont understand taht question | 18:40 |
| SpamapS | going on 10 minutes now | 18:40 |
| anteaya | nibalizer: is puppet possibly going to over write file permisions taht are set in git | 18:41 |
| anteaya | but which are not echoed in puppet files | 18:41 |
| fungi | anteaya: where do you see that file getting installed by puppet? | 18:41 |
| anteaya | I don't | 18:42 |
| anteaya | I'm asking | 18:42 |
| nibalizer | no puppet will let git be in charge | 18:42 |
| anteaya | nibalizer: thank you | 18:42 |
| openstackgerrit | Merged openstack-infra/gear: Add SSL functional test https://review.openstack.org/143235 | 18:42 |
| fungi | afaik the only automation we have clones the repo and runs stuff directly from there, without puppet doing any file manipulation | 18:42 |
| *** pelix has quit IRC | 18:43 | |
| anteaya | thanks | 18:43 |
| anteaya | that was what I wanted to know, that and in a git vs puppet situation about file permissions, git wins | 18:43 |
| fungi | well, there is no puppet in this case | 18:44 |
| fungi | that is a script run from a git checkout by a jenkins job | 18:44 |
| *** salv-orlando has joined #openstack-infra | 18:44 | |
| nibalizer | anteaya: what fungi is saying is true | 18:45 |
| *** banix has quit IRC | 18:45 | |
| nibalizer | puppet manages the git repo, the git repo manages that file | 18:45 |
| nibalizer | if we had puppet and git managing that file, they would fight, and the file state would oscilate probably | 18:45 |
| anteaya | ah great | 18:45 |
| fungi | i'm not even sure puppet is installing that repo in the situations where we run that script | 18:45 |
| nibalizer | which is not what we want | 18:45 |
| anteaya | thank you | 18:45 |
| nibalizer | project-config ? it should be | 18:46 |
| fungi | it's getting pre-cached by nodepool scripts and then later cloned by job macros | 18:46 |
| anteaya | nibalizer: yes that was the scenario I did want to avoid, which as fungi says is easy since puppet isn't doing work there | 18:46 |
| *** jistr has quit IRC | 18:46 | |
| nibalizer | fungi: ah | 18:47 |
| fungi | nibalizer: the only place it's run in automation is from http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/infra.yaml#n26 | 18:48 |
| *** vigneshvar has joined #openstack-infra | 18:48 | |
| fungi | which clones the repo (from the nodepool-provided cache on disk, updated to the change from zuul) and then calls tox to run the script in it | 18:48 |
| fungi | so... no puppet anywhere for that | 18:49 |
| anteaya | fungi: awesome thanks | 18:50 |
| fungi | happy to help | 18:51 |
| anteaya | :) | 18:52 |
| anteaya | you do it so well | 18:52 |
| fungi | thanks! | 18:52 |
| *** spzala has quit IRC | 18:53 | |
| *** craigbr has joined #openstack-infra | 18:53 | |
| anteaya | :) | 18:54 |
| *** banix has joined #openstack-infra | 18:54 | |
| fungi | did we approve a change to gerrit's javascript recently (is the worker results box missing for anyone else in the webui), or is my browser acting up? | 18:54 |
| fungi | nevermind. i think it's my browser | 18:54 |
| fungi | no, wait, on pages where i had it, i now see it disappear on a force reload | 18:55 |
| *** patrickeast has joined #openstack-infra | 18:56 | |
| *** fdegir has joined #openstack-infra | 18:56 | |
| *** dannywilson has joined #openstack-infra | 18:56 | |
| *** mtanino has quit IRC | 18:57 | |
| *** mtanino has joined #openstack-infra | 18:57 | |
| *** bswartz has quit IRC | 18:57 | |
| *** ghostpl_ has joined #openstack-infra | 18:58 | |
| *** marcusvrn has quit IRC | 18:58 | |
| anteaya | worker results box | 18:58 |
| anteaya | is that the jenkins logs links? | 18:58 |
| fungi | yeah | 18:58 |
| *** e0ne has joined #openstack-infra | 18:58 | |
| fungi | next to the reviews box | 18:59 |
| anteaya | I see it on: https://review.openstack.org/#/c/146047/ | 18:59 |
| jesusaurus | jeblair: i was just about to -1 162714 because im pretty sure we're double-counting ready when calculating extra_demand, can you remove your workflow+1 and read my comment? | 18:59 |
| anteaya | to the right of the list of reviewers below the commit message | 18:59 |
| fungi | yeah, that works for me too, and then it disappears with a force refresh, so probably just browser wonkiness | 18:59 |
| anteaya | Jenkins checkMar 9, 2015 12:48 PM | 18:59 |
| anteaya | clicking f5 still has it for me | 19:00 |
| fungi | thanks anteaya i think it's just me. good thing i mostly use gertty anyway | 19:00 |
| anteaya | yup | 19:00 |
| *** marun has quit IRC | 19:00 | |
| *** marcusvrn has joined #openstack-infra | 19:01 | |
| SpamapS | Well this is just silly | 19:01 |
| SpamapS | it appears notifications in nova _must_ use the same url as RPC | 19:01 |
| SpamapS | rabbit all the things i guess. :-P | 19:01 |
| openstackgerrit | Merged openstack-infra/project-config: Ensure that gerritbot channels are in accessbot https://review.openstack.org/162070 | 19:01 |
| jeblair | jesusaurus: i don't see a comment from you? | 19:01 |
| *** arxcruz has quit IRC | 19:01 | |
| jeblair | jesusaurus: feel free to go ahead and -1 it | 19:01 |
| openstackgerrit | Merged openstack-infra/project-config: Support custom static nameserver during build https://review.openstack.org/157554 | 19:02 |
| *** bswartz has joined #openstack-infra | 19:03 | |
| jesusaurus | jeblair: gertty just synced, is it there for you? | 19:04 |
| *** gokrokve_ has quit IRC | 19:04 | |
| jeblair | jesusaurus: yep, thx, and thanks for the heads up | 19:04 |
| banix | anteaya: thank you for reviewing/approving my patch for our new repo. | 19:06 |
| *** sdake__ has joined #openstack-infra | 19:08 | |
| clarkb | I think the math is correct. the idea is to have min ready extra | 19:08 |
| clarkb | so extra demand is indeed extra | 19:09 |
| *** tnovacik has quit IRC | 19:09 | |
| anteaya | banix: you are welcome be sure to start with 4 python tests in your first patch | 19:10 |
| e0ne | hi. does anybody know why we have so many patches in check queue? | 19:12 |
| *** sdake_ has quit IRC | 19:12 | |
| *** bknudson has joined #openstack-infra | 19:13 | |
| *** mrunge_bbl is now known as mrunge | 19:14 | |
| *** scottda has joined #openstack-infra | 19:15 | |
| anteaya | e0ne: 160 patches is not a lot | 19:16 |
| *** spzala has joined #openstack-infra | 19:16 | |
| anteaya | over 400 would be something to question | 19:16 |
| anteaya | also events | 19:17 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard-webclient: Moved preference resolution into its own resolver. https://review.openstack.org/163574 | 19:17 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard-webclient: Preference service uses private scope. https://review.openstack.org/163575 | 19:17 |
| anteaya | Queue lengths: 3 events, 0 results. | 19:17 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard-webclient: Safety check for preference save. https://review.openstack.org/163576 | 19:17 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard-webclient: Removed static pageSize injector. https://review.openstack.org/163577 | 19:17 |
| anteaya | e0ne: if you ever see events reach over 500 and stay there for longer than 30 minutes, that is worth knowing about | 19:17 |
| anteaya | events can spike to over 8000 for a few minutes when zuul is resetting the gate | 19:18 |
| *** pblaho has quit IRC | 19:19 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Run some project-config jobs only if needed https://review.openstack.org/159512 | 19:19 |
| *** tosky has quit IRC | 19:19 | |
| anteaya | mtreinish: in https://review.openstack.org/#/c/160548/7/nodepool/elements/cache-devstack/install.d/98-build-wheelhouse you set -eux, if haven't seen u used before and nothing I'm search is helping me find it | 19:19 |
| anteaya | mtreinish: can I get a pointer to continue reviewing your patch? | 19:19 |
| *** teran has quit IRC | 19:20 | |
| tsg_ | clarkb: need your help with bandersnatch .. the pypi cache seems to be stale (we are trying to pick up the latest pyeclib update - 1.0c2) | 19:20 |
| fungi | tsg_: is bandersnatch hung? have you looked at its log? did it merely skip that file or has it done nothing at all? | 19:21 |
| *** taron has joined #openstack-infra | 19:22 | |
| tsg_ | fungi: not sure where to look for the logs | 19:22 |
| fungi | tsg_: on our servers it's /var/log/bandersnatch | 19:22 |
| tsg_ | fungi: have never tried to log in to the servers .. can you tell me more | 19:23 |
| anteaya | mtreinish: found it in my bash reference, yay books | 19:23 |
| fungi | tsg_: oh, i thought you meant on a bandersnatch server you were running | 19:23 |
| fungi | tsg_: i'll take a look and see what's going on | 19:23 |
| anteaya | mtreinish: nounset, treat undefined variables as errors, not as null | 19:23 |
| tsg_ | fungi: thanks - pypi updates don't seem to have been picked up since yesterday | 19:24 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: WIP: test nodepool upload failures https://review.openstack.org/163239 | 19:24 |
| greghaynes | clarkb: ^ getting closer | 19:24 |
| mtreinish | anteaya: heh, yeah I was just going to point you to the set manpage :) Although fwiw I just copy and pasted that from another script somewhere in the repo | 19:24 |
| anteaya | mtreinish: cargo culter! | 19:25 |
| anteaya | mtreinish: do you want to keep that option then? | 19:25 |
| fungi | tsg_: i see it here http://pypi.dfw.openstack.org/simple/pyeclib/ but i'll check the rest of our mirrors... maybe only one is stuck | 19:25 |
| anteaya | mtreinish: I'm fine I would just like if it was intentional | 19:25 |
| mtreinish | anteaya: it worked fine when I tested it locally I don't think it hurts anything | 19:26 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: WIP: test nodepool upload failures https://review.openstack.org/163239 | 19:26 |
| anteaya | mtreinish: okey dokey | 19:26 |
| tsg_ | fungi: ok | 19:26 |
| fungi | tsg_: all our mirrors have it | 19:26 |
| tsg_ | fungi: ok thanks - Jenkins still seems to pick 0.9.8 | 19:27 |
| fungi | tsg_: are you sure you're requesting a beta version? modern pip won't install non-numeric releases without additional effort | 19:27 |
| tsg_ | let me try another check | 19:27 |
| *** hodos has quit IRC | 19:27 | |
| *** achanda has quit IRC | 19:27 | |
| *** resker has quit IRC | 19:27 | |
| tsg_ | fungi: I assume you mean non-PEP440? | 19:27 |
| fungi | tsg_: PyECLib-1.0c2.tar.gz is a prerelease by pip's reckoning | 19:27 |
| *** ominakov_ has joined #openstack-infra | 19:28 | |
| tsg_ | fungi: "pip install --upgrade" in my local testing seems to have picked it up | 19:28 |
| fungi | so asking pip for just PyECLib or PyECLib>=0.9.0 or something won't install 1.0c2 | 19:28 |
| tsg_ | fungi: good point though .. I will consider using a numeric-only version number | 19:28 |
| fungi | when they release a 1.0 or 1.0.0 or something we'll install that | 19:29 |
| *** emagana has quit IRC | 19:29 | |
| *** marcusvrn has quit IRC | 19:29 | |
| tsg_ | fungi: the reason I brought up bandersnatch though, is that, last few times we updated the library, it wasn't picked up until bandersnatch was kicked :) | 19:29 |
| mordred | tsg_: if it worked for you locally, then chances are you have an old pip | 19:29 |
| anteaya | dougwig: did you ever take a look at mtreinish's comments on https://review.openstack.org/#/c/160914/2 | 19:29 |
| tsg_ | mordred: let me double-check - I am using 14.04.2 | 19:30 |
| mordred | tsg_: yeah- pip from ubuntu is WAY too old | 19:30 |
| fungi | tsg_: alternatively you can use something like PyECLib>=0.0.0a0 and it will see the prerelease in that spec as an indicator that prerelease versions are okay | 19:30 |
| tsg_ | (pip 1.5.4) | 19:30 |
| mordred | I think they started ignoring pre-releases by default in 1.6? dstufft ^^ ? | 19:30 |
| fungi | i thought that was 1.5 | 19:31 |
| dstufft | 1.4 | 19:31 |
| tsg_ | mordred, fungi: to avoid problems, let me push a new rev | 19:31 |
| mordred | cool | 19:31 |
| *** radez is now known as radez_g0n3 | 19:32 | |
| dougwig | anteaya: no, but i just did, and it would be safe to switch to just the neutron job. do you want that folded in that patch, or in a follow-on? | 19:33 |
| *** esker has joined #openstack-infra | 19:33 | |
| *** timcline_ has quit IRC | 19:34 | |
| *** esker has quit IRC | 19:34 | |
| anteaya | mtreinish: which approach would you like dougwig to take? | 19:34 |
| anteaya | ^^ | 19:34 |
| *** yfried|afk is now known as yfried|pto | 19:35 | |
| *** esker has joined #openstack-infra | 19:36 | |
| jesusaurus | clarkb: extra demand is definitely extra, but I don't think it's enough extra. it is subtracting the ready (ready + building + test) from both the start demand and the min_ready | 19:36 |
| openstackgerrit | Merged openstack-infra/project-config: Build wheel house during nodepool devstack caching https://review.openstack.org/160548 | 19:37 |
| *** kmartin has quit IRC | 19:37 | |
| *** cody-somerville has quit IRC | 19:38 | |
| *** achanda has joined #openstack-infra | 19:38 | |
| openstackgerrit | Merged openstack-infra/ansible-puppet: Add ability to run puppet with passed-in data https://review.openstack.org/159159 | 19:38 |
| jesusaurus | clarkb: so we end up with (start_demand - ready) + (min_ready - ready) when we should have (start_demand + min_ready) - ready | 19:39 |
| anteaya | dougwig: well mtreinish said he is fine with that patch so I'll approve it and please make the switch in a following patch | 19:39 |
| jesusaurus | assuming capacity for the extra_demand | 19:39 |
| dougwig | anteaya: ok, thanks. | 19:39 |
| *** banix has quit IRC | 19:40 | |
| mtreinish | anteaya: yeah I'm fine with adding the other job, but if after investigation they can be deduped that would be the best | 19:40 |
| anteaya | sure | 19:40 |
| anteaya | dougwig: so dedupping as much as we can in that follow-up? | 19:41 |
| anteaya | mtreinish: thanks | 19:41 |
| *** dhritishikhar has quit IRC | 19:41 | |
| *** timcline has joined #openstack-infra | 19:42 | |
| openstackgerrit | Merged openstack-infra/project-config: add experimental ceilometer elasticsearch db jobs https://review.openstack.org/160824 | 19:42 |
| anteaya | I'm going to go for walk now | 19:42 |
| dougwig | anteaya, mtreinish - i'll submit one that drops the other grenade job, after taking one more look at the code path. nothing in the grenade repo looks like it does anything fancy with nova-net (unlike neutron) | 19:42 |
| mtreinish | dougwig: well the other thing is getting feedback from the nova team on whether that code path is worth testing independently, because there might still be value in doing the upgrade test | 19:43 |
| *** mpopow has joined #openstack-infra | 19:43 | |
| dougwig | mtreinish: ok, i'll ping in channel as well. | 19:44 |
| *** Somay has joined #openstack-infra | 19:44 | |
| *** Somay has left #openstack-infra | 19:44 | |
| *** HeOS has joined #openstack-infra | 19:45 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 19:45 | |
| *** baoli has quit IRC | 19:46 | |
| *** fdegir has quit IRC | 19:46 | |
| *** annegentle has quit IRC | 19:46 | |
| *** annegentle has joined #openstack-infra | 19:47 | |
| *** mfink_ has quit IRC | 19:47 | |
| openstackgerrit | Merged openstack-infra/project-config: Since grenade+neutron relies on devstack, add it to devstack's check queue https://review.openstack.org/160914 | 19:48 |
| *** nelsnelson has quit IRC | 19:50 | |
| *** claudiub has joined #openstack-infra | 19:51 | |
| *** vigneshvar has quit IRC | 19:51 | |
| *** annegentle has quit IRC | 19:52 | |
| *** esker has quit IRC | 19:53 | |
| *** Longgeek has joined #openstack-infra | 19:54 | |
| *** gokrokve has joined #openstack-infra | 19:55 | |
| *** ominakov_ has quit IRC | 19:56 | |
| openstackgerrit | Merged openstack-infra/system-config: Pass in a ref for the project_config repo https://review.openstack.org/154305 | 19:57 |
| *** kevinbenton has joined #openstack-infra | 19:57 | |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 19:57 |
| clarkb | jesusaurus I see so extra demand should just be min-ready? | 19:58 |
| *** scottda has left #openstack-infra | 19:58 | |
| *** mpaolino has joined #openstack-infra | 19:59 | |
| jesusaurus | clarkb: yeah, that's my understanding. instead of calculating extra_demand, we should just add min_ready if we have capacity | 19:59 |
| *** mpaolino has quit IRC | 19:59 | |
| jesusaurus | clarkb: does that make sense, or is my math off? | 19:59 |
| *** Longgeek has quit IRC | 20:00 | |
| *** fdegir has joined #openstack-infra | 20:01 | |
| *** otter768 has joined #openstack-infra | 20:01 | |
| *** AJaeger_ has quit IRC | 20:02 | |
| *** tnovacik has joined #openstack-infra | 20:02 | |
| clarkb | I think you may be correct but need to read through again after lunch | 20:04 |
| *** praveenkumar has quit IRC | 20:06 | |
| *** dboik_ has quit IRC | 20:06 | |
| *** otter768 has quit IRC | 20:06 | |
| *** dboik has joined #openstack-infra | 20:07 | |
| *** garyh has quit IRC | 20:07 | |
| *** annegentle has joined #openstack-infra | 20:08 | |
| *** praveenkumar has joined #openstack-infra | 20:08 | |
| *** garyh has joined #openstack-infra | 20:09 | |
| *** esker has joined #openstack-infra | 20:09 | |
| *** hdd_ has joined #openstack-infra | 20:10 | |
| *** vigneshvar has joined #openstack-infra | 20:12 | |
| *** radez_g0n3 is now known as radez | 20:13 | |
| annegentle | reed: fungi: reading more about the tags and user survey tie-in ideas, it feels like it's really a doc/data project | 20:16 |
| annegentle | like how stackalytics really does help apply real data the more and more we gather | 20:16 |
| fungi | annegentle: yeah, i mostly concur | 20:16 |
| annegentle | even though it seems like it could be gamed (and does get gamed) with enough data the truth (interpreted, sure) will show | 20:17 |
| *** hasharOut is now known as hashar | 20:17 | |
| fungi | annegentle: i foresee project representatives _mostly_ just proposing the tags they think apply to their projects, and there being some community review, and there's significant hope that any problems will be laid bare at that point. but for everything else, there's git revert | 20:18 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate: Set NOVA_ALLOW_DUPLICATE_NETWORKS=True when testing with Neutron https://review.openstack.org/163593 | 20:18 |
| *** mrmartin has quit IRC | 20:18 | |
| annegentle | I just want data. | 20:19 |
| annegentle | esp. for docs it's a good goal to quantify, how many bugs? how many page views? how many docs patches? Etc. | 20:19 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate: Set NOVA_ALLOW_DUPLICATE_NETWORKS=True when testing with Neutron https://review.openstack.org/163593 | 20:19 |
| *** ihrachyshka has joined #openstack-infra | 20:19 | |
| fungi | it seems idealistic to expect most of those tags to be clear-cut, data-driven and automatically assigned | 20:20 |
| fungi | a lot of what's been discussed so far falls on the subjective consensus side | 20:21 |
| fungi | i suppose we can try to find pure data analogues we can query to act as a proxy for what those tags really represent, but it feels like a bit of a stretch. i guess the best we can do is just try and see what happens | 20:22 |
| *** ominakov_ has joined #openstack-infra | 20:23 | |
| fungi | for example, contributor diversity... we can marry commit history and employer affiliation from foundation profiles to work out relative percent contributions to a project (like stackalytics and the activity dashboard do presently), but api stability i have no idea how we even begin to measure | 20:25 |
| *** esp has joined #openstack-infra | 20:25 | |
| fungi | or confirming that the devstack-gate job for a project really tests that project | 20:26 |
| *** yfried|pto is now known as yfried|afk | 20:26 | |
| *** kmartin has joined #openstack-infra | 20:29 | |
| *** ChuckC_ has quit IRC | 20:29 | |
| *** mwagner_lap has quit IRC | 20:30 | |
| *** _nadya_ has joined #openstack-infra | 20:30 | |
| openstackgerrit | John L. Villalovos proposed openstack/requirements: Avoid httpretty 0.8.8 as it can break unittests https://review.openstack.org/163600 | 20:32 |
| reed | annegentle, I have in mind complex tools like http://sosopensource.com/ that are hard to game because they're multidimensional | 20:34 |
| reed | the code is also free as in freedom, https://opensourceprojects.eu/p/osp/osseval/code/ci/92d0557890d54e9f0271d833e51b824a661685bd/tree/ | 20:34 |
| reed | check a recent example of their analysis on http://sosopensource.com/862.html | 20:35 |
| *** dkranz has quit IRC | 20:35 | |
| *** jistr has joined #openstack-infra | 20:35 | |
| reed | annegentle, in the specific case of OSSEval the metrics are hard to display automatically, they require 'manual' judgement though | 20:36 |
| reed | also, they make sense for comparisons | 20:36 |
| *** cody-somerville has joined #openstack-infra | 20:36 | |
| reed | so we may use them to compare nova to say, barbican | 20:37 |
| *** marun has joined #openstack-infra | 20:37 | |
| *** ominakov_ has quit IRC | 20:38 | |
| annegentle | reed: OSSEval, tell me more? I dunno that one | 20:38 |
| annegentle | reed: oh wait, making the connections now. | 20:39 |
| reed | annegentle, it's the evaluation engine behind sosopensource.com | 20:39 |
| openstackgerrit | John L. Villalovos proposed openstack/requirements: Avoid httpretty 0.8.8 as it can break unittests https://review.openstack.org/163600 | 20:39 |
| * annegentle reads | 20:39 | |
| reed | there are other tools in this area, though, the EU has funded lots of research to evaluate quality of open source projects | 20:39 |
| reed | to help public procurement | 20:39 |
| annegentle | reed: oh neat. | 20:39 |
| annegentle | reed: I like this report, "While there are few books about OpenStack and some are also available about OpenNebula, there is no book about Eucalyptus." | 20:40 |
| reed | prof. Jesus Barahona (and his team) from Bitergia has done some research in this area | 20:40 |
| reed | annegentle, "books available" is a measure of the success of an open source project in fact | 20:40 |
| annegentle | reed: wow. | 20:40 |
| reed | there is little to game with metrics like these :) | 20:41 |
| annegentle | reed: seems like a nice cloud writer opportunity if they know about it :) | 20:41 |
| *** salv-orlando has quit IRC | 20:43 | |
| reed | mine were just crazy ideas though, I came up with them thinking that if some tags are too hard to come up with maybe it's because they're just too hard :) | 20:43 |
| tsg_ | fungi: assuming the jenkins jobs don't allow "sudo" in package setup.py scripts, do the jobs run "sudo pip install.."? | 20:43 |
| *** jedimike has quit IRC | 20:44 | |
| fungi | tsg_: no, tox-based jobs at least are installing things from pypi into a virtualenv as the "jenkins" user | 20:44 |
| tsg_ | fungi: ok that works :) | 20:45 |
| annegentle | reed: well quantified data is tough for docs, adoption, etc. for sure. | 20:45 |
| *** yfried|afk is now known as yfried|pto | 20:45 | |
| reed | indeed, annegentle, it's not simple | 20:45 |
| annegentle | reed: :) | 20:48 |
| *** sdake__ has quit IRC | 20:51 | |
| *** trey has quit IRC | 20:51 | |
| *** sdake_ has joined #openstack-infra | 20:53 | |
| * mkj_wk struggles with the general python popen subprocess raw_input EOF problem | 20:53 | |
| *** trey has joined #openstack-infra | 20:55 | |
| *** achanda has quit IRC | 20:55 | |
| mkj_wk | haven't found a way yet to make this changed test not blow up with EOFError from the inferior git-review | 20:56 |
| mkj_wk | well, I have | 20:56 |
| *** mtanino has quit IRC | 20:56 | |
| mkj_wk | but I'm going to guess that the quick hack of time.sleep(1) wouldn't go over very well ☺ | 20:56 |
| *** dustins has quit IRC | 20:57 | |
| *** hogepodge has joined #openstack-infra | 20:58 | |
| ajmiller | fungi I'm back with a question about https://review.openstack.org/#/c/160625/ which you looked at for me earlier today. I ran recheck, and it spent all day working its way through the check queue, and finished there about 10 minutes ago. But it didn't show up in the gate queue... | 20:58 |
| fungi | ajmiller: that's definitely strange. i'm going to check zuul's log for any indication of why it didn't enqueue | 21:00 |
| *** _nadya_ has quit IRC | 21:00 | |
| ajmiller | thanks... | 21:00 |
| fungi | clarkb: jeblair: ^ did any bugs emerge while i was out that account for that behavior? | 21:00 |
| fungi | don't want to spend too much time digging in logs if this is a known issue | 21:01 |
| fungi | d'oh, i know what's causing that | 21:01 |
| fungi | it's the thing where jenkins replacing its vote doesn't emit a +1 in the event stream | 21:02 |
| fungi | because gerrit already had a +1 | 21:02 |
| * fungi sighs | 21:02 | |
| fungi | ajmiller: i'll just directly enqueue it into the gate pipeline since it should be fine at this point | 21:02 |
| *** dprince has quit IRC | 21:02 | |
| *** esker has quit IRC | 21:02 | |
| ajmiller | ok, thanks fungi | 21:03 |
| jeblair | another aprv vote would enqueue it | 21:03 |
| *** bswartz has quit IRC | 21:03 | |
| ajmiller | Ah, OK, that would make sense too... | 21:04 |
| *** r-daneel has quit IRC | 21:05 | |
| fungi | yeah, for future reference if it's on that same project, any of these people https://review.openstack.org/#/admin/groups/501,members can (re)add an approval vote to kick that | 21:05 |
| ajmiller | k | 21:06 |
| *** _qb has joined #openstack-infra | 21:08 | |
| *** kgiusti has left #openstack-infra | 21:09 | |
| clarkb | fungi: yes I think its because of the vote not changing | 21:09 |
| clarkb | fungi: zaro pushed a patch upstream to fix that | 21:09 |
| clarkb | not sure how it is doing | 21:09 |
| clarkb | also I am back for the day now | 21:09 |
| *** eharney has quit IRC | 21:10 | |
| *** jistr has quit IRC | 21:10 | |
| *** ayoung has quit IRC | 21:10 | |
| dhellmann | fungi, clarkb : can one of you add me to aeromancer-core and aeromancer-review in gerrit, please? https://review.openstack.org/#/admin/groups/633,members and https://review.openstack.org/#/admin/groups/634,members | 21:12 |
| clarkb | dhellmann: sure | 21:12 |
| dhellmann | fungi, clarkb : for reference, that's a new stackforge project: https://review.openstack.org/#/c/161447/ | 21:12 |
| *** aysyd has quit IRC | 21:12 | |
| *** andreykurilin has quit IRC | 21:12 | |
| jeblair | dhellmann: what is that project? | 21:12 |
| dhellmann | jeblair: it's a little tool I've been working on for querying the openstack source base. It has commands like "which projects use this requirement" and "grep across the source of all projects for this pattern" | 21:13 |
| clarkb | dhellmann: yup found it in my local git log | 21:13 |
| *** vponomaryov has quit IRC | 21:13 | |
| *** aarefiev has quit IRC | 21:13 | |
| clarkb | dhellmann: done | 21:13 |
| dhellmann | clarkb: thanks! | 21:14 |
| *** ldnunes has quit IRC | 21:14 | |
| *** aarefiev has joined #openstack-infra | 21:14 | |
| dhellmann | clarkb: hmm, I still can't +2 https://review.openstack.org/#/c/163611/ -- I wonder if I messed up the ACLs file? | 21:15 |
| *** teran has joined #openstack-infra | 21:15 | |
| *** craigbr has quit IRC | 21:15 | |
| clarkb | dhellmann: probably the gerrit cache | 21:15 |
| fungi | that reminds me livegrep will be cool once we have it | 21:15 |
| *** mattfarina is now known as mfer | 21:15 | |
| dhellmann | clarkb: "gerrit cache"? Like if I wait until tomorrow it'll work? | 21:15 |
| *** vponomaryov has joined #openstack-infra | 21:15 | |
| clarkb | dhellmann: https://review.openstack.org/#/admin/projects/stackforge/aeromancer,access does look good as far as the ACLs | 21:15 |
| dhellmann | fungi: yeah, this just runs git grep, but it knows how to find the projects | 21:15 |
| clarkb | dhellmann: if it doesn't work in a few minutes I can manually purge the cache for you | 21:15 |
| *** mfer has quit IRC | 21:16 | |
| dhellmann | the requirements queries are more interesting, and I use those for oslo to figure out which projects aren't using libs yet | 21:16 |
| dhellmann | clarkb: nah, I can wait, I just wanted to make sure I understood | 21:16 |
| *** andreykurilin has joined #openstack-infra | 21:16 | |
| *** tiswanso has quit IRC | 21:16 | |
| _qb | hello. I'm interested in setting up a third party ci instance for a large company. I've read a lot, but I can't seem to find a comprehensive diagram which shows how all these moving parts fit together. Does such a diagram exist anywhere? | 21:16 |
| asselin | _qb I have one | 21:17 |
| _qb | I'd love to see it, esp if it's up to date! | 21:17 |
| _qb | I can find some really old ones, but there has apparently been a lot of organic growth and lots of new components added | 21:18 |
| asselin | it's powerpoint...not sure how to share...let me see... | 21:18 |
| asselin | _qb links? I created this one myself based on how I understand it | 21:18 |
| *** dimtruck is now known as zz_dimtruck | 21:19 | |
| *** pc_m has quit IRC | 21:20 | |
| _qb | just searching, I found what Freescale and IBM did | 21:20 |
| _qb | http://fslopenstackci.com/ for example, but it's not detailed enough | 21:21 |
| _qb | need to depict every component in order to get it past our security review | 21:21 |
| _qb | (tall order, I know) | 21:21 |
| *** esker has joined #openstack-infra | 21:21 | |
| *** yfried|pto is now known as yfried|afk | 21:22 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/ansible-puppet: Its 0o not 0c to make an octal number https://review.openstack.org/163618 | 21:22 |
| clarkb | fungi: mordred ^ | 21:22 |
| fungi | _qb: part of the challenge is that it's different for different deployments. we write a bag of parts which we assemble in a certain way to do our jobs upstream, but different deployments may need more or fewer of them to accomplish their goals | 21:23 |
| clarkb | jeblair: what do you think about jesusaurus' comment? I think I should do demand = demand + min-ready - ready if less than capacity else demand = demand - ready | 21:23 |
| fungi | clarkb: *sigh* i should have spotted that too | 21:24 |
| _qb | fungi: makes sense, but just a detailed depiction of how the upstream part works would be great | 21:24 |
| clarkb | fungi: its hard to catch c is so close to o | 21:24 |
| clarkb | fungi: also flake8 doesn't catch it | 21:24 |
| zaro | jeblair: re mysql encoding, take a look at my comment on https://review.openstack.org/#/c/163104/ | 21:24 |
| mordred | clarkb: I agree with your commit comment | 21:25 |
| zaro | jeblair: do you prefer that alternative? | 21:25 |
| *** matt__ is now known as mattoliverau | 21:25 | |
| *** yfried|afk is now known as yfried|pto | 21:25 | |
| jesusaurus | clarkb: i think you can remove extra_demand and use label.min_ready in its place, keeping the logic the same | 21:26 |
| zaro | fungi, clarkb : no reviews on that gerrit patch yet, https://gerrit-review.googlesource.com/#/c/65530/ | 21:26 |
| *** dkliban is now known as dkliban_afl | 21:27 | |
| *** dkliban_afl is now known as dkliban_afk | 21:27 | |
| *** movielovers has joined #openstack-infra | 21:27 | |
| clarkb | jesusaurus: good point | 21:27 |
| fungi | _qb: we have this diagram floating around in some presentations http://docs.openstack.org/infra/publications/ci-automation/#(5) | 21:27 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Remove trove from default config https://review.openstack.org/161797 | 21:28 |
| *** achanda has joined #openstack-infra | 21:28 | |
| zaro | fungi: would you be able to help me verify https://review.openstack.org/#/c/163104/ | 21:28 |
| *** salv-orlando has joined #openstack-infra | 21:28 | |
| fungi | _qb: most third-party ci deployments are the stuff to the right starting with zuul, communicating with the bits we're running upstream on the left | 21:28 |
| zaro | fungi: look at the last comment | 21:29 |
| clarkb | jeblair: does that make sense to you? maybe the thing to do is just push it up and let people argue over it in gerrit :) | 21:29 |
| clarkb | jesusaurus: will push that up as soon as I can run tests on it | 21:29 |
| jesusaurus | clarkb: awesome | 21:29 |
| asselin | how do you share images? | 21:29 |
| clarkb | asselin: imgur | 21:29 |
| fungi | zaro: yeah, i thought jeblair was suggesting running mysql client commands to convert the charset on the tables in the current database | 21:30 |
| zaro | fungi: yeah, i tried that but didn't help at all | 21:30 |
| zaro | fungi: i don't think it has anything to do with the collation of the tables. its the default connection between client and db | 21:31 |
| _qb | fungi: thanks, good start. I need to flesh out more detail for mine tho, depicting nodepool, puppet, jjb, components of the ci cloud, etc. I guess if it doesn't exist, maybe it'll be a useful contribution once it's done? | 21:31 |
| jeblair | clarkb: i was just about to sit down and do the math on that; i don't have anything further to offer yet. but if you have a solution, feel free to push it up and hopefully by then i'll be caught up. | 21:31 |
| fungi | zaro: got it, then yeah i expect being explicit about the encoding on the mysql server side of the connection is preferable to embedding that implementation detail in the uri | 21:31 |
| *** ddieterl_ has quit IRC | 21:31 | |
| asselin | _qb, ok, here's what I created: http://imgur.com/VvGzZyc | 21:31 |
| jlvillal | So can I beg anyone for a review of: https://review.openstack.org/#/c/163600/ The openstack/python-ironicclient is blocked because of this. :( | 21:32 |
| jlvillal | This is an httpretty new release issue. | 21:32 |
| _qb | asselin: thanks! | 21:32 |
| *** boris-42 has quit IRC | 21:32 | |
| fungi | _qb: definitely--i think a lot of that is already being fleshed out in some contributions up for review right now so reviewing those or adding to them is always appreciated | 21:33 |
| zaro | fungi: we can try it on review-dev.o.o first | 21:33 |
| fungi | _qb: asselin and krtaylor can probably point you to those faster than i can though | 21:33 |
| fungi | zaro: yep, i'm all for trying it there and seeing what happens | 21:33 |
| jeblair | zaro: so after setting the default charset on the tables, and restarting gerrit, jdbc still did not choose utf8 character encoding? | 21:34 |
| zaro | jeblair: that is correct. | 21:34 |
| jesusaurus | asselin: oh, nice image. thats useful | 21:34 |
| *** mmedvede has quit IRC | 21:34 | |
| jeblair | zaro: okay, let's ask SpamapS and mordred to weigh in on https://review.openstack.org/#/c/163104/2 and the option in your comment there | 21:35 |
| asselin | jesusaurus, glad you like it | 21:35 |
| fungi | asselin: very nice diagram | 21:35 |
| jeblair | zaro: also, we should decide out if we _also_ want to set the table charset and collation. | 21:35 |
| clarkb | jeblair: ya I am pretty sure jesusaurus is correct now. Just testing the change locally before I push it up | 21:35 |
| clarkb | hrm no that makes tests explode | 21:36 |
| clarkb | jesusaurus: ^ | 21:37 |
| jogo | have you guys ever experienced out of sync nova quotas on public clouds? | 21:37 |
| clarkb | oh wait I think I know | 21:37 |
| zaro | jeblair: the review-dev.o.o db has already been converted to utf8_bin if we want to do any other testing before converting review.o.o db | 21:37 |
| jesusaurus | clarkb: it does? | 21:37 |
| *** yfried|pto is now known as yfried|afk | 21:38 | |
| clarkb | jesusaurus: ya we don't end up building enough nodes with taht change | 21:38 |
| jogo | I am trying to reproduce some of the issues | 21:38 |
| clarkb | so the tests timeout waiting for nodes | 21:38 |
| asselin | fungi, thanks | 21:38 |
| clarkb | jogo: I don't think so. Usually when we have quota errors we have leaked actual resources that are consuming that quota | 21:38 |
| jogo | clarkb: good to know thanks | 21:39 |
| clarkb | jesusaurus: I think the reason is that we may want the middle group that the current patch provides | 21:39 |
| mordred | jeblair, zaro: sooo.... the current db is latin-1 and also the connection string is latin1, yeah? | 21:39 |
| jesusaurus | clarkb: which middle group? | 21:39 |
| clarkb | jesusaurus: sorry not group, ground | 21:40 |
| *** radez is now known as radez_g0n3 | 21:40 | |
| clarkb | jesusaurus: the change as currently written works towards satisfying min-ready without trying to reach it in one step | 21:40 |
| clarkb | jesusaurus: if you try to reach it in one step then you hit the capacity boundry much easier | 21:40 |
| clarkb | which is what causes the tests to fail I think | 21:40 |
| jesusaurus | oh | 21:40 |
| *** koolhead_ has quit IRC | 21:41 | |
| mordred | jeblair, zaro: I have no problem with the patch, and yeah, it shoudl work - however, it means that strings will be encoded strangely if we access them from not-gerrit | 21:42 |
| clarkb | based on the test results I think the current change is what we want | 21:42 |
| zaro | mordred: the character_set_server is set to "latin1" | 21:42 |
| mordred | yeah | 21:42 |
| *** baoli has joined #openstack-infra | 21:42 | |
| jeblair | clarkb: i don't think anything about this was designed to be multi-step, so that's confusing... | 21:42 |
| jeblair | clarkb: i'm not sure we should count on that | 21:42 |
| *** HeOS has quit IRC | 21:42 | |
| jesusaurus | clarkb: well in that case, do we want to be more explicit about what we are doing and why? and add a line that reduces extra_demand for that purpose rather than double-subtracting ready? | 21:42 |
| clarkb | jeblair: jesusaurus specifically I think the issue in the tests is min-ready is label specific but capacity is provider specific | 21:43 |
| clarkb | and in the tests neither provider can satisfy min ready outright | 21:43 |
| mordred | if we know that we're going to be inserting data in utf8, we should really also set the character_set_server to utf8 and we should alter the table | 21:43 |
| zaro | mordred: not sure if that answers your question but i believe setting that to utf8 fixes issue in 163104 | 21:43 |
| *** tonytan4ever has quit IRC | 21:43 | |
| mordred | that way, if a mysql command line client connects with a default value of latin1, it will know that the server is sending it utf8 and will transcode appropriately | 21:43 |
| clarkb | jesusaurus: jeblair: and since the tests rely on min-ready to supply nodes instead of job demand we basically schedule no jobs | 21:44 |
| clarkb | er no nodes | 21:44 |
| *** timcline has quit IRC | 21:44 | |
| *** ociuhandu has quit IRC | 21:44 | |
| *** baoli has quit IRC | 21:44 | |
| jeblair | mordred: is that a client or server setting? (or both) | 21:44 |
| mordred | jeblair: both | 21:44 |
| jeblair | mordred: since we use trove for the server, i don't know if we can set it there. | 21:44 |
| mordred | jeblair: it's a setting in many places | 21:45 |
| *** baoli has joined #openstack-infra | 21:45 | |
| jeblair | mordred: so at least setting it on the gerrit server means that anything we run from there will use it, which is good. | 21:45 |
| mordred | jeblair: yes | 21:45 |
| mordred | it's likely a fine choice | 21:45 |
| jeblair | mordred: but connections from not-the-gerrit-server (which should be none, unless we are migrating) would not use it | 21:45 |
| *** zz_dimtruck is now known as dimtruck | 21:46 | |
| *** sdake_ has quit IRC | 21:46 | |
| jeblair | mordred, zaro: so sounds like config file update + alter table is the way to go | 21:46 |
| jesusaurus | clarkb: ah, so the min_ready of one label could potentially starve capacity of another label in the same provider... | 21:46 |
| mordred | jeblair: yes. although we could also set a default client charset setting in those | 21:46 |
| clarkb | jesusaurus: yes | 21:46 |
| jeblair | i'm also okay reverting this feature out and saying "reduce min-ready if it's bothering you" | 21:47 |
| clarkb | jeblair: which feature? | 21:47 |
| jeblair | clarkb: the change to ignore min ready when near capacity | 21:47 |
| zaro | jeblair, mordred : i assume we would still be altering tables to utf8_bin ? | 21:47 |
| *** sdake_ has joined #openstack-infra | 21:48 | |
| *** sdake_ has quit IRC | 21:48 | |
| *** sdake_ has joined #openstack-infra | 21:48 | |
| clarkb | jeblair: I am going to read my orinal change again to see if that is different | 21:48 |
| jeblair | clarkb: i may not have been clear; the change i'm referring to was added by ianw quite a while ago | 21:49 |
| jesusaurus | clarkb: jeblair what are your thoughts on a larger change to consider all labels of a provider before determining how many of each label to create? | 21:50 |
| clarkb | jeblair: I know, but my patchset2 was different code | 21:50 |
| *** amotoki has quit IRC | 21:50 | |
| jeblair | jesusaurus: i would rather stabilize nodepool, not touch the allocator, and work on zuulv3 changes for it so we can get rid of the allocator | 21:50 |
| jeblair | clarkb: ok, just making sure | 21:50 |
| clarkb | jeblair: and that worked too then ianw suggested the current stuff | 21:50 |
| *** banix has joined #openstack-infra | 21:51 | |
| jeblair | jesusaurus: also, it is not clear to me that the allocator does not already do that :) | 21:51 |
| *** dimtruck is now known as zz_dimtruck | 21:51 | |
| *** mrunge has quit IRC | 21:52 | |
| jeblair | (or at least greatly simplify the allocator) | 21:52 |
| *** zz_dimtruck is now known as dimtruck | 21:52 | |
| clarkb | right I think allocator is doing the correct thing | 21:53 |
| clarkb | this is determining demand to feed into the allocator that is being trouble | 21:53 |
| *** mriedem is now known as mriedem_away | 21:55 | |
| banix | anteaya: could you or any other core please add me (username on gerrit is mb-s) to the newly created project networking-ibm and networking-ibm-release | 21:55 |
| *** esker has quit IRC | 21:55 | |
| jesusaurus | oh, if the allocator is taking this demand and figuring out the correct number of nodes to allocate, then why not just always add the min_ready to the demand? | 21:55 |
| clarkb | hrm the capacity for loop does accomodate all providers so maybe my initial thoughts on why tests fail are wrong | 21:55 |
| *** hashar has quit IRC | 21:56 | |
| fungi | jeblair: zaro: mordred: sorry, stepped away for a moment, but do we need to check whether we can set a default encoding in trove for that instance? | 21:56 |
| clarkb | jesusaurus: thats what it used to do prior to the change jeblair has suggested we might revert. The chagne was made because if min-ready is high for some labels you can start other labels | 21:56 |
| clarkb | jesusaurus: because min-ready ratios play into the allocators calculation | 21:56 |
| *** HeOS has joined #openstack-infra | 21:56 | |
| jesusaurus | right, so you can use that to your advantage to tune which labels get prioritized | 21:57 |
| jeblair | fungi: it might be nice to know, but considering we don't manage that in puppet right now, i worry about setting it there (since it affects the way data are stored) | 21:57 |
| *** yfried|afk is now known as yfried|pto | 21:58 | |
| openstackgerrit | Mathieu Gagné proposed openstack-infra/jenkins-job-builder: Add ability to configure releaseEnvVar for maven-deploy publisher https://review.openstack.org/163626 | 21:59 |
| openstackgerrit | Merged openstack-infra/ansible-puppet: Its 0o not 0c to make an octal number https://review.openstack.org/163618 | 21:59 |
| fungi | fair enough, that's admittedly a longer-lasting effect than the timeout config change we added | 21:59 |
| jeblair | fungi: yeah, if we forget to set that, we haven't lost any data | 21:59 |
| SlickNik | fungi / jeblair: You can use the trove config groups API to set the default encoding if you choose to do so. | 22:00 |
| jeblair | clarkb: i could probably get used to the behavior you have in the current patchset (4) | 22:00 |
| jeblair | clarkb: if you end up deciding it's the best way to go | 22:00 |
| *** sdake_ has quit IRC | 22:00 | |
| * SlickNik just saw the conversation and is reading scrollback for context | 22:00 | |
| clarkb | jeblair: my gut is telling me its correct, trying to quantify that though :) | 22:01 |
| jeblair | SlickNik: https://review.openstack.org/#/c/163104/2 (and comments therein) should help fill you in | 22:01 |
| mkj_wk | clarkb: were you the one who suggested ssh -T to me earlier? | 22:01 |
| fungi | SlickNik: thanks. i think right now the concern is that we don't have any configuration management/orchestration around our use of trove | 22:01 |
| fungi | SlickNik: so it's too easy to forget to do that | 22:01 |
| *** marun has quit IRC | 22:01 | |
| clarkb | mkj_wk: yes | 22:02 |
| jeblair | hopefully we will be able to manage that with mordred's ansible work in the future | 22:02 |
| mordred | yes | 22:02 |
| mordred | we will | 22:02 |
| *** otter768 has joined #openstack-infra | 22:02 | |
| mkj_wk | I have another case of EOFError that it looks like the only way around it other than ugly time.sleep(1) is to include a dependency on the pexpect module | 22:02 |
| mkj_wk | which is fine for py3 | 22:03 |
| mkj_wk | but maybe not fine for py26 | 22:03 |
| clarkb | jesusaurus: jeblair let me try one more thing | 22:03 |
| fungi | mkj_wk: pexpect has some odd quirks. i used to be a fan, but in more recent years have discovered that reimplementing whatever i was using it for from stdlib functions is pretty trivial and easier to debug | 22:04 |
| mkj_wk | fungi: ugh | 22:04 |
| mkj_wk | fungi: I didn't go down the pexpect path yet | 22:05 |
| *** mpopow_ has joined #openstack-infra | 22:05 | |
| zaro | jeblair, mordred : so it's unclear to me what you mean when you say alter table. Does that mean change all the db configs (charset & collation) to utf8? and change the collation on the gerrit tables to 'utf8_bin'? | 22:05 |
| mkj_wk | even turning off line buffering and waiting for a single byte() to be written hangs | 22:05 |
| clarkb | jeblair: jesusaurus I think the trouble with jesusaurus' algorithm is that max(0, start_demand -ready) removes the -ready if startdemand < ready | 22:05 |
| *** annegentle has quit IRC | 22:05 | |
| mkj_wk | I'm guessing it's related to messing around with file descriptors for logging in the test suite | 22:06 |
| mkj_wk | kind of frustrating; I have all the branches covered by unit tests but I really want to keep the functional test | 22:06 |
| fungi | mkj_wk: can you interrupt it and provide the traceback? though i'm quickly reaching the point in the evening where i'm probably going to go do some not here stuff | 22:06 |
| mkj_wk | and with time.sleep(1) it does validate the resulting output correctly | 22:07 |
| zaro | fungi: are we gonna test that change to mysql config? | 22:07 |
| mkj_wk | it's from raw_input | 22:07 |
| *** mpopow has quit IRC | 22:07 | |
| *** otter768 has quit IRC | 22:07 | |
| fungi | zaro: sure, did you disable puppet on review-dev and edit my.cnf yet? | 22:07 |
| *** baoli has quit IRC | 22:08 | |
| zaro | fungi: isn't my.cnf on the trove server? | 22:08 |
| *** yfried|pto is now known as yfried|afk | 22:08 | |
| *** cody-somerville has quit IRC | 22:08 | |
| clarkb | jesusaurus: jeblair ya thats it | 22:08 |
| clarkb | ok let me write a new patch that accomodates all that I have jus learned | 22:08 |
| mkj_wk | fungi: http://pastebin.com/DQnLQ6iR | 22:08 |
| fungi | zaro: not in this case no. that's what we were talking about not bothering with the server side just setting my.cnf on the gerrit server (assuming the jdbc is looking at it at all) | 22:08 |
| zaro | fungi: i don't have ssh access to the db | 22:08 |
| mkj_wk | fungi: but I don't think the traceback helps much | 22:09 |
| mkj_wk | fungi: Even just as a backup, and for review of the changes I did due to latest review cycle, I think I'll submit the patch for review with the current ugly time.sleep() | 22:09 |
| openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Run ironicclient functional tests as STACK_USER https://review.openstack.org/163552 | 22:10 |
| mkj_wk | be interesting, if nothing else, to see what it does under jenkins | 22:10 |
| fungi | mkj_wk: yeah, i wonder if do_input() should just be mocked out for unit tests | 22:10 |
| zaro | fungi: hmm, i was referring to the db side. i didn't know there was a my.cnf on review-dev | 22:10 |
| mkj_wk | fungi: I *did* mock it for the unit tests | 22:10 |
| mkj_wk | the unit tests are fine | 22:10 |
| jeblair | zaro: nobody does so i think the idea is to set my.cnf on review-dev to use the option, then see if gerrit respects it (without setting the connection string) | 22:10 |
| mkj_wk | it's the funtional testing where we're invoking a subprocess | 22:10 |
| fungi | zaro: it would affect mysql client sessions run from the gerrit server | 22:10 |
| fungi | and potentially other things that look at that config (no idea if gerrit's process does or not) | 22:11 |
| jeblair | zaro: if gerrit needs the connection string set, then probably we should do it both places or revisit the idea of setting it in trove | 22:11 |
| *** dboik has quit IRC | 22:11 | |
| *** dims has quit IRC | 22:11 | |
| * zaro is confused | 22:12 | |
| fungi | ultimately, i think that having our trove databases default to latin1 for _anything_ is bad form, but i understand it was a default in mysql for so long that lots of trove users probably expect it | 22:12 |
| *** jedimike has joined #openstack-infra | 22:12 | |
| zaro | review-dev.o.o is set to use an external trove db. why would i make changes to the my.cnf on review-dev.o.o? | 22:13 |
| jeblair | zaro: because mysql clients read that file | 22:13 |
| fungi | and ultimately most applications i've dealt with ignore what charset is reported by the database server, so gerrit strikes me as a little weird in that regard | 22:13 |
| *** baoli has joined #openstack-infra | 22:13 | |
| openstackgerrit | Michael Johnson proposed openstack-infra/git-review: Choose correct branch for rebase when submitting https://review.openstack.org/158877 | 22:13 |
| fungi | zaro: when we do maintenance, database backups and restores, et cetera, they use the my.cnf on the gerrit server | 22:14 |
| zaro | ok. will give a try. | 22:14 |
| fungi | but yeah, i have doubts that gerrit itself will ever know anything about what's in that file | 22:15 |
| jeblair | me too, but i'd like certanties :) | 22:15 |
| fungi | absolutely | 22:15 |
| fungi | scientific method and all that | 22:15 |
| mkj_wk | I don't think the rest of the patch is ugly, just that one sleep... We'll see what happens in Jenkins; I'm curious | 22:16 |
| anteaya | fungi: could you add banix (gerrit username: mb-s) to https://review.openstack.org/#/admin/groups/635,members and the co-responding -release group when you have a moment? | 22:16 |
| *** carl_baldwin has quit IRC | 22:16 | |
| jroll | hey, ironicclient gate is busted on a new httpretty version, someone mind getting this through? https://review.openstack.org/#/c/163600/ | 22:17 |
| fungi | mkj_wk: you said it was hanging under python 2.x but not 3.x? we seem to use raw_input() in 3.x and input() in 2.x | 22:17 |
| fungi | anteaya: banix: done | 22:18 |
| banix | anteaya: fungi thanks! | 22:19 |
| jeblair | jroll: is that the same issue that prompted the 087 blacklist? | 22:19 |
| *** craigbr has joined #openstack-infra | 22:19 | |
| jroll | jeblair: I'm not sure, I wasn't in on that one. wouldn't be surprised | 22:19 |
| jeblair | https://review.openstack.org/#/c/158897/ | 22:20 |
| jeblair | jlvillal: ^ | 22:20 |
| jeblair | i ask because the linked bug seems to have some people blacklisting 0.8.7 | 22:20 |
| jroll | jlvillal: are you thinking pin it harder? | 22:20 |
| jroll | err, jeblair ^ | 22:20 |
| jeblair | i wonder if we should continue the whack-a-mole, or change strategy | 22:21 |
| jroll | yeah, I was thinking the same | 22:21 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Test that dib failures don't stop node builds https://review.openstack.org/162237 | 22:21 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Accomodate ready nodes in min-ready checks https://review.openstack.org/162714 | 22:21 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Don't allocate nodes to providers without images https://review.openstack.org/162255 | 22:21 |
| zaro | fungi, jeblair : i changed my.cnf on review-dev.o.o but it didn't work | 22:21 |
| *** mmedvede has joined #openstack-infra | 22:21 | |
| clarkb | jeblair: jesusaurus ^ I believe that to be correct and it passes tests locally | 22:21 |
| clarkb | it also reads a bit cleaner than patchset2 which was also correct I think | 22:21 |
| *** movielovers has left #openstack-infra | 22:22 | |
| anteaya | fungi: thanks for your corrections and input on https://etherpad.openstack.org/p/scaling-election-tooling | 22:22 |
| jeblair | zaro, mordred, fungi: okay so i think our choices are (a) set my.cnf AND gerrit's jdbc connection string or (b) set the value for the server in trove | 22:22 |
| zaro | fungi, jeblair : i have tested that config on my personal mysql server and it does work for me. but i applied it on mysql server side | 22:22 |
| clarkb | ok puppet is much happier now with the octal settings | 22:24 |
| clarkb | er octal fix. I do notice that the ansible task can't figure out the puppet agent state on some nodes though | 22:24 |
| fungi | jeblair: we can likely just add it to the same custom trove config we're already applying to adjust the timeout. it strikes me as something we should consider applying to all our trove instances anyway, across the board | 22:24 |
| *** ayoung has joined #openstack-infra | 22:24 | |
| *** hogepodge has quit IRC | 22:24 | |
| jeblair | jroll, jlvillal: +2 with the comment that i would also +2 something stronger | 22:25 |
| *** annegentle has joined #openstack-infra | 22:25 | |
| *** pblaho has joined #openstack-infra | 22:25 | |
| jeblair | fungi: yeah, the complexity of (a) is leading me to think that (b) might be the better option (and try to remember not to screw it up) | 22:26 |
| clarkb | wow thats interesting. zm05 is running puppet2 | 22:26 |
| jroll | jeblair: thanks | 22:26 |
| jeblair | clarkb: i love it when that happens | 22:26 |
| fungi | clarkb: is it staging a revolt? | 22:26 |
| clarkb | fungi: must be | 22:26 |
| clarkb | I think 05-08 are all that way | 22:26 |
| jeblair | someday it's going to get fed up and just run ansible | 22:26 |
| clarkb | likely built together and all got the same initial config | 22:26 |
| *** saper has quit IRC | 22:26 | |
| * fungi was thinking exactly the same thing | 22:26 | |
| clarkb | the next puppet run is the first one that will use project_config_ref | 22:27 |
| clarkb | in ~3 minutes | 22:27 |
| openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Install python-ironicclient from git when we're testing it https://review.openstack.org/163632 | 22:27 |
| jlvillal | jeblair: I think it is the same bug for 0.8.7 and 0.8.8. | 22:28 |
| jlvillal | jeblair: jroll: I put the link to what I think is the bug. I'm not 100% sure though. | 22:28 |
| devananda | adam_g: with ^ I think we could remove the gate-tempest-dsvm-neutron-src-python-ironicclient job ? | 22:29 |
| * clarkb notices that hpcloud is mostly errors today | 22:29 | |
| fungi | jeblair: mordred: zaro: SpamapS: SlickNik: so the last question i think is, regardless of where we end up setting our encoding preference, do we need to do any sort of etl to convert text from latin1 to utf8 or is a sufficient amount of latin1 a proper subset of utf8 that it's not worth bothering (or is there some special mysql operation that happens during table conversion to take care of it for | 22:30 |
| *** asettle is now known as asettle-mtg | 22:30 | |
| fungi | us)? | 22:30 |
| clarkb | ClientException: Unknown Error (HTTP 500) | 22:30 |
| fungi | clarkb: after seeing how the sausage is made, i pretty much just assume that errors are the steady state all clouds approach | 22:31 |
| mordred | clarkb: it's my favorite error | 22:31 |
| clarkb | mordred: OSError: [Errno 2] No such file or directory: '/etc/facter/facts.d/ansible.json' | 22:31 |
| jeblair | fungi: oh, i guess we should change the table regardless? | 22:31 |
| clarkb | mordred: so I think your ansible module needs to mkdir | 22:31 |
| *** jaypipes-afk is now known as jaypipes | 22:31 | |
| mordred | clarkb: piddle. k | 22:31 |
| *** dangers is now known as dangers_away | 22:31 | |
| *** adalbas has quit IRC | 22:31 | |
| mordred | clarkb: think we should just do that in the role regardless? or in the python? | 22:32 |
| fungi | jeblair: maybe? does that make alterations to the data stored in it? | 22:32 |
| clarkb | mordred: I think it should be part of ansible-puppet since it intends to make use of the feature | 22:32 |
| fungi | my lack of mysql-savvy is showing | 22:32 |
| clarkb | mordred: but role vs puppet I don't know enough about ansible to say | 22:32 |
| adam_g | devananda maybe, still looking thru JJB yaml | 22:33 |
| jeblair | fungi: i don't think so | 22:33 |
| clarkb | er sorry role vs python | 22:33 |
| clarkb | mordred: though maybe python because that is where we write to the dir so making the dir keeps everything together | 22:34 |
| *** dboik has joined #openstack-infra | 22:34 | |
| clarkb | mordred: keeps the code readable for understanding | 22:34 |
| *** annegentle has quit IRC | 22:34 | |
| zaro | fungi: i believe it does. but i think you can get around that by doing export then import | 22:34 |
| fungi | jeblair: hence my question as to whether there's any etl we should be doing | 22:34 |
| fungi | zaro: yeah, basically that | 22:34 |
| fungi | export, change encoding, import | 22:34 |
| *** dboik_ has joined #openstack-infra | 22:34 | |
| mordred | clarkb: kk | 22:35 |
| *** peristeri has quit IRC | 22:35 | |
| jeblair | fungi: oh, i would expect the latin1 < utf8 characteristic to mean we don't need to etl. keep bugging mordred for an answer though. ;) | 22:35 |
| fungi | jeblair: also SpamapS had described the challenges relating to mysql charset changes at one point, so cornering him might help | 22:36 |
| jeblair | yup. | 22:36 |
| *** cody-somerville has joined #openstack-infra | 22:36 | |
| *** jgrimm is now known as zz_jgrimm | 22:36 | |
| fungi | but yeah, i gather that at least _most_ (all?) of latin1 is a subset of utf8 using the same codepoint to byte value mapping | 22:36 |
| clarkb | mordred: if you are taking care of that I will look into the hpcloud failures a bit more | 22:36 |
| *** dboik has quit IRC | 22:38 | |
| fungi | my jukebox has decided to start playing the original wendy carlos film score for tron, so i'm taking that as a clue to find beer and do some other things for a bit | 22:39 |
| clarkb | we are seeing {"message": "No valid host was found. ", "code": 500, "created": "2015-03-11T22:32:18Z"} again | 22:39 |
| SpamapS | jeblair: what is the question? | 22:39 |
| SpamapS | I have a ridiculous amount of experience dealing with utf-8 encoding issues and mysql. | 22:39 |
| SpamapS | ridiculous. | 22:39 |
| jeblair | fungi: END OF LINE | 22:40 |
| clarkb | I do not think it is related to bad images | 22:40 |
| fungi | SpamapS: we have a mysql database with tables containing latin1 text and want to switch to utf8. any need to convert the data? | 22:40 |
| clarkb | instead the node with that error is in az2 and last time when I tried to dbeug the image I saw that az2 would fail with that error but az1 and az3 would now | 22:40 |
| clarkb | s/now/not/ | 22:40 |
| fungi | jeblair: heh. i recognize that | 22:40 |
| SpamapS | fungi: are you 100% certain all of the data is latin1 and none of it is high-byte? | 22:40 |
| clarkb | so I think that az2 is simply not able to accomodate those requests at times because it is the default az2 so likely has higher use | 22:40 |
| SpamapS | fungi: that is _not_ an easy question to answer. ;) | 22:41 |
| clarkb | we can try to use less of az2 or maybe not use it at all | 22:41 |
| clarkb | or maybe poke hpcloud to add capacity there? | 22:41 |
| jeblair | clarkb: so you're seeing 500 unknown errors predominately in az2? | 22:41 |
| *** banix has quit IRC | 22:41 | |
| fungi | SpamapS: in this case i think it is because gerrit seems to apply some substitution to data it's storing if there is no representation in the target encoding for the codepoint provided, so stores literal ? characters in the db | 22:41 |
| *** nikhil_k is now known as _pope | 22:41 | |
| SpamapS | fungi: if the answer is yes, though, then no, "alter table foo convert to charset 'utf-8'" is safe and effective | 22:42 |
| clarkb | jeblair: when the theory was bad image and I was trying to reproduce that yes. I am still trying to see if that is the case with nodepool now | 22:42 |
| *** gordc has quit IRC | 22:42 | |
| clarkb | jeblair: hopefully will be able to confirm this theory soon | 22:42 |
| SpamapS | fungi: ah yes! gerrit probably uses iconv or some workalike | 22:42 |
| fungi | yeah, a java equivalent of that anyway | 22:42 |
| fungi | so sounds like we ought to be fine | 22:43 |
| fungi | or at least no more broken after the conversion than before | 22:43 |
| *** _pope is now known as nikhil_k | 22:43 | |
| mordred | clarkb: yeah - I got it in just a sec | 22:43 |
| clarkb | also nova show doesn't show the AZs properly :/ | 22:43 |
| SpamapS | fungi: and yeah, thats a lossy conversion unfortunately. | 22:43 |
| jeblair | SpamapS: so i think the proposal is: alter the tables and set the connection encoding to utf8 in trove | 22:43 |
| SpamapS | fungi: but it does mean you can just convert to utf-8 and then make sure gerrit knows to expect utf-8 in/out | 22:43 |
| SpamapS | Yeah that's the other piece. :) | 22:44 |
| fungi | SpamapS: mostly we want to switch to utf8 so we can stop losing from here on, but there's no hope of recovering whatever gerrit never stored in the first place obviously | 22:44 |
| SpamapS | thats the _stupid_ piece. :-P | 22:44 |
| *** thedodd has quit IRC | 22:44 | |
| fungi | thankfully it's just review comments that are at issue. important data is in git and utf8 works there just dandy | 22:45 |
| clarkb | jeblair: I am seeing it in az3 nodes too | 22:45 |
| clarkb | jeblair: but the error message there is slightly different {"message": "No valid host was found. Exceeded max scheduling attempts 3 for instance 7321402d-0ccc-4bf3-9270-5b20583b57d2", "code": 500, "created": "2015-03-11T22:30:39Z"} | 22:45 |
| *** Longgeek has joined #openstack-infra | 22:45 | |
| jeblair | clarkb: so that seems like they ran out of capacity :( | 22:46 |
| fungi | clarkb: i've seen that one plenty off and on | 22:46 |
| clarkb | jeblair: ya that would be my guess | 22:46 |
| *** dims_ has joined #openstack-infra | 22:46 | |
| fungi | someone (us?) called the bluff on their overcommit | 22:46 |
| clarkb | fungi: and throttled resources :) | 22:46 |
| fungi | heh | 22:46 |
| fungi | maybe gilliard or tteggel are around and know what's going on | 22:47 |
| clarkb | but ya sampling the most recent errors there is those two error messages with on affecting az2 and the other affecting az3 | 22:47 |
| jeblair | wow. currently used nodes: rax: 253. hpcloud: 59. | 22:47 |
| fungi | https://community.hpcloud.com/status has a couple items for todat | 22:48 |
| fungi | today too | 22:48 |
| fungi | truedat | 22:48 |
| clarkb | I don't think those should affect us. Horizon and account creation | 22:48 |
| clarkb | but maybe fallout? | 22:48 |
| *** ayoung has quit IRC | 22:50 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Skip the neutron client compat job for ironic, test it elsewhere https://review.openstack.org/163632 | 22:50 |
| openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Skip the default client compat job for ironic, test it elsewhere https://review.openstack.org/163632 | 22:50 |
| *** amotoki has joined #openstack-infra | 22:50 | |
| adam_g | devananda, ^ | 22:51 |
| *** jedimike has quit IRC | 22:51 | |
| *** banix has joined #openstack-infra | 22:52 | |
| *** banix has quit IRC | 22:53 | |
| *** Longgeek has quit IRC | 22:55 | |
| clarkb | fungi: any chance you can review the stack starting at 162673? | 22:55 |
| fungi | clarkb: sure | 22:55 |
| *** sdake_ has joined #openstack-infra | 22:55 | |
| *** amotoki has quit IRC | 22:56 | |
| fungi | seen those flying by but hadn't dug into them yet | 22:56 |
| clarkb | az1 just had a {"message": "No valid host was found. Exceeded max scheduling attempts 3 for instance 982b5dde-c89a-4d52-aa09-c95962503f98", "code": 500, "created": "2015-03-11T22:48:41Z"} | 22:57 |
| jeblair | clarkb: how do you see that error message? | 22:57 |
| *** sdake__ has joined #openstack-infra | 22:57 | |
| fungi | shows up in the nodepool debug log, yeah? | 22:58 |
| mordred | jeblair: nova show on an instance id will have that | 22:58 |
| clarkb | jeblair: I am grepping for 'status: ERROR' in the nodepool debug log then taking the uuid and using nova show on it | 22:58 |
| openstackgerrit | Wayne Warren proposed openstack-infra/infra-specs: (WIP) Initial work on gitub-integration spec. https://review.openstack.org/163637 | 22:58 |
| fungi | oh, right, nova show on an instance in error starte | 22:58 |
| fungi | state | 22:58 |
| fungi | that's where i ended up finding it in the past | 22:58 |
| fungi | wonder how we could go about getting that into nodepoold's line of sight | 22:59 |
| *** baoli has quit IRC | 22:59 | |
| fungi | i guess when it's doing the nova list and spots an instance it was waiting for go into error, it could grab nova show details before switching to delete | 22:59 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Gracefully handle upload failures https://review.openstack.org/163239 | 23:00 |
| greghaynes | clarkb: ^ that works from tox, unsure why I get deadlock issues when I testtools.run directly | 23:00 |
| *** sdake_ has quit IRC | 23:00 | |
| *** tnovacik has quit IRC | 23:02 | |
| openstackgerrit | Merged openstack-infra/nodepool: Add logging Popen to tests https://review.openstack.org/162673 | 23:02 |
| openstackgerrit | Merged openstack-infra/nodepool: Use local allocation history in scheduler https://review.openstack.org/162691 | 23:02 |
| *** vigneshvar has quit IRC | 23:03 | |
| *** dannywil_ has joined #openstack-infra | 23:03 | |
| *** dannywil_ has quit IRC | 23:03 | |
| *** craigbr has quit IRC | 23:03 | |
| jeblair | clarkb, mordred, fungi: the last time we got more than 100 instances from hpcloud was 1600 utc (when we had 200). it looks like we're between 50-100 since 1700 utc. | 23:04 |
| clarkb | jeblair: also sometimes nova show shows the az as "nova" in that case I have been looking in the nodepool list for the uuid as that shows me the az nodepool tried to schedule it in | 23:04 |
| fungi | clarkb: i'm cool with 162714 but ianw makes a good point with readability on the extra_demand calculation. you're doing (albeit trivial) extra work there which makes the relationship to actual_demand less obvious | 23:04 |
| *** e0ne is now known as e0ne_ | 23:04 | |
| clarkb | fungi: so thats what the giant discussion was above | 23:04 |
| clarkb | fungi: ianw's suggestion is unfortunately not correct | 23:04 |
| jeblair | our graphs seem to show a problem from 1000 to 1600 utc | 23:05 |
| *** ghostpl_ has quit IRC | 23:05 | |
| clarkb | fungi: so I have incorporated some of his suggestions while writing a correct demand calculation | 23:05 |
| fungi | oh, rereading again to see where i miscomprehended | 23:05 |
| *** patrickeast_ has joined #openstack-infra | 23:05 | |
| clarkb | fungi: specifically we can't max(0, x - y) then reuse that value in arithmetic later because the max functions breaks the maths | 23:05 |
| *** dannywilson has quit IRC | 23:06 | |
| clarkb | fungi: max(0, x - y) + z != max(0, x-y+z) | 23:06 |
| *** sdake__ has quit IRC | 23:06 | |
| *** patrickeast has quit IRC | 23:06 | |
| *** patrickeast_ is now known as patrickeast | 23:06 | |
| fungi | clarkb: oh, good point. if start_demand - ready is a negative value, then we'd be combining label.min_ready to 0 | 23:06 |
| cody-somerville | clarkb: jeblair: Is this US East or West? | 23:06 |
| clarkb | fungi: yup and that speficall is what broke when I tried jesusaurus' suggestion. So the current patch is blend of jesusaurus and ianw math | 23:07 |
| clarkb | cody-somerville: east | 23:07 |
| jeblair | people keep asking that -- is there a west we should be using? | 23:07 |
| clarkb | jeblair: no, I was specifically told to not use west | 23:07 |
| clarkb | though that may have changed since then | 23:08 |
| fungi | apparently hpcloud west is a myth used as a marketing ploy to convince customers there are multiple regions ;) | 23:08 |
| clarkb | in fact when I tried to add it there was a great panic | 23:08 |
| *** sdake_ has joined #openstack-infra | 23:09 | |
| *** hugh_afk is now known as hughhalf | 23:09 | |
| fungi | clarkb: was 162237 spurred on by an error spotted in the wild? | 23:11 |
| *** hdd_ has quit IRC | 23:11 | |
| clarkb | fungi: yes, right around when rax rebooted the world we saw that | 23:12 |
| fungi | oh so joyous | 23:12 |
| clarkb | fungi: basically the exception rose up into the main event loop short circuiting it | 23:12 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Gracefully handle upload failures https://review.openstack.org/163239 | 23:12 |
| clarkb | jeblair wrote a fix that we got in so this is mostly CYA to make sure we don't regress again | 23:12 |
| ianw | clarkb: good point, that effect might be subtle enough that a extra comment to call it out is justified. | 23:12 |
| fungi | yep, looks like all tests and no runtime change which is why i was wondering | 23:13 |
| clarkb | ianw: ya I should probaby put my != statement I wrote above in the change | 23:13 |
| *** sdake_ has quit IRC | 23:14 | |
| ianw | clarkb: the other option might be to just remove the whole thing all together | 23:15 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Test that dib failures don't stop node builds https://review.openstack.org/162237 | 23:16 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Accomodate ready nodes in min-ready checks https://review.openstack.org/162714 | 23:16 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Don't allocate nodes to providers without images https://review.openstack.org/162255 | 23:16 |
| clarkb | I am fine with it in. I think it is understood now and the comments make it pretty straightforward to understand | 23:16 |
| jeblair | clarkb: did you see scheduling errors in az3? | 23:16 |
| *** hichihara has joined #openstack-infra | 23:16 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/nodepool: Gracefully handle upload failures https://review.openstack.org/163239 | 23:16 |
| clarkb | jeblair: yes | 23:16 |
| jeblair | hrm | 23:17 |
| fungi | rebased on outdated parent ^ | 23:17 |
| clarkb | jeblair: all of them had the problems but az3 appears to be worst | 23:17 |
| clarkb | though I am mostly only looking at the current errors and not historical ones (for simplicity) | 23:17 |
| *** asselin_ has joined #openstack-infra | 23:18 | |
| clarkb | I wonder if maybe this is an image interaction? we could try deleting images to see if it alleviates. We got much better reliability last time after going to the old image | 23:20 |
| fungi | zuul has finally started making progress on the post pipeline again | 23:20 |
| clarkb | which is why I had focused on the image but its may be more complex than that | 23:20 |
| *** woodster_ has quit IRC | 23:20 | |
| jeblair | clarkb: i thought we got instances that booted, but did not boot completely | 23:21 |
| rcarrillocruz | clarkb: i tried your foreground fix for the devstack gate, works perfect | 23:21 |
| rcarrillocruz | thx | 23:21 |
| jeblair | clarkb: is there another problem i am not remembering where we would not get instances reliably? | 23:21 |
| clarkb | jeblair: yes that is what we got there so this does appear different | 23:22 |
| clarkb | jeblair: so ssh was failing on those nodes and nodepool recycled them | 23:22 |
| clarkb | the tie in is when i tried to manually test the broken image I got these scheduling errors in az2 | 23:22 |
| clarkb | booting in az1/az3 fixed them though | 23:22 |
| jeblair | clarkb: could we have leaked enough ports to be over-quota again? was there a specific 'not enough ports' error? | 23:23 |
| *** asselin_ has quit IRC | 23:23 | |
| clarkb | jeblair: I think we got quota errors instead of these unknown exceptions, but worth checking how we look there | 23:23 |
| jeblair | we have 605 ports | 23:24 |
| jeblair | what's our port quota? | 23:24 |
| clarkb | jeblair: 600 | 23:24 |
| clarkb | I think, it should roughly be 1 port per node and we have a 600 node limit | 23:25 |
| clarkb | we also have 601 floating IPs | 23:25 |
| clarkb | nova list shows 542 nodes | 23:25 |
| clarkb | er -3 so 539 | 23:25 |
| *** sdake_ has joined #openstack-infra | 23:26 | |
| jeblair | clarkb: so we could be hitting limits on ports and ips | 23:27 |
| clarkb | we could be, but I have a hunch thats more of a symptom than a cause. Leaks would be more probable when nodepool is spinning super hard to boot stuff | 23:27 |
| mordred | clarkb, jeblair: do we have a current instance in that state? | 23:28 |
| clarkb | mordred: b741c9a5-1b1e-4028-a6ae-cf324e332033 | 23:28 |
| clarkb | but expect nodepool to delete it soonish | 23:28 |
| mordred | clarkb: can you hold it? | 23:28 |
| clarkb | mordred: its hard to because the delete happens immediately upon error | 23:29 |
| mordred | yah | 23:29 |
| jeblair | {"message": "Connection to neutron failed: Maximum attempts reached" is another one, btw | 23:30 |
| clarkb | I can run my scripts to pick out the leaked ports now | 23:30 |
| jeblair | clarkb: ~root/delete-leaked-ports.sh will delete them | 23:31 |
| jeblair | how about i kick that off in screen? | 23:31 |
| clarkb | jeblair: sure, does it do the listing too? | 23:31 |
| *** bknudson has quit IRC | 23:31 | |
| *** annegentle has joined #openstack-infra | 23:32 | |
| clarkb | I had been doing the listing and checking it to avoid deleting dhcp and router ports | 23:32 |
| jeblair | clarkb: oh, take a look at it and tell me if it does what you think we should do then | 23:32 |
| clarkb | if thats jesusaurus' script I think it will work it will just use more api calls than necessary which probalby isn't a real problem | 23:32 |
| jeblair | clarkb: yep, it is | 23:33 |
| jeblair | it's slow but steady | 23:33 |
| fungi | tortoises all the way down | 23:33 |
| clarkb | ya should be fine then. it specifically greps for compute as the device_owner | 23:33 |
| *** ihrachyshka has quit IRC | 23:34 | |
| clarkb | the faster way is the do neutron port-list -c id -c device_id -c device_owner to get those fields all at once. But then you would need to test the new script :) | 23:34 |
| jeblair | clarkb: running old script in screen | 23:34 |
| openstackgerrit | Qiming Teng proposed openstack-infra/project-config: new-project: stackforge/senlin https://review.openstack.org/163292 | 23:34 |
| *** wenlock has quit IRC | 23:34 | |
| jeblair | clarkb: noc tracked down a 'scheduled 3 times' error and confirmed it was due to ports | 23:36 |
| *** bswartz has joined #openstack-infra | 23:37 | |
| clarkb | cool | 23:37 |
| clarkb | I am going to run my script to delete unused floating ips | 23:37 |
| clarkb | `venv/bin/neutron floatingip-list | grep -v '10\.0\.' | sed -e '1,3d' -e '$d' | cut -d'|' -f 2 | xargs -n 1 -P 1 venv/bin/neutron floatingip-delete` ftr | 23:37 |
| clarkb | I'm weird and find grep -v, sed, and cut all useful for those specific operations rather than using only sed :) | 23:38 |
| *** cody-somerville has quit IRC | 23:39 | |
| clarkb | also I used xargs -P 1 beacuse the last time I tried -P10 I got rate limited | 23:40 |
| clarkb | ianw: lol python greatest hits tracebacks | 23:41 |
| *** chlong has joined #openstack-infra | 23:41 | |
| *** annegentle has quit IRC | 23:43 | |
| ianw | clarkb: i'm almost certain the call stack from the kernel entry-point, through the filesystem, through the i/o subsystem, to the driver is shorter than that. i guess that isn't doing something complex like installing a package though | 23:43 |
| openstackgerrit | Merged openstack-infra/project-config: Make manual checklang target voting https://review.openstack.org/162033 | 23:43 |
| clarkb | wow got rate limited with -P1 | 23:43 |
| clarkb | will have to make a second pass at this to get those that were missed | 23:43 |
| greghaynes | clarkb: shouldve used -P0.5 | 23:44 |
| clarkb | greghaynes: your test is running under tox -epy27 -- --until-failure on my local testbed | 23:45 |
| clarkb | greghaynes: did you figure out the meta thing? | 23:45 |
| greghaynes | yes, I was doing something silly | 23:46 |
| clarkb | was it the kwargs.get in the fake? | 23:46 |
| greghaynes | yep | 23:46 |
| greghaynes | such silly | 23:46 |
| clarkb | cool, and the change to the provider_manager is about what I expected | 23:47 |
| clarkb | er nodepool.py | 23:47 |
| jgriffith | clarkb: wondering if you might point me in the right direction on something with unit tests and output | 23:47 |
| jgriffith | clarkb: I'm trying to figure out how to get rid of all the "Captured stdout" cruft in the cinder unit tests | 23:48 |
| jgriffith | clarkb: you had a ML post with some similar stuff a while back... thought you might have some insight | 23:48 |
| clarkb | jgriffith: sure, let me dig up where that happens | 23:48 |
| clarkb | jgriffith: https://git.openstack.org/cgit/openstack/cinder/tree/cinder/test.py#n129 we have fixtures that collect stdout and stderr and logs for each test because the tests run in parallel | 23:50 |
| *** e0ne_ has quit IRC | 23:50 | |
| rcarrillocruz | can't quite figure out why this failure: https://jenkins07.openstack.org/job/check-shade-dsvm-functional/2/console | 23:50 |
| clarkb | jgriffith: so to associate particular output with specific tests that was the solution. If you don't want captured stdout then I would make the tests not write to stdout at all | 23:50 |
| rcarrillocruz | cacert is None, why it gets in? | 23:50 |
| rcarrillocruz | tests work fine locally, but i keep getting that failure in gate | 23:51 |
| rcarrillocruz | mordred: ^ | 23:51 |
| clarkb | jgriffith: should be easy to identify where that happens by monkey patching stdout to raise exceptions | 23:51 |
| jgriffith | clarkb: hmm.. we've got *a version* of that in place. | 23:51 |
| jgriffith | clarkb: it's libs that seems to be the culprit | 23:51 |
| *** ajmiller has quit IRC | 23:51 | |
| SpamapS | rcarrillocruz: how are you running the tests locally btw? | 23:52 |
| rcarrillocruz | putting some print statements in OpenstackCloud to figure out what's passed as argument on my cloud devstack instance, can you figure at a glance what may be? | 23:52 |
| *** mtanino has joined #openstack-infra | 23:52 | |
| rcarrillocruz | SpamapS: tox -e functional | 23:52 |
| rcarrillocruz | that on a plain VM with devstack | 23:52 |
| clarkb | jgriffith: the other alternative is to remove the fixture and have all that write to stdout but that might be the worst thing (bceause its all interleaved and not really useable) | 23:52 |
| *** bknudson has joined #openstack-infra | 23:52 | |
| *** funzo has quit IRC | 23:52 | |
| jgriffith | clarkb: yeah, I gathered that from your ML post I read ;) | 23:52 |
| SpamapS | rcarrillocruz: maybe devstack-gate is configuring things differently. | 23:52 |
| rcarrillocruz | but simulating a devstack gate test i get that same error from above ^ | 23:53 |
| clarkb | rcarrillocruz: SpamapS perhaps os-client-config is different for some reason and providing different inputs? | 23:53 |
| jgriffith | clarkb: hmm... so one of the tests I run it has OS_STDOUT_CAPTURE False | 23:53 |
| rcarrillocruz | i'm puttint print statemnts on shade code , something is getting passed to cacert, but it is weird to me since cacert defaults to None... | 23:53 |
| SpamapS | clarkb: yeah thats another possibility. | 23:53 |
| SpamapS | rcarrillocruz: print statements might be problematic as they'll interrupt subunit | 23:54 |
| SpamapS | rcarrillocruz: unless you intercept stdout. | 23:54 |
| clarkb | SpamapS: they should not if you have the correct base class | 23:54 |
| clarkb | SpamapS: see discussion with jgriffith :) | 23:54 |
| jgriffith | so the offenders all seem to be libs | 23:54 |
| jgriffith | clarkb: SpamapS hehe | 23:54 |
| clarkb | jgriffith: https://git.openstack.org/cgit/openstack/cinder/tree/.testr.conf#n2 that config should pass your Falsethrough | 23:55 |
| anteaya | clarkb fungi whichever of you has a moment, any reason to hold off on merging: https://review.openstack.org/#/c/163188/5 ? | 23:55 |
| SpamapS | ah set OS_STDOUT_CAPTURE=true | 23:55 |
| anteaya | clarkb: it just changes a jenkins script so I don't see the harm | 23:56 |
| clarkb | anteaya: I don't think so, we will just want to watch it once new images are built tomorrow | 23:56 |
| anteaya | but I don't want to miss something | 23:56 |
| clarkb | anteaya: someone might want to check my math on how many seconds == 6 months | 23:56 |
| anteaya | okay I'll merge now then | 23:56 |
| anteaya | I wondered and decided to trust you | 23:56 |
| anteaya | will check first | 23:56 |
| clarkb | 60 * 60 * 24 *30 * 6 = 15552000 and thats seconds minutes hours days months | 23:56 |
| clarkb | so I think its correct | 23:57 |
| anteaya | we could also do 365/2 which is 182 rather than 180 | 23:58 |
| anteaya | if we care | 23:58 |
| clarkb | nah its mostly fuzzy anyways | 23:58 |
| anteaya | k | 23:58 |
| *** patrickeast has quit IRC | 23:58 | |
| clarkb | aiui swift runs a service on its nodes that will delete at some point after that time period | 23:58 |
| clarkb | so they may live longer but not shorter | 23:58 |
| notmyname | clarkb: oh! I saw is some buffer playback this week you were asking about swift's expiring objects | 23:59 |
| anteaya | I confirm the accuracy of your calculation | 23:59 |
| clarkb | notmyname: yes, want to review https://review.openstack.org/#/c/163188/5 ? | 23:59 |
| anteaya | notmyname: context: https://review.openstack.org/#/c/163188/5 | 23:59 |
| clarkb | notmyname: basically we are moving full steam ahead to using swift logs and one thing we realized we could do is have swift delete old ones for us | 23:59 |
| notmyname | yay | 23:59 |
| clarkb | notmyname: we were told that we cannot update this attribute after we upload the object | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!