fungi | er, actually exactly what you said | 00:00 |
---|---|---|
fungi | now that i reread you | 00:00 |
fungi | if we modify the copied tree, that would actually be more work on the launcher than merely indexing it, i think? | 00:01 |
jeblair | fungi: that's a good point, a bit more io | 00:02 |
*** sdake_ has joined #openstack-infra | 00:02 | |
*** sdake has quit IRC | 00:02 | |
fungi | just modifications to the filesystem index and not actually moving blocks, but still it's more writes | 00:02 |
*** thorst has joined #openstack-infra | 00:03 | |
*** Sukhdev has joined #openstack-infra | 00:03 | |
*** Sukhdev has quit IRC | 00:03 | |
jeblair | so maybe my ordered favorites are: (a) rsync down with embedded find, rsync up; (b) remote find, synchronize down, rsync up; (c) synchronize down, local mutation, rsync up | 00:04 |
openstackgerrit | Merged openstack-infra/project-config: Remove FIPs graphing from OSIC https://review.openstack.org/324947 | 00:05 |
patrickeast | hi, maybe folks here have some ideas, i'm trying to change my ssh key for gerrit through https://review.openstack.org/#/settings/ssh-keys and its getting stuck on 'Working ..." and eventually giving a 500 | 00:05 |
patrickeast | any suggestions? | 00:05 |
patrickeast | derp nvm | 00:06 |
jeblair | patrickeast: wait a few minutes until the database backups have completed :( | 00:06 |
patrickeast | signing out and back in fixed it | 00:06 |
jeblair | patrickeast: (everything breaks for a few minutes at 00:00 utc) | 00:07 |
patrickeast | jeblair: ohh, that would do it | 00:07 |
pabelanger | fungi: have a minute to +A https://review.openstack.org/#/c/323865/2. Removes our skip test logic based on the conversation just now with clarkb | 00:07 |
patrickeast | jeblair: thanks! | 00:07 |
jeblair | np | 00:07 |
clarkb | pabelanger: its possible I am the only one that feels the hand curating of these rules over time isn't worth it. Not sure how muh feedback we want to get. I just know that neutron and nova and other projects that have used them regularly run into similar problems | 00:08 |
clarkb | pabelanger: in fact, I bet that those projects will be similarly broken if they switch to using other requirements | 00:08 |
*** thorst has quit IRC | 00:09 | |
*** annegentle has quit IRC | 00:10 | |
*** thorst has joined #openstack-infra | 00:10 | |
fungi | jeblair: i was actually pondering (d) synchronize down, rsync up with embedded find. the volume of data copied will still be basically the same (we're just not creating subdirectories below the target in the second phase) and it's less change to the existing code | 00:11 |
fungi | clarkb: pabelanger: i've long argued that the job filters based on changed file patterns is a misfeature which creates confusion through added complexity and increases the risk of not thoroughly testing a change | 00:12 |
*** sflanigan has joined #openstack-infra | 00:15 | |
*** thorst has quit IRC | 00:15 | |
pabelanger | clarkb: fungi: I do like the functionality, for the simple fact we can limit our resources depending on the patch. However, I also agree it does open us to the exposure of failures. I'm happy to switch it based on your comments. | 00:16 |
pabelanger | now that osic is back online, we have more resources too | 00:16 |
*** rlandy has quit IRC | 00:16 | |
*** masayukig has quit IRC | 00:16 | |
*** Sukhdev has joined #openstack-infra | 00:17 | |
*** xarses has quit IRC | 00:17 | |
clarkb | pabelanger: ya the issue is that computers are cheap and humans aren't. What that feature really does is externalize the cost of testing to infra when things don't work as expected | 00:17 |
clarkb | pabelanger: which is great when you are working on neutron I guess but not so great for us | 00:17 |
*** masayukig has joined #openstack-infra | 00:18 | |
pabelanger | clarkb: I can agree with that logic | 00:18 |
*** rlandy has joined #openstack-infra | 00:19 | |
*** jerryz has quit IRC | 00:19 | |
openstackgerrit | Goutham Pacha Ravi proposed openstack-infra/project-config: Add manila-specs to specs.yaml https://review.openstack.org/324941 | 00:19 |
*** ayoung has joined #openstack-infra | 00:20 | |
*** sarob has quit IRC | 00:20 | |
*** Sukhdev has quit IRC | 00:21 | |
*** piet_ has quit IRC | 00:21 | |
openstackgerrit | Merged openstack-infra/puppet-openstack_health: Use the distributed memcached locked dbm cache backend https://review.openstack.org/324103 | 00:22 |
jeblair | fungi: ok that works | 00:23 |
*** Swami has quit IRC | 00:23 | |
*** yamahata has joined #openstack-infra | 00:24 | |
jeblair | fungi: i mostly agree, though i think "files" has a place, and requirements is a pretty good one for it. how we define requirements changes once every 3 years on average. | 00:25 |
*** david-lyle has quit IRC | 00:25 | |
jeblair | i will sign up for reviewing changes to that once every 3 years | 00:25 |
jeblair | monthly is probably too much | 00:25 |
*** rhallisey has joined #openstack-infra | 00:26 | |
*** david-lyle has joined #openstack-infra | 00:26 | |
jeblair | (skip-if, on the other hand, i generally find far too complex to use and maintain and will not sign up for reviewing those patches) | 00:27 |
*** banix has quit IRC | 00:29 | |
lifeless | clarkb: fungi: re the pylint discussion earlier; pylint is one of the blacklisted things we don't constrain because linters | 00:30 |
*** david-lyle has quit IRC | 00:30 | |
*** xarses has joined #openstack-infra | 00:30 | |
*** xarses has quit IRC | 00:33 | |
*** xarses_ has joined #openstack-infra | 00:33 | |
*** mriedem has joined #openstack-infra | 00:34 | |
*** baoli has joined #openstack-infra | 00:36 | |
*** r-mibu has quit IRC | 00:36 | |
fungi | jeblair: yeah, i shouldn't have said "misfeature" but it does serve as an attractive nuisance for people with a compulsion to optimize away every last corner case where some job might not be entirely necessary | 00:36 |
*** Sukhdev has joined #openstack-infra | 00:37 | |
*** kushal has quit IRC | 00:39 | |
*** amitgandhinz has joined #openstack-infra | 00:39 | |
*** markvoelker has joined #openstack-infra | 00:40 | |
*** amotoki has joined #openstack-infra | 00:40 | |
*** banix has joined #openstack-infra | 00:41 | |
*** r-mibu has joined #openstack-infra | 00:42 | |
*** amitgandhinz has quit IRC | 00:44 | |
*** andreww has joined #openstack-infra | 00:45 | |
*** amotoki has quit IRC | 00:45 | |
*** tqtran has quit IRC | 00:46 | |
*** asselin_ has quit IRC | 00:46 | |
*** ffrank has quit IRC | 00:47 | |
*** pvaneck has quit IRC | 00:47 | |
*** xarses_ has quit IRC | 00:48 | |
cloudnull | clarkb fungi -- Will work for beer :P | 00:49 |
*** akshai_ has quit IRC | 00:50 | |
*** Julien-zte has joined #openstack-infra | 00:51 | |
openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add dib-utils func test https://review.openstack.org/324213 | 00:56 |
*** rhallisey has quit IRC | 00:56 | |
cloudnull | let me know how things go with the OSIC and the provider net setup. If anything needs to be adjusted I should be available for the next few days before I go back on holiday . | 00:56 |
*** fedexo has joined #openstack-infra | 00:57 | |
*** annegentle has joined #openstack-infra | 00:58 | |
clarkb | cloudnull: will do but initial results look great | 00:59 |
clarkb | I have some extra deschutes pine drop in my refrigerator if you want some | 00:59 |
clarkb | it may not last very long | 00:59 |
bkero | mmmm deschutes | 01:00 |
*** mtanino has quit IRC | 01:01 | |
clarkb | bkero: I am trying to drink something other than wanderlust | 01:01 |
bkero | clarkb: Get some DeGarde | 01:01 |
clarkb | I am actually planning to try having a keg of wanderlust available at all times at new house | 01:01 |
bkero | haha | 01:01 |
bkero | kegerator investment | 01:01 |
*** Qiming has joined #openstack-infra | 01:02 | |
*** Goneri has joined #openstack-infra | 01:05 | |
*** zhurong has joined #openstack-infra | 01:07 | |
*** sputnik13 has joined #openstack-infra | 01:08 | |
*** sputnik13 has quit IRC | 01:08 | |
*** mixos has joined #openstack-infra | 01:09 | |
*** Sukhdev has quit IRC | 01:09 | |
*** mixos_ has joined #openstack-infra | 01:10 | |
*** mixos has quit IRC | 01:13 | |
*** Sukhdev has joined #openstack-infra | 01:13 | |
*** Sukhdev has quit IRC | 01:15 | |
cloudnull | clarkb: I love pine drop | 01:18 |
* cloudnull just discovered it | 01:19 | |
cloudnull | HEB had a family pack on sale the other day and it was a tasty investment :) | 01:19 |
*** cody-somerville has quit IRC | 01:21 | |
* bkero is busy burning through his stash of Sticky Hands. | 01:21 | |
bkero | The consistently best IPA I've ever tasted. | 01:21 |
clarkb | do they distribute up here? | 01:22 |
*** baoli has quit IRC | 01:23 | |
bkero | they do, they just started canning pints | 01:24 |
bkero | They don't produce in volume enough to be in grocery stores yet sadly | 01:24 |
clarkb | darn | 01:24 |
jhesketh | jeblair: couple of comments on https://review.openstack.org/#/c/324889/2 if you're still around | 01:27 |
*** baoli has joined #openstack-infra | 01:27 | |
clarkb | jhesketh: for your first comment execution would break the while, hit the end of with execute the exit and return from the function | 01:30 |
clarkb | not sure I grok the concern there | 01:30 |
*** baoli has quit IRC | 01:30 | |
*** baoli has joined #openstack-infra | 01:31 | |
*** tphummel has quit IRC | 01:32 | |
jhesketh | clarkb: err yes, I've failed there... and that may make the rest of my comments wrong... gimme a sec | 01:32 |
*** Daisy has joined #openstack-infra | 01:32 | |
*** Qiming__ has joined #openstack-infra | 01:33 | |
*** Qiming__ has quit IRC | 01:33 | |
jhesketh | clarkb: actually I think we may still want to rejoin the thread | 01:33 |
openstackgerrit | Jeff Grafton proposed openstack-infra/jenkins-job-builder: Update Git SCM so that extensions are configured correctly. https://review.openstack.org/324975 | 01:34 |
clarkb | jhesketh: ya especially since both threads write to the console | 01:34 |
*** jerryz has joined #openstack-infra | 01:34 | |
*** tlian2 has joined #openstack-infra | 01:35 | |
*** akshai has joined #openstack-infra | 01:35 | |
*** baoli has quit IRC | 01:36 | |
openstackgerrit | Jamie Lennox proposed openstack-infra/puppet-jenkins: Use servername and apache_name in vhost https://review.openstack.org/323788 | 01:37 |
*** yanyanhu has joined #openstack-infra | 01:37 | |
*** zz_dimtruck is now known as dimtruck | 01:38 | |
*** tlian has quit IRC | 01:38 | |
*** amitgandhinz has joined #openstack-infra | 01:40 | |
*** akshai has quit IRC | 01:40 | |
*** amitgandhinz has quit IRC | 01:44 | |
*** Sukhdev has joined #openstack-infra | 01:46 | |
openstackgerrit | Merged openstack-infra/zuul: When a playbook fails, don't succeed in the error_block https://review.openstack.org/324726 | 01:46 |
*** woodster_ has quit IRC | 01:48 | |
*** Qiming_ has joined #openstack-infra | 01:49 | |
*** Qiming has quit IRC | 01:49 | |
*** roxanaghe has joined #openstack-infra | 01:54 | |
*** mriedem has quit IRC | 01:56 | |
*** roxanaghe has quit IRC | 01:58 | |
*** PollyZ has joined #openstack-infra | 01:59 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: [WIP] Add mulitnode CI job support https://review.openstack.org/324777 | 02:00 |
*** mtanino has joined #openstack-infra | 02:01 | |
*** sarob has joined #openstack-infra | 02:01 | |
*** Apoorva has quit IRC | 02:03 | |
*** sarob has quit IRC | 02:06 | |
*** baoli has joined #openstack-infra | 02:06 | |
*** gouthamr has quit IRC | 02:09 | |
*** baoli has quit IRC | 02:09 | |
*** Qiming_ is now known as Qiming | 02:10 | |
*** shashank_hegde has quit IRC | 02:10 | |
cloudnull | clarkb: https://twitter.com/cloudnull/status/738553154619375616 -- great beer :) | 02:14 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul: Support keep-hierarchy in launcher rsync publisher https://review.openstack.org/324996 | 02:14 |
fungi | jhesketh: first stab ^ | 02:14 |
* jhesketh looks | 02:15 | |
*** baoli has joined #openstack-infra | 02:15 | |
fungi | jhesketh: not tested, but relatively trivial adjustment and should work based on my reading of the ansible docs | 02:16 |
jhesketh | fungi: why shell not command? | 02:16 |
fungi | jhesketh: because needing ` support | 02:16 |
jhesketh | ah | 02:17 |
fungi | jhesketh: command does not run under a shell | 02:17 |
jhesketh | fungi: so by adding that trailing slash, I don't think rsync will copy the folder name (just its contents) | 02:19 |
jhesketh | although maybe I'm remembering wrong | 02:19 |
jhesketh | that looks like what we want though (given scproot is a tmpdir), but it's different to what was happening | 02:19 |
jhesketh | were we getting tmpdir names copied across before? | 02:19 |
fungi | jhesketh: the trailing / was already there | 02:19 |
jhesketh | oh, so it was! | 02:20 |
jhesketh | just in the command | 02:20 |
jhesketh | neato | 02:20 |
jhesketh | fungi: thanks, lgtm | 02:20 |
fungi | now i have some release automation to hack on | 02:20 |
*** PollyZ has quit IRC | 02:21 | |
*** dimtruck is now known as zz_dimtruck | 02:28 | |
*** csomerville has joined #openstack-infra | 02:30 | |
*** gildub has joined #openstack-infra | 02:30 | |
*** gyee has quit IRC | 02:36 | |
*** shashank_hegde has joined #openstack-infra | 02:39 | |
*** amitgandhinz has joined #openstack-infra | 02:39 | |
*** amitgandhinz has quit IRC | 02:40 | |
*** mixos_ has quit IRC | 02:41 | |
*** sflanigan is now known as sflanigan_afk | 02:41 | |
*** amotoki has joined #openstack-infra | 02:41 | |
*** amitgandhinz has joined #openstack-infra | 02:42 | |
*** csomerville has quit IRC | 02:44 | |
*** mtanino has quit IRC | 02:46 | |
*** amotoki has quit IRC | 02:46 | |
*** amitgandhinz has quit IRC | 02:46 | |
*** amitgandhinz has joined #openstack-infra | 02:47 | |
*** yamamoto_ has joined #openstack-infra | 02:48 | |
*** yuanying has quit IRC | 02:50 | |
*** r-daneel has quit IRC | 02:53 | |
*** sflanigan_afk is now known as sflanigan | 02:55 | |
*** fedexo has quit IRC | 02:55 | |
*** piet has joined #openstack-infra | 02:57 | |
*** sputnik13 has joined #openstack-infra | 03:04 | |
*** anteaya has quit IRC | 03:05 | |
*** yamahata has quit IRC | 03:05 | |
*** liusheng has quit IRC | 03:07 | |
*** fedexo has joined #openstack-infra | 03:08 | |
*** Daisy has quit IRC | 03:09 | |
*** Daisy has joined #openstack-infra | 03:09 | |
*** piet has quit IRC | 03:11 | |
*** Daisy has quit IRC | 03:14 | |
*** banix has quit IRC | 03:21 | |
*** jerryz has quit IRC | 03:24 | |
*** Sukhdev has quit IRC | 03:28 | |
*** Sukhdev has joined #openstack-infra | 03:29 | |
*** amitgandhinz has quit IRC | 03:30 | |
*** shashank_hegde has quit IRC | 03:33 | |
*** Sukhdev has quit IRC | 03:33 | |
*** piet has joined #openstack-infra | 03:35 | |
*** jamielennox is now known as jamielennox|away | 03:39 | |
*** amotoki has joined #openstack-infra | 03:42 | |
*** markvoelker has quit IRC | 03:44 | |
*** yamamoto_ has quit IRC | 03:45 | |
*** tlian2 has quit IRC | 03:46 | |
*** amotoki has quit IRC | 03:47 | |
*** yuanying has joined #openstack-infra | 03:49 | |
*** roxanaghe has joined #openstack-infra | 03:55 | |
*** hparekh has quit IRC | 03:55 | |
*** baoli has quit IRC | 03:59 | |
*** roxanaghe has quit IRC | 04:00 | |
*** javeriak has joined #openstack-infra | 04:01 | |
*** javeriak_ has joined #openstack-infra | 04:04 | |
*** Sukhdev has joined #openstack-infra | 04:04 | |
*** javeriak has quit IRC | 04:05 | |
*** piet has quit IRC | 04:06 | |
*** hparekh has joined #openstack-infra | 04:07 | |
*** harlowja_at_home has joined #openstack-infra | 04:08 | |
openstackgerrit | Min Pae proposed openstack-infra/project-config: Add octavia periodic jobs with oslo master https://review.openstack.org/325032 | 04:13 |
*** sree has joined #openstack-infra | 04:15 | |
*** ayoung has quit IRC | 04:20 | |
*** shashank_hegde has joined #openstack-infra | 04:25 | |
*** Daisy has joined #openstack-infra | 04:29 | |
*** yamamoto has joined #openstack-infra | 04:30 | |
*** amitgandhinz has joined #openstack-infra | 04:30 | |
*** vaidy has quit IRC | 04:31 | |
*** Daisy has quit IRC | 04:34 | |
*** amitgandhinz has quit IRC | 04:35 | |
*** psachin has joined #openstack-infra | 04:35 | |
*** links has joined #openstack-infra | 04:38 | |
*** hdaniel has joined #openstack-infra | 04:39 | |
jeblair | jhesketh, clarkb: responded to comment on 324889 | 04:40 |
*** amotoki has joined #openstack-infra | 04:43 | |
*** markvoelker has joined #openstack-infra | 04:44 | |
*** hdaniel has quit IRC | 04:44 | |
*** nwkarsten has joined #openstack-infra | 04:45 | |
*** e0ne has quit IRC | 04:46 | |
*** e0ne has joined #openstack-infra | 04:46 | |
*** e0ne has quit IRC | 04:46 | |
*** Sukhdev has quit IRC | 04:47 | |
*** amotoki has quit IRC | 04:47 | |
jeblair | jhesketh, clarkb: and again | 04:49 |
*** markvoelker has quit IRC | 04:49 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: Write console in thread https://review.openstack.org/324889 | 04:54 |
jeblair | jhesketh, clarkb: ^ | 04:54 |
*** flwang has quit IRC | 04:56 | |
*** roxanaghe has joined #openstack-infra | 04:56 | |
*** harlowja_at_home has quit IRC | 04:56 | |
*** sputnik13 has quit IRC | 04:56 | |
jhesketh | jeblair: cool, responded | 04:57 |
*** Daisy has joined #openstack-infra | 04:58 | |
*** rcernin has joined #openstack-infra | 04:58 | |
*** nwkarsten has quit IRC | 05:00 | |
*** roxanaghe has quit IRC | 05:01 | |
*** nwkarsten has joined #openstack-infra | 05:01 | |
*** vaidy has joined #openstack-infra | 05:02 | |
openstackgerrit | Merged openstack-infra/project-config: [translations] Fix path for firstapp https://review.openstack.org/324259 | 05:02 |
jeblair | jhesketh: i would like that, but i know of no good way to break out of readline like that; the alternative would be a select loop in python where we read 1 character at a time. readline is, i believe, implemented in C outside of the GIL and so is much more efficient. i think it's worth sticking with readline -- there is ultimately no difference between the fd being closed by python before sys.exit or during. :) | 05:03 |
*** vaidy has quit IRC | 05:04 | |
*** rcernin has quit IRC | 05:04 | |
*** nadya has joined #openstack-infra | 05:05 | |
*** nwkarsten has quit IRC | 05:06 | |
openstackgerrit | Merged openstack-infra/project-config: Fix translation proposals https://review.openstack.org/324723 | 05:07 |
*** maishsk_ has joined #openstack-infra | 05:10 | |
jhesketh | jeblair: works for me, but won't we need to make the thread a daemon so that the program can exit? | 05:11 |
jeblair | jhesketh: it is | 05:11 |
jeblair | jhesketh: line 81 in patch | 05:11 |
jhesketh | heh, indeed it is... I'm very blind today sorry | 05:12 |
*** maishsk has quit IRC | 05:12 | |
*** maishsk_ is now known as maishsk | 05:12 | |
jeblair | np | 05:12 |
jhesketh | jeblair: I haven't heard from pabelanger about his progress on the timeout issue... do you know if he had started it | 05:13 |
* jhesketh doesn't want to duplicate effort | 05:13 | |
*** Julien-zte has quit IRC | 05:16 | |
*** yuanying has quit IRC | 05:17 | |
jeblair | jhesketh: my understanding is that he was focusing on trying to understand it more, particularly focusing on getting more real-time logs from ansible (rather than just logging at the end of the run) | 05:18 |
*** elynn__ has joined #openstack-infra | 05:18 | |
elynn__ | Hi | 05:19 |
jeblair | jhesketh: you might consider working on a watchdog for ansible, where if the ansible playbook hasn't finished within the timeout we gave it (plus a bit of slop), we forcibly terminate ansible (using the mechanism we use for aborting a job perhaps) | 05:19 |
jeblair | jhesketh: that might be a good complimentary thing to work on while pabelanger continues to try to uncover the underlying cause | 05:20 |
jhesketh | possibly a worthwhile addition to what pabelanger is doing | 05:20 |
jhesketh | snap | 05:20 |
jhesketh | okay, I'll take a look at that | 05:20 |
jeblair | ^5 | 05:20 |
jeblair | and i will go to bed :) | 05:20 |
jeblair | thx, night! | 05:20 |
jhesketh | heh, isn't it super late? | 05:20 |
jhesketh | no worries | 05:20 |
* jhesketh makes no promises though | 05:20 | |
jhesketh | seeya :-) | 05:20 |
elynn__ | If I want to skip a gate job in stable/mitaka release, how to do that in openstack-infra/openstack-config? Any references? | 05:21 |
*** nwkarsten has joined #openstack-infra | 05:22 | |
openstackgerrit | Steven Dake proposed openstack-infra/project-config: Add security-analysis docuemntation repository https://review.openstack.org/325049 | 05:25 |
openstackgerrit | Steven Dake proposed openstack-infra/project-config: Add security-analysis docuemntation repository https://review.openstack.org/325049 | 05:27 |
*** gongysh has joined #openstack-infra | 05:28 | |
*** psachin_ has joined #openstack-infra | 05:29 | |
*** psachin_ has quit IRC | 05:30 | |
*** amitgandhinz has joined #openstack-infra | 05:31 | |
*** pcrews has quit IRC | 05:33 | |
*** yamahata has joined #openstack-infra | 05:34 | |
*** pcrews has joined #openstack-infra | 05:36 | |
openstackgerrit | Steven Dake proposed openstack-infra/project-config: Add security-analysis documentation repository https://review.openstack.org/325049 | 05:36 |
openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Update documentation about infra cloud https://review.openstack.org/308277 | 05:37 |
*** amitgandhinz has quit IRC | 05:38 | |
*** nwkarsten has quit IRC | 05:40 | |
*** nwkarsten has joined #openstack-infra | 05:40 | |
*** nadya has quit IRC | 05:42 | |
*** amotoki has joined #openstack-infra | 05:44 | |
*** nwkarsten has quit IRC | 05:45 | |
*** rcernin has joined #openstack-infra | 05:46 | |
sdake_ | elynn__ you can make it nonvoting | 05:46 |
sdake_ | elynn__ grep the repo for nonvoting | 05:47 |
sdake_ | I need to hit the sack or I'd help more - night :) | 05:47 |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Refactor: rename temporary directories https://review.openstack.org/325053 | 05:47 |
elynn__ | sdake_, thanks, have a good night :) | 05:47 |
*** Daisy has quit IRC | 05:48 | |
*** amotoki has quit IRC | 05:49 | |
*** Daisy has joined #openstack-infra | 05:49 | |
openstackgerrit | Merged openstack-infra/zuul: Support keep-hierarchy in launcher rsync publisher https://review.openstack.org/324996 | 05:49 |
openstackgerrit | Merged openstack-infra/project-config: Part two of kolla-mesos retirement https://review.openstack.org/311574 | 05:51 |
*** slaweq_ has joined #openstack-infra | 05:51 | |
*** Daisy has quit IRC | 05:54 | |
*** zhurong has quit IRC | 05:56 | |
openstackgerrit | Merged openstack-infra/project-config: Remove skip test logic for project-config https://review.openstack.org/323865 | 05:57 |
*** zhurong has joined #openstack-infra | 05:57 | |
*** nadya has joined #openstack-infra | 05:58 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Cleanup source-repositories output https://review.openstack.org/321961 | 05:59 |
*** liusheng has joined #openstack-infra | 06:00 | |
*** amitgandhinz has joined #openstack-infra | 06:00 | |
*** fedexo has quit IRC | 06:02 | |
*** yuanying has joined #openstack-infra | 06:05 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/325059 | 06:05 |
*** amitgandhinz has quit IRC | 06:05 | |
*** aeng has quit IRC | 06:06 | |
*** vaidy has joined #openstack-infra | 06:08 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Ansible launcher: add watchdog for ansible https://review.openstack.org/325061 | 06:09 |
jhesketh | jeblair, pabelanger: ^ first pass at a watchdog | 06:09 |
openstackgerrit | Merged openstack-infra/project-config: Run Ironic Inspector jobs with TinyIPA https://review.openstack.org/323994 | 06:10 |
*** vaidy has quit IRC | 06:10 | |
*** slaweq_ has quit IRC | 06:15 | |
*** slaweq_ has joined #openstack-infra | 06:15 | |
*** Daisy has joined #openstack-infra | 06:15 | |
*** openstackgerrit has quit IRC | 06:17 | |
*** openstackgerrit has joined #openstack-infra | 06:18 | |
*** elynn has joined #openstack-infra | 06:18 | |
*** elynn__ has quit IRC | 06:19 | |
openstackgerrit | Masahito Muroi proposed openstack-infra/irc-meetings: Add meeting chair to Congress meetings https://review.openstack.org/325066 | 06:19 |
openstackgerrit | Merged openstack-infra/puppet-zuul: Remove launcher socket option https://review.openstack.org/324086 | 06:26 |
*** bhavik has joined #openstack-infra | 06:27 | |
*** yuanying has quit IRC | 06:28 | |
*** cgross has quit IRC | 06:28 | |
*** yuanying has joined #openstack-infra | 06:29 | |
*** lmiccini has quit IRC | 06:29 | |
*** mkoderer has quit IRC | 06:30 | |
*** yuanying has quit IRC | 06:31 | |
*** mkoderer has joined #openstack-infra | 06:31 | |
*** yuanying has joined #openstack-infra | 06:31 | |
*** cgross has joined #openstack-infra | 06:31 | |
*** slaweq_ has quit IRC | 06:32 | |
*** lmiccini has joined #openstack-infra | 06:32 | |
openstackgerrit | Merged openstack-infra/project-config: Create separate ACL groups for murano-apps project https://review.openstack.org/323340 | 06:32 |
*** nadya has quit IRC | 06:32 | |
*** yuanying has quit IRC | 06:33 | |
*** yuanying has joined #openstack-infra | 06:34 | |
*** andreas_s has joined #openstack-infra | 06:35 | |
openstackgerrit | Merged openstack-infra/project-config: Add mitaka to gerritbot for OpenStack-Chef https://review.openstack.org/324612 | 06:35 |
openstackgerrit | Merged openstack-infra/project-config: Enable lbaasv2 jobs into check and gate queues https://review.openstack.org/303017 | 06:35 |
*** harlowja has quit IRC | 06:35 | |
*** nadya has joined #openstack-infra | 06:36 | |
openstackgerrit | Merged openstack-infra/project-config: Enable the Ubuntu binary gate on liberty branch https://review.openstack.org/313561 | 06:38 |
*** dingyichen has quit IRC | 06:38 | |
openstackgerrit | Merged openstack-infra/project-config: Revert "Revert "Actually use the service domain in V3 jobs"" https://review.openstack.org/315969 | 06:39 |
openstackgerrit | Merged openstack-infra/project-config: Run {name}-announce-release for Puppet OpenStack modules https://review.openstack.org/323981 | 06:40 |
openstackgerrit | Merged openstack-infra/project-config: Add openstack-server-release-jobs to Mistral in zuul https://review.openstack.org/321271 | 06:40 |
openstackgerrit | Merged openstack-infra/project-config: Add dib-utils func test https://review.openstack.org/324213 | 06:40 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Cleanup source-repositories output https://review.openstack.org/321961 | 06:41 |
AJaeger | elynn: you can easily skip a job - just add a branch condition to it. | 06:41 |
AJaeger | elynn: do you need a pointer? | 06:41 |
*** nadya has quit IRC | 06:42 | |
*** asselin_ has joined #openstack-infra | 06:42 | |
openstackgerrit | Merged openstack-infra/project-config: Allow core reviewers to push merge commits to fuel-plugin-cinder-netapp https://review.openstack.org/318009 | 06:42 |
elynn | AJaeger, yes | 06:42 |
openstackgerrit | Merged openstack-infra/project-config: Update gate-ironic-staging-drivers-dsvm-nv job https://review.openstack.org/324340 | 06:43 |
elynn | AJaeger, for example, I just want to run tempest job on master branch and mitaka branch won't support tempest tests since it's newly added. | 06:43 |
*** vaidy has joined #openstack-infra | 06:43 | |
*** vaidy has quit IRC | 06:44 | |
AJaeger | elynn: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n1300 | 06:44 |
AJaeger | elynn: that one blacklists kilo - but the principal is the same | 06:45 |
*** amotoki has joined #openstack-infra | 06:45 | |
AJaeger | Just have a regex that skips mitaka, liberty and kilo | 06:45 |
elynn | AJaeger, Cool! thanks! | 06:45 |
AJaeger | elynn: and make a proper comment on your commit so when we review it we check that it does the right thing ;) | 06:45 |
*** markvoelker has joined #openstack-infra | 06:45 | |
elynn | AJaeger, got it ;) | 06:46 |
bhavik | Hi, I need help to implement process with gerrit+zuul ... we have two git repos .. let's say upstream and internal, right now we sync branches from upstream and publish to internal, as it is .. now got a requirement that get branch commits from upstream and pass them to gerrit and on approval submit to internal repo. any suggestion pointers appreciated. | 06:46 |
*** shashank_hegde has quit IRC | 06:49 | |
*** amotoki has quit IRC | 06:49 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add support for bindep https://review.openstack.org/322456 | 06:52 |
*** rlandy has quit IRC | 06:53 | |
bhavik | I've wrote script to convert upstream commits to understand by gerrit at https://gist.github.com/anonymous/a9ea11803a1fa12cf06656e47d8b7a09 | 06:56 |
*** roxanaghe has joined #openstack-infra | 06:57 | |
*** gildub has quit IRC | 06:58 | |
*** markvoelker has quit IRC | 06:58 | |
*** yamada-h has joined #openstack-infra | 06:59 | |
AJaeger | sdake_: is security-analysis a document repository or do you have code and will release it? | 07:00 |
*** nadya has joined #openstack-infra | 07:00 | |
openstackgerrit | Merged openstack-infra/project-config: Make keystone functional tests job voting https://review.openstack.org/321890 | 07:00 |
sdake_ | AJaeger i just answered thatin the review | 07:00 |
sdake_ | with a "I am not certain" | 07:00 |
*** dizquierdo has joined #openstack-infra | 07:00 | |
AJaeger | bhavik: sorry, can't help with that. There's a 3rd party meeting, see https://wiki.openstack.org/wiki/Meetings/ThirdParty - best to ask there | 07:00 |
*** asselin_ has quit IRC | 07:01 | |
openstackgerrit | Merged openstack-infra/project-config: Add configure_mirror.sh back to tripleo-centos-7 https://review.openstack.org/324790 | 07:01 |
sdake_ | I think it will jut be RST files with SVG files | 07:01 |
openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/325059 | 07:01 |
sdake_ | but who knwos what will happen with this repository :) | 07:01 |
sdake_ | I'm not really on the security team so I don't have details | 07:01 |
bhavik | @AJaeger , thanks for pointer | 07:01 |
*** roxanaghe has quit IRC | 07:01 | |
*** harlowja_at_home has joined #openstack-infra | 07:02 | |
AJaeger | sdake_: if its a doc repo, you won't tag and upload to pypi. Right now it has no tag permissions, thus it will never upload to pypi. | 07:02 |
*** amitgandhinz has joined #openstack-infra | 07:02 | |
*** harlowja_at_home has quit IRC | 07:02 | |
AJaeger | sdake_: I suggest for now to remove the pypi jobs - and keep the pypi entry... | 07:02 |
*** ggnel_t has joined #openstack-infra | 07:02 | |
sdake_ | it is a doc repo | 07:02 |
*** openstackgerrit has quit IRC | 07:03 | |
sdake_ | AJaeger would you mind throwing me a bone and leaving exact instructions on wht ot remove, yo uwould think I'd know this stuff by now but i struggle with every new project add :) | 07:03 |
*** openstackgerrit has joined #openstack-infra | 07:03 | |
AJaeger | sdake_: Ok, let me give more details.. | 07:03 |
sdake_ | thanks | 07:03 |
sdake_ | I don't totaly understand how all the jobs work is most of the problem | 07:03 |
sdake_ | or part of it atleast | 07:04 |
sdake_ | AJaeger i've bee nrolling for 18 hours, need to hit the sack | 07:04 |
sdake_ | I'll submit a new version tomorrow morning | 07:04 |
sdake_ | thanks for taking a look :) | 07:04 |
*** flepied has quit IRC | 07:04 | |
*** vincentll has joined #openstack-infra | 07:06 | |
AJaeger | sdake_: have a good night! | 07:06 |
sdake_ | AJaeger one quick question, I have a upstream line in there in that review | 07:06 |
sdake_ | will that pull from my github repo that I have specified there? | 07:06 |
AJaeger | yes, it will import *once* from your github repo. | 07:06 |
sdake_ | I see all the upstream lines have been removed, so I was concerned maybe that function was removed | 07:06 |
sdake_ | ya I want just one import | 07:06 |
sdake_ | its a cookiecutter built repo anyway | 07:06 |
*** amitgandhinz has quit IRC | 07:07 | |
AJaeger | so, that's fine | 07:07 |
AJaeger | No, we remove them after the import - to reduce confusion. Some people thought it would sync somehow... | 07:07 |
sdake_ | git-upstream ftw ;) | 07:08 |
*** arxcruz has joined #openstack-infra | 07:09 | |
sdake_ | 113degrees F tomorrow | 07:10 |
* sdake_ GROANS | 07:10 | |
AJaeger | sdake_: sleep now, you can worry tomorrow ;) | 07:10 |
*** ociuhandu_ has quit IRC | 07:10 | |
*** nadya has quit IRC | 07:15 | |
*** sorantis has joined #openstack-infra | 07:15 | |
*** nadya_ has joined #openstack-infra | 07:15 | |
*** mikelk has joined #openstack-infra | 07:15 | |
*** vaidy has joined #openstack-infra | 07:16 | |
*** amoralej|off is now known as amoralej | 07:17 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix VENV temporary path https://review.openstack.org/325090 | 07:19 |
AJaeger | infra-root: I fear we have lots of unused tmp directories in /tmp on the proposal slave since the translation setup was broken, see above ^. An "rmdir /tmp/tmp.*" on the proposal slave might be a nice idea to get rid of those created but unused directories | 07:21 |
*** jistr is now known as jistr|mtg | 07:22 | |
openstackgerrit | Yanyan Hu proposed openstack-infra/project-config: Tune rally gate jobs for senlin https://review.openstack.org/325091 | 07:22 |
*** yamahata has quit IRC | 07:23 | |
*** watanabe_isao has joined #openstack-infra | 07:25 | |
*** nadya_ has quit IRC | 07:25 | |
*** watanabe_isao has quit IRC | 07:26 | |
*** watanabe_isao has joined #openstack-infra | 07:27 | |
*** elynn has quit IRC | 07:27 | |
AJaeger | ah, that was with my change that merged yesterday - so we won't have that many unused directories... | 07:28 |
*** shashank_hegde has joined #openstack-infra | 07:28 | |
*** yaume has joined #openstack-infra | 07:28 | |
*** watanabe_isao has quit IRC | 07:29 | |
*** watanabe_isao has joined #openstack-infra | 07:29 | |
pleia2 | AJaeger: yeah, just seeing a few from june 3 in tmp/tmp.Mt3pWOJVvb etc | 07:30 |
openstackgerrit | Martin Mágr proposed openstack-infra/tripleo-ci: Add opstools candidate repo https://review.openstack.org/325095 | 07:30 |
AJaeger | pleia2: yeah, just from today - not yesterday. | 07:30 |
AJaeger | pleia2: what time is it for you? | 07:30 |
*** matrohon has joined #openstack-infra | 07:30 | |
*** esikachev has joined #openstack-infra | 07:31 | |
AJaeger | let's first merge 325090 to not create more... | 07:31 |
*** javeriak_ has quit IRC | 07:31 | |
*** elynn has joined #openstack-infra | 07:31 | |
pleia2 | AJaeger: 3:30AM | 07:32 |
*** tmorin has joined #openstack-infra | 07:32 | |
*** dizquierdo has quit IRC | 07:32 | |
AJaeger | pleia2: that's a crazy time to be online ;( | 07:32 |
AJaeger | pleia2: nothing urgent here - just didn't want it forgotten... | 07:33 |
openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Increase tempest baremetal deploy/unprovision timeouts https://review.openstack.org/315545 | 07:34 |
*** armax has joined #openstack-infra | 07:34 | |
pleia2 | AJaeger: which change introduced this? | 07:35 |
*** yaume has quit IRC | 07:36 | |
*** elynn_ has joined #openstack-infra | 07:36 | |
AJaeger | pleia2: mine ;( https://review.openstack.org/324723 | 07:36 |
AJaeger | I should have removed the two extra lines when I changed the mktemp call ;( | 07:36 |
*** ramishra has quit IRC | 07:37 | |
*** elynn has quit IRC | 07:37 | |
pleia2 | aha, it happens :) | 07:38 |
*** jlanoux has joined #openstack-infra | 07:38 | |
*** Daisy has quit IRC | 07:38 | |
*** ramishra has joined #openstack-infra | 07:39 | |
*** Daisy has joined #openstack-infra | 07:39 | |
AJaeger | yeah :( | 07:39 |
AJaeger | thanks for review, pleia2 ! | 07:39 |
pleia2 | sure | 07:40 |
*** jlanoux has quit IRC | 07:42 | |
*** Daisy has quit IRC | 07:43 | |
*** jlanoux has joined #openstack-infra | 07:44 | |
*** flepied has joined #openstack-infra | 07:44 | |
*** jlanoux has quit IRC | 07:45 | |
*** amotoki has joined #openstack-infra | 07:45 | |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github https://review.openstack.org/247500 | 07:46 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter https://review.openstack.org/243250 | 07:46 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: GitHub file matching support https://review.openstack.org/292376 | 07:46 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs https://review.openstack.org/258448 | 07:46 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose https://review.openstack.org/247487 | 07:46 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Log GitHub API rate limit https://review.openstack.org/292377 | 07:46 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: support github pull reqeust labels https://review.openstack.org/247421 | 07:46 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts https://review.openstack.org/280667 | 07:46 |
*** watersoul has quit IRC | 07:47 | |
*** javeriak has joined #openstack-infra | 07:49 | |
*** amotoki has quit IRC | 07:50 | |
*** yuanying has quit IRC | 07:50 | |
*** roxanaghe has joined #openstack-infra | 07:50 | |
*** roxanaghe has quit IRC | 07:53 | |
*** watersoul has joined #openstack-infra | 07:53 | |
*** mhickey has joined #openstack-infra | 07:54 | |
*** timello has quit IRC | 07:55 | |
*** bhavik has quit IRC | 07:58 | |
*** bhavik has joined #openstack-infra | 07:58 | |
*** nikhil has quit IRC | 07:58 | |
*** monester has quit IRC | 07:58 | |
*** jed56 has quit IRC | 07:58 | |
*** kgalanov has quit IRC | 07:58 | |
*** teran has quit IRC | 07:58 | |
*** jaranovich has quit IRC | 07:58 | |
*** igorbelikov has quit IRC | 07:58 | |
*** madhuvishy has quit IRC | 07:58 | |
*** ogelbukh has quit IRC | 07:58 | |
*** fmccrthy has quit IRC | 07:58 | |
*** jpmaxman has quit IRC | 07:58 | |
*** yonglihe has quit IRC | 07:58 | |
*** dham1 has quit IRC | 07:58 | |
*** evgenyl has quit IRC | 07:58 | |
*** kozhukalov has quit IRC | 07:58 | |
*** rajinir has quit IRC | 07:58 | |
*** zxiiro has quit IRC | 07:58 | |
*** tpeoples has quit IRC | 07:58 | |
*** rguillebert has quit IRC | 07:58 | |
*** auggy has quit IRC | 07:58 | |
*** Daisy has joined #openstack-infra | 07:59 | |
*** bexelbie has quit IRC | 07:59 | |
*** bexelbie has joined #openstack-infra | 07:59 | |
*** zzzeek has quit IRC | 08:00 | |
*** yaume has joined #openstack-infra | 08:00 | |
*** kzaitsev_mb has joined #openstack-infra | 08:00 | |
*** zzzeek has joined #openstack-infra | 08:01 | |
*** zeih has joined #openstack-infra | 08:02 | |
*** amitgandhinz has joined #openstack-infra | 08:02 | |
*** sdake_ has quit IRC | 08:03 | |
openstackgerrit | Ethan Lynn proposed openstack-infra/project-config: Don't run gate-senlin-dsvm-tempest-api on mitaka branch https://review.openstack.org/325109 | 08:05 |
*** daemontool has joined #openstack-infra | 08:06 | |
*** ifarkas has joined #openstack-infra | 08:06 | |
*** amitgandhinz has quit IRC | 08:07 | |
*** flwang has joined #openstack-infra | 08:08 | |
*** permalac has joined #openstack-infra | 08:08 | |
*** fesp has joined #openstack-infra | 08:10 | |
*** lucas-afk is now known as lucasagomes | 08:11 | |
*** derekh has joined #openstack-infra | 08:13 | |
*** ihrachys has joined #openstack-infra | 08:15 | |
*** fesp has quit IRC | 08:16 | |
*** dizquierdo has joined #openstack-infra | 08:16 | |
*** yaume has quit IRC | 08:18 | |
openstackgerrit | Martin Mágr proposed openstack-infra/project-config: Retiring monitoring-for-openstack step 2 https://review.openstack.org/325122 | 08:24 |
*** e0ne has joined #openstack-infra | 08:24 | |
*** javeriak has quit IRC | 08:25 | |
openstackgerrit | Ethan Lynn proposed openstack-infra/project-config: Make gate-senlin-dsvm-tempest-api job voting https://review.openstack.org/325123 | 08:27 |
*** esikachev has quit IRC | 08:28 | |
*** dtantsur|afk is now known as dtantsur | 08:28 | |
penguinolog | Hello! Zuul feel bad? I see a lot of UNSTABLE statuses on checks | 08:29 |
penguinolog | Example: gate-fuel-web-docs: UNSTABLE (non-voting) -> no logs available | 08:31 |
*** sflanigan has quit IRC | 08:31 | |
AJaeger | Is any infra-root around to check our log servers? ^ | 08:31 |
AJaeger | thanks penguinolog for noticing us. | 08:32 |
*** esikachev has joined #openstack-infra | 08:32 | |
Adri2000 | hi, is there a reason for not having git.openstack.org https only? I'd "file a bug" for that but I'm not sure how to do it in storyboard :) (new story?) | 08:35 |
*** andreww has quit IRC | 08:35 | |
*** andreww has joined #openstack-infra | 08:35 | |
*** betherly_ has joined #openstack-infra | 08:36 | |
*** phschwartz_ has joined #openstack-infra | 08:36 | |
*** MarkAtwood_ has joined #openstack-infra | 08:36 | |
*** nemish has quit IRC | 08:36 | |
*** fkautz_ has joined #openstack-infra | 08:37 | |
vsaienko | please help to merge https://review.openstack.org/315496 https://review.openstack.org/315545 the patches are blockers for ironic grenade | 08:37 |
*** fkautz_ has quit IRC | 08:37 | |
*** ggillies_ has joined #openstack-infra | 08:37 | |
*** senk_ has joined #openstack-infra | 08:37 | |
*** ildikov_ has joined #openstack-infra | 08:38 | |
*** reed_ has joined #openstack-infra | 08:38 | |
*** fkautz_ has joined #openstack-infra | 08:38 | |
*** briancli1e has joined #openstack-infra | 08:38 | |
*** matbu_ has joined #openstack-infra | 08:38 | |
*** daemontool has quit IRC | 08:38 | |
*** nemish has joined #openstack-infra | 08:38 | |
*** e0ne has quit IRC | 08:38 | |
*** jzerebec1i has joined #openstack-infra | 08:38 | |
*** e0ne has joined #openstack-infra | 08:39 | |
*** terryw has quit IRC | 08:39 | |
*** fkautz has quit IRC | 08:39 | |
*** ildikov has quit IRC | 08:39 | |
*** sshnaidm|afk has quit IRC | 08:39 | |
*** reed has quit IRC | 08:39 | |
*** johnthetubaguy has quit IRC | 08:39 | |
*** MarkAtwood has quit IRC | 08:39 | |
*** senk has quit IRC | 08:39 | |
*** bradjones has quit IRC | 08:39 | |
*** AJaeger has quit IRC | 08:39 | |
*** rackertom has quit IRC | 08:39 | |
*** phschwartz has quit IRC | 08:39 | |
*** morgabra has quit IRC | 08:39 | |
*** briancline has quit IRC | 08:39 | |
*** jzerebecki has quit IRC | 08:39 | |
*** watanabe_isao has quit IRC | 08:39 | |
*** sulo has quit IRC | 08:39 | |
*** ggillies has quit IRC | 08:39 | |
*** pblaho has quit IRC | 08:39 | |
*** mescanef_ has quit IRC | 08:39 | |
*** jamespage has quit IRC | 08:39 | |
*** tonyb has quit IRC | 08:39 | |
*** betherly has quit IRC | 08:39 | |
*** matbu has quit IRC | 08:39 | |
*** dasm has quit IRC | 08:39 | |
*** verdurin has quit IRC | 08:39 | |
*** jamespage has joined #openstack-infra | 08:39 | |
*** sulo has joined #openstack-infra | 08:39 | |
*** tonyb has joined #openstack-infra | 08:39 | |
*** johnthetubaguy has joined #openstack-infra | 08:39 | |
*** jamespage has quit IRC | 08:39 | |
*** jamespage has joined #openstack-infra | 08:39 | |
openstackgerrit | Lucas Alvares Gomes proposed openstack-infra/project-config: Add virtualbmc from source non-voting test https://review.openstack.org/315646 | 08:39 |
*** ildikov_ is now known as ildikov | 08:39 | |
*** otherwiseguy has joined #openstack-infra | 08:39 | |
*** yuanying has joined #openstack-infra | 08:39 | |
*** reed_ is now known as reed | 08:39 | |
*** bradjones has joined #openstack-infra | 08:39 | |
*** bradjones has quit IRC | 08:39 | |
*** bradjones has joined #openstack-infra | 08:39 | |
*** morgabra_ has joined #openstack-infra | 08:40 | |
*** AJaeger has joined #openstack-infra | 08:40 | |
*** MarkAtwood_ is now known as MarkAtwood | 08:40 | |
*** pblaho has joined #openstack-infra | 08:40 | |
*** verdurin has joined #openstack-infra | 08:40 | |
*** dasm has joined #openstack-infra | 08:40 | |
*** rackertom has joined #openstack-infra | 08:41 | |
*** betherly_ is now known as betherly | 08:41 | |
*** mescanef has joined #openstack-infra | 08:41 | |
*** penguinolog has quit IRC | 08:42 | |
*** fkautz_ is now known as fkautz | 08:43 | |
*** fkautz is now known as Guest99301 | 08:43 | |
*** jistr|mtg is now known as jistr | 08:43 | |
*** _degorenko|afk is now known as degorenko | 08:45 | |
*** armax has quit IRC | 08:45 | |
*** chem has joined #openstack-infra | 08:45 | |
*** amotoki has joined #openstack-infra | 08:46 | |
*** kzaitsev_mb has quit IRC | 08:47 | |
*** markusry has joined #openstack-infra | 08:48 | |
*** esikachev has quit IRC | 08:49 | |
*** penguinolog has joined #openstack-infra | 08:49 | |
*** Daisy has quit IRC | 08:51 | |
*** amotoki has quit IRC | 08:51 | |
*** jaosorior has joined #openstack-infra | 08:51 | |
*** roxanaghe has joined #openstack-infra | 08:51 | |
*** sshnaidm|afk has joined #openstack-infra | 08:51 | |
*** Daisy has joined #openstack-infra | 08:51 | |
*** madhuvishy has joined #openstack-infra | 08:53 | |
*** esikachev has joined #openstack-infra | 08:54 | |
*** hdaniel has joined #openstack-infra | 08:54 | |
*** rajinir has joined #openstack-infra | 08:54 | |
*** roxanaghe has quit IRC | 08:56 | |
*** AJaeger has quit IRC | 08:57 | |
*** kozhukalov has joined #openstack-infra | 08:57 | |
*** evgenyl has joined #openstack-infra | 08:57 | |
*** AJaeger has joined #openstack-infra | 08:58 | |
*** dizquierdo has quit IRC | 08:58 | |
*** jaranovich has joined #openstack-infra | 08:58 | |
*** zxiiro has joined #openstack-infra | 09:00 | |
*** hdaniel has quit IRC | 09:01 | |
*** esikachev has quit IRC | 09:01 | |
*** armax has joined #openstack-infra | 09:01 | |
*** teran has joined #openstack-infra | 09:01 | |
*** rguillebert has joined #openstack-infra | 09:02 | |
*** liusheng has quit IRC | 09:03 | |
*** kgalanov has joined #openstack-infra | 09:03 | |
*** liusheng has joined #openstack-infra | 09:03 | |
*** amitgandhinz has joined #openstack-infra | 09:03 | |
*** flwang has quit IRC | 09:03 | |
*** Daisy_ has joined #openstack-infra | 09:04 | |
*** chem` has joined #openstack-infra | 09:05 | |
*** infra-red has joined #openstack-infra | 09:05 | |
*** monester has joined #openstack-infra | 09:06 | |
*** chem has quit IRC | 09:06 | |
*** tpeoples has joined #openstack-infra | 09:08 | |
*** amitgandhinz has quit IRC | 09:08 | |
*** Daisy has quit IRC | 09:08 | |
*** sambetts|afk is now known as sambetts | 09:08 | |
*** ogelbukh has joined #openstack-infra | 09:08 | |
*** esikachev has joined #openstack-infra | 09:09 | |
*** yonglihe has joined #openstack-infra | 09:11 | |
*** jed56 has joined #openstack-infra | 09:11 | |
*** jpmaxman has joined #openstack-infra | 09:12 | |
*** auggy has joined #openstack-infra | 09:12 | |
*** skolekonov has left #openstack-infra | 09:13 | |
robcresswell | Something up with the gate? Patches exploding with UNSTABLE. See https://review.openstack.org/#/c/172067/ :) | 09:13 |
*** dham1 has joined #openstack-infra | 09:14 | |
*** fmccrthy has joined #openstack-infra | 09:14 | |
*** igorbelikov has joined #openstack-infra | 09:14 | |
*** nikhil_ has joined #openstack-infra | 09:17 | |
*** nikhil_ is now known as Guest27231 | 09:17 | |
*** yaume has joined #openstack-infra | 09:18 | |
*** vdrok has joined #openstack-infra | 09:19 | |
AJaeger | robcresswell, yeah something looks broken - we ned an infra-root to check the log server | 09:20 |
jaosorior | yep, same is going on for TripleO jobs now | 09:21 |
*** yamada-h has quit IRC | 09:21 | |
*** jaosorior has quit IRC | 09:21 | |
*** rpodolyaka is now known as roman | 09:23 | |
*** shashank_hegde has quit IRC | 09:25 | |
*** jaosorior has joined #openstack-infra | 09:26 | |
*** Daisy_ has quit IRC | 09:27 | |
*** hashar has joined #openstack-infra | 09:28 | |
*** Daisy has joined #openstack-infra | 09:28 | |
ttx | AJaeger: maybe send alert ? | 09:30 |
ttx | no point in rechecking | 09:30 |
*** rcernin is now known as rcernin|lunch | 09:31 | |
AJaeger | ttx, go ahead - I don't have permissions and seems nobody else is around ;( | 09:32 |
AJaeger | ttx, indeed no point in rechecking | 09:32 |
robcresswell | AJaeger: Ah, understood. Thanks! | 09:35 |
ttx | #status notice CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 09:35 |
openstackstatus | ttx: sending notice | 09:35 |
* ttx looks up how to add AJaeger to the statusbot whitelist | 09:36 | |
-openstackstatus- NOTICE: CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 09:37 | |
openstackstatus | ttx: finished sending notice | 09:38 |
*** armax has quit IRC | 09:40 | |
*** sdague has joined #openstack-infra | 09:41 | |
*** maishsk has quit IRC | 09:41 | |
*** kzaitsev_mb has joined #openstack-infra | 09:41 | |
openstackgerrit | Thierry Carrez proposed openstack-infra/system-config: Add AJaeger to statusbot auth_nicks https://review.openstack.org/325171 | 09:42 |
*** elynn_ has quit IRC | 09:42 | |
ttx | AJaeger: that may do it ^ | 09:42 |
AJaeger | ah, ttx... | 09:42 |
*** sree has quit IRC | 09:42 | |
openstackgerrit | amrith proposed openstack-infra/project-config: Add channel notification for trove-image-builder https://review.openstack.org/325175 | 09:43 |
AJaeger | thanks, ttx | 09:43 |
*** pcaruana has joined #openstack-infra | 09:44 | |
amrith | AJaeger, my apologies re: https://review.openstack.org/325175. I should've re-read the instructions when you reviewed https://review.openstack.org/#/c/312805/ and asked about channel notifications. | 09:45 |
AJaeger | amrith: no worries, we can do this in two steps... - but see the notice that the bot just send and don't recheck when you get UNSTABLE jobs for now | 09:46 |
*** amotoki has joined #openstack-infra | 09:47 | |
amrith | yes, saw that | 09:48 |
amrith | in #openstack-trove | 09:48 |
sdague | AJaeger: I have a docs job question when you get a chance | 09:50 |
*** Na3iL has joined #openstack-infra | 09:51 | |
*** amotoki has quit IRC | 09:51 | |
*** bhavik has quit IRC | 09:51 | |
*** sorantis has quit IRC | 09:52 | |
*** roxanaghe has joined #openstack-infra | 09:52 | |
*** abregman|afk has quit IRC | 09:52 | |
*** penguinolog has quit IRC | 09:54 | |
*** penguinolog has joined #openstack-infra | 09:55 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Filter non-public fields when searching for users https://review.openstack.org/324725 | 09:56 |
*** roxanaghe has quit IRC | 09:56 | |
AJaeger | sdague: I'm here now... | 09:57 |
sdague | AJaeger: so... with the os-api-ref code what I'd *really* love to be able to do is have a non-voting job that renders the api-ref of another project with master of it | 09:57 |
*** logan_ has joined #openstack-infra | 09:57 | |
sdague | so when we propose a change, we can see how it looks with another project automatically | 09:58 |
sdague | I'm doing that entirely locally right now | 09:58 |
*** logan_ is now known as Guest62971 | 09:58 | |
AJaeger | sdague: yeah, some kind of integration testing. | 09:58 |
sdague | yeh, basically | 09:58 |
AJaeger | some options: | 09:58 |
*** charz_ has joined #openstack-infra | 09:59 | |
aspiers | am I misunderstanding something, or is Jenkins broken? it's giving a -1 for reasons I can't understand since there's no logs either: https://review.openstack.org/#/c/324129/ | 09:59 |
AJaeger | 1) Do it like bandit in gate-bandit-integration-{target-project} | 09:59 |
*** logan- has quit IRC | 09:59 | |
AJaeger | aspiers: see recent notice from the bots - please wait, our infrastructure is broken | 09:59 |
AJaeger | sdague: jenkins/jobs/bandit.yaml | 10:00 |
aspiers | AJaeger: ok thanks! | 10:00 |
*** javeriak has joined #openstack-infra | 10:00 | |
*** hferenc has quit IRC | 10:00 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Filter non-public fields in users when updating https://review.openstack.org/324717 | 10:00 |
aspiers | AJaeger: BTW your reply could have been 3usec quicker you know ;-) | 10:00 |
*** frickler has quit IRC | 10:01 | |
AJaeger | sdague: 2) do that with some scripts in your repository. You can easily checkout e.g. nova, cd in there and create the docs... | 10:01 |
*** hogepodge has quit IRC | 10:01 | |
*** charz has quit IRC | 10:01 | |
*** Guest62971 is now known as logan- | 10:01 | |
AJaeger | aspiers: you owe me some drinks next week now ;) | 10:02 |
*** jed56 has quit IRC | 10:02 | |
*** kgalanov has quit IRC | 10:02 | |
*** igorbelikov has quit IRC | 10:02 | |
*** ogelbukh has quit IRC | 10:02 | |
*** fmccrthy has quit IRC | 10:02 | |
*** kozhukalov has quit IRC | 10:02 | |
*** jpmaxman has quit IRC | 10:02 | |
*** rguillebert has quit IRC | 10:02 | |
*** evgenyl has quit IRC | 10:02 | |
*** yonglihe has quit IRC | 10:02 | |
*** jaranovich has quit IRC | 10:02 | |
*** auggy has quit IRC | 10:02 | |
*** rajinir has quit IRC | 10:02 | |
*** tpeoples has quit IRC | 10:02 | |
*** dham1 has quit IRC | 10:02 | |
*** Guest27231 has quit IRC | 10:02 | |
*** teran has quit IRC | 10:02 | |
*** monester has quit IRC | 10:02 | |
*** madhuvishy has quit IRC | 10:02 | |
*** zxiiro has quit IRC | 10:02 | |
aspiers | AJaeger: I think I already did ;-) | 10:02 |
*** Mmike has quit IRC | 10:02 | |
rakhmerov | hi, some gates are in UNSTABLE status, do you know the reason? | 10:02 |
aspiers | lol | 10:02 |
sdague | AJaeger: ok, I'll look. I was kind of wondering if there was a good example of checking out another repo in the system. I understand the full stack jobs a lot better than these :) | 10:02 |
AJaeger | sdague: periodic-python-jobs-with-oslo-master is another example | 10:02 |
*** Mmike has joined #openstack-infra | 10:03 | |
*** frickler has joined #openstack-infra | 10:03 | |
AJaeger | rakhmerov: known issue, see previous notice by the bots | 10:03 |
aspiers | AJaeger / ttx: maybe it's worth putting the Jenkins outage in $TOPIC? | 10:03 |
rakhmerov | AJaeger: ok | 10:03 |
aspiers | what does the openstackstatus bot do, exactly? | 10:03 |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Allow superusers to edit other users successfully https://review.openstack.org/325196 | 10:03 |
ttx | I just issues a notice rather than an later | 10:03 |
ttx | so it just spoke in channels | 10:03 |
ttx | rather than an alert, I mean | 10:04 |
AJaeger | aspiers: send notices to all subscribed channels, or update topic as well... | 10:04 |
aspiers | it did not alert #openstack-ha so I guess I did not configure that channel ccorrectly? | 10:04 |
ttx | AJaeger: should I reissue it as an alert ? | 10:04 |
*** amitgandhinz has joined #openstack-infra | 10:04 | |
ttx | aspiers: probably not :) | 10:04 |
AJaeger | aspiers: http://docs.openstack.org/infra/system-config/irc.html | 10:04 |
aspiers | thanks | 10:04 |
AJaeger | ttx, it's so broken right now that an alert seems a good idea... | 10:05 |
*** tdasilva has quit IRC | 10:05 | |
ttx | #alert notice CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 10:05 |
AJaeger | ttx, than we can just write a bot that welcomes each newcomer with: Please read topic first ;) | 10:05 |
*** zeih_ has joined #openstack-infra | 10:05 | |
*** zeih has quit IRC | 10:05 | |
ttx | #status alert CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 10:05 |
openstackstatus | ttx: sending alert | 10:05 |
*** bastelfreak has quit IRC | 10:06 | |
*** tdasilva has joined #openstack-infra | 10:07 | |
*** bhavik has joined #openstack-infra | 10:08 | |
-openstackstatus- NOTICE: CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 10:08 | |
*** ChanServ changes topic to "CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience." | 10:08 | |
*** bastelfreak has joined #openstack-infra | 10:08 | |
AJaeger | aspiers: updated system-config/hiera/common.yaml and add openstack-ha there | 10:08 |
aspiers | AJaeger: already done it | 10:08 |
AJaeger | great, aspiers | 10:08 |
*** ihrachys has quit IRC | 10:09 | |
*** amitgandhinz has quit IRC | 10:09 | |
*** zhurong has quit IRC | 10:10 | |
openstackgerrit | Adam Spiers proposed openstack-infra/system-config: Add #openstack-ha to statusbot https://review.openstack.org/325200 | 10:10 |
openstackstatus | ttx: finished sending alert | 10:11 |
*** pkoniszewski has quit IRC | 10:12 | |
*** isq has quit IRC | 10:12 | |
*** spiffxp has quit IRC | 10:12 | |
*** pkoniszewski has joined #openstack-infra | 10:12 | |
*** isq has joined #openstack-infra | 10:12 | |
*** anthonyper_ has joined #openstack-infra | 10:12 | |
*** andymccr_ has joined #openstack-infra | 10:13 | |
*** SlickN1k has joined #openstack-infra | 10:13 | |
*** spiffxp has joined #openstack-infra | 10:14 | |
aspiers | AJaeger: should I add a link from http://docs.openstack.org/project-team-guide/open-community.html#project-irc-channels to https://wiki.openstack.org/wiki/IRC#OpenStack_IRC_channels_.28chat.freenode.net.29 ? currently channel creation is undocumented? if so it's easy to forget things like setting up statusbot/meetbot | 10:14 |
*** madhuvishy has joined #openstack-infra | 10:14 | |
*** rhallisey has joined #openstack-infra | 10:14 | |
aspiers | IMHO it would be better to include the setup process in the docs, rather than having it on the wiki | 10:14 |
AJaeger | aspiers: better ask ttx for project-team-guide ^ | 10:14 |
*** ihrachys has joined #openstack-infra | 10:14 | |
*** rajinir has joined #openstack-infra | 10:15 | |
AJaeger | aspiers: see also http://docs.openstack.org/infra/manual/creators.html#configure-gerritbot-to-announce-changes which links to the system-config | 10:15 |
AJaeger | aspiers: do you want your channel to be logged as well? Or only status messages? | 10:15 |
aspiers | AJaeger: it's already logged | 10:15 |
*** javeriak has quit IRC | 10:16 | |
*** Daisy has quit IRC | 10:16 | |
*** jaosorior has quit IRC | 10:16 | |
*** permalac has quit IRC | 10:16 | |
*** mkoderer has quit IRC | 10:16 | |
*** gothicmindfood has quit IRC | 10:16 | |
*** slagle has quit IRC | 10:16 | |
*** anthonyper has quit IRC | 10:16 | |
*** SlickNik has quit IRC | 10:16 | |
*** andymccr has quit IRC | 10:16 | |
*** anthonyper_ is now known as anthonyper | 10:16 | |
*** SlickN1k is now known as SlickNik | 10:16 | |
AJaeger | aspiers: indeed, found it now... | 10:16 |
aspiers | but I never knew about statusbot until now, hence the question | 10:16 |
*** andymccr_ is now known as andymccr | 10:16 | |
*** zeih_ has quit IRC | 10:17 | |
*** zeih has joined #openstack-infra | 10:18 | |
*** kozhukalov has joined #openstack-infra | 10:19 | |
*** evgenyl has joined #openstack-infra | 10:19 | |
*** rcernin|lunch is now known as rcernin | 10:20 | |
*** jaranovich has joined #openstack-infra | 10:21 | |
aspiers | AJaeger: ah, I was getting confused between the Project Team guide and the Project Creator's Guide | 10:22 |
aspiers | AJaeger: perhaps partially because there no link from the former to the latter?! | 10:23 |
*** yujunz has joined #openstack-infra | 10:23 | |
*** sshnaidm|afk has quit IRC | 10:23 | |
*** tdasilva has quit IRC | 10:23 | |
ttx | aspiers: It's tricky because projects should be created on infra before they are openstack projects | 10:24 |
ttx | so the egg comes before the chicken | 10:24 |
*** nadya has joined #openstack-infra | 10:24 | |
aspiers | ttx: doesn't that mean people need the Creator's Guide first? | 10:24 |
*** zxiiro has joined #openstack-infra | 10:25 | |
ttx | yes, they do | 10:25 |
aspiers | in which case, if they mistakenly arrive at the Project Team guide first, they need a way to find it | 10:25 |
AJaeger | aspiers: http://docs.openstack.org/infra/manual/creators.html#decide-status-of-your-project has a link to Project Team Guide | 10:25 |
ttx | yeah, some warning in project team guide that you don't have to be official to get a repo would prevent things like https://review.openstack.org/#/c/324798/ | 10:25 |
aspiers | AJaeger: I'm talking about a link in the opposite direction | 10:26 |
*** teran has joined #openstack-infra | 10:26 | |
AJaeger | aspiers: ah ;) | 10:26 |
*** tdasilva has joined #openstack-infra | 10:26 | |
aspiers | ttx: right | 10:26 |
*** flepied has quit IRC | 10:26 | |
* ttx lunches | 10:26 | |
*** yujunz has quit IRC | 10:26 | |
*** rguillebert has joined #openstack-infra | 10:27 | |
*** kgalanov has joined #openstack-infra | 10:27 | |
*** nadya has quit IRC | 10:27 | |
*** gongysh has quit IRC | 10:28 | |
*** hdaniel has joined #openstack-infra | 10:29 | |
*** jlanoux has joined #openstack-infra | 10:29 | |
*** andreykurilin has joined #openstack-infra | 10:29 | |
aspiers | AJaeger: any suggestions in which section I should put such a link? | 10:29 |
AJaeger | aspiers: not really ;( | 10:30 |
aspiers | AJaeger: a new extremely short "Project creation" section before the Intro section? | 10:30 |
*** monester has joined #openstack-infra | 10:30 | |
*** dtantsur is now known as dtantsur|lunch | 10:30 | |
*** jzerebec1i is now known as jzerebecki | 10:32 | |
*** yanyanhu has quit IRC | 10:32 | |
*** tpeoples has joined #openstack-infra | 10:32 | |
*** ogelbukh has joined #openstack-infra | 10:33 | |
AJaeger | aspiers: I really don't know what's best, I don't have time to dig into that now. Propose something and see what others say ;) | 10:33 |
aspiers | AJaeger: or a single sentence at the very top of the intro section? | 10:33 |
aspiers | ok | 10:33 |
*** jaosorior has joined #openstack-infra | 10:34 | |
*** yonglihe has joined #openstack-infra | 10:35 | |
*** yamamoto has quit IRC | 10:35 | |
*** jed56 has joined #openstack-infra | 10:35 | |
*** jpmaxman has joined #openstack-infra | 10:36 | |
*** auggy has joined #openstack-infra | 10:36 | |
andreykurilin | AJaeger: hi! I found that novaclient's pypy job started failed while installing requirements. http://logs.openstack.org/59/324859/1/check/gate-python-novaclient-pypy/95954b3/console.html#_2016-06-02_22_05_08_666 Should pypy be updated on our gates? | 10:37 |
*** sshnaidm|afk has joined #openstack-infra | 10:38 | |
*** dham1 has joined #openstack-infra | 10:38 | |
*** fmccrthy has joined #openstack-infra | 10:38 | |
*** igorbelikov has joined #openstack-infra | 10:39 | |
*** banix has joined #openstack-infra | 10:41 | |
*** flepied has joined #openstack-infra | 10:41 | |
*** Guest27231 has joined #openstack-infra | 10:41 | |
* dims reads the topic first :) | 10:43 | |
*** permalac has joined #openstack-infra | 10:45 | |
*** schipiga has joined #openstack-infra | 10:45 | |
*** sorantis has joined #openstack-infra | 10:46 | |
schipiga | Hello, all! Some problems with CI ? Almost all builds have status "unstable" without any reports https://review.openstack.org/#/c/323956/ | 10:46 |
*** amotoki has joined #openstack-infra | 10:48 | |
BobBall | Any ideas why | 10:48 |
*** lucasagomes is now known as lucas-lunch | 10:49 | |
*** hogepodge has joined #openstack-infra | 10:49 | |
*** Daisy has joined #openstack-infra | 10:49 | |
*** mkoderer has joined #openstack-infra | 10:49 | |
*** gothicmindfood has joined #openstack-infra | 10:49 | |
*** slagle has joined #openstack-infra | 10:49 | |
*** orwell.freenode.net changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 10:49 | |
*** jamespage has quit IRC | 10:49 | |
sdague | hmmm... right the Unstable thing? | 10:50 |
*** gnuoy has quit IRC | 10:50 | |
*** gnuoy has joined #openstack-infra | 10:51 | |
robcresswell | schipiga: Its in all the room topics. | 10:51 |
*** jamespage has joined #openstack-infra | 10:51 | |
robcresswell | schipiga: Or was, until 30 secs ago. | 10:51 |
*** jamespage has quit IRC | 10:51 | |
*** jamespage has joined #openstack-infra | 10:51 | |
sdague | right, something set it back on a rejoin | 10:52 |
AJaeger | argh ;( | 10:52 |
*** amotoki has quit IRC | 10:52 | |
sdague | irc topic is not really persistent status :) | 10:52 |
*** hashar is now known as hasharAway | 10:52 | |
*** roxanaghe has joined #openstack-infra | 10:53 | |
AJaeger | schipiga: I can't help with pypy at all... | 10:53 |
robcresswell | No, but I can imagine its a little frustrating for infra to have to repeat it to everyone who joins the channel for 2 minns :) | 10:53 |
*** banix has quit IRC | 10:53 | |
aspiers | hrm, gerritbot broken too, or just slower than normal in here? | 10:54 |
aspiers | I just submitted two reviews to project-team-guide | 10:54 |
aspiers | maybe just need to be more patient | 10:54 |
AJaeger | aspiers: project-team-guide is not announced here. | 10:55 |
aspiers | ah ok | 10:55 |
AJaeger | robcresswell: I'll just say now: Read https://wiki.openstack.org/wiki/Infrastructure_Status ;) | 10:55 |
*** markvoelker has joined #openstack-infra | 10:55 | |
robcresswell | AJaeger: Oh I wasn't aware of this. Saves me bothering you every few days. Thanks! | 10:56 |
*** armax has joined #openstack-infra | 10:57 | |
*** roxanaghe has quit IRC | 10:57 | |
*** markvoelker has quit IRC | 11:00 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job https://review.openstack.org/229789 | 11:00 |
*** nadya has joined #openstack-infra | 11:01 | |
*** raildo-afk is now known as raildo | 11:02 | |
*** nadya has quit IRC | 11:02 | |
*** nadya_ has joined #openstack-infra | 11:02 | |
*** nadya_ has quit IRC | 11:03 | |
*** nadya has joined #openstack-infra | 11:04 | |
*** javeriak has joined #openstack-infra | 11:04 | |
*** amitgandhinz has joined #openstack-infra | 11:05 | |
sdague | AJaeger: are any infra-root looking into it, or do we need to wait for folks to wake up? | 11:07 |
AJaeger | sdague: we have to wait for one to wake up | 11:07 |
*** Daisy_ has joined #openstack-infra | 11:09 | |
*** sree has joined #openstack-infra | 11:09 | |
*** amitgandhinz has quit IRC | 11:09 | |
*** flepied has quit IRC | 11:10 | |
*** nadya has quit IRC | 11:10 | |
*** vdrok has quit IRC | 11:10 | |
*** Daisy has quit IRC | 11:12 | |
*** vdrok has joined #openstack-infra | 11:12 | |
*** sree has quit IRC | 11:13 | |
*** Daisy_ has quit IRC | 11:16 | |
*** sshnaidm|afk has quit IRC | 11:16 | |
*** Daisy has joined #openstack-infra | 11:16 | |
*** penguinolog has quit IRC | 11:17 | |
*** penguinolog has joined #openstack-infra | 11:18 | |
*** yamamoto has joined #openstack-infra | 11:18 | |
*** rhallisey has quit IRC | 11:19 | |
*** sshnaidm|afk has joined #openstack-infra | 11:20 | |
*** mrunge has quit IRC | 11:20 | |
*** Daisy has quit IRC | 11:21 | |
*** xarses_ has joined #openstack-infra | 11:23 | |
*** yamamoto has quit IRC | 11:24 | |
*** flepied has joined #openstack-infra | 11:25 | |
*** mrunge has joined #openstack-infra | 11:26 | |
*** sorantis has quit IRC | 11:26 | |
*** andreww has quit IRC | 11:26 | |
*** gordc has joined #openstack-infra | 11:29 | |
*** erlon has joined #openstack-infra | 11:32 | |
*** sorantis has joined #openstack-infra | 11:32 | |
*** ociuhandu has joined #openstack-infra | 11:33 | |
*** tesseract has joined #openstack-infra | 11:33 | |
*** d0ugal has quit IRC | 11:34 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: WIP: Add a OVB te-broker server https://review.openstack.org/295243 | 11:36 |
ttx | #status alert CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 11:39 |
openstackstatus | ttx: sending alert | 11:39 |
*** gordc has quit IRC | 11:39 | |
* ttx resends alert | 11:39 | |
*** hdaniel has quit IRC | 11:39 | |
AJaeger | thanks, ttx | 11:40 |
*** gordc has joined #openstack-infra | 11:40 | |
-openstackstatus- NOTICE: CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience. | 11:41 | |
*** ChanServ changes topic to "CI is experiencing issues with test logs, all jobs are currently UNSTABLE as a result. No need to recheck until this is fixed! Thanks for your patience." | 11:41 | |
*** bhavik has quit IRC | 11:41 | |
*** gordc has quit IRC | 11:43 | |
openstackstatus | ttx: finished sending alert | 11:44 |
*** pcaruana has quit IRC | 11:45 | |
*** amotoki has joined #openstack-infra | 11:48 | |
*** thorst has joined #openstack-infra | 11:50 | |
*** thorst has quit IRC | 11:50 | |
*** thorst has joined #openstack-infra | 11:50 | |
*** ldnunes has joined #openstack-infra | 11:50 | |
*** baoli has joined #openstack-infra | 11:51 | |
*** yamamoto has joined #openstack-infra | 11:52 | |
*** lucas-lunch is now known as lucasagomes | 11:52 | |
*** yamamoto_ has joined #openstack-infra | 11:52 | |
*** amotoki has quit IRC | 11:53 | |
*** baoli_ has joined #openstack-infra | 11:53 | |
*** roxanaghe has joined #openstack-infra | 11:54 | |
*** rhallisey has joined #openstack-infra | 11:54 | |
*** yamamoto_ has quit IRC | 11:55 | |
*** gordc has joined #openstack-infra | 11:55 | |
*** baoli has quit IRC | 11:56 | |
*** yamamoto has quit IRC | 11:56 | |
*** roxanaghe has quit IRC | 11:59 | |
*** andymaier has joined #openstack-infra | 12:01 | |
*** sorantis has quit IRC | 12:02 | |
*** vincentfrancoise has joined #openstack-infra | 12:02 | |
*** psilvad has joined #openstack-infra | 12:03 | |
*** aysyd has joined #openstack-infra | 12:05 | |
*** claudiub has joined #openstack-infra | 12:05 | |
*** amitgandhinz has joined #openstack-infra | 12:06 | |
*** banix has joined #openstack-infra | 12:09 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Only update changed fields when editing tasks https://review.openstack.org/325247 | 12:09 |
*** yaume_ has joined #openstack-infra | 12:09 | |
SotK | jeblair, fungi: that patch fixes the disappearing task notes bug you encountered yesterday | 12:10 |
krotscheck | timothyb89: Ohai, you ready for some subunit? | 12:11 |
*** amitgandhinz has quit IRC | 12:11 | |
*** markvoelker has joined #openstack-infra | 12:11 | |
*** dtantsur|lunch is now known as dtantsur | 12:11 | |
*** trown|outtypewww is now known as trown | 12:11 | |
*** aarefiev has quit IRC | 12:12 | |
*** yaume has quit IRC | 12:12 | |
*** aarefiev has joined #openstack-infra | 12:13 | |
*** dprince has joined #openstack-infra | 12:14 | |
*** markvoelker has quit IRC | 12:15 | |
*** markvoelker has joined #openstack-infra | 12:16 | |
*** daemontool has joined #openstack-infra | 12:16 | |
*** nadya has joined #openstack-infra | 12:16 | |
*** tmorin has quit IRC | 12:16 | |
*** zhurong has joined #openstack-infra | 12:17 | |
*** yaume_ has quit IRC | 12:20 | |
*** yaume has joined #openstack-infra | 12:21 | |
*** nadya has quit IRC | 12:21 | |
*** sree has joined #openstack-infra | 12:22 | |
*** tmorin has joined #openstack-infra | 12:22 | |
*** asselin_ has joined #openstack-infra | 12:23 | |
*** banix has quit IRC | 12:24 | |
BobBall | Any clues why https://review.openstack.org/#/c/321340/ might not be merging? It's got +2 and +A; and I've attempted to reapply +A and reverify (since it says "Needs Verified") but still no joy. | 12:24 |
*** amoralej is now known as amoralej|lunch | 12:25 | |
*** yamamoto has joined #openstack-infra | 12:25 | |
*** asselin_ has quit IRC | 12:28 | |
*** mdrabe has joined #openstack-infra | 12:29 | |
mugsie | BobBall: CI is having issues - that could be causing the merge to fail | 12:30 |
BobBall | I suppose it could. Will wait until they are fixed before asking again :P | 12:30 |
persia | BobBall: I think it may also need https://review.openstack.org/#/c/317869/3 to merge first, if I'm reading gerrit correctly | 12:32 |
persia | (or be rebased, etc.) | 12:33 |
AJaeger | BobBall: see Topic | 12:33 |
BobBall | Ok. Yes. It might. | 12:33 |
BobBall | AJaeger: I saw that; but my only jenkins job is a noop which is reporting Success | 12:33 |
BobBall | But I suspect persia may be right - I hadn't spotted that. | 12:33 |
AJaeger | BobBall: Ah;) Yes, persia's observation is on the spot | 12:34 |
*** deadnull_ has joined #openstack-infra | 12:34 | |
* BobBall hides his head in embarassment | 12:34 | |
persia | Note that /topic may mean fixing that doesn't let it merge, of course :) | 12:34 |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Implement propose_rdo_promote CI periodic job https://review.openstack.org/324557 | 12:34 |
*** yamamoto has quit IRC | 12:34 | |
jroll | is it known that https://www.openstack.org/marketplace/ is down? | 12:36 |
*** julim has joined #openstack-infra | 12:36 | |
*** rlandy has joined #openstack-infra | 12:37 | |
sdague | jroll: it's not down here, also that's not infra maintained | 12:39 |
jroll | sdague: oh, just came back up | 12:40 |
jroll | but, noted. thanks | 12:40 |
*** alaski is now known as lascii | 12:40 | |
*** iurygregory has quit IRC | 12:42 | |
*** markusry has quit IRC | 12:42 | |
*** nadya has joined #openstack-infra | 12:44 | |
*** piet has joined #openstack-infra | 12:48 | |
*** amotoki has joined #openstack-infra | 12:49 | |
*** sdake has joined #openstack-infra | 12:49 | |
*** daemontool has quit IRC | 12:50 | |
*** matt-borland has joined #openstack-infra | 12:51 | |
*** infra-red has quit IRC | 12:53 | |
*** amotoki has quit IRC | 12:54 | |
*** katomo has joined #openstack-infra | 12:54 | |
*** markusry has joined #openstack-infra | 12:54 | |
*** roxanaghe has joined #openstack-infra | 12:54 | |
*** andreas_s has quit IRC | 12:54 | |
*** d0ugal has joined #openstack-infra | 12:55 | |
*** infra-red has joined #openstack-infra | 12:55 | |
*** Julien-zte has joined #openstack-infra | 12:55 | |
*** jcoufal has joined #openstack-infra | 12:56 | |
*** tonytan4ever has quit IRC | 12:56 | |
Adri2000 | is there a reason for not having git.openstack.org https only? I'd "file a bug" for that but I'm not sure how to do it in storyboard :) (new story?) | 12:57 |
*** infra-red has quit IRC | 12:57 | |
*** psachin has quit IRC | 12:59 | |
*** roxanaghe has quit IRC | 12:59 | |
*** rodrigods has quit IRC | 12:59 | |
SotK | Adri2000: creating a new story is indeed the correct way to file a bug | 12:59 |
*** rodrigods has joined #openstack-infra | 12:59 | |
SotK | I'm not sure which project you should pick to file it against in this situation | 12:59 |
*** andymaier has quit IRC | 13:00 | |
Adri2000 | SotK: puppet-cgit ? | 13:00 |
SotK | that would be my best guess | 13:00 |
*** psilvad has quit IRC | 13:00 | |
*** infra-red has joined #openstack-infra | 13:01 | |
*** xyang1 has joined #openstack-infra | 13:03 | |
Adri2000 | done at https://storyboard.openstack.org/#!/story/2000624 | 13:04 |
*** amitgandhinz has joined #openstack-infra | 13:06 | |
fungi | infra-root: what's the situation with log uploads? do we have a problem with static.o.o? | 13:07 |
*** amitgandhinz has quit IRC | 13:07 | |
*** amitgandhinz has joined #openstack-infra | 13:07 | |
fungi | oh yeah, tons of i/o errors from at least one cinder volume | 13:07 |
*** binbincong has quit IRC | 13:08 | |
*** _ari_ has joined #openstack-infra | 13:08 | |
*** amitgandhinz has quit IRC | 13:08 | |
fungi | i'll see if i can get the filesystem brought back into service | 13:08 |
fungi | is anybody else working on it? | 13:08 |
fungi | i'm guessing not, as i'm the only user ssh'd into the server | 13:08 |
*** phschwartz_ is now known as pschwartz | 13:08 | |
AJaeger | fungi, you're the first infra-root to show up to action. | 13:08 |
*** amitgandhinz has joined #openstack-infra | 13:09 | |
AJaeger | fungi, thanks for looking into it! | 13:09 |
*** pschwartz is now known as phschwartz | 13:09 | |
*** amotoki has joined #openstack-infra | 13:09 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul: Fix turbohipster git repo https://review.openstack.org/325278 | 13:09 |
*** infra-red has quit IRC | 13:12 | |
*** zqfan has quit IRC | 13:13 | |
pleia2 | good morning | 13:15 |
AJaeger | morning, pleia2 ! | 13:15 |
*** nadya has quit IRC | 13:16 | |
*** anteaya has joined #openstack-infra | 13:16 | |
*** daemontool has joined #openstack-infra | 13:16 | |
*** yamamoto has joined #openstack-infra | 13:17 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Make task notes button clearer https://review.openstack.org/325292 | 13:18 |
fungi | docs-draft and tarballs need a quick fsck unfortunately | 13:19 |
pleia2 | fungi: need some help? | 13:19 |
*** amoralej|lunch is now known as amoralej | 13:20 | |
fungi | pleia2: nah, it's under control at this point. everything is almost back online again | 13:20 |
fungi | thanks though! | 13:20 |
pleia2 | ok | 13:20 |
fungi | tarballs is already cleaned up, docs-draft is taking a few minutes to fsck because it's larger | 13:20 |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Make vertical alignment of task table cells consistent https://review.openstack.org/325293 | 13:21 |
fungi | the other volumes are back in service again, jenkins ssh access reenabled, puppet reenabled and apache's started back up | 13:21 |
pleia2 | thanks fungi! | 13:21 |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Make task notes read-only by default https://review.openstack.org/325294 | 13:22 |
* pleia2 gets to translations checksite debugging | 13:22 | |
*** nadya has joined #openstack-infra | 13:24 | |
*** mriedem has joined #openstack-infra | 13:24 | |
*** akostrikov has joined #openstack-infra | 13:24 | |
*** annegentle has quit IRC | 13:24 | |
*** sorantis has joined #openstack-infra | 13:25 | |
*** tonytan4ever has joined #openstack-infra | 13:26 | |
*** rbrndt has joined #openstack-infra | 13:29 | |
fungi | ugh, docs-draft fsck is _still_ going | 13:30 |
AJaeger | sdague: could you review https://review.openstack.org/322427 , please? That was something you run into in the past AFAIR in openstackdocstheme | 13:30 |
*** tonytan4ever has quit IRC | 13:31 | |
mugsie | AJaeger: yeah, that was for the custom CSS files | 13:32 |
*** PollyZ has joined #openstack-infra | 13:32 | |
*** tlian has joined #openstack-infra | 13:33 | |
mugsie | AJaeger: https://review.openstack.org/#/c/295489/ was the patch that fixed that. | 13:33 |
*** zeih has quit IRC | 13:33 | |
*** nadya has quit IRC | 13:34 | |
*** Goneri has quit IRC | 13:34 | |
openstackgerrit | Yury Tsarev proposed openstack-infra/zuul: Set filter according to PR/Change in URL https://review.openstack.org/325300 | 13:35 |
AJaeger | mugsie: ah, thanks! | 13:35 |
*** zeih has joined #openstack-infra | 13:35 | |
*** katomo has quit IRC | 13:36 | |
*** PollyZ has left #openstack-infra | 13:36 | |
*** tlian has quit IRC | 13:38 | |
pabelanger | morning | 13:39 |
mnaser | fungi: if you're having issues with block storage, we can start providing a few nodes for static infra as we spoke a while ago ^ | 13:39 |
fungi | mnaser: well, statistically we're skirting danger by having a logical volume residing on 12 cinder volumes of 1tb each | 13:40 |
*** tempo has joined #openstack-infra | 13:40 | |
*** edmondsw has joined #openstack-infra | 13:41 | |
mnaser | fungi: forgive me if this is a silly question but .. why not a single 12tb volume..? | 13:41 |
fungi | so if a network blip interrupts connectivity between the hypervisor and any of the backends serving those, we end up with an outage | 13:41 |
fungi | mnaser: rackspace sets a 1tb maximum limit on cinder volumes | 13:41 |
mnaser | oh i see | 13:41 |
fungi | max 1tb size per cinder volume that is | 13:41 |
*** gouthamr has joined #openstack-infra | 13:41 | |
*** zeih has quit IRC | 13:42 | |
mnaser | yeah given we're using ceph we don't really have problems with however big volumes you want/need | 13:42 |
fungi | and actually it's 14 cinder volumes, i misremembered | 13:42 |
*** zeih has joined #openstack-infra | 13:42 | |
*** trown is now known as trown|brb | 13:42 | |
fungi | basically the maximum number of additional block devices their xen deployment will support attaching to a single domu guest | 13:42 |
anteaya | jroll: here is the place to file bugs with the openstack.org website: https://bugs.launchpad.net/openstack-org we don't maintain the servers or have any say on the content | 13:42 |
mnaser | heh | 13:43 |
sdague | AJaeger: yeh, I proposed that before for the same reasons that mugsie is | 13:43 |
fungi | mnaser: but yeah, that's tempting. we do end up with a lot of disruption from this particular configuration | 13:43 |
sdague | mugsie is working on trying to get os-api-ref working with docs theme | 13:43 |
fungi | oh finally docs-draft has gotten past fsck stage 2 and is repairing links | 13:43 |
sdague | mugsie: how did you deal with conflicting jquery? | 13:43 |
*** vincentfrancoise has left #openstack-infra | 13:44 | |
mnaser | fungi: let me know if -infra decides to move things over so i can make sure the appropriate resources are allocated | 13:44 |
fungi | mnaser: thanks, i'll bring it up and see if there's ideas around how we might sync that data over gracefully | 13:45 |
*** thiagop has joined #openstack-infra | 13:45 | |
*** Guest27231 has quit IRC | 13:45 | |
mugsie | sdague: eh, I am pretty sure I just dropped one of them | 13:45 |
mnaser | fungi: sounds good, if there's anything we can do to help out on a provider level id be more than happy to | 13:46 |
*** Guest27231 has joined #openstack-infra | 13:46 | |
*** vdrok has quit IRC | 13:46 | |
*** tlian has joined #openstack-infra | 13:47 | |
*** Guest27231 is now known as nikhil | 13:48 | |
*** nwkarsten has joined #openstack-infra | 13:48 | |
*** nwkarsten has quit IRC | 13:48 | |
*** nwkarsten has joined #openstack-infra | 13:49 | |
*** bauzas is now known as bauwser | 13:49 | |
*** piet has quit IRC | 13:50 | |
bswartz | Infra team: can we start to use xenial for our jenkins jobs yet, or are those images not yet ready for use? | 13:50 |
*** dansmith is now known as superdan | 13:51 | |
fungi | bswartz: they are ready for use as far as i know, though we haven't moved all jobs for master branches over to them yet (i think there may still be some devstack/tempest job issues getting worked out? i don't know the exact state there) | 13:52 |
pabelanger | agreed. Other projects are using them, we still need to schedule python-jobs update | 13:52 |
bswartz | fungi: we may test it out with one of our jobs -- thanks | 13:52 |
fungi | pabelanger: you did the eavesdrop server upgrade, right? i've got a snapshot generating for the old offline server and will delete the server once the image is complete | 13:53 |
*** mriedem is now known as mriedem_meetings | 13:53 | |
*** dprince has quit IRC | 13:53 | |
*** dprince has joined #openstack-infra | 13:54 | |
pabelanger | fungi: yes, I did the new server. Thanks, I didn't generate a snapshot | 13:54 |
*** piet has joined #openstack-infra | 13:54 | |
fungi | np, just happened to be in there looking for tickets about block storage disruption overnight and spotted that straggler | 13:55 |
*** tempo has quit IRC | 13:55 | |
fungi | okay, docs-draft is finally repaired | 13:55 |
*** roxanaghe has joined #openstack-infra | 13:55 | |
*** mriedem has joined #openstack-infra | 13:56 | |
*** trown|brb is now known as trown | 13:57 | |
fungi | #status ok Cleanup from earlier block storage disruption on static.openstack.org has been repaired, and any jobs which reported an "UNSTABLE" result or linked to missing logs between 08:00-14:00 UTC can be retriggered by leaving a "recheck" comment. | 13:57 |
openstackstatus | fungi: sending ok | 13:57 |
*** mriedem_meetings has quit IRC | 13:58 | |
anteaya | fungi: thank you | 13:58 |
*** amitgandhinz has quit IRC | 13:58 | |
*** amitgandhinz has joined #openstack-infra | 13:58 | |
fungi | you're welcome! | 13:59 |
anteaya | :) | 13:59 |
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 13:59 | |
-openstackstatus- NOTICE: Cleanup from earlier block storage disruption on static.openstack.org has been repaired, and any jobs which reported an "UNSTABLE" result or linked to missing logs between 08:00-14:00 UTC can be retriggered by leaving a "recheck" comment. | 13:59 | |
*** roxanaghe has quit IRC | 13:59 | |
*** e0ne has quit IRC | 13:59 | |
*** e0ne has joined #openstack-infra | 14:00 | |
*** eharney has joined #openstack-infra | 14:00 | |
*** ayoung has joined #openstack-infra | 14:00 | |
openstackstatus | fungi: finished sending ok | 14:02 |
pabelanger | fungi: was there a specific volume that had the problems? | 14:03 |
*** sree has quit IRC | 14:03 | |
tdasilva | good morning, has anybody run into this error with bindep? http://paste.fedoraproject.org/374081/14649624 | 14:03 |
*** salv-orlando has joined #openstack-infra | 14:05 | |
fungi | pabelanger: yes, according to dmesg, at least several of them | 14:05 |
pabelanger | tdasilva: does other-requirements.txt exist? | 14:06 |
tdasilva | pabelanger: yes | 14:06 |
pabelanger | looks like an issue with lsb_release if I am reading this right | 14:06 |
*** sorantis has quit IRC | 14:06 | |
pabelanger | fungi: thanks | 14:07 |
fungi | pabelanger: i count 7 of the 14 attached volumes reporting i/o errors at 08:34 utc today | 14:07 |
tdasilva | pabelanger: i'm trying to test this patch https://review.openstack.org/#/c/325029 | 14:07 |
*** sorantis has joined #openstack-infra | 14:08 | |
fungi | pabelanger: xvdd, xvdf, xvdg, xvdh, xvdi, xvdk, xvdl | 14:08 |
*** Na3iL has quit IRC | 14:08 | |
pabelanger | tdasilva: let me try the patch | 14:10 |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add support for bindep https://review.openstack.org/322456 | 14:10 |
tdasilva | pabelanger: this fixed it: http://www.unixmen.com/linux-troubleshooting-fix-lsb_release-command-found-centos/ | 14:11 |
tdasilva | pabelanger: thanks for the pointer :-) | 14:12 |
pabelanger | tdasilva: Great, tested it locally and it works too | 14:12 |
tdasilva | pabelanger: great! thanks | 14:13 |
*** abregman has joined #openstack-infra | 14:13 | |
*** xarses_ has quit IRC | 14:13 | |
*** hongbin has joined #openstack-infra | 14:14 | |
*** nadya has joined #openstack-infra | 14:14 | |
*** e0ne has quit IRC | 14:14 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Make task notes read-only by default https://review.openstack.org/325294 | 14:14 |
*** e0ne has joined #openstack-infra | 14:14 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Fix spelling mistake on profile page https://review.openstack.org/325321 | 14:15 |
*** nadya has quit IRC | 14:16 | |
*** weshay has joined #openstack-infra | 14:17 | |
fungi | SotK: here's an interesting one... i'm guessing it's a rendering issue, but the content in the comment i added a few minutes ago isn't displayed though you can see it quoted if you hit the reply button https://storyboard.openstack.org/#!/story/2000336 | 14:21 |
*** denisra has quit IRC | 14:21 | |
tdasilva | pabelanger: also, just a heads up, the launchpad link referenced here: http://docs.openstack.org/infra/bindep/contributing.html doesn't exist | 14:22 |
* SotK takes a look | 14:22 | |
SotK | very weird | 14:22 |
*** sigmavirus24_awa is now known as sigmavirus24 | 14:22 | |
* SotK investigates further | 14:22 | |
*** timello has joined #openstack-infra | 14:22 | |
openstackgerrit | Merged openstack-infra/project-config: Fix VENV temporary path https://review.openstack.org/325090 | 14:23 |
pabelanger | tdasilva: Yes, we should add something there too | 14:23 |
*** Goneri has joined #openstack-infra | 14:23 | |
SotK | fungi: argh, the html sanitiser is trying to parse the email addresses in the comment as html elements | 14:24 |
fungi | tdasilva: pabelanger: oops, that's supposed to be a link to https://storyboard.openstack.org/#!/project/811 | 14:24 |
tdasilva | pabelanger: just to clarify, when I add other-requirements.txt and define a jenkins job, will those dependencies be automatically installed before tests are run? | 14:25 |
*** r-daneel has joined #openstack-infra | 14:25 | |
fungi | SotK: i wondered if it might be something like that. the preview was displaying the comment but eating the < and > symbols (even if i replaced them with < and >) | 14:25 |
tdasilva | fungi: I can update that link, I was in the middle of fixing a little typo I found | 14:26 |
fungi | tdasilva: only if the job includes the install-distro-packages builder | 14:26 |
pabelanger | tdasilva: yes, you need to use the install-distro-packages macro to use other-requirements.txt | 14:26 |
anteaya | fungi: SotK I replied to the not visible comment to see what would happen, now I can see both fungi's comment and my own | 14:26 |
pabelanger | that fungi said | 14:26 |
pabelanger | what* | 14:26 |
tdasilva | fungi, pabelanger: awesome, thanks, will give it a try... | 14:26 |
jeblair | ugh not again | 14:26 |
jeblair | fungi: anything need doing? | 14:26 |
anteaya | fungi: SotK yes I had noticed that the comment parser consumes any angle brackets | 14:27 |
fungi | jeblair: i think we're all patched up now on the static.o.o front | 14:27 |
*** mdrabe has quit IRC | 14:27 | |
openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: A newer version of virtualenv is already installed https://review.openstack.org/325330 | 14:28 |
SotK | anteaya: yeah, it seems to have turned the email addresses into mailto: links in your comment | 14:28 |
fungi | jeblair: i pushed up a proposed launcher fix for keep-hierarchy feature parity last night 324996 (looks like yolanda approved it already?) | 14:28 |
openstackgerrit | Thiago da Silva proposed openstack-infra/bindep: fix small typo and link https://review.openstack.org/325331 | 14:29 |
anteaya | SotK: fungi interesting, do we want email addresses in comments turned into mailto: links? | 14:29 |
*** ri0 has joined #openstack-infra | 14:31 | |
*** Na3iL has joined #openstack-infra | 14:32 | |
*** e0ne has quit IRC | 14:33 | |
*** zz_dimtruck is now known as dimtruck | 14:33 | |
*** xarses_ has joined #openstack-infra | 14:34 | |
*** matrohon has quit IRC | 14:35 | |
anteaya | I think that comments shouldn't try to be too smart, they should just render the characters as they are input | 14:35 |
*** vdrok has joined #openstack-infra | 14:35 | |
*** links has quit IRC | 14:36 | |
anteaya | else we risk losing being able to accurately communicate what we are trying to say | 14:36 |
SotK | they currently render as markdown, I don't want to lose the rich-text functionality | 14:36 |
fungi | anteaya: well, it's tricky with web interfaces. you have to translate/sanitize certain things to keep browsers from reinterpreting things like <script> | 14:36 |
anteaya | fair enough | 14:36 |
anteaya | SotK: okay | 14:37 |
fungi | SotK: i likely just didn't realize that was trying to interpret markdown. i'll read up on the syntax for it (i'm only used to restructuredtext and raw html) | 14:37 |
*** e0ne has joined #openstack-infra | 14:37 | |
*** Daisy has joined #openstack-infra | 14:38 | |
*** kzaitsev_mb has quit IRC | 14:38 | |
*** tonytan4ever has joined #openstack-infra | 14:38 | |
*** PollyZ has joined #openstack-infra | 14:38 | |
jeblair | fungi: i will post-hoc review it, thanks :) | 14:38 |
fungi | jeblair: thanks, it seemed trivial, but i did not test it yet | 14:39 |
*** Mmike has quit IRC | 14:39 | |
*** Mmike has joined #openstack-infra | 14:39 | |
SotK | fungi: yeah, I keep meaning to add a note mentioning it and a link to some syntax guide but haven't got round to it | 14:40 |
*** bryan_att has joined #openstack-infra | 14:40 | |
*** mdrabe has joined #openstack-infra | 14:41 | |
*** jcoufal has quit IRC | 14:42 | |
jeblair | fungi: neat. it even works with more than one matching file | 14:42 |
*** deadnull_ has quit IRC | 14:42 | |
fungi | that was the goal | 14:42 |
fungi | because some of our jobs may depend on that, not sure | 14:43 |
jeblair | fungi: http://paste.openstack.org/show/507678/ | 14:43 |
*** Daisy has quit IRC | 14:43 | |
jeblair | fungi: that's my job definition, and then what showed up | 14:43 |
*** jcoufal has joined #openstack-infra | 14:43 | |
*** csomerville has joined #openstack-infra | 14:43 | |
jeblair | fungi: anything else you think i should test while i have this set up? | 14:44 |
fungi | my only concern is that _if_ you need the hierarchy flattened _and_ there are uploaded files with spaces in their names, it may (probably will) break. if we null-separate the find output and tell rsync the file list is null-separated that mighth be an improvement, but would need some further fiddling | 14:44 |
jroll | SotK: I like the way github does it, a little note under the comment box with a link to a guide | 14:45 |
jeblair | fungi: do you think that might provide a shell escape vulnerability? we are running this on the launcher... | 14:45 |
*** hasharAway is now known as hashar | 14:45 | |
clarkb | jeblair I would test **/whatever with multiple dir levels | 14:46 |
*** zeih has quit IRC | 14:46 | |
fungi | jeblair: oh, good point... i bet we could tease find -print into formatting the paths with " wrapping? | 14:46 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Deprecated snaphot image building https://review.openstack.org/325339 | 14:46 |
jeblair | clarkb: ya -- i think there's a tox macro that will do that -- i'll base a test on that. | 14:46 |
*** rcernin has quit IRC | 14:46 | |
jeblair | i'm trying the space thing now | 14:46 |
*** kzaitsev_mb has joined #openstack-infra | 14:47 | |
fungi | i expect it to assume the spaces are delimiting different paths | 14:47 |
fungi | and fail miserably | 14:47 |
*** EricGonczer_ has joined #openstack-infra | 14:47 | |
*** Guest86121 has quit IRC | 14:48 | |
timothyb89 | krotscheck: hi, sorry I'm a bit late, let me know if you still wanted to discuss subunit things | 14:48 |
krotscheck | timothyb89: No worries, gimme 30 minutes, the munchkin is up and needs to go to daycare. | 14:48 |
timothyb89 | krotscheck: sure, no problem | 14:49 |
anteaya | jroll: I'm going to start by creating a gui guide, currently there isn't one and they putting it in there: https://storyboard.openstack.org/#!/story/2000627 | 14:49 |
jroll | anteaya: ++ | 14:49 |
jroll | anteaya: I like the little link because I often don't realize I need the markdown guide until I'm writing something | 14:50 |
anteaya | jroll: then we can work on links in the gui, actually can you add your comment to my story? | 14:50 |
jroll | yes! | 14:50 |
*** Hal has joined #openstack-infra | 14:50 | |
anteaya | jroll: fair enough | 14:50 |
sdague | also, d-g core folks - https://review.openstack.org/#/c/320925/ - it's blocking things that would make liberty actually pass | 14:50 |
anteaya | jroll: thank you | 14:50 |
*** amitgandhinz has quit IRC | 14:50 | |
jeblair | fungi, clarkb: yep, on spaces: http://paste.openstack.org/show/507685/ | 14:50 |
*** Hal is now known as Guest77820 | 14:50 | |
mriedem | can we get another infra core to +W this d-g change from sdague so we can get live migration testing working in master? https://review.openstack.org/#/c/320925/ | 14:51 |
*** amitgandhinz has joined #openstack-infra | 14:51 | |
jeblair | fungi, clarkb: that was "a file.tar.gz" and "b file.tar.gz" | 14:51 |
acabot | hi, I just submitted a new release for Watcher project (freshly accepted in the big tent) #link https://review.openstack.org/#/c/325201/ but tox cannot validate it because of this msg "deliverables/newton/watcher.yaml release 0.3.0 is missing openstack/watcher from the governance list" | 14:51 |
acabot | do I need to update a specific file on openstack-infra ? | 14:52 |
*** jaosorior has quit IRC | 14:52 | |
*** Goneri has quit IRC | 14:52 | |
AJaeger | acabot: for release, best ask on #openstack-release | 14:53 |
*** raildo is now known as raildo-afk | 14:53 | |
fungi | jeblair: after the release meeting, i'll see if i can come up with a good quoting solution for the find output (unless you're already hacking one out) | 14:53 |
acabot | AJaeger : sure thx | 14:53 |
jeblair | fungi: i am not | 14:53 |
*** xarses_ is now known as xarses | 14:54 | |
fungi | cool, should have something in the next hour then | 14:54 |
*** dizquierdo has joined #openstack-infra | 14:54 | |
*** Kaiyan has joined #openstack-infra | 14:55 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Fix the profile submenu https://review.openstack.org/325350 | 14:55 |
*** chem` has quit IRC | 14:55 | |
*** roxanaghe has joined #openstack-infra | 14:56 | |
*** sorantis has quit IRC | 14:57 | |
*** javeriak has quit IRC | 14:58 | |
*** arxcruz has quit IRC | 14:59 | |
fungi | unfortunate that find -printf doesn't seem to support %q | 14:59 |
fungi | that would have been a trivial solution | 15:00 |
*** javeriak has joined #openstack-infra | 15:00 | |
*** roxanaghe has quit IRC | 15:00 | |
fungi | may need to use find -print0 | rsync -0 ... | 15:01 |
*** ifarkas has quit IRC | 15:01 | |
fungi | that should get us around any shell injection risk, without opening up format string vulnerability risks in the process | 15:01 |
*** fedexo has joined #openstack-infra | 15:03 | |
openstackgerrit | Merged openstack-infra/system-config: Remove double slash for individual links https://review.openstack.org/276558 | 15:03 |
*** mtanino has joined #openstack-infra | 15:04 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Stream subprocess output for ansible-playbook https://review.openstack.org/325356 | 15:04 |
pabelanger | jeblair: ^ Tests the best I could locally, but think that gives realtime output from ansible | 15:04 |
AJaeger | jeblair, project-config cores: There's a change by dhellmann to introduce a new queue into Zuul - a release-check one. jeblai, I'd like your review on that one, please | 15:04 |
AJaeger | jeblair: change is https://review.openstack.org/324768 | 15:04 |
*** zul has quit IRC | 15:05 | |
*** zul has joined #openstack-infra | 15:05 | |
*** Goneri has joined #openstack-infra | 15:05 | |
*** e0ne has quit IRC | 15:05 | |
*** lezbar has quit IRC | 15:05 | |
*** csomerville has quit IRC | 15:06 | |
openstackgerrit | Merged openstack-infra/project-config-example: Email notifications should only be for silent checks. https://review.openstack.org/278541 | 15:06 |
*** fedexo has quit IRC | 15:06 | |
*** tphummel has joined #openstack-infra | 15:06 | |
krotscheck | timothyb89 ALrightey, let's take a look. You'd like to land this in openstack-health, yes? DId you want the karma-subunit-reporter to be managed by infra as well? | 15:07 |
*** mriedem1 has joined #openstack-infra | 15:07 | |
*** e0ne has joined #openstack-infra | 15:07 | |
*** e0ne has quit IRC | 15:08 | |
*** tmorin has left #openstack-infra | 15:08 | |
*** mriedem has quit IRC | 15:08 | |
timothyb89 | krotscheck: right, looking to add to openstack-health/stackviz | 15:08 |
krotscheck | Gothca | 15:08 |
timothyb89 | krotscheck: as for management, wherever the best home will be :) | 15:08 |
openstackgerrit | Merged openstack-infra/ansible-puppet: Remove dead code https://review.openstack.org/278850 | 15:08 |
openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: add liberasurecode gate jobs https://review.openstack.org/325357 | 15:09 |
*** mriedem1 is now known as mriedem | 15:09 | |
timothyb89 | krotscheck: there's also https://github.com/timothyb89/node-subunit to worry about as well | 15:10 |
pabelanger | jeblair: we may need to pass PYTHONUNBUFFERED = 1 to env, for ansible too. We currently do that when running ansible from jenkins to enable live streaming in ansible | 15:11 |
krotscheck | timothyb89: Well, governance is orthogonal to getting it into the project. | 15:13 |
*** javeriak has quit IRC | 15:13 | |
krotscheck | So let's start with making it work, and then bikeshed in the QA channel as to whether we want those two projects in Gerrit :D | 15:13 |
timothyb89 | krotscheck: okay, sounds like a plan! | 15:14 |
timothyb89 | krotscheck: I've already got a preliminary patch up for openstack-health: https://review.openstack.org/#/c/322449/ | 15:14 |
krotscheck | timothyb89: That patch works, eh? | 15:16 |
timothyb89 | krotscheck: it should, though we'll need patches to project-config and the log client to actually collect results | 15:16 |
*** dprince has quit IRC | 15:17 | |
*** jcoufal has quit IRC | 15:17 | |
krotscheck | timothyb89: Makes sense, and should be easy enough. When you say "collect" though, you mean having it stream back to "<insert something here>", yes? | 15:18 |
*** r-daneel has quit IRC | 15:18 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a note mentioning markdown is supported under the comment box https://review.openstack.org/325360 | 15:18 |
timothyb89 | krotscheck: publishing to the log server during npm-run jobs for one, but also collecting for subunit2sql | 15:19 |
krotscheck | I'm digging through project-config right now to figure out where that's done in other places. | 15:21 |
*** piet has quit IRC | 15:22 | |
jeblair | AJaeger: that change looks techincally correct, so i left a comment to that effect. i would like to abstain from weighing in on whether it's something we want to do. | 15:22 |
cloudnull | mornings | 15:22 |
timothyb89 | krotscheck: I want to say subunit collection is configured here: https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/files/logstash/jenkins-log-client.yaml#L14 | 15:22 |
*** vincentll has quit IRC | 15:23 | |
*** thiagop is now known as thiagop-afk | 15:23 | |
krotscheck | Ah, that's system-config | 15:23 |
* krotscheck was looking the wrong place | 15:23 | |
*** pradk has quit IRC | 15:24 | |
AJaeger | jeblair: thanks for reviewing. Let's see what others think | 15:24 |
*** pradk has joined #openstack-infra | 15:24 | |
*** pradk has quit IRC | 15:24 | |
pabelanger | cloudnull: morning | 15:24 |
eharney | what should i do if i'm getting "Code Review - Error" "file cinder...common.py not found in revision 317643,4" when trying to post comments on a review? i've somehow written comments that can't be saved? | 15:24 |
pabelanger | I noticed a few SSH timeouts this morning on osic nodes, for example | 15:24 |
pabelanger | 2016-06-03 15:20:56,577 ERROR nodepool.NodeLauncher: Timeout launching node id: 1405352 in provider: osic-cloud1 error: Timeout waiting for ssh access | 15:24 |
pabelanger | cloudnull: we usually see that when we cannot connect into the public IP of a server for whatever reason | 15:25 |
*** pradk has joined #openstack-infra | 15:25 | |
jeblair | fungi: i've been attempting to make a shell injection vulnerability, but so far i can't seem to create a file with backticks in its name. i may not be very good at haxoring. | 15:25 |
krotscheck | Anyone familiar with how subunit/elasticsearch is set up in infra that can give me a quick overview of how our builds send streams? | 15:26 |
jeblair | fungi: er, s/vulnerability/exploit/ | 15:26 |
sdague | clarkb: ug, after all that the d-g change fails on rax networking at the ansible phase - http://logs.openstack.org/25/320925/5/gate/gate-grenade-dsvm-multinode/99dacf7/console.html | 15:26 |
fungi | jeblair: how about files with > or | or ; in their names? | 15:26 |
kashyap | Heya folks, I'm sure I've asked this before here, but I forget, in a series of changes, when Jenkins gives throws this: "This change depends on a change that failed to merge." What could be the root cause? https://review.openstack.org/#/c/320610/10 | 15:27 |
clarkb | krotscheck: the builds dont send anything but a completion event, another daemon picks that up and pulls logs off the log server and processes them | 15:27 |
jeblair | fungi: okay, i'll try that | 15:27 |
pabelanger | cloudnull: and example of how often it happens: http://paste.openstack.org/show/507691/ | 15:27 |
fungi | jeblair: or & | 15:27 |
*** migi is now known as migi_afk | 15:27 | |
*** migi_afk is now known as migi | 15:27 | |
*** nwkarsten has quit IRC | 15:27 | |
*** woodster_ has joined #openstack-infra | 15:27 | |
krotscheck | clarkb: Gotcha, so copying the subunit to /logs/testrepository.subunit and ensuring that they're uploaded would be sufficient. | 15:27 |
krotscheck | clarkb: Everything else is automagic? | 15:27 |
*** zhurong has quit IRC | 15:27 | |
*** nwkarsten has joined #openstack-infra | 15:28 | |
fungi | jeblair: really, any character which could trigger overwriting arbitrary files or terminate the current shell command and initiate a new one | 15:28 |
clarkb | krotscheck: anno you still have to co figure the backend to do things with it, I lack context for wjat you are trying to do | 15:28 |
krotscheck | clarkb: We have a subunit reporter for javascript builds now. | 15:28 |
AJaeger | kashyap: rebase your change | 15:30 |
kashyap | AJaeger: So that Zuul re-queus it? | 15:31 |
kashyap | s/queus/queues/ | 15:31 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Upload karma.subunit to log server https://review.openstack.org/325366 | 15:31 |
krotscheck | clarkb: Here's the start ^^ | 15:31 |
AJaeger | kashyap: I'm currently double checking your change... | 15:31 |
*** rcernin has joined #openstack-infra | 15:31 | |
kashyap | AJaeger: Not mine, asking for another contributor on -nova | 15:31 |
AJaeger | kashyap: those message come from 3rd party CIs - nothing you can do besides informing the 3rd party CIs. | 15:32 |
*** vhosakot has joined #openstack-infra | 15:32 | |
*** nwkarsten has quit IRC | 15:32 | |
AJaeger | Wait, Jenkins also reports it. Let me dig deeper... | 15:32 |
*** sree has joined #openstack-infra | 15:33 | |
*** mdbooth has joined #openstack-infra | 15:34 | |
AJaeger | kashyap: I'm confused now - hope somebody else can help... | 15:34 |
kashyap | AJaeger: mdbooth is the author here | 15:35 |
mdbooth | AJaeger: Hey, kashyap is abandoning his attempts to repurpose himself as a message broker | 15:35 |
kashyap | mdbooth: Messages you might've missed above: AJaeger says what you observed: Jenkins reports too, and that he's not sure of it... | 15:35 |
mdbooth | Thanks | 15:36 |
kashyap | Okay, out for real :-) Gotta clean the dishes and run to the tram station | 15:36 |
mdbooth | Some of the patches which were kicked out of zuul are now back in | 15:36 |
mdbooth | So it might just be resolving itself | 15:36 |
openstackgerrit | Tim Buckley proposed openstack-infra/system-config: Collect 'karma.subunit' files https://review.openstack.org/325369 | 15:36 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Get translation jobs into healthcheck https://review.openstack.org/311459 | 15:37 |
timothyb89 | krotscheck, clarkb: ^^ I think this should be the changes for subunit2sql collection as well | 15:37 |
clarkb | timothyb89: krotscheck right so that will get your subunit log files on the log server. It will not do anything to elasticsearch | 15:38 |
clarkb | which is fine but I have a feeling you are looking for something more? | 15:38 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Upload karma.subunit to log server https://review.openstack.org/325366 | 15:39 |
mdbooth | AJaeger: I suspect a race in whatever queues the jobs meant that they were initially queued in the wrong order. | 15:39 |
*** d0ugal has quit IRC | 15:39 | |
timothyb89 | clarkb: are there any other places subunit results are used? | 15:39 |
*** rcernin has quit IRC | 15:39 | |
clarkb | timothyb89: subunit2sql slurps them up but only for tempest I think | 15:40 |
clarkb | mdbooth: no I don't think that is it | 15:40 |
EmilienM | fungi: I'll let you take decision on this new periodic job: https://review.openstack.org/#/c/324557/ | 15:40 |
timothyb89 | clarkb: I think this patch should configure collection for subunit2sql? https://review.openstack.org/325369 | 15:40 |
clarkb | mdbooth: I think what happened was you pushed a new patchset to a parent change which kicked the child out of the gate because its parent updated | 15:40 |
mdbooth | clarkb: I pushed the whole series at once. | 15:41 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul: Make ansible launcher rsync flattening more secure https://review.openstack.org/325372 | 15:41 |
clarkb | oh hrm ya they all went up about an hour ago | 15:41 |
fungi | jeblair: so there's an option ^ | 15:41 |
*** chem` has joined #openstack-infra | 15:41 | |
openstackgerrit | amrith proposed openstack-infra/project-config: Add channel notification for trove-image-builder https://review.openstack.org/325175 | 15:41 |
*** asettle has quit IRC | 15:42 | |
*** Na3iL has quit IRC | 15:43 | |
*** ri0 has quit IRC | 15:43 | |
*** csomerville has joined #openstack-infra | 15:44 | |
notmorgan | fungi: always print filenames exactly as is? isn;t that the opposite of what you want? | 15:44 |
fungi | notmorgan: is it? | 15:45 |
notmorgan | fungi: wouldn't -ls/fls be more correct? | 15:45 |
*** ihrachys has quit IRC | 15:45 | |
notmorgan | fungi: -print0: Always print the exact filename, unchanged, even if the output is going to a terminal. | 15:45 |
fungi | notmorgan: it's not going to a terminal though, it's going to a pipe | 15:45 |
fungi | and rsync is instructed to read the list from a pipe | 15:45 |
fungi | so no shell to interpret any of that | 15:46 |
clarkb | the trivial explanation would be that nova master has moved ahead around when you did your rebase and introduced a new conflict | 15:46 |
clarkb | but I haven't tested that | 15:46 |
notmorgan | fungi: hmmmm. | 15:46 |
notmorgan | fungi: oh i missed the '|' | 15:46 |
*** infra-red has joined #openstack-infra | 15:47 | |
notmorgan | fungi: yeah thats fine then :) | 15:47 |
fungi | notmorgan: it's the classic solution for avoiding shell injection (and misinterpretation of filenames in general)... get rid of the shell when passing data | 15:47 |
notmorgan | fungi: i thought it was just -print0 | 15:47 |
*** sree has quit IRC | 15:47 | |
* fungi was hoping the code comment there was explicit about it | 15:47 | |
notmorgan | fungi: pre-coffee | 15:47 |
fungi | np | 15:48 |
notmorgan | fungi: comments look like line noise ;) | 15:48 |
fungi | i'm about to disappear for lunchies anyway | 15:48 |
notmorgan | fungi: ooh yum. enjoy | 15:48 |
anteaya | fungi: enjoy lunchies | 15:48 |
fungi | after i have a look at EmilienM's change | 15:48 |
EmilienM | fungi: this is not urgent, lunch is > than my patch ;-) | 15:49 |
notmorgan | EmilienM knows whats up. Lunch > lots of things. | 15:49 |
notmorgan | :) | 15:49 |
openstackgerrit | Tim Buckley proposed openstack-infra/system-config: Collect 'karma.subunit' files https://review.openstack.org/325369 | 15:49 |
*** csomerville has quit IRC | 15:49 | |
EmilienM | notmorgan: I'll let you imagine "French lunch > ?" ;-) | 15:50 |
fungi | time is an illusion, lunchtime doubly so | 15:50 |
notmorgan | EmilienM: i don't need to imagine. | 15:50 |
notmorgan | EmilienM: French Lunch > all | 15:50 |
pleia2 | chocolate bread with cheese and wine | 15:50 |
notmorgan | :P | 15:50 |
*** Na3iL has joined #openstack-infra | 15:51 | |
jeblair | fungi, notmorgan: hrm, that's not working -- rsync is outputing the usage message | 15:51 |
notmorgan | pleia2: oooooooooh | 15:51 |
krotscheck | clarkb, timothyb89: So, https://review.openstack.org/#/c/325366/ plus https://review.openstack.org/#/c/325369/1 plus https://review.openstack.org/#/c/322449 equals subunit-in-elasticsearch, yes? | 15:51 |
fungi | jeblair: oh, i wonder if the '{source}' replacement being two parameters is causing it to misinterpret | 15:51 |
clarkb | krotscheck: there is no subunit in elasticsearch anywhere | 15:52 |
notmorgan | fungi: very well might be. | 15:52 |
clarkb | krotscheck: which is sort of why I am asking about what you want to achieve | 15:52 |
jeblair | fungi: i think you still need SRC with files-from | 15:52 |
*** EricGonczer_ has quit IRC | 15:52 | |
fungi | jeblair: aha, i bet that's it | 15:53 |
krotscheck | clarkb: That's why I asked for explanation as to what the pieces in infra were earlier wrt subunit, because I don't understand the system well enough to know what's possible, and what's currently being done. | 15:53 |
jeblair | "The filenames that are read from the FILE are all relative to the source dir" | 15:53 |
*** EricGonczer_ has joined #openstack-infra | 15:53 | |
*** bhavik has joined #openstack-infra | 15:53 | |
pleia2 | while we have some folks around, etherpad for rename in ~4 hours could use some eyes https://etherpad.openstack.org/p/repo-renaming-2016-06-03 (anteaya looked+added comments yesterday), the changes are prepped and ready | 15:53 |
fungi | jeblair: yeah, then i'll likely need to rework that also so that find prunes the parent dirs | 15:53 |
fungi | i can take a stab at fixing after lunch | 15:53 |
krotscheck | clarkb: In short: We have jobs that generate subunit. What do those jobs actually do right now? Do they send a stream of results to a collector? How is that collector determined? Do they just upload it to the log server? ¯\_(ツ)_/¯ | 15:54 |
anteaya | fungi: are we altering the timing of the rename at all for release folks? pleia2 | 15:54 |
fungi | anteaya: only if they're not done with release activities by the start of the window | 15:55 |
*** markmcd has quit IRC | 15:55 | |
*** pblaho has quit IRC | 15:55 | |
anteaya | fungi: pleia2 grand thank you | 15:55 |
*** pblaho has joined #openstack-infra | 15:56 | |
*** schipiga has quit IRC | 15:56 | |
*** roxanaghe has joined #openstack-infra | 15:56 | |
EmilienM | ok I have a dumb question, is there a mechanism in place in our infra that +2 +A a patch that is passing CI on a patch proposed by our Proposal Bot? | 15:56 |
*** markmcd has joined #openstack-infra | 15:57 | |
fungi | EmilienM: nope, by design we expect actual humans to review proposed changes and be responsible for interpreting them and their job results before approving them to merge | 15:58 |
EmilienM | ok, makes sense thx | 15:58 |
*** mikelk has quit IRC | 15:58 | |
*** infra-red has quit IRC | 16:00 | |
anteaya | EmilienM: we had a long chat about this in Austin, what you propose would be a vector for exploitation | 16:01 |
EmilienM | ok cool no prob, just asking | 16:01 |
jeblair | fungi: fwiw, with the current state (not your proposed pipe patch), when i create "a&foo.tar.gz" i end up with "a&foo.tar.gz" at the destination. | 16:02 |
anteaya | EmilienM: sure | 16:02 |
notmorgan | jeblair: sounds like it isn't breaking out of the shell in the find. | 16:03 |
notmorgan | jeblair: which is good news (tm) | 16:03 |
fungi | jeblair: that's a good sign. the additional pipe might just be overkill | 16:03 |
fungi | okay, heading out. bbiab | 16:03 |
*** Swami has joined #openstack-infra | 16:03 | |
notmorgan | fungi: i would worry about >, |, and `` still but if & isn't causing issues i'm not sure the others would. | 16:04 |
notmorgan | fungi: and/or $() | 16:04 |
*** bdemers has quit IRC | 16:05 | |
*** jlanoux has quit IRC | 16:05 | |
cloudnull | pabelanger: ping. sorry was AFK. Do you happen to have the ip addresses for a few of the nodes that we/are failing to get SSH access? | 16:07 |
krotscheck | timothyb89: seems like clarkb's busy, so let's see what we can do about getting those tests into openstack-health. How does openstack-health accept subunit data? | 16:08 |
timothyb89 | krotscheck: it queries it directly through subunit2sql | 16:08 |
timothyb89 | krotscheck: mtreinish would know for sure, but I think https://review.openstack.org/#/c/325369/1 should be enough for that | 16:09 |
*** javeriak has joined #openstack-infra | 16:09 | |
*** sree has joined #openstack-infra | 16:09 | |
krotscheck | timothyb89: Oh good! | 16:09 |
jeblair | clarkb, fungi: fungi's initial solution also works for the '.tox/*/log/*' and '**/*testrepository.subunit.gz' cases | 16:10 |
krotscheck | timothyb89: Alright, let's go ahead and see what the gate thinks, and if we're lucky it will all work like magic :D | 16:11 |
timothyb89 | krotscheck: cool! | 16:11 |
openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: add liberasurecode gate jobs https://review.openstack.org/325357 | 16:11 |
* krotscheck pushes the "That was easy" button | 16:11 | |
*** piet has joined #openstack-infra | 16:12 | |
pabelanger | cloudnull: Let me look | 16:12 |
*** PollyZ has quit IRC | 16:12 | |
*** bdemers has joined #openstack-infra | 16:12 | |
pabelanger | cloudnull: 2016-06-03 15:23:34,005 DEBUG nodepool.NodeLauncher: Node id: 1405539 is running, ipv4: 172.99.106.233, ipv6: | 16:13 |
timothyb89 | krotscheck: while we're on the topic, do you have any thoughts about proper translation of karma spec names to something more subunit-y? | 16:13 |
*** javeriak_ has joined #openstack-infra | 16:13 | |
jeblair | notmorgan, fungi: http://paste.openstack.org/show/507725/ | 16:13 |
timothyb89 | krotscheck: right now it's dot-separating and converting | 16:13 |
*** trown is now known as trown|lunch | 16:13 | |
jeblair | notmorgan, fungi: those all seem to show up in the destination as they are in the source | 16:13 |
timothyb89 | krotscheck: ... and converting ' ' to '_', resulting in names like this: GroupedRunsController.should_process_chart_data_correctly | 16:13 |
krotscheck | timothyb89: What would be a better subunit-y format? | 16:14 |
notmorgan | jeblair: ok cool | 16:14 |
*** moravec has quit IRC | 16:14 | |
timothyb89 | krotscheck: well, for openstack-health it works alright, but for e.g. ironic-webclient the results are less good | 16:14 |
notmorgan | jeblair: i'm happy with that (I can take a stab at other awful shell things as well after i get checked out of my hotel if you want - but it seems pretty sane) | 16:14 |
timothyb89 | krotscheck: that translation doesn't work so well for 'Unit: OpenStack Ironic API Transformation Methods' | 16:15 |
*** degorenko is now known as _degorenko|afk | 16:15 | |
*** reed has quit IRC | 16:15 | |
*** reed has joined #openstack-infra | 16:15 | |
jeblair | notmorgan: yeah, the more the merrier on something like this :) | 16:15 |
krotscheck | timothyb89: Ah, yes. That was during my verbose phase | 16:15 |
*** sambetts is now known as sambetts|afk | 16:15 | |
*** javeriak has quit IRC | 16:16 | |
openstackgerrit | Merged openstack-infra/project-config: Add manila-specs to specs.yaml https://review.openstack.org/324941 | 16:16 |
*** mriedem is now known as mriedem_away | 16:16 | |
krotscheck | timothyb89: Also, we may have other projects that use things like protractor, which'll have an entirely different output. | 16:16 |
krotscheck | (protractor-subunit anyone?) | 16:16 |
openstackgerrit | Merged openstack-infra/project-config: Add missing release jobs for instack & instack-undercloud https://review.openstack.org/324837 | 16:16 |
timothyb89 | krotscheck: heh, I think that's less an issue with your code, and more a problem with my quick-and-dirty normalizing | 16:16 |
timothyb89 | krotscheck: that should be doable as well :) | 16:17 |
*** aarefiev has quit IRC | 16:17 | |
*** bnemec has quit IRC | 16:17 | |
Shrews | jeblair: remind me again why we call rsync directly | 16:18 |
*** bhavik1 has joined #openstack-infra | 16:18 | |
*** nwkarsten has joined #openstack-infra | 16:18 | |
*** bdemers_ has joined #openstack-infra | 16:18 | |
*** tesseract has quit IRC | 16:19 | |
openstackgerrit | Merged openstack-infra/project-config: Implement propose_rdo_promote CI periodic job https://review.openstack.org/324557 | 16:19 |
jeblair | Shrews: because we're copying from controller to third-party site. synchronize module has no option to copy stuff that does not include the target host as either the source or destination. | 16:19 |
*** PollyZ has joined #openstack-infra | 16:19 | |
krotscheck | timothyb89: The jasmine naming pattern is (thing)+ (should behave like X). The naming I use in ironic-webclient asumed that the test categorization needed to happen in the test description, which I've since learned isn't really necessary. | 16:19 |
krotscheck | timothyb89: Ultimately, quick-and-dirty normalization becomes a usability issue, so it's probably easier to address issues as they come up. | 16:20 |
*** xarses has quit IRC | 16:20 | |
*** aarefiev has joined #openstack-infra | 16:20 | |
cloudnull | pabelanger: would it be possible to keep one of the bad actor nodes online for a while so I can poke at things ? | 16:20 |
zaro | morning | 16:20 |
anteaya | morning zaro | 16:20 |
timothyb89 | krotscheck: fair enough, right now the plugin just leaves those as off-by-default options, probably best to keep it that way | 16:21 |
cloudnull | looks like the VM using 172.99.106.233 was cleaned up | 16:21 |
*** nadya has joined #openstack-infra | 16:21 | |
clarkb | krotscheck: aiui its tempest only aubunit in health | 16:21 |
anteaya | zaro: would you have any time in perhaps getting the storyboard gerrit plugin working on review-dev? | 16:21 |
Shrews | jeblair: ah right | 16:21 |
*** bhavik has quit IRC | 16:21 | |
anteaya | zaro: if we can get it working on review-dev that means that Zara doesn't have to take her time figuring out how to stand up a gerrit | 16:21 |
*** david-lyle has joined #openstack-infra | 16:22 | |
pabelanger | cloudnull: I'm not sure it is possible. Basically, if we cannot ssh into the VM, we delete it right away | 16:22 |
pabelanger | let me look at the code quickly | 16:22 |
*** bdemers has quit IRC | 16:22 | |
cloudnull | ok | 16:22 |
*** bhavik1 has quit IRC | 16:23 | |
*** bnemec has joined #openstack-infra | 16:23 | |
pabelanger | cloudnull: Ya, we delete it on exception. So I'd need to randomly hold nodes currently in the build state in an attempt to catch one | 16:24 |
*** PollyZ has quit IRC | 16:24 | |
pabelanger | cloudnull: let me try that | 16:24 |
cloudnull | if its too much ill try and attack it another way | 16:25 |
*** mhickey has quit IRC | 16:25 | |
jeblair | pabelanger: it looks like jhesketh didn't get around to doing a watchdog for the ansible timeout. have you started working on that, or should i? | 16:25 |
jeblair | pabelanger: (also see comment on 325356) | 16:25 |
pabelanger | cloudnull: Ya, I have no way to know which will hold, until after it fails | 16:26 |
pabelanger | jeblair: Oh, I thought I see some watchdog code | 16:26 |
jhesketh | jeblair: actually I did | 16:26 |
jeblair | jhesketh: oh neat! | 16:26 |
jhesketh | Should be tagged with v25 | 16:26 |
zaro | anteaya: just got back from pycon. this is my priority: 1 gerrit git gc research, 2 find solutions for gerrit memory issues, 3 figure out how we can force online reindex for project renames. i might be able to do storyboard in parallel but would be lower priority | 16:26 |
jhesketh | Not sure if it's what you had in mind | 16:26 |
jeblair | gah it's right there | 16:27 |
jeblair | jhesketh: sorry i missed it | 16:27 |
jhesketh | It's quite crude | 16:27 |
jhesketh | All good :-) | 16:27 |
anteaya | zaro: fair enough, welcome back from pycon, I hope you had a good time, thank you for sharing your priority list with me, I appreciate it | 16:27 |
pabelanger | jeblair: thanks for the comment on 325356, I didn't even think of doing that. | 16:27 |
anteaya | jhesketh: what are you doing up? | 16:27 |
*** cody-somerville has joined #openstack-infra | 16:27 | |
jhesketh | That is a good question | 16:28 |
cloudnull | pabelanger: no worries. I'll figure something else out | 16:28 |
anteaya | jhesketh: glad I asked | 16:29 |
krotscheck | clarkb: Gotcha. I think OpenStack Health wants to report on itself :) | 16:29 |
jeblair | jhesketh: since we're using threads now, i don't think we can use sigalarm (we'll have a bunch of those going at once) | 16:30 |
*** nwkarsten has quit IRC | 16:31 | |
*** shashank_hegde has joined #openstack-infra | 16:31 | |
jeblair | jhesketh: how about i rework that patch to spawn a timeout thread while you sleep? | 16:31 |
pabelanger | cloudnull: would a list of IPs help? | 16:31 |
zaro | anteaya: np, sorry i think i missed some discussion around gerrit on storyboard channel, lost my backscroll because i switched my irc server. | 16:31 |
*** nwkarsten has joined #openstack-infra | 16:31 | |
*** rcernin has joined #openstack-infra | 16:31 | |
cloudnull | pabelanger: that would | 16:31 |
cloudnull | IDK if the issue is IP specific but i'll try to rule that out | 16:32 |
*** Apoorva has joined #openstack-infra | 16:32 | |
*** dprince has joined #openstack-infra | 16:32 | |
anteaya | zaro: I understand, fortunately meetbot was mostly working http://eavesdrop.openstack.org/irclogs/%23storyboard/ | 16:32 |
*** kushal has joined #openstack-infra | 16:33 | |
pabelanger | cloudnull: here is the most recently failures: http://paste.openstack.org/show/507731/ | 16:33 |
pabelanger | cloudnull: I can write a quick script to generate a list of all failures too if needed | 16:33 |
*** PollyZ has joined #openstack-infra | 16:33 | |
pabelanger | cloudnull: there does seem to be a pattern | 16:34 |
jhesketh | jeblair: hmm okay. Yeah I was about to say having the watcher launch another thread would be easy enough. Im happy to do it but won't be able to until tomorrow (or possibly my Sunday). You're welcome to though if you'd like | 16:34 |
*** nwkarsten has quit IRC | 16:36 | |
openstackgerrit | Merged openstack-dev/hacking: Updated from global requirements https://review.openstack.org/322555 | 16:36 |
jeblair | jhesketh: yeah, i'll give it a shot | 16:37 |
*** deadnull_ has joined #openstack-infra | 16:37 | |
*** nadya has quit IRC | 16:37 | |
*** xarses has joined #openstack-infra | 16:37 | |
*** nadya has joined #openstack-infra | 16:37 | |
*** PollyZ has quit IRC | 16:38 | |
*** nadya_ has joined #openstack-infra | 16:38 | |
*** piet has quit IRC | 16:39 | |
*** piet has joined #openstack-infra | 16:39 | |
*** r-daneel has joined #openstack-infra | 16:42 | |
*** nadya has quit IRC | 16:42 | |
*** dtantsur is now known as dtantsur|afk | 16:42 | |
*** lucasagomes is now known as lucas-afk | 16:42 | |
*** nadya_ has quit IRC | 16:42 | |
anteaya | jeblair: I've commented on the comments should not paginate story: https://storyboard.openstack.org/#!/story/2000620 | 16:43 |
*** derekh has quit IRC | 16:44 | |
anteaya | I just learned about the red gear myself allowing a user to set event timeline preferences | 16:44 |
jeblair | anteaya: yes, i set those settings a while ago, but i do not think it is reasonable to expect every user to do that. | 16:45 |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Add python logger configuration https://review.openstack.org/325409 | 16:46 |
*** shashank_hegde has quit IRC | 16:46 | |
*** javeriak has joined #openstack-infra | 16:47 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Simplify translation sync https://review.openstack.org/325410 | 16:48 |
*** johnny has joined #openstack-infra | 16:49 | |
*** johnny is now known as Guest11182 | 16:49 | |
openstackgerrit | Roman Vasilets proposed openstack-infra/project-config: Remove redundant job suffix for rally jobs https://review.openstack.org/325411 | 16:49 |
*** javeriak_ has quit IRC | 16:50 | |
*** nwkarsten has joined #openstack-infra | 16:50 | |
anteaya | jeblair: understood, have you time to say so in the story or shall I copy paste? | 16:51 |
anteaya | ah you commented, thank yoi | 16:52 |
anteaya | you | 16:52 |
*** yamahata has joined #openstack-infra | 16:53 | |
*** tonytan4ever has quit IRC | 16:53 | |
*** bnemec is now known as beekneemech | 16:54 | |
*** harlowja has joined #openstack-infra | 16:55 | |
openstackgerrit | Tim Hinrichs proposed openstack-infra/irc-meetings: Add meeting chair to Congress meetings https://review.openstack.org/325066 | 16:55 |
*** ociuhandu has quit IRC | 16:58 | |
*** Guest77820 has quit IRC | 16:59 | |
*** yaume has quit IRC | 17:00 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Deprecated snaphot image building https://review.openstack.org/325339 | 17:00 |
jeblair | pabelanger: i think i need your zuul patch in final form to do the watchdog thing; do you have time to update it real quick? | 17:01 |
*** PollyZ has joined #openstack-infra | 17:03 | |
*** kencjohnston has joined #openstack-infra | 17:05 | |
*** deadnull_ has quit IRC | 17:06 | |
*** amitgandhinz has quit IRC | 17:06 | |
*** amitgandhinz has joined #openstack-infra | 17:07 | |
*** _vsaienko has joined #openstack-infra | 17:09 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Stream subprocess output for ansible-playbook https://review.openstack.org/325356 | 17:09 |
pabelanger | jeblair: sorry, did the work. Forgot to git-review | 17:09 |
jeblair | pabelanger: woot, thx! | 17:09 |
pabelanger | cloudnull: http://paste.openstack.org/show/507754/ | 17:09 |
pabelanger | cloudnull: that is the list of IPs for all our failure since switching to public IPs | 17:09 |
*** sarob has joined #openstack-infra | 17:10 | |
*** amitgandhinz has quit IRC | 17:11 | |
*** csomerville has joined #openstack-infra | 17:11 | |
*** sree has quit IRC | 17:11 | |
*** cody-somerville has quit IRC | 17:11 | |
*** salv-orlando has quit IRC | 17:11 | |
*** amitgandhinz has joined #openstack-infra | 17:11 | |
*** sree has joined #openstack-infra | 17:11 | |
*** salv-orlando has joined #openstack-infra | 17:12 | |
*** shashank_hegde has joined #openstack-infra | 17:12 | |
pabelanger | jeblair: Feel free to ping me when the next round of timeout failures once we are running watchdog and streaming ansible | 17:12 |
pabelanger | jeblair: I'm going to search more in ansible about timeout not being respected | 17:13 |
*** timello has quit IRC | 17:13 | |
*** sree has quit IRC | 17:16 | |
*** flepied has quit IRC | 17:18 | |
Kaiyan | Hello infra team, https://review.openstack.org/#/c/316293/ is ready for review again (adding tempest tests on each monasca-repo as non-voting check jobs). It would be great if i can get some reviews on that :-D Thanks in advance! | 17:18 |
*** timello has joined #openstack-infra | 17:18 | |
cloudnull | pabelanger: thanks ! | 17:19 |
*** ccamacho has quit IRC | 17:21 | |
*** _vsaienko has quit IRC | 17:21 | |
*** rvasilets__ has joined #openstack-infra | 17:22 | |
*** rbrndt has quit IRC | 17:23 | |
*** kzaitsev_mb has quit IRC | 17:25 | |
notmorgan | devananda: storyville is good coffee, you are right. | 17:29 |
*** shashank_hegde has quit IRC | 17:29 | |
devananda | notmorgan: isn't that the best?! | 17:29 |
devananda | notmorgan: also - good morning | 17:29 |
notmorgan | devananda: yah, and happy friday! | 17:29 |
devananda | notmorgan: mind hopping into -ironic for a minute? we were just talking about keystone stuff | 17:30 |
notmorgan | oh sure sec. | 17:30 |
*** Na3iL has quit IRC | 17:30 | |
*** jerryz has joined #openstack-infra | 17:30 | |
*** deadnull_ has joined #openstack-infra | 17:31 | |
*** notmorgan is now known as morgan | 17:32 | |
* morgan switches to "casual nick friday" nick. | 17:32 | |
*** JayF is now known as notJayF | 17:32 | |
*** devananda is now known as deva | 17:32 | |
*** notJayF is now known as JasonF | 17:32 | |
*** deva is now known as devananda | 17:33 | |
*** devananda is now known as deva | 17:34 | |
dmsimard | Is there a spec for other-requirements.txt format ? I'd like to perhaps put comments in there but afraid it'd break something. | 17:34 |
*** nwkarsten has quit IRC | 17:34 | |
*** deva is now known as devananda | 17:34 | |
*** mriedem_away has quit IRC | 17:36 | |
pabelanger | dmsimard: http://docs.openstack.org/infra/manual/drivers.html#package-requirements | 17:37 |
dmsimard | pabelanger: cool, ty | 17:37 |
timothyb89 | pabelanger: by any chance do you know the status of stackviz building in nodepool? | 17:39 |
*** mriedem has joined #openstack-infra | 17:40 | |
pabelanger | timothyb89: I thought we merge it | 17:41 |
*** esikachev has quit IRC | 17:42 | |
timothyb89 | pabelanger: it seems to be, but I'm not seeing the dib element in the nodepool logs? http://nodepool.openstack.org/dib.ubuntu-xenial.log | 17:42 |
*** csomerville has quit IRC | 17:42 | |
*** tonytan4ever has joined #openstack-infra | 17:42 | |
*** piet has quit IRC | 17:43 | |
pabelanger | timothyb89: I think we need to restart nodepool-builder | 17:44 |
pabelanger | timothyb89: I can do that today | 17:44 |
*** daemontool has quit IRC | 17:44 | |
fungi | jeblair: excellent news on the original rsync patch then. i'm going to consider my follow-on change as mostly paranoid overengineering and put it on the back burner for now in case we discover a need for it later | 17:44 |
timothyb89 | pabelanger: oh okay, cool, thank you! | 17:44 |
pabelanger | timothyb89: Once our images finish uploading, I can restart nodepool-builder and fire off a build, confirming it works | 17:45 |
pabelanger | timothyb89: should be in about 4 hours | 17:45 |
anteaya | persia: ah we did capture the task id in gerrit commit message story after all: https://storyboard.openstack.org/#!/story/2000584 | 17:45 |
*** cody-somerville has joined #openstack-infra | 17:46 | |
persia | Cool | 17:46 |
timothyb89 | pabelanger: sounds good, I'll keep an eye out for it! | 17:47 |
anteaya | :) | 17:48 |
*** sputnik13_ has joined #openstack-infra | 17:48 | |
fungi | morgan: for me, every day is casual nick friday (and hawaiian shirt day i guess) | 17:48 |
anteaya | morgan: oh you are you today | 17:48 |
anteaya | morgan: I wanted to include you in the story I highlighted persia on, but I couldn't find you | 17:49 |
morgan | anteaya: hehe | 17:49 |
anteaya | fungi: are you wearing a hawaiian shirt? | 17:49 |
morgan | anteaya: i'm hiding | 17:49 |
fungi | morgan is sneakily hiding in plain sight | 17:49 |
morgan | exactly! | 17:49 |
morgan | :P | 17:49 |
*** shashank_hegde has joined #openstack-infra | 17:49 | |
anteaya | morgan: well it makes it harder to include on things I thought you were interested in | 17:49 |
fungi | anteaya: i was when i went to lunch, but i've changed back into my work uniform now (pajamas) | 17:49 |
AJaeger | anteaya: could you abandon https://review.openstack.org/306589 , please? It's not needed anymore | 17:49 |
anteaya | fungi: that's my work uniform! | 17:50 |
anteaya | fungi: either that or bathrobe | 17:50 |
morgan | anteaya: hehe i was just a joke for the -ironic folks. i'll switch back :( | 17:50 |
*** morgan is now known as notmorgan | 17:50 | |
fungi | it's trendy, for sure | 17:50 |
*** flepied has joined #openstack-infra | 17:50 | |
anteaya | AJaeger: done | 17:50 |
*** EricGonczer_ has quit IRC | 17:50 | |
pleia2 | my nephew is pretty jealous of my star wars angry bird pants | 17:50 |
anteaya | notmorgan: I don't care what you pick as long as it is somewhat consistent so I can find you | 17:51 |
fungi | pleia2: he's forgiven you for using his band-aids then? | 17:51 |
anteaya | pleia2: photo! | 17:51 |
pleia2 | fungi: yeah, short memory :) | 17:51 |
anteaya | I would like star trek pajamas | 17:51 |
anteaya | then I really could be wearing a uniform | 17:51 |
anteaya | plaid doesn't make for a convincing uniform | 17:52 |
*** EricGonczer_ has joined #openstack-infra | 17:52 | |
AJaeger | thanks, anteaya | 17:52 |
fungi | i bet someone did market pajamas looking like star trek uniforms in the 60s/70s | 17:52 |
anteaya | AJaeger: welcome, thanks for cleaning up' | 17:52 |
beisner | hi all. we init'd a new project and seem to have forgotten the upstream: bit in the project definition. we have a nice, shiny empty repo as one would expect. how much of a pita is it for us to re-init that and pull in its code at this point? | 17:52 |
anteaya | where are they now? | 17:52 |
*** vdrok has quit IRC | 17:53 | |
beisner | ie. should we revert the infra change and start a-new, or can we have someone manually poke something for us? | 17:53 |
AJaeger | beisner: which change was that? | 17:53 |
beisner | charm-hacluster | 17:53 |
beisner | AJaeger ^ | 17:53 |
notmorgan | anteaya: i try not to change the nick, but it's a 50/50 chance which one i land on after netsplits. | 17:54 |
beisner | AJaeger, the missing piece was: upstream: https://github.com/openstack-charmers/charm-hacluster | 17:54 |
notmorgan | anteaya: it will always be either morgan or notmorgan | 17:54 |
*** piet has joined #openstack-infra | 17:54 | |
anteaya | notmorgan: that is fair | 17:54 |
anteaya | notmorgan: okay I will try to tab complete both in future before I give up | 17:54 |
anteaya | figured you were around | 17:54 |
*** pblaho has quit IRC | 17:55 | |
AJaeger | beisner: Ah - didn't review that one. I normally double check that an empty repo is fine (which is fine often). | 17:55 |
AJaeger | beisner: you need to persuade an infra-root to do it manually for you | 17:55 |
pleia2 | anteaya: https://www.flickr.com/photos/pleia2/26831027384/ | 17:56 |
beisner | AJaeger, and I even cross reviewed this /o\ - yah, i suspect empty repos are not entirely uncommon for folks to start with. | 17:56 |
notmorgan | anteaya: i try and keep it notmorgan because i overlap with notmyname in fewer channels than mordred | 17:58 |
*** nwkarsten has joined #openstack-infra | 17:58 | |
anteaya | pleia2: nice | 17:58 |
pleia2 | #morganproblems | 17:58 |
*** sputnik13_ has quit IRC | 17:58 | |
*** permalac has quit IRC | 17:58 | |
anteaya | pleia2: exactly | 17:58 |
anteaya | beisner: an empty repo is a choice some folks choose to make | 17:59 |
*** yolanda has quit IRC | 17:59 | |
anteaya | beisner: the commit message should inform if the choice is a conscious choice | 17:59 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Stop rebuilding locales on centos-7 https://review.openstack.org/318311 | 17:59 |
beisner | anteaya, yep i imagine so. ack re: indicating that in the commit msg. | 18:00 |
beisner | anteaya, we'd prefer not to dump a huge commit in the repo to preserve commit history. can you help us manually> | 18:01 |
anteaya | beisner: so it isn't an option to revert creating a repo | 18:01 |
anteaya | personally no I cannot | 18:01 |
beisner | anteaya, ps. apologies for the extra work on this one. we just missed it. any idea who i would need to ask? | 18:01 |
anteaya | anyone who can is listening and if they want to will speak up | 18:01 |
anteaya | I'm not speaking for anyone else | 18:01 |
anteaya | the option at present is to create an initial commit to the repo to import the contents | 18:02 |
tdasilva | AJaeger: re your comment here: https://review.openstack.org/#/c/325357/2/jenkins/jobs/projects.yaml@3077 how can I make sure that tarball will be uploaded to tarballs.openstack.org? | 18:02 |
anteaya | the import of the current repo is a one time step that is available during repo creation, it can't be repeated after the repo is created | 18:02 |
beisner | right, we'd prefer to preserve the commit history naturally | 18:02 |
*** PollyZ has quit IRC | 18:03 | |
openstackgerrit | Merged openstack-infra/system-config: Have zuul use the copied jenkins jobs directory https://review.openstack.org/323594 | 18:03 |
anteaya | how many commits do you have to the project? | 18:03 |
anteaya | we had someone do this with a 177 chained commits that took out our testing system | 18:03 |
beisner | anteaya, 227 | 18:03 |
anteaya | okay so our system is pretty good with about 20 commit at a time | 18:04 |
anteaya | if you can offer them as patches in gerrit in finite packages of 20 or less chained commits that preserves your history and will get your code into the repo | 18:04 |
*** andymaier has joined #openstack-infra | 18:05 | |
mtreinish | timothyb89, krotscheck: that patch will work assuming you store the subunit file in the root of the log dir | 18:05 |
*** sarob has quit IRC | 18:05 | |
anteaya | pabelanger yolanda ^^ in future could you make a point of ensuring starting wtih an empty repo is the conscious choice of the new project patch owner? | 18:05 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: add watchdog for ansible https://review.openstack.org/325061 | 18:05 |
openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: A newer version of virtualenv is already installed https://review.openstack.org/325330 | 18:05 |
*** sarob has joined #openstack-infra | 18:05 | |
*** sarob has quit IRC | 18:05 | |
*** sarob has joined #openstack-infra | 18:06 | |
*** psilvad has joined #openstack-infra | 18:06 | |
AJaeger | tdasilva: tarballs are only uploaded if you have a job for that - and you did not specify one... | 18:06 |
AJaeger | tdasilva: since you have a C project, our usual tarball jobs will not work. | 18:06 |
*** tqtran has joined #openstack-infra | 18:06 | |
AJaeger | tdasilva: so, you need to either create a custom job or update jenkins/scripts/run-tarball.sh. | 18:07 |
jeblair | pabelanger, jhesketh: 325061 builds on pabelanger's change and does timeout using a watchdog thread | 18:07 |
AJaeger | tdasilva: Your change does not add a tarball job at all. Let's do this in two steps ;) Get yours in with my suggestions and then work on a tarball job... | 18:08 |
tdasilva | AJaeger: sounds good! thank you | 18:08 |
* fungi assumes a tarball job for a c/autotools based project would call `make dist` | 18:08 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Ironic: always install tempest plugin from master https://review.openstack.org/299888 | 18:09 |
openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: add liberasurecode gate jobs https://review.openstack.org/325357 | 18:09 |
pabelanger | anteaya: beisner: Sure, but I think we do a good job documenting it already in: http://docs.openstack.org/infra/manual/creators.html#adding-the-project-to-the-ci-system, which we do note if you don't configure upstream source it will create an empty repo | 18:10 |
*** sarob has quit IRC | 18:10 | |
pabelanger | jeblair: jhesketh: great | 18:10 |
AJaeger | tdasilva: Looks fine now. | 18:10 |
anteaya | pabelanger: I do think it is worth asking the question during the review to ensure intent if it is not explicitly stated in the commit message | 18:11 |
tdasilva | AJaeger: thx | 18:11 |
AJaeger | pabelanger: http://git.openstack.org/cgit/openstack-infra/project-config/tree/REVIEWING.rst#n37 | 18:11 |
krotscheck | mtreinish: Awesome. Like this? https://review.openstack.org/#/c/325366/2/jenkins/jobs/javascript.yaml | 18:11 |
* AJaeger agrees with anteaya | 18:11 | |
*** trown|lunch is now known as trown | 18:12 | |
* AJaeger sometimes forgets asking as well... | 18:12 | |
*** nwkarsten has quit IRC | 18:12 | |
pabelanger | AJaeger: anteaya: ack | 18:12 |
beisner | pabelanger, indeed you have doc'd it quite well. we got ~27 of them right :) | 18:12 |
anteaya | pabelanger: great, thank you | 18:12 |
*** PollyZ has joined #openstack-infra | 18:12 | |
beisner | pabelanger, sorry for the extra work. we'll definitely double/triple check that on any future projects. | 18:12 |
anteaya | well I am a big fan of very clear commit messages, in my opinion they prevent a host of fix up work after the fact | 18:13 |
anteaya | beisner: at this point the extra work is all yours | 18:14 |
*** mixos has joined #openstack-infra | 18:14 | |
*** andymaier has quit IRC | 18:14 | |
*** sdague has quit IRC | 18:15 | |
pabelanger | I think there is a way for an infra-root to force push up the contents of the repo, but I've not done it | 18:15 |
pabelanger | maybe not | 18:15 |
pabelanger | *shurgs* | 18:16 |
*** nwkarsten has joined #openstack-infra | 18:16 | |
fungi | pabelanger: yes, clone the intended original repo state, add a gerrit remote, put your account in the "Project Bootstrappers" group in gerrit, and then git push --force gerrit | 18:17 |
*** yamada-h has joined #openstack-infra | 18:18 | |
pabelanger | beisner: where is the upstream repo? | 18:18 |
fungi | that will replace the boilerplate initial repo with the other desired commits | 18:18 |
pabelanger | fungi: sure, let me try that | 18:18 |
beisner | pabelanger, https://github.com/openstack-charmers/charm-hacluster | 18:18 |
jeblair | beisner, pabelanger: just don't tell anyone you're doing it -- we have a reputation to maintain! ;) | 18:20 |
beisner | jeblair, pabelanger /o\ so sorry. you won't see us do that again. ;) | 18:21 |
*** kzaitsev_mb has joined #openstack-infra | 18:21 | |
*** rbrndt has joined #openstack-infra | 18:22 | |
pabelanger | beisner: pushed | 18:22 |
pabelanger | fungi: great, thanks | 18:22 |
*** cody-somerville has quit IRC | 18:23 | |
*** sarob has joined #openstack-infra | 18:23 | |
pabelanger | beisner: http://git.openstack.org/cgit/openstack/charm-hacluster | 18:23 |
beisner | pabelanger, i owe ya a beer, cookie, or whatever, whenever some time ;-) | 18:23 |
*** akostrikov has quit IRC | 18:23 | |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Create a StoryBoard gui manual https://review.openstack.org/325474 | 18:23 |
*** thiagop-afk has quit IRC | 18:24 | |
anteaya | funny openstackgerrit missed one of my patches, in #storyboard it reported both, the original and the commit message fix | 18:24 |
beisner | tyvm, all | 18:25 |
anteaya | jroll: my first patch on the storyboard gui guide: https://review.openstack.org/#/c/325474/2 | 18:25 |
AJaeger | beisner: now add a proper .gitreview to your repo! | 18:26 |
beisner | AJaeger, on that now. | 18:26 |
AJaeger | beisner: if it's not there yet... | 18:26 |
jroll | anteaya: thanks, I'll add myself as a reviewer but can't promise I can take the time to make sure it's right (totally unfamiliar with storyboard right now) | 18:26 |
*** deadnull_ has quit IRC | 18:26 | |
anteaya | jroll: yup, I get it | 18:26 |
anteaya | jroll: actually you are the audience for the guide | 18:26 |
anteaya | totally unfamiliar is what I am looking for here | 18:27 |
anteaya | jroll: and thank you | 18:27 |
jroll | anteaya: indeed, just unsure when I'll have the time to go through it :) | 18:27 |
jroll | I will try! | 18:27 |
*** cody-somerville has joined #openstack-infra | 18:27 | |
anteaya | oh I understand, prioritize accordly | 18:27 |
anteaya | accordingly | 18:27 |
*** yamada-h has quit IRC | 18:28 | |
*** javeriak has quit IRC | 18:30 | |
*** javeriak has joined #openstack-infra | 18:31 | |
jeblair | clarkb, fungi, jhesketh, pabelanger, mordred, notmorgan, Shrews: i think all of the blockers we identified are either merged or in review; can you take a look at 324889 325356 325061? | 18:31 |
jeblair | clarkb, fungi, jhesketh, pabelanger, mordred, notmorgan, Shrews: the ansible async timeout failing to function is still a mystery -- 325356 is intended to get us a bit more information next time it happens and 325061 is designed to avoid disruption when it fails | 18:32 |
mordred | word | 18:32 |
* mordred waves at the channel of lovely people | 18:32 | |
*** Na3iL has joined #openstack-infra | 18:33 | |
pabelanger | jeblair: looking | 18:33 |
notmorgan | jeblair: i shall look. | 18:33 |
notmorgan | mordred: oh look it's a mordred! | 18:33 |
Shrews | jeblair: ack | 18:33 |
* mordred hands notmorgan some mud from the dead sea | 18:33 | |
*** kzaitsev_mb has quit IRC | 18:34 | |
jeblair | that mud is dead. | 18:34 |
* bkero waves back, happily mud-free. | 18:34 | |
*** jed56 has quit IRC | 18:35 | |
mordred | pabelanger: I see something in scrollback about switching to public ips with cloudnull ... what did I miss? | 18:35 |
fungi | mordred: osic has levelled up | 18:35 |
*** Swami has quit IRC | 18:36 | |
*** nwkarsten has quit IRC | 18:36 | |
mordred | fungi: zomg. we have non-floaters there? | 18:36 |
mordred | OSSUM | 18:36 |
pabelanger | We've reached the final boss on OSIC | 18:37 |
*** nwkarsten has joined #openstack-infra | 18:37 | |
* mordred hands cloudnull a bag of gourmet salt from the dead sea | 18:37 | |
pabelanger | mordred: No FIPs, but we are timing out SSHing to a few public IPs. | 18:37 |
sridhar_ram | infra-team - i'm looking for the procedure / process to add "openstackstatus" to the #tacker channel. Just so we don't miss any important annoucements - like the one this morning on CI stability. | 18:38 |
mordred | pabelanger: cool. that would still be a thing we're handling right, right? | 18:38 |
mordred | pabelanger: like, we time out and don't leak resources | 18:38 |
pabelanger | mordred: Right, we look good on that front | 18:38 |
* mordred does a dance | 18:38 | |
notmorgan | jeblair: the first of those were pretty easy to review, looking at the watchdog one now. | 18:41 |
openstackgerrit | Merged openstack-infra/project-config: Add DefCore guideline gate checks for json lint and schema https://review.openstack.org/317800 | 18:41 |
anteaya | mordred: I'll take salt from the dead sea | 18:41 |
anteaya | I have a salt collection | 18:41 |
anteaya | so far none from the dead sea | 18:42 |
*** sjmc7 has joined #openstack-infra | 18:43 | |
*** Swami has joined #openstack-infra | 18:43 | |
krotscheck | There's some intermittent gate failures on NPM-based things due to a low file-descriptor limit in xenial. Any cores around to tell me this isnt' crazy? https://review.openstack.org/#/c/324735/ | 18:43 |
AJaeger | sridhar_ram: http://docs.openstack.org/infra/system-config/irc.html | 18:43 |
*** dimtruck is now known as zz_dimtruck | 18:44 | |
openstackgerrit | Merged openstack-infra/project-config: Add pushMerge for oslo.messaging core for feature branches https://review.openstack.org/319452 | 18:44 |
sridhar_ram | AJaeger: thanks ,will look it up! | 18:44 |
anteaya | AJaeger: if you feel so inclined I would be grateful if you would be willing to review this storyboard documentation patch of mine: https://review.openstack.org/#/c/325474/2 | 18:45 |
anteaya | AJaeger: things like when to use full stops, when to use hyphens things of that nature for consistentcy | 18:45 |
*** dprince has quit IRC | 18:45 | |
*** zul has quit IRC | 18:45 | |
anteaya | AJaeger: as well as content of course | 18:45 |
*** chem`` has joined #openstack-infra | 18:46 | |
*** dprince has joined #openstack-infra | 18:46 | |
*** asettle has joined #openstack-infra | 18:47 | |
*** chem` has quit IRC | 18:47 | |
*** PollyZ_ has joined #openstack-infra | 18:48 | |
*** sdague has joined #openstack-infra | 18:49 | |
mgagne | is there a way to tell nodepool to not spawn more of an image? I mean max-servers is shared across all images. Can it be per image? | 18:50 |
*** PollyZ has quit IRC | 18:50 | |
*** zul has joined #openstack-infra | 18:51 | |
Shrews | jeblair: the big pink warning above this (https://docs.python.org/2/library/subprocess.html#subprocess.Popen.stdin) concerns me a bit with what you are doing in 325356 | 18:52 |
*** dizquierdo has quit IRC | 18:52 | |
*** asettle has quit IRC | 18:52 | |
pabelanger | krotscheck: left comment | 18:52 |
rvasilets__ | AJaeger: Hi, could you reply https://review.openstack.org/#/c/325411/1 Thx | 18:53 |
bkero | mordred: are you doing DevOpsDays Israel? | 18:53 |
jeblair | Shrews: i believe that's saying "don't call stdout.read() when you also may have data waiting on stderr". in our case, we only have one outbound pipe, and we're reading from it. we have no inbound pipe. so there should be nothing to deadlock. | 18:54 |
jeblair | pabelanger: ^ (your change :) | 18:54 |
mordred | bkero: OpenStack Israel | 18:55 |
bkero | ah right on, didn't realize that was coinciding | 18:55 |
openstackgerrit | Sridhar Ramaswamy proposed openstack-infra/system-config: Add #tacker to statusbot https://review.openstack.org/325488 | 18:55 |
*** Na3iL has quit IRC | 18:56 | |
*** zul has quit IRC | 18:56 | |
*** zul has joined #openstack-infra | 18:56 | |
AJaeger | anteaya: thansk for the writeup, that's an important document! I left some comments, some apply for the whole text | 18:57 |
AJaeger | rvasilets__: this is best done here ;) | 18:57 |
anteaya | AJaeger: wonderful thank you | 18:57 |
pabelanger | jeblair: sorry, not following | 18:58 |
Shrews | jeblair: hopefully, but, yeah, i think your thinking may be valid there | 18:58 |
AJaeger | rvasilets__: If you update zuul/layout.yaml in project-config, it's very convenient to know whether a job is voting or not. That's why we use the -nv, it's a handy notation for us as reviewers as well... | 18:58 |
jeblair | pabelanger: Shrews was asking about your change; wanted to make sure you saw it :) | 18:59 |
sridhar_ram | infra-team, AJaeger - I pushed a patchset to enable #tacker for statusbot. BTW, a quick follow on IRC question - how can I change the title of the channel, similar to the one infra (& other projects has) - "Discussion of ... " | docs .. | logged .. | 18:59 |
pabelanger | jeblair: reading now | 18:59 |
notmorgan | Shrews: i *think* jeblair is correct on that | 18:59 |
notmorgan | it sounds right? | 18:59 |
AJaeger | sridhar_ram: #tacker should have an operator that has those permissions... | 18:59 |
jeblair | notmorgan, Shrews, pabelanger: amusingly, communicate has a complimentary warning that's basically "don't use communicate if there's lots of data". it doesn't suggest what to do instead. but i'd probably do this. :) | 19:00 |
sridhar_ram | AJaeger: hmm.. i'm the PTL but i don't remember getting it from the last person who ran this | 19:00 |
notmorgan | jeblair: lol oi | 19:00 |
jeblair | (or if you need to have separate stdout/stderr streams, select i guess) | 19:00 |
pabelanger | warnings each way you go :) | 19:00 |
notmorgan | jeblair: that is probably the right answer | 19:01 |
notmorgan | jeblair: but.. yeesh | 19:01 |
sridhar_ram | AJaeger: is there way to check who holds the operator permission for #tacker channel ? | 19:01 |
pabelanger | infra-root: I have to step away for 90mins to run an errand. Feel free to take over any of my zuulv25 patches in flight | 19:01 |
AJaeger | sridhar_ram: run "/msg chanserv access #tacker list" and ask one of those folks for help... | 19:01 |
pabelanger | will be back online after | 19:01 |
jeblair | yeah. i think we're good here. at least, i'm willing to take it for a spin :) | 19:01 |
sridhar_ram | AJaeger: will do.. thanks | 19:01 |
notmorgan | jeblair: it wont be worse than what we have. and we can pull it together into something else if we need [select loops] | 19:02 |
notmorgan | jeblair: or whatever. | 19:02 |
fungi | pleia2: i'm going to go ahead and stop puppet on the puppetmaster in preparation for our maintenance | 19:03 |
fungi | also checking in with the release team on their situation | 19:03 |
pleia2 | fungi: thanks | 19:03 |
*** markusry has quit IRC | 19:03 | |
pleia2 | fungi: I figure in 30 minutes I'll send out the statusbot notice | 19:04 |
pleia2 | (once we confirm with release folks) | 19:04 |
fungi | yup | 19:04 |
fungi | sounds good | 19:04 |
*** EricGonc_ has joined #openstack-infra | 19:04 | |
rvasilets__ | AJaeger: Ou. Now I get. https://github.com/openstack-infra/project-config/blob/0e536e6cd87e2834ef3b2298a488a6d1b03435f9/jenkins/jobs/projects.yaml#L7989 Its always -nv... | 19:05 |
rvasilets__ | AJaeger: If its help to infra revivers then I will update our job names | 19:06 |
rvasilets__ | AJaeger: Is it needed? | 19:06 |
*** amoralej is now known as amoralej|off | 19:06 | |
rvasilets__ | *reviewers | 19:06 |
*** nwkarsten has quit IRC | 19:06 | |
*** nwkarsten has joined #openstack-infra | 19:07 | |
*** EricGonczer_ has quit IRC | 19:08 | |
rvasilets__ | AJaeger: I just not understand why we can't write it explisitly) | 19:08 |
rvasilets__ | by the link | 19:08 |
AJaeger | rvasilets__: it's a nice convention. It's not required but appreciated | 19:09 |
mgagne | My understanding is that there is a maintenance in progress with Gerrit? Is it normal I get an error with the contact store at this time? | 19:09 |
fungi | mgagne: maintenance isn't starting for another ~hour | 19:10 |
anteaya | mgagne: what error? | 19:10 |
mgagne | the usual "Error contacting contact store" | 19:10 |
jroll | ooo gerrit maintenance in an hour? yay early friday | 19:11 |
notmorgan | fungi: was lunchies good? | 19:11 |
notmorgan | ;) | 19:11 |
*** javeriak has quit IRC | 19:11 | |
fungi | notmorgan: fish burrito and some local(ish) cerveza, so yes | 19:11 |
notmorgan | perfect fiday lunch imnsho. | 19:12 |
fungi | sridhar_ram: AJaeger: it looks like permissions on #tacker are already set correctly to me | 19:12 |
* AJaeger signs off for the day and hopes for a smoothless gerrit maintenance... | 19:12 | |
pleia2 | have a nice weekend, AJaeger | 19:12 |
AJaeger | fungi: what needs to be done to change the topic there? | 19:12 |
fungi | thanks AJaeger! | 19:12 |
AJaeger | thanks, pleia2 and fungi! | 19:13 |
pleia2 | AJaeger: as you said, they just need to ask an existing operator to do it | 19:13 |
sridhar_ram | fungi: i was poking around few chanserv cmds as well to understand this... | 19:13 |
pleia2 | oh, looks like we're the only ones with access? | 19:13 |
mtreinish | krotscheck: yep, that should do it | 19:14 |
pleia2 | we can add one of the tacker folks to the list | 19:14 |
pleia2 | sridhar_ram: I'll see about adding you, as the ptl and all | 19:14 |
fungi | AJaeger: sridhar_ram: accessbot is set correctly at http://git.openstack.org/cgit/openstack-infra/project-config/tree/accessbot/channels.yaml#n228 but statusbot configuration still needs adding http://git.openstack.org/cgit/openstack-infra/system-config/tree/hiera/common.yaml#n33 | 19:15 |
sridhar_ram | pleia2: thanks! | 19:15 |
pleia2 | sridhar_ram: you can now /msg chanserv topic #tacker your topic here | 19:15 |
fungi | if this was about the original question of how to get statusbot updating topics in #tacker, anyway | 19:15 |
pleia2 | fungi: they want to update their channel topic | 19:15 |
sridhar_ram | fungi: i just pushed a patchset to add tacker to statusbot .. | 19:15 |
*** salv-orl_ has joined #openstack-infra | 19:15 | |
*** penguinolog has quit IRC | 19:16 | |
fungi | ah! i misread the original question. reread it just now | 19:16 |
fungi | sorry for the confusion | 19:16 |
*** piet has quit IRC | 19:16 | |
sridhar_ram | fungi: https://review.openstack.org/#/c/325488/ | 19:16 |
*** kzaitsev_ws has quit IRC | 19:16 | |
sridhar_ram | pleia2: trying the chanserv cmd now... | 19:17 |
mgagne | found the problem, coworker didn't register the right email at the foundation =) | 19:17 |
pleia2 | mgagne: story of our life :) | 19:17 |
*** pramchan has joined #openstack-infra | 19:17 | |
pramchan | how do I create a an openstack repo? | 19:18 |
*** salv-orlando has quit IRC | 19:18 | |
pramchan | I would like to create the openstack/meghdwar repo for a project | 19:18 |
anteaya | mgagne: yeah, I wondered if you were getting that error, that wasn't making sense to me | 19:18 |
sridhar_ram | pleia2: woot, it worked ! thanks everyone.. | 19:18 |
pleia2 | pramchan: we have instructions here: http://docs.openstack.org/infra/manual/creators.html | 19:18 |
pleia2 | sridhar_ram: great! | 19:18 |
openstackgerrit | Boris Deschenes proposed openstack-infra/glean: changed the name of the interface on which to add the default gw in gentoo https://review.openstack.org/325491 | 19:18 |
sridhar_ram | pleia2: so, just so i understand.. you've added my nick to #tacker channel operators ? | 19:18 |
pleia2 | sridhar_ram: yes | 19:19 |
pramchan | I attempted to do it through the official openstack process, but was told by the governance code review that I should create the repo first and have some development on it first before making it an official openstack project | 19:19 |
sridhar_ram | pleia2: cool, thx! | 19:19 |
mgagne | smallest change ever, 1 character :D | 19:20 |
pleia2 | pramchan: link to the governance change? some projects do start with no repository to import | 19:21 |
anteaya | mgagne: wooo | 19:21 |
pleia2 | but I'd need to see context, some projects may have different rules | 19:21 |
pramchan | here's the link to the comment | 19:22 |
pramchan | https://review.openstack.org/#/c/319466/12//COMMIT_MSG@9 | 19:22 |
sridhar_ram | pleia2: infra-team: along the same lines, our github repo message is awfully wrong at https://github.com/openstack/tacker How can I have that changed ? | 19:22 |
pleia2 | pramchan: he's not saying you can't create an empty repo, he's saying you can't submit it to governance until it's an active project | 19:23 |
*** PollyZ_ has quit IRC | 19:23 | |
pramchan | https://review.openstack.org/#/c/324798/ | 19:23 |
pramchan | and there's the governance repo gerrit code review | 19:23 |
*** linuxmaniac has joined #openstack-infra | 19:23 | |
*** linuxmaniac_ has quit IRC | 19:23 | |
pramchan | ah, so how do I create an empty repo? I couldn't find that piece of information in the project creation guide | 19:23 |
pramchan | I would like to create the openstack/meghdwar repo | 19:23 |
anteaya | pramchan: I'll suggest as I did last night, perhaps contributing to some current projects and understanding our workflow might be of use to you | 19:23 |
anteaya | pramchan: would save everyone conserned a lot of time if you learned our workflow first | 19:24 |
pleia2 | pramchan: your change 319466 adds the empty repo, you need to abandon the governance change and remove it from Depends-on: in the commit message | 19:24 |
pleia2 | pramchan: but anteaya makes a good point, it's very unusual for a first commit to be a project creation, being familiar with the tools in the OpenStack ecosystem by contributing to other projects is important | 19:26 |
pabelanger | and back online, errand cut short | 19:27 |
*** yolanda has joined #openstack-infra | 19:27 | |
*** pramchan has quit IRC | 19:28 | |
*** csomerville has joined #openstack-infra | 19:28 | |
*** piet has joined #openstack-infra | 19:30 | |
Shrews | jeblair: qq... where do you actually set the 'timeout' module variable used by 'async'? | 19:30 |
Shrews | jeblair: b/c i'm not seeing that :( | 19:30 |
*** Jeffrey4l_ has quit IRC | 19:30 | |
*** pramchan has joined #openstack-infra | 19:31 | |
pramchan | anteaya: pleaia2: point taken, I will find a bug in Neutron or Nova to fix to get familiar with the current workflow. If you have a specific bug you need help with, please let me know as well | 19:31 |
*** cody-somerville has quit IRC | 19:32 | |
Shrews | jeblair: oh, command line level. nm | 19:32 |
anteaya | pramchan: well we aren't in those projects and we don't know what you know, but yes that is the best direction for learning our workflow | 19:32 |
anteaya | pramchan: thank you for listening | 19:32 |
pleia2 | fungi: any word from release folks? | 19:33 |
fungi | pleia2: dhellmann is still working on flushing some final releases through. we may need to push it out a bit depending on if he thinks they' | 19:33 |
fungi | ll be wrapped up in the next hour | 19:33 |
pleia2 | ok, I'll hold off on the notice then | 19:33 |
pleia2 | I can't stay too late tonight (having dinner here, but would like to do the family thing a bit before I fly home tomorrow :)) | 19:34 |
dhellmann | I'm waiting for zuul to merge the patch I approved 15 minutes ago -- and it just did :-) | 19:34 |
*** Jeffrey4l_ has joined #openstack-infra | 19:35 | |
fungi | pleia2: no worries, i can babysit the offline reindex and bring everything back online once finished, so duck out whenever you need to | 19:35 |
pleia2 | also thinking I should run the reindex as root under screen, so anyone else can attach to it | 19:35 |
*** slaweq_ has joined #openstack-infra | 19:35 | |
fungi | absolutely | 19:35 |
pleia2 | (I'm on a Verizon hotspot out here, it's been good, but who knows!) | 19:35 |
nibalizer | ++ | 19:35 |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Create a StoryBoard gui manual https://review.openstack.org/325474 | 19:35 |
fungi | pleia2: well, not as root (as gerrit2) but otherwise yes | 19:35 |
anteaya | dhellmann: yay! | 19:36 |
pleia2 | ah, we do run it as gerrit2 already | 19:36 |
openstackgerrit | Prakash Ramchandran proposed openstack-infra/project-config: add new project meghdwar https://review.openstack.org/319466 | 19:36 |
pleia2 | so, I do this hacky thing of opening up a second screen to prevent the first screen from closing when the job is done, how am I supposed to do this? :) | 19:37 |
pleia2 | must be some "don't close" screen option... | 19:37 |
* pleia2 man page | 19:37 | |
*** pramchan has quit IRC | 19:37 | |
anteaya | there is a man page for pleia2? | 19:38 |
anteaya | I wonder if it says anything about star wars uniforms/pajamas | 19:38 |
pleia2 | haha, if only | 19:38 |
bkero | I made one of those for myself once. The man syntax is archaic | 19:39 |
*** sarob has quit IRC | 19:39 | |
*** sarob has joined #openstack-infra | 19:39 | |
*** roxanaghe has quit IRC | 19:39 | |
pleia2 | oh, I should just screen, then run the command | 19:40 |
anteaya | would be interesting practice for writing man pages | 19:40 |
pleia2 | etherpad updated | 19:40 |
pleia2 | bkero: you never fail to make me feel old :) | 19:40 |
*** nwkarste_ has joined #openstack-infra | 19:41 | |
*** nwkarsten has quit IRC | 19:41 | |
anteaya | they exist! https://www.thinkgeek.com/product/f02b/ | 19:41 |
anteaya | red gold or blue? | 19:41 |
*** banix has joined #openstack-infra | 19:41 | |
anteaya | so many decisions | 19:41 |
pleia2 | definitely not red | 19:41 |
bkero | pleia2: my bad ._. | 19:42 |
pleia2 | hehe | 19:42 |
anteaya | I could give red out though | 19:42 |
*** Kaiyan has quit IRC | 19:43 | |
*** slaweq_ has quit IRC | 19:43 | |
* bkero checks to see that it is reasonably worksafe: http://staff.osuosl.org/~bkero/ben.1 | 19:44 | |
pleia2 | haha, cute | 19:44 |
pleia2 | good at parties: -d | 19:45 |
fungi | pleia2: yeah, just start screen by itself and you'll have a shell in it. then whatever command you run in that shell will return you to the shell in screen rather than causing screen to terminate | 19:45 |
pleia2 | fungi: nods | 19:45 |
*** Apoorva has quit IRC | 19:45 | |
*** sarob has quit IRC | 19:45 | |
*** timello has quit IRC | 19:46 | |
*** sputnik13_ has joined #openstack-infra | 19:47 | |
*** zz_dimtruck is now known as dimtruck | 19:49 | |
*** amrith is now known as _amrith_ | 19:49 | |
fungi | anteaya: blue of course! science is always a good career choice | 19:50 |
anteaya | blue it is | 19:50 |
bkero | anteaya: redshirts are a whole thing | 19:51 |
bkero | also http://www.amazon.com/Redshirts-Novel-Three-John-Scalzi/dp/1491514388 | 19:51 |
fungi | yeah, that too. you want to make sure you come back from your away missions | 19:51 |
fungi | red shirts were like phaser magnets | 19:52 |
anteaya | the black market yellow dye | 19:52 |
openstackgerrit | Anita Kuno proposed openstack-infra/storyboard: Create a StoryBoard gui manual https://review.openstack.org/325474 | 19:54 |
*** sputnik13_ has quit IRC | 19:56 | |
*** aimeeu has quit IRC | 19:57 | |
pleia2 | sounds like we're on track to being "soon" so I'll send out the notice, we'll do the alert when we actually begin | 19:57 |
anteaya | pleia2: sounds good to me | 19:58 |
pleia2 | #status notice The infrastructure team is taking Gerrit offline for maintenance this afternoon, beginning shortly after 20:00 UTC. We aim to have it back online around 00:00 UTC. | 19:58 |
openstackstatus | pleia2: sending notice | 19:58 |
*** asettle has joined #openstack-infra | 19:58 | |
*** asettle has quit IRC | 19:58 | |
*** pvaneck has joined #openstack-infra | 19:58 | |
-openstackstatus- NOTICE: The infrastructure team is taking Gerrit offline for maintenance this afternoon, beginning shortly after 20:00 UTC. We aim to have it back online around 00:00 UTC. | 19:59 | |
*** aimeeu has joined #openstack-infra | 19:59 | |
*** e0ne has joined #openstack-infra | 20:00 | |
openstackstatus | pleia2: finished sending notice | 20:01 |
pleia2 | "Also add changes to update projects.txt in all branches of the requirements repo" <-- I don't remember what this means | 20:01 |
*** hashar has quit IRC | 20:01 | |
anteaya | in the requirements repo if any of the projects are listed in projects.txt we have to offer patches to the requirements repo | 20:01 |
anteaya | also we have to check all branches in the requirements repo | 20:02 |
* timrc does his routine Friday check-in and see Star Trek references and notes all is good. | 20:02 | |
anteaya | I did not do that step | 20:02 |
*** kushal has quit IRC | 20:02 | |
* pleia2 does not see either in the projects.txt | 20:02 | |
anteaya | pleia2: yay, thank you for completing that step | 20:02 |
anteaya | pleia2: did you want to use strikethrough on that step? | 20:03 |
anteaya | yay | 20:03 |
pleia2 | the first bit of the step did need to be done, and it is | 20:03 |
*** cbader has quit IRC | 20:03 | |
anteaya | indeed | 20:03 |
*** banix has quit IRC | 20:04 | |
*** _amrith_ is now known as amrith | 20:04 | |
*** timello has joined #openstack-infra | 20:04 | |
anteaya | pleia2: announce it with statusbot is our version of 'say it with flowers' | 20:05 |
pleia2 | haha | 20:05 |
pleia2 | "since none of you read pleia2's emails" | 20:06 |
*** baoli_ has quit IRC | 20:06 | |
anteaya | I do | 20:06 |
anteaya | I read some | 20:06 |
pleia2 | thank you :) | 20:06 |
fungi | what was the etherpad url again? | 20:06 |
pleia2 | https://etherpad.openstack.org/p/repo-renaming-2016-06-03 | 20:06 |
pleia2 | fungi: want to do zuul and github? | 20:06 |
pleia2 | I can do gerrit and gitXX | 20:07 |
fungi | can do | 20:07 |
pleia2 | #status alert Gerrit is offline for maintenance until 00:00 UTC | 20:07 |
openstackstatus | pleia2: sending alert | 20:07 |
fungi | i guess as soon as the alert is done updating topics everywhere i'll dump zuul check/gate and stop it | 20:08 |
*** nwkarste_ has quit IRC | 20:09 | |
fungi | jeblair: any special handling needed on zuul.o.o with your launcher testing? | 20:09 |
-openstackstatus- NOTICE: Gerrit is offline for maintenance until 00:00 UTC | 20:09 | |
*** ChanServ changes topic to "Gerrit is offline for maintenance until 00:00 UTC" | 20:09 | |
*** nwkarsten has joined #openstack-infra | 20:09 | |
*** sputnik13_ has joined #openstack-infra | 20:10 | |
openstackstatus | pleia2: finished sending alert | 20:12 |
fungi | took it a while longer than i'm used to expecting | 20:12 |
fungi | okay, dumping zuul check/gate and stopping now | 20:13 |
* pleia2 pats openstackstatus | 20:13 | |
anteaya | maybe it has more channels to alert these days | 20:13 |
fungi | confirmed zuul daemon is no longer running | 20:13 |
pleia2 | ok, gerrit time | 20:14 |
fungi | anteaya: that's my assumption too | 20:14 |
fungi | anteaya: and possibly also chanserv being slow to act | 20:14 |
anteaya | ah | 20:14 |
anteaya | I don't have any sense of chanserv's pace | 20:14 |
*** Swami has quit IRC | 20:15 | |
fungi | i interact with it only infrequently as well | 20:15 |
pleia2 | ok, gerrit is off | 20:15 |
*** rcernin has quit IRC | 20:15 | |
pleia2 | database now | 20:15 |
*** Apoorva has joined #openstack-infra | 20:15 | |
*** gyee has joined #openstack-infra | 20:16 | |
pleia2 | hmm, not matching anything | 20:17 |
fungi | that's not unusual (at least the account project watches) | 20:17 |
pleia2 | ok | 20:17 |
fungi | it's changes which hopefulyl matches something | 20:18 |
fungi | but even that _might_ not if there were never any changes for a project | 20:18 |
pleia2 | Query OK, 0 rows affected (0.36 sec) | 20:18 |
pleia2 | Rows matched: 0 Changed: 0 Warnings: 0 | 20:18 |
pleia2 | yeah | 20:18 |
fungi | if neither table is matching for one of those projects, might be a good idea to check on the filesystem and make sure that's _really_ it | 20:18 |
anteaya | is account project watches the people watching the project? | 20:18 |
fungi | anteaya: yes | 20:18 |
anteaya | thanks | 20:19 |
fungi | it's a table of which accounts have set to watch that project in their preferences | 20:19 |
anteaya | awesome | 20:19 |
pleia2 | fungi: mind jumping on to see if I'm missing something in this database? | 20:20 |
fungi | sure | 20:20 |
pleia2 | mysql> select * from changes where dest_project_name="ansible-puppet"; | 20:20 |
pleia2 | Empty set (0.38 sec) | 20:20 |
fungi | pleia2: missing namespaces on those queries | 20:21 |
fungi | pleia2: and on your filesystem commands too | 20:21 |
fungi | openstack-infra/ansible-puppet | 20:22 |
fungi | et cetera | 20:22 |
pleia2 | aha! | 20:22 |
mordred | pleia2, fungi: btw - I am here. although it's 23:22 and I have spotty internets | 20:22 |
*** sjmc7 has left #openstack-infra | 20:22 | |
*** Swami has joined #openstack-infra | 20:22 | |
anteaya | mordred: glad you are here | 20:22 |
*** bauwser is now known as bauzas | 20:22 | |
anteaya | mordred: you can hand out a round of cats if you would like | 20:22 |
pleia2 | Rows matched: 3 Changed: 3 Warnings: 0 | 20:22 |
anteaya | we haven't had a round lately | 20:22 |
pleia2 | much better :) | 20:22 |
*** kgiusti has quit IRC | 20:22 | |
anteaya | pleia2: yay! | 20:23 |
pleia2 | ok, database is done | 20:23 |
* mordred hands pleia2 a few of the cats he found on the street in Tel Aviv | 20:23 | |
pleia2 | moving git repositories | 20:23 |
pleia2 | mordred: \o/ | 20:23 |
anteaya | my cat is standing guard to my left | 20:24 |
anteaya | she just came in to stand beside me for a bit | 20:24 |
pleia2 | ok, #8 is done, time to reindex | 20:24 |
fungi | pleia2: don't forget to use a screen session for the reindex | 20:24 |
anteaya | wooo, the fun bit | 20:24 |
* pleia2 nods | 20:24 | |
*** eumel8 has joined #openstack-infra | 20:25 | |
pleia2 | Cannot open your terminal '/dev/pts/1' - please check. | 20:25 |
pleia2 | yay sudo | 20:25 |
fungi | script /dev/null | 20:25 |
pleia2 | thanks | 20:26 |
fungi | it's a hacky workaround to clear the parent pty | 20:26 |
fungi | looks like you're in. i'm attached to it as well now | 20:26 |
* dasm is reading it as a good thriller book | 20:26 | |
pleia2 | ok, it's running | 20:27 |
*** PollyZ has joined #openstack-infra | 20:27 | |
fungi | yep, i see it too. good deal | 20:27 |
anteaya | pleia2: yay | 20:27 |
* pleia2 does favor and reduces terminal size | 20:27 | |
fungi | i'll get started on the github bits now while you work on the git farm i guess | 20:27 |
pleia2 | sounds good | 20:27 |
anteaya | now we watch grass grow and paint dry for four hours or so, yeah | 20:27 |
jeblair | o/ | 20:28 |
*** _ari_ has quit IRC | 20:28 | |
fungi | anteaya: well, it's _possible_ that our upgrade to a faster server will also make the reindex go more quickly | 20:28 |
*** banix has joined #openstack-infra | 20:28 | |
anteaya | fungi: ohhhh, wouldn't _that_ be lovely | 20:28 |
fungi | i'm not banking on it, but here's hoping | 20:29 |
anteaya | always room for hope | 20:29 |
anteaya | jeblair: https://etherpad.openstack.org/p/repo-renaming-2016-06-03 | 20:29 |
*** abregman has quit IRC | 20:29 | |
*** jerryz has quit IRC | 20:29 | |
jeblair | i guess we're not doing the groovy online reindex thing? | 20:29 |
pleia2 | git farm is done | 20:30 |
*** amotoki has quit IRC | 20:30 | |
*** nadya has joined #openstack-infra | 20:30 | |
pleia2 | jeblair: I guess not :\ I didn't know we were planning to | 20:30 |
anteaya | I thought we had concluded during the Feb rename that the online reindex wouldn't work | 20:30 |
jeblair | i don't think we necessarily were planning to | 20:30 |
pleia2 | ok | 20:31 |
jeblair | zaro said he had a solution that involved using groovy to force it to do a full online reindex | 20:31 |
pleia2 | ah | 20:31 |
fungi | github renames are done now | 20:31 |
jeblair | my question would have been perhaps better phrased as "i guess zaro's work on groovy-based online reindex has not progressed to the point where we are ready to try it for this rename?" | 20:31 |
fungi | jeblair: yeah, but we'd need to add the groovy script plugin to be able to do that | 20:31 |
anteaya | etherpad from Feb: https://etherpad.openstack.org/p/repo-renaming-2016-02-12 | 20:31 |
fungi | jeblair: after some back and forth, zaro concluded that getting it added as an option in the admin plugin might make more sense and he proposed (or was going to propose, can't remember if he did yet) a patch upstream for that | 20:32 |
anteaya | my read of zaro's update of his priorities he gave me today in channel was that is on his list of things to address | 20:32 |
jeblair | okiedokie | 20:33 |
anteaya | http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-06-03.log.html#t2016-06-03T16:26:56 | 20:33 |
*** roxanaghe has joined #openstack-infra | 20:33 | |
fungi | apparently online reindexing is completely implemented, but it only triggers on a gerrit upgrade and so an additional little bit was required to be able to get it to trigger arbitrarily even when there were no changes to the gerrit version/db schema | 20:33 |
*** persia has quit IRC | 20:33 | |
*** nwkarsten has quit IRC | 20:34 | |
*** dimtruck is now known as zz_dimtruck | 20:34 | |
pleia2 | my favorite part of renames is when I decide to go back to reviewing to pass the ...oh | 20:34 |
mordred | pleia2: ++ | 20:35 |
fungi | indeed | 20:35 |
fungi | the missing blobs are, i guess, still not completely cleaned up | 20:35 |
jeblair | pleia2: yeah, it's nice to be able to use gertty to review when gerrit's offline, right? | 20:35 |
*** nwkarsten has joined #openstack-infra | 20:35 | |
*** persia has joined #openstack-infra | 20:35 | |
fungi | gertty is working great for me, other than indicating it's got a sync error | 20:36 |
anteaya | fungi: the missing blobs that were supposed to be cleaned up in Feb? https://etherpad.openstack.org/p/repo-renaming-2016-02-12 | 20:36 |
*** baoli has joined #openstack-infra | 20:37 | |
jeblair | fungi: oh, huh, i think there's a bug... | 20:37 |
jeblair | well, sort of | 20:37 |
jeblair | i don't think we handle 503's as indicating it's offline | 20:37 |
fungi | anteaya: we cleaned up some ond half-deleted/half-renamed projects from ancient times, if that's what you're recalling | 20:38 |
pleia2 | hah, yeah, haven't kept my gertty synced this trip | 20:38 |
*** rhallisey has quit IRC | 20:38 | |
*** flwang1 has quit IRC | 20:38 | |
pleia2 | (on pay-by-the-gig internet, doing everything I can to control what I use) | 20:38 |
fungi | the missing blobs are actual git objects gerrit can't find which it thinks it has references to | 20:38 |
fungi | jeblair: that 'splains why it's not transitioned to offline mode for me | 20:38 |
anteaya | fungi: yes I think that is what I am recalling | 20:38 |
*** amotoki has joined #openstack-infra | 20:39 | |
jeblair | fungi: yeah, i'll whip up a patch. i've got 4 hours to test it. | 20:39 |
anteaya | fungi: ah sorry | 20:39 |
*** eharney has quit IRC | 20:39 | |
fungi | jeblair: if we're lucky, maybe only three! | 20:39 |
fungi | Reindexing changes: projects: 45% (474/1044), 33% (106889/322853) | 20:39 |
*** amotoki has quit IRC | 20:39 | |
fungi | it's making okay time so far, but as we know this is nonlinear | 20:40 |
*** roxanaghe has quit IRC | 20:40 | |
*** roxanaghe has joined #openstack-infra | 20:40 | |
*** kushal has joined #openstack-infra | 20:41 | |
*** PollyZ has quit IRC | 20:41 | |
*** tonytan4ever has quit IRC | 20:41 | |
pleia2 | in the proud tradition of status bars | 20:42 |
fungi | microsoft would be proud | 20:42 |
*** dprince has quit IRC | 20:43 | |
*** julim has quit IRC | 20:44 | |
*** gouthamr has quit IRC | 20:44 | |
*** ayoung has quit IRC | 20:44 | |
jeblair | fungi: http://paste.openstack.org/show/507821/ if you want to manually apply | 20:45 |
jeblair | fungi: or, better yet, i'll mail that in to dr. dobbs and you can type it in from the next issue. | 20:45 |
fungi | hah | 20:46 |
*** flwang has joined #openstack-infra | 20:46 | |
*** e0ne has quit IRC | 20:46 | |
*** flwang1 has joined #openstack-infra | 20:47 | |
fungi | jeblair: worked! | 20:48 |
fungi | Offline Sync: 9 | 20:48 |
jeblair | w00t! | 20:48 |
pleia2 | nice | 20:49 |
jeblair | now i just need gertty to remember to push that up for me in 4 (3?) hours | 20:49 |
fungi | in gerrit watched pot news... Reindexing changes: projects: 54% (566/1044), 47% (151776/322853) | 20:49 |
jeblair | i approved all the zuul ansible things | 20:51 |
jeblair | hopefully we can switch that back on later today or over weekend or something | 20:51 |
fungi | sounds good | 20:51 |
pabelanger | ++ | 20:51 |
*** nwkarsten has quit IRC | 20:53 | |
notmorgan | jeblair: at <4hrs from now> <run gertty again> ? ;) | 20:53 |
*** nwkarsten has joined #openstack-infra | 20:53 | |
notmorgan | jeblair: aslo next week can i bug you for a gear release? | 20:53 |
notmorgan | i'll remind you next week (of course) | 20:54 |
*** eumel8 has quit IRC | 20:54 | |
jeblair | notmorgan: oh, gertty will push up reviews automatically, i was joking i wanted to extend it to push up changes too | 20:54 |
notmorgan | jeblair: ahhhh | 20:54 |
jeblair | notmorgan: absolutely -- i looked yesterday, and there was a change i wanted to go ahead and get in; i approved it, and then the zuul launcher stuff... | 20:54 |
jeblair | lemme see if it merged | 20:54 |
notmorgan | jeblair: its so i can close out all but the socket issues with getting nodepool to py3 and voting (i'll play rebase chasing after that) | 20:55 |
jeblair | notmorgan: what are the socket issues? | 20:55 |
notmorgan | jeblair: gear is not reliably starting/stopping in the fixture under py3 | 20:55 |
jeblair | oh :( | 20:56 |
jeblair | notmorgan: i want to land https://review.openstack.org/301222 | 20:56 |
notmorgan | jeblair: the server. its... a bit baffling, and i'm about to need to open python in gdb | 20:56 |
jeblair | notmorgan: i just approved it | 20:56 |
*** rhochmuth has joined #openstack-infra | 20:56 | |
notmorgan | because pdb can't break on socket things very well. | 20:56 |
notmorgan | also threading. | 20:56 |
jeblair | notmorgan: does the server reliably stop/start on its own in py3? | 20:57 |
notmorgan | jeblair: ah cool will look when gerrit is back up. | 20:57 |
notmorgan | jeblair: yep. as far as i can tell it works fine under py27 | 20:57 |
notmorgan | and i can't replicate the hang outside of the fixture and test cases | 20:57 |
notmorgan | so, something weird is happening with threading, fixture, gear, test case. | 20:57 |
notmorgan | but it worries be because it's consistently unreliable enough i dont want to vote on py3 things before it can be resolved. | 20:58 |
*** nwkarsten has quit IRC | 20:58 | |
*** nadya has quit IRC | 20:58 | |
notmorgan | jeblair: or at least this happens way less under py27, it might aslo account for some spurrious errors i've seen in nodepool on py27. | 20:58 |
notmorgan | (testing) | 20:58 |
*** piet has quit IRC | 20:59 | |
* notmorgan is trying to avoid a fixture that spins up a full separate process gearman and then kills it -- it shou;dn't be an issue. | 20:59 | |
*** gouthamr has joined #openstack-infra | 20:59 | |
jeblair | that definitely should not be necessary | 21:02 |
*** Goneri has quit IRC | 21:03 | |
jeblair | notmorgan: this works for me and exits cleanly with only the main thread running at the end: http://paste.openstack.org/show/507824/ | 21:03 |
anteaya | what fiction is our progress bar reporting? | 21:03 |
notmorgan | jeblair: exactly | 21:04 |
*** Swanson has joined #openstack-infra | 21:04 | |
notmorgan | jeblair: works fine with something like that. but consistently fails in the nodepool tests (the worst offender is the disconnect handling test) | 21:04 |
notmorgan | jeblair: and the other tests will occasionally just not start with the fixture. | 21:04 |
notmorgan | jeblair: the disconnect test never closes the socket/listener on linux (using netstat to track it, and with artificial sleeps after the shutdown/join is calleD) | 21:05 |
jeblair | notmorgan: and gear has py3 tests which have a server fixture too | 21:05 |
notmorgan | jeblair: yup. and it's always worked outside of the nodepool tests. so something magic extra is happening in nodepool that is hanging up the socket. | 21:06 |
*** flwang1 has quit IRC | 21:06 | |
*** xyang1 has quit IRC | 21:06 | |
*** salv-orl_ has quit IRC | 21:06 | |
notmorgan | jeblair: i'll chase it down next week for sure - i'm sure it's going to be something silly. | 21:06 |
notmorgan | and really trivial once the fix is "known" | 21:06 |
* notmorgan is looking at the final failing py27 test for zuul getting a bunch of py3 fixes in too | 21:07 | |
*** salv-orlando has joined #openstack-infra | 21:07 | |
notmorgan | need to see what is happening with some urllib.urlopen oddity | 21:07 |
anteaya | fungi: pleia2 any indexing update? | 21:08 |
fungi | Reindexing changes: projects: 73% (772/1044), 65% (212392/322853) | 21:10 |
*** csomerville has quit IRC | 21:10 | |
*** jianghuaw has quit IRC | 21:10 | |
*** psilvad has quit IRC | 21:10 | |
anteaya | fungi: thank you | 21:11 |
*** flwang1 has joined #openstack-infra | 21:13 | |
*** pradk has quit IRC | 21:14 | |
*** pt_15 has joined #openstack-infra | 21:14 | |
*** amrith is now known as _amrith_ | 21:15 | |
*** flwang1 has quit IRC | 21:17 | |
*** flwang1 has joined #openstack-infra | 21:17 | |
*** harlowja has quit IRC | 21:20 | |
*** ldnunes has quit IRC | 21:21 | |
*** baoli has quit IRC | 21:22 | |
jeblair | and i wrote a change to gracefully stop the zuul launcher | 21:23 |
*** baoli has joined #openstack-infra | 21:24 | |
*** thorst has quit IRC | 21:24 | |
jeblair | fungi, clarkb: you'll like this -- the graceful stop includes a step where we release all idle nodes back to nodepool. that's also something we can run on its own. | 21:24 |
*** thorst has joined #openstack-infra | 21:24 | |
*** matt-borland has quit IRC | 21:24 | |
jeblair | (graceful is basically: pause + release + wait + stop) | 21:25 |
fungi | oh, speaking of, i guess i should stop nodepool and start it again once zuul | 21:26 |
fungi | 's back online? | 21:26 |
fungi | i don't think our rename process has been updated to account for nodepool's use of gearman | 21:26 |
jeblair | fungi: well, you shouldn't need to stop it | 21:27 |
*** thorst_ has joined #openstack-infra | 21:27 | |
jeblair | fungi: but if you do, i think it has a bug that will mean you have to wait until it's back online | 21:27 |
fungi | just restart i guess | 21:27 |
jeblair | fungi: shouldn't even need to do that | 21:27 |
*** lascii is now known as alaski | 21:27 | |
*** _amrith_ is now known as amrith | 21:27 | |
jeblair | fungi: yeah, it's happily idle. | 21:28 |
jeblair | fungi: what we *should* do however is set all nodes to delete state. i can do that if you want | 21:28 |
fungi | oh, i thought we'd had issues with nodepool not reestablishing its connection to gearman or something | 21:28 |
jeblair | fungi: yes, that's only on startup | 21:28 |
*** thorst has quit IRC | 21:29 | |
jeblair | fungi: if it also has problems when running, that's a new bug | 21:29 |
fungi | aha, got it | 21:29 |
fungi | then yeah, i can set all nodes to delete state. which integer value is that? | 21:29 |
jeblair | fungi: i just did it. 4. | 21:29 |
notmorgan | mordred, jeblair: woo found my urllib issue, whee will have that posted once gerrit comes back :) | 21:30 |
fungi | update node set state=4; | 21:30 |
fungi | got it | 21:30 |
jeblair | notmorgan: neat! | 21:30 |
fungi | thanks! | 21:30 |
notmorgan | jeblair: turns out it was in the FakeURLOpener and i missed a req=urllib.request.Request conversion | 21:30 |
*** trown is now known as trown|outtypewww | 21:30 | |
*** daemontool has joined #openstack-infra | 21:31 | |
*** thorst_ has quit IRC | 21:31 | |
fungi | Reindexing changes: projects: 99% (1036/1044), 88% (285553/322853) | 21:35 |
fungi | getting close (maybe?) | 21:35 |
pleia2 | or 2 hours at 88% :) | 21:35 |
* pleia2 fingers crossed | 21:35 | |
fungi | indeed | 21:35 |
*** baoli has quit IRC | 21:37 | |
*** banix has quit IRC | 21:38 | |
*** PollyZ has joined #openstack-infra | 21:39 | |
*** bryan_att has quit IRC | 21:43 | |
*** thorst has joined #openstack-infra | 21:46 | |
*** erlon has quit IRC | 21:46 | |
*** rvasilets__ has quit IRC | 21:46 | |
*** ffrank has joined #openstack-infra | 21:48 | |
*** esikachev has joined #openstack-infra | 21:50 | |
*** thorst has quit IRC | 21:50 | |
pleia2 | Reindexing changes: projects: 99% (1040/1044), 92% (300021/322853) (\) | 21:55 |
pleia2 | dinner is ready, so I'm going to attend to that | 21:55 |
pleia2 | I'll check in after | 21:56 |
anteaya | thanks pleia2 | 21:56 |
anteaya | enjoy dinner and family | 21:56 |
*** _vsaienko has joined #openstack-infra | 21:57 | |
*** sbelous has left #openstack-infra | 21:57 | |
*** yolanda has quit IRC | 21:57 | |
*** shashank_hegde has quit IRC | 21:58 | |
fungi | i'm still around and keeping tabs on it anyway | 21:59 |
fungi | so we're covered | 21:59 |
fungi | take your time | 21:59 |
*** ffrank has quit IRC | 22:00 | |
*** timello has quit IRC | 22:04 | |
*** mriedem has quit IRC | 22:04 | |
*** JasonF is now known as JayF | 22:05 | |
*** timello has joined #openstack-infra | 22:09 | |
*** EricGonc_ has quit IRC | 22:10 | |
fungi | Reindexing changes: projects: 99% (1042/1044), 95% (306856/322853) | 22:10 |
anteaya | yay! | 22:11 |
*** shashank_hegde has joined #openstack-infra | 22:11 | |
*** gordc has quit IRC | 22:15 | |
*** gouthamr has quit IRC | 22:16 | |
notmorgan | so close! | 22:16 |
anteaya | the last 1% takes the longest | 22:17 |
timrc | Y'all know how to do Friday, 'round here. | 22:17 |
anteaya | Happy Friday! | 22:18 |
timrc | When Gerrit says Service Unavailable what it's really trying to tell me is, "Go get a beer Tim. You deserve it!" | 22:18 |
anteaya | now you speak gerrit | 22:19 |
notmorgan | anteaya: so.. nova? | 22:19 |
notmorgan | :P | 22:19 |
anteaya | notmorgan: yeah | 22:19 |
notmorgan | that makes me a little sad | 22:19 |
anteaya | notmorgan: it has made us sad for some time | 22:19 |
anteaya | it is a known issue in upstream | 22:19 |
notmorgan | almost time to call it a day here and head up to visit w/ friends :) | 22:19 |
notmorgan | i was hoping to rebase a change but... alas | 22:20 |
notmorgan | i think i wont get to | 22:20 |
anteaya | notmorgan: sounds reasonable for me | 22:20 |
anteaya | yeah have some Friday | 22:20 |
anteaya | I don't expect reindexing to finish in the next hour | 22:20 |
notmorgan | eah and i am leaving in ~10min or so | 22:21 |
anteaya | cool | 22:21 |
notmorgan | oh blah, my weather widget stopped working :( | 22:23 |
anteaya | boo | 22:23 |
*** mdrabe has quit IRC | 22:23 | |
*** earlephilhower has quit IRC | 22:23 | |
anteaya | would you consider looking out the window? | 22:23 |
anteaya | radical idea, I know | 22:24 |
notmorgan | anteaya: i use it for things not-where i am | 22:24 |
anteaya | okay | 22:24 |
notmorgan | aka what is the weather at home, where i am headed to (travel wise) etc. | 22:24 |
notmorgan | so i know what to pack for. | 22:24 |
* dtroyer checks in to the weather bureau: 'sun shining here' | 22:24 | |
*** _vsaienko has quit IRC | 22:24 | |
notmorgan | dtroyer: lol | 22:24 |
anteaya | dtroyer: ha ha ha | 22:24 |
anteaya | notmorgan: where are you going? maybe someone there can look out the window? | 22:25 |
*** yamahata has quit IRC | 22:25 | |
anteaya | sun shining here too, btw | 22:25 |
dtroyer | and thanks to Gerrit's indexing, I get to enjoy it sooner than planned! | 22:25 |
notmorgan | anteaya: i am in seattle now was looking for home weather | 22:25 |
notmorgan | anteaya: Portland, OR 24 hr temps: 82.3°F |▇████▇▇▅▅▃▃▃▁▁_▁▃▅▅▇▇██| 90.9°F Range: 64.1°F - 90.9°F | 22:25 |
anteaya | dtroyer: wooo, spread the happiness | 22:25 |
notmorgan | waaaarm. | 22:25 |
anteaya | notmorgan: nice | 22:25 |
anteaya | yes warm it is | 22:25 |
anteaya | low 20's here | 22:26 |
*** daemontool has quit IRC | 22:26 | |
sputnik13_ | what's the dealio with gerrit? | 22:26 |
sputnik13_ | oh, should look at the topic maybe | 22:26 |
sputnik13_ | :) | 22:26 |
anteaya | sputnik13_: it is down | 22:27 |
anteaya | sputnik13_: http://lists.openstack.org/pipermail/openstack-dev/2016-May/095691.html | 22:27 |
timrc | notmorgan: Sounds like you're having a hotter day than we are in Austin... which is sort of crazy to consider. | 22:27 |
fungi | Reindexing changes: projects: 99% (1042/1044), 96% (312543/322853) | 22:27 |
*** xarses has quit IRC | 22:27 | |
* SpamapS has visions of Office Space | 22:28 | |
anteaya | fungi: yay another 1% | 22:28 |
notmorgan | timrc: record temp in PDX for today is 91, 1987 | 22:28 |
*** xarses has joined #openstack-infra | 22:28 | |
SpamapS | Lumberg is coming | 22:28 |
notmorgan | SpamapS: ... PC Load Letter | 22:28 |
*** markvoelker has quit IRC | 22:31 | |
*** PollyZ has quit IRC | 22:34 | |
*** kdas__ has joined #openstack-infra | 22:35 | |
*** esikachev has quit IRC | 22:36 | |
*** kushal has quit IRC | 22:37 | |
*** esikachev has joined #openstack-infra | 22:39 | |
*** EricGonczer_ has joined #openstack-infra | 22:39 | |
*** edmondsw has quit IRC | 22:41 | |
timrc | notmorgan: Feel marginally bad for anyone that doesn't have A/C there! | 22:42 |
timrc | I have to keep my house at a mild 72-ish at all times, otherwise I get sad. | 22:43 |
*** nwkarsten has joined #openstack-infra | 22:44 | |
*** rlandy has quit IRC | 22:44 | |
*** rbrndt has quit IRC | 22:44 | |
*** xarses has quit IRC | 22:47 | |
*** xarses has joined #openstack-infra | 22:47 | |
*** nwkarsten has quit IRC | 22:49 | |
*** ffrank has joined #openstack-infra | 22:51 | |
*** harlowja has joined #openstack-infra | 22:51 | |
*** mriedem has joined #openstack-infra | 22:52 | |
*** aysyd has quit IRC | 22:52 | |
*** nwkarsten has joined #openstack-infra | 22:56 | |
*** sdague has quit IRC | 22:57 | |
fungi | Reindexing changes: projects: 99% (1043/1044), 97% (314387/322853) | 22:57 |
anteaya | wooo | 23:00 |
anteaya | burning through that last few percent | 23:00 |
*** nwkarsten has quit IRC | 23:01 | |
*** hongbin has quit IRC | 23:03 | |
*** r-daneel has quit IRC | 23:04 | |
*** kdas__ has quit IRC | 23:05 | |
*** harlowja has quit IRC | 23:10 | |
*** harlowja has joined #openstack-infra | 23:10 | |
*** shashank_hegde has quit IRC | 23:11 | |
jlvillal | Is there a known issue with Zuul status? http://status.openstack.org/zuul/ | 23:12 |
anteaya | jlvillal: well zuul is stopped | 23:12 |
jlvillal | I get a "Loading..." message and it doesn't bring up the running jobs | 23:12 |
jlvillal | Ah, that would be the issue then :) | 23:13 |
anteaya | http://lists.openstack.org/pipermail/openstack-dev/2016-May/095691.html | 23:13 |
* jlvillal would vote for the Zuul status page to say so | 23:13 | |
jlvillal | anteaya, Thanks! | 23:13 |
anteaya | likely yes, watch the channel topic change and if the issue persists once the maintenance is over, do let us know | 23:13 |
anteaya | welcome | 23:13 |
*** esikachev has quit IRC | 23:14 | |
fungi | ugh, at the current pace of advancement indexing changes (~1/sec), we're looking at almost 2 hours to go | 23:17 |
anteaya | woo | 23:18 |
fungi | maybe it will speed back up again | 23:19 |
anteaya | that would be over 5 hours this time | 23:19 |
anteaya | fungi: anything besides you optimisim in support of that possibility? | 23:19 |
anteaya | your | 23:19 |
SpamapS | fungi: is it CPU locked? | 23:20 |
SpamapS | Might be good to do these on a baremetal box if so | 23:20 |
*** vhosakot has quit IRC | 23:21 | |
*** tphummel has quit IRC | 23:24 | |
*** kdas__ has joined #openstack-infra | 23:25 | |
pleia2 | anteaya: for the storyboard one #15 we say update the db, but it seems I can rename it through the UI | 23:27 |
*** kdas__ has quit IRC | 23:27 | |
anteaya | pleia2: oh can you? | 23:27 |
pleia2 | not sure if we couldn't edit it that way before and noted the db, or if there's something else we need to do | 23:27 |
fungi | anteaya: pure optimism i'm afraid | 23:28 |
anteaya | pleia2: perhaps use the gui first then check the db and see what it says? | 23:28 |
anteaya | fungi: go go pure optimism | 23:28 |
anteaya | fungi: I love your optimism | 23:28 |
pleia2 | I wouldn't even know where to begin with the db :) | 23:28 |
pleia2 | could poke around, but if it's something specific I'd likely miss it | 23:28 |
anteaya | when I need some I picture myself standing beside you and then I feel better | 23:28 |
anteaya | pleia2: hmmm, I don't know then | 23:29 |
anteaya | pleia2: I wonder if fungi has any thoughts on the storyboard rename bit | 23:29 |
fungi | SpamapS: it seems to be mostly single-cpu bound (whatever its parallelism scheme is, it's not great... maybe split by project?) | 23:29 |
pleia2 | anteaya: ok, I'll rename through the UI first then, we'll figure it out if something else needs to be edited | 23:29 |
anteaya | pleia2: sound good, thank you | 23:30 |
fungi | SpamapS: zaro is working on a solution to allow us to use an online background reindexing feature in gerrit for this in the future, at least | 23:30 |
fungi | pleia2: go for the gui--i think that feature didn't exist when we added that item in the instructions | 23:31 |
anteaya | awesome | 23:31 |
fungi | pleia2: though the schema is simple--there's just one table with a name to integer index mapping for projects anyway | 23:32 |
pleia2 | fungi: ah, that's good | 23:32 |
*** tphummel has joined #openstack-infra | 23:33 | |
anteaya | I think I'm going to grab some dinner since we are here for another few hours anyway | 23:33 |
fungi | SpamapS: yeah, it's sad... top shows 16 cpus on this server, 15 of which are sitting idle and 1 which is slammed | 23:33 |
zaro | SpamapS: yeah, wasn't able to get that feature onto our gerrit this time around but probably next time | 23:34 |
zaro | this is why reindex is slow https://groups.google.com/d/msg/repo-discuss/Ux6mr9jvuUA/oTs623GiBAAJ | 23:34 |
*** EricGonczer_ has quit IRC | 23:34 | |
fungi | ahh, yep. that was my guess | 23:35 |
*** EricGonczer_ has joined #openstack-infra | 23:35 | |
*** tphummel has quit IRC | 23:35 | |
*** EricGonczer_ has quit IRC | 23:35 | |
fungi | explains why it goes more quickly at first but then when we get down to the last dozen or so projects it starts to slow considerably | 23:35 |
fungi | if it prioritized the project order by decreasing number of changes then it would do a much better job of maximizing the scheduling | 23:36 |
*** mtanino has quit IRC | 23:37 | |
*** EricGonczer_ has joined #openstack-infra | 23:37 | |
*** EricGonczer_ has quit IRC | 23:38 | |
*** xarses has quit IRC | 23:39 | |
*** EricGonczer_ has joined #openstack-infra | 23:41 | |
zaro | fungi: i don't see how that would make it any faster? | 23:41 |
*** weshay has quit IRC | 23:41 | |
*** Swami has quit IRC | 23:41 | |
fungi | zaro: at least with a large number of projects of varying change count like we have now, it would be utilizing all available processors all the way up to the end | 23:43 |
*** gyee has quit IRC | 23:43 | |
*** flaviof has joined #openstack-infra | 23:43 | |
*** rhochmuth has quit IRC | 23:44 | |
fungi | nova gets scheduled to cpu 0, neutron on cpu 1, cinder on cpu 2, glance on cpu 3... glance will finish before the others and cpu 3 will move on to horizon, then cinder will finish and cpu 2 will move on to ironic... | 23:44 |
*** EricGonczer_ has quit IRC | 23:45 | |
fungi | nova's still churning on 0 and neutron on 1 possibly for most of the duration, but the other cpus are getting scheduled faster and faster projects to complete as the situation progresses | 23:45 |
fungi | so if you still end up with only cpu 0 in use at the end it's because you eventually ran out of other projects to index, and the max time is however long it takes to process nova | 23:47 |
fungi | but if instead nova gets saved until near the end of the project list... then it's however long it took to index the other projects _plus_ how long it took to index nova | 23:48 |
*** ffrank has quit IRC | 23:48 | |
*** roxanaghe has quit IRC | 23:49 | |
fungi | Reindexing changes: projects: 99% (1043/1044), 98% (317401/322853) | 23:50 |
zaro | i see what mean, that may help. i think it's alpha order now. | 23:50 |
zaro | here's the disussion on possible ways to improve, maybe post your idea? https://groups.google.com/d/msg/repo-discuss/lzv_vvcOaKQ/iEcs5eFHBAAJ | 23:51 |
zaro | fungi: while we are on the topic. | 23:52 |
zaro | fungi: i'm wondering how we should test the forcing of online reindex? | 23:52 |
*** rguillebert has quit IRC | 23:53 | |
*** johnthetubaguy has quit IRC | 23:53 | |
*** johnthetubaguy has joined #openstack-infra | 23:53 | |
*** evgenyl has quit IRC | 23:53 | |
zaro | i don't think anybody else has done it maybe beside the guys at Gerritforge | 23:53 |
*** rguillebert has joined #openstack-infra | 23:54 | |
zaro | i'm slightly concerned that it might do something bad. | 23:54 |
*** banix has joined #openstack-infra | 23:55 | |
*** evgenyl has joined #openstack-infra | 23:55 | |
fungi | zaro: just replied to that thread (it's awaiting moderation now). thanks for the suggestion | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!