| bknudson_ | gerrit goes to sleep for a few minutes | 00:03 |
|---|---|---|
| anteaya | bknudson_: how do you mean? | 00:05 |
| bknudson_ | anteaya: it took 2 minutes to post a change. happens at 0 UTC | 00:06 |
| anteaya | bknudson_: backup time | 00:08 |
| *** piet has quit IRC | 00:09 | |
| *** gordc has quit IRC | 00:10 | |
| *** ddieterly has quit IRC | 00:11 | |
| *** otter768 has joined #openstack-infra | 00:13 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure Gerrit diff timeout options https://review.openstack.org/263485 | 00:13 |
| *** asselin_ has joined #openstack-infra | 00:15 | |
| asselin_ | Thelo, double check your configuration setting for ssh access | 00:17 |
| *** bharathm_ has joined #openstack-infra | 00:17 | |
| *** bharathm has quit IRC | 00:17 | |
| *** otter768 has quit IRC | 00:18 | |
| Thelo | I just did | 00:19 |
| Thelo | now I am having issue to restart nodepool | 00:19 |
| Thelo | somehow it does not start | 00:19 |
| asselin_ | Thelo, you using the nodepool user? anything in the log file? | 00:20 |
| *** kzaitsev_mb has quit IRC | 00:20 | |
| lifeless | hello infra! looks like we're going to want to do a 0.11.1 release of pbr, because kilo :/. But we have no branch for kilo. Whats the best way to get one (either called feature/0.11, like our 0.10 branch, or stable/kilo - either is fine IMO) | 00:20 |
| *** bharathm_ has quit IRC | 00:22 | |
| Thelo | asselin_: Yes ( http://paste.openstack.org/show/482989/) | 00:22 |
| *** bharathm has joined #openstack-infra | 00:22 | |
| *** bharathm has quit IRC | 00:22 | |
| openstackgerrit | melanie witt proposed openstack-infra/elastic-recheck: Remove query for bug 1501435 https://review.openstack.org/263488 | 00:22 |
| openstack | bug 1501435 in python-novaclient "osc 1.7 no longer can boot a server from volume" [Critical,Fix released] https://launchpad.net/bugs/1501435 - Assigned to melanie witt (melwitt) | 00:22 |
| *** bharathm has joined #openstack-infra | 00:23 | |
| *** ashleighfarnham has quit IRC | 00:23 | |
| jhesketh | jeblair: so noting the zuul github work has come out of WIP... is that something we want in parallel to v3? I feel like there's been a lot of work there and we should consider merging it sooner rather than later | 00:23 |
| asselin_ | Thelo, that's usually because of a config file issue. Look at the command being run by the service and run it manually as non-daemon and you should be able to get the error | 00:24 |
| *** hdd has quit IRC | 00:25 | |
| asselin_ | Thelo, I think it's -d optino | 00:25 |
| mordred | jhesketh, jeblair: I think it would be useful for other things if it existed - but I do not know what the impact on v3 is/would be | 00:25 |
| jeblair | jhesketh: i wasn't planning on looking at it until after v3; it's a slippery slope which is why i decided 6 months ago that the connections stuff is where i'd draw the line | 00:25 |
| *** Qiming has joined #openstack-infra | 00:25 | |
| Thelo | asselin_: How can I know the command, the logs print nothing | 00:26 |
| *** Swami_ has quit IRC | 00:26 | |
| jeblair | (i'm keen on the idea, just have to draw the line somewhere) | 00:26 |
| jhesketh | agreed... I guess it depends how far the reporters/triggers get refactored | 00:26 |
| jhesketh | maybe it'll be easy for it to come along for the v3 ride | 00:26 |
| asselin_ | Thelo, I believe you can find it in /etc/init.d/nodepool or a file there. That's what service nodepool start calls itself. | 00:27 |
| jeblair | jhesketh: i'm hoping not a lot in spirit (even if we move the code around a bit, their basic inputs and outputs should be about the same i think, so hopefully it will be a smallish rebase) | 00:27 |
| *** bhunter71 has quit IRC | 00:27 | |
| asselin_ | Thelo, also, I think you should be root to run it...I'm not sure nodepool user has sudo access | 00:28 |
| waynr | zaro: would you mind if I add you as a reviewer on the commits in https://review.openstack.org/#/q/topic:jjb-2.0.0-api ? also, I keep forgetting other JJB contributor's IRC nicks so who else should I ping here? | 00:28 |
| anteaya | waynr: https://review.openstack.org/#/admin/groups/194,members | 00:29 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Increase Gerrit's diff timeout https://review.openstack.org/263490 | 00:29 |
| *** sabeen3 has quit IRC | 00:30 | |
| waynr | anteaya: cool, thanks! | 00:30 |
| anteaya | welcome | 00:30 |
| anteaya | waynr: in the gerrit navigation at the top, people > list groups > enter group name (usually repo based) in search text field | 00:31 |
| *** rbrndt_ has quit IRC | 00:31 | |
| waynr | anteaya: huh, I only see 5 membes on that group, but when I try to add the group as a reviewer on the review it warns that there are 14 people in the group | 00:31 |
| waynr | oh right, it includes infra-core | 00:31 |
| anteaya | look at included groups | 00:31 |
| anteaya | yes | 00:31 |
| *** rbrndt_ has joined #openstack-infra | 00:32 | |
| *** Sukhdev has quit IRC | 00:32 | |
| waynr | would it be annoying if I added that whole group to each review in the topic? | 00:32 |
| *** dims has joined #openstack-infra | 00:33 | |
| *** dims_ has quit IRC | 00:34 | |
| openstackgerrit | Sachi King proposed openstack/requirements: Run Kilo with PBR latest https://review.openstack.org/263494 | 00:34 |
| rm_work | anyone aware of something funky with tempest changing recently that would cause "tempest_lib.exceptions.InvalidCredentials: Invalid Credentials" on everything? | 00:35 |
| Thelo | asselin_: when I run the command manually (start-stop-daemon --start --quiet --pidfile $PIDFILE -c $USER --exec $DAEMON --test ) I get the following message ( Would start /usr/local/bin/nodepoold (as user nodepool[1002], and group [1002]).), but still no deamon running | 00:36 |
| jhesketh | jeblair: yep, if that's the case though do we want to look at it merging sooner (realising this goes against the line in the sand) for two reasons. 1) There's a lot of work there so the less rebasing the better, and by having it in tree it'll make v3 more concious of changes that would make the rebasing difficult. 2) it's a feature some may like to use | 00:36 |
| jhesketh | (I'm leaning towards sticking with the line in the sand and waiting to post v3 fwiw) | 00:37 |
| asselin_ | Thelo, I think it's the next line. This one is --test | 00:38 |
| asselin_ | but you don't want to use the start-stop-daemon | 00:38 |
| asselin_ | you want to run it outside of daemon context. so it would be /usr/local/bin/nodepoold with the args specified in that file | 00:38 |
| rm_work | ... is there a tempest channel? | 00:39 |
| JayF | rm_work: probably #openstack-qa | 00:39 |
| rm_work | thanks | 00:39 |
| anteaya | waynr: I would find that annoying | 00:43 |
| *** tzn has joined #openstack-infra | 00:43 | |
| *** jpr has joined #openstack-infra | 00:44 | |
| *** bharathm has quit IRC | 00:48 | |
| *** zz_dimtruck is now known as dimtruck | 00:49 | |
| *** tzn has quit IRC | 00:50 | |
| openstackgerrit | kevin proposed openstack-infra/project-config: New Project - jacket https://review.openstack.org/263500 | 00:51 |
| waynr | anteaya: yeah I just added a comment to the first commit indicating that there are other commits to follow | 00:52 |
| openstackgerrit | Merged openstack-infra/shade: Normalize server objects https://review.openstack.org/262627 | 00:52 |
| anteaya | waynr: okay | 00:52 |
| waynr | i guess y'all are pretty savvy with this gerrit review thing and would realize that anyway | 00:53 |
| anteaya | it appears that 263500 is a repo proposed to be for other drivers, which doesn't make a whole lot of sense to me | 00:53 |
| anteaya | waynr: using the same topic for a series is very helpful | 00:53 |
| anteaya | waynr: and if the commits are children of a parent commit, gerrit tells us that, so does gertty | 00:54 |
| waynr | yeah these are all jjb-2.0.0-api topic | 00:54 |
| anteaya | a common topic makes them easy to find | 00:54 |
| anteaya | as a group | 00:54 |
| waynr | yeah i really like that about gerrit, makes it easy to see related changes across projects | 00:56 |
| *** eil397 has quit IRC | 00:57 | |
| anteaya | the gerrit devs work hard at creating multiple ways for patches to be grouped and discovered, it is true | 00:57 |
| *** baoli has joined #openstack-infra | 01:00 | |
| *** ybathia has quit IRC | 01:04 | |
| *** ybathia has joined #openstack-infra | 01:04 | |
| *** baoli has quit IRC | 01:06 | |
| *** mtanino has quit IRC | 01:08 | |
| *** eliqiao has quit IRC | 01:12 | |
| *** eliqiao has joined #openstack-infra | 01:13 | |
| anteaya | 163.com appears to be Korean gmail | 01:14 |
| *** pvaneck has quit IRC | 01:15 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Show toggle CI button for Gerrit URLs with patch set ranges https://review.openstack.org/261110 | 01:16 |
| *** fawadkhaliq has quit IRC | 01:18 | |
| mordred | Shrews: yay! the normalize patch landed! | 01:18 |
| *** Sukhdev has joined #openstack-infra | 01:18 | |
| dahoo | anteaya: it is chinese | 01:19 |
| anteaya | dahoo: ah thank you | 01:19 |
| Shrews | mordred: yeah. left a comment about a followup that is non-urgent | 01:19 |
| anteaya | google translate led me astray | 01:19 |
| mordred | Shrews: thanks for mentioning - I nevr would see that comment otherwise now that it's landed | 01:20 |
| mordred | but I have now seen it | 01:20 |
| dahoo | anteaya: could you help me with the gerrit web login issue | 01:20 |
| dahoo | anteaya: openid doesn't work. i can login to review-dev.o.o though | 01:21 |
| *** otter768 has joined #openstack-infra | 01:21 | |
| anteaya | well I think clarkb was helping you earlier | 01:21 |
| anteaya | and as far as I could tell following along, I had thought you were able to remember your password and log in | 01:22 |
| anteaya | is that not the case? | 01:22 |
| dahoo | clarkb: could you think of other cause to the openid issue with gerrit | 01:22 |
| dahoo | anteaya: ssh worked, but not openid | 01:22 |
| anteaya | oh I had thought you had gotten into your account | 01:23 |
| dahoo | anteaya: unfortunately no | 01:23 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to set Gerrit sshd options to control connections https://review.openstack.org/262820 | 01:24 |
| dahoo | anteaya: did gerrit change to a new server also? | 01:24 |
| dahoo | anteaya: i noticed the fingerprint changed | 01:24 |
| anteaya | no we upgraded gerrit in place | 01:24 |
| *** sputnik13_ has quit IRC | 01:24 | |
| anteaya | we used the same server as we had been using | 01:25 |
| anteaya | we did change the server last spring | 01:25 |
| anteaya | when we upgraded the operating system | 01:25 |
| Thelo | Hi, I get an import error in nodepool. is anyone familiar with that (http://paste.openstack.org/show/482994/) | 01:27 |
| anteaya | dahoo: http://lists.openstack.org/pipermail/openstack-infra/2015-February/002425.html | 01:28 |
| openstackgerrit | Spencer Krum proposed openstack-infra/shade: Allow inventory filering by cloud name https://review.openstack.org/263513 | 01:29 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit's sshd.batchThreads option https://review.openstack.org/262053 | 01:29 |
| *** ybathia has quit IRC | 01:31 | |
| *** otter768 has quit IRC | 01:31 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/shade: Allow inventory filering by cloud name https://review.openstack.org/263513 | 01:33 |
| *** dimtruck is now known as zz_dimtruck | 01:34 | |
| *** asselin_ has quit IRC | 01:34 | |
| *** piet has joined #openstack-infra | 01:36 | |
| *** weshay has quit IRC | 01:36 | |
| *** Liuqing has joined #openstack-infra | 01:37 | |
| Thelo | Does anyone know how nodepool connect to a node? I guess through the private key defined in nodepool.yaml, however when I check the vm I see that it does not have any key. | 01:41 |
| pleia2 | Thelo: have you seen the nodepool docs? they may be helpful to you :) http://docs.openstack.org/infra/nodepool/ | 01:43 |
| * mordred is excited to see nibalizer shade patch | 01:43 | |
| *** claudiub has quit IRC | 01:44 | |
| *** amotoki has quit IRC | 01:45 | |
| anteaya | nibalizer does cast a large shadow it is true | 01:45 |
| nibalizer | mordred: its wip because I don't know how to write tests for it yet | 01:45 |
| *** tzn has joined #openstack-infra | 01:46 | |
| nibalizer | but Shrews has agreed to help me with that tomorrow | 01:46 |
| *** sam_wan has joined #openstack-infra | 01:49 | |
| *** tlian has quit IRC | 01:49 | |
| *** thorst has joined #openstack-infra | 01:49 | |
| *** thorst_ has joined #openstack-infra | 01:51 | |
| mordred | woot! | 01:51 |
| *** piet has quit IRC | 01:53 | |
| *** thorst has quit IRC | 01:53 | |
| *** piet has joined #openstack-infra | 01:54 | |
| *** piet has quit IRC | 01:54 | |
| *** piet has joined #openstack-infra | 01:55 | |
| *** tlian has joined #openstack-infra | 01:56 | |
| Thelo | pleia2: Thanks, I see that I need to specify the private key, however I don't see where I should specify the public key | 01:59 |
| *** fawadkhaliq has joined #openstack-infra | 02:00 | |
| *** bpokorny_ has joined #openstack-infra | 02:00 | |
| *** ddieterly has joined #openstack-infra | 02:02 | |
| *** sridhar_ram has quit IRC | 02:02 | |
| *** bpokorny has quit IRC | 02:03 | |
| *** zz_dimtruck is now known as dimtruck | 02:04 | |
| *** bpokorny_ has quit IRC | 02:05 | |
| openstackgerrit | kevin proposed openstack-infra/project-config: New Project - jacket https://review.openstack.org/263500 | 02:05 |
| *** zhurong has joined #openstack-infra | 02:09 | |
| *** gsagie has quit IRC | 02:14 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack-infra/shade: correct rpmlint errors https://review.openstack.org/263526 | 02:15 |
| *** baoli has joined #openstack-infra | 02:16 | |
| *** rfolco_ has joined #openstack-infra | 02:18 | |
| *** rfolco_ has quit IRC | 02:18 | |
| *** baoli has quit IRC | 02:18 | |
| *** baoli has joined #openstack-infra | 02:18 | |
| *** unicell has joined #openstack-infra | 02:18 | |
| *** tzn has quit IRC | 02:19 | |
| *** unicell has quit IRC | 02:20 | |
| *** hdd has joined #openstack-infra | 02:21 | |
| lifeless | mordred: so ping | 02:22 |
| *** dims has quit IRC | 02:25 | |
| *** gsagie has joined #openstack-infra | 02:27 | |
| *** thorst_ has quit IRC | 02:27 | |
| *** unicell has joined #openstack-infra | 02:28 | |
| *** thorst has joined #openstack-infra | 02:28 | |
| *** baoli has quit IRC | 02:28 | |
| *** unicell1 has joined #openstack-infra | 02:28 | |
| *** unicell has quit IRC | 02:28 | |
| *** thorst has quit IRC | 02:29 | |
| *** thorst has joined #openstack-infra | 02:29 | |
| *** amuller has quit IRC | 02:31 | |
| openstackgerrit | Merged openstack-infra/zuul: Disable most tests https://review.openstack.org/255019 | 02:34 |
| *** Sukhdev has quit IRC | 02:34 | |
| openstackgerrit | Merged openstack/requirements: Bump notifier up to 1.0.3 https://review.openstack.org/256900 | 02:36 |
| openstackgerrit | Merged openstack-infra/zuul: Add tenants https://review.openstack.org/254457 | 02:45 |
| *** dims has joined #openstack-infra | 02:46 | |
| *** dimtruck is now known as zz_dimtruck | 02:47 | |
| *** zz_dimtruck is now known as dimtruck | 02:48 | |
| openstackgerrit | Merged openstack-infra/zuul: Update the test config with a function https://review.openstack.org/255413 | 02:49 |
| *** jyuso1 has joined #openstack-infra | 02:50 | |
| *** dimtruck is now known as zz_dimtruck | 02:55 | |
| *** zz_dimtruck is now known as dimtruck | 02:56 | |
| *** dimtruck is now known as zz_dimtruck | 03:00 | |
| *** zz_dimtruck is now known as dimtruck | 03:06 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/requirements: Keep py3.X compatibility for urllib https://review.openstack.org/261190 | 03:09 |
| openstackgerrit | Merged openstack-infra/zuul: Merge configurations with multiple layout files https://review.openstack.org/255414 | 03:09 |
| *** tlian has quit IRC | 03:10 | |
| *** dims has quit IRC | 03:14 | |
| *** tlian has joined #openstack-infra | 03:15 | |
| *** tzn has joined #openstack-infra | 03:16 | |
| *** darvon has quit IRC | 03:18 | |
| *** piet has quit IRC | 03:19 | |
| *** Qiming has quit IRC | 03:21 | |
| *** piet has joined #openstack-infra | 03:26 | |
| *** pcrews has quit IRC | 03:29 | |
| *** pcrews has joined #openstack-infra | 03:30 | |
| *** otter768 has joined #openstack-infra | 03:32 | |
| *** yamahata has quit IRC | 03:33 | |
| *** hdd has quit IRC | 03:33 | |
| *** signed8bit has joined #openstack-infra | 03:35 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/devstack-gate: Update README.rst on how users can reproduce gate issues https://review.openstack.org/263548 | 03:35 |
| *** Qiming has joined #openstack-infra | 03:41 | |
| *** david-lyle_ has joined #openstack-infra | 03:49 | |
| *** tzn has quit IRC | 03:49 | |
| *** bharathm has joined #openstack-infra | 03:50 | |
| *** Sukhdev has joined #openstack-infra | 03:50 | |
| *** links has joined #openstack-infra | 03:52 | |
| *** tlian has quit IRC | 03:52 | |
| *** bharathm has quit IRC | 03:54 | |
| *** amotoki has joined #openstack-infra | 03:54 | |
| *** unicell1 has quit IRC | 03:57 | |
| *** amotoki has quit IRC | 03:58 | |
| *** signed8bit has quit IRC | 03:59 | |
| *** amotoki has joined #openstack-infra | 03:59 | |
| *** apoorvad has joined #openstack-infra | 04:00 | |
| *** yamahata has joined #openstack-infra | 04:01 | |
| *** flepied has quit IRC | 04:01 | |
| *** asselin_ has joined #openstack-infra | 04:03 | |
| asselin_ | Thelo, http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/manifests/single_node_ci.pp#n46 | 04:05 |
| *** bpokorny has joined #openstack-infra | 04:08 | |
| *** appprod0 has left #openstack-infra | 04:09 | |
| openstackgerrit | Merged openstack-infra/zuul: Load in-repo configuration https://review.openstack.org/255601 | 04:09 |
| openstackgerrit | Merged openstack-infra/zuul: Remove stop method from reporters, sources, triggers https://review.openstack.org/256067 | 04:09 |
| openstackgerrit | Merged openstack-infra/zuul: Remove metajobs https://review.openstack.org/258197 | 04:09 |
| *** bpokorny has quit IRC | 04:10 | |
| *** bpokorny has joined #openstack-infra | 04:11 | |
| *** sam_wan has quit IRC | 04:20 | |
| *** hdd has joined #openstack-infra | 04:22 | |
| *** sam_wan has joined #openstack-infra | 04:22 | |
| *** armax has joined #openstack-infra | 04:22 | |
| *** piet has quit IRC | 04:24 | |
| *** harlowja_at_home has joined #openstack-infra | 04:27 | |
| *** thorst has quit IRC | 04:27 | |
| *** thorst has joined #openstack-infra | 04:28 | |
| *** aeng has quit IRC | 04:34 | |
| *** hdd has quit IRC | 04:34 | |
| oomichi | hi, I tried to release a new python library(tempest-lib 0.13.0) yesterday, but https://pypi.python.org/pypi/tempest-lib doesn't show it still now. | 04:35 |
| oomichi | http://tarballs.openstack.org/tempest-lib/ contains the tar file(tempest-lib-0.13.0.tar.gz), can someone help me? | 04:36 |
| *** thorst has quit IRC | 04:36 | |
| *** nelsnels_ has joined #openstack-infra | 04:40 | |
| openstackgerrit | João Vale proposed openstack-infra/jenkins-job-builder: Add view management functionality https://review.openstack.org/206178 | 04:40 |
| clarkb | oomichi: pull up the jobs logs for the sha1 of the tag at http://logs.openstack.org/first2charsofsha1/sha1 | 04:41 |
| *** tsg_ has quit IRC | 04:42 | |
| *** nelsnelson has quit IRC | 04:42 | |
| *** dahoo has quit IRC | 04:42 | |
| openstackgerrit | Merged openstack-infra/zuul: Add job inheritance and start refactoring https://review.openstack.org/258198 | 04:45 |
| *** tzn has joined #openstack-infra | 04:46 | |
| *** treaki__ has joined #openstack-infra | 04:46 | |
| oomichi | clarkb: the jobs logs is the operation log of `git push gerrit <tag number>` ? if so, I lost it because it happened yesterday.. | 04:47 |
| *** tzn has quit IRC | 04:50 | |
| *** treaki_ has quit IRC | 04:51 | |
| clarkb | oomichi: yes, you can get those logs from the url I showed you | 04:52 |
| clarkb | you just have to replace the sha1 | 04:53 |
| oomichi | clarkb: thanks, will try it | 04:53 |
| *** fawadkhaliq has quit IRC | 04:54 | |
| *** fawadkhaliq has joined #openstack-infra | 04:55 | |
| *** asselin_ has quit IRC | 04:57 | |
| *** asselin_ has joined #openstack-infra | 04:58 | |
| *** ddieterly has quit IRC | 05:01 | |
| clarkb | oomichi: http://logs.openstack.org/f0/f0b44f3e4292353b186ee3b32d9b89f9bfe9d894/release/tempest-lib-pypi-both-upload/92ab2a5/console.html | 05:01 |
| *** signed8bit has joined #openstack-infra | 05:01 | |
| clarkb | oomichi: pypi errored | 05:01 |
| clarkb | once we know pypi is working again we can reschedule the upload job | 05:01 |
| oomichi | clarkb: thanks! | 05:02 |
| oomichi | clarkb: this kind of thing happens usually? | 05:02 |
| clarkb | I don't think so | 05:03 |
| *** PsionTheory has quit IRC | 05:03 | |
| oomichi | clarkb: ok, I was unlucky | 05:03 |
| oomichi | clarkb: thanks anyways :) | 05:04 |
| *** Liuqing has quit IRC | 05:05 | |
| *** zhurong has quit IRC | 05:05 | |
| *** zhurong has joined #openstack-infra | 05:05 | |
| *** Liuqing has joined #openstack-infra | 05:06 | |
| *** signed8__ has joined #openstack-infra | 05:06 | |
| *** Sukhdev has quit IRC | 05:07 | |
| *** Sukhdev has joined #openstack-infra | 05:09 | |
| *** signed8bit has quit IRC | 05:09 | |
| *** david-lyle_ has quit IRC | 05:09 | |
| *** sdake has quit IRC | 05:10 | |
| *** Sukhdev has quit IRC | 05:11 | |
| *** Ramanjaneya has joined #openstack-infra | 05:12 | |
| *** Sukhdev has joined #openstack-infra | 05:13 | |
| *** otter768 has quit IRC | 05:16 | |
| *** dahoo has joined #openstack-infra | 05:18 | |
| *** Sukhdev has quit IRC | 05:20 | |
| *** Sukhdev has joined #openstack-infra | 05:21 | |
| *** abregman has joined #openstack-infra | 05:23 | |
| *** aeng has joined #openstack-infra | 05:24 | |
| *** julim has joined #openstack-infra | 05:24 | |
| *** piet has joined #openstack-infra | 05:30 | |
| *** nikil89_ has joined #openstack-infra | 05:31 | |
| *** unicell has joined #openstack-infra | 05:34 | |
| *** thorst has joined #openstack-infra | 05:34 | |
| *** Thelo has quit IRC | 05:35 | |
| *** jaosorior has joined #openstack-infra | 05:37 | |
| *** Thelo has joined #openstack-infra | 05:38 | |
| *** harlowja_at_home has quit IRC | 05:39 | |
| *** nikil89_ is now known as naggappan | 05:39 | |
| *** bpokorny has quit IRC | 05:40 | |
| *** thorst has quit IRC | 05:42 | |
| *** signed8bit has joined #openstack-infra | 05:43 | |
| *** piet has quit IRC | 05:45 | |
| *** signed8__ has quit IRC | 05:46 | |
| *** tzn has joined #openstack-infra | 05:47 | |
| *** Sukhdev has quit IRC | 05:47 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/gearman-plugin: Use git.openstack.org https://review.openstack.org/262308 | 05:48 |
| *** apoorvad has quit IRC | 05:51 | |
| *** Liuqing has quit IRC | 05:51 | |
| *** tzn has quit IRC | 05:51 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/gearman-plugin: Remove broken scm section https://review.openstack.org/263566 | 05:55 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/gearman-plugin: Remove broken scm section https://review.openstack.org/263566 | 05:56 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zmq-event-publisher: Remove broken scm section https://review.openstack.org/263568 | 05:58 |
| *** sputnik13 has joined #openstack-infra | 05:59 | |
| *** signed8bit has quit IRC | 05:59 | |
| *** sputnik13 has quit IRC | 06:01 | |
| *** gyee has quit IRC | 06:01 | |
| *** ddieterly has joined #openstack-infra | 06:02 | |
| *** coolsvap|away is now known as coolsvap | 06:02 | |
| *** jaosorior has quit IRC | 06:05 | |
| *** sputnik13 has joined #openstack-infra | 06:06 | |
| *** ddieterly has quit IRC | 06:07 | |
| *** sputnik13 has quit IRC | 06:09 | |
| *** unicell has quit IRC | 06:11 | |
| *** unicell has joined #openstack-infra | 06:14 | |
| *** coolsvap is now known as coolsvap|away | 06:17 | |
| *** coolsvap|away is now known as coolsvap | 06:20 | |
| openstackgerrit | Einst Crazy proposed openstack-infra/zuul: Use assertTrue/False instead of assertEqual(T/F) https://review.openstack.org/263575 | 06:22 |
| *** ildikov_afk is now known as ildikov | 06:22 | |
| *** sputnik13 has joined #openstack-infra | 06:23 | |
| *** sputnik13 has quit IRC | 06:24 | |
| *** hdd has joined #openstack-infra | 06:25 | |
| *** jaosorior has joined #openstack-infra | 06:26 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/263576 | 06:26 |
| *** hdd has quit IRC | 06:29 | |
| *** flepied has joined #openstack-infra | 06:32 | |
| *** MarkAtwood has quit IRC | 06:32 | |
| dougwig | pabelanger: have you gotten any reports of the apscheduler bump in zuul causing issues? i just spent the day figuring out why my zuul was hanging at start, and it narrowed down to that. | 06:38 |
| *** thorst has joined #openstack-infra | 06:39 | |
| *** aopincar has joined #openstack-infra | 06:46 | |
| *** thorst has quit IRC | 06:47 | |
| *** tzn has joined #openstack-infra | 06:47 | |
| *** dizquierdo has joined #openstack-infra | 06:48 | |
| *** apoorvad has joined #openstack-infra | 06:51 | |
| *** tzn has quit IRC | 06:52 | |
| *** unicell1 has joined #openstack-infra | 06:53 | |
| *** unicell has quit IRC | 06:54 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/263592 | 06:59 |
| *** apoorvad has quit IRC | 06:59 | |
| *** ddieterly has joined #openstack-infra | 07:04 | |
| *** ddieterly has quit IRC | 07:09 | |
| openstackgerrit | Qiming Teng proposed openstack/requirements: Bump python-senlinclient version to 0.2.1 https://review.openstack.org/263598 | 07:10 |
| openstackgerrit | Alexandre Viau proposed openstack-dev/pbr: exclude from files in _find_git_files https://review.openstack.org/263297 | 07:13 |
| *** otter768 has joined #openstack-infra | 07:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/263576 | 07:19 |
| *** otter768 has quit IRC | 07:22 | |
| *** oomichi has quit IRC | 07:24 | |
| *** dahoo has quit IRC | 07:29 | |
| *** Hal has joined #openstack-infra | 07:32 | |
| *** Hal is now known as Guest75250 | 07:32 | |
| *** irenab has quit IRC | 07:34 | |
| *** flepied has quit IRC | 07:35 | |
| *** e0ne has joined #openstack-infra | 07:43 | |
| *** salv-orlando has joined #openstack-infra | 07:44 | |
| *** nmagnezi has joined #openstack-infra | 07:44 | |
| *** flepied has joined #openstack-infra | 07:47 | |
| *** tzn has joined #openstack-infra | 07:48 | |
| *** samuelBartel has joined #openstack-infra | 07:52 | |
| *** _nadya_ has joined #openstack-infra | 07:52 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Split puppet installation into its own element https://review.openstack.org/198417 | 07:52 |
| *** tzn has quit IRC | 07:53 | |
| *** _nadya_ has quit IRC | 07:53 | |
| *** aopincar has quit IRC | 07:53 | |
| *** apoorvad has joined #openstack-infra | 07:56 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Split puppet installation into its own element https://review.openstack.org/198417 | 07:58 |
| *** coolsvap is now known as coolsvap|away | 08:00 | |
| *** salv-orl_ has joined #openstack-infra | 08:01 | |
| *** apoorvad has quit IRC | 08:02 | |
| *** jtomasek has joined #openstack-infra | 08:02 | |
| *** ddieterly has joined #openstack-infra | 08:04 | |
| *** salv-orlando has quit IRC | 08:05 | |
| *** salv-orl_ has quit IRC | 08:05 | |
| *** irenab has joined #openstack-infra | 08:06 | |
| *** ifarkas has joined #openstack-infra | 08:07 | |
| *** markus_z has joined #openstack-infra | 08:08 | |
| *** ddieterly has quit IRC | 08:09 | |
| *** claudiub has joined #openstack-infra | 08:12 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove python3 checks from Dragonflow gate https://review.openstack.org/262981 | 08:15 |
| *** arxcruz has joined #openstack-infra | 08:22 | |
| *** sam_wan has quit IRC | 08:23 | |
| *** saggi has joined #openstack-infra | 08:23 | |
| saggi | Hi, we have the smaug meeting every two weeks on even weeks. This month there is a string of two odd weeks. Do we have the slot today (since it's been two weeks) or do we have it next week (since it's an odd week)? | 08:25 |
| *** sam_wan has joined #openstack-infra | 08:26 | |
| *** matrohon has joined #openstack-infra | 08:26 | |
| *** armax has quit IRC | 08:28 | |
| *** shardy has joined #openstack-infra | 08:33 | |
| *** mpaolino has joined #openstack-infra | 08:35 | |
| *** fhubik has joined #openstack-infra | 08:37 | |
| *** AJaeger has joined #openstack-infra | 08:37 | |
| AJaeger | saggi, there were some mails on the openstack-dev list about these odd weeks - and there's a calendar exported for your meeting on eavesdrop that should guide you | 08:38 |
| AJaeger | so, the meeting will be in the next even week | 08:38 |
| *** flepied has quit IRC | 08:42 | |
| *** fhubik is now known as fhubik_brb | 08:44 | |
| AJaeger | yolanda: happy new year! if you have time later for reviews, could you look at https://review.openstack.org/#/c/261828/ and https://review.openstack.org/261743 , please? | 08:45 |
| *** treaki__ has quit IRC | 08:45 | |
| *** treaki has joined #openstack-infra | 08:45 | |
| *** bexelbie_ has joined #openstack-infra | 08:47 | |
| *** bexelbie_ is now known as bexelbie | 08:48 | |
| *** dingyichen has quit IRC | 08:48 | |
| *** jlanoux has joined #openstack-infra | 08:48 | |
| *** thorst has joined #openstack-infra | 08:49 | |
| *** tzn has joined #openstack-infra | 08:49 | |
| saggi | AJaeger: The ics files[1] don't specify even\odd week so they say that we have a meeting today and Neutron next week and not the other way around. If you say our meeting is next week the ICS files should be fixed. http://eavesdrop.openstack.org/#Smaug_Project_Meeting | 08:50 |
| *** sfinucan has joined #openstack-infra | 08:52 | |
| *** tzn has quit IRC | 08:53 | |
| *** _nadya_ has joined #openstack-infra | 08:53 | |
| *** fawadkhaliq has quit IRC | 08:56 | |
| *** thorst has quit IRC | 08:56 | |
| *** _nadya_ has quit IRC | 08:58 | |
| *** fawadkhaliq has joined #openstack-infra | 08:59 | |
| *** hashar has joined #openstack-infra | 09:03 | |
| AJaeger | saggi: Read http://lists.openstack.org/pipermail/openstack-dev/2016-January/083216.html | 09:03 |
| *** ddieterly has joined #openstack-infra | 09:05 | |
| *** jordanP has joined #openstack-infra | 09:05 | |
| *** tzn has joined #openstack-infra | 09:05 | |
| *** femnad has joined #openstack-infra | 09:06 | |
| *** _nadya_ has joined #openstack-infra | 09:06 | |
| *** _nadya_ has quit IRC | 09:08 | |
| *** zeih has joined #openstack-infra | 09:08 | |
| *** thiagop has quit IRC | 09:09 | |
| *** ddieterly has quit IRC | 09:09 | |
| *** apoorvad has joined #openstack-infra | 09:10 | |
| *** apoorvad has quit IRC | 09:10 | |
| *** apoorvad has joined #openstack-infra | 09:10 | |
| yolanda | AJaeger, thanks for the review. I picked an old version of my patch to fix the rebase, so i repeated my typos | 09:11 |
| AJaeger | ;( | 09:12 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Split puppet installation into its own element https://review.openstack.org/198417 | 09:12 |
| AJaeger | Run git review -d XXX to download first next time ;) | 09:12 |
| yolanda | yep, clever advice :) | 09:13 |
| *** abregman has quit IRC | 09:13 | |
| odyssey4me | HNY yolanda :) if you have a moment, please help by doing the last review on https://review.openstack.org/263341 and https://review.openstack.org/263360 | 09:14 |
| odyssey4me | morning AJaeger :) | 09:14 |
| *** abregman has joined #openstack-infra | 09:14 | |
| *** flepied has joined #openstack-infra | 09:15 | |
| AJaeger | morning, odyssey4me | 09:15 |
| yolanda | hi odyssey4me, i'll take a look | 09:15 |
| *** kzaitsev_mb has joined #openstack-infra | 09:15 | |
| *** fhubik_brb is now known as fhubik | 09:16 | |
| *** coolsvap|away is now known as coolsvap | 09:17 | |
| *** otter768 has joined #openstack-infra | 09:18 | |
| *** tzn has quit IRC | 09:20 | |
| *** nihilifer has quit IRC | 09:20 | |
| *** jistr has joined #openstack-infra | 09:21 | |
| *** nihilifer has joined #openstack-infra | 09:21 | |
| *** hashar has quit IRC | 09:21 | |
| *** jcoufal has joined #openstack-infra | 09:22 | |
| *** zhurong has quit IRC | 09:22 | |
| *** otter768 has quit IRC | 09:22 | |
| *** kzaitsev_mb has quit IRC | 09:24 | |
| AJaeger | yolanda: did you see my request earlier for review as well? | 09:27 |
| yolanda | AJaeger, no , i was out | 09:27 |
| * yolanda is still on a long holiday | 09:27 | |
| yolanda | but i see now, just a sec | 09:27 |
| *** gampel has joined #openstack-infra | 09:29 | |
| AJaeger | yolanda: in that case: go back to your holiday! | 09:30 |
| AJaeger | yolanda: this can wait... | 09:31 |
| yolanda | i approved first one, for the second one i set a +2, but as I saw anteaya added some comments, i'd prefer to wait for her feedback to approve | 09:31 |
| AJaeger | yolanda: thanks! | 09:32 |
| openstackgerrit | Merged openstack-infra/project-config: Merge openstack-ansible skip-if to resolve conflict https://review.openstack.org/263360 | 09:32 |
| yolanda | no problem. I try to come back slow to reality, after that long period of holiday :) | 09:32 |
| openstackgerrit | Merged openstack-infra/project-config: Skip openstack-ansible-docs gate/post jobs for juno branch https://review.openstack.org/263341 | 09:33 |
| gampel | Hi all,I need help uploading the lost Smaug weekly meeting log due to my mis typing added space to the start; Can you please direct me to who could help me | 09:33 |
| *** jyuso1 has quit IRC | 09:33 | |
| AJaeger | gampel: any of the infra-roots can help you - best come back during US morning... | 09:33 |
| yolanda | hi gampel, if you have preserved the transcription somehow, you can send me and i can add it manually | 09:34 |
| gampel | yolanda: thx, I have preserved the log, whats your e-mail to send it ? | 09:35 |
| yolanda | send it to infra mailing list as an attach, i can pick it | 09:35 |
| *** devvesa has joined #openstack-infra | 09:35 | |
| gampel | yolanda: Thanks I will send it now | 09:36 |
| openstackgerrit | Merged openstack-infra/project-config: check that osc plugins do not break openstackclient https://review.openstack.org/261828 | 09:36 |
| *** apoorvad has quit IRC | 09:37 | |
| yolanda | cool | 09:39 |
| *** yaume has joined #openstack-infra | 09:40 | |
| nibalizer | hi yolanda AJaeger :) | 09:41 |
| *** fhubik is now known as fhubik_brb | 09:42 | |
| yolanda | hi nibalizer, how are you? | 09:42 |
| nibalizer | good | 09:42 |
| nibalizer | going to bed soon but figured I'd say hi | 09:42 |
| nibalizer | how was your holiday? | 09:42 |
| *** devvesa has left #openstack-infra | 09:42 | |
| yolanda | still enjoying the last 2 days. Very looong | 09:42 |
| *** jaosorior has quit IRC | 09:44 | |
| *** jaosorior has joined #openstack-infra | 09:44 | |
| *** nmagnezi has quit IRC | 09:45 | |
| *** thorst has joined #openstack-infra | 09:54 | |
| *** jaosorior has quit IRC | 09:56 | |
| *** zeih has quit IRC | 09:56 | |
| *** jaosorior has joined #openstack-infra | 09:56 | |
| *** fhubik_brb is now known as fhubik | 09:56 | |
| AJaeger | nibalizer: hi! | 09:57 |
| *** nmagnezi has joined #openstack-infra | 09:57 | |
| *** Guest75250 has quit IRC | 09:57 | |
| *** devvesa has joined #openstack-infra | 09:58 | |
| devvesa | Hi AJaeger | 09:58 |
| AJaeger | Hi devvesa | 09:58 |
| devvesa | It's about this comment: https://review.openstack.org/#/c/260093/2/gerrit/projects.yaml | 09:59 |
| devvesa | I understand that you don't want to push all the tags | 09:59 |
| devvesa | But we prefer to keep them in the original repo | 09:59 |
| AJaeger | devvesa: We will not delete your tags and branches in our imported version if you don't need them in the future - and we will not touch the original repo either ;) | 10:00 |
| devvesa | It is acceptable if I fork the midonet/puppet-midonet to my GitHub namespace and I remove the tags there | 10:00 |
| *** mdbooth has quit IRC | 10:00 | |
| devvesa | ? | 10:00 |
| AJaeger | devvesa: that'S what many do if they want to create a cleaned up repo for import | 10:00 |
| AJaeger | so, yes, perfectly fine. | 10:00 |
| devvesa | AJaeger: great. Thanks! | 10:01 |
| *** mdbooth has joined #openstack-infra | 10:01 | |
| *** rguillebert has joined #openstack-infra | 10:01 | |
| AJaeger | devvesa: you're welcome | 10:01 |
| *** thorst has quit IRC | 10:01 | |
| *** boris-42 has quit IRC | 10:03 | |
| *** ddieterly has joined #openstack-infra | 10:06 | |
| *** hashar has joined #openstack-infra | 10:07 | |
| AJaeger | devvesa: and then change gerrit/projects.yaml to point to the new repo | 10:08 |
| devvesa | AJaeger: Yup. On it | 10:08 |
| *** _nadya_ has joined #openstack-infra | 10:09 | |
| *** mdbooth_ has joined #openstack-infra | 10:09 | |
| *** yamahata has quit IRC | 10:10 | |
| *** mdbooth has quit IRC | 10:10 | |
| *** mdbooth_ is now known as mdbooth | 10:10 | |
| *** ddieterly has quit IRC | 10:10 | |
| *** yuanying has quit IRC | 10:11 | |
| *** yuanying has joined #openstack-infra | 10:11 | |
| *** isaacb has joined #openstack-infra | 10:14 | |
| *** _nadya_ has quit IRC | 10:14 | |
| *** tzn has joined #openstack-infra | 10:14 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder https://review.openstack.org/263349 | 10:14 |
| *** tzn has quit IRC | 10:14 | |
| *** tzn has joined #openstack-infra | 10:15 | |
| *** flepied has quit IRC | 10:15 | |
| *** Hal has joined #openstack-infra | 10:16 | |
| *** Hal is now known as Guest68862 | 10:17 | |
| openstackgerrit | Merged openstack/requirements: Remove oslo-incubator from projects.txt https://review.openstack.org/261148 | 10:17 |
| e0ne | hi team. I'm trying to add patch on review for a new project: http://paste.openstack.org/show/483011/ | 10:18 |
| e0ne | AJaeger: hi. could you please help me ^^ | 10:18 |
| *** mdbooth has quit IRC | 10:19 | |
| openstackgerrit | Timur Sufiev proposed openstack-infra/project-config: Use scripts from horizon repo in integration job test hooks https://review.openstack.org/263457 | 10:19 |
| *** flepied1 has joined #openstack-infra | 10:19 | |
| AJaeger | e0ne: that repo does not include a gitreview file ;( | 10:19 |
| AJaeger | e0ne: oh, it does... | 10:20 |
| openstackgerrit | Jaume Devesa proposed openstack-infra/project-config: Add puppet-midonet to OpenStack infrastructure https://review.openstack.org/260093 | 10:20 |
| e0ne | https://github.com/openstack/python-brick-cinderclient-ext/blob/master/.gitreview | 10:20 |
| *** zeih has joined #openstack-infra | 10:20 | |
| AJaeger | e0ne: it's broken, let me send a patch ;) | 10:20 |
| e0ne | AJaeger: ok, thanks for the help! | 10:21 |
| * e0ne waits for the patch link | 10:21 | |
| e0ne | oh.. we have to replace "brick-python-cinderclient-ext" with "python-brick-cinderclient-ext" in .gitreview | 10:22 |
| AJaeger | e0ne: git review -d 263662 ;git review -s and then start again... | 10:22 |
| AJaeger | e0ne: exactly - approve 263662 if you can ;) | 10:22 |
| AJaeger | or ask for cinder core review help | 10:23 |
| e0ne | AJaeger: thanks for the help. it was my mistake during on if the cycles of renames | 10:23 |
| *** Qiming has quit IRC | 10:23 | |
| AJaeger | this block everybody contributing to that repo... | 10:23 |
| AJaeger | e0ne: I suggest you ask for additional reviews yourself to push this through... | 10:24 |
| e0ne | AJaeger: yes, I'll ask somebody else to approve it | 10:24 |
| e0ne | once CI passed | 10:24 |
| *** sshnaidm_ has joined #openstack-infra | 10:25 | |
| AJaeger | e0ne: thanks | 10:25 |
| *** zeih has quit IRC | 10:25 | |
| *** mdbooth has joined #openstack-infra | 10:27 | |
| *** dtantsur|afk is now known as dtantsur | 10:28 | |
| *** yuanying has quit IRC | 10:28 | |
| *** yuanying has joined #openstack-infra | 10:29 | |
| *** abregman is now known as abregman|brb | 10:30 | |
| *** fhubik is now known as fhubik_brb | 10:31 | |
| *** zhurong has joined #openstack-infra | 10:33 | |
| *** abregman|brb is now known as abregman | 10:34 | |
| *** tzn has quit IRC | 10:35 | |
| *** mdbooth has quit IRC | 10:35 | |
| *** tzn has joined #openstack-infra | 10:35 | |
| *** tzn has quit IRC | 10:36 | |
| *** zeih has joined #openstack-infra | 10:38 | |
| *** apoorvad has joined #openstack-infra | 10:39 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:42 | |
| *** salv-orlando has joined #openstack-infra | 10:44 | |
| *** fhubik_brb is now known as fhubik | 10:44 | |
| *** dims has joined #openstack-infra | 10:47 | |
| *** masber has joined #openstack-infra | 10:55 | |
| *** yamamoto has joined #openstack-infra | 10:56 | |
| *** apoorvad has quit IRC | 10:57 | |
| *** samuelBartel has quit IRC | 10:58 | |
| *** thorst has joined #openstack-infra | 10:59 | |
| *** cdent has joined #openstack-infra | 11:02 | |
| *** kzaitsev_mb has quit IRC | 11:02 | |
| *** lucas-dinner is now known as lucasagomes | 11:03 | |
| *** yamamoto has quit IRC | 11:04 | |
| *** thorst has quit IRC | 11:06 | |
| *** ddieterly has joined #openstack-infra | 11:07 | |
| *** apoorvad has joined #openstack-infra | 11:07 | |
| *** apoorvad has quit IRC | 11:08 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: tooz: gate on etcd https://review.openstack.org/263678 | 11:09 |
| *** _nadya_ has joined #openstack-infra | 11:10 | |
| *** ddieterly has quit IRC | 11:11 | |
| *** salv-orlando has quit IRC | 11:13 | |
| *** salv-orlando has joined #openstack-infra | 11:14 | |
| *** _nadya_ has quit IRC | 11:15 | |
| *** yuanying has quit IRC | 11:15 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:15 | |
| *** salv-orlando has quit IRC | 11:16 | |
| *** salv-orlando has joined #openstack-infra | 11:17 | |
| *** salv-orlando has quit IRC | 11:18 | |
| *** BobBall has quit IRC | 11:18 | |
| *** otter768 has joined #openstack-infra | 11:19 | |
| *** salv-orlando has joined #openstack-infra | 11:20 | |
| *** salv-orl_ has joined #openstack-infra | 11:21 | |
| *** salv-orlando has quit IRC | 11:21 | |
| *** fhubik is now known as fhubik_brb | 11:22 | |
| *** salv-orl_ has quit IRC | 11:23 | |
| *** salv-orlando has joined #openstack-infra | 11:23 | |
| *** BobBall has joined #openstack-infra | 11:23 | |
| *** otter768 has quit IRC | 11:24 | |
| *** salv-orlando has quit IRC | 11:24 | |
| *** dimtruck is now known as zz_dimtruck | 11:25 | |
| *** salv-orlando has joined #openstack-infra | 11:26 | |
| *** zeih has quit IRC | 11:28 | |
| *** salv-orlando has quit IRC | 11:29 | |
| *** salv-orlando has joined #openstack-infra | 11:29 | |
| *** salv-orlando has quit IRC | 11:30 | |
| *** kzaitsev_mb has quit IRC | 11:31 | |
| *** Qiming has joined #openstack-infra | 11:31 | |
| *** salv-orlando has joined #openstack-infra | 11:32 | |
| *** salv-orlando has quit IRC | 11:35 | |
| *** daemontool has joined #openstack-infra | 11:35 | |
| *** salv-orlando has joined #openstack-infra | 11:36 | |
| *** dizquierdo has quit IRC | 11:39 | |
| *** sam_wan has quit IRC | 11:41 | |
| *** zeih has joined #openstack-infra | 11:42 | |
| *** tzn has joined #openstack-infra | 11:43 | |
| *** salv-orlando has quit IRC | 11:43 | |
| *** salv-orl_ has joined #openstack-infra | 11:43 | |
| *** ericksonsantos has joined #openstack-infra | 11:43 | |
| *** bradjones has joined #openstack-infra | 11:44 | |
| *** bradjones has quit IRC | 11:44 | |
| *** bradjones has joined #openstack-infra | 11:44 | |
| *** salv-orl_ has quit IRC | 11:46 | |
| *** yaume has quit IRC | 11:46 | |
| *** salv-orlando has joined #openstack-infra | 11:47 | |
| *** salv-orlando has quit IRC | 11:47 | |
| *** salv-orl_ has joined #openstack-infra | 11:51 | |
| *** salv-orl_ has quit IRC | 11:53 | |
| *** coolsvap is now known as coolsvap|away | 11:54 | |
| *** ihrachys has joined #openstack-infra | 11:55 | |
| *** salv-orl_ has joined #openstack-infra | 11:55 | |
| *** salv-orl_ has quit IRC | 11:56 | |
| *** salv-orlando has joined #openstack-infra | 11:57 | |
| *** salv-orlando has quit IRC | 11:58 | |
| *** mpaolino has quit IRC | 12:00 | |
| *** salv-orlando has joined #openstack-infra | 12:04 | |
| *** zz_dimtruck is now known as dimtruck | 12:04 | |
| *** thorst has joined #openstack-infra | 12:04 | |
| sdague | AJaeger: so zantana is going to strip out the authors now - https://review.openstack.org/#/c/252197/35/nova/locale/ja/LC_MESSAGES/nova.po ? | 12:05 |
| *** salv-orlando has quit IRC | 12:05 | |
| sdague | I just want to make sure all that looks like you expect before I approve it | 12:06 |
| AJaeger | let me double check, sdague | 12:06 |
| *** erlon has joined #openstack-infra | 12:06 | |
| *** Ramanjaneya has quit IRC | 12:07 | |
| *** ddieterly has joined #openstack-infra | 12:07 | |
| *** salv-orlando has joined #openstack-infra | 12:10 | |
| *** sfinucan has quit IRC | 12:10 | |
| *** sfinucan has joined #openstack-infra | 12:10 | |
| *** rhallisey has joined #openstack-infra | 12:11 | |
| *** thorst has quit IRC | 12:11 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Constraint based experimental jobs for neutron-vpnaas https://review.openstack.org/263398 | 12:12 |
| *** salv-orlando has quit IRC | 12:12 | |
| *** salv-orl_ has joined #openstack-infra | 12:12 | |
| *** ddieterly has quit IRC | 12:12 | |
| *** bexelbie has quit IRC | 12:12 | |
| *** salv-orl_ has quit IRC | 12:13 | |
| *** fhubik_brb is now known as fhubik | 12:13 | |
| AJaeger | sdague: let me investigate this a bit more - thanks for spotting this. | 12:13 |
| *** kushal has quit IRC | 12:14 | |
| *** fawadkhaliq has quit IRC | 12:15 | |
| AJaeger | sdague: I'll -1 the change and will ask StevenK and pleia2 for help via email... | 12:15 |
| *** dimtruck is now known as zz_dimtruck | 12:15 | |
| *** fawadkhaliq has joined #openstack-infra | 12:16 | |
| *** tzn has quit IRC | 12:16 | |
| sdague | ok | 12:17 |
| *** piet has joined #openstack-infra | 12:20 | |
| *** fhubik has quit IRC | 12:21 | |
| *** devvesa has quit IRC | 12:32 | |
| *** bexelbie has joined #openstack-infra | 12:36 | |
| bexelbie | join #centos-docs | 12:36 |
| openstackgerrit | Fausto Marzi proposed openstack-infra/project-config: Creation of a dedicated repo for API and media storage client https://review.openstack.org/255349 | 12:36 |
| *** rfolco has joined #openstack-infra | 12:39 | |
| *** gongysh has joined #openstack-infra | 12:40 | |
| *** andreykurilin__ has joined #openstack-infra | 12:40 | |
| *** aopincar has joined #openstack-infra | 12:42 | |
| *** piet has quit IRC | 12:42 | |
| openstackgerrit | Fausto Marzi proposed openstack-infra/project-config: Creation of a dedicated repo for API and media storage client https://review.openstack.org/255349 | 12:43 |
| *** trown|outttypeww is now known as trown | 12:43 | |
| *** piet has joined #openstack-infra | 12:44 | |
| *** salv-orlando has joined #openstack-infra | 12:47 | |
| *** fawadkhaliq has quit IRC | 12:47 | |
| *** thorst has joined #openstack-infra | 12:47 | |
| *** fawadkhaliq has joined #openstack-infra | 12:48 | |
| *** salv-orlando has quit IRC | 12:48 | |
| *** bexelbie has quit IRC | 12:51 | |
| *** devvesa has joined #openstack-infra | 12:51 | |
| *** kzaitsev_mb has joined #openstack-infra | 12:52 | |
| *** baoli has joined #openstack-infra | 12:53 | |
| *** dprince has joined #openstack-infra | 12:54 | |
| *** moravec has quit IRC | 12:54 | |
| *** aopincar has quit IRC | 12:55 | |
| *** moravec has joined #openstack-infra | 12:56 | |
| *** devvesa has quit IRC | 12:59 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Improve usability of the "New Board" modal https://review.openstack.org/263717 | 13:00 |
| *** bexelbie has joined #openstack-infra | 13:01 | |
| *** amuller has joined #openstack-infra | 13:02 | |
| *** piet has quit IRC | 13:04 | |
| *** zz_dimtruck is now known as dimtruck | 13:07 | |
| *** masber has quit IRC | 13:08 | |
| *** ddieterly has joined #openstack-infra | 13:08 | |
| *** mattt has joined #openstack-infra | 13:08 | |
| *** links has quit IRC | 13:10 | |
| openstackgerrit | Sean Dague proposed openstack-infra/elastic-recheck: ovh cirros crashing bug https://review.openstack.org/263722 | 13:11 |
| *** _nadya_ has joined #openstack-infra | 13:12 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add tests for stack search API https://review.openstack.org/259727 | 13:12 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Fix filtering in search_stacks() https://review.openstack.org/263724 | 13:12 |
| *** zhurong has quit IRC | 13:12 | |
| *** gordc has joined #openstack-infra | 13:12 | |
| *** ddieterly has quit IRC | 13:12 | |
| *** jpr has quit IRC | 13:15 | |
| *** _nadya_ has quit IRC | 13:16 | |
| *** dimtruck is now known as zz_dimtruck | 13:20 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Improve usability of the "New Worklist" modal https://review.openstack.org/263728 | 13:21 |
| *** amuller_ has joined #openstack-infra | 13:21 | |
| *** moravec has quit IRC | 13:22 | |
| *** hashar has quit IRC | 13:23 | |
| *** _amrith_ is now known as amrith | 13:24 | |
| *** samuelBartel has joined #openstack-infra | 13:24 | |
| *** piet has joined #openstack-infra | 13:24 | |
| *** moravec has joined #openstack-infra | 13:25 | |
| *** amuller has quit IRC | 13:25 | |
| *** edmondsw has joined #openstack-infra | 13:27 | |
| *** pradk has joined #openstack-infra | 13:27 | |
| *** pradk has quit IRC | 13:27 | |
| *** nmagnezi has quit IRC | 13:28 | |
| *** hashar has joined #openstack-infra | 13:29 | |
| *** kgiusti has joined #openstack-infra | 13:30 | |
| *** sdake has joined #openstack-infra | 13:31 | |
| *** kzaitsev_mb has quit IRC | 13:31 | |
| *** weshay_xchat has joined #openstack-infra | 13:34 | |
| *** weshay_xchat is now known as weshay | 13:34 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: ovh cirros crashing bug https://review.openstack.org/263722 | 13:36 |
| *** ddieterly has joined #openstack-infra | 13:41 | |
| *** moravec has quit IRC | 13:42 | |
| *** Daisy has joined #openstack-infra | 13:43 | |
| *** tzn has joined #openstack-infra | 13:44 | |
| *** nmagnezi has joined #openstack-infra | 13:44 | |
| *** shardy has quit IRC | 13:47 | |
| *** tlian has joined #openstack-infra | 13:48 | |
| *** tzn has quit IRC | 13:48 | |
| *** shardy has joined #openstack-infra | 13:49 | |
| *** mpaolino has joined #openstack-infra | 13:52 | |
| *** bcourt has joined #openstack-infra | 13:52 | |
| *** dtantsur is now known as dtantsur|brb | 13:54 | |
| *** bexelbie- has joined #openstack-infra | 13:55 | |
| *** bexelbie has quit IRC | 13:55 | |
| *** bexelbie- is now known as bexelbie | 13:55 | |
| *** tzn has joined #openstack-infra | 13:55 | |
| *** piet has quit IRC | 13:56 | |
| *** piet has joined #openstack-infra | 13:57 | |
| *** kushal has joined #openstack-infra | 14:00 | |
| *** lucasagomes is now known as lucas-hungry | 14:00 | |
| *** amotoki has quit IRC | 14:00 | |
| *** signed8bit has joined #openstack-infra | 14:01 | |
| *** Daisy has quit IRC | 14:02 | |
| *** dkranz has joined #openstack-infra | 14:02 | |
| *** dslev has joined #openstack-infra | 14:02 | |
| *** zz_dimtruck is now known as dimtruck | 14:04 | |
| *** fawadkhaliq has quit IRC | 14:04 | |
| yolanda | gampel, ping. This will be the first meeting for smaug? i don't see the folder created on eavesdrop | 14:04 |
| *** yaume has joined #openstack-infra | 14:06 | |
| *** signed8bit has quit IRC | 14:07 | |
| *** amuller_ is now known as amuller | 14:07 | |
| *** ddieterly has quit IRC | 14:07 | |
| *** kzaitsev_mb has joined #openstack-infra | 14:09 | |
| gampel | yolanda: yes thanks it was the first one | 14:11 |
| *** Anticimex has joined #openstack-infra | 14:11 | |
| *** signed8bit has joined #openstack-infra | 14:11 | |
| Anticimex | is there anyone around to help me change my gerrit (review.openstack.org) username? (created it before i understood it should === linux username) | 14:12 |
| AJaeger | Anticimex: it does not need to be the same as your linux username | 14:13 |
| AJaeger | Anticimex: please follow http://docs.openstack.org/infra/manual/developers.html#account-setup | 14:13 |
| Anticimex | fine, but i have conflicts due to other review.* systems, so i end up having to configure it manually per repo which is a hassle | 14:13 |
| *** devvesa has joined #openstack-infra | 14:14 | |
| *** sdake has quit IRC | 14:14 | |
| AJaeger | Anticimex: I have to leave now and can't help with that - but this is a one time setup per repo... | 14:14 |
| AJaeger | fungi, clarkb, could you review https://review.openstack.org/#/c/263678/ ? We removed etcd from our images and now they download it via a script, I like a review on that approach, please | 14:15 |
| *** Sukhdev has joined #openstack-infra | 14:15 | |
| Anticimex | AJaeger: ack, i guess i could just script "make me new openstack gerrit folder" | 14:16 |
| *** AJaeger has quit IRC | 14:16 | |
| *** krtaylor has joined #openstack-infra | 14:17 | |
| fungi | Anticimex: you can set per-destination-host default usernames in your ~/.ssh/config | 14:17 |
| Anticimex | fungi: now that's an excellent fix, i do that already.. great :) | 14:18 |
| fungi | yeah, just create a Host review.openstack.org section in there and tell it what your gerrit username is | 14:19 |
| *** woodster_ has joined #openstack-infra | 14:19 | |
| *** zeih has quit IRC | 14:21 | |
| *** ericksonsantos has quit IRC | 14:22 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/shade: Add normalize stack function for heat stack_list https://review.openstack.org/254337 | 14:23 |
| *** darvon has joined #openstack-infra | 14:24 | |
| *** links has joined #openstack-infra | 14:24 | |
| *** darvon has quit IRC | 14:25 | |
| *** darvon has joined #openstack-infra | 14:25 | |
| *** jsavak has joined #openstack-infra | 14:25 | |
| yolanda | gampel, i created here http://eavesdrop.openstack.org/meetings/smaug/2015/ | 14:26 |
| yolanda | naming and formatting may not be the best... | 14:26 |
| *** Sukhdev has quit IRC | 14:26 | |
| openstackgerrit | Monty Taylor proposed openstack-dev/pbr: Split changelog on nulls instead of ( https://review.openstack.org/263748 | 14:27 |
| *** Sukhdev has joined #openstack-infra | 14:27 | |
| pabelanger | dougwig: No reports yet. Do you have more details on the issue? | 14:27 |
| *** nmagnezi has quit IRC | 14:27 | |
| mordred | fungi: ^^ that pbr patch fixes a thing that's bugged me for quite a while | 14:27 |
| *** zeih has joined #openstack-infra | 14:28 | |
| *** Sukhdev has quit IRC | 14:29 | |
| *** dimtruck is now known as zz_dimtruck | 14:29 | |
| *** _nadya_ has joined #openstack-infra | 14:29 | |
| *** sdake has joined #openstack-infra | 14:30 | |
| *** kzaitsev_mb has quit IRC | 14:30 | |
| *** jsavak has quit IRC | 14:33 | |
| openstackgerrit | Monty Taylor proposed openstack-dev/pbr: Split changelog on nulls instead of ( https://review.openstack.org/263748 | 14:33 |
| *** sdake has quit IRC | 14:33 | |
| *** jsavak has joined #openstack-infra | 14:34 | |
| pabelanger | dougwig: trying to reproduce locally now | 14:34 |
| *** regXboi has joined #openstack-infra | 14:34 | |
| *** sdake has joined #openstack-infra | 14:34 | |
| *** esikachev has joined #openstack-infra | 14:35 | |
| gampel | yolanda: thank you very much | 14:37 |
| *** irenab has quit IRC | 14:39 | |
| *** denisra has joined #openstack-infra | 14:40 | |
| *** signed8b_ has joined #openstack-infra | 14:42 | |
| *** esikachev has quit IRC | 14:43 | |
| *** ddieterly has joined #openstack-infra | 14:43 | |
| *** dtantsur|brb is now known as dtantsur | 14:44 | |
| *** signed8bit has quit IRC | 14:45 | |
| *** moravec has joined #openstack-infra | 14:46 | |
| *** erlon has quit IRC | 14:46 | |
| *** Qiming has quit IRC | 14:48 | |
| *** mriedem_away is now known as mriedem | 14:48 | |
| Anticimex | fungi: so i've done the .ssh/config entry, but "git review -s" initialization in a repo overrides that with "git config --get gitreview.username" for its ssh'ing | 14:49 |
| isaacb | yolanda: Hi, can you please review: https://review.openstack.org/#/c/262466/ | 14:49 |
| *** links has quit IRC | 14:49 | |
| *** dkranz has quit IRC | 14:49 | |
| Anticimex | but i guess i can work around this by some git review args or just manually setting up the remote, thx again | 14:49 |
| *** dkranz has joined #openstack-infra | 14:50 | |
| *** hashar_ has joined #openstack-infra | 14:50 | |
| *** hashar has quit IRC | 14:53 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Improve usability of the "New Board" modal https://review.openstack.org/263717 | 14:53 |
| *** zz_dimtruck is now known as dimtruck | 14:53 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Improve usability of the "New Worklist" modal https://review.openstack.org/263728 | 14:54 |
| *** signed8b_ has quit IRC | 14:55 | |
| *** zeih has quit IRC | 14:57 | |
| *** ddieterl_ has joined #openstack-infra | 14:58 | |
| *** amitgandhinz has joined #openstack-infra | 14:58 | |
| *** jsavak has quit IRC | 15:00 | |
| *** jsavak has joined #openstack-infra | 15:01 | |
| *** ddieterly has quit IRC | 15:01 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:02 | |
| *** isaacb has quit IRC | 15:02 | |
| *** lucas-hungry is now known as lucasagomes | 15:05 | |
| *** jsavak has quit IRC | 15:06 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: Add neutron on-steroids job template for advanced features https://review.openstack.org/247697 | 15:06 |
| *** zeih has joined #openstack-infra | 15:06 | |
| *** fawadkhaliq has joined #openstack-infra | 15:07 | |
| *** peristeri has joined #openstack-infra | 15:08 | |
| fungi | Anticimex: if it's not possible to make git-review fall back on ssh's username default (and omit the username@ in its git remotes) then i'd consider that a bug worth fixing | 15:09 |
| EmilienM | nibalizer: on meeting-4 | 15:09 |
| EmilienM | nibalizer: 25-26-27 of January would work for you for the puppet sprint? | 15:09 |
| Anticimex | fungi: yeah, doesn't appear to work, but, git-openstack.sh to the rescue | 15:10 |
| Anticimex | fungi: git-review falls back on appending $USER if it doesn't get anything from the "git config --get gitreview.username" | 15:11 |
| pabelanger | dougwig: works for me. I'd be interested in hearing what issues you found | 15:11 |
| Anticimex | (which is clearly redundant...) | 15:11 |
| *** zeih has quit IRC | 15:12 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Improve usability of "Edit board" form https://review.openstack.org/263761 | 15:12 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Improve the usability of the "Edit project" form https://review.openstack.org/263762 | 15:13 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Bug fix: Cinder v2 returns bools now https://review.openstack.org/263764 | 15:14 |
| *** dizquierdo has joined #openstack-infra | 15:14 | |
| Shrews | mordred: ^^^ | 15:14 |
| *** eharney has joined #openstack-infra | 15:15 | |
| *** isaacb has joined #openstack-infra | 15:16 | |
| *** peristeri has quit IRC | 15:17 | |
| *** bhunter71 has joined #openstack-infra | 15:17 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Improve usability of the "Edit project" form https://review.openstack.org/263762 | 15:18 |
| *** ddieterl_ has quit IRC | 15:18 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Improve usability of the "Edit board" form https://review.openstack.org/263761 | 15:18 |
| *** Ramanjaneya has joined #openstack-infra | 15:18 | |
| *** otter768 has joined #openstack-infra | 15:20 | |
| *** wznoinsk has quit IRC | 15:21 | |
| amuller | quick Q - anyone remember offhand where's the bit of code that forbids direct 'sudo' usage (without rootwrap)? devstack-gate? | 15:21 |
| Anticimex | fungi: done: https://storyboard.openstack.org/#!/story/2000453 | 15:22 |
| *** gampel has quit IRC | 15:23 | |
| *** jsavak has joined #openstack-infra | 15:23 | |
| *** bexelbie has quit IRC | 15:23 | |
| *** bexelbie has joined #openstack-infra | 15:23 | |
| *** bcourt has quit IRC | 15:24 | |
| openstackgerrit | Sean Dague proposed openstack-infra/elastic-recheck: add bug for subnode failing to come up https://review.openstack.org/263769 | 15:25 |
| *** otter768 has quit IRC | 15:25 | |
| mordred | Shrews: woot | 15:26 |
| mordred | Shrews: in return, I just put up an OCC patch to add IBM Cloud | 15:26 |
| *** changbl has quit IRC | 15:27 | |
| fungi | amuller: yes, in devstack-vm-gate-wrap.sh it defaults DEVSTACK_GATE_REMOVE_STACK_SUDO to 1 and then uses that to decide whether devstack-vm-gate.sh should remove the /etc/sudoers.d/50_stack_sh file, but you should be able to pass in a 0 if you need to undo that for some reason (i'd recommend consulting the devstack maintainers in #openstack-qa though to find out if there's a saner solution to | 15:27 |
| fungi | whatever you're trying to do there) | 15:27 |
| *** arxcruz has quit IRC | 15:28 | |
| *** bhunter71 has quit IRC | 15:29 | |
| *** ganso has quit IRC | 15:29 | |
| *** bhunter71 has joined #openstack-infra | 15:30 | |
| amuller | fungi: thanks now I know what to grep for :) I just noticed that some of the neutron functional tests are running with sudo directly and passing | 15:31 |
| *** jsavak has quit IRC | 15:31 | |
| fungi | Anticimex: thanks! i left a comment that it may need some additional consideration for non-ssh protocol urls, but otherwise i agree 100% with the recommendation there | 15:31 |
| Anticimex | good catch | 15:32 |
| *** jsavak has joined #openstack-infra | 15:32 | |
| *** kzaitsev_mb has joined #openstack-infra | 15:32 | |
| *** piet has quit IRC | 15:32 | |
| *** peristeri has joined #openstack-infra | 15:34 | |
| fungi | amuller: oh, well the rootwrap enforcement is for the "stack" user specifically, to make sure that devstack isn't calling sudo directly. that doesn't prevent tests (running as the "jenkins" or "tempest" users) from possibly calling sudo | 15:35 |
| *** Thelo has quit IRC | 15:35 | |
| fungi | so depending on what uses of sudo you're seeing, that may or may not be relevant | 15:35 |
| *** dslev has quit IRC | 15:35 | |
| *** shardy has quit IRC | 15:35 | |
| amuller | fungi: thanks I'll look in to it | 15:36 |
| fungi | and when i say devstack using sudo, of course i really mean things running in the context of devstack (so nova, neutron, cinder, whatever) are being forced to go through rootwrap | 15:36 |
| *** arxcruz has joined #openstack-infra | 15:37 | |
| *** ociuhandu has joined #openstack-infra | 15:37 | |
| *** Thelo has joined #openstack-infra | 15:37 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Update to statsd 3.0 https://review.openstack.org/229232 | 15:39 |
| *** ayoung has quit IRC | 15:41 | |
| *** naggappan has quit IRC | 15:41 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Update to statsd 3.0 https://review.openstack.org/229232 | 15:41 |
| *** cdent has quit IRC | 15:42 | |
| *** signed8b_ has joined #openstack-infra | 15:43 | |
| *** signed8b_ has quit IRC | 15:43 | |
| *** piet has joined #openstack-infra | 15:44 | |
| *** shardy has joined #openstack-infra | 15:44 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: use send-announcements-to metadata for deliverables https://review.openstack.org/262281 | 15:44 |
| openstackgerrit | mathieu bultel proposed openstack-infra/shade: Add normalize stack function for heat stack_list https://review.openstack.org/254337 | 15:45 |
| *** Daisy has joined #openstack-infra | 15:46 | |
| *** piet has quit IRC | 15:46 | |
| *** piet has joined #openstack-infra | 15:47 | |
| *** apoorvad has joined #openstack-infra | 15:48 | |
| *** signed8b_ has joined #openstack-infra | 15:49 | |
| *** Daisy has quit IRC | 15:51 | |
| *** bcourt has joined #openstack-infra | 15:52 | |
| *** apoorvad has quit IRC | 15:52 | |
| *** pblaho has quit IRC | 15:53 | |
| *** cdent has joined #openstack-infra | 15:53 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: add bug for subnode failing to come up https://review.openstack.org/263769 | 15:56 |
| *** bgmccollum has left #openstack-infra | 15:57 | |
| pleia2 | good morning | 15:57 |
| *** weshay_xchat has joined #openstack-infra | 15:58 | |
| *** baoli has quit IRC | 15:59 | |
| fungi | yay! the best thing about a script you only run once every few months is that it's a guaranteed source of work to update every time you do run it | 15:59 |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Skip if doc only change for neutron-lib https://review.openstack.org/263786 | 16:00 |
| fungi | the atcs script needs updating to deal with gerrit 2.11 database schema differences, it appears | 16:00 |
| *** baoli has joined #openstack-infra | 16:00 | |
| *** mtanino has joined #openstack-infra | 16:00 | |
| clarkb | can probably completely rest it now? of course the rest api changes too so :( | 16:01 |
| *** weshay has quit IRC | 16:01 | |
| *** devvesa has quit IRC | 16:03 | |
| pleia2 | sdague: re: translations script pulling out authors, we have a mechanism in our script to update the headers for the year and this is the first change of the year for nova translations, I *believe* that's what is wiping out the old translation author headers, we'll have to dig into it | 16:04 |
| sdague | pleia2: mostly I want to know if it's desired behavior | 16:05 |
| sdague | if I'm told yes, that's fine, I'll approve that through | 16:05 |
| sdague | but it was notable enough I figured I'd ask | 16:05 |
| pleia2 | sdague: I don't really know why we track authors in the header, so I'm going to chat with AJaeger about it | 16:05 |
| * pleia2 nods | 16:05 | |
| pleia2 | good catch | 16:05 |
| pabelanger | morning peeps! have 2 reviews open related to nodepool requirements. Mostly uncapping or bumping them to latest releases: https://review.openstack.org/#/q/status:open+project:openstack-infra/nodepool+branch:master+topic:fedora-packaging This is part of my effort to package our tools into Fedora / CentOS | 16:05 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Stop using implict joins https://review.openstack.org/261771 | 16:06 |
| openstackgerrit | Alexandre Viau proposed openstack-dev/pbr: exclude from files in _find_git_files https://review.openstack.org/263297 | 16:06 |
| clarkb | pabelanger: have you tested https://review.openstack.org/#/c/262019/2/requirements.txt works with jenkins? | 16:07 |
| *** pblaho has joined #openstack-infra | 16:07 | |
| anteaya | fungi: yay summit passes | 16:07 |
| fungi | clarkb: i started looking into that and there's still some user account info not presented through the rest api even in 2.11 | 16:08 |
| clarkb | darn | 16:09 |
| fungi | i have a partway completed attempt at reimplementing it via rest api | 16:09 |
| *** isaacb has quit IRC | 16:09 | |
| *** cdent has quit IRC | 16:09 | |
| fungi | i believe where i got stuck is that there's no detailed change owner information in the query results so i can't map it to an account | 16:09 |
| *** tonytan4ever has joined #openstack-infra | 16:09 | |
| *** femnad has quit IRC | 16:10 | |
| openstackgerrit | Alexandre Viau proposed openstack-dev/pbr: exclude from files in _find_git_files https://review.openstack.org/263297 | 16:10 |
| *** pblaho has quit IRC | 16:10 | |
| fungi | if i find time i'll write up a feature request for gerrit to add that (i doubt i'd have time to figure out how to try to implement it in gerrit myself) | 16:11 |
| *** pblaho has joined #openstack-infra | 16:11 | |
| *** femnad has joined #openstack-infra | 16:11 | |
| *** matrohon has quit IRC | 16:11 | |
| fungi | if memory serves, it only provides an owner name but no option for including uniquely identifying details (e-mail address, username, anything) which would allow me to then do an account lookup query | 16:12 |
| clarkb | no account id? | 16:12 |
| fungi | nope | 16:13 |
| fungi | that would be ideal | 16:13 |
| *** matrohon has joined #openstack-infra | 16:13 | |
| fungi | it's possible i'm wrong about that. now i can't recall if i tested against 2.11 on review-dev at the time or simply relied on their api docs (the latter could be lagging behind) but it was definitely not working on 2.8 | 16:14 |
| *** austin81 has joined #openstack-infra | 16:14 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Bug fix: Cinder v2 returns bools now https://review.openstack.org/263764 | 16:14 |
| *** signed8b_ is now known as signed8bit_ZZZzz | 16:15 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Don't build everything in periodic jobs https://review.openstack.org/244519 | 16:15 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Set DELOREAN_REPO_URL for the master periodic job https://review.openstack.org/244526 | 16:15 |
| jeblair | fungi: i think gertty maps changes to owners via id lemme dbl check | 16:15 |
| jeblair | fungi: account = session.getAccountByID(remote_change['owner']['_account_id'] | 16:16 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Bug fix: Cinder v2 returns bools now https://review.openstack.org/263764 | 16:16 |
| jeblair | fungi: naturally, the underscore is there because the mysql db is only temporary until it's all in git, so the account id will go away when they figure out how to make it go away :) | 16:16 |
| *** dslev has joined #openstack-infra | 16:17 | |
| *** signed8bit_ZZZzz is now known as signed8b_ | 16:17 | |
| *** pblaho has quit IRC | 16:17 | |
| pabelanger | clarkb: Ya, I ran it locally before christmas. Let me reconfirm | 16:17 |
| *** pblaho has joined #openstack-infra | 16:17 | |
| jeblair | fungi: but that's via a rest api query of the change, not an ssh query | 16:18 |
| *** hdd has joined #openstack-infra | 16:19 | |
| fungi | jeblair: yeah, i want to say that the problem is that if you query for a set of changes you can't get them to include that and so you end up needing to make a rest api call for every single change id to find the owner? or maybe i just didn't explore that avenue--it's been months since i tried. i'll give it another shot | 16:19 |
| fungi | sort of odd that you can have it include detailed account info for reviewers on each change but not the owner | 16:20 |
| *** pblaho has quit IRC | 16:20 | |
| *** pblaho has joined #openstack-infra | 16:20 | |
| jeblair | fungi: it shows up in gertty's queries (which are big batches) with &o=DETAILED_ACCOUNTS | 16:20 |
| fungi | huh. i could just be misremembering what i ended up stuck on in that case | 16:21 |
| clarkb | https://gerrit-review.googlesource.com/Documentation/rest-api-changes.html#detailed-accounts | 16:21 |
| *** pblaho has quit IRC | 16:22 | |
| jeblair | i wonder of the method of querying (and recombining results after paging, etc, in gertty is now complicated enough to move it into gerritlib) | 16:22 |
| *** pblaho has joined #openstack-infra | 16:22 | |
| jeblair | fungi: oh look! https://review.openstack.org/Documentation/rest-api-accounts.html#list-account-emails | 16:22 |
| jeblair | fungi: i _think_ that means that we can make the script entirely rest with no local db access! | 16:23 |
| fungi | yeah, i'm paging back in where i left off to see what exactly i was stuck on | 16:23 |
| jeblair | (since as i recall, we needed the local db in order to get the non-primary addresses) | 16:24 |
| fungi | oh, that may have been where i actually got stuck | 16:24 |
| *** hdd has quit IRC | 16:24 | |
| fungi | trying to find non-primary addresses | 16:24 |
| *** zeus has quit IRC | 16:24 | |
| fungi | in 2.8 | 16:24 |
| jeblair | yeah, no idea if that was there then | 16:24 |
| *** PsionTheory has joined #openstack-infra | 16:25 | |
| jeblair | fungi: do you want me to take a stab at resting this? i recently refreshed the query code in gertty so it's fresh in my mind. but i don't want to steal your fun if you were looking forward to it. | 16:26 |
| pabelanger | clarkb: anything specific I should try? nodepool is able to delete / launch new nodes to jenkins without an issue locally. This is using pyzmq==15.1.0 | 16:26 |
| *** woodster_ has quit IRC | 16:26 | |
| *** pradk has joined #openstack-infra | 16:26 | |
| clarkb | pabelanger: just that it can receive events ok, so nodes should go ready -> used -> delete based on jenkins events | 16:27 |
| fungi | jeblair: i'd welcome the help. i'll check how far i got and push it up as a wip if it's not trivial to finish now | 16:27 |
| *** vgridnev has joined #openstack-infra | 16:27 | |
| jeblair | fungi: cool. i'll eat breakfast, and i bet we can have something well before the meeting. | 16:27 |
| pabelanger | clarkb: Yup, nodepool works as expected | 16:28 |
| *** zeus has joined #openstack-infra | 16:29 | |
| *** zeus is now known as Guest54332 | 16:30 | |
| fungi | jeblair: aha, i am definitely getting owner details from change queries now | 16:30 |
| *** rbrndt__ has joined #openstack-infra | 16:31 | |
| *** rbrndt_ has quit IRC | 16:32 | |
| *** vgridnev_ has joined #openstack-infra | 16:32 | |
| *** vgridnev has quit IRC | 16:32 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Fix --start with existing cache https://review.openstack.org/261039 | 16:32 |
| openstackgerrit | Merged openstack-infra/reviewstats: Add release cycle management tools to projects https://review.openstack.org/261254 | 16:33 |
| openstackgerrit | Merged openstack-infra/reviewstats: Update keystone projects https://review.openstack.org/261268 | 16:33 |
| *** ddieterly has joined #openstack-infra | 16:33 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Add rpm packaging to projects https://review.openstack.org/261273 | 16:35 |
| *** ayoung has joined #openstack-infra | 16:35 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Add OpenStack ansible to projects https://review.openstack.org/261255 | 16:35 |
| openstackgerrit | Merged openstack-infra/reviewstats: Add manila to projects https://review.openstack.org/261252 | 16:36 |
| openstackgerrit | Merged openstack-infra/reviewstats: Add i18n to projects https://review.openstack.org/261262 | 16:36 |
| openstackgerrit | Merged openstack-infra/reviewstats: Add rally to projects https://review.openstack.org/261260 | 16:36 |
| openstackgerrit | Merged openstack-infra/reviewstats: Update glance projects https://review.openstack.org/261251 | 16:36 |
| openstackgerrit | Merged openstack-infra/reviewstats: Add deb packaging to projects https://review.openstack.org/261271 | 16:36 |
| *** Guest68862 has quit IRC | 16:37 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Add zaqar to projects https://review.openstack.org/261258 | 16:37 |
| *** harlowja_at_home has joined #openstack-infra | 16:37 | |
| anteaya | yolanda: I understand you are on holidays still, I have reviewed https://review.openstack.org/#/c/261743/9 thanks for giving me time to do so, I have left a +1 if you want to approve | 16:37 |
| *** sridhar_ram has joined #openstack-infra | 16:37 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Add refstack to projects https://review.openstack.org/261261 | 16:37 |
| openstackgerrit | Merged openstack-infra/reviewstats: Add congress to projects https://review.openstack.org/261267 | 16:37 |
| openstackgerrit | Merged openstack-infra/reviewstats: Update heat project list https://review.openstack.org/261265 | 16:37 |
| openstackgerrit | Merged openstack-infra/reviewstats: Add OpenStack Client to projects https://review.openstack.org/261263 | 16:39 |
| *** piet has quit IRC | 16:39 | |
| *** piet has joined #openstack-infra | 16:40 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/reviewstats: Add additional repositories to OpenStack-Ansible https://review.openstack.org/263799 | 16:41 |
| *** yaume has quit IRC | 16:42 | |
| *** ashleighfarnham has joined #openstack-infra | 16:43 | |
| *** weshay__xchat has joined #openstack-infra | 16:44 | |
| *** pblaho has quit IRC | 16:44 | |
| *** pblaho has joined #openstack-infra | 16:44 | |
| *** dprince has quit IRC | 16:45 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/os-testr: Support comments in whitelist files https://review.openstack.org/263803 | 16:45 |
| *** weshay_xchat has quit IRC | 16:47 | |
| rajinir | asselin: Figured the nodepool ssh timeout issue. The node takes more than 10 mins to boot but it is marked as active so ssh timesout | 16:48 |
| clarkb | thats really slow | 16:49 |
| clarkb | are you using qemu or real virt? | 16:49 |
| *** dprince has joined #openstack-infra | 16:50 | |
| rajinir | clarkb: Qemu.Its devstack on a vm. I'm planning to setup the openstack on physical node(using kvm) | 16:51 |
| rajinir | clarkb: In the meantime the boot-timeout and launch-timeout in the nodepool.yaml is not affecting the ssh timeout | 16:52 |
| *** armax has joined #openstack-infra | 16:53 | |
| *** unicell1 has quit IRC | 16:54 | |
| *** matrohon has quit IRC | 16:54 | |
| *** hdd has joined #openstack-infra | 16:54 | |
| clarkb | boot-timeout is for that | 16:54 |
| *** pblaho has quit IRC | 16:54 | |
| clarkb | it is in seconds | 16:54 |
| *** pblaho has joined #openstack-infra | 16:54 | |
| *** markus_z has quit IRC | 16:55 | |
| *** ericksonsantos has joined #openstack-infra | 16:55 | |
| sdague | so, if anyone is up for poking at a thing with ovh people - http://status.openstack.org//elastic-recheck/#1531155 | 16:56 |
| sdague | cirros guests are crashing some times on boot, only on ovh nodes | 16:56 |
| *** pblaho has quit IRC | 16:56 | |
| *** pblaho has joined #openstack-infra | 16:57 | |
| sdague | and, curiously, the subnode allocation failure looks to be rax-iad 100% of the time - http://status.openstack.org//elastic-recheck/#1531187 | 16:57 |
| clarkb | sdague could that be nested virt? | 16:57 |
| sdague | clarkb: don't know | 16:57 |
| *** kzaitsev_mb has quit IRC | 16:57 | |
| sdague | did they enable nested kvm? | 16:58 |
| clarkb | yes its enabled because distros enable by default now | 16:58 |
| asselin_ | rajinir, yeah, you'll want to run it on bare metal if you want the vm to do any useful work | 16:58 |
| greghaynes | whoa its enabled in rax? | 16:58 |
| clarkb | no | 16:58 |
| clarkb | in ovh only | 16:58 |
| greghaynes | oh, ok | 16:58 |
| jeblair | clarkb: did we land a d-g change to use that? | 16:58 |
| clarkb | jeblair no, devstack uses it by default | 16:59 |
| *** kzaitsev_mb has joined #openstack-infra | 16:59 | |
| clarkb | so we would have to explicitly disable | 16:59 |
| jeblair | clarkb: i know we putzed around with something locally and decided it didn't make a huge difference | 16:59 |
| greghaynes | ah, I was crossing the streams | 16:59 |
| clarkb | ya not a big difference for performance | 16:59 |
| jeblair | DEVSTACK_LOCAL_CONFIG="LIBVIRT_TYPE=qemu" | 16:59 |
| rajinir | asselin: thanks, will probably take that route. But not sure why boot-time is not effective | 16:59 |
| jeblair | clarkb: ah yeah, we turned it off sometimes | 16:59 |
| rajinir | asselin: I meant boot-timeout in the nodepool.yaml | 17:00 |
| openstackgerrit | Merged openstack/os-testr: Add tool to create a subunit stream https://review.openstack.org/263465 | 17:00 |
| *** gongysh has quit IRC | 17:00 | |
| jeblair | clarkb, sdague: so i think that means we're using it on ovh. if we add that line to d-g, we should disable it everywhere. may be worth doing and seeing if the problem disappears | 17:00 |
| clarkb | rajinir it works on our integration tests which have long boot due to qemu | 17:00 |
| greghaynes | clarkb: so those nodepool builder changes - if I recheck them they will in theory 'just merge' - is that fine to do? | 17:00 |
| sdague | jeblair: wfm | 17:00 |
| *** ttx has quit IRC | 17:00 | |
| *** unicell has joined #openstack-infra | 17:01 | |
| *** Guest54332 is now known as zeus | 17:01 | |
| clarkb | greghaynes uh, would be good to line up a service restart too | 17:01 |
| jeblair | sdague, clarkb: patch in progress | 17:01 |
| clarkb | so we run the new code | 17:01 |
| greghaynes | clarkb: ok, thats why I was kind of holding off ;) | 17:01 |
| *** ttx has joined #openstack-infra | 17:01 | |
| *** zeus has quit IRC | 17:01 | |
| *** zeus has joined #openstack-infra | 17:01 | |
| clarkb | I have puppet thing today and doctors next two days, maybe friday or find another root? | 17:02 |
| greghaynes | clarkb: sure, so should I WIP the bottom of the stack or? | 17:02 |
| anteaya | clarkb: memory usage on logstashworker20 seems to have increased a bit but has leveled off and is sitting at 1G compared to 3G on logstashworker01 | 17:02 |
| dougwig | pabelanger: i've since wiped the hang by reverting my zuul, to get my system back online, but it was hanging on this line, when importing the timer trigger: | 17:03 |
| dougwig | https://www.irccloud.com/pastebin/Jl5WwTWY/ | 17:03 |
| clarkb | greghaynes ya probably safest | 17:03 |
| dougwig | pabelanger: i expect some package combo is not happy. | 17:03 |
| *** ayoung has quit IRC | 17:03 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: net-bagpipe: remove now unneeded -liberty jobs https://review.openstack.org/263809 | 17:04 |
| asselin_ | rajinir, yeah...maybe there's a bug with that? You can try to investigate and see what the root cause it. | 17:04 |
| mtreinish | fungi, clarkb: btw, I finally got around to fixing that issue you reported on health way back on the first prototype deployment: https://review.openstack.org/#/c/259646/ | 17:04 |
| *** bexelbie has quit IRC | 17:05 | |
| mtreinish | I did try using a histogram instead of a line graph, but it didn't look quite right because of the number of samples | 17:05 |
| rajinir | asselin: sure, will post a bug when I confirm the root cause | 17:05 |
| *** jlanoux has quit IRC | 17:05 | |
| *** bexelbie has joined #openstack-infra | 17:06 | |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate: Use qemu everywhere https://review.openstack.org/263810 | 17:07 |
| jeblair | clarkb, sdague: ^ | 17:07 |
| *** bexelbie has quit IRC | 17:07 | |
| *** bexelbie has joined #openstack-infra | 17:07 | |
| *** pblaho has quit IRC | 17:07 | |
| *** pblaho has joined #openstack-infra | 17:07 | |
| jeblair | fungi: want to hand me the baton on the script or you still enthralled? | 17:08 |
| fungi | jeblair: still poking at what i have. i think it's doable now | 17:08 |
| *** gyee has joined #openstack-infra | 17:08 | |
| fungi | mostly just working out the logic to retain per project team atcs lists and handle extra atcs parsing | 17:09 |
| *** zz_ja is now known as zz_zz_ja | 17:09 | |
| jeblair | fungi: okay, i'll go elsewhere :) | 17:09 |
| clarkb | jeblair need to write it to localrc right? | 17:09 |
| jeblair | clarkb: it's already there | 17:09 |
| clarkb | ah | 17:10 |
| jeblair | clarkb: it was apparently a pattern-breaking variable that existed in the main script but not documented with a default in the wrap :( | 17:10 |
| *** e0ne has quit IRC | 17:11 | |
| *** jsavak has quit IRC | 17:11 | |
| *** peristeri has quit IRC | 17:11 | |
| *** jsavak has joined #openstack-infra | 17:12 | |
| pleia2 | need to take a sick kitty to the vet, hopefully will make it back for the meeting, but depends on many vet timing things | 17:12 |
| anteaya | pleia2: I hope kitty has good health | 17:12 |
| pleia2 | anteaya: thanks | 17:12 |
| anteaya | :) | 17:12 |
| jeblair | clarkb: added in this change https://review.openstack.org/#/c/134348/3 | 17:12 |
| *** Ramanjaneya has quit IRC | 17:13 | |
| jesusaurus | clarkb: logstash-worker-20 seems to be doing well with memory \o/ | 17:17 |
| clarkb | jesusaurus: ya I think switching to having logstash do the load balancing is going to be a good improvement | 17:17 |
| dhellmann | fungi : I'd like to find a time this week to talk about next steps for the release automation work. I think we have all of the scripts we need written, but they're going to rely on the artifact signing work and I need to know how to send email from the CI nodes. Do you have time this week to discuss? | 17:17 |
| jesusaurus | yep, looks like it | 17:17 |
| clarkb | jeblair: +3'd at least locally | 17:18 |
| *** sfinucan has quit IRC | 17:18 | |
| *** samuelBartel has quit IRC | 17:18 | |
| clarkb | mtreinish: nice | 17:18 |
| *** moravec has quit IRC | 17:18 | |
| *** kzaitsev_mb has quit IRC | 17:19 | |
| *** jistr has quit IRC | 17:19 | |
| *** AJaeger has joined #openstack-infra | 17:19 | |
| clarkb | the vanilla tempest run that ran on bluebox yesterday passed | 17:19 |
| clarkb | jeblair: mordred: I think we should go ahead and revert the max-servers back to 39 or whatever it was | 17:19 |
| jeblair | clarkb: ++ | 17:19 |
| jeblair | dhellmann: does today between 19:00 and 20:00 work for you? :) | 17:20 |
| fungi | jeblair: the new api call to list account emails does in fact work as desired. it's only available as an authenticated endpoint method, so this script will still need credentials, but that's better than nothing | 17:20 |
| mordred | clarkb: ++ | 17:20 |
| clarkb | jeblair: mordred cool let me get the patch up for you to review | 17:21 |
| *** femnad has quit IRC | 17:21 | |
| fungi | dhellmann: i second jeblair's question--we can put it on today's meeting agenda | 17:21 |
| jeblair | fungi: see tools/maintain-infra-groups.py where i inexplicably have a script read in .gertty.yaml :) | 17:21 |
| *** otter768 has joined #openstack-infra | 17:21 | |
| dhellmann | fungi , jeblair : sure, we can do that, I thought it might be too short notice | 17:21 |
| fungi | jeblair: heh. tempting. i have it currently just prompting with getpass() | 17:22 |
| fungi | but gertty.yaml can certainly be a first check | 17:22 |
| *** baoli has quit IRC | 17:22 | |
| fungi | and would now be consistent with an existing tool in the same repo ;) | 17:23 |
| *** dizquierdo has quit IRC | 17:23 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run Bluebox at full IP address capacity https://review.openstack.org/263815 | 17:23 |
| nibalizer | clarkb: for bluebox? | 17:23 |
| clarkb | nibalizer: yup ^ | 17:23 |
| nibalizer | sweet | 17:23 |
| dhellmann | jeblair , fungi : added | 17:24 |
| nibalizer | did we get some confirmation they swapped cpus or hamsters or whatever they were going to do? | 17:24 |
| fungi | dhellmann: thanks--looking forward to discussing! | 17:24 |
| *** dahoo has joined #openstack-infra | 17:24 | |
| jeblair | nibalizer: mordred confirmed they did | 17:24 |
| *** baoli has joined #openstack-infra | 17:24 | |
| mordred | yes. they have swapped cpus | 17:24 |
| mordred | OR | 17:24 |
| mordred | rather | 17:24 |
| mordred | they have reported that they have swapped CPUs | 17:24 |
| openstackgerrit | Merged openstack/os-testr: Support comments in whitelist files https://review.openstack.org/263803 | 17:24 |
| jeblair | they mey have _actually_ swapped hamsters | 17:24 |
| *** vgridnev_ has quit IRC | 17:24 | |
| mordred | I have not independently verified that new cpus exist | 17:24 |
| greghaynes | these hamsters have racing stripes | 17:25 |
| *** fawadkhaliq has quit IRC | 17:25 | |
| *** ddieterly has quit IRC | 17:25 | |
| jeblair | they painted little stripes on them? how cute! | 17:25 |
| clarkb | gerrit us up to mean heap use of 9GB | 17:25 |
| clarkb | s/us/is/ | 17:25 |
| AJaeger | pleia2: good morning, do you have time for the authors discussion? | 17:26 |
| clarkb | mordred: neither have I fwiw, I have learned to not trust what VMs tell me | 17:26 |
| *** otter768 has quit IRC | 17:26 | |
| clarkb | gerrit GC time has spiked a few times in the lsat day but nothing too crazy | 17:26 |
| mordred | clarkb: I think my testing was going to be "look at performance graphs and see if it's faster" | 17:26 |
| greghaynes | yea, if they dont lie a bit then live migration is a pain | 17:26 |
| pabelanger | dougwig: if I am looking correctly, it seems related to this commit: https://github.com/openstack-infra/zuul/commit/352264b3c22b501ae53c1643e31df2ccdfc89388 | 17:27 |
| pabelanger | dougwig: would be interesting to try to reproduce it | 17:27 |
| *** moravec has joined #openstack-infra | 17:27 | |
| *** moravec has quit IRC | 17:27 | |
| *** dims has quit IRC | 17:29 | |
| anteaya | AJaeger: she took her sick kitty to the vet | 17:29 |
| *** baoli has quit IRC | 17:29 | |
| anteaya | AJaeger: she hopes to be back in time for the team meeting but isn't sure | 17:29 |
| AJaeger | thanks, anteaya . Ok, I'll wait | 17:30 |
| anteaya | AJaeger: awesome | 17:30 |
| krotscheck | jeblair, mordred: I couldn't help but notice that the AFS cell you two set up already had a /mirror directory in it that was populated. Is that a thing that is already working, oooor.... | 17:31 |
| jeblair | krotscheck: tested a bit but not in prod; we need to land a change to bandersnatch to use it for pypi, and need to get around to it for git. | 17:31 |
| *** baoli has joined #openstack-infra | 17:32 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 17:33 |
| *** mudassirlatif has joined #openstack-infra | 17:33 | |
| AJaeger | jeblair: Here's another revision of my cross dependencies change incorporating a suggestion by anteaya (thanks, anteaya !) - could you review it again, please? | 17:34 |
| *** shardy has quit IRC | 17:34 | |
| anteaya | done | 17:34 |
| anteaya | thank you, sorry you lost your 2 +2's to incorporate my suggestion, but thank you for doing so | 17:35 |
| AJaeger | anteaya: I rather get this one really clear and have a few questions less to answer ;) | 17:35 |
| clarkb | fungi: I just added a meeting topic that I think is becoming important as we draw near to the end of the month | 17:36 |
| *** dims has joined #openstack-infra | 17:36 | |
| clarkb | fungi: particularly since some of us will be semi afk traveling around then | 17:36 |
| anteaya | AJaeger: agreed, you have worked hard on it and is very good now, thank you | 17:36 |
| zaro | morning | 17:36 |
| *** shardy has joined #openstack-infra | 17:36 | |
| openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Add heat lbaas specific test for v1 and v2 https://review.openstack.org/237156 | 17:37 |
| clarkb | zaro: good morning, small gerrit memory use update in scrollback. TL;DR is mean heap use is now 9GB and we are seeing some graphable GC time | 17:37 |
| AJaeger | clarkb: could you review these, please? https://review.openstack.org/263566 and https://review.openstack.org/263566 The zmq-event-publisher change was your original change, I think this maven scm plugin will not work with OpenStack | 17:37 |
| *** unicell has quit IRC | 17:37 | |
| AJaeger | thanks, jeblair and anteaya for the reviews! | 17:38 |
| clarkb | AJaeger: thats the same change twice :) I think that was mostly just copy pasta from the example plugin | 17:39 |
| zaro | clarkb: from yesterday, correct? | 17:39 |
| clarkb | zaro: from this morning | 17:39 |
| *** moravec has joined #openstack-infra | 17:39 | |
| clarkb | AJaeger: zaro the pom.xml scm information is for things like eclipse or whatever to push and pull from the upstream? | 17:40 |
| *** moravec1 has joined #openstack-infra | 17:40 | |
| *** austin81 has quit IRC | 17:40 | |
| AJaeger | https://review.openstack.org/263568 - same change again, different repo and change ;) | 17:40 |
| *** austin81 has joined #openstack-infra | 17:40 | |
| zaro | waynr: np, the other jjb cores are zxiiro, hashar, electrofelix and of course infra-core | 17:41 |
| clarkb | AJaeger: if the tests for those manage to build properly I think its fine, but zaro should weigh in too I think he groks that the best | 17:41 |
| AJaeger | clarkb: sorry for wrong change - 263568 is the other one | 17:41 |
| clarkb | yup see it now thanks | 17:41 |
| AJaeger | clarkb: tests passed... | 17:42 |
| *** dtantsur is now known as dtantsur|afk | 17:42 | |
| AJaeger | zaro, can you check 263568 and 263566, please? | 17:42 |
| clarkb | gah, I fial at reading new change screen | 17:42 |
| krotscheck | jeblair: What change in bandersnatch? | 17:42 |
| hashar_ | zaro: though I have been barely reviewing anything for months :-((( ( I should do my review duty ... | 17:42 |
| bhunter71 | Is there something.. that limits the amount of usable RAM on a devstack-trusty/running dsvm instance? That is, when I make a 16GB devstack-trusty, I see some evidence that Nova is only seeing ~7GB of free memory. cgroups in play here? | 17:42 |
| clarkb | bhunter71: kernel boot parameter | 17:43 |
| jeblair | krotscheck: https://bitbucket.org/pypa/bandersnatch/pull-requests/12/add-option-to-dir-hash-index-files/diff | 17:43 |
| bhunter71 | thanks clarkb! | 17:43 |
| krotscheck | jeblair: ah-hah! | 17:43 |
| jeblair | krotscheck: seems like they're ok with the change, i just need to figure out how to update an hg pr | 17:43 |
| anteaya | hashar_: we miss you | 17:44 |
| *** jaosorior has quit IRC | 17:44 | |
| *** moravec has quit IRC | 17:44 | |
| *** fawadkhaliq has joined #openstack-infra | 17:44 | |
| hashar_ | anteaya: yeah I do to. Been to busy in 2015 with misc random stuff at wikimedia :-D | 17:44 |
| anteaya | hashar_: yay random stuff | 17:44 |
| *** jaosorior has joined #openstack-infra | 17:44 | |
| clarkb | bhunter71: its intentional to keep memory use semi sane across providers regardless of the underlying flavor size | 17:44 |
| clarkb | bhunter71: will probably go away at the end of the month when hpcloud is turned off since that is the only place we really need it right now | 17:45 |
| *** jaosorior has quit IRC | 17:45 | |
| *** jaosorior has joined #openstack-infra | 17:45 | |
| clarkb | AJaeger: approved the gearman plugin one and +2'd the zmq event plugin | 17:45 |
| zaro | AJaeger: reviewed | 17:45 |
| *** bdemers has quit IRC | 17:45 | |
| AJaeger | clarkb, zaro: Thanks! | 17:46 |
| *** abregman has quit IRC | 17:46 | |
| *** amuller is now known as amuller_afk | 17:47 | |
| pleia2 | AJaeger: at the vet with my kitty this morning | 17:47 |
| *** hashar_ has quit IRC | 17:47 | |
| krotscheck | jeblair: So, your vision to set up an AFS mirrors is to have some form of a mirror-master, and then a bunch of mirror slaves? | 17:47 |
| zxiiro | zaro: happy new year! I'm working on getting another student for the summer to work on JJB again. | 17:48 |
| krotscheck | I'm guessing only one privileged mirror master, because bandersnatch might step on its own feet | 17:48 |
| AJaeger | pleia2: understood - let's talk once you're back if I'm still around... | 17:48 |
| *** bdemers has joined #openstack-infra | 17:48 | |
| pleia2 | AJaeger: yep, sur | 17:48 |
| pleia2 | sure | 17:48 |
| krotscheck | I'm just exploring this right now. Am going to get the wheel-thingie working first, then start thinking about mirror things. | 17:48 |
| mordred | krotscheck: kinda - there will be one read-write volume | 17:49 |
| jeblair | krotscheck: yeah, run the mirroring script (eg bandersnatch) on one host -- it writes to a read-write mounted afs volume. when complete, it does a vos-release which replicates that volume to multiple read-only replicas. the actual 'mirrors' are basically just apache servers that serve out the read-only volumes | 17:49 |
| *** Swami has joined #openstack-infra | 17:49 | |
| *** yamahata has joined #openstack-infra | 17:49 | |
| mordred | what jeblair said | 17:49 |
| *** sputnik13 has joined #openstack-infra | 17:50 | |
| jeblair | krotscheck: (they will have large caches, so as they are used, they eventually converge on just serving the active set of data from their local cache) | 17:50 |
| zaro | fungi: take a look at https://gerrit-documentation.storage.googleapis.com/Documentation/2.11/rest-api-changes.html#detailed-accounts | 17:50 |
| openstackgerrit | Merged openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 17:50 |
| * krotscheck goes to read things about vos-release | 17:50 | |
| *** ddieterly has joined #openstack-infra | 17:51 | |
| clarkb | hpcloud is http 500'ing and there are nodes in ovh-bhs1 entering error state | 17:52 |
| clarkb | I am going to guess hpcloud may have leaked ports/fips | 17:52 |
| clarkb | will work on sorting that out | 17:52 |
| fungi | zaro: helpful--thanks! | 17:53 |
| zaro | clarkb: i can't find anything in today's scrollback regarding gerrit memory. could you please provide recap | 17:53 |
| zaro | ? | 17:53 |
| *** trown is now known as trown|lunch | 17:54 | |
| clarkb | zaro: mean use is 9GB, max is still 12GB (so we are spiking and hitting that often ish), and gc time occasionally is spiking but not to 10% more like 1% | 17:54 |
| openstackgerrit | Merged openstack-infra/gearman-plugin: Remove broken scm section https://review.openstack.org/263566 | 17:54 |
| zaro | clarkb: that seems to suggest may just a little more memory would be ideal? | 17:55 |
| zaro | *may/maybe | 17:55 |
| clarkb | zaro: if it continues to use more and more I agree, I still have a small amount of hope that it has reached a steady state | 17:55 |
| *** lezbar has quit IRC | 17:56 | |
| openstackgerrit | Merged openstack-infra/project-config: Run Bluebox at full IP address capacity https://review.openstack.org/263815 | 17:57 |
| *** jordanP has quit IRC | 17:59 | |
| anteaya | lennyb_: this also might be helpful for you for your patch to make lastcomment work with 2.11: https://gerrit-documentation.storage.googleapis.com/Documentation/2.11/rest-api-changes.html#detailed-accounts | 17:59 |
| *** tlian has quit IRC | 18:00 | |
| clarkb | we seem to have only leaked ~7 fips in hpcloud, I will go ahead and delete them | 18:00 |
| clarkb | that may account for the errors since we are basically at capacity | 18:01 |
| *** bharathm has joined #openstack-infra | 18:01 | |
| anteaya | ack | 18:01 |
| pabelanger | clarkb: any reason not to make nodepool more aggressive in deleting them? Some sort of crontab every few minutes | 18:02 |
| clarkb | pabelanger: yes, 1) cloud should not leak these resources 2) it would require managing pools of a second resource which gets complicated | 18:02 |
| *** signed8b_ is now known as signed8bit_ZZZzz | 18:02 | |
| clarkb | pabelanger: I worry that we would invest a lot of effort into a thing that should just be fixed in neutron/nova | 18:03 |
| clarkb | then they would fix it and our work would be redundant | 18:03 |
| *** sabeen1 has joined #openstack-infra | 18:04 | |
| *** signed8bit_ZZZzz is now known as signed8b_ | 18:04 | |
| clarkb | hrm do any of the clouds other than hpcloud require floating IPs? | 18:04 |
| clarkb | that may be another reason to ust ignore it for now | 18:04 |
| *** e0ne has joined #openstack-infra | 18:05 | |
| pabelanger | clarkb: Ya, fair enough. I often heard about leaked FIPs but was curiously why we manually dealt with deleting them. | 18:05 |
| mordred | clarkb: ibm does, as does bluebox | 18:06 |
| mordred | clarkb, pabelanger: this will be better when we land the shade patch | 18:06 |
| clarkb | pabelanger: stubborness and a hope that the issue goes away? its actually a bit unfun to fix properly since you have to keep track of what fips map to what hosts and whether or not that host is still valid | 18:06 |
| *** tlian has joined #openstack-infra | 18:07 | |
| mordred | as the mechanism for attaching floating ips is different (using neutron api) | 18:07 |
| greghaynes | clarkb: By managing a second pool of resources you mean manage fips as a pool also? | 18:07 |
| mordred | which means that all unattached floating ips will always be a leak, and never an in-process fip | 18:07 |
| clarkb | greghaynes: yes | 18:07 |
| mordred | we do not need to do that | 18:07 |
| clarkb | greghaynes: beacuse neutron and nova don't keep track for you when it breaks | 18:07 |
| mordred | we do not have to keep track of anything | 18:07 |
| clarkb | mordred: how do you know what is safe to delete or not then? | 18:08 |
| mordred | we just have to creat/attache the fips differently | 18:08 |
| greghaynes | mordred: what is the api youre talking about? | 18:08 |
| mordred | clarkb: it is ALWAYS safe to delete an unattached fip | 18:08 |
| mordred | in the shade codepath | 18:08 |
| clarkb | mordred: it isn't due to races on the back end | 18:08 |
| mordred | becuase shade creates the fip with a port id | 18:08 |
| greghaynes | mordred: there is some atomic "booot and attach"? | 18:08 |
| mordred | yes | 18:08 |
| mordred | that's what shade does instead of how nodepool does it | 18:08 |
| clarkb | last I checked there is no atomic api call | 18:08 |
| clarkb | and you can't properly detect errors in each step of the multi step attach | 18:09 |
| mordred | the floating ip is created with the server's port id | 18:09 |
| clarkb | (or delete) | 18:09 |
| mordred | there is no multi-step attach | 18:09 |
| mordred | that's what I'm trying to say - it's a single step attach | 18:09 |
| clarkb | mordred: its create + attach | 18:09 |
| mordred | it's not | 18:09 |
| mordred | not in the shade path | 18:09 |
| clarkb | then where does the fip come from? | 18:09 |
| mordred | ok | 18:09 |
| mordred | let me try this again | 18:09 |
| mordred | when you create eh floating ip - you create it with the port_id of the server - this is a single step of "create-and-attac" from the FIP perspective, not from the server perspective | 18:10 |
| mordred | so you can have a server without a fip | 18:10 |
| mordred | but not a fip without a server | 18:10 |
| mordred | thus, fips without a server are fips where the server has been deleted but the fip hasn't | 18:10 |
| Sam-I-Am | you can have non-attached fips | 18:10 |
| mordred | yes you can | 18:10 |
| mordred | but they will always be fips to be deleted in our case | 18:10 |
| *** unicell has joined #openstack-infra | 18:11 | |
| mordred | becuase we do not re-use them | 18:11 |
| mordred | this is a diffrent workflow than our current sequence | 18:11 |
| *** tonytan4ever has quit IRC | 18:11 | |
| clarkb | mordred: iirc, the issue on the create side is attach returns 200, but nova/neutron actually don't manage to attach | 18:11 |
| AJaeger | mordred: could you review https://review.openstack.org/198417 and tell us whether you're happy with this updated version, please? | 18:11 |
| mordred | which has the characteristics clarkb was talking about | 18:11 |
| clarkb | mordred: so from nova's perspective there is no attach | 18:11 |
| mordred | clarkb: we do not run an attach call | 18:11 |
| mordred | clarkb: there is literally never a time when we call attach | 18:11 |
| clarkb | mordred: are you sure? when I read the code its distinct api calls | 18:12 |
| lifeless | mordred: hi | 18:12 |
| *** armax has quit IRC | 18:12 | |
| clarkb | mordred: the client fudges over it poorly | 18:12 |
| mordred | clarkb: yes. very very much so | 18:12 |
| lifeless | mordred: we need to do a 0.11.1 pbr | 18:12 |
| *** Adri2000 has quit IRC | 18:12 | |
| dougwig | pabelanger: i reverted to the commit immediately before the apscheduler upgrade and it all started working, which is three commits (apsched, webob removal, tox tweak) | 18:12 |
| mordred | lifeless: did you see my latest pbr patch? | 18:12 |
| Sam-I-Am | neutron floatingip-create <net> will just create a fip without attaching it | 18:12 |
| clarkb | mordred: which is part of the problem because different bits will fail but you don't know what bit and iether way you don't get enough info to rollback properly | 18:12 |
| *** changbl has joined #openstack-infra | 18:12 | |
| mordred | Sam-I-Am: yes. that's not what we're talking about | 18:12 |
| Sam-I-Am | oh, ok | 18:12 |
| * Sam-I-Am fades out again | 18:12 | |
| clarkb | this was made better in response to our original complaint of the issue, but not completely fixed | 18:12 |
| clarkb | (the racey code was minimized) | 18:13 |
| *** Adri2000 has joined #openstack-infra | 18:13 | |
| lifeless | mordred: https://review.openstack.org/#/c/263748/ ? | 18:13 |
| greghaynes | mordred: I think clarkb is just saying that there is a failure case in nova/neutron which can leave an unattached fip | 18:13 |
| greghaynes | which seems plausible | 18:14 |
| greghaynes | but IMO that is a better failure case since we can say "whenever that happens it is a nova/neutron bug" | 18:14 |
| mordred | clarkb: http://developer.openstack.org/api-ref-networking-v2-ext.html#createFloatingIp | 18:14 |
| clarkb | mordred: ya I am reading that there is no server id | 18:14 |
| mordred | clarkb: port_id | 18:14 |
| mordred | clarkb: you pass the port_id of the server | 18:14 |
| *** mpaolino has quit IRC | 18:14 | |
| mordred | of the fixesd ip of the server | 18:14 |
| clarkb | mordred: right so the issue is this | 18:14 |
| pabelanger | dougwig: Hmm. keep my updated please. Interested to see what you find | 18:15 |
| clarkb | all of that is neutron construct that nova is unaware of iirc. So neutron willreturn 200 and say its all golden | 18:15 |
| clarkb | nova on the other hand never found out about the floating IP | 18:15 |
| clarkb | this means when you go to delete the VM that floating IP which was "attached" does not exist and you cannot delete it | 18:15 |
| clarkb | because you don't know its there | 18:15 |
| pabelanger | dougwig: only thing I can think of is maybe stale dependencies? | 18:15 |
| clarkb | if you want to track that state outside of nova and neutron it will work | 18:15 |
| clarkb | but you have to track the state yourself | 18:15 |
| mordred | so, that's all valid - but the thing is that it doesn't matter and you don't have to track the state | 18:16 |
| greghaynes | clarkb: I think we wouldnt need to track state there though? if something is unattached we'd just delete | 18:16 |
| clarkb | or otherwise do reverse lookup listings that are expense etc | 18:16 |
| clarkb | greghaynes: no there is a race | 18:16 |
| jeblair | clarkb: but i think mordred is saying that because of the different way of creating them it's safe to simply periodically "delete all unattached fips" | 18:16 |
| mordred | clarkb: because when you delete the server, it will delete the port | 18:16 |
| clarkb | greghaynes: because internally neutron will have fip's that are not yet attached that will be attached | 18:16 |
| mordred | which means that the fip will then not have a fixed port_id | 18:16 |
| AJaeger | pabelanger: our currently oldest untouched change in project-config is https://review.openstack.org/186441 -could you have a look at it or should I abandon it? | 18:16 |
| mordred | which means that you can ALWAYS run a sweep operation that says "get me all the fips that do not have fixed port ids and delete them" | 18:16 |
| mordred | and that will ALWAYS be safe to do | 18:17 |
| greghaynes | clarkb: uhhh | 18:17 |
| greghaynes | clarkb: wat | 18:17 |
| greghaynes | clarkb: that is bad | 18:17 |
| clarkb | mordred: so that relies on the underlying non floating IP port going away? | 18:17 |
| mordred | clarkb: no. we will NEVER have fips that are not yet attached but _will_ be attached. if we have fips tht are not attached, they will never be attached | 18:17 |
| mordred | that's the difference in the workflows | 18:17 |
| mordred | they both have failure conditions | 18:17 |
| mordred | but you can infer different information in the new one | 18:18 |
| greghaynes | I mean, that is a plausable assertion... I cant know without reading code. | 18:18 |
| mordred | becaue there is not a valid state of "exists pending attachment" | 18:18 |
| clarkb | mordred: ok, that was definitely the case when I read the server and client code when this first popped up | 18:18 |
| mordred | right | 18:18 |
| clarkb | so I am confused how shade can do it differently | 18:18 |
| mordred | it's a _completely_ different code path we'll be using in shade | 18:18 |
| mordred | we use neutron api not nova api | 18:19 |
| clarkb | right the issue is in neutron api | 18:19 |
| mordred | which gives us the ability to create a floaitng ip wiht the server fixed port id | 18:19 |
| mordred | no | 18:19 |
| mordred | zomg | 18:19 |
| mordred | you're still talking about the old attach-based api | 18:19 |
| mordred | that is not what we're talking about here | 18:19 |
| clarkb | ok | 18:19 |
| mordred | we're talking about creating the floating ip with a pre-existing fixed port target at create time | 18:19 |
| mordred | there is no attach | 18:19 |
| greghaynes | mordred: I think clarkb is just asserting that the neutron api is not atomic and can raced with neutron list calls | 18:20 |
| mordred | you are correct that if we used attach with neutron api we'd still be in the broken place | 18:20 |
| pabelanger | AJaeger: Ya. Sadly that project did work as I expected. Now that deb-packaging group is a thing, we should either ask if they want to maintain it or maybe just close it off. FWIW: I'm actually working directly in fedora packaging team for zuul, nodepool, etc. | 18:20 |
| greghaynes | I can just read the codes and see | 18:20 |
| pabelanger | AJaeger: add to that, we never landed our packaging spec this year and sadly it just lagged behind | 18:20 |
| pabelanger | AJaeger: I'll abandon for now to keep things easy | 18:21 |
| mordred | greghaynes: I have not been able to produce a race, where the other one that clarkb talks about produces a race _very_ trivially | 18:21 |
| greghaynes | Yep | 18:21 |
| mordred | (exists in a constant state of race really) | 18:21 |
| greghaynes | Absolutely. I havent actually read the code so *shrug* | 18:21 |
| AJaeger | pabelanger: in that case you can tell the rpm-packaging guys as well . thanks for abandoning it | 18:21 |
| greghaynes | They would just need some extra internal state for fips to not show them while attempting an attach, so that should be fixable if it doesnt exist. | 18:22 |
| mordred | I will concede that it's possible that there will be a moment where a list shows a floating ip without a fixed port - but I have not been able to produce such a state in the new code path | 18:22 |
| mordred | right | 18:22 |
| pabelanger | AJaeger: Ya. Once I have some spare cycles, I want to get packaging builds going again. I had it working, but our lack of spec made it hard to land | 18:22 |
| clarkb | mordred: also, I think you are suggesting periodic cleanup rather than correct deletes right? | 18:22 |
| clarkb | er correct deletes at VM delete | 18:22 |
| AJaeger | pabelanger: understood. | 18:22 |
| clarkb | because we can't do that either way without a ton of extra api calls? | 18:22 |
| mordred | clarkb: well, I'm suggesting correct deletes at VM delete - but also safe automatic sweeps becuase E_CLOUD | 18:23 |
| *** _nadya_ has quit IRC | 18:23 | |
| mordred | in any case, we should absolutely not maintain our own floating ip pool state :) | 18:24 |
| mordred | a point on which I believe we both violently agree | 18:24 |
| clarkb | yes :) | 18:24 |
| AJaeger | pabelanger: do you want to continue on 208088, 258682, 205673 as well? | 18:24 |
| *** tonytan4ever has joined #openstack-infra | 18:24 | |
| pabelanger | AJaeger: Ya, just looking at my outstanding reviews now | 18:24 |
| *** eil397 has joined #openstack-infra | 18:25 | |
| sputnik13 | can someone with +2 for requirements please take a look at https://review.openstack.org/#/c/261074/, it already has a +2 from dims | 18:25 |
| AJaeger | pabelanger: thanks | 18:25 |
| jlvillal | I know basically nothing about Puppet, but trying to setup an environment to simulate the devstack-gate. https://github.com/openstack-infra/devstack-gate When doing 'puppet apply ...' I get an error about not being able to upgrade tox. | 18:25 |
| sputnik13 | just bumping taskflow minimum version | 18:25 |
| *** angdraug has joined #openstack-infra | 18:25 | |
| jlvillal | My theory is that the 'pip' module in puppet doesn't know how to go through a proxy server. Or I somehow have to configure it. I do have http_proxy/https_proxy set. | 18:26 |
| *** dslev has quit IRC | 18:26 | |
| jlvillal | The error generated seems to come from: /etc/modules/pip/lib/puppet/provider/package/pip3.rb | 18:27 |
| sputnik13 | jlvillal afaik http_proxy/https_proxy settings don't always carry over when doing sudo | 18:27 |
| jroll | jlvillal: https://tickets.puppetlabs.com/browse/PUP-5212 :( | 18:27 |
| jlvillal | sputnik13: I am running this as root, inside the VM | 18:27 |
| jlvillal | jroll: You are a font of sad news :P But thanks, that is helpful! | 18:28 |
| *** hdd has quit IRC | 18:28 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add ansible-role-functional-jobs-(centos|trusty)-nv https://review.openstack.org/258682 | 18:28 |
| * jlvillal sobs softly... | 18:28 | |
| jroll | heh | 18:28 |
| *** hdd has joined #openstack-infra | 18:28 | |
| sputnik13 | jlvillal maybe setting proxy in pip config would work? | 18:28 |
| mordred | lifeless: heya | 18:28 |
| jlvillal | sputnik13: It isn't actually pip that is failing. It is the puppet module. pip itself works fine through the proxy. But thanks for the idea! | 18:29 |
| jroll | jlvillal: probably not released yet, but https://github.com/puppetlabs/puppet/pull/4503 | 18:29 |
| sputnik13 | kk, good luck | 18:29 |
| mordred | lifeless: sorry, you tried to talk to me about a pbr release while clarkb and I were talking about fips (yay) | 18:29 |
| mgagne | jeblair I'm back from holidays. Checking at created instances by nodepool at Internap and I see nodes are created and deleted in less then 30s. Is it the normal behavior or is nodepool going crazy? | 18:29 |
| jlvillal | jroll: I could try hacking that in there locally, maybe... I will look at it. | 18:29 |
| mordred | lifeless: yes, that is the patch I was talking about, would love to get it in if we're cutting something, but it's also by no means essentially | 18:30 |
| mordred | (just ugly in changelogs) | 18:30 |
| lifeless | mordred: yes, we need a 0.11.1 release | 18:30 |
| *** _nadya_ has joined #openstack-infra | 18:30 | |
| lifeless | mordred: which means we need a branch for that | 18:30 |
| lifeless | mordred: for which I believe I need infra help | 18:30 |
| clarkb | mordred: I am rereading fip implementation (for dvr because its what I found) and I think there is still the issue let me link some code | 18:30 |
| anteaya | mgagne: I do believe we prefer for created nodes to last a little longer than 30s | 18:30 |
| lifeless | mordred: [before we can put the patch up or anything useful] | 18:31 |
| *** signed8b_ is now known as signed8bit_ZZZzz | 18:31 | |
| anteaya | mgagne: is that the behaviour you are seeing on all your nodes created by our nodepool | 18:31 |
| mgagne | anteaya I'm looking for an explanation for the (faulty or not) behavior =) | 18:31 |
| anteaya | understood | 18:31 |
| mgagne | anteaya I don't have access to Nova logs/database of other providers | 18:32 |
| jeblair | mgagne, clarkb, mordred: this change was intended to address the problem that mgagne is seeing: https://review.openstack.org/252000 | 18:32 |
| jeblair | anteaya: ^ | 18:32 |
| clarkb | mordred: actually I see whree it adds the fixed port now | 18:32 |
| anteaya | I'm trying to draw attention to your request for an explaination by engaing you | 18:32 |
| anteaya | engaging you | 18:32 |
| clarkb | mordred: it does the updates in two different location buts apperas to be a single transaction | 18:32 |
| clarkb | so it may be ok | 18:32 |
| *** andreykurilin__ has quit IRC | 18:32 | |
| jroll | jlvillal: good luck :) | 18:33 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Add wheel mirror to mirrors https://review.openstack.org/253521 | 18:33 |
| mordred | clarkb: good. that's what the experiene I've had is - but I could totally imagine a server-side race :) | 18:33 |
| mgagne | jeblair is there anything I can do to speed up merge of this change? | 18:33 |
| jeblair | clarkb, mgagne, mordred, greghaynes: it has a minor conflict with the builders series which is approved but failed jenkins. | 18:33 |
| greghaynes | clarkb: I say we switch to that style, if we end up with unattached fips then we know it is a nova/neutron bug | 18:33 |
| *** aopincar has joined #openstack-infra | 18:33 | |
| jlvillal | jroll: Looks fairly simple. Famous last words... | 18:33 |
| *** signed8bit_ZZZzz is now known as signed8b_ | 18:33 | |
| jeblair | clarkb, mgagne, mordred, greghaynes: we should either merge the builders changes immediately or approve that change and rebase builders. | 18:33 |
| mordred | greghaynes: yes. we will be changing to that style when we land the shade patch | 18:33 |
| *** ifarkas has quit IRC | 18:33 | |
| mordred | greghaynes: which I will start working on again once builders has landed | 18:34 |
| greghaynes | jeblair: Builders are ready to merge and have a +A, they just failed to merge due to occ bug which is now fixed | 18:34 |
| clarkb | jeblair: I have committed to helping crinkle with the puppet-mysql update after the meeting so not really in a place to approve and restart nodepool and check it all | 18:34 |
| clarkb | but if someone else has time that would be great | 18:34 |
| clarkb | its ready to go and tests should pass after the occ release | 18:34 |
| greghaynes | Yep, just waiting on that | 18:34 |
| krotscheck | greghaynes: I'm messing around with your wheel patches. | 18:34 |
| krotscheck | greghaynes: Just fyi | 18:34 |
| jeblair | greghaynes: you have the root of the series in WIP. | 18:34 |
| greghaynes | krotscheck: fun | 18:34 |
| greghaynes | jeblair: Yep, I was asking this morning if I should recheck or wait, I got a 'wait until we are ready to deploy' so I did that | 18:35 |
| pabelanger | ya, looking forward to the nodepool builder stuff landing, set aside some time already to play with it :) | 18:35 |
| jeblair | greghaynes: well, if we're waiting then we need to merge the internap-fixing change and rebase builders. that is not my preference but we must do one or the other. | 18:35 |
| mgagne | ok so status is: waiting for free cycle to merge and babysit the deployment | 18:36 |
| greghaynes | jeblair: Do you have a link to that change? I am curious how bad it conflicts | 18:36 |
| jeblair | greghaynes: it is minor | 18:36 |
| jeblair | greghaynes: https://review.openstack.org/252000 | 18:36 |
| *** dslev has joined #openstack-infra | 18:36 | |
| jeblair | mgagne: no, when we last discussed this we agreed that we would only delay https://review.openstack.org/252000 for builders as long as we were waiting for quota from internap. we have it now, so we should proceed. | 18:37 |
| mgagne | jeblair ok I have some free time this week to work with you guys to increase quota if things go well | 18:38 |
| greghaynes | jeblair: Ya, we can go ahead with merging that and i'll rebase | 18:38 |
| jeblair | greghaynes: i'm perfectly happy to restart nodepool. what other work would be involved? | 18:38 |
| anteaya | 22 minutes to team meeting | 18:38 |
| *** ganso has joined #openstack-infra | 18:38 | |
| greghaynes | jeblair: in theory no, I dont want to get in to a firedril on bugfixing right now if something does pop up though | 18:38 |
| fungi | jeblair: pretty close now... i have a script dumping yaml of gerrit change owner e-mail addresses per governance project-team based on an arbitrary change query. artificially constraining it to the past month of changes for repos under the cinder and nova teams, it completes in ~60 seconds so probably not much worse than the mysql/ssh-based solution | 18:39 |
| jeblair | greghaynes: okay, we can always revert, but your call. | 18:39 |
| greghaynes | jeblair: The rebase shouldn't be too bad so lets do that | 18:39 |
| *** jsavak has quit IRC | 18:39 | |
| mgagne | jeblair I'm also looking at graphite.o.o and I can't login (getting a python error). Is it a known behavior? Should I be able to login and saves personal dashboards and charts? | 18:40 |
| AJaeger | sdague: could you review https://review.openstack.org/#/c/258642 , please? I'm not sure whether that works as expected... | 18:40 |
| *** piet has quit IRC | 18:40 | |
| mgagne | http://paste.openstack.org/show/483064/ | 18:40 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Bug fix: Cinder v2 returns bools now https://review.openstack.org/263764 | 18:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Add 'public' attribute to 'networks' entry https://review.openstack.org/252000 | 18:40 |
| *** terriyu has joined #openstack-infra | 18:40 | |
| jeblair | mgagne: no login needed | 18:40 |
| *** fawadkhaliq has quit IRC | 18:40 | |
| mgagne | jeblair all stored in cookies? | 18:40 |
| mgagne | or local storage. | 18:41 |
| jeblair | mordred, greghaynes, clarkb: if you could approve https://review.openstack.org/252000 that would be great. | 18:41 |
| greghaynes | Also, there are tests, so I am happy :) | 18:41 |
| jeblair | mgagne: it's mostly stateless, graphs are just long urls | 18:42 |
| pabelanger | If reviewers are around, I wouldn't mind help getting statsd 3.0 for zuul landed: https://review.openstack.org/#/c/229232/ Then maybe get a new release of zuul later today | 18:42 |
| mgagne | jeblair ok, I was more or less looking for a way to avoid copy/paste the URLs somewhere just to save them if I can have then saved online under my personal account | 18:43 |
| jeblair | mgagne: we're starting to make dashboards in grafana.openstack.org | 18:43 |
| *** jaosorior has quit IRC | 18:43 | |
| mgagne | jeblair I'm selfish, I don't see an internap provider centric dashboard :D | 18:44 |
| jeblair | mgagne: we can go ahead and make one there :) | 18:44 |
| AJaeger | could I get another pair of eyes on mordred's change for run-pep8 in project-config, please? https://review.openstack.org/#/c/255466 It has two +2s but was not approved, so if somebody wants to check, it would be nice - otherwise I'll approve tomorrow... | 18:44 |
| jeblair | mgagne: i've been going around and getting okays from our existing providers (ovh and bluebox are both okay, still need to talk to rax) which is why we haven't done it yet | 18:44 |
| mgagne | jeblair right, just looking for a way to get more details about how upstream uses our resources =) | 18:44 |
| mgagne | cool | 18:45 |
| *** tzn has quit IRC | 18:45 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Add wheel_mirror_slaves that use pypi-mirror https://review.openstack.org/165240 | 18:45 |
| waynr | zxiiro zaro, either of you have any insight into why commits targeting the feature/2.0.x branch of jenkins-job-builder would be taking in the range of 14-20 minues on the jenkins-job-builder-compare-xml test? | 18:46 |
| *** sabeen1 has quit IRC | 18:46 | |
| zxiiro | waynr: I have no idea | 18:46 |
| *** ihrachys has quit IRC | 18:47 | |
| *** ayoung has joined #openstack-infra | 18:47 | |
| clarkb | jeblair: ya paging it back in for review | 18:48 |
| jeblair | thx | 18:48 |
| jlvillal | So on puppet. Are the modules it executes in /etc/puppet/ ? I updated the code in there and I get the same error message. So then I updated the error message but I don't see my change. | 18:49 |
| jlvillal | Just wondering if the modules put in /etc/puppet/ are just there to confuse people like me :) | 18:49 |
| jlvillal | I had tried modifying /etc/modules/pip/lib/puppet/provider/package/pip3.rb | 18:49 |
| clarkb | jlvillal: /etc/puppet/modules | 18:50 |
| jlvillal | clarkb: Aha, I found it :) /usr/lib/ruby/vendor_ruby/puppet/provider/package/pip.rb | 18:50 |
| jlvillal | clarkb: Sorry I meant to say: /etc/puppet/modules/pip/lib/puppet/provider/package/pip3.rb | 18:51 |
| jlvillal | That code is ignored. | 18:51 |
| jlvillal | clarkb: Changing /usr/lib/ruby/vendor_ruby/puppet/provider/package/pip.rb made it work | 18:51 |
| clarkb | pip3 is only for python3 | 18:51 |
| clarkb | and you ahve to set it as the provider explicitly iirc | 18:51 |
| jlvillal | clarkb: Ah, thanks for the info. First time ever running puppet. | 18:52 |
| *** rbrndt__ has quit IRC | 18:52 | |
| * krotscheck is pondering how to rsync built wheels into an AFS-and-pip-sensitive folder structure without having to hit every file :/ | 18:52 | |
| *** arxcruz has quit IRC | 18:53 | |
| AJaeger | thanks, anteaya ! | 18:53 |
| anteaya | AJaeger: welcome, it looks fairly straightward from what I understand, if I am wrong, then I get to learn what I should have done | 18:54 |
| mordred | krotscheck: hitting every file in the read-write volume should be fine - since the volume in question should be local | 18:54 |
| mordred | krotscheck: and it shouldn't mess with the caches on the readonly volumes or hosts | 18:54 |
| krotscheck | mordred: I'm trying to land wheel pre-afs | 18:54 |
| krotscheck | Because faster things are awesome, and I don't have a schedule on that bandersnatch patch. | 18:55 |
| mordred | krotscheck: nod. mainly just trying to say I don't think you have to be _too_ careful about not hitting every file - unless I'm missing an important (which is quite possible) | 18:55 |
| mordred | ++ | 18:55 |
| *** rbrndt__ has joined #openstack-infra | 18:55 | |
| clarkb | mordred: did we figure out what the slow stating of large dirs was about? | 18:55 |
| clarkb | rsync may bump into that depending on dir structure | 18:55 |
| mordred | clarkb: I have not poked in to it more | 18:56 |
| krotscheck | mordred: My current theory is building the desired folder structure with symlinks. | 18:56 |
| krotscheck | And then rsyncing that. | 18:56 |
| *** tonytan_brb has joined #openstack-infra | 18:57 | |
| krotscheck | THe way these wheel slaves are currenlty set up, they don't clean their output directory | 18:57 |
| *** hdd_ has joined #openstack-infra | 18:57 | |
| *** hdd has quit IRC | 18:58 | |
| mordred | lifeless: what branch do we need / why? | 18:58 |
| *** sshnaidm_ has quit IRC | 18:58 | |
| mordred | lifeless: there is a stable/liberty branch already and a master branch | 18:59 |
| *** tonytan4ever has quit IRC | 18:59 | |
| *** isaacb has joined #openstack-infra | 18:59 | |
| *** baoli has quit IRC | 18:59 | |
| *** jsavak has joined #openstack-infra | 19:00 | |
| fungi | meeting time! see you all in #openstack-meeting | 19:00 |
| openstackgerrit | Merged openstack-infra/project-config: Do the sdist check in a virtualenv https://review.openstack.org/255466 | 19:00 |
| *** baoli has joined #openstack-infra | 19:00 | |
| *** tonytan_brb has quit IRC | 19:02 | |
| *** _nadya_ has quit IRC | 19:02 | |
| *** tonytan4ever has joined #openstack-infra | 19:03 | |
| *** amuller_afk is now known as amuller | 19:04 | |
| *** signed8b_ is now known as signed8bit_ZZZzz | 19:04 | |
| openstackgerrit | Mathieu Gagné proposed openstack-infra/system-config: gerrit: Add borders to test result table https://review.openstack.org/263866 | 19:06 |
| *** erikwilson has joined #openstack-infra | 19:06 | |
| *** jsavak has quit IRC | 19:07 | |
| *** jsavak has joined #openstack-infra | 19:07 | |
| *** ociuhandu has quit IRC | 19:09 | |
| lifeless | mordred: yeah, kilo | 19:10 |
| lifeless | mordred: setuptools 19.2 has a fix that means pbr's 'patch all the commands' code actually starts working properly | 19:10 |
| mordred | lifeless: ah - we need a stable/kilo - can you give me a sha from which to start it? | 19:11 |
| lifeless | mordred: of course, pbr's testr glue command (in kilo) breaks if testr isn't installed | 19:11 |
| lifeless | mordred: 0.11 | 19:11 |
| *** harlowja_at_home has quit IRC | 19:11 | |
| lifeless | mordred: erm 0.11.0 | 19:11 |
| mordred | lifeless: kk | 19:12 |
| *** gampel has joined #openstack-infra | 19:12 | |
| mordred | lifeless: done | 19:12 |
| lifeless | mordred: thanks. Nakato ^ | 19:13 |
| *** rbrndt__ has quit IRC | 19:13 | |
| *** harlowja_at_home has joined #openstack-infra | 19:14 | |
| *** thiagop has joined #openstack-infra | 19:17 | |
| krotscheck | mordred, jeblair: Either /a/a-versionthing.whl or /a/b/ablongerthanonecharacter-versionthing.whl? | 19:19 |
| krotscheck | or is it /a/{packagename}/{packagename}-{version}.whl, I don't quite recall. | 19:19 |
| mordred | krotscheck: I think jeblair was doing /a/b//ablonger | 19:19 |
| *** trown|lunch is now known as trown | 19:20 | |
| krotscheck | Ok, so it's the first character, second character if it exists, packagename as dir, and then package file itself. Check. | 19:20 |
| *** rbrndt__ has joined #openstack-infra | 19:21 | |
| *** davideagnello has quit IRC | 19:21 | |
| *** otter768 has joined #openstack-infra | 19:22 | |
| mordred | krotscheck: I _think_ | 19:24 |
| jeblair | krotscheck, mordred: yep | 19:24 |
| mordred | jeblair: does your rewrite take in to account single-character things? | 19:24 |
| *** bdemers has left #openstack-infra | 19:24 | |
| mordred | jeblair: like /a/a.whl ? | 19:24 |
| jeblair | mordred: yep | 19:24 |
| jeblair | a/b/abcdef.whl and a/a.whl | 19:24 |
| *** otter768 has quit IRC | 19:27 | |
| *** aopincar has quit IRC | 19:27 | |
| greghaynes | clarkb: did you say friday might be ok for you to do builders? | 19:27 |
| greghaynes | clarkb: trying to figure out when is a potential good time for me... | 19:27 |
| clarkb | ya | 19:28 |
| clarkb | I hvae doctors next two days | 19:28 |
| greghaynes | Next two days a pretty bad for me too | 19:28 |
| greghaynes | clarkb: so try for friday morning? I have family in town but I should be able to get stuff done in the morning | 19:28 |
| clarkb | sure | 19:29 |
| nibalizer | ill be plane | 19:31 |
| nibalizer | i mean I'll be on a plane or getting ready to be on one friday mornign | 19:31 |
| nibalizer | but I think yall said the puppet stuff isn't actually required? | 19:32 |
| greghaynes | nibalizer: this bit is no puppet | 19:32 |
| clarkb | yup first step is no puppet, next step is puppet | 19:32 |
| *** salv-orlando has joined #openstack-infra | 19:33 | |
| sdague | AJaeger: that part seems fine on it's own | 19:34 |
| sdague | if folks feel they have an answer to the rest of it, it's fine | 19:34 |
| AJaeger | thanks, sdague | 19:34 |
| AJaeger | will you +2? | 19:35 |
| AJaeger | ah, you did - thanks | 19:35 |
| *** salv-orlando has quit IRC | 19:38 | |
| *** daemontool has quit IRC | 19:39 | |
| *** daemontool has joined #openstack-infra | 19:41 | |
| *** dslev has quit IRC | 19:42 | |
| *** eharney_ has joined #openstack-infra | 19:43 | |
| *** baoli has quit IRC | 19:43 | |
| *** eharney has quit IRC | 19:45 | |
| *** sabeen1 has joined #openstack-infra | 19:46 | |
| *** jcoufal has quit IRC | 19:46 | |
| *** Sukhdev has joined #openstack-infra | 19:47 | |
| *** davideagnello has joined #openstack-infra | 19:47 | |
| *** hashar has joined #openstack-infra | 19:47 | |
| *** sabeen3 has joined #openstack-infra | 19:47 | |
| *** daemontool has quit IRC | 19:47 | |
| *** daemontool has joined #openstack-infra | 19:48 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Bug fix: Cinder v2 returns bools now https://review.openstack.org/263764 | 19:48 |
| *** sabeen1 has quit IRC | 19:50 | |
| *** baoli has joined #openstack-infra | 19:50 | |
| *** daemontool has quit IRC | 19:51 | |
| *** devananda has quit IRC | 19:54 | |
| *** harlowja_at_home has quit IRC | 19:54 | |
| openstackgerrit | Mathieu Gagné proposed openstack-infra/system-config: gerrit: Add borders to test result table https://review.openstack.org/263866 | 19:55 |
| openstackgerrit | Merged openstack-infra/project-config: fix stable/liberty telemetry integration job https://review.openstack.org/258642 | 19:57 |
| krotscheck | jeblair: Case sensitive? /B/a/Babel is different from /b/a/babel | 19:57 |
| clarkb | krotscheck: I want to say packages themselves are not case sensitive | 19:58 |
| clarkb | becuase windows | 19:58 |
| *** ddanielroche has joined #openstack-infra | 19:58 | |
| krotscheck | jeblair: Also, pip prefers /packagename/packagename-version-things.whl. Would that then map to /p/a/packagename/packagename-version-things.whl, or does the package-named directory need to go? | 19:58 |
| clarkb | so pip install Babel and pip install babel should install the same thing | 19:58 |
| jeblair | krotscheck: i think my regexes just pass through whatever, so i think the rewrite is case sensitive (but the tool may not be) | 19:59 |
| *** weshay__xchat is now known as weshay | 19:59 | |
| *** lucasagomes is now known as lucas-dinner | 19:59 | |
| *** ayoung has quit IRC | 19:59 | |
| *** devananda has joined #openstack-infra | 20:00 | |
| jeblair | krotscheck: i am not 100% positive on that | 20:00 |
| anteaya | I'm in favour of slowly weaning ourselves off of hpcloud so the sunset is not abrupt | 20:01 |
| krotscheck | Well, URL's are case sensitive. | 20:01 |
| *** eharney_ is now known as eharney | 20:01 | |
| fungi | clarkb: i'd be fine with turning down hpcloud sooner, especially if it's being problematic and needing intervention frequently anyway | 20:01 |
| *** jsavak has quit IRC | 20:01 | |
| *** gampel1 has joined #openstack-infra | 20:02 | |
| *** jsavak has joined #openstack-infra | 20:02 | |
| mordred | anteaya: ++ to weaning | 20:02 |
| AJaeger | looking at our nodes stats, we're maxing out, don't we? So, if it works, I would leave it running - but if maintenance is expensive... | 20:02 |
| clarkb | I want us off of it before the 31st | 20:03 |
| anteaya | clarkb: want to offer a series of patches pulling us back with suggested dates for merging? | 20:03 |
| clarkb | if we want to wean off of it do a chagne a week until 0 of equal increments? | 20:03 |
| nibalizer | I don't see what the value of that would be | 20:03 |
| fungi | i don't known what a slow turn-down buys us | 20:03 |
| anteaya | AJaeger: well all that will happen if we leave it at max until it is abruptly shut off is that we are flooded with angry devs week of feb 1 | 20:03 |
| fungi | yeah, what nibalizer said | 20:03 |
| *** gampel has quit IRC | 20:03 | |
| anteaya | AJaeger: I'm not in favour | 20:03 |
| *** ddanielroche has left #openstack-infra | 20:04 | |
| anteaya | it communicates a change to the community | 20:04 |
| fungi | turning it off sooner than the deadline so it's under our control and not a zomgemergency sounds good, but slowly decreasing it doesn't seem like it's much use | 20:04 |
| anteaya | either way | 20:04 |
| nibalizer | we could send some emails to the list I guess | 20:04 |
| fungi | we already did | 20:04 |
| anteaya | mostly if we are going to have a flood I'd like to be prepared | 20:05 |
| fungi | months ago | 20:05 |
| nibalizer | HPE has done a pretty good job of publicising that its being turned off | 20:05 |
| fungi | but a reminder might make sense | 20:05 |
| AJaeger | and getting it in the weekly newsletter ;) | 20:05 |
| nibalizer | I don't want to promise that infra-cloud can provide nodes by jan 31st but it is getting really close now | 20:05 |
| fungi | a pingee for thingee perhaps | 20:05 |
| clarkb | ya I too think just turning it off all at once makes the most sense and being prepared to do that | 20:06 |
| clarkb | that way wwe can take advantage of the resources until that time | 20:06 |
| fungi | nibalizer: well, we've got ovh ramped up, bb close, internap on the way... | 20:06 |
| nibalizer | those are pretty small node counts though rightt? | 20:06 |
| *** Eva-i has quit IRC | 20:06 | |
| clarkb | one thing to note is that none of the not rax and not hpcloud clouds run unittests | 20:06 |
| nibalizer | collectively they aren't even half of hpe iirc | 20:06 |
| fungi | together they're fairly substantial | 20:06 |
| anteaya | nibalizer: well we have been in the onboard phase for at least a month | 20:07 |
| anteaya | each provider has their own quirks and we have to build a relationship | 20:07 |
| clarkb | what I really want to avoid is nodepool having a bad day on february 1st | 20:07 |
| *** rguillebert has quit IRC | 20:07 | |
| clarkb | so just want to make sure we control the shutoff on our side | 20:07 |
| thingee | fungi, clarkb ack | 20:08 |
| nibalizer | I think we should communicate to the devs what is happening, I don't think we should turn it down ahead of schedule, I do think we should turn it off ourselves instead of waiting for it to dissapear | 20:08 |
| AJaeger | clarkb: agreed. So, it should be done at least on Friday the 29th, so planninga few days buffer, I would say 25th as the latest date. | 20:09 |
| clarkb | I am looking at a calendar, jan 29th is friday | 20:09 |
| clarkb | AJaeger is ahead of me | 20:09 |
| *** Eva-i has joined #openstack-infra | 20:09 | |
| AJaeger | clarkb: we had the same idea - counting backwards | 20:09 |
| clarkb | ya so maybe write the change, then make a note for infra-root to get it merged. I and fungi I think are afkish 24th-28th | 20:10 |
| clarkb | and I think others are headed to LCA early feb | 20:10 |
| nibalizer | and fosdem | 20:10 |
| *** ayoung has joined #openstack-infra | 20:10 | |
| nibalizer | ok sounds like a plan? | 20:11 |
| fungi | i'm not super worried about a sudden drop in quota. we frequently end up consuming whatever quota we have for as long as necessary to work through the backlog. this will be no different from having an increase in workload or an extended hpcloud outage (no offense to anyone, but we have seen some of those in the past) | 20:11 |
| *** jsavak has quit IRC | 20:11 | |
| *** hdd_ has quit IRC | 20:11 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Bug fix: Cinder v2 returns bools now https://review.openstack.org/263764 | 20:11 |
| nibalizer | fungi: good point | 20:11 |
| *** jsavak has joined #openstack-infra | 20:11 | |
| clarkb | ya, I will go ahead and write the change to set max-servers to -1 and a follow up to remove the config from nodepool.yaml and clouds.yaml | 20:12 |
| clarkb | then WIP them | 20:12 |
| fungi | at the end of the day, we have whatever capacity we have. sometimes that means devs wait a while for job results. situation normal | 20:12 |
| fungi | thanks clarkb! i'll leave it on the meeting agenda so we can revisit next tuesday | 20:12 |
| krotscheck | jeblair: Ok, so if pip is expecting /packagename/packagename-version.whl, which of these two would you prefer? http://paste.openstack.org/show/483066/ http://paste.openstack.org/show/483067/ | 20:12 |
| clarkb | then we can merge the max-server change a few days early, giving us time to clean it up and remove it from the config completely | 20:12 |
| fungi | wfm | 20:12 |
| *** purp_too is now known as purp | 20:13 | |
| nibalizer | wfm | 20:13 |
| AJaeger | likewise | 20:13 |
| anteaya | clarkb: are you lca'ing this year? | 20:13 |
| clarkb | anteaya: no I have a foundation thing | 20:13 |
| fungi | as do i | 20:14 |
| * anteaya is not as going from nova mid-cycle to au seemed like to much this year | 20:14 | |
| anteaya | ah, well happy foundation thing then | 20:14 |
| clarkb | and decided trying to do both and leaving larissa at home with babies for that long would end up with bad things happening when I got home | 20:14 |
| *** signed8bit_ZZZzz is now known as signed8b_ | 20:14 | |
| krotscheck | clarkb: I feel your pain. | 20:14 |
| fungi | anteaya: yeah, since our staff are spread out and normally only see each other twice a year at summits, we try to pick a few days in between summits to have other quarterly in-person meetings | 20:15 |
| crinkle | clarkb: hey, ready for wiki/nodepool downtime at 2100? | 20:15 |
| krotscheck | clarkb: btw, my wife & baby are joining me for Barcelona, but probably not Austin. Are you bringing the fam, and if so, can we collaborate on childcare? | 20:15 |
| anteaya | clarkb: sounds like you are making good choices | 20:15 |
| anteaya | fungi: sounds like a recipe for sanity to me | 20:15 |
| anteaya | fungi clarkb where are you frolicing this year? | 20:16 |
| krotscheck | rbradfor may also be interested in joint childcare arrangments @ summit things. | 20:16 |
| clarkb | crinkle: yes, should I go ahead and disable puppet on wiki.o.o and nodepool.o.o so I can approve the change to bump the mysql version? | 20:16 |
| *** mudassirlatif has quit IRC | 20:17 | |
| crinkle | clarkb: sure, we can also approve https://review.openstack.org/#/c/258193/ first without hurting anything | 20:17 |
| *** Sukhdev has quit IRC | 20:17 | |
| clarkb | crinkle: then I can more gracefully stop services, do db backup, run puppet, start services | 20:17 |
| *** jsavak has quit IRC | 20:17 | |
| fungi | anteaya: the yucatan coast of mexico, gulf side, mostly because it's cheap and easy to get to/from | 20:17 |
| *** mudassirlatif has joined #openstack-infra | 20:17 | |
| anteaya | nice | 20:18 |
| anteaya | I like it there, or did when I was there long ago | 20:18 |
| *** otter768 has joined #openstack-infra | 20:18 | |
| *** mudassirlatif has quit IRC | 20:18 | |
| fungi | well, it reduces the risk of any of us stuck when nyc or chicago area airports inevitably end up buried in white stuff | 20:18 |
| anteaya | indeed it does | 20:18 |
| *** ociuhandu has joined #openstack-infra | 20:19 | |
| *** krtaylor has quit IRC | 20:19 | |
| clarkb | crinkle: let me stop puppet first because the nI can approve whatever without worrying | 20:19 |
| clarkb | crinkle: I am doing that now | 20:19 |
| *** mudassirlatif has joined #openstack-infra | 20:19 | |
| crinkle | clarkb: kk | 20:19 |
| fungi | which befell me when we did one in utah. all flights through chicago were cancelled, and the passenger backlog meant the earliest they could rebook me into a seat was going to be a couple days later | 20:19 |
| *** otter768 has quit IRC | 20:19 | |
| anteaya | basically missing the in person event | 20:20 |
| *** mudassirlatif has quit IRC | 20:20 | |
| fungi | nah, that was at least after the event, so it was delaying my ability to get home | 20:21 |
| anteaya | by getting to know many airport staff and passengers whilst typing which you do such a great job of at home | 20:21 |
| anteaya | ah | 20:21 |
| anteaya | you do have some great getting home after event stories, I must say | 20:21 |
| *** annegentle has joined #openstack-infra | 20:21 | |
| clarkb | ok those two should no longer have ansible run puppet happen | 20:21 |
| clarkb | the ansible emergency hosts file is updated to add them | 20:22 |
| clarkb | krotscheck: I have a feeling that it may just be me | 20:22 |
| fungi | i ended up getting them to find me an open seat on a flight to phx, where i slept in a chair in one of the terminals and found a four-stop redeye the next morning to get me from phx to near home that night | 20:22 |
| Clint | four-stop redeye, you say | 20:22 |
| clarkb | krotscheck: though I need to do more research on what our seat options are. With twins apparently most of the time you end up in different rows due to oxygen mask availability or something | 20:22 |
| fungi | so slightly quicker than waiting two days for another same-day itenerary from slc to home | 20:23 |
| *** arxcruz has joined #openstack-infra | 20:23 | |
| fungi | Clint: yeah, one of those insane commuter hoppers that goes from one mid-sized regional airport to another working its way across the country | 20:23 |
| *** peristeri has joined #openstack-infra | 20:23 | |
| Clint | i don't know about those! | 20:24 |
| clarkb | krotscheck: they are definitely getting a lot easier to deal with as they get older | 20:24 |
| clarkb | but that could all change tomorrow | 20:24 |
| krotscheck | clarkb: Yeah I know. We did Hawaii a few weeks ago though, and S. was super, super easy | 20:24 |
| *** signed8b_ is now known as signed8bit_ZZZzz | 20:24 | |
| *** gyee has quit IRC | 20:25 | |
| fungi | Clint: er, not a redeye. departed early in the morning and got in late at night, so the opposite of a redeye. a blackeye? | 20:25 |
| krotscheck | Until he got there. Then he was all "What is this 'warm weather' thing, gimme my seattle rain!" | 20:25 |
| Clint | that makes me hungry | 20:25 |
| krotscheck | clarkb: LMK if y'all end up deciding to make it a family vacation. I'll reach out to the foundation about childcare. | 20:25 |
| anteaya | fungi: wow, I just I don't know what to say | 20:27 |
| anteaya | I do like pbx airport though, but never had to spend the night there | 20:27 |
| clarkb | crinkle: and we aren't doing the backwrad forward compat thing with the non test slave manifests? | 20:27 |
| fungi | anteaya: well, they had good wifi, so i mostly stayed up and did code review if memory serves. it was very quiet there overnight! | 20:28 |
| crinkle | clarkb: no, since it's all in system-config it should be all atomic so there should be no need | 20:28 |
| *** e0ne has quit IRC | 20:28 | |
| fungi | also managed to find a lounge where they'd left one of the televisions on all night, set to a channel with classic cartoons, so it wasn't so bad | 20:29 |
| clarkb | oh right I remember asking the same question before, sorry | 20:29 |
| crinkle | np | 20:29 |
| anteaya | yay cartoons | 20:29 |
| clarkb | crinkle: the change you linked is approved, looking at the system-config change now | 20:29 |
| anteaya | which do you consider the classics? | 20:29 |
| anteaya | bugs bunny? | 20:29 |
| fungi | anteaya: sure | 20:29 |
| fungi | anything from ~1960..1980 i guess' | 20:29 |
| *** AJaeger has quit IRC | 20:30 | |
| * anteaya makes a note | 20:30 | |
| anteaya | I found a television station in utah that played old televison shows | 20:30 |
| anteaya | leave it to beaver, my three sons | 20:30 |
| anteaya | I couldn't remember last time I had seen any of those | 20:31 |
| clarkb | crinkle: then my plan is do nodepool first since its data is mostly ephemeral | 20:31 |
| anteaya | it was awesome | 20:31 |
| clarkb | I worry less about it :) | 20:31 |
| *** signed8bit_ZZZzz is now known as signed8b_ | 20:31 | |
| fungi | yeah, nodepool outages are also relatively painless for us | 20:31 |
| crinkle | clarkb: okay | 20:31 |
| fungi | unless it goes on for hours, we're generally the only ones who know it's down | 20:31 |
| fungi | however, it does usually destroy our image updates for the day | 20:32 |
| *** rfolco has quit IRC | 20:32 | |
| fungi | so if you don't kill it until after the dib uploads have finished, that's even less impact | 20:32 |
| *** Sukhdev has joined #openstack-infra | 20:33 | |
| *** yolanda has quit IRC | 20:33 | |
| *** yolanda has joined #openstack-infra | 20:34 | |
| clarkb | well we are scheduled for start at 2100 | 20:34 |
| *** sparkyco_ has joined #openstack-infra | 20:36 | |
| *** mudassirlatif has joined #openstack-infra | 20:36 | |
| clarkb | and system config chagne is approved now | 20:37 |
| *** andreykurilin__ has joined #openstack-infra | 20:37 | |
| *** mudassirlatif has quit IRC | 20:37 | |
| *** weshay has quit IRC | 20:38 | |
| *** terriyu has quit IRC | 20:40 | |
| clarkb | crinkle: so now we wait | 20:40 |
| openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Add heat lbaas specific test for v1 and v2 https://review.openstack.org/237156 | 20:40 |
| crinkle | clarkb: mmk | 20:40 |
| *** signed8b_ is now known as signed8bit_ZZZzz | 20:41 | |
| *** piet has joined #openstack-infra | 20:41 | |
| openstackgerrit | Merged openstack-infra/puppet-nodepool: Add logic to work with old and new mysql module https://review.openstack.org/258193 | 20:42 |
| pleia2 | cat tended to and me fed | 20:42 |
| anteaya | pleia2: yay | 20:42 |
| anteaya | pleia2: welcome back | 20:42 |
| pleia2 | anteaya: thanks | 20:42 |
| isaacb | clarkb: Hi, following our talk last week about timing the cron job in puppet master, can you please look in https://review.openstack.org/#/c/262466/ | 20:42 |
| *** signed8bit_ZZZzz is now known as signed8b_ | 20:44 | |
| openstackgerrit | Merged openstack-infra/system-config: Upgrade mysql module to 3.6.1 https://review.openstack.org/257640 | 20:44 |
| *** piet has quit IRC | 20:45 | |
| *** piet has joined #openstack-infra | 20:45 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:45 | |
| clarkb | isaacb: when I am done with the puppet-mysql trainsition | 20:45 |
| clarkb | crinkle: and you said that mysql will flap as part of this right? | 20:46 |
| *** mudassirlatif has joined #openstack-infra | 20:46 | |
| isaacb | clarkb: thanks. | 20:46 |
| clarkb | crinkle: it won't do that on every puppet run just as part of the initial transition because of hte ocnfig file changes? | 20:46 |
| clarkb | (this was how I understood it at least) | 20:46 |
| crinkle | clarkb: correct, the newer module is going to rearrange some things in my.cnf, it will only do it once | 20:47 |
| *** Sukhdev has quit IRC | 20:47 | |
| *** jsavak has joined #openstack-infra | 20:49 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add option to use the wall time instead of the sum to run_time_meta https://review.openstack.org/231764 | 20:52 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: WIP: Kinda hacky double sorted run time meta https://review.openstack.org/234494 | 20:52 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new graph time for variance of individual tests https://review.openstack.org/230611 | 20:52 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new graph type to show run_time variance by metadata https://review.openstack.org/210569 | 20:52 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add a db api call to provide a rough wall time for a given run https://review.openstack.org/231762 | 20:52 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add run_time_meta arge to specify values to use in graph https://review.openstack.org/231763 | 20:52 |
| *** weshay has joined #openstack-infra | 20:53 | |
| *** eharney has quit IRC | 20:53 | |
| rbradfor | krotscheck, maybe, that would enable them to come, likewise, probably barcelona would be a good goal. | 20:55 |
| pabelanger | fungi: nibalizer: pleia2: do you mind reviewing: https://review.openstack.org/#/c/229232/ | 20:55 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add option to use the wall time instead of the sum to run_time_meta https://review.openstack.org/231764 | 20:56 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: WIP: Kinda hacky double sorted run time meta https://review.openstack.org/234494 | 20:56 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new graph time for variance of individual tests https://review.openstack.org/230611 | 20:56 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new graph type to show run_time variance by metadata https://review.openstack.org/210569 | 20:56 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add a db api call to provide a rough wall time for a given run https://review.openstack.org/231762 | 20:56 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add run_time_meta arge to specify values to use in graph https://review.openstack.org/231763 | 20:56 |
| *** piet has quit IRC | 20:57 | |
| pleia2 | pabelanger: sure, having a look | 20:57 |
| *** tzn has joined #openstack-infra | 20:59 | |
| clarkb | crinkle: it is time, I will be stopping nodepool, dumping the db, and running puppet momentarily | 21:00 |
| *** baoli has quit IRC | 21:00 | |
| clarkb | (I also confirmed that the new version of mysql module is on the master) | 21:00 |
| crinkle | clarkb: cool | 21:00 |
| clarkb | nibalizer: mordred fungi puppet agent --test is still the way to run puppet ya? | 21:00 |
| nibalizer | ya | 21:00 |
| mordred | yah | 21:01 |
| clarkb | kk thanks | 21:01 |
| *** krtaylor has joined #openstack-infra | 21:01 | |
| *** kzaitsev_mb has quit IRC | 21:02 | |
| *** ayoung has quit IRC | 21:02 | |
| clarkb | ok service is stopped and mysqldump is made, running puppet now | 21:03 |
| clarkb | nodepool is running again | 21:05 |
| crinkle | it looks good in puppetboard | 21:06 |
| waynr | zaro zxiiro hashar I think this review is ready to go: https://review.openstack.org/#/c/133465/ | 21:06 |
| fungi | clarkb: it's what i ended up doing on paste.o.o on sunday night, at least | 21:06 |
| clarkb | yup sees to be working so far | 21:06 |
| clarkb | I didn't see any tracebacks about nodepool complaining about mysql things | 21:07 |
| clarkb | I am going to rerun puppet to prove that it won't flap myslq again | 21:07 |
| zxiiro | waynr: looking | 21:07 |
| waynr | not sure if we should wait for Darragh/electrofelix (and maybe i shouldn't have +2'd it since I last updated it) | 21:09 |
| clarkb | crinkle: hrm ps seems to indicate mysqld has been running since 2015 | 21:09 |
| clarkb | so it may not actually flap the service | 21:09 |
| jeblair | mordred: do you have time to approve https://review.openstack.org/252000 or should i just do it? | 21:09 |
| clarkb | mordred: does mysql do config reloads on the fly? | 21:09 |
| mordred | jeblair: lookig | 21:09 |
| mordred | clarkb: no | 21:09 |
| crinkle | clarkb: that is strange | 21:10 |
| mordred | clarkb: some settings you can set on the fly | 21:10 |
| mordred | programatically | 21:10 |
| mordred | some you cannot - the mysql docs indicate which can be set live | 21:10 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add option to use the wall time instead of the sum to run_time_meta https://review.openstack.org/231764 | 21:10 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: WIP: Kinda hacky double sorted run time meta https://review.openstack.org/234494 | 21:10 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new graph time for variance of individual tests https://review.openstack.org/230611 | 21:10 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add a db api call to provide a rough wall time for a given run https://review.openstack.org/231762 | 21:10 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add run_time_meta arge to specify values to use in graph https://review.openstack.org/231763 | 21:10 |
| *** piet has joined #openstack-infra | 21:10 | |
| mordred | clarkb: do you have a setting that has been changed? | 21:10 |
| crinkle | clarkb: it looks like whether to restart is controlled in puppet, https://github.com/puppetlabs/puppetlabs-mysql/blob/master/manifests/params.pp#L6 | 21:11 |
| crinkle | clarkb: i'm not sure why it restarted when i was testing it then | 21:11 |
| clarkb | mordred: puppet has rewritten the mysql.conf so mostly just want to sanity check it comes back with the new config that is euqivalent | 21:11 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Reorder imports to match hacking guidelines https://review.openstack.org/133465 | 21:11 |
| mordred | gotcha | 21:11 |
| mordred | clarkb: so - fwiw: show global variables like 'innodb_buffer_pool_size'; | 21:11 |
| clarkb | crinkle: do you think I should stop nodepool again, bounce mysqld, then start nodepool? | 21:12 |
| mordred | is how you verify a config setting is in the running mysql | 21:12 |
| clarkb | mordred: thanks | 21:12 |
| crinkle | clarkb: yes | 21:12 |
| mordred | but in this case bouncing both might be easier | 21:12 |
| clarkb | ya I will go ahead and do that now | 21:12 |
| *** hdd has joined #openstack-infra | 21:13 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Rename puppet-community to voxpupuli https://review.openstack.org/263910 | 21:14 |
| clarkb | thats done and seems to be working | 21:14 |
| crinkle | okay | 21:14 |
| clarkb | I will be sure to check mysqld on wiki before starting apache and fast cgi things | 21:14 |
| *** ajmiller has quit IRC | 21:14 | |
| *** rockyg has joined #openstack-infra | 21:14 | |
| clarkb | now I want to say in the psat we have stopped php-fpm and apache both in order to stop the wiki service | 21:16 |
| clarkb | fungi: ^ is that what you remember? | 21:16 |
| fungi | clarkb: yeah, php-fpm tends to cache the php source | 21:16 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: use default from address for emails https://review.openstack.org/263912 | 21:16 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: add command to actually send email announcements https://review.openstack.org/263913 | 21:16 |
| *** ajmiller has joined #openstack-infra | 21:17 | |
| fungi | so restarting it is good if you need some stuff reloaded from disk | 21:17 |
| clarkb | I don't think I need tat but better safe than sorry | 21:17 |
| *** kgiusti has left #openstack-infra | 21:18 | |
| *** rhallisey has quit IRC | 21:18 | |
| clarkb | ok stopping apache and php-fpm on wiki now | 21:18 |
| *** amitgandhinz has quit IRC | 21:19 | |
| clarkb | waiting it says | 21:19 |
| *** amitgandhinz has joined #openstack-infra | 21:20 | |
| clarkb | mysql dump is dumping | 21:20 |
| *** chlong has quit IRC | 21:22 | |
| *** zzzeek has quit IRC | 21:22 | |
| *** zzzeek has joined #openstack-infra | 21:22 | |
| clarkb | (and still going this db is fairly large I guess that is to be expected) | 21:22 |
| clarkb | and its done, running puppet agent --test now | 21:23 |
| *** annegentle has quit IRC | 21:24 | |
| clarkb | and thats still going | 21:25 |
| clarkb | Error: Could not retrieve catalog; skipping run | 21:26 |
| rajinir | asselin: Nodepool successfully added the node to the jenkins and slave is ready. But when I make commits to the ci-sandbox, zuul is only sending emails (Silient check ones), jenkins jobs are not triggered. Any ideas? | 21:26 |
| *** weshay has quit IRC | 21:26 | |
| jeblair | mordred: thanks. waiting on you to review then i'll land and restart nodepool. | 21:26 |
| clarkb | crinkle: nibalizer ^ is that just a retry error or a go digging on the puppetmaster error? | 21:26 |
| crinkle | clarkb: that makes it seem like it can't contact the puppetmaster or isn't in site.pp | 21:27 |
| crinkle | retry first | 21:27 |
| clarkb | crinkle: it did get the new plugin stuff at the start fwiw | 21:27 |
| *** aeng has quit IRC | 21:27 | |
| clarkb | retying | 21:27 |
| crinkle | that's weird that it would get part of the catalog | 21:28 |
| clarkb | there it goes, maybe just contention with the master | 21:28 |
| crinkle | okay | 21:28 |
| clarkb | and mysqld was not restarted so restarting it now | 21:28 |
| mordred | jeblair: did you see dougwig's comment? | 21:28 |
| mordred | jeblair: (I'm happy to think about that later - just wanted to make sure you saw it) | 21:29 |
| mriedem | clarkb: $100 if you pull a tonya harding on russell wilson's leg before sunday | 21:29 |
| mriedem | easy money | 21:29 |
| *** kzaitsev_mb has joined #openstack-infra | 21:29 | |
| *** claudiub has quit IRC | 21:29 | |
| clarkb | ok starting wiki and php fpm now | 21:29 |
| clarkb | mriedem: but I want him to win | 21:30 |
| jlvillal | I am (still) trying to do 'Simulating Devstack Gate Tests' https://github.com/openstack-infra/devstack-gate I got to the part of doing: ./safe-devstack-vm-gate-wrap.sh | 21:30 |
| jeblair | mordred: yep, responded | 21:30 |
| jlvillal | But it errors because stuff isn't in /opt/stack/ | 21:30 |
| asselin | rajinir, not sure.....what's in the zuul debug.log file? | 21:30 |
| *** Sukhdev has joined #openstack-infra | 21:30 | |
| *** gyee has joined #openstack-infra | 21:30 | |
| clarkb | ok please to test wiki | 21:30 |
| crinkle | looks good in puppetboard and i can pull up the infra agenda | 21:31 |
| clarkb | home page loads for me, I am going to try editing something | 21:31 |
| jeblair | searching works | 21:31 |
| anteaya | here too | 21:31 |
| anteaya | I can log in | 21:32 |
| jeblair | i added a thing to the infra meeting agenda for zuulv3 | 21:32 |
| jlvillal | This is the output of trying to do the devstack-gate simulation: http://paste.openstack.org/show/483076/ | 21:32 |
| mordred | jeblair: cool. +A | 21:32 |
| nibalizer | jlvillal: n.b. https://git.openstack.org/cgit/openstack-infra/devstack-gate is the cannonical url | 21:32 |
| clarkb | I can make an edit | 21:32 |
| jlvillal | nibalizer: Those are the instructions I'm following :) | 21:32 |
| clarkb | cool so looks good to everyone? | 21:32 |
| clarkb | I am going to rerun puppet really quickly to confirm it noops now | 21:33 |
| dougwig | jeblair: heh, i saw the note in the commit message, i did not see a why. it's likely just my latent dislike of how inconsistent openstack is with accepting id, name, or id/name. | 21:33 |
| jlvillal | Just wondering what devstack-gate is expecting to be in /opt/stack/ so I can also set that up too. | 21:34 |
| jeblair | dougwig: yeah, wasn't sure if you're question was "why?" or "why why?" :) | 21:34 |
| jeblair | dougwig: i'm not thrilled either :) | 21:34 |
| *** gyee has quit IRC | 21:34 | |
| clarkb | looks like the rerun may timeout again | 21:35 |
| anteaya | I can edit | 21:35 |
| clarkb | but once I get that to noop I can reenable puppet | 21:35 |
| anteaya | wiki seems to be wiki'ing for me | 21:36 |
| clarkb | yup it nooped | 21:37 |
| crinkle | sweet | 21:37 |
| clarkb | crinkle: from what you can see it looks good? | 21:37 |
| clarkb | if so I am ready to reenable puppeting on these two Vms | 21:37 |
| crinkle | clarkb: as far as i can tell | 21:37 |
| pleia2 | crinkle: nice work! | 21:38 |
| clarkb | then I can trigger a bare-trusty image build to check that puppet still works for the slave builds | 21:38 |
| rajinir | asselin: http://paste.openstack.org/show/483078/ | 21:38 |
| *** hashar has quit IRC | 21:39 | |
| clarkb | puppet is reenabled | 21:39 |
| rajinir | asselin: http://paste.openstack.org/show/483079/ - layout.yaml | 21:39 |
| crinkle | should i send an all-clear to the ml? | 21:40 |
| *** weshay has joined #openstack-infra | 21:40 | |
| clarkb | ya Ithink we are done (I just started the nodepool image build in rax-dfw | 21:40 |
| *** aeng has joined #openstack-infra | 21:40 | |
| crinkle | cool thank you clarkb | 21:40 |
| *** signed8b_ is now known as signed8bit_ZZZzz | 21:41 | |
| openstackgerrit | Merged openstack-infra/nodepool: Add 'public' attribute to 'networks' entry https://review.openstack.org/252000 | 21:41 |
| *** gyee has joined #openstack-infra | 21:41 | |
| anteaya | mgagne: ^ | 21:41 |
| mgagne | thanks, will wait for deployment if not done already =) | 21:42 |
| mordred | jeblair: nodepool change landed | 21:42 |
| anteaya | I think that a change to nodepool requires a nodepool restart | 21:42 |
| mgagne | I guess puppet needs to run first to update sources | 21:43 |
| mgagne | but I don't know all the details of how it's deployed now | 21:43 |
| anteaya | to be honest neither do I | 21:43 |
| jeblair | yep, puppet then manual restart | 21:43 |
| clarkb | and puppet is running again | 21:44 |
| nibalizer | crinkle: clarkb excellent! | 21:44 |
| pleia2 | yes, very nice to have mysql from this era :) | 21:46 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add option to use the wall time instead of the sum to run_time_meta https://review.openstack.org/231764 | 21:46 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: WIP: Kinda hacky double sorted run time meta https://review.openstack.org/234494 | 21:46 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new graph time for variance of individual tests https://review.openstack.org/230611 | 21:46 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new graph type to show run_time variance by metadata https://review.openstack.org/210569 | 21:46 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add a db api call to provide a rough wall time for a given run https://review.openstack.org/231762 | 21:46 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add run_time_meta arge to specify values to use in graph https://review.openstack.org/231763 | 21:46 |
| pleia2 | s/mysql/mysql module | 21:46 |
| asselin | rajinir, seems you have a chain of patches, that should work, but it makes debugging a bit more tricky. Try using a single patch without any dependencies. | 21:47 |
| asselin | also, try telnet localhost 4730 and type 'status' and paste the output | 21:47 |
| *** matrohon has joined #openstack-infra | 21:47 | |
| rajinir | asselin: status in telnet http://paste.openstack.org/show/483082/ | 21:48 |
| mordred | jeblair: fwiw: Forbidden: IP allocation over quota in pool external. (HTTP 403) (Request-ID: req-d99b99f2-e32e-4243-9243-130e8668f0a4) | 21:49 |
| mordred | we're getting floating ip quota issues in bluebox - I'm looking in to it | 21:49 |
| *** signed8bit_ZZZzz is now known as signed8b_ | 21:50 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: disable puppet-tuskar jobs on master https://review.openstack.org/263923 | 21:51 |
| asselin | rajinir, so none of the jobs are registered. you know this b/c none of them from your layout.yaml are listed there. Try deleting a nodepool node and let one get recreated and get the updated status. | 21:54 |
| clarkb | asselin: rajinir you can just offline online in jenkins | 21:54 |
| clarkb | or disable enable a job to dp that | 21:54 |
| *** annegentle has joined #openstack-infra | 21:55 | |
| sputnik13 | hate to keep asking, but this is gating a much needed feature for cue so... | 21:55 |
| sputnik13 | can someone with +2 for requirements please review https://review.openstack.org/#/c/261074/ | 21:55 |
| greghaynes | odyssey4me: Hey - did new images fix your resizing issue? | 21:56 |
| *** eharney has joined #openstack-infra | 21:56 | |
| *** arxcruz has quit IRC | 21:57 | |
| *** bhunter71 has quit IRC | 21:58 | |
| *** sparkyco_ has quit IRC | 22:00 | |
| mordred | greghaynes: any chance you know how to set neutron quota? | 22:00 |
| mordred | greghaynes: or, rather, how as a user I can check what my neutron quota is | 22:00 |
| mordred | ? | 22:00 |
| greghaynes | mordred: no idea :( | 22:00 |
| greghaynes | mordred: neutron quota-update doesnt work? | 22:01 |
| greghaynes | thats what help says | 22:01 |
| mordred | greghaynes: I'm sure that will work - but wasn't sure how I'd check as a user what my quota qas | 22:01 |
| mordred | to verify it had worked | 22:01 |
| greghaynes | quota-show will show for a tenant | 22:01 |
| greghaynes | no idea user | 22:02 |
| jeblair | restarting nodepool | 22:02 |
| greghaynes | er, no idea for user | 22:02 |
| mordred | greghaynes: ok seems you can do that for your tenant-id as a normal user | 22:02 |
| *** matrohon has quit IRC | 22:03 | |
| mordred | jeblair, clarkb, greghaynes: we were seeing a non-zero number of failures on bluebox beause the floating ip quota on the openstackjenkins user was set to 10 and 50 in neutron | 22:03 |
| mordred | I'm guessing it was the nova limit that was borking us | 22:04 |
| mordred | I have raised the quotas | 22:04 |
| greghaynes | ah, awesome | 22:04 |
| jeblair | mordred: 10 and 50? | 22:04 |
| clarkb | mordred: does a quota of 50 mean we have more available IPs? | 22:04 |
| mordred | jeblair: I think those were just the default values | 22:04 |
| mordred | and that when we got new ips we didn't get quota updates? | 22:04 |
| jeblair | mordred: i don't understand why there are 2 numbers? | 22:04 |
| mordred | anywho - we do have 2x /27 networks | 22:05 |
| mordred | jeblair: because nova has a number and neutron has a number | 22:05 |
| *** sparkyco_ has joined #openstack-infra | 22:05 | |
| jeblair | mordred: so nova was 10 and neutron was 50? | 22:05 |
| *** jsavak has quit IRC | 22:05 | |
| mordred | because nova had one from history because nova-network, but also neutron has one because you actually create floating ips via neutron | 22:05 |
| mordred | yah | 22:05 |
| jeblair | mordred: when i set up the tenant, there was a fip quota option | 22:05 |
| jeblair | and i set it | 22:05 |
| *** jsavak has joined #openstack-infra | 22:05 | |
| mordred | neat! | 22:05 |
| jeblair | using the gui | 22:05 |
| jeblair | so perhaps there's a bug that causes that to only set one thing? | 22:06 |
| mordred | you probably wold have set it to 50, yeah? | 22:06 |
| jeblair | mordred: yeah, i think so | 22:06 |
| mordred | well, let's see if our bluebox error rate goes down now | 22:06 |
| *** matrohon has joined #openstack-infra | 22:06 | |
| jeblair | mordred: ok. also, surely we've had more than 10 in use though? | 22:06 |
| openstackgerrit | Sachi King proposed openstack-dev/pbr: Make setup.py --help-commands work without testrepository https://review.openstack.org/263928 | 22:07 |
| mordred | jeblair: totally unsure | 22:07 |
| openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Add heat lbaas specific test for v1 and v2 https://review.openstack.org/237156 | 22:07 |
| mordred | jeblair: yes. in the past we definitely have had more than 10 | 22:07 |
| mordred | NotFound: No more floating ips in pool external. (HTTP 404) (Request-ID: req-ffae274d-3143-4851-8ca4-34339753681b) | 22:08 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Nodepool: Identify public internap network https://review.openstack.org/263929 | 22:09 |
| jeblair | clarkb, mgagne, mordred, anteaya: ^ that should now correct our use of internap (no further restart needed) | 22:09 |
| *** trown is now known as trown|outttypeww | 22:09 | |
| *** moravec1 has quit IRC | 22:09 | |
| *** rguillebert has joined #openstack-infra | 22:09 | |
| mordred | jeblair: ah - actually, we seem to have leaked a bunch of fips there | 22:09 |
| jeblair | mordred: it'll be nice to be in the shade | 22:09 |
| *** harlowja has quit IRC | 22:09 | |
| greghaynes | always throwing shade at the clouds | 22:10 |
| *** harlowja has joined #openstack-infra | 22:10 | |
| anteaya | jeblair: +2 | 22:10 |
| *** sparkyco_ has quit IRC | 22:10 | |
| greghaynes | mordred: does that mean the nova quota might have been a red herring? | 22:10 |
| greghaynes | mordred: it seems really wierd to me that nova would care about that when using neutron | 22:10 |
| *** thiagop has quit IRC | 22:11 | |
| *** dslev has joined #openstack-infra | 22:12 | |
| mordred | greghaynes: quite possibly | 22:12 |
| isaacb | clarkb: reminder, following our talk last week about timing the cron job in puppet master, can you please look in https://review.openstack.org/#/c/262466/ | 22:13 |
| anteaya | clarkb: different topic what is the status of the rax/intel <insert acronym here> thing? I just thought of it, sorry to interrupt | 22:13 |
| clarkb | anteaya: last I heard they were trying to have something we could tlak to by mid month | 22:13 |
| anteaya | clarkb: cool, thank you | 22:14 |
| anteaya | I wish acronyms were hieroglyphics instead, I could remember "draw me a picture" | 22:15 |
| clarkb | anteaya: with a quota of 100 test VMs | 22:16 |
| *** dslev_ has joined #openstack-infra | 22:17 | |
| *** moravec has joined #openstack-infra | 22:17 | |
| *** moravec has quit IRC | 22:17 | |
| anteaya | that is usable | 22:18 |
| * anteaya draws a quota of 100 test vms in hieroglyphs | 22:18 | |
| Nakato | Thanks mordred, lifeless: https://review.openstack.org/263928 | 22:19 |
| *** boris-42 has joined #openstack-infra | 22:20 | |
| *** otter768 has joined #openstack-infra | 22:20 | |
| *** dims has quit IRC | 22:20 | |
| *** masber has joined #openstack-infra | 22:20 | |
| *** dslev has quit IRC | 22:20 | |
| *** regXboi has quit IRC | 22:22 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder https://review.openstack.org/263349 | 22:22 |
| *** ybathia has joined #openstack-infra | 22:23 | |
| *** kzaitsev_mb has quit IRC | 22:24 | |
| *** peristeri has quit IRC | 22:24 | |
| *** thorst has quit IRC | 22:24 | |
| *** otter768 has quit IRC | 22:25 | |
| *** thorst has joined #openstack-infra | 22:25 | |
| *** dims has joined #openstack-infra | 22:25 | |
| *** annegentle has quit IRC | 22:28 | |
| *** erikwilson has quit IRC | 22:28 | |
| mordred | Nakato, lifeless: looks great! wanna review https://review.openstack.org/#/c/263748/ ? | 22:29 |
| isaacb | clarkb: thanks. | 22:30 |
| *** thorst has quit IRC | 22:30 | |
| *** moravec has joined #openstack-infra | 22:31 | |
| *** signed8b_ is now known as signed8bit_ZZZzz | 22:32 | |
| clarkb | isaacb: np | 22:32 |
| *** moravec has quit IRC | 22:32 | |
| *** edmondsw has quit IRC | 22:33 | |
| *** dkranz has quit IRC | 22:34 | |
| Nakato | mordred: Taking a look | 22:34 |
| *** signed8bit_ZZZzz is now known as signed8b_ | 22:34 | |
| clarkb | crinkle: bare-trusty build in rax-dfw completed successfully | 22:36 |
| *** edmondsw has joined #openstack-infra | 22:37 | |
| *** isaacb has quit IRC | 22:37 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: toci_gate_test/overcloud/non-ha: enable monitoring https://review.openstack.org/254787 | 22:37 |
| openstackgerrit | Merged openstack-infra/system-config: Dynamically schedule for updatepuppet master cron job https://review.openstack.org/262466 | 22:37 |
| *** edmondsw has quit IRC | 22:37 | |
| crinkle | clarkb: \o/ | 22:38 |
| *** dprince has quit IRC | 22:40 | |
| *** piet has quit IRC | 22:40 | |
| reed | should the linux kernel resolution be on http://governance.openstack.org/resolutions/index.html ? | 22:41 |
| *** Sukhdev has quit IRC | 22:41 | |
| mordred | reed: yes. it seems neither thing today has published docs | 22:41 |
| mordred | reed: I have not been able to look in to it yet | 22:42 |
| reed | the draft job doesn't have it either | 22:42 |
| *** annegentle has joined #openstack-infra | 22:42 | |
| jlvillal | clarkb: I am trying to simulate the devstack-gate. If I don't have: /etc/nodepool/sub_nodes_private is that a problem? As the ansible command seems to be using that. | 22:43 |
| *** krtaylor has quit IRC | 22:43 | |
| jlvillal | Basically wondering what I should put in that file. | 22:43 |
| jlvillal | clarkb: Asking you because git blame says you wrote that part of the code :) | 22:43 |
| *** aeng has quit IRC | 22:43 | |
| clarkb | no its not a problem the error is higher in your paste | 22:44 |
| mordred | reed: it's there when I build it locally :( | 22:44 |
| clarkb | it should write out an empty inventory which is why ansible nooped there | 22:44 |
| jlvillal | clarkb: Okay. I will look higher in my pastebin and see what I can discover. | 22:46 |
| jlvillal | clarkb: But if you have any hints it would be appreciated... | 22:46 |
| *** amitgandhinz has quit IRC | 22:47 | |
| *** amitgandhinz has joined #openstack-infra | 22:48 | |
| *** annegent_ has joined #openstack-infra | 22:48 | |
| *** annegentle has quit IRC | 22:49 | |
| *** thorst has joined #openstack-infra | 22:49 | |
| clarkb | its says the main script has failed please refer to such and such log for details | 22:49 |
| jlvillal | clarkb: Thanks. I think I found an issue. | 22:50 |
| openstackgerrit | Merged openstack-infra/project-config: Nodepool: Identify public internap network https://review.openstack.org/263929 | 22:50 |
| anteaya | jeblair: ^ | 22:51 |
| *** Qiming has joined #openstack-infra | 22:51 | |
| jeblair | anteaya: woot, should just start working after the next puppeting | 22:52 |
| docaedo | Any infra cores care to merge https://review.openstack.org/#/c/260230/ ? It festively adorned with +2's and +1's :) | 22:52 |
| *** thorst has quit IRC | 22:53 | |
| openstackgerrit | Merged openstack-infra/shade: Bug fix: Cinder v2 returns bools now https://review.openstack.org/263764 | 22:54 |
| *** aeng has joined #openstack-infra | 22:56 | |
| anteaya | jeblair: yay | 22:57 |
| *** amitgandhinz has quit IRC | 22:57 | |
| anteaya | clarkb: I have a question on 263923, the jobs will be thus according to the layout output: http://logs.openstack.org/23/263923/1/check/gate-project-config-layout/51a593d/console.html#_2016-01-05_22_26_15_186 | 22:57 |
| anteaya | clarkb: to me it looks like that master will only run with noop thus avoiding the issue where a patch has both noop jobs and other jobs on it | 22:58 |
| anteaya | clarkb: do you see the same? | 22:58 |
| anteaya | EmilienM: btw somehow puppet-tuskar still has two icehouse jobs configured for it: http://logs.openstack.org/23/263923/1/check/gate-project-config-layout/51a593d/console.html#_2016-01-05_22_26_15_186 | 22:59 |
| EmilienM | anteaya: we don't support icehouse anymore | 22:59 |
| EmilienM | anteaya: we stop after juno | 22:59 |
| *** matrohon has quit IRC | 22:59 | |
| anteaya | I know | 22:59 |
| anteaya | but if you look at the jobs in the link, somehow there are still two icehouse jobs configured | 23:00 |
| anteaya | EmilienM: I don't know where they are coming from | 23:00 |
| *** daemontool has joined #openstack-infra | 23:00 | |
| anteaya | <Job gate-puppet-tuskar-puppet-syntax-4-dsvm-centos7> ^(?!stable/(icehouse)).*$ | 23:00 |
| anteaya | and -3 from the line above | 23:01 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/devstack-gate: Fix misspelling of connectivity https://review.openstack.org/263938 | 23:01 |
| EmilienM | anteaya: that's weird. This module does not have stable/icehouse so it will never match | 23:02 |
| anteaya | EmilienM: right, I also find it weird | 23:02 |
| *** matrohon has joined #openstack-infra | 23:02 | |
| anteaya | EmilienM: thought I would share what I saw with you | 23:02 |
| *** yuanying has joined #openstack-infra | 23:03 | |
| *** jsavak has quit IRC | 23:04 | |
| *** rhallisey has joined #openstack-infra | 23:04 | |
| *** otter768 has joined #openstack-infra | 23:05 | |
| EmilienM | anteaya: I can add icehouse if you want to the branch line | 23:07 |
| EmilienM | but it's useless, since we don't have this branch online | 23:07 |
| *** bhunter71 has joined #openstack-infra | 23:07 | |
| anteaya | no no no | 23:07 |
| *** woodster_ has joined #openstack-infra | 23:07 | |
| anteaya | I failed to communicate what I tried to do | 23:07 |
| clarkb | anteaya: le me see | 23:08 |
| anteaya | I am saying that our configuration believes it needs to configure an icehouse job for that repo | 23:08 |
| anteaya | clarkb: thanks | 23:08 |
| anteaya | EmilienM: which both you and I know it does not need to do | 23:08 |
| anteaya | EmilienM: there is a ghost in the configuration somewhere and it is thinking it needs to configure a job for that repo that it doesn't need to | 23:09 |
| *** dingyichen has joined #openstack-infra | 23:09 | |
| anteaya | EmilienM: and we didn't catch it before because that non-existant job will never run | 23:09 |
| anteaya | my dinner is ready and I will be back in a bit | 23:11 |
| clarkb | anteaya: so that will run the noop jobs on all branches, and restrict the other jobs to the stable branches. This is problematic because then that project ends up in the noop job queue with real jobs | 23:11 |
| clarkb | you can have a project specific noop job instead | 23:11 |
| clarkb | and use that only against master | 23:11 |
| anteaya | clarkb: thanks for taking a look, that was exactly the feedback I was looking for, thanks | 23:12 |
| anteaya | dinner now, back in a few | 23:12 |
| clarkb | if it wree me I would just deprecate the project | 23:12 |
| *** chlong has joined #openstack-infra | 23:12 | |
| clarkb | if upstreams is saying no more then its easy downstream to follow along | 23:12 |
| *** chlong has quit IRC | 23:14 | |
| clarkb | https://jenkins01.openstack.org/job/gate-tempest-dsvm-neutron-full/17978/console is running on internap | 23:15 |
| clarkb | jeblair: ^ fyi | 23:15 |
| *** doug-fis_ has joined #openstack-infra | 23:15 | |
| *** angdraug has quit IRC | 23:16 | |
| clarkb | mgagne: ^ you are probably interested as well | 23:17 |
| mgagne | was about to check =) | 23:17 |
| mgagne | thanks for the link | 23:17 |
| *** doug-fish has quit IRC | 23:17 | |
| *** dims has quit IRC | 23:20 | |
| *** matrohon has quit IRC | 23:22 | |
| *** krtaylor has joined #openstack-infra | 23:22 | |
| *** dims has joined #openstack-infra | 23:25 | |
| *** doug-fis_ has quit IRC | 23:25 | |
| Thelo | Hi all, if I do two commits, one in os_brick the other one in nova, is there any way to tell the CI that I want my nova patch to be tested with the path for os_brick (which is installed by pip)? | 23:26 |
| JayF | I'm having all kinds of trouble building upper-constraints.txt for the requirements repo. Everytime I run the generate-constraints command, I get failures that look like a malformed krb5 build string | 23:27 |
| asselin | Thelo, yes, there's a env variable in devstack: libs_from_git or something like that | 23:27 |
| anteaya | EmilienM: any chance you can just deprecate the project as clarkb suggests? | 23:27 |
| clarkb | JayF: have a paste? | 23:27 |
| JayF | https://gist.github.com/jayofdoom/291c6122e1c80756d2f0 | 23:28 |
| JayF | just got finished pasting it | 23:28 |
| samueldmq | asselin: isn't he wanting to get it tested via openstack ci? if so, isn't that what Depends-On does ? | 23:28 |
| EmilienM | clarkb: the project is deprecated | 23:28 |
| JayF | clarkb: ^ the weird thing is it looks like some error message is getting passed as options to gcc | 23:28 |
| EmilienM | clarkb: I don't mind dropping all jobs | 23:28 |
| anteaya | EmilienM: then let's do that | 23:28 |
| asselin | samueldmq, depend-on won't work for a lib afaik | 23:28 |
| *** sridhar_ram has quit IRC | 23:28 | |
| anteaya | just remove the jobs | 23:28 |
| EmilienM | anteaya: noop | 23:29 |
| EmilienM | so we can still patch stable branches | 23:29 |
| EmilienM | just in case | 23:29 |
| anteaya | EmilienM: well if you like | 23:29 |
| *** dimtruck is now known as zz_dimtruck | 23:29 | |
| asselin | samueldmq, it will check it out, but sill install via pip. if you set libs-from-git to include os-brick, it will install based on the depends-on | 23:29 |
| asselin | Thelo, ^^ | 23:29 |
| *** austin81 has left #openstack-infra | 23:29 | |
| *** shardy has quit IRC | 23:30 | |
| clarkb | JayF: looks like you ar emissing C headers | 23:30 |
| *** chlong has joined #openstack-infra | 23:30 | |
| JayF | build-essential is installed, as is the output of bindep -b | 23:31 |
| *** weshay has quit IRC | 23:31 | |
| clarkb | you need krb-config | 23:31 |
| Thelo | where do I put the "libs from git" | 23:31 |
| Thelo | in the commit message? | 23:31 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: disable puppet-tuskar jobs https://review.openstack.org/263923 | 23:31 |
| JayF | clarkb: it's installed. | 23:31 |
| JayF | clarkb: that was the first thing I tried upon seeing the error | 23:31 |
| clarkb | JayF: the -dev headers package? | 23:31 |
| clarkb | oh looks like there is no header package for that on trusty at least | 23:32 |
| clarkb | hrm | 23:32 |
| asselin | Thelo, no, you need a special ci job. here's one for example: https://review.openstack.org/#/c/188156/ | 23:32 |
| samueldmq | asselin: sure, I thought it wasn't about testing it locally or not needing to create a new ci job | 23:32 |
| JayF | clarkb: libkrb5-dev existed and wasn't installed | 23:32 |
| JayF | clarkb: so rerunning now | 23:32 |
| samueldmq | asselin: great thanks for clarifying | 23:32 |
| *** annegent_ has quit IRC | 23:32 | |
| jroll | JayF: that should be added to other-requirements.txt, AIUI | 23:33 |
| jroll | JayF: is this running on master of openstack/requirements or with additional requirements added? | 23:33 |
| JayF | it's running on openstack/requirements w/mimic 2.0 added | 23:33 |
| *** gordc has quit IRC | 23:33 | |
| JayF | I guess I should've run against master first | 23:33 |
| asselin | samueldmq, Thelo http://git.openstack.org/cgit/openstack-dev/devstack/tree/doc/source/configuration.rst#n324 | 23:33 |
| jroll | JayF: yeah, you need to, to get a baseline, but sounds like you'll need to add libkrb5-dev to other-requirements.txt to the patch | 23:34 |
| JayF | 10-4 can do that | 23:34 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:35 | |
| asselin | infra-root http://codesearch.openstack.org/ seems broken now | 23:36 |
| Thelo | thanks | 23:36 |
| asselin | nevermind...working again. | 23:36 |
| nibalizer | asselin: it works http://codesearch.openstack.org/?q=asselin&i=nope&files=&repos= | 23:36 |
| asselin | thre was a message "server broke down" followed by a refresh will a 500 error | 23:36 |
| *** mriedem has quit IRC | 23:37 | |
| nibalizer | ill look at some logs | 23:37 |
| *** otter768 has quit IRC | 23:37 | |
| *** oomichi has joined #openstack-infra | 23:37 | |
| *** signed8b_ is now known as signed8bit_ZZZzz | 23:39 | |
| *** moravec has joined #openstack-infra | 23:39 | |
| Thelo | asselin: But when you push a patch for review how do you sy you want to add this option in the gate local.conf? | 23:39 |
| *** tonytan4ever has quit IRC | 23:39 | |
| anteaya | asselin nibalizer: jeblair has said that there is a strange intermittent failure with codesearch, that usually goes away on a refresh | 23:39 |
| anteaya | I don't think a bug has been filed | 23:40 |
| *** daemontool has quit IRC | 23:40 | |
| asselin | yeah, sound like this | 23:40 |
| anteaya | if nibalizer can find any evidence in logs mayhap it is time for a bug report? | 23:40 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Fix filtering in search_stacks() https://review.openstack.org/263724 | 23:41 |
| *** signed8bit_ZZZzz is now known as signed8b_ | 23:41 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add tests for stack search API https://review.openstack.org/259727 | 23:41 |
| asselin | Thelo, yeah I see, I don't think that's possible right now. You can however test your os-brick patch with a depends-on nova patch.... | 23:41 |
| nibalizer | from the logs it looks like it spends almost a minute down while starting new searchers | 23:41 |
| anteaya | nibalizer: hmmm | 23:42 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: correct rpmlint errors https://review.openstack.org/263526 | 23:42 |
| anteaya | nibalizer: how does it start new searchers? | 23:42 |
| nibalizer | yes | 23:42 |
| anteaya | ha ha ha | 23:42 |
| *** thorst has joined #openstack-infra | 23:42 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud modules to modules.env https://review.openstack.org/209617 | 23:42 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud controller node https://review.openstack.org/209698 | 23:42 |
| nibalizer | it also seems to wipe out its log every time it restarts | 23:42 |
| nibalizer | so thats cool | 23:42 |
| anteaya | interesting | 23:43 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud compute node definition https://review.openstack.org/213980 | 23:43 |
| anteaya | does it start new searchers after it re-indexes? | 23:43 |
| anteaya | is that the trigger? | 23:43 |
| anteaya | or I guess if it takes out the logs it would be tough to find out | 23:43 |
| *** amuller has quit IRC | 23:44 | |
| *** sabeen3 has quit IRC | 23:45 | |
| samueldmq | asselin: thanks for the link | 23:46 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-hound: Append to logfile instead of overwriting https://review.openstack.org/263953 | 23:46 |
| *** dslev_ has quit IRC | 23:46 | |
| nibalizer | that should fix the log issue | 23:46 |
| Thelo | asselin: thanks | 23:46 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Create jobs for a wheel mirror https://review.openstack.org/164927 | 23:48 |
| anteaya | nibalizer: thanks | 23:48 |
| *** sridhar_ram has joined #openstack-infra | 23:48 | |
| krotscheck | jeblair: Do you have a pastebin with those rewrite rules of yours? I'd like to add them to https://review.openstack.org/#/c/253521/ | 23:49 |
| anteaya | jhesketh: jenkins is unhappy on these: https://review.openstack.org/#/q/status:open+topic:enable_swift+project:openstack-infra/project-config | 23:49 |
| *** rbrndt__ has quit IRC | 23:49 | |
| *** signed8b_ has quit IRC | 23:49 | |
| nibalizer | ya it kinda looks like whenever hound restarts its just down for a little bit while it figure its life out | 23:49 |
| nibalizer | finds new repos, clones them, ettc | 23:49 |
| nibalizer | asselin: did you get a proxy nott responding error? | 23:49 |
| nibalizer | that seems to be the error apache has | 23:49 |
| asselin | nibalizer, no | 23:49 |
| anteaya | so whenever it finds a new repo, it restarts itself? | 23:50 |
| nibalizer | what did you get | 23:50 |
| *** annegentle has joined #openstack-infra | 23:50 | |
| asselin | should've taken a screenshot. First was a nicely formated page with the words "server broke down" | 23:50 |
| anteaya | ha ha ha | 23:50 |
| nibalizer | that sounds like the kind of error that the etsy people would write (making me think it came from hound) | 23:51 |
| krotscheck | greghaynes: I think I've managed to combine both the folder structure concerns from the last comment, and the desire to have the folder structure work with AFS, into ^^. | 23:51 |
| * anteaya pictures a server by the side of the road, steam issuing from under the hood | 23:51 | |
| asselin | I refreshed and got the standard server not available message | 23:51 |
| asselin | I refreshed again and it was up and ready to go | 23:52 |
| asselin | yeah I think it's from hound too | 23:52 |
| taron | hmm, this is what I was afraid of when I set hound up that way, though I don't have any brilliant alternatives off the top of my head | 23:56 |
| *** tzn has quit IRC | 23:56 | |
| anteaya | taron: so when hound encounters a new repo it restarts itself? | 23:57 |
| taron | the restart is triggered through puppet | 23:57 |
| anteaya | taron: can you link me to where it is triggered? | 23:57 |
| taron | yep, one sec | 23:57 |
| anteaya | thanks | 23:57 |
| *** piet has joined #openstack-infra | 23:58 | |
| *** eil397 has quit IRC | 23:58 | |
| taron | https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/codesearch.pp#n32 | 23:59 |
| anteaya | thanks | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!