| *** caphrim007_ has joined #openstack-infra | 00:01 | |
| *** mikal has joined #openstack-infra | 00:02 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add result_TIMED_OUT & result_RETRY_LIMIT as failure colors https://review.openstack.org/513444 | 00:02 |
|---|---|---|
| *** caphrim007 has quit IRC | 00:04 | |
| *** PramodJ has joined #openstack-infra | 00:05 | |
| *** markvoelker_ has quit IRC | 00:07 | |
| *** markvoelker has joined #openstack-infra | 00:08 | |
| *** pramodrj07 has quit IRC | 00:08 | |
| *** dingyichen has joined #openstack-infra | 00:09 | |
| *** rtjure has quit IRC | 00:11 | |
| *** markvoelker has quit IRC | 00:12 | |
| *** rtjure has joined #openstack-infra | 00:16 | |
| *** markvoelker has joined #openstack-infra | 00:18 | |
| *** armax has joined #openstack-infra | 00:18 | |
| *** rhallisey has quit IRC | 00:19 | |
| *** rhallisey has joined #openstack-infra | 00:20 | |
| openstackgerrit | Merged openstack-infra/system-config master: puppetmaster: rotate /var/log/puppet_run_all_infracloud.log https://review.openstack.org/516165 | 00:25 |
| *** rhallisey has quit IRC | 00:32 | |
| *** zhurong has joined #openstack-infra | 00:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: save oooq logs https://review.openstack.org/517136 | 00:42 |
| *** camunoz has quit IRC | 00:43 | |
| *** huanxie has joined #openstack-infra | 00:43 | |
| *** dave-mccowan has joined #openstack-infra | 00:46 | |
| *** cuongnv has joined #openstack-infra | 00:52 | |
| *** xingchao has joined #openstack-infra | 00:54 | |
| *** xingchao has quit IRC | 00:54 | |
| sc` | i merged a review some hours ago and it still hasn't popped up on the github mirror | 00:55 |
| *** Apoorva has quit IRC | 00:56 | |
| sc` | https://review.openstack.org/#/c/517041/ is the gerrit change | 00:57 |
| *** nicolasbock has quit IRC | 00:57 | |
| fungi | sc`: i'm on airline wifi but will try to figure that one out | 00:57 |
| sc` | np. i have a reputation to keep by dropping clusterfucks after business hours ;) | 00:58 |
| *** xingchao has joined #openstack-infra | 00:58 | |
| *** LindaWang has joined #openstack-infra | 00:58 | |
| *** bobh has joined #openstack-infra | 00:59 | |
| sc` | i'm not chomping at the bit for resolution, but it did become more visible earlier due to that change not existing | 01:00 |
| *** rwsu has joined #openstack-infra | 01:00 | |
| fungi | sc`: sorry, i can't seem to connect to my bastion at the moment, so can't see whether gerrit is backlogged on replication... maybe another infra-root can take a look | 01:02 |
| *** rwsu_ has joined #openstack-infra | 01:03 | |
| *** markvoelker has quit IRC | 01:03 | |
| sc` | i just have to draft a happy "go this way" email. s'all good | 01:03 |
| *** markvoelker has joined #openstack-infra | 01:03 | |
| ianw | sc` : hmm, let me see | 01:03 |
| *** yamahata has quit IRC | 01:04 | |
| *** PramodJ has quit IRC | 01:04 | |
| EmilienM | can anyone approve https://review.openstack.org/#/c/517060/ please? it's blocking us to release tripleo... thanks! | 01:04 |
| *** iyamahat has quit IRC | 01:05 | |
| *** bobh has quit IRC | 01:07 | |
| *** markvoelker has quit IRC | 01:08 | |
| *** edmondsw has joined #openstack-infra | 01:08 | |
| *** caphrim007 has joined #openstack-infra | 01:11 | |
| *** edmondsw has quit IRC | 01:13 | |
| *** mriedem has quit IRC | 01:13 | |
| *** caphrim007 has quit IRC | 01:16 | |
| *** rlandy|afk is now known as rlandy | 01:17 | |
| ianw | scheduling replication All-Users:refs/users/70/13770 => git@github.com:All-Users.git | 01:17 |
| ianw | that's an interesting log line | 01:17 |
| sc` | neat | 01:18 |
| ianw | i can not see 517060 scheduled and not replicated | 01:20 |
| ianw | i can not see it scheduled at all. maybe fungi has a suggestion of what i should look at | 01:20 |
| openstackgerrit | Merged openstack-infra/project-config master: tripleo: fix release jobs layout https://review.openstack.org/517060 | 01:20 |
| sc` | it's because i'm trying to simplify things. i knew it. | 01:21 |
| *** andreww has quit IRC | 01:24 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-bup master: Exclude /var/lib/lxcfs/* https://review.openstack.org/517148 | 01:27 |
| *** gildub has quit IRC | 01:27 | |
| *** jd_ has quit IRC | 01:28 | |
| *** rloo has quit IRC | 01:30 | |
| *** jd_ has joined #openstack-infra | 01:31 | |
| *** liujiong_lj has joined #openstack-infra | 01:32 | |
| mnaser | https://review.openstack.org/#/c/516794/ should be a simple change that already had 2x +2's but wanted a full commit message | 01:36 |
| mnaser | noow that we have that, it'd speed things up for merging things if possible | 01:36 |
| *** gildub has joined #openstack-infra | 01:39 | |
| *** sflanigan has quit IRC | 01:41 | |
| *** liujiong_lj is now known as liujiong | 01:43 | |
| SamYaple | i wish gerrit would either persist -W or read WIP in the commit message a -W automagically | 01:43 |
| *** psachin has joined #openstack-infra | 01:44 | |
| fungi | ianw: sc`: 96951887 waiting .... 20:00:07.463 [36a9ccd1] push git@github.com:openstack/openstack-chef-repo.git | 01:45 |
| fungi | according to gerrit show-queue -w | 01:46 |
| * fungi finally got back in touch with his bastion | 01:46 | |
| *** zhurong has quit IRC | 01:46 | |
| fungi | we have some 133 queue entries at the moment and 125 of those are gh replication | 01:47 |
| *** xarses has joined #openstack-infra | 01:47 | |
| fungi | so something is up with gh... stuck? throttling us? | 01:47 |
| fungi | we seem to be replicating to our git.o.o farm just fine | 01:47 |
| ianw | fungi: ahh, show-queue, til | 01:49 |
| fungi | ianw: gerrit --help is highly recommended | 01:50 |
| *** tinwood has quit IRC | 01:50 | |
| ianw | yeah, i just, didn't think that would be in there | 01:51 |
| *** tinwood has joined #openstack-infra | 01:51 | |
| fungi | it has a few nifty diagnostic commands | 01:54 |
| *** nikhil has quit IRC | 01:59 | |
| *** kukacz has quit IRC | 02:00 | |
| *** zhurong has joined #openstack-infra | 02:00 | |
| *** kukacz has joined #openstack-infra | 02:01 | |
| *** dhinesh_ has quit IRC | 02:02 | |
| *** rlandy has quit IRC | 02:11 | |
| *** xinliang has quit IRC | 02:13 | |
| *** xingchao has quit IRC | 02:14 | |
| *** xingchao has joined #openstack-infra | 02:17 | |
| *** petevg is now known as petevg|afk | 02:17 | |
| *** caphrim007 has joined #openstack-infra | 02:21 | |
| *** hongbin has joined #openstack-infra | 02:21 | |
| *** xingchao has quit IRC | 02:24 | |
| *** salv-orlando has joined #openstack-infra | 02:26 | |
| *** xingchao has joined #openstack-infra | 02:27 | |
| *** xinliang has joined #openstack-infra | 02:29 | |
| *** xinliang has joined #openstack-infra | 02:29 | |
| *** salv-orl_ has quit IRC | 02:29 | |
| *** dhinesh has joined #openstack-infra | 02:29 | |
| *** ykarel|afk has joined #openstack-infra | 02:31 | |
| openstackgerrit | zhongshengping proposed openstack-infra/project-config master: Remove legacy jobs from puppet openstack modules https://review.openstack.org/517162 | 02:35 |
| *** xinliang has quit IRC | 02:41 | |
| *** ykarel|afk has quit IRC | 02:42 | |
| *** larainema has joined #openstack-infra | 02:45 | |
| *** xinliang has joined #openstack-infra | 02:54 | |
| *** xinliang has quit IRC | 02:54 | |
| *** xinliang has joined #openstack-infra | 02:54 | |
| *** xingchao has quit IRC | 02:54 | |
| *** xingchao has joined #openstack-infra | 02:56 | |
| *** xingchao has quit IRC | 02:58 | |
| *** thorst has joined #openstack-infra | 03:00 | |
| *** xingchao has joined #openstack-infra | 03:03 | |
| *** dave-mccowan has quit IRC | 03:05 | |
| *** rwsu_ has quit IRC | 03:06 | |
| *** rwsu has quit IRC | 03:06 | |
| mnaser | sorry to nag a bit but if any project cores can give this a quick eye - https://review.openstack.org/#/c/516794/ -- i think we're about to hit a timeout in tripleo ci thats going to reset the queue again (changes are at ~20h now :() | 03:08 |
| mnaser | yep. it just failed | 03:08 |
| mnaser | entire stack from 515247 and after will start all over again, booo | 03:09 |
| ianw | mnaser: i'd just like AJaeger to look at that because he had comments | 03:14 |
| ianw | he's usually around ... soon | 03:15 |
| mnaser | ianw: ok no worries, yeah hopefully he gets to it | 03:15 |
| ianw | i'm sure he will, there's no finer reviewer :) | 03:15 |
| mnaser | :D | 03:15 |
| mnaser | https://review.openstack.org/#/q/topic:bindep/puppet+is:open | 03:15 |
| mnaser | trying to clear this last little bit of stuff to get our q1 release which is a bit behind because of release job shenanigans | 03:16 |
| * mnaser goes back to troubleshooting his o-key for randomly typing two o's | 03:16 | |
| *** udesale has joined #openstack-infra | 03:16 | |
| *** xingchao has quit IRC | 03:19 | |
| *** xingchao has joined #openstack-infra | 03:20 | |
| *** xingchao has quit IRC | 03:22 | |
| *** aviau has quit IRC | 03:28 | |
| *** aviau has joined #openstack-infra | 03:28 | |
| *** threestrands has quit IRC | 03:29 | |
| *** xingchao has joined #openstack-infra | 03:30 | |
| dmsimard | ianw, mnaser: you nice gentlemen mind some quick reviews on https://review.openstack.org/#/c/517099/ and https://review.openstack.org/#/c/517100/ ? :) | 03:32 |
| * dmsimard shameless plug | 03:32 | |
| *** xingchao has quit IRC | 03:35 | |
| *** xingchao has joined #openstack-infra | 03:37 | |
| *** xingchao has quit IRC | 03:40 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy ara job https://review.openstack.org/517099 | 03:42 |
| *** jistr has quit IRC | 03:42 | |
| *** jistr has joined #openstack-infra | 03:43 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove ara job https://review.openstack.org/517100 | 03:54 |
| *** cuongnv_ has joined #openstack-infra | 03:59 | |
| *** cuongnv has quit IRC | 04:01 | |
| *** thorst has quit IRC | 04:03 | |
| *** coolsvap has joined #openstack-infra | 04:06 | |
| dmsimard | Wow, I had never seen that XKCD before. Hilarious. https://xkcd.com/1782/ | 04:06 |
| AJaeger | mnaser, could you follow up on your change and remove now unused jobs, please? | 04:07 |
| *** sree has joined #openstack-infra | 04:08 | |
| mnaser | AJaeger: good catch, I’ll keep a note for tomorrow. It’s 12 am here and I’ll grab some zzzs soon | 04:11 |
| AJaeger | mnaser: good night... | 04:11 |
| *** rwsu has joined #openstack-infra | 04:13 | |
| *** rwsu_ has joined #openstack-infra | 04:13 | |
| openstackgerrit | Merged openstack-infra/project-config master: Drop TripleO jobs from Puppet modules https://review.openstack.org/516794 | 04:16 |
| *** Rockyg has joined #openstack-infra | 04:22 | |
| *** huanxie has quit IRC | 04:24 | |
| *** ijw has joined #openstack-infra | 04:24 | |
| *** yamamoto has joined #openstack-infra | 04:24 | |
| *** vsaienk0 has joined #openstack-infra | 04:28 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Refactor jobs to use build-openstack-sphinx-docs template https://review.openstack.org/515974 | 04:29 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add missing system-required template for Zuul projects https://review.openstack.org/515975 | 04:31 |
| *** aeng has quit IRC | 04:33 | |
| *** hongbin has quit IRC | 04:34 | |
| *** ishant has joined #openstack-infra | 04:35 | |
| *** vsaienk0 has quit IRC | 04:38 | |
| ishant | Hi Guys, I am facing a problem with the project release | 04:38 |
| ishant | I pushed a new tag 11.0.0 to openstack/networking-infoblox 3 days ago but the tarball is still not pushed to the pypi. https://github.com/openstack/networking-infoblox/releases/tag/11.0.0 | 04:38 |
| ishant | I cannot see any jobs for this in zuul also | 04:39 |
| ishant | How should i debug this and publish the tarball to the pypi? | 04:40 |
| *** ykarel has joined #openstack-infra | 04:48 | |
| *** aeng has joined #openstack-infra | 04:51 | |
| *** ramishra has joined #openstack-infra | 04:54 | |
| *** huanxie has joined #openstack-infra | 04:57 | |
| *** cuongnv has joined #openstack-infra | 04:58 | |
| AJaeger | ishant: I don't see logs either, an infra-root needs to either requeue this for you or you tag 11.0.1. Some infra-roots are currently travelling due to the summit, not sure whether anybody can help now - if not, ask again later, please | 04:58 |
| sc` | fungi: ok. i thought i was seeing things for the first few minutes before mentioning something here. checked my contacts and everything | 05:00 |
| *** cuongnv_ has quit IRC | 05:00 | |
| ishant | AJaeger: I cannot tag 11.0.1 because we need the 11.0.0 release in pypi. Ok can you please give me a timeline as to when should i ask again for the requeue? | 05:00 |
| *** ramishra has quit IRC | 05:01 | |
| *** gmann is now known as gmann_afk | 05:01 | |
| ianw | ishant: let me see ... | 05:01 |
| ianw | i'm not sure i've triggered a zuulv3 job | 05:02 |
| *** ramishra has joined #openstack-infra | 05:03 | |
| ianw | i guess it was http://logs.openstack.org/d8/d8097af1844c19c3be3cc0a13cddc0bfd61b1d96/post/ | 05:05 |
| *** aeng has quit IRC | 05:05 | |
| *** aeng has joined #openstack-infra | 05:06 | |
| ianw | ishant: i think you've got the release jobs going now ... check status | 05:08 |
| ishant | ianw: Yes I can see a job in zuul now. Thanks a lot for the help! | 05:10 |
| ianw | don't thank me till it worked ;) | 05:10 |
| AJaeger | config-core, a few cleanups/job removals: https://review.openstack.org/510390 https://review.openstack.org/517036 https://review.openstack.org/516998 https://review.openstack.org/516011 | 05:14 |
| ishant | ianw: okay will thank you again :) | 05:14 |
| AJaeger | ianw: could you put an infra-manual change on your review queue, please? https://review.openstack.org/517106 | 05:14 |
| *** armaan has quit IRC | 05:17 | |
| *** armaan has joined #openstack-infra | 05:18 | |
| AJaeger | ianw, ishant https://pypi.python.org/pypi/networking-infoblox/11.0.0 is up | 05:21 |
| *** armaan has quit IRC | 05:23 | |
| ishant | AJaeger, ianw: Yeah its published :) Thanks a lot for your help ! | 05:24 |
| *** armaan has joined #openstack-infra | 05:24 | |
| *** ijw has quit IRC | 05:26 | |
| *** ijw has joined #openstack-infra | 05:26 | |
| *** armax has quit IRC | 05:27 | |
| *** armax has joined #openstack-infra | 05:27 | |
| *** ijw has quit IRC | 05:27 | |
| *** janki has joined #openstack-infra | 05:27 | |
| *** armax has quit IRC | 05:27 | |
| *** ramishra has quit IRC | 05:28 | |
| *** armax has joined #openstack-infra | 05:28 | |
| *** armax has quit IRC | 05:28 | |
| *** gildub has quit IRC | 05:29 | |
| *** armax has joined #openstack-infra | 05:29 | |
| *** armax has quit IRC | 05:29 | |
| *** ramishra has joined #openstack-infra | 05:29 | |
| *** armaan has quit IRC | 05:30 | |
| *** armaan has joined #openstack-infra | 05:30 | |
| ianw | for my own reference when i do this again it was : | 05:32 |
| ianw | zuul enqueue-ref --tenant openstack --trigger gerrit --pipeline release --project openstack/networking-infoblox --ref refs/tags/11.0.0 --newrev d8097af1844c19c3be3cc0a13cddc0bfd61b1d96 | 05:32 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add integration test coverage for iptables persistence https://review.openstack.org/513934 | 05:33 |
| *** ramishra has quit IRC | 05:34 | |
| *** sree_ has joined #openstack-infra | 05:34 | |
| *** sree_ is now known as Guest20018 | 05:35 | |
| *** ramishra has joined #openstack-infra | 05:36 | |
| *** Guest20018 has quit IRC | 05:36 | |
| *** sree has quit IRC | 05:37 | |
| *** sree has joined #openstack-infra | 05:38 | |
| *** gildub has joined #openstack-infra | 05:46 | |
| *** aeng has quit IRC | 05:46 | |
| *** ishant has quit IRC | 05:47 | |
| *** ramishra has quit IRC | 05:49 | |
| *** cshastri has joined #openstack-infra | 05:50 | |
| *** ramishra has joined #openstack-infra | 05:51 | |
| *** jbadiapa has joined #openstack-infra | 05:52 | |
| *** rwsu_ has quit IRC | 05:55 | |
| *** rwsu has quit IRC | 05:55 | |
| *** rwsu has joined #openstack-infra | 05:56 | |
| *** pcaruana has joined #openstack-infra | 05:58 | |
| openstackgerrit | Merged openstack-infra/infra-manual master: Add "openstack-tox-cover (PTI)" to list of things not to convert https://review.openstack.org/517106 | 06:02 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove now obsolete periodic-stable templates https://review.openstack.org/516998 | 06:04 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/517170 | 06:04 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove obsolete infra-publications jobs https://review.openstack.org/516011 | 06:05 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy networking-cisco jobs https://review.openstack.org/517036 | 06:07 |
| *** gk__ has joined #openstack-infra | 06:08 | |
| gk__ | fungi: Hi, are you there? | 06:08 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy jobs from Barbican https://review.openstack.org/510390 | 06:09 |
| *** gk__ has quit IRC | 06:09 | |
| *** gk__ has joined #openstack-infra | 06:09 | |
| *** hemna_ has joined #openstack-infra | 06:11 | |
| *** hemna has quit IRC | 06:14 | |
| *** dhinesh has quit IRC | 06:16 | |
| *** namnh has joined #openstack-infra | 06:19 | |
| openstackgerrit | Merged openstack-infra/puppet-bup master: Exclude /var/lib/lxcfs/* https://review.openstack.org/517148 | 06:22 |
| *** ijw has joined #openstack-infra | 06:28 | |
| *** armaan has quit IRC | 06:28 | |
| *** sree has quit IRC | 06:29 | |
| *** armaan has joined #openstack-infra | 06:29 | |
| *** armaan has quit IRC | 06:30 | |
| *** armaan has joined #openstack-infra | 06:30 | |
| *** edmondsw has joined #openstack-infra | 06:32 | |
| *** sree has joined #openstack-infra | 06:33 | |
| *** ijw has quit IRC | 06:33 | |
| *** edmondsw has quit IRC | 06:36 | |
| yamamoto | where is devstack-tempest base job? | 06:47 |
| *** eumel8 has joined #openstack-infra | 06:51 | |
| eumel8 | morning | 06:52 |
| *** dsariel__ has joined #openstack-infra | 06:52 | |
| berendt | looks like ask.openstack.org is not reachable at the moment | 07:03 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/infra-manual master: zull v3: Stop recommending non-existent base job https://review.openstack.org/517184 | 07:04 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/infra-manual master: zuul v3: Stop recommending non-existent base job https://review.openstack.org/517184 | 07:04 |
| *** pahuang has quit IRC | 07:07 | |
| eumel8 | yeah, no traffic anymore: http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=2548&rra_id=0&view_type=tree&graph_start=1509520048&graph_end=1509606448 | 07:09 |
| frickler | yamamoto: devstack-tempest seems to be still under development by andreaf, see the stack starting at https://review.openstack.org/509242 | 07:10 |
| frickler | berendt: sadly there is about half an hour outage every morning, if it takes longer some infra-root will have to take a look | 07:11 |
| berendt | frickler: thanks. | 07:12 |
| andreaf | yamamoto, frickler: yeah that's a good starting point - the only reason it's not merged yet is a dependency on zuul-jobs side - hopefully I can get that fixed in Sydney | 07:13 |
| *** jascott1 has joined #openstack-infra | 07:14 | |
| frickler | berendt: eumel8: seems to have returned just now | 07:14 |
| *** liujiong has quit IRC | 07:15 | |
| *** gildub has quit IRC | 07:15 | |
| *** liujiong has joined #openstack-infra | 07:16 | |
| eumel8 | hi frickler | 07:16 |
| *** annp has quit IRC | 07:16 | |
| frickler | andreaf: are you talking about https://review.openstack.org/509233 ? I could fix the typos for you that I commented on and then get some other config-core to review, if that helps | 07:18 |
| andreaf | frickler: oh I can fix the typos too - just give me a sec | 07:20 |
| *** zhurong has quit IRC | 07:20 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/zuul-jobs master: Add a generic stage-output role https://review.openstack.org/509233 | 07:22 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add graph for aggregate run time grouped by run metadata https://review.openstack.org/492655 | 07:22 |
| andreaf | frickler: ^^^ thanks | 07:22 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql master: Add api func to get list of unique values for run_metadata key https://review.openstack.org/492656 | 07:22 |
| andreaf | frickler: upz I meant https://review.openstack.org/509233 | 07:23 |
| *** rcernin has quit IRC | 07:27 | |
| *** ijw has joined #openstack-infra | 07:30 | |
| *** dhajare has joined #openstack-infra | 07:30 | |
| frickler | andreaf: thx, once zuul is done with that, I'll nag other reviewers ;) | 07:32 |
| andreaf | frickler thanks | 07:32 |
| *** vsaienk0 has joined #openstack-infra | 07:34 | |
| *** ijw has quit IRC | 07:37 | |
| openstackgerrit | zhongshengping proposed openstack-infra/openstack-zuul-jobs master: Add openstack/puppet-modulesync-configs to puppet jobs https://review.openstack.org/517193 | 07:38 |
| *** martinkopec has joined #openstack-infra | 07:40 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements https://review.openstack.org/503645 | 07:46 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements https://review.openstack.org/503645 | 07:47 |
| openstackgerrit | Merged openstack-infra/subunit2sql master: turn on warning-is-error in documentation build https://review.openstack.org/477155 | 07:52 |
| *** Rockyg has quit IRC | 07:54 | |
| openstackgerrit | Merged openstack-infra/subunit2sql master: Switch to use stestr completely https://review.openstack.org/514933 | 07:54 |
| *** armaan has quit IRC | 07:55 | |
| *** armaan has joined #openstack-infra | 07:55 | |
| *** vsaienk0 has quit IRC | 07:56 | |
| *** vsaienk0 has joined #openstack-infra | 07:57 | |
| *** zhurong has joined #openstack-infra | 07:59 | |
| openstackgerrit | Merged openstack/os-testr master: Updated from global requirements https://review.openstack.org/503645 | 07:59 |
| *** kjackal__ has joined #openstack-infra | 08:03 | |
| *** salv-orlando has quit IRC | 08:08 | |
| *** tesseract has joined #openstack-infra | 08:10 | |
| *** pcrews has quit IRC | 08:10 | |
| openstackgerrit | zhongshengping proposed openstack-infra/openstack-zuul-jobs master: Add openstack/puppet-modulesync-configs to puppet jobs https://review.openstack.org/517193 | 08:14 |
| *** jascott1 has quit IRC | 08:15 | |
| *** annp has joined #openstack-infra | 08:15 | |
| *** jascott1 has joined #openstack-infra | 08:16 | |
| *** shardy has joined #openstack-infra | 08:16 | |
| *** huanxie has quit IRC | 08:19 | |
| *** edmondsw has joined #openstack-infra | 08:20 | |
| *** jascott1 has quit IRC | 08:21 | |
| *** alexchadin has joined #openstack-infra | 08:21 | |
| *** edmondsw has quit IRC | 08:25 | |
| *** rcernin has joined #openstack-infra | 08:26 | |
| *** lihi has quit IRC | 08:30 | |
| *** dimak has quit IRC | 08:30 | |
| *** oanson has quit IRC | 08:30 | |
| *** leyal has quit IRC | 08:30 | |
| *** oanson has joined #openstack-infra | 08:31 | |
| *** jpena|off is now known as jpena | 08:33 | |
| *** ijw has joined #openstack-infra | 08:33 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove Barbican legacy jobs https://review.openstack.org/510414 | 08:35 |
| *** spectr has joined #openstack-infra | 08:36 | |
| *** ykarel is now known as ykarel|lunch | 08:37 | |
| *** ijw has quit IRC | 08:38 | |
| *** gk__ has quit IRC | 08:39 | |
| *** xinliang has quit IRC | 08:39 | |
| *** dingyichen has quit IRC | 08:40 | |
| *** huanxie has joined #openstack-infra | 08:42 | |
| *** tmorin has joined #openstack-infra | 08:44 | |
| *** oanson has quit IRC | 08:45 | |
| *** oanson has joined #openstack-infra | 08:46 | |
| *** armaan has quit IRC | 08:49 | |
| *** armaan has joined #openstack-infra | 08:50 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove Barbican legacy jobs https://review.openstack.org/510414 | 08:51 |
| *** ralonsoh has joined #openstack-infra | 08:51 | |
| *** xinliang has joined #openstack-infra | 08:52 | |
| *** xinliang has quit IRC | 08:52 | |
| *** xinliang has joined #openstack-infra | 08:52 | |
| *** lucas-afk is now known as lucasagomes | 08:59 | |
| *** ykarel|lunch is now known as ykarel | 09:01 | |
| *** jpich has joined #openstack-infra | 09:02 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Add cloud quota handling https://review.openstack.org/503838 | 09:03 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Don't fail on quota exceeded https://review.openstack.org/503051 | 09:03 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Make max-servers optional https://review.openstack.org/504282 | 09:03 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Support cores limit per pool https://review.openstack.org/504283 | 09:03 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Support ram limit per pool https://review.openstack.org/504284 | 09:03 |
| *** dtantsur|afk is now known as dtantsur | 09:04 | |
| *** amoralej|off is now known as amoralej | 09:04 | |
| *** pcrews has joined #openstack-infra | 09:05 | |
| *** stakeda has quit IRC | 09:05 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove Barbican legacy jobs https://review.openstack.org/510414 | 09:06 |
| *** salv-orlando has joined #openstack-infra | 09:06 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove barbican-tempest-plugins legacy jobs https://review.openstack.org/517217 | 09:07 |
| *** slaweq_ has quit IRC | 09:08 | |
| *** cuongnv has quit IRC | 09:09 | |
| *** cuongnv has joined #openstack-infra | 09:09 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Replace legacy-tox-build with native job https://review.openstack.org/517081 | 09:11 |
| AJaeger | frickler: moved around as suggested by you ^ | 09:12 |
| *** kiennt26 has joined #openstack-infra | 09:13 | |
| frickler | AJaeger: thx, +2 | 09:14 |
| AJaeger | thanks, frickler | 09:14 |
| *** jaosorior has quit IRC | 09:15 | |
| *** slaweq has joined #openstack-infra | 09:16 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:16 | |
| *** yamamoto has quit IRC | 09:18 | |
| *** liujiong has quit IRC | 09:19 | |
| *** liujiong has joined #openstack-infra | 09:19 | |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: [WIP] Support autoholding nodes for specific changes/refs https://review.openstack.org/515169 | 09:21 |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/517170 | 09:22 |
| *** armaan has quit IRC | 09:22 | |
| *** armaan has joined #openstack-infra | 09:22 | |
| *** vsaienk0 has quit IRC | 09:23 | |
| *** yamamoto has joined #openstack-infra | 09:24 | |
| *** gmann_afk is now known as gmann | 09:24 | |
| *** vsaienk0 has joined #openstack-infra | 09:26 | |
| *** gouthamr has quit IRC | 09:26 | |
| *** huanxie has quit IRC | 09:28 | |
| *** yamamoto has quit IRC | 09:28 | |
| *** electrofelix has joined #openstack-infra | 09:30 | |
| *** gmann is now known as gmann_afk | 09:33 | |
| *** ijw has joined #openstack-infra | 09:35 | |
| *** yamamoto has joined #openstack-infra | 09:35 | |
| *** yamamoto has quit IRC | 09:35 | |
| *** ijw has quit IRC | 09:39 | |
| *** hashar has joined #openstack-infra | 09:42 | |
| *** links has quit IRC | 09:44 | |
| *** zhurong has quit IRC | 09:48 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: save oooq logs https://review.openstack.org/517136 | 09:48 |
| *** e0ne has joined #openstack-infra | 09:48 | |
| *** pgadiya has joined #openstack-infra | 09:49 | |
| *** huanxie has joined #openstack-infra | 09:49 | |
| pabelanger | ask.o.o looks to be running again | 09:51 |
| *** panda|ruck|off is now known as panda|ruck | 09:54 | |
| *** yamamoto has joined #openstack-infra | 09:57 | |
| *** makowals has joined #openstack-infra | 10:00 | |
| *** alexchadin has quit IRC | 10:05 | |
| *** alexchadin has joined #openstack-infra | 10:06 | |
| *** edmondsw has joined #openstack-infra | 10:08 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/shade master: Fix regression for list_router_interfaces https://review.openstack.org/516247 | 10:10 |
| *** edmondsw has quit IRC | 10:13 | |
| *** cuongnv has quit IRC | 10:15 | |
| *** nicolasbock has joined #openstack-infra | 10:16 | |
| *** rtjure has quit IRC | 10:17 | |
| *** alex_xu has quit IRC | 10:18 | |
| *** alex_xu has joined #openstack-infra | 10:18 | |
| *** liujiong has quit IRC | 10:19 | |
| *** sambetts|afk is now known as sambetts | 10:20 | |
| *** derekh has joined #openstack-infra | 10:20 | |
| *** slaweq has quit IRC | 10:21 | |
| *** rtjure has joined #openstack-infra | 10:22 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/openstack-zuul-jobs master: networking-midonet: Exclude ml2 grenade job for ocata https://review.openstack.org/517245 | 10:23 |
| *** maciejjozefczyk has quit IRC | 10:24 | |
| *** dpawlik has quit IRC | 10:24 | |
| *** boden has joined #openstack-infra | 10:28 | |
| *** eroux has joined #openstack-infra | 10:30 | |
| *** maciejjozefczyk has joined #openstack-infra | 10:31 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: fix some periodic networking jobs https://review.openstack.org/517248 | 10:32 |
| *** dpawlik has joined #openstack-infra | 10:32 | |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: [WIP] Support autoholding nodes for specific changes/refs https://review.openstack.org/515169 | 10:32 |
| *** eroux has quit IRC | 10:32 | |
| openstackgerrit | Bernard Cafarelli proposed openstack-infra/openstack-zuul-jobs master: Remove legacy networking-sfc jobs https://review.openstack.org/517249 | 10:33 |
| openstackgerrit | Bernard Cafarelli proposed openstack-infra/project-config master: Remove legacy networking-sfc jobs https://review.openstack.org/517250 | 10:33 |
| *** ijw has joined #openstack-infra | 10:36 | |
| *** sree has quit IRC | 10:38 | |
| *** sree has joined #openstack-infra | 10:38 | |
| *** slaweq has joined #openstack-infra | 10:38 | |
| *** sree_ has joined #openstack-infra | 10:40 | |
| *** sree_ is now known as Guest54744 | 10:40 | |
| *** e0ne has quit IRC | 10:41 | |
| *** ijw has quit IRC | 10:41 | |
| *** e0ne has joined #openstack-infra | 10:42 | |
| *** sree has quit IRC | 10:43 | |
| *** Guest54744 has quit IRC | 10:44 | |
| *** namnh has quit IRC | 10:51 | |
| *** gildub has joined #openstack-infra | 10:56 | |
| *** pbourke has quit IRC | 10:57 | |
| *** pbourke has joined #openstack-infra | 10:59 | |
| *** dizquierdo has joined #openstack-infra | 10:59 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 11:08 |
| *** fultonj has quit IRC | 11:12 | |
| *** hashar is now known as hasharCooking | 11:12 | |
| *** zhurong has joined #openstack-infra | 11:14 | |
| *** smatzek has joined #openstack-infra | 11:15 | |
| *** yamamoto has quit IRC | 11:16 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 11:18 |
| *** yamamoto has joined #openstack-infra | 11:19 | |
| *** tmorin1 has joined #openstack-infra | 11:21 | |
| *** tmorin has quit IRC | 11:21 | |
| *** hemna_ has quit IRC | 11:22 | |
| *** yamamoto has quit IRC | 11:24 | |
| *** huanxie has quit IRC | 11:25 | |
| *** armaan has quit IRC | 11:26 | |
| odyssey4me | I'm seeing a few patches where a subset of tests aren't firing. One example is https://review.openstack.org/517085 where the tests that should fire are actually defined in the patch (although the job itself is defined in another repo). | 11:26 |
| *** armaan has joined #openstack-infra | 11:27 | |
| odyssey4me | Another example is https://review.openstack.org/517238 where it shoulld be firing the tests which were merged some time ago in https://review.openstack.org/515713 | 11:27 |
| *** alexchadin has quit IRC | 11:32 | |
| *** ijw has joined #openstack-infra | 11:38 | |
| *** hasharCooking is now known as hasharEat | 11:38 | |
| *** armaan has quit IRC | 11:39 | |
| *** armaan has joined #openstack-infra | 11:39 | |
| *** vsaienk0 has quit IRC | 11:40 | |
| *** jaosorior has joined #openstack-infra | 11:42 | |
| *** ijw has quit IRC | 11:42 | |
| *** pgadiya has quit IRC | 11:48 | |
| *** alexchadin has joined #openstack-infra | 11:48 | |
| *** fultonj has joined #openstack-infra | 11:50 | |
| *** dsariel__ has quit IRC | 11:51 | |
| *** vsaienk0 has joined #openstack-infra | 11:52 | |
| *** edmondsw has joined #openstack-infra | 11:54 | |
| *** rosmaita has joined #openstack-infra | 11:54 | |
| *** rcernin has quit IRC | 11:56 | |
| *** edmondsw has quit IRC | 11:58 | |
| *** jpena is now known as jpena|lunch | 11:59 | |
| *** shardy is now known as shardy_lunch | 12:01 | |
| *** armaan has quit IRC | 12:05 | |
| *** amoralej is now known as amoralej|lunch | 12:06 | |
| Shrews | odyssey4me: Interesting. We saw a similar case yesterday, but as soon as jeblair showed up to investigate with a recheck, the jobs ran as expected. | 12:07 |
| *** jaosorior has quit IRC | 12:08 | |
| odyssey4me | Shrews the first case appears consistent | 12:11 |
| *** yamamoto has joined #openstack-infra | 12:11 | |
| openstackgerrit | Bernard Cafarelli proposed openstack-infra/project-config master: Remove legacy networking-sfc jobs https://review.openstack.org/517250 | 12:12 |
| *** yamamoto has quit IRC | 12:15 | |
| *** yamamoto has joined #openstack-infra | 12:15 | |
| *** hasharEat is now known as hashar | 12:16 | |
| *** jkilpatr has joined #openstack-infra | 12:16 | |
| *** yamamoto has quit IRC | 12:20 | |
| *** rhallisey has joined #openstack-infra | 12:21 | |
| *** trown|outtypewww is now known as trown | 12:22 | |
| *** armaan has joined #openstack-infra | 12:22 | |
| *** ccamacho has joined #openstack-infra | 12:22 | |
| *** lucasagomes is now known as lucas-hungry | 12:23 | |
| *** dsariel__ has joined #openstack-infra | 12:26 | |
| *** jaypipes has joined #openstack-infra | 12:27 | |
| *** kgiusti has joined #openstack-infra | 12:27 | |
| *** jcoufal has joined #openstack-infra | 12:28 | |
| *** rlandy has joined #openstack-infra | 12:30 | |
| *** witek has quit IRC | 12:31 | |
| *** witek has joined #openstack-infra | 12:31 | |
| *** udesale has quit IRC | 12:33 | |
| *** mrunge has quit IRC | 12:33 | |
| *** jaosorior has joined #openstack-infra | 12:34 | |
| *** catintheroof has joined #openstack-infra | 12:34 | |
| *** smatzek has quit IRC | 12:34 | |
| *** aarefiev is now known as aarefiev_afk | 12:34 | |
| *** dave-mccowan has joined #openstack-infra | 12:36 | |
| *** ijw has joined #openstack-infra | 12:39 | |
| *** thorst has joined #openstack-infra | 12:41 | |
| *** alexchadin has quit IRC | 12:41 | |
| odyssey4me | hmm, it's not particularly critical, but it looks like the github mirroring isn't working right either | 12:41 |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: [WIP] Support autoholding nodes for specific changes/refs https://review.openstack.org/515169 | 12:42 |
| *** alexchadin has joined #openstack-infra | 12:42 | |
| odyssey4me | I've seen a mismatch on two repositories this morning - openstack/openstack-ansible and openstack/openstack-ansible-os_nova | 12:42 |
| odyssey4me | in particular for the stable/newton branches | 12:42 |
| *** ijw has quit IRC | 12:44 | |
| *** dtantsur is now known as dtantsur|bbl | 12:45 | |
| AJaeger | odyssey4me: see fungi's comment around 1:50 this night - seems we did not recover yet. | 12:46 |
| *** yamamoto has joined #openstack-infra | 12:47 | |
| *** yamamoto has quit IRC | 12:47 | |
| * AJaeger see 255 open github entries in the queue ;( | 12:47 | |
| dmsimard | clarkb: the thing that you did for http://paste.openstack.org/show/621218/ .. was that a one time (expensive) thing to run ? or is that perhaps something we could get in statsd/grafana ? | 12:48 |
| *** markvoelker has joined #openstack-infra | 12:49 | |
| *** yamamoto has joined #openstack-infra | 12:50 | |
| *** markvoelker_ has joined #openstack-infra | 12:50 | |
| *** zhurong has quit IRC | 12:51 | |
| *** gildub has quit IRC | 12:51 | |
| *** e0ne_ has joined #openstack-infra | 12:52 | |
| *** wolverineav has joined #openstack-infra | 12:52 | |
| *** markvoelker has quit IRC | 12:53 | |
| odyssey4me | AJaeger ah ok, thanks - no worries, just making sure it's known | 12:53 |
| *** smatzek has joined #openstack-infra | 12:54 | |
| *** e0ne has quit IRC | 12:55 | |
| *** dizquierdo has quit IRC | 12:57 | |
| *** LindaWang has quit IRC | 12:57 | |
| *** lucas-hungry is now known as lucasagomes | 12:59 | |
| *** smatzek has quit IRC | 12:59 | |
| *** jcoufal_ has joined #openstack-infra | 12:59 | |
| *** jcoufal has quit IRC | 12:59 | |
| *** sshnaidm has quit IRC | 13:02 | |
| *** smatzek has joined #openstack-infra | 13:03 | |
| *** bhavik1 has joined #openstack-infra | 13:03 | |
| *** sshnaidm has joined #openstack-infra | 13:03 | |
| *** ccamacho has quit IRC | 13:04 | |
| *** ccamacho has joined #openstack-infra | 13:04 | |
| *** smatzek has quit IRC | 13:07 | |
| *** edmondsw has joined #openstack-infra | 13:10 | |
| *** bobh has joined #openstack-infra | 13:15 | |
| *** LindaWang has joined #openstack-infra | 13:15 | |
| *** rtjure has quit IRC | 13:15 | |
| *** salv-orlando has quit IRC | 13:16 | |
| *** jascott1 has joined #openstack-infra | 13:17 | |
| *** rtjure has joined #openstack-infra | 13:19 | |
| *** jascott1 has quit IRC | 13:21 | |
| *** smatzek has joined #openstack-infra | 13:23 | |
| *** yamamoto has quit IRC | 13:24 | |
| *** smatzek has quit IRC | 13:24 | |
| *** shardy_lunch is now known as shardy | 13:25 | |
| *** bhavik1 has quit IRC | 13:26 | |
| *** sree has joined #openstack-infra | 13:27 | |
| *** mrunge has joined #openstack-infra | 13:27 | |
| *** yamamoto has joined #openstack-infra | 13:28 | |
| *** sree_ has joined #openstack-infra | 13:28 | |
| *** sree_ is now known as Guest85873 | 13:29 | |
| AJaeger | odyssey4me: yes, it's known - but not sure what's going on ;( | 13:30 |
| AJaeger | config-core, could anybody review this cleanup, please? https://review.openstack.org/#/c/515974 | 13:30 |
| *** thorst has quit IRC | 13:30 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci master: Nothing to see here https://review.openstack.org/111011 | 13:31 |
| *** amoralej|lunch is now known as amoralej | 13:32 | |
| *** sree has quit IRC | 13:32 | |
| *** eumel8 has quit IRC | 13:33 | |
| *** jpena|lunch is now known as jpena | 13:34 | |
| *** lbragstad has joined #openstack-infra | 13:34 | |
| *** mriedem has joined #openstack-infra | 13:39 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 13:40 |
| *** markvoel_ has joined #openstack-infra | 13:41 | |
| *** markvoelker_ has quit IRC | 13:42 | |
| *** camunoz has joined #openstack-infra | 13:42 | |
| *** ijw has joined #openstack-infra | 13:46 | |
| *** markvoel_ has quit IRC | 13:47 | |
| *** camunoz has quit IRC | 13:50 | |
| *** camunoz has joined #openstack-infra | 13:51 | |
| *** annp_ has joined #openstack-infra | 13:52 | |
| *** ijw has quit IRC | 13:52 | |
| *** mat128 has joined #openstack-infra | 13:53 | |
| *** eharney has joined #openstack-infra | 13:56 | |
| *** ralonsoh has quit IRC | 13:57 | |
| *** ralonsoh has joined #openstack-infra | 13:57 | |
| *** smatzek has joined #openstack-infra | 13:59 | |
| *** smatzek_ has joined #openstack-infra | 14:02 | |
| *** baoli has joined #openstack-infra | 14:02 | |
| *** smatzek has quit IRC | 14:03 | |
| *** david-lyle has quit IRC | 14:04 | |
| *** jkilpatr has quit IRC | 14:06 | |
| *** esberglu has joined #openstack-infra | 14:07 | |
| *** rbrndt has joined #openstack-infra | 14:09 | |
| jeblair | we're stuck on 7f898796 18:23:02.705 (retry 19997) [71a12fd6] push git@github.com:openstack/nova-specs.git | 14:10 |
| *** dhajare has quit IRC | 14:11 | |
| *** salv-orlando has joined #openstack-infra | 14:12 | |
| *** janki has quit IRC | 14:12 | |
| *** ccamacho has quit IRC | 14:12 | |
| jeblair | i killed that task. the queue is moving again. 259 github replication tasks outstanding now. | 14:12 |
| *** ccamacho has joined #openstack-infra | 14:13 | |
| *** thorst has joined #openstack-infra | 14:13 | |
| AJaeger | jeblair: looking at show-queue, I see some very old entries at the top for ansible, see http://paste.openstack.org/show/625355/ - is there a problem as well? | 14:13 |
| *** thorst_ has joined #openstack-infra | 14:14 | |
| openstackgerrit | Merged openstack-infra/project-config master: Refactor jobs to use build-openstack-sphinx-docs template https://review.openstack.org/515974 | 14:14 |
| jeblair | AJaeger: are you asking about the git-receive-pack entries? | 14:15 |
| AJaeger | jeblair: I don't see more information for them - "d70326be Oct-18 08:44 openstack/openstack-ansible-os_cinder" - Oct 18 strikes me as odd | 14:15 |
| openstackgerrit | Merged openstack-infra/project-config master: Add missing system-required template for Zuul projects https://review.openstack.org/515975 | 14:16 |
| *** dizquierdo has joined #openstack-infra | 14:16 | |
| jeblair | AJaeger: ah, looks like my version has more info | 14:16 |
| jeblair | AJaeger: d70326be Oct-18 08:44 git-receive-pack '/openstack/openstack-ansible-os_cinder.git' (<username>) | 14:16 |
| *** hongbin has joined #openstack-infra | 14:17 | |
| AJaeger | jeblair: I just run " gerrit show-queue -w" | 14:17 |
| jeblair | AJaeger: that's likely a git push where the connection died. it's not blocking anything. | 14:17 |
| *** thorst has quit IRC | 14:18 | |
| AJaeger | hope so ;) | 14:18 |
| AJaeger | but shouldn't it time out after two weeks? | 14:18 |
| jeblair | yes. network programming is hard. :( | 14:18 |
| AJaeger | :( | 14:19 |
| *** armax has joined #openstack-infra | 14:19 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Use -t devpts for /dev/pts mounts https://review.openstack.org/514043 | 14:20 |
| jeblair | odyssey4me: i'll look into 517085, thanks | 14:20 |
| odyssey4me | jeblair if you need anything, just holler - I marked it WIP to prevent it merging | 14:22 |
| *** armaan has quit IRC | 14:23 | |
| *** jkilpatr has joined #openstack-infra | 14:24 | |
| *** coolsvap has quit IRC | 14:26 | |
| *** jcoufal_ has quit IRC | 14:27 | |
| *** jcoufal has joined #openstack-infra | 14:28 | |
| *** nikhil has joined #openstack-infra | 14:29 | |
| *** spectr-RH has joined #openstack-infra | 14:30 | |
| *** caphrim007 has quit IRC | 14:32 | |
| *** spectr has quit IRC | 14:33 | |
| *** caphrim007 has joined #openstack-infra | 14:33 | |
| *** martinkopec has quit IRC | 14:33 | |
| *** Guest85873 has quit IRC | 14:33 | |
| *** sree has joined #openstack-infra | 14:34 | |
| *** caphrim007 has quit IRC | 14:37 | |
| AJaeger | jeblair: what did you do to the github queue? it's empty now... | 14:38 |
| *** sree has quit IRC | 14:38 | |
| *** janki has joined #openstack-infra | 14:38 | |
| *** vsaienk0 has quit IRC | 14:40 | |
| *** cshastri has quit IRC | 14:41 | |
| jeblair | AJaeger: i killed the stuck nova-specs task | 14:41 |
| jeblair | i guess i should log that | 14:42 |
| jeblair | #status log killed stuck gerrit to github replication task on nova-specs repo | 14:42 |
| openstackstatus | jeblair: finished logging | 14:42 |
| *** jcoufal_ has joined #openstack-infra | 14:42 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config master: Run tripleo projects in tripleo gate queue https://review.openstack.org/517335 | 14:43 |
| mwhahaha | weshay, EmilienM -^ | 14:43 |
| * weshay looks | 14:43 | |
| weshay | nice catch | 14:44 |
| *** jcoufal has quit IRC | 14:45 | |
| openstackgerrit | Tytus Kurek proposed openstack-infra/project-config master: Add charm-interface-designate project https://review.openstack.org/517336 | 14:45 |
| *** armaan has joined #openstack-infra | 14:48 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:48 | |
| jeblair | odyssey4me: thanks -- i think i have a lead. give me a few more mins to confirm with a test case, then i think i can give you a workaround. | 14:49 |
| *** ijw has joined #openstack-infra | 14:49 | |
| *** felipemonteiro__ has joined #openstack-infra | 14:49 | |
| EmilienM | mwhahaha: thx | 14:51 |
| jeblair | odyssey4me: when was stable/pike branched for that project? | 14:52 |
| *** felipemonteiro_ has quit IRC | 14:53 | |
| *** ijw has quit IRC | 14:53 | |
| jeblair | (i mean, when was the branch actually created) | 14:54 |
| *** sshnaidm is now known as sshnaidm|afk | 14:55 | |
| openstackgerrit | Tytus Kurek proposed openstack-infra/project-config master: Add charm-interface-designate project https://review.openstack.org/517336 | 14:56 |
| *** xarses_ has joined #openstack-infra | 14:56 | |
| *** dhinesh has joined #openstack-infra | 14:57 | |
| *** ijw has joined #openstack-infra | 14:59 | |
| *** ijw has quit IRC | 15:00 | |
| *** ijw has joined #openstack-infra | 15:00 | |
| odyssey4me | jeblair I did one last night, and this might be that one | 15:04 |
| odyssey4me | jeblair yes, it is that one | 15:05 |
| *** vsaienk0 has joined #openstack-infra | 15:05 | |
| jeblair | odyssey4me: great, that helps, thanks | 15:05 |
| odyssey4me | jeblair I do have another instance of this issue which definitely did not involve a branch change, but I suspect they're different issues | 15:06 |
| odyssey4me | The other example is https://review.openstack.org/517238 where it shoulld be firing the tests which were merged some time ago in https://review.openstack.org/515713 | 15:06 |
| odyssey4me | unfortunately I didn't block that patch from merging, so we can't test with that one - but I can push up another patch | 15:07 |
| *** janki has quit IRC | 15:07 | |
| mnaser | hi infra, would it be ok to mirror puppetlabs repos if i proposed it? | 15:11 |
| mnaser | http://logs.openstack.org/31/517331/1/check/puppet-openstack-integration-4-scenario003-tempest-centos-7/24be519/job-output.txt.gz#_2017-11-02_14_44_23_464749 | 15:11 |
| mnaser | this is happening a bit too often :( | 15:11 |
| *** ramishra has quit IRC | 15:11 | |
| *** krtaylor has quit IRC | 15:12 | |
| *** sshnaidm|afk is now known as sshnaidm | 15:15 | |
| *** salv-orlando has quit IRC | 15:25 | |
| *** janki has joined #openstack-infra | 15:26 | |
| *** annp_ has quit IRC | 15:26 | |
| dhinesh | on my ci setup, once a job is completed on a instance jenkins/nodepool deletes the instance, is there a setting where it can be turned off? | 15:28 |
| *** dpawlik has quit IRC | 15:28 | |
| mnaser | dhinesh: i think the idea is that if you dont do that you'll end up with a lot of instances, though if you're trying to hold a specific instance, i think there's an instance hold feature | 15:30 |
| mnaser | https://docs.openstack.org/infra/nodepool/operation.html#hold | 15:30 |
| dhinesh | mnaser: cool let me try it out | 15:33 |
| dhinesh | mnaser: the reason i was trying to hold was workaround for a problem i had, once nodepool deploys and agent shows up on jenkins, it has default credentials selected to "null" instead of preferred "jenkins" | 15:36 |
| *** witek has quit IRC | 15:37 | |
| *** slaweq has quit IRC | 15:38 | |
| dhinesh | even though i have the user as username as "jenkins" under images on nodepool.yml | 15:38 |
| *** alexchadin has quit IRC | 15:39 | |
| *** salv-orlando has joined #openstack-infra | 15:40 | |
| *** yamamoto has quit IRC | 15:41 | |
| *** eumel8 has joined #openstack-infra | 15:41 | |
| *** spectr has joined #openstack-infra | 15:41 | |
| *** yamamoto has joined #openstack-infra | 15:43 | |
| *** spectr-RH has quit IRC | 15:44 | |
| AJaeger | config-core, could you review https://review.openstack.org/#/c/517086/ ? Once that is in I'll recheck and would like to merge https://review.openstack.org/#/c/517095 as well | 15:46 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: networking-midonet: Exclude ml2 grenade job for ocata https://review.openstack.org/517245 | 15:47 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: fix some periodic networking jobs https://review.openstack.org/517248 | 15:48 |
| *** yamamoto has quit IRC | 15:48 | |
| *** janki has quit IRC | 15:51 | |
| *** spectr has quit IRC | 15:55 | |
| openstackgerrit | Merged openstack-infra/project-config master: Merge project-config linter jobs (1/2) https://review.openstack.org/517086 | 15:57 |
| *** ijw has quit IRC | 15:57 | |
| *** shardy has quit IRC | 15:59 | |
| *** mikal_ has joined #openstack-infra | 15:59 | |
| *** ykarel is now known as ykarel|away | 16:00 | |
| *** andreww has joined #openstack-infra | 16:00 | |
| *** andreww has quit IRC | 16:00 | |
| openstackgerrit | Akshat Tandon proposed openstack/python-jenkins master: This feature will allow build_job to accept build parameters as a list of two membered tuples - [('parameter key', 'parameter value', ), ...]. Currently, build_job expects to receive a dictionary of parameters but this limits the build_job_url function (w https://review.openstack.org/517361 | 16:00 |
| *** xarses_ has quit IRC | 16:01 | |
| *** iyamahat has joined #openstack-infra | 16:02 | |
| *** mikal has quit IRC | 16:02 | |
| *** andreww has joined #openstack-infra | 16:03 | |
| *** ijw has joined #openstack-infra | 16:03 | |
| *** kiennt26_ has joined #openstack-infra | 16:04 | |
| *** ijw has quit IRC | 16:04 | |
| *** yamamoto has joined #openstack-infra | 16:04 | |
| *** yamamoto has quit IRC | 16:04 | |
| *** iyamahat has quit IRC | 16:06 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix gerrit branch creation detection https://review.openstack.org/517363 | 16:07 |
| *** jaosorior has quit IRC | 16:08 | |
| *** psachin has quit IRC | 16:09 | |
| jeblair | odyssey4me: ^ i think that fixes the bug you found... i think i can unblock you by performing a full reconfiguration. i'll do that now. | 16:09 |
| *** links has joined #openstack-infra | 16:10 | |
| *** katkapilatova has joined #openstack-infra | 16:10 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Merge project-config linter jobs (2/2) https://review.openstack.org/517095 | 16:11 |
| AJaeger | jeblair: are you running some debug session on Zuul? It's very slowly adding to the event queue | 16:16 |
| AJaeger | jeblair: never mind, just recovered ;) | 16:16 |
| openstackgerrit | Alex Schultz proposed openstack-infra/openstack-zuul-jobs master: Cleanup old legacy jobs no longer referenced https://review.openstack.org/517367 | 16:17 |
| jeblair | AJaeger: it was the full reconfiguration i mentioned above | 16:17 |
| jeblair | odyssey4me: that fixed it; 517085 is running the full set of jobs now | 16:17 |
| odyssey4me | jeblair oh awesome, tyvm | 16:17 |
| jeblair | odyssey4me: thank you! not merging that patch was very helpful. :) | 16:18 |
| *** dsariel__ has quit IRC | 16:19 | |
| AJaeger | jeblair: ah, missed that ;( | 16:20 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 16:21 |
| *** gordc has joined #openstack-infra | 16:21 | |
| *** dave-mccowan has quit IRC | 16:22 | |
| *** caphrim007 has joined #openstack-infra | 16:22 | |
| *** dhinesh has quit IRC | 16:23 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Merge project-config linter jobs (2/2) https://review.openstack.org/517095 | 16:25 |
| *** petevg|afk is now known as petevg | 16:25 | |
| *** catintheroof has quit IRC | 16:26 | |
| *** Rockyg has joined #openstack-infra | 16:27 | |
| *** Rockyg has quit IRC | 16:27 | |
| gordc | hi, could some with powers add me to panko-stable group? and possibly add sileht to ceilometer/aodh/panko stable groups as well? | 16:27 |
| *** armaan has quit IRC | 16:30 | |
| *** armaan has joined #openstack-infra | 16:30 | |
| *** catintheroof has joined #openstack-infra | 16:30 | |
| *** iyamahat has joined #openstack-infra | 16:31 | |
| *** yamahata has joined #openstack-infra | 16:31 | |
| *** trown is now known as trown|lunch | 16:31 | |
| AJaeger | gordc: looking at panko-stable-maint at https://review.openstack.org/#/admin/groups/1433,members - jd_ can do this | 16:31 |
| AJaeger | gordc: and https://review.openstack.org/#/admin/groups/1066,members has you already | 16:32 |
| pabelanger | gordc: AJaeger: looking at goverence, you're the PTL? | 16:32 |
| gordc | AJaeger: oh. i thought it required someone else since i can't add anyone for ceilometer | 16:32 |
| gordc | pabelanger: i'm 'ptl' | 16:33 |
| AJaeger | gordc: https://review.openstack.org/#/admin/groups/1066,members is self-managed and you're there | 16:33 |
| AJaeger | gordc: https://review.openstack.org/#/admin/groups/533,info (ceilo-stable9 is owned by stable-maint | 16:33 |
| AJaeger | gordc: so, I suggest to talk with those - and if nobody is around ask here. Those groups should all be self-service | 16:34 |
| gordc | AJaeger: kk, i was only looking at ceilometer-stable and thought it was the same for the rest | 16:35 |
| pabelanger | looks like gordc is only missing from panko-stable-maint | 16:35 |
| gordc | i'll wait for jd to return from vacation. not critical anyways. | 16:35 |
| *** links has quit IRC | 16:35 | |
| pabelanger | well, your PTL, so I don't see why we can't add you to panko-stable-maint | 16:36 |
| AJaeger | pabelanger: agreed, we could... | 16:36 |
| pabelanger | and added | 16:37 |
| gordc | yay. thanks! | 16:37 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Merge project-config linter jobs (2/2) https://review.openstack.org/517095 | 16:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix gerrit branch creation detection https://review.openstack.org/517363 | 16:40 |
| *** dtantsur|bbl is now known as dtantsur | 16:41 | |
| *** rwsu has quit IRC | 16:41 | |
| *** Apoorva has joined #openstack-infra | 16:41 | |
| *** ptomka has joined #openstack-infra | 16:42 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Unpause a declined request https://review.openstack.org/517068 | 16:42 |
| *** ptomka has quit IRC | 16:42 | |
| Shrews | tobiash: ^^^ now with more testiness goodness. Took me a while to figure out how to actually test it. | 16:43 |
| *** lbragstad has quit IRC | 16:46 | |
| *** rwsu has joined #openstack-infra | 16:47 | |
| AJaeger | config-core, https://review.openstack.org/517095 is now ready for review - please put it on your queue since I had to disable the ansible-lint to merge this and like to have full coverage again ;) | 16:51 |
| pabelanger | clarkb: looking at logstash-workers, looks like a few processes have died. Going look and start them back up | 16:52 |
| *** hemna has joined #openstack-infra | 16:54 | |
| *** kiennt26_ has quit IRC | 16:55 | |
| openstackgerrit | Merged openstack-infra/project-config master: Run tripleo projects in tripleo gate queue https://review.openstack.org/517335 | 16:58 |
| *** bhavik has joined #openstack-infra | 16:58 | |
| *** bhavik has quit IRC | 16:59 | |
| *** Apoorva_ has joined #openstack-infra | 17:01 | |
| *** tmorin1 has quit IRC | 17:02 | |
| *** e0ne_ has quit IRC | 17:02 | |
| *** armaan has quit IRC | 17:03 | |
| *** Apoorva has quit IRC | 17:03 | |
| *** armaan has joined #openstack-infra | 17:03 | |
| *** rosmaita has quit IRC | 17:04 | |
| *** yamamoto has joined #openstack-infra | 17:05 | |
| *** markvoelker_ has joined #openstack-infra | 17:07 | |
| *** nikhil has quit IRC | 17:09 | |
| *** ijw has joined #openstack-infra | 17:11 | |
| *** markvoelker_ has quit IRC | 17:11 | |
| *** markvoelker has joined #openstack-infra | 17:12 | |
| *** yamamoto has quit IRC | 17:12 | |
| *** markvoelker has quit IRC | 17:13 | |
| *** rosmaita has joined #openstack-infra | 17:13 | |
| *** hashar is now known as hasharAway | 17:14 | |
| *** ijw has quit IRC | 17:15 | |
| *** vsaienk0 has quit IRC | 17:15 | |
| *** LindaWang has quit IRC | 17:16 | |
| *** markvoelker has joined #openstack-infra | 17:18 | |
| *** ijw has joined #openstack-infra | 17:18 | |
| *** markvoelker_ has joined #openstack-infra | 17:21 | |
| *** lucasagomes is now known as lucas-afk | 17:22 | |
| *** markvoelker has quit IRC | 17:23 | |
| *** rbrndt has quit IRC | 17:23 | |
| *** markvoelker has joined #openstack-infra | 17:24 | |
| *** andreww is now known as xarses_ | 17:25 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: normalize daemon process handling https://review.openstack.org/517381 | 17:25 |
| *** markvoelker_ has quit IRC | 17:26 | |
| *** markvoelker_ has joined #openstack-infra | 17:28 | |
| *** markvoelker has quit IRC | 17:29 | |
| *** lbragstad has joined #openstack-infra | 17:29 | |
| *** katkapilatova has left #openstack-infra | 17:32 | |
| *** katkapilatova has quit IRC | 17:32 | |
| *** caphrim007_ has joined #openstack-infra | 17:33 | |
| *** markvoelker_ has quit IRC | 17:34 | |
| *** caphrim007 has quit IRC | 17:36 | |
| *** gyee has joined #openstack-infra | 17:37 | |
| *** fultonj has quit IRC | 17:39 | |
| openstackgerrit | Merged openstack-infra/project-config master: Merge project-config linter jobs (2/2) https://review.openstack.org/517095 | 17:39 |
| *** dhinesh has joined #openstack-infra | 17:43 | |
| *** trown|lunch is now known as trown | 17:44 | |
| *** electrofelix has quit IRC | 17:44 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 17:53 |
| SpamapS | jeblair clarkb mnaser noticed that rechecks on merged patches are still running. I believe we're missing a 'require' on the check pipeline. | 17:53 |
| mnaser | SpamapS: i think its "open: True" ? | 17:54 |
| mnaser | https://github.com/openstack-infra/project-config/blob/master/zuul.d/pipelines.yaml#L112-L114 | 17:55 |
| mnaser | similar to that | 17:55 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/project-config master: Only run checks on open patches https://review.openstack.org/517387 | 17:55 |
| SpamapS | ^^ | 17:55 |
| SpamapS | I think | 17:55 |
| SpamapS | not 100% sure | 17:55 |
| mnaser | does 2 same guesses make for a right answer? :p | 17:55 |
| SpamapS | mnaser: ALWAYS | 17:56 |
| mnaser | :P | 17:56 |
| * SpamapS fist pumps | 17:56 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 17:56 |
| SpamapS | bias confirmed | 17:56 |
| *** caphrim007_ has quit IRC | 17:56 | |
| *** caphrim007 has joined #openstack-infra | 17:56 | |
| *** jpich has quit IRC | 17:57 | |
| *** dizquierdo has quit IRC | 17:57 | |
| jeblair | current-patchset: True | 17:59 |
| jeblair | SpamapS: we also had that before -- want to throw that in too? | 17:59 |
| *** sambetts is now known as sambetts|afk | 17:59 | |
| *** derekh has quit IRC | 17:59 | |
| *** vsaienk0 has joined #openstack-infra | 18:00 | |
| *** dizquierdo has joined #openstack-infra | 18:00 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix gerrit branch creation detection https://review.openstack.org/517363 | 18:00 |
| SpamapS | jeblair: will do | 18:00 |
| *** gouthamr has joined #openstack-infra | 18:00 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/project-config master: Only run checks on open patches https://review.openstack.org/517387 | 18:01 |
| mnaser | AJaeger: those are some really cool small tests for the yaml config files | 18:01 |
| *** SumitNaiksatam has joined #openstack-infra | 18:01 | |
| AJaeger | mnaser: took them over from layout.yaml - but those are the only ones worth. | 18:02 |
| AJaeger | mnaser: but if others come up, we now have a framework ;) | 18:02 |
| *** ralonsoh has quit IRC | 18:02 | |
| mnaser | indeed! | 18:02 |
| mnaser | left a small tiny comment AJaeger :) | 18:04 |
| AJaeger | mnaser: thanks, fixed | 18:04 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 18:05 |
| dhinesh | as part of /etc/nodepool/secure.conf, i have the "credentials=jenkins" which should ideally be the key for jenkins slaves to use(if i am right) | 18:05 |
| dhinesh | but by default it is -none- on the jenkins UI | 18:05 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Cleanup old legacy jobs no longer referenced https://review.openstack.org/517367 | 18:05 |
| dhinesh | am i doing something wrong here? | 18:06 |
| *** vsaienk0 has quit IRC | 18:09 | |
| *** pcaruana has quit IRC | 18:10 | |
| *** esberglu has quit IRC | 18:10 | |
| *** esberglu has joined #openstack-infra | 18:10 | |
| dmsimard | jeblair: Can you share what you used to fsck the different executor git repos ? Would like to check something on our end | 18:11 |
| dmsimard | Was it just a simple git fsck that iterates through the dirs or was it something more ? | 18:12 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Replace legacy-tox-build with native job https://review.openstack.org/517081 | 18:13 |
| *** fultonj has joined #openstack-infra | 18:14 | |
| *** esberglu has quit IRC | 18:15 | |
| jeblair | dmsimard: that was it | 18:16 |
| *** ijw has quit IRC | 18:17 | |
| jeblair | dmsimard: http://paste.openstack.org/show/625379/ | 18:17 |
| *** ijw has joined #openstack-infra | 18:18 | |
| openstackgerrit | Merged openstack-infra/project-config master: Only run checks on open patches https://review.openstack.org/517387 | 18:18 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 18:19 |
| *** ijw has quit IRC | 18:21 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Unpause a declined request https://review.openstack.org/517068 | 18:21 |
| *** esberglu has joined #openstack-infra | 18:21 | |
| dirk | is there a known issue with pypi mirroring? | 18:21 |
| dirk | infra-root: http://mirror.mtl01.inap.openstack.org/pypi/last-modified looks dated | 18:22 |
| *** ijw has joined #openstack-infra | 18:22 | |
| *** rakhmerov has quit IRC | 18:23 | |
| dmsimard | we fixed some out of date mirrors recently, maybe there is something else going on | 18:23 |
| dmsimard | "2017-11-01 21:57:53 UTC jessie mirror not updated since oct 10 due to reboot of server mid-update. manually removed stale lockfile for debian jessie reprepro; mirror updated and release sucessfully." | 18:23 |
| *** asilenkov has quit IRC | 18:24 | |
| *** asilenkov has joined #openstack-infra | 18:24 | |
| *** tesseract has quit IRC | 18:25 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 18:27 |
| *** jcoufal_ has quit IRC | 18:27 | |
| *** jcoufal has joined #openstack-infra | 18:28 | |
| *** rakhmerov has joined #openstack-infra | 18:28 | |
| *** gordc has left #openstack-infra | 18:29 | |
| dmsimard | infra-root: I see four "NODE_FAILURE" jobs for a single review. What are those ? Should we investigate ? I have zero logs.. | 18:33 |
| *** asilenkov has quit IRC | 18:33 | |
| *** asilenkov has joined #openstack-infra | 18:33 | |
| dmsimard | looks like jobs that would've ran on rh1 but I'm not sure https://review.openstack.org/#/c/516785/ | 18:34 |
| dmsimard | sshnaidm, mwhahaha ^ do you know ? | 18:34 |
| *** jpena is now known as jpena|off | 18:34 | |
| AJaeger | dmsimard: those jobs just got removed | 18:34 |
| *** e0ne has joined #openstack-infra | 18:34 | |
| dmsimard | huh | 18:35 |
| AJaeger | https://review.openstack.org/#/c/516794/ | 18:35 |
| sshnaidm | dmsimard, they run on rh1 | 18:36 |
| dmsimard | AJaeger: but that's not a puppet module review | 18:36 |
| sshnaidm | and they should run | 18:37 |
| *** caphrim007_ has joined #openstack-infra | 18:37 | |
| AJaeger | dmsimard: indeed | 18:37 |
| *** ijw has quit IRC | 18:37 | |
| dmsimard | ok let's try to see on our end if there's anything up with rh1, otherwise we have to rely on external help :) | 18:37 |
| dmsimard | nothing obvious on http://grafana.openstack.org/dashboard/db/nodepool-tripleo-test-cloud | 18:38 |
| AJaeger | mnaser: do you want to review https://review.openstack.org/517274 again? | 18:39 |
| *** caphrim007 has quit IRC | 18:40 | |
| *** armaan has quit IRC | 18:42 | |
| *** armaan has joined #openstack-infra | 18:43 | |
| *** dtantsur is now known as dtantsur|afk | 18:44 | |
| *** jascott1 has joined #openstack-infra | 18:47 | |
| jeblair | dmsimard: i can look at the node_failure error | 18:48 |
| jeblair | (we should have zuul emit the nodepool request id for those) | 18:48 |
| *** sshnaidm is now known as sshnaidm|off | 18:49 | |
| dmsimard | jeblair: there's apparently a peak of "TIME TO READY" here, http://grafana.openstack.org/dashboard/db/nodepool-tripleo-test-cloud -- does this correlate perhaps to a new image upload ? node_failure is because zuul gave up trying to allocate a node to that job ? | 18:51 |
| jeblair | launcher-debug.log.2017-11-02_07:2017-11-02 10:03:48,140 DEBUG nodepool.driver.openstack.OpenStackNodeRequestHandler[nl01.openstack.org-6235-PoolWorker.tripleo-test-cloud-rh1-main]: Declining node request 200-0000845432 because nodes failed | 18:51 |
| jeblair | that's the next breadcrumb | 18:51 |
| *** eharney has quit IRC | 18:52 | |
| jeblair | dmsimard: http://paste.openstack.org/show/625381/ | 18:52 |
| dmsimard | bnemec: ^ | 18:53 |
| jeblair | i'll see if i can list fips for that cloud | 18:53 |
| dmsimard | bnemec: could there be leaks in the tenant that could explain the fip quota being reached ? | 18:54 |
| bnemec | It's possible. | 18:54 |
| dmsimard | bnemec: Sagi is gone so you're the only person I know who could check that :D | 18:55 |
| bnemec | I only see 57 fips though. | 18:55 |
| bnemec | I'm pretty sure we have a full /24 assigned to this cloud. | 18:55 |
| dmsimard | bnemec: that was earlier today, ~3hrs ago. What are the quotas like ? | 18:56 |
| jeblair | i also see 57 fips | 18:56 |
| openstackgerrit | Merged openstack-infra/project-config master: Add some check for zuul.d/projects.yaml https://review.openstack.org/517274 | 18:57 |
| jeblair | nodepool is using 46 nodes | 18:57 |
| jeblair | 10 fips are unallocated | 18:57 |
| jeblair | or, rather, unattached | 18:57 |
| Shrews | infra-root: i'd like to restart the nodepool launchers to pick up 2 important bug fixes (and some extra logging). any objections to doing this now? | 18:58 |
| bnemec | I'm checking quotas, but I don't think anything has been changed recently on that front. | 18:58 |
| jeblair | Shrews: maybe wait just a sec in case we find something with the current rh1 situation we want to look into? | 18:58 |
| Shrews | jeblair: certainly | 18:58 |
| jeblair | | totalFloatingIpsUsed | 0 | | 18:59 |
| jeblair | | maxTotalFloatingIps | 75 | | 18:59 |
| jeblair | i don't understand the 0, but the 75 seems okay. | 18:59 |
| bnemec | Yeah, that agrees with what I'm seeing. | 18:59 |
| *** ijw has joined #openstack-infra | 19:01 | |
| jeblair | dmsimard, bnemec: we can drop the rh1 max-instances to 45 until folks have a chance to figure it out. that should stop the errors. i can also delete about 10 unattached fips which are most likely leaked. | 19:03 |
| dmsimard | bnemec: those are shared with OVB nodes right ? | 19:04 |
| *** ijw has quit IRC | 19:05 | |
| bnemec | dmsimard: No, we don't do anything with floating ips in OVB for these jobs. We just use the nodepool-assigned address. | 19:05 |
| *** rbrndt has joined #openstack-infra | 19:05 | |
| jeblair | i deleted the presumptive leakd fips | 19:06 |
| dmsimard | bnemec: hmm, that'd odd.. we have a max-servers of 70. I guess we'll keep an eye out and see if it reproduces. | 19:07 |
| *** dizquierdo has quit IRC | 19:07 | |
| bnemec | dmsimard: Yeah, I don't think this is OVB-related. Those failures present differently and the OVB stacks are creating quite smoothly since we cleaned up the db and rabbit. | 19:08 |
| Shrews | jeblair: oh, fips? I saw errors related to that the other day while looking at other errors. 1 sec... | 19:08 |
| Shrews | launcher-debug.log.2017-11-02_07:shade.exc.OpenStackCloudException: Tried to delete floating ip 66.187.229.132 associated with server 79918a42-9a3a-4823-8e35-bad975481c6b but there was an error deleting it. Not deleting server. | 19:09 |
| jeblair | Shrews: hrm. that is from rh1. | 19:09 |
| Shrews | jeblair: yes, i think all that i saw where rh1 | 19:10 |
| Shrews | jeblair: there are still several in the current launcher logs on nl01 | 19:10 |
| bnemec | We do have one instance that is stuck in a deleting state. | 19:10 |
| jeblair | Shrews: however, that fip is gone now, and so is its server (and it wasn't one of the leaked ones i just deleted) so i guess it recovered? | 19:11 |
| Shrews | jeblair: let me pull the latest... | 19:11 |
| Shrews | shade.exc.OpenStackCloudException: Tried to delete floating ip 66.187.229.244 associated with server 5febb4d4-6881-4ed8-bd31-a335f209972d but there was an error deleting it. Not deleting server. | 19:11 |
| Shrews | that's the most recent (from under an hour ago, i think) | 19:12 |
| jeblair | Shrews: also fip and server gone now | 19:12 |
| dhinesh | i currently use jenkins to post to gerrit , what is the format of commands for the CI to post a "Success" or "Failure" along with the link to the logs? | 19:12 |
| jeblair | Shrews: so it does seem like there's some fip-related trouble on rh1 causing us not to be able to immediately delete things, but it eventually works? | 19:12 |
| Shrews | jeblair: i suspect so. the initial delete fails b/c of the fip. but later cleanup on the server succeeds (presumably the fip is actually deleted by that point, thus no error?) | 19:13 |
| jeblair | bnemec: ^ | 19:13 |
| dmsimard | dhinesh: when I used jenkins the gerrit trigger plugin handled that for me automatically | 19:13 |
| dmsimard | dhinesh: the link to the logs was actually the link to the jenkins build | 19:14 |
| Shrews | jeblair: it seems to have successfully deleted on the very next run (10s later) | 19:14 |
| jeblair | Shrews: this is the other rh1 fip error (that got our attention): http://paste.openstack.org/show/625381/ | 19:15 |
| jeblair | it would be nice if that included the values | 19:15 |
| jeblair | because it doesn't look like we're at quota | 19:15 |
| jeblair | so it would be interesting to see if neutron thought we were | 19:16 |
| bnemec | With 10 extra fips and a quota of 75 we might have hit that though. | 19:16 |
| jeblair | (i mean, presumably it does, but no numbers so <shrug>) | 19:16 |
| bnemec | max-servers is currently 70. | 19:16 |
| Shrews | jeblair: shade just returns what the endpoint returns (which doesn't include quota values) | 19:16 |
| jeblair | Shrews: yeah, i was pontificating in general :) | 19:16 |
| jeblair | bnemec: oh you think we spiked? i had assumed that we were staying steady at max capacity due to backlog, but maybe that's a bad assumption | 19:17 |
| bnemec | jeblair: According to http://grafana.openstack.org/dashboard/db/nodepool-tripleo-test-cloud the servers were maxed out until a little over an hour ago. | 19:17 |
| jeblair | bnemec: indeed, sorry about that. that seems to be the most likely explanation then | 19:18 |
| dhinesh | dmsimard: i tried a bunch a different formats, i was able to post comments like https://review.openstack.org/#/c/516479/, but i dont have an entry under "Workflow" | 19:18 |
| bnemec | Which, conveniently, matches up with the last time I see a quote exceeded message in the neutron logs. | 19:18 |
| jeblair | let me see if i can find more info about the leaked fips | 19:18 |
| dhinesh | bnemec: like ZUUL, which is how a CI is supposed to post correct | 19:19 |
| jeblair | ftr those were: http://paste.openstack.org/show/625383/ | 19:19 |
| *** amoralej is now known as amoralej|off | 19:19 | |
| jeblair | bnemec, Shrews, dmsimard: http://paste.openstack.org/show/625384/ | 19:20 |
| jeblair | that's the last log line for one of the leaked fips | 19:20 |
| *** e0ne has quit IRC | 19:20 | |
| Shrews | neat | 19:20 |
| Shrews | and not sure how such a thing could happen | 19:21 |
| bnemec | jeblair: 10-27, the cloud was in pretty bad shape that day. | 19:21 |
| jeblair | that's our network uuid. | 19:21 |
| jeblair | bnemec: oh ok, should we just chalk it up to $ecloud | 19:22 |
| bnemec | jeblair: Yeah, I think so. | 19:22 |
| bnemec | A lot of bad stuff happened Thursday night into Friday last week. | 19:23 |
| jeblair | okay, so we can probably just say all of this is resolved by deleting the leaked fips, and if something similar happens again, hopefully we'll have more stable debug conditions :) | 19:23 |
| bnemec | Agreed | 19:23 |
| jeblair | (part of me wants to say maybe shade should have done something different there, however, "delete fip that cloud thinks is attached to another server" may not be the best choice :) | 19:24 |
| bnemec | jeblair: dmsimard: Thanks for your help. | 19:24 |
| jeblair | bnemec: likewise | 19:24 |
| bnemec | jeblair: Our neutron behaves very strangely when it's overloaded like it was those days. | 19:24 |
| jeblair | Shrews: i'd say you're all clear for restarts now if you want | 19:24 |
| bnemec | We leak all kinds of ports under those circumstances. | 19:24 |
| bnemec | I cleaned up the private ports, but I didn't realize we had leaked fips too. | 19:25 |
| dmsimard | jeblair: we get that error pretty often in RDO's nodepool, it eventually ends up suceeding to delete the FIP. I discussed this with mordred before.. | 19:25 |
| dmsimard | my suspicion that I was never able to confirm is that the delete operation is not atomic -- the FIP is detached first and then the VM is deleted, in the meantime, something else can pick up the FIP and then nodepool tries to delete the VM but the FIP it had has already been re-assigned elsewhere and it errors out there. | 19:26 |
| Shrews | jeblair: k. doing so now | 19:27 |
| *** rhallisey has quit IRC | 19:28 | |
| *** dprince has joined #openstack-infra | 19:28 | |
| Shrews | infra-root: nodepool launcher processes restarted | 19:29 |
| *** camunoz has quit IRC | 19:29 | |
| *** smatzek_ is now known as smatzek | 19:30 | |
| *** dave-mccowan has joined #openstack-infra | 19:33 | |
| openstackgerrit | Ken Giusti proposed openstack-infra/project-config master: Move devstack-plugin-amqp1 tests to the project repo https://review.openstack.org/517415 | 19:42 |
| *** camunoz has joined #openstack-infra | 19:43 | |
| openstackgerrit | Ken Giusti proposed openstack-infra/openstack-zuul-jobs master: Move devstack-plugin-amqp1 jobs to the project repo https://review.openstack.org/517416 | 19:43 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Reset state on unpaused, declined request https://review.openstack.org/517417 | 19:44 |
| *** gridinv has quit IRC | 19:46 | |
| *** edmondsw has quit IRC | 19:51 | |
| *** caphrim007_ has quit IRC | 19:51 | |
| *** caphrim007 has joined #openstack-infra | 19:52 | |
| *** ijw has joined #openstack-infra | 19:53 | |
| *** dave-mccowan has quit IRC | 19:56 | |
| pabelanger | ack | 19:56 |
| *** mikal_ is now known as mikal | 20:01 | |
| *** jcoufal has quit IRC | 20:02 | |
| *** eharney has joined #openstack-infra | 20:02 | |
| AJaeger | config-cores, https://review.openstack.org/517248 fixes periodic jobs for three networking repos, could you review it, please? | 20:02 |
| *** jcoufal has joined #openstack-infra | 20:02 | |
| *** camunoz has quit IRC | 20:03 | |
| AJaeger | mnaser: https://review.openstack.org/517193 is a puppet change you might be interested in | 20:03 |
| *** camunoz has joined #openstack-infra | 20:03 | |
| AJaeger | jeblair: could you review https://review.openstack.org/509233 again, please? andreaf needs this to move forward with some qa tests.. | 20:04 |
| AJaeger | infra-root, the oldest three changes in the check queue just miss a single job each - something looks very odd there. There's no progress and the oldest is 6+ hours old | 20:08 |
| *** dprince has quit IRC | 20:08 | |
| *** Apoorva_ has quit IRC | 20:08 | |
| jeblair | AJaeger: it's timing out, very slowly | 20:10 |
| *** SumitNaiksatam has quit IRC | 20:10 | |
| jeblair | it has a long job timeout which is being applied to each of the post playbooks | 20:11 |
| AJaeger | argh ;( and that on all three of them? Then let it timeout... | 20:11 |
| jeblair | Shrews: log streamer has stopped on ze08, but no info since this: | 20:12 |
| jeblair | 2017-10-31 15:32:13,566 DEBUG zuul.lib.LogStreamer: LogStreamer starting on port 79 | 20:12 |
| jeblair | oh wait | 20:13 |
| jeblair | Shrews: there's a different logger name | 20:13 |
| jeblair | (i think we should switch all our loggers to 'logical' rather than class-based names) | 20:13 |
| *** dprince has joined #openstack-infra | 20:14 | |
| jeblair | Shrews: this is the last log entry: http://paste.openstack.org/show/625388/ | 20:14 |
| *** dave-mccowan has joined #openstack-infra | 20:15 | |
| *** jcoufal_ has joined #openstack-infra | 20:16 | |
| *** dprince has quit IRC | 20:17 | |
| *** thorst_ has quit IRC | 20:17 | |
| *** dprince has joined #openstack-infra | 20:17 | |
| *** gyee has quit IRC | 20:18 | |
| *** jcoufal has quit IRC | 20:19 | |
| *** jcoufal has joined #openstack-infra | 20:20 | |
| jeblair | Shrews: i have no idea :( | 20:21 |
| AJaeger | infra-root, another disk full? | 20:22 |
| AJaeger | https://review.openstack.org/516511 has a merger failure in the gate queue | 20:22 |
| *** jcoufal_ has quit IRC | 20:22 | |
| *** kjackal__ has quit IRC | 20:23 | |
| *** kjackal_ has quit IRC | 20:23 | |
| *** kgiusti has left #openstack-infra | 20:23 | |
| *** jcoufal_ has joined #openstack-infra | 20:24 | |
| *** camunoz has quit IRC | 20:25 | |
| *** smatzek has quit IRC | 20:25 | |
| *** slaweq has joined #openstack-infra | 20:26 | |
| *** jcoufal has quit IRC | 20:27 | |
| jeblair | AJaeger: looking | 20:28 |
| *** mat128 has quit IRC | 20:29 | |
| *** ijw has quit IRC | 20:29 | |
| *** ijw has joined #openstack-infra | 20:29 | |
| *** rbrndt has quit IRC | 20:29 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: fix the undercloud-oooq job's subunit failures https://review.openstack.org/517428 | 20:31 |
| *** dave-mccowan has quit IRC | 20:35 | |
| *** gyee has joined #openstack-infra | 20:36 | |
| *** rbrndt has joined #openstack-infra | 20:39 | |
| jeblair | AJaeger: git had an issue which seems to be transient. it looks fine now, so i can't really debug any further. i'll delete the repo just in case though. | 20:40 |
| *** kmalloc has quit IRC | 20:40 | |
| *** xingchao has joined #openstack-infra | 20:41 | |
| *** Apoorva has joined #openstack-infra | 20:41 | |
| *** felipemonteiro_ has joined #openstack-infra | 20:42 | |
| Shrews | jeblair: well, at least that's more than we had before. even still, i'm perplexed | 20:43 |
| Shrews | jeblair: that's just a child of the main finger daemon. doesn't explain why the main process balked | 20:44 |
| *** rhallisey has joined #openstack-infra | 20:44 | |
| *** xingchao has quit IRC | 20:44 | |
| *** felipemonteiro__ has quit IRC | 20:44 | |
| jeblair | ya | 20:46 |
| Shrews | jeblair: which log file was that last entry in? | 20:46 |
| jeblair | Shrews: and the startup message confirms we at least got logging from the main proc | 20:46 |
| jeblair | Shrews: i think the .1.gz | 20:46 |
| jeblair | i think startup was from .2.gz but not sure | 20:46 |
| AJaeger | jeblair: thanks. please look at https://review.openstack.org/509233 as well so that andreaf can move forward with zuul v3 tempest jobs | 20:49 |
| *** trown is now known as trown|outtypewww | 20:49 | |
| jeblair | AJaeger: i'm going to have to talk to andreaf about that next week. a number of things confuse me. | 20:51 |
| *** dprince has quit IRC | 20:54 | |
| AJaeger | jeblair: ok, thanks | 20:54 |
| *** gyee has quit IRC | 20:54 | |
| Shrews | jeblair: i'm not sure what to do about the finger daemon aborting at this point. we could try switching to the threading model. would be less optimal, but maybe it could give us some clue? | 20:54 |
| jeblair | Shrews: worth a shot. | 20:55 |
| *** jascott1 has quit IRC | 20:59 | |
| *** jascott1 has joined #openstack-infra | 21:00 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Switch to threading model of socketserver https://review.openstack.org/517437 | 21:00 |
| Shrews | jeblair: ^^^ *shrug* | 21:00 |
| zigo | I am concerned that this patch is a security problem: https://review.openstack.org/#/c/284415/ | 21:00 |
| *** rhallisey has quit IRC | 21:01 | |
| *** jascott1 has quit IRC | 21:01 | |
| zigo | Shouldn't lock files be accessible only by *one* user? | 21:01 |
| *** jascott1 has joined #openstack-infra | 21:02 | |
| *** jascott1 has quit IRC | 21:03 | |
| *** jascott1 has joined #openstack-infra | 21:03 | |
| jeblair | zigo: i see you already asked dims in #openstack-dev. that's the best place for the question. | 21:03 |
| *** jascott1 has quit IRC | 21:05 | |
| *** jascott1 has joined #openstack-infra | 21:05 | |
| *** rbrndt has quit IRC | 21:06 | |
| *** eharney has quit IRC | 21:08 | |
| AJaeger | jeblair: do you want to WIP andreaf's change for now? | 21:08 |
| *** jascott1 has quit IRC | 21:09 | |
| *** rbrndt has joined #openstack-infra | 21:09 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: fix the undercloud-oooq job's subunit failures https://review.openstack.org/517428 | 21:11 |
| *** hasharAway is now known as hashar | 21:13 | |
| andreaf | jeblair: heh that may be due to my poor ansible skills :P but yeah let's have a chat sometime next week | 21:14 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add openstack/puppet-modulesync-configs to puppet jobs https://review.openstack.org/517193 | 21:18 |
| *** aeng has joined #openstack-infra | 21:24 | |
| *** xingchao has joined #openstack-infra | 21:26 | |
| johnsom | Is devstack-tempest a thing? I see reference to it here: https://docs.openstack.org/infra/manual/zuulv3.html#converting-custom-dsvm-jobs but I'm not seeing it in openstack-zuul-jobs or zuul-jobs | 21:28 |
| jeblair | andreaf, AJaeger: none of my confusion precludes landing that patch and iterating forward, so i +3d it | 21:30 |
| *** xingchao has quit IRC | 21:31 | |
| jeblair | johnsom: hopefully soon | 21:31 |
| johnsom | Ah, ok. We are just about to start landing out plugin and was looking into setting up the gates. | 21:31 |
| jeblair | johnsom: i think the current work in progress is here: https://review.openstack.org/509242 | 21:32 |
| johnsom | jeblair Thanks! | 21:32 |
| *** rosmaita has quit IRC | 21:32 | |
| *** ccamacho has quit IRC | 21:33 | |
| *** jtomasek has quit IRC | 21:35 | |
| *** ijw has quit IRC | 21:40 | |
| *** d0ugal has quit IRC | 21:40 | |
| *** d0ugal has joined #openstack-infra | 21:46 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add a generic stage-output role https://review.openstack.org/509233 | 21:49 |
| *** yamamoto has joined #openstack-infra | 21:51 | |
| *** boden has quit IRC | 21:52 | |
| *** catintheroof has quit IRC | 21:53 | |
| *** baoli has quit IRC | 21:54 | |
| *** baoli has joined #openstack-infra | 21:55 | |
| *** felipemonteiro_ has quit IRC | 21:56 | |
| *** bobh has quit IRC | 21:58 | |
| *** baoli has quit IRC | 21:59 | |
| *** hashar has quit IRC | 22:00 | |
| *** gildub has joined #openstack-infra | 22:01 | |
| *** xingchao has joined #openstack-infra | 22:01 | |
| *** rcernin has joined #openstack-infra | 22:01 | |
| *** threestrands has joined #openstack-infra | 22:10 | |
| *** threestrands has quit IRC | 22:10 | |
| *** threestrands has joined #openstack-infra | 22:10 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Call undercloud install for containerized CI job https://review.openstack.org/517447 | 22:13 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Prime github app install map on connection load https://review.openstack.org/517121 | 22:14 |
| *** xingchao has quit IRC | 22:16 | |
| *** dizquierdo has joined #openstack-infra | 22:16 | |
| *** esberglu has quit IRC | 22:18 | |
| *** iyamahat_ has joined #openstack-infra | 22:21 | |
| *** iyamahat has quit IRC | 22:21 | |
| *** xarses_ has quit IRC | 22:22 | |
| *** lbragstad has quit IRC | 22:24 | |
| *** jaypipes has quit IRC | 22:29 | |
| *** david-lyle has joined #openstack-infra | 22:29 | |
| *** ijw has joined #openstack-infra | 22:41 | |
| *** rlandy is now known as rlandy|afk | 22:43 | |
| *** thorst has joined #openstack-infra | 22:44 | |
| *** thorst has quit IRC | 22:45 | |
| *** ijw has quit IRC | 22:46 | |
| *** rbrndt has quit IRC | 22:48 | |
| *** rbrndt has joined #openstack-infra | 22:48 | |
| *** rbrndt has quit IRC | 22:48 | |
| *** eumel8 has quit IRC | 22:48 | |
| *** thorst has joined #openstack-infra | 22:49 | |
| dirk | is there any way for me to debug mirroring issues? | 22:54 |
| dirk | it looks like all the cloud pypi mirrors are several days old | 22:54 |
| dirk | do they sync from one master place? where can I see the master place? | 22:54 |
| mnaser | dirk: this is data only accessible to infra-root atm and i think it's going to be hard to find someone to look into it due to travels | 22:58 |
| *** dizquierdo has quit IRC | 22:59 | |
| openstackgerrit | Jamey McCabe proposed openstack-infra/irc-meetings master: Updating LCOO schedule to new time and channel https://review.openstack.org/517449 | 23:01 |
| jeblair | mnaser, dirk: i'll take a look at the log | 23:03 |
| jeblair | subprocess.CalledProcessError: Command '['bandersnatch', 'mirror']' returned non-zero exit status 1 | 23:04 |
| jeblair | that's not as helpful as i would like. | 23:04 |
| jeblair | i'll try to run it manually and see what i can glean | 23:04 |
| *** thorst has quit IRC | 23:06 | |
| jeblair | OSError: [Errno 122] Disk quota exceeded: '/afs/.openstack.org/mirror/pypi/web/simple/tmpBoeAob' | 23:08 |
| *** wolverineav has quit IRC | 23:08 | |
| jeblair | mirror.pypi.readonly 1000000000 999588732 100%<< 39% <<WARNING | 23:08 |
| *** wolverineav has joined #openstack-infra | 23:08 | |
| *** felipemonteiro_ has joined #openstack-infra | 23:08 | |
| jeblair | pypi is getting big. | 23:08 |
| *** slaweq has quit IRC | 23:09 | |
| *** dizquierdo has joined #openstack-infra | 23:10 | |
| jeblair | #status log increased mirror.pypi afs volume quota from 1000000000 to 1200000000 | 23:11 |
| openstackstatus | jeblair: finished logging | 23:11 |
| *** slaweq has joined #openstack-infra | 23:12 | |
| *** wolverineav has quit IRC | 23:13 | |
| *** bobh has joined #openstack-infra | 23:16 | |
| *** bobh has quit IRC | 23:16 | |
| *** slaweq has quit IRC | 23:16 | |
| *** rcernin has quit IRC | 23:17 | |
| mnaser | yay, cool, thanks jeblair | 23:17 |
| *** bobh has joined #openstack-infra | 23:23 | |
| *** caphrim007_ has joined #openstack-infra | 23:26 | |
| *** caphrim007 has quit IRC | 23:30 | |
| *** caphrim007_ has quit IRC | 23:30 | |
| dhinesh | "credentials" property of nodepool does not seem to work on slaves even if there are entries for it in jenkins, https://docs.openstack.org/infra/nodepool/configuration.html , has anyone tried it? | 23:38 |
| *** hongbin has quit IRC | 23:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test repositories https://review.openstack.org/517130 | 23:40 |
| *** jcoufal has joined #openstack-infra | 23:41 | |
| *** slaweq has joined #openstack-infra | 23:41 | |
| *** nikhil has joined #openstack-infra | 23:41 | |
| *** jcoufal_ has quit IRC | 23:43 | |
| *** ijw has joined #openstack-infra | 23:43 | |
| *** links has joined #openstack-infra | 23:44 | |
| *** ijw has quit IRC | 23:50 | |
| dirk | jeblair: thanks, that seems like it would help | 23:54 |
| openstackgerrit | Tom Barron proposed openstack-infra/project-config master: Update project setttings for manila-ui https://review.openstack.org/517456 | 23:55 |
| *** Apoorva has quit IRC | 23:59 | |
| *** felipemonteiro_ has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!