| ianw | i feel like this could be done in devstack-gate, but i'm not sure i feel as strongly about that as clarkb seems to feel against it | 00:00 |
|---|---|---|
| clarkb | (it is ridiculously hard to find vxlan info as it relates to specific kernels. Or maybe I am bad at googling) | 00:00 |
| ianw | we already have a periodic job building afs rpms ... | 00:01 |
| pabelanger | forgot about that | 00:01 |
| *** maishsk has joined #openstack-infra | 00:01 | |
| clarkb | 3.7 was the first kernel to include it | 00:01 |
| clarkb | what does centos run? | 00:01 |
| ianw | and a repo ... is ovs distributed in an easily buildable form? | 00:01 |
| clarkb | ianw: please lets not build it | 00:01 |
| pabelanger | okay, so we can push back to RDO team about moving ovs out of their tree. That gives me something to work with in the morning | 00:02 |
| mordred | jeblair, clarkb: you're going to LOVE this next shade patch | 00:03 |
| *** ayoung has joined #openstack-infra | 00:03 | |
| mordred | actually | 00:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use configured overrides for internal/external https://review.openstack.org/306190 | 00:03 |
| mordred | clarkb: I can't push to gerrit - is it working for you? | 00:03 |
| openstackgerrit | Merged openstack-infra/puppet-openafs: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306139 | 00:03 |
| mordred | oh. there it is | 00:03 |
| openstackgerrit | Merged openstack-infra/puppet-openstackid: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306141 | 00:03 |
| clarkb | mordred: db backups | 00:03 |
| mordred | clarkb: duh | 00:03 |
| openstackgerrit | Merged openstack-infra/puppet-os_client_config: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306142 | 00:03 |
| ianw | well, FWIW, all the stuff to build it is right there in the tree -> https://github.com/openvswitch/ovs/tree/master/rhel | 00:04 |
| mordred | Shrews: ^^ see above | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-packagekit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306143 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-pgsql_backup: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306144 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-project_config: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306148 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-redis: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306150 | 00:04 |
| *** ddieterly has joined #openstack-infra | 00:04 | |
| openstackgerrit | Merged openstack-infra/puppet-planet: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306147 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-reviewday: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306153 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-puppet: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306149 | 00:04 |
| clarkb | I am collecting kernel versions. centos7 3.10, debian 3.16, 3.13 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-ssh: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306156 | 00:04 |
| clarkb | er that last one is ubuntu-trusty | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-jeepyb: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306125 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-refstack: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306151 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-stackalytics: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306158 | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-storyboard: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306160 | 00:04 |
| clarkb | so in theory vxlan is an option with linux bridge on everything we run (xenial and fedora should be newer than trusty and centos) | 00:05 |
| openstackgerrit | Merged openstack-infra/puppet-statusbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306159 | 00:05 |
| openstackgerrit | Merged openstack-infra/puppet-tmpreaper: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306163 | 00:05 |
| clarkb | pabelanger: ianw feel free to convert us to linux bridge + vxlan instead | 00:05 |
| pabelanger | clarkb: so, serious question.... is that a lot of work? | 00:05 |
| clarkb | pabelanger: yes likely | 00:05 |
| clarkb | well | 00:06 |
| clarkb | depends | 00:06 |
| *** asettle has quit IRC | 00:06 | |
| clarkb | if any of the platforms fail to vxlan the debugging is unfun | 00:06 |
| *** pradk has quit IRC | 00:06 | |
| clarkb | if they all work then no should be straightforward | 00:06 |
| Shrews | mordred: tested. works. bueno | 00:06 |
| *** ihrachys has quit IRC | 00:06 | |
| pabelanger | clarkb: okay, I'll propose that too | 00:06 |
| fungi | yeah, most of the hits i get on the internet for installing ovs on centos say to rpmbuild the specfile it provides and install the result | 00:06 |
| fungi | few if any even mention rdo | 00:07 |
| mordred | so, fwiw, I've been doing a CD-from-master OpenStack cloud inside the corporate walls | 00:07 |
| mordred | and part of that invovled master of ovs too | 00:07 |
| ianw | fungi / clarkb: build our own is probably a decent intermediate step, if we've got a longer-term plan | 00:07 |
| *** apoorvad has joined #openstack-infra | 00:07 | |
| clarkb | ok everyone back up | 00:07 |
| clarkb | we literally do not need ovs from master | 00:07 |
| mordred | custom built ovs worked great | 00:07 |
| mordred | no, I know | 00:07 |
| mordred | I'm just saying that ovs packaging in tree does work well | 00:08 |
| mordred | with very little fiddling | 00:08 |
| mordred | I am not suggesting master ovs | 00:08 |
| fungi | we could use liberty rdo instead as a short term solution i guess | 00:08 |
| fungi | or whatever | 00:08 |
| *** esker has joined #openstack-infra | 00:08 | |
| *** ramishra has joined #openstack-infra | 00:08 | |
| *** IlyaG has joined #openstack-infra | 00:08 | |
| fungi | my concern is that if latest rdo is unstable and shouldn't be depended upon, then that extends to the ovs package and its deps as well | 00:09 |
| clarkb | fungi: which is the same if we build our own... except we are on the hook for it | 00:09 |
| mordred | well, we're on the hook for it either way | 00:09 |
| mordred | it doesn't matter if rdo breaks or we break | 00:10 |
| clarkb | mordred: actually it does | 00:10 |
| mordred | if our nodes break, it's on us | 00:10 |
| clarkb | mordred: beaues the people breaking rdo are the people running tests on centos with us | 00:10 |
| fungi | agreed. i wasn't suggesting we build our own. i was pointing out that it's not really packaged generally in the rh ecosystem (which is _why_ everyone seems to be building it from source instead) | 00:10 |
| mordred | clarkb: fair enough | 00:10 |
| mordred | clarkb: if the only consumers of the rdo ovs packages are people running test jobs in support of rdo, then that seems fine to me | 00:10 |
| pabelanger | I should clarify. I don't think ovs in RDO master is broken, having RDO enabled broken stable jobs because we pin to master | 00:11 |
| clarkb | mordred: I think largely that is the case, with kolla and a few othres on the side | 00:11 |
| mordred | if other non-rdo people would wind up being affected by the ovs package | 00:11 |
| mordred | yah. that's the thing | 00:11 |
| mordred | I'd worry about kolla and a few others | 00:11 |
| *** piet has quit IRC | 00:12 | |
| fungi | this is similarly why i'm not keen on adding uca to our ubuntu images by default each time it comes up | 00:12 |
| clarkb | anyways the test env needs this package, we install it from upstream where it is packaged | 00:12 |
| clarkb | we can probably use linux bridge instead | 00:12 |
| clarkb | or packaging can be fixed | 00:12 |
| mordred | Shrews: woot! | 00:12 |
| clarkb | the reason I feel strongly about htis is I have spent far too much time debugging and fixing this for openstack and neutron in particular | 00:13 |
| *** lakshmiS_ has quit IRC | 00:13 | |
| *** sflanigan has joined #openstack-infra | 00:13 | |
| *** sflanigan has joined #openstack-infra | 00:13 | |
| *** esker has quit IRC | 00:13 | |
| clarkb | what we have now works and it works really really well | 00:13 |
| *** bpokorny_ has joined #openstack-infra | 00:14 | |
| mordred | yah. I pretty much categorically defer to you on this topic | 00:14 |
| *** bpokorny_ has quit IRC | 00:14 | |
| r-mibu | infra cores, could you review/merge https://review.openstack.org/#/c/303921/ ? | 00:15 |
| r-mibu | we have to enable these non-voting jobs - thanks in advance | 00:15 |
| *** Sukhdev has joined #openstack-infra | 00:15 | |
| pabelanger | Right, I think I had enough to update RDO team. | 00:16 |
| *** tphummel has quit IRC | 00:16 | |
| pabelanger | clarkb: thanks for the info | 00:16 |
| r-mibu | it's in openstack-infra/project-config repository... | 00:16 |
| *** bpokorny_ has joined #openstack-infra | 00:16 | |
| fungi | i do agree that ovs moving (or being copied) from rdo to epel would be wonderful | 00:16 |
| fungi | then we could drop rdo being on by default on our images | 00:16 |
| pabelanger | fungi: Yup, I think that is a starting point. | 00:17 |
| *** bpokorny has quit IRC | 00:18 | |
| clarkb | fwiw I am generally a fan of linux bridge, it does have higher interface counts which can be a little confusing but over all is more pleasant to deal with than ovs | 00:18 |
| clarkb | but back when we set this stuff up neutron threw their hands in the air and said the original linux bridge stuff was all wrong and we had to ovs (and for better or worse I listened) | 00:18 |
| clarkb | it looks like the reality is all of our kernels will work with linux bridge and vxlan | 00:18 |
| clarkb | so we should be fine | 00:19 |
| *** Qiming has joined #openstack-infra | 00:19 | |
| pabelanger | I don't know enough about it to know :( I should look into it once of these days | 00:20 |
| pabelanger | hopefully see it in action when infracloud comes back online | 00:20 |
| *** sambetts|afk has quit IRC | 00:22 | |
| *** mylu has joined #openstack-infra | 00:23 | |
| *** tonytan4ever has quit IRC | 00:23 | |
| clarkb | pabelanger: to switch its just a matter of paying a lot of attention to detail to make sure all the "wires" are wired up to the correct places and that we set the MTUs correctly everywhere | 00:24 |
| clarkb | it is like wiring a virtual rack of hardware | 00:25 |
| clarkb | the two big things that have tripped us up in the path are MTUs and "miswired" connections | 00:25 |
| clarkb | well that and clouds not letting gre traffic flow | 00:26 |
| *** alex_xu has quit IRC | 00:26 | |
| anteaya | have any of the work setting new defaults for mtu made it through to your end, clarkb? | 00:27 |
| anteaya | has | 00:27 |
| *** sridhar_ram has quit IRC | 00:27 | |
| *** alex_xu has joined #openstack-infra | 00:27 | |
| clarkb | anteaya: that was basically the carrot to neutron, we said "we set our interface MTUs properly, neutron should then determine what its MTUs are based on that" | 00:28 |
| *** yarkot1 has joined #openstack-infra | 00:29 | |
| clarkb | anteaya: previouly you had t oset a handful of neutron config options aiui, which itself is complicated and messy | 00:29 |
| clarkb | anteaya: but neutron typically has all the info it needs available to it on the systems | 00:29 |
| *** yarkot1 has quit IRC | 00:30 | |
| anteaya | so have you any feedback on what you have seen from the mtu defaults lately? | 00:30 |
| *** sambetts has joined #openstack-infra | 00:31 | |
| anteaya | I believe they have implimented some of the new defaults | 00:31 |
| clarkb | anteaya: not really, we set up the fake hardware and neutron consumes that info and configures itself | 00:31 |
| *** mylu has quit IRC | 00:31 | |
| clarkb | anteaya: if neutrons tests are working then it likely means that everything functions | 00:31 |
| anteaya | okay great, thank you | 00:32 |
| *** yarkot1 has joined #openstack-infra | 00:34 | |
| openstackgerrit | Merged openstack-infra/puppet-snmpd: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306155 | 00:35 |
| openstackgerrit | Merged openstack-infra/puppet-nodepool: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306137 | 00:38 |
| clarkb | aha! found it | 00:38 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Add a few more layout checks https://review.openstack.org/306194 | 00:38 |
| *** avarner has joined #openstack-infra | 00:38 | |
| openstackgerrit | Merged openstack-infra/puppet-logstash: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306132 | 00:38 |
| clarkb | random blog says you can't vxlan with unicast on >2 hosts | 00:39 |
| clarkb | with linux bridge | 00:39 |
| openstackgerrit | Merged openstack-infra/puppet-ssl_cert_check: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306157 | 00:39 |
| openstackgerrit | Merged openstack-infra/puppet-mysql_backup: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306136 | 00:39 |
| clarkb | right now we only do two hosts but the system is designed toscale up until the virtual switch falls over | 00:39 |
| clarkb | pabelanger: ^ so that would be a limitation to ocnsider | 00:39 |
| clarkb | but is also something to confirm becuase random internet blog (https://www.flockport.com/flockport-labs-lxc-and-vxlan/) might be wrong | 00:39 |
| clarkb | we can't multicast in our cloud envs | 00:40 |
| fungi | though we can unicast flood, if the tool will support falling back to it | 00:41 |
| clarkb | fungi: according ot that blog it won't | 00:42 |
| fungi | (send copies to all configured peers, ignore unneeded copies received) | 00:42 |
| fungi | unfortunate | 00:42 |
| clarkb | fungi: you can run some other service to keep track of vteps | 00:42 |
| fungi | wonder if there's a kernel module which could translate one to the other | 00:43 |
| clarkb | considering we only need 2 hosts to be connected now this may work fine until we can switch back to ovs more clenaly | 00:44 |
| *** yarkot1 has quit IRC | 00:44 | |
| *** stewie925 has quit IRC | 00:45 | |
| *** xarses has quit IRC | 00:45 | |
| clarkb | this is so much fun, GRE is blocked on some clouds, linux bridge + vxlan is point to point only (out of the box), ovs + vxlan has funny packaging | 00:45 |
| clarkb | we have a ball, a frisbee, and a hockey puck, but what we really need is a pigskin | 00:46 |
| *** zz_dimtruck is now known as dimtruck | 00:51 | |
| *** maishsk has quit IRC | 00:52 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Add a few more layout checks https://review.openstack.org/306194 | 00:52 |
| ianw | "The most crisp and clear documentation on VXLAN online can be found in this 5 part blog post" . not sure if i'd say a 5-part blog post was "crisp" :) | 00:54 |
| ianw | i'm constantly amazed any packets manage to make it out of neutron at any point, though | 00:55 |
| *** pvaneck_ has quit IRC | 00:55 | |
| *** _amrith_ is now known as amrith | 00:57 | |
| *** kzaitsev_mb has quit IRC | 00:58 | |
| *** Qiming has quit IRC | 00:58 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Convert devstack docs jobs to regular format https://review.openstack.org/306197 | 00:59 |
| *** zhurong has joined #openstack-infra | 01:00 | |
| *** maishsk has joined #openstack-infra | 01:01 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-dev/pbr: File is wrongly marked as executable https://review.openstack.org/306202 | 01:05 |
| *** tqtran has quit IRC | 01:05 | |
| clarkb | nibalizer: you are going to need to recheck a fair number of those gemfile updates | 01:07 |
| lifeless | there used to be a thing in gerrit | 01:07 |
| *** tiswanso has joined #openstack-infra | 01:07 | |
| lifeless | to get you the git command to fetch a change | 01:07 |
| nibalizer | clarkb: looking | 01:07 |
| lifeless | I can't see it in the UI anymore | 01:08 |
| nibalizer | lifeless: upper right | 01:08 |
| lifeless | anyone know where it is ? | 01:08 |
| nibalizer | 'download' | 01:08 |
| lifeless | nibalizer: thanks | 01:08 |
| fungi | also you probably want to select "anonymous http" rather than "http" as the method | 01:10 |
| lifeless | fungi: defaulted to a sane url for me | 01:10 |
| fungi | since "http" apparently (confusingly) means "authenticated http" | 01:10 |
| nibalizer | recheckin | 01:10 |
| fungi | cool | 01:10 |
| *** MarkAtwood has quit IRC | 01:10 | |
| *** yamahata has quit IRC | 01:11 | |
| lifeless | fungi: I pinged you to comment on a thing a few days back, now I forget what it was | 01:11 |
| *** jamesmcarthur has joined #openstack-infra | 01:11 | |
| fungi | lifeless: the spec to run neutron unit tests on constraints proposals? | 01:11 |
| fungi | er, s/spec/change/ | 01:11 |
| *** apoorvad has quit IRC | 01:12 | |
| lifeless | fungi: ah yes | 01:13 |
| *** bpokorny_ has quit IRC | 01:13 | |
| *** baoli has joined #openstack-infra | 01:15 | |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306161 | 01:16 |
| *** amotoki_ has quit IRC | 01:16 | |
| openstackgerrit | Merged openstack-infra/puppet-releasestatus: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306152 | 01:16 |
| *** ddieterly has quit IRC | 01:17 | |
| *** denisra has quit IRC | 01:17 | |
| openstackgerrit | Merged openstack-infra/puppet-unbound: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306166 | 01:18 |
| openstackgerrit | Merged openstack-infra/puppet-user: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306167 | 01:18 |
| *** denisra has joined #openstack-infra | 01:18 | |
| *** apoorvad has joined #openstack-infra | 01:18 | |
| *** kushal has joined #openstack-infra | 01:18 | |
| *** apoorvad has quit IRC | 01:18 | |
| *** apoorvad has joined #openstack-infra | 01:19 | |
| *** denisra has quit IRC | 01:20 | |
| *** denisra has joined #openstack-infra | 01:20 | |
| openstackgerrit | Vasyl Saienko proposed openstack/requirements: Block broken netmiko release 0.4.3 https://review.openstack.org/306206 | 01:20 |
| *** sputnik13_ has quit IRC | 01:20 | |
| clarkb | nibalizer: seems like the bare-precise job is really good at timing out too :( | 01:22 |
| clarkb | nibalizer: current tip of gate is going to timeout as well I think | 01:22 |
| nibalizer | clarkb: neat | 01:22 |
| clarkb | it always passes at the not tip of gate | 01:23 |
| clarkb | (thats beause the 4 change above merged and left the broken one remaining at tip) | 01:23 |
| *** Sukhdev has quit IRC | 01:25 | |
| clarkb | Iam going to have todeal with new mirror tomorrow, its late time for dinner | 01:26 |
| anteaya | clarkb: enjoy dinner | 01:26 |
| *** cody-somerville has quit IRC | 01:32 | |
| *** claudiub has quit IRC | 01:32 | |
| *** Qiming has joined #openstack-infra | 01:32 | |
| *** kengo_sakai has quit IRC | 01:33 | |
| *** ams_ has quit IRC | 01:33 | |
| *** yarkot1 has joined #openstack-infra | 01:33 | |
| dmsimard | pabelanger: did you figure out that rdo-release repo thing ? | 01:34 |
| *** baoli has quit IRC | 01:35 | |
| *** piet has joined #openstack-infra | 01:35 | |
| *** baoli has joined #openstack-infra | 01:35 | |
| *** mtanino has quit IRC | 01:36 | |
| *** julim has quit IRC | 01:38 | |
| *** sridhar_ram has joined #openstack-infra | 01:38 | |
| *** jamesmcarthur has quit IRC | 01:39 | |
| *** IlyaG has quit IRC | 01:44 | |
| *** apoorvad has quit IRC | 01:44 | |
| openstackgerrit | Tan Lin proposed openstack/requirements: Bump ironic-lib to 1.3.0 https://review.openstack.org/305553 | 01:44 |
| openstackgerrit | Merged openstack-infra/puppet-yum: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306170 | 01:46 |
| *** baoli has quit IRC | 01:48 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306172 | 01:48 |
| *** baoli has joined #openstack-infra | 01:48 | |
| openstackgerrit | Merged openstack-infra/puppet-zanata: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306171 | 01:49 |
| openstackgerrit | Merged openstack-infra/puppet-sudoers: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306162 | 01:49 |
| openstackgerrit | Merged openstack-infra/puppet-mailman: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306133 | 01:49 |
| EmilienM | pabelanger: so your patch in puppet-aodh merged | 01:50 |
| EmilienM | pabelanger: but no tarballs yet | 01:50 |
| openstackgerrit | Merged openstack/requirements: bump keystoneauth upper constraints https://review.openstack.org/305418 | 01:51 |
| *** maishsk has quit IRC | 01:51 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/303416 | 01:52 |
| *** asettle has joined #openstack-infra | 01:56 | |
| openstackgerrit | Merged openstack-infra/puppet-kibana: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306128 | 01:56 |
| openstackgerrit | Merged openstack-infra/puppet-kerberos: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306127 | 01:56 |
| openstackgerrit | Merged openstack-infra/system-config: Change afs path for ceph mirror for readability https://review.openstack.org/306181 | 01:56 |
| *** thorst has quit IRC | 01:56 | |
| *** thorst has joined #openstack-infra | 01:57 | |
| *** avarner has quit IRC | 02:00 | |
| *** maishsk has joined #openstack-infra | 02:00 | |
| *** mriedem has quit IRC | 02:01 | |
| *** LaT0rtue has quit IRC | 02:02 | |
| *** alex_xu has quit IRC | 02:02 | |
| *** akshai has joined #openstack-infra | 02:04 | |
| *** thorst has quit IRC | 02:05 | |
| *** baoli has quit IRC | 02:07 | |
| fungi | still trying to juggle our summit schedule. we have two workroom sessions which involve both ansible and puppet. there is not a single timeslot where our work sessions don't conflict with either ansible or puppet team sessions | 02:07 |
| *** ramishra has quit IRC | 02:08 | |
| fungi | so i guess we or they can divide and conquer some of this | 02:08 |
| *** alex_xu has joined #openstack-infra | 02:09 | |
| *** mylu has joined #openstack-infra | 02:10 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Fix up EPEL element https://review.openstack.org/306213 | 02:10 |
| *** LaT0rtue has joined #openstack-infra | 02:10 | |
| *** esker has joined #openstack-infra | 02:13 | |
| *** mylu_ has joined #openstack-infra | 02:15 | |
| *** ramishra has joined #openstack-infra | 02:17 | |
| anteaya | fungi: :( | 02:17 |
| anteaya | fungi: well you certain have put in a full day of obsessing over the schedule | 02:18 |
| anteaya | certainly | 02:18 |
| *** esker has quit IRC | 02:18 | |
| fungi | i wish | 02:18 |
| fungi | i've been distracted by all manner of other things, which is why i'm still working on it now | 02:18 |
| anteaya | do the fishbowls look okay? | 02:19 |
| *** mylu has quit IRC | 02:19 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: use gerrit-git-prep for all jobs https://review.openstack.org/306218 | 02:19 |
| EmilienM | puppet CI has issues, because of bindep, but no worries ! I think this patch can really help us ^ | 02:20 |
| *** chlong has joined #openstack-infra | 02:20 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: use gerrit-git-prep for all jobs https://review.openstack.org/306218 | 02:21 |
| fungi | anteaya: so far. i'll have it all up and an e-mail out to the list sometime in the coming hours | 02:22 |
| *** haleyb has quit IRC | 02:22 | |
| anteaya | yay fishbowls \o/ | 02:23 |
| anteaya | fungi: I'm not in a hurry, just offering emotional support by way of making conversation | 02:23 |
| anteaya | trying to find a bright spot to cheer about | 02:23 |
| anteaya | yay fishbowls | 02:23 |
| openstackgerrit | Merged openstack-infra/puppet-ulimit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306164 | 02:24 |
| *** vilobhmm111 has joined #openstack-infra | 02:24 | |
| EmilienM | nibalizer: you might want to consider a gem to manage your deps in a common way | 02:24 |
| *** gildub has joined #openstack-infra | 02:25 | |
| *** amotoki has joined #openstack-infra | 02:25 | |
| anteaya | EmilienM: what is the worst case of 306218 merging? | 02:25 |
| *** vilobhmm11 has quit IRC | 02:25 | |
| anteaya | EmilienM: are the jobs that you are changing currently broken right now? | 02:25 |
| anteaya | so worst case they continue to be broken? | 02:25 |
| *** asettle has quit IRC | 02:26 | |
| *** kushal has quit IRC | 02:26 | |
| *** dingyichen has quit IRC | 02:26 | |
| *** thingee has quit IRC | 02:26 | |
| *** akshai has quit IRC | 02:26 | |
| *** bdemers has quit IRC | 02:26 | |
| openstackgerrit | Merged openstack-infra/puppet-mediawiki: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306134 | 02:26 |
| *** akshai_ has joined #openstack-infra | 02:26 | |
| openstackgerrit | Merged openstack-infra/puppet-unattended_upgrades: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306165 | 02:26 |
| openstackgerrit | Merged openstack-infra/puppet-gerritbot: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306116 | 02:26 |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306115 | 02:27 |
| EmilienM | anteaya: no worries! it's "only" our stable/liberty that is broken now | 02:27 |
| EmilienM | but I'm trying to fix it before it get worst | 02:27 |
| openstackgerrit | Merged openstack-infra/puppet-github: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306117 | 02:27 |
| EmilienM | but yeah, 306218 needs review when possible, hopefully someone can look tomorrow morning | 02:28 |
| *** mylu_ has quit IRC | 02:28 | |
| anteaya | EmilienM: okay, but this would affect all branches, yes, master, stable/mitaka and stable/liberty? | 02:30 |
| EmilienM | yes | 02:30 |
| anteaya | so it might break master and stable/mitaka | 02:31 |
| EmilienM | no, we actually want to disable bindep things for us | 02:31 |
| EmilienM | in all branches | 02:31 |
| *** bdemers has joined #openstack-infra | 02:32 | |
| *** asettle has joined #openstack-infra | 02:33 | |
| anteaya | right | 02:33 |
| anteaya | but I'm just noting that it is possible this patch might break jobs on master and stable/mitaka | 02:33 |
| *** vikram has joined #openstack-infra | 02:33 | |
| anteaya | so I +2'd it | 02:33 |
| EmilienM | why break? | 02:34 |
| anteaya | and just asked that whoever merges it co-ordinates with you so you can monitor jobs | 02:34 |
| vikram | Needs review help for https://review.openstack.org/#/c/268726/ | 02:34 |
| vikram | Can someone please help | 02:34 |
| anteaya | well hopefully it shouldn't, but it might as an outcome | 02:34 |
| anteaya | any change to a job that goes straight into production has the possible outcome of breaking a job | 02:34 |
| EmilienM | anteaya: thx for looking, going to bed now. Will catch-up tomorrow morning first thing | 02:35 |
| *** ramishra_ has joined #openstack-infra | 02:35 | |
| anteaya | EmilienM: so I just asked that whoever merges it talks to you about it and merges it in co-ordination with you | 02:35 |
| *** kengo_sakai has joined #openstack-infra | 02:35 | |
| anteaya | EmilienM: so you are availble to monitor once it merges | 02:35 |
| anteaya | EmilienM: sweet dreams | 02:35 |
| *** dimtruck is now known as zz_dimtruck | 02:36 | |
| *** ramishra has quit IRC | 02:37 | |
| *** ramishra_ has quit IRC | 02:37 | |
| *** ramishra has joined #openstack-infra | 02:38 | |
| *** mylu has joined #openstack-infra | 02:38 | |
| *** akshai_ has quit IRC | 02:38 | |
| *** fedexo has joined #openstack-infra | 02:39 | |
| *** dingyichen has joined #openstack-infra | 02:40 | |
| *** Nikolay_St has joined #openstack-infra | 02:40 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Fix up EPEL element https://review.openstack.org/306213 | 02:40 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add EPEL as requirement of centos-minimal https://review.openstack.org/306220 | 02:40 |
| anteaya | fungi: the senlin contributor has 811 patches merged | 02:42 |
| *** vikram has quit IRC | 02:42 | |
| anteaya | though it is still in the ballpark of oh my goodness, how is this possible which 750 definitely is | 02:43 |
| *** yamamoto_ has joined #openstack-infra | 02:43 | |
| fungi | anteaya: i think it was 811 total patches merged, but only ~750 of those were in senlin and the rest were in random other projects | 02:43 |
| *** LaT0rtue has quit IRC | 02:43 | |
| fungi | either way, certainly a high number | 02:44 |
| anteaya | ah, sorry I mis-remembered that point | 02:45 |
| anteaya | yes, a high number | 02:45 |
| anteaya | sanitizing gemfile has work to do to match the master | 02:45 |
| *** cody-somerville has joined #openstack-infra | 02:46 | |
| *** yuanying has quit IRC | 02:48 | |
| *** e0ne has joined #openstack-infra | 02:51 | |
| *** vilobhmm111 has quit IRC | 02:52 | |
| *** ddieterly has joined #openstack-infra | 02:53 | |
| *** cody-somerville has quit IRC | 02:54 | |
| *** amotoki has quit IRC | 02:55 | |
| *** e0ne has quit IRC | 02:56 | |
| *** esikachev has joined #openstack-infra | 02:56 | |
| openstackgerrit | Merged openstack-infra/system-config: Set the debian ceph key id to proper value https://review.openstack.org/306179 | 02:57 |
| krotscheck | Urm- is there a maximum # of files that apache can show? | 02:57 |
| krotscheck | Because I'm getting 500 errors on http://mirror.dfw.rax.openstack.org/npm/b/ | 02:58 |
| clarkb | krotscheck: there is a maximum that afs can handle iirc which is wht whole reason for splitting things up by prefix | 02:58 |
| *** amotoki has joined #openstack-infra | 02:59 | |
| *** ddieterly is now known as ddieterly[away] | 02:59 | |
| krotscheck | clarkb: Yeah, I know. I don't know enough about what's blowing up to have an opinon on that though | 02:59 |
| krotscheck | clarkb: It's some directories, not others. | 03:00 |
| *** e0ne has joined #openstack-infra | 03:00 | |
| *** esikachev has quit IRC | 03:02 | |
| *** thorst has joined #openstack-infra | 03:03 | |
| *** piet has quit IRC | 03:07 | |
| *** armax has quit IRC | 03:08 | |
| *** Nikolay_St has quit IRC | 03:08 | |
| *** e0ne has quit IRC | 03:08 | |
| *** sridhar_ram has quit IRC | 03:09 | |
| *** baoli has joined #openstack-infra | 03:10 | |
| *** thorst has quit IRC | 03:11 | |
| *** e0ne has joined #openstack-infra | 03:11 | |
| *** e0ne has quit IRC | 03:13 | |
| *** sdake_ has quit IRC | 03:14 | |
| *** esker has joined #openstack-infra | 03:16 | |
| *** maishsk has quit IRC | 03:16 | |
| *** sdake has joined #openstack-infra | 03:16 | |
| *** FallenPegasus has joined #openstack-infra | 03:16 | |
| *** salv-orlando has joined #openstack-infra | 03:16 | |
| *** salv-orlando has quit IRC | 03:17 | |
| *** e0ne has joined #openstack-infra | 03:17 | |
| *** salv-orlando has joined #openstack-infra | 03:17 | |
| *** woodster_ has quit IRC | 03:18 | |
| *** harlowja_at_home has joined #openstack-infra | 03:18 | |
| *** salv-orl_ has quit IRC | 03:20 | |
| *** FallenPegasus has quit IRC | 03:20 | |
| *** esker has quit IRC | 03:21 | |
| *** salv-orlando has quit IRC | 03:22 | |
| *** ajmiller_ has joined #openstack-infra | 03:23 | |
| *** FallenPegasus has joined #openstack-infra | 03:23 | |
| *** tiswanso_ has joined #openstack-infra | 03:24 | |
| *** whoops has joined #openstack-infra | 03:24 | |
| *** maishsk has joined #openstack-infra | 03:25 | |
| *** jogo has quit IRC | 03:25 | |
| *** larainema_ has joined #openstack-infra | 03:26 | |
| *** pleia2_ has joined #openstack-infra | 03:27 | |
| *** sdake has quit IRC | 03:27 | |
| *** fzhadaev_ has joined #openstack-infra | 03:27 | |
| *** ddieterly[away] has quit IRC | 03:27 | |
| *** gildub has quit IRC | 03:27 | |
| *** jaranovich_ has joined #openstack-infra | 03:27 | |
| *** thingee has joined #openstack-infra | 03:28 | |
| *** piet has joined #openstack-infra | 03:29 | |
| *** tphummel has joined #openstack-infra | 03:29 | |
| *** tiswanso_ has quit IRC | 03:30 | |
| *** harlowja_at_home has quit IRC | 03:30 | |
| *** mattoliverau has joined #openstack-infra | 03:30 | |
| *** monester_ has joined #openstack-infra | 03:30 | |
| *** fedexo_ has joined #openstack-infra | 03:30 | |
| *** sambetts_ has joined #openstack-infra | 03:31 | |
| *** baoli has quit IRC | 03:32 | |
| *** fedexo has quit IRC | 03:32 | |
| *** tiswanso has quit IRC | 03:32 | |
| *** sambetts has quit IRC | 03:32 | |
| *** sflanigan has quit IRC | 03:32 | |
| *** Guest63537 has quit IRC | 03:32 | |
| *** waynr has quit IRC | 03:32 | |
| *** ajmiller has quit IRC | 03:32 | |
| *** zul has quit IRC | 03:32 | |
| *** dhellmann has quit IRC | 03:32 | |
| *** docaedo has quit IRC | 03:32 | |
| *** SergK has quit IRC | 03:32 | |
| *** tsufiev has quit IRC | 03:32 | |
| *** jaranovich has quit IRC | 03:32 | |
| *** monester has quit IRC | 03:32 | |
| *** larainema has quit IRC | 03:32 | |
| *** fzhadaev has quit IRC | 03:32 | |
| *** pleia2 has quit IRC | 03:32 | |
| *** matt6434 has quit IRC | 03:32 | |
| *** swat30 has quit IRC | 03:32 | |
| *** Volundr has quit IRC | 03:32 | |
| *** larainema_ is now known as larainema | 03:32 | |
| *** monester_ is now known as monester | 03:32 | |
| *** jaranovich_ is now known as jaranovich | 03:32 | |
| *** fzhadaev_ is now known as fzhadaev | 03:33 | |
| *** SergK has joined #openstack-infra | 03:33 | |
| *** Sukhdev has joined #openstack-infra | 03:33 | |
| *** tsufiev has joined #openstack-infra | 03:33 | |
| *** sdake has joined #openstack-infra | 03:35 | |
| *** swat30 has joined #openstack-infra | 03:37 | |
| *** esker has joined #openstack-infra | 03:37 | |
| *** sflanigan has joined #openstack-infra | 03:38 | |
| *** sflanigan has joined #openstack-infra | 03:38 | |
| *** sdake_ has joined #openstack-infra | 03:39 | |
| *** zul has joined #openstack-infra | 03:39 | |
| *** waynr has joined #openstack-infra | 03:40 | |
| *** Hal has joined #openstack-infra | 03:40 | |
| *** ramishra has quit IRC | 03:40 | |
| *** sdake has quit IRC | 03:40 | |
| *** Hal is now known as Guest58657 | 03:40 | |
| *** ramishra has joined #openstack-infra | 03:41 | |
| *** esker has quit IRC | 03:42 | |
| fungi | clarkb: for the xenial upgrade fishbowl session you wanted to focus more on upgrading infra systems from trusty to xenial, less revisiting how we skin our newton openstack testing on xenial while keeping kilo/liberty/mitaka on trusty? | 03:42 |
| fungi | your session description seemed to be entirely about the former, but i'm a little more worried about the immediacy of the latter given that we've talked about probably not even starting to move production services onto xenial until next calendar year anyway | 03:43 |
| clarkb | fungi correct | 03:44 |
| fungi | okie dokie | 03:44 |
| clarkb | I think the job side will be straightforward | 03:44 |
| *** yamamoto_ has quit IRC | 03:44 | |
| fungi | wfm. early consensus on trusty->xenial and maybe also talk about where we still are on precise->trusty for the interim | 03:45 |
| *** docaedo has joined #openstack-infra | 03:45 | |
| *** pleia2_ is now known as pleia2 | 03:46 | |
| fungi | actually rereading, the short description starts with "plan xenial upgrade" and then goes on to mostly be about getting off of precise | 03:47 |
| fungi | so i may retitle it a bit | 03:47 |
| *** yuanying has joined #openstack-infra | 03:47 | |
| clarkb | ya mostly its get our base infrastructure on newer distros | 03:47 |
| fungi | "distro upgrade plans" | 03:48 |
| *** zhurong has quit IRC | 03:49 | |
| clarkb | ++ | 03:49 |
| *** jogo has joined #openstack-infra | 03:50 | |
| fungi | okay, i think i have the basic schedule/descriptions good enough for now. firing off an announcement to the -infra ml in moments | 03:50 |
| *** zhurong has joined #openstack-infra | 03:50 | |
| *** maishsk has quit IRC | 03:52 | |
| fungi | trying to make the fishbowl titles as boring and uninteresting as possible | 03:52 |
| *** jogo has quit IRC | 03:54 | |
| greghaynes | "typing on computers" | 03:56 |
| *** maishsk has joined #openstack-infra | 03:56 | |
| greghaynes | maybe thats too uninteresting ;) | 03:57 |
| *** amrith is now known as _amrith_ | 03:57 | |
| *** esker has joined #openstack-infra | 03:58 | |
| *** nelsnels_ has joined #openstack-infra | 04:00 | |
| *** e0ne has quit IRC | 04:00 | |
| *** nelsnelson has quit IRC | 04:01 | |
| *** yamamoto_ has joined #openstack-infra | 04:02 | |
| *** esker has quit IRC | 04:03 | |
| *** e0ne has joined #openstack-infra | 04:04 | |
| *** dhellmann has joined #openstack-infra | 04:05 | |
| fungi | it's what i do all day every day so... i hope not? | 04:05 |
| fungi | though i'm also okay with the possibility that i'm just an unbelievably boring person | 04:05 |
| *** jaosorior has joined #openstack-infra | 04:07 | |
| *** yamamoto_ has quit IRC | 04:09 | |
| *** thorst has joined #openstack-infra | 04:11 | |
| *** roxanagh_ has joined #openstack-infra | 04:11 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Remove setting of heat engine workers https://review.openstack.org/306235 | 04:13 |
| *** gyee has quit IRC | 04:13 | |
| *** thorst has quit IRC | 04:16 | |
| *** salv-orlando has joined #openstack-infra | 04:18 | |
| *** esker has joined #openstack-infra | 04:19 | |
| *** e0ne has quit IRC | 04:22 | |
| *** [HeOS] has joined #openstack-infra | 04:22 | |
| *** esker has quit IRC | 04:24 | |
| *** HeOS has quit IRC | 04:24 | |
| fungi | okay, announcement off to the list, self off to bed, then off to another island | 04:25 |
| fungi | night, all, see you monday | 04:25 |
| *** e0ne has joined #openstack-infra | 04:26 | |
| *** kengo_sa_ has joined #openstack-infra | 04:29 | |
| *** e0ne has quit IRC | 04:30 | |
| *** salv-orlando has quit IRC | 04:30 | |
| *** jogo has joined #openstack-infra | 04:31 | |
| *** kengo_sa_ has quit IRC | 04:33 | |
| *** piet has quit IRC | 04:38 | |
| *** piet has joined #openstack-infra | 04:39 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/zuul: Add additional zuul.conf information https://review.openstack.org/271868 | 04:41 |
| openstackgerrit | Thanh Ha proposed openstack-infra/zuul: Add quick-start guide https://review.openstack.org/271872 | 04:41 |
| *** roxanagh_ has quit IRC | 04:42 | |
| *** zhurong_ has joined #openstack-infra | 04:43 | |
| *** zhurong has quit IRC | 04:44 | |
| *** salv-orlando has joined #openstack-infra | 04:45 | |
| *** claudiub has joined #openstack-infra | 04:45 | |
| *** salv-orlando has quit IRC | 04:48 | |
| *** yamahata has joined #openstack-infra | 04:48 | |
| *** chlong has quit IRC | 04:48 | |
| *** harlowja_at_home has joined #openstack-infra | 04:50 | |
| *** xarses has joined #openstack-infra | 04:52 | |
| *** claudiub has quit IRC | 04:54 | |
| *** hdd has joined #openstack-infra | 04:54 | |
| *** piet has quit IRC | 04:57 | |
| *** esikachev has joined #openstack-infra | 04:57 | |
| *** roxanagh_ has joined #openstack-infra | 04:59 | |
| *** harlowja_at_home has quit IRC | 05:00 | |
| *** chlong has joined #openstack-infra | 05:01 | |
| *** esikachev has quit IRC | 05:02 | |
| *** esker has joined #openstack-infra | 05:02 | |
| *** FallenPegasus has quit IRC | 05:02 | |
| *** flwang1 has quit IRC | 05:03 | |
| *** rossella_ has quit IRC | 05:03 | |
| *** rossella_ has joined #openstack-infra | 05:03 | |
| *** roxanagh_ has quit IRC | 05:04 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pybabel instead of python setup.py, enable sync https://review.openstack.org/305043 | 05:05 |
| *** mylu has quit IRC | 05:06 | |
| *** esker has quit IRC | 05:06 | |
| *** alex_xu_ has joined #openstack-infra | 05:10 | |
| *** rcernin has joined #openstack-infra | 05:11 | |
| *** asettle has quit IRC | 05:12 | |
| *** alex_xu has quit IRC | 05:12 | |
| *** thorst has joined #openstack-infra | 05:13 | |
| *** asettle has joined #openstack-infra | 05:13 | |
| *** piet has joined #openstack-infra | 05:14 | |
| *** mylu has joined #openstack-infra | 05:15 | |
| openstackgerrit | Merged openstack-infra/project-config: puppet: use gerrit-git-prep for all jobs https://review.openstack.org/306218 | 05:19 |
| *** thorst has quit IRC | 05:20 | |
| *** mylu has quit IRC | 05:20 | |
| *** vgridnev has joined #openstack-infra | 05:22 | |
| *** ajmiller__ has joined #openstack-infra | 05:24 | |
| *** tqtran has joined #openstack-infra | 05:24 | |
| *** vilobhmm11 has joined #openstack-infra | 05:24 | |
| *** lezbar__ has joined #openstack-infra | 05:25 | |
| *** amotoki_ has joined #openstack-infra | 05:26 | |
| *** mat128 has quit IRC | 05:26 | |
| *** mkoderer__ has quit IRC | 05:26 | |
| *** dougshelley66 has quit IRC | 05:26 | |
| *** amotoki has quit IRC | 05:27 | |
| *** timfreund has quit IRC | 05:27 | |
| *** lezbar has quit IRC | 05:27 | |
| *** mylu has joined #openstack-infra | 05:27 | |
| *** zhurong_ has quit IRC | 05:27 | |
| *** fzhadaev has quit IRC | 05:28 | |
| *** ajmiller_ has quit IRC | 05:28 | |
| *** dingyichen has quit IRC | 05:28 | |
| *** jlvillal has quit IRC | 05:28 | |
| *** dkehn has quit IRC | 05:28 | |
| *** zaro has quit IRC | 05:28 | |
| *** masayukig has quit IRC | 05:28 | |
| *** markvoelker has quit IRC | 05:28 | |
| *** zhurong has joined #openstack-infra | 05:28 | |
| *** LaT0rtue has joined #openstack-infra | 05:28 | |
| *** sflanigan has quit IRC | 05:28 | |
| AJaeger | EmilienM, anteaya: Sorry, missed to read the second part of anteaya's comment about coordination of the change. The change is in now... | 05:29 |
| *** nadya has quit IRC | 05:29 | |
| *** nadya has joined #openstack-infra | 05:30 | |
| *** ihrachys has joined #openstack-infra | 05:30 | |
| *** fzhadaev has joined #openstack-infra | 05:31 | |
| *** tphummel has quit IRC | 05:32 | |
| *** tqtran has quit IRC | 05:33 | |
| *** daemontool has joined #openstack-infra | 05:33 | |
| *** masayukig has joined #openstack-infra | 05:33 | |
| *** jlvillal has joined #openstack-infra | 05:34 | |
| *** dougshelley66 has joined #openstack-infra | 05:34 | |
| *** mkoderer__ has joined #openstack-infra | 05:34 | |
| *** nadya has quit IRC | 05:35 | |
| *** piet has quit IRC | 05:35 | |
| *** mat128 has joined #openstack-infra | 05:35 | |
| *** markvoelker has joined #openstack-infra | 05:36 | |
| *** maishsk has quit IRC | 05:36 | |
| *** nt has quit IRC | 05:38 | |
| *** tphummel has joined #openstack-infra | 05:40 | |
| *** nt has joined #openstack-infra | 05:41 | |
| *** sflanigan has joined #openstack-infra | 05:41 | |
| *** sflanigan has joined #openstack-infra | 05:41 | |
| *** timfreund has joined #openstack-infra | 05:41 | |
| *** dingyichen has joined #openstack-infra | 05:41 | |
| *** zaro has joined #openstack-infra | 05:41 | |
| *** maishsk has joined #openstack-infra | 05:42 | |
| *** nelsnels_ has quit IRC | 05:42 | |
| *** yamamoto has joined #openstack-infra | 05:43 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: yum-minimal: strip locale archive https://review.openstack.org/304399 | 05:44 |
| ianw | pabelanger: ^ i think that's about the best we can do on the locale front with centos7 | 05:44 |
| *** davidlenwell has quit IRC | 05:44 | |
| *** davidlenwell has joined #openstack-infra | 05:46 | |
| *** nadya has joined #openstack-infra | 05:47 | |
| openstackgerrit | Merged openstack-infra/project-config: Glance fix glance_store functional tests https://review.openstack.org/305694 | 05:49 |
| *** salv-orlando has joined #openstack-infra | 05:51 | |
| *** dkehn has joined #openstack-infra | 05:53 | |
| *** Nikolay_St has joined #openstack-infra | 05:54 | |
| *** burgerk has joined #openstack-infra | 05:56 | |
| *** Sukhdev has quit IRC | 05:59 | |
| *** mikelk has joined #openstack-infra | 06:00 | |
| *** maishsk has quit IRC | 06:00 | |
| *** mylu has quit IRC | 06:01 | |
| *** chlong has quit IRC | 06:02 | |
| *** YorikSar has quit IRC | 06:02 | |
| *** YorikSar has joined #openstack-infra | 06:03 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/306249 | 06:05 |
| *** aeng has quit IRC | 06:05 | |
| *** maishsk has joined #openstack-infra | 06:07 | |
| *** sdake_ has quit IRC | 06:07 | |
| *** amotoki_ has quit IRC | 06:07 | |
| *** burgerk has quit IRC | 06:07 | |
| *** sdake has joined #openstack-infra | 06:07 | |
| *** vgridnev has quit IRC | 06:10 | |
| *** scheuran has joined #openstack-infra | 06:11 | |
| *** yamamoto has quit IRC | 06:14 | |
| *** yamamoto has joined #openstack-infra | 06:16 | |
| *** kengo_sa_ has joined #openstack-infra | 06:16 | |
| *** vilobhmm111 has joined #openstack-infra | 06:17 | |
| *** thorst has joined #openstack-infra | 06:18 | |
| openstackgerrit | hardik proposed openstack-infra/project-config: Added docker_image_build.sh script https://review.openstack.org/306252 | 06:19 |
| *** vilobhmm111 has left #openstack-infra | 06:20 | |
| *** zhenguo_ has quit IRC | 06:20 | |
| *** exploreshaifali has joined #openstack-infra | 06:20 | |
| *** vilobhmm11 has quit IRC | 06:21 | |
| *** nadya has quit IRC | 06:22 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Convert devstack docs jobs to regular format https://review.openstack.org/306197 | 06:23 |
| *** claudiub has joined #openstack-infra | 06:25 | |
| *** thorst has quit IRC | 06:25 | |
| *** flepied has joined #openstack-infra | 06:25 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: WIP: Start using new atomic dib images on magnum jobs https://review.openstack.org/306254 | 06:26 |
| *** maishsk has quit IRC | 06:26 | |
| *** camunoz has quit IRC | 06:26 | |
| yolanda | good morning | 06:27 |
| *** maishsk has joined #openstack-infra | 06:27 | |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Be able to handle Slack Plugin 2.0 configuration https://review.openstack.org/306034 | 06:29 |
| *** tesseract has joined #openstack-infra | 06:29 | |
| *** tesseract is now known as Guest63229 | 06:29 | |
| *** salv-orlando has quit IRC | 06:31 | |
| *** Nikolay_St has quit IRC | 06:33 | |
| *** asettle has quit IRC | 06:38 | |
| *** tphummel has quit IRC | 06:38 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Remove non voting job for magum dib checks https://review.openstack.org/306254 | 06:39 |
| *** vgridnev has joined #openstack-infra | 06:40 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Convert devstack docs jobs to regular format https://review.openstack.org/306197 | 06:41 |
| *** exploreshaifali has quit IRC | 06:43 | |
| openstackgerrit | Dong Ma proposed openstack-infra/subunit2sql: Add db api tests for subunit2sql https://review.openstack.org/305030 | 06:46 |
| *** placko_ has joined #openstack-infra | 06:46 | |
| *** LaT0rtue has quit IRC | 06:47 | |
| *** maishsk_ has joined #openstack-infra | 06:47 | |
| *** maishsk has quit IRC | 06:50 | |
| openstackgerrit | vikram.choudhary proposed openstack-infra/project-config: Adding a new project called "neutron-dynamic-routing" https://review.openstack.org/268726 | 06:51 |
| *** maishsk has joined #openstack-infra | 06:52 | |
| *** maishsk_ has quit IRC | 06:53 | |
| *** infra-red has joined #openstack-infra | 06:55 | |
| *** hdd_ has joined #openstack-infra | 06:56 | |
| *** ihrachys_ has joined #openstack-infra | 06:57 | |
| *** placko_ has quit IRC | 06:57 | |
| *** jlvillal has quit IRC | 06:58 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Remove setting of heat engine workers https://review.openstack.org/306235 | 06:58 |
| *** gongysh has joined #openstack-infra | 06:58 | |
| *** ihrachys has quit IRC | 06:59 | |
| *** hdd__ has joined #openstack-infra | 06:59 | |
| *** dingyichen has quit IRC | 07:00 | |
| *** exploreshaifali has joined #openstack-infra | 07:00 | |
| *** hdd_ has quit IRC | 07:00 | |
| *** davidlenwell_ has joined #openstack-infra | 07:01 | |
| *** jogo has quit IRC | 07:01 | |
| *** mkoderer__ has quit IRC | 07:03 | |
| *** mikelk has quit IRC | 07:04 | |
| *** davidlenwell has quit IRC | 07:04 | |
| *** timfreund has quit IRC | 07:04 | |
| *** sflanigan has quit IRC | 07:04 | |
| *** nt has quit IRC | 07:04 | |
| *** rossella_ has quit IRC | 07:04 | |
| *** hdd has quit IRC | 07:04 | |
| *** mat128 has quit IRC | 07:05 | |
| *** nt has joined #openstack-infra | 07:07 | |
| AJaeger | morning, yolanda | 07:08 |
| *** maishsk has quit IRC | 07:08 | |
| *** maishsk has joined #openstack-infra | 07:09 | |
| AJaeger | yolanda, ianw : could you review https://review.openstack.org/305043 , please? | 07:09 |
| *** mkoderer__ has joined #openstack-infra | 07:09 | |
| *** ryotagami has joined #openstack-infra | 07:10 | |
| *** rossella_ has joined #openstack-infra | 07:10 | |
| *** jlvillal has joined #openstack-infra | 07:11 | |
| *** timfreund has joined #openstack-infra | 07:11 | |
| *** jamielennox is now known as jamielennox|away | 07:11 | |
| *** mat128 has joined #openstack-infra | 07:12 | |
| *** sflanigan has joined #openstack-infra | 07:12 | |
| *** sflanigan has quit IRC | 07:12 | |
| *** sflanigan has joined #openstack-infra | 07:12 | |
| *** dingyichen has joined #openstack-infra | 07:12 | |
| *** mikelk has joined #openstack-infra | 07:14 | |
| *** maishsk has quit IRC | 07:14 | |
| yolanda | AJaeger, sure | 07:16 |
| *** markvoelker has quit IRC | 07:16 | |
| *** ifarkas has joined #openstack-infra | 07:17 | |
| *** vgridnev has quit IRC | 07:17 | |
| AJaeger | thanks, yolanda | 07:18 |
| *** arxcruz has joined #openstack-infra | 07:18 | |
| *** fedexo_ has quit IRC | 07:20 | |
| *** achanda has joined #openstack-infra | 07:20 | |
| *** nt has quit IRC | 07:21 | |
| *** thorst has joined #openstack-infra | 07:23 | |
| *** vincentll has joined #openstack-infra | 07:23 | |
| *** maishsk has joined #openstack-infra | 07:23 | |
| *** amotoki has joined #openstack-infra | 07:25 | |
| *** LaT0rtue has joined #openstack-infra | 07:25 | |
| openstackgerrit | Merged openstack-infra/project-config: Use pybabel instead of python setup.py, enable sync https://review.openstack.org/305043 | 07:26 |
| *** Nikolay_St has joined #openstack-infra | 07:29 | |
| *** thorst has quit IRC | 07:30 | |
| *** pcaruana has joined #openstack-infra | 07:31 | |
| openstackgerrit | zhangmin proposed openstack-infra/jenkins-job-builder: new file https://review.openstack.org/306276 | 07:31 |
| *** exploreshaifali has quit IRC | 07:31 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove non voting job for magum dib checks https://review.openstack.org/306254 | 07:32 |
| *** vincentll has quit IRC | 07:33 | |
| *** vincentll has joined #openstack-infra | 07:34 | |
| *** nadya has joined #openstack-infra | 07:35 | |
| openstackgerrit | Merged openstack-infra/project-config: Convert devstack docs jobs to regular format https://review.openstack.org/306197 | 07:38 |
| *** vikram_ has joined #openstack-infra | 07:39 | |
| vikram_ | AJaeger: Addressed your comment about https://review.openstack.org/#/c/268726/ | 07:40 |
| *** jordanP has joined #openstack-infra | 07:40 | |
| AJaeger | vikram_: waiting for armax +1 again... | 07:40 |
| vikram_ | AJaeger: ;-) | 07:40 |
| vikram_ | AJaeger: Ok will let him know | 07:40 |
| openstackgerrit | Merged openstack-infra/puppet-openstack_health: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306140 | 07:41 |
| openstackgerrit | Merged openstack-infra/puppet-odsreg: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306138 | 07:42 |
| *** ihrachys_ has quit IRC | 07:43 | |
| openstackgerrit | Merged openstack-infra/project-config: Switch gate-neutron-dsvm-api to be invoked via tempest plugin framework https://review.openstack.org/304321 | 07:43 |
| openstackgerrit | Merged openstack-infra/project-config: Remove trove-dashboard from trove group https://review.openstack.org/306097 | 07:43 |
| *** bauzas is now known as bauwser | 07:45 | |
| *** maishsk has quit IRC | 07:46 | |
| *** nt has joined #openstack-infra | 07:47 | |
| *** jaosorior has quit IRC | 07:48 | |
| *** jaosorior has joined #openstack-infra | 07:48 | |
| *** jaosorior has quit IRC | 07:51 | |
| *** jaosorior has joined #openstack-infra | 07:51 | |
| *** Guest58657 has quit IRC | 07:52 | |
| *** andymccr has quit IRC | 07:52 | |
| *** Hal has joined #openstack-infra | 07:52 | |
| yolanda | AJaeger, seems that puppet is running correctly today. I hope that the memory issues are solved | 07:53 |
| *** maishsk has joined #openstack-infra | 07:53 | |
| *** Hal is now known as Guest1677 | 07:53 | |
| AJaeger | So do I... | 07:53 |
| openstackgerrit | Merged openstack-infra/infra-manual: update project creator's guide section on tag ACLs https://review.openstack.org/305502 | 07:54 |
| *** yamahata has quit IRC | 07:54 | |
| *** sflanigan has quit IRC | 07:56 | |
| openstackgerrit | Merged openstack-infra/project-config: Add release notes jobs for python-troveclient https://review.openstack.org/301899 | 07:56 |
| *** e0ne has joined #openstack-infra | 07:58 | |
| *** shardy has joined #openstack-infra | 07:58 | |
| *** LaT0rtue has quit IRC | 07:59 | |
| openstackgerrit | Merged openstack-infra/project-config: Add os/designate-tempest-plugin notifications to IRC https://review.openstack.org/305857 | 07:59 |
| *** jtomasek_ has joined #openstack-infra | 08:00 | |
| *** jcoufal has joined #openstack-infra | 08:00 | |
| yolanda | fungi, mrmartin, i deleted old groups.openstack.org | 08:02 |
| *** dizquierdo has joined #openstack-infra | 08:02 | |
| *** asettle has joined #openstack-infra | 08:05 | |
| *** achanda has quit IRC | 08:06 | |
| jordanP | is it me or gerrit is super slow now ? | 08:07 |
| markusz | jordanP: yep, same experience here | 08:07 |
| *** markusz is now known as markus_z | 08:07 | |
| *** openstackgerrit has quit IRC | 08:08 | |
| jordanP | it was fine and then suddendly super slow (almost down), usually it becomes slower and slower progressively | 08:08 |
| *** chem has joined #openstack-infra | 08:09 | |
| *** asettle has quit IRC | 08:09 | |
| yolanda | it was fine for me some minutes ago, but going to check logs | 08:09 |
| yolanda | yep, not responsive now | 08:10 |
| yolanda | i actually cannot ssh to it | 08:10 |
| AJaeger | ;( | 08:10 |
| *** asettle has joined #openstack-infra | 08:11 | |
| *** jamielennox|away is now known as jamielennox | 08:11 | |
| *** asettle has quit IRC | 08:11 | |
| yolanda | looking at the stats, i see 63% of packet loss | 08:12 |
| *** vincentll has quit IRC | 08:12 | |
| markus_z | yolanda: Are those stats somewhere public? Just out of curiosity. | 08:13 |
| *** andymccr has joined #openstack-infra | 08:13 | |
| yolanda | no, i was looking inside rackspace | 08:13 |
| *** vincentll has joined #openstack-infra | 08:13 | |
| AJaeger | markus_z: http://cacti.openstack.org | 08:14 |
| markus_z | muahaha, all the power of all the data in my hands now :D | 08:14 |
| AJaeger | http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=9 | 08:14 |
| AJaeger | markus_z: that's what's publically available ^ | 08:14 |
| *** infra-red has quit IRC | 08:15 | |
| yolanda | well yes, the cacti are public | 08:15 |
| markus_z | AJaeger: thanks! | 08:15 |
| *** infra-red has joined #openstack-infra | 08:15 | |
| markus_z | It's somewhat ridiculous how much I enjoy graphs and stats... | 08:15 |
| *** andymccr has quit IRC | 08:15 | |
| yolanda | gerrit back to life now | 08:15 |
| yolanda | i did nothing | 08:15 |
| yolanda | so looks as network problems | 08:15 |
| *** andymccr has joined #openstack-infra | 08:16 | |
| *** alex_xu_ has quit IRC | 08:16 | |
| AJaeger | yolanda: you looked friendly at it ;) Thanks! | 08:16 |
| *** exploreshaifali has joined #openstack-infra | 08:16 | |
| *** eliqiao has quit IRC | 08:16 | |
| *** YorikSar has quit IRC | 08:17 | |
| *** YorikSar has joined #openstack-infra | 08:17 | |
| *** eliqiao has joined #openstack-infra | 08:17 | |
| *** openstackgerrit has joined #openstack-infra | 08:18 | |
| *** openstackgerrit has quit IRC | 08:18 | |
| *** openstackgerrit has joined #openstack-infra | 08:18 | |
| *** infra-red has quit IRC | 08:20 | |
| AJaeger | yolanda: I have two changes that just merged but they are not in git | 08:20 |
| AJaeger | http://git.openstack.org/cgit/openstack/openstack-manuals/ misses them | 08:20 |
| AJaeger | changes are https://review.openstack.org/#/c/305644/ and https://review.openstack.org/#/c/303925/ | 08:21 |
| yolanda | it may be related about gerrit being not responsive for a while | 08:21 |
| yolanda | i can trigger a replication | 08:21 |
| AJaeger | yes, might be just bad timing.. | 08:21 |
| AJaeger | thanks | 08:21 |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Be able to handle Slack Plugin 2.0 configuration https://review.openstack.org/306034 | 08:21 |
| AJaeger | or will it self-heal? | 08:21 |
| yolanda | i checked the queue, and there are 3685 tasks pending for replication | 08:22 |
| AJaeger | Ah - and they just appeared as wel... | 08:22 |
| yolanda | so it's likely that is going to self-heal | 08:22 |
| AJaeger | Ok, thanks | 08:22 |
| openstackgerrit | Merged openstack-infra/puppet-hound: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306121 | 08:22 |
| * AJaeger needs more patience | 08:22 | |
| yolanda | when replication fails, it keeps retrying, so was it had network problems, it just keeps retrying | 08:22 |
| AJaeger | good | 08:22 |
| *** alex_xu has joined #openstack-infra | 08:23 | |
| openstackgerrit | Merged openstack-infra/puppet-grafyaml: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306118 | 08:24 |
| openstackgerrit | Merged openstack-infra/puppet-ciwatch: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306108 | 08:24 |
| *** thorst has joined #openstack-infra | 08:28 | |
| *** rossella_ has quit IRC | 08:28 | |
| *** ihrachys has joined #openstack-infra | 08:29 | |
| *** matrohon has joined #openstack-infra | 08:30 | |
| *** jistr has joined #openstack-infra | 08:30 | |
| *** rossella_s has joined #openstack-infra | 08:32 | |
| *** thorst has quit IRC | 08:36 | |
| *** nadya has quit IRC | 08:40 | |
| *** dizquierdo has quit IRC | 08:42 | |
| *** e0ne has quit IRC | 08:43 | |
| *** jamielennox is now known as jamielennox|away | 08:43 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Explicitly set num_engine_workers for mitaka and below https://review.openstack.org/306296 | 08:43 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Explicitly set num_engine_workers for mitaka and below https://review.openstack.org/306296 | 08:44 |
| *** pc_m has quit IRC | 08:46 | |
| *** xarses has quit IRC | 08:46 | |
| *** dims_ has quit IRC | 08:46 | |
| *** gsilvis has quit IRC | 08:46 | |
| *** lyz has quit IRC | 08:47 | |
| *** gsilvis has joined #openstack-infra | 08:47 | |
| *** lyz has joined #openstack-infra | 08:47 | |
| *** pc_m has joined #openstack-infra | 08:47 | |
| *** asettle has joined #openstack-infra | 08:49 | |
| *** dims has joined #openstack-infra | 08:49 | |
| *** asettle has quit IRC | 08:50 | |
| *** maishsk has quit IRC | 08:50 | |
| *** esikachev has joined #openstack-infra | 08:51 | |
| *** e0ne has joined #openstack-infra | 08:53 | |
| *** tqtran has joined #openstack-infra | 08:55 | |
| *** infra-red has joined #openstack-infra | 08:56 | |
| *** infra-red has quit IRC | 08:56 | |
| *** infra-red has joined #openstack-infra | 08:56 | |
| openstackgerrit | Merged openstack-infra/puppet-simpleproxy: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306154 | 08:58 |
| *** dtantsur|afk is now known as dtantsur | 08:58 | |
| *** bexelbie has quit IRC | 08:58 | |
| *** bexelbie has joined #openstack-infra | 08:58 | |
| *** maishsk has joined #openstack-infra | 08:59 | |
| yolanda | AJaeger, can you confirm if you can recheck changes and they appear on zuul? seems we are having problems | 09:00 |
| *** xarses has joined #openstack-infra | 09:01 | |
| *** vgridnev has joined #openstack-infra | 09:01 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: WIP: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 09:02 |
| *** rossella_s has quit IRC | 09:03 | |
| yolanda | #status notice Gerrit is going to be restarted because is not processing new changes | 09:03 |
| openstackstatus | yolanda: sending notice | 09:03 |
| *** rossella_s has joined #openstack-infra | 09:03 | |
| *** zeih has joined #openstack-infra | 09:04 | |
| -openstackstatus- NOTICE: Gerrit is going to be restarted because is not processing new changes | 09:04 | |
| *** salv-orlando has joined #openstack-infra | 09:05 | |
| AJaeger | yolanda: the two manual changes never went into post queue ;( | 09:06 |
| openstackstatus | yolanda: finished sending notice | 09:06 |
| AJaeger | and zuul looks quite idle | 09:06 |
| yolanda | yep, but i restarted gerrit, and still same problems | 09:06 |
| yolanda | it may be zuul | 09:06 |
| *** _degorenko|afk is now known as degorenko | 09:06 | |
| AJaeger | might be a result of the network? No self-healing ;( | 09:06 |
| yolanda | starting zuul is not that easy | 09:07 |
| *** alex_xu has quit IRC | 09:07 | |
| yolanda | zuul is not receiving events | 09:07 |
| yolanda | at least, not logged in zuul | 09:07 |
| AJaeger | that's not good | 09:08 |
| yolanda | weird, zuul complains about identity changed for review.openstack.org | 09:08 |
| *** alex_xu has joined #openstack-infra | 09:09 | |
| AJaeger | oops, is it trying t otalk to the old server? | 09:09 |
| yolanda | going to check, i hope not | 09:10 |
| *** sdake has quit IRC | 09:10 | |
| *** jogo has joined #openstack-infra | 09:11 | |
| *** sambetts_ is now known as sambetts | 09:11 | |
| openstackgerrit | hardik proposed openstack-infra/project-config: Script from mistral repo is used in gate-mistral-docker-buildimage job https://review.openstack.org/306252 | 09:12 |
| yolanda | no, tries to connect to 104.130.246.91, is ok | 09:13 |
| AJaeger | good | 09:15 |
| *** nelsnelson has joined #openstack-infra | 09:15 | |
| *** salv-orlando has quit IRC | 09:15 | |
| *** markvoelker has joined #openstack-infra | 09:17 | |
| *** kengo_sa_ has joined #openstack-infra | 09:17 | |
| yolanda | so at this point, as no new jobs are being collected, i think the option is to restart zuul | 09:17 |
| yolanda | is quite idle anyway | 09:17 |
| *** amotoki has quit IRC | 09:18 | |
| yolanda | #status alert No jobs are being processed by gerrit and zuul . We are working to solve the problem, please be aware that no changes have been sent to the queue in the last hour, so you will need to recheck jobs for that period. | 09:18 |
| openstackstatus | yolanda: sending alert | 09:18 |
| yolanda | i put zuul on restart mode, but it will take a bit, because current jobs need to finish | 09:20 |
| *** nelsnelson has quit IRC | 09:20 | |
| -openstackstatus- NOTICE: No jobs are being processed by gerrit and zuul . We are working to solve the problem, please be aware that no changes have been sent to the queue in the last hour, so you will need to recheck jobs for that period. | 09:20 | |
| *** ChanServ changes topic to "No jobs are being processed by gerrit and zuul . We are working to solve the problem, please be aware that no changes have been sent to the queue in the last hour, so you will need to recheck jobs for that period." | 09:20 | |
| *** nadya has joined #openstack-infra | 09:20 | |
| *** markvoelker has quit IRC | 09:22 | |
| openstackstatus | yolanda: finished sending alert | 09:23 |
| AJaeger | yolanda: don't you normally safe the queues, restart, and then put jobs back inthe queue? | 09:23 |
| yolanda | AJaeger, but if the jobs are on execution? | 09:24 |
| *** kengo_sa_ has quit IRC | 09:24 | |
| AJaeger | put them back in the queue and let them start again... | 09:25 |
| *** alex_xu_ has joined #openstack-infra | 09:25 | |
| AJaeger | yolanda: but if you don't know how to do it, better ask somebody else how to do it properly. | 09:25 |
| * AJaeger only knows from talking what others do... | 09:25 | |
| *** alex_xu has quit IRC | 09:26 | |
| yolanda | i know how to enqueue/dequeue, but i always thought about the enqueue, for jobs that were not even procesed | 09:27 |
| yolanda | in this case all the pending jobs are just executing | 09:27 |
| AJaeger | yolanda: I don't know all the subtile points ;) | 09:27 |
| *** jogo has quit IRC | 09:29 | |
| yolanda | is there any other infra-root around to help? it may be a bad hour | 09:29 |
| *** amaretskiy has left #openstack-infra | 09:31 | |
| *** tqtran has quit IRC | 09:32 | |
| *** thorst has joined #openstack-infra | 09:33 | |
| *** tqtran has joined #openstack-infra | 09:34 | |
| openstackgerrit | Merged openstack-infra/puppet-pip: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306146 | 09:34 |
| openstackgerrit | Markus Zoeller (markus_z) proposed openstack-infra/release-tools: make query for fixed bugs match more bugs https://review.openstack.org/306318 | 09:36 |
| *** nt has quit IRC | 09:39 | |
| yolanda | ok, things are working now | 09:39 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Remove setting of heat engine workers https://review.openstack.org/306235 | 09:39 |
| yolanda | it may need some time because i see NOT_REGISTERED jobs | 09:40 |
| *** LaT0rtue has joined #openstack-infra | 09:40 | |
| *** thorst has quit IRC | 09:41 | |
| *** ams_ has joined #openstack-infra | 09:41 | |
| AJaeger | thanks, yolanda | 09:41 |
| *** nt has joined #openstack-infra | 09:42 | |
| eliqiao | yolanda: so we can do recheck now/ | 09:42 |
| eliqiao | ? | 09:42 |
| yolanda | eliqiao, i'm still seeing some jobs as not registered,so better wait a bit | 09:42 |
| eliqiao | k. | 09:42 |
| yolanda | i'll send the alert when i'm totally sure | 09:42 |
| *** tqtran has quit IRC | 09:43 | |
| eliqiao | yolanda: FYI, I rechecked magnum, it works. | 09:43 |
| yolanda | ah great | 09:43 |
| yolanda | going to remove the alert | 09:45 |
| yolanda | mm, still seeing errors with centos7, but it may affect an small subset of jobs | 09:45 |
| *** zeih has quit IRC | 09:46 | |
| yolanda | #status Zuul and gerrit are working normally now. Please recheck any jobs that may have been affected by this failure. | 09:46 |
| openstackstatus | yolanda: unknown command | 09:46 |
| yolanda | #status ok Zuul and gerrit are working normally now. Please recheck any jobs that may have been affected by this failure. | 09:46 |
| openstackstatus | yolanda: sending ok | 09:46 |
| *** alex_xu_ has quit IRC | 09:47 | |
| cschwede | yolanda: thanks for fixing it! after rechecking i just noticed that „gate-tempest-dsvm-platform-centos7-nv: NOT_REGISTERED“ | 09:48 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 09:48 | |
| -openstackstatus- NOTICE: Zuul and gerrit are working normally now. Please recheck any jobs that may have been affected by this failure. | 09:48 | |
| jaosorior | still seeing some NOT_REGISTERED issues :/ | 09:49 |
| AJaeger | cschwede, jaosorior: Those nodes are building up, you might need to recheck once the job as finished. Sorry | 09:49 |
| *** alex_xu has joined #openstack-infra | 09:49 | |
| jaosorior | AJaeger: Thanks | 09:49 |
| AJaeger | yolanda: do we have centos-7 nodes now? | 09:49 |
| yolanda | yes, there are NOT_REGISTERED problems for centos7 specially | 09:49 |
| yolanda | not yet | 09:49 |
| AJaeger | yolanda: next time, let's wait with the recheck message until all jobs are registered, please | 09:50 |
| cschwede | AJaeger: ah yes, makes sense, thx | 09:50 |
| yolanda | AJaeger, do you know why centos-7 take longer to be present? | 09:51 |
| *** maishsk has quit IRC | 09:51 | |
| openstackstatus | yolanda: finished sending ok | 09:51 |
| AJaeger | yolanda: we have a lower number of them as ready nodes | 09:51 |
| AJaeger | yolanda: might be that nodepool does not generate a new one since it lost count | 09:52 |
| AJaeger | Are there available nodes? Those might be orphaned and no new one gets build | 09:52 |
| AJaeger | otherwise: nodepool should be building them | 09:52 |
| yolanda | it actually had one ready, but dated from 11 hours ago, i deleted it | 09:52 |
| yolanda | and now is building one | 09:52 |
| yolanda | do we only have one min-ready? | 09:52 |
| AJaeger | might be | 09:53 |
| AJaeger | best ask pabelanger, we're not done migrating centos7 nodes... | 09:53 |
| AJaeger | let me chck and propose a change ... | 09:54 |
| yolanda | thanks | 09:55 |
| yolanda | i see centos-7 nodes as used now, so the problem was this idle ready node | 09:55 |
| AJaeger | yep | 09:55 |
| *** nt has quit IRC | 09:55 | |
| *** amotoki has joined #openstack-infra | 09:55 | |
| *** tosky has joined #openstack-infra | 09:56 | |
| *** andymaier has joined #openstack-infra | 09:56 | |
| *** nt has joined #openstack-infra | 09:57 | |
| jaosorior | centos ndoes seem to be working now | 09:58 |
| jaosorior | thanks a lot guys :D | 09:58 |
| yolanda | ++ | 09:58 |
| AJaeger | glad to hear, jaosorior | 09:58 |
| jaosorior | yolanda, AJaeger: That was brilliant, thanks :D | 09:58 |
| yolanda | glad to help | 09:58 |
| *** aspiers_ has quit IRC | 09:59 | |
| *** maishsk has joined #openstack-infra | 10:00 | |
| *** dtantsur is now known as dtantsur|lunch | 10:00 | |
| *** exploreshaifali has quit IRC | 10:01 | |
| *** xarses has quit IRC | 10:02 | |
| *** zhurong has quit IRC | 10:02 | |
| *** Qiming has quit IRC | 10:02 | |
| *** xarses has joined #openstack-infra | 10:03 | |
| *** xarses has quit IRC | 10:03 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Increase min-ready for centos-7 nodes https://review.openstack.org/306330 | 10:04 |
| *** xarses has joined #openstack-infra | 10:04 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix typo ubuntbu-trusty-2-node https://review.openstack.org/306331 | 10:05 |
| AJaeger | yolanda: the first one contains some interesting numbers - the second a typo fix ^ | 10:05 |
| *** amotoki has quit IRC | 10:05 | |
| *** notnownikki has joined #openstack-infra | 10:05 | |
| yolanda | ok going to review | 10:06 |
| *** salv-orlando has joined #openstack-infra | 10:06 | |
| AJaeger | bbl | 10:06 |
| *** jog0 has joined #openstack-infra | 10:07 | |
| *** nt has quit IRC | 10:10 | |
| *** yolanda has quit IRC | 10:12 | |
| *** nt has joined #openstack-infra | 10:12 | |
| *** ociuhandu has quit IRC | 10:13 | |
| *** alex_xu has quit IRC | 10:14 | |
| *** LaT0rtue has quit IRC | 10:14 | |
| *** alex_xu has joined #openstack-infra | 10:16 | |
| *** nt has quit IRC | 10:26 | |
| *** daemontool has quit IRC | 10:28 | |
| *** [HeOS] has quit IRC | 10:28 | |
| *** exploreshaifali has joined #openstack-infra | 10:29 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks https://review.openstack.org/291393 | 10:34 |
| *** nt has joined #openstack-infra | 10:35 | |
| openstackgerrit | Tom Fifield proposed openstack-infra/groups: Link group name to group URL in status report https://review.openstack.org/306353 | 10:37 |
| openstackgerrit | Tom Fifield proposed openstack-infra/groups: Link group name to group URL in status report https://review.openstack.org/306353 | 10:38 |
| *** thorst has joined #openstack-infra | 10:39 | |
| *** sdague has joined #openstack-infra | 10:40 | |
| *** kengo_sakai has quit IRC | 10:42 | |
| *** gongysh has quit IRC | 10:42 | |
| rossella_s | hello :) we are getting some error in packaging openstack master because nova http://tarballs.openstack.org/nova/nova-master.tar.gz requires python-neutronclient >= 4.2.0 | 10:44 |
| *** vgridnev has quit IRC | 10:45 | |
| rossella_s | but if you get it from http://tarballs.openstack.org/python-neutronclient/python-neutronclient-master.tar.gz you get 4.1 not 4.2 | 10:45 |
| rossella_s | AJaeger, sorry if I always bother you, maybe you have some suggestion? | 10:45 |
| *** thorst has quit IRC | 10:45 | |
| openstackgerrit | Nate Marsella proposed openstack-infra/elastic-recheck: Make the index format string configurable in the conf file. This allows query to work against indices not named the typical "logstash-%Y.%m.%d". https://review.openstack.org/306360 | 10:46 |
| openstackgerrit | Tom Fifield proposed openstack-infra/groups: Link group name to group URL in status report https://review.openstack.org/306353 | 10:47 |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Pin google-api-client; sanitize Gemfile https://review.openstack.org/306123 | 10:48 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Explicitly set num_engine_workers for mitaka and below https://review.openstack.org/306296 | 10:49 |
| *** kengo_sakai has joined #openstack-infra | 10:50 | |
| *** zeih has joined #openstack-infra | 10:51 | |
| rossella_s | AJaeger, ihrachys has identified the problem already, no new patch was merged into master since Apr-12 and the 4.2 tag was created on Apr-13 | 10:52 |
| ihrachys | AJaeger: should we retrigger tarball on tag merge? | 10:53 |
| openstackgerrit | Vitaly Gusev proposed openstack-infra/project-config: Add openstack/stacklight-integration-tests project https://review.openstack.org/306361 | 10:54 |
| *** kengo_sakai has quit IRC | 10:54 | |
| *** _amrith_ is now known as amrith | 10:54 | |
| *** zeih has quit IRC | 10:56 | |
| *** jtomasek_ has quit IRC | 10:56 | |
| *** doug-fish has quit IRC | 10:56 | |
| ihrachys | rossella_s: I think I know the place for a fix. working on a smart regex. | 10:57 |
| *** asettle has joined #openstack-infra | 10:59 | |
| *** asettle has quit IRC | 10:59 | |
| *** jaosorior has quit IRC | 10:59 | |
| krotscheck | infra-core: Could someone hop onto mirror-update and shut down the npm mirroring script? I think we have to go back to the drawing board. | 11:00 |
| krotscheck | jeblair: ^^ | 11:00 |
| *** akshai has joined #openstack-infra | 11:04 | |
| *** akshai_ has joined #openstack-infra | 11:05 | |
| *** daemontool has joined #openstack-infra | 11:06 | |
| *** akshai has quit IRC | 11:08 | |
| *** dtantsur|lunch is now known as dtantsur | 11:09 | |
| openstackgerrit | Vitaly Gusev proposed openstack-infra/project-config: Add openstack/stacklight-integration-tests project https://review.openstack.org/306361 | 11:10 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: Add grenade jobs https://review.openstack.org/306363 | 11:10 |
| *** electrofelix has joined #openstack-infra | 11:11 | |
| ihrachys | rossella_s: nah, I guess it's not that easy. we need someone from infra to take a closer look | 11:12 |
| *** fhubik has joined #openstack-infra | 11:12 | |
| *** jtomasek_ has joined #openstack-infra | 11:14 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: Add grenade jobs https://review.openstack.org/306363 | 11:18 |
| *** markvoelker has joined #openstack-infra | 11:18 | |
| *** jtomasek_ has quit IRC | 11:18 | |
| *** yonglihe has quit IRC | 11:19 | |
| ihrachys | rossella_s: that's what is triggered on new deliverable merged: https://github.com/openstack-infra/release-tools/blob/master/release.sh#L87 | 11:19 |
| *** ifarkas has quit IRC | 11:19 | |
| ihrachys | note there is no zuul involved, so there is nothing that could trigger the event to republish new tarball | 11:19 |
| AJaeger | ihrachys, rossella_s this needs an infra-root to help with... I can't help | 11:20 |
| *** jtomasek_ has joined #openstack-infra | 11:20 | |
| ihrachys | AJaeger: actually, I believe it would also require some coding. see my previous comment | 11:20 |
| AJaeger | ihrachys: tarball upload is done via zuul | 11:20 |
| *** yonglihe has joined #openstack-infra | 11:20 | |
| ihrachys | ah right. zuul should still be triggered after new tag appears | 11:21 |
| AJaeger | ihrachys: this should work without any coding at all, just trigger the right job - but that needs admin rights that I don't have | 11:21 |
| *** clif_h has quit IRC | 11:21 | |
| ihrachys | so where is that event triggered to build tarball for the new tag? | 11:21 |
| *** Qiming has joined #openstack-infra | 11:21 | |
| ihrachys | AJaeger: you mean it's supposed to work? | 11:21 |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: WIP: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 11:21 |
| *** exploreshaifali has quit IRC | 11:22 | |
| AJaeger | ihrachys: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n110 is the pipeline | 11:22 |
| AJaeger | and then http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n562 | 11:22 |
| AJaeger | publish-to-pypi uploads tarballs | 11:23 |
| ihrachys | AJaeger: to tarballs.openstack.org too? | 11:23 |
| *** markvoelker has quit IRC | 11:24 | |
| *** clif_h has joined #openstack-infra | 11:24 | |
| AJaeger | just retriggering the tarball job in the release pipeline should do it - but this needs all the right parameter. Let's wait for people to show up. I hope clarkb or jeblair can help with that later | 11:24 |
| AJaeger | ihrachys: yes | 11:24 |
| AJaeger | '{name}-tarball' | 11:24 |
| *** breton has joined #openstack-infra | 11:25 | |
| ihrachys | AJaeger: ok great. I guess I reached the point where my ignorance starts to show up :) | 11:25 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix typo: locale -> locale https://review.openstack.org/306368 | 11:27 |
| AJaeger | ihrachys: and that's my brown-paper-bug ^ ;( | 11:28 |
| AJaeger | ihrachys: anything else to explain? Yeah, this is all related with each other somehow... | 11:28 |
| *** ramishra has quit IRC | 11:28 | |
| ihrachys | AJaeger: nah, I think I am good, I will assume infra will handle it somehow. if not, we will land a patch eventually. :) | 11:29 |
| ihrachys | AJaeger: ouch (re bug) | 11:29 |
| *** vgridnev has joined #openstack-infra | 11:29 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix typo: locale -> local https://review.openstack.org/306368 | 11:29 |
| AJaeger | ihrachys: yes, I seem I cannot type local at all ;( Thanks | 11:30 |
| ihrachys | :))) | 11:30 |
| AJaeger | ihrachys: yeah, infra handles it magically ;) | 11:30 |
| *** ramishra has joined #openstack-infra | 11:30 | |
| *** BobBall-AWOL is now known as BobBall | 11:31 | |
| *** jtomasek_ has quit IRC | 11:33 | |
| *** dprince has joined #openstack-infra | 11:33 | |
| AJaeger | ihrachys: Looking at your description, what about just merging something to python-neutronclient? | 11:34 |
| AJaeger | ihrachys: It might be that the tagging only pushes the neutronclient-4.2 tarball but not the master one. | 11:36 |
| AJaeger | So, if you merge anything, you should be fine again... | 11:36 |
| AJaeger | but let me double check that logic | 11:36 |
| ihrachys | AJaeger: meh. well that's what I was trying to say from the start. | 11:37 |
| ihrachys | but you told that it should update both :) or so I understood. | 11:37 |
| *** thorst has joined #openstack-infra | 11:37 | |
| ihrachys | AJaeger: anyhow, I am landing a patch into master (pushed W+1 for one of patches) | 11:38 |
| ihrachys | but since zuul is not in great shape, I guess it may take more time than usual | 11:38 |
| sdague | AJaeger: you up for landing this - https://review.openstack.org/#/c/306009/ ? | 11:38 |
| *** jbernard_ has quit IRC | 11:38 | |
| *** aysyd has joined #openstack-infra | 11:38 | |
| AJaeger | ihrachys: zuul should be fine again... | 11:38 |
| ihrachys | oh great. | 11:39 |
| AJaeger | sdague: yes, wanted to wait for a nova expert to see it first - so, let me review again... | 11:39 |
| *** yamamoto has quit IRC | 11:40 | |
| *** baoli has joined #openstack-infra | 11:40 | |
| AJaeger | sdague: let me just fix that nit (check->gate->experimental) and then I'll +2A... | 11:40 |
| *** exploreshaifali has joined #openstack-infra | 11:40 | |
| AJaeger | sdague: this one is for you: https://review.openstack.org/306004 | 11:41 |
| *** sheeprine has quit IRC | 11:41 | |
| *** baoli_ has joined #openstack-infra | 11:41 | |
| *** sheeprine has joined #openstack-infra | 11:42 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Make the ceph devstack-plugin-based job gating on Nova https://review.openstack.org/306009 | 11:43 |
| AJaeger | sdague: do you want to +2A? ^ I'll +2 now... | 11:43 |
| *** xarses_ has joined #openstack-infra | 11:43 | |
| sdague | AJaeger: ok, done | 11:44 |
| sdague | what do I actually need to do to cut a release now? | 11:44 |
| sdague | I only know how to do that manually | 11:45 |
| *** baoli has quit IRC | 11:45 | |
| AJaeger | sdague: just tag it and upload the tag - see http://docs.openstack.org/infra/manual/drivers.html#tagging-a-release | 11:45 |
| *** pc_m has quit IRC | 11:46 | |
| AJaeger | sdague: but first wait until the change is merged and in place... | 11:46 |
| *** ldnunes has joined #openstack-infra | 11:46 | |
| AJaeger | and my change for dash-creator needs reappproval after whitespace cleanup, let me do that quickly... | 11:46 |
| *** dims has quit IRC | 11:46 | |
| *** dmsimard has quit IRC | 11:46 | |
| *** pc_m has joined #openstack-infra | 11:47 | |
| AJaeger | sdague: could you review https://review.openstack.org/306368 as well, please? | 11:47 |
| *** lyz has quit IRC | 11:47 | |
| *** xarses has quit IRC | 11:47 | |
| *** dmsimard has joined #openstack-infra | 11:47 | |
| *** lyz has joined #openstack-infra | 11:51 | |
| *** vikram_ has quit IRC | 11:51 | |
| sdague | AJaeger: at least in devstack we made the convention that local variables are lower case | 11:51 |
| sdague | to distinguish what may or may not be changed by scope | 11:51 |
| sdague | is that a thing you want to do here? | 11:51 |
| AJaeger | sdague: yeah, can do - I extracted that out before... | 11:51 |
| *** openstack has quit IRC | 11:51 | |
| *** openstack has joined #openstack-infra | 11:52 | |
| *** sheeprine has quit IRC | 11:54 | |
| *** sheeprine has joined #openstack-infra | 11:55 | |
| AJaeger | thanks, sdague | 11:55 |
| *** dims has joined #openstack-infra | 11:56 | |
| openstackgerrit | Merged openstack-infra/project-config: PUblish gerrit-dash-creator to PyPI https://review.openstack.org/306004 | 11:57 |
| openstackgerrit | Merged openstack-infra/project-config: Make the ceph devstack-plugin-based job gating on Nova https://review.openstack.org/306009 | 11:58 |
| *** asettle has joined #openstack-infra | 11:59 | |
| breton | where can i find job template for nova? https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/nova.yaml seems to be for novaclient. | 12:00 |
| *** asettle has quit IRC | 12:00 | |
| *** andymaier has quit IRC | 12:01 | |
| AJaeger | breton: which job template are you looking for? nova.yaml is for both nova and novaclient | 12:01 |
| AJaeger | breton: but there're other places like devstack-gate.yaml | 12:02 |
| *** akshai_ has quit IRC | 12:02 | |
| *** maishsk has quit IRC | 12:04 | |
| *** maishsk has joined #openstack-infra | 12:04 | |
| *** dalgaaf has joined #openstack-infra | 12:05 | |
| *** weshay has joined #openstack-infra | 12:05 | |
| breton | AJaeger: i an not sure. I am trying to figure out how their functional tests are configured, the ones in nova/tests/functional | 12:06 |
| AJaeger | breton: then ask the nova folks - sdague, can you help breton, please? | 12:06 |
| pabelanger | morning | 12:07 |
| pabelanger | EmilienM: okay, will have to look into the logs | 12:07 |
| AJaeger | morning, pabelanger | 12:07 |
| AJaeger | breton: this job gate-nova-tox-db-functional ? That's run via tox... | 12:07 |
| AJaeger | declated in projects.yaml | 12:07 |
| AJaeger | pabelanger: what do you think of https://review.openstack.org/306331 and https://review.openstack.org/306330 ? | 12:08 |
| *** degorenko is now known as _degorenko|afk | 12:08 | |
| *** che-arne has joined #openstack-infra | 12:08 | |
| AJaeger | pabelanger: nothing urgent ;) | 12:08 |
| pabelanger | ianw: ack | 12:08 |
| breton | AJaeger: i'll then move to the nova channel. Thank you! | 12:08 |
| pabelanger | AJaeger: yolanda: kolla should be releasing today, so we can migrate them once they cut a release. Then we can do our jobs | 12:09 |
| AJaeger | pabelanger: I think we can increase the min-ready already as proposed in 306330, what do you think? | 12:10 |
| pabelanger | and caught up with backscroll | 12:10 |
| AJaeger | ;) | 12:10 |
| pabelanger | have a dentist appointment in 45mins so will be out most of the morning | 12:10 |
| AJaeger | pabelanger: ARgh ;( | 12:10 |
| pabelanger | AJaeger: but can look at patches quick | 12:10 |
| openstackgerrit | Merged openstack-infra/project-config: Fix typo: locale -> local https://review.openstack.org/306368 | 12:11 |
| *** pradk has joined #openstack-infra | 12:11 | |
| *** che-arne_ has joined #openstack-infra | 12:12 | |
| *** dingyichen has quit IRC | 12:13 | |
| *** jed56 has quit IRC | 12:13 | |
| *** newjersey has joined #openstack-infra | 12:13 | |
| *** che-arne has quit IRC | 12:14 | |
| dims | breton : here's how i usually go about it.. first look at the name of the job in a recent review (gate-nova-tox-db-functional), look for it in hound, open the file and look at git blame and find AJaeger 's patch (Id5f0ffd66d2368a26d859d991d0cf1b690e0138e), gives me the clue that it's a specific instance of a general template "gate-{name}-tox-db-{envlist}" and you can find that again in hound - http://codesearch.openstack.org/?q=gate-.*-tox-db-.*&i=nop | 12:14 |
| dims | e&files=&repos= | 12:14 |
| *** kzaitsev_mb has joined #openstack-infra | 12:14 | |
| dims | breton : in the end you can spot this http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/python-jobs.yaml#n330 | 12:15 |
| AJaeger | dims, breton another way: Open the log file for it like http://logs.openstack.org/50/305950/1/check/gate-nova-tox-db-functional/a51efe7/console.html and then see | 12:15 |
| kzaitsev_mb | folks, who is responsible for stackalitics.com at this point? | 12:15 |
| AJaeger | dims, breton "JJB template: gate-{name}-tox-db-{envlist}" | 12:15 |
| dims | AJaeger : ah even better :) | 12:16 |
| kzaitsev_mb | http://stackalytics.com/?user_id=kzaitsev&project_type=all looks like there is no murano info there at all | 12:16 |
| AJaeger | So, that's the template name to grep for - for most templates we output it this way | 12:16 |
| *** che-arne_ is now known as che-arne | 12:16 | |
| *** markvoelker has joined #openstack-infra | 12:16 | |
| dims | AJaeger : if you switch release=all you can see murano | 12:17 |
| AJaeger | kzaitsev_mb: AFAIK still the mirantis folks, not sure who. Have a look who approved the last merges ... | 12:17 |
| dims | kzaitsev_mb : ^^ | 12:17 |
| *** tpsilva has joined #openstack-infra | 12:17 | |
| kzaitsev_mb | AJaeger: ok, would ping mirantis folks about this then | 12:17 |
| kzaitsev_mb | thanks ) | 12:17 |
| AJaeger | kzaitsev_mb: or go back to Mitaka instead of Newtoan | 12:17 |
| dims | kzaitsev_mb : are you sure kzaitsev worked on murano in newton? :) | 12:17 |
| AJaeger | kzaitsev_mb: no need, see dims' comment | 12:17 |
| dims | (joking) | 12:18 |
| AJaeger | dims: I think kzaitsev_mb did, see http://stackalytics.com/?user_id=kzaitsev&project_type=all&release=mitaka - as recently as 12th of APril ;) | 12:18 |
| AJaeger | 11th I mean. Not sure when Newton started for Stackalytics ;) | 12:18 |
| dims | kzaitsev_mb : AJaeger : ah. no clue :) | 12:19 |
| dims | kzaitsev_mb : you can ping Ilya Shakat i believe | 12:19 |
| kzaitsev_mb | I'm sure I worked on murano =) | 12:20 |
| kzaitsev_mb | yep, I'm going to ping him, thanks | 12:21 |
| *** EricGonczer_ has joined #openstack-infra | 12:21 | |
| dims | kzaitsev_mb : https://review.openstack.org/#/q/owner:%22Kirill+Zaitsev+%253Ckzaitsev%2540mirantis.com%253E%22+branch:master some of the ones on top should have counted. | 12:22 |
| pabelanger | eventually we'll switch to http://stackalytics.openstack.org I need to loop back to that | 12:22 |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 12:23 |
| dims | pabelanger : can we get it ready in time for summit? | 12:23 |
| openstackgerrit | Merged openstack-infra/project-config: Fix typo ubuntbu-trusty-2-node https://review.openstack.org/306331 | 12:23 |
| pabelanger | dims: no, we still need to figure our a few tasks before we cut it over | 12:24 |
| dims | pabelanger : ack thanks | 12:24 |
| dims | just curious | 12:24 |
| kzaitsev_mb | actually http://stackalytics.openstack.org seem to be more uptodate | 12:24 |
| *** yamamoto has joined #openstack-infra | 12:24 | |
| *** aspiers has joined #openstack-infra | 12:24 | |
| *** trown|outtypewww is now known as trown | 12:24 | |
| *** wznoinsk has joined #openstack-infra | 12:26 | |
| *** doug-fish has joined #openstack-infra | 12:27 | |
| *** salv-orl_ has joined #openstack-infra | 12:27 | |
| *** wznoinsk has quit IRC | 12:28 | |
| *** tpsilva has quit IRC | 12:29 | |
| *** dalgaaf has quit IRC | 12:29 | |
| *** rfolco has joined #openstack-infra | 12:29 | |
| *** ldnunes has quit IRC | 12:30 | |
| *** salv-orlando has quit IRC | 12:30 | |
| breton | sdague: so, there is a scenario -- federation. To test it, shibboleth-related deb/rpm packages need to be installed (with install_package i guess) and configured (with sed, cp or whatever). I know that there are hooks like pre_test_hook. Heat uses it, for exmaple. Neutron uses gate_hook. In keystone initially a wrapper for ./stack.sh was proposed, but not implemented. | 12:30 |
| *** notnownikki has quit IRC | 12:31 | |
| *** rossella_s has quit IRC | 12:31 | |
| EmilienM | pabelanger: ok periodic jobs for puppet4 work for us now. | 12:31 |
| AJaeger | EmilienM: morning, I approved your change from last night - is everything fine on that one? | 12:32 |
| *** kzaitsev_mb has quit IRC | 12:32 | |
| AJaeger | EmilienM: glad to hear that those work now! | 12:32 |
| sdague | breton: right, so you are into building a custom dsvm setup | 12:33 |
| *** dalgaaf has joined #openstack-infra | 12:33 | |
| *** tpsilva has joined #openstack-infra | 12:33 | |
| *** che-arne has quit IRC | 12:33 | |
| sdague | breton: if you were going to test this manually, how would you do it? | 12:34 |
| pabelanger | EmilienM: ack | 12:34 |
| sdague | it sounds like it might be devstack + custom plugin for this feature | 12:34 |
| *** keedya has joined #openstack-infra | 12:34 | |
| EmilienM | AJaeger: thanks for asking! https://review.openstack.org/#/c/306218/ was actually another issue we had, I'll check the status after my meeting | 12:34 |
| EmilienM | AJaeger: another problem I have is that tarballs are not published, I can't figure why, and I don't find logs | 12:35 |
| *** che-arne has joined #openstack-infra | 12:35 | |
| *** Goneri has joined #openstack-infra | 12:35 | |
| AJaeger | EmilienM: 306218 is merged - that's the one I meant... | 12:35 |
| EmilienM | AJaeger: pabelanger pushed a patch to puppet-aodh yesterday and the post job did not publish tarball, I can't find logs though | 12:35 |
| AJaeger | EmilienM: let me check log files... | 12:35 |
| *** EricGonczer_ has quit IRC | 12:35 | |
| pabelanger | Ya, I haven't looked yet | 12:35 |
| EmilienM | AJaeger: please tell me how you find post logs for a specific project, I could not find it | 12:35 |
| AJaeger | EmilienM: git checkout master;git pull - in puppet-aodh;git show | 12:36 |
| AJaeger | And that gives me the sha1 of teh change: de1f651f5b3755cfc636dc78655552f70065d279 | 12:36 |
| AJaeger | Now go to logs.openstakc.org/first2sha/completesha1 | 12:37 |
| AJaeger | So, http://logs.openstack.org/de/de1f651f5b3755cfc636dc78655552f70065d279/post/puppet-aodh-tarball/ | 12:37 |
| EmilienM | I think clarkb gave me this url | 12:37 |
| * EmilienM facepalm | 12:37 | |
| AJaeger | and finally http://logs.openstack.org/de/de1f651f5b3755cfc636dc78655552f70065d279/post/puppet-aodh-tarball/d222499/console.html | 12:37 |
| AJaeger | EmilienM: or install https://github.com/dhellmann/git-os-job and run "git os-job" | 12:37 |
| EmilienM | I'll analyze the logs after my call /me brb | 12:38 |
| AJaeger | EmilienM: it still runs "tox -evenv pip install wheel" | 12:38 |
| AJaeger | EmilienM: it runs usr/local/jenkins/slave_scripts/run-wheel.sh - that looks wrong;( | 12:38 |
| AJaeger | EmilienM: the tarball macro runs both run-tarball and run-wheel. run-tarball has worked, now you need to add a section to run-wheel to not do anything... | 12:40 |
| *** maishsk has quit IRC | 12:41 | |
| *** gordc has joined #openstack-infra | 12:42 | |
| *** ivc_ has joined #openstack-infra | 12:43 | |
| *** ldnunes has joined #openstack-infra | 12:43 | |
| *** rossella_s has joined #openstack-infra | 12:43 | |
| *** keedya has quit IRC | 12:43 | |
| *** notnownikki has joined #openstack-infra | 12:43 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Revert "Added NPM Mirror to mirror_update" https://review.openstack.org/306393 | 12:43 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Revert "Add NPM mirror hosting to unified mirrors" https://review.openstack.org/306394 | 12:43 |
| krotscheck | jeblair, fungi: ^^ | 12:43 |
| krotscheck | We're starting to see 500 server errors on some of the package directories. I suspect we're over the AFS file limit on those, so we'll have to go back to the drawing board. | 12:44 |
| krotscheck | jeblair, fungi: If one of you could go kill the script on mirror-update, and clean out the directory, it'd be much appreciated. (also- lockfile once the revert lands). | 12:45 |
| krotscheck | I'm in the process of building an entirely clean mirror without AFS, to see how many files we're dealing with. | 12:45 |
| *** nt has quit IRC | 12:46 | |
| *** exploreshaifali has quit IRC | 12:46 | |
| dims | sdague : breton : like this one? https://review.openstack.org/#/c/289255/ | 12:47 |
| *** nt has joined #openstack-infra | 12:47 | |
| sdague | dims: yeh, though does that actually work? | 12:48 |
| sdague | plugin name and git directory need to be the same | 12:48 |
| dims | good question, i haven't tried that one :) | 12:49 |
| *** pradk has quit IRC | 12:49 | |
| *** pradk has joined #openstack-infra | 12:50 | |
| sdague | I left a postmortem comment on that review | 12:50 |
| *** matt-borland has joined #openstack-infra | 12:50 | |
| *** amrith is now known as _amrith_ | 12:51 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Remove HP Cloud from clouds.yaml https://review.openstack.org/306396 | 12:51 |
| *** jheroux has joined #openstack-infra | 12:51 | |
| *** alaski is now known as lascii | 12:52 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: run-wheel.sh: only run wheel for Python projects https://review.openstack.org/306398 | 12:53 |
| EmilienM | AJaeger: ^ feedback welcome | 12:53 |
| dims | sdague : ack | 12:53 |
| dims | sdague : breton : the one i am most familiar with and it does work is magnum's jobs - https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/magnum.yaml | 12:53 |
| dims | sdague : breton : it has plugins and gate and post hooks | 12:53 |
| dims | so the one with most complexity | 12:54 |
| *** xyang1 has joined #openstack-infra | 12:54 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Make the Add Lane button show the new worklist modal https://review.openstack.org/306399 | 12:55 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Show a modal when editing worklists in a board https://review.openstack.org/306400 | 12:55 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Remove pointless variable creation https://review.openstack.org/306401 | 12:55 |
| AJaeger | EmilienM: looks good to me. | 12:56 |
| *** rlandy has quit IRC | 12:57 | |
| *** julim has joined #openstack-infra | 12:57 | |
| *** rlandy has joined #openstack-infra | 12:57 | |
| EmilienM | AJaeger: dhellmann/git-os-job is awesome, I'll use that in the future, it just works \o/ | 12:58 |
| *** jiggalator has joined #openstack-infra | 12:59 | |
| dhellmann | EmilienM: :-) | 13:00 |
| *** nt has quit IRC | 13:01 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Get storyboard resources by properties other than ID https://review.openstack.org/305411 | 13:01 |
| *** yamamoto has quit IRC | 13:01 | |
| *** netsin has quit IRC | 13:01 | |
| *** nt has joined #openstack-infra | 13:02 | |
| *** rossella_s has quit IRC | 13:03 | |
| *** derekh has joined #openstack-infra | 13:03 | |
| *** akshai has joined #openstack-infra | 13:04 | |
| mnaser | just poking in to let everyone know what we're reshuffling resources around to be able to bring our # of instances back up | 13:06 |
| *** rossella_s has joined #openstack-infra | 13:06 | |
| mnaser | but.. we're dealing with some annoying live migration problems which are slowing things down | 13:06 |
| mordred | infra-root: on nodepool.o.o I have a script, test_nodes.py in ~nodepool that shows internal and external network discovery via shade like we need in nodepool. it fails like nodepool failed - but there is a virtualenv there called "testnets" that has the shade fix checked out in it | 13:08 |
| mordred | infra-root: tl;dr - I have verified that we have a fix for the problem we saw yesterday - but you can verify it too if you'd like | 13:08 |
| *** yamamoto has joined #openstack-infra | 13:08 | |
| *** nadya has quit IRC | 13:08 | |
| mordred | there is also a modified clouds.yaml in the home dir that has the changes that I'm pushing up to system-config currently | 13:09 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add network entries to clouds.yaml for internap https://review.openstack.org/306407 | 13:10 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Use floating_ip_source for tripleo cloud https://review.openstack.org/306408 | 13:10 |
| *** _ari_ has joined #openstack-infra | 13:12 | |
| *** kgiusti has joined #openstack-infra | 13:12 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Also set the network info for internap ci account https://review.openstack.org/306415 | 13:13 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Make the Add Lane button show the new worklist modal https://review.openstack.org/306399 | 13:13 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Remove pointless variable creation https://review.openstack.org/306401 | 13:13 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Show a modal when editing worklists in a board https://review.openstack.org/306400 | 13:13 |
| *** andymaier has joined #openstack-infra | 13:13 | |
| *** nelsnelson has joined #openstack-infra | 13:15 | |
| *** nt has quit IRC | 13:16 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Get storyboard resources by properties other than ID https://review.openstack.org/305411 | 13:16 |
| *** julim has quit IRC | 13:18 | |
| Shrews | mordred: have you run the network test against all infra providers for verification? | 13:18 |
| Shrews | maybe that's what your test_nodes.py does | 13:18 |
| *** zeih has joined #openstack-infra | 13:19 | |
| *** mkwiek has quit IRC | 13:20 | |
| *** sdake has joined #openstack-infra | 13:20 | |
| openstackgerrit | Merged openstack-infra/storyboard: requirements: Set upper version limit for 'apscheduler' https://review.openstack.org/303482 | 13:21 |
| *** mriedem has joined #openstack-infra | 13:22 | |
| *** amitgandhinz has joined #openstack-infra | 13:22 | |
| *** _degorenko|afk is now known as degorenko | 13:22 | |
| *** woodster_ has joined #openstack-infra | 13:22 | |
| mordred | Shrews: yes | 13:22 |
| *** julim has joined #openstack-infra | 13:22 | |
| openstackgerrit | Merged openstack-infra/python-storyboardclient: Add story_type_id to stories https://review.openstack.org/299390 | 13:22 |
| *** sdake_ has joined #openstack-infra | 13:22 | |
| openstackgerrit | Merged openstack-infra/python-storyboardclient: Update Timeline https://review.openstack.org/299395 | 13:23 |
| mordred | Shrews: with the patch and with the updated clouds.yaml it works | 13:23 |
| openstackgerrit | Merged openstack-infra/python-storyboardclient: Update tasks.py to include links https://review.openstack.org/299356 | 13:23 |
| openstackgerrit | Merged openstack-infra/python-storyboardclient: Add worklists https://review.openstack.org/299454 | 13:23 |
| krotscheck | mordred: Have a sec? Npm mirror go splodey, and I need some help debugging before I go back to the drawing board. | 13:24 |
| krotscheck | mordred: Specifically, http://mirror.dfw.rax.openstack.org/npm/a/ | 13:25 |
| *** mkwiek has joined #openstack-infra | 13:25 | |
| *** jaosorior has joined #openstack-infra | 13:25 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Remove network info for internap from nodepool.yaml https://review.openstack.org/306422 | 13:25 |
| mordred | krotscheck: sure! | 13:25 |
| *** nt has joined #openstack-infra | 13:25 | |
| openstackgerrit | Merged openstack-infra/python-storyboardclient: Add repo_url and team_id https://review.openstack.org/299411 | 13:25 |
| krotscheck | mordred: Current working theory is that there's enough packages in /npm/a/ to trip up AFS. | 13:26 |
| *** tiswanso has joined #openstack-infra | 13:26 | |
| krotscheck | mordred: Since it /a/ and /b/ are broken, but others like /Y/ are not | 13:26 |
| *** sdake has quit IRC | 13:26 | |
| mordred | krotscheck: I'm running ls in /afs/openstack.org/mirror/npm/a | 13:26 |
| mordred | it's ... not fast :) | 13:27 |
| krotscheck | mordred: I am surprised! | 13:27 |
| * krotscheck is not actually surprised | 13:27 | |
| mordred | krotscheck: wait. I'm confused. are you surprised or not surprised? you've said both things in close proximity | 13:29 |
| mordred | zomg. you're BOTH aren't you!!! | 13:29 |
| * mordred starts thinking in sanskrit | 13:30 | |
| mordred | krotscheck: if it is too much - you thinking of a double hash? like a/ab/abacus ? | 13:30 |
| *** vgridnev has quit IRC | 13:30 | |
| mordred | krotscheck: mordred@camelot:/afs/openstack.org/mirror/npm/a$ ls -l | wc -l | 13:31 |
| mordred | 8920 | 13:31 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Removing previously created resources in pingtest and --skip-pingtest-cleanup option https://review.openstack.org/304560 | 13:31 |
| *** Qiming has quit IRC | 13:31 | |
| *** piet has joined #openstack-infra | 13:31 | |
| krotscheck | mordred: Yeah, if anything we'll doubel hash | 13:31 |
| krotscheck | Huhn. | 13:31 |
| krotscheck | 8920 doesn't seem like too much | 13:32 |
| mordred | krotscheck: [Fri Apr 15 13:31:54.690837 2016] [core:error] [pid 17397:tid 140058301458176] [client 71.170.139.139:36355] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace. | 13:32 |
| mordred | that's what shows up in apache error log | 13:32 |
| *** andymaier has quit IRC | 13:32 | |
| krotscheck | Internal redirects? Whaaaa | 13:32 |
| krotscheck | Maybe a mod_rewrite thing? | 13:32 |
| krotscheck | But then why would it work on Y, but not a | 13:32 |
| krotscheck | Hrm. | 13:33 |
| mordred | krotscheck: there is a package called a | 13:33 |
| krotscheck | ....that's probably it then. | 13:33 |
| krotscheck | ok, so we don't need to kill that script. | 13:33 |
| *** salv-orlando has joined #openstack-infra | 13:33 | |
| mordred | cool | 13:33 |
| mordred | we just need slightly better rewrite things | 13:33 |
| krotscheck | I'll go look at the rewrite | 13:33 |
| mordred | krotscheck: if you spin up an apache and point it at your local /afs you should be able to break in the same way | 13:34 |
| krotscheck | mordred: Yep, that's my hope. | 13:34 |
| *** vgridnev has joined #openstack-infra | 13:34 | |
| mordred | krotscheck: \o/ | 13:34 |
| mordred | krotscheck: it's good to start the day with hope | 13:34 |
| krotscheck | it's so rare these days | 13:34 |
| *** salv-orl_ has quit IRC | 13:35 | |
| EmilienM | AJaeger, anteaya: thanks for the bindep review last night, all is working fine for us now. | 13:38 |
| *** oshykhkerimov has quit IRC | 13:39 | |
| breton | dims: thanks, /me looks | 13:39 |
| *** nt has quit IRC | 13:39 | |
| anteaya | EmilienM: oh good, I'm glad things are working well, thanks for the update | 13:40 |
| *** piet has quit IRC | 13:41 | |
| agentle | has anyone got a great trick for exporting an ical from the Austin Summit Schedule? | 13:42 |
| * agentle asks hopefully | 13:42 | |
| *** piet has joined #openstack-infra | 13:42 | |
| anteaya | I didn't know the austin summit schedule had an ical to export | 13:43 |
| agentle | anteaya: not that I can find. saddened. :) | 13:43 |
| agentle | I kidd. | 13:43 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Update deprecated commands in tripleo.sh (Old heat * calls) https://review.openstack.org/301087 | 13:43 |
| agentle | I should ask Tony | 13:43 |
| agentle | or write a screenscraper? | 13:43 |
| agentle | hm | 13:43 |
| *** vgridnev has quit IRC | 13:44 | |
| anteaya | agentle: ah you want an ical of the summit schedule, now I understand | 13:44 |
| agentle | anteaya: specifically of My Schedule | 13:44 |
| anteaya | ah okay | 13:44 |
| agentle | such as scraping that particular page... hm | 13:44 |
| *** nt has joined #openstack-infra | 13:44 | |
| agentle | I'll have a think | 13:44 |
| anteaya | yeah, I don't create a personalized schedule in the app, so I don't have the same problem | 13:45 |
| *** rodrigods has quit IRC | 13:45 | |
| *** rodrigods has joined #openstack-infra | 13:45 | |
| breton | sdague: i'd apt-get install shibboleth, edit wsgi-keystone.conf, restart services, run tox -e functional path.to.federation.tests | 13:45 |
| anteaya | but I can understand how an ical of your schedule would be handy | 13:45 |
| agentle | anteaya: ok. calendaring is super personal how people want to do it :) but I think an ical would be handy | 13:45 |
| mordred | agentle: it does not exist | 13:47 |
| anteaya | yes I can see that | 13:47 |
| anteaya | and yes, calendaring is super personal | 13:47 |
| anteaya | right up there with toothbrush choice | 13:47 |
| mordred | agentle: I got ragey at collier the other day about that, but have since learned to just live with my pain | 13:47 |
| sdague | breton: ok, so build a devstack plugin that does: apt-get install shibboleth, edit wsgi-keystone.conf, restart services, | 13:48 |
| sdague | then you can make a dsvm job which just enables that plugin | 13:48 |
| sdague | and does the tox run you have listed | 13:48 |
| EmilienM | anteaya: I have another request, if you have time to review it: https://review.openstack.org/#/c/306398/ - thanks! | 13:48 |
| mordred | agentle, anteaya: the expected behavior seems to be for people to install the mobile app. people not being interested in doing that, or needing to see a single schedule with official events and personal meetings seems to be a "next cycle" feature | 13:48 |
| anteaya | mordred: yes that seems to be my interpretation of it | 13:49 |
| mordred | I think "there is no way I'm installing the mobile app" is not a response that was anticipated | 13:49 |
| anteaya | mordred: oh my | 13:49 |
| anteaya | EmilienM: thank you | 13:49 |
| *** che-arne has quit IRC | 13:50 | |
| anteaya | I don't install moblie apps for anything | 13:51 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: Add grenade jobs https://review.openstack.org/306363 | 13:51 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: fixes typo in mikita branch job https://review.openstack.org/306437 | 13:51 |
| anteaya | if the website works on my phone, great | 13:51 |
| anteaya | if not, I don't use it | 13:51 |
| *** nwkarsten has joined #openstack-infra | 13:51 | |
| *** piet has quit IRC | 13:51 | |
| *** vgridnev has joined #openstack-infra | 13:51 | |
| *** piet has joined #openstack-infra | 13:51 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: fixes typo in mitika branch job https://review.openstack.org/306437 | 13:51 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: Add grenade jobs https://review.openstack.org/306363 | 13:51 |
| *** netsin has joined #openstack-infra | 13:51 | |
| *** infra-red has quit IRC | 13:52 | |
| *** infra-red has joined #openstack-infra | 13:52 | |
| mordred | anteaya: yup. I'm the same way | 13:52 |
| mordred | I see event-specific or brand-specific mobile apps as a failure | 13:52 |
| anteaya | me too | 13:52 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: fixes typo in mitaka branch job https://review.openstack.org/306437 | 13:53 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: Add grenade jobs https://review.openstack.org/306363 | 13:53 |
| breton | sdague: where should this plugin live? http://docs.openstack.org/developer/devstack/plugins.html describes that plugin should be in <giturl>, but my plugin probably should be in keystone tree | 13:56 |
| *** Nisha_away has joined #openstack-infra | 13:57 | |
| *** nt has quit IRC | 13:58 | |
| *** daemontool_ has joined #openstack-infra | 13:58 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Update deprecated commands in tripleo.sh (Old heat * calls) https://review.openstack.org/301087 | 13:58 |
| *** dims has quit IRC | 14:01 | |
| *** xarses_ has quit IRC | 14:01 | |
| *** daemontool has quit IRC | 14:01 | |
| *** tiswanso has quit IRC | 14:02 | |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/306249 | 14:02 |
| *** julim has quit IRC | 14:02 | |
| *** tiswanso has joined #openstack-infra | 14:02 | |
| sdague | breton: maybe, it could also be a dedicated git tree | 14:03 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add domain_id param to project operations https://review.openstack.org/291701 | 14:04 |
| *** dims has joined #openstack-infra | 14:04 | |
| *** tonytan4ever has joined #openstack-infra | 14:05 | |
| *** yolanda has joined #openstack-infra | 14:05 | |
| *** gordc has quit IRC | 14:06 | |
| *** dizquierdo has joined #openstack-infra | 14:06 | |
| *** rossella_s has quit IRC | 14:06 | |
| *** dansmith is now known as superdan | 14:07 | |
| *** sdague has quit IRC | 14:07 | |
| *** gordc has joined #openstack-infra | 14:07 | |
| *** sdague has joined #openstack-infra | 14:08 | |
| *** eharney has joined #openstack-infra | 14:10 | |
| *** rbrndt_ has joined #openstack-infra | 14:11 | |
| *** abregman has joined #openstack-infra | 14:11 | |
| *** rossella_s has joined #openstack-infra | 14:11 | |
| *** salv-orlando has quit IRC | 14:12 | |
| *** nt has joined #openstack-infra | 14:12 | |
| *** pcrews has quit IRC | 14:12 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:12 | |
| *** pcrews has joined #openstack-infra | 14:13 | |
| *** jlanoux has joined #openstack-infra | 14:13 | |
| *** mtanino has joined #openstack-infra | 14:14 | |
| *** _amrith_ is now known as amrith | 14:15 | |
| *** zz_dimtruck is now known as dimtruck | 14:15 | |
| *** hdd__ has quit IRC | 14:16 | |
| *** salv-orlando has joined #openstack-infra | 14:17 | |
| *** jog0 has quit IRC | 14:17 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Go to story from card https://review.openstack.org/306454 | 14:18 |
| *** julim has joined #openstack-infra | 14:19 | |
| openstackgerrit | Christian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup https://review.openstack.org/304465 | 14:22 |
| *** Nikolay_St has quit IRC | 14:23 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Run slave-cleanup on all proposal jobs https://review.openstack.org/306467 | 14:23 |
| *** Nisha_away has quit IRC | 14:23 | |
| AJaeger | anteaya, fungi, the slave cleanup works fine now, let's run it everywhere ^ | 14:24 |
| *** nt has quit IRC | 14:25 | |
| *** e0ne_ has joined #openstack-infra | 14:25 | |
| anteaya | yay slave clean up works! | 14:25 |
| *** e0ne has quit IRC | 14:26 | |
| *** achanda has joined #openstack-infra | 14:30 | |
| *** nt has joined #openstack-infra | 14:30 | |
| *** fhubik has quit IRC | 14:30 | |
| *** achanda has quit IRC | 14:32 | |
| *** [HeOS] has joined #openstack-infra | 14:33 | |
| AJaeger | anteaya: just looking at https://jenkins.openstack.org/job/cinder-upstream-translation-update/1892/console - from 241 M to 61 M. | 14:34 |
| anteaya | yay | 14:34 |
| AJaeger | And we're not deleting any caches, just content that the next run would delete at start of job. | 14:34 |
| anteaya | less space used | 14:35 |
| anteaya | nice work | 14:35 |
| anteaya | and thanks so much for the great output to assess the difference | 14:35 |
| AJaeger | anteaya: yeah, that was needed to verify that we're not just deleting nothing like in the past ;( Should have done much earlier ;) | 14:36 |
| AJaeger | It's typo day, anybody wants to +2A a project-config change? https://review.openstack.org/306437 | 14:36 |
| anteaya | well you did it now, so thank you | 14:36 |
| anteaya | everyday is typo day for me | 14:36 |
| *** avarner has joined #openstack-infra | 14:37 | |
| AJaeger | anteaya: I had a typo in my change that broke a script and my commit message included the same typo again ;( So, for me it's typo fighting day ;) | 14:39 |
| *** annegentle has joined #openstack-infra | 14:40 | |
| *** dizquierdo has quit IRC | 14:40 | |
| breton | sdague: ok, how do i enable a plugin if it lives in keystone tree? | 14:40 |
| anteaya | AJaeger: ha ha ha | 14:40 |
| *** annegentle is now known as Guest18489 | 14:40 | |
| anteaya | AJaeger: hope it is less stressful than fire fighting day | 14:40 |
| anteaya | :) | 14:40 |
| *** Guest18489 is now known as notsogentle | 14:40 | |
| EmilienM | AJaeger: in fact, mwhahaha reported we are having some issues with https://review.openstack.org/306218 - it's weird, we did not have like 1h ago | 14:41 |
| * EmilienM in a meeting, might be slow to reply | 14:41 | |
| sdague | breton: a devstack plugin is a git tree | 14:42 |
| *** nt has quit IRC | 14:42 | |
| *** fedexo has joined #openstack-infra | 14:42 | |
| breton | sdague: so, a separate git repo? | 14:43 |
| *** electrofelix has quit IRC | 14:43 | |
| sdague | breton: http://docs.openstack.org/developer/devstack/plugins.html | 14:43 |
| *** mrunge is now known as m\runge | 14:43 | |
| EmilienM | AJaeger, mwhahaha: the error is logged here: http://logs.openstack.org/87/305387/3/gate/gate-puppet-openstack-integration-3-scenario003-tempest-ubuntu-trusty/4fe7fc2/console.html#_2016-04-15_13_30_22_188 | 14:44 |
| breton | sdague: i don't want to have a new repo. I want the plugin to live in keystone/devstack/federation_plugin/plugin.sh. | 14:44 |
| *** EricGonczer_ has joined #openstack-infra | 14:44 | |
| openstackgerrit | Richard Theis proposed openstack/requirements: Bump openstacksdk version to 0.8.5 https://review.openstack.org/306479 | 14:44 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add domain_id param to project operations https://review.openstack.org/291701 | 14:45 |
| *** m\runge is now known as mrunge | 14:45 | |
| *** EricGonczer_ has quit IRC | 14:45 | |
| *** nt has joined #openstack-infra | 14:45 | |
| pabelanger | EmilienM: you cannot do what | 14:47 |
| pabelanger | EmilienM: because now you are checking out each project, not puppet-openstack-integration | 14:47 |
| *** EricGonczer_ has joined #openstack-infra | 14:47 | |
| pabelanger | thats the reason we setup zuul-cloner | 14:47 |
| sdague | breton: that's not really an option | 14:47 |
| EmilienM | pabelanger: damn | 14:48 |
| EmilienM | pabelanger: we need to revert it then | 14:48 |
| breton | sdague: :( | 14:48 |
| EmilienM | pabelanger: and figure how to deal with other-requirements.txt file | 14:48 |
| EmilienM | pabelanger: because bindep was looking for the file at workspace root | 14:48 |
| pabelanger | EmilienM: yes, revert is best | 14:48 |
| pabelanger | I can help this afternoon with bindep | 14:48 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Revert "puppet: use gerrit-git-prep for all jobs" https://review.openstack.org/306480 | 14:49 |
| EmilienM | pabelanger: thanks! | 14:49 |
| pabelanger | EmilienM: I suggest the following: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/windmill.yaml#L1 | 14:49 |
| EmilienM | pabelanger: ok, will look | 14:49 |
| pabelanger | EmilienM: replacing windmill with puppet-openstack-integration | 14:49 |
| sdague | breton: or let me be more specific, that's not a supported pattern. If you want to hack up something custom to do that, feel free. But the 1 plugin / repo model has been very effective at making it clear how to specify which plugins are active. Otherwise you need to support some other selector mechanism because a git repo has more than one plugin, and the nesting is different. | 14:50 |
| pabelanger | EmilienM: then bindep will work | 14:50 |
| EmilienM | pabelanger: you rocks | 14:50 |
| *** electrofelix has joined #openstack-infra | 14:51 | |
| *** vgridnev has quit IRC | 14:53 | |
| *** daemontool__ has joined #openstack-infra | 14:54 | |
| EmilienM | AJaeger, anteaya: I was wrong, sorry: https://review.openstack.org/306480 - I'll re-work on it today. | 14:54 |
| *** vgridnev has joined #openstack-infra | 14:55 | |
| AJaeger | EmilienM: do you want another +2? Sorry, can give only one ;) | 14:55 |
| breton | sdague: understood, thank you | 14:55 |
| EmilienM | AJaeger: ah, did not see your +2 :-P | 14:55 |
| anteaya | EmilienM: okey dokey | 14:56 |
| anteaya | EmilienM: thanks for keeping a close eye on it | 14:56 |
| EmilienM | anteaya: well, I break it, I fix it :P | 14:56 |
| *** daemontool_ has quit IRC | 14:56 | |
| anteaya | EmilienM: you do so | 14:57 |
| *** jog0 has joined #openstack-infra | 14:57 | |
| anteaya | one of many qualities I admire about you | 14:57 |
| anteaya | thank you | 14:57 |
| anteaya | keep being you | 14:57 |
| anteaya | \o/ | 14:57 |
| *** nt has quit IRC | 14:57 | |
| *** ajmiller__ is now known as ajmiller | 14:59 | |
| *** scheuran has quit IRC | 15:00 | |
| *** fedexo has quit IRC | 15:01 | |
| anteaya | channel ops, #openstack-meeting could use a topic refresh, other meeting channel topics look fine | 15:01 |
| *** hdd__ has joined #openstack-infra | 15:03 | |
| *** esker has joined #openstack-infra | 15:03 | |
| EmilienM | pabelanger: just a doubt, should I keep gerrit-git-prep? | 15:03 |
| *** xarses_ has joined #openstack-infra | 15:04 | |
| *** nwkarsten has quit IRC | 15:05 | |
| ihrachys | hi all. I was notified by AJaeger that neutron-*aas translation jobs are broken as in bug 1568708 | 15:05 |
| openstack | bug 1568708 in neutron "neutron-fwaas: translation sync broken due to wrong useage of venv" [High,Confirmed] https://launchpad.net/bugs/1568708 | 15:05 |
| *** nwkarsten has joined #openstack-infra | 15:06 | |
| ihrachys | the problem, as per AJaeger, is that we use zuul-cloner in post job (venv) | 15:06 |
| ihrachys | since it's not supposed to work | 15:06 |
| ihrachys | we use zuul-cloner to pull neutron repo that is a dep for neutron-*aas | 15:06 |
| ihrachys | note neutron is not published on pypi | 15:06 |
| *** pcaruana has quit IRC | 15:06 | |
| ihrachys | so how could we fetch neutron code in post without zuul-cloner? | 15:06 |
| pabelanger | EmilienM: I'd keep zuul-cloner | 15:06 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Implement puppet-openstack-integration-checkout JJB builder https://review.openstack.org/306492 | 15:07 |
| EmilienM | pabelanger: ^ is it correct? | 15:07 |
| *** bauwser is now known as _ | 15:08 | |
| openstackgerrit | Vitaly Gusev proposed openstack-infra/project-config: Add openstack/stacklight-integration-tests project https://review.openstack.org/306361 | 15:08 |
| *** _ is now known as Guest90517 | 15:08 | |
| *** superdan is now known as _-_ | 15:08 | |
| *** Guest90517 is now known as bauwser | 15:08 | |
| * AJaeger cannot help ihrachys here today... | 15:08 | |
| *** nadya has joined #openstack-infra | 15:09 | |
| *** _-_ is now known as superdan | 15:09 | |
| AJaeger | example breakage for the neutron problem: https://jenkins.openstack.org/job/neutron-vpnaas-upstream-translation-update/65/console | 15:09 |
| pabelanger | EmilienM: Ya, should just be able to do a search / replace for windmill | 15:09 |
| pabelanger | EmilienM: which I think you did | 15:09 |
| ihrachys | AJaeger: do we have a way to trigger the job on a patch? | 15:10 |
| *** nwkarsten has quit IRC | 15:10 | |
| pabelanger | okay, stepping away again for another errand today | 15:10 |
| AJaeger | ihrachys: it runs as post job on each change | 15:11 |
| *** kozhukalov has quit IRC | 15:11 | |
| *** serverascode has quit IRC | 15:11 | |
| *** zxiiro has quit IRC | 15:11 | |
| *** skath_ has quit IRC | 15:11 | |
| *** zhiyan has quit IRC | 15:11 | |
| *** vdrok has quit IRC | 15:11 | |
| *** boris-42 has quit IRC | 15:11 | |
| *** etoews has quit IRC | 15:11 | |
| *** hdd__ has quit IRC | 15:11 | |
| AJaeger | and there's the periodic jobs every morning | 15:11 |
| *** sdake_ has quit IRC | 15:11 | |
| *** kevinshort has quit IRC | 15:12 | |
| *** devananda has quit IRC | 15:12 | |
| *** tdurakov has quit IRC | 15:12 | |
| *** fmccrthy has quit IRC | 15:12 | |
| *** bryan_att has quit IRC | 15:12 | |
| *** igorbelikov has quit IRC | 15:12 | |
| *** ameade has quit IRC | 15:12 | |
| ihrachys | AJaeger: yeah, but then we can't experiment. for one thing, I would try setting ZUUL_BRANCH to see how far it goes | 15:12 |
| *** andrewbogott has quit IRC | 15:12 | |
| *** fungi has quit IRC | 15:12 | |
| *** jmccrory has quit IRC | 15:12 | |
| *** edwarnicke has quit IRC | 15:12 | |
| *** madorn has quit IRC | 15:12 | |
| *** Hunner has quit IRC | 15:12 | |
| *** dham1 has quit IRC | 15:12 | |
| *** Ng has quit IRC | 15:12 | |
| *** JayF has quit IRC | 15:12 | |
| *** tdasilva has quit IRC | 15:12 | |
| *** msuriar has quit IRC | 15:12 | |
| AJaeger | ihrachys: jeblair and fungi (who's off today) might be able to help better with this | 15:12 |
| *** EricGonc_ has joined #openstack-infra | 15:13 | |
| *** xgerman has quit IRC | 15:13 | |
| *** rpodolyaka has quit IRC | 15:13 | |
| *** flwang has quit IRC | 15:13 | |
| *** erikwilson has quit IRC | 15:13 | |
| *** odyssey4me has quit IRC | 15:13 | |
| *** markmcclain has quit IRC | 15:13 | |
| *** cargonza has quit IRC | 15:13 | |
| *** briancline has quit IRC | 15:13 | |
| *** ogelbukh has quit IRC | 15:13 | |
| AJaeger | ihrachys: note that we do not loose data if no translation sync happens, so no need to fix it *now*. But let's not wait too long | 15:13 |
| *** hrybacki has quit IRC | 15:13 | |
| *** GheRivero has quit IRC | 15:13 | |
| *** peterlisak has quit IRC | 15:13 | |
| *** auggy has quit IRC | 15:13 | |
| *** andreykurilin__ has quit IRC | 15:13 | |
| ihrachys | AJaeger: ok that's good to know we are not in fire drill mode | 15:13 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Make the Add Lane button show the new worklist modal https://review.openstack.org/306399 | 15:14 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Remove pointless variable creation https://review.openstack.org/306401 | 15:14 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Show a modal when editing worklists in a board https://review.openstack.org/306400 | 15:14 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Don't allow cards to be dragged to/from automatic worklists https://review.openstack.org/306497 | 15:14 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Upload the overcloud images to cache https://review.openstack.org/306499 | 15:14 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "puppet: use gerrit-git-prep for all jobs" https://review.openstack.org/306480 | 15:15 |
| *** EricGonczer_ has quit IRC | 15:16 | |
| *** nelsnels_ has joined #openstack-infra | 15:16 | |
| *** daemontool_ has joined #openstack-infra | 15:16 | |
| *** doug-fis_ has joined #openstack-infra | 15:17 | |
| *** peterlisak has joined #openstack-infra | 15:17 | |
| *** tiswanso_ has joined #openstack-infra | 15:17 | |
| *** julim_ has joined #openstack-infra | 15:17 | |
| *** bdemers_ has joined #openstack-infra | 15:17 | |
| *** odyssey4me has joined #openstack-infra | 15:17 | |
| *** briancline has joined #openstack-infra | 15:17 | |
| *** erikmwilson has joined #openstack-infra | 15:17 | |
| *** Hunner has joined #openstack-infra | 15:18 | |
| *** Hunner has quit IRC | 15:18 | |
| *** Hunner has joined #openstack-infra | 15:18 | |
| *** electrofelix has quit IRC | 15:18 | |
| *** skath_ has joined #openstack-infra | 15:18 | |
| *** mrmartin has joined #openstack-infra | 15:19 | |
| *** JayF has joined #openstack-infra | 15:19 | |
| *** msuriar has joined #openstack-infra | 15:19 | |
| *** sambetts_ has joined #openstack-infra | 15:19 | |
| *** mat128_ has joined #openstack-infra | 15:19 | |
| *** boris-42 has joined #openstack-infra | 15:19 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 15:20 |
| *** sdake has joined #openstack-infra | 15:20 | |
| *** madorn has joined #openstack-infra | 15:20 | |
| *** kevinshort has joined #openstack-infra | 15:20 | |
| *** vgridnev has quit IRC | 15:20 | |
| *** daemontool__ has quit IRC | 15:20 | |
| *** julim has quit IRC | 15:20 | |
| *** fungi has joined #openstack-infra | 15:20 | |
| *** markmcclain has joined #openstack-infra | 15:20 | |
| *** zz_ja has quit IRC | 15:20 | |
| *** tonyb_ has joined #openstack-infra | 15:20 | |
| rcarrillocruz | gerrit seems laggish... | 15:20 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Moved npm rewrite rules out of directory scope https://review.openstack.org/306503 | 15:21 |
| *** pfalleno2 has joined #openstack-infra | 15:21 | |
| *** r-mibu_ has joined #openstack-infra | 15:21 | |
| *** gsilvis_ has joined #openstack-infra | 15:21 | |
| *** pleia2_ has joined #openstack-infra | 15:21 | |
| krotscheck | mordred: ^^ | 15:21 |
| *** matt6434 has joined #openstack-infra | 15:21 | |
| krotscheck | Also, fungi, jeblair: ^^ | 15:21 |
| krotscheck | That fixes the 500 errros we're encountering in the NPM mirror. | 15:22 |
| *** eliqiao_ has joined #openstack-infra | 15:22 | |
| mordred | krotscheck: woot! | 15:22 |
| *** flwang has joined #openstack-infra | 15:22 | |
| *** zz_ja has joined #openstack-infra | 15:22 | |
| krotscheck | mordred: Note that it also makes /npm/ look as if it's the root of the "index.json" package. | 15:22 |
| *** andrewbogott has joined #openstack-infra | 15:23 | |
| * krotscheck should fix that | 15:23 | |
| *** edwarnicke has joined #openstack-infra | 15:23 | |
| *** etoews has joined #openstack-infra | 15:23 | |
| *** zxiiro has joined #openstack-infra | 15:23 | |
| *** rpodolyaka has joined #openstack-infra | 15:23 | |
| *** jlanoux_ has joined #openstack-infra | 15:23 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Conditionally request a test env from geard https://review.openstack.org/306506 | 15:23 |
| *** baoli has joined #openstack-infra | 15:24 | |
| *** tdurakov has joined #openstack-infra | 15:24 | |
| *** LaT0rtue has joined #openstack-infra | 15:24 | |
| *** zhiyan has joined #openstack-infra | 15:24 | |
| *** ameade has joined #openstack-infra | 15:24 | |
| *** rvba` has joined #openstack-infra | 15:24 | |
| *** vdrok_ has joined #openstack-infra | 15:24 | |
| *** davidlenwell has joined #openstack-infra | 15:24 | |
| *** jlvillal_ has joined #openstack-infra | 15:24 | |
| *** vdrok has joined #openstack-infra | 15:24 | |
| *** vdrok_ has left #openstack-infra | 15:25 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use absolute path for VENV https://review.openstack.org/306507 | 15:25 |
| *** kzaitsev_mb has joined #openstack-infra | 15:25 | |
| *** e0ne_ has quit IRC | 15:25 | |
| *** jlanoux has quit IRC | 15:25 | |
| *** eharney has quit IRC | 15:25 | |
| *** gordc has quit IRC | 15:25 | |
| *** dims has quit IRC | 15:25 | |
| *** tiswanso has quit IRC | 15:25 | |
| *** amitgandhinz has quit IRC | 15:25 | |
| *** nelsnelson has quit IRC | 15:25 | |
| *** derekh has quit IRC | 15:25 | |
| *** notnownikki has quit IRC | 15:25 | |
| *** doug-fish has quit IRC | 15:25 | |
| *** baoli_ has quit IRC | 15:25 | |
| *** dprince has quit IRC | 15:25 | |
| *** gsilvis has quit IRC | 15:25 | |
| *** eliqiao has quit IRC | 15:25 | |
| *** Guest1677 has quit IRC | 15:25 | |
| *** jordanP has quit IRC | 15:25 | |
| *** arxcruz has quit IRC | 15:25 | |
| *** mikelk has quit IRC | 15:25 | |
| *** mat128 has quit IRC | 15:25 | |
| *** jlvillal has quit IRC | 15:25 | |
| *** davidlenwell_ has quit IRC | 15:25 | |
| *** dhellmann has quit IRC | 15:25 | |
| *** sambetts has quit IRC | 15:25 | |
| *** mattoliverau has quit IRC | 15:25 | |
| *** pleia2 has quit IRC | 15:25 | |
| *** bdemers has quit IRC | 15:25 | |
| *** edmondsw has quit IRC | 15:25 | |
| *** pfallenop has quit IRC | 15:25 | |
| *** r-mibu has quit IRC | 15:25 | |
| *** sileht has quit IRC | 15:25 | |
| *** ericksonsantos has quit IRC | 15:25 | |
| *** zynzel_ has quit IRC | 15:25 | |
| *** hamzy has quit IRC | 15:25 | |
| *** tonyb has quit IRC | 15:25 | |
| *** pabelanger has quit IRC | 15:25 | |
| *** bauwser has quit IRC | 15:25 | |
| *** rvba has quit IRC | 15:25 | |
| *** ianychoi has quit IRC | 15:25 | |
| *** gmann has quit IRC | 15:25 | |
| *** EmilienM has quit IRC | 15:25 | |
| *** mrunge has quit IRC | 15:25 | |
| *** lxsli has quit IRC | 15:25 | |
| *** matbu has quit IRC | 15:25 | |
| *** pleia2_ is now known as pleia2 | 15:26 | |
| *** johnthetubaguy has quit IRC | 15:26 | |
| *** ihrachys has quit IRC | 15:26 | |
| anteaya | rcarrillocruz: cacti for review.o.o doesn't appear unsual | 15:26 |
| *** dims has joined #openstack-infra | 15:26 | |
| anteaya | mordred: would you have time to take a peek at gerrit's melody behaviour? | 15:26 |
| *** e0ne has joined #openstack-infra | 15:26 | |
| *** mbu has joined #openstack-infra | 15:26 | |
| AJaeger | project-config cores, one more translation issue to fix - could you review 306507, please? | 15:26 |
| *** Nikolay_St has joined #openstack-infra | 15:26 | |
| *** dhellmann has joined #openstack-infra | 15:26 | |
| *** amitgandhinz has joined #openstack-infra | 15:27 | |
| *** mbu is now known as matbu | 15:27 | |
| *** gordc has joined #openstack-infra | 15:27 | |
| *** amotoki has joined #openstack-infra | 15:27 | |
| *** jlvillal_ is now known as jlvillal | 15:27 | |
| *** mrunge has joined #openstack-infra | 15:27 | |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Require oslo.privsep>=1.5.0 for os-brick https://review.openstack.org/306508 | 15:27 |
| mriedem | gus: smcginnis: ^ | 15:27 |
| *** jlvillal is now known as Guest81062 | 15:27 | |
| *** EmilienM has joined #openstack-infra | 15:28 | |
| *** dprince has joined #openstack-infra | 15:28 | |
| *** greghaynes has quit IRC | 15:28 | |
| *** mhayden has joined #openstack-infra | 15:28 | |
| *** rpodolyaka has quit IRC | 15:28 | |
| jeblair | anteaya: i don't see anything interesting, but gerrit has apparently only been running for a few hours | 15:29 |
| anteaya | jeblair: thanks for looking | 15:29 |
| *** ameade has quit IRC | 15:29 | |
| *** lxsli has joined #openstack-infra | 15:29 | |
| *** pblaho has quit IRC | 15:29 | |
| *** tosky_ has joined #openstack-infra | 15:29 | |
| *** sileht has joined #openstack-infra | 15:29 | |
| anteaya | dhellmann: very nice release email | 15:29 |
| *** gmann has joined #openstack-infra | 15:29 | |
| jeblair | no gc time, memory use flat-ish. | 15:30 |
| *** tpsilva has quit IRC | 15:30 | |
| *** iremizov has quit IRC | 15:30 | |
| jeblair | slight increase in cpu time as usa woke up | 15:30 |
| *** jmccrory has joined #openstack-infra | 15:30 | |
| *** edwarnicke has quit IRC | 15:30 | |
| *** jistr has quit IRC | 15:30 | |
| *** rcernin has quit IRC | 15:30 | |
| *** eharney has joined #openstack-infra | 15:30 | |
| *** zynzel has joined #openstack-infra | 15:30 | |
| *** derekh has joined #openstack-infra | 15:30 | |
| *** pabelanger has joined #openstack-infra | 15:30 | |
| *** jordanP has joined #openstack-infra | 15:30 | |
| *** bauzas has joined #openstack-infra | 15:30 | |
| *** pabelanger has quit IRC | 15:30 | |
| *** pabelanger has joined #openstack-infra | 15:30 | |
| *** tosky has quit IRC | 15:30 | |
| *** Hal has joined #openstack-infra | 15:31 | |
| anteaya | awesome | 15:31 |
| *** hamzy has joined #openstack-infra | 15:31 | |
| *** edmondsw has joined #openstack-infra | 15:31 | |
| anteaya | rcarrillocruz: any further details on your experience that gerrit seems laggish? | 15:31 |
| *** Hal is now known as Guest1916 | 15:31 | |
| openstackgerrit | Ben Nemec proposed openstack/diskimage-builder: Don't stop dib-lint on first flake8 failure https://review.openstack.org/306510 | 15:31 |
| *** Guest63229 has quit IRC | 15:31 | |
| *** ericksonsantos has joined #openstack-infra | 15:32 | |
| rcarrillocruz | must be my end | 15:32 |
| *** vgridnev has joined #openstack-infra | 15:32 | |
| *** vincentll has quit IRC | 15:32 | |
| *** notnownikki has joined #openstack-infra | 15:32 | |
| *** andrewbogott has quit IRC | 15:33 | |
| *** andrewbogott has joined #openstack-infra | 15:33 | |
| *** fmccrthy has joined #openstack-infra | 15:33 | |
| *** devananda has joined #openstack-infra | 15:33 | |
| anteaya | rcarrillocruz: okay | 15:33 |
| *** ianychoi has joined #openstack-infra | 15:34 | |
| *** nt has joined #openstack-infra | 15:35 | |
| *** dtantsur is now known as dtantsur|afk | 15:35 | |
| *** nwkarsten has joined #openstack-infra | 15:35 | |
| *** arxcruz has joined #openstack-infra | 15:35 | |
| *** nwkarsten has quit IRC | 15:36 | |
| *** andreykurilin__ has joined #openstack-infra | 15:36 | |
| *** nwkarsten has joined #openstack-infra | 15:36 | |
| *** ogelbukh has joined #openstack-infra | 15:37 | |
| *** dham1 has joined #openstack-infra | 15:37 | |
| *** zul has quit IRC | 15:37 | |
| *** tpsilva has joined #openstack-infra | 15:37 | |
| *** xgerman has joined #openstack-infra | 15:38 | |
| *** cargonza has joined #openstack-infra | 15:38 | |
| *** igorbelikov has joined #openstack-infra | 15:38 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Moved npm rewrite rules out of directory scope https://review.openstack.org/306503 | 15:38 |
| *** pblaho has joined #openstack-infra | 15:38 | |
| EmilienM | AJaeger, anteaya: the fix is ready for review : https://review.openstack.org/#/c/306492/ | 15:38 |
| *** GheRivero has joined #openstack-infra | 15:39 | |
| *** iremizov has joined #openstack-infra | 15:39 | |
| *** rpodolyaka has joined #openstack-infra | 15:39 | |
| *** armax has joined #openstack-infra | 15:39 | |
| openstackgerrit | Ben Nemec proposed openstack/diskimage-builder: Allow skipping the md docs check https://review.openstack.org/306514 | 15:39 |
| breton | Why do many projects run their functional or integration tests with shell scripts in their repos? And why is post_test_hook used? Isn't it more logical to override gate_hook? For example, https://github.com/openstack/python-openstackclient/blob/master/post_test_hook.sh, https://github.com/openstack/murano/blob/master/functionaltests/post_test_hook.sh. | 15:39 |
| krotscheck | That's better | 15:39 |
| krotscheck | jeblair: goooood morning! | 15:39 |
| *** mescanef_ has quit IRC | 15:39 | |
| *** vgridnev has quit IRC | 15:39 | |
| *** ameade has joined #openstack-infra | 15:39 | |
| *** newjersey has quit IRC | 15:40 | |
| *** mnencia has quit IRC | 15:40 | |
| *** mgkwill has quit IRC | 15:40 | |
| *** hrybacki has joined #openstack-infra | 15:40 | |
| *** bryan_att has joined #openstack-infra | 15:40 | |
| jeblair | krotscheck: morning! | 15:40 |
| *** auggy has joined #openstack-infra | 15:41 | |
| krotscheck | jeblair: Ignore most of the chatter from last night, it was caused by a bad interaction between <directory> and mod_rewrite. | 15:41 |
| *** edwarnicke has joined #openstack-infra | 15:41 | |
| *** chuck__ has joined #openstack-infra | 15:41 | |
| jeblair | krotscheck: too late -- i'm all caught up :) | 15:41 |
| breton | a lot of clients also use post_test_hook | 15:41 |
| krotscheck | DOH | 15:42 |
| *** jistr has joined #openstack-infra | 15:42 | |
| markus_z | dims: I think https://review.openstack.org/#/c/306318 got swallowed by the gerrit restart. Could you +W again please? | 15:43 |
| clarkb | breton: because the existing gate hook runs devstack which means they dont have to overrode that | 15:43 |
| *** Ng has joined #openstack-infra | 15:43 | |
| *** jaosorior has quit IRC | 15:43 | |
| breton | clarkb: but doesn't gate hook run unnecessary tempest tests? | 15:43 |
| clarkb | no, you can turn tempest off | 15:44 |
| *** mgkwill has joined #openstack-infra | 15:44 | |
| *** nt has quit IRC | 15:45 | |
| AJaeger | clarkb, pabelanger: Could either of you do a quick review on https://review.openstack.org/306507, please? we need absolete VENV for horizon setup. | 15:45 |
| * AJaeger will be back later | 15:45 | |
| *** tdasilva has joined #openstack-infra | 15:46 | |
| breton | clarkb: so, gate_hook will set up devstack only? How do i turn it off? | 15:46 |
| *** johnthetubaguy has joined #openstack-infra | 15:46 | |
| *** vgridnev has joined #openstack-infra | 15:46 | |
| *** andymaier has joined #openstack-infra | 15:47 | |
| clarkb | by default tempest will run, but there is a var you can set to not do that | 15:47 |
| *** kozhukalov has joined #openstack-infra | 15:47 | |
| *** greghaynes has joined #openstack-infra | 15:47 | |
| *** serverascode has joined #openstack-infra | 15:48 | |
| *** tphummel has joined #openstack-infra | 15:48 | |
| *** gyee has joined #openstack-infra | 15:48 | |
| breton | are tempest plugins used during gate_hook? | 15:49 |
| *** sdake has quit IRC | 15:49 | |
| clarkb | if they are installed via entrypoints they should be | 15:50 |
| openstackgerrit | Merged openstack-infra/project-config: Implement puppet-openstack-integration-checkout JJB builder https://review.openstack.org/306492 | 15:50 |
| samueldmq | jeblair: hi, I replied your comment in https://review.openstack.org/#/c/264398/8/doc/source/project-setup/python.rst | 15:50 |
| *** sdake has joined #openstack-infra | 15:50 | |
| *** mnencia has joined #openstack-infra | 15:50 | |
| samueldmq | jeblair: could you take a look at it and see if you agree with what I proposed there? | 15:51 |
| samueldmq | thanks | 15:51 |
| *** lakshmiS has joined #openstack-infra | 15:51 | |
| jeblair | samueldmq: sorry, i probably didn't express myself well -- the fallback file will install *lots* of random packages that may or may not be needed by any random project we have ever tested | 15:52 |
| jeblair | samueldmq: so i think, even now, that we should not tell people to install it | 15:52 |
| *** nt has joined #openstack-infra | 15:52 | |
| *** mescanef has joined #openstack-infra | 15:52 | |
| jeblair | samueldmq: the fact is that right now there is not an automated way to tell people "install the packages needed by this project". some projects will have that documented in their readme files, some may not. | 15:52 |
| jeblair | but that's the state of the world | 15:52 |
| jeblair | the other-requirements file will make that better | 15:53 |
| jeblair | but it's not fully there yet | 15:53 |
| samueldmq | yes | 15:54 |
| samueldmq | jeblair: so what should I tell people to do in the case ther isn't an other-requirements file there? | 15:54 |
| samueldmq | jeblair: should I tell them to look at the project's specific docs and learn what needs to be installed from there ? | 15:55 |
| samueldmq | seems a fair approach | 15:56 |
| *** dtroyer has quit IRC | 15:56 | |
| jeblair | samueldmq: yeah, i think that's the best right now. | 15:56 |
| *** dtroyer has joined #openstack-infra | 15:56 | |
| *** marcusvrn_ has joined #openstack-infra | 15:56 | |
| *** jordanP has quit IRC | 15:56 | |
| *** akshai has quit IRC | 15:57 | |
| samueldmq | jeblair: nice, I will update it accordingly, thanks | 15:57 |
| jeblair | samueldmq: thank you :) | 15:58 |
| marcusvrn_ | jeblair: hi | 15:58 |
| *** zeih has quit IRC | 15:58 | |
| *** akshai has joined #openstack-infra | 15:58 | |
| *** vgridnev has quit IRC | 16:00 | |
| *** jistr is now known as jistr|afk | 16:00 | |
| *** akshai has quit IRC | 16:00 | |
| *** akshai has joined #openstack-infra | 16:00 | |
| marcusvrn_ | jeblair: I'm coding a "tool" for zuul to make the change queue persistent (when restart zuul, all patches that were in the queue are put back to the zuul queue). I'm using the zuul tag 2.1.0 as code base. I tested the promote command, but it's not working.... as you have some patches in zuul, maybe you could help me with it. | 16:03 |
| *** yamahata has joined #openstack-infra | 16:05 | |
| *** jlanoux_ has quit IRC | 16:06 | |
| dims | markus_z : i did a "recheck" let's see if it gets picked up | 16:07 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Add a function to decide if using cache is appropriate https://review.openstack.org/306524 | 16:07 |
| *** sambetts_ is now known as sambetts | 16:07 | |
| *** jcoufal has quit IRC | 16:08 | |
| *** mrmartin has quit IRC | 16:10 | |
| *** xyang1 has quit IRC | 16:11 | |
| dhellmann | anteaya : thanks :-) | 16:13 |
| zaro | morning | 16:13 |
| *** marcusvrn_ has quit IRC | 16:13 | |
| *** lakshmiS has quit IRC | 16:13 | |
| *** serverascode has quit IRC | 16:13 | |
| *** andymaier has quit IRC | 16:13 | |
| *** gabriel-bezerra has quit IRC | 16:13 | |
| *** nwkarsten has quit IRC | 16:13 | |
| zaro | fungi did you say that gerrit online reindex doesn't work for project name changes? | 16:14 |
| *** matrohon has quit IRC | 16:14 | |
| *** andymaier has joined #openstack-infra | 16:14 | |
| *** lakshmiS has joined #openstack-infra | 16:14 | |
| *** marcusvrn_ has joined #openstack-infra | 16:14 | |
| *** bpokorny has joined #openstack-infra | 16:14 | |
| *** serverascode has joined #openstack-infra | 16:15 | |
| *** gabriel-bezerra has joined #openstack-infra | 16:15 | |
| openstackgerrit | Merged openstack-infra/system-config: Moved npm rewrite rules out of directory scope https://review.openstack.org/306503 | 16:15 |
| *** yarkot has quit IRC | 16:15 | |
| *** dham1 has quit IRC | 16:16 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: run-wheel.sh: only run wheel for Python projects https://review.openstack.org/306398 | 16:16 |
| *** yonglihe has quit IRC | 16:17 | |
| jeblair | marcusvrn_ seems to be gone | 16:17 |
| *** yarkot1 has quit IRC | 16:17 | |
| *** andreykurilin__ has quit IRC | 16:17 | |
| jeblair | zaro: fungi is out today, but yes. | 16:17 |
| marcusvrn_ | jeblair: I did not submit the patch...it's local yet....but I want to know if the promote command has a bug in tag 2.1.0 | 16:18 |
| *** dham1 has joined #openstack-infra | 16:18 | |
| *** kzaitsev_mb has quit IRC | 16:19 | |
| jeblair | marcusvrn_: oh there you are :) | 16:19 |
| marcusvrn_ | hehehe | 16:19 |
| *** xgerman has quit IRC | 16:19 | |
| *** mriedem is now known as mriedem_lunch | 16:19 | |
| jeblair | marcusvrn_: not that i know of -- but you may need to use enqueue rather than promote. | 16:20 |
| jeblair | marcusvrn_: also, do you know about tools/zuul-changes.py ? | 16:20 |
| *** andreykurilin__ has joined #openstack-infra | 16:20 | |
| *** yonglihe has joined #openstack-infra | 16:20 | |
| *** xgerman has joined #openstack-infra | 16:21 | |
| zaro | jeblair: have we found a workaround or have we stopped doing name changes due to offline reindex duration? | 16:21 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Add a few more layout checks https://review.openstack.org/306194 | 16:21 |
| jeblair | zaro: we have not done one since. i don't know that we've adopted a policy, but i know that the prospect of 4 hours of downtime has made us reluctant. | 16:22 |
| *** Ng has quit IRC | 16:22 | |
| zaro | jeblair: i think 4hrs was only because it was reindex after upgrade, non-upgrade reindex shoule be much faster. | 16:22 |
| *** Sukhdev has joined #openstack-infra | 16:23 | |
| jeblair | zaro: i'm pretty sure we've done one since the upgrade | 16:23 |
| jeblair | zaro: https://gerrit-review.googlesource.com/Documentation/cmd-index-start.html | 16:23 |
| *** bryan_att has quit IRC | 16:23 | |
| jeblair | zaro: the second paragraph in description indicates why it doesn't work for us. | 16:23 |
| jeblair | zaro: "This command will not start the indexer ... if the active index is the latest." | 16:24 |
| *** hrybacki has quit IRC | 16:24 | |
| *** Ng has joined #openstack-infra | 16:24 | |
| *** amotoki has quit IRC | 16:24 | |
| marcusvrn_ | jeblair: yes, I know about that, but it's useful when you know when the zuul will stop...What I'm trying to do is a way to keep all changes saved and if the machine reboot unexpectedly, those change will not be lost | 16:24 |
| clarkb | was gerrit intentionally restarted? | 16:24 |
| jeblair | clarkb: i believe yolanda did so | 16:25 |
| *** nadya has quit IRC | 16:25 | |
| *** bryan_att has joined #openstack-infra | 16:25 | |
| zaro | jeblair: i mean the offline reindex should be faster. | 16:25 |
| zaro | i can test it if you like, would just need a recent db and git file | 16:25 |
| *** achanda has joined #openstack-infra | 16:26 | |
| clarkb | hrm, something wasn't processing events apparently | 16:26 |
| openstackgerrit | Merged openstack-infra/release-tools: make query for fixed bugs match more bugs https://review.openstack.org/306318 | 16:26 |
| *** salv-orlando has quit IRC | 16:26 | |
| *** arxcruz has quit IRC | 16:26 | |
| *** hrybacki has joined #openstack-infra | 16:26 | |
| zaro | clarkb: processing events error was due to gerrit? | 16:27 |
| marcusvrn_ | jeblair: In my approach, I'm using enqueue and it's working | 16:27 |
| clarkb | zaro: no looks like it was zuul side | 16:27 |
| zaro | wondering why gerrit restart then? | 16:28 |
| *** mgkwill has quit IRC | 16:28 | |
| *** roxanagh_ has joined #openstack-infra | 16:28 | |
| EmilienM | so now we have periodic jobs for puppet4, I see them failing for some reasons I never saw before: http://logs.openstack.org/periodic/periodic-puppet-openstack-integration-4-scenario001-tempest-centos-7/86c8101/console.html#_2016-04-15_06_02_06_189 | 16:28 |
| *** mgkwill has joined #openstack-infra | 16:28 | |
| jeblair | zaro: the first (and last) time we ran an offline reindex for a rename after the upgrade (so, not the upgrade itself), it took 272 minutes. | 16:29 |
| EmilienM | Provide either ZUUL_REF or BRANCH in the calling enviromnent. | 16:29 |
| jeblair | zaro: see http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-02-12.log.html and http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-02-13.log.html | 16:29 |
| pabelanger | and back for a bit | 16:29 |
| *** Guest1916 has quit IRC | 16:29 | |
| *** sputnik13 has joined #openstack-infra | 16:29 | |
| jeblair | clarkb: i don't really understand what happened this morning, but i got the impression that there was a network problem | 16:30 |
| *** achanda has quit IRC | 16:30 | |
| jeblair | zaro: sorry, 164 minutes | 16:31 |
| jeblair | zaro: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-02-13.log.html#t2016-02-13T01:06:23 | 16:31 |
| jeblair | so ~3 hours | 16:32 |
| clarkb | jeblair: ya from my reading of scrollback seems to have been network related | 16:32 |
| clarkb | with zuul not being able to talk to gerrit | 16:32 |
| *** kzaitsev_mb has joined #openstack-infra | 16:32 | |
| *** gyee has quit IRC | 16:32 | |
| EmilienM | nevermind, I think it's because we ran gerrit-git-prep and we just reverted it | 16:32 |
| *** sputnik13_ has joined #openstack-infra | 16:33 | |
| *** sputnik13 has quit IRC | 16:35 | |
| *** tosky_ is now known as tosky | 16:35 | |
| *** cfarquhar has quit IRC | 16:37 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Redirect instack image build output to file https://review.openstack.org/306533 | 16:37 |
| *** elmiko_ is now known as elmiko | 16:38 | |
| *** bpokorny has quit IRC | 16:38 | |
| zaro | jeblair: hmm, isn't the event in those irc logs the gerrit 2.8->2.11 upgrade. that 3 hrs was for offline reindex after upgrade correct? | 16:39 |
| *** apoorvad has joined #openstack-infra | 16:39 | |
| *** akshai has quit IRC | 16:39 | |
| jeblair | zaro: those logs are from februrary. we upgraded in december. | 16:40 |
| *** apoorvad has quit IRC | 16:40 | |
| openstackgerrit | Merged openstack-infra/project-config: Use absolute path for VENV https://review.openstack.org/306507 | 16:40 |
| *** infra-red has quit IRC | 16:41 | |
| jeblair | zaro: http://lists.openstack.org/pipermail/openstack-infra/2016-February/003773.html | 16:41 |
| jeblair | zaro: do you think it's possible gerrit could just lift the restriction of the online reindex only running if the schema version is not the latest? | 16:42 |
| *** sputnik13_ has quit IRC | 16:43 | |
| zaro | jeblair: ahh, ok. sorry about that. | 16:43 |
| *** cfarquhar has joined #openstack-infra | 16:43 | |
| *** cfarquhar has quit IRC | 16:43 | |
| *** cfarquhar has joined #openstack-infra | 16:43 | |
| *** apoorvad has joined #openstack-infra | 16:43 | |
| *** amrith is now known as _amrith_ | 16:44 | |
| zaro | jeblair: i really didn't notice that online index can only be used for upgrades. there might be some good reason behind that though. I'll investigate though. | 16:44 |
| *** zynzel_ has joined #openstack-infra | 16:44 | |
| jeblair | zaro: thanks! | 16:44 |
| *** harlowja has quit IRC | 16:44 | |
| *** kzaitsev_mb has quit IRC | 16:45 | |
| *** harlowja has joined #openstack-infra | 16:45 | |
| *** roxanagh_ has quit IRC | 16:46 | |
| zaro | Zara: storyboard keeps crashing for me (chromium), is that a known thing? | 16:46 |
| *** zynzel has quit IRC | 16:46 | |
| *** roxanagh_ has joined #openstack-infra | 16:47 | |
| AJaeger | project-config cores and zuul experts: There's a change to add some more checks for zuul/layout.yaml that looks reasonable to me: https://review.openstack.org/#/c/306194 Anybody wants to comment on noop job checks, please review | 16:47 |
| SotK | zaro: is there something you try to do which triggers a crash? | 16:47 |
| Zara | zaro: not known | 16:48 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Stop uploading to job logs to swift https://review.openstack.org/306537 | 16:48 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add final success/failure message to ping test https://review.openstack.org/304864 | 16:50 |
| *** trown is now known as trown|lunch | 16:51 | |
| *** akshai has joined #openstack-infra | 16:51 | |
| zaro | SotK: just clicking around, it's crashed like 3 times already. | 16:56 |
| zaro | ohh just did it again | 16:56 |
| *** sambetts is now known as sambetts|afk | 16:56 | |
| jeblair | zaro: what does 'crash' mean in this context? | 16:56 |
| zaro | last thing i did was clicked on dashboard icon | 16:56 |
| *** Sukhdev has quit IRC | 16:57 | |
| * SotK uses chromium and has never managed to see this | 16:57 | |
| *** Sukhdev has joined #openstack-infra | 16:57 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 16:58 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion with net-iso in periodic job https://review.openstack.org/296765 | 16:58 |
| *** sridhar_ram has joined #openstack-infra | 16:58 | |
| zaro | jeblair, SotK : http://imgur.com/mpaVCmG | 16:58 |
| *** derekh has quit IRC | 16:58 | |
| zaro | SotK: i'm on mac | 16:58 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add undercloud idempotency test https://review.openstack.org/279218 | 16:59 |
| *** piet has quit IRC | 16:59 | |
| *** jistr|afk is now known as jistr | 17:00 | |
| *** piet has joined #openstack-infra | 17:00 | |
| Zara | trying to see if I can reproduce... but it's weird if sotk hasn't seen it | 17:00 |
| zaro | SotK: actually that ugly face just means unresponsive, althought i would interpret as crash | 17:00 |
| *** xyang1 has joined #openstack-infra | 17:01 | |
| *** permalac has joined #openstack-infra | 17:01 | |
| *** roxanagh_ has quit IRC | 17:02 | |
| *** vgridnev has joined #openstack-infra | 17:02 | |
| Zara | hm, I'm able to reproduce a different, known error | 17:02 |
| zaro | yeah, actually it never seem to become responsive again so 'crash' would be correct term. | 17:03 |
| Zara | (where a big list of green status messages appear-- seems to happen if the user moves too fast between the dashboard and boards/worklists when things haven't finished loading. but it doesn't crash for me) | 17:03 |
| Zara | so I'm wondering if maybe different versions of chromium might be handling something differently? | 17:03 |
| Zara | or it's a difference in connection | 17:03 |
| zaro | i'm on Version 49.0.2623.0 (64-bit) | 17:04 |
| *** rkukura has quit IRC | 17:04 | |
| *** roxanagh_ has joined #openstack-infra | 17:04 | |
| *** achanda has joined #openstack-infra | 17:04 | |
| *** Guest81062 is now known as jlvillal | 17:04 | |
| *** Sukhdev has quit IRC | 17:04 | |
| *** bpokorny has joined #openstack-infra | 17:04 | |
| Zara | ah, I am on a different version, and on debian | 17:04 |
| Zara | Version 37.0.2062.120 Built on Debian 7.6, running on Debian 7.9 (281580) (64-bit) in full... | 17:05 |
| *** bpokorny has quit IRC | 17:05 | |
| Zara | so that might be a start to working out what's going on, though that's just a guess at this point. | 17:05 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: fix integration jobs https://review.openstack.org/306545 | 17:05 |
| EmilienM | mwhahaha: ^ | 17:05 |
| EmilienM | I hope it's the last one :( | 17:06 |
| *** bpokorny has joined #openstack-infra | 17:06 | |
| mwhahaha | of course not, it's friday. i expect a lot more failure | 17:06 |
| Zara | (I normally use iceweasel so that sotk and I are each using a different browser) | 17:06 |
| EmilienM | pabelanger, AJaeger: really sorry guys. This is not my day. https://review.openstack.org/#/c/306545/ | 17:06 |
| *** esikachev has quit IRC | 17:07 | |
| AJaeger | EmilienM: indeed, the cd is not needed with the change you made ;( Not my day with reviewing your changes;( | 17:07 |
| openstackgerrit | Merged openstack-infra/project-config: Add a few more layout checks https://review.openstack.org/306194 | 17:07 |
| EmilienM | AJaeger: I guess we need a good week end :-) | 17:07 |
| *** achanda has quit IRC | 17:08 | |
| *** rkukura has joined #openstack-infra | 17:08 | |
| AJaeger | Agreed | 17:08 |
| Zara | (if it is related to the known error I mentioned, then this is the story for that: https://storyboard.openstack.org/#!/story/2000507) | 17:10 |
| *** yamamoto has quit IRC | 17:10 | |
| clarkb | jeblair: I am going to attempt to run reprepro for ceph now | 17:10 |
| zaro | Zara: no, i don't think it's that. it's something to do with the queries for the dashboard, it seems really slow | 17:11 |
| jeblair | clarkb: yays! | 17:11 |
| *** yamamoto has joined #openstack-infra | 17:11 | |
| zaro | Zara: i can see it on safari as well, the slow response but no crash | 17:11 |
| jeblair | (btw, the last npm release from yesterday morning is still running) | 17:11 |
| Zara | zaro: okay, on chrome on windows I can't reproduce the error, but it does take a while to load. (and same in chromium for me) | 17:12 |
| zaro | Zara: for me it's click on dashboard, click a link on the dashboard then click back button | 17:12 |
| *** pvaneck has joined #openstack-infra | 17:13 | |
| *** oanson has joined #openstack-infra | 17:13 | |
| clarkb | Could not find 'main/debian-installer/binary-amd64/Packages' within '/afs/.openstack.org/mirror/ceph-deb-hammer/lists/debian-ceph-hammer_trusty_Release' I think my reprepro is still configured wrongish | 17:13 |
| zaro | although it seems like that's some caching there so maybe it's really slow the first time but is faster on next occurance | 17:14 |
| clarkb | there is no debian-installer | 17:14 |
| pabelanger | EmilienM: +A | 17:14 |
| pabelanger | clarkb: yay | 17:14 |
| *** nwkarsten has joined #openstack-infra | 17:14 | |
| *** salv-orlando has joined #openstack-infra | 17:14 | |
| Zara | zaro: btw, do you have a lot of recent events listed? that has made my dashboard slower before, and is a known bug, but there could be other issues. | 17:14 |
| EmilienM | pabelanger: thanks, I also addressed your comment on https://review.openstack.org/#/c/306398/ | 17:14 |
| zaro | Zara: ahh, i didn't even notice the drop down list. it says i have ~2100 events in that list | 17:16 |
| Zara | aha... wow | 17:16 |
| Zara | it is prrrrobably triggered by that, then, though we should still handle it better | 17:16 |
| clarkb | AJaeger: that is what I get for using sed :/ | 17:17 |
| Zara | mine gets noticeably slower around the 300 mark, so I can't even imagine what 2100 looks like xD (well, I can. it looks like chrome's ugly face) | 17:17 |
| *** salv-orl_ has joined #openstack-infra | 17:17 | |
| *** pvaneck_ has joined #openstack-infra | 17:17 | |
| *** ajmiller_ has joined #openstack-infra | 17:17 | |
| Zara | https://storyboard.openstack.org/#!/story/2000518 | 17:18 |
| *** resker has joined #openstack-infra | 17:18 | |
| AJaeger | clarkb: I was wondering already ;) | 17:18 |
| *** yuanying_ has joined #openstack-infra | 17:18 | |
| AJaeger | clarkb: using sed is a good first start | 17:18 |
| *** tiswanso has joined #openstack-infra | 17:18 | |
| *** vdrok has quit IRC | 17:18 | |
| *** mat128_ has quit IRC | 17:18 | |
| *** bpokorny has quit IRC | 17:18 | |
| Zara | zaro: ^ would be good to add some details about your experience for the story I just linked for the future | 17:19 |
| *** avarner_ has joined #openstack-infra | 17:19 | |
| *** fmccrthy has quit IRC | 17:19 | |
| *** nwkarsten has quit IRC | 17:19 | |
| Zara | (I'm about to disappear from irc for the night, but hopefully deleting them should fix it, as a workaround...) | 17:19 |
| *** madorn has quit IRC | 17:20 | |
| *** skath_ has quit IRC | 17:20 | |
| pabelanger | EmilienM: will check it in a bit | 17:20 |
| *** jiggangalator has joined #openstack-infra | 17:20 | |
| *** matt-borland_ has joined #openstack-infra | 17:20 | |
| clarkb | AJaeger: new patchset pushed should be better | 17:20 |
| *** ogelbukh has quit IRC | 17:21 | |
| *** yamamoto has quit IRC | 17:21 | |
| *** BobBall is now known as BobBall-awol | 17:21 | |
| *** chem` has joined #openstack-infra | 17:21 | |
| *** che-arne has joined #openstack-infra | 17:21 | |
| SotK | heh, oops | 17:21 |
| SotK | we should probably put a limit on that events thing | 17:21 |
| *** briancli1e has joined #openstack-infra | 17:21 | |
| *** dalgaaf_ has joined #openstack-infra | 17:21 | |
| *** chem` has left #openstack-infra | 17:21 | |
| *** daemontool__ has joined #openstack-infra | 17:22 | |
| *** gordc_ has joined #openstack-infra | 17:22 | |
| *** jmccrory has quit IRC | 17:22 | |
| *** mhayden has quit IRC | 17:22 | |
| *** andreykurilin___ has joined #openstack-infra | 17:22 | |
| *** matbu_ has joined #openstack-infra | 17:22 | |
| *** pleia2 has quit IRC | 17:22 | |
| *** pblaho_ has joined #openstack-infra | 17:22 | |
| *** auggy has quit IRC | 17:23 | |
| *** mat128 has joined #openstack-infra | 17:23 | |
| *** madorn has joined #openstack-infra | 17:23 | |
| *** yonglihe_ has joined #openstack-infra | 17:23 | |
| *** monester_ has joined #openstack-infra | 17:23 | |
| *** jog0 has quit IRC | 17:23 | |
| *** boris-42 has quit IRC | 17:24 | |
| *** yamamoto has joined #openstack-infra | 17:24 | |
| *** ramishra_ has joined #openstack-infra | 17:24 | |
| *** pleia2 has joined #openstack-infra | 17:24 | |
| krotscheck | Any infra-core around available to check the status of the npm mirroring job? | 17:24 |
| krotscheck | Also, check the file system? | 17:25 |
| AJaeger | armax, dougwig, mestery : Could you review some project-config changes, please? https://review.openstack.org/#/c/299844/ https://review.openstack.org/#/c/298510/ https://review.openstack.org/#/c/303242/ https://review.openstack.org/#/c/303121/ https://review.openstack.org/#/c/258522/ | 17:25 |
| yolanda | clarkb, yes, so we had to restart gerrit and zuul this morning | 17:25 |
| yolanda | gerrit had been not responsive for a while, even was not reachable by ssh, and stats showed packet loss | 17:25 |
| dougwig | AJaeger: on it | 17:25 |
| AJaeger | thanks, dougwig | 17:25 |
| yolanda | it recovered itself, but then, it was not publishing events to zuul | 17:25 |
| *** pcm_ has joined #openstack-infra | 17:25 | |
| *** yamamoto has quit IRC | 17:25 | |
| *** andymccr_ has joined #openstack-infra | 17:26 | |
| yolanda | i restarted gerrit, but that not fixed it. I had to restart zuul, because no jobs were being processed | 17:26 |
| clarkb | yolanda: ok, sounds liek there was network trouble in rax then? | 17:26 |
| *** sdake_ has joined #openstack-infra | 17:26 | |
| AJaeger | infra puppet experts, do you want beaker running on all infra puppet repos? Please chime in on https://review.openstack.org/#/c/305416/ | 17:26 |
| yolanda | clarkb, i only saw that for gerrit at that time, other vms were fine | 17:26 |
| *** salv-orlando has quit IRC | 17:26 | |
| *** pvaneck has quit IRC | 17:26 | |
| *** permalac has quit IRC | 17:26 | |
| *** piet has quit IRC | 17:26 | |
| *** cfarquhar has quit IRC | 17:26 | |
| *** mgkwill has quit IRC | 17:26 | |
| *** hrybacki has quit IRC | 17:26 | |
| *** bryan_att has quit IRC | 17:26 | |
| *** Ng has quit IRC | 17:26 | |
| *** xgerman has quit IRC | 17:26 | |
| *** yonglihe has quit IRC | 17:26 | |
| *** andreykurilin__ has quit IRC | 17:26 | |
| *** dham1 has quit IRC | 17:26 | |
| *** serverascode has quit IRC | 17:26 | |
| *** marcusvrn_ has quit IRC | 17:26 | |
| *** dtroyer has quit IRC | 17:26 | |
| *** nt has quit IRC | 17:26 | |
| *** mnencia has quit IRC | 17:26 | |
| *** briancline has quit IRC | 17:26 | |
| *** ogelbukh has joined #openstack-infra | 17:27 | |
| yolanda | AJaeger, sorry, i was disconnected pretty much all day. Few moments after the incident with zuul was fixed, i lost internet, i had a problem with the provider, and took hours to recover the connectivity | 17:27 |
| yolanda | i hope everything was fine | 17:27 |
| *** yonglihe_ is now known as yonglihe | 17:27 | |
| *** andreykurilin___ is now known as andreykurilin__ | 17:27 | |
| *** lyz has quit IRC | 17:27 | |
| *** oanson has quit IRC | 17:27 | |
| *** rkukura has quit IRC | 17:27 | |
| *** vgridnev has quit IRC | 17:27 | |
| *** xyang1 has quit IRC | 17:27 | |
| *** sridhar_ram has quit IRC | 17:27 | |
| *** apoorvad has quit IRC | 17:27 | |
| *** gabriel-bezerra has quit IRC | 17:27 | |
| *** andymaier has quit IRC | 17:27 | |
| *** yamahata has quit IRC | 17:27 | |
| *** chuck__ has quit IRC | 17:27 | |
| *** edwarnicke has quit IRC | 17:27 | |
| *** armax has quit IRC | 17:27 | |
| *** GheRivero has quit IRC | 17:27 | |
| *** pblaho has quit IRC | 17:27 | |
| *** igorbelikov has quit IRC | 17:27 | |
| *** tpsilva has quit IRC | 17:27 | |
| *** hamzy has quit IRC | 17:27 | |
| *** eharney has quit IRC | 17:27 | |
| *** lxsli has quit IRC | 17:27 | |
| *** EmilienM has quit IRC | 17:27 | |
| *** gordc has quit IRC | 17:27 | |
| *** dhellmann has quit IRC | 17:27 | |
| *** matbu has quit IRC | 17:27 | |
| *** zhiyan has quit IRC | 17:27 | |
| *** etoews has quit IRC | 17:27 | |
| *** markmcclain has quit IRC | 17:27 | |
| *** fungi has quit IRC | 17:27 | |
| *** sambetts|afk has quit IRC | 17:27 | |
| *** msuriar has quit IRC | 17:27 | |
| *** tiswanso_ has quit IRC | 17:27 | |
| *** nelsnels_ has quit IRC | 17:27 | |
| *** daemontool_ has quit IRC | 17:27 | |
| *** esker has quit IRC | 17:27 | |
| *** notsogentle has quit IRC | 17:27 | |
| *** avarner has quit IRC | 17:27 | |
| *** [HeOS] has quit IRC | 17:27 | |
| *** sdague has quit IRC | 17:27 | |
| *** netsin has quit IRC | 17:27 | |
| *** matt-borland has quit IRC | 17:27 | |
| *** ivc_ has quit IRC | 17:27 | |
| *** Goneri has quit IRC | 17:27 | |
| *** dalgaaf has quit IRC | 17:27 | |
| *** markvoelker has quit IRC | 17:27 | |
| *** sheeprine has quit IRC | 17:27 | |
| *** pc_m has quit IRC | 17:27 | |
| *** ramishra has quit IRC | 17:27 | |
| *** alex_xu has quit IRC | 17:27 | |
| *** openstackgerrit has quit IRC | 17:27 | |
| *** andymccr has quit IRC | 17:27 | |
| *** chem has quit IRC | 17:27 | |
| *** timfreund has quit IRC | 17:27 | |
| *** zaro has quit IRC | 17:27 | |
| *** ajmiller has quit IRC | 17:27 | |
| *** yuanying has quit IRC | 17:27 | |
| *** monester has quit IRC | 17:27 | |
| *** thingee has quit IRC | 17:27 | |
| *** whoops has quit IRC | 17:27 | |
| *** trey has quit IRC | 17:27 | |
| *** trey has joined #openstack-infra | 17:28 | |
| *** monester_ is now known as monester | 17:28 | |
| *** che-arne has quit IRC | 17:29 | |
| *** EmilienM has joined #openstack-infra | 17:29 | |
| *** sdake has quit IRC | 17:29 | |
| odyssey4me | pabelanger if I want to add an experimental job for the ansible roles, do I need to modify https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ansible-role-jobs.yaml#L44-L60 ? | 17:29 |
| *** lyz has joined #openstack-infra | 17:29 | |
| AJaeger | yolanda: no further trouble here ;) | 17:29 |
| *** dalgaaf_ has quit IRC | 17:29 | |
| *** sridhar_ram has joined #openstack-infra | 17:30 | |
| AJaeger | odyssey4me: you can, you don't have to ;) | 17:30 |
| *** eliqiao_ has quit IRC | 17:30 | |
| *** mhayden has joined #openstack-infra | 17:30 | |
| pabelanger | odyssey4me: Oh, I did that already | 17:30 |
| pabelanger | I guess I didn't publish it | 17:30 |
| odyssey4me | pabelanger oh? | 17:30 |
| AJaeger | odyssey4me: that job gropu is added to each repo, if you want that, then add it there. If you only want it for none repo, then not... | 17:30 |
| *** yamamoto has joined #openstack-infra | 17:31 | |
| pabelanger | odyssey4me: Ya, let me publish it | 17:31 |
| *** e0ne has quit IRC | 17:31 | |
| odyssey4me | I'd like to switch the CentOS7 jobs for openstack-ansible role to be experimental, and add a Xenial experimental job too | 17:31 |
| *** kevinshort has quit IRC | 17:31 | |
| *** JayF has quit IRC | 17:31 | |
| *** tiswanso has quit IRC | 17:32 | |
| pabelanger | odyssey4me: I'll add the xenial bits, you can rebase atop for your openstack-ansible changes | 17:32 |
| *** andreykurilin__ has quit IRC | 17:32 | |
| *** tphummel has quit IRC | 17:32 | |
| *** sambetts has joined #openstack-infra | 17:32 | |
| *** tiswanso has joined #openstack-infra | 17:32 | |
| odyssey4me | pabelanger thanks, I would be happy to learn from your prior art :) | 17:32 |
| *** zaro has joined #openstack-infra | 17:33 | |
| *** tphummel has joined #openstack-infra | 17:33 | |
| *** [HeOS] has joined #openstack-infra | 17:34 | |
| pabelanger | odyssey4me: Ya, I thought I published it the other day | 17:34 |
| odyssey4me | pabelanger another thing I'd like to do is optionally increase the job timeout for some roles... some of them do a multi-project build and 30 mins is not enough time | 17:34 |
| pabelanger | https://review.openstack.org/306557 | 17:34 |
| *** edwarnicke has joined #openstack-infra | 17:34 | |
| *** eliqiao has joined #openstack-infra | 17:34 | |
| *** david-lyle has quit IRC | 17:34 | |
| *** david-lyle has joined #openstack-infra | 17:34 | |
| pabelanger | odyssey4me: would need a little rework, but you could do it per project | 17:35 |
| odyssey4me | pabelanger ah, so I thought that https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ansible-role-jobs.yaml#L60 forced the job to be a gate job, but I guess that just sets a default? | 17:35 |
| *** apoorvad has joined #openstack-infra | 17:35 | |
| *** markvoelker has joined #openstack-infra | 17:35 | |
| odyssey4me | *gate queue job | 17:35 |
| *** lxsli has joined #openstack-infra | 17:35 | |
| AJaeger | clarkb: you're updating 4644 jobs with your small change! A new record ;) | 17:36 |
| *** jog0 has joined #openstack-infra | 17:36 | |
| clarkb | AJaeger: nice | 17:36 |
| *** etoews has joined #openstack-infra | 17:36 | |
| pabelanger | odyssey4me: not, doesn't force it. Just a naming convention... you'd actually update zuul/layout.yaml to pick which pipeline to use | 17:36 |
| AJaeger | odyssey4me: that line is just a "name". zuul/layout.yaml defines when to trigger a job | 17:36 |
| pabelanger | odyssey4me: https://review.openstack.org/#/c/306557/1/zuul/layout.yaml line 273 is the pipeline it will use | 17:37 |
| *** chuck__ has joined #openstack-infra | 17:37 | |
| *** jmccrory has joined #openstack-infra | 17:37 | |
| AJaeger | clarkb: change looks fine now | 17:37 |
| *** _amrith_ is now known as amrith | 17:37 | |
| pabelanger | odyssey4me: IIRC, at one time we had some regex magic to match gate / experimental in the job name, but that was removed | 17:37 |
| odyssey4me | pabelanger that makes sense :) thanks for the explanation | 17:37 |
| *** infra-red has joined #openstack-infra | 17:37 | |
| *** yarkot has joined #openstack-infra | 17:37 | |
| odyssey4me | and experimental jobs are never voting? | 17:38 |
| *** kevinshort has joined #openstack-infra | 17:38 | |
| *** bpokorny has joined #openstack-infra | 17:38 | |
| pabelanger | odyssey4me: they can be both, but have no affect on the patchset | 17:38 |
| *** sdake_ has quit IRC | 17:38 | |
| *** cfarquhar has joined #openstack-infra | 17:39 | |
| *** cfarquhar has quit IRC | 17:39 | |
| *** cfarquhar has joined #openstack-infra | 17:39 | |
| odyssey4me | ok, so they don't prevent a merge | 17:39 |
| docaedo | clarkb: is it OK if I +1 those changes? Could really use the stackalytics bump ;) | 17:39 |
| odyssey4me | cool, so if I do a patch set based on your review we should be good to go then | 17:39 |
| clarkb | pabelanger: jeblair https://review.openstack.org/306559 with that in reprepro does its thing | 17:39 |
| clarkb | docaedo: well its one small change it just explodes out to a ton of updates :) | 17:39 |
| docaedo | clarkb: oh duh, sorry that's not 4644 PRs... | 17:39 |
| pabelanger | odyssey4me: right, so look into zuul/layout.yaml at the top is our pipeline settings. You can see it does not have success or failure fields | 17:39 |
| docaedo | haha | 17:39 |
| jlvillal | The openstackgerrit bot appears to be down. Not sure if already noticed. | 17:39 |
| *** auggy has joined #openstack-infra | 17:40 | |
| pabelanger | odyssey4me: so, yes, you are right. Then never vote on a patch, but return results to be displayed | 17:40 |
| odyssey4me | cool, okie dokey | 17:40 |
| jeblair | clarkb: what' a udeb component? | 17:40 |
| pabelanger | clarkb: ack | 17:40 |
| odyssey4me | lemme get that in, then move on to the next action | 17:40 |
| *** daemontool__ has quit IRC | 17:40 | |
| jeblair | i'll kick gerritbot | 17:41 |
| clarkb | jeblair: https://wiki.debian.org/udeb apparently it is a minimal thing that is used for the debian installer | 17:41 |
| *** alex_xu has joined #openstack-infra | 17:41 | |
| *** mnencia has joined #openstack-infra | 17:41 | |
| jeblair | okies. | 17:41 |
| clarkb | jeblair: so the errors saying no main/debian-installer found was due to having enabled udeb component main | 17:41 |
| *** rkukura has joined #openstack-infra | 17:42 | |
| *** nwkarsten has joined #openstack-infra | 17:42 | |
| *** mriedem_lunch has quit IRC | 17:42 | |
| jeblair | hrm, gerritbot still doesn't seem to be connecting. | 17:43 |
| *** sdake has joined #openstack-infra | 17:43 | |
| *** vgridnev has joined #openstack-infra | 17:43 | |
| *** dham1 has joined #openstack-infra | 17:43 | |
| *** claudiub has quit IRC | 17:43 | |
| *** eliqiao has quit IRC | 17:44 | |
| *** dhellmann has joined #openstack-infra | 17:44 | |
| *** JayF has joined #openstack-infra | 17:45 | |
| *** dalgaaf_ has joined #openstack-infra | 17:45 | |
| *** GheRivero has joined #openstack-infra | 17:45 | |
| clarkb | vos release mirror.deb-hammer -localauth is happening | 17:45 |
| clarkb | the reprepro side was actually really quick | 17:45 |
| *** Goneri has joined #openstack-infra | 17:45 | |
| jeblair | hrm. gerritbot is connecting over ipv6, there is only one ipv6 addr in rotation right now, and it's not answering. | 17:46 |
| *** eharney has joined #openstack-infra | 17:46 | |
| *** mgkwill has joined #openstack-infra | 17:46 | |
| *** MarkAtwood has joined #openstack-infra | 17:46 | |
| *** yamahata has joined #openstack-infra | 17:46 | |
| *** fmccrthy has joined #openstack-infra | 17:46 | |
| *** dhellmann_ has joined #openstack-infra | 17:46 | |
| clarkb | it occurs ot me that we could add some glue magic to meetbot and other bots that do a name lookup, remove AAAA records because supybot, then do a connectivity test to A records until one resonds then feed that to the actual bot code | 17:47 |
| clarkb | probably more trouble than it is worth | 17:47 |
| *** dhellmann_ has quit IRC | 17:47 | |
| jeblair | i pinned it | 17:48 |
| clarkb | wfm | 17:48 |
| *** mriedem has joined #openstack-infra | 17:48 | |
| *** openstackgerrit has joined #openstack-infra | 17:48 | |
| *** gsilvis_ is now known as gsilvis | 17:48 | |
| *** nelsnelson has joined #openstack-infra | 17:48 | |
| *** sdague has joined #openstack-infra | 17:49 | |
| *** igorbelikov has joined #openstack-infra | 17:49 | |
| *** dhellmann has quit IRC | 17:50 | |
| *** trown|lunch is now known as trown | 17:50 | |
| *** oanson has joined #openstack-infra | 17:50 | |
| *** hamzy has joined #openstack-infra | 17:50 | |
| *** armax has joined #openstack-infra | 17:50 | |
| *** Sukhdev has joined #openstack-infra | 17:51 | |
| *** yarkot1 has joined #openstack-infra | 17:51 | |
| *** jistr has quit IRC | 17:51 | |
| *** shardy has quit IRC | 17:51 | |
| *** serverascode has joined #openstack-infra | 17:52 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add experimental ubuntu-xenial jobs for OpenStack-Ansible roles https://review.openstack.org/306564 | 17:52 |
| *** degorenko is now known as degorenko|afk | 17:52 | |
| *** psanchez has quit IRC | 17:53 | |
| *** tosky has quit IRC | 17:53 | |
| odyssey4me | pabelanger ^ does it make sense to do it that way? I thought it best to make the job -nv so that when we graduate it it can be done in seperate stages | 17:53 |
| *** imcsk8_ has joined #openstack-infra | 17:53 | |
| *** monester has quit IRC | 17:53 | |
| *** Kiall has quit IRC | 17:53 | |
| *** eliqiao has joined #openstack-infra | 17:54 | |
| *** boris-42 has joined #openstack-infra | 17:54 | |
| *** Kiall has joined #openstack-infra | 17:54 | |
| *** psanchez has joined #openstack-infra | 17:54 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable gate-networking-midonet-v2-rally-dsvm-nv for liberty https://review.openstack.org/298510 | 17:54 |
| *** igorbelikov has quit IRC | 17:54 | |
| *** GheRivero has quit IRC | 17:54 | |
| *** imcsk8 has quit IRC | 17:54 | |
| *** sheeprine has joined #openstack-infra | 17:54 | |
| *** yamamoto has quit IRC | 17:54 | |
| *** dhellmann has joined #openstack-infra | 17:55 | |
| *** dtroyer has joined #openstack-infra | 17:55 | |
| *** dham1 has quit IRC | 17:55 | |
| *** EricGonc_ has quit IRC | 17:55 | |
| *** yonglihe has quit IRC | 17:55 | |
| *** hrybacki has joined #openstack-infra | 17:56 | |
| *** GheRivero has joined #openstack-infra | 17:56 | |
| *** markmcclain has joined #openstack-infra | 17:56 | |
| *** dhellmann has quit IRC | 17:57 | |
| *** raginbajin has quit IRC | 17:57 | |
| *** monester has joined #openstack-infra | 17:57 | |
| *** mylu has joined #openstack-infra | 17:57 | |
| *** tpsilva has joined #openstack-infra | 17:57 | |
| *** dhellmann has joined #openstack-infra | 17:57 | |
| *** igorbelikov has joined #openstack-infra | 17:58 | |
| *** dham1 has joined #openstack-infra | 17:58 | |
| *** vdrok has joined #openstack-infra | 17:59 | |
| *** Ng has joined #openstack-infra | 17:59 | |
| *** mrmartin has joined #openstack-infra | 17:59 | |
| *** zhiyan has joined #openstack-infra | 17:59 | |
| *** xgerman has joined #openstack-infra | 17:59 | |
| *** sridhar_ram has quit IRC | 17:59 | |
| openstackgerrit | Merged openstack-infra/project-config: networking-midonet: Move coverage job from post to check https://review.openstack.org/303242 | 17:59 |
| *** marcusvrn_ has joined #openstack-infra | 17:59 | |
| *** andreykurilin__ has joined #openstack-infra | 17:59 | |
| *** vgridnev has quit IRC | 17:59 | |
| *** yonglihe has joined #openstack-infra | 18:00 | |
| *** EricGonczer_ has joined #openstack-infra | 18:00 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove VENV before pushing to Zanata https://review.openstack.org/306569 | 18:01 |
| *** bryan_att_ has joined #openstack-infra | 18:01 | |
| *** sridhar_ram has joined #openstack-infra | 18:01 | |
| *** esikachev has joined #openstack-infra | 18:02 | |
| *** raginbajin has joined #openstack-infra | 18:02 | |
| *** yamamoto has joined #openstack-infra | 18:02 | |
| AJaeger | project-config cores, one more fix needed for translation sync ^ - please review | 18:02 |
| AJaeger | pleia2: thanks! | 18:03 |
| openstackgerrit | Merged openstack-infra/system-config: Don't mirror udeb on ceph debian mirror https://review.openstack.org/306559 | 18:04 |
| *** bryan_att_ is now known as bryan_att | 18:04 | |
| pleia2 | sure | 18:04 |
| *** sputnik13 has joined #openstack-infra | 18:04 | |
| *** alex_xu has quit IRC | 18:04 | |
| *** msuriar has joined #openstack-infra | 18:05 | |
| *** gabriel-bezerra has joined #openstack-infra | 18:05 | |
| *** gyee has joined #openstack-infra | 18:05 | |
| *** skath_ has joined #openstack-infra | 18:06 | |
| openstackgerrit | Merged openstack-infra/shade: Use configured overrides for internal/external https://review.openstack.org/306190 | 18:06 |
| *** alex_xu has joined #openstack-infra | 18:07 | |
| *** fungi has joined #openstack-infra | 18:07 | |
| *** whoops has joined #openstack-infra | 18:07 | |
| *** esikachev has quit IRC | 18:08 | |
| *** Goneri has quit IRC | 18:09 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Implement higher job timeout for Ansible role jobs https://review.openstack.org/306573 | 18:09 |
| *** degorenko|afk is now known as degorenko | 18:10 | |
| *** mylu has quit IRC | 18:10 | |
| *** eliqiao has quit IRC | 18:10 | |
| *** EricGonc_ has joined #openstack-infra | 18:11 | |
| *** eliqiao has joined #openstack-infra | 18:11 | |
| AJaeger | thanks, anteaya ! | 18:12 |
| anteaya | welcome | 18:12 |
| * AJaeger hopes thats the final bit to get everything working... | 18:12 | |
| * anteaya is glad AJaeger is chasing all the bits and also hopes this is the final bit | 18:12 | |
| *** dahoo has joined #openstack-infra | 18:13 | |
| *** EricGonc_ has quit IRC | 18:13 | |
| *** EricGonczer_ has quit IRC | 18:14 | |
| *** robcresswell has quit IRC | 18:14 | |
| *** robcresswell has joined #openstack-infra | 18:15 | |
| *** boden has joined #openstack-infra | 18:15 | |
| *** yamamoto has quit IRC | 18:16 | |
| *** hrubi has quit IRC | 18:17 | |
| *** EricGonczer_ has joined #openstack-infra | 18:17 | |
| openstackgerrit | Stephen Gordon proposed openstack-infra/irc-meetings: Remove Telco Working Group meeting https://review.openstack.org/306577 | 18:17 |
| boden | anybody hear of issues with gate-devstack-docs job? In the last 2 builds I'm seeing ERROR: unknown environment 'venv' | 18:17 |
| openstackgerrit | Merged openstack-infra/project-config: Remove VENV before pushing to Zanata https://review.openstack.org/306569 | 18:17 |
| *** hrubi has joined #openstack-infra | 18:18 | |
| *** e0ne has joined #openstack-infra | 18:19 | |
| *** mylu has joined #openstack-infra | 18:20 | |
| *** yamamoto has joined #openstack-infra | 18:20 | |
| *** asettle has joined #openstack-infra | 18:23 | |
| *** mrmartin has quit IRC | 18:23 | |
| *** pfalleno2 has quit IRC | 18:24 | |
| *** lezbar__ has quit IRC | 18:24 | |
| *** mrmartin has joined #openstack-infra | 18:24 | |
| *** pfallenop has joined #openstack-infra | 18:25 | |
| *** pfallenop has joined #openstack-infra | 18:25 | |
| *** yamahata has quit IRC | 18:25 | |
| *** degorenko is now known as _degorenko|afk | 18:26 | |
| *** tqtran has joined #openstack-infra | 18:27 | |
| *** asettle has quit IRC | 18:27 | |
| anteaya | boden: linking to the full logs with the failure usually gets better results than just pasting the error into channel | 18:31 |
| openstackgerrit | Doug Wiegley proposed openstack/requirements: Bump neutron-lib to 0.1.0 https://review.openstack.org/306586 | 18:32 |
| openstackgerrit | Nate Marsella proposed openstack-infra/elastic-recheck: Make the index format string configurable in the conf file. This allows query to work against indices not named the typical "logstash-%Y.%m.%d". https://review.openstack.org/306360 | 18:32 |
| boden | anteaya thanks... I opened a bug for this one https://bugs.launchpad.net/devstack/+bug/1571024 so will just keep an eye on it | 18:34 |
| openstack | Launchpad bug 1571024 in devstack "gate-devstack-docs failing with ERROR: unknown environment 'venv'" [Undecided,New] | 18:34 |
| openstackgerrit | Merged openstack-infra/project-config: Stop uploading to job logs to swift https://review.openstack.org/306537 | 18:35 |
| *** thingee has joined #openstack-infra | 18:35 | |
| *** vgridnev has joined #openstack-infra | 18:36 | |
| anteaya | boden: looks like the problem starts up here: http://logs.openstack.org/41/306541/1/check/gate-devstack-docs/a5247d7/console.html#_2016-04-15_17_00_58_190 | 18:36 |
| anteaya | ianw: didn't you have a patch changing devstack-docs jobs? | 18:36 |
| anteaya | ianw: there is currently an error with devstack-docs jobs | 18:37 |
| *** Sukhdev has quit IRC | 18:37 | |
| *** mylu has quit IRC | 18:37 | |
| anteaya | there it is: https://review.openstack.org/#/c/306197/ | 18:38 |
| anteaya | boden: when did you first notice the error? | 18:38 |
| *** mylu has joined #openstack-infra | 18:39 | |
| boden | anteaya I didn't dig too deep... just noticed it on the top 2 devstack reviews that have V of -1 appears within the last few hours | 18:41 |
| anteaya | boden: okay thanks | 18:42 |
| *** tiswanso has quit IRC | 18:43 | |
| *** timfreund has joined #openstack-infra | 18:46 | |
| *** EricGonczer_ has quit IRC | 18:48 | |
| * AJaeger is happy - horizon translation sync worked finally! | 18:48 | |
| * AJaeger calls it weekend now | 18:48 | |
| mordred | AJaeger: woot! | 18:48 |
| mordred | AJaeger: happy weekend | 18:48 |
| *** sdake_ has joined #openstack-infra | 18:49 | |
| * AJaeger waves good-bye and wishes everybody a happy weekend! | 18:49 | |
| AJaeger | thanks, mordred ! | 18:49 |
| *** Goneri has joined #openstack-infra | 18:50 | |
| *** imcsk8_ is now known as imcsk8 | 18:50 | |
| anteaya | the gate-devstack-docs job appears to now be at 100% failure: http://tinyurl.com/jqj8lp7 | 18:50 |
| anteaya | AJaeger: congratulations | 18:51 |
| openstackgerrit | Merged openstack-infra/system-config: Remove HP Cloud from clouds.yaml https://review.openstack.org/306396 | 18:51 |
| openstackgerrit | Anita Kuno proposed openstack-infra/project-config: Revert "Convert devstack docs jobs to regular format" https://review.openstack.org/306589 | 18:52 |
| *** sdake has quit IRC | 18:52 | |
| openstackgerrit | Merged openstack-infra/system-config: Add network entries to clouds.yaml for internap https://review.openstack.org/306407 | 18:52 |
| openstackgerrit | Merged openstack-infra/system-config: Use floating_ip_source for tripleo cloud https://review.openstack.org/306408 | 18:52 |
| AJaeger | anteaya: regarding 306589 - the repo misses a venv environment... | 18:53 |
| AJaeger | this is the error http://logs.openstack.org/41/306541/1/check/gate-devstack-docs/a5247d7/console.html#_2016-04-15_17_01_01_626 | 18:53 |
| AJaeger | let me fix it quickly... | 18:53 |
| anteaya | AJaeger: okay great | 18:53 |
| *** mrmartin has quit IRC | 18:54 | |
| AJaeger | anteaya: https://review.openstack.org/306592 | 18:55 |
| AJaeger | your call what to push through, anteaya ! | 18:55 |
| AJaeger | Enjoy the weekend! | 18:55 |
| *** Goneri has quit IRC | 18:56 | |
| *** esikachev has joined #openstack-infra | 18:56 | |
| mordred | sdague: ^^ if you have a sec | 18:56 |
| *** nwkarsten has quit IRC | 18:56 | |
| anteaya | AJaeger: thanks you too | 18:56 |
| anteaya | AJaeger: thanks for the fix | 18:56 |
| *** dprince has quit IRC | 18:57 | |
| openstackgerrit | Merged openstack-infra/system-config: Also set the network info for internap ci account https://review.openstack.org/306415 | 18:57 |
| *** yamamoto has quit IRC | 18:57 | |
| openstackgerrit | Merged openstack-infra/system-config: Normalize list indentation in clouds.yaml https://review.openstack.org/306554 | 18:57 |
| *** esikachev has quit IRC | 19:01 | |
| *** slogan has joined #openstack-infra | 19:02 | |
| *** yamahata has joined #openstack-infra | 19:02 | |
| *** dolphm has quit IRC | 19:03 | |
| *** esikachev has joined #openstack-infra | 19:03 | |
| *** dolphm has joined #openstack-infra | 19:03 | |
| sdague | AJaeger: can someone explain what happened here that that was needed? | 19:04 |
| *** nwkarsten has joined #openstack-infra | 19:05 | |
| *** nwkarsten has quit IRC | 19:05 | |
| anteaya | sdague: this patch merged: https://review.openstack.org/#/c/306197/ | 19:05 |
| anteaya | the jobs now fail 100% http://tinyurl.com/jqj8lp7 | 19:05 |
| *** nwkarsten has joined #openstack-infra | 19:05 | |
| anteaya | sdague: I offered a revert, AJaeger offered the devstack patch | 19:05 |
| *** nwkarsten has quit IRC | 19:05 | |
| anteaya | sdague: take your pick | 19:05 |
| clarkb | note that the revert will continue to publish broken docs | 19:06 |
| *** nwkarsten has joined #openstack-infra | 19:06 | |
| *** nwkarsten has quit IRC | 19:06 | |
| anteaya | clarkb: docs were broken prior to 306197? | 19:06 |
| *** nwkarsten has joined #openstack-infra | 19:06 | |
| *** nwkarsten has quit IRC | 19:07 | |
| anteaya | for devstack? | 19:07 |
| clarkb | anteaya: yes, one of the pages isn't generated properly | 19:07 |
| *** Sukhdev has joined #openstack-infra | 19:07 | |
| clarkb | te one where the script is walked through | 19:07 |
| sdague | ok, I guess we should probably document somewhere that "venv" is required for docs jobs. I guess I thought a docs target was good enough. | 19:07 |
| anteaya | shame the commit message for 306197 didn't say that | 19:07 |
| clarkb | sdague: we do in the project testing interface docs | 19:07 |
| sdague | fast merging it, but grenade might also need it | 19:07 |
| *** nwkarsten has joined #openstack-infra | 19:07 | |
| sdague | clarkb: where? | 19:08 |
| sdague | http://governance.openstack.org/reference/cti/python_cti.html doesn't list it | 19:08 |
| sdague | oh, I guess it does | 19:08 |
| sdague | huh, why isn't it tox -e docs | 19:08 |
| *** nwkarste_ has joined #openstack-infra | 19:08 | |
| *** chuck__ is now known as zul | 19:08 | |
| clarkb | sdague: https://wiki.openstack.org/wiki/Obsolete:ProjectTestingInterface | 19:09 |
| clarkb | oh it moved to governance, ya my url says "obsolete" | 19:09 |
| *** lennyb has quit IRC | 19:09 | |
| *** nwkarst__ has joined #openstack-infra | 19:09 | |
| clarkb | sdague: because people were abusing tox -e docs to make sphinx not work properly | 19:09 |
| *** nwkarst__ has quit IRC | 19:09 | |
| clarkb | sdague: the idea is that your docs should just build without magic | 19:09 |
| clarkb | (also we started with venv and people gave us good reasons not to switch :) ) | 19:09 |
| *** sdake_ has quit IRC | 19:10 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Partially Revert "Pass extended network information in to occ/shade" https://review.openstack.org/306594 | 19:10 |
| sdague | ok, that's fine. | 19:10 |
| *** nwkarst__ has joined #openstack-infra | 19:11 | |
| sdague | except I'm pretty sure that's not going to work | 19:11 |
| sdague | because devstack doesn't have a requirements.txt | 19:11 |
| AJaeger | sdague: I needed to update https://review.openstack.org/#/c/306592/ | 19:11 |
| AJaeger | sdague: it passed the docs job now... | 19:11 |
| *** sdake has joined #openstack-infra | 19:12 | |
| *** nwkarsten has quit IRC | 19:12 | |
| sdague | ok | 19:12 |
| sdague | yeh, I see the new one has deps | 19:12 |
| AJaeger | yep | 19:12 |
| *** nwkarsten has joined #openstack-infra | 19:12 | |
| AJaeger | https://jenkins06.openstack.org/job/gate-devstack-docs/1/console | 19:12 |
| AJaeger | for passing job | 19:12 |
| *** nwkarsten has quit IRC | 19:12 | |
| * AJaeger says again good-bye ;) | 19:13 | |
| *** nwkarsten has joined #openstack-infra | 19:13 | |
| sdague | AJaeger: but... doesn't this just lose half our docs | 19:13 |
| *** melwitt has quit IRC | 19:13 | |
| *** nwkarste_ has quit IRC | 19:13 | |
| sdague | devstack docs aren't all sphinx | 19:13 |
| *** oanson has quit IRC | 19:13 | |
| sdague | tools/build_docs.sh does real things | 19:14 |
| *** binbincong has quit IRC | 19:14 | |
| *** nwkarste_ has joined #openstack-infra | 19:14 | |
| *** nwkarste_ has quit IRC | 19:14 | |
| *** uberjay has quit IRC | 19:14 | |
| *** nwkarste_ has joined #openstack-infra | 19:15 | |
| *** mylu has quit IRC | 19:15 | |
| *** nwkarste_ has quit IRC | 19:15 | |
| *** keedya has joined #openstack-infra | 19:15 | |
| *** melwitt has joined #openstack-infra | 19:15 | |
| *** dalgaaf_ is now known as dalgaaf | 19:15 | |
| *** nwkarst__ has quit IRC | 19:16 | |
| *** uberjay has joined #openstack-infra | 19:16 | |
| *** nadya has joined #openstack-infra | 19:17 | |
| *** nwkarste_ has joined #openstack-infra | 19:17 | |
| *** nwkarsten has quit IRC | 19:17 | |
| *** asettle has joined #openstack-infra | 19:18 | |
| *** avarner__ has joined #openstack-infra | 19:18 | |
| *** borland__ has joined #openstack-infra | 19:18 | |
| *** pvaneck__ has joined #openstack-infra | 19:18 | |
| *** sputnik13_ has joined #openstack-infra | 19:18 | |
| *** roxanag__ has joined #openstack-infra | 19:19 | |
| *** ajmiller__ has joined #openstack-infra | 19:19 | |
| *** netsin has joined #openstack-infra | 19:19 | |
| *** markvoelker_ has joined #openstack-infra | 19:19 | |
| *** boden_ has joined #openstack-infra | 19:19 | |
| *** eharney has quit IRC | 19:19 | |
| *** nadya_ has joined #openstack-infra | 19:19 | |
| *** nwkarsten has joined #openstack-infra | 19:20 | |
| *** armax_ has joined #openstack-infra | 19:20 | |
| *** esker has joined #openstack-infra | 19:20 | |
| *** apoorvad_ has joined #openstack-infra | 19:20 | |
| *** salv-orlando has joined #openstack-infra | 19:20 | |
| *** nwkarste_ has quit IRC | 19:21 | |
| *** nwkarsten has quit IRC | 19:21 | |
| HenryG | Hi, I need some help figuring out a strange job logging anomaly. How so I copy a logstash so I can show the issue? | 19:21 |
| *** pblaho has joined #openstack-infra | 19:21 | |
| *** sheeprine_ has joined #openstack-infra | 19:22 | |
| *** kinrui has joined #openstack-infra | 19:22 | |
| *** asettle has quit IRC | 19:22 | |
| *** serverascode_ has joined #openstack-infra | 19:22 | |
| *** matbu has joined #openstack-infra | 19:22 | |
| *** Ng has quit IRC | 19:22 | |
| *** sheeprine has quit IRC | 19:22 | |
| *** serverascode has quit IRC | 19:22 | |
| *** e0ne has quit IRC | 19:22 | |
| *** fungi has quit IRC | 19:22 | |
| *** rkukura has quit IRC | 19:22 | |
| *** yarkot has quit IRC | 19:22 | |
| *** boden has quit IRC | 19:22 | |
| *** [HeOS] has quit IRC | 19:22 | |
| *** pblaho_ has quit IRC | 19:22 | |
| *** zynzel_ has quit IRC | 19:22 | |
| *** nadya has quit IRC | 19:22 | |
| *** armax has quit IRC | 19:22 | |
| *** sdague has quit IRC | 19:22 | |
| *** MarkAtwood has quit IRC | 19:22 | |
| *** mgkwill has quit IRC | 19:22 | |
| *** matbu_ has quit IRC | 19:22 | |
| *** jiggangalator has quit IRC | 19:22 | |
| *** avarner_ has quit IRC | 19:22 | |
| *** ajmiller_ has quit IRC | 19:22 | |
| *** salv-orl_ has quit IRC | 19:22 | |
| *** pvaneck_ has quit IRC | 19:22 | |
| *** roxanagh_ has quit IRC | 19:22 | |
| *** armax_ is now known as armax | 19:22 | |
| *** sputnik13 has quit IRC | 19:22 | |
| *** zul has quit IRC | 19:22 | |
| *** markvoelker has quit IRC | 19:22 | |
| *** apoorvad has quit IRC | 19:22 | |
| *** matt-borland_ has quit IRC | 19:22 | |
| *** resker has quit IRC | 19:22 | |
| *** MarkAtwood1 has joined #openstack-infra | 19:22 | |
| *** boden_ is now known as boden | 19:22 | |
| *** HeOS has joined #openstack-infra | 19:23 | |
| *** nwkarsten has joined #openstack-infra | 19:23 | |
| *** sdague has joined #openstack-infra | 19:23 | |
| *** Ng has joined #openstack-infra | 19:23 | |
| *** nwkarsten has quit IRC | 19:23 | |
| *** serverascode_ is now known as serverascode | 19:23 | |
| mordred | infra-root, Shrews: it seems that shade-nodepool is working | 19:23 |
| *** e0ne has joined #openstack-infra | 19:24 | |
| *** nwkarsten has joined #openstack-infra | 19:24 | |
| *** piet has joined #openstack-infra | 19:24 | |
| *** binbincong has joined #openstack-infra | 19:24 | |
| *** jpmaxman has quit IRC | 19:25 | |
| *** rguillebert has quit IRC | 19:25 | |
| *** lindsayk_ has quit IRC | 19:25 | |
| Shrews | mordred: \o/ | 19:25 |
| *** gordc_ has quit IRC | 19:25 | |
| rcarrillocruz | sweet | 19:25 |
| rcarrillocruz | so no need to revert | 19:25 |
| *** sridhar_ram has quit IRC | 19:25 | |
| rcarrillocruz | ? | 19:25 |
| *** zynzel has joined #openstack-infra | 19:26 | |
| *** rkukura has joined #openstack-infra | 19:26 | |
| pabelanger | mordred: congrats! | 19:26 |
| pleia2 | mordred: \o/ | 19:26 |
| pleia2 | pabelanger: have a few minutes to chat presentation? April got away from me | 19:27 |
| *** ihrachys has joined #openstack-infra | 19:27 | |
| pabelanger | pleia2: For sure | 19:27 |
| *** zul has joined #openstack-infra | 19:27 | |
| *** sridhar_ram has joined #openstack-infra | 19:28 | |
| *** lindsayk_ has joined #openstack-infra | 19:28 | |
| HenryG | How do I include a timespan in a logstash URL? | 19:28 |
| pabelanger | odyssey4me: just looking now | 19:28 |
| *** mgkwill has joined #openstack-infra | 19:28 | |
| pabelanger | odyssey4me: yup, that works too. | 19:29 |
| pleia2 | pabelanger: so I'm mostly wondering if we just want to use a refreshed version of http://docs.openstack.org/infra/publications/overview/#(1) or do something different (maybe people are bored of that slide deck? do we want to include different things?) | 19:29 |
| odyssey4me | pabelanger awesome :) | 19:29 |
| mtreinish | HenryG: I don't think there isn't a mechanism to do that | 19:29 |
| *** jpmaxman has joined #openstack-infra | 19:29 | |
| *** rguillebert has joined #openstack-infra | 19:29 | |
| mtreinish | HenryG: the shareable urls are something clarkb had to hack into the kibana js because it normally requires write access to elasticsearch | 19:30 |
| pabelanger | pleia2: either works for me. I personally think that is a great presentation, so if we refresh it, it can always be the go to presentation about openstack-infra | 19:31 |
| *** e0ne has quit IRC | 19:31 | |
| *** esikachev has quit IRC | 19:32 | |
| *** salv-orl_ has joined #openstack-infra | 19:33 | |
| *** salv-orl_ has quit IRC | 19:33 | |
| *** salv-orl_ has joined #openstack-infra | 19:34 | |
| AJaeger | sdague: see https://review.openstack.org/#/c/303115/ | 19:35 |
| *** mhayden has quit IRC | 19:35 | |
| *** Sukhdev has quit IRC | 19:36 | |
| *** madhu_ak has joined #openstack-infra | 19:36 | |
| *** salv-orlando has quit IRC | 19:36 | |
| *** sheeprine_ has quit IRC | 19:36 | |
| *** lakshmiS has quit IRC | 19:36 | |
| sdague | AJaeger: ok, apparently I didn't have that commit yet | 19:37 |
| *** mhayden has joined #openstack-infra | 19:37 | |
| *** esikachev has joined #openstack-infra | 19:37 | |
| *** sheeprine has joined #openstack-infra | 19:37 | |
| *** flwang1 has joined #openstack-infra | 19:38 | |
| HenryG | mtreinish: thanks | 19:38 |
| *** salv-orl_ has quit IRC | 19:39 | |
| sdake | pabelanger ping re kolla base images | 19:39 |
| pabelanger | clarkb: guess we need to update apache config for ceph-deb-hammer? | 19:40 |
| pabelanger | sdake: how did the release go? | 19:40 |
| *** nadya_ has quit IRC | 19:40 | |
| clarkb | pabelanger: yes | 19:40 |
| clarkb | pabelanger: symlink to docroot looks like | 19:40 |
| sdake | pabelanger we are tagging rc4 shortly | 19:40 |
| pabelanger | clarkb: neat, so just looked in /afs and I see ceph :) | 19:40 |
| sdake | we are left with this: https://launchpad.net/kolla/+milestone/2.0.0 | 19:41 |
| sdake | pabelanger i created a bug for your tox changes here: https://bugs.launchpad.net/kolla/+bug/1569004 | 19:41 |
| openstack | Launchpad bug 1569004 in kolla mitaka "migrate to disk image builder images in the gates" [Critical,Confirmed] | 19:41 |
| pabelanger | sdake: okay, when do you think you'll do your 2.0.0 tag? | 19:41 |
| sdake | the date is listed, 21st hard hard deadline | 19:42 |
| sdake | whether bugs are fixed or not - we are tagging 2.0.0 | 19:42 |
| sdake | rc4 is in reallly good shape as is | 19:42 |
| sdake | but i want more testing time in the community | 19:42 |
| *** achanda has joined #openstack-infra | 19:42 | |
| pabelanger | ok | 19:42 |
| sdake | a coupel foolks say9ing it looks good isnt sufficient for a releae tag imo ;) | 19:42 |
| sdake | we fixed a slew of things in rc4 - about 40 bugs | 19:42 |
| openstackgerrit | Merged openstack-infra/project-config: run-wheel.sh: only run wheel for Python projects https://review.openstack.org/306398 | 19:43 |
| sdake | pabelanger the reson we require bugss for gate changes is so we can track them in the backport process in launchpad | 19:43 |
| sdake | we obviously wnt our gate to work the same across releases if possible | 19:44 |
| odyssey4me | pabelanger any thoughts on https://review.openstack.org/306573 ? if there's an alternative that you think would be better, then I'd appreciate your pointers | 19:44 |
| pabelanger | sdake: okay, anything you can do to hit the 21st helps. kolla is the last project on devstack-centos7, and think we've fixed all issue on centos-7 images now | 19:45 |
| *** baoli has quit IRC | 19:45 | |
| *** nwkarsten has quit IRC | 19:46 | |
| sdake | pabelanger we are hitting the 21st even if there are bugs | 19:46 |
| sdake | as i said rc4 is in really good shape | 19:46 |
| pabelanger | odyssey4me: sure, that will work. And should be fine to bump all jobs to use 60 timeout. Another option would be to template {timeout} and only up projects that need it. But, 60 is a sane default IMO | 19:46 |
| sdake | if bugs remain they will go into a z stream release | 19:46 |
| pabelanger | sdake: understood, we can slip a little now since we had to rebuild nodepool.o.o last week, which fixed out HDD issue for DIBs. So infra is not under pressure any more, except to just close out the task once kolla migrates. If you tag on the 21, we'll be in good shape to migrate you before the summit and turn off devstack-centos7 | 19:48 |
| pabelanger | then, remove it after (during) the summit | 19:48 |
| sdake | wfm | 19:49 |
| sdake | the reason we chose the 21st is this change: | 19:49 |
| pabelanger | then, switch to ubuntu-xenial upgrades and fedora-24 | 19:49 |
| sdake | https://review.openstack.org/#/c/300752/ | 19:50 |
| *** piet has quit IRC | 19:50 | |
| *** dulek has quit IRC | 19:50 | |
| sdake | 21 is 7th + 2 weeks | 19:51 |
| *** dulek has joined #openstack-infra | 19:52 | |
| *** ericksonsantos has quit IRC | 19:52 | |
| HenryG | mtreinish: The query is: build_name:"gate-tempest-dsvm-neutron-pg-full" AND build_status:"FAILURE" | 19:53 |
| HenryG | mtreinish: and the time range is: Apr 15, 2016 14:32:06 to Apr 15, 2016 14:32:14 | 19:54 |
| pleia2 | pabelanger: ok, I'll carve out some time on Monday to update the deck | 19:54 |
| pabelanger | clarkb: any issue if I get the patch up to fix apache ceph? | 19:54 |
| clarkb | pabelanger: no | 19:55 |
| *** rguillebert has quit IRC | 19:55 | |
| pabelanger | pleia2: okay, monday works. I'll book off the day to help | 19:55 |
| mordred | clarkb: + sudo mv /tmp/pip.conf /etc/pip.conf | 19:55 |
| mordred | + cat | 19:55 |
| *** Goneri has joined #openstack-infra | 19:55 | |
| mordred | + host git.openstack.org | 19:56 |
| mordred | Host git.openstack.org.openstacklocal not found: 2(SERVFAIL) | 19:56 |
| HenryG | mtreinish: I don't understand how the failure rate can be so high in such a short time? | 19:56 |
| *** rguillebert has joined #openstack-infra | 19:56 | |
| clarkb | mordred: wow | 19:56 |
| mtreinish | HenryG: that query will return all log lines from all files for failed builds with the name gate-tempest-dsvm-neutron-pg-full | 19:57 |
| mordred | clarkb: yah. I just saw that once in the debug log | 19:57 |
| mtreinish | it will be really large number | 19:57 |
| clarkb | mordred: I think that means thr first lookup failed so it checked searchdomains? | 19:57 |
| mordred | clarkb: on an osic node | 19:57 |
| mordred | clarkb: I saw another osic node have a different dns resolution error but not that one | 19:57 |
| clarkb | mordred: we might make it not check search domains with a trailing . | 19:57 |
| *** yamamoto has joined #openstack-infra | 19:58 | |
| HenryG | mtreinish: Aha. I was trying to list the failed runs of that job. I failed. | 19:58 |
| *** kgiusti has left #openstack-infra | 19:58 | |
| mtreinish | HenryG: add a message:"Finished: " to that query and it should report what you're looking for | 19:58 |
| mtreinish | HenryG: is that job not on gate or periodic? (I just looked for it on openstack-health) | 19:59 |
| HenryG | mtreinish: It is in the neutron check queue. I have not looked to see where else it is. | 20:00 |
| *** toabctl has quit IRC | 20:00 | |
| *** andreaf has quit IRC | 20:00 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add symlink for ceph-deb-hammer https://review.openstack.org/306615 | 20:01 |
| pabelanger | clarkb: ^ | 20:01 |
| mtreinish | HenryG: ok, if its not on gate or periodic it won't be collected into subunit2sql so openstack-health won't know about it. I assume that's what's happening | 20:01 |
| *** andreaf has joined #openstack-infra | 20:01 | |
| *** toabctl has joined #openstack-infra | 20:01 | |
| HenryG | mtreinish: It is currently non-voting but I want fix the error rate so we can make it voting. | 20:02 |
| mtreinish | HenryG: ok cool | 20:02 |
| HenryG | mtreinish: hence my clumsy efforts at trying to find a pattern in the errors | 20:02 |
| krotscheck | infra-core: If anyone could give me a status update of the npm sync script running on mirror_update, I'll buy you a pony* | 20:03 |
| krotscheck | *no actual ponies offered. | 20:03 |
| *** cfarquhar has quit IRC | 20:03 | |
| nibalizer | krotscheck: i'm a bit busy at the moment | 20:04 |
| nibalizer | can we pick that up monday? | 20:04 |
| krotscheck | nibalizer: No prob. | 20:04 |
| krotscheck | nibalizer: I was just hoping to get the vos release running over the weekend, if possible | 20:04 |
| *** nelsnelson has quit IRC | 20:04 | |
| nibalizer | i can check on that | 20:04 |
| nibalizer | but only because I care about you as a friend krotscheck | 20:05 |
| pabelanger | gg nibalizer | 20:05 |
| krotscheck | nibalizer: it is much appreciated. I shall expense you a beer at the summit. | 20:05 |
| *** achanda has quit IRC | 20:05 | |
| nibalizer | we aree still running the vos release that jeblari started yesterdayish | 20:05 |
| *** cfarquhar has joined #openstack-infra | 20:06 | |
| *** cfarquhar has quit IRC | 20:06 | |
| *** cfarquhar has joined #openstack-infra | 20:06 | |
| nibalizer | mirror.npm 953.7G 563.5G 59% 49% | 20:06 |
| mordred | infra-root: nodepool is disabled in puppet and running with two unlanded patches, just fyi | 20:06 |
| *** lakshmiS has joined #openstack-infra | 20:06 | |
| pabelanger | krotscheck: does that mean you didn't need to revert your npm work? | 20:06 |
| pabelanger | mordred: ack | 20:06 |
| krotscheck | pabelanger: That is correct | 20:06 |
| pabelanger | krotscheck: neat! | 20:06 |
| krotscheck | nibalizer: Neat. Only 100GB to go! | 20:07 |
| nibalizer | krotscheck: so we're closing in on the ~650 number the yahoo people gaave us | 20:07 |
| *** baoli has joined #openstack-infra | 20:07 | |
| krotscheck | nibalizer: Right, but it'll probably take another 10 hours or so | 20:07 |
| bkero | oh dear | 20:08 |
| krotscheck | nibalizer: That's... a very long vos release. | 20:08 |
| *** yamamoto has quit IRC | 20:08 | |
| krotscheck | pabelanger: Turns out the error was a bad interaction between <directory> and mod_rewrite | 20:08 |
| pabelanger | krotscheck: Ah, ya some of that code you added for rewrite is magic to me | 20:08 |
| mordred | krotscheck: yah. these initial vos releases are not quick | 20:09 |
| krotscheck | mordred: But at least we have a mirror now :) | 20:09 |
| mordred | krotscheck: wootwoot | 20:09 |
| krotscheck | What's next, gem? | 20:09 |
| krotscheck | RPM? | 20:09 |
| pabelanger | Does rax expose metrics for data between regions? | 20:09 |
| pabelanger | hopefully RPM | 20:09 |
| pabelanger | going to finish that up later tonight | 20:09 |
| krotscheck | pabelanger: go go go :) | 20:10 |
| *** nwkarsten has joined #openstack-infra | 20:10 | |
| pabelanger | with mordred suggestions, should be an easier rsync process now | 20:10 |
| mordred | yup! | 20:10 |
| *** eharney has joined #openstack-infra | 20:10 | |
| *** doug-fish has joined #openstack-infra | 20:11 | |
| *** doug-fis_ has quit IRC | 20:11 | |
| openstackgerrit | Vasyl Saienko proposed openstack/requirements: Block broken netmiko release 0.4.3 https://review.openstack.org/306206 | 20:14 |
| *** mrmartin has joined #openstack-infra | 20:14 | |
| *** nwkarsten has quit IRC | 20:14 | |
| *** mrmartin has quit IRC | 20:16 | |
| *** mylu has joined #openstack-infra | 20:16 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 20:17 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 20:17 | |
| *** Nisha_away has joined #openstack-infra | 20:20 | |
| *** pvaneck_ has joined #openstack-infra | 20:20 | |
| *** [HeOS] has joined #openstack-infra | 20:20 | |
| *** armax_ has joined #openstack-infra | 20:20 | |
| *** andreykurilin__ has quit IRC | 20:21 | |
| *** cody-somerville has joined #openstack-infra | 20:22 | |
| *** cody-somerville has quit IRC | 20:22 | |
| *** cody-somerville has joined #openstack-infra | 20:22 | |
| *** armax has quit IRC | 20:22 | |
| *** whoops has quit IRC | 20:22 | |
| *** tpsilva has quit IRC | 20:22 | |
| *** hrybacki has quit IRC | 20:22 | |
| *** armax_ is now known as armax | 20:22 | |
| *** andreaf has quit IRC | 20:23 | |
| *** HeOS has quit IRC | 20:23 | |
| *** pvaneck__ has quit IRC | 20:23 | |
| *** yamahata has quit IRC | 20:23 | |
| *** xgerman has quit IRC | 20:23 | |
| *** whoops has joined #openstack-infra | 20:24 | |
| *** ericksonsantos has joined #openstack-infra | 20:24 | |
| *** Nisha_away has quit IRC | 20:24 | |
| *** trown is now known as trown|outtypewww | 20:24 | |
| *** hrybacki has joined #openstack-infra | 20:25 | |
| *** xgerman has joined #openstack-infra | 20:26 | |
| *** tpsilva has joined #openstack-infra | 20:26 | |
| *** andreaf has joined #openstack-infra | 20:28 | |
| *** Goneri has quit IRC | 20:29 | |
| *** abregman has quit IRC | 20:29 | |
| *** notsogentle has joined #openstack-infra | 20:29 | |
| *** EricGonczer_ has joined #openstack-infra | 20:29 | |
| *** achanda has joined #openstack-infra | 20:29 | |
| *** _ari_ has quit IRC | 20:32 | |
| *** alex_xu has quit IRC | 20:34 | |
| zaro | jeblair: not sure if you are interested, but it looks like the way others are renaming gerrit projects is to use a combination of 2 plugins (importer plugin and delete project plugin). | 20:34 |
| *** achanda has quit IRC | 20:34 | |
| *** andreykurilin__ has joined #openstack-infra | 20:34 | |
| zaro | jeblair: https://gerrit.googlesource.com/plugins/importer/+/master/src/main/resources/Documentation/about.md#project-copy | 20:34 |
| zaro | jeblair: By doing a project copy and then using the delete-project plugin to delete the source project, a project can be renamed. | 20:35 |
| clarkb | zaro: does that preserve all of the old changes and code review? | 20:35 |
| *** agentle has quit IRC | 20:35 | |
| zaro | clarkb: yes, it says it will | 20:36 |
| *** alex_xu has joined #openstack-infra | 20:36 | |
| mordred | I agree with zaro | 20:36 |
| mordred | "Draft changes, draft patch sets, change edits and draft comments are not imported. | 20:36 |
| mordred | it calls out the things that are not imported | 20:36 |
| mordred | what are "change edits" ? | 20:36 |
| mordred | is that an in-progress not-committed edit? | 20:36 |
| *** yamahata has joined #openstack-infra | 20:37 | |
| zaro | yes, i believe so. from that inline edit feature i believe | 20:37 |
| *** salv-orlando has joined #openstack-infra | 20:38 | |
| *** salv-orlando has quit IRC | 20:38 | |
| *** salv-orlando has joined #openstack-infra | 20:38 | |
| docaedo | pabelanger pleia2 - regarding the presentation, if there's any specific stuff I can do to refresh let me know, I'll make time to do that stuff next week | 20:40 |
| *** jheroux has quit IRC | 20:40 | |
| pleia2 | docaedo: great, I figure I'll put a review up and we can dive in there | 20:41 |
| *** baoli has quit IRC | 20:41 | |
| docaedo | pleia2: excellent! please add me as a reviewer so I don't miss it :) | 20:42 |
| jeblair | zaro: cool, maybe we should look into altering our process :) | 20:42 |
| pleia2 | docaedo: will do | 20:43 |
| *** esikachev has quit IRC | 20:43 | |
| *** ajmiller__ is now known as ajmiller | 20:43 | |
| *** newjersey has joined #openstack-infra | 20:43 | |
| zaro | jeblair: i'll test it out on review-dev first and give let you know how it goes. | 20:43 |
| *** newjersey has quit IRC | 20:43 | |
| pabelanger | docaedo: indeed! | 20:46 |
| anteaya | zaro: if you start an etherpad to keep your notes in, let me know so I can track it | 20:46 |
| *** jbernard_ has joined #openstack-infra | 20:50 | |
| zaro | anteaya: will do | 20:52 |
| anteaya | zaro: thank you | 20:53 |
| *** edmondsw has quit IRC | 20:55 | |
| *** Sukhdev has joined #openstack-infra | 20:56 | |
| *** roxanag__ has quit IRC | 20:57 | |
| ianw | AJaeger: thanks for that | 20:57 |
| *** psanchez has quit IRC | 20:58 | |
| *** roxanaghe has joined #openstack-infra | 20:58 | |
| *** tonytan4ever has quit IRC | 20:59 | |
| *** psanchez has joined #openstack-infra | 21:00 | |
| *** LaT0rtue has quit IRC | 21:01 | |
| sdake | ok folks | 21:01 |
| sdake | need a bit of help on how to handle a particular problem we have | 21:01 |
| *** lascii is now known as alaski | 21:01 | |
| sdake | http://eavesdrop.openstack.org/meetings/kolla/2016/kolla.2016-04-13-23.01.log.html | 21:02 |
| sdake | at 23:56 tonyb uggestd tagging our liberty branch as liberty-early-demise | 21:02 |
| sdake | and I think in his mind he was thinking remove the branch, and then recreate it from the stable/mitaka branch | 21:02 |
| sdake | this preserves histroy | 21:02 |
| sdake | the alternative is this beast: | 21:03 |
| sdake | https://review.openstack.org/306625 | 21:03 |
| *** rossella_s has quit IRC | 21:03 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add EPEL as requirement of centos-minimal https://review.openstack.org/306220 | 21:03 |
| sdake | essntially we want oru stable/liberty branch to match our stable/mitaka branch without losing history of the changes | 21:03 |
| sdake | and then we want to fix up our stable/liberty branch with 1-3 commits to make it deploy liberty propery | 21:04 |
| sdake | one of which is https://review.openstack.org/306625 | 21:04 |
| *** inc0 has joined #openstack-infra | 21:04 | |
| *** rhallisey has joined #openstack-infra | 21:05 | |
| *** rossella_s has joined #openstack-infra | 21:06 | |
| sdake | inc0 rhallisey no resposes yet | 21:07 |
| sdake | but this seems like the most viable plan i've heard so far | 21:07 |
| inc0 | it's surely better than megapatch | 21:07 |
| sdake | its a bit disruptive to git to rewrite histories of branches | 21:08 |
| sdake | as in I think git doesns't handle it well | 21:08 |
| clarkb | yes you have to force update any local versions of that branch | 21:08 |
| *** aysyd has quit IRC | 21:09 | |
| sdake | fwiw this is a one time thign | 21:10 |
| *** roxanaghe has quit IRC | 21:11 | |
| slogan | quick question on https://review.openstack.org/#/c/306286/ - it shows state as verified, but is marked as "Needs Verified". Been sitting like that for several hours after a +2 and workflow. Trying to figure out if there is something else that I need to do for it to merge. | 21:11 |
| *** sridhar_ram is now known as sridhar_ram_afk | 21:11 | |
| slogan | Or perhaps we are in a state where merges are not being performed (perhaps not surprising this close to Austin) | 21:12 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Initial commit for RPM afs mirror https://review.openstack.org/289520 | 21:12 |
| sdake | clarkb is this approach bad and the megapatch better? | 21:14 |
| sdake | clarkb i am far from a git expert - so want to do the right thing here | 21:14 |
| clarkb | sdake: sorry I am distracted, not really in a place to opinionate | 21:14 |
| sdake | and what we dont want to do is submit our 1k patches into a backport | 21:14 |
| sdake | clarkb ack, seems like most folsk are out | 21:14 |
| anteaya | sdake: where does it show the state as verified on https://review.openstack.org/#/c/306286/ | 21:14 |
| sdake | i'll send a mail to openstack-infra | 21:14 |
| anteaya | sdake: sorry tab fail | 21:14 |
| *** ldnunes has quit IRC | 21:14 | |
| anteaya | slogan: where does it show the state as verified on https://review.openstack.org/#/c/306286/ | 21:14 |
| sdake | anteaya happens alot ;) | 21:14 |
| slogan | anteaya: Verified Workflow +1 Syd Logan | 21:15 |
| anteaya | slogan: from my view, jenkins has never seen your patch | 21:15 |
| anteaya | slogan: that isn't verified | 21:15 |
| slogan | oh | 21:15 |
| anteaya | slogan: verified is after jenkins tests it and the tests pass | 21:15 |
| *** sridhar_ram_afk has quit IRC | 21:16 | |
| anteaya | slogan: if you click the toggle ci button at the bottom | 21:16 |
| slogan | ok, and that will happen eventually I guess | 21:16 |
| anteaya | slogan: no it won't | 21:16 |
| anteaya | that is my point | 21:16 |
| anteaya | jenkins can not see your patch | 21:16 |
| anteaya | you have some form of dependency somewhere on that patch and zuul can't queue it to test it | 21:16 |
| slogan | hrmmm, ok | 21:17 |
| sdake | inc0 rhallisey subscribe to openstack-infra mailing list plesae | 21:17 |
| slogan | anteaya: is there a way to determine what that dependency might be? | 21:18 |
| anteaya | slogan: there is something wrong with broadview-ui's test setup | 21:18 |
| anteaya | I just downloaded the patch and looked at the git log | 21:19 |
| anteaya | this is the second patch to the repo, the first merged patch is .gitreview | 21:19 |
| anteaya | so I think that I'm wrong and that your tests on this repo are not set up correctly | 21:19 |
| slogan | yep | 21:19 |
| slogan | maybe the cookiecutter isn't good for horizon panels somehow | 21:20 |
| anteaya | http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n4587 | 21:20 |
| anteaya | merge check and noop jobs should result in noop jobs reporting back | 21:20 |
| anteaya | but they don't | 21:20 |
| slogan | ok | 21:21 |
| *** nelsnelson has joined #openstack-infra | 21:21 | |
| slogan | so, since I had two other projects successfully merge with noop jobs, perhaps I should look at their tests and see what might be different | 21:21 |
| anteaya | that would be a start | 21:21 |
| slogan | thanks so much anteaya | 21:22 |
| anteaya | I'm looking and I can't figure out why they aren't running | 21:22 |
| anteaya | you're welcome | 21:22 |
| anteaya | but the problem is the noop jobs aren't running on that repo | 21:22 |
| *** dimtruck is now known as zz_dimtruck | 21:22 | |
| anteaya | slogan: how did the .gitreview file get merged, do you know? | 21:23 |
| slogan | we followed same process for all three projects (broadview-lib, broadview-collector, broadview-ui) documented in the infra project manuals | 21:23 |
| anteaya | openstack project creator created it: http://git.openstack.org/cgit/openstack/broadview-ui/commit/?id=12ffcc0130a252319728b8c20461c611ac3d63fd | 21:23 |
| slogan | and same cookiecutter template | 21:23 |
| anteaya | so there was no patch for the .gitreview file, so no example to see if noop jobs had been working on this repo | 21:24 |
| *** nwkarsten has joined #openstack-infra | 21:26 | |
| slogan | http://git.openstack.org/cgit/openstack/broadview-collector/commit/?id=681f013d80856aa22aedd9a6428d90e003d203b3 is a project we merged without any issues, looks the same at a quick glance. | 21:26 |
| *** cbader has quit IRC | 21:26 | |
| *** MarkAtwood1 has quit IRC | 21:27 | |
| slogan | maybe I'm missing the point about the .gitreview file | 21:27 |
| *** MarkAtwood1 has joined #openstack-infra | 21:27 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Don't pass URL to safe jenkins shutdown https://review.openstack.org/306636 | 21:28 |
| *** rfolco has quit IRC | 21:28 | |
| *** roxanaghe has joined #openstack-infra | 21:28 | |
| *** pradk has quit IRC | 21:29 | |
| anteaya | slogan: the point about the .gitreview file was that it was never in gerrit | 21:29 |
| anteaya | slogan: it never passed noop jobs on that repo | 21:29 |
| anteaya | slogan: this is the first patch to the repo that has gone through gerrit so this is the first example we have of the jobs on that repo not working | 21:29 |
| *** julim_ has quit IRC | 21:30 | |
| slogan | I see | 21:30 |
| anteaya | great | 21:30 |
| slogan | so, again, it's tests that are at issue | 21:30 |
| slogan | right? | 21:30 |
| anteaya | well the noop jobs are not being triggered | 21:30 |
| anteaya | but yes, the noop jobs | 21:30 |
| anteaya | noop jobs means there are no tests | 21:31 |
| anteaya | but we have to have the noop jobs there to trigger zuul to know about the patch and merge it when you +A it | 21:31 |
| anteaya | and right now zuul doesn't know about the patch | 21:31 |
| slogan | all the changes we made to openstack-infra were the same for all 3 projects | 21:32 |
| anteaya | hopefully someone able to look at zuul logs will drop by and hopefully look up what zuul thinks the problem is from the logs and tell you what to do to fix it | 21:32 |
| slogan | I went looking a couple of hours ago | 21:32 |
| anteaya | slogan: I believe you | 21:32 |
| slogan | ok | 21:32 |
| anteaya | I don't have access to zuul logs | 21:32 |
| slogan | got it | 21:32 |
| *** lenny has joined #openstack-infra | 21:32 | |
| anteaya | great thanks | 21:32 |
| anteaya | stay available in irc | 21:32 |
| slogan | will do | 21:33 |
| anteaya | thanks | 21:33 |
| *** ams_ has quit IRC | 21:33 | |
| slogan | who should I be looking for that can help? | 21:33 |
| slogan | with the zuul logs that is | 21:33 |
| *** nwkarsten has quit IRC | 21:33 | |
| *** nwkarsten has joined #openstack-infra | 21:34 | |
| anteaya | someone will read backscroll and ping you | 21:35 |
| slogan | ok | 21:35 |
| anteaya | if you haven't heard anything by Monday come back and say that broadview-ui noop jobs aren't been seen by zuul and add the url of that patch | 21:35 |
| slogan | ok | 21:36 |
| anteaya | and ask for someone to look at zuul logs and help you find the solution | 21:36 |
| *** EricGonczer_ has quit IRC | 21:36 | |
| *** gyee has quit IRC | 21:37 | |
| slogan | ok, thanks anteaya | 21:37 |
| anteaya | you are welcome slogan | 21:38 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Remove network info for internap from nodepool.yaml https://review.openstack.org/306422 | 21:38 |
| anteaya | have a good weekend | 21:38 |
| *** doug-fish has quit IRC | 21:38 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Remove public flag from internap network info https://review.openstack.org/306422 | 21:39 |
| *** vgridnev has quit IRC | 21:39 | |
| slogan | anteaya: u2 | 21:39 |
| *** nwkarsten has quit IRC | 21:39 | |
| *** rfolco has joined #openstack-infra | 21:42 | |
| openstackgerrit | Merged openstack-infra/nodepool: Partially Revert "Pass extended network information in to occ/shade" https://review.openstack.org/306594 | 21:42 |
| *** amitgandhinz has quit IRC | 21:42 | |
| *** thorst has quit IRC | 21:43 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:43 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 21:43 | |
| *** thorst has joined #openstack-infra | 21:43 | |
| *** mark-casey has joined #openstack-infra | 21:43 | |
| *** mark-casey has left #openstack-infra | 21:44 | |
| *** rfolco has quit IRC | 21:44 | |
| *** mriedem has quit IRC | 21:45 | |
| *** ddutta has joined #openstack-infra | 21:45 | |
| *** borland__ has quit IRC | 21:45 | |
| *** thorst_ has joined #openstack-infra | 21:46 | |
| *** thorst has quit IRC | 21:48 | |
| *** ihrachys has quit IRC | 21:50 | |
| *** kevinshort has quit IRC | 21:50 | |
| *** kevinshort has joined #openstack-infra | 21:50 | |
| *** thorst_ has quit IRC | 21:50 | |
| *** inc0 has quit IRC | 21:51 | |
| *** rlandy has quit IRC | 21:51 | |
| *** Sukhdev has quit IRC | 21:52 | |
| *** rhallisey has quit IRC | 21:52 | |
| *** piet has joined #openstack-infra | 21:53 | |
| *** cody-somerville has quit IRC | 21:54 | |
| *** pcm_ has quit IRC | 21:54 | |
| *** ddutta has left #openstack-infra | 21:55 | |
| *** pc_m has joined #openstack-infra | 21:55 | |
| *** |-paul-| has joined #openstack-infra | 21:56 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove public flag from internap network info https://review.openstack.org/306422 | 21:56 |
| *** EricGonczer_ has joined #openstack-infra | 21:59 | |
| *** raginbajin has quit IRC | 22:00 | |
| *** thorst has joined #openstack-infra | 22:00 | |
| *** boden has quit IRC | 22:05 | |
| *** thorst has quit IRC | 22:05 | |
| *** raginbajin has joined #openstack-infra | 22:05 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:05 | |
| *** thorst has joined #openstack-infra | 22:06 | |
| *** EricGonczer_ has quit IRC | 22:07 | |
| *** gyee has joined #openstack-infra | 22:09 | |
| *** gyee has quit IRC | 22:13 | |
| *** alex_xu has quit IRC | 22:13 | |
| *** thorst has quit IRC | 22:14 | |
| openstackgerrit | Merged openstack-infra/system-config: Don't pass URL to safe jenkins shutdown https://review.openstack.org/306636 | 22:15 |
| *** alex_xu has joined #openstack-infra | 22:15 | |
| *** tpsilva has quit IRC | 22:17 | |
| *** docaedo has quit IRC | 22:19 | |
| *** SergeyLukjanov has quit IRC | 22:22 | |
| *** SergeyLukjanov has joined #openstack-infra | 22:22 | |
| *** odyssey4me has quit IRC | 22:22 | |
| *** mrunge has quit IRC | 22:23 | |
| *** ttx has quit IRC | 22:23 | |
| *** mrunge has joined #openstack-infra | 22:25 | |
| *** akshai has quit IRC | 22:25 | |
| *** sridhar_ram has joined #openstack-infra | 22:26 | |
| *** odyssey4me has joined #openstack-infra | 22:27 | |
| *** akshai has joined #openstack-infra | 22:27 | |
| *** notnownikki has quit IRC | 22:27 | |
| *** piet has quit IRC | 22:30 | |
| *** baoli has joined #openstack-infra | 22:30 | |
| *** yamahata has quit IRC | 22:35 | |
| *** nelsnelson has quit IRC | 22:35 | |
| *** ttx has joined #openstack-infra | 22:36 | |
| *** thorst has joined #openstack-infra | 22:38 | |
| *** avarner__ has quit IRC | 22:43 | |
| *** sdague has quit IRC | 22:45 | |
| *** thorst has quit IRC | 22:47 | |
| openstackgerrit | Anand Shanmugam proposed openstack-infra/project-config: Add create option and acl for refs/heads/stable for cloudpulse https://review.openstack.org/306650 | 22:47 |
| *** baoli has quit IRC | 22:48 | |
| *** MarkAtwood1 has quit IRC | 22:51 | |
| *** dangers_away has joined #openstack-infra | 22:54 | |
| *** Sukhdev has joined #openstack-infra | 22:55 | |
| melwitt | logstash.openstack.org looks to be stuck, page loads the theme but then stops | 22:56 |
| *** hdd has joined #openstack-infra | 22:56 | |
| *** dangers_away is now known as dangers | 22:57 | |
| *** dangers is now known as dangers_away | 22:57 | |
| *** catherineD has joined #openstack-infra | 22:57 | |
| openstackgerrit | Anand Shanmugam proposed openstack-infra/project-config: Add create option and acl for refs/heads/stable for cloudpulse https://review.openstack.org/306650 | 22:57 |
| *** rhallisey has joined #openstack-infra | 23:01 | |
| *** hdd has quit IRC | 23:02 | |
| *** eliqiao_ has joined #openstack-infra | 23:02 | |
| *** eliqiao has quit IRC | 23:03 | |
| anteaya | I confirm melwitt's description | 23:03 |
| anteaya | I don't see anything odd on the logstash.o.o server according to cacti: http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=24&page=1 | 23:03 |
| anteaya | the logstash job queue however looks very odd: http://status.openstack.org/zuul/ | 23:04 |
| anteaya | clarkb: are you able to access a keyboard and take a peek at what logstash is up to? | 23:04 |
| clarkb | anteaya: not right now, currently distracted, maybe later this evening | 23:04 |
| *** akshai has quit IRC | 23:05 | |
| anteaya | I understand | 23:06 |
| anteaya | melwitt: thanks for reporting | 23:06 |
| melwitt | anteaya: thanks for taking a look. agree the logstash job queue doesn't look good | 23:08 |
| clarkb | I think the job queue is related to subunit2sql | 23:09 |
| clarkb | it makes things look like that because it grabs jobs ahead of time before processing them iirc | 23:09 |
| *** |-paul-| has quit IRC | 23:10 | |
| *** |-paul-| has joined #openstack-infra | 23:13 | |
| anteaya | okay | 23:13 |
| *** rhallisey has quit IRC | 23:13 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Restrict access to Jenkinses https://review.openstack.org/306653 | 23:13 |
| anteaya | the eth0 graph on workers 1-14 and 16-20 looks like this: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=1754&rra_id=all | 23:13 |
| anteaya | both inbound and outbound basically died 40 minutes ago | 23:14 |
| *** mriedem has joined #openstack-infra | 23:14 | |
| anteaya | worker 15 is the outlier | 23:14 |
| anteaya | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=1305&rra_id=all | 23:14 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Stop linking to jenkins in zuul status page https://review.openstack.org/306654 | 23:17 |
| *** dalgaaf has quit IRC | 23:19 | |
| *** Sukhdev has quit IRC | 23:25 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Switch gate-neutron-dsvm-scenario job to be invoked via tempest plugin framework https://review.openstack.org/306655 | 23:26 |
| mordred | infra-root: I have un-disabled nodepool.o.o | 23:28 |
| nibalizer | cool | 23:28 |
| openstackgerrit | cathy proposed openstack-infra/irc-meetings: change service-chaining metting time schedule https://review.openstack.org/306657 | 23:29 |
| mordred | the nodepool graph on the bottom of the zuul status page visually seems to have slightly more building and deleting | 23:29 |
| jeblair | clarkb, anteaya: https://review.openstack.org/304303 is also a problem | 23:29 |
| mordred | so there may still be some tweaks we want to find and make | 23:29 |
| mordred | but to me it seems largely within operational tolerances | 23:30 |
| pabelanger | nice | 23:30 |
| mordred | Shrews: ^^ congrats. we're now much more on the hook for nodepool than before :) | 23:30 |
| pabelanger | So, one thing I noticed, I think we lost some statsd info: http://grafana.openstack.org/dashboard/db/nodepool-blue-box | 23:30 |
| pabelanger | guess because shade is doing it now? | 23:30 |
| jeblair | i think the tasks changed names? | 23:31 |
| pabelanger | eg: create server | 23:31 |
| pabelanger | maybe | 23:31 |
| pabelanger | I can check graphite in a bit | 23:31 |
| mordred | ah. yes indeed | 23:31 |
| *** davideag_ has quit IRC | 23:31 | |
| mordred | pabelanger: it'll be an inversion of the word | 23:32 |
| mordred | pabelanger: in nodepool is was CreateServer - in shade it's ServerCreate | 23:32 |
| *** tonyb_ is now known as tonyb | 23:33 | |
| pabelanger | mordred: cool, I'll start updating some grafyaml | 23:33 |
| anteaya | jeblair: perhaps I don't have enough context, other than 304303 needing to be approved again, what is the problem I am supposed to be seeing? | 23:33 |
| mordred | we could also land a renaming patch to shade - the task names themselves are not part of the published API | 23:33 |
| mordred | jeblair: ^^ opinion? | 23:33 |
| mordred | (the tasks file sorts nice with NounVerb - but the methods on the cloud object are actually verb_noun - so I could argue either way) | 23:34 |
| jeblair | anteaya: i thought you asked about the logstash job graph | 23:34 |
| *** xarses_ has quit IRC | 23:35 | |
| anteaya | jeblair: yes I did, sorry I was confused whether we were talking about logstash or about making jenkins opaque | 23:35 |
| *** tphummel has quit IRC | 23:36 | |
| *** piet has joined #openstack-infra | 23:36 | |
| jeblair | mordred: i don't mind the name change -- in this case, it will be tricky to compare before/after times, but i don't think it's critical. we should consider them somewhat firm in shade though, as changing them there will be annoying. | 23:36 |
| mordred | jeblair: yah. agree | 23:37 |
| *** markvoelker_ has quit IRC | 23:37 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/grafyaml: Add support for graph's legend https://review.openstack.org/306660 | 23:39 |
| *** dahoo has quit IRC | 23:40 | |
| *** ZZelle_ has joined #openstack-infra | 23:40 | |
| *** asettle has joined #openstack-infra | 23:41 | |
| *** IlyaG has joined #openstack-infra | 23:43 | |
| *** asettle has quit IRC | 23:43 | |
| *** infra-red has quit IRC | 23:43 | |
| *** thorst has joined #openstack-infra | 23:44 | |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Make subunit2sql population single threaded https://review.openstack.org/303583 | 23:45 |
| *** woodster_ has quit IRC | 23:48 | |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Ensure all jobs send a completion packet https://review.openstack.org/304303 | 23:48 |
| mtreinish | jeblair: ^^^ are we gonna try to switch one of the workers over now? | 23:49 |
| mtreinish | or wait until next week? (probably would be better for me) | 23:50 |
| jeblair | mtreinish: i'd like to wait too | 23:50 |
| mtreinish | ok | 23:50 |
| clarkb | me three | 23:50 |
| *** knikolla has left #openstack-infra | 23:51 | |
| *** thorst has quit IRC | 23:52 | |
| *** piet has quit IRC | 23:52 | |
| *** apoorvad_ has quit IRC | 23:58 | |
| mordred | RESTART ALL THE THINGS!!!! | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!