| EmilienM | I don't see the hiera packaging thing anymore, thanks to the roll back I guess | 00:01 |
|---|---|---|
| sdake | getting a not registered error: https://review.openstack.org/#/c/298479/ | 00:02 |
| EmilienM | though NOT_REGISTERED on devstack-centos7 | 00:02 |
| EmilienM | sdake: zuul got restarted | 00:02 |
| clarkb | EmilienM: yes see scrollback | 00:02 |
| sdake | recheck? | 00:02 |
| clarkb | er | 00:02 |
| clarkb | sdake ^ | 00:02 |
| clarkb | mnaser: if you are able can you update https://bugs.launchpad.net/nova/+bug/1558807 with the version of libvirt you use? | 00:02 |
| openstack | Launchpad bug 1558807 in OpenStack Compute (nova) "Volume attached at different path than reported by nova/cinder when using config drive" [Undecided,Incomplete] | 00:02 |
| pabelanger | I am looking on nodepool to see if there is an error in the logs | 00:02 |
| *** roxanaghe has joined #openstack-infra | 00:04 | |
| *** aeng has quit IRC | 00:04 | |
| *** eil397 has quit IRC | 00:04 | |
| *** harlowja has quit IRC | 00:05 | |
| pabelanger | 2016-03-30 00:04:47,114 DEBUG nodepool.NodePool: Deficit: devstack-centos7: 0 (start: 0 min-ready: 2 ready: 2 capacity: 96) | 00:05 |
| *** sflanigan has quit IRC | 00:05 | |
| *** camunoz has quit IRC | 00:05 | |
| pabelanger | current 2 online | 00:05 |
| pabelanger | I think once they delete nodepool will start up again | 00:06 |
| clarkb | it is possible that we aren't reregistering jobs properly on reconnect to geamran? | 00:06 |
| clarkb | actuall I know | 00:06 |
| timrc | Hey yo... which project is the summit website? | 00:06 |
| pabelanger | once just came online in bluebox | 00:06 |
| pabelanger | one* | 00:06 |
| timrc | I'd like to submit a fix to a bug on event pages. | 00:06 |
| clarkb | the main run loop in the gearman plugin does both job running and job registration | 00:06 |
| clarkb | so noes rhtat are running jobs won't register jobs | 00:07 |
| *** Sukhdev has quit IRC | 00:07 | |
| clarkb | so we basically got stuck in lalaland without demand for a bit | 00:07 |
| clarkb | pabelanger: the one in bluebox should've registerd things,you can check against gearman directly | 00:07 |
| timrc | Oh https://git.openstack.org/cgit/openstack-infra/openstackweb/, I think. | 00:07 |
| pabelanger | ya, it is working now | 00:07 |
| * timrc clones | 00:07 | |
| clarkb | timrc: no | 00:07 |
| clarkb | timrc: let me find the real repo | 00:07 |
| clarkb | (that should be the real repo bt we never got them to transition off of github) | 00:08 |
| pabelanger | clarkb: Right, I think we are in lala until the 2 in use deleted, then zuul detected it and created a new server | 00:08 |
| pabelanger | which reregistered | 00:08 |
| *** roxanaghe has quit IRC | 00:08 | |
| pabelanger | EmilienM: sdake: should be fixed now | 00:08 |
| lifeless | clarkb: yes, the mellanox NICs were 10Gbe | 00:08 |
| clarkb | timrc: https://github.com/openstackweb somewhere in there | 00:09 |
| sdake | thanks pabelanger | 00:09 |
| clarkb | lifeless: thank you for confirming. crinkle so ya we seem to have lost our 10Gbe | 00:09 |
| *** IlyaG has quit IRC | 00:09 | |
| lifeless | clarkb: the second tranche of hardware was a different config though - the 120 or whatever machines that turned up about 2 years in | 00:09 |
| timrc | clarkb: Thanks, sir. | 00:10 |
| clarkb | pabelanger: pleia2 fungi the trick would be to stop zuul, delete all the used nodes in nodepool, wait for one of each variety t ocome up, then start zuul | 00:10 |
| pabelanger | clarkb: which makes sense | 00:10 |
| lifeless | clarkb: they were in fact a bunch of different configs from different early cloud roles | 00:10 |
| *** Sukhdev has joined #openstack-infra | 00:10 | |
| crinkle | clarkb: possibly they only checked useast, which i think was not mellanox | 00:10 |
| clarkb | lifeless: gotcha, any idea if 10Gbe availability was at least constant? | 00:10 |
| *** gokrokve has joined #openstack-infra | 00:10 | |
| lifeless | clarkb: so, if you're examining some hardware from the big-bag-of-hardware, you'd need to know where/when it was obtained to see what it should have | 00:10 |
| lifeless | clarkb: no, a big chunk of that 120-odd batch of machines were swift nodes | 00:11 |
| lifeless | clarkb: lots of disk, low CPU/memory/network | 00:11 |
| clarkb | I see | 00:11 |
| lifeless | clarkb: also omg old ilo hardware version on those ones. made me want to cry :) | 00:12 |
| *** ajmiller has quit IRC | 00:12 | |
| *** BobBall_ has joined #openstack-infra | 00:12 | |
| pabelanger | fungi: ianw: clarkb: EmilienM: if we land 299031 tonight, I can kick off a ubuntu-trusty rebuild later this evening | 00:12 |
| clarkb | pabelanger: it should have my +2 unless a new patchset rolled in | 00:12 |
| *** BobBall_ is now known as Guest4737 | 00:12 | |
| pabelanger | clarkb: Yup, just rechecking because of NOT_REGISTERED | 00:12 |
| clarkb | pabelanger: it is trivial enough that I feel comfortable just approving it if we don't have other reviewers | 00:12 |
| clarkb | pabelanger: oh gotcha | 00:12 |
| clarkb | crinkle: lifeless maybe that means we should just requiest 2x1gig and move on if there is a mix that doesn't include 10Gbe | 00:13 |
| lifeless | clarkb: the machines with 10G didn't have 2x1G | 00:13 |
| clarkb | ha | 00:14 |
| clarkb | would the 10Gbe nics negotiate 1G? | 00:14 |
| *** devkulkarni has quit IRC | 00:14 | |
| clarkb | I assume so | 00:14 |
| lifeless | clarkb: they had a single 1G - and the iLO 1G, which isn't linux-usable | 00:14 |
| lifeless | clarkb: I don't know - for all I know, it was 10G fibre | 00:14 |
| clarkb | or was it fancy infinibandness that can't manage ethernet at 1gig? | 00:14 |
| clarkb | ya | 00:14 |
| clarkb | hrm | 00:14 |
| lifeless | clarkb: no, its defintely not IB | 00:14 |
| *** gokrokve has quit IRC | 00:15 | |
| *** BobBall has quit IRC | 00:15 | |
| lifeless | clarkb: but the actual phys link could be anything - I never drilled down enough to know (or need to know) | 00:15 |
| lifeless | clarkb: (IB, as you know, has radically different semantics) | 00:15 |
| clarkb | ya | 00:15 |
| lifeless | so its true ethernet, can arp spoof, do NAT, run VM's on VLAN's etc. | 00:16 |
| anteaya | pleia2: pabelanger nice work on the zuul restart | 00:16 |
| *** IlyaG has joined #openstack-infra | 00:16 | |
| *** Guest4737 has quit IRC | 00:16 | |
| lifeless | clarkb: what are you doing - planning the new home? | 00:16 |
| *** ybathia has quit IRC | 00:16 | |
| clarkb | lifeless: yes they moved the hardware and said "no more 10Gbe" | 00:17 |
| clarkb | and I went uh what | 00:17 |
| *** BobBall has joined #openstack-infra | 00:17 | |
| clarkb | but sounds like that may be an east vs west difference and west isn't moved yet? | 00:17 |
| *** Swami has quit IRC | 00:17 | |
| *** BobBall is now known as Guest22941 | 00:17 | |
| clarkb | anyways we may just have to put up with what we get | 00:18 |
| *** aeng has joined #openstack-infra | 00:18 | |
| *** achanda has joined #openstack-infra | 00:18 | |
| *** SumitNaiksatam has quit IRC | 00:19 | |
| *** zul has quit IRC | 00:19 | |
| *** fawadkhaliq has quit IRC | 00:20 | |
| *** fawadkhaliq has joined #openstack-infra | 00:20 | |
| lifeless | clarkb: I have no direct visibility; if you're running into walls getting answers let me know - but I handed all my contacts over to the folk doing the cloud a year or so back | 00:20 |
| clarkb | ya crinkle is doing a great job, just trying to get a handle on what we expect to have and what we really have and how we can get sane networking out of it | 00:21 |
| clarkb | sounds like we might just have t oaim for mostly consistent over anything else | 00:21 |
| lifeless | So, the machines that had 10G cards probably still do, unless the move orders specifically requested removal. | 00:22 |
| lifeless | So you may be missing switches / wiring. | 00:22 |
| lifeless | Or you may be looking at the other dc's machines, which was - IIRC - east, and they were really all over the place. | 00:22 |
| *** sdake has quit IRC | 00:22 | |
| crinkle | my guess is the uswest machines still have the 10G cards and they only happened to look at the east machines | 00:23 |
| clarkb | if we continue to keep them separated we could go 10Gbe in west and 2x1G in east | 00:23 |
| pabelanger | anteaya: thanks, learned something new too | 00:23 |
| lifeless | crinkle: plausible indeed; also remember that esast was something like 4 different machine configurations | 00:23 |
| clarkb | assuming there is proper switch gear for the 10Gbe in west | 00:23 |
| *** mylu has quit IRC | 00:24 | |
| anteaya | pabelanger: awesome | 00:24 |
| *** sdake has joined #openstack-infra | 00:24 | |
| anteaya | 'tis a good day then | 00:24 |
| *** camunoz has joined #openstack-infra | 00:24 | |
| *** gokrokve has joined #openstack-infra | 00:24 | |
| *** fawadkhaliq has quit IRC | 00:24 | |
| *** achanda has quit IRC | 00:24 | |
| *** mylu has joined #openstack-infra | 00:25 | |
| timrc | Accidentally typed "git mush" instead of "git push", I think git "git mush" should be an alias to git rebase with a squash. | 00:27 |
| anteaya | what did it do? | 00:27 |
| anteaya | or the dogs could take off dragging the sleigh behind them | 00:28 |
| *** nelsnels_ has quit IRC | 00:28 | |
| *** nelsnelson has joined #openstack-infra | 00:29 | |
| *** kzaitsev_mb has joined #openstack-infra | 00:29 | |
| *** IlyaG has quit IRC | 00:29 | |
| *** mylu has quit IRC | 00:30 | |
| *** baoli has joined #openstack-infra | 00:32 | |
| *** mylu has joined #openstack-infra | 00:32 | |
| anteaya | pabelanger: thank you for adding your xenial dib work to this etherpad: https://etherpad.openstack.org/p/infra-operating-system-upgrades | 00:34 |
| anteaya | I appreciate it | 00:34 |
| anteaya | it helps me to keep track of large changes | 00:34 |
| *** baoli_ has joined #openstack-infra | 00:34 | |
| *** sc68cal has quit IRC | 00:35 | |
| anteaya | so waynr looking at where you put your jjb bits in the etherpad: https://etherpad.openstack.org/p/infra-newton-summit-planning | 00:35 |
| anteaya | waynr: you put them in the section for items that are not in the infra track but which infra needs to know about | 00:36 |
| *** mylu has quit IRC | 00:36 | |
| anteaya | waynr: I don't think that is the best section for your proposal | 00:36 |
| *** kzaitsev_mb has quit IRC | 00:36 | |
| anteaya | waynr: I suggest moving it to a fishbowl session, based upon what I believe you want | 00:36 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Document prereqs/usage for reproduce script https://review.openstack.org/294308 | 00:36 |
| *** mtanino_ has quit IRC | 00:37 | |
| *** mtanino__ is now known as mtanino_ | 00:37 | |
| *** baoli has quit IRC | 00:38 | |
| anteaya | pabelanger: I'm uncertain as how setting any of the offered smitespam configurations will of any benefit to us: https://www.mediawiki.org/wiki/Extension:SmiteSpam | 00:42 |
| anteaya | is there other documenation about giving it certain regexes? | 00:42 |
| *** tiswanso_ has quit IRC | 00:42 | |
| *** gokrokve has quit IRC | 00:43 | |
| openstackgerrit | Michael Johnson proposed openstack-infra/devstack-gate: Add archiving of nova instance console logs https://review.openstack.org/298915 | 00:43 |
| *** tiswanso has joined #openstack-infra | 00:43 | |
| *** mylu has joined #openstack-infra | 00:43 | |
| anteaya | tonyb: any thoughts on if the yaml2ical syntax will be accessible to the irc-meetings repo anytime soon? | 00:45 |
| *** baoli_ has quit IRC | 00:45 | |
| *** mylu has quit IRC | 00:49 | |
| *** sputnik13 has quit IRC | 00:52 | |
| *** mylu has joined #openstack-infra | 00:53 | |
| *** harlowja has joined #openstack-infra | 00:54 | |
| pabelanger | anteaya: not sure, I'll get back to you tomorrow once I look into it more | 00:54 |
| *** mylu has quit IRC | 00:54 | |
| pabelanger | clarkb: okay, so you are good with +A on 299031? | 00:55 |
| *** mylu has joined #openstack-infra | 00:58 | |
| clarkb | pabelanger: yes | 00:59 |
| clarkb | pabelanger: want me to approve it? | 00:59 |
| *** sdake_ has joined #openstack-infra | 00:59 | |
| clarkb | pabelanger: I went ahead and did it this way tomorrow mornings build will have the fix if you odn't get to it sooner | 01:00 |
| *** mylu has quit IRC | 01:00 | |
| *** sdake has quit IRC | 01:02 | |
| openstackgerrit | Sachi King proposed openstack-infra/git-review: Fix no_git_dir UnboundLocalError in except block https://review.openstack.org/298473 | 01:03 |
| *** IlyaG has joined #openstack-infra | 01:04 | |
| anteaya | pabelanger: okay thanks | 01:04 |
| anteaya | pabelanger: I'm offline for a good chunk of the morning, should be around mid-day | 01:04 |
| anteaya | we have had a lot of spam pdfs | 01:05 |
| anteaya | did smitespam ever catch any pdfs that you recall? | 01:05 |
| *** baoli has joined #openstack-infra | 01:06 | |
| *** achanda has joined #openstack-infra | 01:06 | |
| openstackgerrit | Merged openstack-infra/system-config: Fix typo with xenial logic https://review.openstack.org/299031 | 01:07 |
| *** zul_ has joined #openstack-infra | 01:08 | |
| *** zul_ is now known as zul | 01:08 | |
| *** Sukhdev has quit IRC | 01:08 | |
| *** IlyaG has quit IRC | 01:09 | |
| *** devkulkarni has joined #openstack-infra | 01:09 | |
| *** mylu has joined #openstack-infra | 01:09 | |
| *** baoli has quit IRC | 01:10 | |
| *** baoli has joined #openstack-infra | 01:11 | |
| *** baoli has quit IRC | 01:12 | |
| anteaya | if multiple users edit a page mass delete may not catch all the pages | 01:13 |
| anteaya | I'm going to contributions first then opening mass delete in a separate tab, after that deletes, refresh contributions for that user and follow the chain of multiple edits from different users to find the straglers | 01:14 |
| *** pvaneck has quit IRC | 01:17 | |
| pabelanger | clarkb: thanks, starting image build now | 01:19 |
| *** tqtran has quit IRC | 01:19 | |
| *** zhurong_ has joined #openstack-infra | 01:20 | |
| *** zz_dimtruck is now known as dimtruck | 01:23 | |
| anteaya | mass delete only seems to work on pdfs and files that user created, if a file was moved or edited by multiple users mass delete doesn't seem to catch it | 01:25 |
| *** gtmanfred has quit IRC | 01:29 | |
| *** raginbajin has quit IRC | 01:30 | |
| *** weshay has quit IRC | 01:30 | |
| *** devkulkarni has quit IRC | 01:31 | |
| *** krotscheck_dcm has quit IRC | 01:31 | |
| *** mnaser has quit IRC | 01:31 | |
| *** devkulkarni has joined #openstack-infra | 01:31 | |
| *** raginbajin has joined #openstack-infra | 01:31 | |
| *** jklare has quit IRC | 01:31 | |
| *** gtmanfred has joined #openstack-infra | 01:31 | |
| *** psanchez has quit IRC | 01:32 | |
| *** kzaitsev_mb has joined #openstack-infra | 01:32 | |
| *** krotscheck has joined #openstack-infra | 01:33 | |
| *** jklare has joined #openstack-infra | 01:33 | |
| *** baoli has joined #openstack-infra | 01:34 | |
| openstackgerrit | liusheng proposed openstack/requirements: bump aodhclient upper-constraints https://review.openstack.org/299054 | 01:34 |
| *** bdemers has joined #openstack-infra | 01:35 | |
| waynr | anteaya: cool, thanks for the feedback...ill rearrange now | 01:36 |
| *** Jeffrey4l has joined #openstack-infra | 01:36 | |
| *** psanchez has joined #openstack-infra | 01:36 | |
| *** kzaitsev_mb has quit IRC | 01:38 | |
| *** mtanino has joined #openstack-infra | 01:39 | |
| *** sridhar_ram has quit IRC | 01:40 | |
| *** baoli has quit IRC | 01:41 | |
| anteaya | waynr: great | 01:42 |
| *** cody-somerville has quit IRC | 01:43 | |
| *** baoli has joined #openstack-infra | 01:43 | |
| *** mnaser has joined #openstack-infra | 01:45 | |
| *** gyee has quit IRC | 01:47 | |
| *** rakhmerov has quit IRC | 01:49 | |
| *** Daisy has joined #openstack-infra | 01:49 | |
| *** apoorvad has quit IRC | 01:50 | |
| *** baoli has quit IRC | 01:53 | |
| *** rakhmerov has joined #openstack-infra | 01:53 | |
| *** salv-orl_ has joined #openstack-infra | 01:55 | |
| *** amrith is now known as _amrith_ | 01:56 | |
| *** salv-orl_ has quit IRC | 01:58 | |
| *** salv-orl_ has joined #openstack-infra | 01:58 | |
| *** salv-orlando has quit IRC | 01:59 | |
| *** dims has quit IRC | 01:59 | |
| *** thorst has joined #openstack-infra | 02:00 | |
| anteaya | did we know the spammers were also uploading jpgs? | 02:00 |
| *** cody-somerville has joined #openstack-infra | 02:01 | |
| *** cody-somerville has quit IRC | 02:01 | |
| *** cody-somerville has joined #openstack-infra | 02:01 | |
| *** mriedem has quit IRC | 02:02 | |
| *** tqtran has joined #openstack-infra | 02:03 | |
| *** dims has joined #openstack-infra | 02:04 | |
| *** salv-orl_ has quit IRC | 02:05 | |
| *** tqtran has quit IRC | 02:07 | |
| *** aeng has quit IRC | 02:10 | |
| *** mylu has quit IRC | 02:10 | |
| *** mylu has joined #openstack-infra | 02:11 | |
| *** EricGonczer_ has quit IRC | 02:12 | |
| *** ramishra has joined #openstack-infra | 02:13 | |
| *** Rocky_g has quit IRC | 02:14 | |
| *** mylu has quit IRC | 02:15 | |
| *** thorst has quit IRC | 02:17 | |
| *** julim has joined #openstack-infra | 02:18 | |
| *** hichihara has joined #openstack-infra | 02:21 | |
| *** mylu has joined #openstack-infra | 02:21 | |
| *** bpokorny has quit IRC | 02:21 | |
| *** aeng has joined #openstack-infra | 02:22 | |
| *** mylu has quit IRC | 02:26 | |
| *** mylu has joined #openstack-infra | 02:27 | |
| *** achanda has quit IRC | 02:27 | |
| *** tphummel has quit IRC | 02:30 | |
| *** achanda has joined #openstack-infra | 02:31 | |
| *** mylu has quit IRC | 02:33 | |
| *** yamahata has quit IRC | 02:34 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:35 | |
| *** kzaitsev_mb has quit IRC | 02:40 | |
| *** Nakato_ is now known as Nakato | 02:44 | |
| *** devkulkarni has quit IRC | 02:45 | |
| *** sflanigan has joined #openstack-infra | 02:45 | |
| *** dims_ has joined #openstack-infra | 02:45 | |
| *** dims has quit IRC | 02:46 | |
| *** sputnik13 has joined #openstack-infra | 03:02 | |
| *** grassass has joined #openstack-infra | 03:03 | |
| *** sdake_ is now known as sdake | 03:07 | |
| *** roxanaghe has joined #openstack-infra | 03:07 | |
| *** torandu has quit IRC | 03:10 | |
| *** torandu has joined #openstack-infra | 03:11 | |
| *** roxanaghe has quit IRC | 03:12 | |
| *** bpokorny has joined #openstack-infra | 03:14 | |
| *** mylu has joined #openstack-infra | 03:16 | |
| *** Qiming has quit IRC | 03:17 | |
| *** sdake_ has joined #openstack-infra | 03:17 | |
| *** sdake has quit IRC | 03:20 | |
| *** yuanying has quit IRC | 03:22 | |
| *** bpokorny has quit IRC | 03:25 | |
| *** baoli has joined #openstack-infra | 03:28 | |
| tonyb | anteaya: Not certain. I need to do a release of yaml2ical which is sort of hung up by the release ATM. | 03:30 |
| *** yamahata has joined #openstack-infra | 03:31 | |
| *** baoli has quit IRC | 03:32 | |
| *** aeng has quit IRC | 03:34 | |
| *** sflanigan has quit IRC | 03:35 | |
| *** kzaitsev_mb has joined #openstack-infra | 03:36 | |
| *** Daisy has quit IRC | 03:37 | |
| *** Daisy has joined #openstack-infra | 03:37 | |
| openstackgerrit | Sachi King proposed openstack-infra/zuul: Support post jobs by supporting rev checkout https://review.openstack.org/293194 | 03:38 |
| *** Nikolay_St has joined #openstack-infra | 03:40 | |
| *** links has joined #openstack-infra | 03:40 | |
| *** yamada-h has joined #openstack-infra | 03:41 | |
| *** tiswanso has quit IRC | 03:42 | |
| *** Daisy has quit IRC | 03:42 | |
| *** kzaitsev_mb has quit IRC | 03:42 | |
| *** sflanigan has joined #openstack-infra | 03:47 | |
| *** sflanigan has joined #openstack-infra | 03:47 | |
| *** dimtruck is now known as zz_dimtruck | 03:50 | |
| *** ramishra has quit IRC | 03:50 | |
| *** aeng has joined #openstack-infra | 03:51 | |
| *** ramishra has joined #openstack-infra | 03:51 | |
| *** sputnik13_ has joined #openstack-infra | 03:54 | |
| anteaya | tonyb: yup, thanks | 03:55 |
| tonyb | anteaya: I have a workaround I can do which is to "require" yaml2ical from git rather than pypi | 03:57 |
| *** yamada-h has quit IRC | 03:57 | |
| tonyb | anteaya: if dhellmann and dims_ are swamped I'll do that rather then the release. | 03:58 |
| anteaya | oh as long as everyone is fine with that | 03:58 |
| anteaya | good idea | 03:58 |
| *** torandu has quit IRC | 03:58 | |
| *** yamada-h has joined #openstack-infra | 03:59 | |
| *** torandu has joined #openstack-infra | 04:00 | |
| *** yamada-h_ has joined #openstack-infra | 04:01 | |
| *** sputnik13_ has quit IRC | 04:02 | |
| *** achanda has quit IRC | 04:03 | |
| *** Daisy has joined #openstack-infra | 04:05 | |
| *** yamada-h has quit IRC | 04:05 | |
| *** IlyaG has joined #openstack-infra | 04:06 | |
| *** akshai has quit IRC | 04:06 | |
| openstackgerrit | Rabi Mishra proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 04:09 |
| *** Daisy has quit IRC | 04:09 | |
| *** IlyaG has quit IRC | 04:10 | |
| *** IlyaG has joined #openstack-infra | 04:10 | |
| *** maishsk has quit IRC | 04:12 | |
| *** nihilifer has quit IRC | 04:15 | |
| openstackgerrit | Nisha Agarwal proposed openstack/diskimage-builder: Install proliantutils in IPA's virtualenv https://review.openstack.org/299116 | 04:16 |
| *** nihilifer has joined #openstack-infra | 04:16 | |
| *** maishsk has joined #openstack-infra | 04:18 | |
| *** fawadkhaliq has joined #openstack-infra | 04:18 | |
| *** maishsk has quit IRC | 04:22 | |
| *** yuanying has joined #openstack-infra | 04:24 | |
| *** yfried has quit IRC | 04:28 | |
| *** harlowja_at_home has joined #openstack-infra | 04:33 | |
| *** rossella_s has quit IRC | 04:34 | |
| *** Daisy has joined #openstack-infra | 04:35 | |
| *** rossella_s has joined #openstack-infra | 04:35 | |
| *** markvoelker has joined #openstack-infra | 04:36 | |
| *** achanda has joined #openstack-infra | 04:37 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:38 | |
| *** esker has joined #openstack-infra | 04:43 | |
| *** kzaitsev_mb has quit IRC | 04:44 | |
| *** resker has joined #openstack-infra | 04:47 | |
| *** erlon has quit IRC | 04:47 | |
| *** esker_ has joined #openstack-infra | 04:48 | |
| *** esker has quit IRC | 04:48 | |
| *** esker has joined #openstack-infra | 04:50 | |
| *** resker has quit IRC | 04:51 | |
| *** esker_ has quit IRC | 04:52 | |
| *** roxanaghe has joined #openstack-infra | 04:53 | |
| openstackgerrit | Merged openstack-infra/project-config: create api-ref publishing pipeline https://review.openstack.org/298888 | 04:54 |
| *** esker has quit IRC | 04:55 | |
| *** yamada-h has joined #openstack-infra | 04:55 | |
| *** MarkAtwood has joined #openstack-infra | 04:56 | |
| *** yamada-h_ has quit IRC | 04:58 | |
| *** yamada-h has quit IRC | 05:02 | |
| *** esker has joined #openstack-infra | 05:04 | |
| *** resker has joined #openstack-infra | 05:05 | |
| *** esker_ has joined #openstack-infra | 05:06 | |
| *** yamada-h has joined #openstack-infra | 05:07 | |
| *** esker has quit IRC | 05:09 | |
| *** resker has quit IRC | 05:10 | |
| *** sputnik13_ has joined #openstack-infra | 05:10 | |
| *** esker has joined #openstack-infra | 05:11 | |
| *** esker_ has quit IRC | 05:11 | |
| *** yamada-h has quit IRC | 05:12 | |
| *** resker has joined #openstack-infra | 05:12 | |
| openstackgerrit | Fredrik Medley proposed openstack-infra/zuul: Improve job dependencies using graph instead of tree https://review.openstack.org/231124 | 05:13 |
| *** jaosorior has joined #openstack-infra | 05:14 | |
| *** esker has quit IRC | 05:16 | |
| *** resker has quit IRC | 05:17 | |
| *** sputnik13_ has quit IRC | 05:17 | |
| *** rlandy has quit IRC | 05:17 | |
| openstackgerrit | Fredrik Medley proposed openstack-infra/zuul: Improve job dependencies using graph instead of tree https://review.openstack.org/231124 | 05:18 |
| *** isaacb has joined #openstack-infra | 05:18 | |
| *** esker has joined #openstack-infra | 05:20 | |
| *** sdake_ has quit IRC | 05:20 | |
| *** mtanino has quit IRC | 05:21 | |
| *** resker has joined #openstack-infra | 05:22 | |
| *** roxanaghe has quit IRC | 05:22 | |
| *** matt6434 is now known as mattoliverau | 05:23 | |
| *** esker_ has joined #openstack-infra | 05:24 | |
| *** esker has quit IRC | 05:24 | |
| *** asselin has quit IRC | 05:24 | |
| *** esker has joined #openstack-infra | 05:25 | |
| *** Nikolay_St has quit IRC | 05:26 | |
| *** resker has quit IRC | 05:26 | |
| *** resker has joined #openstack-infra | 05:26 | |
| *** resker has quit IRC | 05:27 | |
| *** resker has joined #openstack-infra | 05:27 | |
| *** Sukhdev has joined #openstack-infra | 05:28 | |
| *** esker__ has joined #openstack-infra | 05:28 | |
| *** esker_ has quit IRC | 05:29 | |
| *** sdake has joined #openstack-infra | 05:29 | |
| *** esker has quit IRC | 05:30 | |
| *** resker has quit IRC | 05:32 | |
| *** esker__ has quit IRC | 05:33 | |
| *** abregman has joined #openstack-infra | 05:35 | |
| *** mylu has quit IRC | 05:38 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:39 | |
| *** Sukhdev has quit IRC | 05:39 | |
| *** Daisy has quit IRC | 05:40 | |
| *** yamada-h has joined #openstack-infra | 05:40 | |
| *** esikachev has joined #openstack-infra | 05:40 | |
| *** sridhar_ram has joined #openstack-infra | 05:45 | |
| *** sputnik13net has joined #openstack-infra | 05:45 | |
| *** kzaitsev_mb has quit IRC | 05:45 | |
| *** isaacb has quit IRC | 05:46 | |
| *** esker has joined #openstack-infra | 05:46 | |
| *** sdake has quit IRC | 05:48 | |
| *** sputnik13 has quit IRC | 05:48 | |
| *** yfried has joined #openstack-infra | 05:51 | |
| *** sdake has joined #openstack-infra | 05:51 | |
| *** esker has quit IRC | 05:53 | |
| *** sridhar_ram1 has joined #openstack-infra | 05:55 | |
| *** sridhar_ram has quit IRC | 05:57 | |
| *** esikachev has quit IRC | 05:57 | |
| *** jerryz has quit IRC | 05:59 | |
| *** esker has joined #openstack-infra | 05:59 | |
| *** esikachev has joined #openstack-infra | 06:01 | |
| *** harlowja_at_home has quit IRC | 06:01 | |
| *** yamada-h has quit IRC | 06:03 | |
| *** esker has quit IRC | 06:04 | |
| *** camunoz has quit IRC | 06:04 | |
| *** esker has joined #openstack-infra | 06:05 | |
| *** esikachev has quit IRC | 06:08 | |
| *** Sukhdev has joined #openstack-infra | 06:09 | |
| *** esker has quit IRC | 06:09 | |
| *** Douhet has quit IRC | 06:10 | |
| *** markvoelker has quit IRC | 06:10 | |
| *** sputnik13 has joined #openstack-infra | 06:11 | |
| *** Douhet has joined #openstack-infra | 06:12 | |
| *** flepied1 is now known as flepied | 06:13 | |
| *** sridhar_ram1 is now known as sridhar_ram | 06:14 | |
| *** LaT0rtue has quit IRC | 06:15 | |
| *** akaszuba has joined #openstack-infra | 06:17 | |
| *** esikachev has joined #openstack-infra | 06:19 | |
| *** esker has joined #openstack-infra | 06:20 | |
| *** mikelk has joined #openstack-infra | 06:20 | |
| *** scheuran has joined #openstack-infra | 06:22 | |
| *** Nikolay_St has joined #openstack-infra | 06:24 | |
| *** esker has quit IRC | 06:25 | |
| *** rcernin has joined #openstack-infra | 06:26 | |
| *** LaT0rtue has joined #openstack-infra | 06:26 | |
| *** markvoelker has joined #openstack-infra | 06:26 | |
| *** Daisy has joined #openstack-infra | 06:29 | |
| *** esikachev has quit IRC | 06:30 | |
| *** aeng has quit IRC | 06:31 | |
| *** sflanigan has quit IRC | 06:32 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/288849 | 06:33 |
| *** Daisy has quit IRC | 06:34 | |
| *** salv-orlando has joined #openstack-infra | 06:37 | |
| *** daemontool has joined #openstack-infra | 06:37 | |
| *** esker has joined #openstack-infra | 06:38 | |
| *** markvoelker has quit IRC | 06:39 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:39 | |
| *** mrunge_ is now known as mrunge | 06:40 | |
| *** Daisy has joined #openstack-infra | 06:42 | |
| *** esker has quit IRC | 06:43 | |
| yolanda | good morning | 06:43 |
| *** flip214_ is now known as flip214 | 06:44 | |
| *** flip214 has joined #openstack-infra | 06:44 | |
| *** aeng has joined #openstack-infra | 06:44 | |
| *** kzaitsev_mb has quit IRC | 06:45 | |
| *** sflanigan has joined #openstack-infra | 06:45 | |
| *** maishsk has joined #openstack-infra | 06:45 | |
| *** tesseract has joined #openstack-infra | 06:45 | |
| *** tesseract is now known as Guest23157 | 06:46 | |
| *** jlanoux has joined #openstack-infra | 06:46 | |
| *** esker has joined #openstack-infra | 06:51 | |
| *** Thelo has joined #openstack-infra | 06:52 | |
| Thelo | Hi all, in Nodepool which elements is supposed to create the jenkins user into the daily build? | 06:53 |
| *** asettle has quit IRC | 06:53 | |
| *** esker has quit IRC | 06:56 | |
| abregman | Thelo: hi. you mean this?: http://docs.openstack.org/developer/diskimage-builder/elements/devuser/README.html | 06:56 |
| *** nadya has joined #openstack-infra | 06:56 | |
| *** woodster_ has quit IRC | 06:57 | |
| *** zeih has joined #openstack-infra | 06:58 | |
| *** flepied has quit IRC | 06:58 | |
| *** eliqiao_ is now known as eliqiao | 06:58 | |
| *** LaT0rtue has quit IRC | 06:59 | |
| Thelo | abregman: perhaps, to do simple, when I run nodepool build-image I find out that the jenkins user is not there and some of my elements refer to this user. From what I see here I just need to set up some environment variables? | 07:00 |
| *** lezbar has joined #openstack-infra | 07:01 | |
| abregman | Thelo: what elements do you see refer to this user? | 07:01 |
| Thelo | abregman: for example : https://github.com/thelo-gaultier/project-config/blob/master/nodepool/elements/openstack-repos/install.d/95-chown-jenkins | 07:02 |
| *** jtomasek_ has joined #openstack-infra | 07:02 | |
| *** scheuran has quit IRC | 07:04 | |
| Thelo | abregman: then I get error like this ( I added the existing user to check whether jenkins is one of them) http://paste.openstack.org/show/492397/ | 07:05 |
| abregman | hmm yes: chown: invalid user: 'jenkins:jenkins' | 07:06 |
| *** shardy has joined #openstack-infra | 07:07 | |
| *** Sukhdev has quit IRC | 07:08 | |
| *** sridhar_ram has quit IRC | 07:09 | |
| *** arxcruz has joined #openstack-infra | 07:13 | |
| abregman | looks like it assumes you have this user on the system | 07:14 |
| *** nadya has quit IRC | 07:14 | |
| *** esker has joined #openstack-infra | 07:15 | |
| *** LaT0rtue has joined #openstack-infra | 07:15 | |
| *** yamahata has quit IRC | 07:16 | |
| *** yamahata has joined #openstack-infra | 07:17 | |
| *** matrohon has joined #openstack-infra | 07:17 | |
| *** scheuran has joined #openstack-infra | 07:18 | |
| *** esker has quit IRC | 07:20 | |
| Thelo | abregman: you mean the image I am building should have it by default | 07:22 |
| *** yfried has quit IRC | 07:23 | |
| abregman | Thelo: yes but that doesn't make sense | 07:23 |
| *** fawadkhaliq has quit IRC | 07:24 | |
| *** Hal has joined #openstack-infra | 07:24 | |
| *** Hal is now known as Guest7877 | 07:25 | |
| *** esker has joined #openstack-infra | 07:27 | |
| *** ifarkas has joined #openstack-infra | 07:28 | |
| *** mrmartin has joined #openstack-infra | 07:28 | |
| *** ociuhandu has quit IRC | 07:30 | |
| *** daemontool has quit IRC | 07:30 | |
| *** fhubik has joined #openstack-infra | 07:31 | |
| *** permalac has joined #openstack-infra | 07:31 | |
| *** esker has quit IRC | 07:31 | |
| *** ybathia has joined #openstack-infra | 07:32 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Add a job to build openstack-pkg-tools https://review.openstack.org/294022 | 07:34 |
| *** sputnik13 has quit IRC | 07:37 | |
| *** IlyaG has quit IRC | 07:37 | |
| *** sputnik13 has joined #openstack-infra | 07:37 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:37 | |
| openstackgerrit | Oleksandr Berezovskyi proposed openstack-infra/project-config: Add bareon-image-elements project https://review.openstack.org/295167 | 07:37 |
| *** IlyaG has joined #openstack-infra | 07:38 | |
| *** elo has quit IRC | 07:38 | |
| *** elo has joined #openstack-infra | 07:38 | |
| *** markvoelker has joined #openstack-infra | 07:40 | |
| *** jed56 has joined #openstack-infra | 07:40 | |
| *** flepied has joined #openstack-infra | 07:41 | |
| *** ybathia has quit IRC | 07:41 | |
| *** daemontool has joined #openstack-infra | 07:41 | |
| *** hashar has joined #openstack-infra | 07:41 | |
| *** markvoelker has quit IRC | 07:45 | |
| *** esikachev has joined #openstack-infra | 07:47 | |
| *** LaT0rtue has quit IRC | 07:48 | |
| *** sdake_ has joined #openstack-infra | 07:49 | |
| *** nmagnezi has joined #openstack-infra | 07:49 | |
| *** sputnik13 has quit IRC | 07:49 | |
| *** dizquierdo has joined #openstack-infra | 07:50 | |
| *** sdake has quit IRC | 07:51 | |
| *** LaT0rtue has joined #openstack-infra | 07:54 | |
| DuncanT | anteaya: and anybody else who might be interested / able to fix: pages on the wiki that are almost certainly spam (766 entries so far): http://paste.openstack.org/show/492398/ | 07:54 |
| *** jtomasek has quit IRC | 07:58 | |
| *** salv-orlando has quit IRC | 07:58 | |
| *** esker has joined #openstack-infra | 07:59 | |
| trash | SpamapS: Yeah, no problem. But how do we plan to solve this now? :) | 07:59 |
| *** mkoderer__ has quit IRC | 08:00 | |
| *** yamada-h has joined #openstack-infra | 08:00 | |
| *** jordanP has joined #openstack-infra | 08:01 | |
| *** jtomasek_ has quit IRC | 08:01 | |
| *** mkoderer__ has joined #openstack-infra | 08:02 | |
| *** dkehn has quit IRC | 08:03 | |
| *** dkehn has joined #openstack-infra | 08:03 | |
| *** esker has quit IRC | 08:03 | |
| *** Nikolay_St has quit IRC | 08:03 | |
| DuncanT | anteaya: And a second, smaller set - I had case sensitive searching by mistake: http://paste.openstack.org/show/492399/ | 08:04 |
| openstackgerrit | Oleksandr Berezovskyi proposed openstack-infra/project-config: Add bareon-image-elements project https://review.openstack.org/295167 | 08:05 |
| *** esker has joined #openstack-infra | 08:05 | |
| *** Nikolay_St has joined #openstack-infra | 08:07 | |
| *** salv-orlando has joined #openstack-infra | 08:08 | |
| *** dizquierdo has quit IRC | 08:09 | |
| *** hashar has quit IRC | 08:09 | |
| *** tojuvone has quit IRC | 08:10 | |
| *** tojuvone has joined #openstack-infra | 08:10 | |
| *** esker has quit IRC | 08:10 | |
| *** hashar has joined #openstack-infra | 08:10 | |
| *** EricGonczer_ has joined #openstack-infra | 08:14 | |
| openstackgerrit | Merged openstack-infra/project-config: zuul_swift_upload add support for --verbose https://review.openstack.org/269288 | 08:14 |
| *** jlanoux has quit IRC | 08:14 | |
| openstackgerrit | Merged openstack-infra/project-config: Conveyor focuses on cloning and migrating Openstack resources. https://review.openstack.org/296951 | 08:15 |
| openstackgerrit | Merged openstack-infra/system-config: Remove 'Temporary for debugging glance' on jenkins slaves https://review.openstack.org/298806 | 08:15 |
| openstackgerrit | Merged openstack-infra/project-config: Remove oslo.messaging from bandit integration https://review.openstack.org/298366 | 08:16 |
| openstackgerrit | Merged openstack-infra/project-config: Add a periodic mitaka job for TripleO https://review.openstack.org/298369 | 08:18 |
| *** _degorenko|afk is now known as degorenko | 08:18 | |
| *** sfinucan has joined #openstack-infra | 08:18 | |
| openstackgerrit | Merged openstack-infra/project-config: devstack-plugin-nfs: Make tempest non-voting https://review.openstack.org/298774 | 08:19 |
| *** ihrachys has joined #openstack-infra | 08:20 | |
| *** tojuvone has quit IRC | 08:21 | |
| *** tojuvone has joined #openstack-infra | 08:21 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Rename openstack-ansible-ironic to openstack-ansible-os_ironic https://review.openstack.org/299192 | 08:21 |
| *** EricGonczer_ has quit IRC | 08:21 | |
| *** yamahata has quit IRC | 08:22 | |
| *** esker has joined #openstack-infra | 08:22 | |
| *** achanda has quit IRC | 08:23 | |
| *** resker has joined #openstack-infra | 08:23 | |
| *** lucas-dinner is now known as lucasagomes | 08:23 | |
| *** zhurong_ has quit IRC | 08:23 | |
| *** jcoufal has joined #openstack-infra | 08:24 | |
| *** zhurong has joined #openstack-infra | 08:25 | |
| *** jistr has joined #openstack-infra | 08:25 | |
| *** LaT0rtue has quit IRC | 08:27 | |
| *** esker has quit IRC | 08:27 | |
| *** resker has quit IRC | 08:28 | |
| *** dgonzalez has quit IRC | 08:29 | |
| *** derekh has joined #openstack-infra | 08:29 | |
| *** earlephilhower has quit IRC | 08:30 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Deploy ceph in the nonha job https://review.openstack.org/293051 | 08:31 |
| *** sputnik13net has quit IRC | 08:35 | |
| *** dgonzalez has joined #openstack-infra | 08:35 | |
| *** sdake_ has quit IRC | 08:36 | |
| *** tojuvone has quit IRC | 08:37 | |
| *** tojuvone has joined #openstack-infra | 08:37 | |
| *** jlanoux has joined #openstack-infra | 08:41 | |
| *** markvoelker has joined #openstack-infra | 08:42 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Rename openstack-ansible-ironic to openstack-ansible-os_ironic https://review.openstack.org/299192 | 08:45 |
| *** tosky has joined #openstack-infra | 08:46 | |
| odyssey4me | AJaeger is there something specific I'm missing from https://review.openstack.org/299192 ? I did follow that documentation, but it appears to be geared at infra-cores and not really project owners (I can't do things on the puppetmaster, for instance). | 08:46 |
| *** markvoelker has quit IRC | 08:47 | |
| AJaeger | odyssey4me: http://docs.openstack.org/infra/manual/creators.html#project-renames contains everything you can do. | 08:47 |
| AJaeger | Where does it mention puppetmaster? | 08:47 |
| odyssey4me | AJaeger oops, I was reading http://docs.openstack.org/infra/system-config/gerrit.html#renaming-a-project :/ | 08:48 |
| *** ociuhandu has joined #openstack-infra | 08:48 | |
| AJaeger | odyssey4me: That is internal documentation indeed ;) | 08:48 |
| *** e0ne has joined #openstack-infra | 08:48 | |
| AJaeger | You really should follow the short section I gave on your review. | 08:48 |
| AJaeger | Quick check: Check topic and our tracking list "Upcoming Project Renames". | 08:49 |
| AJaeger | odyssey4me: best to reach out to fungi later today and ask him when to do this. | 08:49 |
| AJaeger | Project renames are really bad - a manual process that means downtime for whole of gerrit for at least an hour ;( | 08:50 |
| *** Ramanjaneya has joined #openstack-infra | 08:50 | |
| *** Ramanjaneya has quit IRC | 08:50 | |
| *** Ramanjaneya_ has joined #openstack-infra | 08:50 | |
| AJaeger | odyssey4me: for governance changes, follow best practice and say: | 08:50 |
| mrmartin | yolanda: morning, do you know who can help me from infra side to upgrade the groups-dev.o.o node from precise to trusty? | 08:50 |
| mrmartin | I'll add a patch for system-config's site.pp, but as I understand it is still a manual process. | 08:51 |
| AJaeger | Needed-By: CHANGE-ID in the project-config one - so, Needed-By: I2ab80e4fdb413d469c7aa65e5f018b66cc203b7c | 08:51 |
| *** flepied has quit IRC | 08:51 | |
| odyssey4me | AJaeger yeah, just fixed up the topic and added the rename to the agenda | 08:52 |
| odyssey4me | oh needed-by? that's a new one :) | 08:52 |
| *** Ramanjaneya has joined #openstack-infra | 08:52 | |
| yolanda | mrmartin, in that cases we setup a replacement node, with the new distro. Do you have data that needs to be migrated? or will be ok to have a new server? | 08:52 |
| AJaeger | mrmartin: btw. I stopped the php removal for now, that's something for the future | 08:52 |
| AJaeger | odyssey4me: http://docs.openstack.org/infra/manual/creators.html#add-new-repository-to-the-governance-repository | 08:52 |
| AJaeger | odyssey4me: introduced at the same time as we introduced depends-on | 08:52 |
| AJaeger | odyssey4me: it'S just for documentation purposes - so, the backlink for depends-on | 08:53 |
| mrmartin | yolanda: nothing extra, as it is a dev node, we can rebuild it | 08:53 |
| mrmartin | without any consequences | 08:53 |
| odyssey4me | oh, I seem to have been doing it wrong the whole time | 08:53 |
| odyssey4me | ok, will fix that up now | 08:53 |
| yolanda | i can launch a replacement node for you | 08:53 |
| mrmartin | next to the existing one, or replace it? | 08:54 |
| AJaeger | odyssey4me: not worth a -1 but I noticed it and therefore wanted to bring it up... | 08:54 |
| yolanda | a new one, with new ip addresses | 08:54 |
| * AJaeger will be offline for a while now... | 08:54 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Rename openstack-ansible-ironic to openstack-ansible-os_ironic https://review.openstack.org/299192 | 08:54 |
| yolanda | mrmartin, once it is ready and tested, the dns entry can be changed | 08:54 |
| yolanda | is that ok for you? | 08:54 |
| *** Ramanjaneya_ has quit IRC | 08:54 | |
| odyssey4me | AJaeger thanks - I'll be doing it right from now on :) | 08:54 |
| mrmartin | that's perfect | 08:54 |
| mrmartin | but | 08:55 |
| *** AJaeger has quit IRC | 08:55 | |
| mrmartin | we need to approve those patches first: https://review.openstack.org/298742 https://review.openstack.org/295231 https://review.openstack.org/295208 | 08:55 |
| *** lezbar has quit IRC | 08:55 | |
| mrmartin | it is required for trusty compatibility | 08:55 |
| yolanda | ah, then it will need an extra +2 | 08:55 |
| openstackgerrit | Merged openstack-infra/system-config: Do not install sbcl https://review.openstack.org/298627 | 08:56 |
| yolanda | mrmartin, i think the best is to wait for pabelanger to come online, he usually comes soon, and ask for review | 08:56 |
| yolanda | the i can setup the replacement node | 08:56 |
| mrmartin | ok, I'll try to catch the guys later | 08:56 |
| mrmartin | awesome, thank you | 08:57 |
| *** esker has joined #openstack-infra | 08:57 | |
| yolanda | let's talk later then | 08:57 |
| openstackgerrit | Merged openstack-infra/project-config: fuel-stats: use db setup for python jobs https://review.openstack.org/298800 | 08:58 |
| *** esker has quit IRC | 09:01 | |
| *** achanda has joined #openstack-infra | 09:06 | |
| *** scheuran has quit IRC | 09:07 | |
| *** esker has joined #openstack-infra | 09:08 | |
| *** flepied has joined #openstack-infra | 09:08 | |
| openstackgerrit | Merged openstack-infra/project-config: Add release notes translation scripts https://review.openstack.org/297045 | 09:11 |
| openstackgerrit | Merged openstack-infra/project-config: Run bindep on project-config only if needed https://review.openstack.org/297809 | 09:11 |
| openstackgerrit | Merged openstack-infra/project-config: Remove sbcl from bindep-fallback.txt https://review.openstack.org/298229 | 09:11 |
| *** tojuvone has quit IRC | 09:11 | |
| *** tojuvone has joined #openstack-infra | 09:11 | |
| *** rraja has joined #openstack-infra | 09:12 | |
| *** esker has quit IRC | 09:13 | |
| *** ramineni has quit IRC | 09:13 | |
| *** ramineni has joined #openstack-infra | 09:13 | |
| *** daemontool has quit IRC | 09:17 | |
| *** Ramanjaneya has quit IRC | 09:21 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Use --overcloud-update in the upgrades job https://review.openstack.org/260466 | 09:21 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks https://review.openstack.org/163117 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent https://review.openstack.org/238948 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Lower the log level in tests https://review.openstack.org/263364 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter https://review.openstack.org/243250 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose https://review.openstack.org/247487 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug. https://review.openstack.org/192457 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: support github pull reqeust labels https://review.openstack.org/247421 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts https://review.openstack.org/280667 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github https://review.openstack.org/247500 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub https://review.openstack.org/239138 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: GitHub file matching support https://review.openstack.org/292376 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs https://review.openstack.org/258448 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Log GitHub API rate limit https://review.openstack.org/292377 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow using webapp from connections https://review.openstack.org/215642 | 09:22 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow list values in template parameters. https://review.openstack.org/191208 | 09:22 |
| *** scheuran has joined #openstack-infra | 09:22 | |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 09:22 |
| *** hichihara has quit IRC | 09:23 | |
| *** mescanef has joined #openstack-infra | 09:23 | |
| *** esker has joined #openstack-infra | 09:24 | |
| *** yamada-h has quit IRC | 09:24 | |
| *** nadya has joined #openstack-infra | 09:25 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Upgrade groups-dev.o.o to trusty https://review.openstack.org/299238 | 09:26 |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use IPv6 on the upgrades job https://review.openstack.org/289445 | 09:26 |
| *** esker has quit IRC | 09:29 | |
| *** ramineni has quit IRC | 09:30 | |
| *** yaume has joined #openstack-infra | 09:31 | |
| *** markmcd1 has quit IRC | 09:34 | |
| *** lezbar has joined #openstack-infra | 09:35 | |
| *** esker has joined #openstack-infra | 09:36 | |
| *** maishsk has quit IRC | 09:37 | |
| *** Daisy has quit IRC | 09:37 | |
| *** resker has joined #openstack-infra | 09:38 | |
| *** Daisy has joined #openstack-infra | 09:38 | |
| *** lucasagomes has quit IRC | 09:38 | |
| openstackgerrit | Merged openstack-infra/project-config: Add job to test Nova with specific libvirt and kvm packages https://review.openstack.org/289255 | 09:38 |
| *** esker_ has joined #openstack-infra | 09:39 | |
| *** markmcd has joined #openstack-infra | 09:39 | |
| *** maishsk has joined #openstack-infra | 09:39 | |
| *** maishsk has quit IRC | 09:39 | |
| *** dtantsur|afk is now known as dtantsur | 09:39 | |
| *** Daisy has quit IRC | 09:39 | |
| *** esker__ has joined #openstack-infra | 09:40 | |
| *** Daisy has joined #openstack-infra | 09:40 | |
| openstackgerrit | Stéphane Albert proposed openstack/requirements: Fix use of a renamed itertools function in python3 https://review.openstack.org/299247 | 09:40 |
| *** esker___ has joined #openstack-infra | 09:41 | |
| *** esker has quit IRC | 09:41 | |
| *** maishsk has joined #openstack-infra | 09:42 | |
| *** resker has quit IRC | 09:42 | |
| *** resker has joined #openstack-infra | 09:43 | |
| *** esker_ has quit IRC | 09:43 | |
| *** lucasagomes has joined #openstack-infra | 09:43 | |
| *** markvoelker has joined #openstack-infra | 09:44 | |
| *** esker_ has joined #openstack-infra | 09:44 | |
| *** esker__ has quit IRC | 09:44 | |
| *** Daisy has quit IRC | 09:45 | |
| *** ramineni has joined #openstack-infra | 09:45 | |
| *** esker___ has quit IRC | 09:45 | |
| *** tojuvone has quit IRC | 09:46 | |
| *** tojuvone has joined #openstack-infra | 09:46 | |
| *** markmcd has quit IRC | 09:46 | |
| *** resker has quit IRC | 09:48 | |
| *** esker_ has quit IRC | 09:48 | |
| *** markmcd has joined #openstack-infra | 09:49 | |
| *** markvoelker has quit IRC | 09:49 | |
| *** arxcruz has quit IRC | 09:50 | |
| *** LaT0rtue has joined #openstack-infra | 09:51 | |
| *** arxcruz has joined #openstack-infra | 09:51 | |
| *** eliqiao has quit IRC | 09:52 | |
| *** eliqiao has joined #openstack-infra | 09:53 | |
| *** cdent has joined #openstack-infra | 09:53 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 09:54 |
| mescanef | hello. have here anyone tried nodepool with Ironic? | 09:55 |
| rcarrillocruz | mescanef: what do you mean? | 09:55 |
| rcarrillocruz | running it against a cloud that has nova-ironic | 09:55 |
| rcarrillocruz | nodepool doesn't have a 'plugin' system, where you can choose to boot vms vs bm vs containers | 09:56 |
| rcarrillocruz | (unfortunately) | 09:56 |
| *** esker has joined #openstack-infra | 09:56 | |
| mescanef | rcarrillocruz: yes, Im looking for information if older nodepool version - 0.1.x - is compatibile with this setup | 09:56 |
| rcarrillocruz | well, nodepool talks to nova | 09:56 |
| mescanef | or Ill need nodepool 0.2.x | 09:56 |
| rcarrillocruz | so the stuff you put underneath it | 09:56 |
| rcarrillocruz | it won't care | 09:56 |
| rcarrillocruz | i mean, you could even set up your cloud with nova-docker | 09:56 |
| rcarrillocruz | nodepool would not even know | 09:56 |
| rcarrillocruz | as it just interfaces with nova for 'gimme a server' | 09:57 |
| *** Jeffrey4l has quit IRC | 09:57 | |
| mescanef | rcarrillocruz: oh, great, thanks | 09:57 |
| rcarrillocruz | mescanef: if you play with it, let us know, i'd be curious how it works for you | 09:58 |
| rcarrillocruz | as it was discussed this topic on yesterday's infra meeting | 09:58 |
| *** Qiming has joined #openstack-infra | 09:58 | |
| yolanda | mescanef, yes please, i'm interested on that as well | 09:58 |
| mescanef | yeah there is a plan to run nodepool with ironic, we will see how it goes | 09:58 |
| *** resker has joined #openstack-infra | 09:59 | |
| rcarrillocruz | ++ | 10:00 |
| *** esker has quit IRC | 10:00 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 10:01 |
| *** resker has quit IRC | 10:03 | |
| *** chem has quit IRC | 10:08 | |
| *** esker has joined #openstack-infra | 10:09 | |
| *** chem has joined #openstack-infra | 10:10 | |
| *** resker has joined #openstack-infra | 10:10 | |
| *** resker has quit IRC | 10:11 | |
| *** resker has joined #openstack-infra | 10:11 | |
| *** flepied has quit IRC | 10:12 | |
| *** tojuvone has quit IRC | 10:13 | |
| *** tojuvone has joined #openstack-infra | 10:14 | |
| *** esker has quit IRC | 10:14 | |
| *** achanda has quit IRC | 10:14 | |
| *** tojuvone has quit IRC | 10:14 | |
| odyssey4me | yolanda is there something I need to do in order for https://review.openstack.org/298754 to merge? or is there something unrelated that's gone wrong? | 10:14 |
| *** tojuvone has joined #openstack-infra | 10:15 | |
| odyssey4me | it looks like the irc-access job is failing | 10:15 |
| *** achanda has joined #openstack-infra | 10:16 | |
| *** resker has quit IRC | 10:16 | |
| *** sdague has joined #openstack-infra | 10:16 | |
| yolanda | let me check | 10:17 |
| yolanda | yep, that timeout in check and gate is not good | 10:19 |
| *** zeih has quit IRC | 10:21 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: DO NOT REVIEW https://review.openstack.org/299273 | 10:21 |
| yolanda | i rechecked and will hold the node used for it | 10:22 |
| *** ams_ has joined #openstack-infra | 10:23 | |
| yolanda | i see another that hangs on midonet as well, there is something wrong there for sure | 10:24 |
| krotscheck | I've had another vexxhost node timeout during bindep. Anyone know what's going on? | 10:24 |
| yolanda | krotscheck,i'm debugging another timeout now, but i don't see that as related | 10:25 |
| *** esker has joined #openstack-infra | 10:25 | |
| *** _amrith_ is now known as amrith | 10:26 | |
| *** flepied has joined #openstack-infra | 10:26 | |
| krotscheck | Alrightey. | 10:26 |
| krotscheck | yolanda: Rechecking is safe enough | 10:26 |
| *** resker has joined #openstack-infra | 10:26 | |
| yolanda | yep, try a recheck, and if that continues i can take a look at logs. I have seen the queue very slow today | 10:26 |
| *** achanda has quit IRC | 10:27 | |
| *** esker_ has joined #openstack-infra | 10:28 | |
| *** tojuvone has quit IRC | 10:28 | |
| *** tojuvone has joined #openstack-infra | 10:29 | |
| yolanda | odyssey4me, check seems to be stopping on kolla | 10:30 |
| *** esker has quit IRC | 10:30 | |
| *** resker has quit IRC | 10:31 | |
| *** esker_ has quit IRC | 10:32 | |
| *** maishsk has quit IRC | 10:32 | |
| *** chem has quit IRC | 10:35 | |
| *** esker has joined #openstack-infra | 10:40 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Update wanted_ci_job to reflect current status of things https://review.openstack.org/294071 | 10:41 |
| *** resker has joined #openstack-infra | 10:41 | |
| *** cdent has quit IRC | 10:41 | |
| *** esker_ has joined #openstack-infra | 10:42 | |
| *** esker__ has joined #openstack-infra | 10:43 | |
| *** rraja has quit IRC | 10:44 | |
| *** esker has quit IRC | 10:45 | |
| yolanda | odyssey4me, i have the problem. There is a redirect from kolla to openstack-kolla. When i run the check on openstack-kolla, it works. So i'm going to propose a fix | 10:46 |
| *** LaT0rtue has quit IRC | 10:46 | |
| *** resker has quit IRC | 10:46 | |
| *** esker_ has quit IRC | 10:47 | |
| odyssey4me | yolanda great, thanks | 10:47 |
| *** tojuvone has quit IRC | 10:48 | |
| *** tojuvone has joined #openstack-infra | 10:48 | |
| *** esker__ has quit IRC | 10:48 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Rename kolla channel in accessbot https://review.openstack.org/299286 | 10:49 |
| yolanda | AJaeger, odyssey4me ^ | 10:49 |
| *** zeih has joined #openstack-infra | 10:51 | |
| odyssey4me | thanks yolanda - hopefully that works | 10:51 |
| yolanda | yes, i tested manually and worked | 10:51 |
| openstackgerrit | vikram.choudhary proposed openstack-infra/project-config: Adding neutron-bgp as a part of neutron project. https://review.openstack.org/268726 | 10:52 |
| *** sdague has quit IRC | 10:53 | |
| *** sdague has joined #openstack-infra | 10:53 | |
| yolanda | sdague, can you +2 https://review.openstack.org/299286 ? needed to unlock gate for project-config | 10:56 |
| *** daemontool has joined #openstack-infra | 10:57 | |
| sdague | looking | 10:57 |
| yolanda | thx | 10:57 |
| sdague | +2 | 10:57 |
| yolanda | at least going to send that, but then the proper rename of the channel in all bots needs to be done | 10:58 |
| *** hashar has quit IRC | 10:58 | |
| yolanda | the proper solution should be that the bot doesn't hang on redirects anyway... | 10:58 |
| *** esker has joined #openstack-infra | 11:00 | |
| *** esikachev has quit IRC | 11:01 | |
| *** nadya has quit IRC | 11:02 | |
| *** esker has quit IRC | 11:05 | |
| *** dprince has joined #openstack-infra | 11:05 | |
| *** pblaho has joined #openstack-infra | 11:06 | |
| openstackgerrit | Oleksandr Berezovskyi proposed openstack-infra/project-config: Add bareon-image-elements project https://review.openstack.org/295167 | 11:08 |
| yolanda | sdague, so the change failed. Seems that this check is comparing the channels in accessbot and gerritbot, so i need to do a proper rename to fix it | 11:08 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Rename kolla channel in accessbot https://review.openstack.org/299286 | 11:11 |
| *** maishsk has joined #openstack-infra | 11:11 | |
| *** tojuvone has quit IRC | 11:12 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again https://review.openstack.org/288915 | 11:12 |
| yolanda | #status notice Gate on project-config is currently broken due to IRC tests. The problem has been detected and we are working to fix the issue as soon as possible. | 11:12 |
| openstackstatus | yolanda: sending notice | 11:12 |
| *** tojuvone has joined #openstack-infra | 11:13 | |
| *** esikachev has joined #openstack-infra | 11:14 | |
| -openstackstatus- NOTICE: Gate on project-config is currently broken due to IRC tests. The problem has been detected and we are working to fix the issue as soon as possible. | 11:14 | |
| openstackstatus | yolanda: finished sending notice | 11:15 |
| *** dprince has quit IRC | 11:20 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Tempest for tripleo CI https://review.openstack.org/295844 | 11:21 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 11:21 |
| *** ramineni has quit IRC | 11:21 | |
| *** ericksonsantos has quit IRC | 11:21 | |
| *** esker has joined #openstack-infra | 11:24 | |
| yolanda | sdague, can you +2 again? it passed now | 11:24 |
| *** resker has joined #openstack-infra | 11:25 | |
| sdague | done | 11:25 |
| *** rraja has joined #openstack-infra | 11:25 | |
| yolanda | thanks | 11:25 |
| *** asselin has joined #openstack-infra | 11:26 | |
| yolanda | thx AJaeger as well | 11:26 |
| *** devkulkarni has joined #openstack-infra | 11:27 | |
| *** esker_ has joined #openstack-infra | 11:27 | |
| *** achanda has joined #openstack-infra | 11:27 | |
| openstackgerrit | Julien Danjou proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config https://review.openstack.org/296061 | 11:28 |
| *** esker__ has joined #openstack-infra | 11:28 | |
| *** cdent has joined #openstack-infra | 11:28 | |
| *** esker has quit IRC | 11:28 | |
| *** esker has joined #openstack-infra | 11:29 | |
| *** resker has quit IRC | 11:30 | |
| *** resker has joined #openstack-infra | 11:30 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Added validation to tripleo.sh --overcloud-deploy option. https://review.openstack.org/296362 | 11:31 |
| *** esker_ has quit IRC | 11:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Rename kolla channel in accessbot https://review.openstack.org/299286 | 11:33 |
| *** esker__ has quit IRC | 11:33 | |
| yolanda | nice! time for rechecks | 11:33 |
| *** cj has quit IRC | 11:33 | |
| *** achanda has quit IRC | 11:33 | |
| *** esker has quit IRC | 11:34 | |
| *** resker has quit IRC | 11:34 | |
| *** placko_ has joined #openstack-infra | 11:35 | |
| *** permalac has quit IRC | 11:35 | |
| *** |-paul-| has joined #openstack-infra | 11:36 | |
| *** ramineni has joined #openstack-infra | 11:36 | |
| *** skolekonov|away is now known as skolekonov | 11:37 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Add ironic-staging-drivers-dsvm job https://review.openstack.org/299318 | 11:38 |
| *** tojuvone has quit IRC | 11:41 | |
| *** esker has joined #openstack-infra | 11:41 | |
| *** tojuvone has joined #openstack-infra | 11:41 | |
| *** resker has joined #openstack-infra | 11:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 11:43 |
| *** LaT0rtue has joined #openstack-infra | 11:45 | |
| *** tojuvone has quit IRC | 11:45 | |
| *** ldnunes has joined #openstack-infra | 11:45 | |
| *** Daisy has joined #openstack-infra | 11:45 | |
| *** esker has quit IRC | 11:46 | |
| *** tojuvone has joined #openstack-infra | 11:46 | |
| *** markvoelker has joined #openstack-infra | 11:46 | |
| *** resker has quit IRC | 11:47 | |
| *** placko_ has quit IRC | 11:47 | |
| openstackgerrit | Merged openstack-infra/groups: Remove map panel title from home https://review.openstack.org/298782 | 11:47 |
| *** openstackgerrit has quit IRC | 11:47 | |
| *** dprince has joined #openstack-infra | 11:47 | |
| *** openstackgerrit has joined #openstack-infra | 11:48 | |
| *** huzhj_ has joined #openstack-infra | 11:48 | |
| *** hashar has joined #openstack-infra | 11:48 | |
| *** esker has joined #openstack-infra | 11:50 | |
| *** tojuvone has quit IRC | 11:51 | |
| *** resker has joined #openstack-infra | 11:51 | |
| *** tojuvone has joined #openstack-infra | 11:51 | |
| *** thorst has joined #openstack-infra | 11:51 | |
| *** markvoelker has quit IRC | 11:51 | |
| *** tpsilva has joined #openstack-infra | 11:51 | |
| *** esker_ has joined #openstack-infra | 11:52 | |
| *** esker__ has joined #openstack-infra | 11:53 | |
| *** esker___ has joined #openstack-infra | 11:54 | |
| *** esker has quit IRC | 11:54 | |
| *** nadya has joined #openstack-infra | 11:55 | |
| *** tojuvone has quit IRC | 11:55 | |
| *** resker has quit IRC | 11:55 | |
| *** Daisy has quit IRC | 11:56 | |
| *** resker has joined #openstack-infra | 11:56 | |
| *** nadya has quit IRC | 11:56 | |
| *** tojuvone has joined #openstack-infra | 11:56 | |
| *** Daisy has joined #openstack-infra | 11:56 | |
| *** esker_ has quit IRC | 11:57 | |
| *** nadya has joined #openstack-infra | 11:57 | |
| *** esker__ has quit IRC | 11:57 | |
| *** esker___ has quit IRC | 11:58 | |
| *** Daisy has quit IRC | 12:01 | |
| *** resker has quit IRC | 12:01 | |
| *** placko_ has joined #openstack-infra | 12:03 | |
| openstackgerrit | Merged openstack-infra/project-config: Add Rally role to OpenStack-Ansible https://review.openstack.org/298754 | 12:04 |
| *** |-paul-| has quit IRC | 12:06 | |
| *** weshay has joined #openstack-infra | 12:07 | |
| *** weshay has quit IRC | 12:08 | |
| *** weshay has joined #openstack-infra | 12:09 | |
| *** esker has joined #openstack-infra | 12:10 | |
| *** resker has joined #openstack-infra | 12:11 | |
| *** zeih has quit IRC | 12:12 | |
| *** esker_ has joined #openstack-infra | 12:12 | |
| *** Nikolay_St has quit IRC | 12:13 | |
| *** esker__ has joined #openstack-infra | 12:13 | |
| *** esker___ has joined #openstack-infra | 12:14 | |
| *** esker has quit IRC | 12:15 | |
| *** sfinucan has quit IRC | 12:15 | |
| *** resker has quit IRC | 12:15 | |
| *** esker_ has quit IRC | 12:17 | |
| *** david-lyle_ has joined #openstack-infra | 12:17 | |
| *** david-lyle has quit IRC | 12:17 | |
| *** LaT0rtue has quit IRC | 12:17 | |
| *** esker__ has quit IRC | 12:18 | |
| *** esker___ has quit IRC | 12:19 | |
| *** smarcet has joined #openstack-infra | 12:19 | |
| smarcet | yolanda: morning | 12:19 |
| smarcet | yolanda: i am trying to update metadata.json here https://review.openstack.org/#/c/298699/ | 12:20 |
| smarcet | yolanda: for puppetlabs-apache, but i found that here https://github.com/openstack-infra/system-config/blob/master/modules.env is tied to a commit sha1 not a version number | 12:20 |
| smarcet | so not sure how to reflect that on metadata.json | 12:21 |
| *** pradk has quit IRC | 12:21 | |
| *** pradk has joined #openstack-infra | 12:21 | |
| smarcet | yolanda : { "name": "puppetlabs/apache", "version_requirement": "b9f630a60811694916ecf8758103d4bca2ac6038" } ? | 12:21 |
| *** erlon has joined #openstack-infra | 12:23 | |
| *** esker has joined #openstack-infra | 12:25 | |
| *** lucasagomes is now known as lucas-hungry | 12:25 | |
| *** kgiusti has joined #openstack-infra | 12:26 | |
| *** resker has joined #openstack-infra | 12:26 | |
| *** Guest15833 is now known as Vivek | 12:26 | |
| *** Vivek has quit IRC | 12:26 | |
| *** Vivek has joined #openstack-infra | 12:26 | |
| *** daemontool has quit IRC | 12:27 | |
| *** esker_ has joined #openstack-infra | 12:27 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Update tasks.py to include links https://review.openstack.org/299356 | 12:28 |
| *** esker__ has joined #openstack-infra | 12:28 | |
| *** salv-orl_ has joined #openstack-infra | 12:28 | |
| *** esker has quit IRC | 12:30 | |
| *** resker has quit IRC | 12:30 | |
| *** salv-orlando has quit IRC | 12:31 | |
| *** esker_ has quit IRC | 12:31 | |
| *** daemontool has joined #openstack-infra | 12:32 | |
| *** esker__ has quit IRC | 12:33 | |
| *** LaT0rtue has joined #openstack-infra | 12:33 | |
| *** openstackgerrit has quit IRC | 12:33 | |
| *** openstackgerrit has joined #openstack-infra | 12:33 | |
| *** devkulkarni has quit IRC | 12:34 | |
| *** rossella_s has quit IRC | 12:34 | |
| *** rossella_s has joined #openstack-infra | 12:35 | |
| openstackgerrit | Merged openstack-infra/project-config: Add a microversion-parse project https://review.openstack.org/296046 | 12:36 |
| *** jaosorior has quit IRC | 12:38 | |
| *** aysyd has joined #openstack-infra | 12:39 | |
| *** jaosorior has joined #openstack-infra | 12:39 | |
| *** smarcet has quit IRC | 12:39 | |
| *** baoli has joined #openstack-infra | 12:39 | |
| *** baoli has quit IRC | 12:39 | |
| *** smarcet has joined #openstack-infra | 12:39 | |
| *** baoli has joined #openstack-infra | 12:39 | |
| *** zeih has joined #openstack-infra | 12:39 | |
| *** gordc has joined #openstack-infra | 12:40 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Retire openstack-ansible-os_swift_sync repository https://review.openstack.org/299364 | 12:42 |
| *** aysyd has quit IRC | 12:43 | |
| *** amrith is now known as _amrith_ | 12:44 | |
| *** aysyd has joined #openstack-infra | 12:44 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/requirements: Bump python-ironic-inspector-client to 1.5.0 https://review.openstack.org/299367 | 12:44 |
| *** EricGonczer_ has joined #openstack-infra | 12:44 | |
| *** huzhj has joined #openstack-infra | 12:44 | |
| dtantsur | not sure if requirements are unfrozen already ^^^ | 12:44 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 12:45 |
| *** ayoung has quit IRC | 12:46 | |
| *** markvoelker has joined #openstack-infra | 12:47 | |
| *** huzhj_ has quit IRC | 12:47 | |
| *** e0ne has quit IRC | 12:48 | |
| *** esker has joined #openstack-infra | 12:49 | |
| *** resker has joined #openstack-infra | 12:50 | |
| *** esker_ has joined #openstack-infra | 12:51 | |
| *** markvoelker has quit IRC | 12:51 | |
| *** edmondsw has joined #openstack-infra | 12:52 | |
| *** huzhj_ has joined #openstack-infra | 12:53 | |
| *** baoli_ has joined #openstack-infra | 12:54 | |
| *** esker has quit IRC | 12:54 | |
| *** resker has quit IRC | 12:55 | |
| *** huzhj has quit IRC | 12:55 | |
| *** xyang1 has joined #openstack-infra | 12:55 | |
| *** esker_ has quit IRC | 12:56 | |
| *** eharney has joined #openstack-infra | 12:56 | |
| *** rlandy has joined #openstack-infra | 12:56 | |
| *** baoli has quit IRC | 12:57 | |
| *** amitgandhinz has joined #openstack-infra | 12:57 | |
| *** edmondsw has quit IRC | 12:58 | |
| *** zhurong has quit IRC | 13:01 | |
| *** dtardivel has joined #openstack-infra | 13:01 | |
| *** aysyd has quit IRC | 13:03 | |
| *** aysyd has joined #openstack-infra | 13:03 | |
| *** andymaier has joined #openstack-infra | 13:03 | |
| *** AJaeger has joined #openstack-infra | 13:03 | |
| *** esker has joined #openstack-infra | 13:04 | |
| AJaeger | dims_: I commented on your u-c recommendation - as much as I love to have us ready for this, we're not. | 13:04 |
| *** annegentle has joined #openstack-infra | 13:04 | |
| AJaeger | infra folks: I'm speaking about http://lists.openstack.org/pipermail/openstack-dev/2016-March/090871.html | 13:04 |
| *** placko_ has quit IRC | 13:05 | |
| *** resker has joined #openstack-infra | 13:05 | |
| *** esker_ has joined #openstack-infra | 13:06 | |
| dims_ | AJaeger : ack, we have to keep pushing hopefully in the right direction :) | 13:06 |
| *** abregman is now known as abregman|mtg | 13:07 | |
| *** esker has quit IRC | 13:09 | |
| *** resker has quit IRC | 13:09 | |
| AJaeger | dims_: that trove change is just broken, it will fail to publish tarballs, fail to publish documents ;( | 13:09 |
| *** huzhj__ has joined #openstack-infra | 13:10 | |
| *** esker_ has quit IRC | 13:10 | |
| *** akshai has joined #openstack-infra | 13:10 | |
| AJaeger | dims_: We first need to make u-c foolproof and working in all queues. Projects do not know what is invoked in post queue. Just see my comments on the trove change https://review.openstack.org/#/c/298850 on what is wrong - I hope you educate and review all projects if you push them ;) | 13:11 |
| *** cloudtrainme has joined #openstack-infra | 13:11 | |
| *** huzhj_ has quit IRC | 13:12 | |
| *** [1]Thelo has joined #openstack-infra | 13:16 | |
| *** _ari_ has joined #openstack-infra | 13:17 | |
| *** annegentle has quit IRC | 13:17 | |
| *** mescanef_ has joined #openstack-infra | 13:17 | |
| *** [HeOS] has joined #openstack-infra | 13:18 | |
| *** openstackgerrit has quit IRC | 13:18 | |
| *** placko_ has joined #openstack-infra | 13:18 | |
| *** openstackgerrit has joined #openstack-infra | 13:18 | |
| *** EricGonc_ has joined #openstack-infra | 13:18 | |
| *** nikhil_k has joined #openstack-infra | 13:18 | |
| *** mescanef has quit IRC | 13:19 | |
| *** Thelo has quit IRC | 13:19 | |
| *** [1]Thelo is now known as Thelo | 13:19 | |
| *** hrybacki has quit IRC | 13:19 | |
| AJaeger | zuul cores, could you check Nakato's change for supporting constraints in the post queue, please? https://review.openstack.org/#/c/293194/ That's a major change in setting up the job. | 13:19 |
| *** nikhil has quit IRC | 13:19 | |
| *** edwarnicke has quit IRC | 13:19 | |
| *** ams_ has quit IRC | 13:20 | |
| *** HeOS has quit IRC | 13:20 | |
| *** hrybacki has joined #openstack-infra | 13:21 | |
| *** EricGonczer_ has quit IRC | 13:21 | |
| *** edwarnicke has joined #openstack-infra | 13:21 | |
| *** tiswanso has joined #openstack-infra | 13:22 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Add story_type_id to stories https://review.openstack.org/299390 | 13:24 |
| *** esker has joined #openstack-infra | 13:24 | |
| *** ams_ has joined #openstack-infra | 13:24 | |
| *** doug-fis_ has quit IRC | 13:25 | |
| *** EricGonc_ has quit IRC | 13:26 | |
| *** tmorin has joined #openstack-infra | 13:28 | |
| tmorin | hi everyone | 13:29 |
| tmorin | I'm refining a gate job and running into an issue: the OVS version on the node is very old (version 2.0.2) | 13:29 |
| *** esker has quit IRC | 13:29 | |
| tmorin | what can I do to have a more recent one | 13:29 |
| *** links has quit IRC | 13:30 | |
| *** zhurong_ has joined #openstack-infra | 13:30 | |
| tmorin | (adding a package in devstack/files could be a way, but I'd hope for something lighter) | 13:30 |
| tmorin | dougwig: ^^ maybe you'd have an idea ? | 13:30 |
| *** achanda has joined #openstack-infra | 13:30 | |
| *** akaszuba has quit IRC | 13:31 | |
| matrohon | ajo, ihrachys : ^ | 13:31 |
| *** doug-fish has joined #openstack-infra | 13:31 | |
| *** huzhj__ has quit IRC | 13:32 | |
| matrohon | ajo, ihrachys : I think that qos jobs require a up-to-date version of ovs, am I wrong? | 13:32 |
| *** tonytan4ever has joined #openstack-infra | 13:32 | |
| ihrachys | matrohon: for qos we don't depend on anything that is not avail in gate | 13:32 |
| *** esker has joined #openstack-infra | 13:33 | |
| ihrachys | matrohon: but you should look at how we install new ovs for functional job | 13:33 |
| *** mriedem has joined #openstack-infra | 13:33 | |
| *** Daisy has joined #openstack-infra | 13:33 | |
| matrohon | ihrachys, that's probably in fullstack that I saw a newer version of ovs in use! | 13:33 |
| ihrachys | matrohon: https://github.com/openstack/neutron/blob/master/neutron/tests/contrib/gate_hook.sh#L36 | 13:33 |
| ihrachys | functional it is | 13:33 |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Update Timeline https://review.openstack.org/299395 | 13:34 |
| ihrachys | we use it for the new flow based firewall driver | 13:34 |
| matrohon | ihrachys, great thanks! | 13:34 |
| *** edmondsw has joined #openstack-infra | 13:34 | |
| *** devkulkarni has joined #openstack-infra | 13:34 | |
| *** salv-orl_ has quit IRC | 13:34 | |
| ihrachys | matrohon: and that's the lib for ovs compilation in neutron devstack plugin tree: https://github.com/openstack/neutron/blob/master/devstack/lib/ovs | 13:35 |
| ihrachys | matrohon: there were plans to move it out of tree though | 13:35 |
| AJaeger | fungi, clarkb: Could either of you look later at rossella_s's change for reviewday, please? Question is how to install gerrit-dash-creator. See https://review.openstack.org/#/c/298779 | 13:35 |
| tmorin | ihrachys: thanks a lot | 13:35 |
| ihrachys | matrohon: you need to talk to jlibosva | 13:35 |
| anteaya | DuncanT: thank you, I work on deleting these lists | 13:35 |
| anteaya | I'll | 13:35 |
| *** doug-fish has quit IRC | 13:35 | |
| rossella_s | AJaeger, thanks for raising this point :) | 13:36 |
| *** lucas-hungry is now known as lucasagomes | 13:36 | |
| ihrachys | tmorin: my pleasure | 13:36 |
| mordred | clarkb: apparently the ceph jewel release, which is the next LTS, is in RC and is coming out in the next or two | 13:36 |
| *** achanda has quit IRC | 13:36 | |
| mordred | clarkb: is it worth considering skipping hammer and going straight to jewel? | 13:36 |
| mordred | since it's an LTS, that would potentially reduce the churn we'd have in repos | 13:36 |
| mordred | otoh, I'm guessing hammer is what's out there now | 13:36 |
| matrohon | tmorin, ihrachys : this means that we would better have some functional or fullstack tests rather than gate jobs to test bagpipe | 13:37 |
| *** esker has quit IRC | 13:37 | |
| matrohon | tmorin, ihrachys : I think it would make sense | 13:37 |
| tmorin | matrohon: I think that the functional test ihrachys is talking about are run in the gate, aren't they ? | 13:38 |
| *** annegentle has joined #openstack-infra | 13:38 | |
| ihrachys | matrohon: you won't be able to run *integrated* job with your plugin enabled; but for other jobs that are not common to the whole openstack, you can also have your own ovs version. | 13:38 |
| matrohon | tmorin, yep, non-voting last time I checked | 13:38 |
| pabelanger | EmilienM: we rolled new images last night, I take it you are not having the hiera issue now? | 13:38 |
| ihrachys | matrohon: that said, I really suggest to consider lighter testing like functional or fullstack than pulling the whole stack with nova and friends if you don't really need it | 13:38 |
| EmilienM | pabelanger: not afik, will let you know if I see it | 13:39 |
| ihrachys | tmorin: they are in check queue | 13:39 |
| pabelanger | EmilienM: Ya, I confirmed the correct version of puppet was installed before the upload | 13:39 |
| anteaya | mordred: would that be next day or two, your sentence omitted a unit of time | 13:39 |
| tmorin | matrohon, ihrachys: it seems to me that for us, simply adding our own trustry-compiled OVS-2.4 under ./devstack/files/debs/ would be good enough | 13:39 |
| *** LaT0rtue has quit IRC | 13:39 | |
| EmilienM | pabelanger: nice catch, thanks | 13:39 |
| ihrachys | tmorin: so yes, in that sense they are also kinda 'gate' | 13:39 |
| tmorin | ihrachys: yeah, ok | 13:40 |
| mordred | anteaya: haha | 13:40 |
| ihrachys | tmorin: it may work for you. though then you need to maintain the package. | 13:40 |
| AJaeger | anteaya: year ;) | 13:40 |
| mordred | anteaya: week | 13:40 |
| mordred | anteaya: according to SamYaple | 13:40 |
| anteaya | AJaeger: that's a unit of time, indeed | 13:40 |
| anteaya | mordred: week, that too is a unit of time | 13:40 |
| tmorin | ihrachys: true, versus using the OVS compilation sh routines in neutron/devstack -- that's worth considering | 13:40 |
| pabelanger | AJaeger: fungi: So I talked with ianw, and think we are ready to roll out the centos-7 migration from devstack-centos7 | 13:42 |
| pabelanger | AJaeger: fungi: So, depending on what you think, we can likely start shortly | 13:42 |
| *** annegentle has quit IRC | 13:43 | |
| AJaeger | Seems like we have around 830 jobs on these nodes (local test is a week old) | 13:44 |
| AJaeger | pabelanger: can we start with one or two jobs? | 13:44 |
| anteaya | <-- not really here yet | 13:44 |
| pabelanger | AJaeger: Yup, we can start with a slow roll out | 13:44 |
| pabelanger | confirming this are working, then ramp up | 13:45 |
| openstackgerrit | Luigi Toscano proposed openstack-infra/project-config: [sahara-tests] create and merge, selectivly disable tests https://review.openstack.org/299407 | 13:45 |
| mordred | anteaya: me either | 13:45 |
| AJaeger | pabelanger: yeah... | 13:45 |
| AJaeger | pabelanger: we could start with projects that are already released for mitaka - or don't release - like windmill and puppet | 13:46 |
| pabelanger | AJaeger: Yup, that is a good idea | 13:47 |
| AJaeger | 679 out of 829 jobs have puppet in the name | 13:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add experimental centos-7 puppet-apply https://review.openstack.org/293409 | 13:47 |
| pabelanger | okay, lets wait for fungi and also get some signoff from EmilienM | 13:47 |
| EmilienM | pabelanger: from what I can tell, this morning at 9am all was fine for our CI | 13:48 |
| *** markvoelker has joined #openstack-infra | 13:48 | |
| EmilienM | pabelanger: if nothing happens after, we're good | 13:48 |
| pabelanger | EmilienM: excellent! Just in time for us to do more CI changes :D | 13:48 |
| AJaeger | which leaves us with: cookbooks, ansible, packstack, kolla | 13:48 |
| EmilienM | pabelanger: go ahead! | 13:48 |
| *** zeih has quit IRC | 13:48 | |
| AJaeger | pabelanger: pick one area and go ahead. I'm happy not to be involved this time ;) | 13:49 |
| pabelanger | AJaeger: ack | 13:49 |
| *** doug-fish has joined #openstack-infra | 13:50 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Add repo_url and team_id https://review.openstack.org/299411 | 13:50 |
| *** e0ne has joined #openstack-infra | 13:50 | |
| *** esker has joined #openstack-infra | 13:51 | |
| AJaeger | pabelanger: the dependencies have merged, care to +A https://review.openstack.org/#/c/298913/ , please? | 13:51 |
| AJaeger | pabelanger: I can do that myself ;( Sorry, mixed up repository... | 13:52 |
| *** doug-fis_ has joined #openstack-infra | 13:52 | |
| AJaeger | pabelanger: https://review.openstack.org/#/c/298914/ needs +2A but is not urgent | 13:52 |
| *** markvoelker has quit IRC | 13:52 | |
| *** mriedem is now known as mriedem_meeting | 13:54 | |
| pabelanger | AJaeger: done and done | 13:55 |
| *** doug-fish has quit IRC | 13:55 | |
| *** esker has quit IRC | 13:55 | |
| AJaeger | thansk | 13:56 |
| pabelanger | odyssey4me: if you have a moment to read scroll back, we've looking at updating the ansible-roles-job to use centos-7 dib over devstack-centos7. Wanted to confirm you are okay with us starting on this? | 13:56 |
| openstackgerrit | Merged openstack-infra/puppet-drupal: Support Apache 2.4 https://review.openstack.org/298742 | 13:57 |
| *** tqtran has joined #openstack-infra | 13:57 | |
| fungi | smarcet: pabelanger offered earlier this week to help switching puppet-openstackid over to using the puppetlabs apache module. he may still be willing to pitch in on 298699 if he's not too busy with other things | 13:57 |
| smarcet | fungi: i think that its almost done | 13:58 |
| smarcet | fungi: i just have some doubts on how to update metadata.json | 13:58 |
| *** _amrith_ is now known as amrith | 13:58 | |
| smarcet | fungi: https://review.openstack.org/#/c/298699/13/metadata.json its ok ? | 13:59 |
| odyssey4me | pabelanger yeah, no problem at all - the centos jobs are all nv for us at the moment | 13:59 |
| smarcet | fungi: bc the modules.env on config is tied to a commit sha not to a version # | 13:59 |
| fungi | pabelanger: AJaeger: kicking off devstack-centos7 -> centos-7 seems fine to me. i expect impact to be even less than we say moving from devstack-trusty to ubuntu-trusty | 13:59 |
| AJaeger | pabelanger: if they are all -nv for ansible, that's one place to start, isn't it? | 13:59 |
| *** scheuran has quit IRC | 13:59 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Reset network caches after network create/delete https://review.openstack.org/299420 | 14:00 |
| *** Guest42028 has joined #openstack-infra | 14:00 | |
| odyssey4me | AJaeger pabelanger yeah, it has no impact that would be a problem for OpenStack-Ansible | 14:00 |
| pabelanger | fungi: I think so too | 14:00 |
| pabelanger | AJaeger: odyssey4me: Ya, we can do -nv jobs first, which makes sense | 14:00 |
| fungi | pabelanger: do you have a moment to weigh in on smarcet's metadata.json question for 298699? | 14:01 |
| pabelanger | fungi: sure | 14:01 |
| fungi | you may have better context there since it's having to do with the apache puppet module migration | 14:01 |
| fungi | i'm still trying to untangle a pile of other requests from overnight | 14:01 |
| *** marcusvrn_ has joined #openstack-infra | 14:02 | |
| openstackgerrit | Merged openstack-infra/system-config: Add puppet-drush module to modules.env https://review.openstack.org/295208 | 14:03 |
| smarcet | pabelanger: hey i think that its mostly done , :) | 14:03 |
| smarcet | fungi: tnx ! | 14:03 |
| openstackgerrit | Merged openstack-infra/system-config: Remove libtidy install https://review.openstack.org/298914 | 14:04 |
| openstackgerrit | Merged openstack-infra/project-config: Remove libtidy from bindep https://review.openstack.org/298913 | 14:05 |
| pabelanger | smarcet: fungi: we should really update our version of puppetlabs-apache to 1.8.0, since that was the release that includes our patch. I'm just doing a diff now to see what else was included | 14:05 |
| *** ramineni has quit IRC | 14:05 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Reset network caches after network create/delete https://review.openstack.org/299420 | 14:05 |
| fungi | mrmartin: yolanda: i reviewed and approved the handful of changes needed to support upgrading groups.openstack.org to trusty. last of them should be merging momentarily | 14:05 |
| mrmartin | fungi: thank you, sounds exciting | 14:05 |
| *** LaT0rtue has joined #openstack-infra | 14:05 | |
| *** knikolla has joined #openstack-infra | 14:05 | |
| fungi | i am also happy to boot the replacement server if yolanda is unavailable to do so for a while | 14:06 |
| smarcet | pabelanger: ok bc rite now on modules.env is tied to a commit sha1 | 14:06 |
| *** Guest42028 has quit IRC | 14:07 | |
| *** EricGonczer_ has joined #openstack-infra | 14:08 | |
| Shrews | mordred: so, should we cut a bug fix shade release with this change, or do we want to try to get other things in with it? https://review.openstack.org/298789 | 14:08 |
| pabelanger | smarcet: right | 14:08 |
| *** esker has joined #openstack-infra | 14:08 | |
| mordred | Shrews: I'd like to get the fixes needed for nodepool in too | 14:09 |
| Shrews | mordred: ack | 14:09 |
| mordred | Shrews: which I'm hoping to finish up in a few hours | 14:09 |
| *** resker has joined #openstack-infra | 14:10 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Bump puppetlabs-apache to 1.8.1 https://review.openstack.org/299433 | 14:11 |
| pabelanger | smarcet: fungi: I would suggest testing with ^ | 14:11 |
| *** e0ne has quit IRC | 14:11 | |
| pabelanger | as that is the first release (and latest) to include or vhost::custom patch | 14:11 |
| pabelanger | I've included a diff to compare the changes that have landed | 14:12 |
| *** esikachev has quit IRC | 14:12 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:12 | |
| smarcet | pabelanger: ok i would update metadata.json then | 14:13 |
| *** esker has quit IRC | 14:13 | |
| *** chem has joined #openstack-infra | 14:13 | |
| pabelanger | smarcet: yup, and also add a depends-on in your comment message for the patch above | 14:14 |
| *** scheuran has joined #openstack-infra | 14:14 | |
| pabelanger | smarcet: you can then use that version of puppetlabs-apache locally to test things work as expected | 14:14 |
| *** resker has quit IRC | 14:14 | |
| smarcet | well i am using last one | 14:15 |
| *** e0ne has joined #openstack-infra | 14:16 | |
| smarcet | locally | 14:16 |
| *** markvoelker has joined #openstack-infra | 14:16 | |
| *** zz_dimtruck is now known as dimtruck | 14:17 | |
| *** ajmiller has joined #openstack-infra | 14:19 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 14:19 |
| *** burgerk has joined #openstack-infra | 14:21 | |
| *** jaypipes has joined #openstack-infra | 14:21 | |
| *** eharney has quit IRC | 14:23 | |
| *** nmagnezi has quit IRC | 14:24 | |
| daemontool | AJaeger, ping | 14:24 |
| *** Swami has joined #openstack-infra | 14:26 | |
| *** esikachev has joined #openstack-infra | 14:26 | |
| *** sohail_ has joined #openstack-infra | 14:28 | |
| *** links has joined #openstack-infra | 14:30 | |
| *** oanson has quit IRC | 14:32 | |
| *** jamesmcarthur has joined #openstack-infra | 14:34 | |
| *** armax_ has joined #openstack-infra | 14:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Move ansible-func non-voting to centos-7 dib https://review.openstack.org/299443 | 14:36 |
| pabelanger | AJaeger: odyssey4me: fungi: ^ | 14:37 |
| amrith | AJaeger, yt? | 14:38 |
| odyssey4me | pabelanger LGTM, thanks for the heads-up | 14:38 |
| *** armax has quit IRC | 14:39 | |
| *** armax_ is now known as armax | 14:39 | |
| *** EricGonczer_ has quit IRC | 14:40 | |
| *** abregman|mtg has quit IRC | 14:40 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Add boards https://review.openstack.org/299445 | 14:41 |
| *** cloudtrainme has quit IRC | 14:42 | |
| *** jsavak has joined #openstack-infra | 14:43 | |
| openstackgerrit | Markus Zoeller (markus_z) proposed openstack-infra/project-config: fix testing job "tempest-dsvm-nova-libvirt-kvm-apr" https://review.openstack.org/299447 | 14:44 |
| *** dizquierdo has joined #openstack-infra | 14:44 | |
| *** sdake has joined #openstack-infra | 14:44 | |
| *** hogepodge has quit IRC | 14:44 | |
| *** Sukhdev has joined #openstack-infra | 14:45 | |
| *** mriedem_meeting is now known as mriedem | 14:45 | |
| *** mtanino has joined #openstack-infra | 14:45 | |
| *** annegent_ has joined #openstack-infra | 14:46 | |
| *** markvoelker has quit IRC | 14:46 | |
| *** eharney has joined #openstack-infra | 14:47 | |
| rcarrillocruz | mordred: | 14:48 |
| rcarrillocruz | heya | 14:48 |
| rcarrillocruz | around | 14:48 |
| rcarrillocruz | ? | 14:48 |
| *** links has quit IRC | 14:49 | |
| *** esker has joined #openstack-infra | 14:49 | |
| mrmartin | yolanda: it was timed out and got -2 from Jenkins: https://review.openstack.org/#/c/295231/ what is the proper way to restart the job? | 14:50 |
| *** dtantsur is now known as dtantsur|bbl | 14:52 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Add worklists https://review.openstack.org/299454 | 14:53 |
| jpmaxman | pabelanger: just curious why this apache module is a dependency for our patch to go through? | 14:53 |
| fungi | jpmaxman: our (legacy) httpd module did not provide a mechanism for selecting the apache mpm and defaulted to whatever the distro selects instead (apache2-mpm-prefork package on ubuntu precise, for example) | 14:54 |
| fungi | we've been underway with a peicemeal migration to the upstream puppetlabs apache module for a while | 14:55 |
| *** MarkAtwood has quit IRC | 14:55 | |
| *** tmorin has left #openstack-infra | 14:55 | |
| *** cdent has quit IRC | 14:55 | |
| *** esker has quit IRC | 14:55 | |
| *** maishsk has quit IRC | 14:56 | |
| rcarrillocruz | mordred: about to disconnect shortly | 14:56 |
| rcarrillocruz | but | 14:56 |
| rcarrillocruz | https://github.com/rcarrillocruz/ansible-openstack-cloud-launcher | 14:56 |
| rcarrillocruz | which is explained in | 14:56 |
| rcarrillocruz | http://rcarrillocruz.com/deploying-multiple-openstack-clouds-with-ansible-in-a-data-driven-fashion/ | 14:56 |
| *** sdake_ has joined #openstack-infra | 14:56 | |
| rcarrillocruz | let me know what you think | 14:56 |
| rcarrillocruz | i plan on putting more enhancements, but the main functionality is there | 14:56 |
| mordred | rcarrillocruz: cool! I will look/read | 14:57 |
| *** sdake has quit IRC | 14:57 | |
| rcarrillocruz | one of the enhancements is the multi-region region resources on multi-region clouds.yaml clouds, but that needs fixing on ansible modules | 14:58 |
| *** thiagop has joined #openstack-infra | 14:58 | |
| *** yamahata has joined #openstack-infra | 14:58 | |
| *** fedexo has joined #openstack-infra | 14:58 | |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config: Add NFS job to Cinder experimental https://review.openstack.org/299455 | 14:58 |
| pabelanger | jpmaxman: what fungi said | 14:59 |
| yolanda | hi, i am back | 15:00 |
| mordred | rcarrillocruz: dude. I need to play with it in anger - but reading the example and the blog post - nicely done! | 15:00 |
| rcarrillocruz | ;-) | 15:00 |
| *** jsavak has quit IRC | 15:01 | |
| *** annegent_ has quit IRC | 15:02 | |
| pabelanger | fungi: clarkb: pleia2: Did we want to roll the dice on our ubuntu-xenial dib for nodepool? Even thought it is not stable yet? https://review.openstack.org/#/c/297981/ | 15:02 |
| pabelanger | give people the change to start experimenting with it? | 15:02 |
| jpmaxman | pabelanger fungi understood. I just want to make sure we're not holding this up because we're seeing things that ideally should be upgraded but if they weren't upgraded the patch would still be fine. In other words, should these things maybe be proposed as a separate patch and not as a dependency to this one? In our tests, adding in the PHP5-FPM module | 15:03 |
| jpmaxman | adjusted httpd to use the correct mpm | 15:03 |
| pabelanger | clarkb: Also, I did run devstack-gate on xenial, and found some issues. Didn't actually get devstack running | 15:03 |
| fungi | pabelanger: i'm not opposed to starting to build images for it. we should make it very clear to anyone who tries to configure jobs for it that it's experimental use only for now | 15:03 |
| pabelanger | fungi: agreed | 15:03 |
| pabelanger | fungi: and once we land it, I can restart nodepool-builder to pick it up | 15:04 |
| fungi | jpmaxman: it can be split up into separate dependent patches in series for ease of reviewing. i'll leave it to pabelanger as to whether it's possible to move forward with the metadata.json pin to a git sha, but it sounds like it becomes far simpler with the latest puppetlabs module | 15:04 |
| fungi | pabelanger: how many services do we have relying on that module at the moment? | 15:05 |
| fungi | not many, right? i'd be fine pressing forward as long as it passes tests | 15:05 |
| jpmaxman | fungi ok if it is simpler I'm all for it ;) | 15:05 |
| pabelanger | fungi: none right now. I have a nodepool patch up | 15:05 |
| jpmaxman | I just want to make sure that it isn't a cascading change | 15:06 |
| fungi | pabelanger: okay, in that case merging the update to a proper release version should be completely non-impacting | 15:06 |
| *** jsavak has joined #openstack-infra | 15:06 | |
| *** roxanaghe has joined #openstack-infra | 15:06 | |
| pabelanger | yes | 15:06 |
| pabelanger | I figured openstackid could test it out, since they needed new functionality | 15:06 |
| jpmaxman | when the objective is to get this patch in place to allow the server to handle more requests and not be crushed by load ;) | 15:06 |
| fungi | jpmaxman: yep, i'm all for that | 15:06 |
| *** esker has joined #openstack-infra | 15:07 | |
| fungi | seeing what we can do to get this in place in a maintainable fashion asap | 15:07 |
| jpmaxman | also it's my understanding we're going to do this in dev first | 15:07 |
| jpmaxman | :) | 15:07 |
| jpmaxman | I understand you have to see the bigger picture for these changes beyond just how it affects openstackid | 15:08 |
| fungi | jpmaxman: correct, probably easiest given the significant size of the config management rework there to just temporarily disable puppet/ansible runs for production. it's a one-line patch to teh system-config repo which i'll go ahead and propose if someone else hasn't yet | 15:08 |
| *** sdake has joined #openstack-infra | 15:08 | |
| jpmaxman | fungi: yes that would be great - thank you | 15:08 |
| fungi | then as soon as we see it work for openstackid-dev.openstack.org, we can revert the disablement | 15:08 |
| fungi | and it will roll to produciton at that point | 15:08 |
| fungi | or the version of that word which has some letters in a different order anyway ;) | 15:09 |
| jpmaxman | a prediction that production will produce | 15:10 |
| *** sdake_ has quit IRC | 15:10 | |
| openstackgerrit | Merged openstack-infra/puppet-drupal: Refactor drush deployment https://review.openstack.org/295231 | 15:10 |
| fungi | precisely! | 15:10 |
| *** roxanaghe has quit IRC | 15:11 | |
| openstackgerrit | Victor Ryzhenkin proposed openstack-infra/project-config: Add murano non-voting job with glare backend https://review.openstack.org/299465 | 15:11 |
| *** esker has quit IRC | 15:11 | |
| *** akaszuba has joined #openstack-infra | 15:11 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Move ansible-func non-voting to centos-7 dib https://review.openstack.org/299443 | 15:13 |
| AJaeger | amrith, I'll review your change now. daemontool, what's up? | 15:13 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support provider networks in public network detection https://review.openstack.org/298890 | 15:15 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Mutex protect internal/external network detection https://review.openstack.org/298927 | 15:15 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Temporarily disable Puppet runs on openstackid.org https://review.openstack.org/299466 | 15:15 |
| jpmaxman | ok so if I understand correctly we're going to leave the patch as is, disable puppet/ansible production runs, then (hopefully) approve the patch so it goes to openstackid-dev.openstack.org | 15:15 |
| fungi | smarcet: jpmaxman: pabelanger: ^ there's the disablement | 15:15 |
| openstackgerrit | Merged openstack-infra/system-config: Bump puppetlabs-apache to 1.8.1 https://review.openstack.org/299433 | 15:15 |
| daemontool | AJaeger, all sorted thanks | 15:15 |
| fungi | jpmaxman: right | 15:15 |
| jpmaxman | great | 15:15 |
| jpmaxman | :D | 15:16 |
| fungi | jpmaxman: and the upgrade to a proper release of the puppetlabs apache module is already winding its way to merging | 15:16 |
| AJaeger | daemontool: great ;) | 15:16 |
| yolanda | mrmartin, changes passed now, going to setup the replacement node | 15:16 |
| jpmaxman | ok cool - have to jump into a meeting, but will check back in an hour or so - appreciate it | 15:17 |
| yolanda | mrmartin, you need groups-dev, right? | 15:17 |
| fungi | jpmaxman: sure thing! i'm excited to see what this manages to scale to | 15:17 |
| mrmartin | yolanda, yes | 15:17 |
| *** jsavak has quit IRC | 15:18 | |
| *** jsavak has joined #openstack-infra | 15:18 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Add boards https://review.openstack.org/299445 | 15:19 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Add pypi and resource links to README.rst https://review.openstack.org/297524 | 15:20 |
| *** Daisy_ has joined #openstack-infra | 15:21 | |
| *** mikelk has quit IRC | 15:21 | |
| *** Guest23157 has quit IRC | 15:21 | |
| *** sc68cal has joined #openstack-infra | 15:21 | |
| *** annegentle has joined #openstack-infra | 15:22 | |
| *** Daisy has quit IRC | 15:24 | |
| *** Daisy_ has quit IRC | 15:25 | |
| *** Sukhdev has quit IRC | 15:25 | |
| *** jamesmcarthur has quit IRC | 15:25 | |
| *** Sukhdev has joined #openstack-infra | 15:26 | |
| *** zeih has joined #openstack-infra | 15:26 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: OAuth2.0 app name edition https://review.openstack.org/299471 | 15:26 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Use Fedora 23 atomic in container gate https://review.openstack.org/293108 | 15:27 |
| *** LaT0rtue has quit IRC | 15:27 | |
| rcarrillocruz | bbl folks | 15:27 |
| *** annegentle has quit IRC | 15:28 | |
| *** markvoelker has joined #openstack-infra | 15:29 | |
| *** esikachev has quit IRC | 15:29 | |
| yolanda | ok, launch node running | 15:29 |
| *** jamesmcarthur has joined #openstack-infra | 15:30 | |
| pabelanger | yolanda: AJaeger: https://review.openstack.org/#/c/299443/ if you don't mind. first centos-7 migration | 15:30 |
| *** devkulkarni has quit IRC | 15:31 | |
| openstackgerrit | Merged openstack-infra/project-config: fix testing job "tempest-dsvm-nova-libvirt-kvm-apr" https://review.openstack.org/299447 | 15:31 |
| pabelanger | fungi: Do you mind +A https://review.openstack.org/#/c/297981/ if you are happy with nodepool starting on ubuntu-xenial | 15:31 |
| AJaeger | pabelanger: just +2ed ;) | 15:31 |
| *** devkulkarni has joined #openstack-infra | 15:31 | |
| AJaeger | pabelanger: was just going to comment that this looks like a safe bet ;) | 15:32 |
| *** cloudtrainme has joined #openstack-infra | 15:32 | |
| yolanda | ok approved | 15:32 |
| pabelanger | great | 15:32 |
| *** woodster_ has joined #openstack-infra | 15:32 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Change #kolla to point to #openstack-kolla https://review.openstack.org/298999 | 15:32 |
| *** matrohon has quit IRC | 15:32 | |
| AJaeger | pabelanger: we have min-ready: 2 for devstack-centos7 and 1 for centos7 - should we increase the value for centos7? 2 looks little for the number of tests we will have (800+) | 15:33 |
| *** achanda has joined #openstack-infra | 15:34 | |
| AJaeger | sdake: let's not do the eavesdrop change via gerrit, please ;) | 15:34 |
| openstackgerrit | Merged openstack-infra/project-config: Remove gnome-doc-utils from bindep https://review.openstack.org/298917 | 15:34 |
| pabelanger | AJaeger: lets see how the patch works first, then we can look at swaping out the min-ready values | 15:34 |
| *** yaume has quit IRC | 15:35 | |
| fungi | AJaeger: eavesdrop change via gerrit... is that in reference to the accessbot wedge from this morning? | 15:35 |
| AJaeger | fungi, in reference to 298999 | 15:35 |
| *** Sukhdev has quit IRC | 15:35 | |
| *** yaume has joined #openstack-infra | 15:35 | |
| AJaeger | fungi , the commit message contains " Please also move the eavesdrop logs. TIA :)" | 15:36 |
| openstackgerrit | Merged openstack-infra/system-config: Temporarily disable Puppet runs on openstackid.org https://review.openstack.org/299466 | 15:36 |
| *** sridhar_ram has joined #openstack-infra | 15:37 | |
| fungi | AJaeger: oh, right. i'm not convinced there's any issue with having the old channel logs under the old channel name, but if they were moved it would require assistance from a root sysadmin on eavesdrop.openstack.org | 15:37 |
| AJaeger | fungi, agreed - and that's why it doesn't belong in the commit message... | 15:38 |
| AJaeger | sdake: ^ | 15:38 |
| *** yamahata has quit IRC | 15:38 | |
| *** mrmartin has quit IRC | 15:38 | |
| *** achanda has quit IRC | 15:39 | |
| openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Add repo_url and team_id https://review.openstack.org/299411 | 15:39 |
| *** MarkAtwood has joined #openstack-infra | 15:39 | |
| AJaeger | fungi, do you have time to look at rossella_s's https://review.openstack.org/#/c/298779 for reviewday, please? How do we get gerrit-dash-board installed? | 15:40 |
| *** jamesmcarthur has quit IRC | 15:41 | |
| amrith | AJaeger, I've never ever looked at the output of post jobs. Where does one go for that? | 15:41 |
| openstackgerrit | Merged openstack-infra/project-config: Move ansible-func non-voting to centos-7 dib https://review.openstack.org/299443 | 15:41 |
| *** armax has quit IRC | 15:41 | |
| openstackgerrit | vikram.choudhary proposed openstack-infra/project-config: Adding neutron-bgp as a part of neutron project. https://review.openstack.org/268726 | 15:41 |
| *** yolanda has quit IRC | 15:42 | |
| amrith | is it to wait for the job on zuul and then look for it; that seems like the wrong way to me and google didn't give a better answer. | 15:42 |
| *** asselin__ has joined #openstack-infra | 15:42 | |
| *** armax has joined #openstack-infra | 15:42 | |
| AJaeger | amrith: grab the sha of a job, and then http://logs.openstack.org/first-two-chars-of-sha/full-sha | 15:42 |
| amrith | thanks AJaeger | 15:42 |
| openstackgerrit | Sam Betts proposed openstack-infra/project-config: Add post job for building and uploading tinyipa https://review.openstack.org/299485 | 15:42 |
| *** dprince has quit IRC | 15:43 | |
| *** jamesmcarthur has joined #openstack-infra | 15:43 | |
| AJaeger | amrith: for current head: http://logs.openstack.org/d6/d6d212fe454ff82ec7a8e76715a7321d0d567d39/ | 15:43 |
| *** smarcet has quit IRC | 15:43 | |
| *** dkehn has quit IRC | 15:43 | |
| *** dprince has joined #openstack-infra | 15:43 | |
| amrith | great, looking through it now | 15:43 |
| *** dkehn has joined #openstack-infra | 15:44 | |
| *** permalac has joined #openstack-infra | 15:44 | |
| openstackgerrit | Merged openstack-infra/project-config: Add ubuntu-xenial DIB to nodepool https://review.openstack.org/297981 | 15:44 |
| * timrc can't figure out how https://github.com/OpenStackweb/openstack-org is developed. I introduced the PR but rather than pulling it in and rebasing, it appears the fix was incorporated into an unrelated change that was merged (and not by PR) *shrug* | 15:45 | |
| *** asselin has quit IRC | 15:45 | |
| *** MarkAtwood has quit IRC | 15:45 | |
| *** piet has joined #openstack-infra | 15:46 | |
| *** flwang1 has quit IRC | 15:46 | |
| *** annegentle has joined #openstack-infra | 15:46 | |
| Zara | anteaya: so, it looks like I'm gonna be taking over the efforts to fiiiiinally hook up storyboard to gerrit, over the next couple of weeks. Do you have any pointers on where to start? (I'm asking you as I think you suggested pedro contact you about it, earlier) | 15:46 |
| sdake | AJaeger i can change the commit message | 15:46 |
| *** yolanda has joined #openstack-infra | 15:46 | |
| *** roxanaghe has joined #openstack-infra | 15:46 | |
| sdake | AJaeger however, i would really appreciate having the logs moved aorund | 15:46 |
| sdake | the reason being people use the logs all the time | 15:47 |
| *** kzaitsev_mb has quit IRC | 15:47 | |
| pabelanger | timrc: Ya, not sure why its not done on review.o.o too | 15:47 |
| sdake | jeblair (I think) suggested adding a requestin the comit message to have the logs moved | 15:47 |
| *** fhubik has quit IRC | 15:47 | |
| sdake | but I could be wrong | 15:47 |
| sdake | or misunderstood him | 15:47 |
| *** scheuran has quit IRC | 15:48 | |
| sdake | or imagining it all | 15:48 |
| sdake | 18 hour day monday and tuesday, bit tired :) | 15:48 |
| AJaeger | sdake: not every project-config reviewer is root, so you will not get a +2 from me on a change that I cannot act on ;) | 15:49 |
| *** arxcruz has quit IRC | 15:49 | |
| sdake | AJaeger ok i'll handle them serpately | 15:49 |
| sdake | moment | 15:49 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Change #kolla to point to #openstack-kolla https://review.openstack.org/298999 | 15:50 |
| *** jamesmcarthur has quit IRC | 15:51 | |
| *** annegentle has quit IRC | 15:51 | |
| timrc | pabelanger: Yeah... I wondered that too. | 15:51 |
| *** cbader_ has quit IRC | 15:52 | |
| AJaeger | sdake: and see my comment on the commit message, it's now completely wrong... | 15:52 |
| *** cbader has joined #openstack-infra | 15:52 | |
| openstackgerrit | Merged openstack-infra/openstackid: OAuth2.0 app name edition https://review.openstack.org/299471 | 15:53 |
| *** nwkarsten has joined #openstack-infra | 15:53 | |
| *** obondarev has joined #openstack-infra | 15:53 | |
| *** abregman has joined #openstack-infra | 15:54 | |
| sdake | AJaeger i have no idea how that happened | 15:54 |
| *** Sukhdev has joined #openstack-infra | 15:54 | |
| * sdake must be having an 8am day today :) | 15:54 | |
| bkero | 8AM? Where are you? | 15:55 |
| bkero | On a boat in the pacific? | 15:55 |
| timrc | pabelanger: The gerrit development workflow w/ gating, git review and gertty... can you get much better? Also, there's something to be said for consistency. | 15:55 |
| *** tosky has quit IRC | 15:55 | |
| AJaeger | sdake: the channel redirect broke our infra jobs, so yolanda merged a quick fix without seeing your change - and therefore now most of it is obsolete | 15:56 |
| sdake | rather 9am | 15:56 |
| *** apoorvad has joined #openstack-infra | 15:56 | |
| sdake | i nphonix | 15:56 |
| bkero | Ah | 15:56 |
| *** imcsk8 is now known as imcsk8|afk | 15:56 | |
| sdake | AJaeger ok so all is good then? | 15:56 |
| yolanda | yep, i asked in openstack-kolla channel, to confirm the channel rename, and sent a quick fix for it, because changes on project-config were not passing. Sorry if I missed some pending change about it | 15:56 |
| sdake | AJaeger sorry - igeuss that the gerrit changes need to be depends_on for the actual rename | 15:56 |
| sdake | plea2 setup those docs iirc or pointed them out | 15:57 |
| sdake | yolanda i submitted changes | 15:57 |
| sdake | but the gate was in a state of not owrking yesterday | 15:57 |
| AJaeger | sdake: yeah, all is good now. We should have merged your change *directly* after you set up the redirect ;( | 15:57 |
| *** jamesmcarthur has joined #openstack-infra | 15:57 | |
| AJaeger | Or before ;) | 15:58 |
| *** tosky has joined #openstack-infra | 15:58 | |
| *** kzaitsev_mb has joined #openstack-infra | 15:58 | |
| yolanda | yep, once the redirect was done, it caused that check to fail with timeout | 15:58 |
| AJaeger | sdake: your change also removed notifications for some branches, this is somthing you still might want to do | 15:58 |
| fungi | well, hopefully someone's also working on an accessbot patch to not hang indefinitely when it encounters that condition in the future | 15:58 |
| *** gyee has joined #openstack-infra | 15:58 | |
| *** yaume has quit IRC | 15:59 | |
| *** maishsk has joined #openstack-infra | 15:59 | |
| *** ericksonsantos has joined #openstack-infra | 15:59 | |
| sdake | AJaeger those branches are gone now | 15:59 |
| sdake | but I will fix that | 15:59 |
| *** flwang1 has joined #openstack-infra | 15:59 | |
| obondarev | hi there, could someone help me with the issue I have: people (and even myself) can't add me as a reviewer using my email obondarev@mirantis.com. Gerrit says "Oleg Bondarev <obondarev@mirantis.com> does not identify a registered user or group" while I'm registered in fact | 15:59 |
| sdake | AJaeger they wer edeleted, but i'll submit a patch for that | 15:59 |
| fungi | obondarev: that usually means you have more than one gerrit account fighting over the same e-mail address | 15:59 |
| fungi | obondarev: i'll look in the db and see what needs cleaning up | 16:00 |
| obondarev | fungi: great! | 16:00 |
| *** yamahata has joined #openstack-infra | 16:00 | |
| *** rajinir has joined #openstack-infra | 16:00 | |
| obondarev | fungi: thanks! | 16:00 |
| yolanda | fungi i debugged the issue and that happens that irc library level. I saw where it fails but haven't started any work on it | 16:00 |
| fungi | obondarev: in fact, there are three active Oleg Bondarevs in gerrit, all with that preferred e-mail address | 16:01 |
| obondarev | fungi: I see, not sure how that happened | 16:02 |
| *** salv-orlando has joined #openstack-infra | 16:02 | |
| *** sputnik13 has joined #openstack-infra | 16:02 | |
| fungi | obondarev: usually happens if you authenticate through login.launchpad.net with different e-mail addresses | 16:02 |
| obondarev | fungi: can we leave just one account? | 16:03 |
| *** Rockyg has joined #openstack-infra | 16:03 | |
| *** MarkAtwood has joined #openstack-infra | 16:03 | |
| fungi | obondarev: i'm going to attempt to merge the additional openids into 5948 and then mark the 5949 and 5951 accounts inactive | 16:03 |
| *** annegentle has joined #openstack-infra | 16:03 | |
| *** Guest7877 has quit IRC | 16:03 | |
| *** Qiming has quit IRC | 16:03 | |
| obondarev | fungi: nice, thanks | 16:03 |
| fungi | obondarev: given the close proximity of the account ids, i have a feeling this happened right at the time you were first creating your account several years ago, and has been this way ever since | 16:03 |
| *** zeih has quit IRC | 16:03 | |
| *** akaszuba has quit IRC | 16:03 | |
| obondarev | fungi: I guess so yeah | 16:04 |
| openstackgerrit | Graham Hayes proposed openstack/requirements: Bump UC for python-designateclient to 2.0.1 https://review.openstack.org/299502 | 16:04 |
| fungi | obondarev: in fact, it looks like some cleanup may already have been done since 5949 and 5951 have no external ids, so i'm just going to mark those as inactive and it should solve the issue | 16:04 |
| Zara | (oh, also, more general question-- people where I work are looking at gitlab for some things; wondered if infra people considered it at any point and rejected it for reasons we should be aware of?) | 16:05 |
| obondarev | fungi: let's try | 16:05 |
| *** annegentle has quit IRC | 16:05 | |
| *** jlanoux has quit IRC | 16:05 | |
| *** kzaitsev_mb has quit IRC | 16:05 | |
| *** jaosorior has quit IRC | 16:06 | |
| fungi | Zara: it was commercial only until fairly recently, now it's open core (they keep the good stuff for their paying customers) | 16:06 |
| *** dtantsur|bbl is now known as dtantsur | 16:06 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Remove duplicate FakeServer class from unit tests https://review.openstack.org/299505 | 16:06 |
| * AJaeger will be back later | 16:06 | |
| fungi | obondarev: okay, the two duplicates have been set inactive and i've flushed gerrit's caches, so see if things are any better now | 16:06 |
| *** zeih has joined #openstack-infra | 16:06 | |
| Zara | fungi: ahhh, right. perhaps not a problem for my employer, then, though a pita if they later want me to integrate storyboard. \o/ | 16:07 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Remove duplicate FakeServer class from unit tests https://review.openstack.org/299505 | 16:07 |
| fungi | Zara: i don't know a whole lot more about it, other than they've recently started working with debian to get it packaged and for the debian community to maybe run a public instance of it (possibly as an alioth v2 sort of solution i think?) | 16:08 |
| *** smarcet has joined #openstack-infra | 16:08 | |
| *** stevemar has quit IRC | 16:08 | |
| * Zara searches alioth | 16:09 | |
| Zara | thanks :) | 16:09 |
| obondarev | fungi: solved! thank you very much! | 16:09 |
| fungi | Zara: sorry, alioth is debian's current public collaborative source code management interface | 16:09 |
| fungi | Zara: https://alioth.debian.org/ | 16:10 |
| *** doug-fish has joined #openstack-infra | 16:10 | |
| Zara | fungi: I found it, thanks! :) | 16:10 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Remove duplicate FakeServer class from unit tests https://review.openstack.org/299505 | 16:10 |
| fungi | they do more than source code management with it of course | 16:10 |
| clarkb | gitlab is basically github from a few years ago | 16:10 |
| *** jistr has quit IRC | 16:10 | |
| clarkb | which lacks in the code review department (github still does) | 16:10 |
| *** dizquierdo has quit IRC | 16:11 | |
| fungi | clarkb: well, the for-pay version might be up to github standards! | 16:11 |
| bkero | Their pay-for has some things that github doesn't | 16:11 |
| bkero | like real hooks | 16:11 |
| *** jamesmcarthur has quit IRC | 16:11 | |
| * fungi doesn't know how core their open core really is) | 16:11 | |
| *** cdent has joined #openstack-infra | 16:11 | |
| bkero | and ldap group sync | 16:11 |
| *** salv-orlando has quit IRC | 16:11 | |
| *** doug-fis_ has quit IRC | 16:12 | |
| bkero | and multiple forks per user | 16:12 |
| bkero | and per-path commit access | 16:12 |
| bkero | and has a more complete API | 16:13 |
| *** jamesmcarthur has joined #openstack-infra | 16:14 | |
| *** doug-fish has quit IRC | 16:14 | |
| pleia2 | good morning | 16:14 |
| clarkb | but ya the reason we dont gitlab is largely the same reason we dont github. the functionality we want isnt there | 16:14 |
| clarkb | stateful code review with history | 16:15 |
| *** sputnik13 has quit IRC | 16:15 | |
| bkero | Why don't the merge requests meet the requirement of 'stateful code review with history'? | 16:16 |
| fungi | yolanda: now that https://review.openstack.org/299433 has merged, are you okay with the state of https://review.openstack.org/298699 ? | 16:16 |
| *** fedexo has quit IRC | 16:16 | |
| *** jcoufal has quit IRC | 16:16 | |
| clarkb | because rebases kill history and pull requests dont have state other than open or closed | 16:16 |
| clarkb | gerrit has arbitrary state matrixes that can be updated by humans and robots | 16:17 |
| clarkb | this allows you to build the "at least two +2 code review, +2 from jenkins, and approval" setup | 16:17 |
| *** daemontool has quit IRC | 16:18 | |
| bkero | I wonder if that could be done with labels. | 16:18 |
| clarkb | you also dont get bisectable trees out of pull requests | 16:19 |
| *** stevemar has joined #openstack-infra | 16:19 | |
| clarkb | which is a nice feature of gating + gerrit | 16:19 |
| fungi | well, you do depending on the pr policy of the project | 16:19 |
| fungi | some of them insist on using a rebase until it's right workflow in your pr | 16:19 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Fix test_get_server_ip unit test https://review.openstack.org/299517 | 16:19 |
| clarkb | fungi but there is no way of enforcing that because no state | 16:19 |
| *** openstack has joined #openstack-infra | 17:04 | |
| *** mescanef_ has joined #openstack-infra | 17:05 | |
| *** esker has quit IRC | 17:06 | |
| *** esker has joined #openstack-infra | 17:06 | |
| clarkb | pabelanger: it probably won't hurt to add in the xenial image builds now assuming we have enough disk space for them | 17:06 |
| fungi | clarkb: though we work around it terribly by putting a specific ip address from the round robin pool in eavesdrop's /etc/hosts file, which works until they decide to readdress or remove that server | 17:06 |
| clarkb | pabelanger: but I don't expect us to even remotely start to switch until devstack runs on it | 17:07 |
| *** permalac has quit IRC | 17:07 | |
| *** eil397 has joined #openstack-infra | 17:07 | |
| clarkb | fungi: oh right, fun | 17:07 |
| *** annegentle has joined #openstack-infra | 17:07 | |
| *** jamesmcarthur has joined #openstack-infra | 17:07 | |
| zaro | sdague, jeblair : verify-status plugin to view test results in Gerrit. I thought it might be a good time to check in for feedback: https://imgur.com/KDquXfy | 17:07 |
| *** MarkAtwood has quit IRC | 17:07 | |
| pabelanger | clarkb: Yup, I agree with that. Also, this was the first issue I found with d-g: https://review.openstack.org/#/c/298998/ | 17:08 |
| fungi | smarcet: jpmaxman: it looks like the updates are deployed to openstackid-dev.openstack.org now but apache is refusing to start. i'm looking into its confusion now | 17:08 |
| *** rkukura has quit IRC | 17:08 | |
| *** esker has quit IRC | 17:08 | |
| *** rkukura has joined #openstack-infra | 17:08 | |
| *** esker has joined #openstack-infra | 17:08 | |
| *** mescanef_ has quit IRC | 17:09 | |
| *** esker has quit IRC | 17:09 | |
| *** jtomasek_ has joined #openstack-infra | 17:09 | |
| *** lakshmiS has joined #openstack-infra | 17:09 | |
| clarkb | pabelanger: +2 that is a simple one, does fixing that get devstack itself to run? | 17:09 |
| *** kzaitsev_mb has quit IRC | 17:09 | |
| pabelanger | clarkb: nope, that was the first issue | 17:09 |
| lakshmiS | one more review please - https://review.openstack.org/#/c/298360/ | 17:10 |
| pabelanger | clarkb: but something was stopping ansible from launching devstack, but didn't figure it out last night | 17:10 |
| *** fawadkhaliq has quit IRC | 17:10 | |
| clarkb | pabelanger: as it is we are really close to our /opt space limits with our current images, deleting devstack-trusty would go a long way there I think | 17:10 |
| clarkb | pabelanger: maybe we delete devstack-trusty then add in xenial images? | 17:10 |
| Zara | anteaya: okay :) I'll try to ping you early! :D | 17:10 |
| pabelanger | clarkb: sure, let me rebase 297942 and we can land that | 17:11 |
| *** fawadkhaliq has joined #openstack-infra | 17:11 | |
| anteaya | Zara: sounds good, thank you | 17:11 |
| *** gyee has quit IRC | 17:12 | |
| clarkb | pabelanger: have the logs for where ansible failed? | 17:12 |
| *** ihrachys has quit IRC | 17:12 | |
| *** esker has joined #openstack-infra | 17:12 | |
| *** jamesmcarthur has quit IRC | 17:12 | |
| pabelanger | clarkb: not any more, I'll spin up another today | 17:12 |
| Eva-i | Hello. I believe maximum line width in OpenStack is 79 characters. But why limit lines in Gerrit are not located at 79th character, but at 100th? | 17:12 |
| *** jerryz has joined #openstack-infra | 17:13 | |
| *** jamesmcarthur has joined #openstack-infra | 17:13 | |
| smarcet | fungi: ok | 17:13 |
| smarcet | will take a look also | 17:13 |
| smarcet | thx | 17:13 |
| *** abregman is now known as abregman|mtg | 17:13 | |
| *** MarkAtwood has joined #openstack-infra | 17:13 | |
| clarkb | Eva-i: they are independent concerns. One is a pep8 requirement which many projects enforce (but not all) and the other is a gerrit default ui setting | 17:14 |
| fungi | smarcet: yeah, we're missing the mod_proxy_fcgi.so file, i'm just hunting down what we need to add to get it | 17:14 |
| *** MarkAtwood has quit IRC | 17:14 | |
| clarkb | Eva-i: you can change the setting in gerrit if you like | 17:14 |
| clarkb | Eva-i: the little gear in the top right of the diff view lets you set that | 17:14 |
| *** dtantsur is now known as dtantsur|afk | 17:16 | |
| Eva-i | clarkb: oh, thank you! | 17:16 |
| smarcet | fungi: smarcet@openstackid-dev:~$ sudo a2enmod proxy_fcgi | 17:16 |
| smarcet | Module proxy_fcgi already enabled | 17:16 |
| clarkb | lakshmiS: don | 17:16 |
| clarkb | e | 17:16 |
| lakshmiS | thanks clarkb! | 17:17 |
| fungi | smarcet: right, but there's no /usr/lib/apache2/modules/mod_proxy_fcgi.so into server: /usr/lib/apache2/modules/mod_proxy_fcgi.so file on the system | 17:17 |
| *** Kennan has quit IRC | 17:17 | |
| smarcet | fungi:yeah i just saw it | 17:17 |
| fungi | smarcet: er, no /usr/lib/apache2/modules/mod_proxy_fcgi.so file on the system | 17:17 |
| *** jsavak has quit IRC | 17:18 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Remove devstack-trusty from nodepool https://review.openstack.org/297942 | 17:18 |
| fungi | smarcet: looks like there is no mod_proxy_fcgi backported to apache 2.2, but i'm still confirming that | 17:18 |
| *** skolekonov is now known as skolekonov|away | 17:18 | |
| pabelanger | fungi: clarkb ^ | 17:19 |
| smarcet | fungi: ok i think that is the problem | 17:19 |
| smarcet | thinking | 17:19 |
| fungi | smarcet: once we upgrade the server to ubuntu trusty we'll have it available, but wasn't planning to undertake that until after the summit | 17:20 |
| *** sputnik13 has joined #openstack-infra | 17:20 | |
| smarcet | ok let me check on that | 17:20 |
| *** cdent has quit IRC | 17:20 | |
| *** flepied has quit IRC | 17:21 | |
| smarcet | fungi: i think that the only one thta is available is libapache2-mod-fastcgi | 17:21 |
| smarcet | i will need to update the patch | 17:21 |
| smarcet | i am afraid | 17:21 |
| *** MarkAtwood has joined #openstack-infra | 17:21 | |
| openstackgerrit | Merged openstack-infra/puppet-releasestatus: Order of the classes parameters is refactored https://review.openstack.org/295353 | 17:22 |
| rossella_s | fungi, clarkb jeblair I've pushed a patch following your suggestions regarding using reviewday for the neutron dashboard, I'd appreciate if you could have a look. I still have a doubt, I need to use gerrit-dash-creator and it's probably not present on the host. Thanks!! https://review.openstack.org/#/c/298779/ | 17:22 |
| fungi | smarcet: agreed, that is definitely available for us to use | 17:22 |
| smarcet | fungi: ok on it | 17:23 |
| *** Eva-i has left #openstack-infra | 17:23 | |
| *** mrmartin has joined #openstack-infra | 17:23 | |
| clarkb | rossella_s: does reviewday have a requirements list? you could add the dash creator there if so | 17:23 |
| *** sohail_ has quit IRC | 17:24 | |
| *** gyee has joined #openstack-infra | 17:24 | |
| *** degorenko is now known as _degorenko|afk | 17:25 | |
| clarkb | pabelanger: did you manage to rebuild ubuntu-trusty yesterday? I don't see it in nodepool dib-image-list | 17:25 |
| *** jamesmcarthur has quit IRC | 17:26 | |
| *** tosky has joined #openstack-infra | 17:26 | |
| rossella_s | clarkb, gerrit-dash-creator is not available on pypi, would that work? | 17:26 |
| *** tosky has quit IRC | 17:26 | |
| fungi | clarkb: pabelanger: it's possible i redeleted it when i woke up, as i was still on the lookout for broken ubuntu-trusty images coming online in providers | 17:26 |
| pabelanger | fungi | 17:26 |
| pabelanger | err | 17:26 |
| pabelanger | fungi: clarkb Oh, ya I uploaded it yesterday | 17:27 |
| fungi | clarkb: pabelanger: though it should have been rebuilt in today's batch anyway | 17:27 |
| pabelanger | Yup | 17:27 |
| pabelanger | it will | 17:27 |
| clarkb | rossella_s: pip understands git urls too, that is less than ideal but should function | 17:27 |
| clarkb | pabelanger: hrm I don't see it | 17:27 |
| *** jsavak has joined #openstack-infra | 17:27 | |
| clarkb | pabelanger: the only non building image there is almost 2 days old | 17:27 |
| *** electrofelix has quit IRC | 17:28 | |
| *** rlandy has quit IRC | 17:28 | |
| *** imcsk8|afk is now known as imcsk8 | 17:28 | |
| pabelanger | clarkb: let me check | 17:28 |
| rossella_s | clarkb, thanks for the hint, I will try that! I learn new things every time I talk to you infra people, that's awesome :) thanks | 17:28 |
| *** Goneri has quit IRC | 17:28 | |
| pabelanger | clarkb: I guess fungi delete it? | 17:28 |
| fungi | pabelanger: yeah, probably | 17:28 |
| openstackgerrit | Merged openstack-infra/project-config: Change experimental to actual for searchlight https://review.openstack.org/298360 | 17:28 |
| fungi | pabelanger: i thought nodepool had somehow respawned it before your fix landed | 17:28 |
| *** rlandy has joined #openstack-infra | 17:29 | |
| anteaya | fungi: pabelanger pleia2 and anyone else who has spent some time looking at the wiki spam issue, I have some experiences and thoughts I'd like to discuss, when would be a good time? | 17:29 |
| *** esker has quit IRC | 17:29 | |
| clarkb | rossella_s: let me know if you need help with it, but pips docs should have the info you need for using them | 17:29 |
| marcusvrn_ | asselin_: hi! I was researching some features to improve CI and I found this one: https://review.openstack.org/#/c/192819/ It's actually stopped...there is something similar to this feature or the community don't think it's a good idea? | 17:30 |
| *** ayoung has joined #openstack-infra | 17:30 | |
| rossella_s | clarkb, very kind of you, thanks a lot! | 17:30 |
| *** piet has quit IRC | 17:30 | |
| *** Kennan has joined #openstack-infra | 17:30 | |
| anteaya | fungi: you had said yesterday you don't want me to spend a lot of time deleting pages, so to that end, I would like to discuss options | 17:30 |
| *** jtomasek_ has quit IRC | 17:31 | |
| AJaeger | pabelanger: add libselinux-python to bindep-fallback | 17:31 |
| asselin_ | marcusvrn_, hi, I stopped looking at that one. Seems the community is fine with it as a 'feature', but not sure where it is on the priority list with zuulv3. | 17:32 |
| *** mrmartin has quit IRC | 17:32 | |
| *** jsavak has quit IRC | 17:32 | |
| asselin_ | marcusvrn_, you can take it over ifyou like. | 17:32 |
| AJaeger | jroll: might work on master but fail on stable ;( | 17:32 |
| fungi | anteaya: i've not really been involved at all. i think it's mostly been pleia2 and pabelanger who worked on it thus far, and also some other wiki admins like fifieldt (who isn't in here) | 17:33 |
| anteaya | fungi: fair enough | 17:33 |
| *** jsavak has joined #openstack-infra | 17:33 | |
| *** salv-orlando has joined #openstack-infra | 17:33 | |
| AJaeger | jroll: it really depends on setup, we had it failing - not generating tarballs for a release at all! | 17:33 |
| anteaya | well my assessment thus far is that mass delete and smitespam (including the documented configuration changes) don't come close to addressing the problem | 17:34 |
| *** mescanef has joined #openstack-infra | 17:34 | |
| *** MarkAtwood has quit IRC | 17:34 | |
| fungi | anteaya: in terms of cleanup? | 17:34 |
| anteaya | right | 17:34 |
| marcusvrn_ | asselin_: nice! I'll investigate this feature and maybe I can try to do it...I think it can help some slow CIs...thanks!! | 17:34 |
| clarkb | marcusvrn_: asselin_ that is probably a very small portion of your load though right? | 17:34 |
| clarkb | abandoned changes are not super common | 17:34 |
| anteaya | so other than going through page history and tracking individual contributors and manually deleting pages, I don't think we have a way of addressing the spam | 17:35 |
| anteaya | mostly I"m saying something because you told me that is what you don't want | 17:35 |
| asselin_ | clarkb, it wasn't really for abandoned, but for merged | 17:35 |
| *** nikhil_k is now known as nikhil | 17:35 | |
| anteaya | and I"m sharing that based on my experience yesterday, I think that is the only way | 17:35 |
| clarkb | asselin_: ah | 17:35 |
| fungi | anteaya: the nuke feature seemed to work when i (briefly) tried it, but worth noting it continues to find matches for deleted pages since deletion is non-permanent | 17:36 |
| asselin_ | clarkb, fixes the issue of a ci reporting results 2 days after it's merged.... | 17:36 |
| clarkb | I read status: open and immediately associated with abandoned, I see the commit message is clear | 17:36 |
| *** MarkAtwood has joined #openstack-infra | 17:36 | |
| anteaya | fungi: right mass delete is nuke (I believe) | 17:36 |
| fungi | yeah, same thing | 17:36 |
| *** esker has joined #openstack-infra | 17:36 | |
| anteaya | fungi: however if I go to a contributor page, and open mass delete in a separate tab, and mass delete, then refresh the contributor page | 17:37 |
| anteaya | most contributors still have contributions | 17:37 |
| marcusvrn_ | clarkb: asselin_ yep, this feature can save resources for patched not merged yet | 17:37 |
| anteaya | some of them still have over a hundred contributions | 17:37 |
| *** cdent has joined #openstack-infra | 17:37 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: script to propose final releases for a series https://review.openstack.org/299551 | 17:37 |
| marcusvrn_ | s/patched/patches | 17:37 |
| fungi | i think pabelanger had mentioned something about identifying the list of accounts with no associated openid (which would indicate they came in through the brief mobile interface backdoor we accidentally opened when trying to solve the earlier compromised/malicious lp account spamming) and feeding that into the mass deletion routine | 17:37 |
| anteaya | the only way I have found is to mass delete to start (which as you say can continually delete pages it has found before to delete) then go through the contributions for a user one at a time | 17:38 |
| openstackgerrit | Merged openstack-infra/puppet-pip: Order of the class parameters is refactored https://review.openstack.org/295340 | 17:38 |
| anteaya | fungi: okay that's worth a shot | 17:38 |
| *** tosky has joined #openstack-infra | 17:38 | |
| anteaya | pabelanger: any status update on using accounts with no associated openid and using mass delete? | 17:39 |
| fungi | thuogh i suspect that's going to involve analyzing a database dump, and it still doesn't get us the ones which came in through launchpad | 17:39 |
| anteaya | right | 17:39 |
| anteaya | also if I understand mass delete that still won't remove pages that have been edited by mulitple people nor pages that have been moved | 17:39 |
| anteaya | nor redirects | 17:39 |
| pabelanger | anteaya: not yet. We can run a database script to see what they are and start deleting them | 17:40 |
| anteaya | as mass delete just takes out files | 17:40 |
| anteaya | great | 17:40 |
| anteaya | happy to help with that | 17:40 |
| *** salv-orlando has quit IRC | 17:40 | |
| openstackgerrit | Michael Johnson proposed openstack-infra/devstack-gate: Add archiving of nova instance console logs https://review.openstack.org/298915 | 17:40 |
| fungi | right, we don't for example want to delete important pages simply because someone replaced the content in them with spam or moved them to a new title | 17:40 |
| anteaya | what can I do? | 17:40 |
| anteaya | right | 17:40 |
| anteaya | fungi: to be honest I didn't see any of that last night | 17:40 |
| anteaya | all where new pages that I saw | 17:40 |
| fungi | that's good. i know pleia2 encountered it with the how to contribute page | 17:41 |
| fungi | but i don't know how widespread teh situation is in practice | 17:41 |
| anteaya | also there is a search feature to find duplicate pages, except the search feature isn't tied to delete in anyway | 17:41 |
| *** pvaneck has joined #openstack-infra | 17:41 | |
| anteaya | fungi: good to know pleia2's experience | 17:41 |
| anteaya | I deleted hundreds last night and didn't see any that were real pages that had been co-opted | 17:42 |
| *** Goneri has joined #openstack-infra | 17:42 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again https://review.openstack.org/288915 | 17:42 |
| openstackgerrit | Merged openstack-infra/puppet-project_config: Order of the class parameters is refactored https://review.openstack.org/295342 | 17:42 |
| *** sdake has quit IRC | 17:42 | |
| fungi | when it's happened, they appear to first move the page to a new title and then replace the content on it in a subsequent update (sometimes using two separate accounts to do that) | 17:42 |
| pleia2 | anteaya: I wrote about this on list a couple days ago | 17:42 |
| anteaya | mostly I bring this up because I am work functional until about this time tomorrow and they getting ready to travel, then gone for a week | 17:42 |
| anteaya | pleia2: I believe you, thank you | 17:43 |
| pabelanger | anteaya: Right, there might be some gotchas with the mass delete like you found. I haven't had time to look into them to see if we can fix it | 17:43 |
| anteaya | fungi: awesome | 17:43 |
| anteaya | what gotchas? | 17:43 |
| anteaya | it deletes a whole lot of stuff, so I'd like to start with that if we can | 17:43 |
| pleia2 | anteaya: http://lists.openstack.org/pipermail/openstack-infra/2016-March/004075.html | 17:43 |
| fungi | the main page's talk subpage had that happen to it a couple times i kept cleaning up back when the spamming was at its worst | 17:43 |
| pleia2 | anteaya: ^^ I outlined what happened there, so we need to watch out for that | 17:44 |
| anteaya | I'm not interested in perfect as I do believe manual cleanup will be necessary | 17:44 |
| anteaya | pleia2: thanks | 17:44 |
| fungi | but since we likely don't care much about content in the talk subpages i wasn't too worried about outright deletion | 17:44 |
| anteaya | fungi: :( | 17:44 |
| pabelanger | clarkb: fungi: so, ubuntu-xenial won't build until we restart nodepool pool. And we should be safe to delete devstack-trusty once we land 297942 too. So that will free up some HDD space | 17:44 |
| anteaya | basically I'm saying what we are doing right now isn't cleaning up the wiki | 17:44 |
| anteaya | and I'd really like to have a clean wiki | 17:44 |
| fungi | pabelanger: restart the nodepool image builder daemon i assume you mean? | 17:44 |
| clarkb | pabelanger: ok, we should do things in that order to pick up the devstack-trusty removal when we pick up the xenial ad | 17:45 |
| anteaya | and willing to put my money where my mouth is | 17:45 |
| clarkb | fungi: oui | 17:45 |
| *** esker has quit IRC | 17:45 | |
| pabelanger | fungi: yes | 17:45 |
| anteaya | and will spend my time manually deleting unless I have something more effective to do | 17:45 |
| anteaya | because manual deleting is proving effective | 17:45 |
| fungi | anteaya: agreed, mass deletion by content pattern match seems like a more likely (if somewhat iterative) way to catch more of them | 17:45 |
| *** e0ne has quit IRC | 17:45 | |
| *** esker has joined #openstack-infra | 17:45 | |
| anteaya | I'm all for that | 17:45 |
| anteaya | how do I do it? | 17:46 |
| clarkb | fungi: pabelanger pleia2 other d-g cores https://review.openstack.org/#/c/280027/3 would be a good one to get in to make the reproduce.sh script more useful | 17:46 |
| *** esker has quit IRC | 17:46 | |
| clarkb | that script is super handy we just need to smooth out the rough edges so it works in the general case | 17:46 |
| fungi | so if you see duplicative patterns across some of the spam pages you're finding, then feed that into the mass delete (as long as you can come up with a pattern which is unlikely to match legitimate content) | 17:46 |
| pabelanger | fungi: clarkb: do we need to do anything to zuul? becuase I see see we have 4 devstack-trusty nodes online | 17:46 |
| *** esker has joined #openstack-infra | 17:46 | |
| *** esker has quit IRC | 17:47 | |
| anteaya | fungi: I've tried | 17:47 |
| clarkb | pabelanger: its possible those were straggler registrations in gearman creating demand? | 17:47 |
| clarkb | pabelanger: I can check gearman really quick | 17:47 |
| anteaya | feeding mass delete content doesn't result in me getting more pages to delete | 17:47 |
| *** MarkAtwood has quit IRC | 17:47 | |
| anteaya | fungi: I tried that last night | 17:47 |
| anteaya | search can find duplicates | 17:47 |
| pabelanger | clarkb: ack | 17:48 |
| *** annegentle has quit IRC | 17:48 | |
| clarkb | pabelanger: echo "status" | nc localhost 4730 | grep devstack-trusty on zuul says only the image-build job is registered so I think we are fine | 17:48 |
| *** abregman|mtg is now known as abregman | 17:48 | |
| *** MarkAtwood has joined #openstack-infra | 17:48 | |
| anteaya | if I go to a file of spam at the bottom it will say if there are duplicates | 17:48 |
| *** jamesmcarthur has joined #openstack-infra | 17:48 | |
| pabelanger | clarkb: okay, let me delete them and see what happens | 17:48 |
| anteaya | if I follow that I can get to a page where I can search on content and it gives me results on content | 17:48 |
| anteaya | but then I can't delete them as I have no function to do so | 17:48 |
| fungi | anteaya: the other thing i'm still thinking we may want to do is stand up a second copy of the wiki somewhere not indexed by search engines, then have a root admin purge deleted pages from the production one semi-regularly until we whittle down the remaining spam content while still having the old version to refer back to if we discover we've accidentally purged something valuable | 17:48 |
| pabelanger | AJaeger: okay, will get a patch up | 17:48 |
| anteaya | just a list of pages I can delete manually if I open each one | 17:48 |
| *** Sukhdev has quit IRC | 17:48 | |
| lakshmiS | clarkb: zuul tests showing "NOT REGISTERED" for patch(298339). gate-searchlight-python34-searchlight was added in https://review.openstack.org/#/c/298360/. What does NOT REGISTERED mean? | 17:48 |
| anteaya | fungi: I'm for that | 17:49 |
| clarkb | lakshmiS: it means that zuul's gearman server doesn't know about that job yet, which can happen if zuul updates before jenkins updates | 17:49 |
| fungi | anteaya: odd, the mass delete should be giving you a button for that. i'm checking now | 17:49 |
| anteaya | fungi: as this is a big big big mess and I can't see the bottom | 17:49 |
| *** cdent has quit IRC | 17:49 | |
| clarkb | lakshmiS: ansible should force jenkins to update first so this may indicate the job updates are currently broken | 17:49 |
| *** fawadkhaliq has quit IRC | 17:49 | |
| anteaya | fungi: thanks, if there is a button and I haven't seen it I sure will use it if you can point it out to me | 17:49 |
| *** annegentle has joined #openstack-infra | 17:50 | |
| anteaya | I spend about 5 or 6 hours following page history and user contribs and deleting both mass and individual pages | 17:50 |
| *** zul has quit IRC | 17:50 | |
| lakshmiS | clarkb: so i guess that means it will eventually pickup the job next time patch runs again | 17:50 |
| anteaya | and it just keep looking bigger every time I opened a new page history | 17:50 |
| *** piet has joined #openstack-infra | 17:50 | |
| fungi | anteaya: when i have the match list, at the top of it there's a "delete selected" button | 17:50 |
| fungi | the same button also appears at the bottom | 17:51 |
| clarkb | lakshmiS: yes I would expect this to self correct shortly and if it does not I can do more digging into why jenkins isn't registering those jobs | 17:51 |
| * anteaya goes to try to find the page with 'the match list' on it | 17:51 | |
| lakshmiS | thanks | 17:51 |
| *** fawadkhaliq has joined #openstack-infra | 17:51 | |
| AJaeger | jroll, fungi: I checked your tox.ini file, you're not using constraints at all. | 17:51 |
| fungi | anteaya: for example, i searched on the pattern %turbotax% | 17:51 |
| AJaeger | jroll: see line 10 of https://github.com/openstack/ironic/blob/master/tox.ini#L10 | 17:52 |
| fungi | anteaya: under the mass delete special page | 17:52 |
| *** Goneri has quit IRC | 17:52 | |
| AJaeger | jroll: "pip install -U {opts} {packages}" - that's the ocmmand you use | 17:52 |
| *** Goneri has joined #openstack-infra | 17:52 | |
| *** MarkAtwood has quit IRC | 17:52 | |
| AJaeger | It would fail with line 9 since there wouldn't be any upper-constraints file checked out. | 17:52 |
| pabelanger | clarkb: devstack-trusty nodes deleted, good so far | 17:53 |
| AJaeger | jroll: so, remove line 9, it's a nop ;) | 17:53 |
| clarkb | pabelanger: my only concern with https://review.openstack.org/#/c/297942/2/nodepool/nodepool.yaml is you will likely need to do manual cleanup since we didn't go to -1 first and use nodepool to remove the on disk files and glance uploads | 17:54 |
| anteaya | fungi: okay thanks | 17:54 |
| anteaya | fungi: did you delete those entries on your page? | 17:54 |
| fungi | anteaya: no, i didn't | 17:54 |
| fungi | figured you could use them to test | 17:54 |
| clarkb | pabelanger: you may (I am not 100% sure) have to remove from the db directly then check the alien image lists and remove those and clean out /opt/nodepool_dib | 17:54 |
| tosky | AJaeger: oh, hi again - so, do you suggest to ask here about the required steps for https://review.openstack.org/#/c/299407/ ? I can do the first change (the group of reviewers) but not still sure about the other | 17:54 |
| anteaya | fungi: okay thanks I found 8 entries | 17:54 |
| anteaya | fungi: I've deleted them | 17:55 |
| fungi | anteaya: i checked one of them at random and it was definitely not (yet) deleted but some of the others might have been | 17:55 |
| pabelanger | clarkb: I can do -1 first to be safe | 17:55 |
| anteaya | fungi: do they still show up as needing to be deleted on your end? | 17:55 |
| *** esikachev has joined #openstack-infra | 17:55 | |
| fungi | anteaya: yay! the one i was looking at as an example is definitely a deleted page now | 17:55 |
| AJaeger | tosky: I'm not sure either ;) Let's ask... | 17:55 |
| clarkb | pabelanger: that may be simplest, -1 it, then use nodepool commands to delete the images | 17:55 |
| clarkb | pabelanger: then we can remove it from the yaml | 17:55 |
| anteaya | fungi: great, so that works | 17:56 |
| fungi | anteaya: as fifieldt pointed out in that infra ml thread though, deleted pages are still matched by the mass delete search since they're still pages | 17:56 |
| tosky | AJaeger: I'm always scared asking here, the channel is either completely silent or full throttle uber busy :) | 17:56 |
| anteaya | fungi: I still like your idea of standing up a second wiki and migrating good content and users over | 17:56 |
| fungi | anteaya: at least until we decide to do a purge, yeah | 17:56 |
| AJaeger | project-config cores, tosky wants in 299407 run no jobs on a specific branch. Could I get some help on what's the best way to do this? | 17:56 |
| anteaya | fungi: have we discussed when to purge? | 17:56 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Set devstack-trusty(-2-node) to min-ready -1 https://review.openstack.org/299559 | 17:56 |
| pabelanger | clarkb: ^ | 17:56 |
| fungi | tosky: when the channel is not busy, that means that we are ;) | 17:56 |
| pabelanger | will rebase a top of that | 17:56 |
| clarkb | pabelanger: basically nodepool image-delete, then nodepool dib-image-delete, make sure those are all gone, then remove the yaml configs | 17:57 |
| *** jamesmcarthur has quit IRC | 17:57 | |
| clarkb | pabelanger: approved | 17:57 |
| tosky | the idea behind that commit is described in the referenced email (based on some hints that I've got in the previous weeks here) | 17:57 |
| fungi | anteaya: i didn't propose a timeline. i'm hesitant to volunteer to do the server build, it should probably be tackled by whoever's working on polishing up the puppet-mediawiki manifest to be more thoroughly redeployable | 17:57 |
| anteaya | fungi: I'm at the point of wanting to put this on the etherpad as part of summit discussions | 17:58 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Remove devstack-trusty from nodepool https://review.openstack.org/297942 | 17:58 |
| pabelanger | and rebase | 17:58 |
| anteaya | so we can address it | 17:58 |
| anteaya | fungi: and yes, I understand your position | 17:58 |
| tosky | anteaya, pabelanger: not sure it can help, but in kde.org we had spam issues with our wikis as well, and we asked some hints to mediawiki people - maybe they can help here as well | 17:59 |
| anteaya | tosky: can you share what they told you? | 17:59 |
| pabelanger | tosky: Always open to help, especially combating spam | 17:59 |
| fungi | anteaya: i'd vote for a session on how to move forward fixing (well, really completing) that puppet module and discussing options and timelines for upgrading the server/software, installing additional mitigation solutions and cleaning up the remaining mess | 17:59 |
| anteaya | and we have mediawiki folks in channel | 17:59 |
| tosky | anteaya: let me ask around | 18:00 |
| *** tiswanso has quit IRC | 18:00 | |
| fungi | tosky: yep, we have some mediawiki people in channel. step 1 is to get on a newer version of mediawiki, and step 0.5 is to get on a newer distro release so that we have a new enough php to run current mediawiki | 18:00 |
| anteaya | fungi: I will add it to the etherpad, and am willing to chair the discussion, note I will be absent next week so will miss the meeting where slots are alocated | 18:00 |
| *** e0ne has joined #openstack-infra | 18:00 | |
| tosky | fungi: that helped too, the mediawiki version on kde.org wikis was two years old and upgrade was the first step | 18:01 |
| *** tiswanso has joined #openstack-infra | 18:01 | |
| fungi | anteaya: feel free to throw some indication of vote by proxy into that etherpad, for sessions you would attend | 18:01 |
| openstackgerrit | Merged openstack-infra/project-config: Make job networking-generic-switch-dsvm voting https://review.openstack.org/297218 | 18:01 |
| anteaya | pabelanger: I'm not trying to take over for you with regards to the wiki and really appreciate all you have done here, but you are getting pulled off on other projects (that is what happens when you are effective) and I think this topic needs some completion | 18:02 |
| anteaya | fungi: ah okay, I'll add my nick as my vote, so you don't have to guess | 18:02 |
| fungi | tosky: part of the challenge is that the server was set up years ago by a mediawiki dev but he didn't find time to complete the configuraiton management for it, so it's not trivially redeployable (yet) | 18:02 |
| *** cloudtrainme has quit IRC | 18:02 | |
| tosky | fungi: that doesn't help, I see | 18:03 |
| *** annegentle has quit IRC | 18:03 | |
| fungi | right, so we're retrofitting config management by sort of reverse engineering what's there | 18:04 |
| *** mriedem1 has joined #openstack-infra | 18:06 | |
| *** piet has quit IRC | 18:07 | |
| *** rraja has quit IRC | 18:07 | |
| *** Guest87573 has quit IRC | 18:07 | |
| *** jamesmcarthur has joined #openstack-infra | 18:07 | |
| *** mriedem has quit IRC | 18:07 | |
| *** piet has joined #openstack-infra | 18:07 | |
| *** daemontool has quit IRC | 18:07 | |
| *** stevemar has quit IRC | 18:08 | |
| *** stevemar has joined #openstack-infra | 18:09 | |
| anteaya | using mass delete it is possible I am deleting files that already are deleted | 18:09 |
| anteaya | correct? | 18:09 |
| *** placko_ has quit IRC | 18:10 | |
| anteaya | so I really have no actual way of knowing if I am making any progress or not in terms of how much spam remains in the wiki | 18:10 |
| anteaya | yes? | 18:10 |
| pabelanger | anteaya: nope, feel free to drive. no issues here | 18:10 |
| anteaya | pabelanger: well mostly trying to make space for the conversation | 18:10 |
| anteaya | I don't think I will be doing any of the standing up of the server bits | 18:10 |
| anteaya | and thanks for understanding | 18:10 |
| *** piet has quit IRC | 18:11 | |
| *** mrmartin has joined #openstack-infra | 18:11 | |
| *** zul has joined #openstack-infra | 18:11 | |
| *** piet has joined #openstack-infra | 18:11 | |
| *** e0ne has quit IRC | 18:11 | |
| fungi | anteaya: yeah, other than maybe spot-checking a few in the list you get to see whether they're maybe already deleted, there's no direct indication that the matched pages in the list you get have been deleted already | 18:12 |
| anteaya | it is possible I am just deleting the same files over and over | 18:12 |
| anteaya | okay thanks | 18:12 |
| anteaya | I appear to be breaking fresh ground | 18:13 |
| *** mriedem1 has quit IRC | 18:13 | |
| *** mriedem has joined #openstack-infra | 18:13 | |
| openstackgerrit | Merged openstack-infra/puppet-phabricator: Order of the classes parameters is refactored https://review.openstack.org/295337 | 18:14 |
| AJaeger | so, has anybody a suggestion how to help tosky with 299407, please? | 18:15 |
| clarkb | AJaeger: tosky just push to master and rely on self testing of changes? | 18:16 |
| clarkb | I really don't want to have to delete these branches if I read the commit message correctly | 18:16 |
| fungi | anteaya: the other thing i did on the ones i looked at was to check the page history and see when they were created/updated. luckily they seemed to be primarily from the blast in late february and none recent | 18:16 |
| anteaya | awesome thanks | 18:17 |
| tosky | clarkb: it would be just one branch; what I'm not sure is that it should be created by the person sending the set of commits to gerrit when he sends them, or if you should create it instead and then it can be used | 18:17 |
| AJaeger | tosky: why not send single changes to master? | 18:18 |
| anteaya | I was checking page history a lot last night and didn't see any contibutors on the pages I was viewing that were non-spammers | 18:18 |
| clarkb | oh this is for history retention | 18:18 |
| tosky | yes | 18:18 |
| clarkb | ya I think thats fine, the commit message made it sound like it would be ongoing | 18:18 |
| tosky | ongoing? It's ongoing in the way that it will take few days before the changes to infra can be reverted | 18:19 |
| tosky | the time to do the pushes and so on (hopefully two days) | 18:19 |
| tosky | or do you mean something else by ongoing? | 18:19 |
| *** roxanaghe has quit IRC | 18:19 | |
| fungi | "indefinite" was probably a more appropriate word | 18:19 |
| tosky | ah | 18:19 |
| tosky | I thought I underlined __temporary__ enough in the commit message | 18:20 |
| clarkb | yup fungi parsed correctly and picked a better word | 18:20 |
| tosky | :) | 18:20 |
| clarkb | tosky: I read it as temporary orphan branches | 18:20 |
| tosky | aaah | 18:20 |
| clarkb | that may repeat until whenver | 18:20 |
| tosky | no, no | 18:20 |
| clarkb | I grok now | 18:20 |
| tosky | so, should I restrict the set to release instead of core? The problem is that the set of release is just one iirc | 18:21 |
| * tosky checks | 18:21 | |
| mriedem | clarkb: when you get a sec, indexing is behind by 17 hours for logstash, but cluster status health says it's green http://status.openstack.org/elastic-recheck/index.html | 18:21 |
| tosky | yes, just one | 18:21 |
| clarkb | tosky: yes we typically like the group to be small | 18:21 |
| tosky | clarkb: well, then I could avoid that, as the one is SergeyLukjanov, who I guess could already create the branch | 18:22 |
| *** fawadkhaliq has quit IRC | 18:22 | |
| tosky | the group of sahara core is small enough anyway | 18:22 |
| tosky | for the other issue with the set of jobs, I need at least one, but how can I easily do that? I used skip-if to skip all of them, I guess I need a more complex regexp then | 18:23 |
| *** fawadkhaliq has joined #openstack-infra | 18:23 | |
| clarkb | mriedem: looks like we may have idle workers for some reason | 18:23 |
| mriedem | fungi: did you ever figure out if the g-r sync bot was busted for stable/kilo? | 18:23 |
| tosky | or I would need to deactivate all the jobs one by one for that branch | 18:23 |
| anteaya | fungi: I have made ammendments to https://etherpad.openstack.org/p/infra-newton-summit-planning | 18:24 |
| anteaya | fungi: if my edits are unclear, do let me know I will fix | 18:24 |
| *** e0ne has joined #openstack-infra | 18:24 | |
| AJaeger | tosky: or deactivate all jobs temporarily on all branches? | 18:24 |
| tosky | AJaeger: all - but one ? | 18:25 |
| *** sridhar_ram has quit IRC | 18:25 | |
| tosky | I thought it was going to be more controversial | 18:25 |
| openstackgerrit | Merged openstack-infra/puppet-puppet: Order of the class parameters is refactored https://review.openstack.org/295345 | 18:25 |
| clarkb | looks like recvfrom just hanging out? perhaps network disruptions that haven't been caught by the tcp stack? | 18:25 |
| AJaeger | tosky: only noop-jobs and merge-check | 18:25 |
| *** e0ne has quit IRC | 18:26 | |
| *** davidlenwell has quit IRC | 18:27 | |
| tosky | AJaeger: if I combine that line with a new line which defines noop- for that specific branch, I guess it should minimize the impact | 18:27 |
| *** jamesmcarthur has quit IRC | 18:27 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:28 | |
| AJaeger | tosky: defining noop for a specific branch works but is tricky, I would temporarily remove everything. | 18:28 |
| AJaeger | And temporarily means: Propose a patch and the reversal of it (WIPed) at the same time ;) | 18:29 |
| *** piet has quit IRC | 18:29 | |
| tosky | AJaeger: uhm, I thought I could just copy the existing definition, but I get it | 18:30 |
| clarkb | mriedem: I have given them all a restart and we can watch them to see if this persists | 18:30 |
| *** baoli_ has quit IRC | 18:30 | |
| * AJaeger has to step out a bit | 18:30 | |
| clarkb | mriedem: from the logs what I see is that they were fetching form the log server days ago and never received more bytes | 18:30 |
| tosky | AJaeger: sure, thanks | 18:30 |
| jesusaur | clarkb: it also looks like kibana isn't returning any results at all | 18:30 |
| clarkb | mriedem: I should probably add a timeout to those requests | 18:30 |
| clarkb | jesusaur: is that because we havne't been indexing? | 18:30 |
| jesusaur | clarkb: ive been watching spinners spin for a few minutes | 18:30 |
| *** e0ne has joined #openstack-infra | 18:31 | |
| clarkb | thats odd | 18:31 |
| jesusaur | which likely means it isn't getting query results from elasticsearch | 18:31 |
| clarkb | it says we only have 5 nodes but we are green | 18:31 |
| *** e0ne has quit IRC | 18:31 | |
| tosky | the only thing I'm not sure is: if the "create" is assigned to one person, then that person should send all the reviews from the imported history to gerrit (or at least the first one), or can he just create the branch from gerrit interface and someone else send the reviews to gerrit? | 18:31 |
| clarkb | which makes me think we lost a node and just moved on | 18:31 |
| *** abregman is now known as abregman|afk | 18:32 | |
| *** jamesmcarthur has joined #openstack-infra | 18:33 | |
| clarkb | tosky: they can create the branch and someone else can push | 18:33 |
| *** e0ne has joined #openstack-infra | 18:33 | |
| tosky | clarkb: thanks! | 18:33 |
| *** e0ne has quit IRC | 18:33 | |
| clarkb | es03 was out to lunch | 18:33 |
| clarkb | I have restarted it | 18:33 |
| *** tiswanso has quit IRC | 18:34 | |
| clarkb | looks like it was unhappy about the size of timestamps | 18:34 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 18:34 | |
| *** davidlenwell has joined #openstack-infra | 18:34 | |
| *** tiswanso has joined #openstack-infra | 18:34 | |
| clarkb | we have a lot of unhappy indexes too and they don't appear to be getting deleted :/ | 18:35 |
| *** annegentle has joined #openstack-infra | 18:35 | |
| *** e0ne has joined #openstack-infra | 18:35 | |
| clarkb | I will try manually running the cleanup cron entry | 18:35 |
| *** piet has joined #openstack-infra | 18:35 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 18:35 | |
| anteaya | fungi: I think we may need to discuss wiki purge as soon as possible, my search engine is finding pages that were deleted at the end of February | 18:35 |
| *** kushal has quit IRC | 18:35 | |
| anteaya | fungi: so the bots seem to index deleted pages as well | 18:35 |
| fungi | mriedem: thanks for the reminder. it got lost in the shuffle between meetings yesterday. i'm digging up logs for that job now | 18:35 |
| *** cloudtrainme has joined #openstack-infra | 18:36 | |
| *** e0ne has quit IRC | 18:36 | |
| *** e0ne has joined #openstack-infra | 18:37 | |
| *** e0ne has quit IRC | 18:37 | |
| *** nwkarsten has joined #openstack-infra | 18:37 | |
| *** piet has quit IRC | 18:38 | |
| *** piet has joined #openstack-infra | 18:38 | |
| *** jamesmcarthur has quit IRC | 18:38 | |
| *** dizquierdo has joined #openstack-infra | 18:38 | |
| *** jcooley_ has joined #openstack-infra | 18:40 | |
| clarkb | ok it claims to be happier now after a manual curator run | 18:40 |
| fungi | mriedem: less "broken" and more "not running at all" from what i can tell | 18:40 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Reset network caches after network create/delete https://review.openstack.org/299420 | 18:40 |
| clarkb | I think what happened was 03 was down long enough to have a bunch of stale indexes that had already been curated on the other hosts | 18:40 |
| *** jamesmcarthur has joined #openstack-infra | 18:41 | |
| clarkb | but resurfaced once I restarted the service on 03 | 18:41 |
| fungi | mriedem: here's the jobs which ran in the post pipeline for the most recent requirements change merged on its stable/kilo branch: http://logs.openstack.org/2e/2e600fff1ad5f5e445d0f587e34895779e3c2253/post/ | 18:41 |
| fungi | mriedem: note that only the docs job for it actually ran | 18:41 |
| clarkb | and hte reason we get no results back is we have too many timestamps to load into memory | 18:41 |
| clarkb | so it is "healthy" now but unable to perform queries | 18:42 |
| fungi | mriedem: i'm going to hunt in zuul to see if maybe that index is shadowing jobs which got uploaded to swift instead | 18:42 |
| clarkb | I am going to manually delete an older index or two to free up memory on that front | 18:42 |
| mriedem | fungi: hmm yeah, error: invalid command 'build_sphinx' | 18:42 |
| jesusaur | clarkb: but the default kibana query should only look at the most recent index | 18:43 |
| openstackgerrit | Merged openstack-infra/project-config: Set devstack-trusty(-2-node) to min-ready -1 https://review.openstack.org/299559 | 18:43 |
| jbernard_ | clarkb: re the ceph mirror patch, i shouldn't need to update any apt sources to fetch those packages, correct? | 18:43 |
| *** jamesmcarthur has quit IRC | 18:43 | |
| *** jsavak has quit IRC | 18:43 | |
| mriedem | fungi: oh right, less about the docs job, more that it was the only one | 18:43 |
| anteaya | channel ops topic in -meeting could use a refresh, thanks AJaeger | 18:43 |
| clarkb | jesusaur: ya but I think this hoses the esrver in general, at least in the psat we asw it get happy when we reduced the amount of data | 18:44 |
| jesusaur | huh | 18:44 |
| clarkb | jbernard_: correct, but that part of the change hasn't been written yet. First step is just getting the mirror up, second step is updating our mirror ocnfigs on the jenkins slaves | 18:44 |
| *** jsavak has joined #openstack-infra | 18:44 | |
| *** Sukhdev has joined #openstack-infra | 18:44 | |
| fungi | anteaya: thanks, taken care of | 18:44 |
| jbernard_ | clarkb: i see. so the only plugin change needed is to /not/ update apt sources | 18:45 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Update Configuration for Precise https://review.openstack.org/299577 | 18:45 |
| *** shardy has quit IRC | 18:45 | |
| clarkb | jbernard_: well in your plugin I would do a test to see if the ceph-hammer sources.list.d file exists and if not write it out and update. If it does exist assume it is correct | 18:45 |
| *** krotscheck is now known as krotscheck_dcm | 18:46 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Update Configuration for Precise https://review.openstack.org/299577 | 18:46 |
| *** woodster_ has quit IRC | 18:47 | |
| fungi | smarcet: did you mean to checkin those .idea files? looks like that was an accident? | 18:47 |
| jbernard_ | clarkb: got it, and the file name is 'debian-ceph-hammer', right? | 18:47 |
| smarcet | fungi: was accident , sorry | 18:47 |
| clarkb | ok oldest index is deleted, I am tailing the logs to see if the timestamp memory issue returns | 18:47 |
| smarcet | fungi: https://review.openstack.org/#/c/299577/2 should take care of precise issue | 18:47 |
| clarkb | jbernard_: that hasn't been settled on :) but I think anything like that under /etc/apt/sources.list.d/ will work | 18:48 |
| clarkb | jbernard_: if you go ahead and pick a name I can use that one | 18:48 |
| fungi | smarcet: yep, was skimming and looks good | 18:48 |
| jbernard_ | clarkb: awesome, thanks man | 18:48 |
| anteaya | fungi: thanks | 18:48 |
| *** jamesmcarthur has joined #openstack-infra | 18:49 | |
| clarkb | jesusaur: and there are kibana results now | 18:49 |
| *** piet has quit IRC | 18:50 | |
| clarkb | jesusaur: you are right though and I don't fully understand the relation between these things, but basically removing old indexes reduces memory overhead which makes it happy | 18:50 |
| *** piet has joined #openstack-infra | 18:50 | |
| *** jamesmcarthur has quit IRC | 18:50 | |
| jesusaur | clarkb: so there are | 18:50 |
| *** jsavak has quit IRC | 18:51 | |
| *** jsavak has joined #openstack-infra | 18:51 | |
| *** yamamoto has quit IRC | 18:53 | |
| anteaya | I have zero way of tracking what effect using mass delete has, I have ended up going to contributor pages, as I did last night and deleting them (mass and one at a time) until none remain for that contributor | 18:53 |
| anteaya | at least it gives me a sense of working toward the goal of a clean wiki | 18:54 |
| fungi | thanks for tackling it, anteaya | 18:54 |
| *** jamesmcarthur has joined #openstack-infra | 18:54 | |
| fungi | pabelanger: do you have a moment to peek at 299577? smarcet's implementing some conditional logic to get different (similar) apache modules on precise vs trusty | 18:55 |
| fungi | looks good to me, but a second set of eyeballs would be welcome | 18:55 |
| *** kushal has joined #openstack-infra | 18:55 | |
| *** piet has quit IRC | 18:56 | |
| *** roxanaghe has joined #openstack-infra | 18:56 | |
| *** sdake has joined #openstack-infra | 18:57 | |
| pabelanger | fungi: comment left, LGTM | 18:57 |
| *** piet has joined #openstack-infra | 18:58 | |
| *** MarkAtwood has joined #openstack-infra | 18:58 | |
| *** sc68cal has quit IRC | 18:58 | |
| fungi | thanks. i'll approve it once the check jobs come back +1 | 18:58 |
| *** ociuhandu has quit IRC | 18:58 | |
| *** cloudtrainme has quit IRC | 19:00 | |
| fungi | mriedem: confirmed from zuul debug logs, that's the only post job it ran for that commit. so next suspicion is that we've somehow introduced a filter in the zuul layout causing it to skip the sync job | 19:01 |
| clarkb | pabelanger: devstack-trusty is set to -1 now, do you want to clean things up or should I work on that? | 19:01 |
| clarkb | pabelanger: I think it is just image-delete ing all the devstack-trusty images then dib-image-delete ing the dib images | 19:01 |
| *** kzaitsev_mb has joined #openstack-infra | 19:02 | |
| *** salv-orlando has joined #openstack-infra | 19:03 | |
| *** tiswanso has quit IRC | 19:03 | |
| *** Rockyg has quit IRC | 19:03 | |
| AJaeger | propose-requirements-updates: branch master? | 19:04 |
| fungi | mriedem: https://review.openstack.org/297225 says you +1'd the change | 19:04 |
| *** tiswanso has joined #openstack-infra | 19:04 | |
| mriedem | fungi: ah gdi, | 19:05 |
| mriedem | fungi: that was intended only for upper-constraints bot proposals to the requirements repo | 19:05 |
| *** baoli has joined #openstack-infra | 19:05 | |
| mriedem | not the g-r sync proposals to the !requirements repo | 19:05 |
| mriedem | dims_: ^ | 19:05 |
| fungi | mriedem: yeah, that change does not do the thing you wanted then | 19:06 |
| mriedem | fungi: i suppose we should just revert | 19:06 |
| dims_ | mriedem : hang on | 19:06 |
| mriedem | i'd have to dig up what dhellmann did to turn that off for liberty | 19:06 |
| *** jamesmcarthur has quit IRC | 19:06 | |
| clarkb | pabelanger: I am about to have lunch but can pick that up after if it helps | 19:06 |
| fungi | mriedem: dims_: we already only run the propose-requirements-constraints-master job in the periodic pipeline for openstack/requirements | 19:07 |
| *** tiswanso_ has joined #openstack-infra | 19:07 | |
| *** tiswanso has quit IRC | 19:08 | |
| fungi | mriedem: dims_: the definition removed from jenkins/jobs/projects.yaml in that change was just cruft cleanup, so the only real effect of the change was to stop running the requirements sync to other projects for changes on any branches besides master | 19:08 |
| *** EricGonczer_ has joined #openstack-infra | 19:09 | |
| fungi | mriedem: dims_: the thing you actually wanted (don't run constraints updates for stable branches) was already teh case | 19:09 |
| dims_ | fungi : propose-requirements-constraints-master runs once every day, right? | 19:10 |
| dims_ | fungi : propose-requirements-updates was on every merge (post job) | 19:10 |
| fungi | dims_: right | 19:10 |
| *** e0ne has joined #openstack-infra | 19:11 | |
| dims_ | fungi : guess, i added this as i mixed them up? https://review.openstack.org/#/c/297225/1/zuul/layout.yaml | 19:11 |
| *** amitgandhinz has quit IRC | 19:11 | |
| fungi | dims_: it's possible that propose-requirements-updates also proposed constraints updates to the requirements project, but i'll have to look at the script | 19:11 |
| dims_ | fungi : just dropping that is enough. right? | 19:11 |
| *** mylu has quit IRC | 19:11 | |
| dims_ | ack am checking as well | 19:11 |
| *** esikachev has quit IRC | 19:12 | |
| fungi | dims_: yeah, i think so, unless the job itself also does a constraints update in addition to reqs sync to all the projects | 19:12 |
| *** tqtran has quit IRC | 19:12 | |
| *** tqtran has joined #openstack-infra | 19:12 | |
| *** jsavak has quit IRC | 19:13 | |
| *** e0ne has quit IRC | 19:13 | |
| *** MarkAtwood has quit IRC | 19:13 | |
| openstackgerrit | Merged openstack-infra/puppet-user: Order of the class parameters is refactored https://review.openstack.org/295380 | 19:13 |
| openstackgerrit | Merged openstack-infra/puppet-yum: Order of the class parameters is refactored https://review.openstack.org/295381 | 19:13 |
| *** mylu has joined #openstack-infra | 19:13 | |
| openstackgerrit | Merged openstack-infra/puppet-stackalytics: Order of the class parameters is refactored https://review.openstack.org/295362 | 19:13 |
| openstackgerrit | Merged openstack-infra/puppet-redis: Order of the class parameters is refactored https://review.openstack.org/295346 | 19:13 |
| *** EricGonczer_ has quit IRC | 19:13 | |
| lennyb | Hi Infra, I've started to get exception from zuul ( I am working with master ). #link http://paste.openstack.org/show/492493/ | 19:13 |
| *** amitgandhinz has joined #openstack-infra | 19:14 | |
| *** jtomasek_ has joined #openstack-infra | 19:15 | |
| fungi | dims_: yeah, following the logic in the job definition and the script it calls, that job shouldn't br proposing constraints updates. which i believe is why we've generally recommended that requirements changes when proposed include constraints edits when necessary (for example, when capping/skipping latest release of a dep) | 19:15 |
| *** esikachev has joined #openstack-infra | 19:15 | |
| dims_ | fungi : ack i'll propose a review to revert just https://review.openstack.org/#/c/297225/1/zuul/layout.yaml then | 19:15 |
| fungi | dims_: thanks. that should do it | 19:16 |
| dims_ | good catch fungi : thanks | 19:16 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Update Configuration for Precise https://review.openstack.org/299577 | 19:17 |
| fungi | dims_: well, mriedem deserves the credit for spotting it, i just did the detective work through logs and git history | 19:17 |
| clarkb | lennyb: does check-nova run on merged refs? | 19:17 |
| dims_ | mriedem : thanks! | 19:17 |
| clarkb | lennyb: it looks like there is a mismatch between the chagne type you have provided and whatever is in the queue already | 19:17 |
| smarcet | fungi: i sent another update to https://review.openstack.org/#/c/299577 its seems that failed to build | 19:17 |
| fungi | smarcet: awesome--i was just digging into the failure log for that | 19:18 |
| lennyb | clarkb: no, I was trying to rerun job that failed, and missed that this change was already merged. | 19:18 |
| pabelanger | clarkb: Ya, I can do that now | 19:19 |
| smarcet | fungi: i just saw a warning re: class scope, | 19:19 |
| *** akshai has quit IRC | 19:19 | |
| lennyb | clarkb: thanks, I got your point. | 19:19 |
| *** jsavak has joined #openstack-infra | 19:19 | |
| *** piet has quit IRC | 19:20 | |
| *** akshai has joined #openstack-infra | 19:20 | |
| *** piet has joined #openstack-infra | 19:21 | |
| fungi | smarcet: agreed, that looks like all there was. i'll approve once that job reruns | 19:21 |
| *** devkulkarni has quit IRC | 19:21 | |
| smarcet | fungi: roger thx ! | 19:21 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: propose-requirements-updates should run on all branches https://review.openstack.org/299589 | 19:21 |
| dims_ | mriedem : fungi : ^^ | 19:21 |
| *** jamesmcarthur has joined #openstack-infra | 19:22 | |
| mriedem | dims_: what is the job that updates upper-constraints? | 19:22 |
| mriedem | oh propose-requirements-constraints-master | 19:22 |
| *** achanda has quit IRC | 19:24 | |
| dims_ | mriedem : y both jobs run /usr/local/jenkins/slave_scripts/propose_update.sh with different params | 19:24 |
| *** akshai has quit IRC | 19:24 | |
| *** gordc has quit IRC | 19:25 | |
| fungi | the same proposal logic gets used for lots of different things, so we just have branching in there based on a command-line parameter | 19:25 |
| dims_ | right | 19:26 |
| *** ociuhandu has joined #openstack-infra | 19:26 | |
| *** jsavak has quit IRC | 19:26 | |
| *** EricGonczer_ has joined #openstack-infra | 19:27 | |
| *** jsavak has joined #openstack-infra | 19:27 | |
| *** fawadkhaliq has quit IRC | 19:28 | |
| *** fawadkhaliq has joined #openstack-infra | 19:28 | |
| *** EricGonczer_ has quit IRC | 19:30 | |
| *** akshai has joined #openstack-infra | 19:30 | |
| *** imcsk8 has quit IRC | 19:33 | |
| *** imcsk8 has joined #openstack-infra | 19:34 | |
| *** esker has joined #openstack-infra | 19:34 | |
| pabelanger | clarkb: 29 images left to upload | 19:34 |
| pabelanger | clarkb: also deleted devstack-trusty too | 19:35 |
| *** gyee has quit IRC | 19:35 | |
| *** resker has joined #openstack-infra | 19:36 | |
| *** esikache1 has joined #openstack-infra | 19:36 | |
| fungi | we seem to be a bit starved for devstack-centos7 nodes at the moment | 19:37 |
| openstackgerrit | Merged openstack-infra/project-config: Adding networking-hpe project. https://review.openstack.org/295775 | 19:37 |
| pabelanger | checking | 19:37 |
| *** esikachev has quit IRC | 19:38 | |
| *** esker has quit IRC | 19:39 | |
| *** kuromagi has quit IRC | 19:39 | |
| pabelanger | fungi: should have 2 online atm | 19:39 |
| *** abregman|afk has quit IRC | 19:39 | |
| *** kuromagi has joined #openstack-infra | 19:39 | |
| *** resker has quit IRC | 19:41 | |
| *** mrmartin has quit IRC | 19:41 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add libselinux-python for ansible jobs https://review.openstack.org/299592 | 19:41 |
| jroll | AJaeger: LOL, oops, I missed that | 19:44 |
| openstackgerrit | Matthew Edmonds proposed openstack/requirements: Update keystoneclient lower bound https://review.openstack.org/299593 | 19:44 |
| *** Sukhdev has quit IRC | 19:44 | |
| fungi | pabelanger: yeah, jobs i was watching eventually got one | 19:45 |
| *** dimtruck is now known as zz_dimtruck | 19:46 | |
| *** cburgess has quit IRC | 19:46 | |
| AJaeger | jroll: that's one of the reasons why I warned about using it, there're too many subtile things that can go wrong ;) | 19:46 |
| *** jamesmcarthur has quit IRC | 19:46 | |
| *** kgiusti has joined #openstack-infra | 19:47 | |
| *** cburgess has joined #openstack-infra | 19:47 | |
| *** baoli has quit IRC | 19:47 | |
| *** dtardivel has quit IRC | 19:48 | |
| jroll | AJaeger: ya, fair enough :) | 19:48 |
| *** esker has joined #openstack-infra | 19:48 | |
| *** baoli has joined #openstack-infra | 19:49 | |
| *** zz_dimtruck is now known as dimtruck | 19:49 | |
| *** baoli has quit IRC | 19:49 | |
| *** baoli has joined #openstack-infra | 19:50 | |
| *** devkulkarni has joined #openstack-infra | 19:50 | |
| *** achanda has joined #openstack-infra | 19:51 | |
| *** piet has quit IRC | 19:51 | |
| *** devkulkarni has quit IRC | 19:51 | |
| *** amitgandhinz has quit IRC | 19:51 | |
| *** abregman|afk has joined #openstack-infra | 19:51 | |
| *** amitgandhinz has joined #openstack-infra | 19:51 | |
| *** gordc has joined #openstack-infra | 19:52 | |
| *** devkulkarni has joined #openstack-infra | 19:52 | |
| *** esker has quit IRC | 19:53 | |
| *** rockyg has joined #openstack-infra | 19:53 | |
| *** yamamoto has joined #openstack-infra | 19:53 | |
| *** zeih_ has joined #openstack-infra | 19:54 | |
| *** fawadkhaliq has quit IRC | 19:55 | |
| *** angdraug has joined #openstack-infra | 19:55 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackid: Update Configuration for Precise https://review.openstack.org/299577 | 19:56 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Move windmill to centos-7 dib https://review.openstack.org/299597 | 19:56 |
| *** devkulkarni has quit IRC | 19:56 | |
| *** jamesmcarthur has joined #openstack-infra | 19:57 | |
| *** mrmartin has joined #openstack-infra | 19:58 | |
| *** zeih__ has joined #openstack-infra | 19:59 | |
| *** sdake_ has joined #openstack-infra | 20:00 | |
| *** zeih_ has quit IRC | 20:00 | |
| *** jtomasek_ has quit IRC | 20:00 | |
| *** abregman|afk has quit IRC | 20:01 | |
| *** mylu has quit IRC | 20:01 | |
| clarkb | pabelanger: I think its safe to approve devstack trusty removal now so will review that change | 20:01 |
| *** baoli has quit IRC | 20:01 | |
| *** |-paul-| has joined #openstack-infra | 20:01 | |
| *** cburgess has quit IRC | 20:01 | |
| *** piet has joined #openstack-infra | 20:02 | |
| *** kuromagi has quit IRC | 20:02 | |
| *** kuromagi has joined #openstack-infra | 20:02 | |
| pabelanger | clarkb: great | 20:02 |
| *** sdake has quit IRC | 20:02 | |
| *** annegentle has quit IRC | 20:03 | |
| *** Clint has quit IRC | 20:03 | |
| *** yamamoto has quit IRC | 20:03 | |
| *** cburgess has joined #openstack-infra | 20:04 | |
| *** fawadkhaliq has joined #openstack-infra | 20:05 | |
| *** kuromagi has quit IRC | 20:05 | |
| clarkb | pabelanger: and it is approved | 20:05 |
| *** cburgess has quit IRC | 20:05 | |
| *** kuromagi has joined #openstack-infra | 20:05 | |
| *** gibi has quit IRC | 20:07 | |
| *** gibi has joined #openstack-infra | 20:07 | |
| smarcet | fungi: did puppet change applied to openstackid-dev.openstack.org? | 20:08 |
| *** cburgess has joined #openstack-infra | 20:08 | |
| fungi | smarcet: it should in the next few minutes. i'm tailing the syslog on the server so i can switch context to it once it shows up | 20:08 |
| smarcet | fungi: got ti | 20:09 |
| *** Clint has joined #openstack-infra | 20:09 | |
| openstackgerrit | Merged openstack-infra/project-config: propose-requirements-updates should run on all branches https://review.openstack.org/299589 | 20:11 |
| *** jamesmcarthur has quit IRC | 20:11 | |
| pabelanger | clarkb: exciting | 20:11 |
| *** angdraug has quit IRC | 20:12 | |
| pabelanger | clarkb: Going to update the nodepool patch and use the CLI like you suggested for the image workers | 20:12 |
| *** jamesmcarthur has joined #openstack-infra | 20:13 | |
| *** angdraug has joined #openstack-infra | 20:13 | |
| clarkb | pabelanger: ok | 20:13 |
| *** angdraug has quit IRC | 20:13 | |
| *** kzaitsev_mb has quit IRC | 20:13 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:14 | |
| *** cburgess has quit IRC | 20:14 | |
| *** piet has quit IRC | 20:14 | |
| clarkb | pabelanger: we are also down to 24 image uploads | 20:15 |
| openstackgerrit | Merged openstack-infra/project-config: Remove devstack-trusty from nodepool https://review.openstack.org/297942 | 20:15 |
| pabelanger | #success migration from devstack-trusty to ubuntu-trusty complete! | 20:15 |
| openstackstatus | pabelanger: Added success to Success page | 20:15 |
| AJaeger | yeah! | 20:15 |
| pabelanger | AJaeger: awesome work | 20:16 |
| AJaeger | pabelanger: awesome work ;) | 20:16 |
| AJaeger | pabelanger: great team work as usual, thanks! | 20:16 |
| *** jamesmcarthur has quit IRC | 20:16 | |
| pabelanger | ++ | 20:16 |
| *** esker has joined #openstack-infra | 20:16 | |
| fungi | anybody happen to know, from way waaaaaay back, why some projects might still have feedparser in their test requirements? http://codesearch.openstack.org/?q=feedparser turns up a handful declaring it as a test requirement but none actually importing it | 20:17 |
| *** cburgess has joined #openstack-infra | 20:19 | |
| clarkb | fungi: does git log show when/why it was added? | 20:19 |
| *** pleia2 has quit IRC | 20:19 | |
| clarkb | fungi: if I had to guess though its a docs thing? | 20:20 |
| *** pleia2 has joined #openstack-infra | 20:20 | |
| fungi | clarkb: sort of... i did a git blame on sqlalchemy-migrate and turned up this gem: http://git.openstack.org/cgit/openstack/sqlalchemy-migrate/commit/?id=a71799e | 20:20 |
| clarkb | like sphinx uses it to generate feeds for doc updates maybe? | 20:20 |
| *** mylu has joined #openstack-infra | 20:20 | |
| fungi | "Updated to OpenStack Build stuff." | 20:20 |
| AJaeger | it was in the initial import to requirements repository | 20:20 |
| fungi | yeah, and sqla-m is the oldest repo carrying it still | 20:21 |
| *** annegentle has joined #openstack-infra | 20:21 | |
| fungi | looks like it cargo-culted from something still older | 20:21 |
| *** esker has quit IRC | 20:21 | |
| AJaeger | fungi, will you send cleanup patches? | 20:21 |
| pabelanger | sdague: do you mind reviewing: https://review.openstack.org/#/c/298525/ since you disabled fedora-23 | 20:22 |
| fungi | AJaeger: if i figure out for sure it's unused. it's possible this is an optional dependency we don't import in our code but something else we use does magic when it's present | 20:22 |
| clarkb | ya I am not finding anything more useful | 20:23 |
| clarkb | probably is stale and can be removed? | 20:23 |
| *** sridhar_ram has joined #openstack-infra | 20:23 | |
| fungi | it was in nova's test-requirements as recently as last year | 20:23 |
| *** nadya has joined #openstack-infra | 20:23 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bgpvpn dvsm job: add gate_hook https://review.openstack.org/299610 | 20:23 |
| *** fawadkhaliq has quit IRC | 20:24 | |
| fungi | i think i'll do a little spelunking there | 20:24 |
| *** fawadkhaliq has joined #openstack-infra | 20:25 | |
| sdague | pabelanger: do we have a recent log somewhere? | 20:25 |
| sdague | pabelanger: ah, yep, in the commit message | 20:25 |
| sdague | pabelanger: +A | 20:26 |
| pabelanger | sdague: Ya, ianw did some logging | 20:26 |
| pabelanger | sdague: thanks | 20:26 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on external orders * added 412 validation * addded 404 validation https://review.openstack.org/299614 | 20:26 |
| sdague | yep, great, it's in the hour ball park which is totally cool | 20:26 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use cached instack qcow image for all ci tests https://review.openstack.org/299537 | 20:26 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Pre install packages on the instack image https://review.openstack.org/299538 | 20:26 |
| sdague | it was just the running to 3 hours that wasn't :) | 20:26 |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bgpvpn dvsm job: add gate_hook https://review.openstack.org/299610 | 20:26 |
| fungi | clarkb: AJaeger: aha! http://git.openstack.org/cgit/openstack/nova/commit/?id=9e3fd76 "Use feedparser to parse the generated atom feeds in the tests for the versions resource." | 20:26 |
| fungi | circa 5 years ago | 20:26 |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on external orders * added 412 validation * addded 404 validation https://review.openstack.org/299614 | 20:27 |
| openstackgerrit | Merged openstack-infra/project-config: Remove deprecated branches from irc notification https://review.openstack.org/299498 | 20:27 |
| sdague | fungi: just remember, if you ever need an openwrt image, you can get it out of the nova git tree | 20:27 |
| *** zeih__ has quit IRC | 20:27 | |
| *** esikache1 has quit IRC | 20:27 | |
| fungi | bwahahahahaha | 20:27 |
| AJaeger | fungi, yeah, there's a lot of cruft. Like I found spidermonkey package requirements - and ceilometer is not using it for ages ... | 20:28 |
| zigo | Am I right that there's a $WORKPLACE in jenkins, which will be where the git repo is cloned? | 20:28 |
| zigo | ie: $WORKPLACE vs $WORKSPACE ? | 20:28 |
| zigo | fungi: AJaeger: ^ | 20:28 |
| clarkb | zigo: it is WORKSPACE iirc and yes for non devstack jobs that is typically where the repo is cloned and checked out | 20:28 |
| fungi | generally it will be /home/jenkins/workspace/<name_of_job>/ | 20:29 |
| clarkb | any other takers on https://review.openstack.org/#/c/298998/ for the advancement of our new xenial overlords? | 20:29 |
| fungi | it's also the current working directory for the jobs unless something in your job changes its cwd | 20:30 |
| zigo | I thought that we had WORKPLACE= /home/jenkins/workspace/<name_of_job>/, but that's WORKSPACE ? | 20:30 |
| * clarkb reviews some swift multinode | 20:30 | |
| fungi | zigo: i don't know what WORKPLACE is, but looks like a typo | 20:30 |
| zigo | fungi: Ok, thanks for clearing my confusion ! :) | 20:30 |
| * zigo ammends the commit | 20:31 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: ssh less https://review.openstack.org/295973 | 20:31 |
| sdague | fungi: https://github.com/openstack/nova/commit/6dc4d23e01d1fcd8aa27d34d8b3b2cba5eac9573 | 20:31 |
| openstackgerrit | Merged openstack-infra/project-config: Retire openstack-ansible-os_swift_sync repository https://review.openstack.org/299364 | 20:31 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Add a job to build openstack-pkg-tools https://review.openstack.org/294022 | 20:32 |
| *** angdraug has joined #openstack-infra | 20:32 | |
| *** sdake has joined #openstack-infra | 20:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Re-activate Ubuntu beaker for puppet-pacemaker. https://review.openstack.org/298650 | 20:32 |
| fungi | sdague: wow, 4.4mb | 20:33 |
| fungi | nova/smoketests/openwrt-x86-ext2.image | 20:33 |
| AJaeger | project-config cores, can we merge two more changes, please? Gertty shows the total number of open changes for project-config and we're at 101 ;) | 20:33 |
| *** sdake_ has quit IRC | 20:33 | |
| AJaeger | sdague: wow, thanks for sharing! | 20:34 |
| sdague | fungi: yeh, I found it by running some commands looking for large files | 20:34 |
| sdague | in the git history | 20:34 |
| anteaya | AJaeger: your magic number is 99? | 20:34 |
| *** rossella_s has quit IRC | 20:34 | |
| *** rossella_s has joined #openstack-infra | 20:35 | |
| anteaya | wayne gretzky would be proud | 20:35 |
| fungi | smarcet: pabelanger: new issue with the openstackid-dev changes... it's not creating /etc/apache2/sites-available/50-openstackid-dev.openstack.org.conf (i'm looking now to see if i can spot the reason) | 20:36 |
| AJaeger | anteaya: going from 3 digits to 2 ;) | 20:36 |
| AJaeger | anteaya: 42 is the goal, isn't it? ;) | 20:36 |
| fungi | AJaeger: easier solution--switch to hexidecimal | 20:36 |
| smarcet | fungi: perhaps a parser error ? | 20:36 |
| *** achanda has quit IRC | 20:37 | |
| fungi | smarcet: possibly, i'm still digging | 20:37 |
| zigo | fungi: Using OpenWRT as the image that Nova spawns, instead of cirros? :P | 20:37 |
| zigo | Smart move. | 20:37 |
| fungi | zigo: way back in the day, that's what it looks like they did, yes | 20:37 |
| *** mylu has quit IRC | 20:37 | |
| anteaya | AJaeger: is it? | 20:37 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "move fedora23 devstack to experimental" https://review.openstack.org/298525 | 20:37 |
| AJaeger | fungi: do you think jeblair would approve a switch to use hexadecimal numbers? | 20:37 |
| anteaya | AJaeger: I considered the answer | 20:37 |
| anteaya | never thought about it as the goal | 20:37 |
| *** nadya has quit IRC | 20:38 | |
| clarkb | sdague: for this enable swift services on subnode change, is there work on the devstack side to configure them proprely yet? | 20:38 |
| AJaeger | anteaya: there's no goal for number of open reviews - but having a not too long backlog is great. I think we're in a good position now if we filter out all the ones that jenkins doesn't like | 20:38 |
| fungi | smarcet: we also got... Could not find command '/usr/sbin/php5enmod' | 20:38 |
| clarkb | sdague: are we able to see swift function in a 2 node cluster anywhere yet? | 20:38 |
| *** devkulkarni has joined #openstack-infra | 20:38 | |
| smarcet | ok let me check o nthat | 20:38 |
| *** MarkAtwood has joined #openstack-infra | 20:39 | |
| *** esikache1 has joined #openstack-infra | 20:39 | |
| notmyname | clarkb: "...just a quick note on the rolling upgrade tests: I’m working on a local dual-node test env, based on sdague’s patches to use that approach, but it’s not done yet. i’ll continue working on that" | 20:39 |
| anteaya | AJaeger: no double digits are fine as the reason | 20:39 |
| notmyname | clarkb: that's from cschwede who's been out for a few days | 20:40 |
| *** mylu has joined #openstack-infra | 20:40 | |
| notmyname | clarkb: and we're going to bring it up in the swift meeting in 20 minutes | 20:40 |
| anteaya | and yes you do a wonderful job of keeping reviews in shape, thank you | 20:40 |
| notmyname | clarkb: summary is that it's still in progress, I expect good things soon, but it's not done yet | 20:40 |
| clarkb | ok | 20:40 |
| anteaya | dougwig: can you work a review of https://review.openstack.org/#/c/298142/ into your schedule | 20:40 |
| clarkb | mostly trying to figure out if we can/should approve this devstack-gate change yet | 20:40 |
| clarkb | in other news anyone know what ansible return codes are? | 20:41 |
| anteaya | dougwig: it is a networking-midonet patch | 20:41 |
| pabelanger | fungi: Hmm, do you have a puppet log of the provision? | 20:41 |
| sdague | clarkb: I would hold on the devstack-gate change for now | 20:41 |
| openstackgerrit | Merged openstack-infra/project-config: Add NFS job to Cinder experimental https://review.openstack.org/299455 | 20:41 |
| clarkb | sdague: ok | 20:41 |
| fungi | pabelanger: sure, it's in syslog on openstackid-dev.openstack.org | 20:41 |
| sdague | there is a bit about coordinating the ring building between the nodes that needs sorting out | 20:41 |
| AJaeger | anteaya: it's not only me, others help a lot as well - especially yolanda | 20:42 |
| sdague | some basically wrongness with devstack not starting any services on the subnodes was fixed, and the d-g patch helped see that | 20:42 |
| anteaya | AJaeger: just confirming again 287415 is good to merge? | 20:42 |
| anteaya | AJaeger: she does too | 20:42 |
| clarkb | sdague: is it worth WIPing? from what I can tell that change doesn't appear to break the existing mutlinoe setup, but it doesn't really do anything other than make devstack run longer yet | 20:42 |
| AJaeger | anteaya: yes, it's now. | 20:42 |
| fungi | pabelanger: i'm thinking it's because of this... (/Stage[main]/Openstackid/Apache::Vhost::Custom[openstackid-dev.openstack.org]/Apache::Custom_config[openstackid-dev.openstack.org]/Exec[syntax verification for openstackid-dev.openstack.org]/returns) Invalid command 'MaxRequestWorkers', perhaps misspelled or defined by a module not included in the server configuration | 20:42 |
| anteaya | AJaeger: thanks | 20:42 |
| AJaeger | anteaya: thanks! | 20:42 |
| notmyname | sdague: does the ring-building need to be in that patch right now? or can we do that separately later? | 20:42 |
| pabelanger | fungi: Ya, I think we need to fixup the errors | 20:42 |
| *** mylu has quit IRC | 20:43 | |
| sdague | notmyname: it probably is worth getting sorted up front | 20:43 |
| AJaeger | 99 open project-config changes - time to call it a day ;) | 20:43 |
| * AJaeger waves good bye | 20:43 | |
| notmyname | sdague: ok. I'm waiting to hear from cschwede on that | 20:43 |
| fungi | pabelanger: unfortunately, i'm not immediately spotting where we're setting MaxRequestWorkers (is this something being set by the puppetlabs apache module?) | 20:43 |
| *** esker has joined #openstack-infra | 20:43 | |
| sdague | because until that happens what we actually have is a swift cluster on the main node, and an orphan swift cluster on the subnode that doesn't do anything but take up space... I think | 20:43 |
| fungi | AJaeger: a great end to a great day! | 20:43 |
| clarkb | sdague: that is my understanding as well | 20:44 |
| pabelanger | fungi: yes: https://github.com/puppetlabs/puppetlabs-apache/blob/master/templates/mod/event.conf.erb | 20:44 |
| pabelanger | fungi: we want mpm right? | 20:45 |
| anteaya | AJaeger: enjoy your evening | 20:45 |
| *** matrohon has joined #openstack-infra | 20:45 | |
| smarcet | pabelanger:fungi : ok working on a fix thx ! | 20:45 |
| fungi | pabelanger: mpm_event yes | 20:45 |
| fungi | pabelanger: we want to override that anyway with our own tuning parameters | 20:46 |
| *** MarkAtwood has quit IRC | 20:46 | |
| fungi | oh, i see, that's what that is trying to do | 20:46 |
| *** esikache1 has quit IRC | 20:47 | |
| fungi | pabelanger: and it's installing apache2-mpm-event successfully, but maybe MaxRequestWorkers is not part of apache 2.2? | 20:48 |
| *** openstackgerrit has quit IRC | 20:48 | |
| *** openstackgerrit has joined #openstack-infra | 20:48 | |
| pabelanger | fungi: possible, that is what I am googling | 20:48 |
| fungi | MaxRequestWorkers was called MaxClients before version 2.3.13. The old name is still supported. | 20:48 |
| clarkb | dougwig: comment on https://review.openstack.org/#/c/292175/1 I like the change in general but would like that logging to be tightened up. Inline comment has details | 20:48 |
| fungi | pabelanger: https://httpd.apache.org/docs/current/mod/mpm_common.html#maxrequestworkers | 20:48 |
| *** zeih_ has joined #openstack-infra | 20:48 | |
| rcarrillocruz | https://httpd.apache.org/docs/current/mod/mpm_common.html#maxrequestworkers | 20:48 |
| rcarrillocruz | you beat me | 20:48 |
| rcarrillocruz | so yeah | 20:48 |
| rcarrillocruz | it's a version thing | 20:48 |
| rcarrillocruz | MaxRequestWorkers was called MaxClients before version 2.3.13. The old name is still supported. | 20:49 |
| pabelanger | fungi: smarcet: so, we should be using the apache::mpm class, shouldn't we? | 20:49 |
| smarcet | fungi:pabelanger: at any rate i think that i should use the facilities that module give to set up the tunning connections | 20:49 |
| *** piet has joined #openstack-infra | 20:49 | |
| * rcarrillocruz goes back to his terminal session | 20:49 | |
| smarcet | pabelanger: yes on it | 20:49 |
| smarcet | :) | 20:49 |
| fungi | pabelanger: can we vendor in our own version of that file for now to avoid the error until a fix can be approved into puppetlabs apache? | 20:49 |
| pabelanger | fungi: right, there is also ::apache::mod::event too, for tuning | 20:49 |
| pabelanger | fungi: if that fails, we can patch upstream | 20:50 |
| smarcet | fungi:pabelanger: ok i will use ::apache::mod::event then | 20:50 |
| pabelanger | smarcet: Ya, you have a few choices | 20:50 |
| *** mylu has joined #openstack-infra | 20:51 | |
| *** nadya has joined #openstack-infra | 20:51 | |
| *** mylu has quit IRC | 20:52 | |
| *** gordc has quit IRC | 20:53 | |
| clarkb | dstufft: does pip install a pip2 and pip3 to the bin path when installed via the get pip url thing? | 20:53 |
| clarkb | I think that is a distroism | 20:54 |
| *** mylu has joined #openstack-infra | 20:54 | |
| *** nadya has quit IRC | 20:54 | |
| *** stevemar has quit IRC | 20:55 | |
| fungi | clarkb: i think the python upstream approach is python3 -m pip if you want something like a pip3 | 20:55 |
| dstufft | pip does currently install pip, pipX, and pipX.Y | 20:55 |
| *** stevemar has joined #openstack-infra | 20:55 | |
| *** roxanaghe has quit IRC | 20:55 | |
| fungi | dstufft: for every version of the python interpreter on the system where you install it? | 20:56 |
| clarkb | oh hey looks like it does | 20:56 |
| dstufft | fungi: no, for whatever version you're installing it for | 20:56 |
| fungi | got it | 20:56 |
| dstufft | I'm not sure what th elong term thing will be there | 20:56 |
| fungi | so if you want that behavior for multiple interpreters, you have to reinstall it multiple times | 20:56 |
| dstufft | the current solution kind of sucks | 20:56 |
| *** achanda has joined #openstack-infra | 20:56 | |
| clarkb | in this case it should be sufficient | 20:56 |
| dstufft | it's not unusual for ``python2`` and ``pip2`` to point to different pythons | 20:57 |
| clarkb | https://review.openstack.org/#/c/246017/4/functions.sh | 20:57 |
| dstufft | which is crummy | 20:57 |
| fungi | ouch | 20:57 |
| anteaya | yes | 20:57 |
| fungi | yeah | 20:57 |
| clarkb | dstufft: that would happen if say you have a system python2.6 on centos6 but then sideload a pip + python2.7 elsewhere? | 20:57 |
| *** achanda has quit IRC | 20:57 | |
| dstufft | clarkb: yea, or on OSX if you have Python 2.x from the system and from homebrew | 20:58 |
| *** achanda has joined #openstack-infra | 20:58 | |
| *** mylu has quit IRC | 20:58 | |
| dstufft | python -m pip works, and is more explicit but more typing so users tend to not be particularly happy about it | 20:58 |
| dstufft | (and it doesn't actually work on 2.6, you have to do python -m pip.__main__) | 20:59 |
| *** Sukhdev has joined #openstack-infra | 20:59 | |
| *** matrohon has quit IRC | 20:59 | |
| fungi | given most of our pip usage is in the context of virtualenvs, it's less of an issue since you create the virtualenv with whatever interpreter you want used | 20:59 |
| dstufft | yea | 21:00 |
| *** stevemar has quit IRC | 21:00 | |
| smarcet | fungi:pabelanger: testing changes locally | 21:00 |
| fungi | but some places like devstack, it's still a problem | 21:00 |
| smarcet | i will submit a patch :) | 21:00 |
| fungi | smarcet: thanks! i'll be available to review and get it fast-tracked in | 21:00 |
| openstackgerrit | Merged openstack-infra/project-config: Use ZUUL_REFNAME (2/2) for branch checking https://review.openstack.org/287415 | 21:01 |
| clarkb | fungi: it should be fine with devstack too because devstack never installs python from random places | 21:01 |
| clarkb | fungi: devstack should only use system pythons I think | 21:01 |
| fungi | clarkb: well, yes and no... devstack may have multiple python interpreters | 21:02 |
| fungi | and if you want to pip install something which is going to build extensions against the python3 headers... | 21:02 |
| *** chem has quit IRC | 21:03 | |
| clarkb | devstack would have to be explicit there | 21:03 |
| clarkb | but in that case pip3 should work | 21:03 |
| fungi | at least i assume 246017 is in service of people wanting to do py3k testing of things within devstack environments, though it doesn't really say | 21:03 |
| fungi | clarkb: pip3 will only exist if you explicitly install pip using python3 | 21:03 |
| fungi | or at least that's the way i understood dstufft's explanation | 21:04 |
| *** bpokorny has quit IRC | 21:04 | |
| clarkb | yup | 21:04 |
| *** sdague has quit IRC | 21:04 | |
| clarkb | devstack will need to be explicit | 21:04 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Sync nodepool-builder logging with latest changes https://review.openstack.org/299627 | 21:04 |
| pabelanger | fungi: clarkb: ^ ianw just reminded me about nodepool-builder logging | 21:04 |
| *** _ari_ has quit IRC | 21:04 | |
| fungi | clarkb: sure, but if devstack's going to be explicit anyway, it can just python -m pip instead of reinstalling pip multiple times | 21:04 |
| fungi | er, python3 -m pip | 21:05 |
| dougwig | clarkb and anteaya: looking | 21:05 |
| dougwig | clarkb: np, agree, will respin | 21:06 |
| fungi | clarkb: or i suppose devstack can directly create the pip3 symlink | 21:06 |
| clarkb | fungi: I can remove my approval and you can -1 with comments to use pythonX -m pip for freeze listings instead | 21:06 |
| clarkb | pabelanger: +2 | 21:06 |
| fungi | well, i thought you indicated that you found a /usr/bin/pip3 on a devstack machine, in which case i'm curious what created it | 21:06 |
| ianw | wow, that file is almost getting to the point you could manage it by hand | 21:06 |
| *** roxanaghe has joined #openstack-infra | 21:07 | |
| clarkb | fungi: I did not, as far as I know devstack isn't doing anyhting python3 yet | 21:07 |
| clarkb | fungi: I managed to get those bins created in local venvs | 21:07 |
| *** amitgandhinz has quit IRC | 21:07 | |
| clarkb | I went ahead and changed to a -1 | 21:08 |
| fungi | clarkb: yep, adding a comment now | 21:08 |
| *** julim has quit IRC | 21:08 | |
| *** jsavak has quit IRC | 21:08 | |
| *** dprince has quit IRC | 21:09 | |
| *** amrith is now known as _amrith_ | 21:10 | |
| clarkb | ianw: btw I have approved a change that conflicts with https://review.openstack.org/#/c/296171/1 I figured the proper order was the change that fixes repreoduce then we can reduce the logging (since the assertion isn't quite correct given there is a big) | 21:10 |
| clarkb | ianw: I am happy to rebase that for you if you like | 21:10 |
| *** julim has joined #openstack-infra | 21:11 | |
| *** eil397 has quit IRC | 21:12 | |
| *** mylu has joined #openstack-infra | 21:13 | |
| *** thorst has quit IRC | 21:14 | |
| *** alkhodos has joined #openstack-infra | 21:14 | |
| *** thorst has joined #openstack-infra | 21:15 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** zeih_ has quit IRC | 21:16 | |
| *** jsavak has joined #openstack-infra | 21:16 | |
| *** annegentle has quit IRC | 21:16 | |
| *** YorikSar has quit IRC | 21:16 | |
| ianw | clarkb: sure ... well yeah, i just noticed it constantly in the logs where (usually) it's noise | 21:17 |
| *** thorst_ has joined #openstack-infra | 21:17 | |
| *** YorikSar has joined #openstack-infra | 21:17 | |
| *** thorst has quit IRC | 21:19 | |
| ianw | https://review.openstack.org/#/c/290968/ is another one for dib that would help signal:noise ratios on logs i seem to look at a lot (poke SpamapS :) | 21:19 |
| *** mrmartin has quit IRC | 21:20 | |
| *** maishsk has quit IRC | 21:20 | |
| *** maishsk_ has joined #openstack-infra | 21:20 | |
| *** rfolco has quit IRC | 21:21 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations https://review.openstack.org/288715 | 21:21 |
| *** _amrith_ is now known as amrith | 21:22 | |
| *** tqtran is now known as tqtran-afk | 21:22 | |
| *** thorst_ has quit IRC | 21:22 | |
| *** devkulkarni has quit IRC | 21:23 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Updated config for Precise https://review.openstack.org/299636 | 21:23 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 21:24 |
| smarcet | fungi: i think that i got it https://review.openstack.org/#/c/299636/ | 21:24 |
| *** |-paul-| has quit IRC | 21:24 | |
| smarcet | waiting for jenkins review | 21:24 |
| *** annegentle has joined #openstack-infra | 21:25 | |
| *** eharney has quit IRC | 21:26 | |
| *** asettle has joined #openstack-infra | 21:26 | |
| fungi | smarcet: awesome | 21:26 |
| anteaya | verification | 21:26 |
| anteaya | jenkins can't review it can only verify | 21:27 |
| fungi | this is true. we leave teh reviewing to people | 21:27 |
| *** jsavak has quit IRC | 21:27 | |
| *** jsavak has joined #openstack-infra | 21:28 | |
| anteaya | fungi: can you tell me the story of what would take place if we created a new wiki instance? | 21:28 |
| *** Sukhdev has quit IRC | 21:29 | |
| anteaya | I'm tired of deleting and could use a good story | 21:29 |
| *** devkulkarni has joined #openstack-infra | 21:29 | |
| *** maishsk_ has quit IRC | 21:29 | |
| fungi | anteaya: well, we need the puppet-mediawiki module in a little more complete shape first | 21:29 |
| anteaya | specifically how can we sanitize the data for a migration | 21:29 |
| fungi | anteaya: then we use it do deploy a wiki-dev.o.o or similar | 21:29 |
| *** maishsk has joined #openstack-infra | 21:30 | |
| *** annegentle has quit IRC | 21:30 | |
| anteaya | makes sense so far | 21:30 |
| fungi | and copy a database backup from wiki.o.o to it and load it there | 21:30 |
| anteaya | that just moves the spam too, yeah? | 21:30 |
| fungi | and add a robots.txt that says "don't index anything on this site" | 21:30 |
| anteaya | ah | 21:30 |
| anteaya | that's the magic | 21:30 |
| fungi | so search engines won't be returning search results for that server | 21:30 |
| fungi | then we run the admin script to purge deleted articles on wiki.o.o | 21:31 |
| fungi | and if we discover any which should not have been deleted after that, we still have the ability for anyone in the community to find the content on the dev server and copy that content back into replacement pages on wiki.o.o | 21:31 |
| anteaya | oh we need the -dev server in place before we can run purge, hmmmm | 21:31 |
| fungi | well, i called it -dev but it could be anything | 21:32 |
| *** achanda has quit IRC | 21:32 | |
| anteaya | okay, that makes sense | 21:32 |
| anteaya | right, the non-indexed, non-production server | 21:32 |
| fungi | we should have a dev mediawiki deployment anyway so we can safely work through upgrades | 21:32 |
| clarkb | mtreinish: why isnt' https://review.openstack.org/#/c/297446/3/devstack-vm-gate.sh in devstack? | 21:32 |
| anteaya | I'm fine if that is called -dev | 21:32 |
| anteaya | okay | 21:32 |
| clarkb | mtreinish: seems like that could be part of the tempest install in devstack instead andthen it would work without d-g | 21:32 |
| mtreinish | clarkb: because devstack doesn't run tempest | 21:32 |
| clarkb | no but it installs it | 21:33 |
| mtreinish | and it needs to go into the right tox venv (which depends on how we run tempest) | 21:33 |
| anteaya | so the puppet module to create the non-indexed server, doesn't have to deal with upgrading or anything, just a deployment of what we are running now, right? | 21:33 |
| clarkb | and this is installing parts of tempest | 21:33 |
| fungi | anteaya: i mean, we _could_ run the purge now and just hold onto the most recent backup prior to that indefinitely, but if someone figures out there's a page missing it's some time to get that loaded on another mediawiki server to be able to easily retrieve it | 21:33 |
| fungi | anteaya: yeah, "just" a deployment of what we have in production already, except that the puppetry for that is (from what i've heard) nowhere near complete | 21:34 |
| mtreinish | clarkb: I've gotten a lot of pushback trying to play venv games with tox for tempest in devstack | 21:34 |
| *** thorst has joined #openstack-infra | 21:34 | |
| clarkb | mtreinish: hrm, I mean devstack exists to configure and install these things IMO this is where that goes | 21:34 |
| anteaya | fungi: well just in terms of not upgrading, not just in terms of it should be easy for someone not me to accomplish | 21:35 |
| clarkb | devstack gate shouldn't really need to know how to configure tempest or how to install it | 21:35 |
| mtreinish | like right now it makes 2-3 separate venvs with tox depending on how things are setup. (venv, full, and possible job name) | 21:35 |
| anteaya | fungi: is what we have deployed version wise on the wiki server documented anywhere I can view? | 21:35 |
| mtreinish | and when I've tried to consolidate that I got -1d | 21:35 |
| mtreinish | it was a while ago though | 21:35 |
| fungi | smarcet: close, but puppet lint is complaining about => alignment on lines 224-231 of init.pp | 21:35 |
| smarcet | ok checking on it | 21:36 |
| fungi | smarcet: the only job that hasn't finished running yet is the ubuntu-trusty apply job, but the bare-precise apply job worked so that's probably going to pass too | 21:37 |
| *** shashank_hegde has joined #openstack-infra | 21:37 | |
| mtreinish | clarkb: as absurd as this statement is, devstack only installs tempest twice for configuring things. It actually doesn't install it for the case where we're running with a plugin (or any job besides full) | 21:37 |
| mtreinish | that's the status quo | 21:37 |
| fungi | anteaya: http://docs.openstack.org/infra/system-config/wiki.html and the puppet-mediawiki module are the extent of the documentation we have on that deployment so far | 21:37 |
| anteaya | fungi: this looks like it just pulls in master at the time it is executed: http://git.openstack.org/cgit/openstack-infra/puppet-mediawiki/tree/manifests/app.pp | 21:38 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Updated config for Precise https://review.openstack.org/299636 | 21:38 |
| fungi | anteaya: there's also this https://wiki.openstack.org/wiki/Special:Version | 21:39 |
| *** thorst has quit IRC | 21:39 | |
| fungi | which might be the missing piece of that puzzle for you | 21:39 |
| anteaya | ah thank you | 21:39 |
| anteaya | look at that, version numbers | 21:39 |
| fungi | even git commit hashes! | 21:39 |
| fungi | with links to their source tree | 21:40 |
| anteaya | wooooo | 21:40 |
| fungi | and the list of extensions installed and what versions they're all at | 21:41 |
| anteaya | the list of extentions seem daunting, in that I don't think their installation is puppeted | 21:41 |
| fungi | it's usefully thorough | 21:41 |
| anteaya | it is indeed | 21:41 |
| pabelanger | clarkb: down to 14, going to step away for a bit. Do you mind landing 299627 and a nodepool-builder restart after image uploads? | 21:41 |
| pabelanger | I'll check back in a few hours | 21:41 |
| clarkb | mtreinish: also why does using a tempest plugin imply the all target? is that so that you can specify a regex? | 21:42 |
| anteaya | fungi: if we went with the backup and purge route, do you think we could tell folks to wait until after summit to retrive their content? | 21:43 |
| *** bpokorny has joined #openstack-infra | 21:43 | |
| *** esker has quit IRC | 21:43 | |
| pleia2 | there are a lot of extentions that ship by default but aren't enabled, you enable in the config, which we did get puppetized | 21:43 |
| *** esker has joined #openstack-infra | 21:43 | |
| anteaya | I'd like to help, but given what needs to be puppeted and my level of puppet knowledge I don't think I will get far enough before I leave tomorrow | 21:43 |
| anteaya | pleia2: yay | 21:43 |
| *** esker has quit IRC | 21:43 | |
| pleia2 | so we'd have to determine what has been added | 21:43 |
| fungi | pabelanger: smarcet: even with 299636 i'm still concerned that having MaxRequestWorkers in https://github.com/puppetlabs/puppetlabs-apache/blob/master/templates/mod/event.conf.erb is what's causing apache 2.2 to complain about an unrecognized directive | 21:43 |
| anteaya | pleia2: right | 21:43 |
| fungi | but willing to give it a shot | 21:44 |
| *** esker has joined #openstack-infra | 21:44 | |
| anteaya | pleia2: are you working on translation site things at the moment? | 21:44 |
| anteaya | pleia2: or have you time to look at this with me? | 21:44 |
| smarcet | fungi: i think that puppet apache module take care of that , but we would see i guess | 21:44 |
| anteaya | pleia2: my concern is starting something and then leaving for a week | 21:45 |
| mtreinish | clarkb: yeah, there are regexes on all the other jobs, so it's just to give it a clean slate to ensure whatever the test_ids end up being from the plugins will be run | 21:45 |
| *** fawadkhaliq has quit IRC | 21:45 | |
| anteaya | pleia2: I don't want to leave you doing all the work | 21:45 |
| *** piet has quit IRC | 21:45 | |
| pleia2 | anteaya: depends on what you need :) I don't know that I can make time right now for a deep dive of massive mediawiki understanding | 21:46 |
| *** tiswanso_ has quit IRC | 21:46 | |
| clarkb | now to completely change the subject, I think dib may have regressed our grub configs | 21:46 |
| clarkb | we appear to have a 10 second boot timeout | 21:47 |
| clarkb | because you know 10 seconds * 25k instances per day = money | 21:47 |
| *** esker has quit IRC | 21:47 | |
| fungi | that's ~3 servers worth of quota doing nothing but waiting for a keypress which will never come | 21:48 |
| *** davidlenwell has quit IRC | 21:48 | |
| pleia2 | ugh | 21:48 |
| *** esker has joined #openstack-infra | 21:49 | |
| *** aysyd has quit IRC | 21:49 | |
| anteaya | pleia2: okay thanks, I understand | 21:49 |
| *** Sukhdev has joined #openstack-infra | 21:50 | |
| pleia2 | anteaya: happy to schedule some debugging sessions, or if you need info from the production server | 21:51 |
| pleia2 | just let me know | 21:51 |
| *** fawadkhaliq has joined #openstack-infra | 21:52 | |
| anteaya | thanks, I don't think it is worth me bothering you until after I get back | 21:52 |
| clarkb | I see the issue | 21:52 |
| anteaya | just so sad to see the search engine results | 21:52 |
| anteaya | which keep picking up deleted files | 21:52 |
| clarkb | when we removed the kernel boot parameter memory management stuff we also removed the grub timeout fixing | 21:52 |
| clarkb | I will add this back in | 21:53 |
| fungi | clarkb: d'oh! | 21:53 |
| *** thiagop has quit IRC | 21:53 | |
| fungi | we were eager to get the memory hacks out of there i guess | 21:53 |
| *** lakshmiS has quit IRC | 21:53 | |
| *** esker has quit IRC | 21:54 | |
| *** davidlenwell has joined #openstack-infra | 21:55 | |
| *** stevemar has joined #openstack-infra | 21:56 | |
| *** esker has joined #openstack-infra | 21:56 | |
| *** rockyg has quit IRC | 21:58 | |
| *** piet has joined #openstack-infra | 21:58 | |
| *** esker has quit IRC | 21:59 | |
| *** weshay has quit IRC | 21:59 | |
| *** esker has joined #openstack-infra | 21:59 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations https://review.openstack.org/288715 | 22:00 |
| *** stevemar has quit IRC | 22:01 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Add removal of grub boot timeouts back in https://review.openstack.org/299639 | 22:02 |
| clarkb | reviews for ^ should help us save 10 seconds per ubuntu-trusty boot :) | 22:02 |
| clarkb | not sure what the default is on fedora or centos | 22:02 |
| *** burgerk has quit IRC | 22:02 | |
| *** GonZo2000 has quit IRC | 22:03 | |
| *** esker has quit IRC | 22:04 | |
| *** jaypipes has quit IRC | 22:04 | |
| *** esker has joined #openstack-infra | 22:04 | |
| *** esker has quit IRC | 22:05 | |
| clarkb | to write that change I reverted the removal of the memory management, removed the memory management, then renamed things to better reflect their purpose | 22:05 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Save PROJECTS form the job defintion for use in reproduce.sh https://review.openstack.org/280027 | 22:05 |
| *** GonZo2000 has joined #openstack-infra | 22:05 | |
| *** GonZo2000 has quit IRC | 22:05 | |
| *** GonZo2000 has joined #openstack-infra | 22:05 | |
| *** mylu has quit IRC | 22:06 | |
| *** pradk has quit IRC | 22:07 | |
| *** shashank_hegde has quit IRC | 22:07 | |
| *** amitgandhinz has joined #openstack-infra | 22:08 | |
| *** mylu has joined #openstack-infra | 22:08 | |
| *** moravec has quit IRC | 22:09 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackid: Updated config for Precise https://review.openstack.org/299636 | 22:09 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations https://review.openstack.org/288715 | 22:10 |
| armax | hi fellas | 22:10 |
| armax | I am looking at http://status.openstack.org/zuul/ | 22:11 |
| armax | and the merge-check queue is a bit strange to my eyes | 22:11 |
| armax | I see changes that are not yet merged in the list | 22:11 |
| clarkb | armax: we check for the check queue too | 22:12 |
| clarkb | or rather | 22:12 |
| clarkb | the way that works is it queues a job for unmerged things to make sure they can all merge after something else merges | 22:12 |
| armax | clarkb: ack | 22:12 |
| armax | oh right, I always saw the outcome on gerrit, but I never managed to get that live in zuul | 22:13 |
| *** amitgandhinz has quit IRC | 22:13 | |
| armax | so the ‘noop’ job on each change does indeed do something? | 22:13 |
| fungi | it balloons and then deflates very quickly | 22:13 |
| clarkb | armax: yes it takes advantage of zuul's built in merge before testing behavior to test if those can merge | 22:14 |
| fungi | "noop" is a special job in zuul which actually runs nothing after the merge commit is calculated, so that no actual worker node is expended | 22:14 |
| armax | clarkb, fungi thanks for clearing that up for me | 22:14 |
| clarkb | http://logs.openstack.org/39/299639/1/check/gate-project-config-dib/85244c4/console.html#_2016-03-30_22_10_10_028 /me works to figure that out | 22:15 |
| fungi | basically, it still requests the merge commit but never injects a gearman work request for any the subsequent job | 22:15 |
| *** moravec has joined #openstack-infra | 22:16 | |
| *** shashank_hegde has joined #openstack-infra | 22:16 | |
| *** claudiub|2 has quit IRC | 22:16 | |
| *** jaypipes has joined #openstack-infra | 22:17 | |
| *** annegentle has joined #openstack-infra | 22:17 | |
| mtreinish | nibalizer: did we ever sort out the cacti thing? I still don't see subunit-worker02.o.o on there | 22:18 |
| clarkb | greghaynes: whats with that error I just linked above | 22:18 |
| clarkb | only use #!/bin/bash for scripts | 22:18 |
| clarkb | it is a script | 22:18 |
| *** jsavak has quit IRC | 22:18 | |
| clarkb | and the other finalise.d scripts in that dir do it too | 22:19 |
| clarkb | oh | 22:19 |
| clarkb | it means don't hvae the -xe | 22:19 |
| clarkb | ok../ | 22:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Workaround multiple priate network ports https://review.openstack.org/299645 | 22:19 |
| greghaynes | clarkb: ah, ya | 22:19 |
| greghaynes | clarkb: that message could be more clear | 22:20 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Add removal of grub boot timeouts back in https://review.openstack.org/299639 | 22:20 |
| *** fawadkhaliq has quit IRC | 22:20 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Workaround multiple private network ports https://review.openstack.org/299645 | 22:20 |
| clarkb | mordred: pirate network ports? | 22:20 |
| jeblair | arrr | 22:20 |
| clarkb | mordred: like those used by bittorrent? | 22:20 |
| * mordred walks the plank | 22:20 | |
| *** fawadkhaliq has joined #openstack-infra | 22:20 | |
| mordred | clarkb: :) | 22:20 |
| clarkb | mordred: 293155 is the ceph mirror change and I think it is ready now, but would like your review before I remove the WIP | 22:21 |
| *** mriedem has quit IRC | 22:21 | |
| clarkb | mordred: since it is relatively complicated and has lots of moving parts of which you seem to grasp all of them | 22:21 |
| mordred | clarkb: I shall look | 22:21 |
| mordred | clarkb: did you see my ceph question? | 22:21 |
| clarkb | mordred: I don't think so? | 22:22 |
| mordred | clarkb: there is a new ceph LTS being released in a week or so | 22:22 |
| mordred | clarkb: the thing post hammer | 22:22 |
| clarkb | oh ya I asked the nova people about that and kolla too and they said hammer is what they are using now | 22:23 |
| mordred | ok | 22:23 |
| mordred | cool | 22:23 |
| clarkb | and in theory we can add the next release relatively easily once we have hammer in place | 22:23 |
| clarkb | which is where a lot of the recent churn on that change comes from | 22:23 |
| clarkb | the realization that we need to be able to support >1 ceph repo for ubuntu/debian | 22:24 |
| *** markvoelker has joined #openstack-infra | 22:24 | |
| openstackgerrit | Merged openstack-infra/shade: Support provider networks in public network detection https://review.openstack.org/298890 | 22:25 |
| clarkb | down to 9 image uploads | 22:25 |
| *** tpsilva has quit IRC | 22:27 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:27 | |
| *** EricGonczer_ has joined #openstack-infra | 22:27 | |
| *** dimtruck is now known as zz_dimtruck | 22:28 | |
| *** ajmiller has quit IRC | 22:28 | |
| *** tonytan4ever has quit IRC | 22:28 | |
| fungi | smarcet: pabelanger: yeah, so with that new change applied, puppet-openstackid (via puppetlabs apache module) is creating a /etc/apache2/mods-enabled/event.conf file which contains a line like "MaxRequestWorkers 250" and that's not a valid directive in apache 2.2 | 22:30 |
| *** ajmiller has joined #openstack-infra | 22:30 | |
| *** mylu has quit IRC | 22:30 | |
| clarkb | now 7, we need a rocket launch countdown | 22:30 |
| *** sshnaidm has quit IRC | 22:30 | |
| fungi | smarcet: pabelanger: which is what i suspected was going to happen since that file's format is hard-coded in the puppetlabs apache module, the only parts of it which are parameterized are the values | 22:31 |
| smarcet | fungi: ok so i think that we should overwrite it with our own file i guess | 22:32 |
| *** mylu has joined #openstack-infra | 22:32 | |
| smarcet | fungi: i will write another patch then | 22:32 |
| smarcet | fungi: sorry about the back and forwards | 22:33 |
| *** amrith is now known as _amrith_ | 22:33 | |
| fungi | smarcet: in the short term, yes that will be the most expedient solution. longer term we should get puppetlabs apache fixed to properly support mpm-event tuning on apache 2.2 | 22:33 |
| openstackgerrit | Luigi Toscano proposed openstack-infra/project-config: [sahara-tests] create and merge, disable tests https://review.openstack.org/299407 | 22:33 |
| openstackgerrit | Luigi Toscano proposed openstack-infra/project-config: WIP Revert "[sahara-tests] create and merge, disable tests" https://review.openstack.org/299652 | 22:33 |
| *** gildub has joined #openstack-infra | 22:33 | |
| *** fawadkhaliq has quit IRC | 22:34 | |
| openstackgerrit | Merged openstack-infra/shade: Mutex protect internal/external network detection https://review.openstack.org/298927 | 22:35 |
| openstackgerrit | Merged openstack-infra/shade: Reset network caches after network create/delete https://review.openstack.org/299420 | 22:35 |
| openstackgerrit | Merged openstack-infra/shade: Remove duplicate FakeServer class from unit tests https://review.openstack.org/299505 | 22:35 |
| *** tosky has quit IRC | 22:35 | |
| *** sshnaidm has joined #openstack-infra | 22:36 | |
| openstackgerrit | Merged openstack-infra/shade: Fix test_get_server_ip unit test https://review.openstack.org/299517 | 22:36 |
| openstackgerrit | Merged openstack-infra/shade: Fix test_list_servers unit test https://review.openstack.org/299527 | 22:36 |
| *** fawadkhaliq has joined #openstack-infra | 22:37 | |
| *** ZZelle has joined #openstack-infra | 22:37 | |
| *** ZZelle has quit IRC | 22:38 | |
| clarkb | woot grub timeout fix https://review.openstack.org/#/c/299639/1 passes testing now | 22:39 |
| *** eil397 has joined #openstack-infra | 22:40 | |
| *** gyee has joined #openstack-infra | 22:40 | |
| *** mylu has quit IRC | 22:41 | |
| fungi | clarkb: was most of that logic cribbed from before we accidentally threw it out with the bathwater? | 22:41 |
| *** ZZelle has joined #openstack-infra | 22:41 | |
| clarkb | fungi: yup, I wrote that change by starting wit ha git revert, removing the memory management, then renaming things to be clearer | 22:41 |
| clarkb | which is why the hp copyright remains and all that | 22:41 |
| clarkb | I can hardly take credit for that as being new and novel | 22:42 |
| pleia2 | clarkb: thumbs up | 22:42 |
| *** devkulkarni has quit IRC | 22:42 | |
| fungi | perfect--that's the answer i was hoping for ;) | 22:42 |
| *** mylu has joined #openstack-infra | 22:43 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Log locale during setup_host https://review.openstack.org/298521 | 22:43 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Remove deletion of ~/workspace-cache https://review.openstack.org/293643 | 22:43 |
| fungi | would have been useful for the commit message to mention a sha you retrieved it from, but provenance questions for that will almost certainly never come up | 22:43 |
| *** akshai has quit IRC | 22:44 | |
| *** jiggalator has joined #openstack-infra | 22:44 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Allow to pass TEMPEST_OS_TEST_TIMEOUT from the job https://review.openstack.org/298446 | 22:44 |
| *** netsin has quit IRC | 22:44 | |
| pabelanger | fungi: smarcet: if you get me the syntax I can get a PR up for puppetlabs-apache | 22:44 |
| pabelanger | fungi: guess we don't want to move to ubuntu-trusty? | 22:45 |
| fungi | pabelanger: well, according to https://httpd.apache.org/docs/current/mod/mpm_common.html#maxrequestworkers MaxClients works in 2.2 and 2.4, but you may want to make it conditional in case it's removed in later apache releases in favor of MaxRequestWorkers | 22:46 |
| clarkb | I can amend it if you want | 22:46 |
| fungi | pabelanger: we _do_ want to move to ubuntu-trusty, but not a couple weeks before the summit | 22:46 |
| *** sdake has quit IRC | 22:46 | |
| *** sdake has joined #openstack-infra | 22:46 | |
| fungi | pabelanger: and also it would be useful in general i think if puppetlabs apache had better apache 2.2 support | 22:46 |
| pabelanger | ya | 22:47 |
| clarkb | since its approved I will just leave a comment in gerrit | 22:47 |
| fungi | clarkb: yeah, i didn't really need the amend, which is why i +2'd anyway | 22:47 |
| fungi | pretty sure most of us will know to just dig back in git log -p | 22:47 |
| clarkb | 4 image uploads | 22:48 |
| *** edmondsw has quit IRC | 22:48 | |
| fungi | pabelanger: however, helping smarcet work around this by vendoring an apache 2.2 compliant version of that file in and avoiding having puppetlabs apache create it for us would be appreciated. he'll likely have a patch up shortly for that | 22:49 |
| smarcet | fungi:pabelanger; also i think that mpm event is not supported on apache 2.2 | 22:49 |
| *** knikolla has quit IRC | 22:49 | |
| openstackgerrit | Merged openstack-infra/project-config: Add removal of grub boot timeouts back in https://review.openstack.org/299639 | 22:49 |
| *** netsin has joined #openstack-infra | 22:49 | |
| smarcet | fungi: pabelanger : apache 2.2 only supports fork and worker | 22:49 |
| fungi | smarcet: i think it must be. there's an apache2-mpm-event package installed on the server | 22:49 |
| smarcet | fungi: oh ok | 22:50 |
| fungi | it's this one http://packages.ubuntu.com/precise/apache2-mpm-event | 22:50 |
| smarcet | fungi: ok cool just double checking :) thx | 22:51 |
| pabelanger | fungi: smarcet: https://github.com/puppetlabs/puppetlabs-apache/pull/1415 | 22:51 |
| pabelanger | will add tests later | 22:51 |
| pabelanger | but that should work | 22:51 |
| smarcet | pabelanger: oh cool tnx a lot | 22:52 |
| smarcet | i guess that we should set the module.env to a commit again ? | 22:53 |
| pabelanger | fungi: do you mind +A https://review.openstack.org/#/c/299627/ | 22:53 |
| pabelanger | smarcet: or have fungi test it locally first | 22:53 |
| pabelanger | smarcet: once we get testings and documentation, we can push on puppetlabs to land it | 22:54 |
| smarcet | fungi: should wait on pabelanger patch? or should go ahead and do the patch meanwhile ? | 22:55 |
| fungi | pabelanger: i don't have a suitable local test env set up for that | 22:55 |
| fungi | smarcet: it probably makes sense to go ahead with a workaround in the short term, since there's no guarantee how quickly puppetlabs will approve that fix | 22:56 |
| smarcet | fungi: gotcha | 22:56 |
| anteaya | hey armax | 22:56 |
| *** esker has joined #openstack-infra | 22:56 | |
| anteaya | did you realize you said hi fellas? | 22:56 |
| smarcet | fungi: pabelanger; thx guys! really aprecciate all your help :) | 22:56 |
| *** stevemar has joined #openstack-infra | 22:56 | |
| *** tqtran-afk is now known as tqtran | 22:57 | |
| *** markvoelker has quit IRC | 22:57 | |
| fungi | smarcet: i appreciate yours too. we don't want the server collapsing under load at the summit | 22:57 |
| armax | anteaya: hi | 22:57 |
| anteaya | hi | 22:57 |
| anteaya | did you really intend to only address the men in channel when you asked your question earlier? | 22:58 |
| anteaya | that doesn't seem likeyou | 22:58 |
| armax | anteaya: um, I geniunely did not know that fellas was masculine | 22:59 |
| anteaya | oh my | 22:59 |
| anteaya | I don't know what to say | 22:59 |
| *** Jeffrey4l has joined #openstack-infra | 22:59 | |
| *** piet has quit IRC | 22:59 | |
| jpmaxman | fungi: smarcet any reason why we aren't on latest Apache? | 22:59 |
| smarcet | jpmaxman: bc ubuntu version 12.04 | 23:00 |
| armax | anteaya: sorry, I learned something new today | 23:00 |
| openstackgerrit | Merged openstack-infra/system-config: Sync nodepool-builder logging with latest changes https://review.openstack.org/299627 | 23:00 |
| anteaya | armax: yeah, me too | 23:00 |
| anteaya | armax: thank you | 23:00 |
| armax | anteaya: you learned that I don’t know how to speak English? :) | 23:00 |
| armax | anteaya: that’s not new! | 23:00 |
| fungi | jpmaxman: we're on the version of apache supported by the version of ubuntu which was current at the time the server was built. we've since (with help from smarcet, mrmartin, pabelanger and others) gotten the deployment automation for openstackid in shape to deploy on a newer ubuntu release | 23:00 |
| *** esker has quit IRC | 23:00 | |
| anteaya | no I learned that some folks may not understand what gender inclusive salutations are | 23:01 |
| jpmaxman | Cool so we are going to just move to 14.04? | 23:01 |
| *** stevemar has quit IRC | 23:01 | |
| fungi | jpmaxman: but at this point i'm hesitant to assume it will work great on a new distro release this close to the summit | 23:01 |
| clarkb | pabelanger: 2 image uploads remain | 23:01 |
| fungi | jpmaxman: yes, after the summit i really want to upgrade openstackid-dev.openstack.org and openstackid.org to 14.04 | 23:02 |
| jpmaxman | I personally don't feel like Ubuntu version is a high risk for this app | 23:02 |
| jpmaxman | smarcet: correct me if you feel differently | 23:03 |
| *** annegentle has quit IRC | 23:03 | |
| *** ams_ has quit IRC | 23:03 | |
| jpmaxman | But php version is really biggest thing | 23:03 |
| clarkb | I think the risk is more in the php version apache version redis version and so forth all changing | 23:03 |
| *** thorst has joined #openstack-infra | 23:03 | |
| *** mylu has quit IRC | 23:03 | |
| pabelanger | clarkb: almost | 23:03 |
| *** mylu has joined #openstack-infra | 23:04 | |
| fungi | jpmaxman: smarcet: i can try to redeploy openstackid-dev.openstack.org on ubuntu 14.04 now if you want to go that route, i'm just worried about it being an even bigger rathole to climb out of | 23:04 |
| smarcet | clarkb:jpmaxman: i am running locally on apache 15.04 and works ok | 23:04 |
| jpmaxman | Didn't we run our tests on trusty? | 23:04 |
| smarcet | jpmanxman yes its works fine | 23:05 |
| smarcet | and yes we ran the test on 15.04 | 23:05 |
| smarcet | fungi: let me know what u want to do, bc we should add the php5enmod thing again on 15.04 | 23:05 |
| smarcet | or 14.04 | 23:05 |
| clarkb | btw 15.04 is no longer supported | 23:06 |
| fungi | i'm booting one now. should have it up in a few minutes, computer gods willing | 23:06 |
| clarkb | so uh don't use it | 23:06 |
| *** jaypipes has quit IRC | 23:06 | |
| jpmaxman | Personally I feel more comfortable with going to 1404 than all the work around on 1204 | 23:06 |
| armax | anteaya: right, erroneously thought fellas was synonym with friends, which I know applies to both :) | 23:06 |
| jpmaxman | Think he meant 1404 | 23:06 |
| armax | anteaya: I’ll be more careful next time | 23:07 |
| mordred | clarkb: I +2'd your change, although I left a comment about a whitespace change which confused me | 23:07 |
| mordred | clarkb: I do not want to block you on a whitespace change though | 23:07 |
| jpmaxman | My vote is move to trusty | 23:07 |
| smarcet | fungi: i think that u should specify redis version , bc redis config, on node configuration | 23:07 |
| clarkb | mordred: ok it is entirely possible something else will break and it needs an update anyways | 23:07 |
| fungi | smarcet: jpmaxman: mind if i delete the current openstackid-dev server first? looks like we're pushing the limits of our quota in that tenant | 23:07 |
| mordred | clarkb: yah | 23:07 |
| *** knikolla has joined #openstack-infra | 23:07 | |
| smarcet | fungi : by default is set to 12.04 default version | 23:07 |
| anteaya | armax: ah rriends, friends is a great word | 23:07 |
| fungi | smarcet: oh, in system-config? | 23:08 |
| anteaya | armax: I was mostly surprised | 23:08 |
| *** sridhar_ram has quit IRC | 23:08 | |
| smarcet | y think so | 23:08 |
| smarcet | checking | 23:08 |
| armax | anteaya: I even thought fellow was not masculine | 23:08 |
| armax | anteaya: I stand corrected | 23:08 |
| anteaya | armax: as all your other behaviour is very gender inclusive | 23:08 |
| clarkb | armax: as a job title it may not be | 23:08 |
| clarkb | armax: english is just that confusing :) | 23:08 |
| anteaya | armax: ah okay, cool | 23:09 |
| armax | clarkb: I see | 23:09 |
| smarcet | fungi: here https://github.com/openstack-infra/system-config/blob/master/manifests/site.pp | 23:09 |
| armax | clarkb: that’s the source of my confusion then | 23:09 |
| anteaya | right fellow can be a job title | 23:09 |
| armax | and it applies to both? | 23:09 |
| clarkb | https://en.wikipedia.org/wiki/Fellow | 23:09 |
| anteaya | good question | 23:09 |
| armax | anteaya: I must admit, on this front, I love Italian | 23:09 |
| *** andymaier has quit IRC | 23:09 | |
| smarcet | fungi: https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/manifests/openstackid_dev.pp | 23:09 |
| anteaya | I haven't met any female fellows | 23:09 |
| smarcet | fungi : $redis_version | 23:09 |
| fungi | smarcet: need to set $redis_version to what for 14.04? | 23:09 |
| anteaya | but I think that is more indicative of the state of the industry than lack of a bility to apply an appropriate job title | 23:10 |
| smarcet | checking | 23:10 |
| *** amitgandhinz has joined #openstack-infra | 23:10 | |
| smarcet | fungi: checking | 23:10 |
| anteaya | armax: what would it be in italian? | 23:10 |
| anteaya | maybe italian is better | 23:10 |
| armax | fellow is | 23:10 |
| armax | either compagno or compagna | 23:10 |
| armax | the suffix of the word tells you the gender | 23:10 |
| anteaya | is there one that means both men and women? | 23:11 |
| armax | compagne is feminine plural | 23:11 |
| smarcet | fungi i think that 2.8.x but double checking | 23:11 |
| smarcet | fungi : just a sec :) | 23:11 |
| armax | compagni is masculine plural | 23:11 |
| anteaya | companie | 23:11 |
| anteaya | compagnie | 23:11 |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Refactor, moved mysql part out of init.pp https://review.openstack.org/299661 | 23:11 |
| anteaya | plural inclusive? | 23:11 |
| anteaya | italian does sound better | 23:11 |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Refactor, moved mysql part out of init.pp https://review.openstack.org/299661 | 23:12 |
| smarcet | fungi: from here https://github.com/openstack-infra/puppet-redis/blob/master/manifests/init.pp should be 2.8.x | 23:12 |
| *** fawadkhaliq has quit IRC | 23:12 | |
| armax | compagnie is friendships | 23:12 |
| armax | though it also means companies | 23:12 |
| smarcet | fungi: but checking on a 14.04 machine | 23:12 |
| armax | so, yes to some degree Italian can be confusing without context just as much as any other language | 23:12 |
| anteaya | I like the friendships bit | 23:12 |
| anteaya | and find it interesting the word also means companies | 23:13 |
| anteaya | cool | 23:13 |
| anteaya | thanks for the Italian lesson | 23:13 |
| anteaya | I appreciate it | 23:13 |
| smarcet | fungi: also i think that we should re add the exec { 'enable_php5-mbcrypt': thing for 14.04 | 23:13 |
| *** shashank_hegde has quit IRC | 23:13 | |
| armax | anteaya: thank you for making me learn a new bit of English! | 23:14 |
| *** fawadkhaliq has joined #openstack-infra | 23:14 | |
| *** sridhar_ram has joined #openstack-infra | 23:14 | |
| *** amitgandhinz has quit IRC | 23:14 | |
| anteaya | happy to help :) | 23:14 |
| *** sridhar_ram has quit IRC | 23:14 | |
| *** Jeffrey4l_ has joined #openstack-infra | 23:15 | |
| *** nwkarsten has quit IRC | 23:16 | |
| *** Jeffrey4l has quit IRC | 23:16 | |
| pabelanger | smarcet: fungi: right, I found that issue when testing ubuntu-trusty: https://review.openstack.org/#/c/260660/ | 23:16 |
| *** nwkarsten has joined #openstack-infra | 23:16 | |
| smarcet | smarcet@ubuntu:~$ sudo redis-server -v | 23:16 |
| smarcet | [sudo] password for smarcet: | 23:16 |
| smarcet | Redis server v=2.8.4 sha=00000000:0 malloc=jemalloc-3.4.1 bits=64 build=a44a05d76f06a5d9 | 23:16 |
| *** [1]Thelo has joined #openstack-infra | 23:16 | |
| fungi | smarcet: yeah, confirmed on trusty the redis-server package is 2.8.4 | 23:16 |
| smarcet | fungi : redis version is 2.8.4 | 23:17 |
| pabelanger | but never fixes it properly | 23:17 |
| clarkb | pabelanger: not to put more balls into your juggling system but did you rerun devstack on xenial to capture the errors? | 23:17 |
| smarcet | fungi: will re add the php5-enmod thing for mbcrypt on a new patch | 23:17 |
| pabelanger | clarkb: Give me a sec, I think I have it | 23:17 |
| *** shashank_hegde has joined #openstack-infra | 23:17 | |
| *** mylu has quit IRC | 23:17 | |
| clarkb | I don't currently have enough ram to spin up a local test of my own | 23:17 |
| fungi | smarcet: okay, i'll also go ahead and do the system-config patch to bump openstackid-dev to redis 2.8.4 | 23:18 |
| clarkb | I should probably upgrade my vm machine to 16GB of ram and expense it | 23:18 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Readded php5enmod mbcrypt for trusty https://review.openstack.org/299665 | 23:18 |
| *** Thelo has quit IRC | 23:18 | |
| *** [1]Thelo is now known as Thelo | 23:18 | |
| clarkb | or get a nuc | 23:18 |
| * clarkb checks out memory limits on new nucs | 23:19 | |
| *** devkulkarni has joined #openstack-infra | 23:19 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Declare redis 2.8.4 on openstackid-dev https://review.openstack.org/299667 | 23:19 |
| *** devkulkarni has quit IRC | 23:20 | |
| fungi | smarcet: jpmaxman: ^ there's the redis version bump for the dev server | 23:20 |
| *** mylu has joined #openstack-infra | 23:20 | |
| clarkb | 32GB | 23:20 |
| clarkb | this might be a thing | 23:20 |
| *** nwkarsten has quit IRC | 23:20 | |
| fungi | clarkb: yeah, i should consider replacing my gigabyte brix workstations. i've reached the 3-year "you can expense a new work computer" mark | 23:21 |
| *** mylu has quit IRC | 23:21 | |
| jpmaxman | :) | 23:22 |
| fungi | mine are a scant 16gb, so 32 would be niiice | 23:22 |
| clarkb | all of my machines are currently 8GB | 23:22 |
| clarkb | one because the intel chipset won't do more, another because 8GB died on me and I had to underclock the other 8GB to keep it running, and the last one because I never bought more | 23:22 |
| pleia2 | mine are 16gb as well, have been playing with the idea of 64 in the system that can take it (the others max out at 16) | 23:22 |
| fungi | yeah, you should... do something about that | 23:23 |
| *** mylu has joined #openstack-infra | 23:23 | |
| fungi | right, the brix models i got a few years back only go up to 16gb | 23:23 |
| bkero | 8GB SODIMMs are on the market now | 23:23 |
| fungi | so definitely need new hardware | 23:23 |
| bkero | Err, 16GB | 23:23 |
| bkero | They're pretty damn expensive though | 23:23 |
| clarkb | bkero: if only this x240 could use that | 23:23 |
| *** salv-orl_ has joined #openstack-infra | 23:24 | |
| *** annegentle has joined #openstack-infra | 23:24 | |
| pleia2 | my primary desktop is an i7 from 2009, likely needs a refresh anyway ;) | 23:24 |
| clarkb | pleia2: mine too | 23:24 |
| bkero | clarkb: Yeah. :( Broadwells can upgrade thoug.h | 23:24 |
| pabelanger | clarkb: running now | 23:24 |
| clarkb | I actually have a nehalem i7 floating around somewhere too | 23:24 |
| fungi | though i've gotten used to the haswell displayport multiplexing support | 23:24 |
| bkero | I did the desktop upgrade a few months ago. Went from a Nehalem i7 (2008) to a Skylake i7. Now things are pretty snappy. :) | 23:24 |
| *** knikolla has quit IRC | 23:25 | |
| *** jamesmcarthur has joined #openstack-infra | 23:25 | |
| pleia2 | bkero: nice :) | 23:25 |
| clarkb | bkero: the memory bw on nehalem is still higher right? | 23:25 |
| clarkb | good for space heating and databases | 23:25 |
| fungi | wonder if i can use this same displayport hub on a modern nuc | 23:25 |
| bkero | clarkb: Triple channel vs double channel. The speed of the DDR4 is faster though. | 23:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/shade: Cache ports like servers https://review.openstack.org/299671 | 23:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/shade: Remove conditional blocking on server list https://review.openstack.org/299672 | 23:25 |
| bkero | clarkb: the memory bandwidth on either is hilariously high though. Although if you really want memory bandwidth some sandy bridge chipsets supported quad-channel. | 23:26 |
| *** salv-orlando has quit IRC | 23:26 | |
| *** mylu has quit IRC | 23:27 | |
| *** jiggalator has quit IRC | 23:27 | |
| pabelanger | clarkb: sudo: /usr/sbin/ntpdate: command not found | 23:27 |
| pabelanger | guess I should fix that too | 23:27 |
| *** sridhar_ram has joined #openstack-infra | 23:27 | |
| clarkb | pabelanger: ya we need that because sometimes cloud instances boot in the past or the future | 23:28 |
| fungi | pabelanger: centos-minimal a little too minimal? | 23:28 |
| clarkb | and not by a few seconds or minutes but by hours | 23:28 |
| *** mylu has joined #openstack-infra | 23:28 | |
| *** annegentle has quit IRC | 23:28 | |
| pabelanger | fungi: xenial-minimal | 23:28 |
| clarkb | fungi: I think this is xenial | 23:28 |
| fungi | right, can _not_ trust system time at boot in clouds | 23:28 |
| fungi | got it. ntpdate may be deprecated in favor of something new shiny now too | 23:29 |
| *** _amrith_ is now known as amrith | 23:29 | |
| pabelanger | Ya, could be | 23:29 |
| clarkb | there is still an ntpdate package though | 23:29 |
| clarkb | so simple thing may be to keep using it? | 23:29 |
| fungi | no objection from me | 23:29 |
| *** LaT0rtue has quit IRC | 23:30 | |
| clarkb | http://support.ntp.org/bin/view/Dev/DeprecatingNtpdate | 23:30 |
| clarkb | or alternatively use the ne wthings on trusty/centos/fedora if they exist there too | 23:30 |
| fungi | just found the same | 23:30 |
| clarkb | ntpd -g ? | 23:31 |
| *** Jeffrey4l__ has joined #openstack-infra | 23:32 | |
| pabelanger | It did this yesterday, appears to be hung at: | 23:32 |
| pabelanger | Setting up python-yaml (3.11-3build1) ... | 23:32 |
| pabelanger | will give it some time | 23:32 |
| clarkb | I think we want ntpd -gq | 23:32 |
| *** Jeffrey4l__ is now known as Jeffrey4l | 23:32 | |
| fungi | yeah, looks like ntp.org has caught up with a feature of openntpd on openbsd | 23:33 |
| *** Jeffrey4l_ has quit IRC | 23:33 | |
| fungi | namely, the ability to go ahead and force the system time to jump when first starting the daemon | 23:33 |
| fungi | rather than trying to slowly slew it even right after starting | 23:33 |
| *** annegentle has joined #openstack-infra | 23:34 | |
| clarkb | I will whip up a patch really quick and we can see how it does on all the things | 23:35 |
| fungi | we could ntpd -g followed by ntp-wait | 23:35 |
| *** zz_dimtruck is now known as dimtruck | 23:35 | |
| *** dizquierdo has quit IRC | 23:36 | |
| clarkb | is ntpd -gq not going to be synchronous? | 23:36 |
| fungi | er, i guess just make sure ntpd is running and then ntp-wait | 23:36 |
| fungi | ntp-wait should tell us whether time is accurate | 23:37 |
| jpmaxman | fungi: smarcet so are we all set moving forward with trusty? Sorry I would have chimed in on this earlier. Hope we didn't waste too much time | 23:37 |
| clarkb | fungi: I think the problem is we have to force it to make the big jump which it won't be default in all cases | 23:37 |
| clarkb | fungi: which is where ntpd -gq comes in | 23:37 |
| openstackgerrit | Merged openstack-infra/devstack-gate: TRIVIAL: Fix some misspellings https://review.openstack.org/263938 | 23:37 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Added env variable for subnode conf for multinode https://review.openstack.org/294546 | 23:37 |
| smarcet | fungi: https://review.openstack.org/#/c/299665/ ready to review | 23:38 |
| fungi | jpmaxman: smarcet: well, it's an experiment next. but i need to free up some quota to boot the replacement openstackid-dev (which could be done by deleting the current one) | 23:38 |
| *** annegentle has quit IRC | 23:38 | |
| jpmaxman | I think it is OK. smarcet you agree? | 23:39 |
| fungi | jpmaxman: smarcet: upgrading to trusty, as far as current challenges go, only solves the puppetlabs apache module having an apache 2.2 noncompliant directive in its config | 23:39 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Log deprecations in horizon and keystone https://review.openstack.org/291301 | 23:39 |
| fungi | jpmaxman: smarcet: just making sure you don't have any data on that server you need preserved before i blow it away | 23:39 |
| smarcet | fungi: np from my side | 23:40 |
| smarcet | jpmaxman : i concord | 23:40 |
| pabelanger | Ya, something is going on with apt-get, just stuck on python-yaml | 23:40 |
| clarkb | hrm looks like ntp on ubuntu uses -g by default | 23:40 |
| jpmaxman | Flight of the conchord? | 23:40 |
| clarkb | so maybe the wait is sufficient | 23:40 |
| pabelanger | and the console appears to be locked | 23:41 |
| *** jamesmcarthur has quit IRC | 23:41 | |
| fungi | smarcet: on 299665, as i mentioned a few patches back when you first had that, it's going to run "/usr/sbin/php5enmod mcrypt" every time we reapply puppet on the server because there's nothing to say when it should be run. it's okay for now but we should fix that soon with a subscribe to the package or something | 23:41 |
| clarkb | pabelanger: I thought we had corrected that, are you using reproduce.sh? | 23:41 |
| clarkb | pabelanger: its waiting for user input probably | 23:42 |
| *** gildub has quit IRC | 23:42 | |
| fungi | smarcet: can you +1 299667 if it matches what you were expecting? | 23:42 |
| smarcet | fungi: i think that is subscribed to package | 23:42 |
| *** angdraug has quit IRC | 23:43 | |
| smarcet | fungi: Package['php5-fpm'], | 23:43 |
| smarcet | fungi: oh sorry i see | 23:43 |
| pabelanger | clarkb: no, I follow the directions on devstack-gate readme | 23:44 |
| smarcet | fungi : https://review.openstack.org/#/c/299667/1 done | 23:44 |
| pabelanger | new VM | 23:44 |
| fungi | smarcet: yeah, it declares it as a dependency, but doesn't only run it under specific circumstances, which we'll eventually want to clean up | 23:44 |
| smarcet | fungi: got it :)( | 23:44 |
| smarcet | :) | 23:44 |
| fungi | smarcet: would also be possible to have that exec test for presence of whatever symlink that command would normally create | 23:45 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Use ntp-wait instead of ntpdate to set time https://review.openstack.org/299677 | 23:45 |
| fungi | an onlyif or something | 23:45 |
| jeblair | pabelanger, clarkb: oh yeah, that sort of changed under us. it is waiting for input (sigttin i think). it's fixed with an exec, which as clarkb says reproduce.sh does | 23:45 |
| *** achanda has joined #openstack-infra | 23:45 | |
| *** Jeffrey4l_ has joined #openstack-infra | 23:45 | |
| pabelanger | jeblair: Ah... where does reproduce.sh live? | 23:46 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Remove unused functions https://review.openstack.org/299678 | 23:46 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Pass extended network information in to occ/shade https://review.openstack.org/299679 | 23:46 |
| *** Jeffrey4l has quit IRC | 23:46 | |
| clarkb | exec 0</dev/null | 23:46 |
| jeblair | pabelanger: it's created by devstack-gate runs, by devstack-gate. i'm late to the party, whatcha doin? | 23:46 |
| *** shashank_hegde has quit IRC | 23:47 | |
| jeblair | clarkb: that's the one | 23:47 |
| jeblair | hook stdin to dev/null | 23:47 |
| clarkb | pabelanger: you can find reproduce.sh in the logs of devstack-gate run jobs | 23:48 |
| clarkb | pabelanger: oh thinking about https://review.openstack.org/#/c/298998/1/functions.sh more | 23:49 |
| clarkb | pabelanger: we likely need that if else to be "uses journald else stop start" | 23:49 |
| openstackgerrit | Merged openstack-infra/puppet-openstackid: Readded php5enmod mbcrypt for trusty https://review.openstack.org/299665 | 23:49 |
| clarkb | because in theory xenial like fedora uses journald too and can just do the timestamp trick | 23:49 |
| *** aysyd has joined #openstack-infra | 23:50 | |
| *** roxanaghe has quit IRC | 23:50 | |
| *** annegentle has joined #openstack-infra | 23:51 | |
| jeblair | pabelanger: oh you're manually devstack-gating on xenial? | 23:51 |
| clarkb | jeblair: ya | 23:51 |
| *** SumitNaiksatam has quit IRC | 23:51 | |
| jeblair | cool. i highly recommend just running a reproduce.sh from a recent passing gate job | 23:51 |
| pabelanger | Ah | 23:51 |
| pabelanger | so that's how you get it | 23:51 |
| jeblair | this way you have a a fixed baseline | 23:52 |
| openstackgerrit | Merged openstack-infra/system-config: Declare redis 2.8.4 on openstackid-dev https://review.openstack.org/299667 | 23:52 |
| clarkb | centos7 should also journalctl and we may not do syslog properly there right now | 23:52 |
| clarkb | I will take a stab at making this a bit better | 23:52 |
| *** mylu has quit IRC | 23:52 | |
| fungi | smarcet: jpmaxman: okay, the needed changes are merged, so i'm going to delete the current openstackid-dev to free up quota, then build a replacement | 23:52 |
| smarcet | fungi: oki doki | 23:53 |
| *** shashank_hegde has joined #openstack-infra | 23:54 | |
| *** amrith is now known as _amrith_ | 23:54 | |
| pabelanger | jeblair: clarkb: okay, using http://logs.openstack.org/98/298998/1/check/gate-tempest-dsvm-full/9212fdf/logs/reproduce.sh as my baseline (rsyslog patch) on xenial | 23:55 |
| *** tqtran has quit IRC | 23:55 | |
| pabelanger | TIL how devstack-gate works | 23:55 |
| *** yarkot has joined #openstack-infra | 23:55 | |
| *** ajmiller has quit IRC | 23:56 | |
| pabelanger | clarkb: 0 images uploading | 23:56 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Use journald when it is present https://review.openstack.org/299682 | 23:56 |
| pabelanger | clarkb: did you want to restart or me? | 23:57 |
| clarkb | pabelanger: ^ I think that is a possible alternative to 298998 | 23:57 |
| mordred | clarkb: heya - got a sec to help us with a few nodepool-shade patches? | 23:57 |
| clarkb | pabelanger: I can get it if you like | 23:57 |
| pabelanger | clarkb: go for it | 23:57 |
| *** stevemar has joined #openstack-infra | 23:57 | |
| *** mylu has joined #openstack-infra | 23:57 | |
| clarkb | pabelanger: all done | 23:58 |
| pabelanger | clarkb: okay, will try and test depending on the current results | 23:58 |
| *** Qiming has joined #openstack-infra | 23:59 | |
| mordred | clarkb: https://review.openstack.org/#/q/topic:nodepool-shade | 23:59 |
| clarkb | pabelanger: we have a stale xenial build that I am trying to delete but it may need a db cleanup :/ | 23:59 |
| pabelanger | clarkb: Hmm, ubuntu-xenial is currently building however/ | 23:59 |
| mordred | clarkb: jeblair are sitting in the same room hacking on the issues we had in prod a couple of days ago - we're pretty sure those will clear it up | 23:59 |
| mordred | s/jeblair/jeblair and I/ | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!