*** itisha has quit IRC | 00:00 | |
*** pahuang has joined #openstack-infra | 00:00 | |
*** zhurong has quit IRC | 00:01 | |
*** armax has quit IRC | 00:08 | |
*** rbuzatu has joined #openstack-infra | 00:09 | |
openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: grafana: Correct pipeline of midonet periodic jobs https://review.openstack.org/352170 | 00:10 |
---|---|---|
openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: grafana: Add the rest of midonet stable jobs https://review.openstack.org/352171 | 00:10 |
*** rbuzatu has quit IRC | 00:13 | |
*** sflanigan has joined #openstack-infra | 00:15 | |
openstackgerrit | Craige McWhirter proposed openstack-infra/puppet-phabricator: Patches Required to Deliver Pholio https://review.openstack.org/342481 | 00:18 |
*** johnchalekson has quit IRC | 00:22 | |
*** Teresita-Warrior has joined #openstack-infra | 00:27 | |
*** markvoelker has joined #openstack-infra | 00:28 | |
*** zz_dimtruck is now known as dimtruck | 00:34 | |
openstackgerrit | Goutham Pacha Ravi proposed openstack-infra/project-config: Publish manila install guide from tree https://review.openstack.org/352173 | 00:38 |
*** dimtruck is now known as zz_dimtruck | 00:44 | |
*** kzaitsev_mb has quit IRC | 00:46 | |
*** amitgandhinz has joined #openstack-infra | 00:48 | |
*** thorst has joined #openstack-infra | 00:52 | |
*** amitgandhinz has quit IRC | 00:52 | |
*** edmondsw has joined #openstack-infra | 00:54 | |
openstackgerrit | Goutham Pacha Ravi proposed openstack-infra/project-config: Manila - Skip running devstack jobs on api-ref/install-guide changes https://review.openstack.org/352176 | 01:02 |
openstackgerrit | Goutham Pacha Ravi proposed openstack-infra/project-config: Publish manila install guide from tree https://review.openstack.org/352173 | 01:04 |
jhesketh | craige: I left +W off as I wanted the second patch to be ready (I hadn't reviewed it at the time) | 01:05 |
*** baoli has joined #openstack-infra | 01:05 | |
jhesketh | craige: they probably should be reordered but it's no problem | 01:06 |
*** mriedem has quit IRC | 01:07 | |
craige | Ah, I read your comment and it made sense, I just didn't join the dots on why there was no +W. | 01:07 |
craige | Thanks :-) | 01:07 |
craige | While have your eyes, do you have a second to look at a minor spec issue? | 01:08 |
craige | I've got this doc http://specs.openstack.org/openstack-infra/infra-specs/specs/pholio.html compiling with a bad link (first sentence, third link) but the code http://git.openstack.org/cgit/openstack-infra/infra-specs/tree/specs/pholio.rst#n15 looks good to me. | 01:08 |
*** karthikp_ has quit IRC | 01:09 | |
*** baoli has quit IRC | 01:11 | |
openstackgerrit | Merged openstack-infra/system-config: Update iLO IP and rack for compute011.chocolate https://review.openstack.org/352137 | 01:12 |
*** zhurong has joined #openstack-infra | 01:12 | |
*** camunoz has joined #openstack-infra | 01:17 | |
*** hichihara has joined #openstack-infra | 01:19 | |
*** thorst_ has joined #openstack-infra | 01:24 | |
*** rhallisey has quit IRC | 01:25 | |
*** thorst has quit IRC | 01:27 | |
*** yanyanhu has joined #openstack-infra | 01:30 | |
*** baoli has joined #openstack-infra | 01:41 | |
*** kzaitsev_mb has joined #openstack-infra | 01:43 | |
*** gildub has joined #openstack-infra | 01:46 | |
*** sandanar has joined #openstack-infra | 01:46 | |
*** amitgandhinz has joined #openstack-infra | 01:49 | |
*** sandanar has quit IRC | 01:52 | |
*** sandanar has joined #openstack-infra | 01:52 | |
*** amitgandhinz has quit IRC | 01:53 | |
*** signed8bit_Zzz is now known as signed8bit | 02:01 | |
*** signed8bit has quit IRC | 02:02 | |
*** baoli has quit IRC | 02:02 | |
*** zz_dimtruck is now known as dimtruck | 02:03 | |
*** baoli has joined #openstack-infra | 02:04 | |
*** thorst_ has quit IRC | 02:04 | |
*** Sukhdev has joined #openstack-infra | 02:05 | |
*** baoli has quit IRC | 02:07 | |
*** sandanar_ has joined #openstack-infra | 02:12 | |
*** sandanar has quit IRC | 02:16 | |
openstackgerrit | Merged openstack-infra/irc-meetings: move HA meeting an hour later, to 0900 UTC https://review.openstack.org/349601 | 02:19 |
*** kzaitsev_mb has quit IRC | 02:19 | |
*** Sukhdev has quit IRC | 02:27 | |
*** bswartz has quit IRC | 02:30 | |
*** julim has joined #openstack-infra | 02:35 | |
*** markvoelker has quit IRC | 02:36 | |
*** gildub has quit IRC | 02:39 | |
*** amitgandhinz has joined #openstack-infra | 02:49 | |
*** Sukhdev has joined #openstack-infra | 02:52 | |
*** asilenkov has quit IRC | 02:53 | |
*** amitgandhinz has quit IRC | 02:54 | |
*** gouthamr has quit IRC | 02:55 | |
*** asilenkov has joined #openstack-infra | 02:57 | |
tonyb | Is anyone else seeing the gerrot web UI behave poorly? slow response and frequent proxy errors? | 03:06 |
*** armax has joined #openstack-infra | 03:08 | |
*** Sukhdev has quit IRC | 03:11 | |
*** esberglu has joined #openstack-infra | 03:12 | |
*** armax has quit IRC | 03:13 | |
*** kzaitsev_mb has joined #openstack-infra | 03:16 | |
*** bswartz has joined #openstack-infra | 03:17 | |
craige | Yes but that's why I've almost always used gertty, tonyb, so that experience is probably of no use ;-) | 03:18 |
*** esberglu has quit IRC | 03:19 | |
*** kzaitsev_mb has quit IRC | 03:21 | |
*** Sukhdev has joined #openstack-infra | 03:21 | |
*** sandanar_ has quit IRC | 03:24 | |
*** gbraad has joined #openstack-infra | 03:25 | |
*** chlong has quit IRC | 03:25 | |
tonyb | craige: Oh the REST API is slow too but as that's scripted the slow isn't as visible | 03:27 |
craige | :-) | 03:27 |
*** julim has quit IRC | 03:28 | |
prometheanfire | tonyb: is that like a carrot? | 03:31 |
tonyb | prometheanfire: Umm yes, just like a carrot. | 03:33 |
prometheanfire | so where's the stick? | 03:37 |
*** ayoung has quit IRC | 03:39 | |
masayukig | +1 for craige to use gertty :) | 03:41 |
prometheanfire | gertty rocks :D | 03:41 |
*** fengchaoyang has joined #openstack-infra | 03:50 | |
*** amitgandhinz has joined #openstack-infra | 03:50 | |
fengchaoyang | hello,everybody, now when I "git review", fatal: ICLA contributor agreement requires current contact information. Please review your contact information: https://review.openstack.org/#/settings/contact fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. | 03:51 |
*** gongysh has joined #openstack-infra | 03:52 | |
fengchaoyang | when I go to https://review.openstack.org/#/settings/contact ,it say : Code Review - Error Server Error Cannot store contact information | 03:52 |
fengchaoyang | here is my git config :stack@fe:~/python-gnocchiclient$ git config -l user.email=fengchaoyang@unitedstack.com user.name=fengchaoyang gitreview.username=fengchaoyang core.repositoryformatversion=0 core.filemode=true core.bare=false core.logallrefupdates=true remote.origin.url=https://github.com/openstack/python-gnocchiclient.git remote.origin.fetch=+refs/heads/*:refs/remotes/origin/* branch.master.remote=origin branch | 03:53 |
fengchaoyang | and ICLA is registed StatusNameDescription VerifiedICLAOpenStack Individual Contributor License Agreement New Contributor Agreement | 03:54 |
fengchaoyang | my git remote is : stack@fe:~/python-gnocchiclient$ git remote -v gerritssh://fengchaoyang@review.openstack.org:29418/openstack/python-gnocchiclient.git (fetch) gerritssh://fengchaoyang@review.openstack.org:29418/openstack/python-gnocchiclient.git (push) originhttps://github.com/openstack/python-gnocchiclient.git (fetch) originhttps://github.com/openstack/python-gnocchiclient.git (push) | 03:55 |
*** amitgandhinz has quit IRC | 03:55 | |
fengchaoyang | who kown where I wrong? | 03:55 |
fengchaoyang | I can git review -s ,but I can't git review | 03:56 |
fengchaoyang | Is this is a bug? | 03:57 |
*** sdake has joined #openstack-infra | 03:58 | |
*** jesusaur has joined #openstack-infra | 03:58 | |
fengchaoyang | I have google much times,but can't sort it | 03:58 |
*** spiffxp has quit IRC | 03:58 | |
*** vipuls has quit IRC | 03:59 | |
*** spiffxp has joined #openstack-infra | 03:59 | |
clarkb | fengchaoyang: which directions did you follow to set up your accouny | 04:00 |
*** vipuls has joined #openstack-infra | 04:00 | |
clarkb | please follow the ones in the openstack infra manual | 04:00 |
clarkb | make sure your openstack foundation profile is configured properly | 04:00 |
*** zhurong has quit IRC | 04:04 | |
*** zhurong has joined #openstack-infra | 04:05 | |
*** roxanaghe has joined #openstack-infra | 04:08 | |
fengchaoyang | here is my openstack community member https://www.openstack.org/community/members/profile/66195 | 04:08 |
fengchaoyang | I don't know whether configured properly | 04:09 |
clarkb | you need to be a foundation member not community I think. there should be a button for you to change it | 04:11 |
clarkb | then update the contact info and you should be done | 04:11 |
craige | oh clarkb is about | 04:11 |
* craige prods clarkb for more clues on working with OpenStackID as the last leads came up empty :-( | 04:12 | |
fengchaoyang | You are logged in as: feng chaoyang Resign Membership Change to Community Member Current Member Level: Foundation Member | 04:13 |
*** binbincong has joined #openstack-infra | 04:13 | |
*** jaosorior has joined #openstack-infra | 04:14 | |
clarkb | craige: did you try with the dev server? | 04:14 |
clarkb | fengchaoyang: ok foundation member is correct, make sure the email address matches in gerrit and update your contact info | 04:15 |
openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add Fedora 24 work-around kernel https://review.openstack.org/352211 | 04:15 |
fengchaoyang | this is review Username fengchaoyang Full Namefengchaoyang Email Addressfengchaoyang@unitedstack.com RegisteredJun 29, 2016 7:00 PM Account ID22514 | 04:16 |
fengchaoyang | git remote -v gerritssh://fengchaoyang@review.openstack.org:29418/openstack/python-gnocchiclient.git (fetch) gerritssh://fengchaoyang@review.openstack.org:29418/openstack/python-gnocchiclient.git (push) originhttps://github.com/openstack/python-gnocchiclient.git (fetch) originhttps://github.com/openstack/python-gnocchiclient.git (push) | 04:16 |
*** kzaitsev_mb has joined #openstack-infra | 04:17 | |
*** baoli has joined #openstack-infra | 04:19 | |
fengchaoyang | when I update my contact information, It' will Error Server Error Cannot store contact information | 04:20 |
*** kzaitsev_mb has quit IRC | 04:22 | |
openstackgerrit | Ryan Tidwell proposed openstack-infra/project-config: Make gate-neutron-dynamic-routing-dsvm-tempest job voting. https://review.openstack.org/352212 | 04:23 |
*** senk_ has joined #openstack-infra | 04:24 | |
*** baoli has quit IRC | 04:24 | |
clarkb | fengchaoyang: yes it will do that if your email address in gerrit doesntatch thr address in your foundation profilw | 04:24 |
craige | oh, no I didn't clarkb! That was one of your suggestions I failed to act on. Address for the dev server again? | 04:25 |
craige | (and is the backend data the same?) | 04:25 |
clarkb | openstackid-dev.o.o I think | 04:27 |
clarkb | and no thr passwords are different smarcet can tell you wjat it is your reset yours | 04:27 |
craige | I'll give it a whirl. thanks clarkb | 04:28 |
craige | If it gets as far as asking for a passowrd, I'll hit smarcet up. | 04:29 |
*** Ravikiran_K has joined #openstack-infra | 04:29 | |
openstackgerrit | Craige McWhirter proposed openstack-infra/infra-specs: Corrected Phabricator URL https://review.openstack.org/352215 | 04:35 |
AJaeger | infra-root, I think we need to restart gerrit, the UI is just really slow | 04:35 |
*** markvoelker has joined #openstack-infra | 04:37 | |
*** tonytan4ever has quit IRC | 04:39 | |
jhesketh | AJaeger: it feels okay to me | 04:41 |
*** markvoelker has quit IRC | 04:42 | |
AJaeger | mmh, do we have networking issues? | 04:42 |
* AJaeger just had a 502 | 04:42 | |
jhesketh | hmm | 04:42 |
craige | No love with that either clarkb :-( | 04:43 |
craige | FYI: I replied ealier but didn't ping you, jhesketh, in case you missed it. | 04:43 |
jhesketh | craige: oh, sorry, /me looks | 04:44 |
AJaeger | tonyb also had problems earlier - see backscroll, around 3:06 | 04:44 |
craige | not urgent, jhesketh, I've just been thinking my lack of nick may have caused it to get lost. | 04:44 |
*** coolsvap has joined #openstack-infra | 04:46 | |
AJaeger | craige: your specs change fixes the problems, thanks | 04:46 |
craige | \o/ | 04:46 |
clarkb | craige: do you have a paste of your config? | 04:47 |
clarkb | I cqn dig mine uo when actually on computer with keys | 04:47 |
craige | Thank *you* AJaeger. It was driving me spare and I had no idea that I had doubled up *or* that doubling up was a problem. | 04:47 |
craige | I do clarkb | 04:47 |
jhesketh | AJaeger: resources on gerrit seem high but not abnormal... if it continues maybe a restart but I'm not seeing a reason at hte moment | 04:48 |
jhesketh | craige: I can't see a fault in your rst... maybe because _Phabricator is defined twice? have you tried building the docs locally? | 04:49 |
*** amitgandhinz has joined #openstack-infra | 04:51 | |
craige | https://review.openstack.org/#/c/342481/18/manifests/init.pp and https://review.openstack.org/#/c/342481/18/templates/vhost.erb clarkb, where I've replaced https://login.ubuntu.com/ with https://openstackid-dev.openstack.org or https://openstackid.org/ | 04:51 |
AJaeger | jhesketh: is gerrit doing garbage collection? | 04:52 |
craige | ah, that question, thanks jhesketh. It was just resolved in 352215 | 04:52 |
AJaeger | jhesketh: craige's RST issue is solved | 04:52 |
craige | and it was the double definition of _Phabricator. | 04:52 |
clarkb | craige: and it does work with ubuntu openid? | 04:53 |
*** kushal has joined #openstack-infra | 04:53 | |
craige | Yes, it does clarkb | 04:53 |
*** kushal has quit IRC | 04:53 | |
*** kushal has joined #openstack-infra | 04:53 | |
clarkb | ok I will have to compare what I have when at real conputer | 04:54 |
openstackgerrit | Ryan Tidwell proposed openstack-infra/project-config: Make gate-neutron-dynamic-routing-dsvm-tempest job voting. https://review.openstack.org/352212 | 04:55 |
craige | Cool, thanks clarkb | 04:55 |
clarkb | and you did try the discovery url? | 04:55 |
*** amitgandhinz has quit IRC | 04:56 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-specs: Fix warnings https://review.openstack.org/352218 | 04:56 |
craige | I was unable to determine the discovery URL, clarkb | 04:56 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-specs: Fix warnings https://review.openstack.org/352218 | 04:57 |
clarkb | craige: look at the http response headers for / to find it | 04:57 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-specs: Fix warnings https://review.openstack.org/352218 | 04:57 |
clarkb | its one of them iirc | 04:58 |
AJaeger | clarkb: have you found some internet on vacation or are you back and catching up? ;) | 05:01 |
*** fengchaoyang has quit IRC | 05:02 | |
jhesketh | AJaeger: I don't think it is running | 05:02 |
*** nmagnezi_ has joined #openstack-infra | 05:03 | |
*** roxanaghe has quit IRC | 05:03 | |
*** nmagnezi_ has quit IRC | 05:03 | |
*** pcaruana has quit IRC | 05:03 | |
*** roxanaghe has joined #openstack-infra | 05:03 | |
*** nmagnezi_ has joined #openstack-infra | 05:03 | |
*** roxanaghe has quit IRC | 05:04 | |
AJaeger | jhesketh: what is not running? Sorry, you lost me... | 05:04 |
*** roxanaghe has joined #openstack-infra | 05:04 | |
*** roxanaghe has joined #openstack-infra | 05:05 | |
AJaeger | jhesketh: got it - you mean, it's not doing heavy GC - thanks for confirming. | 05:05 |
clarkb | AJaeger: I have intermittent internets on phone | 05:05 |
*** roxanaghe has quit IRC | 05:06 | |
*** roxanaghe has joined #openstack-infra | 05:06 | |
*** roxanaghe has quit IRC | 05:06 | |
AJaeger | clarkb: I see. Then continue to enjoy your vacation ;) | 05:07 |
*** dimtruck is now known as zz_dimtruck | 05:08 | |
openstackgerrit | Ryan Tidwell proposed openstack-infra/project-config: Make gate-neutron-dynamic-routing-dsvm-tempest job voting. https://review.openstack.org/352212 | 05:09 |
*** senk_ has quit IRC | 05:09 | |
*** senk_ has joined #openstack-infra | 05:13 | |
jhesketh | AJaeger: yes, sorry | 05:14 |
openstackgerrit | Jianghua Wang proposed openstack-infra/devstack-gate: xenapi: Skip multi-host setup for nova network setup https://review.openstack.org/352222 | 05:16 |
AJaeger | interesting - gerrit is still slow for me. Normally it's garbage collecting in such cases... | 05:16 |
AJaeger | bbl | 05:17 |
*** oanson has joined #openstack-infra | 05:18 | |
*** kzaitsev_mb has joined #openstack-infra | 05:18 | |
craige | I'll see if I can find them in the logs. I'll turn on Apache debugging clarkb, as they weren't appearing normally. | 05:22 |
clarkb | craige: just curl it | 05:23 |
*** kzaitsev_mb has quit IRC | 05:23 | |
craige | Unsurprisingly that is much better, clarkb :-) | 05:24 |
* craige wades through the output | 05:24 | |
*** psachin has joined #openstack-infra | 05:25 | |
*** senk_ has quit IRC | 05:26 | |
*** hichihara has quit IRC | 05:27 | |
sshnaidm | AJaeger, hi, I have a question about https://review.openstack.org/#/c/351120/ | 05:31 |
sshnaidm | AJaeger, btw derekh is in pto, so I think he's back next week only | 05:31 |
sshnaidm | AJaeger, what does mean "Why not add the job to the same template as before?"? Which template do you mean? | 05:32 |
*** pgadiya has joined #openstack-infra | 05:35 | |
*** Teresita-Warrior has quit IRC | 05:38 | |
*** rbuzatu has joined #openstack-infra | 05:39 | |
*** fengchaoyang has joined #openstack-infra | 05:48 | |
*** PollyZ has joined #openstack-infra | 05:48 | |
fengchaoyang | sorry, my question already can't solve, this is my question when i git review Enter passphrase for key '/opt/stack/.ssh/id_rsa': Enter passphrase for key '/opt/stack/.ssh/id_rsa': fatal: ICLA contributor agreement requires current contact information. Please review your contact information: https://review.openstack.org/#/settings/contact fatal: Could not read from remote repository. Please make sure you have th | 05:50 |
fengchaoyang | my openstack profile email and gerrit email is same email address | 05:51 |
fengchaoyang | could you tell me what can i do? | 05:52 |
*** amitgandhinz has joined #openstack-infra | 05:52 | |
*** javeriak has joined #openstack-infra | 05:52 | |
*** PollyZ has quit IRC | 05:52 | |
*** _nadya_ has joined #openstack-infra | 05:52 | |
fengchaoyang | git remote -v gerritssh://fengchaoyang@review.openstack.org:29418/openstack/python-gnocchiclient.git (fetch) gerritssh://fengchaoyang@review.openstack.org:29418/openstack/python-gnocchiclient.git (push) originhttps://github.com/openstack/python-gnocchiclient.git (fetch) originhttps://github.com/openstack/python-gnocchiclient.git (push) | 05:53 |
*** PollyZ has joined #openstack-infra | 05:53 | |
fengchaoyang | user.email=fengchaoyang@unitedstack.com user.name=fengchaoyang gitreview.username=fengchaoyang core.repositoryformatversion=0 core.filemode=true core.bare=false core.logallrefupdates=true remote.origin.url=https://github.com/openstack/python-gnocchiclient.git remote.origin.fetch=+refs/heads/*:refs/remotes/origin/* branch.master.remote=origin branch.master.merge=refs/heads/master remote.gerrit.url=ssh://fengchaoyang@revi | 05:53 |
*** yamahata has joined #openstack-infra | 05:53 | |
*** amitgandhinz has quit IRC | 05:56 | |
*** chlong has joined #openstack-infra | 05:59 | |
*** roxanaghe has joined #openstack-infra | 06:02 | |
*** sarob has joined #openstack-infra | 06:02 | |
*** sarob has quit IRC | 06:02 | |
*** sarob has joined #openstack-infra | 06:02 | |
*** mrmartin has joined #openstack-infra | 06:05 | |
*** roxanaghe has quit IRC | 06:06 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Set --use-public option for dlrn execution instead of env var https://review.openstack.org/351682 | 06:07 |
*** dkehn has quit IRC | 06:08 | |
*** gildub has joined #openstack-infra | 06:09 | |
*** dkehn_ has quit IRC | 06:10 | |
*** Hal has quit IRC | 06:10 | |
*** dkehn has joined #openstack-infra | 06:15 | |
*** kzaitsev_mb has joined #openstack-infra | 06:19 | |
craige | found the discovery URL for prod and dev instances and have been unable to get a working response using the URI contained there in (for either) clarkb | 06:20 |
*** vsaienko1 has quit IRC | 06:23 | |
*** _nadya_ has quit IRC | 06:23 | |
*** javeriak has quit IRC | 06:23 | |
*** kzaitsev_mb has quit IRC | 06:24 | |
*** PollyZ has quit IRC | 06:25 | |
*** senk_ has joined #openstack-infra | 06:28 | |
*** javeriak has joined #openstack-infra | 06:28 | |
*** dkehn_ has joined #openstack-infra | 06:29 | |
*** baoli has joined #openstack-infra | 06:31 | |
*** sarob has quit IRC | 06:35 | |
*** baoli has quit IRC | 06:36 | |
*** sdake has quit IRC | 06:38 | |
*** markvoelker has joined #openstack-infra | 06:38 | |
*** pcaruana has joined #openstack-infra | 06:38 | |
*** rcernin has joined #openstack-infra | 06:41 | |
*** markvoelker has quit IRC | 06:42 | |
*** xnox has quit IRC | 06:44 | |
*** matbu|pto is now known as matbu | 06:44 | |
*** fengchaoyang has quit IRC | 06:45 | |
*** fengchaoyang has joined #openstack-infra | 06:46 | |
*** rbuzatu has quit IRC | 06:48 | |
*** Hal has joined #openstack-infra | 06:52 | |
*** amitgandhinz has joined #openstack-infra | 06:52 | |
*** tesseract- has joined #openstack-infra | 06:53 | |
yolanda | good morning | 06:54 |
craige | Good morning yolanda | 06:54 |
*** slaweq has joined #openstack-infra | 06:55 | |
AJaeger | sshnaidm: see the change I referenced that removed the job - the job was in a different template than the one you add it to now. | 06:56 |
AJaeger | fengchaoyang: If you already followed the instructions at http://docs.openstack.org/infra/manual/developers.html#account-setup and still get that, see https://ask.openstack.org/question/56720 for additional troubleshooting tips. | 06:57 |
*** amitgandhinz has quit IRC | 06:57 | |
AJaeger | morning, yolanda | 06:57 |
openstackgerrit | Shinya Kawabata proposed openstack-infra/project-config: Add gate-tempest for Cassandra implementation of monasca https://review.openstack.org/352245 | 06:57 |
sshnaidm | AJaeger, not sure I understand.. I see it there in experimental-tripleo as well: https://review.openstack.org/#/c/337573/2/zuul/layout.yaml | 06:58 |
AJaeger | sshnaidm: You say basically "Add back as previous" - but do it differently. And I wonder why it's not a full revert to the status before. I'm fine with either but like to be convinced that what you do is really what the tripleo team intends to do. | 06:59 |
AJaeger | sshnaidm: I suggest you wait until either derekh is back or pabelanger is online (this European afternoon - Canada morning) and discuss with either of them. | 07:00 |
craige | ping jhesketh | 07:01 |
jhesketh | craige: pong | 07:01 |
craige | Got a moment for a higher bandwidth chat about 342481? | 07:02 |
sshnaidm | AJaeger, I see, I don't think I can really "revert" it, because there were a huge amount of changes in job definitions related to all these movements from rh1, to rh1, etc. But what I need is to be able to run tempest gate job with "check experimental", as it was possible before (this I meant "revert"). From my side it could be considered even as new definition.. | 07:02 |
*** _nadya_ has joined #openstack-infra | 07:02 | |
sshnaidm | AJaeger, sure, I'll talk to pabelanger about this as well | 07:03 |
*** ifarkas_afk is now known as ifarkas | 07:03 | |
*** _nadya_ has quit IRC | 07:04 | |
*** _nadya_ has joined #openstack-infra | 07:05 | |
AJaeger | sshnaidm: there were quite some changes - but you can still look what was the status before those and what it is now ;) And if you don't want to revert, then explain what you do. | 07:06 |
AJaeger | sshnaidm: Just some simple grep why your change make a difference: | 07:06 |
AJaeger | grep experimental-tripleo-jobs zuul/layout.yaml|wc -l | 07:06 |
AJaeger | 6 | 07:06 |
AJaeger | but the same grep with check-tripleo-jobs gives 16. So, before the job was added to 6 repos, now you want to add it to 16. | 07:07 |
*** xnox has joined #openstack-infra | 07:07 | |
AJaeger | Doing it as you propose might be the right thing to do - but then please explain *why* you do it that way. | 07:07 |
*** HeOS has quit IRC | 07:08 | |
*** slaweq has quit IRC | 07:08 | |
*** HeOS has joined #openstack-infra | 07:08 | |
sshnaidm | AJaeger, if I understand you right - it was a split for tripleoci jobs to run different sets of them for different repos, the tempest job could run for everything before this split, as well as now should be | 07:09 |
*** _nadya_ has quit IRC | 07:10 | |
sshnaidm | AJaeger, are we talking about the same..? | 07:10 |
AJaeger | sshnaidm: I don't know - and don't have the time to dig deeper into this right now. I'll wait for your discussion with pabelanger ... | 07:11 |
sshnaidm | AJaeger, yeah, anyway I'll talk to him, he's on top of last changes in jobs definitions there | 07:11 |
*** roxanaghe has joined #openstack-infra | 07:12 | |
*** xnox has quit IRC | 07:13 | |
*** dkehn has quit IRC | 07:13 | |
*** yamamoto has quit IRC | 07:14 | |
*** dkehn_ has quit IRC | 07:14 | |
*** xnox has joined #openstack-infra | 07:14 | |
*** roxanaghe has quit IRC | 07:17 | |
*** _nadya_ has joined #openstack-infra | 07:18 | |
openstackgerrit | Craige McWhirter proposed openstack-infra/puppet-phabricator: Patches Required to Deliver Pholio https://review.openstack.org/342481 | 07:18 |
*** _nadya_ has quit IRC | 07:18 | |
*** kzaitsev_mb has joined #openstack-infra | 07:20 | |
*** jlanoux has joined #openstack-infra | 07:23 | |
fengchaoyang | thanks all | 07:23 |
*** fengchaoyang has quit IRC | 07:23 | |
*** slaweq has joined #openstack-infra | 07:24 | |
*** permalac has joined #openstack-infra | 07:24 | |
*** kzaitsev_mb has quit IRC | 07:25 | |
*** _nadya_ has joined #openstack-infra | 07:31 | |
*** mikelk has joined #openstack-infra | 07:33 | |
*** vincentll has joined #openstack-infra | 07:34 | |
*** jpich has joined #openstack-infra | 07:36 | |
*** e0ne has joined #openstack-infra | 07:36 | |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Update delete flavor test to work with betamax https://review.openstack.org/303459 | 07:37 |
*** matthewbodkin has joined #openstack-infra | 07:37 | |
openstackgerrit | Marton Kiss proposed openstack-infra/puppet-askbot: Add explicit configuration support for Akismet https://review.openstack.org/347020 | 07:41 |
openstackgerrit | Aleksey Zvyagintsev proposed openstack-infra/project-config: [jenkinss]Add {murano-app}-unittest job https://review.openstack.org/351757 | 07:41 |
yolanda | is review.openstack.org very slow for you? | 07:43 |
yolanda | AJaeger, ^ | 07:43 |
*** yaume has joined #openstack-infra | 07:44 | |
*** rbuzatu has joined #openstack-infra | 07:45 | |
*** yaume has quit IRC | 07:47 | |
*** rbuzatu has quit IRC | 07:49 | |
*** e0ne has quit IRC | 07:51 | |
zigo | I get a very weird result on the deb-auto-backports, everything should just work, but it doesn't, I just get sbuild invoked, and then nothing happends instead of building. | 07:51 |
zigo | See: http://logs.openstack.org/26/352026/4/check/pkgdeb-build-auto-backports/adbd601/console.html | 07:52 |
zigo | How can I debug this? | 07:52 |
*** amitgandhinz has joined #openstack-infra | 07:53 | |
*** rossella_s has quit IRC | 07:53 | |
openstackgerrit | Merged openstack-infra/project-config: Add net-info to openstack-infra jobs https://review.openstack.org/352133 | 07:57 |
openstackgerrit | Merged openstack-infra/project-config: Manila - Skip running devstack jobs on api-ref/install-guide changes https://review.openstack.org/352176 | 07:57 |
zigo | AJaeger: ^ | 07:57 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add "audit"package to yum-minimal https://review.openstack.org/352263 | 07:57 |
zigo | Maybe if I get a copy of the image? | 07:57 |
*** gildub has quit IRC | 07:57 | |
zigo | ianw: ^ | 07:57 |
*** amitgandhinz has quit IRC | 07:58 | |
*** matrohon has joined #openstack-infra | 07:58 | |
ianw | zigo: ? | 08:00 |
*** zzzeek has quit IRC | 08:00 | |
*** zzzeek has joined #openstack-infra | 08:00 | |
zigo | ianw: How can I get to understand why sbuild is doing nothing here? http://logs.openstack.org/26/352026/4/check/pkgdeb-build-auto-backports/adbd601/console.html | 08:00 |
zigo | ianw: It's supposed to just build, but it does nothing... | 08:00 |
zigo | (see the very end of the log) | 08:01 |
*** dtantsur|afk is now known as dtantsur | 08:02 | |
*** ramishra_ has joined #openstack-infra | 08:02 | |
ianw | zigo: hmm, odd ... it does go quiet for 27 seconds, is that about the build time? | 08:02 |
ianw | seems like probably the output goes somewhere not captured | 08:03 |
zigo | ianw: I don't know. | 08:03 |
*** Hal has quit IRC | 08:03 | |
zigo | ianw: Maybe I can add an "ls" after the build, just to check the output. | 08:03 |
*** nherciu has joined #openstack-infra | 08:04 | |
* zigo does that | 08:04 | |
ianw | zigo: i can probably put a host on hold and get you a login for it, if that would help | 08:04 |
zigo | ianw: That would help *A LOT* yes. | 08:04 |
ianw | zigo: ok, give me a minute, we can hold hosts after a failed job | 08:05 |
zigo | ianw: I just added the ls in https://review.openstack.org/352026 | 08:05 |
*** ramishra has quit IRC | 08:05 | |
*** jtomasek has quit IRC | 08:07 | |
ianw | | 7 | pkgdeb-build-auto-backports | 1 | | 08:08 |
ianw | zigo: ok, we should hold a node on failure of that job now. try kicking it off for me and we'll see how it goes when it fails | 08:08 |
*** jtomasek has joined #openstack-infra | 08:12 | |
*** javeriak has quit IRC | 08:13 | |
*** roxanaghe has joined #openstack-infra | 08:13 | |
zigo | ianw: As I wrote, I just did in https://review.openstack.org/352026 | 08:13 |
*** Hal has joined #openstack-infra | 08:13 | |
openstackgerrit | Merged openstack-infra/project-config: Rename tripleo-centos-7-ovb to tripleo-centos-7 https://review.openstack.org/352085 | 08:16 |
*** roxanaghe has quit IRC | 08:18 | |
openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Update solr package repository url https://review.openstack.org/352267 | 08:18 |
*** matrohon has quit IRC | 08:19 | |
*** amoralej|off is now known as amoralej | 08:20 | |
*** Goneri has joined #openstack-infra | 08:20 | |
*** kzaitsev_mb has joined #openstack-infra | 08:21 | |
*** ggnel_t has joined #openstack-infra | 08:24 | |
openstackgerrit | Merged openstack-infra/project-config: Add gate-tripleo-quickstart-docs-ubuntu-xenial job https://review.openstack.org/349087 | 08:25 |
*** rbuzatu has joined #openstack-infra | 08:26 | |
*** kzaitsev_mb has quit IRC | 08:26 | |
AJaeger | yolanda: yes, gerrit was/is slow, see my earlier discussion with jhesketh. But haven't touched review for the last 90 mins, so cannot speak about current status. | 08:28 |
*** dingyichen has quit IRC | 08:32 | |
senk_ | AJaeger: still slow currently.. i guess it started yesterday.. | 08:32 |
AJaeger | zigo: One tip - you can also check the log files from ansible in http://logs.openstack.org/26/352026/4/check/pkgdeb-build-auto-backports/adbd601/_zuul_ansible/ . They contain the rest of your job setup. Not sure whether that helps with this example, just wanted to point it out. I agree with ianw's suggestion to hold a note. | 08:32 |
AJaeger | senk_: let's tell yolanda, she has the powers to restart gerrit ;) | 08:32 |
zigo | Thanks. | 08:32 |
yolanda | going to take a look at logs and restart if needed | 08:33 |
senk_ | yolanda: would be great if you can investigate the issue.. the "Proxy Error" happens more frequently | 08:34 |
openstackgerrit | Merged openstack-infra/system-config: Add compute023.chocolate metadata for better tracking https://review.openstack.org/351653 | 08:35 |
Jokke_ | AJaeger & yolanda: it still is dead slow and giving 502 proxy errors | 08:35 |
*** matrohon has joined #openstack-infra | 08:36 | |
yolanda | going to restart it | 08:36 |
*** matrohon has quit IRC | 08:36 | |
*** acabot has joined #openstack-infra | 08:36 | |
*** rossella_s has joined #openstack-infra | 08:37 | |
yolanda | #status notice Gerrit is going to be restarted | 08:37 |
openstackstatus | yolanda: sending notice | 08:37 |
-openstackstatus- NOTICE: Gerrit is going to be restarted | 08:38 | |
*** mrmartin has quit IRC | 08:39 | |
openstackstatus | yolanda: finished sending notice | 08:40 |
yolanda | ok, it has been restarted | 08:41 |
Jokke_ | thanks yolanda | 08:42 |
*** dtantsur is now known as dtantsur|sick | 08:44 | |
*** jistr|mtg is now known as jistr | 08:50 | |
*** tosky has joined #openstack-infra | 08:51 | |
*** mrmartin has joined #openstack-infra | 08:52 | |
*** matrohon has joined #openstack-infra | 08:53 | |
*** mhickey has joined #openstack-infra | 08:54 | |
*** yaume has joined #openstack-infra | 08:56 | |
*** kzaitsev_mb has joined #openstack-infra | 08:56 | |
*** roxanaghe has joined #openstack-infra | 09:00 | |
*** binbincong has quit IRC | 09:03 | |
*** acoles_ is now known as acoles | 09:04 | |
*** roxanaghe has quit IRC | 09:05 | |
*** chem has joined #openstack-infra | 09:06 | |
*** matrohon has quit IRC | 09:08 | |
*** kushal has quit IRC | 09:08 | |
*** Mmike has quit IRC | 09:11 | |
*** e0ne has joined #openstack-infra | 09:11 | |
*** yamamoto has joined #openstack-infra | 09:12 | |
senk_ | thanks yolanda | 09:12 |
*** Mmike has joined #openstack-infra | 09:13 | |
yolanda | no problem | 09:14 |
*** yamamot__ has joined #openstack-infra | 09:14 | |
*** daemontool has joined #openstack-infra | 09:14 | |
*** yamamoto has quit IRC | 09:17 | |
*** Sukhdev has quit IRC | 09:18 | |
openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Askbot add editor_deselector for the staging settings https://review.openstack.org/352284 | 09:18 |
zigo | ianw: The build is done, now 1/ I get what the problem is 2/ the issue is indeed that there's no output redirection or something. | 09:19 |
zigo | ianw: Can you give me access so that I can attempt to find out the output issue? | 09:19 |
e0ne | can anybody please review https://review.openstack.org/351178? | 09:22 |
*** javeriak has joined #openstack-infra | 09:22 | |
*** DaiDV has joined #openstack-infra | 09:24 | |
AJaeger | e0ne: I'd like to see some review of that especially by OpenStack QA and cinder folks | 09:24 |
*** matrohon has joined #openstack-infra | 09:24 | |
e0ne | AJaeger: I'm not sure that QA guys can help with it. it's related only to BDD driver:( | 09:25 |
e0ne | AJaeger: I'll ask somebody else from cinder team to review it | 09:25 |
* zigo pushed a new patch fixing the issue | 09:27 | |
*** binbincong has joined #openstack-infra | 09:27 | |
AJaeger | e0ne: thanks | 09:28 |
mrmartin | hi | 09:29 |
mrmartin | Maybe someone else have a better eye for this, why this trusty job fails? http://logs.openstack.org/20/347020/2/check/gate-infra-puppet-apply-ubuntu-trusty/ded8dd4/console.html | 09:30 |
ianw | zigo: ok, try jenkins@23.253.203.141 | 09:30 |
mrmartin | it is the related patchset: https://review.openstack.org/#/c/347020/ | 09:30 |
zigo | ianw: I'm in, thanks ! | 09:30 |
*** daemontool has quit IRC | 09:31 | |
zigo | Weird, sbuild is producing output when I just type "sbuild" | 09:31 |
zigo | Trying with the ssh trick. | 09:32 |
zigo | Hum... it's not doing it with the ssh thing. | 09:33 |
*** narayrak has joined #openstack-infra | 09:34 | |
*** yamamot__ has quit IRC | 09:35 | |
*** zeroDivisible has joined #openstack-infra | 09:35 | |
*** yamamoto has joined #openstack-infra | 09:35 | |
*** kzaitsev_mb has quit IRC | 09:36 | |
*** ams__ has joined #openstack-infra | 09:38 | |
*** binbincong has quit IRC | 09:40 | |
*** yamamoto has quit IRC | 09:41 | |
*** Sudha has joined #openstack-infra | 09:41 | |
ianw | zigo: i bet it checks isatty() or something... | 09:43 |
*** narayrak has quit IRC | 09:43 | |
ianw | ssh -l might help? | 09:43 |
zigo | ianw: It's looking like it needs $verbose = 1; in .sbuildrc | 09:44 |
zigo | Not sure why... | 09:44 |
zigo | I'll fix that in deb-openstack-pkg-tools. | 09:44 |
*** narayrak has joined #openstack-infra | 09:44 | |
ianw | mrmartin: http://logs.openstack.org/20/347020/2/check/gate-infra-puppet-apply-ubuntu-trusty/ded8dd4/console.html#_2016-08-08_07_47_54_935723 i think | 09:45 |
ianw | those logs are always really hard to parse | 09:45 |
mrmartin | ianw, oh thanks, really | 09:46 |
*** Hal has quit IRC | 09:47 | |
*** Hal has joined #openstack-infra | 09:47 | |
zigo | ianw: Any idea why it's taking so long to schedule packaging jobs, when we're supposed to be alone using the Jessie image? | 09:48 |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Fix /v1/worklists/:id/items endpoint https://review.openstack.org/351819 | 09:48 |
zigo | ianw: It used to take only a few minutes, now I'm waiting more than 30. | 09:48 |
zigo | ianw: And I guess you can now destroy the VM, I've seen what I wanted. | 09:49 |
zigo | Thanks a lot for your help. | 09:49 |
*** nherciu_ has joined #openstack-infra | 09:52 | |
ianw | zigo: ok, cool. umm, well there might be something in nodepool that's not working too well | 09:52 |
zigo | ianw: Yeah, that's my feeling too. It may be worse looking into it. | 09:53 |
zigo | (as it may be slowing down everyone...) | 09:53 |
ianw | zigo: when we first rolled out centos, we hit starvation in a similar situation of only using a few nodes. i did a bunch of work on the scheduler at that point, but things might have changed | 09:53 |
zigo | Ok. | 09:54 |
*** amitgandhinz has joined #openstack-infra | 09:55 | |
*** nherciu has quit IRC | 09:56 | |
ianw | zigo: ok, removed the "hold after failure" on that job | 09:56 |
*** amitgandhinz has quit IRC | 09:59 | |
openstackgerrit | Marton Kiss proposed openstack-infra/puppet-askbot: Add explicit configuration support for Akismet https://review.openstack.org/347020 | 10:01 |
*** matrohon has quit IRC | 10:01 | |
*** zhurong has quit IRC | 10:03 | |
*** binbincong has joined #openstack-infra | 10:04 | |
*** yamamoto has joined #openstack-infra | 10:05 | |
*** yamamoto has quit IRC | 10:05 | |
*** yamamoto has joined #openstack-infra | 10:06 | |
*** rbuzatu has quit IRC | 10:09 | |
*** yanyanhu has quit IRC | 10:12 | |
*** matrohon has joined #openstack-infra | 10:17 | |
*** sshnaidm has quit IRC | 10:20 | |
*** _degorenko|afk has quit IRC | 10:26 | |
*** cshastri has joined #openstack-infra | 10:27 | |
*** HeOS has quit IRC | 10:29 | |
*** degorenko_ has joined #openstack-infra | 10:33 | |
*** degorenko_ has quit IRC | 10:33 | |
*** yamamoto has quit IRC | 10:33 | |
openstackgerrit | sandhya proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 10:33 |
*** yamamoto has joined #openstack-infra | 10:39 | |
*** sshnaidm has joined #openstack-infra | 10:40 | |
*** sshnaidm is now known as sshnaidm|afk | 10:40 | |
*** Ravikiran_K has quit IRC | 10:40 | |
*** kzaitsev_mb has joined #openstack-infra | 10:42 | |
bookwar | hi, is there a specific irc channel for generic JJB development questions or can i ask here? I wonder what is the status of Pipeline Plugin support in jjb and if anyone working on it | 10:48 |
*** dkehn has joined #openstack-infra | 10:48 | |
*** dkehn_ has joined #openstack-infra | 10:49 | |
*** yamamoto has quit IRC | 10:51 | |
*** yamamoto has joined #openstack-infra | 10:55 | |
*** yamamoto has quit IRC | 10:55 | |
openstackgerrit | Aleksey Zvyagintsev proposed openstack-infra/project-config: [jenkinss]Add {murano-app}-unittest job https://review.openstack.org/351757 | 10:55 |
*** amitgandhinz has joined #openstack-infra | 10:56 | |
*** yamamoto has joined #openstack-infra | 10:56 | |
*** matrohon has quit IRC | 10:57 | |
*** yamahata has quit IRC | 10:58 | |
*** senk__ has joined #openstack-infra | 10:59 | |
*** sdague has joined #openstack-infra | 11:00 | |
*** amitgandhinz has quit IRC | 11:00 | |
*** senk_ has quit IRC | 11:01 | |
*** yamamoto has quit IRC | 11:01 | |
*** Sudha has quit IRC | 11:03 | |
*** yamamoto has joined #openstack-infra | 11:03 | |
*** yamamoto has quit IRC | 11:03 | |
*** rbuzatu has joined #openstack-infra | 11:04 | |
*** yamamoto has joined #openstack-infra | 11:05 | |
*** pcaruana has quit IRC | 11:06 | |
*** pcaruana has joined #openstack-infra | 11:07 | |
*** sdake has joined #openstack-infra | 11:08 | |
*** sdake has quit IRC | 11:08 | |
*** sdake has joined #openstack-infra | 11:08 | |
*** mrmartin has quit IRC | 11:09 | |
*** permalac has quit IRC | 11:09 | |
*** yamamoto has quit IRC | 11:10 | |
*** yamamoto has joined #openstack-infra | 11:10 | |
*** DaiDV has quit IRC | 11:11 | |
*** coolsvap is now known as coolsvap_ | 11:12 | |
*** matrohon has joined #openstack-infra | 11:13 | |
*** thiagolib has joined #openstack-infra | 11:17 | |
*** lucasagomes is now known as lucas-hungry | 11:21 | |
*** jkilpatr has joined #openstack-infra | 11:23 | |
*** e0ne has quit IRC | 11:23 | |
*** furlongm_ has joined #openstack-infra | 11:23 | |
*** yamamoto has quit IRC | 11:26 | |
*** yamamoto has joined #openstack-infra | 11:26 | |
*** jaosorior has quit IRC | 11:27 | |
openstackgerrit | Tim Irnich proposed openstack-infra/project-config: Adding project for Gluon fuel plugin. https://review.openstack.org/339488 | 11:28 |
*** jaosorior has joined #openstack-infra | 11:28 | |
*** sshnaidm|afk is now known as sshnaidm | 11:28 | |
*** yolanda has quit IRC | 11:29 | |
*** matthewbodkin has quit IRC | 11:30 | |
*** yamamoto has quit IRC | 11:31 | |
*** yolanda has joined #openstack-infra | 11:33 | |
*** rodrigods has quit IRC | 11:33 | |
*** rodrigods has joined #openstack-infra | 11:33 | |
*** yamamoto has joined #openstack-infra | 11:34 | |
*** yamamoto has quit IRC | 11:34 | |
*** sdake has quit IRC | 11:36 | |
*** ldnunes has joined #openstack-infra | 11:38 | |
*** sdake has joined #openstack-infra | 11:39 | |
*** kzaitsev_mb has quit IRC | 11:39 | |
*** sdake has quit IRC | 11:41 | |
*** gordc has joined #openstack-infra | 11:43 | |
*** sdake has joined #openstack-infra | 11:43 | |
*** jimbaker has quit IRC | 11:44 | |
*** furlongm_ has quit IRC | 11:44 | |
*** markvoelker has joined #openstack-infra | 11:45 | |
*** matrohon has quit IRC | 11:45 | |
*** yamamoto has joined #openstack-infra | 11:46 | |
*** yamamoto has quit IRC | 11:46 | |
*** thorst has joined #openstack-infra | 11:47 | |
*** thorst has quit IRC | 11:47 | |
*** jimbaker has joined #openstack-infra | 11:47 | |
*** jimbaker has joined #openstack-infra | 11:48 | |
*** thorst has joined #openstack-infra | 11:48 | |
*** furlongm_ has joined #openstack-infra | 11:48 | |
*** florianf has joined #openstack-infra | 11:48 | |
*** florianf has quit IRC | 11:48 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/diskimage-builder: TESTING CCAMACHO'S CHANGE https://review.openstack.org/352373 | 11:50 |
strigazi | Hi infra, how can I delete a file from our docs that was published in the past but currently is deleted from our repo? | 11:51 |
*** cshastri has quit IRC | 11:51 | |
strigazi | http://docs.openstack.org/developer/magnum/dev/dev-quickstart.html | 11:51 |
*** furlongm_ has quit IRC | 11:51 | |
strigazi | is replaced by http://docs.openstack.org/developer/magnum/dev/quickstart.html | 11:51 |
AJaeger | strigazi: you cannot ;) I can do it for you... | 11:52 |
AJaeger | strigazi: it's a manual step ;( | 11:52 |
openstackgerrit | Aleksey Zvyagintsev proposed openstack-infra/project-config: Add {murano-app}-unittest job https://review.openstack.org/351757 | 11:54 |
strigazi | AJaeger: Thanks | 11:54 |
*** furlongm_ has joined #openstack-infra | 11:54 | |
AJaeger | strigazi: there are a few more old files in that directory, can those be removed as well? dev-heat-mesos.html, dev-mesos.html, dev-functional-test.html, tls.html? | 11:54 |
*** baoli has joined #openstack-infra | 11:54 | |
*** binbincong has quit IRC | 11:55 | |
*** tpsilva has joined #openstack-infra | 11:56 | |
*** kushal has joined #openstack-infra | 11:56 | |
*** amitgandhinz has joined #openstack-infra | 11:56 | |
*** raildo has joined #openstack-infra | 11:56 | |
strigazi | Whatever is not in the tree of our repo should be removed | 11:57 |
*** larainema has quit IRC | 11:57 | |
strigazi | all the files you mentioned can be deleted | 11:57 |
strigazi | AJaeger: ^^ | 11:58 |
*** larainema has joined #openstack-infra | 11:59 | |
*** furlongm_ has quit IRC | 11:59 | |
*** baoli has quit IRC | 11:59 | |
*** javeriak has quit IRC | 11:59 | |
*** dprince has joined #openstack-infra | 12:00 | |
AJaeger | strigazi: deleted the old content | 12:00 |
strigazi | AJaeger: Thanks a lot | 12:01 |
*** amitgandhinz has quit IRC | 12:01 | |
*** amoralej is now known as amoralej|off | 12:02 | |
*** matrohon has joined #openstack-infra | 12:02 | |
*** baoli has joined #openstack-infra | 12:02 | |
*** rossella_s has quit IRC | 12:03 | |
*** amoralej|off is now known as amoralej|lunch | 12:03 | |
*** cshastri has joined #openstack-infra | 12:04 | |
*** baoli_ has joined #openstack-infra | 12:04 | |
*** senk has quit IRC | 12:04 | |
*** senk__ is now known as senk | 12:04 | |
*** gongysh has quit IRC | 12:04 | |
*** senk has quit IRC | 12:05 | |
*** jimbaker has quit IRC | 12:07 | |
*** baoli has quit IRC | 12:08 | |
*** senk_ has joined #openstack-infra | 12:08 | |
zigo | ianw: Are you still around? Can I bother you with this one? https://review.openstack.org/#/c/351734/ | 12:09 |
*** furlongm_ has joined #openstack-infra | 12:10 | |
*** jimbaker has joined #openstack-infra | 12:11 | |
*** jimbaker has joined #openstack-infra | 12:11 | |
*** yamamoto has joined #openstack-infra | 12:12 | |
*** yamamoto has quit IRC | 12:12 | |
*** pradk has joined #openstack-infra | 12:12 | |
*** matthewbodkin has joined #openstack-infra | 12:13 | |
*** yamamoto has joined #openstack-infra | 12:13 | |
*** chmouel has joined #openstack-infra | 12:13 | |
*** yamamoto has quit IRC | 12:14 | |
*** yamamoto has joined #openstack-infra | 12:14 | |
*** yamamoto has quit IRC | 12:15 | |
*** HeOS has joined #openstack-infra | 12:15 | |
*** rhallisey has joined #openstack-infra | 12:15 | |
*** gouthamr has joined #openstack-infra | 12:17 | |
*** lucas-hungry is now known as lucasagomes | 12:18 | |
*** moravec has quit IRC | 12:18 | |
*** amitgandhinz has joined #openstack-infra | 12:19 | |
*** yamamoto has joined #openstack-infra | 12:20 | |
*** e0ne has joined #openstack-infra | 12:20 | |
*** furlongm_ has quit IRC | 12:21 | |
openstackgerrit | Csaba Henk proposed openstack-infra/project-config: Add jobs for Manila glusterfs, glusterfs-native drivers with Heketi layout https://review.openstack.org/287632 | 12:21 |
openstackgerrit | Csaba Henk proposed openstack-infra/project-config: templatize Manila GlusterFS jobs https://review.openstack.org/350120 | 12:21 |
*** matrohon has quit IRC | 12:23 | |
*** yamamoto has quit IRC | 12:25 | |
*** weshay has joined #openstack-infra | 12:26 | |
openstackgerrit | Merged openstack-infra/system-config: Add compute043.chocolate metadata for better tracking https://review.openstack.org/352161 | 12:29 |
openstackgerrit | Merged openstack-infra/system-config: Update iLO IP and rack for compute010.chocolate https://review.openstack.org/352157 | 12:29 |
openstackgerrit | Merged openstack-infra/system-config: Update iLO IP and rack for compute089.chocolate https://review.openstack.org/352159 | 12:29 |
*** igorn has quit IRC | 12:30 | |
*** javeriak has joined #openstack-infra | 12:30 | |
*** amotoki has joined #openstack-infra | 12:31 | |
e0ne | AJaeger: thanks for the review, Andreas | 12:31 |
*** kzaitsev_mb has joined #openstack-infra | 12:31 | |
openstackgerrit | Merged openstack-infra/system-config: Update iLO IP and rack for compute084.chocolate https://review.openstack.org/352150 | 12:32 |
*** swat30 has joined #openstack-infra | 12:32 | |
strigazi | We have a document in etherpad that I can't open. It contains the summary of our midcycle. Can someone check, I hope the content is not lost. https://etherpad.openstack.org/p/magnum-newton-midcycle-topics | 12:32 |
openstackgerrit | Merged openstack-infra/system-config: Update iLO IP and rack for compute013.chocolate https://review.openstack.org/352151 | 12:33 |
openstackgerrit | Merged openstack-infra/system-config: Add compute061.chocolate metadata for better tracking https://review.openstack.org/352152 | 12:33 |
openstackgerrit | Merged openstack-infra/system-config: Add compute065.chocolate metadata for better tracking https://review.openstack.org/352153 | 12:33 |
*** psilvad has joined #openstack-infra | 12:33 | |
openstackgerrit | Merged openstack-infra/system-config: Add compute067.chocolate metadata for better tracking https://review.openstack.org/352154 | 12:33 |
openstackgerrit | Merged openstack-infra/system-config: Add compute063.chocolate metadata for better tracking https://review.openstack.org/352155 | 12:34 |
*** hichihara has joined #openstack-infra | 12:34 | |
openstackgerrit | Merged openstack-infra/system-config: Update iLO IP and rack for compute086.chocolate https://review.openstack.org/352156 | 12:34 |
*** chem has quit IRC | 12:34 | |
openstackgerrit | Merged openstack-infra/system-config: Add compute070.chocolate metadata for better tracking https://review.openstack.org/352158 | 12:35 |
*** igorn has joined #openstack-infra | 12:35 | |
openstackgerrit | Merged openstack-infra/system-config: Add compute028.chocolate metadata for better tracking https://review.openstack.org/352163 | 12:37 |
openstackgerrit | Merged openstack-infra/system-config: Update iLO IP and rack for compute012.chocolate https://review.openstack.org/352164 | 12:37 |
openstackgerrit | Merged openstack-infra/system-config: Add compute004.chocolate metadata for better tracking https://review.openstack.org/352165 | 12:37 |
*** amitgandhinz has quit IRC | 12:37 | |
openstackgerrit | Merged openstack-infra/system-config: Add compute048.chocolate metadata for better tracking https://review.openstack.org/352166 | 12:38 |
*** cshastri has quit IRC | 12:38 | |
*** amitgandhinz has joined #openstack-infra | 12:38 | |
*** Julien-zte has joined #openstack-infra | 12:38 | |
*** Ravikiran_K has joined #openstack-infra | 12:38 | |
*** chem has joined #openstack-infra | 12:39 | |
*** matrohon has joined #openstack-infra | 12:39 | |
openstackgerrit | Merged openstack/os-client-config: Update Internap information https://review.openstack.org/351889 | 12:43 |
*** javeriak has quit IRC | 12:45 | |
openstackgerrit | Merged openstack-infra/system-config: Add compute018.chocolate metadata for better tracking https://review.openstack.org/351647 | 12:46 |
*** ihrachys has joined #openstack-infra | 12:46 | |
openstackgerrit | Merged openstack-infra/system-config: Add documentation on howto consume events from firehose.o.o https://review.openstack.org/351900 | 12:47 |
strigazi | AJaeger: We have a document in etherpad that I can't open. It contains the summary of our midcycle. I hope the content is not lost. https://etherpad.openstack.org/p/magnum-newton-midcycle-topics | 12:47 |
*** rlandy has joined #openstack-infra | 12:48 | |
openstackgerrit | Merged openstack-infra/system-config: Handle non-ASCII characters in body and subject https://review.openstack.org/350042 | 12:49 |
mordred | strigazi: I also cannot open it - it's entirely likely that someone added an evil unicode character by mistake (has happened before) ... I'm looking right now | 12:49 |
*** oanson has quit IRC | 12:52 | |
*** PollyZ has joined #openstack-infra | 12:52 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: if we fail to send mail, the job should fail https://review.openstack.org/351860 | 12:53 |
zigo | mordred: Hi there! The backport repo is looking good, building and all, I'm now waiting for the first POST job to publish stuff. However, I've seen waiting time which makes me think that there's a serious problem in scheduling jobs. I am the only one using the Jessie image, so my jobs should be scheduled pretty fast, though it's taking 30mins + to get check jobs to run. | 12:53 |
zigo | Something not right is going on. | 12:53 |
zigo | mordred: ianw wrote here in the channel that probably there's something wrong that was merged into nodepool. | 12:53 |
zigo | mordred: Your thoughts? | 12:54 |
AJaeger | zigo, check http://grafana.openstack.org/dashboard/db/nodepool - we'Re using all our images right now. | 12:54 |
pabelanger | morning | 12:54 |
openstackgerrit | Merged openstack-infra/system-config: Remove puppet for jeepyb's trivial rebase script https://review.openstack.org/344944 | 12:54 |
AJaeger | morning, pabelanger ! | 12:54 |
*** rfolco has joined #openstack-infra | 12:54 | |
zigo | AJaeger: Oh, so it's just infra being too busy? | 12:54 |
pabelanger | zigo: post jobs have lowest priority, so the queue is starved for resources. It has often taken 24 hours the last few weeks to clear the queue. | 12:55 |
zigo | pabelanger: I'm not even talking about POST jobs, but also check jobs. | 12:55 |
pabelanger | zigo: right, same applies, it is just slow | 12:56 |
AJaeger | zigo, right now we'Re at our limit | 12:56 |
*** yolanda has quit IRC | 12:56 | |
zigo | pabelanger: AJaeger: Is there something planned to fix the situation? | 12:56 |
*** amotoki has quit IRC | 12:56 | |
pabelanger | infracloud will help add more resources | 12:56 |
pabelanger | bluebox should be coming back online | 12:56 |
zigo | ok | 12:57 |
pabelanger | and osic is switching to IPv6, which should be more nodes online | 12:57 |
*** furlongm_ has joined #openstack-infra | 12:57 | |
AJaeger | pabelanger: could you check https://review.openstack.org/#/c/348880/ and https://review.openstack.org/#/c/351120/ together, please? sshnaidm was asking for tripleo job reviews and I'm a bit confused on the way forward. | 12:57 |
pabelanger | zigo: I'd suggest updating your deb-auto-backports jobs to git clone deb-openstack-tools, over using packaging. That way you don't have to wait for zuul to merge / build it | 12:58 |
openstackgerrit | Merged openstack-infra/project-config: grafana: Correct pipeline of midonet periodic jobs https://review.openstack.org/352170 | 12:58 |
*** yolanda has joined #openstack-infra | 12:58 | |
pabelanger | AJaeger: sure, I can do it shortly | 12:58 |
zigo | pabelanger: I don't really need to change openstack-pkg-tools so often, so that's fine. | 12:58 |
zigo | pabelanger: FYI, the first POST job of deb-auto-backports will run soon. | 12:59 |
zigo | Let's hope we get there! :) | 12:59 |
openstackgerrit | Mathieu Rohon proposed openstack-infra/project-config: net-bgpvpn : move install and tempest tests to the gate queue https://review.openstack.org/352401 | 12:59 |
AJaeger | pabelanger: not that urgent - just wanted to connect them together for you since looking only at 351120 looks wrong - and note that the two changes beside the title do not restore the status before the RH1->RH2 change AFAIU. So, get some coffee and take your time to review. Thanks! | 13:00 |
pabelanger | AJaeger: once we land 352086 and 352087, it will need to be updated. | 13:01 |
pabelanger | yolanda: do you mind helping with 352086? | 13:01 |
*** matrohon has quit IRC | 13:01 | |
*** PollyZ has quit IRC | 13:02 | |
mordred | zigo: I agree with pabelanger ... we have capacity issues for sure | 13:02 |
*** mrmartin has joined #openstack-infra | 13:03 | |
yolanda | sorry on a meeting, i can take a look in a while | 13:03 |
mordred | zigo: but super exciting about the first POST job! | 13:04 |
zigo | :) | 13:04 |
zigo | Sure thing. | 13:04 |
sdague | we're seeing odd network behavior on ovh tempest tests (it reflecting host packets back some times), any idea how we get to the bottom of this? | 13:04 |
*** _nadya_ has quit IRC | 13:05 | |
*** rossella_s has joined #openstack-infra | 13:06 | |
pabelanger | AJaeger: looking at the 2 tripleo reviews, they appear correct. But lets update the image name first, then we can see about reviewing that code again | 13:06 |
pabelanger | yolanda: np, thanks | 13:07 |
pabelanger | mordred: do you have a moment to help land 352086? Cleaning up image names in nodepool | 13:07 |
*** _nadya_ has joined #openstack-infra | 13:09 | |
AJaeger | pabelanger: syntax wise yes. But the tempest job that 351120 readds was before in the experimental-tripleo-jobs template which is used by 6 repos and now gets added to check-tripleo-jobs template which is used by 16 repos. So, that can be the riht decision. But looking at the commit message, I see no reason why it should be the right approach ;) I miss the explanation. | 13:09 |
*** mdrabe has joined #openstack-infra | 13:09 | |
*** amitgandhinz has quit IRC | 13:09 | |
*** amitgandhinz has joined #openstack-infra | 13:10 | |
AJaeger | pabelanger: if it would have "restored the old behaviour" - adding to experimental template - I would have given +2 but seeing the discussion and the lack of comments, I doubt this change is done intentional this way. | 13:10 |
openstackgerrit | Merged openstack-infra/system-config: Rename attended_upgrades playbook to unattended_upgrades https://review.openstack.org/344107 | 13:11 |
*** rbuzatu has quit IRC | 13:11 | |
*** dkehn has quit IRC | 13:11 | |
*** tonytan4ever has joined #openstack-infra | 13:12 | |
AJaeger | mordred: could you +2A 352086 for pabelanger, please? | 13:12 |
*** dkehn_ has quit IRC | 13:12 | |
*** eharney has quit IRC | 13:13 | |
*** Na3iL has joined #openstack-infra | 13:13 | |
*** rbuzatu has joined #openstack-infra | 13:13 | |
*** amotoki has joined #openstack-infra | 13:13 | |
* mordred looking | 13:14 | |
mordred | +A | 13:15 |
AJaeger | thanks. pabelanger ^ | 13:15 |
*** furlongm_ has quit IRC | 13:15 | |
*** zhoragh has joined #openstack-infra | 13:16 | |
zhoragh | have trouble with diskimage-builder inside lxc-container | 13:16 |
zhoragh | 2016-08-08 15:12:08,454 INFO nodepool.image.build.dpc: + /usr/local/share/diskimage-builder/lib/img-functions:run_d_in_target:85 : sudo umount -f /opt/dib_t | 13:16 |
zhoragh | mp/dib_build.2sv2ZIqd/mnt/tmp/in_target.d | 13:16 |
zhoragh | 2016-08-08 15:12:08,460 INFO nodepool.image.build.dpc: umount2: Permission denied | 13:16 |
zhoragh | 2016-08-08 15:12:08,460 INFO nodepool.image.build.dpc: umount: /opt/dib_tmp/dib_build.2sv2ZIqd/mnt/tmp/in_target.d: block devices not permitted on fs | 13:16 |
zhoragh | 2016-08-08 15:12:08,460 INFO nodepool.image.build.dpc: umount2: Permission denied | 13:16 |
zhoragh | any idea? | 13:16 |
*** _ari_ has joined #openstack-infra | 13:16 | |
*** xyang1 has joined #openstack-infra | 13:16 | |
mordred | pabelanger: how's your etherpad content recovery skills? | 13:17 |
*** matrohon has joined #openstack-infra | 13:17 | |
*** dkehn has joined #openstack-infra | 13:20 | |
*** pgadiya has quit IRC | 13:20 | |
*** rvasilets___ has joined #openstack-infra | 13:21 | |
*** furlongm_ has joined #openstack-infra | 13:21 | |
*** furlongm_ has quit IRC | 13:22 | |
*** matt-borland has joined #openstack-infra | 13:23 | |
*** yamamoto has joined #openstack-infra | 13:24 | |
*** dkehn_ has joined #openstack-infra | 13:24 | |
anteaya | bookwar: this is the only channel we have to discuss jenkins job builder issues | 13:25 |
openstackgerrit | Jeffrey Zhang proposed openstack-infra/project-config: Enable ubuntu-xenial for Kolla https://review.openstack.org/352089 | 13:25 |
strigazi | mordred: Any news on the broken etherpad? https://etherpad.openstack.org/p/magnum-newton-midcycle-topics | 13:25 |
openstackgerrit | Oleh Baran proposed openstack-infra/project-config: Add non-voting unit test coverage job for murano-dashboard https://review.openstack.org/352412 | 13:25 |
*** zhurong has joined #openstack-infra | 13:27 | |
*** amotoki has quit IRC | 13:27 | |
mordred | strigazi: the content is definitely in the DB | 13:27 |
mordred | strigazi: so don't lose any sleep | 13:27 |
mordred | strigazi: recovering it is a thing I'd rather one of the other roots help with when they return | 13:27 |
zigo | mordred: pabelanger: One question here. Currently, there's a check, a gate and a post job that are all rebuilding packages. Would there be a way to build only once instead of 3 time? | 13:28 |
openstackgerrit | Merged openstack-infra/project-config: Switch to tripleo-centos-7 for tripleo-ci jobs https://review.openstack.org/352086 | 13:28 |
strigazi | mordred: thanks | 13:29 |
*** nmagnezi_ has quit IRC | 13:29 | |
*** furlongm_ has joined #openstack-infra | 13:29 | |
*** yamamoto has quit IRC | 13:29 | |
mordred | zigo: not in the short term - it sohuld be much easier to accomplish once we've rolled out zuul v3 | 13:30 |
zigo | Ok. | 13:30 |
*** zhurong has quit IRC | 13:31 | |
*** masayukig has quit IRC | 13:31 | |
*** zhurong has joined #openstack-infra | 13:32 | |
*** eharney has joined #openstack-infra | 13:32 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Implement TripleO centos-7-nonha-multinode-updates https://review.openstack.org/351914 | 13:32 |
zigo | Shit, it's not publishing correctly, my bad, fixing... | 13:32 |
*** julim has joined #openstack-infra | 13:33 | |
mnaser | FYI about the etherpad issues | 13:33 |
*** Sudha has joined #openstack-infra | 13:33 | |
mnaser | https://github.com/ether/etherpad-lite/issues/2107 | 13:33 |
*** ayoung has joined #openstack-infra | 13:34 | |
*** masayukig has joined #openstack-infra | 13:34 | |
*** matrohon has quit IRC | 13:35 | |
anteaya | zigo: can you perhaps not swear in channel, please? | 13:35 |
*** esberglu has joined #openstack-infra | 13:36 | |
*** ayoung has quit IRC | 13:37 | |
*** amoralej|lunch is now known as amoralej | 13:37 | |
*** zhoragh1 has joined #openstack-infra | 13:38 | |
anteaya | mtreinish: are the mqtt client and the mostiquo client equivalent? | 13:39 |
*** jcoufal has joined #openstack-infra | 13:39 | |
*** zhoragh has quit IRC | 13:42 | |
*** ayoung has joined #openstack-infra | 13:43 | |
*** moravec has joined #openstack-infra | 13:44 | |
*** ccamacho is now known as ccamacho|lunch | 13:44 | |
*** thorst_ has joined #openstack-infra | 13:44 | |
*** masayukig has quit IRC | 13:45 | |
anteaya | sorry mosquitto | 13:46 |
mordred | anteaya: we should write something called mostiquo but have it not be related to mqtt | 13:46 |
*** masayukig has joined #openstack-infra | 13:46 | |
anteaya | that sounds like it will create hours of fun | 13:47 |
*** thorst has quit IRC | 13:48 | |
anteaya | so far on the firehose I belive I am seeing gerrit events and zuul events | 13:49 |
sdague | mnaser: you are with ovh, right? | 13:50 |
mtreinish | anteaya: the only thing reporting to firehose is gerrit right now | 13:50 |
anteaya | sdague: vexxhost | 13:50 |
sdague | oh, damn | 13:50 |
sdague | anteaya: do we have ovh people in here regularly? | 13:50 |
anteaya | mtreinish: ah, then the status's I am seeing must also be coming from gerrit | 13:51 |
anteaya | sdague: if we do I don't have the cloud to nick mapping in my head | 13:51 |
anteaya | mordred: ^^ | 13:51 |
sdague | because right now ovh's odd networking is preventing changing to neutron by default in devstack | 13:51 |
mordred | sdague: yah - same as anteaya ... I think jean-daniel lurks in here | 13:51 |
*** matrohon has joined #openstack-infra | 13:51 | |
sdague | http://lists.openstack.org/pipermail/openstack-dev/2016-August/100888.html | 13:51 |
mtreinish | anteaya: the mosquitto clients are an implementation of a an mqtt client. mqtt is just a protocol specification and doesn't actually include an implementation | 13:51 |
mordred | but I do not know nick | 13:51 |
mordred | ttx: ^^ ? | 13:51 |
anteaya | mordred: jean-daniel, that's the person, yeah | 13:51 |
mtreinish | so there are a bunch of projects that implement the same thing | 13:51 |
anteaya | yolanda: might now | 13:52 |
anteaya | know | 13:52 |
*** mriedem has joined #openstack-infra | 13:52 | |
anteaya | mtreinish: ah thank you | 13:52 |
anteaya | mtreinish: cool, the debian mosquitto-clients seem to be flooding my terminal adequately | 13:52 |
mtreinish | anteaya: I do have a WIP patche up to add logstash and also another to add gerritbot as a consumer: https://review.openstack.org/351344 and https://review.openstack.org/350651 | 13:53 |
mordred | sdague: woot on the email | 13:53 |
mordred | sdague: otoh - that config doesn't work in ovh? | 13:53 |
sdague | ovh is reflecting outbound packets back in | 13:54 |
mordred | sdague: that seems odd | 13:54 |
matt-borland | Hello...Asking for a second review of https://review.openstack.org/#/c/349077/ ; has one +2 from AJaeger. I appreciate it, let me know if there are questions! Thanks in advance. | 13:54 |
sdague | which causes a tempest test to fail because the it ends up making 2 guests talk to each other which normally shouldn't be able to | 13:54 |
sdague | mordred: agreed, if you read the thread, it's all massively confusing to everyone involved | 13:55 |
mtreinish | the only issue with adding other publishers right now is that mqtt without tls pushes passwords in plaintext on the wire, so we need to add encryption before let remote servers auth against the server | 13:55 |
anteaya | mtreinish: thank you | 13:55 |
matt-borland | That patch I listed is a Horizon patch to create general integration jobs, two from a template rather than a single test job. | 13:55 |
openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Change ipmi_username for all servers to HELIONADMIN https://review.openstack.org/352168 | 13:57 |
anteaya | mtreinish: ah yes, plaintext passwords are not good | 13:58 |
anteaya | mtreinish: do we have a patch up to add encryption? | 13:58 |
*** coolsvap_ is now known as coolsvap | 13:58 | |
anteaya | there it is 348030 | 13:59 |
*** rbuzatu_ has joined #openstack-infra | 13:59 | |
mtreinish | anteaya: sorta: https://review.openstack.org/#/c/348019 and https://review.openstack.org/#/c/348030/ | 13:59 |
Zara | is anyone able to take a look at https://review.openstack.org/#/c/351273/ ? it updates the actions for review-dev so that they do the same things that are planned for review.o.o, re: gerrit-storyboard plugin. that way we can check the behaviour before we merge gerrit-storyboard integration for the production systems. | 13:59 |
mtreinish | but I think I'll have to adjust how that all works, because I think the current approach there is a no-go | 13:59 |
*** Liuqing has joined #openstack-infra | 14:00 | |
mtreinish | anteaya: I'm thinking it might be better to store the certs and key contents in hiera and have puppet-mosquitto (and whatever publishers) manage the files | 14:00 |
*** rbrndt has joined #openstack-infra | 14:01 | |
mtreinish | but I don't have a lot of experience doing tls stuff in the infra setup | 14:01 |
anteaya | well storing secret things in hiera is kind of the established workflow, yeah | 14:01 |
anteaya | I don't think you can go wrong if you take the heira road | 14:01 |
* anteaya shows herself to the door | 14:01 | |
*** roxanaghe has joined #openstack-infra | 14:02 | |
*** xarses_ has quit IRC | 14:02 | |
*** rbuzatu has quit IRC | 14:02 | |
*** elarson has joined #openstack-infra | 14:03 | |
*** e0ne has quit IRC | 14:03 | |
mordred | mtreinish: yah - heira road. it's not terribly bad. basically, you make puppet-mosquitto take a parameter for each secret thing | 14:04 |
*** baoli_ has quit IRC | 14:04 | |
mordred | mtreinish: then in the top-level site.pp, when firehose.o.o is making a puppet-mosquitto, it'll do something like ::mosquitto(cert=hiera('firehose_cert')) | 14:05 |
*** matrohon has quit IRC | 14:06 | |
*** roxanaghe has quit IRC | 14:06 | |
*** Na3iL has quit IRC | 14:07 | |
mtreinish | mordred: ok, yeah I did that for the ssh keys. I guess it doesn't solve the cert generation, but I can leave that to you :) | 14:08 |
*** esker has joined #openstack-infra | 14:10 | |
*** ajmiller has joined #openstack-infra | 14:10 | |
*** woodster_ has joined #openstack-infra | 14:11 | |
openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Search for boards and worklists https://review.openstack.org/341562 | 14:13 |
*** zz_dimtruck is now known as dimtruck | 14:15 | |
*** e0ne has joined #openstack-infra | 14:15 | |
*** PollyZ has joined #openstack-infra | 14:16 | |
*** spzala has joined #openstack-infra | 14:16 | |
*** TheJulia has quit IRC | 14:16 | |
*** mtanino has joined #openstack-infra | 14:18 | |
*** permalac has joined #openstack-infra | 14:21 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Allow creating a floating ip on an arbitrary port https://review.openstack.org/352114 | 14:22 |
*** matrohon has joined #openstack-infra | 14:22 | |
mordred | mtreinish: yah - fungi is good at making certs | 14:22 |
mordred | Shrews: ^^ now with tests | 14:23 |
fungi | mtreinish: yeah, i just need to buy and expense them. i can do that later today | 14:23 |
nibalizer | fungi is the certlord | 14:24 |
*** matrohon has quit IRC | 14:24 | |
fungi | i'd like to get the foundation to set up a startcom account so we can just regenerate certs as needed under a flat annual fee | 14:24 |
fungi | er, startssl | 14:25 |
jroll | letsencrypt is now trusted directly in firefox :) | 14:25 |
* jroll doesn't remember what the argument against that was, but wanted to point it out | 14:25 | |
fungi | letsencrypt is not yet trusted directly by systems administrators | 14:25 |
jroll | ah | 14:26 |
sdague | mordred / fungi - where would I register a bug for this ovh behavior, as we're going to probably need to skip a tempest test temporarily until we get a work around | 14:26 |
fungi | i don't like the idea of some process periodically replacing certs and restarting services causing unanticipated breakage | 14:26 |
*** Sudha has quit IRC | 14:26 | |
mordred | fungi: why would a process periodically replace certs and restart services? | 14:26 |
mordred | fungi: is there a letsencrypt SERVICE? | 14:27 |
nibalizer | mordred: yea its a bit wack | 14:27 |
fungi | mordred: tey call it a "client" but yes | 14:27 |
openstackgerrit | Andrey Nikitin proposed openstack-infra/project-config: Add one new Fuel's plugin https://review.openstack.org/352446 | 14:27 |
nibalizer | it phones home and gets a new cert every 60 days | 14:27 |
fungi | and letsencrypt forces a max 90 day expiration, so we'd end up replacing our certs a lot more often (right now we renew them every two years) | 14:27 |
mordred | uhm | 14:27 |
mordred | wow | 14:27 |
mordred | yeah | 14:27 |
mordred | E_DONOTWANT | 14:27 |
*** beekneemech is now known as bnemec | 14:27 | |
mordred | I mean, I'm thrilled it makes it easier for other folks to add certs to things | 14:27 |
nibalizer | it has bad and good parts | 14:27 |
mordred | that's a great benefit to the world | 14:27 |
pabelanger | mordred: unknown, I haven't done much work with etherpad | 14:27 |
mordred | pabelanger: kk. | 14:27 |
nibalizer | shorter certs is also good in theory, its just a burden too | 14:28 |
mordred | fungi: you konw how to fix borked etherpads, right? | 14:28 |
*** e0ne has quit IRC | 14:28 | |
mordred | nibalizer: I have no problem with frequently replacing certs ... I just want that to be under admin control :) | 14:28 |
*** e0ne has joined #openstack-infra | 14:28 | |
nibalizer | mordred: you manage the cron that does it :P | 14:29 |
*** vponomaryov1 is now known as vponomaryov | 14:29 | |
nibalizer | i mean we already have puppet running regularly and swaping certs and restarting services and such | 14:29 |
*** zhoragh1 has left #openstack-infra | 14:29 | |
fungi | mordred: the only solution i have is you manually construct the url to the history timeslider and then you can copy the content out of there (or can try to export it) | 14:29 |
nibalizer | that doesn't go out to a public service though, which is nice | 14:29 |
mordred | fungi: ah - I thought there was an "edit the db" route | 14:30 |
fungi | nibalizer: we don't have puppet restarting those services when we update the certs in hiera, and also the cert updating in hiera is a manual process so we're under control of when it gets done | 14:30 |
AJaeger | fungi, sorry to ping again. I'm on vacation next week and would love to finish the constraints work this week in time for Newton. Could you review https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:constraints - especially 348764 and 349181, please? | 14:30 |
fungi | mordred: none i've had much luck with | 14:30 |
mordred | fungi: nod | 14:30 |
nibalizer | fungi: oh im just bringing up things, not trying to apples to apples compare | 14:31 |
fungi | AJaeger: i have that query up in gertty right now. just trying to get to the point where i can do code review today. friday ended up being a whole day of me just fixing broken things | 14:31 |
nibalizer | and I think we do have puppet restarting our httpd's, just not our more 'stateful' services | 14:31 |
fungi | sdague: we have an openstack-gate project in lp for that | 14:31 |
*** mrmartin has quit IRC | 14:31 | |
fungi | sdague: https://bugs.launchpad.net/openstack-gate (mostly there so we have a place for elastic-recheck to reference bugs about transient behaviors in systems) | 14:32 |
*** Sudha has joined #openstack-infra | 14:33 | |
*** mrmartin has joined #openstack-infra | 14:33 | |
AJaeger | thanks, fungi. | 14:33 |
fungi | nibalizer: pretty sure the service restarts aren't subscribed to the ssl key/cert files, but it's possible we do that in some places | 14:33 |
fungi | nibalizer: we do it for configuration changes, yes | 14:33 |
fungi | but even those are triggered by us merging some change, not by a timer | 14:34 |
*** amoralej is now known as amoralej|brb | 14:34 | |
nibalizer | yah | 14:34 |
fungi | well, okay, ansible is running on a timer, so technically it is, but you know what i mean | 14:35 |
*** psachin has quit IRC | 14:35 | |
*** Teresita-Warrior has joined #openstack-infra | 14:35 | |
jroll | mordred: updating LE certs is totally admin-initiated, it's just that the recommendation is to cron it (so you don't forget to renew) | 14:35 |
*** _ari_ has quit IRC | 14:35 | |
jroll | nothing happens without you running the client to generate a cert and then doing something with it | 14:36 |
fungi | sdague: do you have a more detailed writeup of the behavior besides "reflecting outbound packets back in"? i could try to flex the long-dormant network engineering parts of my brain | 14:36 |
*** PollyZ_ has joined #openstack-infra | 14:36 | |
*** _ari_ has joined #openstack-infra | 14:36 | |
openstackgerrit | Andrey Nikitin proposed openstack-infra/project-config: Add one new Fuel's plugin https://review.openstack.org/352446 | 14:36 |
fungi | jroll: yep, the cron is recommended so that you don't have to perform a manual operation every couple months because they don't let you do traditionally long cert expirations | 14:36 |
jroll | right | 14:37 |
*** thiagop has joined #openstack-infra | 14:37 | |
*** SudhaKR has joined #openstack-infra | 14:37 | |
sdague | fungi: http://lists.openstack.org/pipermail/openstack-dev/2016-August/100997.html | 14:37 |
*** roxanaghe has joined #openstack-infra | 14:37 | |
*** ccamacho|lunch is now known as ccamacho | 14:38 | |
fungi | so my point was that letsencrypt gives you the choice of either having your certs maintained through periodic automation or renewing certs ~10x as often | 14:38 |
*** Sudha has quit IRC | 14:38 | |
*** xarses_ has joined #openstack-infra | 14:38 | |
*** PollyZ has quit IRC | 14:38 | |
fungi | sdague: oh, ick. we should have some sort of egress filtering to prevent our workers from leaking packets sourced from or destined to rfc-1918 address space | 14:40 |
nibalizer | also as I page back in the infra- stuff, um we have a message queue now? | 14:40 |
*** matrohon has joined #openstack-infra | 14:40 | |
anteaya | by message queue do you mean firehose.openstack.org? | 14:41 |
fungi | nibalizer: and experimental one, yes. http://specs.openstack.org/openstack-infra/infra-specs/specs/firehose.html | 14:41 |
anteaya | yes that is emmiting gerrit events currently | 14:41 |
*** markvoelker has quit IRC | 14:41 | |
fungi | er, an experimental one | 14:41 |
nibalizer | sweet | 14:42 |
anteaya | that should have been emitting | 14:42 |
anteaya | nibalizer: the docs patch on clients is merged but not published yet: http://docs-draft.openstack.org/00/351900/2/check/gate-system-config-docs-ubuntu-xenial/36face1//doc/build/html/firehose.html#client-usage | 14:42 |
mordred | strigazi: https://etherpad.openstack.org/p/magnum-newton-midcycle-topics/timeslider#998 ... your content is there - something about revision 999 borks things | 14:43 |
mordred | strigazi: I recommend going and grabbing your content from that url and putting it somewhere | 14:44 |
*** nherciu_ has quit IRC | 14:44 | |
*** thorst has joined #openstack-infra | 14:45 | |
fungi | we've seen a rash of etherpad page breaks lately (something like one a month that have come to my attention) but haven't updated teh version od etherpad we're running. i have to wonder if there's some browser plugin or something causing broken content to get injected under rare circumstances | 14:45 |
*** mdrabe has quit IRC | 14:46 | |
*** psachin has joined #openstack-infra | 14:46 | |
anteaya | well a long time ago there was a browser plugin on windows that kept adding blank lines to the bottom of an open etherpad | 14:47 |
*** TheJulia has joined #openstack-infra | 14:47 | |
anteaya | I think that was HenryG's and we discovered it at the neutron tempest sprint in montreal | 14:47 |
anteaya | so yeah, I think it is possible | 14:47 |
*** thorst_ has quit IRC | 14:47 | |
anteaya | the maintainer of the browser plugin eventually fixed the plugin, which was nice | 14:48 |
*** asettle has joined #openstack-infra | 14:48 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add support for configuring tls ports https://review.openstack.org/348019 | 14:48 |
*** burgerk has joined #openstack-infra | 14:50 | |
anteaya | mtreinish: I think puppet keys with blank default values are '' instead of undef | 14:51 |
anteaya | however don't ever take my word for any puppet reviews | 14:51 |
*** SudhaKR has quit IRC | 14:51 | |
*** mhickey has quit IRC | 14:52 | |
*** mdrabe has joined #openstack-infra | 14:54 | |
*** markvoelker has joined #openstack-infra | 14:54 | |
fungi | undef has a special behavior when used as a default, in that it can't override another default. sometimes that's a useful property | 14:54 |
anteaya | ah thank you | 14:54 |
anteaya | I don't know which one is best in mtreinish's patch | 14:55 |
*** jaosorior has quit IRC | 14:56 | |
mrmartin | fungi: the puppet-askbot akismet patch looks ok now, I've fixed the syntax issue. | 14:58 |
fungi | i think there was a somewhat recent push to start switching our empty value defaults to undef for ease of debugging, but also puppet 4.x changed some nehaviors around empty strings that have made that more complicated | 14:58 |
anteaya | ah this I did not know | 14:58 |
openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add support for configuring tls ports https://review.openstack.org/348019 | 14:59 |
fungi | mrmartin: oh, thanks! i only had enough time to skim the job log and notice my typos, but not enough time to submit a new patchset | 14:59 |
anteaya | crinkle: have you any thoughts on the best way forward on mtreinish's patch, https://review.openstack.org/#/c/348019/3 | 14:59 |
*** amotoki has joined #openstack-infra | 14:59 | |
*** e0ne has quit IRC | 14:59 | |
anteaya | crinkle: I have no idea if it should be '' or undef | 14:59 |
*** amotoki has quit IRC | 14:59 | |
*** karthikp_ has joined #openstack-infra | 15:00 | |
*** e0ne has joined #openstack-infra | 15:00 | |
*** kragniz has quit IRC | 15:00 | |
*** amotoki has joined #openstack-infra | 15:01 | |
*** bin_ has joined #openstack-infra | 15:01 | |
crinkle | anteaya: it should be undef | 15:01 |
anteaya | crinkle: thank you | 15:01 |
anteaya | mtreinish: you got it right, yay! | 15:02 |
mordred | rcarrillocruz: we still havne't added any support to shade for magnum bays, right? | 15:02 |
rcarrillocruz | niet, it's on my queue | 15:02 |
mordred | rcarrillocruz: I ask - because apparently magnum is renaming bay to cluster | 15:02 |
*** psachin has quit IRC | 15:02 | |
rcarrillocruz | lol | 15:02 |
mordred | which I like much better | 15:02 |
anteaya | crinkle: do you have time to expand on that? I'm fine taking your word but if there is more, I will listen | 15:03 |
rcarrillocruz | ok, i'm glad i didn't get back to it then | 15:03 |
rcarrillocruz | thx for the heads-up mordred | 15:03 |
mordred | rcarrillocruz: yah. we should sync up with their new terminology and make shade's api use it - even if magnum doens't yet :) | 15:03 |
rcarrillocruz | heh | 15:03 |
openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add tls support to firehose https://review.openstack.org/352472 | 15:04 |
*** mriedem1 has joined #openstack-infra | 15:04 | |
mtreinish | anteaya: cool | 15:04 |
crinkle | anteaya: the truthiness of the empty string changes between puppet 3 and puppet 4 so we have lint checks in most of the puppet modules to avoid using it entirely to avoid confusion | 15:05 |
*** karthikp_ has quit IRC | 15:05 | |
anteaya | crinkle: wow | 15:05 |
*** mriedem has quit IRC | 15:05 | |
anteaya | crinkle: okay thank you | 15:05 |
anteaya | crinkle: have you a link for the empty string truthiness change documentation? | 15:06 |
mordred | crinkle: so tl;dr - empty string bad? | 15:06 |
*** amitgandhinz has quit IRC | 15:06 | |
*** amitgandhinz has joined #openstack-infra | 15:06 | |
anteaya | mordred: that is the way I'm taking it | 15:07 |
*** amoralej|brb is now known as amoralej | 15:07 | |
crinkle | anteaya: this is where most of our lint changes came from http://www.camptocamp.com/en/actualite/getting-code-ready-puppet-4/ | 15:07 |
*** baoli has joined #openstack-infra | 15:07 | |
*** mriedem1 is now known as mriedem | 15:07 | |
anteaya | crinkle: thank you | 15:07 |
*** hurgleburgler has joined #openstack-infra | 15:08 | |
*** amotoki has quit IRC | 15:08 | |
crinkle | mordred: in practice it doesn't really matter that much as long as you're using `if $foo == '' {}` and not `if $foo {}` | 15:08 |
crinkle | which we usually do | 15:08 |
crinkle | but the lint check isn't smart enough to find those | 15:08 |
*** matrohon has quit IRC | 15:10 | |
anteaya | thanks crinkle | 15:11 |
anteaya | <-- offline for a bit | 15:11 |
*** narayrak has quit IRC | 15:12 | |
*** dprince has quit IRC | 15:14 | |
*** amotoki has joined #openstack-infra | 15:14 | |
*** amitgandhinz has quit IRC | 15:15 | |
*** amitgandhinz has joined #openstack-infra | 15:16 | |
*** amotoki has quit IRC | 15:16 | |
*** amotoki has joined #openstack-infra | 15:16 | |
*** zhurong has quit IRC | 15:18 | |
*** nherciu has joined #openstack-infra | 15:18 | |
*** rbuzatu_ has quit IRC | 15:18 | |
*** amotoki_ has joined #openstack-infra | 15:20 | |
*** amotoki has quit IRC | 15:21 | |
*** amotoki_ has quit IRC | 15:22 | |
*** vincentll has quit IRC | 15:22 | |
*** rbuzatu has joined #openstack-infra | 15:23 | |
*** matrohon has joined #openstack-infra | 15:27 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add a 'meta' passthrough parameter for glance images https://review.openstack.org/350114 | 15:27 |
*** cody-somerville has joined #openstack-infra | 15:30 | |
*** yamahata has joined #openstack-infra | 15:32 | |
*** mikelk has quit IRC | 15:32 | |
*** matrohon has quit IRC | 15:32 | |
pabelanger | zigo: looks like we need to make reprepro import support multiple packages | 15:33 |
pabelanger | zigo: working on patch now | 15:33 |
*** csomerville has joined #openstack-infra | 15:34 | |
*** karthikp_ has joined #openstack-infra | 15:34 | |
strigazi | mordred: Thanks, I copied the content. In day one, in the last line, drinks with team someone had put a beer emoticon. Either Tom or Drago | 15:34 |
*** armax has joined #openstack-infra | 15:35 | |
*** hichihara has quit IRC | 15:37 | |
*** cody-somerville has quit IRC | 15:37 | |
*** baoli has quit IRC | 15:38 | |
*** baoli has joined #openstack-infra | 15:39 | |
*** harlowja_at_home has joined #openstack-infra | 15:42 | |
*** Liuqing has quit IRC | 15:43 | |
*** thorst is now known as thorst_afk | 15:44 | |
*** Ravikiran_K has quit IRC | 15:45 | |
*** jlanoux has quit IRC | 15:45 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Update reprepro-import build to support multiple files https://review.openstack.org/352489 | 15:46 |
rcarrillocruz | lol | 15:46 |
pabelanger | zigo: mordred: ^first fix | 15:46 |
pabelanger | I spotted another | 15:46 |
rcarrillocruz | they changed the nics cabling again | 15:46 |
rcarrillocruz | eth0 is now eth2 | 15:47 |
rcarrillocruz | which means | 15:47 |
rcarrillocruz | most likely | 15:47 |
rcarrillocruz | the macs we provision on our inventory will have to change | 15:47 |
rcarrillocruz | sigh | 15:47 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Only error for duplicate requirements when strict https://review.openstack.org/352490 | 15:47 |
*** matrohon has joined #openstack-infra | 15:49 | |
mordred | rcarrillocruz: sigh indeed | 15:49 |
crinkle | rcarrillocruz: the mellanox nics don't have physical links so that eth0/eth1/eth2 stuff can't be changed by recabling afaik | 15:49 |
*** edmondsw has quit IRC | 15:50 | |
*** Sukhdev has joined #openstack-infra | 15:50 | |
*** weshay is now known as weshay_mtg | 15:55 | |
*** amitgandhinz has quit IRC | 15:56 | |
*** amitgandhinz has joined #openstack-infra | 15:56 | |
zaro | morning | 15:56 |
zaro | bookwar: ask jjb questions here. what's wrong with pipeline plugin? | 15:57 |
*** inc0 has joined #openstack-infra | 15:58 | |
*** hemanthm has left #openstack-infra | 15:59 | |
*** PollyZ_ has quit IRC | 15:59 | |
*** amotoki has joined #openstack-infra | 15:59 | |
*** matrohon has quit IRC | 15:59 | |
*** karthikp_ has quit IRC | 15:59 | |
*** amitgandhinz has quit IRC | 16:00 | |
prometheanfire | AJaeger: do you have another updated requirements update fail I can look at? | 16:00 |
prometheanfire | AJaeger: freezer was on the list but it seems like they are working https://review.openstack.org/#/c/339885/ | 16:00 |
*** amitgandhinz has joined #openstack-infra | 16:00 | |
*** karthikp_ has joined #openstack-infra | 16:01 | |
*** sshnaidm has quit IRC | 16:01 | |
*** rcernin has quit IRC | 16:01 | |
openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: WIP 'All Boards and Worklists' Page https://review.openstack.org/279753 | 16:02 |
*** amotoki has quit IRC | 16:02 | |
*** amotoki has joined #openstack-infra | 16:02 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova unshelve race bug 1611008 https://review.openstack.org/352495 | 16:03 |
openstack | bug 1611008 in OpenStack Compute (nova) "ServersNegativeTestJSON.test_suspend_server_invalid_state fails with "NovaException: Unable to find host for Instance"" [Undecided,Confirmed] https://launchpad.net/bugs/1611008 | 16:03 |
AJaeger | prometheanfire: http://logs.openstack.org/6c/6c3b4315443e2963ffbba9d1030c6e5dffe2514e/post/propose-requirements-updates/f4c6ca9/console.html#_2016-08-08_11_31_00_246150 | 16:03 |
prometheanfire | thanks | 16:04 |
AJaeger | prometheanfire: yeah, monasco seems fine now! | 16:06 |
prometheanfire | AJaeger: you have the review url? | 16:06 |
*** kzaitsev_mb has quit IRC | 16:06 | |
prometheanfire | :D | 16:06 |
AJaeger | prometheanfire: I took the top-most change from the post queue in status.openstack.org/zuul | 16:07 |
AJaeger | prometheanfire: https://review.openstack.org/gitweb?p=openstack/requirements.git;a=commitdiff;h=6c3b4315443e2963ffbba9d1030c6e5dffe2514e | 16:07 |
*** piet has joined #openstack-infra | 16:07 | |
prometheanfire | k, thanks | 16:07 |
*** kzaitsev_mb has joined #openstack-infra | 16:08 | |
AJaeger | prometheanfire: line http://logs.openstack.org/6c/6c3b4315443e2963ffbba9d1030c6e5dffe2514e/post/propose-requirements-updates/f4c6ca9/console.html#_2016-08-08_11_29_45_581330 would have given us that information as well ;) | 16:08 |
AJaeger | and the log file has the SHA1 in it - 6c3b431... | 16:08 |
openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: 'All Boards and Worklists' Page https://review.openstack.org/279753 | 16:08 |
prometheanfire | suppose so :P | 16:08 |
*** hichihara has joined #openstack-infra | 16:08 | |
AJaeger | log URL I mean | 16:08 |
*** e0ne has quit IRC | 16:09 | |
*** pcaruana has quit IRC | 16:11 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Infer nova-net security groups better https://review.openstack.org/352498 | 16:11 |
*** szaher has joined #openstack-infra | 16:11 | |
prometheanfire | szaher: hi :D | 16:11 |
*** Ravikiran_K has joined #openstack-infra | 16:11 | |
*** PollyZ has joined #openstack-infra | 16:11 | |
*** permalac has quit IRC | 16:12 | |
*** dimtruck is now known as zz_dimtruck | 16:12 | |
*** adrian_otto has joined #openstack-infra | 16:12 | |
mordred | crinkle: "the mellanox nics don't have physical links" is a set of words which confuse me - does one not plug cables into mellanox cards? | 16:12 |
*** Apoorva has joined #openstack-infra | 16:12 | |
*** sshnaidm has joined #openstack-infra | 16:13 | |
*** hichihara has quit IRC | 16:14 | |
*** amotoki has quit IRC | 16:15 | |
*** rvasilets___ has quit IRC | 16:17 | |
*** _nadya_ has quit IRC | 16:18 | |
*** xenogear_ has joined #openstack-infra | 16:19 | |
szaher | prometheanfire: Hi :D | 16:19 |
szaher | prometheanfire: I think m3m0 is going to take of it :) | 16:20 |
prometheanfire | yep, looks like it | 16:21 |
crinkle | mordred: er i meant they don't have more than one | 16:21 |
mordred | crinkle: phew. I understand better now :) | 16:22 |
crinkle | words are hard | 16:23 |
*** ifarkas is now known as ifarkas_afk | 16:24 | |
AJaeger | bnemec, EmilienM, sshnaidm, pabelanger : I see now four reviews changing tripleo - and it seems some of these are in conflict or do the same way: https://review.openstack.org/#/c/352479 https://review.openstack.org/348880 https://review.openstack.org/351120 and https://review.openstack.org/#/c/351914 . Could you together come up with a plan on how to move forward, please? | 16:28 |
*** doug-fish has joined #openstack-infra | 16:29 | |
*** harlowja_at_home has quit IRC | 16:29 | |
* bnemec looks | 16:29 | |
*** david-lyle_ has joined #openstack-infra | 16:29 | |
AJaeger | It might be that all four need to go in - but I see some overlap at least in the descriptions... | 16:30 |
AJaeger | bnemec: thanks | 16:30 |
AJaeger | bbl | 16:30 |
EmilienM | AJaeger: looking | 16:30 |
*** baoli has quit IRC | 16:30 | |
bnemec | Yeah, there's at least some overlap between mine and Derek's. | 16:31 |
*** baoli has joined #openstack-infra | 16:31 | |
EmilienM | AJaeger: https://review.openstack.org/#/c/351914 is something we agreed on ML | 16:31 |
*** asettle has quit IRC | 16:31 | |
AJaeger | EmilienM: bnemec's change uses the old name... | 16:32 |
*** asettle has joined #openstack-infra | 16:32 | |
*** rbuzatu has quit IRC | 16:32 | |
openstackgerrit | Marton Kiss proposed openstack-infra/groups: Custom membership fields and reporting https://review.openstack.org/352504 | 16:32 |
bnemec | Yeah, I should probably rebase that on EmilienM's. | 16:32 |
*** Teresita-Warrior has quit IRC | 16:32 | |
*** david-lyle has quit IRC | 16:33 | |
EmilienM | bnemec: thank you | 16:33 |
sshnaidm | AJaeger, bnemec my patch (https://review.openstack.org/#/c/351120/) is only about returning tempest job to experimental pipeline, no objection to have it included in other patch (e.g. of bnemec), but nobody duplicates it as far as I can see | 16:33 |
*** gyee has joined #openstack-infra | 16:33 | |
AJaeger | I'm happy to abandon Derek's for you if that's the best way forward - please review as a team those four changes and tell the way forward. I have to do some cooking now, will be back later and read backscroll. | 16:33 |
*** tonytan4ever has quit IRC | 16:34 | |
*** tonytan4ever has joined #openstack-infra | 16:34 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add option to ensure get_test_runs_by_test_id() is ordered by date https://review.openstack.org/352506 | 16:35 |
*** rbuzatu has joined #openstack-infra | 16:35 | |
*** Teresita-Warrior has joined #openstack-infra | 16:35 | |
*** mrmartin has quit IRC | 16:36 | |
*** zz_dimtruck is now known as dimtruck | 16:36 | |
*** tonytan_brb has joined #openstack-infra | 16:37 | |
bnemec | sshnaidm: Agreed. I left +1 on that one. | 16:38 |
*** Teresita-Warrior has quit IRC | 16:38 | |
*** tonytan4ever has quit IRC | 16:38 | |
*** Goneri has quit IRC | 16:40 | |
*** Na3iL has joined #openstack-infra | 16:40 | |
*** Teresita-Warrior has joined #openstack-infra | 16:40 | |
*** thorst_a_ has joined #openstack-infra | 16:40 | |
*** roxanaghe has quit IRC | 16:40 | |
*** roxanaghe has joined #openstack-infra | 16:41 | |
*** thorst_afk has quit IRC | 16:41 | |
*** Teresita-Warrior has quit IRC | 16:41 | |
*** Swami has joined #openstack-infra | 16:42 | |
*** Teresita-Warrior has joined #openstack-infra | 16:43 | |
*** Teresita-Warrior has quit IRC | 16:44 | |
*** Teresita-Warrior has joined #openstack-infra | 16:45 | |
*** Teresita-Warrior has quit IRC | 16:45 | |
*** kzaitsev_mb has quit IRC | 16:46 | |
bnemec | AJaeger: Here's what it looks like to me: sshnaidm and EmilienM's patches are fine as-is. I need to rebase my patch on EmilienM's, and pull in a few other things from Derek's patch. | 16:46 |
*** amoralej is now known as amoralej|off | 16:47 | |
bnemec | Derek is out this week, so I think the easiest thing would be to just switch to my patch for re-enabling the jobs. | 16:47 |
bnemec | Also, I really don't want to enable all three at once right off the bat. | 16:47 |
openstackgerrit | Roopak Parikh proposed openstack-infra/project-config: I have updated the review request with suggestions from Andreas, can someone review it again. https://review.openstack.org/352512 | 16:47 |
*** e0ne has joined #openstack-infra | 16:49 | |
*** e0ne has quit IRC | 16:49 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Remove useless Puppet OpenStack experimental jobs https://review.openstack.org/352514 | 16:50 |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Remove useless Puppet OpenStack experimental jobs https://review.openstack.org/352514 | 16:51 |
*** jpich has quit IRC | 16:51 | |
openstackgerrit | Merged openstack-infra/storyboard: Fix /v1/worklists/:id/items endpoint https://review.openstack.org/351819 | 16:52 |
*** matthewbodkin has quit IRC | 16:53 | |
*** Sukhdev has quit IRC | 16:55 | |
*** Sukhdev has joined #openstack-infra | 16:55 | |
*** inc0 has quit IRC | 16:55 | |
*** mrmartin has joined #openstack-infra | 16:55 | |
*** tesseract- has quit IRC | 16:57 | |
*** mat128|weekend is now known as mat128 | 16:57 | |
*** tphummel has joined #openstack-infra | 16:58 | |
*** esker has quit IRC | 16:58 | |
openstackgerrit | Ben Nemec proposed openstack-infra/project-config: Re-enable all three jobs for TripleO https://review.openstack.org/352479 | 16:59 |
*** wfoster has quit IRC | 16:59 | |
openstackgerrit | Ben Nemec proposed openstack-infra/project-config: Move tripleo updates job back to check jobs https://review.openstack.org/352517 | 16:59 |
openstackgerrit | Merged openstack-infra/system-config: Change ipmi_username for all servers to HELIONADMIN https://review.openstack.org/352168 | 17:03 |
*** Sukhdev has quit IRC | 17:03 | |
*** ganso has joined #openstack-infra | 17:04 | |
openstackgerrit | Mike Fedosin proposed openstack-infra/project-config: Glare https://review.openstack.org/352519 | 17:05 |
*** asettle has quit IRC | 17:05 | |
*** javeriak has joined #openstack-infra | 17:06 | |
*** esker has joined #openstack-infra | 17:08 | |
*** zul_ has joined #openstack-infra | 17:09 | |
*** e0ne has joined #openstack-infra | 17:09 | |
*** zul has quit IRC | 17:09 | |
*** javeriak_ has joined #openstack-infra | 17:10 | |
*** javeriak has quit IRC | 17:11 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Fix issue with reprepro-import distribution https://review.openstack.org/352524 | 17:12 |
pabelanger | zigo: mordred: another fix for autobackports ^ | 17:13 |
*** esker has quit IRC | 17:13 | |
*** sdake_ has joined #openstack-infra | 17:13 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Fix issue with reprepro-import distribution https://review.openstack.org/352524 | 17:14 |
*** sdake has quit IRC | 17:15 | |
*** senk has joined #openstack-infra | 17:15 | |
senk | someone here who can tell me how i can make my full name appear here: http://stackalytics.com/?user_id=senk ? | 17:16 |
*** daemontool has joined #openstack-infra | 17:16 | |
pabelanger | senk: you can update your information in http://git.openstack.org/cgit/openstack/stackalytics | 17:17 |
pabelanger | etc/default_data.json | 17:17 |
*** ganesan has joined #openstack-infra | 17:17 | |
senk | ah okay :) i'll try that | 17:18 |
*** asettle has joined #openstack-infra | 17:19 | |
*** wfoster has joined #openstack-infra | 17:20 | |
*** yamamoto has joined #openstack-infra | 17:21 | |
*** BobBall is now known as BobBall_AWOL | 17:21 | |
*** nmagnezi has joined #openstack-infra | 17:22 | |
*** asettle has quit IRC | 17:24 | |
ganesan | I am building 3rd party CI system, I was able to proceed up to "Run masterless Puppet". But struck while starting zull service | 17:25 |
ganesan | zuul service is not starting | 17:25 |
*** yamamoto has quit IRC | 17:27 | |
*** thorst_a_ is now known as thorst | 17:27 | |
*** karthikp_ has quit IRC | 17:27 | |
*** sputnik13 has joined #openstack-infra | 17:28 | |
*** Sukhdev has joined #openstack-infra | 17:28 | |
*** mrmartin has quit IRC | 17:28 | |
*** edmondsw has joined #openstack-infra | 17:28 | |
fungi | ganesan: the zuul module for puppet doesn't automatically start the service since it can be dangerous to have it start when you're not ready to keep an eye on it | 17:29 |
fungi | ganesan: you'll want to `sudo service zuul start` (and probably also `sudo service zuul-merger start`) | 17:30 |
ganesan | I did that, only zuul-merger is running | 17:30 |
*** Sukhdev has quit IRC | 17:30 | |
ganesan | zuul service is still not running | 17:30 |
*** thorst_ has joined #openstack-infra | 17:30 | |
*** thorst has quit IRC | 17:32 | |
fungi | ganesan: make sure there's not a stale /var/run/zuul/zuul.pid | 17:32 |
ganesan | there is no pid file create | 17:32 |
fungi | ganesan: also, check /var/log/zuul/debug.log for any clues as to why it's not starting | 17:32 |
ganesan | only merger.log and merger-debug.log | 17:33 |
ganesan | is available | 17:33 |
*** asettle has joined #openstack-infra | 17:33 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Handle xenial/trusty and -nv jobs https://review.openstack.org/352536 | 17:34 |
fungi | ganesan: and you say you got through this step http://docs.openstack.org/infra/openstackci/third_party_ci.html#run-masterless-puppet without any errors? | 17:35 |
AJaeger | project-config cores, we missed one case with the xenial/trusty switch, could you review the change above to handle -nv jobs as well, please? ^ https://review.openstack.org/352536 | 17:35 |
AJaeger | bnemec: So, should we abandon Derek's ? | 17:35 |
*** pt_15 has joined #openstack-infra | 17:36 | |
ganesan | yes | 17:36 |
ganesan | fungi : yes | 17:36 |
bnemec | AJaeger: That would be my preference. It's also blocked because it comes after another patch that was conflicted. | 17:36 |
*** ihrachys has quit IRC | 17:37 | |
bnemec | Apparently we're all bad about looking at Derek's patches before pushing others. :-( | 17:37 |
*** asettle has quit IRC | 17:37 | |
AJaeger | ;) | 17:38 |
*** thorst_ has quit IRC | 17:38 | |
*** thorst has joined #openstack-infra | 17:39 | |
harlowja | question for any jenkins job builder folks | 17:40 |
AJaeger | pabelanger: Just gave a +2 on https://review.openstack.org/#/c/351120 - if you want to +2A later... | 17:40 |
harlowja | how is it commonly done to run `jenkins-jobs -l DEBUG --conf ./jenkins_jobs.ini -u $USER -p $JENKINS_TOKEN update` safely | 17:40 |
harlowja | (or equivalent) | 17:40 |
harlowja | basically the command to update a live jenkins | 17:40 |
harlowja | is there a sequence the folks here used to ensure that active jobs collasced (and were idle) | 17:41 |
fungi | ganesan: i'm not sure what to suggest next as i haven't tried running an all-in-one zuul+nodepool+jenkins server, but maybe asselin has some ideas | 17:41 |
*** Nakato has quit IRC | 17:41 | |
fungi | harlowja: the job configuration changes don't take effect for jobs which are already running afaik | 17:42 |
*** david-lyle_ has quit IRC | 17:42 | |
*** Nakato has joined #openstack-infra | 17:42 | |
fungi | harlowja: there are a lot of people just triggering this exec whenever job configuration is changed https://git.openstack.org/cgit/openstack-infra/puppet-jenkins/tree/manifests/job_builder.pp#n73 | 17:43 |
fungi | harlowja: back when we were using jenkins, we never did anything to quiesce the jobs before updating configs anyway | 17:44 |
*** bin_ has quit IRC | 17:44 | |
harlowja | fungi kk | 17:44 |
harlowja | fungi thx, good to know | 17:44 |
harlowja | i'll probably use something similar then | 17:45 |
AJaeger | bnemec, EmilienM, sshnaidm, pabelanger : Reviewed all tripleo changes, looks fine from my side now. Thanks for helping to sort it out. Now let's wait for jobs to pass... | 17:45 |
*** david-lyle has joined #openstack-infra | 17:45 | |
*** PollyZ has quit IRC | 17:46 | |
*** asettle has joined #openstack-infra | 17:47 | |
*** e0ne has quit IRC | 17:47 | |
*** acoles is now known as acoles_ | 17:47 | |
ganesan | fungi: thanks | 17:48 |
openstackgerrit | Khai Do proposed openstack-infra/system-config: Upgrade gerrit on review-dev.o.o https://review.openstack.org/352543 | 17:49 |
harlowja | fungi back on that aspect of pipeline plugin and such | 17:50 |
harlowja | https://github.com/jenkinsci/pipeline-plugin/blob/master/TUTORIAL.md (this thing) | 17:50 |
harlowja | has anyone produced a jjb (class?) for that | 17:50 |
fungi | i thought i saw someone talking about it in scrollback yesterday/earlier today | 17:50 |
*** PollyZ has joined #openstack-infra | 17:51 | |
fungi | harlowja: grep says bookwar asked about it in here today at 10:48:04 utc | 17:51 |
harlowja | lol | 17:51 |
harlowja | nice | 17:51 |
harlowja | u are my personal grep, thx :-P | 17:52 |
*** asettle has quit IRC | 17:52 | |
*** karthikp_ has joined #openstack-infra | 17:53 | |
*** javeriak_ has quit IRC | 17:53 | |
mordred | harlowja: I mean, infra isn't particularly interested in the pipeline plugin, and it's worth noting that going down that road likely will make it harder for you to use zuul v3 in the future ... but if it does the thing you want I agree with fungi, people seem interested in adding jjb support for it | 17:54 |
harlowja | ya, mordred i get that, though zuul v3 vs jenkins is a battle i don't really care to fight :-P | 17:54 |
openstackgerrit | Khai Do proposed openstack-infra/system-config: Upgrade gerrit on review.o.o https://review.openstack.org/352546 | 17:54 |
*** sdake has joined #openstack-infra | 17:55 | |
mordred | harlowja: sure. I tihnk of it more as "groovy vs. ansible" though, if that's a better positioning :) | 17:55 |
EmilienM | AJaeger: thanks a lot | 17:55 |
*** mriedem has quit IRC | 17:55 | |
*** tosky has quit IRC | 17:55 | |
harlowja | mordred fair, though the issue i think is more around people know jenkins, not many outside of openstack know zuul, thus jenkins is what companies have built (or are building) on | 17:56 |
mordred | totally | 17:56 |
harlowja | and changing what companies have built or are building on, especially at a fundamental level like this, is ummm, non trival :-P | 17:56 |
* mordred looks at systemd and disagrees | 17:56 | |
*** mriedem has joined #openstack-infra | 17:56 | |
*** sdake_ has quit IRC | 17:57 | |
harlowja | i mean, mordred obviously u will change the world, but the current state, ya... seems to lean (from what i've seen) to jenkins still | 17:57 |
mordred | apparently one company can decide to change out the most fundamental underpinning of 40+ years of IT and it can get rolled out to every distro within three years with no remediation or end-user choice in the matter ... so I have a hunch that people choosing to use zuul instead of jenkins isn't THAT hard | 17:57 |
harlowja | ya, mindshare is part of that | 17:58 |
*** mrmartin has joined #openstack-infra | 17:58 | |
harlowja | zuul needs to get more out of the 'openstack world' to do what u say imho | 17:58 |
*** pvaneck has joined #openstack-infra | 17:58 | |
mordred | working on it | 17:58 |
harlowja | :-P | 17:58 |
*** mriedem1 has joined #openstack-infra | 17:58 | |
mordred | but yeah - like I said, if jenkins pipelines make you happy in some way, awesome. they're not useful for us, but it turns out the world has differnet people with different needs | 17:58 |
mordred | and monocultures are not good for anyone | 17:58 |
harlowja | ha | 17:59 |
harlowja | sorta happy? | 17:59 |
harlowja | not like exteremly | 17:59 |
*** karthikp_ has quit IRC | 17:59 | |
mordred | more like happy in a stockholm syndrome kind of way? :) | 17:59 |
*** karthikp_ has joined #openstack-infra | 17:59 | |
harlowja | ya | 17:59 |
fungi | fwiw, most of the stuff developed under the openstack infra team umbrella is not meant to be openstack-community-specific | 18:00 |
mordred | well, hopefully one day we'll help you break free of your captors - but until then, hopefully the jjb folks can provide you with pleasure | 18:00 |
harlowja | fungi i totally get that :) | 18:00 |
harlowja | fungi it just needs more PR to make that known | 18:00 |
harlowja | PR or something | 18:00 |
*** mriedem has quit IRC | 18:01 | |
*** javeriak has joined #openstack-infra | 18:01 | |
fungi | yep, we're working on that too | 18:02 |
*** Sina_Maleki has joined #openstack-infra | 18:04 | |
*** julim has quit IRC | 18:04 | |
Sina_Maleki | Hi friends , i have 8 hp servers for testing openstack via canonical and maas , so which switch model if cisco do you offer ? Thanks | 18:05 |
harlowja | fungi go do some press releases or something :-P | 18:05 |
*** doug-fish has quit IRC | 18:05 | |
harlowja | or i guess that's mordred job, idk | 18:05 |
harlowja | ha | 18:05 |
fungi | Sina_Maleki: i think you're probably in the wrong channel. who are you looking for? | 18:05 |
*** julim has joined #openstack-infra | 18:05 | |
Sina_Maleki | This chanel is not about openstack ? Installation and deploying ? Hardware requirements? | 18:06 |
fungi | Sina_Maleki: this is the channel where we run the community infrastructure for the openstack project, yes | 18:06 |
fungi | Sina_Maleki: it's not a channel about installing and deploying openstack | 18:07 |
Sina_Maleki | Ok | 18:07 |
fungi | Sina_Maleki: but also as far as i know "canonical maas" is not official openstack software either, so you probably need to find canonical's support group | 18:07 |
*** dprince has joined #openstack-infra | 18:08 | |
*** Sina_Maleki has left #openstack-infra | 18:08 | |
*** hongbin has joined #openstack-infra | 18:09 | |
*** lucasagomes is now known as lucas-dinner | 18:10 | |
*** daemontool has quit IRC | 18:10 | |
*** weshay_mtg is now known as weshay | 18:11 | |
*** doug-fish has joined #openstack-infra | 18:13 | |
*** degorenko is now known as _degorenko|afk | 18:13 | |
AJaeger | What an interesting commit message "I have updated the review request with suggestions from Andreas, can someone review it again. " - https://review.openstack.org/#/c/352512/ | 18:15 |
*** adrian_otto has quit IRC | 18:16 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Add some documentation on functional testing tools https://review.openstack.org/351931 | 18:16 |
*** PollyZ has quit IRC | 18:16 | |
asselin | ganesan, make sure tox -e zuul works for your project-config. Typically bad zuul configuration cause zuul to not start | 18:17 |
asselin | ganesan, probably should doc that if it's not already...seems to be a common failure | 18:18 |
*** jasondotstar has joined #openstack-infra | 18:18 | |
asselin | ganesan, documented here, but maybe needs to be reinforced in the published docs: http://git.openstack.org/cgit/openstack-infra/project-config-example/tree/README.md#n69 | 18:19 |
ganesan | asselin, Thanks, checking now... | 18:20 |
*** doug-fish has quit IRC | 18:20 | |
fungi | asselin: that sounds like something we should try to fix. i expect there's some sort of race where it dies parsing configuration before setting up logging. maybe that would be useful to error to stdout before daemonizing or something | 18:21 |
asselin | ganesan, fungi fyi you can see the actual zuul error by running zuul with -d (start in foreground) | 18:21 |
openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Add integration tests between system-config and logstash-filters https://review.openstack.org/320729 | 18:21 |
asselin | fungi, ++ actually I thought there was a patch to fix that at some point.... | 18:21 |
ganesan | I see error with zuul -d | 18:23 |
ganesan | root@openstack-ci:~# /usr/local/bin/zuul-server -d Traceback (most recent call last): File "/usr/local/bin/zuul-server", line 10, in <module> sys.exit(main()) File "/usr/local/lib/python2.7/dist-packages/zuul/cmd/server.py", line 239, in main server.main() File "/usr/local/lib/python2.7/dist-packages/zuul/cmd/server.py", line 148, in main import zuul.trigger.timer File "/usr/local/lib/python2.7/dist-pack | 18:23 |
fungi | ganesan: your traceback got cut off. paste it to http://paste.openstack.org/ and give us the link | 18:23 |
asselin | fungi, fyi existing pid file for zuul should be fixed: https://review.openstack.org/#/c/194449/ | 18:24 |
fungi | asselin: excellent | 18:24 |
*** rbuzatu has quit IRC | 18:25 | |
openstackgerrit | Sam Yaple proposed openstack-infra/shade: Add update_endpoint() https://review.openstack.org/289052 | 18:25 |
ganesan | fungi, http://paste.openstack.org/show/552073/ | 18:25 |
*** rbuzatu has joined #openstack-infra | 18:25 | |
*** ajmiller has quit IRC | 18:25 | |
asselin | ganesan, no idea about that error...but please make sure `tox` passes in your project-config repo | 18:26 |
*** hurgleburgler1 has joined #openstack-infra | 18:26 | |
*** hurgleburgler has quit IRC | 18:26 | |
fungi | though it does look like maybe we have an incompatible version od apscheduler installed | 18:27 |
fungi | ganesan: do a `pip freeze` and paste the results to paste.openstack.org and give us the link | 18:27 |
*** ayoung has quit IRC | 18:27 | |
fungi | it looks like apscheduler made a non-backward-compatible change in its api for 3.x | 18:27 |
*** apetrich has joined #openstack-infra | 18:28 | |
fungi | yeah, we're requiring apscheduler>=3.0 for zuul | 18:29 |
*** ajmiller has joined #openstack-infra | 18:29 | |
fungi | nevermind, it depends on the version of zuul. latest zuul release needs older apscheduler>=2.1.1,<3.0 | 18:29 |
fungi | http://git.openstack.org/cgit/openstack-infra/zuul/tree/requirements.txt?h=2.1.0#n15 | 18:30 |
openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: fix release notes for final releases https://review.openstack.org/352550 | 18:30 |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: add diff-start to release tag metadata https://review.openstack.org/352551 | 18:30 |
*** rbuzatu has quit IRC | 18:30 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: fix release notes for final releases https://review.openstack.org/352550 | 18:30 |
ganesan | fungi, here is the result of 'pip freeze' http://paste.openstack.org/show/552074/ | 18:30 |
openstackgerrit | Sam Yaple proposed openstack-infra/shade: Add update_endpoint() https://review.openstack.org/289052 | 18:30 |
*** rbuzatu has joined #openstack-infra | 18:31 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: add diff-start to release tag metadata https://review.openstack.org/352551 | 18:31 |
fungi | asselin: ganesan: i suspect the issue is that the latest release of nodepool requires a version of apscheduler that is incompatible with the latest release of zuul http://git.openstack.org/cgit/openstack-infra/nodepool/tree/requirements.txt?h=0.3.0#n10 | 18:31 |
*** dahoo has joined #openstack-infra | 18:31 | |
asselin | interesting | 18:32 |
fungi | yeah, looks like that's got a version of apscheduler suitable for nodepool, but incompatible with zuul | 18:32 |
fungi | which hasn't been a problem for us because we run nodepool and zuul on separate servers | 18:33 |
jeblair | fungi: don't they both require >=3? | 18:33 |
fungi | but would be a problem for an all-in-one install | 18:33 |
openstackgerrit | Sam Yaple proposed openstack-infra/shade: Add update_endpoint() https://review.openstack.org/289052 | 18:33 |
dahoo | clarkb: ping | 18:33 |
fungi | jeblair: we need a new zuul 2.x release for the apscheduler update | 18:33 |
asselin | ganesan, which versions of zuul & nodepool are you using? master or tag? which tag? | 18:33 |
jeblair | fungi: ah | 18:33 |
*** dahoo is now known as jerryz | 18:33 | |
fungi | jeblair: latest tag is prior to that | 18:33 |
jeblair | fungi: i reckon we could issue one now | 18:33 |
fungi | latest nodepool release plus zuul from master would likely work okay | 18:34 |
asselin | ganesan, nevermind...see it in your pip freeze paste output | 18:34 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 18:34 |
*** greghaynes has quit IRC | 18:35 | |
jeblair | fungi: shall i tag 2.2.0 now? | 18:35 |
*** piet has quit IRC | 18:35 | |
pabelanger | fungi: yes, we've needed a new release for a while to fix that | 18:36 |
jeblair | i had been stalling because i did not want to release with a known memory leak, but that seems better now. | 18:37 |
fungi | jeblair: i guess you don't want to go all in on the zuul v2.5 theme and tag it 2.5.0? | 18:37 |
openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Make networking-generic-switch-dsvm-tempest voting https://review.openstack.org/352553 | 18:37 |
jeblair | fungi: oh, heh. i guess we could :) | 18:38 |
fungi | at this point "zuul v2.5" has been discussed in enough places people might get confused by a new 2.2.0 release | 18:38 |
jeblair | okay, i'll do 2.5.0 | 18:38 |
pabelanger | \o/ | 18:39 |
fungi | possibly fewer than would be confused wondering what happened to 2.2, 2.3 and 2.4 | 18:39 |
jeblair | done | 18:39 |
jeblair | asselin, ganesan: ^ zuul 2.5.0 should exist soon | 18:39 |
fungi | ganesan: if all goes well, in a few minutes your problem should be fixed by reapplying puppet | 18:39 |
asselin | ganesan, actually, you'll likely need to update the pin to 2.5.0 and re-run puppet | 18:40 |
ganesan | sure I will do that | 18:41 |
openstackgerrit | Emilien Macchi proposed openstack-infra/system-config: Added Gem Mirror to Infra https://review.openstack.org/253616 | 18:41 |
ganesan | fungi, let me know once it is ready | 18:41 |
openstackgerrit | Merged openstack-infra/project-config: Remove tripleo-centos-7-ovb from nodepool https://review.openstack.org/352087 | 18:42 |
*** senk has quit IRC | 18:44 | |
*** piet has joined #openstack-infra | 18:44 | |
asselin | ganesan, would you like to propose the pin to puppet-openstackci? http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/single_node_ci_data.yaml#n30 | 18:44 |
*** rbuzatu has quit IRC | 18:45 | |
fungi | asselin: oh, right, i forgot we had pinned the version there explicitly rather than just making it latest tag | 18:46 |
*** greghaynes has joined #openstack-infra | 18:47 | |
*** mriedem1 is now known as mriedem | 18:47 | |
ganesan | asselin, sorry I don't understand | 18:48 |
fungi | jeblair: asselin: ganesan: zuul 2.5.0 is up on pypi now https://pypi.org/project/zuul/ | 18:49 |
asselin | ganesan, the file I linked is the main puppet 'hiera' confiruration file you use to setup ci. | 18:49 |
*** tsufiev_ has joined #openstack-infra | 18:49 | |
*** tsufiev has quit IRC | 18:49 | |
*** doffm_ has joined #openstack-infra | 18:50 | |
*** Anticime1 has joined #openstack-infra | 18:50 | |
*** mtreinish_ has joined #openstack-infra | 18:50 | |
*** sc`_ has joined #openstack-infra | 18:50 | |
*** nibalize1 has joined #openstack-infra | 18:50 | |
*** rderose_ has joined #openstack-infra | 18:50 | |
*** gsilvis_ has joined #openstack-infra | 18:50 | |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: make neutron the default integrated gate set of jobs https://review.openstack.org/352557 | 18:50 |
ganesan | asselin, ohh yes | 18:50 |
*** ianw_ has joined #openstack-infra | 18:50 | |
*** dulek_ has joined #openstack-infra | 18:50 | |
*** sc68cal_ has joined #openstack-infra | 18:50 | |
*** mbacchi_ has joined #openstack-infra | 18:50 | |
*** roaet_ has joined #openstack-infra | 18:50 | |
*** tswanson_ has joined #openstack-infra | 18:50 | |
*** pcm_ has joined #openstack-infra | 18:50 | |
*** ivyyy_ has joined #openstack-infra | 18:50 | |
*** dulek has quit IRC | 18:50 | |
*** swat30 has quit IRC | 18:50 | |
*** igorbelikov has quit IRC | 18:50 | |
*** ggherdov- has quit IRC | 18:50 | |
*** zaro has quit IRC | 18:50 | |
*** rkukura has quit IRC | 18:50 | |
*** ianw has quit IRC | 18:50 | |
*** tobiash has quit IRC | 18:50 | |
*** mtreinish has quit IRC | 18:50 | |
*** sc68cal has quit IRC | 18:50 | |
*** ivyyy has quit IRC | 18:50 | |
*** waynr has quit IRC | 18:50 | |
*** pc_m has quit IRC | 18:50 | |
*** mbacchi has quit IRC | 18:50 | |
*** loquacities has quit IRC | 18:50 | |
*** Anticimex has quit IRC | 18:50 | |
*** taron has quit IRC | 18:50 | |
*** nikhil has quit IRC | 18:50 | |
*** doffm has quit IRC | 18:50 | |
*** rderose has quit IRC | 18:50 | |
*** roaet has quit IRC | 18:50 | |
*** dabukalam has quit IRC | 18:50 | |
*** sneti has quit IRC | 18:50 | |
*** nibalizer has quit IRC | 18:50 | |
*** sc` has quit IRC | 18:50 | |
*** gsilvis has quit IRC | 18:50 | |
*** Swanson has quit IRC | 18:50 | |
*** antonym has quit IRC | 18:50 | |
*** SlickNik has quit IRC | 18:50 | |
*** dulek_ is now known as dulek | 18:50 | |
*** sc`_ is now known as sc` | 18:50 | |
*** mtreinish_ is now known as mtreinish | 18:50 | |
ganesan | fungi, so I update the zuul and rerun the puppet | 18:50 |
*** SlickNik has joined #openstack-infra | 18:50 | |
*** ianw_ is now known as ianw | 18:50 | |
*** waynr has joined #openstack-infra | 18:50 | |
*** antonym has joined #openstack-infra | 18:50 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add DB API function to get list of runs from ids https://review.openstack.org/352558 | 18:50 |
*** rkukura has joined #openstack-infra | 18:50 | |
*** swat30 has joined #openstack-infra | 18:50 | |
*** igorbelikov has joined #openstack-infra | 18:50 | |
*** zaro has joined #openstack-infra | 18:50 | |
*** loquacity has joined #openstack-infra | 18:50 | |
*** ggherdov- has joined #openstack-infra | 18:51 | |
*** dabukalam has joined #openstack-infra | 18:51 | |
*** tobiash has joined #openstack-infra | 18:51 | |
asselin | ganesan, btw I posted this recently to the mailing list: instructions are the same: http://lists.openstack.org/pipermail/openstack-dev/2016-August/100989.html | 18:51 |
*** gsilvis_ is now known as gsilvis | 18:51 | |
*** Ravikiran_K has quit IRC | 18:51 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-openstackci: Update to latest Zuul on AIO configuration https://review.openstack.org/352560 | 18:52 |
fungi | ganesan: asselin was suggesting that ^ | 18:52 |
*** nikhil has joined #openstack-infra | 18:52 | |
sdague | fungi / jeblair - could we get this inserted into the gate queue early - https://review.openstack.org/#/c/352454/ - a bunch of projects are impacted by it | 18:52 |
*** taron has joined #openstack-infra | 18:52 | |
sdague | the gate queue is small enough, just being in the end is fine | 18:52 |
ganesan | asselin, fungi, I will follow that | 18:52 |
jeblair | sdague, fungi: i will do that | 18:52 |
fungi | thanks jeblair | 18:52 |
sdague | jeblair: thank you | 18:53 |
jeblair | sdague: enqueud | 18:53 |
jeblair | ueueueueu | 18:53 |
*** sneti has joined #openstack-infra | 18:53 | |
fungi | AJaeger: i'm going to start working through reviews of topic:constraints is:open now | 18:53 |
fungi | sorry it's taken me so long | 18:53 |
AJaeger | thanks, fungi. | 18:53 |
*** asettle has joined #openstack-infra | 18:54 | |
*** dprince has quit IRC | 18:54 | |
AJaeger | fungi, If you +2 348764, I'll remove the WIP... | 18:54 |
AJaeger | so, please don't skip it ;) | 18:55 |
fungi | AJaeger: got it. will look | 18:55 |
fungi | AJaeger: oh, right, that one. this will be fun | 18:56 |
*** sc68cal_ is now known as sc68cal | 18:56 | |
AJaeger | fungi, I tried to keep it simple ;) | 18:56 |
*** javeriak has quit IRC | 18:59 | |
fungi | AJaeger: i see one bug | 19:02 |
fungi | commented | 19:02 |
AJaeger | fungi, let me check and try fixing quickly ;) | 19:02 |
fungi | it should be easy to fix ;) | 19:02 |
*** Sukhdev has joined #openstack-infra | 19:03 | |
AJaeger | it is - and thanks for spotting | 19:03 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use constraints for translation sync https://review.openstack.org/348764 | 19:03 |
AJaeger | ^ | 19:03 |
AJaeger | fungi, ^ | 19:03 |
fungi | thatks, will +2 in just a sec | 19:04 |
fungi | no need to re-wip | 19:04 |
openstackgerrit | Merged openstack-infra/project-config: Enable constraints for releasenotes https://review.openstack.org/349181 | 19:04 |
AJaeger | thanks, that's what I hoped ;) | 19:04 |
*** roxanaghe has quit IRC | 19:04 | |
fungi | AJaeger: fwiw, i'm never sure on those and always end up looking at the xml diff | 19:05 |
fungi | it can be easy to forget | 19:06 |
AJaeger | fungi, indeed. For some of these I check as well - but sometimes forget - as in this case. | 19:06 |
*** HeOS has quit IRC | 19:07 | |
*** fifieldt has quit IRC | 19:07 | |
ganesan | fungi,asselin, jeblair, Its working, now zuul is running | 19:07 |
ganesan | thanks | 19:08 |
fungi | ganesan: excellent news--thanks for bringing that bug to our attention! | 19:08 |
*** oanson has joined #openstack-infra | 19:08 | |
asselin | ganesan, thanks...can you let me know what you did to fix it? Do you follow my e-mail suggestion or do something else? I'd like some feedback before sending another e-mail. | 19:09 |
*** ganesan has quit IRC | 19:09 | |
*** ganesan has joined #openstack-infra | 19:10 | |
*** ganesan has quit IRC | 19:11 | |
*** karthikp_ has quit IRC | 19:11 | |
*** ajmiller has quit IRC | 19:12 | |
*** ganesan has joined #openstack-infra | 19:12 | |
*** ajmiller has joined #openstack-infra | 19:14 | |
*** sarob has joined #openstack-infra | 19:14 | |
*** ganesan has quit IRC | 19:15 | |
*** ganesan has joined #openstack-infra | 19:16 | |
*** mrmartin has quit IRC | 19:16 | |
anteaya | gerrit's ref-replicated event is mirroriing a merged patch out to the git farm and github, yes? | 19:16 |
fungi | anteaya: and to the local gerrit mirror on review.o.o's filesystem too | 19:17 |
anteaya | thank you | 19:17 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Use geard with keepalives https://review.openstack.org/352566 | 19:17 |
*** mdrabe has quit IRC | 19:18 | |
*** ganso has left #openstack-infra | 19:18 | |
*** mdrabe_ has joined #openstack-infra | 19:18 | |
*** fifieldt has joined #openstack-infra | 19:18 | |
AJaeger | armax, dougwig : IF you have time, could you review https://review.openstack.org/346274 https://review.openstack.org/#/c/351464/ https://review.openstack.org/#/c/346978/ - they all have two +2s and wait for Neutron Infra Liason review | 19:18 |
fungi | i'm not sure if you get one ref-replacated event per mirror or just one when the ref has finally been replicated to all mirrors | 19:18 |
fungi | anteaya: ^ | 19:18 |
armax | AJaeger: ack | 19:18 |
fungi | but if you don't see mirror specific metadata in the event, then it's presumably the latter | 19:18 |
AJaeger | fungi, thanks for reviews! | 19:18 |
fungi | AJaeger: thanks even more for your patches | 19:19 |
openstackgerrit | Mike Fedosin proposed openstack-infra/project-config: Glare https://review.openstack.org/352519 | 19:19 |
AJaeger | jeblair, mordred, krotscheck, fungi: Could you review the bindep change which I did based on Friday's discussion, please? https://review.openstack.org/#/c/350184/ | 19:19 |
fungi | AJaeger: on the release-specific macro, we're still planning to eventually try to collapse those into the normal upper-constraints builders, right? | 19:19 |
AJaeger | thanks, armax | 19:20 |
fungi | not urgent, just trying to remember what we had discussed | 19:20 |
*** PollyZ has joined #openstack-infra | 19:20 | |
anteaya | fungi: per mirror is what I see | 19:20 |
anteaya | and I see that "/opt/lib/git/openstack-infra/project-config.git" is the internal gerrit mirror on review.o.o, yes? | 19:20 |
fungi | anteaya: wow, how verbose | 19:20 |
anteaya | very | 19:20 |
*** ajmiller has quit IRC | 19:21 | |
anteaya | shall I paste what I see from firehose? | 19:21 |
fungi | anteaya: yes, that's the "local" one | 19:21 |
fungi | anteaya: no need. i can get plenty of them if i just connect | 19:21 |
AJaeger | fungi, so merging zuul-git-prep-upper-constraints and zuul-release-git-prep-upper-constraints? Which means replacing zuul-git-prep-upper-constraints by zuul-release-git-prep-upper-constraints? let me do that next so that we don't forget it... | 19:21 |
anteaya | http://paste.openstack.org/show/552076/ | 19:21 |
anteaya | ah sorry | 19:21 |
anteaya | yes, very verbose | 19:22 |
pabelanger | anteaya: Oh, nice! | 19:22 |
pabelanger | I haven't tested firehose yet | 19:22 |
*** baoli has quit IRC | 19:22 | |
fungi | AJaeger: right. i expect we'd want to keep a very close eye on it once it merges because it could risk blowing up most tox-based jobs if we're overlooking something | 19:22 |
*** baoli has joined #openstack-infra | 19:23 | |
anteaya | pabelanger: deb has a mosquitto clients package | 19:23 |
*** ajmiller has joined #openstack-infra | 19:23 | |
AJaeger | I'll put out a WIP change now - let's first settle the rest a bit. Thanks for reminder | 19:23 |
EmilienM | hey there, could I have a last review on https://review.openstack.org/#/c/351914/ please? | 19:23 |
fungi | anteaya: pabelanger: yeah, that's what i used. apt-get install it and away i go | 19:23 |
openstackgerrit | Merged openstack-infra/project-config: Remove unneeded --branch from zuul-cloner https://review.openstack.org/351349 | 19:23 |
pabelanger | anteaya: fungi: very nice | 19:24 |
anteaya | pabelanger: this patch merged: http://docs-draft.openstack.org/00/351900/2/check/gate-system-config-docs-ubuntu-xenial/36face1//doc/build/html/firehose.html#client-usage but isn't published on docs yet | 19:24 |
anteaya | not sure why not | 19:24 |
anteaya | merged this morning | 19:24 |
fungi | anteaya: big backlog in the post pipeline? | 19:24 |
fungi | anteaya: looks like we're going on 11 hours of backlog there | 19:24 |
pabelanger | ya, we're basically starved of nodes in post | 19:24 |
anteaya | was just going to look | 19:25 |
anteaya | ah that would be the reason | 19:25 |
anteaya | nice long back log | 19:25 |
anteaya | the release team will be pleased | 19:25 |
*** oanson has quit IRC | 19:25 | |
anteaya | 160 in post | 19:25 |
pabelanger | hotel question about QAInfraNewtonSprint, are we trying to group up at the same place or are people making a choice on personal preference? | 19:26 |
anteaya | cloudnull: I've lost track are you waiting on anything from us before our osic quota is increased? | 19:27 |
rcarrillocruz | pabelanger: i guess it also depends on budget on what the employer travel tool allows | 19:28 |
rcarrillocruz | i've picked... | 19:28 |
*** amitgandhinz has quit IRC | 19:28 | |
rcarrillocruz | sec | 19:28 |
fungi | anteaya: actually, that docs job _just_ finished 5 minutes ago | 19:28 |
anteaya | fungi: woooo | 19:28 |
rcarrillocruz | outlook365 is a bit slow | 19:28 |
fungi | anteaya: i see the new content on docs.o.o now | 19:28 |
*** mbacchi_ is now known as mbacchi | 19:28 | |
anteaya | wonderful thank you | 19:28 |
*** yaume has quit IRC | 19:28 | |
anteaya | for me too | 19:28 |
*** amitgandhinz has joined #openstack-infra | 19:28 | |
rcarrillocruz | pabelanger: leonardo walendorf hotel | 19:29 |
rcarrillocruz | if that helps at all | 19:29 |
anteaya | http://docs.openstack.org/infra/system-config/firehose.html#client-usage is a much nicer url | 19:29 |
pabelanger | rcarrillocruz: Thanks, that is what I am looking at now too | 19:29 |
rcarrillocruz | yolanda and dmellado will be there too | 19:29 |
*** mdrabe_ is now known as mdrabe | 19:29 | |
*** krtaylor has quit IRC | 19:29 | |
pabelanger | rcarrillocruz: flight into FRA Frankfurt right? | 19:30 |
rcarrillocruz | yeah | 19:30 |
rcarrillocruz | pabelanger: not really in today, but was able to set all iLO IPs on all nodes last night | 19:30 |
rcarrillocruz | and also confirmed we can ssh in to the baremetal host | 19:31 |
rcarrillocruz | fyi | 19:31 |
pabelanger | rcarrillocruz: ya, seen that. | 19:31 |
pabelanger | cool, should see if puppetmaster is working again for it | 19:31 |
pabelanger | I can check that shortly | 19:31 |
rcarrillocruz | pabelanger: the IP range changed tho | 19:31 |
anteaya | crinkle: so from the link you posted earlier: puppet-lint-undef_in_function-check: When passing the ‘undef’ value to a Puppet function, Puppet munges it into an empty string. This plugin checks for ‘undef’ as a function parameter. | 19:31 |
rcarrillocruz | if you have the panel for dns handy or you're familiar with the command to update it | 19:32 |
rcarrillocruz | the new IP is: | 19:32 |
rcarrillocruz | 15.184.64.4 | 19:32 |
pabelanger | rcarrillocruz: ah, right. I can do that | 19:32 |
rcarrillocruz | fungi: they had to change the IP range slightly | 19:32 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Explain the difference between 'DIB_OFFLINE' and 'DIB_DEBIAN_USE_DEBOOTSTRAP_CACHE' https://review.openstack.org/345935 | 19:32 |
anteaya | crinkle: should I interpret that as we can't give an empty string anymore as a value to a key, we have to use undef because puppet will then turn it into an empty string? | 19:32 |
rcarrillocruz | the new public ip range is 15.184.64.0 | 19:32 |
rcarrillocruz | will update the infracloud docs to show that | 19:32 |
fungi | rcarrillocruz: yeah, i had a feeling that was going to happen. regardless of their earlier assurances that they wouldn't need to do new address assignments | 19:33 |
rcarrillocruz | :D | 19:33 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Merge zuul-git-prep-upper-constraints/zuul-release-git-prep-upper-constraints https://review.openstack.org/352575 | 19:33 |
rcarrillocruz | 'all is fine, everything will just work' | 19:33 |
crinkle | anteaya: functions are different from classes, i don't think we're really concerned with that behavior | 19:33 |
*** kushal has quit IRC | 19:33 | |
*** baoli has quit IRC | 19:33 | |
anteaya | crinkle: thank you | 19:33 |
fungi | rcarrillocruz: it's like we're just moving a network cable to... oh wait, these switches are in an entirely different part of our network | 19:34 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Explain the difference between 'DIB_OFFLINE' and 'DIB_DEBIAN_USE_DEBOOTSTRAP_CACHE' https://review.openstack.org/345935 | 19:34 |
AJaeger | fungi, could you quickly check 352575, please? I'll mark it as WIP for now since we have changes in flight that need renames and I'd like to wait a few days - but like to know that this is the right thing | 19:34 |
rcarrillocruz | :D | 19:34 |
fungi | AJaeger: sure, will do as soon as i'm through the bindep.txt change | 19:34 |
*** kushal has joined #openstack-infra | 19:35 | |
AJaeger | ;) | 19:35 |
*** oanson has joined #openstack-infra | 19:37 | |
*** ajmiller has quit IRC | 19:37 | |
openstackgerrit | Merged openstack-infra/project-config: networking-odl: add coverage, translation and releasenotes https://review.openstack.org/346274 | 19:37 |
notmorgan | jeblair, mordred, Shrews: any idea what I'm doing wrong here? https://review.openstack.org/#/c/351949/ i cant figure out why the hell this is failing. All attempts to put real debugging in/capture output has resulted in somehow a NoneType ended up in a queue? and/or needing to kill -9 python | 19:38 |
*** baoli has joined #openstack-infra | 19:38 | |
openstackgerrit | Merged openstack-infra/project-config: Make py35 voting for networking-midonet https://review.openstack.org/351464 | 19:39 |
openstackgerrit | Merged openstack-infra/project-config: Make gate-networking-ovn-dsvm-functional voting https://review.openstack.org/346978 | 19:39 |
*** amitgandhinz has quit IRC | 19:39 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for nova unshelve race bug 1611008 https://review.openstack.org/352495 | 19:39 |
openstack | bug 1611008 in OpenStack Compute (nova) "ServersNegativeTestJSON.test_suspend_server_invalid_state fails with "NovaException: Unable to find host for Instance"" [High,In progress] https://launchpad.net/bugs/1611008 - Assigned to Matt Riedemann (mriedem) | 19:39 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: upgrades job is renamed to updates https://review.openstack.org/351937 | 19:39 |
*** amitgandhinz has joined #openstack-infra | 19:40 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995 | 19:40 |
docaedo | fungi: regarding app-catalog-bugs-team, sorry if I messed it up, following http://docs.openstack.org/infra/manual/creators.html#create-bug-tracker I thought I was setting the owner right | 19:40 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 19:40 |
anteaya | AJaeger: check out this paste: http://paste.openstack.org/show/552078/ I think there are 3 separate events in there | 19:40 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton https://review.openstack.org/351330 | 19:41 |
fungi | docaedo: you didn't mess anything up. i've recently discovered that lp auto-adds the owner on new team creation. i may patch the documentation to ask people to remove it as a group member after creation | 19:41 |
*** mrmartin has joined #openstack-infra | 19:41 | |
AJaeger | anteaya: I'm missing context, did you really want me to look at it? | 19:41 |
docaedo | fungi: oh ok, cool - thanks! | 19:42 |
*** kzaitsev_mb has joined #openstack-infra | 19:42 | |
anteaya | AJaeger: that is from the firehose event stream | 19:42 |
*** edmondsw has quit IRC | 19:42 | |
AJaeger | anteaya: ah - sorry, can't dig into that now | 19:43 |
anteaya | and perhaps I am wrong, perhaps one event merge triggered mirroring out to /refs/heads/master, /refs/notes/review both on project-config and as well openstack/openstack | 19:43 |
AJaeger | fungi, shall I quickly fix the nit on bindep? | 19:43 |
anteaya | AJaeger: oh you showed interest in the last paste so thought you wanted to know about firehose, sorry to bother you | 19:43 |
fungi | AJaeger: sure. i'm happy to +2 again | 19:43 |
anteaya | AJaeger: nothing needed | 19:43 |
fungi | anteaya: yes, gerrit is replicating git notes about the merged commit as well as the merged commit itself | 19:44 |
* notmorgan realizes openstack SV is happening so people might be less-available or some such. | 19:44 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/bindep: Add bindep.txt as default filename https://review.openstack.org/350184 | 19:44 |
anteaya | fungi: ah the git notes, thank you | 19:44 |
AJaeger | fungi, done ^ | 19:44 |
*** jistr has quit IRC | 19:44 | |
pabelanger | rcarrillocruz: looks like we might have a DNS issue on 15.184.64.4 ? | 19:44 |
anteaya | notmorgan: what is openstack sv? | 19:44 |
pabelanger | rcarrillocruz: nslookup fails to result google | 19:44 |
pabelanger | resolve* | 19:44 |
*** ajmiller has joined #openstack-infra | 19:45 | |
AJaeger | SV = Silican Valley? | 19:45 |
notmorgan | AJaeger: yes | 19:45 |
anteaya | oh okay | 19:45 |
notmorgan | anteaya: :) | 19:45 |
zigo | pabelanger: mordred: For some reason, the POST job to publish backports didn't work. Is this related to your patch? | 19:45 |
pabelanger | rcarrillocruz: using 8.8.8.8 does | 19:45 |
mordred | notmorgan: looking | 19:45 |
pabelanger | zigo: yes | 19:45 |
*** rbuzatu has joined #openstack-infra | 19:45 | |
pabelanger | zigo: there are 2 patches we need to land | 19:45 |
zigo | pabelanger: Ok. From my side everything works. | 19:46 |
pabelanger | 352489 and 352524 | 19:46 |
rcarrillocruz | pabelanger: you just set the record on rackdns? | 19:46 |
pabelanger | rcarrillocruz: not yet, doing that now | 19:46 |
zigo | pabelanger: http://tarballs.openstack.org/packaging-deb/deb-auto-backports/uploads/509f32bcf75af2291a4c1bb1638bf6b810189099/ | 19:46 |
zigo | :) | 19:46 |
rcarrillocruz | pabelanger: also, i think we want to have baremetal00.ic.openstack.org | 19:46 |
rcarrillocruz | no chocolate, no vanilla | 19:46 |
zigo | pabelanger: It built 4 packages, as I expected. | 19:46 |
rcarrillocruz | since the baremetal host will be the same for both 'clouds' | 19:47 |
pabelanger | that make sense | 19:47 |
pabelanger | zigo: great | 19:47 |
*** karthikp_ has joined #openstack-infra | 19:47 | |
rcarrillocruz | we can then add cnames for vanilla/chocolate | 19:47 |
*** igorbelikov has quit IRC | 19:47 | |
*** igorbelikov has joined #openstack-infra | 19:47 | |
zigo | pabelanger: One thing which would be nice would be to have just the hostname of the repositories, so that I could just use it to compose sources.list within the sbuild chroot. | 19:47 |
*** zaro has quit IRC | 19:47 | |
*** zaro has joined #openstack-infra | 19:47 | |
pabelanger | mordred: AJaeger: do you mind helping on 352489 and 352524 | 19:47 |
*** ggherdov- has quit IRC | 19:47 | |
*** ggherdov- has joined #openstack-infra | 19:47 | |
*** nikhil has quit IRC | 19:47 | |
*** nikhil has joined #openstack-infra | 19:47 | |
*** ganesan has quit IRC | 19:47 | |
*** ganesan has joined #openstack-infra | 19:47 | |
*** tsufiev_ is now known as tsufiev | 19:47 | |
fungi | rcarrillocruz: assuming it's one bastion to rule them all, that's fine by me... but if we end up with more regions later they'll have their own bastions due to not being privately networked to each other, right? what naming convention will those end up with? | 19:48 |
AJaeger | pabelanger, rcarrillocruz, fungi, anteaya : Could I get two +2s on this change https://review.openstack.org/352536 - it fixes the logic for when to run xenial/trusty to handle -nv jobs as well. clarkb missed that initially. | 19:48 |
AJaeger | pabelanger: on it... | 19:48 |
*** jistr has joined #openstack-infra | 19:48 | |
*** ajmiller has quit IRC | 19:48 | |
*** ajmiller has joined #openstack-infra | 19:48 | |
*** karthikp_ has quit IRC | 19:48 | |
*** karthikp_ has joined #openstack-infra | 19:48 | |
AJaeger | pabelanger: see my trade in above ;) | 19:48 |
fungi | rcarrillocruz: say red hat donates a region in one of their datacenters, for example | 19:48 |
amrith | hi infra folks, I have a question re: the CI infrastructure and how requirements (especially upper-constraints.txt) are handled. I've posed my question in this short etherpad https://etherpad.openstack.org/p/Bx0H7Dp4Gi, would someone please provide me some pointers to where I could find more about how this part of the CI works. Thanks | 19:48 |
zigo | pabelanger: I need it in command lines, like for calling sbuild-createchroot. | 19:48 |
pabelanger | AJaeger: +3 | 19:49 |
rcarrillocruz | fungi: then we would add a bastion per region | 19:49 |
zigo | pabelanger: Currently, I'm using httpredir.debian.org for sbuild, which is really sub-optimal. | 19:49 |
rcarrillocruz | fungi: so you mean, ic.openstack.org could have clouds from various 'infraclouds' ? | 19:50 |
*** rbuzatu has quit IRC | 19:50 | |
anteaya | AJaeger: give me a minute to try them out | 19:50 |
fungi | rcarrillocruz: that was my impression at least. and then we divvy them up under flavored subdomains of one or more per cloud | 19:51 |
*** yamahata has quit IRC | 19:51 | |
rcarrillocruz | hmm | 19:51 |
pabelanger | rcarrillocruz: I've kept baremetal00.vanilla.ic.openstack.org for now | 19:51 |
fungi | rcarrillocruz: when the hp east and west gear all got moved into one location that made this first deployment able to have one bastion, but additional deployments in other locations would presumably need separate bastions | 19:51 |
rcarrillocruz | k, i guess we leave for now the baremetal to rule them all, add sub-domains bastions should we get more clouds (hope so!) | 19:51 |
pabelanger | zigo: right, we can make optimizations as we go | 19:52 |
*** nmagnezi has quit IRC | 19:52 | |
rcarrillocruz | fungi: ++ | 19:52 |
fungi | rcarrillocruz: yeah, i definitely don't want to make anything on the first deployment harder just because we might have more deployments than this one down the road, but if there are places we can plan for that possibility without much additional effort... | 19:52 |
*** HeOS has joined #openstack-infra | 19:52 | |
*** jistr has quit IRC | 19:53 | |
rcarrillocruz | fungi: btw, i've spotted at least 15 servers that were not present on hiera | 19:53 |
rcarrillocruz | so moar compute | 19:53 |
*** klindgren_ has joined #openstack-infra | 19:53 | |
rcarrillocruz | i've also opened tickets for the issues i've encountered during the inventory check | 19:53 |
rcarrillocruz | servers not showing stuff on textcons | 19:53 |
rcarrillocruz | unreachables | 19:53 |
rcarrillocruz | but overall they seem to be o-k | 19:53 |
jeblair | notmorgan: i'm just getting back from lunch and was about to poke at your wip patch | 19:53 |
AJaeger | thanks, rcarrillocruz , pabelanger and anteaya | 19:54 |
fungi | rcarrillocruz: ooh! hopefully those are actually ours and not someone else's systems comingled on the same lan ;) | 19:54 |
AJaeger | pabelanger: one +2 and one suggestion to improve comments... | 19:54 |
anteaya | AJaeger: I didn't do much, I didn't get finished testing | 19:54 |
* anteaya moves on to something else | 19:54 | |
rcarrillocruz | fungi: hah, that's the very first question i made to the DC folks :-) | 19:54 |
AJaeger | amrith: for which job did the upper-constraint not work as expected? | 19:55 |
*** karthikp_ has quit IRC | 19:55 | |
*** itisha has joined #openstack-infra | 19:56 | |
amrith | AJaeger, in the trove job, which was depending on the requirements job, I don't see UPPER_CONSTRAINTS_FILE being set | 19:56 |
AJaeger | amrith: which job exactly? | 19:56 |
*** PollyZ has quit IRC | 19:56 | |
*** jistr has joined #openstack-infra | 19:56 | |
amrith | sorry, gate-trove-functional-dsvm-mysql for example | 19:56 |
amrith | or gate-trove-scenario-functional-dsvm-<datastore name> | 19:57 |
amrith | datastore name could be mysql or redis | 19:57 |
AJaeger | amrith: I'm asking since I'm currently enabling UPPER-constraints on the jobs - and not all of it yet. | 19:57 |
amrith | I'm interested in knowing where in infra that gets setup | 19:57 |
amrith | ah! | 19:57 |
AJaeger | amrith: https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:constraints ;) | 19:57 |
*** adrian_otto has joined #openstack-infra | 19:57 | |
amrith | looking | 19:58 |
openstackgerrit | Merged openstack-infra/project-config: Handle xenial/trusty and -nv jobs https://review.openstack.org/352536 | 19:58 |
AJaeger | amrith: I'm currently focussing on the tox based jobs - so can't help with the others. | 19:58 |
AJaeger | Hope that somebody else can help. | 19:58 |
* AJaeger waves good-night | 19:58 | |
*** rbuzatu has joined #openstack-infra | 19:58 | |
anteaya | AJaeger: good night | 19:59 |
amrith | AJaeger, g'night, thanks for the pointer | 19:59 |
*** karthikp_ has joined #openstack-infra | 20:00 | |
*** jcoufal has quit IRC | 20:03 | |
*** Apoorva has quit IRC | 20:03 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Fix issue with reprepro-import distribution https://review.openstack.org/352524 | 20:05 |
*** roxanaghe has joined #openstack-infra | 20:06 | |
fungi | amrith: i _think_ the devstack-based jobs already use constraints if they're using devstack's pip_install function | 20:06 |
amrith | fungi, how would I begin to track that down? | 20:08 |
*** Apoorva has joined #openstack-infra | 20:08 | |
openstackgerrit | Merged openstack-infra/project-config: Implement TripleO centos-7-nonha-multinode-updates https://review.openstack.org/351914 | 20:08 |
fungi | amrith: i'm trying to see if i can spot the problem | 20:08 |
amrith | let me begin at a more basic place, is there a beginners guide to our CI | 20:08 |
amrith | I really need to learn more about it rather than the occasional hack at projects.yaml | 20:08 |
amrith | or jjb | 20:08 |
fungi | amrith: there are some audience-specific guides, i'm trying to figure out which one to recommend | 20:09 |
amrith | thx fungi | 20:10 |
fungi | the surface area is so large that we tend to slice it by areas of interest | 20:10 |
*** rockyg has joined #openstack-infra | 20:10 | |
*** ajmiller_ has joined #openstack-infra | 20:10 | |
fungi | so for example, we have project-specific documentation (zuul has documentation, nodepool has documentation, jenkins-job-builder has documentation, and so on) | 20:11 |
*** dprince has joined #openstack-infra | 20:11 | |
fungi | and then we have holistic documentation of the entire system targeted at people trying to deploy it to operate a third-party ci system | 20:11 |
fungi | and we have operational documentation of the systems we're using to run our deployments of all of that software, targeted at people interested in helping run it | 20:12 |
*** apetrich has quit IRC | 20:12 | |
*** yamahata has joined #openstack-infra | 20:12 | |
fungi | amrith: perhaps a good middle-ground is our operational documentation page on jjb http://docs.openstack.org/infra/system-config/jjb.html | 20:13 |
*** kzaitsev_mb has quit IRC | 20:13 | |
amrith | thanks, let me start there | 20:13 |
*** nibalize1 is now known as nibalizer | 20:13 | |
*** ajmiller has quit IRC | 20:15 | |
fungi | we also have documentation in the infra-manual focused on several different audiences: one for developers interacting with our services (developers), one for people doing code review with approval rights (core reviewers), one for people managing projects administratively (project drivers), and one for people creating new git repos/projects (project creators) http://docs.openstack.org/infra/manual/ | 20:16 |
*** tonytan_brb has quit IRC | 20:16 | |
*** oanson has quit IRC | 20:18 | |
*** rbuzatu has quit IRC | 20:19 | |
*** rocky_g has joined #openstack-infra | 20:19 | |
Shrews | notmorgan: i can look in the morning if you still need me to. context switching to that now would kill my momentum | 20:19 |
Shrews | and hurt my feeble brain | 20:19 |
* mordred hands Shrews a box of spare brains he found over the weekend | 20:20 | |
*** rockyg has quit IRC | 20:20 | |
Shrews | mordred: well, if you aren't using them.... | 20:20 |
mordred | Shrews: I'm not sure I've used a brain in years | 20:20 |
*** apetrich has joined #openstack-infra | 20:20 | |
*** mhickey has joined #openstack-infra | 20:21 | |
dhellmann | fungi : are the scripts from jenkins/scripts/release_tools installed on all of the CI nodes? https://review.openstack.org/#/c/352551/ and https://review.openstack.org/#/c/352550/ have me thinking that we may want to move more release tools into the project-config repo so we can make these changes atomically | 20:24 |
*** rockyg has joined #openstack-infra | 20:24 | |
dhellmann | although those scripts have a pyyaml dependency, so I don't know | 20:24 |
dhellmann | I think that's why we held off before | 20:24 |
*** rocky_g has quit IRC | 20:25 | |
*** spzala has quit IRC | 20:25 | |
fungi | dhellmann: we can install pyyaml from distro packages on our persistent job nodes if needed | 20:25 |
*** rbuzatu has joined #openstack-infra | 20:25 | |
dhellmann | ok, there may be other things, I'd have to look at the list again to see if we have anything weird | 20:26 |
dhellmann | that repo is more organic than most :-) | 20:26 |
mordred | fungi: wow, we have nodes on which pyyaml isn't installed? | 20:26 |
sdague | dims: https://review.openstack.org/#/c/352454/ (the requirements update that unblocks neutron / ironic / and others) failed on random ssh race | 20:26 |
fungi | dhellmann: and yes, those scripts are installed onto all job nodes (preinstalled in single-use node images by nodepool, immediately pushed onto persistent nodes by ansible/puppet) | 20:26 |
*** spzala has joined #openstack-infra | 20:27 | |
fungi | sdague: need to get it reenqueued/promoted? | 20:27 |
sdague | fungi: yeh, it hasn't completely failed out yet | 20:27 |
dhellmann | ok. I think it may have been the delay that kept us from moving them before. Might be time to reconsider. | 20:27 |
sdague | but it will | 20:27 |
dims | sdague : looks like gate-grenade-dsvm-ubuntu-trusty | 20:27 |
fungi | sdague: oh, i can promote it then and it will be retested | 20:27 |
sdague | fungi: yeh, probably good | 20:27 |
fungi | if you'd rather | 20:27 |
sdague | yeh | 20:28 |
dhellmann | fungi : how're things looking with launchpadlib on the signing node? | 20:28 |
fungi | dhellmann: haven't had more time to write up the solution for that yet | 20:28 |
dhellmann | k | 20:28 |
*** tqtran has joined #openstack-infra | 20:29 | |
mordred | sdague: btw - I pushed up a devstack change to try to track down the failure better - I have a patch to neutronclient that I believe will fix things, but I haven't been able to reproduce the problem locally just running similar commands with the same tools against existing clouds | 20:29 |
mordred | sdague: I'd rather verify that the reason I think it's failing is actually the reason it;s failing | 20:29 |
sdague | mordred: well, it reproduced consistently on grenade | 20:29 |
sdague | that might be the thing to try to chase | 20:30 |
sdague | there was no straight devstack reproduce, right? | 20:30 |
mordred | sdague: yah. I'm just not set up on my laptop to run grenade - thus the patch to the devstack plugin where the error shows up | 20:30 |
fungi | sdague: it's promoted now | 20:30 |
mordred | sdague: and yah - it's only on grenade | 20:30 |
sdague | fungi: thanks | 20:30 |
mordred | I mostly want to see what the env vars are at the time that the fail happens | 20:30 |
sdague | mordred: gotcha | 20:30 |
mordred | that's the only piece I'm missing for local reproduction I THINK | 20:31 |
*** nwkarsten has joined #openstack-infra | 20:31 | |
*** edtubill has joined #openstack-infra | 20:31 | |
*** tongli has joined #openstack-infra | 20:32 | |
*** dprince has quit IRC | 20:33 | |
*** sdake has quit IRC | 20:33 | |
*** inc0 has joined #openstack-infra | 20:33 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Prepare to replace jenkins user with zuul user https://review.openstack.org/337821 | 20:33 |
*** igorn has quit IRC | 20:34 | |
pabelanger | clarkb: ^ I _think_ that addresses your comments | 20:34 |
*** dprince has joined #openstack-infra | 20:35 | |
*** Jeffrey4l has quit IRC | 20:35 | |
jeblair | notmorgan: ping me when you are around; i think i'm making headway on that bug | 20:35 |
*** Jeffrey4l has joined #openstack-infra | 20:35 | |
*** mrmartin has quit IRC | 20:36 | |
pabelanger | 2016-08-08 20:26:30,286 p=17226 u=root | baremetal00.vanilla.ic.openstack.org : ok=13 changed=7 unreachable=0 failed=0 | 20:37 |
pabelanger | rcarrillocruz: fungi: ^ | 20:37 |
*** vhosakot has joined #openstack-infra | 20:37 | |
pabelanger | ansible runs on infracloud again! | 20:37 |
rcarrillocruz | \o/ | 20:37 |
*** inc0 has quit IRC | 20:38 | |
*** rossella_s has quit IRC | 20:38 | |
*** rossella_s has joined #openstack-infra | 20:38 | |
zigo | mordred: Could you please review these? https://review.openstack.org/#/c/352489/ and https://review.openstack.org/#/c/352524/ | 20:38 |
mordred | zigo: yup | 20:39 |
mordred | rcarrillocruz: \o/ | 20:39 |
pabelanger | rcarrillocruz: looks like dns is fixed too, now that unbound is configured | 20:39 |
*** moravec1 has joined #openstack-infra | 20:40 | |
mordred | pabelanger, zigo: lgtm | 20:41 |
zigo | :) | 20:42 |
fungi | amrith: looking at http://logs.openstack.org/04/349204/1/check/gate-trove-functional-dsvm-mysql/c9472ff/logs/pip2-freeze.txt.gz it seems like the oslo.context version referenced in the upper-constraints change you depended-on was installed in the system environment by devstack. i'm reading through how your integration tests work to see if i can figure out why they're not using it | 20:42 |
*** krtaylor has joined #openstack-infra | 20:42 | |
sc` | does docs.openstack.org not do https? | 20:42 |
sc` | my browser seems to think so | 20:43 |
*** moravec has quit IRC | 20:43 | |
fungi | sc`: it does not. it's hosted on rackspace cloudsites, not a server we maintain | 20:43 |
sc` | fungi: okay. makes sense. my browser is just being too draconian | 20:44 |
fungi | we also have to push files to it via ftp. a quaint blast from the past | 20:44 |
*** moravec1 has quit IRC | 20:44 | |
*** krtaylor has quit IRC | 20:46 | |
*** gyee has quit IRC | 20:46 | |
openstackgerrit | Merged openstack-infra/project-config: Update reprepro-import build to support multiple files https://review.openstack.org/352489 | 20:47 |
*** gyee has joined #openstack-infra | 20:47 | |
jeblair | fungi: we can do older than ftp! | 20:47 |
*** hichihara has joined #openstack-infra | 20:47 | |
*** sarob has quit IRC | 20:48 | |
fungi | jeblair: touché | 20:48 |
sc` | not sneakernetting files to the castle? | 20:48 |
sc` | such futuristic :) | 20:48 |
jeblair | sc`: wow, 'sneakernet to the castle' does sound like some sort of weird scifi/fantasy thing. | 20:49 |
sc` | it kind of does, doesn't it? | 20:50 |
*** rbuzatu has quit IRC | 20:50 | |
*** vhosakot has quit IRC | 20:51 | |
*** edmondsw has joined #openstack-infra | 20:51 | |
mtreinish | fungi: so do https://review.openstack.org/#/c/352472/ and https://review.openstack.org/#/c/348019/ look better now? | 20:51 |
fungi | sc`: we ship them reels of our content | 20:52 |
*** vhosakot has joined #openstack-infra | 20:52 | |
*** tongli has quit IRC | 20:52 | |
*** eharney has quit IRC | 20:53 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-logstash: WIP: Add mqtt output plugin to logstash indexers https://review.openstack.org/351344 | 20:55 |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Add an example logging.conf for development https://review.openstack.org/352599 | 20:55 |
*** ayoung has joined #openstack-infra | 20:55 | |
notmorgan | jeblair: o/ | 20:56 |
pabelanger | fungi: do you mind helping land: https://review.openstack.org/#/c/352524/ | 20:56 |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Add a fake-secure.conf https://review.openstack.org/352600 | 20:58 |
zigo | fungi: Could you please review that one? This should fix the POST job of deb-auto-backports: https://review.openstack.org/#/c/352524/ | 20:58 |
fungi | pabelanger: zigo: yes, i'm looking at it already | 20:58 |
zigo | :) | 20:58 |
*** ihrachys has joined #openstack-infra | 20:58 | |
sc` | fungi: now that's the dry humor i've come to love out of openstack. /me golfclap | 21:00 |
*** gouthamr has quit IRC | 21:01 | |
*** coolsvap has quit IRC | 21:01 | |
*** baoli has quit IRC | 21:01 | |
*** baoli has joined #openstack-infra | 21:02 | |
*** dprince has quit IRC | 21:02 | |
*** thorst has quit IRC | 21:03 | |
pabelanger | fungi: thanks for the help | 21:03 |
*** thorst has joined #openstack-infra | 21:03 | |
*** raildo has quit IRC | 21:03 | |
fungi | amrith: maybe a clearer log entry to suggest that it's really getting the constrained version of the module http://logs.openstack.org/04/349204/1/check/gate-trove-functional-dsvm-mysql/c9472ff/logs/devstacklog.txt.gz#_2016-07-30_18_28_29_324 | 21:04 |
fungi | amrith: you can see there that pip was called with -c /opt/stack/new/requirements/upper-constraints.txt when installing oslo.context onto the system | 21:04 |
*** vhosakot_ has joined #openstack-infra | 21:05 | |
openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Write /etc/nodepool_mirror_host https://review.openstack.org/352602 | 21:05 |
zigo | pabelanger: Should I wait before attempting to publish backport packages again? | 21:05 |
*** vhosakot has quit IRC | 21:05 | |
*** jkilpatr has quit IRC | 21:05 | |
zigo | (I mean, after the merge happens...) | 21:06 |
*** acoles_ is now known as acoles | 21:06 | |
*** thorst_ has joined #openstack-infra | 21:07 | |
*** vhosakot_ has quit IRC | 21:07 | |
pabelanger | zigo: still a while of before merging | 21:07 |
*** thorst has quit IRC | 21:07 | |
*** yamamoto has joined #openstack-infra | 21:09 | |
*** _nadya_ has joined #openstack-infra | 21:09 | |
*** weshay has quit IRC | 21:10 | |
*** yamamoto has quit IRC | 21:10 | |
*** _nadya_ has quit IRC | 21:10 | |
*** yamamoto has joined #openstack-infra | 21:10 | |
*** _nadya_ has joined #openstack-infra | 21:11 | |
*** thorst_ has quit IRC | 21:11 | |
*** hurgleburgler1 has quit IRC | 21:11 | |
*** hurgleburgler has joined #openstack-infra | 21:11 | |
*** _ari_ has quit IRC | 21:12 | |
*** _nadya__ has joined #openstack-infra | 21:13 | |
*** _nadya_ has quit IRC | 21:13 | |
*** rockyg has quit IRC | 21:13 | |
*** rockyg has joined #openstack-infra | 21:14 | |
*** yamamoto has quit IRC | 21:15 | |
*** tonytan4ever has joined #openstack-infra | 21:17 | |
*** senk_ has quit IRC | 21:18 | |
*** thiagop has quit IRC | 21:20 | |
*** inc0 has joined #openstack-infra | 21:20 | |
*** julim has quit IRC | 21:21 | |
*** _nadya_ has joined #openstack-infra | 21:22 | |
*** _nadya__ has quit IRC | 21:22 | |
*** tonytan4ever has quit IRC | 21:22 | |
*** pradk has quit IRC | 21:22 | |
*** senk has joined #openstack-infra | 21:23 | |
*** inc0 has quit IRC | 21:24 | |
*** ldnunes has quit IRC | 21:24 | |
*** rhallisey has quit IRC | 21:25 | |
*** acoles is now known as acoles_ | 21:26 | |
*** mhickey has quit IRC | 21:27 | |
*** ganesan has quit IRC | 21:28 | |
*** matt-borland has quit IRC | 21:29 | |
openstackgerrit | Khai Do proposed openstack-infra/system-config: Upgrade gerrit on review-dev.o.o https://review.openstack.org/352543 | 21:34 |
*** tonytan4ever has joined #openstack-infra | 21:35 | |
*** piet has quit IRC | 21:37 | |
*** _nadya_ has quit IRC | 21:37 | |
*** _nadya_ has joined #openstack-infra | 21:38 | |
*** Na3iL has quit IRC | 21:38 | |
*** burgerk has quit IRC | 21:38 | |
cloudnull | anteaya: sorry been afk for most the day. We're not waiting on anything from infra, we have issues with IP space for the provider networks but I'm working on getting a new one, setup to get us some breathing room. | 21:39 |
*** _nadya_ has quit IRC | 21:42 | |
anteaya | cloudnull: no worries and thank you | 21:42 |
anteaya | go you \o/ | 21:42 |
*** ihrachys has quit IRC | 21:43 | |
*** dimtruck is now known as zz_dimtruck | 21:43 | |
*** zz_dimtruck is now known as dimtruck | 21:43 | |
anteaya | let us know if you need any emotional support on IP space for the provider networks | 21:43 |
*** ihrachys has joined #openstack-infra | 21:43 | |
cloudnull | will do :) | 21:44 |
cloudnull | I'm hoping to have v6 up and running by end of the week | 21:44 |
*** inc0 has joined #openstack-infra | 21:44 | |
*** thorst has joined #openstack-infra | 21:44 | |
anteaya | awesome, thank yoiu | 21:45 |
anteaya | you* | 21:45 |
anteaya | :) | 21:45 |
mnaser | I didn't know this.. "If you provided an IRC nic - do you prefer the IRC nic to be the most prominent identifier printed on your Summit name badge?" | 21:46 |
mnaser | "based on popular demand" | 21:46 |
anteaya | mnaser: this is a new question when registering for summit | 21:47 |
anteaya | mordred: started the trend | 21:47 |
mordred | \o/ | 21:47 |
mnaser | I remember seeing him with the "mordred" badge at Austin :p | 21:48 |
anteaya | a few of us followed suit last summit then the point came up at the feedback session | 21:48 |
anteaya | mnaser: yeah, that was when it started | 21:48 |
mordred | I hacked the one at the austin summit by going and having it reprinted with my first name as "mordred" | 21:48 |
anteaya | now it is "official" | 21:48 |
*** apetrich has quit IRC | 21:48 | |
anteaya | whatever that means | 21:48 |
mordred | yah. hats off to the folks at the foundation for making that change for us | 21:48 |
*** nherciu has quit IRC | 21:48 | |
*** thorst has quit IRC | 21:49 | |
*** spzala has quit IRC | 21:49 | |
*** rfolco has quit IRC | 21:49 | |
*** moravec has joined #openstack-infra | 21:50 | |
*** rbuzatu has joined #openstack-infra | 21:50 | |
openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add Fedora 24 work-around kernel https://review.openstack.org/352211 | 21:52 |
*** nwkarsten has quit IRC | 21:52 | |
*** dimtruck is now known as zz_dimtruck | 21:52 | |
ianw | pabelanger: ^ i think that's the final revision on that .... so many layers of bugs | 21:53 |
pabelanger | ianw: wow | 21:54 |
*** nwkarsten has joined #openstack-infra | 21:54 | |
*** rbuzatu has quit IRC | 21:55 | |
*** ihrachys_ has joined #openstack-infra | 21:55 | |
*** mriedem has quit IRC | 21:55 | |
*** xenogear_ has quit IRC | 21:55 | |
pabelanger | ianw: any idea when f24 will update the kernel? | 21:56 |
ianw | pabelanger: ahh, i lose track. it goes into the kernel net tree, which gets pulled into the stable kernel tree periodically, which i think fedora update from periodically | 21:57 |
ianw | so, yeah, about then | 21:57 |
pabelanger | nice | 21:58 |
*** baoli has quit IRC | 21:58 | |
*** ihrachys has quit IRC | 21:58 | |
*** baoli has joined #openstack-infra | 21:58 | |
pabelanger | it would be good to see if we can get it into updates-testing repo early some how | 21:58 |
*** nwkarsten has quit IRC | 21:58 | |
pabelanger | but I have no idea how to do that | 21:58 |
ianw | yeah, i will see who i can find who might know | 21:59 |
*** lewo has quit IRC | 22:00 | |
*** lewo has joined #openstack-infra | 22:00 | |
*** Apoorva has quit IRC | 22:00 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Migrate to gate-{name}-tox-db-{envlist}-{node} https://review.openstack.org/352614 | 22:01 |
*** Apoorva has joined #openstack-infra | 22:01 | |
openstackgerrit | Isaku Yamahata proposed openstack-infra/project-config: networking-odl: cover more combinations of version https://review.openstack.org/347045 | 22:01 |
mtreinish | fungi, rcarrillocruz: \o/ our mosquitto bug got tagged as something to fix for the next release: https://github.com/eclipse/mosquitto/issues/234 | 22:01 |
rcarrillocruz | weee | 22:02 |
mtreinish | heh, of course I doubt we'll ever see it backported to the xenial package | 22:03 |
anteaya | one can hope | 22:03 |
*** baoli has quit IRC | 22:05 | |
openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Fix queue for py35 Neutron unit test job https://review.openstack.org/352615 | 22:05 |
*** Apoorva has quit IRC | 22:05 | |
*** Apoorva has joined #openstack-infra | 22:06 | |
*** edtubill has quit IRC | 22:06 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Stack nodepool images targets in grafana https://review.openstack.org/352618 | 22:08 |
*** ihrachys_ has quit IRC | 22:08 | |
*** esberglu has quit IRC | 22:09 | |
*** hurgleburgler1 has joined #openstack-infra | 22:10 | |
*** hurgleburgler has quit IRC | 22:10 | |
*** amitgandhinz has quit IRC | 22:10 | |
*** mdrabe has quit IRC | 22:10 | |
*** hichihara has quit IRC | 22:11 | |
fungi | well, it's not as if it's a problem for _us_ now that we know why it failed | 22:13 |
fungi | but it's good to see they're responsive to bug reports | 22:13 |
*** krtaylor has joined #openstack-infra | 22:13 | |
amrith | fungi, sorry, wasn't paying attention. let me check | 22:17 |
*** julim has joined #openstack-infra | 22:19 | |
amrith | fungi, can I assume that if upper-constraints.txt exists, it will be in /opt/stack/new/requirements/upper-constraints.txt | 22:19 |
asselin | zaro, how were JJB configuration scripts tested before merging? | 22:19 |
pabelanger | fungi: we likely need to restart zuul again, our demand calculation is out again for ubuntu-trusty. We have 50+ nodes in ready state atm | 22:19 |
*** thorst has joined #openstack-infra | 22:22 | |
*** thorst has quit IRC | 22:23 | |
fungi | amrith: for devstack-gate based jobs, like your functional test job, then yes | 22:23 |
amrith | OK, in that case I'll just look for that file instead of the environment variable in my jobs | 22:24 |
amrith | I'm doing this for https://review.openstack.org/#/c/352355/ | 22:25 |
fungi | amrith: devstack-gate copies relevant git repositories into /opt/stack/new and updates them there based on any $ZUUL_REF provided (which will integrate proposed changes in dependencies you've specified, like the depends-on in your example) | 22:25 |
amrith | so, I think my 'big question' is this; is it safe to rely on the path or is there an environment variable that points to (for example) /opt/stack/new | 22:26 |
amrith | that I can treat as being unchanging in the future | 22:26 |
amrith | If you have a minute, I'll explain the bigger issue | 22:26 |
amrith | that I'm trying to deal with | 22:26 |
fungi | amrith: yeah, the $UPPER_CONSTRAINTS_FILE envvar is something being done to make use of constraints files in tox-based jobs, but isn't relevant to devstack-gate based jobs | 22:26 |
*** yamamoto has joined #openstack-infra | 22:26 | |
amrith | OK, so I can't rely on that; explains why my test of https://review.openstack.org/#/c/352355/ didn't find that variable. | 22:27 |
fungi | there's no separate envvar for that which i'm aware of, but i'll double-check the devstack source code for the pip_install function to make sure | 22:27 |
*** sputnik13 has quit IRC | 22:27 | |
*** sputnik13_ has joined #openstack-infra | 22:27 | |
zaro | asselin: it's tested against openstack configs. https://etherpad.openstack.org/p/gerrit-verify-status-plugin | 22:28 |
asselin | zaro, I mean..is there an easy way to get a JJB configuraiton output to bash scripts that someone can use to manually upload and run on a held node? | 22:29 |
fungi | amrith: so it's here where the constraints file path is being assembled inside devstack http://git.openstack.org/cgit/openstack-dev/devstack/tree/inc/python#n138 | 22:30 |
* amrith looks | 22:30 | |
amrith | great, so I can just use $REQUIREMENTS_DIR | 22:31 |
zaro | asselin: i think jjb provides a number of out parameters, one being output to files | 22:31 |
amrith | perfect, $REQUIREMENTS_DIR/upper-constraints.txt should be what I'm after | 22:31 |
zaro | asselin: i mean output all the confis to files so you can use upload it anywhere. | 22:31 |
fungi | amrith: i'm trying to find if that'll be set in any useful context available to your gate_hook | 22:32 |
zaro | asselin: i'm not really understanding what you want to do though | 22:32 |
amrith | fungi, easy for me to try it out :) | 22:32 |
openstackgerrit | Jerry Zhao proposed openstack-infra/devstack-gate: WIP: restart ntpd to sync time https://review.openstack.org/352621 | 22:33 |
fungi | amrith: looks like it's set in stackrc here http://git.openstack.org/cgit/openstack-dev/devstack/tree/stackrc#n214 so maybe? | 22:33 |
fungi | worth a shot | 22:33 |
asselin | zaro, you gave me some ideas of what I can try...but basically before merging JJB configurations, how does the developer gain confidence that the jjb configuration will do what they expect it to do? | 22:33 |
*** raunak has joined #openstack-infra | 22:34 | |
amrith | thx fungi will give it a shot right now | 22:34 |
fungi | asselin: we run a ci job that generates an xml dump of the proposed job config change and diffs it against an xml dump of the parent commit in git | 22:34 |
*** gordc has quit IRC | 22:34 | |
fungi | asselin: so that we can see the resulting jenkins xml configuration which would be applied if that change were to merge | 22:35 |
*** chlong has quit IRC | 22:35 | |
*** piet has joined #openstack-infra | 22:35 | |
fungi | asselin: also runnable locally with `tox -e jjb` in a project-config checkout | 22:36 |
asselin | fungi, right...that tells you what changed, but not necessarily if the developer has an error in their script. | 22:36 |
zaro | asselin: yup basically do exactly as openstack does, or https://git.openstack.org/cgit/openstack-infra/project-config/tree/tools/run-compare-xml.sh | 22:36 |
asselin | I'm looking for a way to say, I want to output the bash for job gate_xyz_test so I can run it myself and find my typos and other errors | 22:37 |
zaro | asselin: jjb unit tests do some of that checking | 22:37 |
fungi | asselin: yeah, actually trying to run the job is risky for us, since some jobs can be configured to run on privileged nodes with access to sensitive credentials, so we don't want jobs to be test-run without review | 22:37 |
asselin | true, but I thinking more in terms of holding a node and run it in that environment as the jenkins user. | 22:38 |
*** asettle has quit IRC | 22:38 | |
asselin | so manual testing for a trusted developer | 22:38 |
*** tpsilva has quit IRC | 22:38 | |
mordred | asselin: so - for zuul 2.5 we translate the jjb into ansible playbooks | 22:38 |
asselin | the issue is that there are often many scripts and it's quite a bit of work to extract all of them from the jjb configurations | 22:38 |
*** sshnaidm is now known as sshnaidm|afk | 22:38 | |
*** hurgleburgler1 has quit IRC | 22:39 | |
*** hurgleburgler has joined #openstack-infra | 22:39 | |
fungi | asselin: oh, for that i bet our ansible-launcher parser could be leveraged to dump a role as one large script you could run | 22:39 |
mordred | asselin: for the transition to 3, we need to write a conversion tool to turn the jjb into ansible ... | 22:39 |
asselin | I see....so with zuul 2.5 this probably basically goes away. devs can just run the playbook and debug on their own from there | 22:39 |
mordred | a thing like fungi just mentioned should be faily simple to write at the moment | 22:39 |
mordred | yah | 22:39 |
mordred | well, with zuul 3 it goes away | 22:39 |
mordred | from now until 3 is ready, the thing you describe is certainly a thing I could see being valued if someone wrote it | 22:40 |
jhesketh | Morning | 22:40 |
*** rbrndt has quit IRC | 22:41 | |
*** hurgleburgler1 has joined #openstack-infra | 22:41 | |
*** hurgleburgler has quit IRC | 22:41 | |
asselin | fungi, do you have the link to ansible-launcher parser? I'd like to dig into that and see if that can be useful for this problem. | 22:41 |
*** Na3iL has joined #openstack-infra | 22:42 | |
fungi | asselin: http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/launcher/ansiblelaunchserver.py#n1363 | 22:43 |
*** rockyg has quit IRC | 22:43 | |
pabelanger | for the most part zuulv2.5 almost give a user to ability to re-run ansible on a local VM to reproduce the test results. We'd have to change very few things to make that work today | 22:43 |
amrith | fungi, I tagged you on a review for this change; will let you know how it works out. thx. hi mordred, bye mordred | 22:43 |
pabelanger | update inventory file for example | 22:44 |
fungi | amrith: cool--i'm curious to know how it goes and whether you need further help | 22:44 |
amrith | I'm curious too, and I'm sure I need a lot of help. I was told that from a young age. | 22:45 |
anteaya | morning jhesketh | 22:45 |
mordred | morning jhesketh | 22:45 |
jhesketh | o/ | 22:46 |
fungi | amrith: i'm still told it at an old age | 22:46 |
mordred | fungi: maybe if people still tell us that, it means we're still young | 22:47 |
amrith | sometimes I don't remember whether I'm old or not | 22:48 |
*** xyang1 has quit IRC | 22:51 | |
*** rbuzatu has joined #openstack-infra | 22:52 | |
openstackgerrit | Merged openstack-infra/project-config: Return tripleo tempest job to experimental pipe https://review.openstack.org/351120 | 22:53 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Use {{ ansible_host }} for ssh-keyscan https://review.openstack.org/352627 | 22:55 |
*** PollyZ has joined #openstack-infra | 22:55 | |
harlowja | dhellmann https://review.openstack.org/#/c/352040/ if u want to work through a similar kind of bot | 22:55 |
harlowja | (or others with bot ideas) | 22:55 |
harlowja | that's a plugin that i've created, will switch to MTQQ soon | 22:55 |
openstackgerrit | Merged openstack-infra/project-config: Fix issue with reprepro-import distribution https://review.openstack.org/352524 | 22:55 |
harlowja | and will figure out some things around using the older config files | 22:56 |
*** rbuzatu has quit IRC | 22:56 | |
pabelanger | mordred: fungi: noop change to start making it easier for users to run our ansible playbooks locally if they want too | 22:56 |
pabelanger | ^ | 22:56 |
pabelanger | zigo: try your build now, patch landed | 22:59 |
openstackgerrit | Monty Taylor proposed openstack-infra/subunit2sql: Trim microseconds before passing to sqlalchemy https://review.openstack.org/352628 | 23:03 |
*** ams__ has quit IRC | 23:04 | |
*** esberglu has joined #openstack-infra | 23:07 | |
*** gouthamr has joined #openstack-infra | 23:08 | |
*** gouthamr_ has joined #openstack-infra | 23:09 | |
*** amitgandhinz has joined #openstack-infra | 23:11 | |
*** gouthamr has quit IRC | 23:13 | |
*** amitgandhinz has quit IRC | 23:15 | |
*** roxanaghe has quit IRC | 23:18 | |
openstackgerrit | Merged openstack-infra/puppet-zuul: Ansible launcher: Pin JJB to 1.6.1 https://review.openstack.org/351867 | 23:18 |
*** esberglu has quit IRC | 23:18 | |
*** sarob has joined #openstack-infra | 23:19 | |
*** sdague has quit IRC | 23:20 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: WIP: Re-enable test_connection tests https://review.openstack.org/351949 | 23:21 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Stop sharing Gerrit event queues in tests https://review.openstack.org/352635 | 23:21 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Update category mapping in tests https://review.openstack.org/352636 | 23:21 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: WIP Fix addFailTest https://review.openstack.org/352637 | 23:21 |
jeblair | jhesketh, notmorgan: ^ | 23:21 |
mordred | jeblair: ooh | 23:21 |
jeblair | jhesketh, notmorgan: 352636 is the big change, and should be ready to go. 635 is the thing i ran into after that, and 637 is me right in the middle of making a change to fix the next thing. but i'm going to EOD soon, so i wanted to push that up. hopefully with that fixed, 949 should start working again | 23:22 |
*** PollyZ has quit IRC | 23:23 | |
jeblair | jhesketh, notmorgan: sorry, 635 is the big change, 636 is the thing after it. :) | 23:23 |
*** thorst has joined #openstack-infra | 23:24 | |
*** inc0 has quit IRC | 23:24 | |
*** nwkarsten has joined #openstack-infra | 23:24 | |
jeblair | jhesketh: you also have a pair of reviews from mordred and i on 223333 | 23:25 |
notmorgan | jeblair: ok looking | 23:26 |
mordred | jhesketh: I was just talking to mtreinish about that actually (not that that is important information) ... but there is a thing I suggest that I think the 'right' way for me to suggest it is a follow on patch that you can squash into yours | 23:26 |
jhesketh | jeblair: awesome, thanks (will take a look) | 23:27 |
openstackgerrit | Jim Rollenhagen proposed openstack-infra/elastic-recheck: Add bug 1610960 https://review.openstack.org/352639 | 23:27 |
openstack | bug 1610960 in neutron "Invalid input for external_gateway_info. Reason: '' is not a valid UUID." [Critical,Confirmed] https://launchpad.net/bugs/1610960 | 23:27 |
jhesketh | mordred: sure | 23:27 |
*** inc0 has joined #openstack-infra | 23:29 | |
*** kien-ha has joined #openstack-infra | 23:29 | |
mordred | jroll: that is the evil bug from earlier? | 23:29 |
jroll | mordred: it is | 23:30 |
*** roxanaghe has joined #openstack-infra | 23:30 | |
jroll | the patch merged a couple hours ago | 23:30 |
jroll | the patch we rechecked to test failed earlier, though, so -.- | 23:30 |
JayF | jroll: if my metrics on the agent client can fail a tempest test, our metrics lib is f'd | 23:30 |
mordred | jroll: cool. I have some patches up to test fixes to neutronclient | 23:31 |
JayF | jroll: especially with the noop metric logger | 23:31 |
*** roxanaghe has quit IRC | 23:31 | |
mordred | jroll: but- given gate load, it might take me a couple of days to cycle through them to be confident of a real fix | 23:31 |
mordred | jroll: so the pin is definitely the right choice | 23:31 |
jroll | mordred: talking in -qa about fixing the query, btw | 23:31 |
*** sarob has quit IRC | 23:32 | |
*** sarob has joined #openstack-infra | 23:33 | |
*** zz_dimtruck is now known as dimtruck | 23:34 | |
openstackgerrit | Jim Rollenhagen proposed openstack-infra/elastic-recheck: Add bug 1610960 https://review.openstack.org/352639 | 23:36 |
openstack | bug 1610960 in neutron "Invalid input for external_gateway_info. Reason: '' is not a valid UUID." [Critical,Confirmed] https://launchpad.net/bugs/1610960 | 23:36 |
*** nwkarsten has quit IRC | 23:37 | |
*** Julien-zte has quit IRC | 23:38 | |
*** dingyichen has joined #openstack-infra | 23:38 | |
*** ggillies has joined #openstack-infra | 23:38 | |
*** markvoelker has quit IRC | 23:39 | |
*** mtanino has quit IRC | 23:40 | |
*** inc0 has quit IRC | 23:42 | |
*** hurgleburgler has joined #openstack-infra | 23:42 | |
*** hurgleburgler1 has quit IRC | 23:44 | |
*** furlongm_ has quit IRC | 23:44 | |
*** xarses_ has quit IRC | 23:45 | |
*** zhurong has joined #openstack-infra | 23:46 | |
*** nwkarsten has joined #openstack-infra | 23:46 | |
*** rfolco has joined #openstack-infra | 23:46 | |
*** PollyZ has joined #openstack-infra | 23:50 | |
*** rbuzatu has joined #openstack-infra | 23:53 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Update docker build publish to use convert xml https://review.openstack.org/352647 | 23:55 |
*** hurgleburgler has quit IRC | 23:55 | |
*** zhurong has quit IRC | 23:55 | |
*** hurgleburgler1 has joined #openstack-infra | 23:55 | |
*** sdake has joined #openstack-infra | 23:56 | |
*** sarob has quit IRC | 23:57 | |
JayF | I'd love a review on https://review.openstack.org/#/c/350795/ for ds-gate; already has a +1 from mtreinish and sambetts (from Ironic). Pretty simple devstack-gate change to enable us changing a default in devstack. (And yes, we do have an open bug currently being worked to remove ds-g as an intermediary for those vars that don't need it) | 23:58 |
*** rbuzatu has quit IRC | 23:58 | |
mordred | lgtm | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!