| anteaya | looks like I'm going to have to boil down tomorrow and on the weekend | 00:02 |
|---|---|---|
| anteaya | last two days have been the two best runs of the season so far | 00:02 |
| *** harlowja has quit IRC | 00:02 | |
| fungi | clarkb: yay! i am also booked on a train, just need to try to make sure i get from my flight to the train station in time to make use of it | 00:02 |
| *** harlowja has joined #openstack-infra | 00:03 | |
| openstackgerrit | Merged openstack-infra/system-config: Disable our friend's noise https://review.openstack.org/169567 | 00:05 |
| clarkb | cool next puppet run should correct things | 00:05 |
| clarkb | ianw: sorry for the noise | 00:05 |
| *** ZZelle_ has quit IRC | 00:05 | |
| fungi | (literally) | 00:06 |
| mordred | clarkb: there were SOUNDS? | 00:06 |
| fungi | and yes, it's all fun and games until someone's sound card gets exercised | 00:06 |
| fungi | (do people still use the term "sound card?" am i showing my age?) | 00:06 |
| *** sputnik13 has quit IRC | 00:07 | |
| *** hdd has quit IRC | 00:09 | |
| nibalizer | if someone really hates it, they can noscript clippy away pertty easily | 00:09 |
| nibalizer | or use gertty :P | 00:09 |
| anteaya | or burn their laptop | 00:09 |
| fungi | well, it is april 1 officially now (utc at least). that's an international holiday as far as i'm concerned | 00:10 |
| fungi | i have a crate of hand buzzers and whoopie cushions to go unpack | 00:10 |
| *** flaper87 has quit IRC | 00:11 | |
| * greghaynes pokes clarkb about 169509 | 00:12 | |
| greghaynes | and others who are still up for reviewing | 00:12 |
| *** masoz has joined #openstack-infra | 00:14 | |
| *** asettle has joined #openstack-infra | 00:15 | |
| *** flaper87 has joined #openstack-infra | 00:15 | |
| *** ibiris_away is now known as ibiris | 00:16 | |
| *** gokrokve_ has quit IRC | 00:17 | |
| *** salv-orlando has quit IRC | 00:18 | |
| anteaya | I actually think it would be funny if clippy asked people "are you sure you don't want to use gertty? | 00:19 |
| anteaya | " | 00:19 |
| *** SumitNaiksatam has quit IRC | 00:19 | |
| *** emagana has quit IRC | 00:19 | |
| nibalizer | anteaya: its pretty easy using greg patch as a template to add things like that | 00:20 |
| anteaya | just wondering if others think it would be too | 00:20 |
| nibalizer | i would +1 that | 00:20 |
| anteaya | as it could also spark a backlash | 00:20 |
| nibalizer | its clippy | 00:20 |
| *** hdd has joined #openstack-infra | 00:20 | |
| nibalizer | its gonna spark a backlash | 00:20 |
| anteaya | depending on what folks had for breakfast | 00:20 |
| dansmith | did we just change something that forces all REST calls in gerrit to https (that wasn't there before)? | 00:24 |
| clarkb | dansmith: I think gerrit was always REST over https before (port 80 redirects to 443) | 00:25 |
| *** ibiris is now known as ibiris_away | 00:25 | |
| dansmith | clarkb: me too, but I suddenly started getting errors from dash.py about https things | 00:26 |
| dansmith | ...and switching to an SSL-supporting python fixes it | 00:29 |
| *** hdd has quit IRC | 00:30 | |
| clarkb | dansmith: was that the python urllib3 warning about insecure platform? | 00:31 |
| *** garyh has quit IRC | 00:31 | |
| *** dboik has joined #openstack-infra | 00:31 | |
| *** imcsk8 has quit IRC | 00:32 | |
| *** imcsk8 has joined #openstack-infra | 00:32 | |
| *** Sukhdev has joined #openstack-infra | 00:32 | |
| *** dboik_ has joined #openstack-infra | 00:33 | |
| *** Swami has quit IRC | 00:33 | |
| dansmith | clarkb: nope. urllib2 and just "unknown url type https" which seems to indicate a total lack of ssl support | 00:33 |
| dansmith | this was a venv from brew's python, which may not support https | 00:33 |
| dansmith | would have thought it was using it all along, but just suddenly started getting that error | 00:34 |
| dansmith | fixed it by enabling ssl, just wondering if something change | 00:34 |
| dansmith | d | 00:34 |
| dansmith | because I didn't change anything locally AFAIK | 00:34 |
| clarkb | we didn't change anything related to ssl | 00:34 |
| *** tiswanso has joined #openstack-infra | 00:35 | |
| jroll | dansmith: I think you need to have openssl installed from brew to have that work, maybe? | 00:35 |
| dansmith | jroll: right, I'm saying nothing has changed in this venv for six months | 00:36 |
| *** dboik has quit IRC | 00:36 | |
| jroll | dansmith: oh huh, I would have assumed fresh install or whatever | 00:36 |
| dansmith | nope | 00:36 |
| *** yamamoto has joined #openstack-infra | 00:42 | |
| *** SumitNaiksatam has joined #openstack-infra | 00:55 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/system-config: Add another action to our friend https://review.openstack.org/169574 | 00:58 |
| *** tobiash_ has quit IRC | 01:01 | |
| *** tobiash has joined #openstack-infra | 01:01 | |
| *** baoli has joined #openstack-infra | 01:03 | |
| *** zz_dimtruck is now known as dimtruck | 01:04 | |
| *** yamamoto has quit IRC | 01:04 | |
| *** flaviosr has quit IRC | 01:14 | |
| *** david-lyle has joined #openstack-infra | 01:15 | |
| *** xyang1 has quit IRC | 01:16 | |
| *** ChuckC has quit IRC | 01:16 | |
| *** gmann has quit IRC | 01:17 | |
| *** annegentle has joined #openstack-infra | 01:18 | |
| *** gmann has joined #openstack-infra | 01:18 | |
| *** baoli has quit IRC | 01:20 | |
| *** baoli has joined #openstack-infra | 01:21 | |
| *** radez is now known as radez_g0n3 | 01:22 | |
| *** tqtran is now known as tqtran_afk | 01:24 | |
| openstackgerrit | Merged openstack/requirements: Remove pip_missing_reqs https://review.openstack.org/166664 | 01:24 |
| *** otter768 has joined #openstack-infra | 01:24 | |
| *** mwagner_lap has quit IRC | 01:27 | |
| *** otter768 has quit IRC | 01:30 | |
| *** kaisers1 has joined #openstack-infra | 01:31 | |
| *** jyuso1 has quit IRC | 01:33 | |
| *** kaisers has quit IRC | 01:33 | |
| *** jerryz_ has joined #openstack-infra | 01:35 | |
| *** baoli has quit IRC | 01:36 | |
| *** armax has quit IRC | 01:36 | |
| *** dboik_ has quit IRC | 01:38 | |
| *** yamamoto has joined #openstack-infra | 01:38 | |
| *** mwagner_lap has joined #openstack-infra | 01:39 | |
| *** oomichi has joined #openstack-infra | 01:39 | |
| *** julim has quit IRC | 01:39 | |
| *** dboik has joined #openstack-infra | 01:39 | |
| *** annegentle has quit IRC | 01:43 | |
| *** salv-orlando has joined #openstack-infra | 01:44 | |
| *** dkranz has joined #openstack-infra | 01:46 | |
| *** ChuckC has joined #openstack-infra | 01:47 | |
| *** ChuckC has quit IRC | 01:51 | |
| *** ChuckC has joined #openstack-infra | 01:52 | |
| *** david-lyle has quit IRC | 01:55 | |
| *** bhunter71 has joined #openstack-infra | 01:56 | |
| *** mwagner_lap has quit IRC | 02:06 | |
| *** ryanpetrello has quit IRC | 02:08 | |
| *** patrickeast has quit IRC | 02:09 | |
| *** mtanino has quit IRC | 02:10 | |
| *** ChuckC has quit IRC | 02:10 | |
| *** ChuckC has joined #openstack-infra | 02:10 | |
| *** sputnik13 has joined #openstack-infra | 02:11 | |
| *** Sukhdev has quit IRC | 02:14 | |
| *** rfolco has joined #openstack-infra | 02:15 | |
| *** yamahata has quit IRC | 02:15 | |
| *** baoli has joined #openstack-infra | 02:16 | |
| *** ryanpetrello has joined #openstack-infra | 02:16 | |
| *** asettle has quit IRC | 02:18 | |
| *** unicell has quit IRC | 02:18 | |
| *** annegentle has joined #openstack-infra | 02:19 | |
| *** mwagner_lap has joined #openstack-infra | 02:19 | |
| *** annegentle has quit IRC | 02:24 | |
| *** macjack has joined #openstack-infra | 02:29 | |
| *** harlowja is now known as harlowja_away | 02:29 | |
| openstackgerrit | Ian Wienand proposed openstack/requirements: Keep pyOpenSSL < 0.14 https://review.openstack.org/169596 | 02:32 |
| *** sputnik13 has quit IRC | 02:38 | |
| mordred | notmyname: if I were me and you were you and I wanted to find out why swift uploads to IAD at rax kept giving me 504s, who would I bug? | 02:44 |
| *** tsg_ has quit IRC | 02:48 | |
| *** dims_ has quit IRC | 02:55 | |
| *** annegentle has joined #openstack-infra | 02:57 | |
| *** achanda has quit IRC | 02:59 | |
| *** salv-orlando has quit IRC | 02:59 | |
| *** medieval1 has joined #openstack-infra | 03:01 | |
| *** Longgeek_ has joined #openstack-infra | 03:03 | |
| *** Longgeek has quit IRC | 03:05 | |
| *** medieval1 has quit IRC | 03:06 | |
| *** medieval1_ has joined #openstack-infra | 03:06 | |
| *** ayoung is now known as ayoung_ZZZzzz__z | 03:07 | |
| *** hdd has joined #openstack-infra | 03:09 | |
| *** spzala has quit IRC | 03:10 | |
| *** medieval1_ has quit IRC | 03:11 | |
| *** david-lyle has joined #openstack-infra | 03:13 | |
| *** SumitNaiksatam has quit IRC | 03:13 | |
| *** SumitNaiksatam has joined #openstack-infra | 03:14 | |
| *** bhunter71 has quit IRC | 03:15 | |
| *** asettle has joined #openstack-infra | 03:18 | |
| *** tiswanso has quit IRC | 03:19 | |
| *** hdd has quit IRC | 03:21 | |
| *** tsg_ has joined #openstack-infra | 03:22 | |
| notmyname | mordred: 504s? | 03:22 |
| mordred | notmyname: swiftclient.exceptions.ClientException: Object POST failed: https://storage101.iad3.clouddrive.com/v1/MossoCloudFS_622b11a1-5dfa-43b4-9f58-4ad3c6dbc4a0/images/dib-ubuntu-trusty 504 Gateway Time-out [first 60 chars of response] <html><body><h1>504 Gateway Time-out</h1> | 03:24 |
| *** SumitNaiksatam has quit IRC | 03:24 | |
| mordred | notmyname: is that a thing I should expect? or is it a thing I should raise? (I've gotten that on IAD multiple times now) | 03:25 |
| notmyname | mordred: 5xx is bad and you dont' want that | 03:25 |
| notmyname | mordred: ok, I just confirmed that there isn't anything in swift that would return a 504 | 03:25 |
| *** otter768 has joined #openstack-infra | 03:25 | |
| notmyname | mordred: which tells me it's probably a LB problem | 03:25 |
| mordred | notmyname: okie. so it's a racker thing then | 03:25 |
| mordred | yah | 03:25 |
| notmyname | mordred: so, ask in #rackspace. or open a support ticket. I think that's about it, these days | 03:26 |
| mordred | kk | 03:26 |
| mordred | notmyname: thanks! | 03:26 |
| *** tqtran_afk has quit IRC | 03:28 | |
| *** btully has quit IRC | 03:29 | |
| *** armax has joined #openstack-infra | 03:29 | |
| *** otter768 has quit IRC | 03:30 | |
| *** SumitNaiksatam has joined #openstack-infra | 03:33 | |
| *** dimtruck is now known as zz_dimtruck | 03:33 | |
| *** changbl_ has joined #openstack-infra | 03:36 | |
| *** zz_dimtruck is now known as dimtruck | 03:36 | |
| *** ryanpetrello has quit IRC | 03:36 | |
| *** ryanpetrello has joined #openstack-infra | 03:37 | |
| *** changbl has quit IRC | 03:38 | |
| *** tkelsey has joined #openstack-infra | 03:39 | |
| *** tkelsey has quit IRC | 03:44 | |
| *** dboik has quit IRC | 03:47 | |
| *** Somay has joined #openstack-infra | 03:48 | |
| *** thingee has quit IRC | 03:51 | |
| *** carl_baldwin has joined #openstack-infra | 03:52 | |
| *** ryanpetrello has quit IRC | 03:52 | |
| *** ryanpetrello has joined #openstack-infra | 03:53 | |
| *** pal_ has joined #openstack-infra | 03:55 | |
| *** baoli has quit IRC | 03:55 | |
| *** salv-orlando has joined #openstack-infra | 03:58 | |
| *** Sukhdev has joined #openstack-infra | 04:00 | |
| *** macjack1 has joined #openstack-infra | 04:03 | |
| *** macjack has quit IRC | 04:04 | |
| *** ryanpetrello has quit IRC | 04:05 | |
| *** ryanpetrello has joined #openstack-infra | 04:06 | |
| *** medieval1 has joined #openstack-infra | 04:07 | |
| *** emagana has joined #openstack-infra | 04:07 | |
| *** medieval1 has quit IRC | 04:12 | |
| *** medieval1 has joined #openstack-infra | 04:12 | |
| *** achanda has joined #openstack-infra | 04:12 | |
| *** dimtruck is now known as zz_dimtruck | 04:17 | |
| *** ryanpetrello has quit IRC | 04:17 | |
| *** ryanpetrello has joined #openstack-infra | 04:18 | |
| *** yfried|afk is now known as yfried | 04:20 | |
| *** prmtl has joined #openstack-infra | 04:26 | |
| *** annegentle has quit IRC | 04:26 | |
| *** signed8bit_ZZZzz is now known as signed8b_ | 04:27 | |
| *** salv-orlando has quit IRC | 04:32 | |
| *** teran has quit IRC | 04:40 | |
| *** medieval1 has quit IRC | 04:44 | |
| *** Somay has quit IRC | 04:45 | |
| *** juggler_ has joined #openstack-infra | 04:45 | |
| *** carl_baldwin has quit IRC | 04:47 | |
| *** juggler has quit IRC | 04:47 | |
| *** eharney has quit IRC | 04:47 | |
| *** krtaylor has quit IRC | 04:48 | |
| *** krtaylor has joined #openstack-infra | 04:49 | |
| *** eharney has joined #openstack-infra | 04:49 | |
| *** deepakcs has joined #openstack-infra | 04:50 | |
| *** macjack1 has quit IRC | 04:53 | |
| *** BharatK has joined #openstack-infra | 04:58 | |
| *** hdd has joined #openstack-infra | 04:59 | |
| *** medieval1 has joined #openstack-infra | 05:04 | |
| *** emagana has quit IRC | 05:04 | |
| *** emagana has joined #openstack-infra | 05:05 | |
| *** mrmartin has joined #openstack-infra | 05:07 | |
| *** btully has joined #openstack-infra | 05:07 | |
| *** prmtl has quit IRC | 05:08 | |
| *** emagana has quit IRC | 05:10 | |
| *** medieval1 has quit IRC | 05:10 | |
| *** signed8b_ has quit IRC | 05:10 | |
| *** medieval1 has joined #openstack-infra | 05:11 | |
| *** yfried has quit IRC | 05:14 | |
| *** medieval1 has quit IRC | 05:17 | |
| *** macjack has joined #openstack-infra | 05:19 | |
| *** otter768 has joined #openstack-infra | 05:26 | |
| *** reed has quit IRC | 05:29 | |
| *** yamahata has joined #openstack-infra | 05:30 | |
| *** otter768 has quit IRC | 05:31 | |
| *** kiseok7_ has quit IRC | 05:32 | |
| *** miqui has quit IRC | 05:35 | |
| *** Longgeek_ has quit IRC | 05:38 | |
| *** Longgeek has joined #openstack-infra | 05:39 | |
| *** mrmartin has quit IRC | 05:39 | |
| *** YorikSar has quit IRC | 05:40 | |
| *** tkelsey has joined #openstack-infra | 05:40 | |
| *** tkelsey has quit IRC | 05:45 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Adds a link for new developers to use sandbox https://review.openstack.org/104951 | 05:48 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Creates a sandbox repo tutorial https://review.openstack.org/138195 | 05:48 |
| *** unicell has joined #openstack-infra | 05:53 | |
| *** prmtl has joined #openstack-infra | 05:55 | |
| *** VijayTripathi has joined #openstack-infra | 05:58 | |
| *** asettle has quit IRC | 05:58 | |
| *** yamamoto_ has joined #openstack-infra | 05:59 | |
| *** yamamoto has quit IRC | 05:59 | |
| *** Sukhdev has quit IRC | 06:00 | |
| *** scheuran has joined #openstack-infra | 06:01 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/169624 | 06:01 |
| *** hdd has quit IRC | 06:04 | |
| *** gulic has quit IRC | 06:07 | |
| *** packet has quit IRC | 06:07 | |
| *** rbradfor has quit IRC | 06:09 | |
| *** YorikSar has joined #openstack-infra | 06:09 | |
| *** medieval1 has joined #openstack-infra | 06:18 | |
| *** salv-orlando has joined #openstack-infra | 06:19 | |
| *** afazekas has joined #openstack-infra | 06:21 | |
| *** medieval1 has quit IRC | 06:23 | |
| *** ildikov_ has quit IRC | 06:25 | |
| *** rbradfor has joined #openstack-infra | 06:29 | |
| *** hashar has joined #openstack-infra | 06:30 | |
| *** woodster_ has quit IRC | 06:30 | |
| *** nilasae has joined #openstack-infra | 06:30 | |
| *** teran has joined #openstack-infra | 06:31 | |
| *** Ala has joined #openstack-infra | 06:31 | |
| *** VijayTripathi has quit IRC | 06:33 | |
| *** jlibosva has joined #openstack-infra | 06:37 | |
| *** flaper87 has quit IRC | 06:45 | |
| *** flaper87 has joined #openstack-infra | 06:45 | |
| *** dulek has joined #openstack-infra | 06:45 | |
| *** stevemar has joined #openstack-infra | 06:45 | |
| flaper87 | LOL @ the clipper! :D | 06:47 |
| *** tnovacik has joined #openstack-infra | 06:47 | |
| *** yfried has joined #openstack-infra | 06:47 | |
| AJaeger | flaper87, any ideas how to kill it? | 06:47 |
| AJaeger | wow, double clicks are nice... | 06:48 |
| *** stevemar has quit IRC | 06:48 | |
| *** yfried_ has joined #openstack-infra | 06:50 | |
| *** yfried has quit IRC | 06:51 | |
| *** salv-orlando has quit IRC | 06:54 | |
| flaper87 | AJaeger: no idea, but I don't mind if it it stays there just for today :D | 06:59 |
| *** rdopiera has joined #openstack-infra | 07:00 | |
| *** doude has joined #openstack-infra | 07:01 | |
| *** jcoufal has joined #openstack-infra | 07:01 | |
| AJaeger | yeah ;) | 07:02 |
| *** timfreund has quit IRC | 07:03 | |
| *** markvoelker has quit IRC | 07:09 | |
| yolanda | hi jeblair, ack. I'm on holiday until tuesday but I want to spend some time on that as well, so i'll dedicate some time to it, thx for that changes | 07:09 |
| *** tsg_ has quit IRC | 07:10 | |
| *** ildikov_ has joined #openstack-infra | 07:11 | |
| *** timfreund has joined #openstack-infra | 07:12 | |
| *** jistr has joined #openstack-infra | 07:14 | |
| *** teran has quit IRC | 07:15 | |
| *** yfried_ is now known as yfried|afk | 07:19 | |
| *** medieval1 has joined #openstack-infra | 07:19 | |
| *** timfreund has quit IRC | 07:20 | |
| *** timfreund has joined #openstack-infra | 07:20 | |
| *** yfried|afk is now known as yfried_ | 07:22 | |
| *** medieval1 has quit IRC | 07:24 | |
| *** sergsh has joined #openstack-infra | 07:27 | |
| *** otter768 has joined #openstack-infra | 07:27 | |
| *** Somay has joined #openstack-infra | 07:29 | |
| *** tnurlygayanov has quit IRC | 07:31 | |
| *** jcoufal has quit IRC | 07:32 | |
| *** arxcruz has joined #openstack-infra | 07:32 | |
| *** otter768 has quit IRC | 07:32 | |
| *** nmagnezi has joined #openstack-infra | 07:33 | |
| *** mrda is now known as mrda-away | 07:33 | |
| *** stevemar has joined #openstack-infra | 07:36 | |
| *** wicope has joined #openstack-infra | 07:36 | |
| *** wicope has quit IRC | 07:36 | |
| *** achanda has quit IRC | 07:36 | |
| *** wicope has joined #openstack-infra | 07:37 | |
| *** sambetts has quit IRC | 07:38 | |
| *** claudiub has joined #openstack-infra | 07:39 | |
| *** sambetts has joined #openstack-infra | 07:40 | |
| *** doude has quit IRC | 07:40 | |
| *** doude has joined #openstack-infra | 07:41 | |
| yfried_ | anyone knows what's up with the office paper clip that showed up on gerrit? | 07:41 |
| StevenK | Haha | 07:41 |
| *** achanda has joined #openstack-infra | 07:42 | |
| StevenK | yfried_: Check the date? :-P | 07:42 |
| yfried_ | StevenK: :) | 07:43 |
| *** achanda has quit IRC | 07:43 | |
| *** markus_z has joined #openstack-infra | 07:44 | |
| *** Krinkle has left #openstack-infra | 07:45 | |
| *** markus_z has quit IRC | 07:47 | |
| *** dims_ has joined #openstack-infra | 07:50 | |
| *** stevemar has quit IRC | 07:50 | |
| AJaeger | yfried_, happy first April! | 07:53 |
| *** mpavone has joined #openstack-infra | 07:53 | |
| AJaeger | yfried_, double click on it and have fun | 07:53 |
| *** dims_ has quit IRC | 07:55 | |
| *** dizquierdo has joined #openstack-infra | 07:55 | |
| *** jcoufal has joined #openstack-infra | 07:56 | |
| yfried_ | AJaeger: I wish it'd do anything. it doesn't... :( | 07:58 |
| *** ajo has joined #openstack-infra | 07:58 | |
| ajo | lol, cool april fool's day, I thought I had a trojan for a moment | 07:58 |
| yfried_ | AJaeger: where can a submit a but report? :) | 07:58 |
| ajo | XDDD | 07:58 |
| ajo | or that somebody had installed some sort of "office" in my mac | 07:59 |
| ajo | XDD | 07:59 |
| AJaeger | yfried_, against gerrit? | 07:59 |
| AJaeger | yfried_, for me it animates in different ways whenever I double click on it... | 07:59 |
| *** btully has quit IRC | 08:00 | |
| * AJaeger just had a paperclip turned bicylce ;) | 08:00 | |
| ajo | very funny | 08:00 |
| *** Somay has quit IRC | 08:00 | |
| deepakcs | AJaeger, so the clipper is intentional or somebody hacked gerrit :) bcos it reminds me of the M$ office appln | 08:00 |
| deepakcs | wondering what that has to do with gerrit ? | 08:01 |
| AJaeger | deepakcs, I was as surprised this morning as all of you are ;) | 08:01 |
| AJaeger | deepakcs, it's a joke, does it need to have a relationship? ;) | 08:01 |
| *** yamahata has quit IRC | 08:02 | |
| deepakcs | AJaeger, then its fine, but was surprised to see M$ office paperclip icon on an opensource page ;-) | 08:02 |
| AJaeger | deepakcs, I hope it'S fine and we're not hacked ;) | 08:02 |
| *** salv-orlando has joined #openstack-infra | 08:03 | |
| deepakcs | AJaeger, yeah :) | 08:03 |
| *** Somay has joined #openstack-infra | 08:05 | |
| fbo | Ahah clippy has been introduce here :) https://git.openstack.org/cgit/openstack-infra/system-config/commit/?id=353d4bd4ab672ad71dc6bfc9919eb7fc30e2012a | 08:07 |
| *** mpaolino has joined #openstack-infra | 08:08 | |
| AJaeger | fbo, ah, thanks! | 08:09 |
| *** yfried_ is now known as yfried|afk | 08:11 | |
| *** YorikSar has quit IRC | 08:11 | |
| *** YorikSar has joined #openstack-infra | 08:12 | |
| *** Hal has joined #openstack-infra | 08:13 | |
| *** Longgeek has quit IRC | 08:13 | |
| *** Longgeek has joined #openstack-infra | 08:13 | |
| *** Hal is now known as Guest58016 | 08:13 | |
| *** ibiris_away is now known as ibiris | 08:14 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 08:15 | |
| *** yfried|afk is now known as yfried_ | 08:15 | |
| *** e0ne has joined #openstack-infra | 08:16 | |
| *** medieval1 has joined #openstack-infra | 08:20 | |
| *** medieval1 has quit IRC | 08:25 | |
| *** tkelsey has joined #openstack-infra | 08:28 | |
| *** jerryz_ has quit IRC | 08:28 | |
| *** ibiris is now known as ibiris_away | 08:29 | |
| *** e0ne is now known as e0ne_ | 08:29 | |
| *** yamamoto_ has quit IRC | 08:30 | |
| *** MaxV has joined #openstack-infra | 08:30 | |
| *** mrmartin has joined #openstack-infra | 08:31 | |
| mrmartin | er | 08:31 |
| *** rlandy has joined #openstack-infra | 08:40 | |
| *** e0ne_ is now known as e0ne | 08:43 | |
| *** ibiris_away is now known as ibiris | 08:44 | |
| *** hogepodge has quit IRC | 08:46 | |
| *** nmagnezi has quit IRC | 08:47 | |
| *** claudiub has quit IRC | 08:48 | |
| *** scheuran has quit IRC | 08:50 | |
| *** hichihara has quit IRC | 08:54 | |
| SlickNik | nibalizer: nice work on clippy! :) | 08:57 |
| *** deepakcs has quit IRC | 08:58 | |
| *** Longgeek has quit IRC | 08:59 | |
| *** andreykurilin_ has joined #openstack-infra | 08:59 | |
| *** dtantsur|afk is now known as dtantsur | 09:00 | |
| *** kashyap has joined #openstack-infra | 09:00 | |
| *** yfried_ is now known as yfried|afk | 09:04 | |
| *** teran has joined #openstack-infra | 09:05 | |
| *** yfried|afk is now known as yfried_ | 09:05 | |
| *** kashyap has left #openstack-infra | 09:08 | |
| *** pelix has joined #openstack-infra | 09:13 | |
| *** dizquierdo has quit IRC | 09:14 | |
| *** markus_z has joined #openstack-infra | 09:15 | |
| *** tnovacik has quit IRC | 09:15 | |
| *** yfried_ is now known as yfried|afk | 09:15 | |
| *** yfried|afk is now known as yfried_ | 09:16 | |
| *** ssam2 has joined #openstack-infra | 09:16 | |
| *** sdake has joined #openstack-infra | 09:18 | |
| *** salv-orl_ has joined #openstack-infra | 09:19 | |
| *** medieval1 has joined #openstack-infra | 09:21 | |
| *** sdake_ has quit IRC | 09:22 | |
| *** sdake has quit IRC | 09:22 | |
| *** salv-orlando has quit IRC | 09:22 | |
| *** medieval1 has quit IRC | 09:26 | |
| *** Longgeek has joined #openstack-infra | 09:27 | |
| *** links has joined #openstack-infra | 09:27 | |
| openstackgerrit | Darragh Bailey proposed stackforge/python-jenkins: Provider helper classes for plugin data management https://review.openstack.org/154316 | 09:28 |
| *** otter768 has joined #openstack-infra | 09:28 | |
| *** ociuhandu has quit IRC | 09:28 | |
| *** amotoki has quit IRC | 09:31 | |
| *** otter768 has quit IRC | 09:33 | |
| *** mrmartin has quit IRC | 09:38 | |
| openstackgerrit | Ilya Shakhat proposed openstack-infra/project-config: Add Catalog project into Stackforge https://review.openstack.org/169671 | 09:41 |
| *** claudiub has joined #openstack-infra | 09:47 | |
| *** yfried_ is now known as yfried|afk | 09:58 | |
| *** dims_ has joined #openstack-infra | 10:00 | |
| *** dims__ has joined #openstack-infra | 10:01 | |
| *** ibiris is now known as ibiris_away | 10:01 | |
| *** cdent has joined #openstack-infra | 10:02 | |
| *** yfried|afk is now known as yfried_ | 10:02 | |
| *** alexpilotti has joined #openstack-infra | 10:03 | |
| *** mpavone has quit IRC | 10:03 | |
| *** claudiub has quit IRC | 10:03 | |
| xnox | Hey, there is something broken on Gerrit | 10:04 |
| xnox | there is this metal thing with a piece of paper, clicking on it does nothing, but it can be moved about. | 10:04 |
| xnox | is it suppose to do something? what is it? | 10:04 |
| xnox | seems broken to me. | 10:04 |
| *** dims_ has quit IRC | 10:04 | |
| openstackgerrit | Ilya Shakhat proposed openstack-infra/project-config: Add Catalog project into Stackforge https://review.openstack.org/169671 | 10:05 |
| chris___2 | try double-clicking it | 10:06 |
| openstackgerrit | Claudiu Belu proposed openstack-infra/project-config: Adds cloud-init to StackForge https://review.openstack.org/169293 | 10:07 |
| *** hashar is now known as hasharLunch | 10:07 | |
| xnox | chris___2: oh, that seems to work - it does tranformations. | 10:09 |
| *** ihrachyshka has joined #openstack-infra | 10:10 | |
| AJaeger | xnox, you can move it around. | 10:10 |
| *** dizquierdo has joined #openstack-infra | 10:12 | |
| *** dbite has joined #openstack-infra | 10:14 | |
| *** andreykurilin_ has quit IRC | 10:14 | |
| *** ghostpl_ has joined #openstack-infra | 10:17 | |
| *** wicope has quit IRC | 10:18 | |
| *** ssam2 has quit IRC | 10:18 | |
| *** tnovacik has joined #openstack-infra | 10:21 | |
| *** pblaho has joined #openstack-infra | 10:22 | |
| *** medieval1 has joined #openstack-infra | 10:22 | |
| *** btully has joined #openstack-infra | 10:22 | |
| *** jistr has quit IRC | 10:23 | |
| *** yfried_ is now known as yfried|afk | 10:24 | |
| *** yfried|afk is now known as yfried_ | 10:24 | |
| *** aarefiev has quit IRC | 10:25 | |
| *** Guest58016 has quit IRC | 10:25 | |
| *** medieval1 has quit IRC | 10:26 | |
| *** btully has quit IRC | 10:27 | |
| *** _nadya_ has joined #openstack-infra | 10:28 | |
| *** ssam2 has joined #openstack-infra | 10:31 | |
| *** ibiris_away is now known as ibiris | 10:31 | |
| kaisers1 | Hello Infra! | 10:34 |
| *** claudiub has joined #openstack-infra | 10:35 | |
| kaisers1 | Can someone pls tell me what exactly a 'network name' is? As in FIXED_NETWORK_NAME option for DevStack? A link to some doc would be great for instance... | 10:35 |
| *** aarefiev has joined #openstack-infra | 10:36 | |
| *** jistr has joined #openstack-infra | 10:36 | |
| *** samueldmq has joined #openstack-infra | 10:36 | |
| samueldmq | morning | 10:37 |
| samueldmq | there is a clippy on my review pages o/ | 10:37 |
| AJaeger | Hi kaisers1 , for DevStack, better ask on the QA channel. | 10:37 |
| AJaeger | samueldmq, Happy April's Fool Day! | 10:37 |
| kaisers1 | AJaeger: Thanks! | 10:38 |
| samueldmq | AJaeger, haha just loved that :) Happy April's Fool Day to you too | 10:38 |
| samueldmq | AJaeger, btw, I do not know how it was last April 1st, but this idea is really amazing :) | 10:38 |
| AJaeger | samueldmq, thanks to nibalizer | 10:39 |
| * AJaeger does not remember either | 10:39 | |
| samueldmq | AJaeger, that's why I am liking infra, we have lots of fun here :) | 10:39 |
| AJaeger | definitely ;) | 10:39 |
| samueldmq | nibalizer, thanks for making our day funny, and happy April Fools' Day | 10:41 |
| *** achanda has joined #openstack-infra | 10:44 | |
| *** ociuhandu has joined #openstack-infra | 10:44 | |
| *** ssam2_ has joined #openstack-infra | 10:46 | |
| *** ssam2 has quit IRC | 10:46 | |
| *** mfmcdonagh has quit IRC | 10:46 | |
| *** achanda has quit IRC | 10:48 | |
| *** mpaolino has quit IRC | 10:49 | |
| *** derekh has joined #openstack-infra | 10:52 | |
| *** e0ne is now known as e0ne_ | 10:53 | |
| *** ssam2_ has quit IRC | 10:55 | |
| *** e0ne_ is now known as e0ne | 10:57 | |
| *** oomichi has quit IRC | 10:58 | |
| *** doug-fish has joined #openstack-infra | 11:01 | |
| *** scheuran has joined #openstack-infra | 11:04 | |
| *** yfried__ has joined #openstack-infra | 11:04 | |
| *** yfried_ has quit IRC | 11:05 | |
| *** pc_m has joined #openstack-infra | 11:06 | |
| *** ssam2_ has joined #openstack-infra | 11:07 | |
| *** dizquierdo has quit IRC | 11:08 | |
| *** jistr is now known as jistr|demo | 11:11 | |
| *** masoz has quit IRC | 11:11 | |
| *** gulic has joined #openstack-infra | 11:14 | |
| *** dizquierdo has joined #openstack-infra | 11:19 | |
| *** dbite has quit IRC | 11:20 | |
| *** mwagner_lap has quit IRC | 11:20 | |
| *** dguitarbite has joined #openstack-infra | 11:20 | |
| *** mpavone has joined #openstack-infra | 11:21 | |
| *** pal has joined #openstack-infra | 11:21 | |
| *** medieval1 has joined #openstack-infra | 11:22 | |
| *** ricolin has joined #openstack-infra | 11:23 | |
| *** pal_ has quit IRC | 11:24 | |
| *** claudiub has quit IRC | 11:26 | |
| *** medieval1 has quit IRC | 11:27 | |
| *** mrmartin has joined #openstack-infra | 11:29 | |
| *** otter768 has joined #openstack-infra | 11:29 | |
| *** mrmartin has quit IRC | 11:30 | |
| *** otter768 has quit IRC | 11:34 | |
| *** ujuc has joined #openstack-infra | 11:35 | |
| *** gnuoy` is now known as gnuoy | 11:36 | |
| *** dulek has quit IRC | 11:40 | |
| *** yfried__ has quit IRC | 11:41 | |
| HenryG | Funny! But ... how do I disable it? | 11:42 |
| *** yfried__ has joined #openstack-infra | 11:44 | |
| *** ldnunes has joined #openstack-infra | 11:44 | |
| *** hasharLunch is now known as hashar | 11:45 | |
| *** Hal has joined #openstack-infra | 11:46 | |
| *** pal_ has joined #openstack-infra | 11:46 | |
| *** Hal is now known as Guest78517 | 11:46 | |
| mordred | HenryG: you don't disable it. It disables you. | 11:46 |
| *** yfried has joined #openstack-infra | 11:48 | |
| *** yfried__ has quit IRC | 11:49 | |
| *** pal has quit IRC | 11:49 | |
| *** dprince has joined #openstack-infra | 11:51 | |
| AJaeger | HenryG, wait 24 hours ;) | 11:53 |
| openstackgerrit | Radomir Dopieralski proposed openstack-infra/project-config: Remove the tuskar-ui-extras repository from Stackforge https://review.openstack.org/169715 | 11:55 |
| *** ajo has quit IRC | 11:57 | |
| rdopiera | Hi guys, we've moved one of our stackforge repositories out of stackforge, what is the procedure for removing the stackforge repository, apart from tha above patch? | 11:57 |
| *** BharatK has quit IRC | 11:58 | |
| mordred | rdopiera: when you say "moved out of stackforge" what do you mean? | 12:01 |
| mordred | gotcha. read the patch | 12:01 |
| *** e0ne is now known as e0ne_ | 12:01 | |
| rdopiera | mordred: it was Red Hat-specific extension code, and it's now kept in Red Hat-specific github account, but still public | 12:02 |
| mordred | rdopiera: so - actually, we dont' delete things around here | 12:02 |
| *** scheuran has quit IRC | 12:02 | |
| mordred | what we can do is move it to the openstack-attic next time we do renames | 12:02 |
| rdopiera | mordred: we don't want to have to maintain that repo and keep it up to date | 12:02 |
| mordred | yah - that's what the attic is for - its the place where repos go to have a nice retirement | 12:03 |
| rdopiera | mordred: that would work, do I need to do something for that to happen? | 12:03 |
| mordred | rdopiera: yeah - I just added a feedback to the patch - basically, you want to make the patch rename the repo in gerrit/projects.yaml from stackforge/tuskar-ui-extras to stackforge-attic/tuskar-ui-extras | 12:04 |
| mordred | the other bits, removing the jenkins jobs and whatnot are fine | 12:05 |
| jaypipes | mordred, jeblair: hahahaha on April Fool's joke on Gerrit. love it. :) | 12:05 |
| *** tnovacik has quit IRC | 12:05 | |
| *** yfried is now known as yfried|afk | 12:05 | |
| *** pblaho has quit IRC | 12:06 | |
| mordred | jaypipes: it was all nibalizer ... glad you enjoyed it! | 12:06 |
| jaypipes | :) | 12:06 |
| *** ajo has joined #openstack-infra | 12:07 | |
| *** bswartz has quit IRC | 12:09 | |
| *** mwagner_lap has joined #openstack-infra | 12:09 | |
| *** mpaolino has joined #openstack-infra | 12:09 | |
| *** ryanpetrello has quit IRC | 12:10 | |
| *** ryanpetrello has joined #openstack-infra | 12:11 | |
| *** BharatK has joined #openstack-infra | 12:13 | |
| rdopiera | mordred: ok, thanks | 12:13 |
| *** weshay has joined #openstack-infra | 12:13 | |
| *** arxcruz has quit IRC | 12:14 | |
| *** tnovacik has joined #openstack-infra | 12:14 | |
| *** markvoelker has joined #openstack-infra | 12:14 | |
| openstackgerrit | Radomir Dopieralski proposed openstack-infra/project-config: Remove the tuskar-ui-extras repository from Stackforge https://review.openstack.org/169715 | 12:16 |
| *** yfried|afk is now known as yfried | 12:16 | |
| *** ghostpl_ has quit IRC | 12:16 | |
| sdague | jaypipes: it's dynamically querying date, so sc68cal got to see it yesterday (being in taipei) | 12:17 |
| sdague | so his twitter stream leaked it for all the us folks :) | 12:17 |
| jaypipes | :) | 12:18 |
| *** skolekonov has joined #openstack-infra | 12:19 | |
| *** kgiusti has quit IRC | 12:20 | |
| *** medieval1 has joined #openstack-infra | 12:23 | |
| *** smccully_ has joined #openstack-infra | 12:23 | |
| *** smccully has joined #openstack-infra | 12:23 | |
| *** ala_ has joined #openstack-infra | 12:24 | |
| *** smccully has quit IRC | 12:24 | |
| *** dizquierdo has quit IRC | 12:24 | |
| *** smccully_ has quit IRC | 12:25 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Migrate API calls to task management https://review.openstack.org/168665 | 12:25 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add task management framework https://review.openstack.org/168664 | 12:25 |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard-webclient: Support for tags https://review.openstack.org/166847 | 12:25 |
| *** pal has joined #openstack-infra | 12:25 | |
| *** scheuran has joined #openstack-infra | 12:26 | |
| *** smccully has joined #openstack-infra | 12:27 | |
| *** Ala has quit IRC | 12:27 | |
| *** pal_ has quit IRC | 12:27 | |
| *** medieval1 has quit IRC | 12:27 | |
| *** david-lyle_ has joined #openstack-infra | 12:28 | |
| *** david-lyle_ has quit IRC | 12:28 | |
| *** kgiusti has joined #openstack-infra | 12:28 | |
| *** links has quit IRC | 12:30 | |
| *** gordc has joined #openstack-infra | 12:30 | |
| *** Somay has quit IRC | 12:30 | |
| *** pal has quit IRC | 12:31 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Add statsd counters to the TaskManager https://review.openstack.org/169724 | 12:31 |
| *** salv-orl_ has quit IRC | 12:32 | |
| *** claudiub has joined #openstack-infra | 12:34 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Use shade to get the client objects https://review.openstack.org/168603 | 12:34 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Add tests for shade cloud config parameter https://review.openstack.org/169339 | 12:34 |
| claudiub | sdague: hello. If you have some time, could you take a look at the cloud-init project proposal commit? https://review.openstack.org/#/c/169293/ | 12:36 |
| *** dizquierdo has joined #openstack-infra | 12:37 | |
| *** woodster_ has joined #openstack-infra | 12:38 | |
| openstackgerrit | Merged openstack-infra/shade: Add 'rebuild' to shade https://review.openstack.org/161067 | 12:38 |
| *** ghostpl_ has joined #openstack-infra | 12:39 | |
| *** pblaho has joined #openstack-infra | 12:39 | |
| *** aysyd has joined #openstack-infra | 12:40 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/reviewstats: Document installation from repository https://review.openstack.org/169728 | 12:42 |
| *** hogepodge has joined #openstack-infra | 12:42 | |
| *** _nadya_ has quit IRC | 12:43 | |
| *** nilasae has quit IRC | 12:43 | |
| *** e0ne_ is now known as e0ne | 12:43 | |
| *** hdd has joined #openstack-infra | 12:43 | |
| *** mpaolino has quit IRC | 12:46 | |
| *** BharatK has quit IRC | 12:48 | |
| *** spzala has joined #openstack-infra | 12:49 | |
| *** otter768 has joined #openstack-infra | 12:52 | |
| *** dboik has joined #openstack-infra | 12:52 | |
| *** salv-orlando has joined #openstack-infra | 12:53 | |
| jroll | clippy \o/ | 12:55 |
| *** dboik_ has joined #openstack-infra | 12:55 | |
| *** ajo has quit IRC | 12:56 | |
| *** baoli has joined #openstack-infra | 12:56 | |
| *** zul has quit IRC | 12:57 | |
| *** zul has joined #openstack-infra | 12:57 | |
| *** dboik has quit IRC | 12:57 | |
| *** flaviosr has joined #openstack-infra | 12:57 | |
| *** ajo has joined #openstack-infra | 12:58 | |
| *** baoli has quit IRC | 12:59 | |
| *** mattfarina has joined #openstack-infra | 12:59 | |
| *** baoli has joined #openstack-infra | 13:00 | |
| *** mpaolino has joined #openstack-infra | 13:02 | |
| *** carl_baldwin has joined #openstack-infra | 13:02 | |
| *** BharatK has joined #openstack-infra | 13:02 | |
| *** hdd has quit IRC | 13:02 | |
| AJaeger | Is zuul not receiving new events? | 13:03 |
| AJaeger | https://review.openstack.org/#/c/169714/ has been approved 13 mins ago and not queued | 13:03 |
| *** bhunter71 has joined #openstack-infra | 13:04 | |
| *** adalbas has joined #openstack-infra | 13:04 | |
| *** doug-fish has left #openstack-infra | 13:05 | |
| *** annegentle has joined #openstack-infra | 13:05 | |
| *** doug-fish has joined #openstack-infra | 13:06 | |
| *** julim has joined #openstack-infra | 13:07 | |
| *** medieval1 has joined #openstack-infra | 13:08 | |
| AJaeger | fungi, new jobs are not picked up ^ | 13:09 |
| fungi | it's possible zuul has ceased receiving events from gerrit again. checking | 13:10 |
| *** bknudson has quit IRC | 13:10 | |
| AJaeger | thanks for checking, fungi! | 13:13 |
| *** tonytan4ever has joined #openstack-infra | 13:14 | |
| zaro | fungi: when you have a moment would you be able to get me the prod gerrit data for testing? | 13:14 |
| *** dboik_ has quit IRC | 13:15 | |
| fungi | 12:48:51 utc seems to be the most recent event received by zuul from the gerrit event stream | 13:16 |
| *** yamamoto has joined #openstack-infra | 13:17 | |
| AJaeger | so, it misses events ;( | 13:17 |
| *** otter768 has quit IRC | 13:18 | |
| hashar | hi guys! | 13:19 |
| hashar | who the hell is that clippy at the bottom right of Gerrit web page ? :D | 13:19 |
| fungi | yep, gerrit show-queue lists a bunch of stream-events tasks waiting since 12:48:51 | 13:19 |
| fungi | i'll try killing them, but suspect i'll need to restart gerrit | 13:20 |
| *** tiswanso has joined #openstack-infra | 13:20 | |
| *** tiswanso has quit IRC | 13:22 | |
| AJaeger | hashar, happy 1st of April to you! | 13:22 |
| *** tiswanso has joined #openstack-infra | 13:22 | |
| *** mriedem_away is now known as mriedem | 13:24 | |
| sc68cal | sdague: yeah I did consider deleting the tweets but figured nobody really follows me on twitter so it'd still make a big splash | 13:24 |
| *** aysyd has quit IRC | 13:25 | |
| fungi | yeah, i tried deleting a lot of possible hung tasks in the gerrit task queue, but it's not helping so i'm going to restart gerrit to get things moving again | 13:25 |
| sdague | sc68cal: :) | 13:25 |
| hashar | AJaeger: good one :) | 13:25 |
| *** prmtl has quit IRC | 13:26 | |
| fungi | #status notice gerrit has been restarted to restore event streaming. any change events missed by zuul (between 12:48 and 13:28 utc) will need to be rechecked or have new approval votes set | 13:27 |
| openstackstatus | fungi: sending notice | 13:27 |
| *** mase_home has joined #openstack-infra | 13:28 | |
| *** mase_home has quit IRC | 13:28 | |
| -openstackstatus- NOTICE: gerrit has been restarted to restore event streaming. any change events missed by zuul (between 12:48 and 13:28 utc) will need to be rechecked or have new approval votes set | 13:28 | |
| fungi | AJaeger: care to add a new approval vote on https://review.openstack.org/169714 and make sure zuul picks it up? | 13:28 |
| AJaeger | fungi, approved - and picked up. | 13:29 |
| openstackstatus | fungi: finished sending notice | 13:29 |
| claudiub | hello folks, if you have a little bit of time, can you take a look at the cloud-init stackforge project proposal commit? https://review.openstack.org/#/c/169293/ .Thanks! :) | 13:31 |
| *** amitgandhinz has joined #openstack-infra | 13:34 | |
| *** aysyd has joined #openstack-infra | 13:34 | |
| *** dboik has joined #openstack-infra | 13:34 | |
| *** dkliban_afk is now known as dkliban | 13:35 | |
| *** alexpilotti has quit IRC | 13:35 | |
| *** signed8bit has joined #openstack-infra | 13:35 | |
| *** garyh has joined #openstack-infra | 13:40 | |
| *** hdd has joined #openstack-infra | 13:41 | |
| *** claudiub has quit IRC | 13:41 | |
| *** dhritishikhar_ has joined #openstack-infra | 13:44 | |
| *** hdd has quit IRC | 13:44 | |
| openstackgerrit | Gauvain Pocentek proposed openstack-infra/project-config: Add the cinder-msa stackforge project https://review.openstack.org/169740 | 13:46 |
| *** miqui has joined #openstack-infra | 13:47 | |
| *** wenlock has joined #openstack-infra | 13:47 | |
| *** mjturek1 has joined #openstack-infra | 13:47 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 13:48 | |
| *** wenlock has quit IRC | 13:49 | |
| jroll | AJaeger: I fixed up https://review.openstack.org/#/c/162162 for you | 13:49 |
| fungi | zaro: i've got a production db dump copied to ~fungi/gerrit.sql.gz.1 on review-dev for you now | 13:50 |
| jroll | nope, I lied, I should look at the code I rebase | 13:50 |
| *** wenlock has joined #openstack-infra | 13:50 | |
| AJaeger | jroll, thanks for fixing it nevertheless ;) | 13:51 |
| jroll | heh | 13:51 |
| jroll | AJaeger: it certainly doesn't fix pep8, just adding a new feature | 13:51 |
| AJaeger | jroll, pep8 should be fixed already, otherwise my patch wouldn't have merged | 13:52 |
| jroll | good point :) | 13:52 |
| AJaeger | jroll, as you commented: Let the original author fix it... | 13:52 |
| * jroll clearly needs to find more coffee | 13:52 | |
| AJaeger | jroll, pep8 is fixed, see also https://review.openstack.org/#/c/169453/ | 13:54 |
| AJaeger | but first get your coffee ;) | 13:54 |
| *** yamamoto has quit IRC | 13:55 | |
| jroll | AJaeger: yep, this has been pointed out to me :) | 13:55 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 13:55 | |
| *** jcoufal has quit IRC | 13:55 | |
| *** yamamoto has joined #openstack-infra | 13:56 | |
| pabelanger | nibalizer, well played sir | 13:56 |
| *** wicope has joined #openstack-infra | 13:56 | |
| *** sabeen has joined #openstack-infra | 13:57 | |
| *** ChuckC has quit IRC | 13:57 | |
| *** dhritishikhar_ has quit IRC | 13:57 | |
| *** malini has joined #openstack-infra | 13:58 | |
| *** signed8b_ has joined #openstack-infra | 13:59 | |
| *** bswartz has joined #openstack-infra | 13:59 | |
| jeblair | anteaya: in the tc meeting yesterday, you had concerns about whether the big tent approach would make your work harder. what are your concerns? | 14:00 |
| *** peristeri has joined #openstack-infra | 14:00 | |
| *** dustins has joined #openstack-infra | 14:00 | |
| *** yamamoto has quit IRC | 14:00 | |
| *** tsg_ has joined #openstack-infra | 14:01 | |
| malini | hello, I have a patch that is approved in workflow, but never got merged (after close to 1.5 days) https://review.openstack.org/#/c/142856/ . Can somebody help me figure out what's going on ? | 14:01 |
| *** signed8bit has quit IRC | 14:03 | |
| *** pblaho has quit IRC | 14:03 | |
| *** ajo has quit IRC | 14:03 | |
| zaro | fungi: thanks. | 14:03 |
| *** pblaho has joined #openstack-infra | 14:03 | |
| *** radez_g0n3 is now known as radez | 14:04 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:04 | |
| *** zz_jgrimm is now known as jgrimm | 14:05 | |
| *** scottda has joined #openstack-infra | 14:06 | |
| *** tsg_ has quit IRC | 14:06 | |
| scottda | I was very disturbed to see an annoying Microsoft Office paperclip on the review.openstack.org pages.... | 14:06 |
| scottda | Especially on my Linux workstation... | 14:06 |
| scottda | until avishay pointed out that it was probably an April Fool's joke. | 14:07 |
| scottda | Nice one! | 14:07 |
| *** signed8b_ has quit IRC | 14:08 | |
| *** hdd has joined #openstack-infra | 14:09 | |
| *** yamamoto has joined #openstack-infra | 14:09 | |
| *** ghostpl_ has quit IRC | 14:09 | |
| *** annegentle has quit IRC | 14:09 | |
| *** zul has quit IRC | 14:10 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add permalink to change view https://review.openstack.org/169766 | 14:11 |
| *** btully has joined #openstack-infra | 14:11 | |
| *** zul has joined #openstack-infra | 14:11 | |
| *** pblaho has quit IRC | 14:12 | |
| *** ghostpl_ has joined #openstack-infra | 14:12 | |
| *** _nadya_ has joined #openstack-infra | 14:14 | |
| *** nelsnelson has joined #openstack-infra | 14:15 | |
| *** sdake has joined #openstack-infra | 14:16 | |
| *** e0ne is now known as e0ne_ | 14:17 | |
| *** mtanino has joined #openstack-infra | 14:18 | |
| *** ZZelle has quit IRC | 14:19 | |
| *** ZZelle has joined #openstack-infra | 14:20 | |
| *** timcline has joined #openstack-infra | 14:21 | |
| mtreinish | anteaya: the depends-on governance patch landed if you wanted to push the big green check on: https://review.openstack.org/#/c/167243/ :) | 14:22 |
| *** yamamoto has quit IRC | 14:22 | |
| *** e0ne_ is now known as e0ne | 14:23 | |
| openstackgerrit | Merged stackforge/gertty: Fix repository checking https://review.openstack.org/169468 | 14:24 |
| mestery | Good morning infra! Any idea why this patch isn't going into the merge queue? It passed the check queue and it's dependency is merged: https://review.openstack.org/#/c/167898/ | 14:24 |
| *** _nadya_ has quit IRC | 14:25 | |
| openstackgerrit | Merged openstack-infra/shade: Fix a use of in where it should be equality https://review.openstack.org/169105 | 14:25 |
| mtreinish | mestery: anti-db2 bias? :) | 14:26 |
| mestery | mtreinish: lol, I'm not sure mriedem would be thrilled with that ;) | 14:26 |
| jroll | mestery: there was a thing earlier | 14:27 |
| jroll | 13:28:35 -- | Notice(openstackstatus): NOTICE: gerrit has been restarted to restore event streaming. any change events missed by zuul (between 12:48 and 13:28 utc) will need to be rechecked or have new approval votes set | 14:27 |
| mestery | jroll: Ack, thanks! | 14:27 |
| mtreinish | mestery: yeah, I normally hit try getting someone else to hit +A again when that happens | 14:27 |
| jroll | :) | 14:28 |
| mriedem | ? | 14:28 |
| mtreinish | although it's normally around Depends-On when I see it not go to gate automatically | 14:28 |
| *** bknudson has joined #openstack-infra | 14:28 | |
| mriedem | oh | 14:28 |
| *** pblaho has joined #openstack-infra | 14:29 | |
| mestery | mriedem: Working on getting the DB2 fix in :) | 14:29 |
| mriedem | i rechecked it | 14:29 |
| mriedem | it's in the check queue now | 14:29 |
| mriedem | i have a bias against neutron migrations using direct sql executes rather than using sqlalchemy | 14:29 |
| mriedem | since sqlalchemy hides the differences in the backends which cause these bugs | 14:30 |
| jeblair | mriedem, mestery: it needs another +A, recheck won't cut it | 14:30 |
| mestery | jeblair: Thanks! 'm working to find anotehr +A, unless I can remove mine, then re-add it, would that work? | 14:30 |
| mestery | Woops, HenryG just helped me :) | 14:30 |
| jeblair | mriedem, mestery: since it already has a +1 from jenkins, when it returns from the check pipelen, gerrit will not emit another event and zuul will not notice | 14:31 |
| mestery | jeblair: I think HenryG just helped us. | 14:31 |
| mriedem | yeah it's in gate now | 14:31 |
| jeblair | mriedem, mestery: yeah, you can remove and re-add a +A | 14:31 |
| jeblair | mtreinish: ^ | 14:31 |
| mestery | mriedem: Yay! | 14:32 |
| *** mpaolino has quit IRC | 14:33 | |
| *** carl_baldwin has quit IRC | 14:33 | |
| *** yamamoto has joined #openstack-infra | 14:34 | |
| *** zz_dimtruck is now known as dimtruck | 14:36 | |
| *** annegentle has joined #openstack-infra | 14:36 | |
| rcarrillocruz | clarkb: i addressed your comments on https://review.openstack.org/#/c/168572/ | 14:37 |
| *** cdent_ has joined #openstack-infra | 14:37 | |
| *** cdent has quit IRC | 14:37 | |
| *** cdent_ is now known as cdent | 14:38 | |
| *** alexpilotti has joined #openstack-infra | 14:38 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/system-config: Add a Fedora 21 node to tripleo cloud https://review.openstack.org/169778 | 14:38 |
| openstackgerrit | Derek Higgins proposed openstack-infra/system-config: Remove hp1 log handlers https://review.openstack.org/169779 | 14:38 |
| *** adreznec has quit IRC | 14:44 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Namespace caching per cloud https://review.openstack.org/168615 | 14:45 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Allow for passing cache class in as a parameter https://review.openstack.org/162148 | 14:45 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Migrate API calls to task management https://review.openstack.org/168665 | 14:45 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add task management framework https://review.openstack.org/168664 | 14:45 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add delete_image call https://review.openstack.org/169783 | 14:45 |
| mordred | jeblair: ^^ you may find that last patch amusing | 14:45 |
| *** patrickeast has joined #openstack-infra | 14:45 | |
| mordred | jeblair: I mean, you probably won't | 14:45 |
| *** yamahata has joined #openstack-infra | 14:48 | |
| mordred | Shrews: ^^ you may also enjoy the delete_image patch | 14:48 |
| *** adreznec has joined #openstack-infra | 14:48 | |
| *** prmtl has joined #openstack-infra | 14:48 | |
| mordred | jeblair, Shrews: I mean, I personally find it VERY important to change the parameter names between v1 and v2 apis myself | 14:48 |
| *** timcline_ has joined #openstack-infra | 14:49 | |
| *** unicell1 has joined #openstack-infra | 14:49 | |
| Shrews | mordred: oh geez... i give up. game over. | 14:49 |
| *** timcline has quit IRC | 14:49 | |
| *** unicell has quit IRC | 14:50 | |
| *** timcline has joined #openstack-infra | 14:51 | |
| *** mpaolino has joined #openstack-infra | 14:51 | |
| *** scottda has left #openstack-infra | 14:52 | |
| jeblair | mordred: it's frustrating i know, but people were confused before and passing in pictures of cats instead of image ids. | 14:52 |
| mordred | jeblair: THAT's why my script was broken | 14:52 |
| *** medieval1 has quit IRC | 14:52 | |
| *** timcline_ has quit IRC | 14:53 | |
| *** dguitarbite has quit IRC | 14:54 | |
| *** yfried has quit IRC | 14:55 | |
| mtreinish | jeblair: but, who would ever want to delete a picture of a cat? | 14:55 |
| *** prmtl has quit IRC | 14:56 | |
| fungi | of course it does | 14:56 |
| Shrews | mordred: what's the deal with the 'timeout' param change? | 14:57 |
| *** emagana has joined #openstack-infra | 14:58 | |
| clarkb | what did I wake up to? | 14:58 |
| mordred | Shrews: well ... | 14:58 |
| clarkb | also we need more cat inages in glance | 14:58 |
| mordred | Shrews: oh piddle. I'd intended to make those two patches | 14:58 |
| *** yamamoto has quit IRC | 14:58 | |
| mordred | Shrews: well - the story there is that glanceclient accepts the param, but it does type validation on it | 14:59 |
| mordred | so if you pass it in, it's going to try to convert it to a float | 14:59 |
| mordred | when what we want None to mean at shade is "we're not setting this" | 14:59 |
| jlvillal | dhellmann: I have two changes for https://github.com/dhellmann/ansible-znc-on-znc that I am working on. 1) Support Fedora. 2) Support specifying a user to run znc, as I like to dedicate a user to run znc. | 14:59 |
| *** ala_ has quit IRC | 15:00 | |
| jlvillal | dhellmann: Would you be interested in those changes? | 15:00 |
| Shrews | mordred: the other clients accept None? | 15:00 |
| *** Bsony has joined #openstack-infra | 15:00 | |
| mordred | Shrews: novaclient does - I'm going to walk through the others in just a sec | 15:00 |
| *** ildikov_ has quit IRC | 15:01 | |
| mordred | Shrews: altough we could probably make a helper method to get common keyword args for the client constructors | 15:01 |
| mordred | Shrews: and just do the include/exclude in one place and use it everywhere | 15:01 |
| Shrews | mordred: that would assume SOME consistency b/w clients, so that's just silly :-P | 15:01 |
| *** carl_baldwin has joined #openstack-infra | 15:02 | |
| *** asselin has joined #openstack-infra | 15:02 | |
| *** annegent_ has joined #openstack-infra | 15:02 | |
| *** mpavone has quit IRC | 15:03 | |
| *** flaviosr has quit IRC | 15:03 | |
| *** annegentle has quit IRC | 15:04 | |
| *** packet has joined #openstack-infra | 15:04 | |
| nibalizer | glad the reaction to clippy is generally positive | 15:05 |
| mtreinish | nibalizer: I hope clippy is here to stay, so many memories. I miss his helpful tips though... | 15:05 |
| bookwar | nibalizer: you sound like there are non-positive reactions. really? | 15:05 |
| nibalizer | https://review.openstack.org/#/c/169509/ if you want to have more fun with it <- jeblair clarkb mordred | 15:05 |
| nibalizer | bookwar: yea idunno why this thing didnt' catch on | 15:06 |
| *** smyers has joined #openstack-infra | 15:06 | |
| fungi | i thought the same thing about microsoft bob | 15:06 |
| *** prmtl has joined #openstack-infra | 15:07 | |
| *** claudiub has joined #openstack-infra | 15:07 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Add statsd counters to the TaskManager https://review.openstack.org/169724 | 15:10 |
| claudiub | AJaeger: hello | 15:10 |
| bookwar | hi, do you know why we lost Jenkins vote here: https://review.openstack.org/#/c/169735/ this looks like a standard patch and we have it voting on similar https://review.openstack.org/#/c/163367/ | 15:11 |
| claudiub | bookwar: hello, gerrit was restarted, so new commits / patchsets were missed by gerrit. doing a simple recheck solves the issue :) | 15:12 |
| *** jlibosva has quit IRC | 15:13 | |
| bookwar | claudiub: thanks, i like that it has an explanation :) | 15:14 |
| claudiub | bookwar: no problem. :) | 15:14 |
| *** jlibosva has joined #openstack-infra | 15:14 | |
| *** ildikov_ has joined #openstack-infra | 15:16 | |
| *** rdopiera has quit IRC | 15:17 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add delete_image call https://review.openstack.org/169783 | 15:20 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Skip passing in timeout to glance if it's not set https://review.openstack.org/169803 | 15:20 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Poll on the actual image showing up https://review.openstack.org/169804 | 15:20 |
| mordred | Shrews, jeblair: the tears continue ^^ | 15:21 |
| fungi | bookwar: change events between 12:48 and 13:28 utc were missed by zuul because gerrit stopped emitting them | 15:21 |
| mordred | jeblair, fungi: https://review.openstack.org/#/c/169783/ <-- sticky -1 | 15:22 |
| mordred | not sure why | 15:22 |
| clarkb | trivial rebase? | 15:23 |
| bookwar | fungi: btw, is there any standard place i should look for such issues? certain status log.. | 15:23 |
| mordred | ah - I understand | 15:23 |
| mordred | I rebased wrong, and it did trigger trivial rebase | 15:23 |
| mordred | neat | 15:23 |
| mordred | the system helped :) | 15:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add delete_image call https://review.openstack.org/169783 | 15:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Poll on the actual image showing up https://review.openstack.org/169804 | 15:24 |
| *** kashyap has joined #openstack-infra | 15:24 | |
| *** thingee has joined #openstack-infra | 15:24 | |
| kashyap | clarkb: Heya, when you get a moment, | 15:24 |
| clarkb | kashyap: hi | 15:25 |
| kashyap | Is 2MB of libvirtd log file acceptable for all DevStack runs? | 15:25 |
| kashyap | clarkb: I.e -- https://review.openstack.org/#/c/169679/ | 15:25 |
| kashyap | Please see the rationale outlined in the commit message. | 15:25 |
| *** erikmwil_ has joined #openstack-infra | 15:25 | |
| *** erikmwilson has quit IRC | 15:25 | |
| *** erikmwil_ is now known as erikmwilson | 15:25 | |
| *** erikmwilson_ has joined #openstack-infra | 15:25 | |
| krotscheck | nibalizer: Nicely done | 15:25 |
| clarkb | kashyap: thats 2 MB compressed, its probably fine as long as you don't try indexing it again :) | 15:26 |
| openstackgerrit | Serg Melikyan proposed openstack-infra/project-config: Rename stackforge/murano to openstack/murano https://review.openstack.org/167934 | 15:27 |
| kashyap | clarkb: Hmm, you're right. | 15:27 |
| kashyap | clarkb: So, is that a yay or nay for the above change? :-) | 15:27 |
| mordred | clarkb, fungi: btw - I regularly get 504 Gateway Timeouts uploading to swift in IAD | 15:27 |
| jeblair | mordred: at the start of the upload or after a certain time? | 15:28 |
| mordred | clarkb, fungi: notmyname tells me this is not a swift error | 15:28 |
| clarkb | kashyap: I think I am ok with it but will -2 attempts to index that file | 15:28 |
| mordred | jeblair: after a certain time | 15:28 |
| mordred | and it pretty much happens every time in IAD | 15:28 |
| clarkb | kashyap: also we are moving to putting logs in swift which makes this much less of a major concern | 15:28 |
| mordred | so I'm thinking we may need to file a support ticket | 15:28 |
| kashyap | clarkb: The reason I was trying to enable them was, libvirt on Gate is a fossil (and Ubuntu's Virt maintenance is less than stellar) | 15:28 |
| fungi | mordred: makes me wonder if rax has a proxy and it's suffering | 15:28 |
| jeblair | mordred: is this new? | 15:29 |
| mordred | jeblair: we've never tried doing it before | 15:29 |
| kashyap | clarkb: So, when debugging all kinds of Virt issues, it saves a ton of time to have the source of the error, right away | 15:29 |
| jeblair | mordred: (or did you just start trying to use iad) | 15:29 |
| kashyap | clarkb: Nice! | 15:29 |
| clarkb | kashyap: my recent expedition into libvirt suggests thats hardly the worst of our issues :P | 15:29 |
| mordred | jeblair: just started trying to use IAD | 15:29 |
| *** tnovacik has quit IRC | 15:29 | |
| jeblair | mordred: k. good to know. thanks. | 15:29 |
| mordred | jeblair: I mean, I started a few days ago ... but I've had other fish to fry so haven't mentioned it yet | 15:29 |
| kashyap | clarkb: :-) | 15:29 |
| clarkb | kashyap: did you know that virsh will happily read an invalid cpu_map.xml and report cpu models that libvirt lcaims does not exist? I still need to go figure out how to file a bug for that | 15:29 |
| *** ajmiller has quit IRC | 15:29 | |
| mordred | swiftclient.exceptions.ClientException: Object POST failed: https://storage101.iad3.clouddrive.com/v1/MossoCloudFS_622b11a1-5dfa-43b4-9f58-4ad3c6dbc4a0/images/dib-ubuntu-trusty 504 Gateway Time-out [first 60 chars of response] <html><body><h1>504 Gateway Time-out</h1> | 15:29 |
| mordred | jeblair: ^^ for reference | 15:30 |
| kashyap | clarkb: First, let's finish this one -- "Will -2 attempts to index that file" | 15:30 |
| kashyap | clarkb: Can you rephrase that? | 15:30 |
| *** ayoung_ZZZzzz__z is now known as ayoung_snort | 15:30 | |
| kashyap | clarkb: About the libvirt bug, please file it here -- bugzilla.redhat.com/bugzilla/enter_bug.cgi?product=Virtualization%20Tools&component=libvirt | 15:30 |
| clarkb | kashyap: yes, previously we attempted to index that log file with elasticsearch, but its too large with the number of jobs we run to do that in a reasonable amount of time | 15:30 |
| *** ayoung_snort is now known as ayoung_yawn | 15:31 | |
| *** _nadya_ has joined #openstack-infra | 15:31 | |
| *** sputnik13 has joined #openstack-infra | 15:31 | |
| *** ayoung_yawn is now known as ayoung_grumble | 15:31 | |
| *** ayoung_grumble is now known as ayoung | 15:31 | |
| clarkb | kashyap: so as long as its sort of the back pocket log file and not a ZOMG we need this for elastic-recheck its fine | 15:31 |
| kashyap | clarkb: Oh, okay, quick context -- | 15:31 |
| kashyap | clarkb: Previously it failed because, it was awfully large, and the log filters were a "catch-all" insane debug level | 15:31 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Add config option for git clone URL https://review.openstack.org/169469 | 15:31 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Fix changeset fetching https://review.openstack.org/124239 | 15:31 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Allow the configured git-url to override gerrit https://review.openstack.org/169810 | 15:31 |
| clarkb | kashyap: its still too large | 15:31 |
| kashyap | clarkb: It's much more targeted and specifc this time. | 15:31 |
| *** prmtl has quit IRC | 15:32 | |
| kashyap | clarkb: Hmm, understood. | 15:32 |
| * clarkb goes to get an uncompressed size | 15:32 | |
| clarkb | kashyap: 21MB | 15:33 |
| kashyap | clarkb: Was about type that here. . . | 15:33 |
| kashyap | clarkb: Okay, fair enough, indexing 21MB of uncompressed is bad. | 15:33 |
| clarkb | kashyap: *25k tests/day | 15:33 |
| clarkb | (that is approximately our test peak under high load iirc) | 15:33 |
| kashyap | Hopefully, in the not-too distant future this'll become a non-issue. | 15:34 |
| *** bswartz has quit IRC | 15:34 | |
| nibalizer | krotscheck: thanks :) | 15:34 |
| *** reed has joined #openstack-infra | 15:35 | |
| kashyap | clarkb: Thanks for the no. of tests/day stat, it brings things into perspective. | 15:36 |
| clarkb | kashyap: that isn't our load right now since we are post feature freeze but typically in the run up to a feature freeze we get way up there in the tests/day count | 15:36 |
| kashyap | clarkb: Yeah, I noticed you said "peak under high load) | 15:37 |
| *** e0ne is now known as e0ne_ | 15:37 | |
| *** e0ne_ is now known as e0ne | 15:38 | |
| kashyap | clarkb: Please note your comment (along w/ your note on "move to Swift" to alleviate that) on that review, when you get time. So this context is archived for future. | 15:38 |
| *** ajmiller has joined #openstack-infra | 15:38 | |
| clarkb | kashyap: yup I left a +1 | 15:38 |
| krotscheck | In macros.yaml, can I declare a builder with a parameterized name? | 15:38 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Allow the configured git-url to override gerrit https://review.openstack.org/169810 | 15:39 |
| kashyap | clarkb: And, about the invalid caps libvirt bug you noticed, please don't forget to file one :-) | 15:39 |
| jroll | mordred: this IAD thing makes me sad | 15:39 |
| mordred | jroll: is it a thing thing? | 15:40 |
| jroll | mordred: for you, apparently, idk | 15:40 |
| *** AJaeger has quit IRC | 15:40 | |
| mordred | jroll: :) | 15:40 |
| *** ChuckC has joined #openstack-infra | 15:40 | |
| *** jheroux has joined #openstack-infra | 15:40 | |
| jroll | mordred: what's your failure rate look like? | 15:40 |
| *** hdd has quit IRC | 15:41 | |
| *** arxcruz has joined #openstack-infra | 15:41 | |
| mordred | jroll: well, I'm uploading 600M files, so I don't make requests that quickly | 15:41 |
| mordred | jroll: but I'd say "most of the time | 15:41 |
| jroll | k | 15:41 |
| mordred | jroll: whereas I have not seen that error at all on DFW or ORD | 15:41 |
| jroll | mordred: this is to glance or swift? | 15:42 |
| mordred | jroll: swift | 15:42 |
| jroll | alright | 15:42 |
| * jroll pokes | 15:42 | |
| mordred | jroll: step one - upload to swift, step two, import to glance | 15:42 |
| *** scheuran has quit IRC | 15:42 | |
| jroll | mordred: cool, seeing if I can bug people; I'd still recommend a ticket in parallel | 15:43 |
| *** Somay has joined #openstack-infra | 15:43 | |
| mordred | jroll: cool. thanks! | 15:43 |
| * mordred goes to lunch - will file ticket when he gets back | 15:43 | |
| zigo_ | Is there a way to tell jenkins-jobs-builder to ignore certificate errors? | 15:43 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: WIP - Enable Karma as an independent build. https://review.openstack.org/169814 | 15:46 |
| krotscheck | clarkb: Is this a thing that's legal? https://review.openstack.org/#/c/169814/1/jenkins/jobs/macros.yaml | 15:46 |
| *** tnovacik has joined #openstack-infra | 15:47 | |
| *** marun has joined #openstack-infra | 15:47 | |
| *** bswartz has joined #openstack-infra | 15:47 | |
| clarkb | krotscheck: not quite, the name shouldn't be templated at all (only job templates need templated names) and you need to use a single layer of {}s for variable substition | 15:48 |
| jeblair | krotscheck: left comment | 15:48 |
| clarkb | krotscheck: so if you do name: npm-install-package | 15:48 |
| clarkb | and remove extra {}s it should be close to what you ant | 15:48 |
| *** aysyd has quit IRC | 15:49 | |
| *** xyang1 has joined #openstack-infra | 15:49 | |
| *** yamahata has quit IRC | 15:50 | |
| *** mpaolino has quit IRC | 15:50 | |
| *** yamahata has joined #openstack-infra | 15:50 | |
| *** kashyap has left #openstack-infra | 15:51 | |
| *** medieval1 has joined #openstack-infra | 15:53 | |
| *** hdd has joined #openstack-infra | 15:55 | |
| *** unicell1 has quit IRC | 15:55 | |
| *** dannywilson has joined #openstack-infra | 15:56 | |
| *** Somay has quit IRC | 15:56 | |
| *** carl_baldwin has quit IRC | 15:56 | |
| *** deepakcs has joined #openstack-infra | 15:57 | |
| *** medieval1 has quit IRC | 15:58 | |
| sputnik13 | err, what's with the microsoft office paperclip thing on review.openstack.org? | 15:59 |
| *** teran_ has joined #openstack-infra | 15:59 | |
| claudiub | hello, if any core reviewer has a little bit of time to look at the cloud-init project proposal, that would great! https://review.openstack.org/#/c/169293/ . It already has a +2. | 16:00 |
| *** dboik_ has joined #openstack-infra | 16:00 | |
| *** tonytan_brb has joined #openstack-infra | 16:02 | |
| *** teran has quit IRC | 16:02 | |
| *** tonytan4ever has quit IRC | 16:02 | |
| fungi | sputnik13: it's a new feature we've added, in observance of the current international holiday | 16:02 |
| *** YorikSar has quit IRC | 16:02 | |
| *** ricolin has quit IRC | 16:02 | |
| sputnik13 | ah, pfff | 16:03 |
| sputnik13 | ok :-D | 16:03 |
| *** rlandy has quit IRC | 16:03 | |
| *** carl_baldwin has joined #openstack-infra | 16:03 | |
| *** mpaolino has joined #openstack-infra | 16:04 | |
| *** dboik has quit IRC | 16:04 | |
| *** aysyd has joined #openstack-infra | 16:04 | |
| *** malini has quit IRC | 16:04 | |
| *** dizquierdo has quit IRC | 16:07 | |
| *** dboik_ has quit IRC | 16:08 | |
| *** dboik has joined #openstack-infra | 16:08 | |
| *** patrickeast has quit IRC | 16:09 | |
| *** SumitNaiksatam has quit IRC | 16:13 | |
| *** dtantsur is now known as dtantsur|afk | 16:13 | |
| *** dustins has quit IRC | 16:14 | |
| *** ghostpl_ has quit IRC | 16:14 | |
| *** Sukhdev has joined #openstack-infra | 16:16 | |
| *** alexpilotti has quit IRC | 16:16 | |
| *** tqtran_afk has joined #openstack-infra | 16:16 | |
| asselin | fungi, sputnik13 :) | 16:16 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: WIP - Enable Karma as an independent build. https://review.openstack.org/169829 | 16:17 |
| *** ghostpl_ has joined #openstack-infra | 16:17 | |
| *** malini has joined #openstack-infra | 16:17 | |
| *** tqtran_afk is now known as tqtran | 16:18 | |
| *** malini has quit IRC | 16:18 | |
| *** erikmwil_ has joined #openstack-infra | 16:20 | |
| *** erikmwilson has quit IRC | 16:20 | |
| *** erikmwil_ is now known as erikmwilson | 16:20 | |
| *** dustins has joined #openstack-infra | 16:20 | |
| *** e0ne has quit IRC | 16:20 | |
| *** malini has joined #openstack-infra | 16:20 | |
| *** erikmwilson has quit IRC | 16:20 | |
| *** andreykurilin_ has joined #openstack-infra | 16:21 | |
| *** erikmwilson_ is now known as erikmwilson | 16:21 | |
| *** annegent_ has quit IRC | 16:22 | |
| *** deepakcs has quit IRC | 16:23 | |
| *** asselin has quit IRC | 16:24 | |
| *** bswartz has quit IRC | 16:24 | |
| *** ivar-lazzaro has joined #openstack-infra | 16:25 | |
| fungi | https://com.google/ is fun today | 16:25 |
| jeblair | !ynnuf | 16:26 |
| openstack | jeblair: Error: "ynnuf" is not a valid command. | 16:26 |
| *** sergsh has quit IRC | 16:26 | |
| *** ildikov_ has quit IRC | 16:26 | |
| *** amitgandhinz has quit IRC | 16:26 | |
| cinerama | lol | 16:26 |
| *** aduarte has quit IRC | 16:27 | |
| JayF | sdague: I'd love to get more insight into what you meant here: https://review.openstack.org/#/c/155117/ -- this is the sort of thing that's easy to ignore until a change breaks it again :/ | 16:27 |
| *** amitgandhinz has joined #openstack-infra | 16:28 | |
| sdague | JayF: I'm 100% opposed to just piling every single devstack using job on devstack changes, because it makes getting anything done on the devstack project impossible. | 16:29 |
| *** ivar-lazzaro has quit IRC | 16:30 | |
| JayF | sdague: I agree with that approach, which is why I didn't propose this vote when creating the job. I'm just trying to determine the best way to insure jobs that Ironic gates on aren't broken by Devstack -- the agent_ssh-src job has been broken twice by devstack, because it has interactions between Ironic and Swift that the normal Ironic jobs don't. | 16:30 |
| *** ivar-lazzaro has joined #openstack-infra | 16:30 | |
| JayF | sdague: I want to know what you'd suggest as an alternate solution to running the job to achieve that goal? | 16:30 |
| jgriffith | clarkb: Did you add clippy to the dashboard :) | 16:31 |
| sdague | JayF: can you point to the changes that caused pain here? | 16:32 |
| JayF | Yeah, give me a bit to spulunk it though, it was back during the Ironic mid-cycle | 16:32 |
| clarkb | jhesketh: that was all nibalizer | 16:33 |
| *** malini has quit IRC | 16:33 | |
| sdague | and, honestly, I think a more productive path would be to move the ironic devstack bits back into the ironic tree as a devstack plugin, so that it's directly fixable by the ironic team | 16:33 |
| sdague | because there are a lot of non main path things the ironic paths in devstack do | 16:34 |
| *** Somay has joined #openstack-infra | 16:34 | |
| jeblair | anteaya: i think your draft email looks fine -- i think that's exactly what's needed to kick off a discussion | 16:36 |
| *** carl_baldwin has quit IRC | 16:36 | |
| *** arxcruz has quit IRC | 16:36 | |
| fungi | heads up, per discussion on #openstack-qa i'm going to manually submit devstack change https://review.openstack.org/169096 to merge so as to unwedge stable/juno integration testing. it's currently both blocking and blocked on nova change https://review.openstack.org/169538 | 16:36 |
| *** jaypipes has quit IRC | 16:37 | |
| JayF | sdague: http://bugs.launchpad.net/ironic/+bug/1421006 is the bug, I'm searching right now for the related change that broke it | 16:37 |
| openstack | Launchpad bug 1421006 in Ironic "agent_ssh tempest job failing with ImageDownloadError" [Critical,Fix released] | 16:37 |
| *** esker has joined #openstack-infra | 16:37 | |
| *** akislitsky has joined #openstack-infra | 16:37 | |
| *** crc32 has joined #openstack-infra | 16:37 | |
| *** malini has joined #openstack-infra | 16:38 | |
| *** crc32 has quit IRC | 16:38 | |
| clarkb | er jgriffith is was all nibalizer | 16:38 |
| JayF | sdague: https://github.com/openstack-dev/devstack/commit/e8bc2b82a04f4cca251ed7437f738672107428a3 is the change that broke it, and https://review.openstack.org/#/c/155357/ fixed it | 16:39 |
| *** andreykurilin_ has quit IRC | 16:39 | |
| thingee | clarkb: I've been waiting for clippy to nitpick at code reviews | 16:39 |
| *** SumitNaiksatam has joined #openstack-infra | 16:39 | |
| openstackgerrit | Merged openstack-infra/project-config: Adds cloud-init to StackForge https://review.openstack.org/169293 | 16:39 |
| thingee | "looks like that comments is ending without a period. Would you like to reup the patch?" | 16:39 |
| claudiub | fungi hello | 16:39 |
| fungi | claudiub: hi there | 16:40 |
| *** markus_z has quit IRC | 16:40 | |
| claudiub | fungi: new project merged, so new cores need to be added. :D | 16:40 |
| claudiub | fungi: https://review.openstack.org/#/c/169293/ | 16:40 |
| *** ayoung has quit IRC | 16:41 | |
| *** skolekonov has quit IRC | 16:41 | |
| jgriffith | clarkb: :) | 16:41 |
| fungi | claudiub: yep, it'll take a little while before the group from that change shows up in gerrit. i'll take a look in half an hour or so | 16:41 |
| *** dkranz has quit IRC | 16:41 | |
| *** unicell has joined #openstack-infra | 16:41 | |
| claudiub | fungi: ah, i see. ok then. :) | 16:41 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 16:43 | |
| *** pblaho has quit IRC | 16:43 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 16:43 | |
| *** yamamoto has joined #openstack-infra | 16:47 | |
| *** Swami has joined #openstack-infra | 16:47 | |
| *** jistr|demo has quit IRC | 16:47 | |
| *** amitgandhinz has quit IRC | 16:48 | |
| *** derekh has quit IRC | 16:49 | |
| *** Guest78517 has quit IRC | 16:51 | |
| *** ZZelle is now known as ZZelle__ | 16:51 | |
| NobodyCam | FYI nice paper clip! | 16:51 |
| *** yamamoto has quit IRC | 16:52 | |
| *** dims__ has quit IRC | 16:53 | |
| *** jlvillal has quit IRC | 16:53 | |
| *** dims_ has joined #openstack-infra | 16:53 | |
| *** dkranz has joined #openstack-infra | 16:53 | |
| zaro | clippy! | 16:54 |
| malini | fungi: hello..I have a patch which somehow doesn't seem to get into the merge pipeline https://review.openstack.org/#/c/142856/ ? Can you help me figure out what's going on? | 16:54 |
| JayF | malini: s/reverify/recheck/ on your comment -- reverify was replaced by recheck aiui | 16:54 |
| fungi | malini: it's missing any code review +2 votes | 16:54 |
| *** ssam2_ has quit IRC | 16:54 | |
| *** medieval1 has joined #openstack-infra | 16:54 | |
| *** ayoung has joined #openstack-infra | 16:55 | |
| malini | fungi: duh…I was just looking at the workflow approval | 16:55 |
| malini | Thanks!! | 16:55 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Add release notes to the README https://review.openstack.org/165485 | 16:56 |
| *** tnovacik has quit IRC | 16:57 | |
| *** dboik has quit IRC | 16:57 | |
| *** dboik has joined #openstack-infra | 16:57 | |
| *** hdd has quit IRC | 16:57 | |
| *** tiswanso has quit IRC | 16:58 | |
| fungi | malini: since you added your workflow +1 approval vote when there was no code review +2 present, you'll probably need to reset and re-apply that workflow +1 so that zuul will know to add it into the gate pipeline | 16:59 |
| *** medieval1 has quit IRC | 16:59 | |
| *** tiswanso has joined #openstack-infra | 17:00 | |
| *** alexpilotti has joined #openstack-infra | 17:00 | |
| fungi | malini: e.g. review the change again but set your workflow vote to 0, then once more setting your workflow vote to +1 again. when that happens it should go straight into the gate pipeline | 17:00 |
| *** jlvillal has joined #openstack-infra | 17:00 | |
| malini | fungi: thanks! I now see it in the gate queue | 17:01 |
| *** dustins has quit IRC | 17:02 | |
| *** harlowja_away is now known as harlowja | 17:02 | |
| fungi | yep, looks good | 17:02 |
| *** dustins_ has joined #openstack-infra | 17:02 | |
| *** tonytan_brb has quit IRC | 17:02 | |
| *** sdake_ has joined #openstack-infra | 17:02 | |
| *** ihrachyshka has quit IRC | 17:04 | |
| *** emagana has quit IRC | 17:04 | |
| *** sarob has joined #openstack-infra | 17:05 | |
| *** ildikov_ has joined #openstack-infra | 17:05 | |
| *** jlvillal has quit IRC | 17:05 | |
| *** sdake has quit IRC | 17:05 | |
| *** aysyd has quit IRC | 17:07 | |
| *** e0ne has joined #openstack-infra | 17:07 | |
| *** sarob has quit IRC | 17:08 | |
| *** dannywilson has quit IRC | 17:08 | |
| *** achanda has joined #openstack-infra | 17:08 | |
| JayF | https://review.openstack.org/#/c/165496/ I'm getting "this patch depends on a change that failed to merge" when the change it depends on quite clearly merged. What's the suggested path to troubleshoot/knock it loose? | 17:08 |
| *** yamamoto has joined #openstack-infra | 17:08 | |
| *** tonytan4ever has joined #openstack-infra | 17:09 | |
| *** achanda has quit IRC | 17:10 | |
| openstackgerrit | Aaron Rosen proposed openstack-infra/project-config: Move congress projects from stackforge to openstack https://review.openstack.org/169530 | 17:11 |
| *** jlvillal has joined #openstack-infra | 17:11 | |
| *** annegentle has joined #openstack-infra | 17:12 | |
| *** carl_baldwin has joined #openstack-infra | 17:12 | |
| *** achanda has joined #openstack-infra | 17:14 | |
| jeblair | JayF: this is similar to a problem we've seen recently but not exactly the same. i will have to look into the cause which will take a bit. | 17:14 |
| *** Sukhdev has quit IRC | 17:14 | |
| *** patrickeast has joined #openstack-infra | 17:14 | |
| fungi | JayF: jeblair: yes, in this case i think it's a nice reduction of the other cases we've observed | 17:14 |
| jeblair | JayF: in the mean time, try a recheck (that is a solution to the similar problem, it will be informative to try here) | 17:14 |
| JayF | recheck which one, the one with the dependency? | 17:15 |
| fungi | the change was in the check pipeline, then the commit message was edited to remove one of two depends-on headers | 17:15 |
| JayF | Yes, I did that :) | 17:15 |
| fungi | and that comment event seems to have immediately triggered zuul to report the depending on a change that failed to merge abort | 17:15 |
| *** yamahata has quit IRC | 17:16 | |
| fungi | JayF: yeah, recheck on 165496 should work | 17:16 |
| JayF | it's been issued, thanks. I assumed that might fix it but it seemed an interesting enough case that you all might have wanted a heads up :) | 17:16 |
| sdague | JayF: I think https://github.com/openstack-dev/devstack/commit/e8bc2b82a04f4cca251ed7437f738672107428a3 is a great instance of why ironic support out of tree might be better | 17:16 |
| JayF | sdague: I don't know what that means | 17:17 |
| JayF | sdague: you mean we host our own lib/ironic as a plugin? | 17:17 |
| sdague | yes | 17:17 |
| JayF | sdague: in this case, it was actually the change to the *swift* user that broke us | 17:17 |
| sdague | why do the ironic jobs assume they are swift admin? | 17:17 |
| JayF | aha, in this case | 17:18 |
| JayF | it was SWIFT_ENABLE_TEMPURLS depended on that user being admin | 17:18 |
| JayF | and Ironic Agent is the only devstack job that uses tempurls | 17:19 |
| JayF | https://github.com/openstack-dev/devstack/blob/master/lib/ironic#L361 | 17:19 |
| *** hashar is now known as hasharDinner | 17:19 | |
| JayF | so tempurl support was broken in devstack, nothing tested that except the agent, so we had ~36 hours of busted gate | 17:19 |
| sdague | so, basically, no one can use ironic agent unless they have admin on their swift cluster? | 17:19 |
| jeblair | sdague: i think it sounds like one's swift cluster must have tempurls enabled to use ironic agent | 17:20 |
| JayF | Yes. | 17:20 |
| JayF | At least IPA+agent_* Ironic driver | 17:20 |
| *** stevemar has joined #openstack-infra | 17:20 | |
| JayF | IPA now supports the pxe_* class of drivers too, so we gotta be specific | 17:20 |
| sdague | jeblair: enabling tempurls is one thing | 17:21 |
| sdague | swift admin is another | 17:21 |
| *** e0ne is now known as e0ne_ | 17:21 | |
| jroll | sdague: JayF: no, it doesn't require admin. | 17:22 |
| jeblair | sdague: i think JayF is saying that devstack contains the code to enable tempurls, but the only path that executes it is the ipa agent job. so when devstack broke its ability to configure that option, it was untested. | 17:22 |
| JayF | jroll: what was it then? I'm confused ... | 17:22 |
| sdague | jeblair: there is a tempest test for it | 17:22 |
| *** pelix has quit IRC | 17:22 | |
| jroll | sdague: JayF: it requires configuring the tempurl key as the same user that owns the images | 17:22 |
| sdague | http://logs.openstack.org/09/169709/1/check/check-tempest-dsvm-full/09348ed/console.html#_2015-04-01_12_06_28_629 | 17:23 |
| jroll | sdague: JayF: since the admin user in this case owns the images, the key needs to be configured by the admin user | 17:23 |
| jeblair | sdague: okay, then my understanding is incomplete :) | 17:23 |
| *** aysyd has joined #openstack-infra | 17:23 | |
| sdague | which sounds like a bug in the ironic implementation here, it should probably carve off a non admin user that owns all these things | 17:24 |
| jeblair | jroll: why the 'swift admin user'? why not an 'ironic user of swift' ? | 17:24 |
| jeblair | sdague: yeah | 17:24 |
| fungi | claudiub: who should be the initial user of cloud-init-.* groups in gerrit? you, or harlowja or smoser or someone else entirely? | 17:24 |
| jroll | jeblair: sdague that would also work. ironic is by definition an admin-only thing, so I'm not sure how much would need to be untangled to support that | 17:24 |
| jroll | ironic's gate was broken here, we were seeking fastest path to resolution | 17:25 |
| harlowja | fungi i think claudiub harlowja smoser | 17:25 |
| harlowja | that seems ok | 17:25 |
| harlowja | fungi me and scott are the 2 cores in the bzr one | 17:25 |
| harlowja | i mean maintainers | 17:25 |
| harlowja | i mean cores | 17:25 |
| harlowja | lol | 17:25 |
| harlowja | haha | 17:25 |
| fungi | harlowja: well, i can add one of you and then you can add whoever else you want as long as they have gerrit accounts | 17:25 |
| sdague | jroll: but no one went back to actually do proper postmortem | 17:26 |
| harlowja | fungi https://launchpad.net/cloud-init/+topcontributors | 17:26 |
| harlowja | so i think scott ; me | 17:26 |
| harlowja | and claudiub is fine to | 17:26 |
| JayF | harlowja: The amount I'm thrilled about the cloud-init going into gerrit cannot be described | 17:26 |
| harlowja | JayF :-P | 17:26 |
| harlowja | bzr pain gone | 17:26 |
| harlowja | lol | 17:26 |
| jroll | sdague: nobody identified this as a problem | 17:26 |
| jroll | sdague: which also falls on us, just saying. | 17:26 |
| *** Krinkle has joined #openstack-infra | 17:26 | |
| harlowja | JayF this will just be for the 'new cloudinit though' | 17:26 |
| jeblair | JayF: and some fun testing possibilities :) | 17:26 |
| harlowja | not older one | 17:26 |
| JayF | harlowja: I know. At least forward movement is occurring though | 17:27 |
| *** e0ne_ has quit IRC | 17:27 | |
| sdague | which is again why I'm 100% opposed to just throwing more jobs at devstack, because now it becomes my problem to sort out all these unwinds in devstack. And there are too many combinations here. | 17:27 |
| Krinkle | jeblair: I filed the issue from yesterday here, https://phabricator.wikimedia.org/T94715. Open to suggestions you might have :) | 17:27 |
| harlowja | JayF cools | 17:27 |
| harlowja | fungi if u just want to add me i can add the rest | 17:28 |
| harlowja | thats fine to | 17:28 |
| jroll | sdague: I'm not saying I'm for or against this patch in particular, fwiw, just helping to understand history. I'm +100000 on this living in ironic's tree. | 17:28 |
| harlowja | *seeing as i've done all this before | 17:28 |
| *** malini has quit IRC | 17:28 | |
| sdague | jroll: awesome, that would be great. Needs an owner to get that moved over. | 17:28 |
| adam_g | jroll, JayF fwiw that works been started here https://review.openstack.org/#/c/161485/ | 17:29 |
| jroll | sweet, we just found an owner :P | 17:29 |
| fungi | harlowja: done | 17:29 |
| harlowja | cool | 17:29 |
| adam_g | i think that was blocked on some devstack patches that have landed, so it should get moving again | 17:29 |
| fungi | harlowja: have fun! | 17:29 |
| harlowja | fungi thx :) | 17:29 |
| jeblair | sdague, jroll: moving it is part of it, but also not assuming more than what devstack promises is also part of it | 17:29 |
| *** thingee has quit IRC | 17:29 | |
| sdague | jeblair: yeh, agreed | 17:30 |
| *** claudiub has quit IRC | 17:30 | |
| *** rhe00 has joined #openstack-infra | 17:30 | |
| *** davideag_ has joined #openstack-infra | 17:30 | |
| sdague | adam_g: cool, let me know if there are any other devstack changes you need in the infrastructure to get that moving | 17:30 |
| *** BharatK has quit IRC | 17:30 | |
| *** ajmiller has quit IRC | 17:30 | |
| *** emagana has joined #openstack-infra | 17:31 | |
| adam_g | so lib/ironic does support quite a bit on lib/neutron, which is a messy bowl of spaghetti. i dont have much faith that small changes to lib/neutron wont break ironic, let alone a long overdue cleanup/refactoring | 17:32 |
| jeblair | sdague, jroll: i think adam_g has seen this, but you can see the completed and work in progress for the move for trove in "topic:devstack-trove" | 17:32 |
| *** dhritishikhar_ has joined #openstack-infra | 17:32 | |
| jeblair | adam_g: we have learned recently that anything in lib/* is not part of the devstack api | 17:33 |
| *** teran_ has quit IRC | 17:33 | |
| *** davideagnello has quit IRC | 17:33 | |
| fungi | Krinkle: i had some thoughts on how that might work but never got past trying to figure out how to map the pipeline definition into the layout. it may be able to use the IndependentPipelineManager with some tweaking, but the type of changeish it will use has no analog in the current source | 17:33 |
| *** armax has quit IRC | 17:33 | |
| *** teran has joined #openstack-infra | 17:33 | |
| jeblair | adam_g: so if they are entangled, they need to be untangled, which sounds like that might be complex. | 17:34 |
| *** aduarte has joined #openstack-infra | 17:34 | |
| *** e0ne has joined #openstack-infra | 17:34 | |
| *** YorikSar has joined #openstack-infra | 17:35 | |
| mtreinish | fungi, jeblair: do you know how to make a read only link to an etherpad? | 17:36 |
| *** annegentle has quit IRC | 17:36 | |
| mtreinish | I saw pleia2 paste one somewhere before, but am not sure how to generate one | 17:36 |
| *** claudiub has joined #openstack-infra | 17:36 | |
| *** yamamoto has quit IRC | 17:36 | |
| jeblair | mtreinish: first i've heard of it :) | 17:36 |
| jeblair | mtreinish: copy the content to paste.o.o is what i'd do :) | 17:37 |
| *** armax has joined #openstack-infra | 17:37 | |
| sdague | mtreinish: there is an html export button, perhaps that? | 17:37 |
| morganfainberg | Ether pad has a read only mode? | 17:37 |
| jeblair | mtreinish: 'share', click 'read only', copy link | 17:37 |
| fungi | Krinkle: the ideal behavior for that kind of pipeline, i think, is that when there is a trigger event (for example a change-merged) then queue up jobs to run for that repo's branch tip, which gets actually resolved at the time the job starts. that also might have some interesting implications on the merger daemon side too, since it would imply needing to keep branch tips updated there | 17:37 |
| *** _nadya_ has quit IRC | 17:38 | |
| *** yamahata has joined #openstack-infra | 17:38 | |
| mtreinish | jeblair: yep, just found it. I would not have guessed that's what that button did based on the icon | 17:38 |
| jeblair | fungi: we can't do resolution when the job starts since there may be more than one job and they start at different times | 17:38 |
| Krinkle | fungi: Yeah, perhaps a generic job that perhaps even bypasses zuul-merge. Or at least pulls a branch tip instead of a zuul/ref. | 17:39 |
| jeblair | fungi: (and they may be interdependent, such as our tarball/upload jobs) | 17:39 |
| sdague | jeblair: I think you lost a few characters here - https://review.openstack.org/#/c/167412 | 17:39 |
| jeblair | sdague: thank you! :) | 17:39 |
| claudiub | fungi harlowja: sorry, I was disconnected. I was told that alexpilotti should also be added. :) | 17:39 |
| *** MaxV has quit IRC | 17:39 | |
| *** Somay has quit IRC | 17:39 | |
| *** garyh has quit IRC | 17:40 | |
| fungi | jeblair: fair point. if we want that to support all jobs run for a repo in that pipeline operating on the same exact commit, it does get messy | 17:40 |
| fungi | so we can't just feed the job the branch name | 17:40 |
| sdague | jeblair: I think this can go unWIP - https://review.openstack.org/#/c/168128 - it's slightly orthogonal | 17:41 |
| jeblair | fungi, Krinkle: you could have a pipeline where it starts jobs for one Item, and then allows at most one Item to be enqueued after it (always the latest) but does not start those jobs until the first Item is complete. | 17:41 |
| sdague | and we should just land it | 17:41 |
| Krinkle | fungi: I'm not too worried about that part though. Deferring the commit resolution to the job start will help if it gets stalled but it will generally start right away. Could even make the job a proxy (e.g. parametised regular job that triggers a job not otherwise triggered that just uses Jenkins GIT to pull the branch and build) | 17:41 |
| sdague | iirc you need to delete the git_clone here - https://review.openstack.org/#/c/167047/ - because devstack has done that already, and weird things happen if you specify it again in the plugin | 17:42 |
| *** garyh has joined #openstack-infra | 17:42 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Remove unneeded 'create' from all tags sections https://review.openstack.org/169853 | 17:42 |
| *** thingee has joined #openstack-infra | 17:42 | |
| Krinkle | jeblair: Ah, nice. One just run-max=1, but run-max=1 and queue-max=1. interesting. That way it will always complete the last one. | 17:42 |
| *** claudiub_ has joined #openstack-infra | 17:42 | |
| sdague | and actually for - https://review.openstack.org/#/c/168145/ (the project-config change) it would be nice to do this as a 2nd config first so both could be run on trove, the devstack change could be self testing, and once it's known to work the old jobs could be deleted | 17:43 |
| harlowja | claudiub ok dokie | 17:43 |
| sdague | all of that is also left in review comments, but repeated here for clarity | 17:43 |
| jeblair | sdague: i constructed the change series so that wouldn't be necessary | 17:43 |
| fungi | jeblair: Krinkle: agreed, that's an interesting compromise | 17:43 |
| claudiub_ | harlowje: thanks! :D | 17:43 |
| sdague | jeblair: in what way? | 17:43 |
| openstackgerrit | Joe Gordon proposed openstack-infra/project-config: Add tempest-dsvm-sahara https://review.openstack.org/167779 | 17:44 |
| jeblair | sdague: 167412 causes the plugin to be used if trove is enabled | 17:44 |
| jeblair | sdague: so the entire series should be self-testing | 17:44 |
| sdague | oh, gotcha | 17:45 |
| *** ajmiller has joined #openstack-infra | 17:45 | |
| Krinkle | Hm. i'm slightly confused by the issue tracker. https://storyboard.openstack.org/#!/project/679 | 17:46 |
| sdague | hmmmm.... the graph isn't working in my head | 17:46 |
| Krinkle | Is there a second page of open issue? | 17:46 |
| Krinkle | or just those handful? | 17:46 |
| *** claudiub has quit IRC | 17:46 | |
| jeblair | Krinkle: it has a bug; i think you can see more if you log in and set your preferred page size | 17:46 |
| Krinkle | I am logged in. | 17:46 |
| Krinkle | I don't see any pagination | 17:46 |
| fungi | that's the bug | 17:47 |
| jeblair | Krinkle: there is no pagination. that's the bug. | 17:47 |
| openstackgerrit | Joe Gordon proposed openstack-infra/project-config: Add sahara tempest job to sahara and tempest https://review.openstack.org/167780 | 17:47 |
| jeblair | Krinkle: if you go to preferences and set the page size to 100 you'll see more | 17:47 |
| sdague | jeblair: ah, right - https://review.openstack.org/#/c/167412 and the actual plugin need fixing | 17:47 |
| fungi | in this case s/bug/unfinished feature/ if you will | 17:47 |
| *** mpaolino has quit IRC | 17:47 | |
| Krinkle | OK | 17:47 |
| Krinkle | Hm.. searching for https://storyboard.openstack.org/#!/search?q=post-merge and adding project zuul from dropdown results in 400: GET /api/v1/stories/search: Unknown argument: "project_id" | 17:48 |
| Krinkle | same if I add a filter for status>active. | 17:49 |
| jeblair | Krinkle: i get that too | 17:49 |
| jeblair | krotscheck: ^ | 17:49 |
| openstackgerrit | Christoph Gysin proposed stackforge/gertty: Add support for auth-type=form https://review.openstack.org/169467 | 17:50 |
| sdague | jeblair: you want me to push some fixes here? I'm curious if this is all going to work actually :) | 17:50 |
| clarkb | I get distracted by linux package management for an hour and the channel goes all active | 17:51 |
| * clarkb catches up | 17:51 | |
| jeblair | sdague: sure thing -- i probably won't be able to give these another pass for a few more hours | 17:51 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: Temporarily add trove plugin configuration https://review.openstack.org/167412 | 17:52 |
| *** e0ne is now known as e0ne_ | 17:52 | |
| *** afazekas has quit IRC | 17:53 | |
| *** ujuc has quit IRC | 17:53 | |
| sdague | jeblair: ok, the 2 changes made that I *think* are needed to make this work | 17:54 |
| sdague | and recheck on the DNM patch | 17:54 |
| sdague | so... we'll see | 17:54 |
| jeblair | sdague: cool; also i agree with the orthoganalness of the grenade patch, so if we want to put that at the head of the series, that works too. but we can wait until these results come back :) | 17:54 |
| sdague | jeblair: yeh, I'm fine waiting for test results and merging it all in one go if it's good | 17:55 |
| jeblair | cool | 17:55 |
| *** dustins has joined #openstack-infra | 17:55 | |
| *** dustins_ has quit IRC | 17:55 | |
| *** medieval1 has joined #openstack-infra | 17:55 | |
| *** malini has joined #openstack-infra | 17:55 | |
| sdague | also, thanks for running off and doing this. Really good to have someone else exposing assumptions in the process. | 17:56 |
| *** malini has left #openstack-infra | 17:56 | |
| jeblair | no prob :) | 17:56 |
| *** timcline has quit IRC | 17:57 | |
| *** ghostpl_ has quit IRC | 17:57 | |
| *** hdd has joined #openstack-infra | 17:57 | |
| clarkb | jeblair: sdague it will only break trove righ? couldn't we just update the job and have them merge the change to make the plugin work in trove? | 17:57 |
| sdague | clarkb: honestly, I'd rather move them from a working state to a working state | 17:57 |
| sdague | it seems like the polite thing to do | 17:58 |
| Krinkle | Hm.. does storyboard support linking to another url? | 17:58 |
| *** teran has quit IRC | 17:58 | |
| sdague | jeblair: hmmm | 17:58 |
| *** unicell has quit IRC | 17:58 | |
| *** teran has joined #openstack-infra | 17:58 | |
| sdague | jenkins is the sad on - https://review.openstack.org/#/c/168134/2 | 17:59 |
| *** e0ne has joined #openstack-infra | 17:59 | |
| clarkb | sdague: sure the change is fine as is, I just don't think I agree with the assertion that we can't test things | 17:59 |
| clarkb | its tested either way, but one way it will break as part of the transition | 18:00 |
| *** medieval1 has quit IRC | 18:00 | |
| jeblair | clarkb: what are you talking about? | 18:00 |
| clarkb | jeblair: https://review.openstack.org/#/c/167412/3 | 18:00 |
| jeblair | clarkb: i think we moved past that. i explained to sdague that the entire patch series is already self-testing | 18:00 |
| *** mpaolino has joined #openstack-infra | 18:01 | |
| sdague | right, I just didn't visualize the graph | 18:01 |
| *** ivar-laz_ has joined #openstack-infra | 18:02 | |
| jeblair | i had notes when i wrote it :) | 18:02 |
| sdague | jeblair: the merge conflict is funny with depends-on | 18:02 |
| sdague | because it turns out the devstack remove patch was actually the problematic one | 18:02 |
| sdague | which I had to rebase to recheck the top | 18:03 |
| *** sarob has joined #openstack-infra | 18:03 | |
| sdague | ok, going for a walk with the fam, back in a bit | 18:03 |
| jeblair | sdague: yeah, was just looking into that, it was a conflict in a dependency? | 18:03 |
| sdague | jeblair: yep | 18:03 |
| *** teran has quit IRC | 18:03 | |
| sdague | it should be good now | 18:03 |
| jeblair | cool, thx | 18:03 |
| *** ivar-laz_ has quit IRC | 18:03 | |
| *** dannywilson has joined #openstack-infra | 18:04 | |
| *** e0ne is now known as e0ne_ | 18:05 | |
| *** dhritishikhar_ has quit IRC | 18:05 | |
| *** ivar-lazzaro has quit IRC | 18:06 | |
| *** carl_baldwin has quit IRC | 18:06 | |
| Krinkle | fungi: jeblair: Hm.. so this kind of pipeline, that would have to be implemented in Zuul, right? We can't declare such a pipeline with the current feature set? | 18:08 |
| fungi | Krinkle: right, this would need to be a new feature in zuul | 18:08 |
| fungi | Krinkle: at least i was unable to figure out a facsimile within the current feature set | 18:08 |
| Krinkle | Could you gauge the amount of work it would take? | 18:08 |
| Krinkle | Are the building blocks there? | 18:09 |
| jeblair | Krinkle: correct, i think this would be a new kind of pipeline (which is neat! there are only two now!) which is a bit more complex than my suggestion yesterday about simply removing the change (which you correctly point out could end up in a starvation situation) | 18:09 |
| *** stevemar has quit IRC | 18:09 | |
| *** stevemar has joined #openstack-infra | 18:10 | |
| *** e0ne_ has quit IRC | 18:10 | |
| jeblair | Krinkle: i would guess someone familiar with zuul internals could do this in a day or two, and someone unfamiliar might take a bit longer. yes, the building blocks are there, but they haven't been assembled in this way before so there are likely to be a few small refactors. | 18:11 |
| *** mpaolino has quit IRC | 18:11 | |
| *** _nadya_ has joined #openstack-infra | 18:12 | |
| *** _nadya_ has quit IRC | 18:12 | |
| fungi | that was the feeling i got when i first started to dive into it, but didn't go deep enough to determine how much work would be involved | 18:12 |
| Krinkle | I'm looking at how much code is involved in a pipeline | 18:12 |
| Krinkle | https://github.com/openstack-infra/zuul/blob/master/zuul/scheduler.py#L1769 | 18:12 |
| *** carl_baldwin has joined #openstack-infra | 18:13 | |
| Krinkle | Seems about a 100 lines for each | 18:13 |
| *** sdake has joined #openstack-infra | 18:13 | |
| *** salv-orl_ has joined #openstack-infra | 18:13 | |
| fungi | yeah, i was thinking of starting from the independent pipeline manager since it's pretty close to the behavior we'd want already | 18:13 |
| *** yfried has joined #openstack-infra | 18:14 | |
| jeblair | combine that with the concept of a window (perhaps a fixed window of size 1) which already exists... | 18:14 |
| jeblair | (that may not need much or any modification) | 18:14 |
| Krinkle | Hm.. I'm not seeing the cancelling behaviour from the independant pipeline | 18:14 |
| Krinkle | I guess it's somewhat implicit | 18:14 |
| * Krinkle updated https://phabricator.wikimedia.org/T94715#1171015 | 18:15 | |
| jeblair | and then add the logic to replace similar items if they are outside the window | 18:15 |
| Krinkle | I guess the concept of applying a window to non-running builds would be new, though? | 18:15 |
| *** xyang1 has quit IRC | 18:15 | |
| *** rfolco has quit IRC | 18:16 | |
| fungi | Krinkle: well, the "window" feature is really that anything outside the window is not going to get resources assigned | 18:16 |
| jeblair | Krinkle: well, the window is how deep in a dependent pipeline's shared change queue jobs should start | 18:16 |
| jeblair | yeah | 18:16 |
| *** sdake_ has quit IRC | 18:16 | |
| *** salv-orlando has quit IRC | 18:17 | |
| fungi | so with a window of 1 only the oldest changeish gets resources, the second-oldest would be "outside" the window and just waiting | 18:17 |
| fungi | e.g. active vs inactive | 18:17 |
| Krinkle | fungi: Hm.. how far outside is this "outside". Would it show up on Zuul dashboard as queued? | 18:18 |
| *** _nadya_ has joined #openstack-infra | 18:18 | |
| fungi | and the specialness of the pipeline would be to just keep cancelling/replacing any outside the window when a new trigger arrives for that queue | 18:18 |
| jeblair | Krinkle: search for 'dequeue_on_new_patchset' to find the dequeuing action | 18:18 |
| jeblair | Krinkle: changes outside the window show up as such, yes | 18:18 |
| fungi | Krinkle: it would show up in the status.json. what does or doesn't show up on the dashboard is more a question of aesthetics | 18:18 |
| Krinkle | Sure :) | 18:19 |
| Krinkle | Cool. | 18:19 |
| jeblair | Krinkle: http://status.openstack.org/zuul/ | 18:19 |
| jeblair | Krinkle: 3 changes in our integrated gate queue are outside the window | 18:19 |
| *** sarob has quit IRC | 18:19 | |
| Krinkle | jeblair: state "unknown"? | 18:19 |
| jeblair | "Waiting until closer to head of queue to start jobs" | 18:20 |
| jeblair | Krinkle: no -- time to land "unknown" | 18:20 |
| Krinkle | Ah interesting | 18:20 |
| jeblair | Krinkle: mouseover the dot for the state explanation | 18:20 |
| Krinkle | jeblair: That pipeline is a dependent pipeline? | 18:20 |
| jeblair | Krinkle: yes | 18:20 |
| Krinkle | Right. And it's doing the speculate-ahead-that-passing concept, but limited to a certain size so that you don't end up allocating too munch of resources on a hunch that may end up being cancelled in case of failure. | 18:21 |
| jeblair | correct. it increases and decreases dynamically based on how often things fail. | 18:21 |
| *** reed_ has joined #openstack-infra | 18:22 | |
| Krinkle | https://integration.wikimedia.org/zuul/ | 18:22 |
| Krinkle | I haven't updated our dashboard in a while | 18:22 |
| jeblair | (it's currently at our minimum, if that tells you anything) | 18:22 |
| Krinkle | Missing some features :) | 18:22 |
| fungi | it's frequently (usually?) at our minimum | 18:22 |
| jeblair | Krinkle: the update of the in-tree dashboard (building on your work) is coming along: http://zuul.openstack.org/ | 18:23 |
| jeblair | Krinkle: i think we're getting close to be able to use it as our main one | 18:23 |
| Krinkle | Hm.. interesting. You've got two zuul dashboards? | 18:23 |
| Krinkle | Ah, right. | 18:23 |
| *** tiswanso has quit IRC | 18:24 | |
| *** isq has quit IRC | 18:24 | |
| jeblair | i'm a big fan of the all-in-one progress bar jhesketh introduced | 18:24 |
| jeblair | i have to run now, biab. | 18:25 |
| fungi | ooh, that reminded me to check if my last https-enablement patch landed for the zuul status api. it has! | 18:25 |
| Krinkle | jeblair: They both consume the same status.json, right? | 18:25 |
| Krinkle | jeblair: Ah, yeah, very nice! Makes it less verbose. | 18:25 |
| fungi | sdague: ^ we can consume https://zuul.o.o/status.json from https://review.o.o now | 18:25 |
| Krinkle | I like that the dashboard on status.os.o/zuul isn't too verbose. | 18:25 |
| fungi | Krinkle: that's, um... out of necessity | 18:26 |
| Krinkle | Yeah, but it makes sense | 18:26 |
| Krinkle | Too much information. | 18:26 |
| fungi | when we get several hundred changes deep, it's unmanageable if they're all expanded by default | 18:26 |
| Krinkle | oh, it has an expansion still | 18:27 |
| *** Bsony_ has joined #openstack-infra | 18:27 | |
| clarkb | and that happens frequently with the merge checks now | 18:27 |
| fungi | yep, click to toggle | 18:27 |
| fungi | i think there's still room to improve on minimizing the profile of inactive changes in the status interface | 18:27 |
| *** Bsony has quit IRC | 18:27 | |
| *** e0ne has joined #openstack-infra | 18:28 | |
| fungi | also i think we could probably hide the change queue labels if they're for a single project | 18:28 |
| *** e0ne is now known as e0ne_ | 18:29 | |
| clarkb | jeblair: have you had a chance to read jhesketh's comment on https://review.openstack.org/#/c/167158/2 ? | 18:29 |
| *** e0ne_ is now known as e0ne | 18:29 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:29 | |
| clarkb | I can get the next round of swift logs stuff in | 18:30 |
| clarkb | but don't want to approve that change until you have had achance to catch up on it | 18:30 |
| * Krinkle files a reminder task to incorporate some code from zuul.openstack.org back to ours. | 18:30 | |
| Krinkle | Nice work | 18:30 |
| *** dboik has quit IRC | 18:30 | |
| *** dboik has joined #openstack-infra | 18:31 | |
| *** rfolco has joined #openstack-infra | 18:31 | |
| *** dboik has quit IRC | 18:32 | |
| arosen | Hi, I'm looking at zuul enqueue. And I was wondering witht he --pipline and --trigger objects mean? | 18:32 |
| *** dboik has joined #openstack-infra | 18:33 | |
| arosen | i'm guessing --pipline would be check | 18:33 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 18:33 | |
| arosen | and trigger could be either: patchset-created, comment-added, change-restored ? | 18:33 |
| fungi | arosen: those should be the name of the pipeline into which you want the change enqueued and the name of the trigger that pipeline uses (probably "gerrit" in your case) | 18:33 |
| arosen | fungi: ah i see it's gerrit | 18:34 |
| arosen | thanks | 18:34 |
| *** _nadya_ has quit IRC | 18:34 | |
| *** tiswanso has joined #openstack-infra | 18:34 | |
| *** erlon has joined #openstack-infra | 18:35 | |
| Krinkle | https://integration.wikimedia.org/zuul/?demo=openstack | 18:35 |
| Krinkle | here is ours running with your data | 18:35 |
| *** Bsony_ has quit IRC | 18:36 | |
| jroll | oh my, that's pretty if the tests were collapsed :) | 18:36 |
| fungi | jroll: http://zuul.openstack.org/ is to a great extent what that would look like with the tests collapsed | 18:36 |
| jroll | fungi: yeah, but this is shinier | 18:37 |
| *** hodos has joined #openstack-infra | 18:37 | |
| jroll | oh wait what | 18:37 |
| jroll | huh. | 18:37 |
| Krinkle | This must be what time travelling feels like. | 18:37 |
| Krinkle | It already exists, jroll :) | 18:37 |
| jroll | fungi: is that new? | 18:37 |
| fungi | jroll: http://zuul.openstack.org/ is the built-in dashboard (based on work contributed by wikimedia devs) | 18:37 |
| *** Sukhdev has joined #openstack-infra | 18:38 | |
| jroll | I see; what' | 18:38 |
| jroll | what's the difference with status.o.o/zuul? | 18:38 |
| *** bswartz has joined #openstack-infra | 18:38 | |
| clarkb | it would be awesome if I didn't have to sign up for a new accunt every time I went to submit a bug for $project | 18:38 |
| arosen | fungi: quick question, when i do gerrit query --format json status:open project:stackforge/congress it gives me the gerrit number but not the patch number. Any idea how to get that? | 18:38 |
| arosen | for example for --change gerrit_number, patch_number | 18:38 |
| fungi | jroll: http://status.openstack.org/zuul/ is the one integrated into our status.openstack.org site. they're both rendering the same json from zuul's status api | 18:38 |
| Krinkle | https://github.com/openstack-infra/zuul/tree/master/etc/status | 18:38 |
| clarkb | I wonder how terrible it would be for bug trackers to allow people to submit a bug pseudo anonymously using only an email address | 18:38 |
| jroll | fungi: interesting, thanks | 18:39 |
| *** cdent has quit IRC | 18:39 | |
| *** cdent has joined #openstack-infra | 18:39 | |
| clarkb | arosen: queries return changes not patchsets so I think its just the way gerrit presents the data? | 18:39 |
| fungi | arosen: there are a couple of patchset-related options to that api. are you looking at the api docs? | 18:39 |
| clarkb | basically a change != a patchset | 18:40 |
| *** garyh has quit IRC | 18:41 | |
| *** garyh has joined #openstack-infra | 18:42 | |
| fungi | arosen: i think --current-patch-set is what you want | 18:42 |
| arosen | fungi: no i'm only looking at : https://gerrit.googlecode.com/svn-history/r3021/documentation/2.1.4/cmd-query.html | 18:42 |
| mordred | arosen: oh - that's very old | 18:42 |
| *** ivar-lazzaro has quit IRC | 18:43 | |
| fungi | arosen: https://review.openstack.org/Documentation/cmd-query.html | 18:43 |
| arosen | fungi: bingo that's it. | 18:44 |
| arosen | I'm writting a little tool that uses gerritlib and zuul.client to recheck failed patches for me in the backend. | 18:44 |
| clarkb | arosen: I think zuul can do that for you but I might be wrong | 18:45 |
| clarkb | https://jenkins04.openstack.org/job/gate-nova-pep8/13165/console thats annoying | 18:49 |
| openstackgerrit | Christoph Gysin proposed stackforge/gertty: Add config option for git clone URL https://review.openstack.org/169469 | 18:50 |
| *** emagana has quit IRC | 18:50 | |
| clarkb | we should just make a script that restarts our jenkins masters every day in a rolling fashion | 18:50 |
| mordred | clarkb: ++ | 18:50 |
| clarkb | (not actually a great idea but this jenkins bug is really annoying) | 18:50 |
| clarkb | jenkins04 is starting to leak. 03 appears dead | 18:51 |
| clarkb | need to check 05-07 | 18:51 |
| mordred | clarkb: seems like an easy enough ansible playbook to write | 18:51 |
| *** isq has joined #openstack-infra | 18:51 | |
| mordred | clarkb: of course, I agree, the need for it is super lame | 18:51 |
| *** tkelsey has quit IRC | 18:51 | |
| clarkb | my favorite thing is jenkins asked me to install a support plugin to get a thread dump, as soon as I add a thread dump (via melody not a support plugin) the bug goes silent | 18:52 |
| *** achanda has quit IRC | 18:52 | |
| mordred | sounds like a thread race to me :) | 18:52 |
| clarkb | its not even a race, a blocking call blocks in a synchronized method | 18:52 |
| clarkb | at that point its game over you lose do not collect $200 | 18:52 |
| mordred | oh ugh | 18:52 |
| mordred | I misunderstood what you meant by "goes silent" | 18:53 |
| clarkb | oh I meant that the person communicating via the bug went silent | 18:53 |
| clarkb | which is :( | 18:53 |
| clarkb | https://issues.jenkins-ci.org/browse/JENKINS-27514 I may need to fire up a jenkins dev env locally and see if I can fix this plugin | 18:53 |
| mtreinish | fungi, mordred, clarkb: if you get a sec https://review.openstack.org/#/c/167243/ could use a 3rd +2 (and hopefully a +A) :) | 18:54 |
| clarkb | anteaya: ^ any specific reason for not approving tis change? | 18:55 |
| *** claudiub_ has quit IRC | 18:56 | |
| yolanda | jeblair, i haven't had a chance to test simulator today, but i'll have some time tomorrow morning. I like that idea, instead of just exploiting my hpcloud account | 18:56 |
| *** medieval1 has joined #openstack-infra | 18:56 | |
| yolanda | added some comments to your change, btw | 18:56 |
| yolanda | i need to look at that more carefully, but i'd like if we could make servers stay for x time before dropping them, so we can simulate better when we reach quota and start getting in trouble | 18:58 |
| *** medieval1 has quit IRC | 19:01 | |
| clarkb | I just restarted jenkins on 03 | 19:02 |
| clarkb | I also grabbed the hs error file from /tmp and put it in my homedir, same story with thread leak | 19:02 |
| *** teran has joined #openstack-infra | 19:04 | |
| clarkb | 05-07 all show signs of the leak too | 19:06 |
| clarkb | I am going to put 04 in shutdown mode now, then once it has stopped running jobs try killing the thread holding the lock | 19:06 |
| fungi | thanks. i'm happy to help take turns on restarting them or whatever | 19:07 |
| fungi | once you're done digging | 19:07 |
| clarkb | fungi: I'm thinking we bring 02 back into the rotation since its already settled | 19:07 |
| clarkb | fungi: then we can hold one of the others if we want | 19:07 |
| fungi | i'll get 02 cleaned up in that case | 19:08 |
| clarkb | cool | 19:08 |
| fungi | need a break from trying to wrestle the dpkg-query behavior differences around multi-arch package naming between precise and trusty for a bit | 19:08 |
| *** emagana has joined #openstack-infra | 19:09 | |
| clarkb | I am going to clean old slaves off of 04 so it is ready to be experimented on once jobs are done | 19:09 |
| fungi | okay, 02 is cleaned and on its way back into service now | 19:10 |
| *** lifeless has quit IRC | 19:11 | |
| sdague | fungi: \o/ | 19:12 |
| fungi | hrm, no lifeless around yet | 19:12 |
| sdague | fungi: does that mean you are now +2 on - https://review.openstack.org/#/c/125944/ | 19:12 |
| asselin_ | Hi, I'm running into this bug. Anyone know how to enable this setting during VM install? https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1413540/comments/5 | 19:13 |
| openstack | Launchpad bug 1413540 in linux (Ubuntu) "Trusty soft lockup issues with nested KVM" [High,Confirmed] - Assigned to Chris J Arges (arges) | 19:13 |
| asselin_ | "set KSM_ENABLED=0 in /etc/default/qemu-kvm" | 19:14 |
| clarkb | asselin_: we do not nested kvm | 19:14 |
| *** crc32 has joined #openstack-infra | 19:14 | |
| clarkb | specifically because in our testing it did things like ^ | 19:14 |
| clarkb | and kernel panics | 19:14 |
| asselin_ | clarkb, what do you do? | 19:15 |
| *** HotTopic has joined #openstack-infra | 19:15 | |
| clarkb | well that and our clouds don't let us :) | 19:15 |
| clarkb | asselin_: we use qemu | 19:15 |
| fungi | sdague: apparently so! | 19:15 |
| asselin_ | clarkb,where do you set that? | 19:15 |
| fungi | i'll keep tabs on gerrit to make sure the javascript keeps getting served after that merges | 19:16 |
| *** ghostpl_ has joined #openstack-infra | 19:16 | |
| clarkb | asselin_: we don't set it anywhere. Our clouds don't expose the virtualization features in the cpus given to us so nova automagically uses qemu | 19:16 |
| *** ghostpl_ has quit IRC | 19:17 | |
| *** ghostpl_ has joined #openstack-infra | 19:17 | |
| *** HotTopic has left #openstack-infra | 19:17 | |
| *** Rockyg has joined #openstack-infra | 19:17 | |
| asselin_ | clarkb, ok....thanks | 19:17 |
| *** mrmartin has joined #openstack-infra | 19:17 | |
| fungi | i can't decide whether bindep on dpkg-based platforms should just ignore multi-arch specifiers so as to support least-common-denominator systems (like precise which doesn't support a binary:Package format macro in dpkg-query) or support them with a legacy fallback behavior | 19:18 |
| *** tkelsey has joined #openstack-infra | 19:18 | |
| clarkb | asselin_: http://docs.openstack.org/trunk/config-reference/content/qemu.html looks like nova can be explicitly told to qemu | 19:18 |
| clarkb | asselin_: but I am not sure if libvirt will default to kvm or not | 19:18 |
| asselin_ | clarkb, ok thanks. yeah just found it here too. will try it out: http://docs.openstack.org/trunk/config-reference/content/list-of-compute-config-options.html | 19:18 |
| clarkb | fungi: if we have to specificy arch specific packages we probably have bigger problems? | 19:18 |
| clarkb | *specificy is a new word which means I don't know what | 19:19 |
| clarkb | fungi: I would consider it a bug if we needed i386 pcakages for something on x86_64. Is there any other situation where this might come up? | 19:19 |
| fungi | clarkb: yeah, the quandry is that bindep currently has the beginnings of multi-arch specifier support, but is ignoring them implicitly. i need to decide between ignoring them explicitly and documenting that as not yet supported, or finishing up support for it | 19:20 |
| clarkb | maybe arm32 vs arm64? | 19:20 |
| fungi | right. for example if you install zlib1g on an amd64 trusty system you get zlib1g:amd64 specifically | 19:20 |
| greghaynes | thats only an issue if something wants the i686 version though? | 19:21 |
| clarkb | ya so arch specific is only necessary if you are on a platform that supports multiple arches and for some reason only the non default arch would work | 19:21 |
| clarkb | which to me is a bug | 19:21 |
| fungi | the tools on trusty (dpkg, dpkg-query, et cetera) default to explicitly listing the :amd64 for it | 19:21 |
| *** tkelsey has quit IRC | 19:22 | |
| clarkb | usually this is only a problem when installing video games | 19:22 |
| fungi | but in good news, you can query zlib1g:amd64 on precise and you get back info for zlib1g | 19:22 |
| mordred | fungi: I think you should ignore it | 19:22 |
| *** reed_ has quit IRC | 19:22 | |
| *** reed_ has joined #openstack-infra | 19:23 | |
| greghaynes | Yea, its probably important to verify we dont have anything with an arch specific bindep... but ++ to we shouldnt | 19:23 |
| fungi | i think i'm going to for now, it just calls for at least a code comment that if you specify zlib1g:i386 on an amd64 system, zlib1g:amd64 will end up satisfying the requirements, which is a non-intuitive corner case | 19:23 |
| *** achanda has joined #openstack-infra | 19:23 | |
| clarkb | jenkins01 is acting up as well. I think it is highly possible all of our masters are currently in this state of slow death | 19:24 |
| fungi | also i'm a little worried that the existing package version support is overreaching for this tool (and a lot of additional complexity to support when adding more platforms) | 19:24 |
| clarkb | except for 02 until it reenters it | 19:24 |
| *** yamamoto has joined #openstack-infra | 19:25 | |
| sdague | jeblair: https://review.openstack.org/#/c/168134 - doesn't seem like it pulled in the depends-on | 19:25 |
| fungi | in my opinion, we should gut the existing version matching support our of bindep, because the situations where your distro has required package x but not within required version range y..z is a corner case you probably can't easily fix anyway | 19:26 |
| openstackgerrit | Merged openstack-infra/system-config: display zuul in gerrit change https://review.openstack.org/125944 | 19:26 |
| clarkb | sdague: "HEAD is now at 5abac15 WIP: Move trove into in-tree plugin" it looks like it did | 19:27 |
| fungi | "you need a newer distro" is of course a helpful thing for a tool to tell you outright, but it's not exactly easy to implement | 19:27 |
| clarkb | sdague: from http://logs.openstack.org/34/168134/3/check/gate-trove-functional-dsvm-mysql/274da67/logs/devstack-gate-setup-workspace-new.txt.gz#_2015-04-01_18_40_12_519 | 19:28 |
| *** doude has quit IRC | 19:29 | |
| *** doude_ has joined #openstack-infra | 19:29 | |
| *** doude_ has quit IRC | 19:29 | |
| *** yamamoto has quit IRC | 19:29 | |
| *** doude has joined #openstack-infra | 19:30 | |
| sdague | hmmm... | 19:31 |
| sdague | it's not got the right line in localrc | 19:31 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: Temporarily add trove plugin configuration https://review.openstack.org/167412 | 19:33 |
| sdague | never mind, bad regex | 19:33 |
| sdague | go go bashism | 19:34 |
| clarkb | I just put 01 in prepare for shutdown because it seemed to be the worst off of the lot | 19:36 |
| clarkb | that leaves us with 5 masters for now which should be fine as we regularly take 2 out of rotation at a time to do restarts | 19:36 |
| clarkb | well 6 if you count jenkins.o.o | 19:36 |
| *** lifeless has joined #openstack-infra | 19:39 | |
| *** reed has quit IRC | 19:40 | |
| *** reed_ is now known as reed | 19:40 | |
| *** rm_work is now known as rm_work|away | 19:43 | |
| timrc | mordred, So https://review.openstack.org/#/c/169724/ is really cool. I'll see about using something like graphene or cubism to provide real-time graphing dashboard. | 19:47 |
| timrc | mordred, There's quite a few tasks so I imagine a stacked graph would become quite noisy. | 19:51 |
| *** mrmartin has quit IRC | 19:51 | |
| timrc | So maybe horizon charts for each task? | 19:52 |
| *** davideag_ has quit IRC | 19:57 | |
| *** medieval1 has joined #openstack-infra | 19:57 | |
| *** davideagnello has joined #openstack-infra | 19:58 | |
| *** davideagnello has quit IRC | 19:58 | |
| *** ajo has joined #openstack-infra | 19:58 | |
| *** davideagnello has joined #openstack-infra | 19:58 | |
| *** tnovacik has joined #openstack-infra | 19:59 | |
| *** medieval1 has quit IRC | 20:01 | |
| *** chris___2 has quit IRC | 20:02 | |
| *** jlibosva has quit IRC | 20:04 | |
| *** cdent has quit IRC | 20:06 | |
| openstackgerrit | Dan Smith proposed openstack-infra/project-config: Make the ceph jobs fetch an image-based cirros and use it by default https://review.openstack.org/169903 | 20:06 |
| *** annegentle has joined #openstack-infra | 20:06 | |
| *** annegent_ has joined #openstack-infra | 20:06 | |
| *** annegentle is now known as Guest6090 | 20:07 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Use HTTPS when including Zuul status via hideci https://review.openstack.org/169905 | 20:07 |
| fungi | sdague: i just remembered ^ why i actually -1'd 125944 | 20:08 |
| fungi | i would have used a procedural -2 instead if i'd been okay with the change, but my -1 meant that i thought you needed another patchset to correct the protocol in the url | 20:09 |
| *** kgiusti has quit IRC | 20:10 | |
| fungi | sdague: my browser error console throws a "blocked loading mixed active content" because of that | 20:13 |
| *** notnownikki has quit IRC | 20:16 | |
| *** emagana has quit IRC | 20:17 | |
| openstackgerrit | Dan Smith proposed openstack-infra/devstack-gate: Do not merge me - I am for testing. https://review.openstack.org/169907 | 20:18 |
| sdague | fungi: oh, right | 20:23 |
| sdague | that would be super cool to merge once the clippy is gone, like reverse april fools | 20:24 |
| jeblair | haha | 20:24 |
| fungi | sdague: in good news, i did very briefly "fix" that by hand in production and it worked as expected, so yes if we can get that in within the next 3.5 hours... | 20:24 |
| *** Swami has quit IRC | 20:24 | |
| dansmith | is there any way to link to the zuul status page with a filter set? | 20:24 |
| dansmith | like status/zuul?filter=xyz ? | 20:24 |
| fungi | clippy will be replaced by something actually useful ;) | 20:24 |
| jeblair | fungi: how do i see the zuul thing | 20:25 |
| jeblair | ? | 20:25 |
| mordred | jeblair: I'm confused - I do not have any outstanding patches that are over two weeks stale | 20:25 |
| * jeblair hands mordred some patches | 20:25 | |
| * mordred puts the patches in his pouch, next to the tinderbox and rations | 20:25 | |
| timrc | mordred, All your patches are outstanding. Don't sell yourself short! | 20:25 |
| fungi | jeblair: make that same hideci.js tweak via your javascript console, or convince your browser to allow "mixed active content" | 20:25 |
| mordred | timrc: aww. :) | 20:25 |
| *** amitgandhinz has joined #openstack-infra | 20:25 | |
| *** ZZelle has joined #openstack-infra | 20:26 | |
| jeblair | fungi: oh, i see. firefox didn't throw as much of a fit as i thought it would. | 20:26 |
| jeblair | i was expecting big yellow page | 20:26 |
| fungi | jeblair: it's "quietly protecting you" | 20:27 |
| *** shardy has quit IRC | 20:27 | |
| jeblair | clarkb: okay, i've read jhesketh's comment on 167158 and for some reason, i still don't understand why we're scp uploading the footers. | 20:28 |
| hasharDinner | mordred: hello monty! You said in an email the jobs are limited in duration to prevent malicious usage ( http://lists.openstack.org/pipermail/openstack-infra/2015-March/002542.html ) I am wondering how you are handling it :) | 20:29 |
| *** zz_ja| is now known as zz_zz_ja| | 20:29 | |
| hasharDinner | mordred: is that nodepool having some feature to timeout an instance? | 20:29 |
| *** claudiub has joined #openstack-infra | 20:29 | |
| jeblair | hasharDinner: jenkins timeout | 20:29 |
| *** ryanpetrello has quit IRC | 20:29 | |
| openstackgerrit | Dan Smith proposed openstack-infra/devstack-gate: Do not merge me - I am for testing. https://review.openstack.org/169907 | 20:29 |
| mordred | hasharDinner: yes, what jeblair said | 20:30 |
| *** hasharDinner is now known as hashar | 20:30 | |
| hashar | \o/ Thanks! | 20:30 |
| fungi | clarkb: i'm deleting all jenkins01 slaves from nodepool except those actively running jobs | 20:30 |
| jeblair | hashar: i hope you enjoyed your dinner! :) | 20:30 |
| hashar | mordred: jeblair: for what it is worth, I had my first meeting today regarding Nodepool / openstack farm for Wikimedia CI! | 20:30 |
| *** emagana has joined #openstack-infra | 20:30 | |
| *** rfolco has quit IRC | 20:31 | |
| hashar | jeblair: always! it is always fun with kids *grin* | 20:31 |
| jeblair | hashar: oh exciting! | 20:31 |
| mordred | hashar: woot! | 20:31 |
| fungi | clarkb: oh, and also except for any in a held status | 20:31 |
| *** annegent_ has quit IRC | 20:31 | |
| *** Guest6090 has quit IRC | 20:31 | |
| *** ryanpetrello has joined #openstack-infra | 20:31 | |
| fungi | though double-checking now, there don't seem to have been any held for jenkins01 anyway | 20:32 |
| hashar | and I have finished a Debian package for our Zuul install ! Next is porting it to Debian and then I will package Nodepool. Double w00t ! | 20:32 |
| clarkb | fungi thanks | 20:32 |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Allow the configured git-url to override gerrit https://review.openstack.org/169810 | 20:32 |
| *** ryanpetrello has quit IRC | 20:33 | |
| *** Swami has joined #openstack-infra | 20:33 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add delete_image call https://review.openstack.org/169783 | 20:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Skip passing in timeout to glance if it's not set https://review.openstack.org/169803 | 20:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Migrate API calls to task management https://review.openstack.org/168665 | 20:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Poll on the actual image showing up https://review.openstack.org/169804 | 20:33 |
| *** adalbas has quit IRC | 20:34 | |
| krotscheck | What is this 'wrappers' annotation I see in job-templates? | 20:34 |
| jeblair | clarkb: do you think you can help alleviate my confusion about 167158? | 20:34 |
| krotscheck | Is that a 'execute around template' thing that could, for example, start up an xvfb thing? | 20:34 |
| jeblair | krotscheck: it's a particular kind of feature in jenkins | 20:34 |
| jeblair | krotscheck: which is to say, it's not a generic thing you can wrap around anything... | 20:35 |
| clarkb | jeblair ya give me a couple minutes to reread thibgs and finish my pancake | 20:35 |
| jeblair | krotscheck: but rather, some features of jenkins jobs are exposed via "wrappers" as opposed to "publishers" and "builders" | 20:35 |
| krotscheck | jeblair: Thanks. I'll do something else for these javascrit nuts. | 20:35 |
| *** ryanpetrello has joined #openstack-infra | 20:35 | |
| jeblair | krotscheck: example: one we use is a timeout. so in jenkins that's implemented as a "wrapper" for the job, i guess because it applies to the whole job as opposed to a build step | 20:36 |
| jeblair | krotscheck: you can make a build step that sets up xvfb, and then make jobs that use the xvfb build step plus whatever else they do. may or may not be the right thing to do. | 20:36 |
| arosen | Is anyone allowed to connect to the openstack-infra zuul-server? Just curious. | 20:37 |
| jeblair | krotscheck: i think mysql is being set up that way in fungi's work to run all jobs on the same kinds of slaves (with nothing installed) | 20:37 |
| *** mattfarina has quit IRC | 20:37 | |
| krotscheck | jeblair: That's what I'm thinking. Right now there's way too much custom scripting to get xvfb working. | 20:37 |
| jeblair | arosen: to the read-only status.json url, yes | 20:37 |
| krotscheck | jeblair: The only concern I have is what happens to the leftover buffer if the build fails. | 20:37 |
| jeblair | arosen: to the gearman server, no | 20:37 |
| *** Sukhdev has quit IRC | 20:37 | |
| jeblair | krotscheck: all build slaves are single-use, so it will be destroyed | 20:38 |
| krotscheck | Technically that _shouldnt_ be a problem since the node is nuked, but it's ncie to clean up after ourselves if the build exit 1's. | 20:38 |
| arosen | jeblair: how is that secured? | 20:38 |
| jeblair | arosen: iptables | 20:38 |
| jeblair | is how it's "secured" :) | 20:38 |
| fungi | krotscheck: look in the jenkins/jobs/experimental-workers.yaml and at the builder macros from macros.yaml that it's calling | 20:38 |
| jeblair | arosen: geard supports ssl though, so it could theoretically be secured more now | 20:38 |
| arosen | jeblair: just curious if there was any kind of auth support. Thanks. | 20:39 |
| jeblair | arosen: (that is a relatively recent addition) | 20:39 |
| jeblair | arosen: so the answer is yes, but we aren't using it, and the jenkins gearman plugin doesn't support it. i think there is unfinished work to wrap jenkins gearman with stunnel to get that. | 20:39 |
| krotscheck | fungi: You mean mysql-prep? | 20:39 |
| fungi | krotscheck: yeah, and other similar builders | 20:40 |
| jeblair | krotscheck: if you want a cleanup to run regardless of test output, youll need to incorporate it into the test. like a script that runs the test, saves exit code, cleans up, then exits with exit code. | 20:40 |
| jeblair | krotscheck: devstack-gate does that (in devstack-gate itself, you won't find that in jjb) | 20:40 |
| clarkb | jeblair: right, my understanding is that with the docs living in devstack-gate we need to upload them to the logs.o.o server too | 20:41 |
| krotscheck | Urgh. Trying to avoid that, it's easier for new projects to handle those thigns. | 20:41 |
| krotscheck | Sorry | 20:41 |
| clarkb | jeblair: but I am double checking on that | 20:41 |
| jeblair | krotscheck: there _is_ a jenkins post-build thing that will run stuff regardless, but we need to limit our use of it because it's not compatible with our direction wrt jenkins | 20:41 |
| krotscheck | It's easier for new projects to get started if they don't have to write all kinds of custom scripts | 20:41 |
| fungi | krotscheck: basically, builders run in sequence until one of them exits nonzero, then jenkins moves on to things like publishers | 20:41 |
| clarkb | krotscheck: way too much custom scripting for xvfb? there should be a single script that I wrote about 3 years ago | 20:42 |
| *** melwitt has joined #openstack-infra | 20:43 | |
| krotscheck | clarkb: I'm referring to things like https://git.openstack.org/cgit/openstack-infra/storyboard-webclient/tree/bin/build.sh | 20:43 |
| krotscheck | Like, why do I even have to have that in there? | 20:43 |
| *** _nadya_ has joined #openstack-infra | 20:43 | |
| jeblair | clarkb: i guess i don't understand why we need to upload them to logs.o.o if we're also using apache footers. are we going to drop apache footers in favor of stuff uploaded via scp so that we aren't managing them in two places? i don't see the harm in just leaving the footers there until we have expired everything served from filesystem. | 20:43 |
| clarkb | jeblair: the help text is in devstack-gate now, trying to confirm now that apache is consuming it from there, if it is already doing that then I Think you are correct that the scp copy of the help is unnecessary | 20:43 |
| jeblair | clarkb: yeah, i thought i saw a puppet change that uses what's in d-g. | 20:44 |
| clarkb | krotscheck: you shouldn't, instead we should've expanded the existing script to xvfb to meet storboards needs | 20:44 |
| krotscheck | clarkb: Well, we didn't. And now I'm fixing it. | 20:44 |
| *** mrda-away is now known as mrda | 20:44 | |
| * krotscheck doesn't recall why he wrote a custom script, but he probably had a good reason. | 20:45 | |
| dougwig | hello infra, topic looks horked in #openstack-meeting-alt. not sure if someone left a meeting open or what. | 20:45 |
| clarkb | krotscheck: probabl because the existing one assumed a python project | 20:45 |
| *** ryanpetrello has quit IRC | 20:45 | |
| clarkb | krotscheck: but that should be fixable in a central everyone use xvfb the same way | 20:46 |
| *** ryanpetrello has joined #openstack-infra | 20:46 | |
| *** tonytan4ever has quit IRC | 20:46 | |
| krotscheck | clarkb: Likely | 20:47 |
| *** rm_work|away is now known as rm_work | 20:47 | |
| *** tonytan4ever has joined #openstack-infra | 20:47 | |
| *** ryanpetrello has quit IRC | 20:47 | |
| clarkb | jeblair: https://review.openstack.org/#/c/167146/ is the consume help from d-g change | 20:48 |
| jeblair | dougwig: fixed, thx | 20:48 |
| dougwig | jeblair: ty | 20:49 |
| clarkb | jeblair: so I think we can approve 167146 then -1 167158 because of the unecessary file copy | 20:49 |
| *** ryanpetrello has joined #openstack-infra | 20:49 | |
| jeblair | clarkb: okay, so i'm not insane! | 20:50 |
| *** ajo has quit IRC | 20:50 | |
| *** radez is now known as radez_g0n3 | 20:51 | |
| *** e0ne has quit IRC | 20:51 | |
| *** sdake_ has joined #openstack-infra | 20:52 | |
| *** e0ne has joined #openstack-infra | 20:52 | |
| jeblair | clarkb: done | 20:52 |
| *** rm_work is now known as rm_work|away | 20:53 | |
| *** thingee has quit IRC | 20:53 | |
| *** e0ne has quit IRC | 20:55 | |
| *** sdake has quit IRC | 20:55 | |
| arosen | I'm using nodepool+dib to build a percise image though the CI seems to fail because of: /usr/bin/pkg-config --print-errors --atleast-version=0.9.11 libvirt | 20:56 |
| arosen | do you guys do anything special to solve this for percise dib images? | 20:56 |
| *** dprince has quit IRC | 20:57 | |
| *** gulic has quit IRC | 20:57 | |
| *** medieval1 has joined #openstack-infra | 20:57 | |
| mtreinish | arosen: are you trying to use master on precise? | 20:58 |
| arosen | mtreinish: yes | 20:58 |
| *** e0ne has joined #openstack-infra | 20:58 | |
| mtreinish | arosen: I don't think that works because nova bumped the min libvirt requirement | 20:59 |
| *** _nadya_ has quit IRC | 20:59 | |
| *** ryanpetrello_ has joined #openstack-infra | 20:59 | |
| *** samueldmq has quit IRC | 20:59 | |
| *** emagana has quit IRC | 21:00 | |
| *** pc_m has quit IRC | 21:00 | |
| *** annegentle has joined #openstack-infra | 21:00 | |
| *** samueldmq has joined #openstack-infra | 21:00 | |
| *** emagana has joined #openstack-infra | 21:00 | |
| *** ryanpetrello has quit IRC | 21:00 | |
| *** annegentle is now known as Guest43704 | 21:01 | |
| fungi | arosen: right, we test icehouse on precise, juno and later on trusty | 21:01 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Redirect rsync output in aiopcpu https://review.openstack.org/169919 | 21:01 |
| *** ryanpetrello_ is now known as ryanpetrello | 21:01 | |
| openstackgerrit | Dan Smith proposed openstack-infra/project-config: Make the ceph jobs fetch an image-based cirros and use it by default https://review.openstack.org/169903 | 21:01 |
| *** dustins has quit IRC | 21:02 | |
| arosen | fungi: Hrm i seem to be hitting this bug in 14.04: http://logs2.aaronorosen.com/85/169585/1/check/dsvm-tempest-full-congress-nodepool/94f8441/logs/syslog.txt.gz#_Apr__1_02_43_44 | 21:02 |
| arosen | https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1413540 | 21:02 |
| openstack | Launchpad bug 1413540 in linux (Ubuntu) "Trusty soft lockup issues with nested KVM" [High,Confirmed] - Assigned to Chris J Arges (arges) | 21:02 |
| *** medieval1 has quit IRC | 21:02 | |
| arosen | I'm surprised you guys aren't hitting it | 21:02 |
| greghaynes | jeblair: with https://review.openstack.org/#/c/169539/1/tools/simulator.py - I wonder if it might be possible to use the client fakes to run the actual scheduler | 21:02 |
| fungi | arosen: we don't see that since, as clarkb mentioned earlier, we don't (can't) use nested kvm | 21:03 |
| clarkb | ok my experiment on jenkins04 failed. Killing the the thread blocking on the ftp transfer did not unstick all of the other threads | 21:03 |
| jeblair | greghaynes: i do that in the next change, but that runs in real time | 21:03 |
| arosen | fungi: Oh must of missed where clarkb said that you don't used nested kvm. | 21:03 |
| arosen | what do you guys use then? | 21:03 |
| clarkb | I'm kind of amazed anyone uses nested kvm | 21:03 |
| clarkb | arosen: qemu | 21:03 |
| openstackgerrit | Merged openstack-infra/system-config: Fetch devstack-gate documentation from dg https://review.openstack.org/167146 | 21:04 |
| clarkb | pleia2 looked into it just to see if it would help us and found that there be dragons (kernel panics and lockups and all manner of fun) | 21:04 |
| openstackgerrit | Merged openstack-infra/project-config: Add os-testr repo https://review.openstack.org/167243 | 21:04 |
| *** emagana_ has joined #openstack-infra | 21:04 | |
| arosen | clarkb: sorry I don't quite follow. You mean you use qemu in the guest right"? | 21:04 |
| *** emagana has quit IRC | 21:04 | |
| greghaynes | jeblair: oh nice. So the next step is to probably make a model per provider | 21:04 |
| arosen | I'm just running devstack in the guest would that be using kvm over qemu? | 21:04 |
| * greghaynes might have to play with that | 21:05 | |
| clarkb | arosen: cloud provides first layer of VMs to us, we run nova with qemu inside that first layer of VMs to make an innner layer | 21:05 |
| clarkb | arosen: it would use kvm over qemu if you passed virt through | 21:05 |
| *** e0ne has quit IRC | 21:05 | |
| cinerama | wow great. so my local zanata is successfully authenticating against openstackid-dev.o.o | 21:06 |
| asselin_ | clarkb, nested kvm is the default.... | 21:06 |
| sdague | asselin_: not in any cloud we run on | 21:06 |
| clarkb | fungi: is your jenkins01 cleanup still in progress? there are a small number of offline nodes there that look like they can be cleaned up | 21:06 |
| fungi | last i remember, our providers didn't even expose the processor features needed for us to run kvm inside an instance? | 21:06 |
| arosen | clarkb: hrm where would I need to look to change this configuration? | 21:06 |
| clarkb | fungi: I can get them if it won't affect you | 21:06 |
| fungi | clarkb: there's one job still running | 21:06 |
| *** achanda has quit IRC | 21:06 | |
| clarkb | fungi: a I was just going to delete the nodes | 21:06 |
| cinerama | the bad news is that inside the admin interface you can override the values in the config which we so carefully templatized in puppet | 21:06 |
| cinerama | and they never get written back out to the file | 21:06 |
| fungi | clarkb: i can also just delete them from config.xml during the restart | 21:06 |
| asselin_ | sdague, well...i'm running my own cloud...hense the default becomes an issue... | 21:07 |
| clarkb | asselin_: no nested kvm is not the default | 21:07 |
| clarkb | at least it wasn't when we looked into it | 21:07 |
| fungi | clarkb: the main reason i did nodepool cleanup was so that jenkins01 wouldn't continue squatting any ready nodes | 21:07 |
| sdague | clarkb: I think it is now with newer ubuntu | 21:07 |
| jeblair | clarkb: i +2d 126747 with a suggestion for a new patchset. :) | 21:07 |
| clarkb | sdague: wow | 21:07 |
| clarkb | jeblair: there probably should be a test like that | 21:08 |
| clarkb | jeblair: I can update the existing test to do both | 21:08 |
| clarkb | fungi: good point | 21:08 |
| sdague | clarkb: cat /etc/modprobe.d/qemu-system-x86.conf | 21:09 |
| sdague | I don't think I changed that on my systems, could be wrong | 21:09 |
| clarkb | sdague: no its set here too | 21:09 |
| clarkb | sdague: which is intesting given the response that asselin_ linked | 21:09 |
| *** doude has quit IRC | 21:09 | |
| clarkb | ubuntu says "don't do this" | 21:09 |
| clarkb | but then also turns it on by default. I don't even | 21:09 |
| *** aysyd has quit IRC | 21:09 | |
| sdague | heh, I didn't realize they said don't do this | 21:10 |
| asselin_ | I hope this is not an april fools joke :) | 21:10 |
| *** doude has joined #openstack-infra | 21:10 | |
| clarkb | https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1413540/comments/5 seems to imply that you shouldn't nest virt | 21:11 |
| openstack | Launchpad bug 1413540 in linux (Ubuntu) "Trusty soft lockup issues with nested KVM" [High,Confirmed] - Assigned to Chris J Arges (arges) | 21:11 |
| *** ryanpetrello has quit IRC | 21:11 | |
| *** jheroux has quit IRC | 21:11 | |
| *** ryanpetrello has joined #openstack-infra | 21:11 | |
| *** tiswanso has quit IRC | 21:12 | |
| *** wicope has quit IRC | 21:12 | |
| *** miqui has quit IRC | 21:13 | |
| *** thingee has joined #openstack-infra | 21:13 | |
| clarkb | fungi: I am going to go ahead and restart jenkins04 now since my thread killing experiment failed | 21:13 |
| arosen | asselin_: are you running with 14.04 guests and seeing this similiar kernel issue? | 21:13 |
| *** doude has quit IRC | 21:13 | |
| fungi | clarkb: as soon as this last tripleo ironic job finishes i'll stop the jenkins process, wipe the remaining slaves in the config, then bring it back into service | 21:13 |
| asselin_ | arosen, yes | 21:14 |
| clarkb | fungi: on 01? | 21:14 |
| fungi | clarkb: on 01 i mean | 21:14 |
| fungi | yeah | 21:14 |
| clarkb | fungi: thanks | 21:14 |
| fungi | and here it goes... logs uploading now | 21:14 |
| mordred | cinerama: wow, that's fantastic | 21:14 |
| mordred | cinerama: are there any reasons one would need to be admin? | 21:14 |
| mordred | cinerama: perhaps we can just not give anyone admin access ... | 21:15 |
| *** sdake_ has quit IRC | 21:15 | |
| cinerama | mordred: add languages, adjust roles, etc | 21:15 |
| *** reed has quit IRC | 21:15 | |
| *** reed has joined #openstack-infra | 21:15 | |
| clarkb | I had to kill -9 jenkins04 | 21:15 |
| jeblair | mordred, cinerama: yeah, we talked about that as something we could kick down the road, but if that's the case, we may need to implement it now. | 21:15 |
| cinerama | mordred: i should chat with the zanata people about various things | 21:16 |
| *** julim has quit IRC | 21:16 | |
| krotscheck | Can I override the required node in a job-template? Horizon uses both precise and trusty, but npm's version on precise is too old. | 21:16 |
| mordred | cinerama: you should tell them that we're not fans of TTW config :) | 21:16 |
| *** ldnunes has quit IRC | 21:16 | |
| *** amitgandhinz has quit IRC | 21:17 | |
| mordred | krotscheck: horizon should only actually run on precise for stable/juno changes | 21:17 |
| openstackgerrit | Joe Gordon proposed openstack-infra/project-config: Don't run aiopcpu on stable branches https://review.openstack.org/169920 | 21:17 |
| fungi | clarkb: same here, though mine's still hanging around as a defunct zombie | 21:17 |
| cinerama | i also needed to import the ssl cert to get the openid to work | 21:17 |
| fungi | clarkb: okay, it finally cleared | 21:17 |
| krotscheck | mordred: Yep. I suspect the JS tests though aren't going to be a thing until liberty. | 21:17 |
| clarkb | I am going to put 05 and 06 in shutdown mode as soon as 01 is up again | 21:18 |
| cinerama | we can either poke at that more or just fix up puppet to create a java keystore | 21:18 |
| krotscheck | mordred: Though I don't think that's going to help much :/ | 21:18 |
| mordred | krotscheck: yah - so, I mean, I don't think you need to override anything | 21:18 |
| mordred | because new tests aren't ever going to get run on precise | 21:18 |
| jeblair | krotscheck: essentially most node specifications in jjb are "what nodes could this _possibly_ be called to run on under various circumstances", actual node selection usually happens in zuul. | 21:18 |
| fungi | clarkb: it's on its way back up now | 21:18 |
| *** Guest43704 has quit IRC | 21:18 | |
| jeblair | and currently, horizon master tests should be running on trusty | 21:18 |
| *** achanda has joined #openstack-infra | 21:18 | |
| mordred | krotscheck: zuul/openstack_functions.py is where you want to look to see that logic, btw | 21:18 |
| mordred | krotscheck: in project-config | 21:19 |
| jeblair | be forewarned: it's mind-bendy. | 21:19 |
| mordred | yah | 21:19 |
| *** dims_ has quit IRC | 21:19 | |
| mordred | jeblair: haven't we deleted stable/icehouse yet? | 21:19 |
| jeblair | we only touch it every six months usually :) | 21:19 |
| clarkb | fungi: cool 01-04 should be good now then | 21:19 |
| fungi | mordred: remember stable/icehouse got extra long support promised | 21:20 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Add NPM Command Execution as a Build Target https://review.openstack.org/169829 | 21:20 |
| mordred | fungi: I apologize for not having been in that room to yell and scream | 21:20 |
| jeblair | fungi: and people are keeping it clean? | 21:20 |
| mordred | fungi: yeah - does stable/icehouse still build? | 21:21 |
| fungi | jeblair: moreso than previous releases anyway. the stable-maint team has gotten more organized | 21:21 |
| mordred | it would have been great for our first long-term thing to have been one based on trusty and not one based on precise | 21:21 |
| fungi | from what i've seen they're communicating with each other and staying on top of the stable bitrot job failures | 21:21 |
| jeblair | neat! | 21:21 |
| mordred | wow! | 21:21 |
| jeblair | mordred: yeah, we should plan better next time | 21:21 |
| clarkb | but only after the major meltdown | 21:22 |
| *** dboik_ has joined #openstack-infra | 21:22 | |
| clarkb | but its good to see them step up after all that | 21:22 |
| mordred | jeblair: so - I suppose I should test that my dib stuff builds precise things too then? | 21:22 |
| mordred | just to make sure | 21:22 |
| clarkb | mordred: yes | 21:22 |
| jeblair | yeah, i think we were 1 week away from deleting it after the usual time frame when the meltdown happened and people stepped up... | 21:22 |
| jeblair | mordred: so, er, precise is an lts | 21:23 |
| mordred | jeblair: yes it is | 21:23 |
| jeblair | mordred: actually seems to be a good thing to base our 'lts' on, yeah? | 21:23 |
| krotscheck | clarkb: So, I'm guessing https://review.openstack.org/#/c/169829/ may not work because of the export? | 21:23 |
| mordred | jeblair: but so is trusty | 21:23 |
| mordred | jeblair: if we'd made juno our first 'lts' | 21:23 |
| jeblair | mordred: okay i gotcha | 21:23 |
| mordred | it would have set us up for less pain | 21:23 |
| clarkb | krotscheck: correct that won't make it across jenkins shell builders | 21:24 |
| clarkb | krotscheck: you can load it into the jenkisn job env with a jenkins plugin though | 21:24 |
| * mordred goes to run dib ubuntu-minimal on DIB_RELEASE=precise | 21:24 | |
| jeblair | clarkb, krotscheck: no you can't -- no jenkins plugins for that sort of thing | 21:25 |
| clarkb | 05 and 06 are in shutdown mode | 21:25 |
| jeblair | clarkb, krotscheck: jobs are simple shell scripts with no crazy jenkins features | 21:25 |
| *** dboik has quit IRC | 21:25 | |
| *** garyh has quit IRC | 21:25 | |
| jeblair | clarkb, krotscheck: so that we can stop using jenkins (so that clarkb can stop restarting them all the time :) | 21:26 |
| krotscheck | So I can't set a global environment variable and just use it in that job script? | 21:26 |
| *** hdd has quit IRC | 21:26 | |
| clarkb | jeblair: good point :) | 21:26 |
| *** dboik_ has quit IRC | 21:26 | |
| clarkb | what you can do is run it as a service on a known display | 21:26 |
| *** hdd has joined #openstack-infra | 21:26 | |
| clarkb | so have xvfb running on display99 and anyone that wants to use it just knows to change their display | 21:27 |
| krotscheck | clarkb: There's no way to preload a global env var? | 21:27 |
| krotscheck | Even outside of any of the scripts? | 21:28 |
| clarkb | krotscheck: thats what jeblair is saying, there are ways but you shouldn't use them | 21:28 |
| *** boris-42 has quit IRC | 21:28 | |
| jeblair | krotscheck: there is no global context within the job -- the builders are all independent scripts | 21:28 |
| jeblair | krotscheck: but what you _can_ do | 21:28 |
| clarkb | because as jeblair points ou I am restarting jenkins right now to work around a jenkins bug that has no upstream traction to debug and it makes jenkins pretty broken | 21:28 |
| krotscheck | I mean, can/t I just write to /etc/environment? | 21:28 |
| jeblair | krotscheck: is have builders take parameters in jjb, and specify things that multiple builders need as jjb expansion | 21:29 |
| jeblair | krotscheck: or write to known files, yes | 21:29 |
| *** ryanpetrello has quit IRC | 21:29 | |
| mordred | krotscheck: yes. you can do that. or write to a file and have other things source that file. or what jeblair said | 21:29 |
| clarkb | oh sure you can solve this compeltely outside of jenkins and jjb | 21:29 |
| krotscheck | The reason I prefer the global approach is that I may not have control over which browsers are invoked, so I just want them to automatically go to the xvfb display. | 21:30 |
| *** ryanpetrello has joined #openstack-infra | 21:30 | |
| jeblair | that is the most future-proof way | 21:30 |
| clarkb | I wouldn't make this too complicated though, you just need to know to use a displa | 21:30 |
| clarkb | krotscheck: they will do that always if you just use the right displa... | 21:30 |
| krotscheck | clarkb: And using the right display woul dbe.... 0? | 21:30 |
| clarkb | its kinda like how tests know where to look for mysql/postgresql/etal | 21:30 |
| clarkb | we don't have to do any crazy negotiating for that, the service is running on a known location and that location is queried | 21:31 |
| clarkb | krotscheck: it would be whatever you tell xvdb to run on | 21:31 |
| clarkb | er | 21:31 |
| clarkb | xvfb | 21:31 |
| krotscheck | clarkb: What you are saying makes sense, however it is lacking the "here's how you make it actually work" context. | 21:32 |
| clarkb | krotscheck: `export DISPLAY=99 tox` | 21:33 |
| krotscheck | So if I say: Start xvfb on :99 | 21:33 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova upgrade bug 1438920 https://review.openstack.org/169924 | 21:33 |
| openstack | bug 1438920 in OpenStack Compute (nova) "specification of a nova network to instance during icehouse->juno partial upgrade fails" [Undecided,Fix committed] https://launchpad.net/bugs/1438920 | 21:33 |
| krotscheck | That's the piece I was missing. | 21:33 |
| fungi | clarkb: if you have a moment, this is a one-character change to fix having zuul test status listed in gerrit webui... https://review.openstack.org/169905 | 21:34 |
| clarkb | fungi: 1674214 has been held for ~48 hours, any idea why? I think I am going to delte it for 05 cleanup | 21:34 |
| fungi | clarkb: that's one of the nodes i'm doing bindep comparisons on | 21:34 |
| clarkb | fungi: should I leave it then? | 21:35 |
| openstackgerrit | Dan Smith proposed openstack-infra/devstack-gate: Do not merge me - I am for testing. https://review.openstack.org/169907 | 21:35 |
| fungi | clarkb: yeah, when deleting nodes in nodepool i've been filtering out any in a hold status | 21:35 |
| clarkb | fungi: approved | 21:35 |
| clarkb | fungi: kk | 21:36 |
| *** garyh has joined #openstack-infra | 21:36 | |
| clarkb | fungi: but I can remove it from the jenkins server? | 21:36 |
| fungi | clarkb: sure. it doesn't need to be in jenkins at all | 21:36 |
| clarkb | thanks | 21:36 |
| openstackgerrit | Dan Smith proposed openstack-infra/devstack-gate: Do not merge me - I am for testing. https://review.openstack.org/169907 | 21:36 |
| *** mwagner_lap has quit IRC | 21:36 | |
| clarkb | fungi: I don't want it to go online when jenkins restarts | 21:36 |
| openstackgerrit | Dan Smith proposed openstack-infra/project-config: Make the ceph jobs fetch an image-based cirros and use it by default https://review.openstack.org/169903 | 21:36 |
| clarkb | fungi: that will allow it ot run a job on your held node | 21:37 |
| *** peristeri has quit IRC | 21:37 | |
| fungi | clarkb: right. i just remove everything in config.xml between the <slaves> and </slaves> line before starting the daemon | 21:37 |
| *** sdake has joined #openstack-infra | 21:37 | |
| *** medieval1 has joined #openstack-infra | 21:37 | |
| clarkb | oh I don't do that because then you have to do extra nodepool cleanup | 21:38 |
| clarkb | basically I try to avoid deleting nodes that we somehow miraculously booted :) | 21:38 |
| fungi | oh, got it | 21:38 |
| clarkb | but both ways work, I am just optimizing for clouds being cranky | 21:39 |
| fungi | we do seem to be doing somewhat better this week than last | 21:39 |
| *** ChuckC has quit IRC | 21:39 | |
| *** ryanpetrello has quit IRC | 21:39 | |
| *** tonytan_brb has joined #openstack-infra | 21:40 | |
| clarkb | ok 05 has been cleaned up of stale slaves | 21:40 |
| clarkb | it is ready to be restarted when jobs complete | 21:40 |
| *** ryanpetrello has joined #openstack-infra | 21:40 | |
| fungi | clarkb: i mean, it's not the end of the world if you delete these held nodes, but catching more between when they go ready and when they start running jobs is next to impossible unless i do it in the middle of the night when zuul is idle | 21:40 |
| *** sdake_ has joined #openstack-infra | 21:41 | |
| jeblair | fungi: yes, when i grabbed values for the simulator, hpcloud was at 20 seconds/create, which is where we were 2 weeks ago (last week was 40-60). | 21:41 |
| jeblair | mordred, cody-somerville: ^ | 21:41 |
| jeblair | or about 320 nodes per hour | 21:42 |
| *** Rockyg has quit IRC | 21:43 | |
| jeblair | (i just used the unit "nodes per hour") | 21:43 |
| cody-somerville | fungi: neat trick. Appreciate you sharing that. We've been deleting nodes by hand via jenkins web ui previously. | 21:43 |
| cody-somerville | haha | 21:43 |
| cody-somerville | jeblair: Whats this simulator you speak of? | 21:44 |
| *** tonytan4ever has quit IRC | 21:44 | |
| jeblair | cody-somerville: https://review.openstack.org/169539 | 21:44 |
| greghaynes | clarkb: updated https://review.openstack.org/156433 | 21:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add delete_image call https://review.openstack.org/169783 | 21:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Skip passing in timeout to glance if it's not set https://review.openstack.org/169803 | 21:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Migrate API calls to task management https://review.openstack.org/168665 | 21:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Poll on the actual image showing up https://review.openstack.org/169804 | 21:44 |
| greghaynes | clarkb: input and output file names make no difference | 21:44 |
| fungi | cody-somerville: yes, if you're taking the jenkins daemon offline anyway, vi will make very quick work of deleting hundreds of slaves ;) | 21:44 |
| *** sdake has quit IRC | 21:45 | |
| cody-somerville | jeblair: nice! | 21:45 |
| cody-somerville | fungi: Oh, it only works if you reboot? | 21:45 |
| *** sdake has joined #openstack-infra | 21:45 | |
| cody-somerville | jeblair: So just to make sure, are you calling out that hpcloud is faster again? So good thing? Or is something wrong and you need me to poke some people? | 21:46 |
| fungi | cody-somerville: well, there is also a jenkins api if you want to script live slave removal. i've not tried editing the global config.xml while the daemon is running, though there's also an api call to tell it to reload its config so that might work... | 21:46 |
| jeblair | cody-somerville: just more data. it's as bad as it was 2 weeks ago, which is better than last week, but still very bad. i am surprised at the variance. | 21:46 |
| *** xyang1 has joined #openstack-infra | 21:47 | |
| mordred | speaking of: https://review.openstack.org/#/c/169724/ <-- statsd counters for tracking such things if jeblair, fungi, clarkb or pleia2 want to review ... | 21:47 |
| cody-somerville | jeblair: Agreed. I'm going to see if we can have them track this if not already. | 21:48 |
| jeblair | mordred: you want the word 'provider' in there? | 21:48 |
| mordred | jeblair: do I not? | 21:48 |
| mordred | did I fat-finger that again? | 21:48 |
| mordred | gah | 21:48 |
| *** bdpayne has joined #openstack-infra | 21:48 | |
| *** marun has quit IRC | 21:49 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Add statsd counters to the TaskManager https://review.openstack.org/169724 | 21:49 |
| mordred | jeblair: sorry | 21:49 |
| jeblair | mordred: we only do that for the guages where i think there was maybe a reason for it? but the launch/delete incr/timing stats have shorter keys | 21:49 |
| *** ryanpetrello has quit IRC | 21:49 | |
| mordred | yah. copypasta error | 21:49 |
| *** sdake_ has quit IRC | 21:49 | |
| jeblair | +2 | 21:49 |
| mordred | yay! | 21:49 |
| *** ryanpetrello has joined #openstack-infra | 21:50 | |
| openstackgerrit | Merged openstack-infra/system-config: Use HTTPS when including Zuul status via hideci https://review.openstack.org/169905 | 21:51 |
| *** asettle has joined #openstack-infra | 21:51 | |
| *** mriedem is now known as mriedem_away | 21:51 | |
| greghaynes | jeblair: oh, is the idea of your fake-workload that youll just run a real nodepool and the fake-workload provides input and outputs status? | 21:51 |
| *** tonytan_brb has quit IRC | 21:52 | |
| *** stevemar has quit IRC | 21:52 | |
| *** ibiris is now known as ibiris_away | 21:53 | |
| jeblair | greghaynes: yep. that's actually usually how i test nodepool (see fake-workers.py) it's just that normally i don't actually care about simulating the effect of jobs which take a certain amount of time to run. so fake-workload pretends to run a jenkins job on each node. | 21:54 |
| *** bknudson has quit IRC | 21:54 | |
| jeblair | greghaynes: sorry the code is so terrible -- it's literally just a bunch of stuff i cobbled together to run nodepool locally "for real" without needing pesky clouds. | 21:54 |
| *** mjturek1 has quit IRC | 21:54 | |
| greghaynes | jeblair: no, its awesome. I might have some fun with this | 21:55 |
| greghaynes | control systems modeling is something I like to do for fun :) | 21:55 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for nova upgrade bug 1438920 https://review.openstack.org/169924 | 21:55 |
| openstack | bug 1438920 in OpenStack Compute (nova) "specification of a nova network to instance during icehouse->juno partial upgrade fails" [Undecided,Fix committed] https://launchpad.net/bugs/1438920 | 21:55 |
| jeblair | elapsed: 102948, run: 914 | 21:55 |
| jeblair | greghaynes: considering that's the output i'm getting after 28 hours, i suspect it's not quite right | 21:56 |
| jhesketh | Morning | 21:56 |
| jeblair | greghaynes: 32 nodes per hour seems really low :) | 21:56 |
| greghaynes | hah, I hope thats low | 21:56 |
| jeblair | greghaynes: have fun! i've task-switched away from it for a bit, so feel free to push up new patchsets or changes even | 21:57 |
| *** ryanpetrello_ has joined #openstack-infra | 21:57 | |
| *** boris-42 has joined #openstack-infra | 21:57 | |
| jeblair | greghaynes, cody-somerville: fwiw, the simulator (note the nodepool fake stuff) was within 20% of our actual observed rate. so it's clearly imperfect, but i think it's in the ballpark and i _think_ it's reasonable enough to get an idea of whether a change is better or worse at least. | 21:58 |
| jeblair | * (not the nodepool fake stuff) | 21:59 |
| *** hashar has quit IRC | 21:59 | |
| *** thingee has quit IRC | 21:59 | |
| greghaynes | yep, what is really useful for these sytems is to just graph queue depth over time for each model | 22:00 |
| *** ryanpetrello has quit IRC | 22:00 | |
| *** ryanpetrello_ is now known as ryanpetrello | 22:00 | |
| *** dangers is now known as dangers_away | 22:00 | |
| *** sarob has joined #openstack-infra | 22:00 | |
| jeblair | mordred: as i re-review your changes, i realize gertty needs to highlight my name in my review comments so i can be reminded of what i have previously written | 22:00 |
| mordred | jeblair: ++ | 22:00 |
| *** emagana_ has quit IRC | 22:01 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:01 | |
| *** ryanpetrello_ has joined #openstack-infra | 22:01 | |
| *** carl_baldwin has quit IRC | 22:02 | |
| jeblair | greghaynes: actually, i think in this system, they should actually level off (the simulator may not quite do that without some randomization). basically because we have a fixed quota and so will not attempt to create more than X servers, and there's a fixed rate at which they are being created. | 22:02 |
| *** ryanpetrello_ has quit IRC | 22:03 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Add os-testr commits to gerritbot config https://review.openstack.org/169933 | 22:03 |
| greghaynes | jeblair: yep, so what you want to look for is how long it takes to reach that point given an input function | 22:03 |
| greghaynes | IIUC | 22:03 |
| *** reed has quit IRC | 22:04 | |
| *** ekarlso has quit IRC | 22:04 | |
| *** ekarlso has joined #openstack-infra | 22:04 | |
| mtreinish | fungi, jeblair, clarkb, mordred: if you get a sec can you populate the new os-testr gerrit groups with my gerrit id | 22:04 |
| fungi | mtreinish: doing so now | 22:04 |
| greghaynes | I also might have some nodepoolisms to learn which playing with will probably help with :) | 22:05 |
| mtreinish | fungi: great thanks | 22:05 |
| jeblair | greghaynes: yeah, that would probably be interesting. my "bottom line" at the moment though is nodes per hour over a multi-hour period, since that's what we care about most when the system is under heavy load. | 22:05 |
| fungi | mtreinish: done | 22:05 |
| jeblair | greghaynes: also, i don't actually want to have to think about this at all. i would _really_ just like the cloud to behave. :) | 22:06 |
| mtreinish | fungi: awesome, now to self approve a change and push the first release :) | 22:06 |
| greghaynes | jeblair: Gotcha, so that should have similar properties but good to know | 22:06 |
| greghaynes | jeblair: but we all know we cant have nice things | 22:07 |
| fungi | jeblair: sdague: jhesketh: the review test details are now showing properly in the gerrit webui | 22:07 |
| mtreinish | haha, turns out the os-testr repo doesn't pass pep8 :) | 22:08 |
| mtreinish | I guess I should fix that first | 22:08 |
| mtreinish | fungi: cool, yeah I just saw that pop up | 22:08 |
| *** ChuckC has joined #openstack-infra | 22:09 | |
| mtreinish | oh, it's the subunit2html script which fails it... | 22:09 |
| mtreinish | oh, and it's not apache licensed... | 22:10 |
| mtreinish | clarkb, jeblair, fungi: ^^^ any advice on that? | 22:10 |
| mordred | mtreinish: it's what, MIT? | 22:10 |
| openstackgerrit | Merged openstack-infra/nodepool: Add statsd counters to the TaskManager https://review.openstack.org/169724 | 22:10 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Change review->change in zuul table https://review.openstack.org/169934 | 22:10 |
| mtreinish | mordred: not sure I didn't recognize it: http://git.openstack.org/cgit/openstack/os-testr/tree/os_testr/subunit2html.py | 22:11 |
| mordred | mtreinish: ah - BSD | 22:11 |
| mordred | or, BSD style | 22:11 |
| mordred | I'd just add an apache header as well ... fungi yes? | 22:11 |
| *** hdd has quit IRC | 22:11 | |
| *** ZZelle__ has quit IRC | 22:11 | |
| jeblair | mordred: you're suggesting that he add an extra license to satisfy hacking? | 22:12 |
| mordred | jeblair: to satisfy the theory of openstack software being apache - and there being in nothing in the BSD license that prevents such a thing? | 22:13 |
| fungi | it't 3-clause bsd. it does require that the list of conditions and disclaimer be included along with the code when it's redistributed so we certainly shouldn't remove what's there | 22:13 |
| mordred | we should definitely not remove the bsd license | 22:13 |
| jeblair | yeah, i'm not actually saying it can't be done | 22:13 |
| jeblair | i'm just not yet convinced it's a good idea | 22:13 |
| *** 77CAAKTHH has joined #openstack-infra | 22:13 | |
| *** 17SAB8E87 has joined #openstack-infra | 22:13 | |
| *** mwagner_lap has joined #openstack-infra | 22:14 | |
| fungi | subunit2html.py looks completely copied. i'd be inclined to call that a vendored dependency which has its own compatible license, and tell hacking to f off | 22:14 |
| mtreinish | fungi: heh, well it's copied from project-config | 22:14 |
| jeblair | basically, there isn't anything being added to that that is under the apache license, so i think it would simply be confusing to anyone looking at it | 22:14 |
| mtreinish | I'm not sure who wrote it though | 22:14 |
| mordred | Wai Yip Tung | 22:15 |
| mordred | it looks like | 22:15 |
| fungi | Wai Yip Tung | 22:15 |
| fungi | yep[ | 22:15 |
| jeblair | mordred: i mean, we'd be saying "we totally grant you a patent license to these zero lines of code". except we would be neglecting to mention the "zero lines of code" part. :) | 22:15 |
| mtreinish | that's who wrote the script it's based on | 22:15 |
| krotscheck | Good lord, I can't believe our javascript builds are as stable as they are. | 22:15 |
| mordred | jeblair: I don't think that's what we'd be saying | 22:15 |
| mtreinish | HTMLTestRunner | 22:15 |
| mordred | jeblair: I think we'd be saying "We are distributing this code to you under the terms of the Apache license - it also turns out that it's licensed under the BSD license, which allows us to relicense it for absolutely no reason" | 22:16 |
| mordred | that we are not copyright owners of any of the code is immaterial | 22:16 |
| mtreinish | the subunit stuff was added by someone on openstack | 22:16 |
| mordred | because BSD | 22:16 |
| * mtreinish wants to say clarkb | 22:16 | |
| mtreinish | http://tungwaiyip.info/software/HTMLTestRunner.html | 22:16 |
| *** thingee has joined #openstack-infra | 22:16 | |
| *** sarob has quit IRC | 22:16 | |
| fungi | aha, yes it says "Original HTMLTestRunner License" at the top | 22:17 |
| mordred | jeblair: I think it'sa silly thing to do - so I am inclined to agree with you | 22:17 |
| fungi | so, anyway, i think that if there is some value in that hacking check, it needs a mechanism to be overridden at least for files which we know don't need an apache license added because they're already being distributed under some other compatible license | 22:18 |
| jeblair | mordred: ok, we don't need to argue for form's sake then. however, if we have added anything to it, and we think we have done so under the apache license, i think adding an apache header (and keeping mit) and so indicating is reasonable. | 22:18 |
| mordred | jeblair: aw. but arguing for form's sake is so much fun! | 22:18 |
| jeblair | mordred: i was reviewing your patches :) | 22:18 |
| fungi | there's plenty of other stuff to usefully argue about instead | 22:18 |
| mordred | jeblair: ok. that's more important | 22:18 |
| *** bdpayne has quit IRC | 22:19 | |
| *** ZZelle__ has joined #openstack-infra | 22:19 | |
| mtreinish | so the conclusion is to add an apache header on the top of the file? | 22:19 |
| mordred | mtreinish: nope. it's to tell hacking to get bent | 22:19 |
| mordred | mtreinish: I believe you can put a flake8: noqa in the header of the file | 22:20 |
| jeblair | unless clarkb added new stuff? | 22:20 |
| clarkb | there were some bug fixes | 22:20 |
| clarkb | it should likely carry both licenses (I thought it did) | 22:20 |
| *** asselin has joined #openstack-infra | 22:20 | |
| mtreinish | all the subunit stuff was added by us too right? | 22:20 |
| jeblair | clarkb: did you write some new code? | 22:20 |
| jhesketh | fungi: great, thanks for that! | 22:21 |
| clarkb | jhesketh: yes, the main() function that calls into the existing code | 22:21 |
| fungi | yeah, i think if clarkb feels he usefully extended it and that his additions warrant updating the copyright header, then adding the apache license too is fine | 22:21 |
| *** reed has joined #openstack-infra | 22:21 | |
| mordred | jroll: swiftclient.exceptions.ClientException: Object POST failed: https://storage101.ord1.clouddrive.com/v1/MossoCloudFS_622b11a1-5dfa-43b4-9f58-4ad3c6dbc4a0/images/dib-ubuntu-trusty 499 Client Disconnect [first 60 chars of response] <html><h1>Client Disconnect</h1><p>The client was disconnect | 22:21 |
| mordred | jroll: I got a new and exciting error, this time from ORD, when trying to upload to swift | 22:22 |
| clarkb | yes I think they do, because the subunit stuff is new and special | 22:22 |
| jroll | mordred: why'd you disconnect your client? :) | 22:22 |
| mordred | jroll: because. I hate texas | 22:22 |
| fungi | however i also think clarkb should submit the commit to add his copyright line and the header, for clarity | 22:22 |
| jeblair | mordred: yeah, stop disconnecting yourself! stop disconnecting yourself! :) | 22:22 |
| jroll | mordred: but that's chicago | 22:22 |
| clarkb | fungi: well lifeless has commits there too iirc | 22:22 |
| jroll | :D | 22:22 |
| * clarkb uses some git log -p and hopes to not be too disappointed by the repo moves | 22:22 | |
| mordred | jroll: are you telling me there is a part of the world that isn't _REALLY_ texas? | 22:22 |
| fungi | clarkb: doesn't meant you can't do it even if he doesn't (or vice versa) | 22:23 |
| mtreinish | fungi: heh, well if it's just the copyright header it'll fail pep8 for other reasons too | 22:23 |
| *** 17SAB8E87 has quit IRC | 22:23 | |
| *** nelsnelson has quit IRC | 22:23 | |
| jroll | mordred: look out your window, do you see rifles and bbq? | 22:23 |
| jroll | mordred: and like, any spare land? | 22:23 |
| jeblair | mordred: i'm looking at 162148 and can't tell if there was a rebase or a change | 22:23 |
| *** 77CAAKTHH has quit IRC | 22:23 | |
| mordred | jroll: uhm, I'm in brooklyn ... yes | 22:23 |
| mordred | jeblair: lookin | 22:23 |
| jroll | heh | 22:23 |
| mordred | jeblair: all rebases - I had to fix a merge conflict | 22:24 |
| mordred | jeblair: it has not changed for reals since your last +@ | 22:24 |
| mordred | jeblair: it has not changed for reals since your last +2 | 22:24 |
| clarkb | but ya I can push a patch to apache license and (C) HP | 22:24 |
| fungi | jroll: here in 'murica everyone has guns, barbecue and spare land | 22:24 |
| *** dkliban is now known as dkliban_afk | 22:24 | |
| jeblair | i only have 1/3 | 22:24 |
| jroll | fungi: I'm in the bay area, I wouldn't know anything about guns or spare land :( | 22:25 |
| *** gordc has quit IRC | 22:25 | |
| *** asselin has quit IRC | 22:25 | |
| *** dimtruck is now known as zz_dimtruck | 22:25 | |
| mordred | jroll: no you would not | 22:25 |
| *** asettle has quit IRC | 22:25 | |
| mordred | mtreinish: the other pep8 errors are trivial to fix | 22:25 |
| mtreinish | mordred: yeah they are | 22:25 |
| fungi | jroll: i thought cascadia already seceded? | 22:25 |
| jeblair | fungi: or are you thinking of the state of jefferson? | 22:26 |
| clarkb | though wait | 22:26 |
| jroll | fungi: cascadia is oregon and up | 22:26 |
| clarkb | is there anything technically wrong with the statement as it stands? | 22:26 |
| *** hdd has joined #openstack-infra | 22:26 | |
| jroll | (according to wikipedia) | 22:26 |
| clarkb | jroll: I thought the bay area had pletny of guns | 22:27 |
| jroll | fungi: at any rate, I can't reasonably afford a yard and I think that is lame | 22:27 |
| clarkb | its merely incomplete right? | 22:27 |
| jroll | clarkb: yeah, toy guns :P | 22:27 |
| fungi | jeblair: neat--i somehow missed the jefferson statehood movement | 22:28 |
| mordred | jroll: why would you think "reasonably" applies? | 22:28 |
| *** tkelsey has joined #openstack-infra | 22:28 | |
| mordred | jroll: you already said you live in the bay | 22:28 |
| jroll | mordred: I don't like ramen that much :P | 22:29 |
| *** yfried has quit IRC | 22:29 | |
| *** esker has quit IRC | 22:29 | |
| clarkb | is hacking going to complain if the first comment block is not apache2? | 22:29 |
| jroll | mordred: at any rate, I need to move back outta here | 22:29 |
| mordred | clarkb: just make the first comment block the apache2 license | 22:30 |
| mordred | clarkb: then follow it with "the original license is: blah" | 22:30 |
| jeblair | (not because of hacking, but because it's appropriate) | 22:30 |
| mordred | jeblair: I'm pretty sure I support the State of Jefferson | 22:31 |
| jeblair | it's the "State of Mind" :) | 22:31 |
| lifeless | clarkb: commits where? | 22:32 |
| mtreinish | clarkb: I think it just needs to be in the first few lines | 22:32 |
| *** tkelsey has quit IRC | 22:32 | |
| clarkb | lifeless subunit2html | 22:34 |
| lifeless | clarkb: ah.only trivial ones I suspect | 22:35 |
| lifeless | clarkb: copyright headaches? | 22:35 |
| *** emagana has joined #openstack-infra | 22:35 | |
| clarkb | lifeless: I don't think there is any headache | 22:37 |
| clarkb | just an incomplete set of data | 22:37 |
| jeblair | mordred: okay, help me out with 168665 | 22:38 |
| lifeless | clarkb: ok. what data is needed? | 22:38 |
| fungi | hrm... so our devstack-trusty workers have python-requests preinstalled but our bare-trusty workers and .*-precise workers do not | 22:38 |
| clarkb | lifeless: I don't think any is needed, it is all in git | 22:38 |
| mordred | jeblair: you are helped! | 22:39 |
| jeblair | mordred: i don't feel helped. i -1 with 5 comments os ps4. you're up to ps12 now. i don't know where to look to find what's changed. | 22:39 |
| boris-42 | mordred: hi | 22:40 |
| boris-42 | mordred: I tried github + travis | 22:40 |
| mordred | jeblair: gotcha. gimme a sec and I will be more helpful | 22:40 |
| boris-42 | mordred: I wanna say that suxxxx | 22:40 |
| boris-42 | =) | 22:40 |
| mordred | boris-42: awesome :) | 22:40 |
| * mordred hands boris-42 a nice fluffy moose | 22:40 | |
| boris-42 | mordred: =) | 22:41 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Add NPM Command Execution as a Build Target https://review.openstack.org/169829 | 22:41 |
| mordred | boris-42: yesterday I had to upload 16 different PRs to a github repo - it took FOREVER | 22:41 |
| boris-42 | mordred: I think a bit more=) | 22:41 |
| krotscheck | clarkb: Next question- will the invocation of npm run {command} work because it's not in quotes? https://review.openstack.org/#/c/169829/3/jenkins/jobs/macros.yaml | 22:42 |
| *** thingee has quit IRC | 22:42 | |
| *** thingee has joined #openstack-infra | 22:43 | |
| *** emagana has quit IRC | 22:43 | |
| mordred | jeblair: the first comment I took care of by creating a different change for that | 22:44 |
| mordred | jeblair: for createImageSnapshot, I reworked it to use all keywords rather than any positional | 22:44 |
| clarkb | http://paste.openstack.org/show/197839/ are the people and years that things got edited in that file | 22:45 |
| mordred | jeblair: for the task comment, I agree, and I renamed task to glance_task per your suggestion | 22:45 |
| clarkb | so I think its (C) 2012-2013 HP and (C) 2013 IBM | 22:45 |
| mordred | jeblair: and in _tasks I removed both usages of pop - because it turns out I can use a different interface in glance that does not require having an image object | 22:46 |
| clarkb | mordred: sdague fungi lifeless ^ | 22:46 |
| mordred | clarkb: works for me | 22:46 |
| mordred | clarkb: I do not know if IBM has a copyright holding special thing like HP does | 22:46 |
| mordred | but a quick grep of openstack should find the right cantrip | 22:46 |
| clarkb | ya, I figured I could find a sdague change from that period and see what sdague did | 22:47 |
| mordred | jeblair: is that helpful at all? *me looks hopefully aroudn the moose he gave boris-42* | 22:47 |
| jeblair | clarkb: i'd just add your own and ask sdague to add himself if he wishes | 22:47 |
| clarkb | jeblair: kk that works | 22:47 |
| jeblair | mordred: did you do those things in a specific patchset? | 22:48 |
| *** annegentle has joined #openstack-infra | 22:48 | |
| jeblair | mordred: basically, i _want_ to review your change, but i can't because there is a change hidden somewhere in 8 rebases and i don't know which is which | 22:48 |
| *** annegentle has quit IRC | 22:48 | |
| lifeless | clarkb: WFM | 22:49 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Add license info to subunit2html https://review.openstack.org/169940 | 22:49 |
| clarkb | there that should cover everything but sdague's edits | 22:49 |
| jeblair | mordred: if you could annotate that in some way that would be swell; possibly by replying to my comments, or leaving a comment indicating a change is a real change or a rebase | 22:50 |
| mordred | jeblair: I believe I did them in patchset 5 | 22:50 |
| *** vinkman_ has joined #openstack-infra | 22:50 | |
| mordred | jeblair: but sure thing | 22:51 |
| jeblair | mordred: oh, i looked there, but assumed not because i saw no response to my first comment | 22:51 |
| clarkb | mtreinish: 169940 should mostly cover you, though it may also want a (C) line for sdague's January 21/22 2013 edits | 22:51 |
| jeblair | mordred: ah, because it was a rebase onto the change that implemented it | 22:53 |
| *** vinkman_ has left #openstack-infra | 22:53 | |
| jeblair | mordred: so everything after ps5 is rebases? | 22:54 |
| mordred | jeblair: nod. sorry about that ... I have added annotations | 22:54 |
| *** teran has quit IRC | 22:54 | |
| mordred | jeblair: no - there are additional fixes found - let me see fi I can make you an interdiff | 22:55 |
| *** andreykurilin_ has joined #openstack-infra | 22:55 | |
| *** vinkman_ has joined #openstack-infra | 22:55 | |
| mtreinish | clarkb: ok I'll port that over to os-testr in a bit | 22:56 |
| mtreinish | thanks | 22:56 |
| *** annegentle has joined #openstack-infra | 22:58 | |
| jeblair | mordred: i think i picked em out, thanks. | 22:59 |
| *** sarob has joined #openstack-infra | 23:00 | |
| mordred | jeblair: aw, darn. I just got fancy and made a diff | 23:00 |
| *** sabeen has quit IRC | 23:01 | |
| mordred | jeblair: http://paste.openstack.org/show/197841 is what I believe changed between ps4 and current | 23:02 |
| mordred | fwiw | 23:02 |
| jeblair | mordred: yeah, but a bunch of that router stuff is from a rebase, right? | 23:03 |
| jeblair | oh, no i see | 23:03 |
| jeblair | nm | 23:03 |
| *** bknudson has joined #openstack-infra | 23:06 | |
| *** chlong has joined #openstack-infra | 23:07 | |
| *** sarob has quit IRC | 23:08 | |
| clarkb | 05 is ready to be restarted so I am doing that now | 23:08 |
| clarkb | (one job on 06 | 23:08 |
| asselin_ | i'm running into this: http://paste.openstack.org/show/197842/ seems related to https://git.openstack.org/cgit/openstack-infra/nodepool/commit/ | 23:08 |
| asselin_ | (just merged...https://review.openstack.org/#/c/169724/) | 23:11 |
| clarkb | putting 07 in shutdown mode now | 23:12 |
| jeblair | asselin_, mordred: wow, i guess that doesn't have test coverage | 23:12 |
| *** andreykurilin_ has quit IRC | 23:13 | |
| jeblair | asselin_, mordred: that needs an "if statsd:" | 23:13 |
| asselin_ | I can try it now | 23:14 |
| jeblair | (maybe it does have coverage but we only test with statds enabled) | 23:14 |
| *** annegentle has quit IRC | 23:15 | |
| asselin_ | jeblair, ok that works for me | 23:16 |
| mtreinish | clarkb: fyi, https://review.openstack.org/#/c/169945 | 23:16 |
| mordred | jeblair: whoops | 23:18 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/nodepool: Protect when statsd is not enabled https://review.openstack.org/169948 | 23:19 |
| asselin_ | mordred, jeblair ^^ | 23:19 |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 23:20 |
| *** asettle has joined #openstack-infra | 23:20 | |
| jeblair | asselin_: lgtm, thanks and sorry :) | 23:20 |
| asselin_ | np | 23:20 |
| *** alexandra has joined #openstack-infra | 23:21 | |
| mordred | +3 | 23:21 |
| asselin_ | thanks | 23:21 |
| *** ajmiller_ has joined #openstack-infra | 23:22 | |
| mordred | jeblair: we need to restart nodepool to get the statsd change, yeah? | 23:22 |
| *** asettle has quit IRC | 23:22 | |
| *** alexandra is now known as asettle | 23:22 | |
| mordred | jeblair: not that it's urgent enough to warrant that - just making sure I have the grokking | 23:22 |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 23:24 |
| *** packet has quit IRC | 23:24 | |
| * asselin_ lives dangerously on the tip of master | 23:25 | |
| jeblair | mordred: yep | 23:25 |
| *** ajmiller has quit IRC | 23:26 | |
| * mordred hands asselin_ a bowl of sausage ... without asserting whether it's cooked or not | 23:26 | |
| *** bhunter71 has quit IRC | 23:29 | |
| *** annegentle has joined #openstack-infra | 23:29 | |
| *** harlowja has quit IRC | 23:31 | |
| *** harlowja has joined #openstack-infra | 23:32 | |
| openstackgerrit | Merged openstack-infra/nodepool: Protect when statsd is not enabled https://review.openstack.org/169948 | 23:33 |
| *** ajmiller_ is now known as ajmiller | 23:34 | |
| clarkb | restarting 06 now | 23:34 |
| asselin_ | clarkb, well I switched to QEMU and it's much slower to boot.... | 23:37 |
| *** annegentle has quit IRC | 23:37 | |
| clarkb | asselin_: yes, qemu is fully emulated with not virtualization | 23:37 |
| asselin_ | yeah...so now I need to set some launch/boot timeouts...never needed those | 23:38 |
| mordred | asselin_: boooo | 23:38 |
| mordred | clarkb: btw - I have booked my train ticket | 23:38 |
| clarkb | asselin_: are you nesting real clouds? | 23:39 |
| asselin_ | clarkb, yes....I have baremetal running openstack (nodepool instances) running openstack | 23:40 |
| asselin_ | I haven't gotten to the 2nd level yet with qemu.... | 23:40 |
| clarkb | so the first level should be virt | 23:40 |
| *** salv-orlando has joined #openstack-infra | 23:40 | |
| clarkb | the second level is no virt | 23:40 |
| *** ajmiller has quit IRC | 23:41 | |
| asselin_ | so 1st level: use qemu, 2nd level use defualt? | 23:41 |
| clarkb | no 1st level use kvm, 2nd level use qemu | 23:41 |
| asselin_ | ok I see! | 23:42 |
| *** Somay has joined #openstack-infra | 23:42 | |
| *** claudiub has quit IRC | 23:42 | |
| *** salv-orl_ has quit IRC | 23:42 | |
| * asselin_ switches back | 23:42 | |
| clarkb | ok 07 is prepped and ready for restart as soon as jobs are complete | 23:43 |
| *** sarob has joined #openstack-infra | 23:43 | |
| *** sarob_ has joined #openstack-infra | 23:44 | |
| *** hodos has quit IRC | 23:44 | |
| *** sarob__ has joined #openstack-infra | 23:44 | |
| *** sarob___ has joined #openstack-infra | 23:45 | |
| *** sarob has quit IRC | 23:47 | |
| *** sarob_ has quit IRC | 23:48 | |
| clarkb | asselin_: the problem is when you nest virt so the inner level can't use kvm | 23:49 |
| *** sarob__ has quit IRC | 23:49 | |
| clarkb | but you want the outer level to be kvm for more performance | 23:49 |
| asselin_ | yeah...I was about to do qemu inside qemu.... | 23:49 |
| *** sarob___ has quit IRC | 23:49 | |
| *** harlowja has quit IRC | 23:49 | |
| *** yamamoto has joined #openstack-infra | 23:50 | |
| *** harlowja has joined #openstack-infra | 23:50 | |
| *** sarob has joined #openstack-infra | 23:50 | |
| bknudson | I'm not seeing https://review.openstack.org/#/c/169535/ in the zuul status... | 23:54 |
| bknudson | maybe it's enforcing my -1 over the +W? | 23:54 |
| *** smccully has quit IRC | 23:55 | |
| *** ryanpetrello has quit IRC | 23:55 | |
| *** sarob_ has joined #openstack-infra | 23:56 | |
| *** ryanpetrello has joined #openstack-infra | 23:56 | |
| harlowja | intersting when did 'Review currently being tested' start showing up in gerrit | 23:57 |
| harlowja | neats | 23:57 |
| bknudson | it's an april fool's joke. | 23:57 |
| harlowja | :-/ | 23:57 |
| harlowja | lol | 23:57 |
| *** sarob has quit IRC | 23:57 | |
| *** SumitNaiksatam has quit IRC | 23:57 | |
| asselin_ | bknudson, really? seemed to be really working! | 23:57 |
| jogo | clarkb: for debugging the new aiopcpu job http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2015-04-01.log | 23:59 |
| jogo | see the bottom with vishy and myself | 23:59 |
| jogo | (didn't see you in the nova room) | 23:59 |
| *** ryanpetrello has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!