| SpamapS | ah ok now I'm seeing why Monthy wanted to put that in a separate repo and import to stackforge | 00:00 |
|---|---|---|
| SpamapS | or infra or whatever | 00:00 |
| greghaynes | SpamapS: it does for me too | 00:00 |
| SpamapS | <gauntlet>grey python script needs tests, badly</gauntlet> | 00:00 |
| *** ivar-lazzaro has quit IRC | 00:00 | |
| SpamapS | <gauntlet>ruby script shot the food</gauntlet> | 00:01 |
| greghaynes | hrmm, rackspace probably should have called me by now | 00:01 |
| *** Slower has quit IRC | 00:01 | |
| SpamapS | oh wow running the thing that caches all the things for diskimages the second time is faster. This caching thing is amazing, we should definitely do more of it. | 00:02 |
| jeblair | greghaynes: you might have some luck using their web chat support thingy and asking if they could go ahead and do that | 00:02 |
| SpamapS | BTW, if you are feeling nostalgic now about gauntlet.. http://codeincomplete.com/projects/gauntlet/ | 00:02 |
| greghaynes | ah, good call | 00:03 |
| greghaynes | (no pun intended) | 00:03 |
| jeblair | good pun | 00:03 |
| *** yamamoto has quit IRC | 00:04 | |
| openstackgerrit | Merged openstack/requirements: Fix oslo caps for kilo https://review.openstack.org/166377 | 00:06 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/166425 | 00:07 |
| *** ayoung has quit IRC | 00:08 | |
| *** enikanorov has quit IRC | 00:12 | |
| fungi | jeblair: pleia2: i think touching ~gerrit2/review_site/etc/GerritSiteHeader.html should cause that problem to resolve itself. puppet may have updated them in the wrong order | 00:12 |
| jeblair | oooh | 00:13 |
| fungi | we have seen updating the modified timestamp on the site header file cause gerrit to hot refresh its javascript bits | 00:13 |
| *** enikanorov has joined #openstack-infra | 00:13 | |
| pleia2 | fungi: ah, puppet order | 00:14 |
| fungi | but there's a good chance that puppet replaced the site header before it added the jquery file it's referring to | 00:14 |
| clarkb | I had zaro add the notify back in | 00:15 |
| *** enikanorov has quit IRC | 00:15 | |
| clarkb | so in theory puppet order should've been correct | 00:15 |
| pleia2 | logs think it went in the right order | 00:16 |
| *** garyh has joined #openstack-infra | 00:16 | |
| pleia2 | so I think there is still some Gerrit mystery | 00:16 |
| *** enikanorov has joined #openstack-infra | 00:16 | |
| clarkb | figuring out innoculations is also a mystery | 00:17 |
| fungi | hrm. yeah anyway gerrit restarts are generally quick at least | 00:17 |
| pleia2 | yeah, it was quick | 00:17 |
| clarkb | do I need Tdap? reading the CDC page is like reading another language | 00:17 |
| pleia2 | clarkb: that's tetanus, yes if you haven't gotten it in 10 years | 00:17 |
| fungi | clarkb: yeah, i got it before going near my newborn nephew. probably a good idea for new parents | 00:18 |
| *** VijayTripathi has joined #openstack-infra | 00:18 | |
| clarkb | pleia2: pertussis is the real concner | 00:18 |
| fungi | particularly for the other non-tetanus things it vaccinates you against, yeah | 00:18 |
| pleia2 | ah :) | 00:18 |
| clarkb | fungi: right bu I had a full set of it as a child | 00:18 |
| greghaynes | clarkb: You have to get double innoculated for twins, right? | 00:18 |
| *** esker has joined #openstack-infra | 00:18 | |
| fungi | it's a booster | 00:18 |
| pleia2 | tdap is every 10 years though | 00:18 |
| pleia2 | there's also an adult polio booster | 00:19 |
| * pleia2 got all the vaccines when she went to ghana | 00:19 | |
| clarkb | fungi: but supposedly pertussis doesn'tneed a booster only tetanus and diptheria need boosters | 00:19 |
| *** sputnik13 has quit IRC | 00:19 | |
| clarkb | I think I will end up just getting it because why not but figuring it out is not fun. I did find my ancient shot card though | 00:19 |
| clarkb | greghaynes: thats not how viruses work thankfully | 00:19 |
| fungi | yep. diptheria is also a risk, which is why they vaccinate infants as soon as it's safe to do so | 00:20 |
| clarkb | I think I have finally found an actual page on the cdc website that says I should Tdap as an adult even if I was immunized as a child (for pertussis) | 00:21 |
| clarkb | pleia2: also every 10 years is just Td aiui | 00:21 |
| pleia2 | tbh, I just go to a doctor and tell them to give me all the things | 00:21 |
| pleia2 | "I am doing $this, tell me what I need" | 00:22 |
| jeblair | pleia2: yeah, i said "i'm going hiking in rural china" and the travel clinic showed me a nice long list. | 00:22 |
| *** achanda has quit IRC | 00:22 | |
| pleia2 | jeblair: yeah, same re: ghana | 00:22 |
| clarkb | also I apparently had MMR 3 times as a kid instead of the normal 2 | 00:22 |
| jeblair | pleia2: i had to make a calendar for the follow-ups. | 00:23 |
| pleia2 | jeblair: yeah, me too :\ | 00:23 |
| jeblair | but on the plus side, i now confidently eat from food trucks! | 00:23 |
| pleia2 | I need to get yellow fever vaccine again, the shot only lasts for 2 years | 00:23 |
| *** esker has quit IRC | 00:23 | |
| pleia2 | but no developing country plans at the moment, so | 00:23 |
| *** achanda has joined #openstack-infra | 00:24 | |
| fungi | well, except for the one you're living in ;) | 00:24 |
| pleia2 | I do visit our public schools sometimes and believe that | 00:24 |
| fungi | undeveloping country maybe | 00:24 |
| jeblair | fungi: that's an 'undeveloping' country | 00:24 |
| fungi | heh | 00:24 |
| pleia2 | haha | 00:24 |
| clarkb | the other problem I run into is adult vaccination schedules seem to assume no childhood vaccinations? | 00:24 |
| pleia2 | clarkb: I think you're the only person ever to have found their old vaccine card from childhood | 00:25 |
| pleia2 | so it may be a good assumption | 00:25 |
| *** bhunter71 has quit IRC | 00:25 | |
| fungi | north carolina apparently has computerized historical vaccination records and have them on file to back when i was a child | 00:26 |
| pleia2 | fungi: wow, fancy | 00:26 |
| clarkb | fungi: nice | 00:26 |
| clarkb | supposedly portland area hospitals are all working to do that as we speak | 00:26 |
| jeblair | fungi: oh neat! i'd love to watch them use the teletype to look them up | 00:26 |
| pleia2 | hahah | 00:26 |
| fungi | i was surprised to discover that last year when i went to a local health dept. for some travel vacs | 00:27 |
| *** garyh has quit IRC | 00:27 | |
| fungi | i think they replaced all their teletypes a few years ago when someone in state govt found some unspent money under a chair | 00:28 |
| pleia2 | must be nice to live in a state that's not california, I think budget cuts removed our chairs | 00:29 |
| *** nelsnelson has quit IRC | 00:29 | |
| *** dmorita has quit IRC | 00:29 | |
| fungi | the film industry needed to use them as props on sets throughout the state | 00:29 |
| pleia2 | anyway, EoD for me | 00:29 |
| fungi | can't have movie execs going hungry | 00:30 |
| pleia2 | :) | 00:30 |
| clarkb | ah yup Tdap is suggested as a replacement of one of your adult age Td vaccinations, ok time to go get inoculated | 00:31 |
| *** tkelsey has joined #openstack-infra | 00:35 | |
| *** tkelsey has quit IRC | 00:40 | |
| *** Longgeek has joined #openstack-infra | 00:43 | |
| *** markvoelker has joined #openstack-infra | 00:43 | |
| clarkb | mordred that dunk miss was funny | 00:46 |
| *** enikanorov has quit IRC | 00:47 | |
| *** markvoelker has quit IRC | 00:47 | |
| *** enikanorov has joined #openstack-infra | 00:48 | |
| *** enikanorov has quit IRC | 00:52 | |
| *** enikanorov has joined #openstack-infra | 00:53 | |
| *** sdake_ has joined #openstack-infra | 00:55 | |
| *** sdake has quit IRC | 00:59 | |
| *** patrickeast has quit IRC | 01:01 | |
| *** enikanorov has quit IRC | 01:01 | |
| *** enikanorov has joined #openstack-infra | 01:03 | |
| *** yamamoto has joined #openstack-infra | 01:04 | |
| *** enikanorov has quit IRC | 01:05 | |
| *** yamamoto has quit IRC | 01:06 | |
| *** enikanorov has joined #openstack-infra | 01:06 | |
| *** yamamoto has joined #openstack-infra | 01:07 | |
| *** tsg has quit IRC | 01:07 | |
| *** yamamoto has quit IRC | 01:07 | |
| *** enikanorov has quit IRC | 01:11 | |
| *** hdd has quit IRC | 01:13 | |
| *** enikanorov has joined #openstack-infra | 01:13 | |
| *** kmartin has quit IRC | 01:13 | |
| *** mdenny has quit IRC | 01:13 | |
| *** kmartin has joined #openstack-infra | 01:13 | |
| *** mdenny has joined #openstack-infra | 01:14 | |
| *** ZZelle_ has quit IRC | 01:14 | |
| *** esker has joined #openstack-infra | 01:14 | |
| *** enikanorov has quit IRC | 01:14 | |
| *** enikanorov has joined #openstack-infra | 01:15 | |
| *** crc32 has quit IRC | 01:15 | |
| *** esker has quit IRC | 01:16 | |
| *** markvoelker has joined #openstack-infra | 01:17 | |
| *** hdd has joined #openstack-infra | 01:19 | |
| *** davideagnello has quit IRC | 01:20 | |
| *** enikanorov has quit IRC | 01:20 | |
| *** sdake_ has quit IRC | 01:20 | |
| *** enikanorov has joined #openstack-infra | 01:21 | |
| *** markvoelker has quit IRC | 01:21 | |
| *** sdake has joined #openstack-infra | 01:22 | |
| *** garyh has joined #openstack-infra | 01:27 | |
| *** enikanorov has quit IRC | 01:31 | |
| *** enikanorov has joined #openstack-infra | 01:33 | |
| *** enikanorov has quit IRC | 01:34 | |
| *** enikanorov has joined #openstack-infra | 01:35 | |
| *** enikanorov has quit IRC | 01:36 | |
| *** thingee has quit IRC | 01:37 | |
| *** garyh has quit IRC | 01:37 | |
| *** enikanorov has joined #openstack-infra | 01:39 | |
| *** tqtran has quit IRC | 01:41 | |
| *** dims has quit IRC | 01:46 | |
| *** enikanorov has quit IRC | 01:46 | |
| *** dims has joined #openstack-infra | 01:46 | |
| *** enikanorov has joined #openstack-infra | 01:47 | |
| *** trey has quit IRC | 01:48 | |
| *** alexpilotti has quit IRC | 01:48 | |
| *** otter768 has joined #openstack-infra | 01:49 | |
| *** trey has joined #openstack-infra | 01:49 | |
| *** ddieterl_ has joined #openstack-infra | 01:50 | |
| *** ddieterly has quit IRC | 01:50 | |
| *** enikanorov has quit IRC | 01:51 | |
| *** dims has quit IRC | 01:51 | |
| *** yamahata has quit IRC | 01:51 | |
| *** enikanorov has joined #openstack-infra | 01:52 | |
| *** sdake_ has joined #openstack-infra | 01:53 | |
| *** enikanorov has quit IRC | 01:53 | |
| *** otter768 has quit IRC | 01:53 | |
| *** enikanorov has joined #openstack-infra | 01:54 | |
| *** Slower has joined #openstack-infra | 01:55 | |
| *** sdake has quit IRC | 01:56 | |
| *** stevemar has quit IRC | 01:59 | |
| *** sdake has joined #openstack-infra | 02:00 | |
| *** unicell has quit IRC | 02:01 | |
| *** sdake_ has quit IRC | 02:03 | |
| *** sdake_ has joined #openstack-infra | 02:06 | |
| *** sdake has quit IRC | 02:07 | |
| *** yamamoto_ has joined #openstack-infra | 02:08 | |
| *** enikanorov has quit IRC | 02:12 | |
| *** yamamoto_ has quit IRC | 02:13 | |
| *** enikanorov has joined #openstack-infra | 02:13 | |
| *** baoli has joined #openstack-infra | 02:15 | |
| *** harlowja is now known as harlowja_away | 02:17 | |
| *** markvoelker has joined #openstack-infra | 02:18 | |
| *** markvoelker has quit IRC | 02:22 | |
| *** kaisers has joined #openstack-infra | 02:29 | |
| *** asselin has quit IRC | 02:29 | |
| *** asselin has joined #openstack-infra | 02:30 | |
| *** tiswanso has joined #openstack-infra | 02:30 | |
| *** kaisers1 has quit IRC | 02:31 | |
| *** enikanorov has quit IRC | 02:32 | |
| *** enikanorov has joined #openstack-infra | 02:33 | |
| *** ajmiller has joined #openstack-infra | 02:33 | |
| *** asselin has quit IRC | 02:33 | |
| *** enikanorov has quit IRC | 02:33 | |
| *** asselin has joined #openstack-infra | 02:34 | |
| *** asselin has quit IRC | 02:34 | |
| *** enikanorov has joined #openstack-infra | 02:35 | |
| *** asselin has joined #openstack-infra | 02:35 | |
| *** garyh has joined #openstack-infra | 02:38 | |
| *** otter768 has joined #openstack-infra | 02:42 | |
| *** cdent has quit IRC | 02:47 | |
| *** MarkAtwood has joined #openstack-infra | 02:48 | |
| *** tiswanso has quit IRC | 02:48 | |
| *** garyh has quit IRC | 02:48 | |
| *** MarkAtwood has quit IRC | 02:48 | |
| *** tiswanso_ has joined #openstack-infra | 02:49 | |
| *** mestery has quit IRC | 02:50 | |
| *** cody-somerville has quit IRC | 02:53 | |
| *** ddieterl_ has quit IRC | 02:55 | |
| *** tiswanso_ has quit IRC | 02:56 | |
| *** fifieldt__ has quit IRC | 02:58 | |
| *** cody-somerville has joined #openstack-infra | 03:00 | |
| *** ghostpl_ has quit IRC | 03:11 | |
| *** hdd has quit IRC | 03:12 | |
| *** sputnik13 has joined #openstack-infra | 03:14 | |
| *** hdd has joined #openstack-infra | 03:15 | |
| *** hdd has quit IRC | 03:16 | |
| *** stevemar has joined #openstack-infra | 03:17 | |
| *** markvoelker has joined #openstack-infra | 03:19 | |
| *** markvoelker has quit IRC | 03:23 | |
| *** sputnik13 has quit IRC | 03:27 | |
| *** Longgeek has quit IRC | 03:28 | |
| *** xyang1 has quit IRC | 03:28 | |
| *** sputnik13 has joined #openstack-infra | 03:28 | |
| *** sdake has joined #openstack-infra | 03:29 | |
| *** sdake_ has quit IRC | 03:30 | |
| *** sdake__ has joined #openstack-infra | 03:30 | |
| *** sdake has quit IRC | 03:34 | |
| *** esker has joined #openstack-infra | 03:39 | |
| *** enikanorov has quit IRC | 03:44 | |
| *** enikanorov has joined #openstack-infra | 03:45 | |
| *** yamamoto_ has joined #openstack-infra | 03:48 | |
| *** garyh has joined #openstack-infra | 03:49 | |
| *** achanda has quit IRC | 03:53 | |
| *** yamamoto_ has quit IRC | 03:55 | |
| *** ddieterly has joined #openstack-infra | 03:56 | |
| *** tiswanso has joined #openstack-infra | 03:57 | |
| *** garyh has quit IRC | 03:59 | |
| *** sputnik13 has quit IRC | 03:59 | |
| *** sputnik13 has joined #openstack-infra | 04:00 | |
| *** ddieterly has quit IRC | 04:01 | |
| *** yamamoto_ has joined #openstack-infra | 04:01 | |
| *** nijaba has quit IRC | 04:02 | |
| *** armax has joined #openstack-infra | 04:02 | |
| *** enikanorov has quit IRC | 04:04 | |
| *** enikanorov has joined #openstack-infra | 04:05 | |
| *** yamahata has joined #openstack-infra | 04:07 | |
| *** nijaba has joined #openstack-infra | 04:08 | |
| *** nijaba has joined #openstack-infra | 04:08 | |
| *** esker has quit IRC | 04:16 | |
| *** esker has joined #openstack-infra | 04:16 | |
| *** markvoelker has joined #openstack-infra | 04:19 | |
| *** ujuc has joined #openstack-infra | 04:21 | |
| *** yamamoto_ has quit IRC | 04:24 | |
| *** markvoelker has quit IRC | 04:24 | |
| *** tiswanso has quit IRC | 04:25 | |
| *** Longgeek has joined #openstack-infra | 04:29 | |
| *** sarob has quit IRC | 04:33 | |
| *** sarob has joined #openstack-infra | 04:34 | |
| *** hdd has joined #openstack-infra | 04:34 | |
| *** tkelsey has joined #openstack-infra | 04:36 | |
| *** sarob has quit IRC | 04:38 | |
| *** tkelsey has quit IRC | 04:41 | |
| *** reed has quit IRC | 04:44 | |
| *** otter768 has quit IRC | 04:46 | |
| *** Longgeek has quit IRC | 04:48 | |
| *** achanda has joined #openstack-infra | 04:53 | |
| *** garyh has joined #openstack-infra | 05:00 | |
| *** Longgeek has joined #openstack-infra | 05:00 | |
| *** emagana has quit IRC | 05:02 | |
| *** emagana has joined #openstack-infra | 05:03 | |
| *** achanda has quit IRC | 05:03 | |
| *** emagana has quit IRC | 05:07 | |
| *** garyh has quit IRC | 05:09 | |
| *** markvoelker has joined #openstack-infra | 05:20 | |
| *** baoli has quit IRC | 05:21 | |
| *** baoli has joined #openstack-infra | 05:23 | |
| *** yamamoto_ has joined #openstack-infra | 05:24 | |
| *** markvoelker has quit IRC | 05:25 | |
| *** bradjones has quit IRC | 05:27 | |
| *** yamamoto_ has quit IRC | 05:29 | |
| *** achanda has joined #openstack-infra | 05:29 | |
| *** armax has quit IRC | 05:29 | |
| *** bradjones has joined #openstack-infra | 05:30 | |
| *** emagana has joined #openstack-infra | 05:33 | |
| *** dboik has quit IRC | 05:34 | |
| *** emagana_ has joined #openstack-infra | 05:35 | |
| *** dboik has joined #openstack-infra | 05:35 | |
| *** emagana has quit IRC | 05:38 | |
| *** baoli has quit IRC | 05:39 | |
| *** emagana_ has quit IRC | 05:40 | |
| *** hdd has quit IRC | 05:44 | |
| *** dboik has quit IRC | 05:51 | |
| *** esker has quit IRC | 05:52 | |
| *** ddieterly has joined #openstack-infra | 05:58 | |
| *** sarob has joined #openstack-infra | 05:59 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/166505 | 06:01 |
| *** ddieterly has quit IRC | 06:02 | |
| *** sarob has quit IRC | 06:04 | |
| *** ibiris_away is now known as ibiris | 06:07 | |
| *** garyh has joined #openstack-infra | 06:10 | |
| *** ujuc has quit IRC | 06:11 | |
| *** ghostpl_ has joined #openstack-infra | 06:12 | |
| *** ghostpl_ has quit IRC | 06:17 | |
| *** garyh has quit IRC | 06:20 | |
| *** davideagnello has joined #openstack-infra | 06:21 | |
| *** _nadya_ has joined #openstack-infra | 06:22 | |
| *** emagana has joined #openstack-infra | 06:29 | |
| *** emagana has quit IRC | 06:34 | |
| *** bradjones has quit IRC | 06:35 | |
| *** ujuc has joined #openstack-infra | 06:36 | |
| *** davideagnello has quit IRC | 06:39 | |
| *** achanda has quit IRC | 06:39 | |
| *** bradjones has joined #openstack-infra | 06:40 | |
| *** woodster_ has quit IRC | 06:40 | |
| *** achanda has joined #openstack-infra | 06:42 | |
| *** unicell has joined #openstack-infra | 06:42 | |
| *** yamahata has quit IRC | 06:43 | |
| *** _nadya_ has quit IRC | 06:47 | |
| *** otter768 has joined #openstack-infra | 06:47 | |
| *** sdake has joined #openstack-infra | 06:50 | |
| *** dhritishikhar has joined #openstack-infra | 06:50 | |
| *** otter768 has quit IRC | 06:52 | |
| *** esker has joined #openstack-infra | 06:53 | |
| *** sdake__ has quit IRC | 06:53 | |
| *** esker has quit IRC | 06:58 | |
| *** VijayTripathi has quit IRC | 06:58 | |
| *** ddieterly has joined #openstack-infra | 06:59 | |
| *** sarob has joined #openstack-infra | 07:00 | |
| *** dhritishikhar has quit IRC | 07:01 | |
| *** unicell1 has joined #openstack-infra | 07:03 | |
| *** unicell has quit IRC | 07:03 | |
| *** ddieterly has quit IRC | 07:03 | |
| *** sarob has quit IRC | 07:05 | |
| *** sdake_ has joined #openstack-infra | 07:15 | |
| *** ibiris is now known as ibiris_away | 07:16 | |
| *** emagana has joined #openstack-infra | 07:18 | |
| *** sdake has quit IRC | 07:18 | |
| *** sputnik13 has quit IRC | 07:21 | |
| *** markvoelker has joined #openstack-infra | 07:22 | |
| *** emagana has quit IRC | 07:23 | |
| *** sdake_ has quit IRC | 07:24 | |
| *** markvoelker has quit IRC | 07:26 | |
| *** sarob has joined #openstack-infra | 07:32 | |
| *** sarob has quit IRC | 07:41 | |
| *** ibiris_away is now known as ibiris | 07:43 | |
| *** stevemar has quit IRC | 07:48 | |
| *** _nadya_ has joined #openstack-infra | 07:50 | |
| *** esker has joined #openstack-infra | 07:54 | |
| *** dhritishikhar has joined #openstack-infra | 07:54 | |
| *** ibiris is now known as ibiris_away | 07:55 | |
| *** sabeen has joined #openstack-infra | 07:56 | |
| *** esker has quit IRC | 07:59 | |
| *** ddieterly has joined #openstack-infra | 07:59 | |
| *** ddieterly has quit IRC | 08:04 | |
| *** dhritishikhar has quit IRC | 08:09 | |
| *** emagana has joined #openstack-infra | 08:12 | |
| *** nilasae|zzz has quit IRC | 08:13 | |
| *** enikanorov has quit IRC | 08:13 | |
| *** enikanorov has joined #openstack-infra | 08:15 | |
| *** _nadya_ has quit IRC | 08:16 | |
| *** emagana has quit IRC | 08:17 | |
| *** markvoelker has joined #openstack-infra | 08:22 | |
| *** melwitt_ has quit IRC | 08:24 | |
| *** markvoelker has quit IRC | 08:27 | |
| *** yamamoto_ has joined #openstack-infra | 08:27 | |
| *** yamamoto_ has quit IRC | 08:32 | |
| *** garyh has joined #openstack-infra | 08:36 | |
| *** garyh has quit IRC | 08:41 | |
| *** otter768 has joined #openstack-infra | 08:48 | |
| *** sabeen has quit IRC | 08:50 | |
| *** tnovacik has joined #openstack-infra | 08:53 | |
| *** otter768 has quit IRC | 08:53 | |
| *** andreykurilin_ has joined #openstack-infra | 08:53 | |
| *** esker has joined #openstack-infra | 08:55 | |
| *** esker has quit IRC | 08:59 | |
| *** ddieterly has joined #openstack-infra | 09:00 | |
| *** achanda has quit IRC | 09:01 | |
| *** yamamoto_ has joined #openstack-infra | 09:03 | |
| *** Bsony has joined #openstack-infra | 09:03 | |
| *** ddieterly has quit IRC | 09:05 | |
| *** emagana has joined #openstack-infra | 09:06 | |
| *** hyakuhei has joined #openstack-infra | 09:09 | |
| *** yamamoto_ has quit IRC | 09:10 | |
| *** emagana has quit IRC | 09:11 | |
| *** Somay has joined #openstack-infra | 09:18 | |
| *** markvoelker has joined #openstack-infra | 09:23 | |
| *** markvoelker has quit IRC | 09:28 | |
| *** andreykurilin_ has quit IRC | 09:29 | |
| *** sushilkm has joined #openstack-infra | 09:33 | |
| *** garyh has joined #openstack-infra | 09:42 | |
| *** ZZelle has quit IRC | 09:43 | |
| *** ZZelle has joined #openstack-infra | 09:44 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/166505 | 09:45 |
| *** sushilkm has left #openstack-infra | 09:46 | |
| *** hyakuhei has quit IRC | 09:49 | |
| *** garyh has quit IRC | 09:52 | |
| *** Somay has quit IRC | 09:53 | |
| *** esker has joined #openstack-infra | 09:55 | |
| *** Somay has joined #openstack-infra | 09:58 | |
| *** esker has quit IRC | 10:00 | |
| *** emagana has joined #openstack-infra | 10:01 | |
| *** ddieterly has joined #openstack-infra | 10:01 | |
| *** ddieterly has quit IRC | 10:05 | |
| *** emagana has quit IRC | 10:05 | |
| *** yamamoto has joined #openstack-infra | 10:10 | |
| *** ociuhandu has joined #openstack-infra | 10:11 | |
| *** yamamoto has quit IRC | 10:15 | |
| *** davideagnello has joined #openstack-infra | 10:17 | |
| *** ociuhandu has quit IRC | 10:17 | |
| *** davideagnello has quit IRC | 10:21 | |
| *** markvoelker has joined #openstack-infra | 10:24 | |
| *** markvoelker has quit IRC | 10:29 | |
| *** Somay has quit IRC | 10:31 | |
| *** Somay has joined #openstack-infra | 10:35 | |
| *** Somay has quit IRC | 10:37 | |
| *** Somay has joined #openstack-infra | 10:38 | |
| *** tkelsey has joined #openstack-infra | 10:39 | |
| *** Somay has joined #openstack-infra | 10:42 | |
| *** tkelsey has quit IRC | 10:43 | |
| *** otter768 has joined #openstack-infra | 10:49 | |
| *** garyh has joined #openstack-infra | 10:53 | |
| *** otter768 has quit IRC | 10:53 | |
| *** emagana has joined #openstack-infra | 10:55 | |
| *** esker has joined #openstack-infra | 10:56 | |
| *** emagana has quit IRC | 10:59 | |
| *** esker has quit IRC | 11:01 | |
| *** ddieterly has joined #openstack-infra | 11:02 | |
| *** garyh has quit IRC | 11:03 | |
| *** ddieterly has quit IRC | 11:06 | |
| *** sushilkm has joined #openstack-infra | 11:07 | |
| *** sushilkm has left #openstack-infra | 11:07 | |
| *** _nadya_ has joined #openstack-infra | 11:17 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Convert all inline publisher examples to tests https://review.openstack.org/166064 | 11:19 |
| *** _nadya_ has quit IRC | 11:21 | |
| *** markvoelker has joined #openstack-infra | 11:25 | |
| *** markvoelker has quit IRC | 11:29 | |
| *** emagana has joined #openstack-infra | 11:49 | |
| *** emagana has quit IRC | 11:54 | |
| *** salv-orlando has quit IRC | 11:56 | |
| *** esker has joined #openstack-infra | 11:57 | |
| *** esker has quit IRC | 12:02 | |
| *** ddieterly has joined #openstack-infra | 12:03 | |
| *** yamamoto has joined #openstack-infra | 12:03 | |
| *** nilasae|zzz has joined #openstack-infra | 12:03 | |
| *** garyh has joined #openstack-infra | 12:04 | |
| *** ddieterly has quit IRC | 12:05 | |
| *** ddieterly has joined #openstack-infra | 12:06 | |
| *** garyh has quit IRC | 12:14 | |
| *** baoli has joined #openstack-infra | 12:15 | |
| *** yamamoto has quit IRC | 12:20 | |
| *** hdd has joined #openstack-infra | 12:22 | |
| *** markvoelker has joined #openstack-infra | 12:26 | |
| *** markvoelker has quit IRC | 12:30 | |
| *** Hal1 has joined #openstack-infra | 12:30 | |
| *** mestery has joined #openstack-infra | 12:31 | |
| *** dims has joined #openstack-infra | 12:33 | |
| openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Add pypi jobs for stackforge/networking-odl https://review.openstack.org/166522 | 12:34 |
| *** baoli has quit IRC | 12:35 | |
| *** ghostpl_ has joined #openstack-infra | 12:35 | |
| *** tkelsey has joined #openstack-infra | 12:40 | |
| *** Somay has quit IRC | 12:41 | |
| *** mestery has quit IRC | 12:41 | |
| *** emagana has joined #openstack-infra | 12:43 | |
| *** sarob has joined #openstack-infra | 12:43 | |
| *** tkelsey has quit IRC | 12:44 | |
| *** hdd has quit IRC | 12:46 | |
| *** emagana has quit IRC | 12:48 | |
| *** sarob has quit IRC | 12:48 | |
| *** hdd has joined #openstack-infra | 12:49 | |
| *** leakypipes has quit IRC | 12:49 | |
| *** Hal1 has quit IRC | 12:50 | |
| *** Hal2 has joined #openstack-infra | 12:50 | |
| *** otter768 has joined #openstack-infra | 12:50 | |
| *** jyuso1 has quit IRC | 12:52 | |
| *** otter768 has quit IRC | 12:54 | |
| *** esker has joined #openstack-infra | 12:58 | |
| *** kashyap has left #openstack-infra | 12:58 | |
| *** Somay has joined #openstack-infra | 13:01 | |
| *** esker has quit IRC | 13:03 | |
| *** bknudson has joined #openstack-infra | 13:03 | |
| *** leakypipes has joined #openstack-infra | 13:05 | |
| *** Somay has quit IRC | 13:07 | |
| *** garyh has joined #openstack-infra | 13:15 | |
| *** yamamoto has joined #openstack-infra | 13:21 | |
| *** Somay has joined #openstack-infra | 13:24 | |
| *** garyh has quit IRC | 13:25 | |
| *** yamamoto has quit IRC | 13:26 | |
| *** dhritishikhar has joined #openstack-infra | 13:26 | |
| *** markvoelker has joined #openstack-infra | 13:26 | |
| *** markvoelker has quit IRC | 13:31 | |
| *** prad has joined #openstack-infra | 13:31 | |
| *** esker has joined #openstack-infra | 13:36 | |
| *** emagana has joined #openstack-infra | 13:37 | |
| fungi | clarkb: did you intend to keep jenkins02 offline (are you still exploring the thread leak there), or can i clean it up and restart it again? | 13:37 |
| *** hdd has quit IRC | 13:38 | |
| *** hdd has joined #openstack-infra | 13:41 | |
| *** baoli has joined #openstack-infra | 13:41 | |
| *** hdd has quit IRC | 13:41 | |
| *** emagana has quit IRC | 13:42 | |
| *** yamamoto has joined #openstack-infra | 13:46 | |
| *** dhritishikhar has quit IRC | 13:51 | |
| *** bradjones has quit IRC | 13:54 | |
| *** tnovacik has quit IRC | 13:56 | |
| *** yamahata has joined #openstack-infra | 13:56 | |
| *** bradjones has joined #openstack-infra | 13:57 | |
| *** e0ne has joined #openstack-infra | 13:57 | |
| *** ddieterly has quit IRC | 14:01 | |
| mordred | fungi: when are we doing the thing today? | 14:03 |
| *** ghostpl_ has quit IRC | 14:07 | |
| *** ghostpl_ has joined #openstack-infra | 14:08 | |
| zaro | mordred: 1500utc | 14:08 |
| *** dhritishikhar has joined #openstack-infra | 14:09 | |
| *** ddieterly has joined #openstack-infra | 14:11 | |
| *** enikanorov has quit IRC | 14:11 | |
| mordred | zaro: thanks | 14:11 |
| *** enikanorov has joined #openstack-infra | 14:12 | |
| *** e0ne has quit IRC | 14:15 | |
| *** enikanorov has quit IRC | 14:16 | |
| *** enikanorov has joined #openstack-infra | 14:17 | |
| *** yamahata has quit IRC | 14:18 | |
| *** tsg has joined #openstack-infra | 14:22 | |
| *** Somay has quit IRC | 14:24 | |
| *** garyh has joined #openstack-infra | 14:26 | |
| * jeblair yawns | 14:27 | |
| *** armax has joined #openstack-infra | 14:27 | |
| *** markvoelker has joined #openstack-infra | 14:27 | |
| fungi | thanks to whoever fixed up the uids/gids on the new trusty gerrit server. i just thought to double-check them in case i needed to renumber stuff there before 1500 | 14:28 |
| *** Longgeek has quit IRC | 14:29 | |
| clarkb | fungi was hoping to leave it that way to help debug if jenkins comes back with questions/answers | 14:30 |
| fungi | clarkb: fine by me | 14:30 |
| jeblair | anyone make an etherpad yet? if not, i'll start one | 14:31 |
| fungi | where was our list of steps for the replacement? mostly making sure we catch things like copying over the service host keys | 14:31 |
| fungi | heh | 14:31 |
| fungi | zaro: ^ you had steps already written up, right? | 14:31 |
| jeblair | i think it was in some earlier meetings | 14:31 |
| pleia2 | morning | 14:31 |
| *** emagana has joined #openstack-infra | 14:31 | |
| fungi | yeah, i'll mine the meeting summaries | 14:31 |
| *** markvoelker has quit IRC | 14:32 | |
| jeblair | https://etherpad.openstack.org/p/review-to-trusty | 14:33 |
| fungi | thanks--beat me to it | 14:33 |
| jeblair | fungi: have the new ips handy? | 14:33 |
| pleia2 | 104.130.159.134 2001:4800:7818:102:be76:4eff:fe05:9b12 | 14:35 |
| *** garyh has quit IRC | 14:35 | |
| *** emagana has quit IRC | 14:36 | |
| *** ajmiller_ has joined #openstack-infra | 14:37 | |
| fungi | somewhere between steps 3 and 10 we'll want to switch the trove db config and restart the trove instance | 14:38 |
| fungi | which is actually 2 trove instance restarts because it's already got a custom config applied and will force us to revert the config to defaults and restart the instance before we can change it to the new config (at which point we have to do a second explicit instance restart to take effect) | 14:39 |
| fungi | but the restarts are only a minute or so apiece | 14:40 |
| jeblair | so i've made some modifications to account for cinder and trove | 14:40 |
| jeblair | /home/gerrit2 is on a cinder volume | 14:40 |
| fungi | oh, right, forgot we had /home on a conder volume now | 14:41 |
| mordred | that's handy | 14:41 |
| jeblair | i still think it's probably a good idea to make a backup of that... | 14:41 |
| *** dhritishikhar has quit IRC | 14:41 | |
| jeblair | but i think what we can do is just copy it to /opt | 14:41 |
| jeblair | on the old server | 14:41 |
| mordred | ++ | 14:41 |
| *** ajmiller has quit IRC | 14:41 | |
| jeblair | oh heh :) | 14:42 |
| mordred | jeblair: you win | 14:42 |
| fungi | yeah, cp -ax/rsync/tar/whatever to /opt | 14:42 |
| *** pcaruana has joined #openstack-infra | 14:42 | |
| jeblair | i will start that now with an rsync so it's faster later | 14:43 |
| fungi | awesome | 14:44 |
| *** sarob has joined #openstack-infra | 14:44 | |
| jeblair | pleia2: done any cinder work yet? | 14:47 |
| pleia2 | jeblair: yeah, with the backups server | 14:47 |
| *** enikanorov has quit IRC | 14:47 | |
| pleia2 | I can create a volume somewhere if needed | 14:47 |
| jeblair | pleia2: actually we're just moving a volume here | 14:48 |
| jeblair | detaching the existing one, and reattaching it to the new server | 14:48 |
| pleia2 | cool | 14:48 |
| fungi | yeah, cinderclient is easy to work with | 14:48 |
| jeblair | (i mean we could, but this way there's not 18G network transfer) | 14:49 |
| anteaya | o/ | 14:49 |
| jeblair | anteaya: hi | 14:49 |
| pleia2 | shall I had some commands to the etherpad? | 14:49 |
| *** enikanorov has joined #openstack-infra | 14:49 | |
| anteaya | jeblair: hi | 14:49 |
| jeblair | pleia2: ++ | 14:49 |
| * anteaya stands by | 14:49 | |
| fungi | pleia2: please do! | 14:49 |
| jeblair | statusbot alert Gerrit will be offline starting at 1500 UTC for scheduled maintenance | 14:50 |
| jeblair | look ok? ^ | 14:50 |
| *** sarob has quit IRC | 14:50 | |
| anteaya | yes | 14:50 |
| mordred | ++ | 14:50 |
| fungi | yep | 14:50 |
| jeblair | #statusbot alert Gerrit will be offline starting at 1500 UTC for scheduled maintenance | 14:50 |
| openstackstatus | jeblair: sending alert | 14:50 |
| jeblair | Gerrit is offline for scheduled maintenance || http://lists.openstack.org/pipermail/openstack-infra/2015-March/002540.html | 14:50 |
| jeblair | how's that for when we actually take it offline ^ ? | 14:51 |
| anteaya | yep | 14:51 |
| *** otter768 has joined #openstack-infra | 14:51 | |
| *** ChuckC has joined #openstack-infra | 14:51 | |
| fungi | wfm | 14:51 |
| anteaya | I just brought up that link to give to people who show up, should they work on saturday | 14:51 |
| jeblair | initial rsync is complete | 14:52 |
| -openstackstatus- NOTICE: Gerrit will be offline starting at 1500 UTC for scheduled maintenance | 14:52 | |
| mordred | woo | 14:52 |
| *** ChanServ changes topic to "Gerrit will be offline starting at 1500 UTC for scheduled maintenance" | 14:52 | |
| fungi | fwiw i included the links to both ml announcements in the etherpad for easy reference | 14:52 |
| anteaya | fungi: I saw that, thank you | 14:52 |
| *** markvoelker has joined #openstack-infra | 14:52 | |
| mordred | I believe I can go ahead and do step 5.3 | 14:52 |
| pleia2 | DFW or ORD? | 14:53 |
| mordred | DFW | 14:53 |
| jeblair | mordred: i just inserted step 2 | 14:53 |
| pleia2 | thanks | 14:53 |
| mordred | yes - in that case, I'm doing step 6.3 :) | 14:53 |
| openstackstatus | jeblair: finished sending alert | 14:54 |
| fungi | should be safe | 14:54 |
| anteaya | yes, following jeblair's example on the etherpad it helps to claim the item you are working on | 14:55 |
| mordred | pleia2: you've got the cinder move - do you want the mount/unmount too? | 14:55 |
| *** otter768 has quit IRC | 14:55 | |
| pleia2 | mordred: sure | 14:56 |
| jeblair | the change in step 8 is applied, does that make step 8 a noop? | 14:56 |
| jeblair | oh | 14:56 |
| jeblair | i should say it's merged | 14:56 |
| jeblair | ah, but that means it will have run on the old review, which means it will be installed in /home/gerrit and be moved over | 14:56 |
| *** markvoelker has quit IRC | 14:56 | |
| jeblair | so i think that takes care of it, yeah? | 14:57 |
| mordred | jeblair: I'm going to go with "yes" | 14:57 |
| fungi | seems like it should be fine. it would have gotten applied via puppet | 14:57 |
| *** enikanorov has quit IRC | 14:57 | |
| jeblair | i also don't think the reindex step applies (and certainly not with 2.9) | 14:57 |
| jeblair | (step11) | 14:57 |
| mordred | jeblair: ++ | 14:58 |
| jeblair | (the old steps are at the bottom if we need to reference them) | 14:58 |
| fungi | ttl on current review.o.o records was already 5 minutes for a while btw, so should take effect quickly. i can raise it back up to an hour once we're comfortable | 14:59 |
| mordred | jeblair: oh - uhm - so ... | 14:59 |
| mordred | jeblair: cinder volume on old gerrit is in via lvm | 14:59 |
| *** tsg has quit IRC | 15:00 | |
| mordred | so we probably need to do something to make a volume group on new gerrit that we can import the pv into? | 15:00 |
| jeblair | mordred: lvm info is all in info stored on the disk | 15:00 |
| jeblair | mordred: so once it shows up in the new place, linux should scan it and find it | 15:01 |
| jeblair | mordred: we may need to trigger the scan if the device hot-add doesn't already | 15:01 |
| jeblair | mordred: however, that does remind me that we need to deactivate the volume before we remove it from the old server | 15:01 |
| fungi | yeah, we'll probably want to make sure we deactivate the vg on the old gerrit though | 15:01 |
| fungi | for safety | 15:01 |
| fungi | having that pv disappear out from under the vg is not so great | 15:02 |
| fungi | ahh, it's in the list now | 15:02 |
| jeblair | i'm not sure we've ever done this before, so we might have to make it up a bit as we go :). probably worth adding to the ci-docs when we're done | 15:03 |
| anteaya | are we ready to stop old gerrit yet? | 15:03 |
| mordred | jeblair: ++ | 15:03 |
| jeblair | #status alert Gerrit is offline for scheduled maintenance || http://lists.openstack.org/pipermail/openstack-infra/2015-March/002540.html | 15:03 |
| openstackstatus | jeblair: sending alert | 15:03 |
| fungi | i'm ready when everyone's ready | 15:04 |
| anteaya | I'm ready | 15:04 |
| jeblair | fungi: go for it | 15:04 |
| fungi | and down it goes | 15:04 |
| fungi | updating dns now too | 15:04 |
| mordred | fungi: it's down? | 15:04 |
| fungi | still on its way down | 15:04 |
| mordred | oh right. java | 15:04 |
| fungi | i'll update when the process is done | 15:04 |
| * zaro is here. | 15:04 | |
| anteaya | 503, it's down | 15:04 |
| fungi | okay, it's offline now | 15:05 |
| zaro | didn't noticed my connection got dropped | 15:05 |
| mordred | backing up db | 15:05 |
| anteaya | zaro: glad you're back | 15:05 |
| jeblair | zaro: we've been busy. :) https://etherpad.openstack.org/p/review-to-trusty | 15:05 |
| jeblair | running rsync | 15:05 |
| fungi | i'm also going to disable puppet agent on the old gerrit so it doesn't try to run stuff there | 15:05 |
| jeblair | fungi: i'll do it on the new one | 15:05 |
| fungi | k | 15:05 |
| mordred | fungi: ++ | 15:05 |
| -openstackstatus- NOTICE: Gerrit is offline for scheduled maintenance || http://lists.openstack.org/pipermail/openstack-infra/2015-March/002540.html | 15:05 | |
| *** ChanServ changes topic to "Gerrit is offline for scheduled maintenance || http://lists.openstack.org/pipermail/openstack-infra/2015-March/002540.html" | 15:05 | |
| jeblair | rsync finished | 15:06 |
| mordred | wow. I'm impressed with how slow the database dump is | 15:06 |
| mordred | done | 15:06 |
| mordred | fungi: trove is all yours | 15:06 |
| fungi | on it. dns records are updated now too | 15:06 |
| fungi | should be propagated fully in ~5 minutes | 15:07 |
| pleia2 | we don't have our own handy docs on detatching+reattaching a cinder volume (we will soon!) so I'm digging around | 15:07 |
| fungi | pleia2: we have some in ci.o.o/static.html i think? | 15:07 |
| fungi | or linked from there | 15:07 |
| openstackstatus | jeblair: finished sending alert | 15:08 |
| jeblair | btw, i love the insecureplatform warnings i get when i run nova commands on puppetmaster now | 15:08 |
| *** armax has quit IRC | 15:09 | |
| pleia2 | fungi: yeah, that for creating one, but I do see how that it's a *nova* command for attaching, so fetching that | 15:09 |
| fungi | yeah. our platform is insecure. totes need latest python everywhere | 15:10 |
| mordred | jeblair: it's so great | 15:10 |
| fungi | we _could_ make it go away by installing requests[security] if we really want | 15:10 |
| jeblair | pleia2: i'm adding some commands to etherpad | 15:10 |
| mordred | jeblair: I just made a patch for shade this mornign to disable them, fwiw | 15:10 |
| pleia2 | ah, jeblair beat me to it :) | 15:11 |
| jeblair | i'm mostly doing this to make sure we're on the same page about the steps :) | 15:11 |
| fungi | trove db is now restarted on the custom config called "sanity" where we've overridden wait_timeout=28800, character_set_server=utf8, collation_server=utf8_bin | 15:12 |
| mordred | fungi: I probably just missed it because of brain - but we put that config into git somewhere, yeah? | 15:12 |
| jeblair | pleia2, mordred, fungi: okay, i put in the cinder steps i think we should do; double check them and the uuids | 15:13 |
| fungi | mordred: zaro did adjust the puppet-gerrit module to override it for local mysql(client,dump) commands on the server. looking to see whether that merged yet | 15:13 |
| pleia2 | jeblair: lgtm | 15:13 |
| mordred | fungi: oh - I really meant a mention of the trove command to set the trove-side configs | 15:14 |
| fungi | mordred: oh, would be good to figure out yes. i did it from the rackspace manglement dashboard for now | 15:14 |
| mordred | fungi: cool - I'll add that to my list for the ansible launch_node replacement | 15:15 |
| *** dhritishikhar has joined #openstack-infra | 15:15 | |
| mordred | jeblair: the commands look good to me | 15:15 |
| fungi | jeblair: those nova commands lgtm | 15:15 |
| zaro | fungi: last i looked it was merged | 15:15 |
| fungi | zaro: cool, thanks! | 15:15 |
| jeblair | pleia2: i think you're clear to proceed whenever you're ready | 15:16 |
| pleia2 | jeblair: ok, starting now then | 15:16 |
| *** salv-orlando has joined #openstack-infra | 15:17 | |
| mordred | anybody know which logfile I should see device attaches pop in to? | 15:19 |
| mordred | syslog | 15:20 |
| mordred | there it is | 15:20 |
| pleia2 | attached | 15:20 |
| mordred | Mar 21 15:20:10 review kernel: [1492981.866619] blkfront: xvdb: barrier: enabled; persistent grants: disabled; indirect descriptors: disabled; | 15:20 |
| fungi | looks like it got /dev/xvdb | 15:20 |
| fungi | yep | 15:20 |
| jeblair | pleia2: pvs lvs and vgs look good | 15:20 |
| mordred | yup | 15:20 |
| fungi | agreed. sees the lv | 15:21 |
| pleia2 | yep | 15:21 |
| mordred | that's neat | 15:21 |
| pleia2 | mounting now | 15:21 |
| pleia2 | before mounting, there's a review_site/ in /home/gerrit2, do we want to rm? | 15:21 |
| mordred | really? | 15:21 |
| *** salv-orlando has quit IRC | 15:22 | |
| mordred | yes - I moved the old one out of teh way | 15:22 |
| fungi | probably got recreated before puppet was disabled? | 15:22 |
| mordred | I'm guessing a puppet run happend? | 15:22 |
| fungi | or something | 15:22 |
| mordred | just nuke it | 15:22 |
| pleia2 | ok | 15:22 |
| fungi | also maybe fsck? | 15:22 |
| fungi | just since we have it unmounted right now | 15:22 |
| jeblair | no puppet runs | 15:22 |
| mordred | WEIRD | 15:23 |
| mordred | gerrit2/review_site/cache/ | 15:23 |
| jeblair | openstack watch ran from cron | 15:23 |
| mordred | is what's in there | 15:23 |
| jeblair | openstackwatch | 15:23 |
| mordred | nod | 15:23 |
| pleia2 | fungi: sorry, didn't see that | 15:23 |
| jeblair | maybe it creates that dir | 15:23 |
| pleia2 | it's mounted | 15:23 |
| fungi | no worries | 15:23 |
| mordred | it looks solid | 15:23 |
| fungi | want me to run puppet? | 15:23 |
| pleia2 | hm, permissions? | 15:24 |
| fungi | d'oh! different uid/gid map | 15:24 |
| mordred | oh! it is, in fact, wrong uid/gid | 15:24 |
| pleia2 | yeah | 15:24 |
| fungi | i can fix that. just a sec | 15:24 |
| pleia2 | thanks | 15:24 |
| jeblair | ubuntu and github could not possibly be more wrong uids for gerrit | 15:24 |
| pleia2 | jeblair: indeed :) | 15:24 |
| fungi | hah | 15:25 |
| *** mpaolino has joined #openstack-infra | 15:25 | |
| *** emagana has joined #openstack-infra | 15:26 | |
| fungi | i've got finds going through to correct them (since some files under there are root owned so just fixing the ones which are the wrong uid/gid) | 15:26 |
| jeblair | pleia2: is your netcat thing still running? | 15:26 |
| pleia2 | jeblair: no | 15:26 |
| pleia2 | gerrit should be able to grab the port when it comes up | 15:26 |
| jeblair | corvus@fuligin:~$ telnet review.openstack.org 29418 | 15:26 |
| jeblair | SSH-2.0-GerritCodeReview_2.8.4-15-g6dc8444 (SSHD-CORE-0.9.0.201311081) | 15:26 |
| pleia2 | or, already have it | 15:26 |
| jeblair | er, was gerrit running on the new server? | 15:27 |
| mordred | no, it's not | 15:27 |
| mordred | are you connecting tot eh old server? | 15:27 |
| zaro | ~.~. | 15:27 |
| jeblair | gerrit2 1678 0.2 1.9 13318644 615056 ? Sl Mar04 73:57 GerritCodeReview -Xmx8g -jar /home/gerrit2/review_site/bin/gerrit.war daemon -d /home/gerrit2/review_site | 15:27 |
| mordred | oh - my bad - I grepped for the wrong thing | 15:27 |
| jeblair | so i think we should "kill -9" that | 15:27 |
| mordred | yah | 15:27 |
| pleia2 | that's from back when it was rebooted | 15:28 |
| *** mpaolino has quit IRC | 15:28 | |
| jeblair | to reduce the chance that it does something to our nice new files we just copied over | 15:28 |
| pleia2 | (which aslo killed my screen session) | 15:28 |
| mordred | jeblair: agree | 15:28 |
| pleia2 | I hadn't realized a reboot was done | 15:28 |
| jeblair | killed | 15:28 |
| jeblair | i'm going to stop gerritbot and delete crontab entries on the old server | 15:29 |
| fungi | yeah, rax rebooted all the things (17 days ago now) | 15:29 |
| *** openstackgerrit has quit IRC | 15:29 | |
| pleia2 | ah | 15:29 |
| fungi | we have a lot of files under /home/gerrit2 btw | 15:29 |
| fungi | 881336 inodes | 15:30 |
| fungi | actually not that many | 15:30 |
| pleia2 | 18G worth | 15:30 |
| *** emagana has quit IRC | 15:30 | |
| fungi | yeah, but this find should really only be slowed by the inode count | 15:30 |
| zaro | I think there's a missing step before starting gerrit again? | 15:30 |
| zaro | the re-indexing | 15:31 |
| jeblair | zaro: why do we need to reindex? | 15:31 |
| fungi | zaro: the (presumably valid?) index files are copied from the old server to the new one | 15:31 |
| zaro | not sure if it's needed, but always nice to do | 15:31 |
| jeblair | it takes 20 minutes | 15:31 |
| zaro | just in case something changed. | 15:32 |
| fungi | the only reason i can think of it might be necessary is the character encoding change | 15:32 |
| zaro | hmm, well up to you then. | 15:32 |
| *** krtaylor has quit IRC | 15:34 | |
| zaro | actually, i'm not sure my memory is correct or not, but i couldn't even start gerrit 2.9 unless i re-indexed. | 15:34 |
| jeblair | zaro: this is gerrit 2.8 | 15:34 |
| zaro | jeblair: sorry, of course. | 15:35 |
| zaro | no reindex necessary | 15:35 |
| *** ZZelle_ has joined #openstack-infra | 15:35 | |
| anteaya | but good to add to the notes for the 2.9 upgrade | 15:35 |
| *** garyh has joined #openstack-infra | 15:36 | |
| jeblair | fungi: did you want to run puppet or shall i? | 15:36 |
| zaro | now i remember why i had that step, it's because i only imported the git folder and not the cache. | 15:37 |
| fungi | jeblair: i can. uid/gid updates have finished | 15:37 |
| jeblair | (zuul is still running jobs) | 15:37 |
| mordred | jeblair: that's pretty awesome | 15:38 |
| fungi | yeah, lots of pending updates from the past month or so since the server was built, but skimming it looks normal and no errors | 15:39 |
| fungi | updating now | 15:39 |
| fungi | puppet done | 15:39 |
| fungi | anything else before i start gerrit? | 15:40 |
| *** mbacchi-pi has joined #openstack-infra | 15:40 | |
| jeblair | fungi: lgtm | 15:40 |
| fungi | going once... twice... | 15:41 |
| fungi | starting | 15:41 |
| fungi | it's running now. test it out | 15:42 |
| *** Hal2 has quit IRC | 15:42 | |
| anteaya | slow | 15:42 |
| *** davideagnello has joined #openstack-infra | 15:42 | |
| fungi | not much is cached yet | 15:42 |
| zaro | jeblair: what happens to zuul reports to gerrit? are they lost? | 15:42 |
| anteaya | I still have working... at the top of my page | 15:43 |
| anteaya | kk | 15:43 |
| jeblair | zaro: for changes that finishud during the downtime, yes | 15:43 |
| fungi | there wouldn't have been many. the queues were basically empty | 15:43 |
| jeblair | zuul has stoped complaining about being unable to talk to gerrit, so i guess it's happy :) | 15:43 |
| anteaya | there we go, I can see the patch now | 15:43 |
| anteaya | took almost a minute to show it | 15:44 |
| zaro | toggle ci button works. | 15:44 |
| anteaya | good news | 15:44 |
| mordred | zaro: woot | 15:45 |
| fungi | posting ascii in review comments works but extended utf-8 throws an internal server error | 15:45 |
| *** krtaylor has joined #openstack-infra | 15:45 | |
| *** davideagnello has quit IRC | 15:45 | |
| zaro | which change? | 15:45 |
| mordred | [2015-03-21 15:45:40,351] INFO com.googlesource.gerrit.plugins.replication.ReplicationQueue : Created remote repository: cgit@git03.openstack.org:/var/lib/git/openstack/heat-specs.git | 15:46 |
| mordred | really? | 15:46 |
| *** sarob has joined #openstack-infra | 15:46 | |
| fungi | zaro: trying to leave a comment of 菌類のカタルシス on https://review.openstack.org/164056 | 15:46 |
| *** garyh has quit IRC | 15:46 | |
| zaro | mordred: is that a problem? | 15:47 |
| mordred | Caused by: java.sql.SQLException: Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE) for operation '<=' | 15:47 |
| fungi | zaro: looks like utf-8 which overlaps with latin-1 is fine, but stuff outside the latin-1 subset (testing east asian width glyphs) is throwing errors | 15:47 |
| fungi | zaro: well, it worked on review-dev | 15:47 |
| mordred | I think we missed a setting somewhere | 15:47 |
| mordred | something it still configued for latin1_swedish | 15:47 |
| fungi | grar | 15:47 |
| mordred | oh - uhm - did we update collations and character sets? | 15:48 |
| mordred | or just character sets | 15:48 |
| fungi | mordred: both | 15:48 |
| mordred | k | 15:48 |
| fungi | collations are set to utf8_bin on the trove instance now | 15:48 |
| mordred | where are they set in the jdbc connection info? | 15:48 |
| fungi | the trove config on the review db is the same as it is on the review-dev db | 15:48 |
| jeblair | i think we did not set jdbc and instead set it only on the mysql server, right? | 15:49 |
| fungi | right | 15:49 |
| fungi | we _can_ override the jdbc's dburi to include those parameters but were trying to avoid doing so | 15:49 |
| zaro | jeblair: jdbc is not set on review-dev.o.o either | 15:49 |
| jeblair | zaro: but review-dev is running a different version | 15:49 |
| mordred | this behavior is really a jdbc thing | 15:50 |
| * zaro keeps forgetting that | 15:50 | |
| zaro | yeah, give that a try. | 15:50 |
| fungi | true, maybe this works as intended on 2.9 but not 2.8? | 15:50 |
| jeblair | zaro: what are the tables configured for? | 15:50 |
| jeblair | zaro: on review-dev? | 15:50 |
| zaro | it's utf8-bin i beleive | 15:50 |
| *** sarob has quit IRC | 15:51 | |
| fungi | oh, yeah do we need to run table charset conversions too? did the trove config only affect defaults? | 15:51 |
| jeblair | so, the differences between production and dev are: different software versions, and the table definitions themselves. | 15:51 |
| jeblair | fungi: i believe the trove config affects the _connection_ | 15:51 |
| fungi | okay | 15:51 |
| mordred | that is correct | 15:51 |
| fungi | so gerrit may still be looking at table charsets to decide what to actually use? | 15:51 |
| jeblair | perhaps. i thought we had excluded that theory on review-dev, but perhaps it was tangled up in 2 other variables | 15:52 |
| fungi | we can stop gerrit quickly and update the tables, i guess | 15:52 |
| zaro | that seems odd since we somehow got this working before this upgrade right? | 15:52 |
| jeblair | fungi: alternatively, we could revert the trove config | 15:52 |
| fungi | that too | 15:52 |
| jeblair | zaro: never with this data set and these versions | 15:52 |
| fungi | i have no particular preference | 15:52 |
| jeblair | i would prefer we do that, and then, next time, properly test this. | 15:53 |
| mordred | I agree | 15:53 |
| fungi | sounds good. stopping gerrit again now | 15:53 |
| fungi | then i'll swap the trove config back | 15:53 |
| *** markvoelker has joined #openstack-infra | 15:53 | |
| fungi | gerrit is down, first trove instance restart is underway | 15:54 |
| mordred | so - table charset is about what's stored there, server charset is about what wants to be sent as output - a table charset of latin1 and a server charset of utf8 means that the server will notice the differnce and do an implicit conversion when sending things over the wire | 15:54 |
| mordred | the client charset is a similar handoff | 15:55 |
| fungi | second instance restart completed with the old config now | 15:55 |
| fungi | starting gerrit again | 15:55 |
| mordred | it's largely about declaring what the data is, and what you you would like it to be at each step along the way | 15:55 |
| jeblair | so we probably do want to update the tables too | 15:56 |
| mordred | yes - but we should test that for sure | 15:56 |
| mordred | with the actual data set | 15:56 |
| jeblair | yep | 15:56 |
| fungi | okay, tested and gerrit is back to the old charset substitution behavior so we should be unregressed now | 15:56 |
| mordred | woo | 15:56 |
| fungi | updating known hosts on puppetmaster now to get ansible happified | 15:57 |
| *** masayukig_ has quit IRC | 15:57 | |
| jeblair | more weird ansible terminology ;) | 15:57 |
| pleia2 | haha | 15:57 |
| *** markvoelker has quit IRC | 15:58 | |
| fungi | happification is a widely used terminism even outside ansiblestuff | 15:58 |
| fungi | it's a perfectly cromulent word | 15:58 |
| *** dboik has joined #openstack-infra | 15:58 | |
| jeblair | https://review.openstack.org/#/c/165448/ | 15:58 |
| fungi | okay, that should be working now | 15:58 |
| jeblair | i just rechecked that change and it looks good | 15:58 |
| jeblair | (it's noop, so it's fast :) | 15:58 |
| jeblair | but that should exercise most of the non-merge aspects of zuul-gerrit interaction | 15:59 |
| zaro | what is the thought on db to utf8 migration, should this be done along with gerrit upgrade? separate? | 15:59 |
| fungi | zaro: we'll likely have a batch of project renames between now and then | 16:00 |
| fungi | maybe next weekend or the weekend after | 16:00 |
| *** harlowja_away has quit IRC | 16:00 | |
| mordred | fungi: I think we shoudl maybe do it in conjunction with that | 16:00 |
| mordred | since the 2.9 migration is more moving parts | 16:00 |
| fungi | completely agree | 16:00 |
| mordred | and the projct renames are just data moves | 16:00 |
| jeblair | sounds good to me | 16:00 |
| mordred | I think we can test the mysql interactions offline in the interim | 16:01 |
| fungi | other than people exercising this looking for bugs and ending the statusbot alert and sending a follow-up e-mail to the lists? | 16:01 |
| jeblair | restarting gerritbot | 16:01 |
| *** masayukig_ has joined #openstack-infra | 16:02 | |
| *** sarob has joined #openstack-infra | 16:02 | |
| fungi | my budgeted time for this is coming to a close. have a half marathon coming up in several weeks and need to disappear for several hours to train. need me for anything else before i afk? | 16:02 |
| jeblair | #status ok Gerrit is back online | 16:02 |
| openstackstatus | jeblair: sending ok | 16:02 |
| mordred | fungi: YUCK my god what the heck are you thinking? | 16:03 |
| jeblair | who wants to send the email? | 16:03 |
| *** tnovacik has joined #openstack-infra | 16:03 | |
| *** _nadya_ has joined #openstack-infra | 16:03 | |
| fungi | mordred: it's an excellent way to get out and enjoy the island here | 16:04 |
| zaro | fungi: i thought you had treadmill thingy conected as your desk? | 16:04 |
| fungi | zaro: yeah but my wife and i can't both walk 13 miles on it simultaneously | 16:04 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/manual/ http://ci.openstack.org/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/" | 16:04 | |
| -openstackstatus- NOTICE: Gerrit is back online | 16:04 | |
| mordred | fungi: I think you're not trying hard enough | 16:05 |
| zaro | mordred: more miles? or more machinery? | 16:06 |
| jeblair | I'll send the followup email | 16:06 |
| pleia2 | thanks jeblair | 16:06 |
| mordred | zaro: I think if they put their minds to it- fungi and his wife COULD walk 13 miles on one treadmill simultaneously | 16:06 |
| openstackstatus | jeblair: finished sending ok | 16:07 |
| *** sarob has quit IRC | 16:07 | |
| zaro | ohh yeah, very efficient! | 16:07 |
| *** Daviey has quit IRC | 16:08 | |
| *** Daviey has joined #openstack-infra | 16:08 | |
| zaro | i'll be afk now, thanks and good job guys. | 16:08 |
| jeblair | zaro: thank you! | 16:08 |
| zaro | maybe do a fungi | 16:08 |
| jeblair | i think gerritbot is having problems, but i think we can deal with that later. | 16:08 |
| jeblair | i'm going to stop it for now. | 16:10 |
| fungi | problems connecting to freenode? | 16:10 |
| jeblair | it thinks it is, but isn't really. i don't have enough debug log to say why | 16:11 |
| fungi | it does seem to think it joined a bunch of channels | 16:11 |
| fungi | about a minute or so ago | 16:11 |
| *** masayukig_ has quit IRC | 16:11 | |
| mordred | fungi: I disagree with it | 16:11 |
| fungi | i'll take a look when i get back in a little while if nobody beats me to it | 16:12 |
| * fungi -> afk | 16:12 | |
| anteaya | is it a new infra thing we all have to run? | 16:13 |
| anteaya | I don't run | 16:13 |
| jeblair | anteaya: you walk which is like running | 16:13 |
| anteaya | I do walk, I love to walk | 16:13 |
| anteaya | okay glad that counts | 16:13 |
| * anteaya tries to picture mordred running | 16:13 | |
| anteaya | not working well | 16:13 |
| mordred | anteaya: is there a bottle of cachaça at the other end of the distance and my caipirinha is empty? | 16:14 |
| mordred | anteaya: that might be a scenario which will help your imagination | 16:14 |
| pleia2 | I'm going to go saturday as well (and probably run! but not training for any part of any marathons ;)) | 16:15 |
| pleia2 | anteaya: I run very slowly, so it's kind of like walking | 16:15 |
| *** davideagnello has joined #openstack-infra | 16:16 | |
| anteaya | mordred: ah running for a beverage, okay | 16:16 |
| jeblair | oh, very old version of gerritbot installed | 16:17 |
| anteaya | pleia2: bridging the gap, how diplomatic of you :) | 16:17 |
| jeblair | i don't know how the newer version got installed on the old server | 16:18 |
| *** emagana has joined #openstack-infra | 16:20 | |
| *** davideagnello is now known as davide_ | 16:20 | |
| anteaya | nor do I | 16:20 |
| jeblair | okay, yeah, i'll look into it later. we can live without it for a bit. | 16:20 |
| *** masayukig_ has joined #openstack-infra | 16:21 | |
| anteaya | very good | 16:21 |
| anteaya | I'm off outside for a bit | 16:21 |
| *** emagana_ has joined #openstack-infra | 16:22 | |
| *** emagana_ has quit IRC | 16:22 | |
| jeblair | found it | 16:23 |
| *** openstackgerrit has joined #openstack-infra | 16:23 | |
| jeblair | there's a new version of the irc module, and gerritbot doesn't work very well with it | 16:23 |
| jeblair | i downgraded it to what's on the old server | 16:23 |
| *** openstackgerrit has quit IRC | 16:24 | |
| *** emagana has quit IRC | 16:24 | |
| jeblair | fungi: ^ gerritbot should be working now | 16:24 |
| *** openstackgerrit has joined #openstack-infra | 16:24 | |
| *** _nadya_ has quit IRC | 16:26 | |
| *** sushilkm has joined #openstack-infra | 16:29 | |
| *** LinuxJedi has quit IRC | 16:29 | |
| *** sushilkm has left #openstack-infra | 16:29 | |
| mordred | jeblair: what's the working version? | 16:33 |
| *** andreykurilin_ has joined #openstack-infra | 16:34 | |
| *** tkelsey has joined #openstack-infra | 16:41 | |
| *** tkelsey has quit IRC | 16:45 | |
| *** otter768 has joined #openstack-infra | 16:52 | |
| *** yfried has joined #openstack-infra | 16:54 | |
| *** harlowja_at_home has joined #openstack-infra | 16:54 | |
| *** otter768 has quit IRC | 16:56 | |
| *** unicell has joined #openstack-infra | 17:00 | |
| *** unicell1 has quit IRC | 17:02 | |
| *** ddieterly has quit IRC | 17:02 | |
| *** sarob has joined #openstack-infra | 17:03 | |
| *** sarob has quit IRC | 17:07 | |
| *** emagana has joined #openstack-infra | 17:16 | |
| mordred | greghaynes, fungi: don't know if anyone has given a thought to this ... | 17:19 |
| *** Bsony has quit IRC | 17:19 | |
| mordred | but the dib's package-installs.yaml and pkg-map could really be replaced by bindep when it's ready | 17:20 |
| mordred | since they're serving the same purpose | 17:20 |
| *** emagana has quit IRC | 17:21 | |
| *** ibiris_away is now known as ibiris | 17:24 | |
| *** harlowja_at_home has quit IRC | 17:25 | |
| *** trey has quit IRC | 17:27 | |
| *** trey has joined #openstack-infra | 17:29 | |
| *** sputnik13 has joined #openstack-infra | 17:41 | |
| greghaynes | yea, theres a bit more descriptive data in package-installs and I have no idea about the mapping that bindep does but IMO package-installs should go the route of really just being for the pre-install phase | 17:44 |
| greghaynes | I got my rax + glance set up though so should be good to try the dib vhd outputting now | 17:46 |
| *** sputnik13 has quit IRC | 17:47 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add config-drive element https://review.openstack.org/154132 | 17:47 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add elements for Infra servers https://review.openstack.org/140840 | 17:47 |
| mordred | greghaynes: woot! | 17:48 |
| mordred | greghaynes: I just updated those a little bit - added ssh hostkey stuff - as well as some docs aroudn the helper scripts I've got to test on rackspace | 17:48 |
| mordred | greghaynes: so hopefully the stepwise process should be a little less opaque | 17:48 |
| *** ominakov has joined #openstack-infra | 17:49 | |
| *** ominakov has quit IRC | 17:49 | |
| mordred | greghaynes, SpamapS: also - I added a run-parts to rc.local - which just seems like one of the insanest things ever - feel free to mock me | 17:51 |
| *** baoli has quit IRC | 17:52 | |
| *** baoli has joined #openstack-infra | 17:53 | |
| *** sputnik13 has joined #openstack-infra | 17:54 | |
| *** sputnik13 has quit IRC | 17:55 | |
| *** davide_ has quit IRC | 18:02 | |
| *** garyh has joined #openstack-infra | 18:03 | |
| *** davide has joined #openstack-infra | 18:03 | |
| *** mestery has joined #openstack-infra | 18:03 | |
| *** ddieterly has joined #openstack-infra | 18:03 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add config-drive element https://review.openstack.org/154132 | 18:04 |
| openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Add pypi jobs for stackforge/networking-[odl,ovn] https://review.openstack.org/166522 | 18:05 |
| *** davide has quit IRC | 18:05 | |
| *** davide has joined #openstack-infra | 18:06 | |
| *** davide has quit IRC | 18:06 | |
| *** ddieterly has quit IRC | 18:08 | |
| *** woodster_ has joined #openstack-infra | 18:08 | |
| *** garyh has quit IRC | 18:08 | |
| *** emagana has joined #openstack-infra | 18:10 | |
| *** koolhead17 has joined #openstack-infra | 18:11 | |
| *** sdake has joined #openstack-infra | 18:14 | |
| *** emagana has quit IRC | 18:15 | |
| *** e0ne has joined #openstack-infra | 18:21 | |
| *** jgrimm- is now known as zz_jgrimm- | 18:23 | |
| morganfainberg | clarkb, jeblair, i think i have a case where a -2 Code review is not sticky | 18:26 |
| morganfainberg | clarkb, jeblair: https://review.openstack.org/#/c/165936/ | 18:26 |
| morganfainberg | fungi, ^ cc | 18:26 |
| *** dims has quit IRC | 18:26 | |
| *** dims has joined #openstack-infra | 18:27 | |
| *** dims has quit IRC | 18:32 | |
| *** andreykurilin_ has quit IRC | 18:32 | |
| *** yfried has quit IRC | 18:33 | |
| *** ominakov has joined #openstack-infra | 18:37 | |
| *** Somay has joined #openstack-infra | 18:41 | |
| *** ominakov has quit IRC | 18:43 | |
| *** e0ne has quit IRC | 18:45 | |
| *** e0ne has joined #openstack-infra | 18:47 | |
| Somay | hi clarkb , please review this - https://review.openstack.org/#/c/163137/ | 18:47 |
| *** achanda has joined #openstack-infra | 18:51 | |
| *** salv-orlando has joined #openstack-infra | 18:53 | |
| *** otter768 has joined #openstack-infra | 18:53 | |
| bknudson | http://logs.openstack.org/41/166541/1/check/gate-keystone-requirements/8cf8434/console.html -- SystemError: Cloning into '/tmp/tmptKV8u7/requirements'... | 18:54 |
| *** Kiall has quit IRC | 18:55 | |
| *** tsg has joined #openstack-infra | 18:57 | |
| *** otter768 has quit IRC | 18:57 | |
| *** salv-orlando has quit IRC | 18:58 | |
| *** e0ne has quit IRC | 19:02 | |
| *** ddieterly has joined #openstack-infra | 19:04 | |
| *** emagana has joined #openstack-infra | 19:04 | |
| *** ddieterly has quit IRC | 19:09 | |
| *** Somay has quit IRC | 19:09 | |
| *** emagana has quit IRC | 19:09 | |
| *** dank_ has quit IRC | 19:14 | |
| *** baoli has quit IRC | 19:14 | |
| mordred | bknudson: hrm | 19:15 |
| mordred | a) I don't nkow why that would fail | 19:16 |
| mordred | b) I don't know why we have a script cloning from gerrit | 19:16 |
| mordred | clarkb: ^^ ? | 19:16 |
| *** hyakuhei has joined #openstack-infra | 19:21 | |
| bknudson | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/project-requirements-change.py#n28 | 19:21 |
| *** emagana has joined #openstack-infra | 19:22 | |
| bknudson | git clone -- http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/project-requirements-change.py#n142 | 19:22 |
| *** achanda has quit IRC | 19:23 | |
| bknudson | git clone https://review.openstack.org/p/openstack/requirements --branch %s --depth 1 %s | 19:23 |
| *** baoli has joined #openstack-infra | 19:26 | |
| bknudson | that command works for me. | 19:26 |
| *** emagana has quit IRC | 19:26 | |
| *** sdake has quit IRC | 19:27 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add config-drive element https://review.openstack.org/154132 | 19:30 |
| mordred | bknudson: yeah - it works for me too - maybe it was just a temp hiccup? | 19:30 |
| mordred | SpamapS, greghaynes: ^^ ok - I made the ansible playbook better, and I have now made a role that should be able to perform "please build image X and upload it to all of my clouds please" | 19:31 |
| *** Somay has joined #openstack-infra | 19:32 | |
| bknudson | rechecking | 19:33 |
| *** ddieterly has joined #openstack-infra | 19:34 | |
| fungi | jeblair: aha, i think i had originally upgraded gerritbot on old gerrit (many months ago because it seemed to solve all the bot not reconnecting problems we had), not realizing we might have had it explicitly pinned in puppet | 19:36 |
| fungi | morganfainberg: that's extremely strange | 19:37 |
| *** teran has quit IRC | 19:38 | |
| fungi | mordred: agreed, project-requirements-change.py should probably use zuul-cloner too now that we have it | 19:40 |
| *** baoli has quit IRC | 19:40 | |
| fungi | bknudson: mordred: it looks endemic... https://jenkins05.openstack.org/job/gate-keystone-requirements/165/console | 19:42 |
| fungi | that's the recheck failing the same way | 19:42 |
| mordred | fungi: that does not seem like a good thing | 19:43 |
| fungi | not sure yet if it's just keystone or other repos too | 19:43 |
| mordred | fungi: unbound caching old dns on build nodes? | 19:43 |
| fungi | maybe. it's https so maybe i can find in the apache log where it's going | 19:44 |
| *** praveenkumar has quit IRC | 19:44 | |
| *** praveenkumar has joined #openstack-infra | 19:45 | |
| fungi | grr, it's connecting via ipv6 and nodepool only logs the ipv4 address | 19:47 |
| mordred | fungi: maybe ipv6 dns didn't propogate? | 19:47 |
| jeblair | it looks correct for me | 19:48 |
| *** hyakuhei has quit IRC | 19:48 | |
| fungi | yeah, dns seems fine | 19:48 |
| fungi | i'll try to match this up in the apache logs by timestamp instead of source address | 19:48 |
| fungi | maybe i'll get lucky and it'll be a slam dunk | 19:48 |
| jeblair | fungi: what are you trying to match up? | 19:49 |
| fungi | jeblair: the git clone failures in those requirements check jobs | 19:49 |
| *** baoli has joined #openstack-infra | 19:49 | |
| jeblair | fungi: trying to match git https request logs on review.o.o? | 19:49 |
| fungi | yeah | 19:50 |
| jeblair | well, i can replicate that locally | 19:50 |
| fungi | oh? i didn't try after mordred and bknudson said it wasn't failing for them | 19:51 |
| jeblair | i think it's a problem with '/p/' | 19:51 |
| jeblair | "git clone https://review.openstack.org/p/openstack/requirements --branch master --depth 1 /tmp/requirements" fails for me locally | 19:51 |
| jeblair | "git clone https://review.openstack.org/openstack/requirements --branch master --depth 1 /tmp/requirements" succeeds | 19:51 |
| bknudson | $ git clone https://review.openstack.org/p/openstack/requirements | 19:51 |
| bknudson | Initialized empty Git repository in /home/bknudson/nobackup/tmp/requirements/.git/ | 19:51 |
| bknudson | remote: Counting objects: 4472, done. | 19:51 |
| fungi | aha, it's the --depth 1 which is doing it to me | 19:52 |
| *** achanda has joined #openstack-infra | 19:52 | |
| fungi | without it i get success, but with i get the hung up unexpectedly error | 19:52 |
| jeblair | yeah, the /p/ is a red herring | 19:52 |
| fungi | i'll git fsck it | 19:53 |
| bknudson | git clone https://review.openstack.org/p/openstack/requirements --depth 1 | 19:53 |
| bknudson | seems to hang? | 19:53 |
| jeblair | fungi: i see the problem with other repos | 19:54 |
| jeblair | i think it's more systemic that git fsck | 19:54 |
| fungi | ahh, yep | 19:54 |
| *** davide has joined #openstack-infra | 19:55 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add ansible role for building and uploading images https://review.openstack.org/166547 | 19:55 |
| mordred | jeblair: did we not make the local replicas? | 19:55 |
| jeblair | mordred: i think gerrit did | 19:55 |
| jeblair | they seem to be there | 19:55 |
| fungi | no, they're right there in /opt | 19:55 |
| mordred | ok. that's good | 19:55 |
| mordred | fatal: The remote end hung up unexpectedly | 19:57 |
| mordred | fatal: Unable to create temporary file '/opt/lib/git/openstack-dev/pbr.git/shallow_J249tC': Permission denied | 19:57 |
| jeblair | when i run locally on the server i get: fatal: Unable to create temporary file '/opt/lib/git/openstack/requirements.git/shallow_N3v8CJ': Permission denied | 19:57 |
| mordred | from apache log | 19:57 |
| mordred | yah | 19:57 |
| jeblair | mordred: oh good, i was running that as my local non-root user | 19:57 |
| fungi | i'm getting teh same with file:/// yeah | 19:57 |
| jeblair | mordred: so i think you confirmed that replicates what's happening with apache | 19:57 |
| *** hyakuhei has joined #openstack-infra | 19:58 | |
| bknudson | maybe --depth 1 isn't more efficient. | 19:58 |
| jeblair | new version of git behaves differently when called as a server? | 19:58 |
| fungi | so... is the git cgi running as a different user than before? | 19:58 |
| fungi | yeah, or that | 19:58 |
| *** ddieterl_ has joined #openstack-infra | 19:58 | |
| jeblair | fungi: or group membership? | 19:59 |
| mordred | I don't see the permissions on the old server indicating anything that would let happen with a non-gerrit user | 19:59 |
| mordred | but I can do this: git clone file:///opt/lib/git/openstack/requirements.git/ --depth 1 | 19:59 |
| jeblair | no, www-data is only a member of www-data | 19:59 |
| mordred | on old gerrit | 19:59 |
| mordred | as me | 19:59 |
| *** davide has quit IRC | 19:59 | |
| jeblair | so it seems like a git behavior change | 20:00 |
| mordred | spectacular | 20:00 |
| *** hashar has joined #openstack-infra | 20:00 | |
| bknudson | sounds like a slam dunk! | 20:00 |
| jeblair | with: ScriptAlias /p/ /usr/lib/git-core/git-http-backend/ | 20:00 |
| mordred | well - I think it's a wide git behavior change | 20:00 |
| mordred | the file non-apache behavior tries to make the file on trusty but not on precise | 20:01 |
| fungi | yeah, i'm hunting for bug reports with some possible clue | 20:01 |
| jeblair | mordred: right | 20:01 |
| jeblair | https://bugs.launchpad.net/linaro-infrastructure-misc/+bug/1253139 | 20:01 |
| openstack | Launchpad bug 1253139 in Linaro Infrastructure Misc "staging.git; --depth=1 doesn't seem to work with "smart http"" [Medium,Fix released] - Assigned to Milo Casagrande (milo) | 20:01 |
| fungi | ugh | 20:01 |
| mordred | http://git.661346.n2.nabble.com/PATCH-upload-pack-allow-shallow-fetching-from-a-read-only-repository-td7604326.html | 20:02 |
| *** ddieterly has quit IRC | 20:02 | |
| fungi | i wonder if there's an additional envvar we need to pass to tell it to create tempfiles elsewhere | 20:02 |
| fungi | hunting that down in docs now | 20:02 |
| jeblair | fungi: that patch might also be too new to be in trusty? | 20:03 |
| fungi | entirely possible | 20:03 |
| jeblair | i say that patch, but of course i don't really know what was finally applied | 20:03 |
| mordred | I can't find reference of it applying | 20:03 |
| mordred | yeah | 20:03 |
| mordred | well, you know patches on mailing lists are awesome | 20:03 |
| jeblair | i am beginning to think the solution to this is to change any jobs that do --depth 1 to reference git.o.o (which they should anyway) | 20:05 |
| jeblair | (i will type that change up while fungi and mordred continue whatever investigation you are doing) | 20:05 |
| bknudson | so the patch is to use /tmp if the git dir isn't writable. | 20:06 |
| *** dan has joined #openstack-infra | 20:06 | |
| mordred | jeblair: k. agree | 20:07 |
| mordred | that patch has not landed in upstream git, btw | 20:07 |
| fungi | jeblair: zuul-cloner rather than doing a remote clone? | 20:07 |
| bknudson | env = getenv("TMPDIR") -- according to http://git.kaarsemaker.net/git/commit/f2db68eda89f2fbe7e4c1a69a3c10b25ea43667c/ | 20:07 |
| jeblair | fungi: hostname change is super easy for now | 20:07 |
| fungi | yep, totally | 20:07 |
| fungi | bknudson: hrm, i wonder if we can't just set that to somewhere writable by www-data then | 20:08 |
| mordred | bknudson: nope | 20:08 |
| fungi | bknudson: it really seems like it's not using TMPDIR for this though | 20:08 |
| mordred | bknudson: setup_temporary_shallow doesn't seem to use that function | 20:08 |
| mordred | https://github.com/git/git/blob/master/shallow.c#L237 | 20:08 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Clone from git.o.o rather than review.o.o https://review.openstack.org/166548 | 20:08 |
| bknudson | oh, xmkstemp | 20:09 |
| fungi | it really seems to want to create temporary packs in the gitdir | 20:09 |
| jeblair | i only found the one place. it will need image builds ^ | 20:09 |
| jeblair | i really don't want to let it do that. :( | 20:09 |
| mordred | jeblair: well, thankfully we have centos git mirrors with older git on them | 20:10 |
| fungi | agreed, for now seems like a "doctor it hurts when i do this" sort of problem | 20:10 |
| jeblair | mordred: yeah, i do worry a bit that we're kicking this down the line, but at least we know about it now and can take care with the mirrors | 20:10 |
| mordred | jeblair: yah - and I mean, in theory we could work on trying to advance that patch | 20:10 |
| mordred | I can think of few things I want to do less than try to land a change like that in upstream git though | 20:11 |
| fungi | i'm about to head out and get something to eat, but can kick off image updates before i go and then check in on them when i get back | 20:13 |
| jeblair | so linaro chose to give it write access, fwiw. | 20:13 |
| fungi | yeah, i found that bug report | 20:13 |
| fungi | oh, that was the same one you linked | 20:14 |
| jeblair | so, i just got back from this place: http://www.m-maselliandsons.com/var/m_9/9d/9d8/335860/404698-the%20salvage%20yard.jpg | 20:14 |
| jeblair | which i can't believe i never knew about until now | 20:14 |
| *** ddieterly has joined #openstack-infra | 20:14 | |
| jeblair | so i'm going to go do some things with the things i got there. :) | 20:15 |
| *** ddieterl_ has quit IRC | 20:15 | |
| fungi | zomg that's huuuuge | 20:15 |
| jeblair | right? it's one of those -- wait, what is this i'm looking at? ohhhhhh... kinds of pictures | 20:16 |
| fungi | want some scrap glavanized culvert? you're in luck! | 20:16 |
| *** changbl has quit IRC | 20:16 | |
| fungi | need a few hundred linear feet of roller conveyors? no problem! | 20:16 |
| *** emagana has joined #openstack-infra | 20:16 | |
| jeblair | they had so many of those | 20:16 |
| *** enikanorov has joined #openstack-infra | 20:16 | |
| jeblair | they also had "big red buttons" of all kinds of varieties... | 20:16 |
| fungi | nice. every computer needs a huge epo button | 20:17 |
| *** teran has joined #openstack-infra | 20:17 | |
| jeblair | used, of course... which makes me wonder about what might have caused them to be pushed. and whether that had anything to do with why they were in the scrapyard. | 20:17 |
| fungi | well, also they're only rated for a handful of depress cycles before they're required to be replaced | 20:18 |
| fungi | so won't meet code if already used, but if you want them for cosmetic purposes it's just fine | 20:18 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add config-drive element https://review.openstack.org/154132 | 20:19 |
| *** koolhead17 has quit IRC | 20:19 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add ansible role for building and uploading images https://review.openstack.org/166547 | 20:20 |
| mordred | jeblair: that is a great steel and pipe place!!! | 20:20 |
| openstackgerrit | Merged openstack-infra/project-config: Clone from git.o.o rather than review.o.o https://review.openstack.org/166548 | 20:20 |
| *** emagana has quit IRC | 20:21 | |
| *** ujuc has quit IRC | 20:21 | |
| morganfainberg | fungi, i re, -2'd that one, but i tried it elsewhere and couldn't duplicate | 20:22 |
| morganfainberg | fungi, maybe something transient | 20:22 |
| fungi | morganfainberg: yeah, unless i get time to go hunting through the terrible, terrible gerrit log for a cause i'm just going to keep an eye out for more occurrences and assume it was a basically one-time event otherwise | 20:23 |
| *** hyakuhei has quit IRC | 20:23 | |
| morganfainberg | fungi, works for me. | 20:23 |
| fungi | it's definitely the first time i've seen it, and might also be a bug corrected in the version we're about to install in a few weeks | 20:23 |
| morganfainberg | right. | 20:24 |
| fungi | jeblair: just to confirm, the job that runs that script only uses bare-trusty so no need to rebuild any other images yeah? | 20:26 |
| fungi | at least it looks to me like it's only bare-trusty | 20:26 |
| fungi | hrm, it's registered on bare-precise too | 20:27 |
| *** yamahata has joined #openstack-infra | 20:31 | |
| *** Bsony has joined #openstack-infra | 20:32 | |
| *** timcline has joined #openstack-infra | 20:32 | |
| *** timcline has quit IRC | 20:32 | |
| fungi | okay, both bare-precise and bare-trusty are updating now in all 8 providers. i'll check back in on them when i return from food | 20:33 |
| *** baoli has quit IRC | 20:33 | |
| *** timcline has joined #openstack-infra | 20:34 | |
| *** baoli has joined #openstack-infra | 20:34 | |
| *** timcline has quit IRC | 20:35 | |
| *** timcline has joined #openstack-infra | 20:36 | |
| *** baoli has quit IRC | 20:40 | |
| *** ddieterly has quit IRC | 20:41 | |
| *** ddieterly has joined #openstack-infra | 20:42 | |
| *** dhritishikhar has quit IRC | 20:42 | |
| *** tkelsey has joined #openstack-infra | 20:42 | |
| *** hashar has quit IRC | 20:46 | |
| *** tkelsey has quit IRC | 20:46 | |
| *** teran_ has joined #openstack-infra | 20:48 | |
| *** woodster_ has quit IRC | 20:50 | |
| *** teran has quit IRC | 20:51 | |
| *** otter768 has joined #openstack-infra | 20:54 | |
| *** otter768 has quit IRC | 20:59 | |
| *** achanda has quit IRC | 20:59 | |
| *** [HeOS] is now known as HeOS | 21:02 | |
| *** changbl has joined #openstack-infra | 21:06 | |
| *** emagana has joined #openstack-infra | 21:10 | |
| *** dims has joined #openstack-infra | 21:12 | |
| mordred | fungi: exciting | 21:13 |
| *** changbl has quit IRC | 21:14 | |
| *** teran has joined #openstack-infra | 21:15 | |
| *** emagana has quit IRC | 21:15 | |
| *** teran_ has quit IRC | 21:19 | |
| *** sarob has joined #openstack-infra | 21:20 | |
| *** achanda has joined #openstack-infra | 21:22 | |
| *** tnovacik has quit IRC | 21:23 | |
| *** sarob has quit IRC | 21:25 | |
| *** ddieterl_ has joined #openstack-infra | 21:26 | |
| *** ddieterly has quit IRC | 21:27 | |
| *** mriedem1 has joined #openstack-infra | 21:27 | |
| *** mriedem has quit IRC | 21:28 | |
| *** timcline has quit IRC | 21:32 | |
| *** timcline has joined #openstack-infra | 21:33 | |
| *** timcline has quit IRC | 21:34 | |
| *** timcline has joined #openstack-infra | 21:34 | |
| *** nilasae|zzz has quit IRC | 21:35 | |
| *** sputnik13 has joined #openstack-infra | 21:40 | |
| *** davide has joined #openstack-infra | 21:44 | |
| *** mwagner_lap has quit IRC | 21:45 | |
| *** davide has quit IRC | 21:48 | |
| *** LinuxJedi has joined #openstack-infra | 21:50 | |
| *** bdpayne has joined #openstack-infra | 21:52 | |
| *** timcline has quit IRC | 21:56 | |
| *** hogepodge has quit IRC | 21:56 | |
| *** markvoelker has joined #openstack-infra | 21:58 | |
| *** achanda has quit IRC | 22:01 | |
| *** markvoelker has quit IRC | 22:02 | |
| *** Bsony has quit IRC | 22:02 | |
| *** sdake has joined #openstack-infra | 22:03 | |
| *** sdake_ has joined #openstack-infra | 22:04 | |
| *** baoli has joined #openstack-infra | 22:04 | |
| *** emagana has joined #openstack-infra | 22:04 | |
| *** patrickeast has joined #openstack-infra | 22:06 | |
| *** sdake has quit IRC | 22:08 | |
| *** sdake has joined #openstack-infra | 22:09 | |
| *** emagana has quit IRC | 22:09 | |
| *** baoli has quit IRC | 22:09 | |
| *** sdake_ has quit IRC | 22:12 | |
| *** Somay has quit IRC | 22:14 | |
| *** achanda has joined #openstack-infra | 22:15 | |
| morganfainberg | mordred, so, meant to ask, would shade and similar tools benefit from keystone auth (session, auth plugins, etc) living in a different namespace? | 22:16 |
| morganfainberg | mordred, or is that generally "meh doesn't matter" for you? | 22:16 |
| mordred | morganfainberg: it would not matter at all | 22:17 |
| morganfainberg | mordred, differentiating interacting with keystone's APIs from the mechanisms to handle authn/authz - especially when not interacting with keystone. | 22:17 |
| mordred | morganfainberg: no - I would actually vote against that if I had a vote | 22:17 |
| mordred | the distinction is not helpful to me | 22:17 |
| mordred | but - I'm sure it also would not hurt me | 22:17 |
| mordred | morganfainberg: hrm. no - actually meh. I do not think it would be worse | 22:18 |
| *** ddieterl_ has quit IRC | 22:19 | |
| morganfainberg | mordred, so more int he "meh" category than "yes!" or "oh god no no no" | 22:19 |
| mordred | best I can tell | 22:19 |
| mordred | I mean, devil is always in the details | 22:19 |
| morganfainberg | we're looking at the split to help limit the extra cruft people are loading when authenticating. | 22:19 |
| mordred | but right now I have no beefs with keystoneclient organization | 22:19 |
| morganfainberg | it doesn't mean anything in ksc is materially changing, just that you *could* do just keystone auth and not need keystoneclient things. | 22:19 |
| morganfainberg | for example if i only ever talk to nova, i could do it with just auth + novaclient. | 22:20 |
| morganfainberg | vs. keystoneclient.keystoneauththings + novaclient | 22:20 |
| mordred | morganfainberg: yes. totally understand | 22:21 |
| mordred | morganfainberg: for shade, I'm taking the opposite approach | 22:21 |
| morganfainberg | thnx for the feedback, appreciate it since i know you use session more in depth than a lot of people do. | 22:21 |
| mordred | which is that I am making _zer_ attempts to minimize the things | 22:21 |
| mordred | zero | 22:21 |
| mordred | shade hard-depends on just about eery python-*client already | 22:21 |
| morganfainberg | mordred, aye. i figured but wanted to be sure. | 22:21 |
| mordred | morganfainberg: I appreciate you! | 22:21 |
| morganfainberg | this reminds me... i need to spin up non-persistent token *real* gate testing. | 22:23 |
| morganfainberg | not just "unit-y-things" | 22:23 |
| *** achanda has quit IRC | 22:23 | |
| *** achanda has joined #openstack-infra | 22:25 | |
| morganfainberg | mordred, one last - totally unrelated question, what is your feeling on if pbr had a mode where it could take like "requirements.in" and load an entry point that say... global-requirements published. where requirements.in was only a list of packages, and global-requirements held the version numbers. pbr then did magic "add version numbers" to the requirements? or am i speaking totally crazy-pants here? | 22:25 |
| * morganfainberg has been stewing on "we already have g-r" why not go the next step and really manage versions rather than auto-proposed updates for requirements.txt files. | 22:26 | |
| morganfainberg | might be too much headache to land updates to g-r then if $random_project would break with the new version. | 22:28 |
| mordred | yah. that's really the problem | 22:28 |
| morganfainberg | but that almost says if we have g-r, that should be a problem updates to g-r need to solve. | 22:28 |
| mordred | ultimately though, what is it that you're trying to accomplish? | 22:29 |
| morganfainberg | not having cases where a release of openstack could get wedged on installing things because project X has incompatible requirements with project Y. | 22:30 |
| morganfainberg | mostly in gate/infra/pip | 22:30 |
| morganfainberg | it would, in theory, be impossible to wedge the gate because of requirement conflicts | 22:30 |
| mordred | it's already impossible to wedge the gate because of requirement conflicts | 22:30 |
| mordred | because we sync with g-r as step one | 22:31 |
| mordred | we don't do integration testing with what's in your repo | 22:31 |
| mordred | we do it with what's in g-r | 22:31 |
| mordred | and we integration test changes to g-r on a devsatck run to make sure that version change will not break anything | 22:31 |
| morganfainberg | mordred, i remember a whole issue we just battled on stable branches along this line | 22:31 |
| morganfainberg | that is contrary to what you just said. | 22:32 |
| mordred | stable branches is a bit different | 22:32 |
| morganfainberg | this is targeted stable. sorry | 22:32 |
| mordred | and has to do with two different problems | 22:32 |
| morganfainberg | wasn't clear | 22:32 |
| *** achanda has quit IRC | 22:32 | |
| *** salv-orlando has joined #openstack-infra | 22:32 | |
| mordred | one was "testing stable branches against master of client libs - which introduced transitive dependency changes" | 22:32 |
| morganfainberg | right. | 22:32 |
| mordred | the other was "we haven't been actually hard-capping stable release requirements" | 22:33 |
| mordred | I believe the first is fixed | 22:33 |
| mordred | the second needs to be, and I'm going to stand my ground until people come around to my POV on that one :) | 22:33 |
| morganfainberg | right, and we could still run into the second unless we capped all transitive | 22:33 |
| mordred | yes. which we shoudl do | 22:33 |
| *** Somay has joined #openstack-infra | 22:33 | |
| mordred | we should set every requirement in stable branches with an == cap | 22:33 |
| *** Somay has quit IRC | 22:34 | |
| mordred | because I think there is ZERO chance EVER that we'll get a magical bugfix release from an upstream python library | 22:34 |
| morganfainberg | i was also thinking that we could just benefit from not needing to patch every repo when we change a cap. | 22:34 |
| morganfainberg | change it in g-r and everyone gets it | 22:34 |
| mordred | people should just accept the g-r patches as a rubberstamp | 22:35 |
| morganfainberg | i do. | 22:35 |
| mordred | more people should be like you | 22:35 |
| morganfainberg | but it's still an extra "oh yeah get that in" type thing | 22:35 |
| mordred | indeed | 22:35 |
| mordred | thing is - python dep management is a bit of a beast anyway | 22:35 |
| mordred | so I'm loathe to add more magic | 22:35 |
| morganfainberg | thats fair. | 22:35 |
| mordred | what we're effectively describing is a micro python distro | 22:36 |
| morganfainberg | this was a crazy idea that came from x-project meeting *and* sitting on a plane with bad wifi | 22:36 |
| morganfainberg | lots of time to let your mind wander | 22:36 |
| mordred | oh my favorite | 22:36 |
| morganfainberg | so off to run my errand for the day... do i get a new iphone [verizon issues], or do i change carriers and use the 1+ I have here. | 22:37 |
| morganfainberg | first time i've lost a cell phone in ~10yrs. | 22:37 |
| *** salv-orlando has quit IRC | 22:38 | |
| *** Bsony has joined #openstack-infra | 22:38 | |
| * morganfainberg grumbles about vzw not using GSM so this would be a non-issue | 22:38 | |
| mordred | morganfainberg: yah - I heard about that - that TOTALLY blows | 22:39 |
| *** sputnik13 has quit IRC | 22:40 | |
| *** sputnik1_ has joined #openstack-infra | 22:40 | |
| morganfainberg | mordred, so i'll just stop thinking of more magic python stuff ;) | 22:41 |
| morganfainberg | we already have enough crazy magic python happening. | 22:41 |
| *** tkelsey has joined #openstack-infra | 22:43 | |
| *** tkelsey has quit IRC | 22:48 | |
| fungi | python _is_ crazy magic | 22:49 |
| fungi | also all but two of the image updates worked, so i've restarted those two | 22:49 |
| *** patrickeast has quit IRC | 22:50 | |
| *** Bsony has quit IRC | 22:51 | |
| *** ddieterly has joined #openstack-infra | 22:53 | |
| *** stevemar has joined #openstack-infra | 22:53 | |
| *** otter768 has joined #openstack-infra | 22:55 | |
| *** markvoelker has joined #openstack-infra | 22:58 | |
| *** emagana has joined #openstack-infra | 22:59 | |
| *** otter768 has quit IRC | 22:59 | |
| *** ghostpl_ has quit IRC | 23:00 | |
| *** dmellado has quit IRC | 23:00 | |
| *** markvoelker has quit IRC | 23:03 | |
| *** emagana has quit IRC | 23:03 | |
| *** dmellado has joined #openstack-infra | 23:06 | |
| *** dboik has quit IRC | 23:11 | |
| *** dboik has joined #openstack-infra | 23:11 | |
| *** andreykurilin_ has joined #openstack-infra | 23:15 | |
| *** mriedem has joined #openstack-infra | 23:16 | |
| *** stevemar has quit IRC | 23:19 | |
| *** mriedem1 has quit IRC | 23:19 | |
| *** darvon has quit IRC | 23:27 | |
| *** darvon has joined #openstack-infra | 23:29 | |
| *** Bsony has joined #openstack-infra | 23:30 | |
| *** hyakuhei has joined #openstack-infra | 23:31 | |
| *** andreykurilin_ has quit IRC | 23:35 | |
| *** ibiris is now known as ibiris_away | 23:38 | |
| *** Bsony has quit IRC | 23:40 | |
| *** ghostpl_ has joined #openstack-infra | 23:40 | |
| *** sputnik1_ has quit IRC | 23:44 | |
| *** sputnik13 has joined #openstack-infra | 23:44 | |
| *** hyakuhei has quit IRC | 23:47 | |
| *** garyh has joined #openstack-infra | 23:53 | |
| *** emagana has joined #openstack-infra | 23:53 | |
| *** sputnik13 has quit IRC | 23:55 | |
| *** woodster_ has joined #openstack-infra | 23:56 | |
| *** emagana has quit IRC | 23:57 | |
| *** tiswanso has joined #openstack-infra | 23:58 | |
| *** markvoelker has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
