Saturday, 2016-02-13

NobodyCamparty at mordred 's house during summit???00:00
mordredboeing field is awesome00:00
anteayaI'm in00:00
mordredNobodyCam: s/during/instead of/00:00
NobodyCamlol00:00
clarkbya the museum there flies many of their planes00:00
NobodyCam++++00:00
anteayaeven better00:00
fungifirst flight airstrip^H^H^H^H^Hport is also fun for watching (small) aircraft00:00
mordredfungi: ++00:00
fungiand is a pleasantly short walk from my house00:00
fungithe wright bros. monument plaza at the top of kill devil hill actually has a great view of the airstrip too00:01
jeblairi saw a hacker project that's an ads-b receiver that looks up the origin/dest airport of planes overhead and displays it; so you can be like "oh, that's the 10:30 swa from san"00:01
*** HeOS has joined #openstack-infra00:01
pleia2cool00:01
clarkbjeblair: that is really neat00:01
fungiNEAT!00:01
anteayaha ha ha00:02
anteayapurring cat in my lap00:02
clarkbwhen I was at garmin all our ground test equipment could be plugged into building antennas to pick up that tpye of info as if we were stationary craft on the ground00:02
anteayanice00:03
anteayaso hey00:04
anteayaif you watch 60 minutes you soon will have a segment on our prime minister00:04
*** annegentle_ has quit IRC00:05
anteayalucky 60 minutes watchers00:05
mordredjeblair: that seems like a hacker project I should maybe install on my patio00:05
*** piet_ has joined #openstack-infra00:05
mordredjeblair: maybe figure out a way to project tracking positoins of flights on the ceiling00:05
anteayato troll the cat?00:06
mordredhahaha00:06
mordredhey cat - chase the 9:45 to SLC!00:06
anteayaha ha ha00:06
pleia2projected google sky map (it does stars and planets), but for airplanes00:06
mordredyah00:06
jeblairanteaya: Jean Poutine was the best pm.00:06
*** HeOS has quit IRC00:06
anteayaI like stars and planes better00:06
mordredpleia2: in the location I'm in it would be a really cool projection00:06
anteayajeblair: absolutely00:06
fungino doubt dhs/tsa would have a fit00:07
mordredhahaha00:07
anteayajeblair: can't do better than Poutine00:07
jeblairmordred: found the blog: http://jeremybmerrill.com/blog/2016/01/flyover.html00:07
mordredfungi: listen - if THAT's what they decide to be unhappy at me about00:07
anteayaha ha ha00:07
fungii'm pretty sure that's far down the list of things they're unhappy with _you_ about00:07
fungiactually, with the amount you fly, they probably all know you by sight (at every major airport)00:08
mordredjeblair: awesome. that seems totally like a thing I could build differently than the fellow there00:09
jeblairmordred: yeah, it could use some polish :)00:09
jeblairbut a good idea and resources00:09
mordredI00:09
mordredI'm thinking collect all the data I can hear00:09
mordredthen define a fixed map grid (since my patio does not move)00:10
jeblairmordred: lucky you00:10
jeblairours move in ca00:10
fungii was just thinking that ;?00:10
mordredand display the flight info as the plane - perhaps with bigger/smaller depending on altitude00:10
anteayaha ha ha00:10
clarkbSergeyLukjanov: how many items to index?00:10
anteayamoving patio as a feature00:11
fungialso, no idea what emoji ;? is. i think it expresses consternation at hitting shift at the wrong times00:11
pleia2secretly SergeyLukjanov took off for the weekend like 20 minutes ago00:11
SergeyLukjanovclarkb 6k :(00:11
pleia2oh good o/00:11
anteayafungi: noted00:11
jeblairit's too late to beat the rush to tahoe00:11
anteayaha ha ha00:11
SergeyLukjanovno, actually, it's bad, because it's processing nearly 1 per second...00:11
mordredI've been imagining that SergeyLukjanov has been skiing this whole time00:11
pleia2mordred: haha00:12
SergeyLukjanov:)00:12
mordredand doing the clarkb irc-on-phone00:12
*** rbrndt has quit IRC00:12
jeblairi think we're learning something really interesting about this version of gerrit00:12
anteayayes00:12
pleia2"spilled snow on my laptop, sec"00:12
mordredjeblair: yes. 'interesting'00:12
fungiwere i more industrious, i'd go back to our channel log from the upgrade and find out how long the reindex took00:12
fungibut instead i'm catching up on e-mail00:12
*** yamamoto_ has joined #openstack-infra00:12
clarkbits late on friday00:13
fungimy beer is getting lonely in the fridge00:13
clarkbI need beer00:13
mordredgood point. it's definitely caipirinha-o'clock00:14
fungii still have a new batch of contributor discount codes for summit registration to generate and send once gerrit comes back up00:14
clarkbmordred: oh! I have limes I can do that instead00:14
mordred\o/00:14
jeblairclarkb: i thought you said you had LINES you could do instead00:14
clarkbmordred: what cachaca do you use? novo fogo has treated me well but apparently its a for foreign markets only cachaca so seems less authentic00:14
jeblairand, well, i mean, er, ...00:14
clarkbjeblair: I am not that exciting :)00:14
SergeyLukjanov98% yay!00:14
clarkbmordred: so I figure you drink something else00:14
mordredclarkb: I usually just do leblon because it's a solid performer that I can always fine00:15
fungithough i did analyze the >100 bounces i received from the initial batch, map it back to the contributor contact data, and come up with a list of 33 people who did not receive their invites because all their e-mail addresses bounced00:15
SergeyLukjanovhave 3 hours before cinema, hopefully, it'll end in 2 hours ;)00:15
mordredclarkb: my favorite is jacuba, but that's harder to get my hands on00:15
*** dims has quit IRC00:15
mordredclarkb: avua is also a really good one you can get in the US00:15
*** hashar has quit IRC00:15
clarkbI think I have had leblon and prefer novo fogo to it00:16
nibalizerfungi: we wouldn't want your beer to feel neglected00:16
SergeyLukjanovshould we update the topic?00:16
clarkbthe other two are new to me00:16
fungiquite a few of the unlucky 33 i know, at least in passing, so need to reach out to them and see if they want a resend (and would like to update their e-mail addresses in gerrit)00:16
SergeyLukjanovwith +1 another hor?00:16
anteayaclarkb: yay for being boring00:16
anteayaSergeyLukjanov: I think those following along have gotten the point00:17
fungiSergeyLukjanov: sure, update to 01:00 utc00:17
fungican't hurt00:17
SergeyLukjanov#status alert Gerrit is offline for maintenance, ETA updated to 01:00 utc00:18
openstackstatusSergeyLukjanov: sending alert00:18
mordredclarkb: there's also one that samueldmq brought me - but I drank it all and can't remember the name00:18
fungisamueldmq no doubt remembers the name00:18
anteayamordred: was it good?00:19
* Sam-I-Am realizes he missed airplane talk00:19
*** ccrouch1 has joined #openstack-infra00:19
clarkbmordred: I find this is a common problem with cachaca00:19
Sam-I-Amand beer talk00:19
anteayaSam-I-Am: we are now onto beer talk00:20
clarkbcaipirinha is basically a little lime then fill glass with cachcaca00:20
clarkbyou run out quickly00:20
anteayaoh I think beer talk is still active00:20
Sam-I-Amanteaya: i might try flying myself to the austin summit00:20
-openstackstatus- NOTICE: Gerrit is offline for maintenance, ETA updated to 01:00 utc00:20
*** ChanServ changes topic to "Gerrit is offline for maintenance, ETA updated to 01:00 utc"00:20
anteayaSam-I-Am: wooooo00:20
anteayaSam-I-Am: I want to go up with you sometime00:20
mordredclarkb: novo fogo is good ... if you can get your hands on sagatiba it's excellent00:20
Sam-I-Amend of april is potentially decent weather for that. i'll have a backup ticket on southwest if it doesnt.00:20
anteayaSam-I-Am: hey can we fly from austin to mordred's house?00:20
anteayaSam-I-Am: he has a backyard!00:21
Sam-I-Amprobably. where does mordred live?00:21
anteayaSam-I-Am: dallas00:21
jeblairi don't know his backyard is _that_ big00:21
*** ybathia has joined #openstack-infra00:21
anteayaha ha ha00:21
Sam-I-Amplenty of airports there. probably an hour or so flight from austin.00:21
Sam-I-Amjeblair: i'm installing a STOL kit00:21
Sam-I-Amland in 50 feet.00:22
mordredanteaya: you can. but you can also drive00:22
Sam-I-Amflying > driving00:22
*** ccrouch has quit IRC00:22
Sam-I-Amwell, when you're not flying commercial, that is00:22
anteaya++00:22
mordredclarkb: and http://www.mapadacachaca.com.br/wp-content/uploads/2012/08/cachaca_nega_fulo_carvalho.jpeg00:22
anteayamordred: is your backyard 50 feet?00:22
Sam-I-Amits texas. its probably 500 feet.00:22
Sam-I-Ameverything is bigger there00:23
pleia2hehe00:23
Sam-I-Amnow mordred just needs a ford F-550 lifted to 3 feet off the ground00:23
openstackstatusSergeyLukjanov: finished sending alert00:23
Sam-I-Amthats how you texas00:23
* anteaya wonders if reindexing is happening on a server in texas00:23
anteayaha ha ha00:23
fungianteaya: in fact, it IS!00:23
Sam-I-Amtexans have pride for their pride00:23
anteayafungi: that explains it00:23
clarkbmordred: I will have to see what I can get in oregon00:24
fungiour servers, including gerrit and our trove database for it, live on servers in the rackspace dallas/ft. worth datacenter00:24
clarkbmordred: I have also just finished off my novo fogo with this caipirinha00:24
anteayaoh perfect00:24
anteayathey are doing friday beer00:24
mordredclarkb: probably not nega fulo. possibly sagatiba, I think there is someone who imports it to the US00:24
Sam-I-Amnothing beats a beer on the porch00:26
*** redixin has quit IRC00:26
clarkbmordred: I hear you can buy entire shopping malls in texas and use them for other things00:26
Sam-I-Amassuming its not -20 out00:26
clarkbSam-I-Am: drinking beer your brewed yourself on the porch :)00:26
Sam-I-Amclarkb: also good00:26
Sam-I-Ami havent brewed in a while. its not easy living in a downtown condo.00:27
Sam-I-Amspace and temperature regulation00:27
clarkbI have some friends that would use the park area with the grills00:27
clarkbbecause of space issues00:27
*** rguillebert has quit IRC00:27
Sam-I-Amfermenting temps, at least00:27
mordredclarkb: yup. they're great places to install very big fans00:28
Sam-I-Ami could exchange the area my bed consumes for a chest freezer with external thermostat00:28
anteayamordred: you buy a shopping mall and install a very big fan?00:28
Sam-I-Amjust sleep in the chest00:28
clarkbI actually looked at a house that had an awesome cellar space that would have been perfect for brewing, except it had no central heat which is :(00:28
anteayamordred: is there more to this vision?00:28
clarkbI need my central heat00:28
mordredanteaya: visit the castle sometime and you'll see what I mean00:29
*** piet_ has quit IRC00:29
anteayaclarkb: good call00:29
jeblairclarkb: you have computers, right?00:29
clarkbjeblair: hahahaha00:29
Sam-I-Amclarkb: i had a place with a basement a few years ago. i could easily lager in the winter... summer was stable enough for ales00:29
anteayamordred: the castle?00:29
clarkbjeblair: I have actually downsized quite a bit, I no longer have a ps3 space heater00:29
anteayamordred: dallas has a castle?00:29
mordredanteaya: where our rax friends in san antonio call home00:29
anteayaah00:29
clarkbjeblair: I like small fanless low heat computers00:29
anteayabeen there00:29
jeblairi have shut off the heat register in the room i use as an office -- haven't had it on all winter00:29
mordredanteaya: then you should have see the very large fans00:29
*** angdraug has quit IRC00:29
pleia2jeblair: admittedly, "winter"00:30
jeblairpleia2: indeed :)00:30
anteayaoh no, sorry not in san antonio, been to rax in austin00:30
*** mtanino has quit IRC00:30
jeblairpleia2: there were those 2 weeks when it almost got down to freezing00:30
jeblairmust have been like, what, 45 or something00:30
anteayagoodness me00:30
*** Sukhdev has quit IRC00:30
anteayahow did you survive?00:30
pleia2hehe00:30
anteayaoh btw it was so lovely last night, sky was cloudless, saw all the stars00:31
jeblairanteaya: well, like half the stars, right?00:31
funginot only does san antonio have a castle, it also have a very memorable catholic mission compound00:31
anteaya-20C and my fingers were cold by the time I finished shoveling00:31
fungier, has00:31
anteayajeblair: yes half :)00:31
clarkbjeblair: we routed the home with a cellar right after it snowed so it was chilly and I basically decided I couldn't live like that00:31
clarkbrouted == toured00:32
anteayaand the snow made the lovely scrunching noise it does at -2000:32
clarkbafter half a caipirinha00:32
anteayaloved being outside last nigh00:32
anteayat00:32
smcginnisanteaya: Sounds like Minnesota. :)00:32
anteayatoo warm tonight00:32
* bswartz notices the channel topic and frowns00:32
anteayasmcginnis: indeed mn would know the pleasure I describe00:32
anteayabswartz: frowning doesn't change it00:32
jeblairbswartz: hey, be happy, i think you're the first person ever to notice it!00:32
*** |-paul-| has quit IRC00:33
* bswartz smiles00:33
mordredclarkb: wow. half a caipirinha has a different effect on you than on me00:33
anteayamuch nicer00:33
fungiif nothing else, gerrit maintenances provide an excuse to take up drinking00:33
anteayabswartz: we are discussing beer00:33
anteayaand fans00:33
smcginnisjeblair: Hah!00:33
Sam-I-Amclarkb: its been springish enough here lately to break out the apricot blonde ale00:34
Sam-I-Amfungi: s/gerrit maintenances/opensource00:34
clarkbSam-I-Am: http://www.beeradvocate.com/beer/profile/2391/42203/ that is one of my favorite beers00:35
*** gangil has quit IRC00:35
*** sdake_ has joined #openstack-infra00:35
*** tmcpeak has joined #openstack-infra00:35
*** tmcpeak has left #openstack-infra00:35
*** sdake has quit IRC00:35
*** EricGonczer_ has quit IRC00:35
Sam-I-Amclarkb: mmmm00:36
Sam-I-Amclarkb: this one is from dry dock brewing00:36
fungilooks tasty, adding to my to-do list00:36
clarkbfungi: next time you are in portland we should hit cascade00:36
fungididn't we try last time?00:36
jeblaircan the next announcement be "Gerrit is offline for maintenance, it'll be up when it's up" ?00:36
clarkbfungi: maybe?00:36
Sam-I-Amclarkb: i'm pretty much in the craft brew capitol, so its easier to walk to a brewery than make beer :/00:36
anteayajeblair: I'm for that00:37
clarkbjeblair: or Gerrit is dead long live Gerrit?00:37
fungi"Gerrit is offline for maintenance, drink up!"00:37
clarkbSam-I-Am: me too :)00:37
anteayaor happy weekend00:37
Sam-I-Amclarkb: denver?00:37
clarkbSam-I-Am: portland oregon00:37
Sam-I-Amanteaya: gerrit offline means i should stop working :)00:37
mordredit should just be "gerrit is offline" - that's the only thing we can state with certainty00:37
anteayathat's what it means00:37
Sam-I-Ammaybe gerrit should go offline from 6pm to 8am00:37
fungimordred: if you observe it, you change its state00:37
fungiso there is no certainty00:37
mordredfungi: well played00:38
anteayathere's a cat in my lap00:38
Sam-I-Amclarkb: plenty of good beer there00:38
anteayano box in sight00:38
mordredfungi: to be fair, the chances of me observing gerrit being down causing it to move to the up state are low00:38
fungialso, mad props to xkcd for ironic use of the term "local group"00:38
jeblaireven nodepool is bored00:38
Sam-I-Ammordred: is it causing gravity waves?00:38
jeblair2016-02-13 00:38:46,565 DEBUG nodepool.ProviderManager: Manager tripleo-test-cloud-rh1 ran task ListServersTask in 32.8094689846s00:39
clarkbSam-I-Am: apparently breweries per capita goes Vermont 1, Oregon 2, Colorado 300:39
jeblairokay, not completely bored00:39
*** EricGonczer_ has joined #openstack-infra00:39
Sam-I-Amclarkb: we need to try harder.00:39
mordredjeblair: that is not a good list-servers api response time00:39
mordredI tink that db needs to have a table cleaned00:39
jeblairclarkb: wow, 3 breweries per capita in co?00:39
clarkbjeblair: no no :) that is a ranking within the USA00:40
jeblairmordred: i suspect you are right.  and maybe an index?00:40
clarkbVermont is 8.6 breweries per 100k residents00:40
mordredjeblair: yup. was fixed 2 or 3 releases of openstack agao00:40
anteayatonight is the night for indexing00:40
anteayaapparently00:40
clarkbsorry thats 100k 21+ residents00:40
Sam-I-Amclarkb: riiiight00:40
clarkboregon is 7.400:40
clarkbcolorado 6.100:40
Sam-I-Ammaybe colorado just has a lot more people :)00:40
fungiso 0.0086 breweries per person?00:41
*** mriedem has joined #openstack-infra00:41
jeblairthat doesn't seem like nearly enough00:41
fungino, wait, i'm doing percents00:41
clarkbfungi: per person 21 and over00:41
mordredclarkb: how does that change if you look at burlington vs portland vs fort collins though?00:41
*** HeOS has joined #openstack-infra00:41
fungi0.000086 breweries per00:41
fungithat seems like far too few00:41
clarkbmordred: looking at https://www.brewersassociation.org/statistics/by-state/ let me see if I can get per city00:41
Sam-I-Amfort collins was awesome when i lived there. i hear it has even more breweries now.00:41
anteayait has many00:41
Sam-I-Ammordred: texas has plenty of great beers too00:41
fungihaving grown up in/near asheville, it seemed pretty high on the breweries per capita gradient00:42
mordredclarkb: there's a thrillist article00:42
*** markvoelker has joined #openstack-infra00:42
*** tzn has joined #openstack-infra00:42
mordredclarkb: it claims portland is #100:42
jeblairfungi: also on the backyard stills gradient?00:42
mordredbut I'm not sure it's ranking on per-capita counts00:42
fungijeblair: sure, depending on how far outside city limits you're willing to hike ;)00:42
clarkbmordred: portland has 91 breweries in the metro area00:43
clarkbmordred: the best part is each neighborhood has its brewery00:43
fungijeblair: keep in mind it's for medicinal purposes, of course00:43
clarkband many have several00:43
SergeyLukjanov3k CRs left00:43
SergeyLukjanovstill 98%00:43
SergeyLukjanovsuper sad00:43
anteayawooo 98%00:43
fungithe used car radiators add some unique flavor profiles00:43
*** annegentle_ has joined #openstack-infra00:43
anteayahalfway there00:43
anteayado you have a favourite radiator?00:44
Sam-I-Ama watched completion % indicator never completes00:44
calebbhey looks like the openstackclient that is packaged in apt may be broken, the pip one works for me but that one doesnt00:44
*** apoorvad has joined #openstack-infra00:44
fungitasting notes: rubbing alcohol with a hint of '57 chevy00:44
anteayaha ha ha00:44
*** ybathia has quit IRC00:44
clarkbfungi: I always find it hilarious when people show up to the brew store and buy 200lb of corn and 50lb of barley and rye. Yes that barley and rye is for your tractor I am sure :)00:44
Sam-I-Amcalebb: not surprising00:45
jeblairi'm going to be afk for about 20 mins or so -- if i'm not back in time, gate.sh and check.sh are in ~root on zuul.o.o00:45
fungitasty, tasty biodiesel?00:45
fungithanks jeblair!00:45
calebbok, just making sure it's known, doesnt really bother me since I can just use the pip stuff, but figured someone might want to know00:45
clarkbfungi: you can distill alcohol for fuel without all the crazy federal stuff, just minimal fedreal stuff00:45
Sam-I-Amcalebb: gotta be careful mixing pip with distro packages. can cause various problems.00:45
*** sridhar_ram has quit IRC00:46
clarkbfungi: but there is bsaically 0 reason to buy barley or rye for fuel purposes because it costs much more00:46
fungicalebb: which distro/release?00:46
*** dims has joined #openstack-infra00:46
Sam-I-Amcalebb: the openstackclient in cloud-archive/liberty for 14.04 mostly works, but not sure what your particular problem is00:46
*** tzn has quit IRC00:46
*** markvoelker has quit IRC00:46
calebbfungi: openstack 0.3.000:47
calebbon ubuntu 14.0400:47
*** kzaitsev_mb has quit IRC00:47
Sam-I-Amoh deat00:47
Sam-I-Amdear00:47
fungicalebb: neat! that's ancient00:47
Sam-I-Amcloud-archive/liberty is 1.7.000:48
Sam-I-Amso that must be the icehouse version?00:48
fungiat least in openstack history terms, 0.3.0 is 2 years old00:48
fungihttps://git.openstack.org/cgit/openstack/python-openstackclient/refs/tags00:48
calebbwelp00:48
Sam-I-Amyeah that makes sense now00:48
*** piet has joined #openstack-infra00:48
fungiso, basically the one that was current when ubuntu 14.04 was frozen00:48
Sam-I-Am14.04 released with icehouse00:48
Sam-I-Amunless you use cloud-archive, thats what you get00:48
calebbok that makes sense00:48
* Sam-I-Am ponders what osc 0.3.0 was like00:49
Sam-I-Amand now i need another beer00:49
fungii didn't think it _actually_ existed back then00:49
Sam-I-Amme neither! lol00:49
* calebb removes and just runs it out of a virtualenv00:49
Sam-I-Amit maybe supported one command?00:49
crinkle0.3.0 was right before 1.0.0 so it wasn't that bad00:49
fungifor all intents and purposes, it wasn't 1.0 until 14 months ago00:49
clarkband I only just started using it in the last week >_>00:49
*** ddieterly has joined #openstack-infra00:49
fungithere were 3 subsequent releases between 0.3.0 and 1.0.000:50
Sam-I-Amaight, i need to head out. time to locate edible objects.00:50
fungi(0.3.1, 0.4.0, 0.4.1)00:50
anteayaSam-I-Am: good hunting00:50
*** ybathia has joined #openstack-infra00:50
Sam-I-Amsee y'all later00:50
anteayanight00:50
anteayaI got a copy of Ender's Game the movie the other day, not bad00:51
smcginnisanteaya: That was my daughter's favorite for awhile.00:52
mordredwell, 0.3.0 is pre-os-client-config00:52
smcginnisanteaya: I must have seen it a dozen times.00:52
mordredso that's sad making00:52
*** yamamoto_ has quit IRC00:52
anteayasmcginnis: nice, it has some good moments00:53
*** dims has quit IRC00:53
anteayaI liked the training room scenes00:53
smcginnisanteaya: Yeah, not bad. Entertaining. :)00:53
*** ybathia has quit IRC00:53
anteayaI thought they did a fairly good job00:53
* anteaya admires the moon00:54
anteayaso beautiful tonight00:54
*** DericHorn-HP has joined #openstack-infra00:55
*** davideagnello has quit IRC00:55
*** DericHorn-HP has quit IRC00:55
*** rfolco has quit IRC00:56
*** DericHorn-HP has joined #openstack-infra00:56
*** yamamoto_ has joined #openstack-infra00:57
*** ajmiller has quit IRC00:57
*** amrith is now known as _amrith_00:58
mordredso - just so you're all clear on this ...00:58
mordredwhen you decide, in the Dallas area, "tonight I'd like to go eat some Tex-Mex"00:58
mordredit's not exactly the easiest task to select the place to go00:59
asselinclarkb, you around? full bandersnatch sync finished and left a 'todo' file, Rerunning it says "2016-02-13 00:54:14,400 INFO: 702 packages to sync.00:59
asselin" Trying again says the same thing. any ideas?00:59
fungido they call it "tex-mex" there? seems redundant00:59
clarkbyou cna't walk around the corner and go to your neighbors tex mex restaurant?00:59
mordredclarkb: I can00:59
clarkbasselin: sorry no I don't know00:59
mordredclarkb: but if I always did that I'd miss the cornucopia of options out there00:59
clarkbmordred: because tat is what I do except instead of around the corner it is a 10 minute walk00:59
fungii assumed in texas they just called that "food"00:59
clarkbthere is a tacqueria behind a grocery store that greghaynes approves of that is about a 40 minute wak01:00
mordredfungi: nah - gotta distinguish from bbq and tacquerias01:00
mordredthere are three types of food here01:00
fungioh, great point01:00
mordredclarkb: there is a tacqueria in a gas station at the edge of my neighborhood01:01
greghaynesmordred: does cachos exist up there?01:01
*** DericHorn-HP has joined #openstack-infra01:01
clarkbooh get this 20% of beer sold in oregon is craft beer made in oregon01:01
fungimordred: the sign says "eat here, get gas"01:01
clarkbthe first state to hit that milestone01:01
mordredgreghaynes: I do not know this cachos you speak of01:01
mordredclarkb: nice!01:01
greghaynes24hr solidly decent texmex that I always get in Houston01:01
mordredgreghaynes: AH. nope, I do not believe we have that here01:02
greghaynesIt's good just got off the plane food01:02
mordredif I want 24 hour texmex I usually go to taco cabana01:02
clarkbthats actually pretty amazing if you think about that01:02
* anteaya is waiting to hear the 3 types of food01:02
clarkb1 in 5 beers purchases here were made here by craft brewers01:02
greghaynesmordred: hahah, I have so many taco c stories from growing up down there01:02
mordredanteaya: texmex, bbq and tacquerias01:02
anteayamordred: ah thank you01:02
mordredoh. crappit01:02
mordredfungi: I'm wrong. there's four01:02
fungimordred: whaddya mean booze ain't food?01:02
clarkbthat is competing against anneuhser, coors, miller and crafter from everywhere else01:02
mordredanteaya: I also apologize01:02
anteayathank you01:02
mordredfungi, anteaya: texmex, bbq, tacquerias ... and STEAK01:03
anteayaah okay that makes sense now01:03
mordredyah. I mean01:03
mordredwow01:03
nibalizerstill indexing?01:03
clarkbnibalizer: si01:03
anteayamy might be evicted for a mistake like that01:03
funginibalizer: either than or SergeyLukjanov finally went to the cinema01:03
anteayaif you made it a second time01:03
nibalizerpoint being, more alerts?01:03
SergeyLukjanov99% -- less than 2k left01:04
clarkbnibalizer: only if you say something like "gerrit still indexing will be done hwen it is done. We recommend tacos and beer in the meantime"01:04
SergeyLukjanovclarkb ++01:04
nibalizerheh01:04
anteayaleave the spelling mistake in01:04
clarkbI am trying to think of the last time I bought beer that wasn't brewed here01:04
clarkbI cna't remember01:04
clarkbit has been so long01:04
greghaynesclarkb: way to portland01:05
clarkbgreghaynes: ddi you see what I said? 20% of beer bought here is brewed here01:05
clarkband I am clearly part of the problem01:05
mordredanteaya: oh! I should tell you about this farm01:05
greghaynesclarkb: That doesn't even count the beer we brew01:06
clarkbgreghaynes: exactly01:06
SergeyLukjanovReindexing changes: projects: 100% (910/910), 99% (275810/277491), done01:06
mordredanteaya: there's a northern suburb of dallas called Plano - it's currently mostly known for being a sea of mini-mansions and planned communities01:06
SergeyLukjanovReindexed 275810 changes in 9864.1s (28.0/s)01:06
SergeyLukjanovreal164m33.273s01:06
SergeyLukjanovuser272m30.175s01:06
SergeyLukjanovsys27m29.520s01:06
SergeyLukjanovyay!01:06
fungiclarkb: mexico?01:06
clarkbwoot01:06
mordredSergeyLukjanov: WOOT!01:06
clarkbfungi: does that count? I didn't buy the pacifico in oregon :)01:06
mordredanteaya: but many years ago it did not used to be a suburb with tons of mini-mansions - it used to be farms and stuff01:06
anteayamordred: awesome01:06
pleia2SergeyLukjanov: yay!01:06
fungiclarkb: well, you didn't specify where you were when you bought beer01:07
*** DericHorn-HP has quit IRC01:07
anteayamordred: yup, the farms I would have liked01:07
mordredanteaya: in any case, there's this one farm that decided, as the construction happened all around, to just not sell or leave01:07
fungiso anyway, time to proceed with turning things back on, starting with gerrit?01:07
clarkbfungi: well the stat is specifically people buying beer in oregon01:07
*** Sukhdev has joined #openstack-infra01:07
pleia2yep, shall I start gerrit now?01:07
clarkbfungi: yes lets do it01:07
anteayafungi: I thought zuul comes online first01:07
mordredanteaya: so in the middle of the sprawl, there is a long-lived family farm01:07
SergeyLukjanovpleia2 yup01:07
anteayamordred: wow, good for them01:07
mordredanteaya: that is the local go-to place to get your raw milk and other things such as that01:07
pleia2gerrit is running01:07
anteayamordred: I want to go there01:08
anteayamordred: do they have bees?01:08
pleia2who's on zuul?01:08
*** bgmccollum has joined #openstack-infra01:08
mordredanteaya: http://www.luckylayla.com/01:08
clarkbjeblair said the files are there waiting01:08
SergeyLukjanovI'll do zuul01:08
clarkbSergeyLukjanov: kk01:08
*** gyee has quit IRC01:08
SergeyLukjanovreview.o.o seems to be working01:08
fungilet's remember, when we get to the starting zuul again step, to make sure we _don't_ reenqueue any changes until we've confirmed that most/all of our node types are represented registered in gearman again01:08
pleia2renaming gerrit groups01:09
anteayamordred: yum01:09
clarkbfungi: good point01:09
fungiotherwise it's a carnage of NOT_REGISTERED results all over the joint01:09
anteayaSergeyLukjanov: did you get that?01:09
anteayaSergeyLukjanov: fungi's point on zuul?01:09
jeblairback01:09
SergeyLukjanovanteaya I hope so01:10
SergeyLukjanovI've just started zuul01:10
SergeyLukjanovnot yet started gate.sh / check.sh01:10
anteayaawesome01:10
SergeyLukjanovwaiting for zuul alive01:10
clarkbwe can check nodepool01:10
SergeyLukjanovjeblair do you want to continue from this point?01:10
jeblairnope i'll watch01:11
fungicheck the gearman status to make sure rarer node types like bare-precise and devstack-centos7 are showing up with at least one worker01:11
SergeyLukjanovokay01:11
clarkbI think we are good01:11
jeblairclarkb: i told nodepool to reset while we were down, so we should have all types built -- just a matter of making sure they are registered as fungi says01:11
clarkbbare-preicse and fedora-23 and devstack-centos7 are all in nodepool at least01:11
clarkbah ok01:11
fungiit's more of an issue when we also restart nodepool at the same time01:11
fungisince it can take a lot longer in those cases01:12
SergeyLukjanovseems we're ok for starting gate/check .sh01:12
SergeyLukjanovcorrect?01:12
fungiyeah, gate first obviously01:12
clarkbhrm maybe I should plan to do my nodepool restart tomorrow01:12
fungithat gives nodepool a chance to start ramping up before we slam it with the check changes01:12
openstackgerritClark Boylan proposed openstack-infra/nodepool: Dont connect to gearman in cmd unless needed  https://review.openstack.org/27982901:13
clarkbjeblair: ^01:13
anteayashould we get our rename patches in the gate01:13
jeblair(though, we should have restarted nodepool to clear its jobs out of the gearman queue)01:13
anteayafirst?01:13
anteayathen reenqueue the gate?01:13
*** ddieterly has quit IRC01:13
clarkbanteaya: either way depending on how quickly we want ot restart puppet01:13
*** ccrouch1 has quit IRC01:13
fungioh, now that nodepool gearmans we need to add a step for that to the rename maintenance process i guess01:14
jeblairfungi: well, ideally, we'll fix the bugs that are orphaning the jobs01:14
*** salv-orlando has joined #openstack-infra01:14
anteayaclarkb: okay thanks01:14
fungiahh, these aren't a permanent problem then. i missed this was related to the gearman job leak in nodepool01:14
jeblairfungi: right, only reason to restart it atm is because we have 900 nodepool jobs that will never be run01:14
jeblairfungi: this distorts the zuul job queue graph so that it's currently meaningless01:15
jeblairwhich is unfortunate, since it's my primary measure of system capacity01:15
*** ddieterly has joined #openstack-infra01:15
*** achanda has joined #openstack-infra01:15
fungiso we should restart nodepool with zuul offline to clean that up, or restarting nodepool while zuul is online should also be fine?01:15
jeblairoh, but of course, geard restarted too, so they're gone01:16
jeblairso nevermind01:16
SergeyLukjanovcheck.sh is running now01:16
SergeyLukjanovrenaming changes approved01:16
SergeyLukjanovonly enable puppet left and ,gitreview CRs01:17
*** _nadya_ has joined #openstack-infra01:17
SergeyLukjanovI can do both later today to not keep all of you folks awake for a few more hours01:17
clarkbjeblair: where do those come from?01:17
clarkbnodepool has been decently solid recentlty01:17
clarkbwith gearman jobs01:18
jeblairclarkb: i dunno; we can check in a couple days i guess01:18
jeblairclarkb: last i looked the red line did not hit 0 when the nodes graph wasn't maxed out, but maybe it's better now?01:19
jeblairthe graph on the status page looks like it might be okay now, so maybe is fixed01:19
jeblairi'll check status early next week01:20
clarkbkk01:20
anteayaso when can we clear the topic?01:21
*** _nadya_ has quit IRC01:21
* slogan621 can see his review now in gerrit code review, so things must be progressing01:21
jeblairnow i think01:21
*** salv-orlando has quit IRC01:21
fungishould be safe to #status ok now that changes are reenqueuing01:21
anteayaSergeyLukjanov: care to do the honours?01:22
SergeyLukjanov#status ok01:22
openstackstatusSergeyLukjanov: sending ok01:22
*** apoorvad has quit IRC01:22
*** shashank_hegde has quit IRC01:22
fungiand somehow i doubt we'll forget that we really, really, REALLY want to use the online reindexing next maintenance01:22
SergeyLukjanovanteaya, sorry, didn't get it01:22
jeblairSergeyLukjanov: for future reference (don't do this now), you can do "#status ok Gerrit is back up" and it will do a channel notice of that01:22
SergeyLukjanovjeblair ack01:22
EmilienMthank you guys!01:23
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/"01:23
* slogan621 sends thanks too01:23
SergeyLukjanovcheck is still re-enqueueing01:23
jeblairnodepool is busy01:23
anteayaSergeyLukjanov: you got it, thank you01:23
*** DericHorn-HP has joined #openstack-infra01:23
SergeyLukjanovwhen check.sh will be finished, I'll run away to avoid wife killing me, will check in a few hours for the merged renaming jobs and enable back the puppetmaster cron01:24
SergeyLukjanovanteaya jeblair fungi ^^01:24
openstackstatusSergeyLukjanov: finished sending ok01:24
*** piet has quit IRC01:24
jeblairSergeyLukjanov: thanks, enjoy your evening!  (and if one of us re-enables it first, we'll let you know with a ping in irc)01:25
SergeyLukjanovthx!01:25
jeblairthe mergers look happy01:25
anteayaSergeyLukjanov: thank you for all your help01:25
anteayaSergeyLukjanov: have a good evening and say hello to DinaBelova01:25
SergeyLukjanovyeah, seems like we'll have them merged in a few mins01:25
jeblairthey will be just a little sluggish at first as they re-clone all the repos, but we have 8 of them so01:25
SergeyLukjanovanteaya thx!01:26
anteayanice to work with you again01:26
DinaBelovaanteaya :) thanks :)01:26
anteayaDinaBelova: hey there01:26
DinaBelova:D01:26
anteayaSergeyLukjanov: is telling stories about you01:26
SergeyLukjanovanteaya me too ;)01:26
anteaya:)01:26
DinaBelovaahaha :D01:26
jeblairDinaBelova: sorry we kept him late :)01:26
*** Sukhdev has quit IRC01:26
DinaBelovajeblair np :D01:26
fungiSergeyLukjanov: yes, please get back to your evening!01:26
anteayaDinaBelova: you are off to see a movie?01:26
fungiSergeyLukjanov: DinaBelova: sorry for the unexpected lengthy maintenance!01:26
DinaBelovaanteaya we're still going to :D it looks like we have a chance :)01:27
anteayaDinaBelova: SergeyLukjanov go go go01:27
openstackgerritMerged openstack-infra/project-config: rename ceilometer-specs to telemetry-specs  https://review.openstack.org/24889701:27
*** sdake_ is now known as sdake01:27
jeblairwhen this system is fast, it's fast ^01:28
*** yamamoto_ has quit IRC01:28
fungiindeed01:29
openstackgerritMerged openstack-infra/project-config: Rename sahara-scenario -> sahara-tests  https://review.openstack.org/26981501:29
openstackgerritMerged openstack-infra/project-config: Rename fuel-plugin-astra to fuel-plugin-astara  https://review.openstack.org/27913801:29
jeblairwell, how about i re-enable puppet?01:30
mordred++01:30
fungithat should be perfectly safe now that those have merged01:30
jeblairSergeyLukjanov, infra-root: i have re-enabled puppet on puppetmaster01:31
jeblairand i cleverly did it just 1 minute past the cron schedule01:31
SergeyLukjanovcheck.sh finished successfully01:31
jeblairso 1:45 should be the next run01:31
SergeyLukjanovI'm dissappearing ;)01:31
jeblairSergeyLukjanov: i thought you were gone!  bye :)01:31
SergeyLukjanovhave a good weekend folks, extended weekend :)01:31
*** tphummel has quit IRC01:32
jeblairyou too01:32
*** madhu_ak has quit IRC01:32
jeblairanteaya: is https://review.openstack.org/279257 ready?  you want to unwip and recheck it?01:33
*** bpokorny_ has joined #openstack-infra01:33
*** tiswanso has quit IRC01:34
*** bpokorny_ has quit IRC01:35
*** pvaneck has quit IRC01:35
*** markvoelker has joined #openstack-infra01:37
asselinany ideas what would cause bandersnatch to hit a url that doesn't exist? http://paste.openstack.org/show/486904/01:37
*** bpokorny has quit IRC01:37
nibalizercool01:42
fungiasselin: what's more likely is that there's a stale negative cache in fastly it's tripping over01:42
*** mriedem has quit IRC01:42
clarkbasselin: mayb that project deleted that file01:42
asselinbandersnatch can't handle it?01:43
clarkbwell it steps through the things01:43
clarkbso first it wiould be sdist added01:43
clarkb40401:43
clarkbthen sdist removed : noop01:43
*** mriedem has joined #openstack-infra01:44
jeblairi issued PURGE requests on the index, but they're still showing up01:44
jeblairasselin: so you probably need dstufft to look into it01:45
asselinthere's a few others too that are failing for similar reasons01:45
asselin2016-02-13 01:45:44,826 DEBUG: Getting https://pypi.python.org/packages/3.4/c/cvsslib/cvsslib-0.5.1-py3-none-any.whl (serial None)01:46
asselin2016-02-13 01:45:44,878 ERROR: Error syncing package: cvsslib@184310801:46
*** tiswanso has joined #openstack-infra01:46
jeblairclarkb: are there some new-provider changes i can review before i head out?01:47
*** openstackgerrit has quit IRC01:47
*** openstackgerrit has joined #openstack-infra01:47
*** nikhil_k has joined #openstack-infra01:48
*** baoli has joined #openstack-infra01:50
*** DericHorn-HP has quit IRC01:50
*** nikhil has quit IRC01:51
*** EricGonczer_ has quit IRC01:51
anteayajeblair: unwiped, rechecked on 27925701:52
clarkbjeblair: no cleaning up after fires and gerrit restart were distractions01:52
jeblairok01:53
clarkbjeblair: crinkle and nibalizer are working on making the ssl stuff for infra cloud match up what was discussed yesterday01:53
clarkbthen those changes can go in and any osic changes can follow01:53
jeblairclarkb: should we just put osic in?01:53
jeblairi mean, honestly, they should hardly even conflict01:53
jeblairi'm not sure we really need to wait -- that was when i thought we were going to merge them within 5 minutes of each other :)01:53
clarkbjeblair: maybe? I am currently semi busy with house purchasing paperwork, but the details are in the passwords file if you are interested in pushing them01:53
clarkbotherwise I may find time tomorro01:54
clarkbw01:54
anteayaclarkb: you have another house?01:54
clarkbanteaya: no, but I have to restart the loan process so bank needs new forms signed01:54
anteayaclarkb: ah01:54
anteayathought once you were approved for a mortgage you had that until you got a house01:54
anteayamaybe that is just up here01:54
clarkbanteaya: my experience is that each application is per property as that property acts as collateral and all that01:55
*** roxanaghe has quit IRC01:55
clarkbso right now it it is pre work to speed process should we find a property01:55
anteayayup01:55
anteayamakes sense01:55
clarkb(pre approval and all that jazz also last years tax docs just came out so they want those)01:55
anteayasigh01:55
clarkbanteaya: the way the market is here if you don't have preapproval as soon as you find something you want there is a good chance it will be gone by the time you do01:57
clarkbso this is all about duck lining01:57
anteayayup01:57
anteayawas like that in toronto when we sold my grandmother's house01:57
anteayaeveryone showed up with paperwork and a house inspector01:58
anteayaand the three bidders had to outdo each other01:58
anteayawhen her church, saint james bond united had its final service01:59
anteayawe took her past the house01:59
anteayathey had knocked it down01:59
anteaya:)01:59
anteaya:(01:59
anteayaI had to make an excuse that we would be late for service01:59
anteayawhich is why we never stopped01:59
anteayaI couldn't show here where her house used to be01:59
anteaya:(01:59
*** annegentle_ has quit IRC02:01
*** baoli has quit IRC02:01
clarkbya its a thing02:01
clarkbespecially if you have a large lot, you can split them several ways often02:02
asselinfungi, jeblair clarkb fyi I deleted those packages that error out from the 'todo' file and now its caught up. (Except for those pacakges of course)02:02
anteayaclarkb: :(02:02
*** wolsen has quit IRC02:03
*** sridhar_ram has joined #openstack-infra02:03
*** baoli has joined #openstack-infra02:04
*** wolsen has joined #openstack-infra02:04
slogan621clarkb: should I ping you later, add you to the review so you can stay updated if there are changes?02:05
slogan621I'm about to bail.02:05
clarkbslogan621: I havne't reviewed it because I won't be around to fix it if the creation fails02:05
clarkbslogan621: maybe ping me tomorrow and I can do it then?02:05
jeblairasselin: that won't work in the long run02:05
slogan621sure, but it's the weekend, we can wait until next week02:05
slogan621sound good?02:06
*** yamamoto_ has joined #openstack-infra02:06
clarkbslogan621: yup02:06
* slogan621 wonders how a new project that no-op'd everything and has no jenkins jobs could possibly fail :-P02:06
asselinjeblair, I know...but will help get stuff working again and minimize weekend issues. I follow-up with  dstufft next week.02:07
slogan621please don't tell me :-O02:07
* slogan621 waves bye02:07
*** slogan621 is now known as slogan621-away02:07
*** dimtruck is now known as zz_dimtruck02:07
*** zz_dimtruck is now known as dimtruck02:12
*** achanda has quit IRC02:14
*** xyang1 has quit IRC02:15
*** annegentle_ has joined #openstack-infra02:19
*** slogan621-away has quit IRC02:21
*** yamamoto_ has quit IRC02:21
*** baoli has quit IRC02:22
*** tphummel has joined #openstack-infra02:22
*** yamamoto_ has joined #openstack-infra02:22
*** yamamoto_ has quit IRC02:22
*** yamamoto_ has joined #openstack-infra02:22
*** annegentle_ has quit IRC02:23
*** cfarquhar has quit IRC02:24
anteayajeblair: the requirements change failed the grenade test: https://jenkins06.openstack.org/job/gate-grenade-dsvm/26287/console02:24
anteayalooks like a volume delete error02:27
anteayaI'm getting tired02:30
anteayaI'd like to stay and solve this but my eyes are getting heavy02:31
clarkbI think that volume test thing is a known issue02:31
anteayawhich bug is that?02:31
*** thorst has joined #openstack-infra02:31
anteayaI'm looking at the elastic-recheck page02:31
clarkbI don't remember but one of my changes hit it and dims and others seemd to know about it02:32
anteayaoh so recheck?02:32
clarkbya02:32
anteayaokay thanks02:32
*** thorst has quit IRC02:33
*** thorst has joined #openstack-infra02:33
anteayahey Registered Users has disappeared in the groups list02:34
anteayafrom02:34
fungithat's what we were hoping02:34
anteayathis page still needs a refresh of some sort: https://review.openstack.org/#/admin/projects/openstack-dev/sandbox,access02:34
*** dimtruck is now known as zz_dimtruck02:35
anteayaas the group disappeared but sandbox still lists the group with a link as its group of preference02:35
clarkbanteaya: can you +2 on sandbox?02:35
anteayano02:36
anteayahttps://review.openstack.org/#/c/279763/02:36
anteayajust -1 +102:36
anteaya:(02:36
fungigrr, that's why i suspected we needed to clean up the groups files on all the affected repos02:36
fungizaro: ^02:36
anteayaso we got rid of the group but not the effect02:36
anteaya:(02:36
fungizaro: you said you tested that?02:36
clarkboh right the map will be wrong02:37
anteayawe sure had the time02:37
fungiwell, i asked explicitly if it would be needed, and he assured me that gerrit ignores any group in a groups file for which the uuid is not present in the db02:37
anteayaI remember that exchange02:37
fungiso maybe this is some other issue?02:37
anteayaperhaps?02:37
anteayaI only know I'm tired and I fly out tomorrow02:38
fungianteaya: get some rest and have a safe flight02:38
anteayathanks02:38
anteayamy requirements change still needs to be merged02:38
anteayait is in check again, keeps failing tests02:39
anteayacan you help it through?02:39
anteayaI think that is the last thing I needed to do02:39
anteayahttps://review.openstack.org/#/c/279257/02:40
anteayasorry I can't stay until its done02:41
anteayag'night02:41
anteayaand thank you02:41
*** mriedem has quit IRC02:41
*** thorst has quit IRC02:41
*** sdake has quit IRC02:43
* Sam-I-Am returns02:44
*** achanda has joined #openstack-infra02:45
*** salv-orlando has joined #openstack-infra02:46
*** dims has joined #openstack-infra02:46
*** dims has quit IRC02:50
*** chlong has joined #openstack-infra02:51
*** nikhil has joined #openstack-infra02:52
*** salv-orlando has quit IRC02:54
*** nikhil_k has quit IRC02:55
*** ggillies has quit IRC02:55
*** sridhar_ram has quit IRC02:56
*** yamamoto_ has quit IRC02:56
*** woodster_ has quit IRC02:56
*** ggillies has joined #openstack-infra02:57
*** [1]Thelo has joined #openstack-infra02:59
*** arxcruz has quit IRC02:59
*** Daisy has joined #openstack-infra03:00
*** Thelo has quit IRC03:01
*** [1]Thelo is now known as Thelo03:01
*** zul__ has quit IRC03:03
*** zul has joined #openstack-infra03:03
*** sdake has joined #openstack-infra03:08
*** esikachev has joined #openstack-infra03:08
*** Daisy has quit IRC03:08
*** Daisy has joined #openstack-infra03:09
*** piet_ has joined #openstack-infra03:10
*** HenryG has quit IRC03:12
*** HenryG has joined #openstack-infra03:13
*** esikachev has quit IRC03:13
*** cfarquhar has joined #openstack-infra03:14
*** cfarquhar has quit IRC03:14
*** cfarquhar has joined #openstack-infra03:14
*** cfarquhar has quit IRC03:14
*** yamahata has quit IRC03:15
*** ddieterly has quit IRC03:15
*** _nadya_ has joined #openstack-infra03:17
*** thorst has joined #openstack-infra03:19
*** tphummel has quit IRC03:19
*** thorst has quit IRC03:19
*** annegentle_ has joined #openstack-infra03:19
*** thorst has joined #openstack-infra03:20
*** zeih has joined #openstack-infra03:21
*** cfarquhar has joined #openstack-infra03:21
*** cfarquhar has quit IRC03:21
*** cfarquhar has joined #openstack-infra03:21
*** achanda has quit IRC03:21
*** _nadya_ has quit IRC03:22
*** achanda has joined #openstack-infra03:22
*** baoli has joined #openstack-infra03:25
*** cfarquhar has quit IRC03:25
*** zeih has quit IRC03:26
*** rfolco has joined #openstack-infra03:28
*** thorst has quit IRC03:29
*** baoli has quit IRC03:30
*** shashank_hegde has joined #openstack-infra03:31
*** amotoki has quit IRC03:37
*** sdake has quit IRC03:37
*** markvoelker has quit IRC03:41
*** achanda has quit IRC03:48
openstackgerritAnne Gentle proposed openstack-infra/infra-specs: Adds specification for serving REST API info on developer.openstack.org  https://review.openstack.org/27648403:49
*** baoli has joined #openstack-infra03:49
*** FallenPegasus has joined #openstack-infra03:51
*** chlong has quit IRC03:54
*** yamamoto has joined #openstack-infra03:56
*** rfolco has quit IRC04:01
*** piet_ has quit IRC04:02
*** salv-orlando has joined #openstack-infra04:03
*** yamamoto has quit IRC04:04
*** roxanaghe has joined #openstack-infra04:05
*** baoli has quit IRC04:07
*** piet has joined #openstack-infra04:10
*** roxanaghe has quit IRC04:10
*** shashank_hegde has quit IRC04:11
*** salv-orlando has quit IRC04:13
*** sambetts|afk has quit IRC04:15
*** ddieterly has joined #openstack-infra04:16
*** sambetts has joined #openstack-infra04:16
*** salv-orlando has joined #openstack-infra04:17
*** tzn has joined #openstack-infra04:18
*** Daisy has quit IRC04:21
*** ddieterly has quit IRC04:22
*** salv-orlando has quit IRC04:22
*** tzn has quit IRC04:22
*** annegentle_ has quit IRC04:23
*** tiswanso has quit IRC04:23
*** dkehn has quit IRC04:25
*** thorst has joined #openstack-infra04:26
*** dkehn has joined #openstack-infra04:27
*** sdake has joined #openstack-infra04:30
*** nikhil has quit IRC04:32
*** thorst has quit IRC04:33
*** nikhil has joined #openstack-infra04:33
*** sdake_ has joined #openstack-infra04:34
*** piet has quit IRC04:35
*** sdake has quit IRC04:35
*** markvoelker has joined #openstack-infra04:41
*** achanda has joined #openstack-infra04:44
*** markvoelker has quit IRC04:46
*** esikachev has joined #openstack-infra04:48
*** Daisy has joined #openstack-infra05:09
*** Daisy has quit IRC05:14
lifelesssigmavirus24_awa: ack; opened will look on monday05:17
lifelessansiwen: pbr builds source distributions, so yes, everything in git should be copied05:18
*** ddieterly has joined #openstack-infra05:18
*** _nadya_ has joined #openstack-infra05:18
*** |-paul-| has joined #openstack-infra05:20
*** yamahata has joined #openstack-infra05:21
*** harlowja_at_home has quit IRC05:21
*** salv-orlando has joined #openstack-infra05:21
*** piet has joined #openstack-infra05:22
*** zeih has joined #openstack-infra05:22
*** armax has quit IRC05:22
*** ddieterly has quit IRC05:22
*** _nadya_ has quit IRC05:23
*** zeih has quit IRC05:26
zarofungi: i thought i did test it.  take a look at my comment in https://review.openstack.org/#/c/270537/05:27
*** ganso has quit IRC05:29
openstackgerritMerged openstack/requirements: Change project name from sahara-scenario to sahara-tests  https://review.openstack.org/27925705:30
*** _nadya_ has joined #openstack-infra05:30
*** salv-orlando has quit IRC05:31
*** thorst has joined #openstack-infra05:31
*** sdake_ has quit IRC05:32
*** thorst has quit IRC05:38
*** shashank_hegde has joined #openstack-infra05:38
*** piet has quit IRC05:41
*** piet has joined #openstack-infra05:52
*** bpokorny has joined #openstack-infra05:53
*** vgridnev has joined #openstack-infra05:53
*** piet has quit IRC06:07
*** daemontool has joined #openstack-infra06:13
*** esikachev has quit IRC06:18
*** ddieterly has joined #openstack-infra06:19
*** esikachev has joined #openstack-infra06:20
*** ddieterly has quit IRC06:23
*** hdd has quit IRC06:28
*** bpokorny has quit IRC06:30
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/27973506:32
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/27974406:33
*** thorst has joined #openstack-infra06:37
*** ildikov has quit IRC06:42
*** markvoelker has joined #openstack-infra06:43
*** thorst has quit IRC06:44
*** markvoelker has quit IRC06:47
*** _nadya_ has quit IRC06:52
*** piet has joined #openstack-infra06:57
*** piet has quit IRC07:12
*** ddieterly has joined #openstack-infra07:19
*** zeih has joined #openstack-infra07:22
*** ddieterly has quit IRC07:25
*** zeih has quit IRC07:27
*** esikachev has quit IRC07:30
*** piet has joined #openstack-infra07:30
*** mrmartin has joined #openstack-infra07:32
*** harlowja_at_home has joined #openstack-infra07:33
*** vgridnev has quit IRC07:35
*** tobiash_ has joined #openstack-infra07:36
*** tobiash has quit IRC07:36
*** wolverin_ has joined #openstack-infra07:40
*** thorst has joined #openstack-infra07:40
*** esikachev has joined #openstack-infra07:43
*** wolveri__ has joined #openstack-infra07:44
*** wolverin_ has quit IRC07:45
*** wolverineav has quit IRC07:45
*** piet has quit IRC07:45
*** kzaitsev_mb has joined #openstack-infra07:45
*** thorst has quit IRC07:48
*** wolveri__ has quit IRC07:49
*** achanda has quit IRC07:56
*** wolverineav has joined #openstack-infra07:58
*** kzaitsev_mb has quit IRC07:58
*** wolverineav has quit IRC08:02
*** mrmartin has quit IRC08:07
*** salv-orlando has joined #openstack-infra08:09
*** wolverineav has joined #openstack-infra08:13
*** hockeynut_afk has joined #openstack-infra08:14
*** betherly_ has joined #openstack-infra08:14
*** jlk` has joined #openstack-infra08:14
*** markusz has joined #openstack-infra08:14
*** markus_z has quit IRC08:15
*** hockeynut has quit IRC08:15
*** betherly has quit IRC08:15
*** jlk has quit IRC08:15
*** pedroalvarez has quit IRC08:15
*** HenryG has quit IRC08:15
*** andymaier has quit IRC08:15
*** betherly_ is now known as betherly08:16
*** pedroalvarez has joined #openstack-infra08:17
*** andymaier has joined #openstack-infra08:17
*** HenryG has joined #openstack-infra08:17
*** Jeffrey4l has joined #openstack-infra08:17
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/27974408:18
*** wolverineav has quit IRC08:19
*** mrmartin has joined #openstack-infra08:20
*** wolverineav has joined #openstack-infra08:20
*** ddieterly has joined #openstack-infra08:20
*** zhurong has joined #openstack-infra08:21
*** zhurong has quit IRC08:22
*** shashank_hegde has quit IRC08:24
*** ddieterly has quit IRC08:25
*** achanda has joined #openstack-infra08:25
*** mrmartin has quit IRC08:27
*** e0ne has joined #openstack-infra08:33
*** esikache1 has joined #openstack-infra08:33
*** esikachev has quit IRC08:34
*** mrmartin has joined #openstack-infra08:38
*** e0ne has quit IRC08:41
*** mrmartin has quit IRC08:42
*** markvoelker has joined #openstack-infra08:44
*** mrmartin has joined #openstack-infra08:46
*** |-paul-| has quit IRC08:46
*** zhurong has joined #openstack-infra08:46
*** achanda has quit IRC08:47
*** markvoelker has quit IRC08:48
*** thorst has joined #openstack-infra08:48
*** achanda has joined #openstack-infra08:49
*** esikache1 has quit IRC08:50
*** mrmartin has quit IRC08:50
*** thorst has quit IRC08:54
*** zhurong has quit IRC08:56
*** salv-orlando has quit IRC08:56
*** zeih has joined #openstack-infra08:57
*** infra-red has joined #openstack-infra08:59
*** zeih has quit IRC09:01
*** achanda has quit IRC09:04
*** infra-red has quit IRC09:05
*** kzaitsev_mb has joined #openstack-infra09:06
*** mikelk has joined #openstack-infra09:16
*** harlowja_at_home has quit IRC09:16
*** ddieterly has joined #openstack-infra09:21
*** ddieterly has quit IRC09:25
*** mrmartin has joined #openstack-infra09:26
*** mrmartin has quit IRC09:26
*** mikelk has quit IRC09:28
*** yamamoto has joined #openstack-infra09:30
*** infra-red has joined #openstack-infra09:30
*** mikelk has joined #openstack-infra09:31
*** infra-re_ has joined #openstack-infra09:32
*** infra-red has quit IRC09:35
*** yamamoto has quit IRC09:37
*** yamahata has quit IRC09:37
*** yamamoto has joined #openstack-infra09:43
*** yamamoto has quit IRC09:46
*** rguillebert has joined #openstack-infra09:51
*** thorst has joined #openstack-infra09:52
*** daemontool has quit IRC09:54
*** max_lobur has joined #openstack-infra09:55
*** infra-re_ has quit IRC09:55
*** infra-red has joined #openstack-infra09:56
*** salv-orlando has joined #openstack-infra09:57
*** zeih has joined #openstack-infra09:57
*** infra-re_ has joined #openstack-infra09:57
*** thorst has quit IRC09:58
*** infra-red has quit IRC10:00
*** zeih has quit IRC10:02
*** infra-re_ has quit IRC10:06
*** salv-orlando has quit IRC10:08
*** mrmartin has joined #openstack-infra10:10
*** mrmartin has quit IRC10:15
*** infra-red has joined #openstack-infra10:17
*** infra-red has quit IRC10:19
*** ddieterly has joined #openstack-infra10:22
*** ddieterly has quit IRC10:26
*** esikache1 has joined #openstack-infra10:28
*** kzaitsev_mb has quit IRC10:41
*** ildikov has joined #openstack-infra10:43
*** markvoelker has joined #openstack-infra10:44
*** mrmartin has joined #openstack-infra10:46
*** yamamoto has joined #openstack-infra10:47
*** markvoelker has quit IRC10:49
*** yamamoto has quit IRC10:53
*** esikache1 has quit IRC10:54
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Add element to bring up bridge on infra cloud  https://review.openstack.org/27629210:54
*** zeih has joined #openstack-infra10:56
*** thorst has joined #openstack-infra10:56
*** wolverineav has quit IRC10:58
*** thorst has quit IRC11:03
*** clayton has quit IRC11:03
*** clayton has joined #openstack-infra11:04
*** mrmartin has quit IRC11:10
*** salv-orlando has joined #openstack-infra11:15
*** ddieterly has joined #openstack-infra11:22
*** salv-orlando has quit IRC11:25
*** ddieterly has quit IRC11:27
*** mrmartin has joined #openstack-infra11:36
openstackgerritPeter Szabo proposed openstack-infra/jenkins-job-builder: Add new parameter for warnings publisher  https://review.openstack.org/27987811:40
*** _amrith_ is now known as amrith11:48
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Setup rabbit user/pass for keystone  https://review.openstack.org/27848211:50
*** piet has joined #openstack-infra11:50
*** HeOS has quit IRC11:52
samueldmqmordred: fungi: clarkb: anteaya: here is the cachaca http://www.cachacasamanau.com.br/index.php/pt/produtos11:57
*** d0ugal has quit IRC11:58
*** wolverineav has joined #openstack-infra11:58
*** mrmartin has quit IRC11:58
samueldmqmordred: there is also a version of nega fulo that comes in a clay jar (http://www.emporiobasilico.com.br/wc_content/wc_uploads/cache/97__w320_h320_zc0_ac_m.jpg)11:58
*** thorst has joined #openstack-infra12:01
*** wolverineav has quit IRC12:03
*** smarcet has joined #openstack-infra12:03
openstackgerritRussell Bryant proposed openstack-infra/project-config: Add non-voting rally job for networking-odl.  https://review.openstack.org/26917412:07
openstackgerritRussell Bryant proposed openstack-infra/project-config: Add non-voting rally job for networking-odl.  https://review.openstack.org/26917412:07
*** thorst has quit IRC12:08
openstackgerritRussell Bryant proposed openstack-infra/project-config: Add non-voting rally job for networking-odl.  https://review.openstack.org/26917412:08
openstackgerritPeter Szabo proposed openstack-infra/jenkins-job-builder: Add new parameter for warnings publisher  https://review.openstack.org/27987812:09
*** piet has quit IRC12:13
*** ddieterly has joined #openstack-infra12:23
*** piet has joined #openstack-infra12:25
*** piet has quit IRC12:25
*** ddieterly has quit IRC12:28
*** tiswanso has joined #openstack-infra12:30
*** markvoelker has joined #openstack-infra12:30
*** tiswanso has quit IRC12:31
*** tiswanso has joined #openstack-infra12:32
*** markvoelker has quit IRC12:34
*** zeih has quit IRC12:34
*** Daisy has joined #openstack-infra12:39
*** bastelfreak has quit IRC12:40
*** Daisy has quit IRC12:44
*** mikelk has quit IRC12:49
*** tiswanso has quit IRC12:50
*** esikache1 has joined #openstack-infra12:50
*** smarcet has quit IRC12:50
*** esikache1 has quit IRC12:55
*** doug-fish has quit IRC12:55
*** doug-fish has joined #openstack-infra12:57
*** doug-fish has quit IRC12:57
*** [1]Thelo has joined #openstack-infra12:59
*** wolverineav has joined #openstack-infra13:00
*** Thelo has quit IRC13:01
*** [1]Thelo is now known as Thelo13:01
*** zhurong has joined #openstack-infra13:04
*** wolverineav has quit IRC13:05
*** thorst has joined #openstack-infra13:07
*** thorst has quit IRC13:13
*** zhurong has quit IRC13:16
*** zhurong has joined #openstack-infra13:19
*** ddieterly has joined #openstack-infra13:24
*** ddieterly has quit IRC13:28
*** dims has joined #openstack-infra13:30
*** markvoelker has joined #openstack-infra13:31
*** markvoelker has quit IRC13:35
*** rfolco has joined #openstack-infra13:38
*** skolekonov_ has joined #openstack-infra13:46
*** ddieterly has joined #openstack-infra13:49
zhurongHi, guys, when i push some commit to greeit, it gives me a error like:`error: unpack failed: error No space left on device`, and my device have much space left, maybe it have some problem with greeit?13:49
skolekonov_Hi, I have the same problem right now13:49
*** esikache1 has joined #openstack-infra13:51
*** rfolco has quit IRC13:51
*** d0ugal has joined #openstack-infra13:51
*** boris-42 has quit IRC13:54
*** njohnston has joined #openstack-infra13:54
njohnstonHi.  I want to report an issue, in case y'all haven't gotten a report of it yet.  I just did "git review" to push a new patchset, and I got the error:13:55
njohnstonerror: unpack failed: error No space left on device13:55
njohnstonfatal: Unpack error, check server log13:55
njohnstonTo ssh://natejohnston@review.openstack.org:29418/openstack/neutron.git13:55
njohnston ! [remote rejected] HEAD -> refs/publish/master/278088 (n/a (unpacker error))13:56
*** esikache1 has quit IRC13:56
*** zhurong has quit IRC13:57
*** salv-orlando has joined #openstack-infra13:59
*** wolverineav has joined #openstack-infra14:01
sgordonnjohnston, so it's not just me14:02
sgordon:)14:02
*** rossella_s has quit IRC14:03
*** rossella_s has joined #openstack-infra14:03
*** wolverineav has quit IRC14:06
*** thorst has joined #openstack-infra14:11
*** salv-orlando has quit IRC14:12
*** zeih has joined #openstack-infra14:15
*** thorst has quit IRC14:17
*** thorst has joined #openstack-infra14:17
*** thorst has quit IRC14:19
Jeffrey4lgot the same error when push new PS: error: unpack failed: error No space left on device14:24
Kiallyea.. it seems the cloud is full ;)14:25
*** sdake has joined #openstack-infra14:36
*** kun_huang has joined #openstack-infra14:38
kun_huangguys, what's the meaning of extra ATC here? https://governance.openstack.org/reference/projects/nova.html#extra-atcs14:38
jeblairnjohnston, sgordon, skolekonov_: thanks, looking into it  (cc: infra-root)14:41
*** Daisy has joined #openstack-infra14:41
*** Daisy has quit IRC14:42
*** Daisy has joined #openstack-infra14:42
jeblair/dev/mapper/main-gerrit   99G   54G   45G  55% /home/gerrit214:45
* Kiall bets it's /var/log - it's always /var/log :)14:45
*** zeih has quit IRC14:45
jeblairKiall: :)  nope -- i get the same error trying to create a file in /home/gerrit2.  /var is on / and still works14:46
jeblair/home/gerrit2 is an LVM'd cinder volume though14:46
Kiallout of inodes?14:47
jeblairKiall: oh! good point14:47
jeblair/dev/mapper/main-gerrit  6553600 6553600        0  100% /home/gerrit214:47
jeblairKiall: thank you :)14:47
Kiallthat'll do it14:47
Kiallno worries14:47
*** edmondsw has joined #openstack-infra14:48
jeblair#inodes isn't a thing we can change with tune2fs; we need a new filesystem, right?14:48
*** edmondsw has quit IRC14:49
*** Daisy has quit IRC14:50
Kiallehh, I don't think it can be changed.14:51
KiallThough, you might be able to `git gc` in the repos, to clear out what I imagine would be 10,000's of small packs uploaded... Though, gerrit may do that, or may not like it14:51
Kiallhttps://gerrit-review.googlesource.com/Documentation/cmd-gc.html <-- apparantly, a command to run it via the gerrit shell14:52
jeblairKiall: we do repack, so the pack files should be okay (if large); it's probably the refs, which are not packed, which are the major driver here14:53
jeblairKiall: however, there's a lot of complexity around that that i want to make sure we fully understand before doing it, so i think i'm going to go with the 'fix the filesystem' approach today14:53
*** max_lobur has quit IRC14:53
jeblairi'm adding a new cinder device and will create a new volume+fs on that, rsync, then restart14:55
*** zz_dimtruck is now known as dimtruck14:56
KiallYou mentioned LVM, i believe if you add the second volume to the group and extend the fs, you get more inodes (and more risk of a cinder issue..) - but might be quicker given I'm sure you want your Saturday back ;)14:56
jeblairKiall: good point... :)  that would probably fix things faster... though, i bet a rsync of 54g on ssds won't take too long14:59
jeblairoh15:01
jeblairthe launchpadlib cache is huge15:01
jeblairand full of files15:01
jeblair226355 of them15:02
*** kun_huang has left #openstack-infra15:02
*** max_lobur has joined #openstack-infra15:03
*** dims has quit IRC15:03
jeblairalso, it's slightly disturbing that 'nova volume-attach' just attached the second volume at the same device as the first one (/dev/xvdb)15:03
Kiallthe device naming from nova has been somewhat of a "best effort" rather than always accurate ;)15:04
jeblairyeesh.  scary.  though this is the first time i've seen this happen15:05
jeblair#status alert Gerrit is offline for filesystem repair15:06
openstackstatusjeblair: sending alert15:06
mordredmorning jeblair15:06
mordredanything I can do to help?15:06
jeblairmordred: morning!  let me know if you think my plan to rysnc to a new fs is okay, or if we should just remove the launchpadlib cache, or extend the fs, either of which might get us up faster.15:07
mordredjeblair: I think we should remove the launchpadlib cache for sure - but I also think rsyncing to a new fs is an ok plan15:08
jeblairmordred: my thinking is the rsync may take a few mins longer, but is a moderate long-term fix15:08
mordredyah15:08
jeblairi'm stopping gerrit itself now15:08
-openstackstatus- NOTICE: Gerrit is offline for filesystem repair15:08
*** ChanServ changes topic to "Gerrit is offline for filesystem repair"15:09
jeblairi've unmounted /home/gerrit215:09
jeblairso back on the cinder front15:09
jeblairthe kernel has not noticed the new device15:09
jeblairwhich is probably good considering the naming issue from earlier.  and possibly related.15:09
jeblairthere was a command we used to have to run to hot add scsi devices... what was it...15:10
Kiallecho "- - -" > /sys/class/scsi/something/scan15:10
*** dims has joined #openstack-infra15:10
openstackstatusjeblair: finished sending alert15:11
jeblairKiall: yeah that was it15:12
*** ganso has joined #openstack-infra15:12
jeblairand neat, it made the b device go away15:12
dimsgood morning :)15:12
mordredKiall: dude. you have a good memory brain15:12
jeblairoh wait, i'm mistaken...15:13
jeblairb is still there, but still no c15:13
jeblairso i wonder if we should reboot15:13
Kiallmordred: lol, nope... just wasted enough time on figuring out I needed that a while back - it's burned in now.15:14
Kialljeblair: maybe the dup'd attachment name is causing an issue? Does RAX let you specify a device name while attaching?15:14
jeblairKiall: yeah, so i specified /dev/xvdc and cinder show reports that now15:15
mordredjeblair: I only see one volume attachment for review.openstack.org in nova15:15
mordred| 4ae4bfbf-c90e-4bad-a9d8-4c1f70604ac1 | /dev/xvdb | 87741fa9-92cb-4d1e-8195-6841e2468fb2 | 4ae4bfbf-c90e-4bad-a9d8-4c1f70604ac1 |15:15
mordredjeblair: that's from running: nova volume-attachments review.openstack.org15:16
jeblairmordred: hrm15:16
jeblair| 4ae4bfbf-c90e-4bad-a9d8-4c1f70604ac1 | in-use |     review.openstack.org/main01      | 100  |     SSD     |  false   | 87741fa9-92cb-4d1e-8195-6841e2468fb2 |15:17
jeblair| 986b125a-2629-435b-ba74-3ba089f1cbcc | in-use |     review.openstack.org/main02      | 100  |     SSD     |  false   | 9d3ff96d-920d-4d4f-854e-7057d268795c |15:17
jeblairmordred: that's from cinder list15:17
mordredyah15:17
mordredI see thta too15:17
*** zeih has joined #openstack-infra15:17
mordredso it seems cinder thinks it's attached and nova does not15:17
mordredwhich would explain why you don't see it15:17
jeblairmordred: i'm using the venvs in http://docs.openstack.org/infra/system-config/sysadmin.html#cinder-volume-management15:17
jeblairmordred: my nova doesn't have 'volume-attachments'15:17
*** thorst has joined #openstack-infra15:19
* jeblair resorts to web interface15:19
jeblairwebui only says 01 as well15:20
mordredjeblair: I'll update the venv - I have also updated the cinder.sh script to include OS_VOLUME_API_VERSION=1 which is needed for recent cinder client with rackspace15:20
*** salv-orlando has joined #openstack-infra15:20
jeblairmordred: should i detach, wait for you to complete that, then try attach again?15:21
*** zeih has quit IRC15:21
mordredyah15:21
mordredand I'm done15:21
mordredoh. WEIRD15:21
mordredthere's still no volume-attachements command15:21
mordredwhat the heck do I have15:21
jeblairmordred: ERROR: publicURL endpoint for volumev2 service in DFW region not found15:21
jeblairand now that15:21
*** EricGonczer_ has joined #openstack-infra15:22
mordredyah - re-source cinder.sh15:22
*** skolekonov_ has quit IRC15:22
jeblairoh right15:22
jeblairbetter15:22
jeblairmordred: shall i try cinder attach one more time, or give you another minute to examine weirdness?15:22
mordrednope. go for it15:22
jeblair(er, nova attach)15:22
mordredjeblair: you can do btw15:23
jeblairmordred: attached15:23
jeblairwebui does not show it15:23
*** dimtruck is now known as zz_dimtruck15:24
mordredneither does my wonky nova with nova volume-attachments15:24
mordredjeblair: maybe try web ui?15:24
jeblairi think the next step in this choose your own adventure is either a) webui b) reboot15:24
mordredI think webui - becuase this seems to be control plane issues15:24
jeblairi'll do webui -- i'll detach in the shell, then try attaching in the webui15:24
*** rvba has quit IRC15:25
jeblairattaching...15:25
*** smarcet has joined #openstack-infra15:25
*** salv-orlando has quit IRC15:25
mordredoh. also - you know what ...15:26
jeblairattached and shows up in webui15:26
mordrednova volume-attach is not a synchronous action15:26
mordredI agree - it shows up in monty-nova15:26
jeblairmordred: but if cinder reports it attached...?15:26
mordredso - that's a mystery to explore more later15:26
mordredjeblair: that's just cinder's view15:26
jeblairmordred: cinder show was saying "available"..."attaching"..."in-use"15:26
mordredjeblair: cinder and nova have two different databases for this15:27
jeblairso i sort of thought that the attaching/in-use change would reflect whether nova had completed the action...15:27
mordredyah - on th enova side if I was using the api, the next step after the attache is to poll the nova server record to see when the attachment shows up15:27
jeblair[2086902.923541] blkfront: xvdc: barrier: enabled; persistent grants: disabled; indirect descriptors: disabled;15:27
jeblair[2086902.925722]  xvdc: unknown partition table15:27
jeblairauto-detected (no probe needed)15:27
*** thorst has quit IRC15:28
mordredawesome15:28
jeblairso, resume speed15:28
mordredjeblair: this reminds me I need to cook up ansible playbooks for this stuff now that we've got 2.0 and the os_ modules on the server15:28
*** rvba has joined #openstack-infra15:28
*** rvba has quit IRC15:28
*** tphummel has joined #openstack-infra15:29
jeblairi'm renaming the old volume to gerritold15:30
*** rvba has joined #openstack-infra15:30
*** rvba has quit IRC15:30
*** rvba has joined #openstack-infra15:30
*** Jeffrey4l has quit IRC15:31
jeblairokay, new mkfs command...15:32
*** markvoelker has joined #openstack-infra15:32
notmorganoh inode issue. fun thing to deal with :(15:33
jeblairdoubling them would be just about right15:33
mordred++15:33
notmorganext4?15:34
jeblairnotmorgan: yep15:34
* notmorgan is just curious.15:34
notmorganjeblair: ah. you know it's been a long time since i ran a FS out of inodes [back when storing < 4k images at $social_media_company_not_facebook$15:34
*** markvoelker has quit IRC15:36
*** moravec has quit IRC15:36
jeblairi think byte-per-inode defaults to 16384 so i'll set it to 8192 ?15:37
*** moravec has joined #openstack-infra15:37
jeblairsudo mkfs.ext4 -m 0 -j -i 8192 -L $NAME /dev/main/$NAME15:38
pabelangerwhat happen to gerrit? Result of the move yesterday?15:38
pabelangererr, project rename15:38
*** achanda has joined #openstack-infra15:38
notmorganpabelanger: inode issue on FS15:38
notmorganpabelanger: they're working on it15:38
jeblairpabelanger: probably just bad luck15:38
pabelangerAh15:38
notmorganjeblair: def. bad luck. no way a rename should cause this :P15:39
jeblair13107200 inodes, 26213376 blocks15:39
jeblairthat's 2x the old fs15:39
notmorganuhm.15:39
*** jlk` is now known as jlk15:39
notmorganjeblair: -i or -N?15:39
notmorgan-i is bytes-per-inode accoridng to man15:39
jeblairnotmorgan: i did -i because the math is harder? :)15:39
jeblairnotmorgan: yeah, i adjusted the ratio instead of the count15:40
notmorganis that what we want? i thought we wanted more actual inodes?15:40
notmorganoh15:40
notmorganokie15:40
* notmorgan can't brain.15:40
jeblairnotmorgan: (you may be thinking of inode size, which i did not change)15:40
mordrednotmorgan: braining is hard15:40
notmorganwith -I vs -i15:40
notmorganyeah15:40
jeblairnotmorgan: (rather, i changed the ratio mkfs uses to calculate how many inodes to allocate)15:40
* notmorgan kicks mkfs for using -i and -I and making it hard to read pre-coffee15:41
jeblairbut confirmed the same result -- it says we have 13107200 and we had 6553600 before15:41
notmorganthankfully this shouldn't occur too terribly offen :)15:42
Clintyou reading pre-coffee?15:42
jeblairrsyncing15:42
notmorganClint: yes.15:42
*** tphummel has quit IRC15:43
jeblairi'm sysadmining pre-coffee15:43
jeblairfortunately, Kiall was around (and presumably caffeinated) to tell me what to type :)15:43
Kialljeblair: next step, rm -rf --no-preserve-root / ;)15:44
pabelangerKiall: how often have you had to deal with inodes :)15:44
KiallMore often that I probably should have :)15:44
notmorganoh hi Kiall!15:45
pabelangerjeblair: distributed sysadmining FTW15:45
*** flepied1 has joined #openstack-infra15:45
jeblair++15:46
*** achanda has quit IRC15:46
mordredKiall: you coming to the ops thing in manchester next week?15:47
*** ddieterly has quit IRC15:47
*** tphummel has joined #openstack-infra15:47
Kiallmordred: nope, I've been travelling the last 2 weeks... The thought of more travel.. ugh!15:48
Kialland... speaking of coffee ;)15:48
mordredKiall: I hear that for sure!15:48
*** flepied has quit IRC15:48
jeblairat about 20%15:50
*** EricGonczer_ has quit IRC15:50
*** ddieterly has joined #openstack-infra15:51
*** esikache1 has joined #openstack-infra15:53
*** dguitarbite_ has joined #openstack-infra15:54
dguitarbite_hello, is review.openstack.org down today?15:54
dguitarbite_or I'm stuck in some sort of maintenance limbo?15:54
pabelangerdguitarbite_: see topic15:54
*** skolekonov_ has joined #openstack-infra15:54
*** skolekonov_ has quit IRC15:54
*** ddieterly has quit IRC15:55
dguitarbite_pabelanger: thanks, I was kind of panicking15:57
Clintdon't panic15:57
*** esikache1 has quit IRC15:58
mordredI have a towel if you need one16:00
Sam-I-Ammornings16:00
jeblairnever could get the hang of them16:01
*** wolverineav has joined #openstack-infra16:03
*** wolverineav has quit IRC16:07
mordredjeblair: I have updated the cinder-venv16:08
mordredjeblair: it now has the right things in it16:08
mordredjeblair: the existing one was REALLY WEIRD - so I actually made a new one16:08
jeblairmordred: did you find the nova attach list thingy command?16:08
mordredyes16:08
mordredit turns out when I upgraded nova in the venv earlier, I did not actually upgrade nova16:09
jeblairmordred: i like your conservative approach16:09
*** EricGonczer_ has joined #openstack-infra16:10
*** zz_dimtruck is now known as dimtruck16:11
*** kzaitsev_mb has joined #openstack-infra16:15
jeblair50%16:15
*** EricGonczer_ has quit IRC16:17
mordredjeblair: wow. we're having so much fun waiting on things on review.o.o these days arent' we?16:20
jeblairya16:20
mordredbtw - xenial first alpha is out - so I'm testing building xenial images with disk-image-builder16:21
jeblairmordred: see if afs works :)16:21
jeblairsometimes they break that16:21
mordredjeblair: good call :)16:21
mordredjeblair: maybe we can skip trusty for our services still on precise and move straight to xenial :)16:22
*** zeih has joined #openstack-infra16:22
jeblairmaybe so :)16:23
*** thorst has joined #openstack-infra16:27
*** hdd has joined #openstack-infra16:30
tristanCHello guys, about the zuul memory leak, has it been bisected already ?16:33
clarkbjeblair we ran out of inodes on /home/gerrit2 and separately cinder nova couldnt agree on volume attachment?16:33
*** rkukura has quit IRC16:33
clarkbtristanC: yes fixed too iirc16:33
mordredclarkb: yes16:33
*** thorst has quit IRC16:33
mordredclarkb: I have also updated the versions of things now in cinder-venv - although we do not know if that had anything to do with the problem16:34
clarkband was the problem manifesting beyond just bookeeping discrepancies?16:34
clarkbI couldnt tell if it was causing problems by skimming scrollback16:35
*** kzaitsev_mb has quit IRC16:35
jeblairclarkb: it didn't actually appear on-host16:36
jeblairclarkb: i attached using the web ui and that worked16:36
tristanCclarkb: I wasn't sure the fix was already merged, thank!16:36
mordredyah. so, my hunch is something to do with the old client lib versions on the host - but I have not spent effort to reproduce the issue yet16:37
*** kzaitsev_mb has joined #openstack-infra16:43
*** dguitarbite_ has quit IRC16:43
*** ildikov_ has joined #openstack-infra16:44
*** ildikov has quit IRC16:46
*** kzaitsev_mb has quit IRC16:48
*** bpokorny has joined #openstack-infra16:52
*** ddieterly has joined #openstack-infra16:52
jeblair80%16:52
*** HeOS has joined #openstack-infra16:53
*** erikm has joined #openstack-infra16:53
*** _nadya_ has joined #openstack-infra16:53
jeblairwell crap16:54
jeblairgerrit is running16:54
jeblairi'm guessing someone didn't agree with the idea that puppet should not ensure -> running16:54
jeblairmordred, clarkb: can one of you stop puppet please?16:55
*** ddieterly has quit IRC16:58
*** zeih has quit IRC16:58
*** bpokorny has quit IRC16:58
jeblairi'll do it16:59
jeblairadded review.o.o to emergency hosts file16:59
jeblairit appeared that gerrit did not believe it had any projects; hopefully that means that it won't have actually changed anything in the db17:00
jeblairon disk we can run the rsync again, but we'll need to add --delete this time17:00
*** tphummel has quit IRC17:00
*** zeih has joined #openstack-infra17:01
jeblairwell, unfortunately, there are 15 changes that have a last_updated_on after i stopped gerrit17:02
*** wolverineav has joined #openstack-infra17:04
*** smarcet has quit IRC17:04
*** matrohon has joined #openstack-infra17:08
*** zeih has quit IRC17:08
*** wolverineav has quit IRC17:09
clarkbsorry I am/was juggling children not in a great place to help17:10
*** Daisy has joined #openstack-infra17:10
jeblairi think it was actually that we re-ran gerrit init17:10
jeblairprobably some missing file in /home/review site triggered it17:10
jeblair4 patch sets were created after i stopped gerrit17:11
jeblairthe other change updates are probably just comments17:12
jeblairso here's what i'm thinking: fetch those changes into a copy of the git repos; rsync again with --delete; push those changes back into the canonical git repos at their original refs location17:14
*** Daisy has quit IRC17:14
*** jsavak has joined #openstack-infra17:14
jeblairthen start gerrit and kick off an online reindex17:14
jeblairinfra-root: ^ does that sound sensible?17:15
clarkbthe db will know about them so as long as the refs exist and the shas match it seems like that eould work17:16
*** armax has joined #openstack-infra17:16
*** ganso has quit IRC17:19
*** jsavak has quit IRC17:20
*** jsavak has joined #openstack-infra17:21
*** yamahata has joined #openstack-infra17:21
*** zeih has joined #openstack-infra17:22
jeblairokay, refs backed up17:22
jeblairrunning rsync again17:22
jeblairrsync has deleted the 4 changes i know about from the git repos17:25
jeblairand it's complete with no surprise deletions17:26
*** zeih has quit IRC17:26
*** matrohon has quit IRC17:28
jeblairpushed back into canonical repos17:29
jeblairi'm going to start gerrit now17:29
jeblairthose 4 changes show up in the webui fine17:32
openstackgerritPeter Szabo proposed openstack-infra/jenkins-job-builder: Add new parameter for warnings publisher  https://review.openstack.org/27987817:32
AJaegerjeblair: great!17:32
AJaegerAnd Peter Szabo tested for us ;)17:32
jeblairsearching for them by change-id doesn't work, but that's expected and should be fixed by an online reindex17:32
*** thorst has joined #openstack-infra17:32
*** markvoelker has joined #openstack-infra17:32
AJaegerjeblair: do we know when the online reindex will be finished? Just trying to get some data...17:33
jeblairgerrit has 7125 git repo push tasks17:33
jeblairAJaeger: we've never run an online reindex before17:33
jeblairAJaeger: yesterday, our offline reindex took... what... 3 hours?17:34
* jeblair checks eavesdrop17:34
AJaegerjeblair: I know - that's why I wonder whether you have a way to measure how long today's will take...17:34
AJaegerjeblair: reading backscroll, yes 3 hours ...17:34
AJaegerI mean: post mortem17:34
AJaegerAs data point for the next time...17:34
jeblairAJaeger: i _was_ going to suggest that we could copy the index to another host and try an online reindex there.17:34
jeblairAJaeger: but now i think i should just run it in production since we know it's out of sync with data on disk  (though, only 4 changes)17:35
AJaegerjeblair: yeah, go for it!17:35
jeblairi will at least wait until all of the git pushes are complete; 5k to go17:35
jeblair#status ok Gerrit is back up17:36
openstackstatusjeblair: sending ok17:36
*** markvoelker has quit IRC17:37
jeblair"This command will not start the indexer if it is already running or if the active index is the latest."17:37
jeblairhrm.17:37
jeblairi'm not sure this command does what we thought it did.17:37
nibalizerhi17:37
jeblairnibalizer: good morning17:38
jeblair3k pushes17:38
AJaegerhi nibalizer!17:38
AJaegerjeblair: that sounds indeed wrong ;(17:38
*** mikelk has joined #openstack-infra17:39
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/"17:39
-openstackstatus- NOTICE: Gerrit is back up17:39
*** thorst has quit IRC17:39
nibalizersounds like fun17:39
jeblairso, i'll still run that command.  but i expect at this point it will simply output something like "nothing to do" to the log and terminate.17:39
nibalizeroh its fixed17:39
jeblairhopefully we will be pleasantly surprised17:40
jeblair1k pushes; 70% to github17:41
openstackstatusjeblair: finished sending ok17:42
jeblair700 pushes all of them to github17:42
jeblairwe only use 1 thread to push to github, so the last bit will be a little slower17:42
*** esikache1 has joined #openstack-infra17:44
jeblair40017:46
AJaegerjeblair: we have some changes that were approved but never made it through the gate. Do you have a saved list to enqueue again - or should we run "recheck" on these?17:46
AJaegeror toggle +A?17:47
jeblairAJaeger: i don't have a list, so toggle/recheck is the way to go17:47
AJaegerjeblair: ok.17:49
AJaegerjeblair: I noticed jobs that are merged on the job page - but not in the list, compare https://review.openstack.org/#/c/274117/ with https://review.openstack.org/#/q/project:openstack/api-site17:49
AJaegerso, 274117 says "merged" but not in the second list17:50
AJaegerAnd there are a few more of these17:50
*** armax has quit IRC17:50
AJaegerAre these part of the 4 that went through?17:50
*** esikache1 has quit IRC17:51
jeblairAJaeger: no; however, 274117 does show up in the git repo17:51
AJaegerSo, 274117, 274035, 276101, 27335317:51
jeblairAJaeger: so i think the database and git repo are consistent there17:51
jeblairand the search results are reflecting an out of date searh index17:52
*** dimtruck is now known as zz_dimtruck17:52
jeblairincidentally, i specifically noted that all of the changes with updated times during the outage were still in the 'n' (new) state, so that means that there should have been no changes that were merged during that time.  (this is a good thing for db/git consistency)17:52
AJaegerwill the online reindex fix these 4?17:53
jeblairAJaeger: hrm, on the list you linked, i see 274117 as merged17:53
*** _nadya_ has quit IRC17:54
jeblairAJaeger: all 4 of those appear as merged in the list i'm looking at17:54
openstackgerritStephen Gordon proposed openstack-infra/project-config: Skip magnum functional test jobs on docs changes  https://review.openstack.org/27789217:54
jeblairAJaeger: maybe it updated the index since you looked?17:54
AJaegerjeblair: might be - which would be nice... Let's see what happens with the rest17:54
jeblairokay, it's finished pushes; i'll try index start now17:55
AJaegeroh, https://review.openstack.org/#/c/273534/ has now "ready to submit" - never seen before...17:55
jeblairNothing to reindex, index is already the latest version17:55
jeblair:(17:55
jeblairso, i think a) that means that those 4 changes won't be properly searchable until we do an offline reindex; and b) we may be looking at 3 hour outages for renames now.17:56
AJaegerSo, no more renames ;)17:57
jeblairi'm glad we did the stackforge move when we did17:57
AJaegerjeblair: yeah!17:57
clarkbcould abandon and repush uf not many comments17:58
clarkbbad workaround but it is an iption17:58
jeblairclarkb: it might even be that pushing a new ps (or maybe even addding a comment) could trigger an index of the change17:58
clarkbgood point17:59
AJaegershould I touch 273534 ?17:59
jeblairAJaeger: my guess with 534 is that zuul was trying to merge it right as gerrit was running out of inodes, so the submit action failed18:00
*** madhu_ak has joined #openstack-infra18:00
jeblairAJaeger: it is not in master (which is good)18:00
jeblairAJaeger: so i think just recheck/toggle for that one18:01
jeblairclarkb, AJaeger: leaving a comment is enough to get a change indexed18:02
*** jsavak has quit IRC18:02
jeblairi will comment on those 4 changes18:02
AJaegerthe change is back in the gate - good!18:02
*** rossella_s has quit IRC18:03
*** rossella_s has joined #openstack-infra18:03
jeblairopenstack/api-site refs/changes/86/279886/1:refs/changes/86/279886/118:03
jeblairopenstack/cinder   refs/changes/87/279887/1:refs/changes/87/279887/118:03
jeblairopenstack/manila   refs/changes/88/279888/1:refs/changes/88/279888/118:03
jeblairopenstack/manila   refs/changes/89/279889/1:refs/changes/89/279889/118:03
jeblairthose are the 4 changes uploaded during downtime for reference18:04
jeblairi've commented on them all18:04
AJaegerlooks good for api-site - thanks18:04
jeblairokay, i need to go saturday now18:06
jeblairi think we're all set here18:06
AJaegerjeblair: we have others with out of date index like https://review.openstack.org/#/c/279884/ and https://review.openstack.org/#/q/project:openstack/openstack-doc-tools ;(18:06
AJaegerI'll check and add comments18:06
AJaegerjeblair: enjoy your Saturday!18:06
jeblairAJaeger: yeah, there are probably some changes that were altered in some way after gerrit ran out of inodes but before the maintenance18:06
jeblairwe could probably look for all changes last updated  after 1330 utc but before 1500 and comment on all of them18:07
jeblairAJaeger: http://paste.openstack.org/show/486914/18:08
jeblairand actually, if we want to be really sure, this goes back to the last time gerritbot announced something in channel but before the first error report:18:10
jeblairhttp://paste.openstack.org/show/486915/18:10
AJaegertoo many for manual change - I went over list of open jobs that have no jenkins vote and will evaluate those...18:10
jeblairi might just gerrty this :)18:10
AJaeger;)18:11
*** mrmartin has joined #openstack-infra18:12
*** vmbrasseur has quit IRC18:13
jeblairmeh, that's harder to do with a bunch of random changes :/18:14
*** vmbrasseur has joined #openstack-infra18:14
AJaeger;(18:16
jeblairi think i can do it with a small change to the auto-sync on search... i'm trying it out18:17
jeblairit's syncing them now18:17
AJaegercool18:17
jeblairthis means quite a few git repo updates18:17
jeblairprobably would have been faster to just do it in a bash for loop18:18
jeblairbut this is more fun18:18
*** mrmartin has quit IRC18:18
*** sputnik13 has joined #openstack-infra18:18
AJaeger;)18:19
AJaegerjeblair: I'm leaving now as well, enjoy the weekend!18:20
jeblairAJaeger: you too18:20
*** madhu_ak has quit IRC18:21
*** sputnik13 has quit IRC18:22
*** zeih has joined #openstack-infra18:22
*** shashank_hegde has joined #openstack-infra18:23
jeblairwe really do need to gc the git repos... someone was looking into that, right?18:24
*** jpr has joined #openstack-infra18:26
*** dims has quit IRC18:30
*** zeih has quit IRC18:30
*** mrmartin has joined #openstack-infra18:35
*** thorst has joined #openstack-infra18:35
*** jpr has quit IRC18:39
*** mrmartin has quit IRC18:39
fungifun, 400 lines of scrollback and multiple highlights on a saturday. catching up!18:41
*** sdake has quit IRC18:42
*** thorst has quit IRC18:43
fungizaro: the _problem_ was not making the group disappear. deleting it from the database did that just fine. the _problem_ is that the acl is still trying to enforce membership in that group, so any of our acls which reference "registered users" are currently checking against a nonexistent group and preventing any accounts from matching those rules. i _expect_ that removing those lines from the groups18:44
fungifiles will solve what we wanted solved, and could hopefully be pushed into each effected repo with gerrit online, but your confirmation of this would be helpful18:44
*** jtomasek_ has joined #openstack-infra18:48
fungiokay, caught up with scrollback now. looks like my decision to spend the first half of the day making marinara caused me to miss all the fun18:55
fungianything still broken that needs immediate attention?18:55
*** zz_dimtruck is now known as dimtruck18:58
*** e0ne has joined #openstack-infra18:58
*** wolverineav has joined #openstack-infra19:05
*** mrmartin has joined #openstack-infra19:06
*** flepied1 has quit IRC19:09
*** flepied has joined #openstack-infra19:10
*** wolverineav has quit IRC19:11
*** hdd has quit IRC19:11
*** alkhodos has quit IRC19:12
*** harlowja_at_home has joined #openstack-infra19:12
fungioh, also, as promised, island snow (my wife took some photos of it yesterday and this morning): http://fungi.yuggoth.org/snow/19:16
*** ddieterly has joined #openstack-infra19:17
*** ddieterly has quit IRC19:18
*** ddieterl_ has joined #openstack-infra19:18
*** sheel has joined #openstack-infra19:20
sheelHello All19:20
sheeljust for informatin19:20
sheelIt seems duplicate patchsets are generated due to some Gerrit issue19:21
sheelIf anybody concerned, can check https://review.openstack.org/#/c/274589/ and https://review.openstack.org/27988719:21
sheelThis may be due to some manual error but for now it seems due to issue in gerrit indexing..19:21
*** sdake has joined #openstack-infra19:22
*** harlowja_at_home has quit IRC19:24
*** mrmartin has quit IRC19:28
*** fedexo has joined #openstack-infra19:28
*** _nadya_ has joined #openstack-infra19:30
*** markvoelker has joined #openstack-infra19:33
*** baoli has joined #openstack-infra19:35
*** Sukhdev has joined #openstack-infra19:35
*** markvoelker has quit IRC19:37
*** thorst has joined #openstack-infra19:41
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Wait for pacemaker cluster to settle  https://review.openstack.org/27989419:42
*** baoli has quit IRC19:42
*** shashank_hegde has quit IRC19:46
*** thorst has quit IRC19:48
*** EricGonczer_ has joined #openstack-infra19:49
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Wait for pacemaker cluster to settle  https://review.openstack.org/27989419:49
*** e0ne has quit IRC19:50
*** FallenPegasus has quit IRC19:52
*** dimtruck is now known as zz_dimtruck19:54
*** alexpilotti_ has joined #openstack-infra19:54
*** alexpilotti_ has quit IRC19:55
*** zz_dimtruck is now known as dimtruck19:57
*** benjaminfarley has joined #openstack-infra20:04
*** jtomasek_ has quit IRC20:05
*** wolverineav has joined #openstack-infra20:07
*** zeih has joined #openstack-infra20:09
*** zeih has quit IRC20:12
*** sdake has quit IRC20:16
*** jsavak has joined #openstack-infra20:20
*** shashank_hegde has joined #openstack-infra20:24
*** jsavak has quit IRC20:25
*** jtomasek_ has joined #openstack-infra20:28
*** Sukhdev has quit IRC20:30
*** baoli has joined #openstack-infra20:32
*** andymaier_ has joined #openstack-infra20:33
*** andymaier has quit IRC20:36
*** baoli has quit IRC20:37
*** sdake has joined #openstack-infra20:38
*** gangil has joined #openstack-infra20:43
*** gangil has joined #openstack-infra20:43
*** thorst has joined #openstack-infra20:48
*** thorst has quit IRC20:53
*** dimtruck is now known as zz_dimtruck20:59
*** EricGonczer_ has quit IRC21:00
*** dims has joined #openstack-infra21:04
*** gangil has quit IRC21:06
*** _nadya_ has quit IRC21:10
*** zeih has joined #openstack-infra21:10
*** zz_dimtruck is now known as dimtruck21:10
*** ddieterl_ has quit IRC21:12
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/27973521:18
*** gangil has joined #openstack-infra21:18
*** gangil has joined #openstack-infra21:18
*** thorst has joined #openstack-infra21:24
*** thorst has quit IRC21:25
*** thorst has joined #openstack-infra21:26
*** jpr has joined #openstack-infra21:26
*** jtomasek_ has quit IRC21:28
*** gangil has quit IRC21:29
*** gangil has joined #openstack-infra21:29
*** gangil has joined #openstack-infra21:29
*** gangil has quit IRC21:33
*** max_lobur has quit IRC21:33
*** markvoelker has joined #openstack-infra21:34
*** thorst has quit IRC21:35
*** hdd has joined #openstack-infra21:36
*** markvoelker has quit IRC21:39
*** EricGonczer_ has joined #openstack-infra21:43
*** andymaier_ has quit IRC21:43
*** sridhar_ram has joined #openstack-infra21:44
*** zeih has quit IRC21:50
*** shashank_hegde has quit IRC21:53
*** ccrouch has joined #openstack-infra21:54
*** jsavak has joined #openstack-infra21:57
*** baoli has joined #openstack-infra21:57
*** jpr has quit IRC21:57
openstackgerritTristan Cacqueray proposed openstack-infra/zuul: Add poll.poll() timeout  https://review.openstack.org/27444521:58
*** rossella_s has quit IRC22:03
*** rossella_s has joined #openstack-infra22:03
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Wait for pacemaker cluster to settle  https://review.openstack.org/27989422:05
*** sdake has quit IRC22:08
*** ddieterly has joined #openstack-infra22:11
*** mriedem has joined #openstack-infra22:14
*** ccrouch has quit IRC22:17
*** dimtruck is now known as zz_dimtruck22:18
*** markvoelker has joined #openstack-infra22:18
*** ccrouch has joined #openstack-infra22:19
*** baoli has quit IRC22:23
*** flepied has quit IRC22:26
*** sridhar_ram1 has joined #openstack-infra22:27
*** salv-orlando has joined #openstack-infra22:29
*** sridhar_ram has quit IRC22:29
*** flepied has joined #openstack-infra22:31
*** ccrouch has quit IRC22:32
*** thorst has joined #openstack-infra22:32
*** ccrouch has joined #openstack-infra22:35
*** |-paul-| has joined #openstack-infra22:35
*** salv-orlando has quit IRC22:38
*** thorst has quit IRC22:39
*** sdake has joined #openstack-infra22:42
*** mikelk has quit IRC22:44
*** flepied1 has joined #openstack-infra22:47
*** flepied has quit IRC22:51
*** [1]Thelo has joined #openstack-infra23:00
*** Thelo has quit IRC23:02
*** [1]Thelo is now known as Thelo23:02
*** jsavak has quit IRC23:04
*** hdd has quit IRC23:09
*** Daisy has joined #openstack-infra23:13
*** sridhar_ram1 has quit IRC23:13
*** andymaier_ has joined #openstack-infra23:15
*** hdd has joined #openstack-infra23:16
*** Daisy has quit IRC23:18
*** ddieterly has quit IRC23:19
*** andymaier_ has quit IRC23:19
*** |-paul-| has quit IRC23:32
*** thorst has joined #openstack-infra23:37
*** zhurong has joined #openstack-infra23:38
openstackgerritFrank Kloeker proposed openstack-infra/puppet-translation_checksite: Puppet module to provide a translation checksite  https://review.openstack.org/27470123:42
openstackgerritFrank Kloeker proposed openstack-infra/system-config: Manifest for configuration translation checksite  https://review.openstack.org/27646623:43
*** thorst has quit IRC23:44
*** sheel has quit IRC23:47
*** salv-orlando has joined #openstack-infra23:52
*** fedexo has quit IRC23:57
*** benjaminfarley has quit IRC23:57
*** baoli has joined #openstack-infra23:57
*** sdake has quit IRC23:58
*** fedexo has joined #openstack-infra23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!