Tuesday, 2014-06-24

nibalizergerrit-git-prep.sh makes it look like /opt/git/thingy00:00
clarkbnibalizer: that is where we have cached all of the repos on the slaves00:01
nibalizeroh00:01
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Add in support for 'recheck openstack-ci'  https://review.openstack.org/10013300:01
clarkbbut it doesn't contain the code being tested, it acts only as a cache for alredy merged stuff00:01
nibalizerwait its okay to run tests as root right?00:01
nibalizerno need to run as jenkins00:01
clarkbjeblair: zaro fungi everyone else. all jenkinses hae had timeout plugin and gearman plugin updated00:01
clarkbI am going to propose revert reverts for the changes I reverted on friday00:02
clarkbnibalizer: again it depends00:02
jeblairclarkb: excellent!00:02
clarkbnibalizer: usually no it isn't ok00:02
clarkbnibalizer: because we expect people to be able to run these things on their laptops mostly safely00:02
clarkbnibalizer: if you allow root well that doesn't work00:02
clarkbnibalizer: the exception is where root is actually required00:02
nibalizerhrm well obviously your puppet apply needs to run as root though right?00:02
anteayacyeoh: yay00:03
nibalizeras you know im working on integrating the puppet beaker-rspec testing stuff00:03
anteayajust everytime I see you I go, yay!! \o/00:03
nibalizerwhich does make the assumption that root will be used00:03
clarkbnibalizer: uhm but not in the test slave I thought00:03
clarkbnibalizer: you were going to only root in containers or someplace else00:03
cyeohanteaya: haha, thanks :-) I hope things are going well for you too!00:04
clarkbnibalizer: there is a difference between root on the control node and root on the subnodes00:04
nibalizerhrm okay00:04
nibalizerso what i've found is that beaker will likely work pretty well with the subnodes00:04
nibalizersince it has a system that allws you to say 'no ill do it, just use this ip'00:05
nibalizerso as long as i can ssh -i some_key root@subnodes we're golden00:05
clarkbnibalizer: cool00:05
anteayacyeoh: they are yes00:05
jeblairclarkb, mordred: The android gerrit is at change #99143.00:06
clarkbnibalizer: in that case I would make the main node not have root access00:06
clarkbnibalizer: then ssh as root to the other nodes and use priveleges there00:06
clarkbjeblair: now we really need that cake00:06
anteayajeblair: when did they system start counting, do we know?00:06
anteayas/they/their00:06
*** devkulkarni has joined #openstack-infra00:06
jeblairanteaya: dunno, their cr #1 is not public00:07
dansmithclarkb: jeblair: fungi: there is a fixed sqla package up, could we trigger the mirror to get things unblocked sooner than later?00:07
anteayajeblair: ah00:07
openstackgerritClark Boylan proposed a change to openstack-infra/config: Revert "Revert "Update jenkins jobs to optionally allow trusty""  https://review.openstack.org/10206200:07
openstackgerritClark Boylan proposed a change to openstack-infra/config: Revert "Revert "Run all dsvm jobs from juno onwards on trusty""  https://review.openstack.org/10206300:07
clarkbjeblair: fungi mordred sdague ^ there is a pair of revert reverts00:08
clarkbdansmith: yes, but can someone confirm it works first00:08
clarkbdansmith: last time we hit this with httpretty the fix didn't fix anything00:08
dansmithclarkb: it's been confirmed00:08
nibalizerclarkb: okay00:08
*** devkulkarni has quit IRC00:08
morganfainbergclarkb: ++ lets not have silly happen like that again00:08
clarkbdansmith: cool I will go ahead and trigger a mirror build now00:08
dansmithclarkb: the sqla dev works on openstack now, and spent all day on it00:08
jeblairclarkb: 1 sec00:08
dansmiths/dev/author/00:08
clarkbjeblair: sure00:08
nibalizerso this http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/nodepool/scripts/multinode_setup.sh , does that mean that the id_rsa.pub will alraedy exist for root@subnode in authorized_keys, or will i have to do some shenanigans to get it put there?00:09
clarkbnibalizer: I think that means you can ssh as jenkisn and that will work00:10
*** annegent_ has quit IRC00:10
nibalizerwell thats what the script does00:10
fungiclarkb: jenkins.o.o honestly seems less of a risk than jenkins\d\d.o.o, for this sort of thing. fine by me00:10
nibalizerbut is insufficient for my purposes :(00:10
clarkbnibalizer: what do you need?00:10
clarkbnibalizer: ssh as jenkins then sudo00:11
jeblairclarkb: okay.  https://review.openstack.org/#/c/102015/ is in check now, so still at least an hour or so away from landing00:11
clarkbor su as appropriate00:11
nibalizerhfm00:11
clarkbjeblair: ya and it doesn't exclude the fix00:11
clarkbjeblair: only the broken version is excluded00:11
clarkbjeblair: so good to run mirror build?00:11
jeblairclarkb: yup00:11
nibalizerclarkb: i agree that jenkins + sudo is equivalent to ssh as root00:12
clarkbdansmith: jeblair periodic jobs manually started00:12
nibalizerbut i doubt the tooling we're consuimng will support that, so id like to find a middle ground00:12
dansmithclarkb: you are a fine gentleman00:12
clarkbshould see that in ~20 minutes?00:12
nibalizerwhat about a buildr that runs before beaker-rspec that uses sudo jenkins to install the key in root's authorizd_keys file?00:13
clarkbnibalizer: then you may need to ssh in first, copy contents of authorized keys, then run rspec beaker00:13
*** yamahata has quit IRC00:13
clarkbya00:13
nibalizerokay cool00:13
nibalizerthis is like, going to work00:13
* nibalizer pretty excited00:13
*** lcheng has quit IRC00:14
*** melwitt has quit IRC00:14
clarkbjeblair: fungi mordred sdague jhesketh I don't think I am up for babysitting trusty tonight but if 102062 and 102063 could get reviewed between now and tomorrow morning that would be excellent as I can babysit tomorrow00:15
jeblairnibalizer: why are there two nodes involved?00:15
clarkbif you don't +A I definitely will :)00:16
clarkband now time to walk home back in a bit00:16
morganfainbergclarkb: have a good walk00:17
*** gokrokve has quit IRC00:17
nibalizerjeblair: i'm trying to integrate the puppet testing framework into our stuff00:19
nibalizerhttps://github.com/puppetlabs/beaker00:19
jeblairnibalizer: why does it need two nodes though?00:19
nibalizerit wants to be in charge of things, such as deciding what to run on what nodes, so an easy way to let it do that is to leverage the multinode stuff thats in nodepool, give beaker a control node to run from, then let it run stuff on the other node00:19
jeblairnibalizer: i agree that will work, but it sort of sounds like we have a job control system (jenkins) running a job control system (beaker) running jobs...00:20
jeblairnibalizer: why not just "sudo run beaker thingy" in the job?00:20
nibalizerjeblair: i agrees00:20
*** rlandy has quit IRC00:21
nibalizerwell becaues it wants to be in charge of things00:21
clarkbya my suggestion was to docker or similar00:21
jeblairnibalizer: can beaker not run locally?00:21
*** matsuhashi has joined #openstack-infra00:21
*** maxbit has joined #openstack-infra00:21
clarkbas it separates concerns a bit00:21
nibalizerits not designed to00:21
nibalizeryou might be able to trick it with some kind of a 'ssh localhost'00:22
jeblairnibalizer: is beaker anything more than a framework for running tests on another host?00:22
*** achanda has quit IRC00:22
*** markmcclain1 has quit IRC00:22
nibalizernot really00:22
nibalizerit does a ton of the stuff we already do with other tools00:22
*** hogepodge_ has joined #openstack-infra00:23
jeblairnibalizer: okay, so why not focus on just running the things that beaker would run, but without beaker?00:23
*** nati_ueno has joined #openstack-infra00:23
*** hogepodge has quit IRC00:23
*** hogepodge_ is now known as hogepodge00:23
clarkbbecause then you make puppeteersmad00:23
jeblairclarkb: ?00:23
clarkbits their standard tool00:23
jeblairclarkb: "it's their standard tool" is not something we accept for anything else :)00:24
clarkband runs on a laptop00:24
*** achanda has joined #openstack-infra00:24
nibalizerso unified testing is good00:24
jeblairput another way -- we have a fairly comprehensive system that distributes test jobs to cloud-based slaves -- i want to make sure we're not duplicating effort00:24
nibalizerin infra/config we have a few moudles that were forked some time ago from puppetlabs00:24
nibalizerif we standardize on the same testing language (theirs) then we can commit up and suck down much easier00:25
*** _nadya_ has quit IRC00:25
jeblairnibalizer: what sort of things does beaker do that we're already doing?00:26
nibalizerso beaker is a laptop developers tool, let me be clear about that00:26
nibalizerbut it sortof handles nodepool, since it provisions and destroys nodes for testing00:27
jesusaurusyeah, in the case of puppet modules its about doing what upstream does (for forked modules) and what the community at large does (for original modules) IMO00:27
nibalizerit does the actual connecting into the machine on runnning the tests00:27
jeblairnibalizer: what are the tests that are eventually run (since beaker isn't a test tool itself)?00:27
nibalizerthe tests are written in beaker-rspec's special syntax00:27
jeblairnibalizer: beaker-rspec link?00:27
nibalizerand it allows you to stop execution on first failure, ssh into the vm and poke around to figure out what went wrong00:27
jeblairrspec is the actual test thingy that we want to run?00:28
nibalizerhttps://github.com/puppetlabs/beaker-rspec00:28
*** timrc is now known as timrc-afk00:28
nibalizeralso if we want to, i could pull in some of the knowlegeable puppet people00:28
nibalizerwho could answer some of these questions better00:28
nibalizerbut i think they're all at home or at laest not at work00:29
nibalizersince most of them work the PDT day00:29
jeblairnibalizer: maybe later; i'd like to join them soon :)00:29
nibalizerya i was proposing that for tomorrow or wednesday00:29
nibalizeranyways i agree that it has some nastyness00:30
jeblairnibalizer: so food for thought: i don't want to run things that overlap with existing tools (eg, zuul, nodepool, jenkins), and i don't want to have control nodes for tests if we don't need them (nodes are a scarce resource)00:30
clarkbso fwiw beaker needs to spin up "VM"s gor testing00:30
*** lcostantino has quit IRC00:30
clarkbtempest does too00:30
jeblairnibalizer: but i'm very keen on running tests :)00:30
clarkbI dont think that is problematic00:30
nibalizerbut beaker-rspec testing is super sweet, it allows the you to run your tests and  then do arbitrary checks00:30
jeblairnibalizer: what kind of arbitrary tests?00:31
clarkbI see beaker and tempest as having logical overlap00:31
nibalizerlike 'is proccess runnning' 'did this commaend exit 0' 'does this file contain a string matching this regex'00:31
jeblairclarkb: tempest does that because it's testing a cloud.  our puppet is not a cloud.00:31
*** marcoemorais has quit IRC00:31
clarkbbut beaker + docker may be a better fit00:31
clarkbit tests a cloud of our puppet00:31
clarkbmake a jenkins zuul gerrit talk to each other sort of thing00:32
jeblairnibalizer: those are useful tests -- is beaker the only way to do those kinds of tests?00:32
nibalizerjeblair: absolutely not00:32
nibalizerjesusaurus: and i hav both indpenedntly written a thing like that00:32
jeblairnibalizer: can you use rspec alone to do those kinds of checks?00:32
nibalizerbut there is a big advantage to getting all the wood behind one arrow00:32
* jeblair wonders about a test framework that doesn't support checking outcomes00:33
nibalizerthe puppet ecosystem has been meandering from one testing system to the other for years00:33
clarkbI mean if you go that route just dont use rspec00:33
clarkb(its terrible)00:33
nibalizerand this is really getting bite, and supports all the things you could want00:33
nibalizerjeblair: what doesn't support checking outcomes?00:34
ianwjeblair: a question on scenarios in nodepool/tests/* ... do you know off hand if they guaranteed to run in the order listed?  i want to test round-robin behavior so later scenarios will depend on earlier ones00:34
openstackgerritA change was merged to openstack-infra/config: Groups portal infra code refactor  https://review.openstack.org/9948100:34
nibalizeranyways i have to step away from the keyboard00:34
nibalizerill be back online in a bit00:34
clarkbianw no order is garuntted00:35
jeblairnibalizer: i won't; we should pick this up tomorrow...00:35
clarkbianw please dont write tests like that00:35
clarkbthey are hard to run and debug00:35
* fungi keeps tabs on the groups portal refactor puppetry00:35
clarkbeach one should be self contained00:35
jeblairnibalizer: i wouldn't recommend proceeding until we get on the same page about this00:35
*** sweston_ has quit IRC00:36
*** timrc-afk is now known as timrc00:36
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Makes a new repo for devstack documentation  https://review.openstack.org/10206900:36
*** markmcclain has joined #openstack-infra00:36
fungiianw: any test which depends on other tests is part of those other tests (they become one logical unit) so you shouldn't separate them because parallel execution and whatnot00:36
ianwclarkb / fungi : ok, thanks; wasn't sure if parallel execution happened at the test-case or scenario-within-a-test-case level.  i'll wrap it all up in a single, longer test00:39
anteayajeblair: have enough energy for a new infra-manual patchset?00:39
* anteaya asked hopefully00:39
jheskethclarkb: hmm, so I lost track a bit, but where did we end up with envinject? was the plan to still update the plugin?00:42
*** maxbit has quit IRC00:42
*** sweston_ has joined #openstack-infra00:42
fungijhesketh: the impression i got was that we should just put remaining inertia behind obsoleting our use of that plugin, but perhaps i misread00:43
*** markmcclain has quit IRC00:43
jheskethfungi: so the jenkins-gearman plugin needs to set up the envvars instead of envinject?00:44
jheskethie, the remaining work is patching jenkins-gearman?00:44
clarkbjhesketh: I think jeblair wants to remove it completely but we have to port a few jobs that use it first00:44
clarkbjhesketh: zaro had a list of jobs at one point. it is a short list and we can use a different env modifier plugin00:45
clarkbjhesketh: the gearman plugin does set up the env vars00:45
clarkbso it should just work00:45
*** e0ne has joined #openstack-infra00:45
clarkbproblem is env inject is putting its nose where it didn't belong and breaking us00:45
jheskethclarkb: oh, so perhaps it's a jenkins-gearman bug that caused the multiple lines to be wrong00:45
clarkbjhesketh: no its env inject00:46
clarkbI think00:46
clarkbbasically it globs itself to all the jobs00:46
clarkbregardless of you wanting it to or not00:46
jheskethperhaps we could update it in the mean time to get the swift stuff moving along?00:46
clarkbbut we can do more testing with jenkins-dev00:46
clarkbjhesketh: I am fine with that too00:46
jheskethjeblair: would you care if we updated envinject just to keep things moving with swift?00:47
*** e0ne has quit IRC00:48
*** otter768 has joined #openstack-infra00:48
*** maxbit has joined #openstack-infra00:49
nibalizerjeblair: okay i'll just push my stuff up so I don't lose it an we can sync up on this later00:51
openstackgerritSpencer Krum proposed a change to openstack-infra/config: First draft of enabling beaker tests to run  https://review.openstack.org/10207100:52
nibalizerserverspec: http://serverspec.org/00:52
nibalizeris what beaker(-rspec) ends up wrapping00:52
nibalizerand it has a local operation mode00:53
nibalizermaybe i can convince rspec(-beaker) to run in a local mode00:53
*** unicell1 has joined #openstack-infra00:56
*** sweston_ has quit IRC00:57
*** unicell has quit IRC00:57
fungihuh, tangential but one of my friends is a professor of computer science doing a data mining/linguistic analysis study of free software irc channels and technical mailing lists tracking use of insulting language and profanity. she mentioned in passing that her preliminary data shows openstack as a very civil project, by comparison ;)00:57
*** dkehn has joined #openstack-infra00:57
*** yamahata has joined #openstack-infra00:58
*** wenlock has quit IRC00:59
fungii'm assuming she measures us all against theo de raadt and linux torvalds ;)00:59
fungis/linux/linus/00:59
fungi(silly fingers)00:59
mroddenthats what i keep telling people that complain about projects not accepting their ideas and patches...01:02
clarkbcivil? does that mean we need to throw more food at each other?01:02
mroddeni mean... 2 minutes on the linux kernel ML and that should be enough to realize01:02
*** chuckC has quit IRC01:02
anteayafungi: yay01:03
anteayaclarkb: no01:04
anteayacivil workable comfortable to newcomers01:04
lifelessanteaya: YHBT.01:04
anteayayou don't want to be ruining good brisket and beer now do you01:04
* anteaya looks up YHBT01:04
*** annegent_ has joined #openstack-infra01:05
anteayaoh I am trolled all the time01:05
anteayaand I make a boring mark01:05
fungii think lifeless must have a belt buckle which says "yhbt"01:05
anteayaone of those big obnoxious cowboy ones01:06
*** maxbit has quit IRC01:06
*** sarob has quit IRC01:06
*** ildikov has quit IRC01:06
anteayamy father trolled me all the time01:06
anteayaI just kept asking questions until he realized how borking I am as a troll mark01:06
lifelessfungi: I should totally get one01:06
*** sarob has joined #openstack-infra01:06
anteayastill works01:06
lifelessfungi: since I can actually wear jeans again...01:06
anteayas/borking/boring01:06
fungilifeless: you need it for $next_summit01:07
*** morganfainberg has quit IRC01:07
*** morganfainberg_Z is now known as morganfainberg01:07
mroddenso is there any testing done on puppet changes in config?01:08
mroddene.g. i want to add new dependency package that gets pulled in, how do we know it doesn't blow up gate until its actually in?01:08
clarkbmrodden: we have puppet apply tests in noop mode01:09
fungimrodden: we have the vestiges of a puppet apply job which just tries to apply all our modules to a jenkins slave01:09
fungiot01:09
mroddennoop mode?01:09
fungiit's non-voting at the moment, and somewhat broken01:09
mroddenok01:09
funginoop, yeah01:09
mroddenso its trying anyways01:09
fungiwe're heading that direction01:10
mroddenok01:10
fungispeaking of which...01:10
*** annegent_ has quit IRC01:10
mroddeni ran into a similar problem today, so was wondering how -infra deals with that01:10
fungimrmartin's groups-dev deployment changes are still somewhat broken... change from notrun to 0 failed: /usr/bin/drush dsd-init @groupsdev /srv/downloads/groups-latest.tar.gz returned 1 instead of one of [0] at /opt/config/production/modules/drupal/manifests/init.pp:21501:10
fungimrodden: reactively, is the politest way i can describe it01:11
mrodden:)01:11
*** jyuso has joined #openstack-infra01:11
*** yaguang has joined #openstack-infra01:11
*** sarob has quit IRC01:11
ianwfungi: not many people probably work on openstack as a side-project/fun though?  when it's part of $DAYJOB maybe that keeps you nicer01:12
fungiianw: some of us intentionally found a $dayjob where we could do the side-project/fun we always wanted01:13
mroddenAFAIK linux is pretty corporate driven...01:13
mroddenbut the lead guys wear the right hats01:14
mroddenjust look at all the kernel module drivers...01:14
fungiyeah, i suspect that the corporate affiliation across the linux developer codebase looks roughly like openstack's01:14
anteayamrodden: you used a very interesting word there01:14
anteayaguys01:14
anteayaI wonder what the numbers say when corelated with gender composition in the projects01:15
mroddenits a midwestern thing01:15
mroddenno gender bias intended01:15
fungithe american midwest. where men are guys and women are guys too01:16
mrodden:)01:16
anteayano I am serious01:16
mroddenyeah01:17
anteayaI am curious what your friend would see if she corrolated language with gender compostion of a project01:17
mroddenlooking at linux heirarchy right now...01:17
anteayafungi: ^01:17
pleia2mrodden: re: puppet changes & reactively, we also have puppetboard.o.o so when a merge does go sideways, anyone can see why without logging in01:18
openstackgerritA change was merged to openstack-dev/pbr: Restore Monkeypatched Distribution Instance  https://review.openstack.org/10178501:19
fungianteaya: she actually commented on that as well, but doesn't have hard numbers. she's probably going to write up some sort of update for ggstem.wordpress.com on gender bias in free software, but said that overall she doesn't find disproportionately misogynistic or otherwise gender-specific slurs/insults to be especially common. that of course says nothing for gender-assuming speech01:19
anteayainteresting01:19
anteayaI would very much like to see the write up when it occurs01:19
anteayathanks for the link01:19
anteayaand interesting inital findings so far01:19
ryanpetrellofungi: any idea if https://bugs.launchpad.net/openstack-ci/+bug/1332716 has been “upgraded on all Jenkins masters” ?01:20
uvirtbotLaunchpad bug 1332716 in openstack-ci "gearman plugin registers all labels for jobs on node with subset of labels" [Critical,Fix committed]01:20
*** UtahDave has quit IRC01:20
fungiapparently the insults she's tracking seem to be overwhelmingly gender neutral and not specifically targeted to womev vs men01:20
fungis/womev/women/01:20
anteayacool01:20
anteayawell actually I'm not sure01:20
fungiryanpetrello: clarkb just finished a little while ago, i believe01:21
ryanpetrellobecause I’m still seeing “NOT REGISTERED” for certain pecan CI builds01:21
anteayaI wonder about the effect of the insulting language01:21
ryanpetrelloe.g., https://review.openstack.org/#/c/94244/01:21
clarkbryanpetrello: fungi that isnt the complete fix01:21
pleia2even having spent a lot of time working with Ubuntu (known for being friendly), OpenStack does tend to be the project I point to when I talk about the most comfortable foss project I've ever worked in, I assumed ianw's observation (most of us are paid)01:21
anteayasince when I selected openstack, part of my choice was based on language in channel01:21
ryanpetrelloclarkb: okay, I will exercise some patience and stop bugging you01:21
clarkbit enables the fix which is making zuul choose all the nodes01:21
anteayaotherwise I wouldn't have decided to work on the project01:21
dstufft0.01:21
clarkbthat is up for tomorrow01:21
ryanpetrelloclarkb: okay, thank you :)01:22
clarkbryanpetrello: thank you for your patience01:22
fungidstufft: 0. a  robot may not harm humanity, or, by inaction, allow humanity to come to harm.01:22
StevenKfungi, anteaya: My high school physics teacher forgot to look over the class list before the first class, so he walks into the class and says "Hi guys ... Er, where guys is a general neutron team refering to both sexes, of course."01:22
clarkbryanpetrello: it is for a good cause I promise (going to move the default etsting to trusty so that we get all the shinies)01:23
ryanpetrelloclarkb: pfffffft, I think this is the third time I’ve asked today, I wouldn’t call that patient01:23
ryanpetrello:)01:23
anteayaStevenK: yeah, guys is never genderal neutral for me01:23
*** crc32 has quit IRC01:23
ryanpetrellothanks for all you do :D01:23
clarkbryanpetrello: well you haven't promised to find where I liev and make me fix it yet01:23
ryanpetrellohaha01:23
anteayaI know I am told it should be, but my gut never feels it is01:23
pleia2hehe01:23
clarkbryanpetrello: I may end up renaming those jobs. I assume this is ok as long as the job itself doesn't change?01:24
clarkbryanpetrello: basically zuul needs some way of knowing that those jobs should run on centos6 ( I believe centos6) so I may add a -centos6 to the naem01:25
ryanpetrellookay, I don’t think that should cause any issues01:25
ryanpetrello(that I know of)01:25
clarkbya I wouldn't expect it to01:25
jerryzclarkb: if you get the time, could you please take a look at this little patch to create a project? thanks!01:26
*** mbacchi has quit IRC01:26
jerryzclarkb: https://review.openstack.org/#/c/99727/01:27
camunozping pleia201:30
pleia2camunoz: hey there!01:30
pleia2camunoz: no delayed airplanes today :) I'm ready when you are01:30
camunozhi Elizabeth.. excellent! I'm ready now. Should we do this on this channel?01:31
*** yshao has joined #openstack-infra01:31
pleia2camunoz: sure01:31
pleia2so I have this: https://etherpad.openstack.org/p/zanata-install01:31
yshaocamunoz, i am here01:31
anteayawell I am soon shutting down01:32
pleia2started with http://zanata.org/download/ and just wanted to see about first getting the most basic pre-configured JBoss AS 7 but couldn't even manage that01:32
pleia2anteaya: have a nice evening01:32
camunozpleia2, yshao has also joined the channel. He is my supervisor and he's also very interested in helping out wherever he can01:33
pleia2welcome yshao01:33
yshaopleia2, good evening i guess?01:33
camunozpleia2, ok... which part did you have trouble with?01:33
pleia2yshao: yes :) good morning to you01:33
pleia2camunoz: so if you go to line 24 in the etherpad, you can see what commands I issued, I wonder if I'm missing something01:34
yshaopleia2, i am now based in Westford, great to know you!01:34
pleia2yshao: oh yes! so later evening then ;)01:34
*** rfolco has quit IRC01:34
pleia2camunoz: pretty much ends at line 5801:35
pleia2I then tried pretty much the same thing on a Centos6 box with similar results01:35
camunozwell, looks like you got it all installed01:35
camunozpleia2, now just cd to JBOSS/bin01:36
pleia2is that what "null" means? :)01:36
pleia2k01:36
camunozpleia2, yeah... there might be some housekeeping needed on that script :)01:36
fungii assume this is a literal "null" (java equivalent of void or None), rather than just not getting any output?01:36
pleia2camunoz: so probably I want to cd into zanata-server/bin ?01:37
*** ramashri has quit IRC01:37
camunozyes.01:37
jeblairjhesketh, clarkb: 99% of the remove-envinjectwork is done, we should just finish that and remove.  it's like 5 mins of typing to fix the remaining jobs01:37
*** mriedem has joined #openstack-infra01:38
camunozthere should be a run-zanata.sh script01:38
jheskethjeblair: is there a list somewhere or something I can work from to get it done?01:38
*** amcrn has quit IRC01:38
jeblairjhesketh: basically "grep inject" in the jjb directory, and move what you find to "source foo" lines inside the builders01:39
jheskethokay, I'll take a look after I finish reviewing your zuul changes :-)01:39
jeblairjhesketh: if there are maven jobs, they will need to be converted to freestyle jobs (which is a teensy bit more work)01:39
jeblairjhesketh: cool, thx.  i'm returning to afk now :)01:40
camunozpleia2, you just need to run the run-zanata.sh script01:40
jheskethno worries, seeya!01:40
jhesketh(also welcome back from your trip, even though it's been a bit)01:40
camunozI just talked to one of my guys about the instructions missing that bit at the end01:40
pleia2camunoz: no run-zanata.sh script, run.sh tells me to read the readme, which tells me standalone.sh, but there is also start-zanata.sh01:40
camunozpleia2, yah, start-zanata.sh!01:41
pleia2ok, I'll run that one :)01:41
*** Sukhdev has quit IRC01:41
camunozpleia2, you should see some logging about Zanata creating the database01:41
* pleia2 nods01:42
pleia2http://15.126.233.162:8080/zanata/01:43
pleia2huzzah!01:43
camunozexcellent!01:43
* fungi sees an interface01:43
*** chuckC has joined #openstack-infra01:43
pleia2alright, I was just missing some instructions01:43
camunozyeah, that's our fault though... .we'll get those corrected asap01:44
pleia2thank you01:44
*** nosnos has joined #openstack-infra01:44
pleia2now, I don't actually want to use this bundled thing, so I'll start this over with a proper version of jboss and https://github.com/zanata/zanata-server/wiki/Installation-Guide01:44
camunozbtw... I was emailing with Mark McLoughlin the other day01:44
pleia2ah good, mordred said he was going to chat with him re: licensing01:45
*** e0ne has joined #openstack-infra01:45
pleia2we're real sticklers for not requiring licenses to run our stuff around here since we want our infrastructure to be reproducable for other companies/projects who want to use it, so I think it's a broader discussion01:45
fungipleia2: i like to require free software licenses, personally ;)01:46
pleia2er right, not paid licenses :)01:46
pleia2it's all still open source01:46
camunozok... well you partly answered a question I had there01:46
*** e0ne has quit IRC01:46
yshaopleia2, if EAP subscription is your concern, i probably could help on something for openstack to be worry free?01:47
camunozwe mainly target EAP as it's stable and supported... as opposed to wildfly's moving target01:47
*** e0ne has joined #openstack-infra01:47
fungiyshao: it's more that we want to document and automate deployment which can be freely reused by others, so unless it's transitive...01:47
pleia2yshao: the trouble is that it's not just for us, it's for other projects and companies who use similar infrastructures, we want to be as free as possible01:47
*** signed8bit_ZZZzz is now known as signed8bit01:48
*** mattoliverau has quit IRC01:48
pleia2camunoz: I can certainly understand that from a development+support perspective01:48
yshaofungi, pleia2 ok, understand, it is just we have been using more stable version of EAP for long01:48
*** signed8bit has quit IRC01:48
camunozabsolutely01:49
*** salv-orlando has quit IRC01:49
camunozwe have someone working on wildfly support and have made some progress there.... but there might be some wrinkles to iron out01:49
yshaofungi, pleia2 i can still try to ask Red Hat legal a little bit on the subscription if you guys think you could still consider EAP?01:50
pleia2camunoz: good to know, I think earlier I was just looking at JBoss AS 7.1.1 since I wasn't familiar with wildfly until you mentioned it01:51
*** mattoliverau has joined #openstack-infra01:51
fungiyshao: right. it's hard to make free software when it's built on a foundation of proprietarily-licensed components. as a project openstack takes a fairly rigid stance (like debian or openbsd) on not consuming/recommending software unless it's free of any restrictions against reuse/redistribution beyond those which are typical of copyleft licenses01:51
*** e0ne has quit IRC01:52
camunozpleia2, that's what the server zip you downloaded is really... AS7 with a few extra modules.... and that's really what wildfly deployment will involve... some extra configuration steps01:52
yshaofungi, totally understand01:53
*** nati_ueno has quit IRC01:53
fungiyshao: so i don't think getting an openstack community exemption from licensing is likely to be of much help in this situation. red hat shifting its business model around jboss to release non-crippled versions under entirely free licenses would be more helpful01:53
*** Ryan_Lane has quit IRC01:54
fungior getting the freely-licensed jboss up to the level needed for zanata to function well would be an alternative there01:54
yshaofungi, red hat is not intentional to make free version bad, but to go through extra testing etc to make EAP better in this case, more stable01:55
fungithough i think markmc is aware and working from his end to help on that too01:55
pleia2thanks camunoz and yshao, now that I know what an up and running system looks like, I'll poke around with wildfly and AS7 and see where I end up01:55
camunozfungi, absolutely... it's not so much wildfly not being up to par... it's more that it differs slightly from EAP and we need to spend the time to keep it up to date with the latest changes in widlfy as they happen01:55
pleia2fungi: thanks for jumping in here :)01:56
camunozpleia2, thanks! let me know if you have any questions... I will keep you up-to-date on any progress we make on that front01:56
yshaoright, we need time to make free version into a stable stage01:56
mordredclarkb, fungi: mordred@camelot:~/src/openstack-infra/config$ ::Slave_db]): Could not look up qualified variable 'mysql::params::server_package_name'; class mysql::params has not been evaluated at /opt/build_git/openstack-infra/config/modules/openstack_project/manifests/slave_db.pp:9^[[0m01:56
fungiyshao: right, i don't think red hat is being negligent or anything, just that they need to understand when some of their free software is indirectly depending on their not-as-free software01:56
mordred(or nibalizer )01:57
pleia2camunoz: will do, I'm out of the office tue-thursday this week, so I'll probably touch base next week01:57
yshaofungi, good point though01:57
mordredyshao: yes. what fungi just said. from everything I can tell, there is nothing going on that's intentionally bad for sure!01:57
yshaomordred, sure01:57
camunozfungi, pleia2 thanks for your time. I'll be in touch with news on the mailing list01:57
pleia2camunoz: great, thank you01:58
yshaopleia2, fungi mordred do you guys have any "deadline" on this?01:58
mordredthanks for connecting with us here! we really appreciated it01:58
pleia2yshao: sooner is better as we're seeking to replace transifex, but this has been a very long process already01:58
mordredyshao: well, the other thing we're using isa  service that was open source and has now decided to stop being open source01:58
mordredbut yeah - what pleia2 said01:58
yshaopleia2, fungi mordred, I want to make sure we are on the same page, so we could prioritize too01:58
yshaook01:59
*** jp_at_hp has quit IRC01:59
*** adrian_otto has joined #openstack-infra02:00
pleia2we were also evaluating pootle, but the translations folks really like zanata so I'd like to see this happen for them02:00
nibalizermordred: whats the source of that error you are getting?02:00
camunozpleia2, is the server zip good enough for the trail? or do would you want to run that on wildfly?02:00
clarkbmordred: you need to include mysql::params02:00
camunozpleia2, *trial02:00
yshaopleia2, good, anyway for camunoz to have the server access, so we could speed up the process?02:01
mordrednibalizer: https://review.openstack.org/#/c/90565/8/modules/openstack_project/files/nodepool/elements/slave-db/post-install.d/99-install-databases02:01
pleia2camunoz: good question, we could probably get away with the zip for now, but I'd need others to chime in02:01
yshaoto help on speeding up the process02:01
mordrednibalizer: which is calling https://review.openstack.org/#/c/98586/4/modules/openstack_project/manifests/slave_db.pp02:01
mordrednibalizer: I _think_ I just need to put an "include mysql" or "include mysql::params" into slave_db.pp02:02
mordrednibalizer: but I'm not 100% sure02:02
clarkbmordred: ya I think you need to do that02:02
pleia2yshao: right now it's just running on an hpcloud vm not tied directly to -infra yet, happy to give access, just give me an ssh key02:02
yshaopleia2, yeah, this would us to identify the problems more easily02:03
mordredclarkb: does "include mysql::params" have any side effects? Should I instead make a class that inherits from mysql::params to do something?02:03
yshaocamunoz, so, probably send the email over to pleia2 next?02:03
pleia2and all of our infrastructure is open source, so even once we get it running "properly" we are able to delegate access to anyone we trust with helping us (like you fine folks!)02:03
pleia2a wikimedian maintains our wiki ;)02:04
clarkbmordred: they should be minimal in finding out what versions of things to use02:04
clarkbmordred: probably safe to direclty include it02:04
camunozyshao, yup.. I'll send her my ssh key02:04
mordredclarkb: cool02:05
mordredclarkb: I'll try that02:05
*** obelix1 has quit IRC02:07
*** mmaglana has joined #openstack-infra02:10
*** dstanek_zzz is now known as dstanek02:13
*** esker has joined #openstack-infra02:14
camunozpleia2, just sent you my public key... let me know if you have any problems with that02:14
pleia2camunoz: thanks, looks good02:14
camunozcool02:14
*** annegent_ has joined #openstack-infra02:15
pleia2camunoz: I'll follow up on the -infra mailing list (and Cc: you) with progress and will set up a test env to see how far I get with wildfly and add your ssh key there02:15
mordredpleia2: I agree we can probably get away with the zip for now02:16
mordredpleia2: we don't need perfect out of the gate -just a path to get there02:16
pleia2mordred: ok, that would be good02:16
*** sweston_ has joined #openstack-infra02:16
camunozok thanks... let me know when you get to the wildfly part... like I said, we already have some progress there and you shouldn't need to start from scratch02:16
pleia2camunoz: I didn't do the admin user setup stuff described at http://zanata.org/download/ - so I should probably go back adn do that and relaunch02:17
camunozyeah... I'm thinking since you want openid, we should also set that up02:17
*** sweston_ has quit IRC02:17
camunozpleia2, you can look at https://github.com/zanata/zanata-server/wiki/JAAS-Authentication for reference on that02:18
*** sweston_ has joined #openstack-infra02:18
pleia2camunoz: great, thanks02:18
camunozno problem02:18
jogocan we prioritize 10201502:20
jogoin the gate02:20
jogooh its at the top02:20
fungijogo: yeah, i re-promoted it just a bit ago02:21
jogofungi: cool thanks02:21
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from openstackid  https://review.openstack.org/10208602:22
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from gerrit-plugin-jobs  https://review.openstack.org/10208702:22
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from gerrit  https://review.openstack.org/10208802:22
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from javascript  https://review.openstack.org/10208902:22
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from groups  https://review.openstack.org/10209002:22
*** Ryan_Lane has joined #openstack-infra02:24
clarkbthe mirror is updated though02:25
clarkbso we should be good now02:25
clarkbjogo ^02:25
*** amcrn has joined #openstack-infra02:27
jogoclarkb: cool, because the patch just failed02:28
jogowith a https://jenkins05.openstack.org/job/gate-requirements-integration-dsvm/199/console02:28
jogoclarkb: thanks02:28
*** Ryan_Lane has quit IRC02:28
*** adalbas has quit IRC02:30
*** mestery has quit IRC02:31
*** mestery has joined #openstack-infra02:31
jheskethso... I don't know much (anything) about Maven... what would be required to get rid of it or at least its dependency on envinjet02:31
jhesketh*envinject02:31
*** pcrews has quit IRC02:34
nibalizermordred: ya i would add an 'inherits mysql::params' to that class02:35
*** sarob has joined #openstack-infra02:35
*** penguinRaider has quit IRC02:35
nibalizermake it look like class mysql (stuff=stuff) inherits mysql::params { stuff }02:35
nibalizerits the only place it is OK to use the inherits keyword02:35
*** amcrn has quit IRC02:38
mordrednibalizer: well, there's already a class mysq inherits mysql::params ...02:42
mordrednibalizer: but in openstack_project::slave_db - I should include mysql ? or include mysql::params02:42
*** mmaglana has quit IRC02:45
*** e0ne has joined #openstack-infra02:45
*** sweston_ has quit IRC02:48
*** e0ne has quit IRC02:49
*** mestery_ has joined #openstack-infra02:52
*** nosnos has quit IRC02:54
*** nosnos has joined #openstack-infra02:54
*** mestery has quit IRC02:55
*** praneshp has quit IRC02:55
*** nosnos has quit IRC02:59
*** mriedem has quit IRC03:02
*** e0ne has joined #openstack-infra03:02
*** nosnos has joined #openstack-infra03:05
*** ramashri has joined #openstack-infra03:07
*** e0ne has quit IRC03:07
*** amcrn has joined #openstack-infra03:07
clarkbjhesketh we use it to inject stuff into the env for gerrit and gerrit plugin builds iirc03:10
clarkbjhesketh zaro mentioned an alternate plugin to use but I forget the name03:11
jheskethclarkb: yeah my changes (above) should remove envinject for all projects except maven ones03:11
*** ramashri has quit IRC03:11
*** devkulkarni has joined #openstack-infra03:11
*** dims__ has quit IRC03:13
*** dstanek is now known as dstanek_zzz03:14
*** homeless has joined #openstack-infra03:14
*** ramashri has joined #openstack-infra03:14
mordredwoot03:15
*** matsuhashi has quit IRC03:18
*** matsuhashi has joined #openstack-infra03:19
*** zhiyan_ is now known as zhiyan03:19
*** dstanek_zzz is now known as dstanek03:19
*** sarob has quit IRC03:22
*** sarob has joined #openstack-infra03:23
*** matsuhashi has quit IRC03:24
*** sarob_ has joined #openstack-infra03:26
*** sarob has quit IRC03:27
*** esker has quit IRC03:32
*** nosnos has quit IRC03:34
*** talluri has joined #openstack-infra03:35
*** nosnos has joined #openstack-infra03:35
*** dstanek is now known as dstanek_zzz03:37
*** nosnos has quit IRC03:39
*** dims__ has joined #openstack-infra03:39
*** penguinRaider has joined #openstack-infra03:39
*** dims__ has quit IRC03:41
*** dstanek_zzz is now known as dstanek03:43
*** e0ne has joined #openstack-infra03:45
*** mfisch has joined #openstack-infra03:45
mfischdo you guys run the pastebin instance?03:45
*** annegent_ has quit IRC03:47
*** CaptTofu_ has quit IRC03:48
*** e0ne has quit IRC03:48
jheskethmfisch: yes03:49
mfischjhesketh: I just figured it out, I was having a heck of a time figuring out "no formatting" since it will not let me submit if I have the "no option" (top) selected. Finally found "Text only" after some looking03:49
jhesketh:-)03:50
*** annegent_ has joined #openstack-infra03:50
*** yaguang has quit IRC03:51
*** annegent_ has quit IRC03:51
nibalizermordred: oh yea03:52
nibalizerjust spam an 'include mysql' in the top of that somewhere03:52
nibalizeri dont know what i was thinking before03:52
*** todd_dsm has joined #openstack-infra03:52
*** michchap has quit IRC03:52
*** michchap has joined #openstack-infra03:52
*** sarob_ has quit IRC03:54
*** sarob has joined #openstack-infra03:55
*** sarob has quit IRC03:59
*** gnuoy has quit IRC04:00
*** jamespage has quit IRC04:00
*** gnuoy has joined #openstack-infra04:00
*** jamespage has joined #openstack-infra04:00
*** GheRivero has quit IRC04:04
*** penguinRaider has quit IRC04:04
*** davidlenwell_ has joined #openstack-infra04:04
*** GheRivero has joined #openstack-infra04:04
*** davidlenwell has quit IRC04:05
*** SlickNik has quit IRC04:05
*** SlickNik has joined #openstack-infra04:06
zarojeblair: i just review all your changes to remove envinject plugin.04:06
zaroopps i meant jhesketh: ^04:06
*** otter768 has quit IRC04:06
jheskethoh cool, somebody who knows something about it!04:07
jheskethI was just stabbing in the dark04:08
jheskethhmm, I only fixed builders :-(04:08
jheskethzaro: any suggestions on how to fix up the war publisher?04:09
*** matsuhashi has joined #openstack-infra04:10
*** dstanek is now known as dstanek_zzz04:10
*** Aleeious has joined #openstack-infra04:12
Aleeioushey04:12
zarojhesketh: only think i can think of right now is to use the envfile plugin.  which basically does the same thing as the envinject plugin.  not sure if you want to go that route04:12
Aleeioushow do i setup my database connection in php?04:13
*** r1chardj0n3s has quit IRC04:13
*** jamielennox is now known as jamielennox|away04:13
zarojhesketh: i guess another approach is to not use a war publisher, just publish with scp from shell?04:15
jheskethzaro: that's probably the preferred as we want to move away from jenkins one day04:16
jheskethI'll take a look04:16
jheskeththanks :-)04:16
zaronp04:16
Aleeiousdoes anyone everyone have access to my source code?04:16
*** nosnos has joined #openstack-infra04:19
*** ramashri has quit IRC04:21
Aleeious?04:21
*** ildikov has joined #openstack-infra04:22
jheskethzaro: oh the war publisher is actually a macro with scp04:23
*** yaguang has joined #openstack-infra04:23
Aleeiousany way to publish my source code?04:23
jheskethzaro: do you know if I export a variable in a shell builder if it is available to other publishers?04:25
zarojhesketh: no, it's not.04:25
*** sarob has joined #openstack-infra04:25
zarojhesketh: it's only available in the current shell.04:25
zaroAleeious: did you push something to gerrit?04:25
*** e0ne has joined #openstack-infra04:25
Aleeious:( then i should stick to github?04:26
Aleeiousgerrit?04:26
jheskethAleeious: what project are you trying to work on?04:26
Aleeiousaleeious an open source one04:26
*** yshao has quit IRC04:27
jheskethAleeious: is it an openstack project/04:27
Aleeiousyes04:27
jheskethAleeious: right, so OpenStack is made up of lots of programs/projects, is there one in particular you are working04:29
jheskethon04:29
Aleeiousyes aleeious04:29
*** radez is now known as radez_g0n304:29
jheskethoh right, that's the project name, sorry04:29
jheskethAleeious: I can't see that on git.openstack.org though04:30
Aleeiousbut i want to expose my source code to everyone04:30
jheskethoh, you want to start a new project?04:30
*** e0ne has quit IRC04:30
Aleeiousno i already did04:30
*** homeless_ has joined #openstack-infra04:30
*** sarob has quit IRC04:30
jheskethAleeious: oh, so your new project is probably in review?04:30
Aleeioushttp://dev-aleeious.rhcloud.com/04:31
Aleeiousdunno04:31
jheskethAleeious: right, so if this is an openstack project you can propose it as a new project on stackforge (http://ci.openstack.org/stackforge.html)04:32
jheskethotherwise if it's just an opensource project you might be better to look at github04:32
*** ildikov has quit IRC04:32
Aleeioushow do i setup my this seems very complicated compared to github04:33
*** homeless has quit IRC04:33
jheskethAleeious: this is only for projects relating directly to OpenStack (ie the OpenStack software), not for projects built on top of OpenStack04:34
jheskethif you are just building on top of OpenStack then yes, this is probably more complicated than what you need04:34
Aleeiousi just want people to access my source code like github04:34
jheskethyep, so if your project is just built on openstack (and isn't openstack software itself) then github is probably your easier bet04:35
Aleeiousopenstack can't expose source code?04:35
jheskethno, OpenStack is for managing your infrastructure04:36
*** todd_dsm has quit IRC04:37
*** talluri has quit IRC04:37
*** otherwiseguy has quit IRC04:38
Aleeiousok ty04:39
*** Aleeious has left #openstack-infra04:39
*** morganfainberg_L has joined #openstack-infra04:41
jheskethzaro: do you know where the scp sites are defined in puppet?04:41
*** dims has joined #openstack-infra04:42
*** gyee has quit IRC04:42
*** gokrokve has joined #openstack-infra04:44
*** dims has quit IRC04:47
zarojhesketh: the sites are in jenkins global config.  so i'm guessing it's probably where puppet sets up jenkins?  maybe jenkins.pp?04:48
jheskethta04:49
*** pcrews has joined #openstack-infra04:49
*** _nadya_ has joined #openstack-infra04:50
*** _nadya__ has joined #openstack-infra04:52
*** talluri has joined #openstack-infra04:52
*** _nadya_ has quit IRC04:52
*** devkulkarni has quit IRC04:55
*** nati_ueno has joined #openstack-infra04:58
*** r1chardj0n3s has joined #openstack-infra04:59
*** basha has joined #openstack-infra05:01
*** CaptTofu_ has joined #openstack-infra05:01
jogohttps://jenkins03.openstack.org/job/gate-nova-pep8/5075/console05:04
jogois that a new afilure ?05:04
*** praneshp has joined #openstack-infra05:04
jogojhesketh: anything going on with the git servers?05:04
jheskethjogo: not that I know of05:06
jogojhesketh: see the gate in zuul05:06
jheskeththat's a zuul merger that it failed to fetch from05:06
*** CaptTofu_ has quit IRC05:06
jogohttps://jenkins07.openstack.org/job/gate-python-keystoneclient-python27/304/console05:07
jheskethjogo: hmm, so I can fetch those refs myself05:08
*** praneshp_ has joined #openstack-infra05:08
jheskethI wonder if the network is wonky05:08
jogohmm possible05:08
jogoanyway its time to go AFK for me05:08
jogohave fun ;)05:08
jheskethlol, thanks05:08
*** _nadya__ has quit IRC05:08
jheskethI can't actually do much because I'm not root, but I'll have a poke05:08
jheskethhave a good evening jogo :-)05:09
*** gokrokve_ has joined #openstack-infra05:09
*** praneshp has quit IRC05:09
*** praneshp_ is now known as praneshp05:09
*** homeless_ has quit IRC05:10
*** gokrokve has quit IRC05:11
*** achanda has quit IRC05:11
*** achanda has joined #openstack-infra05:19
jheskethzaro: so I'm looking to see if we can replace the scp plugin with a shell script.. however I can't find where the scp global configuration for repository hosts is set (ie the hostnames, private keys, root destination paths etc) to figure out how to authenticate and push to various locations05:20
*** talluri has quit IRC05:22
*** talluri has joined #openstack-infra05:23
*** talluri has quit IRC05:23
*** talluri_ has joined #openstack-infra05:23
*** sarob has joined #openstack-infra05:26
*** basha has quit IRC05:28
*** ildikov has joined #openstack-infra05:28
*** amitpp has joined #openstack-infra05:29
*** sarob has quit IRC05:31
*** adrian_otto has quit IRC05:32
*** dstufft|laptop has quit IRC05:36
*** rwsu has quit IRC05:41
*** dims has joined #openstack-infra05:43
*** _nadya_ has joined #openstack-infra05:44
*** dims has quit IRC05:47
*** gcha has quit IRC05:49
*** _nadya_ has quit IRC05:50
*** morganfainberg_L has quit IRC05:51
*** sweston_ has joined #openstack-infra05:53
*** ihrachyshka has joined #openstack-infra05:54
*** ihrachyshka has quit IRC05:55
*** Longgeek has joined #openstack-infra06:01
*** Longgeek has quit IRC06:02
*** rdopieralski has joined #openstack-infra06:02
*** Longgeek has joined #openstack-infra06:03
*** talluri_ has quit IRC06:04
*** talluri has joined #openstack-infra06:05
*** talluri_ has joined #openstack-infra06:06
*** talluri has quit IRC06:06
*** basha has joined #openstack-infra06:07
*** gokrokve_ has quit IRC06:08
*** mrmartin has joined #openstack-infra06:14
*** mrmartin has quit IRC06:15
*** sweston_ has quit IRC06:15
*** r1chardj0n3s1 has joined #openstack-infra06:19
*** lcheng has joined #openstack-infra06:20
*** r1chardj0n3s1 has quit IRC06:20
*** harlowja is now known as harlowja_away06:20
*** r1chardj0n3s1 has joined #openstack-infra06:21
*** r1chardj0n3s has quit IRC06:21
openstackgerritDzmitry Horbach proposed a change to openstack-infra/jenkins-job-builder: Add support for Managed Script Plugin  https://review.openstack.org/9910906:23
*** r1chardj0n3s1 is now known as r1chardj0n3s06:26
*** sarob has joined #openstack-infra06:26
*** sarob has quit IRC06:31
*** markwash has joined #openstack-infra06:33
*** gcha has joined #openstack-infra06:38
*** lcheng has quit IRC06:39
*** praneshp has quit IRC06:40
*** doude has joined #openstack-infra06:42
*** dims has joined #openstack-infra06:43
*** dims has quit IRC06:48
*** CaptTofu_ has joined #openstack-infra06:49
*** skolekonov has joined #openstack-infra06:53
*** CaptTofu_ has quit IRC06:54
*** sarob has joined #openstack-infra06:56
ttxnotmyname, clarkb: sounds sane -- let me know if you need me. FWIW release managers is not just me: https://review.openstack.org/#/admin/groups/11,members06:58
*** r1chardj0n3s1 has joined #openstack-infra06:59
*** r1chardj0n3s has quit IRC06:59
*** r1chardj0n3s1 has quit IRC06:59
*** penguinRaider has joined #openstack-infra07:00
*** sarob has quit IRC07:01
*** amcrn has quit IRC07:02
*** r1chardj0n3s has joined #openstack-infra07:02
*** openstackgerrit has quit IRC07:10
*** mrmartin has joined #openstack-infra07:11
*** pblaho has joined #openstack-infra07:13
*** andreykurilin has joined #openstack-infra07:14
*** nati_ueno has quit IRC07:15
*** afazekas is now known as __afazekas07:17
*** gokrokve has joined #openstack-infra07:19
*** lyxus_ has joined #openstack-infra07:20
lyxus_Guys, what is the procedure if we hit a bug that is hurting a review ?07:21
*** jcoufal has joined #openstack-infra07:21
lyxus_in occurence https://bugs.launchpad.net/bugs/133341007:22
uvirtbotLaunchpad bug 1333410 in nova "Several nova unit tests failing related to IPs - sqla 0.9.5" [Critical,Confirmed]07:22
*** tnurlygayanov has quit IRC07:22
*** asettle has quit IRC07:23
*** tnurlygayanov has joined #openstack-infra07:23
*** gokrokve has quit IRC07:23
*** Hal_ has joined #openstack-infra07:23
*** asettle has joined #openstack-infra07:24
*** salv-orlando has joined #openstack-infra07:26
*** sarob has joined #openstack-infra07:26
*** sarob_ has joined #openstack-infra07:28
*** rm_work has quit IRC07:29
*** sarob has quit IRC07:31
*** ilyashakhat has quit IRC07:31
*** beekneemech has joined #openstack-infra07:32
*** bnemec has quit IRC07:32
*** ilyashakhat has joined #openstack-infra07:33
rgerganovjeblair, I hope the puppet code in https://review.openstack.org/#/c/95743/ is correct07:33
*** sarob_ has quit IRC07:33
*** rm_work has joined #openstack-infra07:33
rgerganovjeblair, please let me know if it needs revisit. thanks.07:33
*** hashar has joined #openstack-infra07:34
*** pblaho is now known as pblaho|afk07:34
*** r1chardj0n3s has quit IRC07:35
*** mrmartin has quit IRC07:38
*** andreaf has joined #openstack-infra07:39
*** achanda has quit IRC07:40
*** mrda is now known as mrda-away07:40
*** dizquierdo has joined #openstack-infra07:41
*** dims_ has joined #openstack-infra07:44
*** ihrachyshka has joined #openstack-infra07:45
*** afazekas has joined #openstack-infra07:46
*** dims_ has quit IRC07:49
*** pblaho|afk is now known as pblaho07:52
*** ociuhandu has joined #openstack-infra07:52
*** jpich has joined #openstack-infra07:55
*** lyxus_ has quit IRC07:56
*** otherwiseguy has joined #openstack-infra08:01
*** andreykurilin has quit IRC08:03
*** jp_at_hp has joined #openstack-infra08:05
*** otherwiseguy has quit IRC08:05
*** 17SAAJC6I has joined #openstack-infra08:07
*** 6JTAAH994 has joined #openstack-infra08:07
*** amitpp has quit IRC08:12
*** habib has joined #openstack-infra08:20
*** dtantsur|afk is now known as dtantsur08:24
*** lcheng has joined #openstack-infra08:26
*** sarob has joined #openstack-infra08:26
*** sergmelikyan has quit IRC08:28
*** bogdando has quit IRC08:29
*** sarob has quit IRC08:31
*** redixin has joined #openstack-infra08:32
*** bogdando has joined #openstack-infra08:32
redixinhi all. could you take a look please, is this an error? https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/jenkins_job_builder/config/devstack-gate.yaml#L873 and https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh#L21708:33
*** jcoufal has quit IRC08:33
redixinDEVSTACK_GATE_TEMPEST_NOVA_V3_API and DEVSTACK_GATE_KEYSTONE_V308:33
*** redixin is now known as rediskin08:34
*** jcoufal has joined #openstack-infra08:34
srenatusrediskin: why?  the declared env variable is used here, https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh#L23008:35
rediskinoh, yes, line 23008:36
rediskinbut without _API at the end08:37
rediskinin infra-config this variable named DEVSTACK_GATE_TEMPEST_NOVA_V3_API08:37
*** jlibosva has joined #openstack-infra08:37
*** CaptTofu_ has joined #openstack-infra08:38
*** ominakov has joined #openstack-infra08:38
srenatusoh. indeed.  I have no real insight into the working here, so I'll just pretend I wasn't here ;)08:38
*** CaptTofu_ has quit IRC08:42
*** isviridov|away is now known as isviridov08:45
*** dims_ has joined #openstack-infra08:45
*** rediskin has left #openstack-infra08:46
*** rediskin has joined #openstack-infra08:47
*** salv-orlando_ has joined #openstack-infra08:47
rediskindear infra-cores, could you please merge it https://review.openstack.org/#/c/101570/ *_*08:47
*** salv-orlando_ has quit IRC08:48
*** salv-orlando_ has joined #openstack-infra08:48
*** salv-orlando has quit IRC08:49
*** salv-orlando_ is now known as salv-orlando08:49
*** dims_ has quit IRC08:50
*** denis_makogon has joined #openstack-infra08:51
*** _nadya_ has joined #openstack-infra08:52
*** hashar has quit IRC08:55
*** _nadya_ has quit IRC08:57
*** pblaho is now known as pblaho|afk08:59
*** _nadya_ has joined #openstack-infra09:00
*** jdahlin has quit IRC09:07
*** pblaho|afk is now known as pblaho09:08
*** ihrachyshka has quit IRC09:10
*** e0ne has joined #openstack-infra09:10
*** talluri_ has quit IRC09:15
*** talluri has joined #openstack-infra09:15
*** pelix has joined #openstack-infra09:16
*** unicell1 has quit IRC09:18
*** talluri has quit IRC09:20
*** rdopieralski has quit IRC09:24
*** sarob has joined #openstack-infra09:26
*** zhiyan is now known as zhiyan_09:28
*** talluri has joined #openstack-infra09:30
*** sarob has quit IRC09:31
*** enikanorov_ has quit IRC09:37
*** enikanorov_ has joined #openstack-infra09:38
*** amitpp has joined #openstack-infra09:41
*** Longgeek has quit IRC09:45
*** Longgeek has joined #openstack-infra09:45
*** dims_ has joined #openstack-infra09:46
*** Longgeek has quit IRC09:46
*** Longgeek has joined #openstack-infra09:47
oomichihi, I'd like to know how to configure the gate test. does someone know the repository?09:47
oomichinow check-tempest-dsvm-nova-v3-full does not work fine, and I want to fix it.09:47
*** openstackgerrit has joined #openstack-infra09:47
oomichithat is an experimental job.09:48
SergeyLukjanovmorning folks09:48
SergeyLukjanovI'm reading scrollback09:48
rediskinoomichi: please take a look https://review.openstack.org/#/c/102149/09:50
*** dtantsur is now known as dtantsur|lunch09:50
*** dims_ has quit IRC09:51
*** zehicle_at_dell has quit IRC09:51
oomichirediskin: perfect for me, thanks a lot !!09:51
*** Longgeek has quit IRC09:52
*** Longgeek has joined #openstack-infra09:53
*** rcarrillocruz has joined #openstack-infra10:00
*** roeyc has joined #openstack-infra10:02
*** rcarrill` has quit IRC10:03
*** lcheng has quit IRC10:04
*** ihrachyshka has joined #openstack-infra10:06
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Publish ko_KR api-quick start  https://review.openstack.org/10217010:10
*** asselin has quit IRC10:17
*** nosnos has quit IRC10:19
*** nosnos has joined #openstack-infra10:19
*** habib has quit IRC10:21
*** matsuhashi has quit IRC10:23
*** matsuhashi has joined #openstack-infra10:24
*** nosnos has quit IRC10:24
*** amitpp has quit IRC10:24
*** HenryG has quit IRC10:25
openstackgerritIan Wienand proposed a change to openstack-infra/nodepool: Track last allocations to ensure forward-progress  https://review.openstack.org/10111010:25
oomichihi SergeyLukjanov10:26
*** CaptTofu_ has joined #openstack-infra10:26
*** sarob has joined #openstack-infra10:26
*** matsuhashi has quit IRC10:28
*** alexpilotti has joined #openstack-infra10:28
*** talluri has quit IRC10:30
*** CaptTofu_ has quit IRC10:31
*** jedimike has joined #openstack-infra10:31
*** sarob has quit IRC10:31
*** talluri has joined #openstack-infra10:31
*** e0ne has quit IRC10:33
*** markmc has joined #openstack-infra10:33
*** 6JTAAH994 has quit IRC10:33
*** talluri has quit IRC10:35
*** 17SAAJC6I is now known as tkelsey10:35
*** ihrachyshka_ has joined #openstack-infra10:38
*** zehicle_at_dell has joined #openstack-infra10:39
ianwsdage / dtroyer : https://review.openstack.org/#/c/102173/ (Use curl to download from github.com) what do you think about some sort of get_from_internet function?   it seems the workarounds might not always be implemented consistently10:40
*** ihrachyshka has quit IRC10:41
*** ihrachyshka_ is now known as ihrachyshka10:41
*** pblaho is now known as pblaho|afk10:41
*** yaguang has quit IRC10:44
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add bug for git.o.o going away  https://review.openstack.org/10218110:44
sdagueianw: the challenge is curl isn't in all our images, as I discovered yesterday10:45
*** alevine has joined #openstack-infra10:46
*** dims_ has joined #openstack-infra10:46
*** jyuso has quit IRC10:46
sdagueianw: though a standardized function would be good probably regardless, especially as it would be sent through the cache10:47
ianwsdague: ok, i'll look into it10:47
sdaguefetch_url .... which creates basename(url)10:47
sdaguein the cache10:47
*** salv-orlando has quit IRC10:48
alevineHi. Can anybody help with Workflow +1 in this review https://review.openstack.org/#/c/97795/  ?10:48
*** abhishek__ has joined #openstack-infra10:51
abhishek__hi10:51
*** lcheng has joined #openstack-infra10:51
abhishek__can any one tell me who uploads the latest packages used by various OpenStack services to http://pypi.openstack.org/openstack10:52
*** talluri has joined #openstack-infra10:53
openstackgerritA change was merged to openstack-infra/elastic-recheck: add bug for git.o.o going away  https://review.openstack.org/10218110:55
*** e0ne has joined #openstack-infra11:01
*** talluri has quit IRC11:02
*** talluri has joined #openstack-infra11:02
openstackgerritIan Wienand proposed a change to openstack-infra/nodepool: Track last allocations to ensure forward-progress  https://review.openstack.org/10111011:03
*** Longgeek has quit IRC11:03
*** ociuhandu has quit IRC11:05
*** lcheng has quit IRC11:06
*** talluri has quit IRC11:07
*** lcheng has joined #openstack-infra11:07
*** alexpilotti has quit IRC11:09
*** freyes has quit IRC11:11
*** zehicle_at_dell has quit IRC11:16
*** freyes has joined #openstack-infra11:17
*** Longgeek has joined #openstack-infra11:18
*** yamahata has quit IRC11:18
*** _nadya_ has quit IRC11:20
*** lcheng has quit IRC11:22
*** lcheng has joined #openstack-infra11:23
*** sarob has joined #openstack-infra11:26
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: added neutron flavor of the sqla bug  https://review.openstack.org/10218911:26
*** sarob has quit IRC11:31
*** pblaho|afk is now known as pblaho11:36
*** Longgeek has quit IRC11:38
*** Longgeek has joined #openstack-infra11:38
*** Longgeek_ has joined #openstack-infra11:39
*** salv-orlando has joined #openstack-infra11:39
*** Longgeek has quit IRC11:43
openstackgerritA change was merged to openstack-infra/elastic-recheck: added neutron flavor of the sqla bug  https://review.openstack.org/10218911:45
*** doug-fish has joined #openstack-infra11:46
openstackgerritDzmitry Horbach proposed a change to openstack-infra/jenkins-job-builder: Cloudbees Folder support  https://review.openstack.org/10219711:49
sdagueSergeyLukjanov: hey, this seems to have 2 +2s now, you feel like landing? https://review.openstack.org/#/c/96835/ ?11:50
openstackgerritA change was merged to openstack-infra/reviewstats: Pretty print projects/neutron.json  https://review.openstack.org/10136511:52
*** e0ne_ has joined #openstack-infra11:53
openstackgerritA change was merged to openstack-infra/reviewstats: add neutron-specs  https://review.openstack.org/10000111:54
SergeyLukjanovsdague, hey, approved11:55
sdagueSergeyLukjanov: thanks!11:55
*** e0ne has quit IRC11:56
*** weshay has joined #openstack-infra11:57
*** mbacchi has joined #openstack-infra11:57
openstackgerritDzmitry Horbach proposed a change to openstack-infra/jenkins-job-builder: Cloudbees Folder support  https://review.openstack.org/10219711:59
*** CaptTofu_ has joined #openstack-infra11:59
*** rfolco has joined #openstack-infra12:00
*** dkranz has joined #openstack-infra12:03
openstackgerritA change was merged to openstack-infra/config: add devstack-vagrant project to openstack-dev  https://review.openstack.org/9683512:07
*** rlandy has joined #openstack-infra12:07
*** timrc is now known as timrc-afk12:09
*** ociuhandu has joined #openstack-infra12:11
fungiabhishek__: these jenkins jobs copy them from pypi.python.org to pypi.openstack.org either daily or when invoked by e.g. a change merging to the openstack/requirements project or a library being tagged for release: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/mirror.yaml12:14
openstackgerritA change was merged to openstack-infra/config: Fix a typo in variable name  https://review.openstack.org/10214912:15
fungiabhishek__: the builder they call is defined at http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/mirror.yaml12:15
fungiabhishek__: and the tool it runs to build those mirror updates is maintained at http://git.openstack.org/cgit/openstack-infra/pypi-mirror/tree/12:16
*** timrc-afk is now known as timrc12:17
alevineSergeyLukjanov: Hi, could you possibly take a look at my review as well and give the Workflow +1 if ok? https://review.openstack.org/#/c/97795/12:17
*** dprince has joined #openstack-infra12:19
*** dtantsur|lunch is now known as dtantsur12:20
*** andreykurilin_ has joined #openstack-infra12:20
abhishek__fungi: thanks for the update12:22
abhishek__fungi: I have pushed a patch for updating websockify in nova12:23
abhishek__https://review.openstack.org/#/c/101906/12:23
abhishek__fungi: but Jenkins is failing as websockify 0.6 is not available on  http://pypi.openstack.org/openstack12:23
abhishek__fungi: could you please let me know how can I proceed on this?12:24
*** yaguang has joined #openstack-infra12:25
SergeyLukjanovjeblair, fungi, clarkb, fyi I've just approved https://review.openstack.org/#/c/100417/12:25
SergeyLukjanovto avoid auto rechecks for -1'd changes12:25
SergeyLukjanovalevine, it's on my backlog12:25
fungiabhishek__: openstack currently requires websockify>=0.5.1,<0.6 so unless you update the openstack/requirements project, we won't update the mirror to add anything outside that range... http://git.openstack.org/cgit/openstack/requirements/tree/global-requirements.txt#n12412:26
*** sarob has joined #openstack-infra12:26
abhishek__fungi: thank you12:27
fungiabhishek__: if you read the failure message left by jenkins on your change, you'll see it says "gate-nova-requirements http://logs.openstack.org/06/101906/2/check/gate-nova-requirements/6a119d8 : Incompatible requirement found; see https://wiki.openstack.org/wiki/Requirements "12:27
fungiabhishek__: i recommend reading that wiki page at a minimum12:27
abhishek__fungi: yes, i will go through it, actually this is first time I have submitted a patch for global requirement update,12:29
abhishek__fungi: i will keep this in mind and will follow the process hence forward12:29
*** sarob has quit IRC12:31
*** yaguang has quit IRC12:31
*** adalbas has joined #openstack-infra12:32
*** lcostantino has joined #openstack-infra12:33
*** andreykurilin_ has quit IRC12:37
vponomaryovfungi: hello, if you have time, could you please review this little change: https://review.openstack.org/#/c/97747/ ?12:38
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Adding Search endpoints and sqlalchemy impl  https://review.openstack.org/10147612:38
*** jedimike is now known as jedimike|afk12:40
*** jaypipes has quit IRC12:41
*** jaypipes has joined #openstack-infra12:43
*** yaguang has joined #openstack-infra12:44
salv-orlandosdague: there is something I’m missing in infra history - when did we revert the neutron jobs to serial?12:44
salv-orlandoand also - why did we do that?12:44
*** mwagner_lap has quit IRC12:45
*** changbl has quit IRC12:45
openstackgerritA change was merged to openstack-infra/config: Don't auto-recheck when last check was false  https://review.openstack.org/10041712:50
openstackgerritDan Prince proposed a change to openstack-infra/config: Run f20 jobs in experimental-tripleo  https://review.openstack.org/10221312:51
*** dstanek_zzz is now known as dstanek12:52
*** penguinRaider has quit IRC12:53
*** dizquierdo is now known as dizquierdo_out12:54
*** flaper87|afk is now known as flaper8712:54
salv-orlandosdague: ok, I saw the answer is that we actually never made them parallel after the big january outage12:54
* salv-orlando feels very happy about knowing that he has to do everything from scracth again12:55
*** jedimike|afk is now known as jedimike12:55
openstackgerritAbhishek Kekane proposed a change to openstack/requirements: Updated version requirement for websockify  https://review.openstack.org/10221512:56
*** oomichi has quit IRC12:57
*** julim has joined #openstack-infra12:59
*** mflobo has joined #openstack-infra13:00
openstackgerritThierry Carrez proposed a change to openstack-infra/release-tools: Add bug-deferral feature to process_bugs.py  https://review.openstack.org/10221813:00
*** yaguang has quit IRC13:03
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Revert "Fix a typo in variable name"  https://review.openstack.org/10222013:10
*** mfer has joined #openstack-infra13:11
*** andreaf has quit IRC13:13
*** dims_ has quit IRC13:13
*** dims_ has joined #openstack-infra13:14
*** bknudson has joined #openstack-infra13:17
*** yaguang has joined #openstack-infra13:18
*** Longgeek has joined #openstack-infra13:21
*** Longgeek_ has quit IRC13:22
*** yshao has joined #openstack-infra13:22
*** devkulkarni has joined #openstack-infra13:22
*** radez_g0n3 is now known as radez13:23
*** sarob has joined #openstack-infra13:26
*** mriedem has joined #openstack-infra13:29
*** pblaho_ has joined #openstack-infra13:30
*** pblaho has quit IRC13:30
*** annegent_ has joined #openstack-infra13:30
*** sarob has quit IRC13:31
*** adrian_otto has joined #openstack-infra13:33
*** dkliban is now known as dkliban_brb13:34
openstackgerritA change was merged to openstack-infra/config: Revert "Fix a typo in variable name"  https://review.openstack.org/10222013:35
mordredsdague: why don't we just install curl?13:38
*** pblaho__ has joined #openstack-infra13:41
*** pblaho__ is now known as pblaho13:41
*** mestery_ is now known as mestery13:42
*** pdmars has joined #openstack-infra13:43
BobBallthat's what I'm doing... in my images... dunno why wget sucks more than curl, but it seems to...13:44
*** _nadya_ has joined #openstack-infra13:45
*** pdmars has quit IRC13:45
*** pblaho_ has quit IRC13:45
*** pdmars has joined #openstack-infra13:45
*** jasondotstar has joined #openstack-infra13:47
*** yaguang has quit IRC13:50
*** lttrl has joined #openstack-infra13:50
*** hashar has joined #openstack-infra13:52
*** pblaho is now known as pblaho|afk13:52
*** pblaho|afk is now known as pblaho13:57
*** pblaho has quit IRC13:58
*** skolekonov has quit IRC13:59
*** esker has joined #openstack-infra14:00
*** annegent_ has quit IRC14:01
*** gokrokve has joined #openstack-infra14:01
*** flaper87 is now known as flaper87|afk14:01
*** yaguang has joined #openstack-infra14:02
*** homeless has joined #openstack-infra14:03
*** devkulkarni has quit IRC14:03
*** HenryG has joined #openstack-infra14:04
*** beekneemech is now known as bnemec14:04
*** salv-orlando has quit IRC14:05
*** signed8bit has joined #openstack-infra14:07
*** dizquierdo_out is now known as dizquierdo14:08
openstackgerritA change was merged to openstack-infra/release-tools: Fix wait_for_tarball.py reporting whl artifacts  https://review.openstack.org/10157314:08
*** abhishek__ has quit IRC14:09
*** devkulkarni has joined #openstack-infra14:09
openstackgerritJulien Vey proposed a change to openstack-infra/config: Add missing 'solum-specs' section in zuul layout  https://review.openstack.org/10224614:12
*** mwagner_lap has joined #openstack-infra14:12
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847914:15
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add additional node types to dib elements  https://review.openstack.org/9056514:15
*** craigbr has joined #openstack-infra14:17
*** markwash has quit IRC14:17
*** xchu has quit IRC14:17
*** Longgeek has quit IRC14:18
*** Longgeek has joined #openstack-infra14:19
*** lttrl has quit IRC14:21
craigbrping anteaya14:22
anteayadhellmann: when you get a chance can I get your feedback on this, the olso acl files patch? https://review.openstack.org/#/c/101361/14:22
anteayadhellmann: then I can review dims patches14:22
anteayahello craigbr14:22
craigbrhi anteaya14:22
*** rgerganov has quit IRC14:22
anteayahow is the day treating you so far?14:22
dhellmannanteaya: I meant to ask you about that yesterday. I wanted to propose some changes. Would it be easier for me to take over the patch, or give you comments?14:22
anteayadhellmann: either way14:22
anteayafeel free to offer a patchset14:23
dhellmannanteaya: ok, I'll put it on my list today14:23
anteayadhellmann: thanks14:23
craigbranteaya: can't complain. Another beautiful Colorado day14:23
anteayacraigbr: great glad to hear it14:23
craigbrHow is your day?14:23
anteayagood14:23
*** jpich has quit IRC14:23
anteayaraining this morning, I love the sound of rain14:23
anteayawhat should we start with today?14:23
*** esker has quit IRC14:24
craigbrI think the acl file would be a good place. I just guessed on that. Tried to follow murano14:24
anteayakk, let's work on that14:24
*** esker has joined #openstack-infra14:24
anteayawell start with some basics about gerrit queries14:24
craigbrok14:24
anteayalet's move to #openstack-dev14:24
craigbrok14:24
anteayasince we will likely get noisy14:24
craigbrhopefully14:25
*** otherwiseguy has joined #openstack-infra14:25
*** alexpilotti has joined #openstack-infra14:25
*** craigbr has quit IRC14:25
*** david-lyle has joined #openstack-infra14:26
*** sarob has joined #openstack-infra14:26
*** andreykurilin_ has joined #openstack-infra14:29
*** dkranz has quit IRC14:31
*** sarob has quit IRC14:31
*** sabeen has joined #openstack-infra14:33
*** zz_gondoi is now known as gondoi14:34
*** unicell has joined #openstack-infra14:34
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Normalize Gerrit ACL documentation  https://review.openstack.org/9306414:34
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Add a script to normalize Gerrit ACLs  https://review.openstack.org/9306514:34
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Strip/condense whitespace and sort Gerrit ACLs  https://review.openstack.org/9306614:34
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Get rid of unneeded tags create in Gerrit ACLs  https://review.openstack.org/9306714:34
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Remove active project.state in Gerrit ACLs  https://review.openstack.org/9306814:34
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Strip *.owner Administrators from Gerrit ACLs  https://review.openstack.org/9306914:34
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Sort exclusiveGroupPermissions in Gerrit ACLs  https://review.openstack.org/9307014:34
*** reed has joined #openstack-infra14:34
*** otherwiseguy has quit IRC14:35
*** jpich has joined #openstack-infra14:35
sdaguemordred: we could14:36
*** adrian_otto has quit IRC14:36
*** andreaf has joined #openstack-infra14:37
*** craigbr has joined #openstack-infra14:37
*** wenlock_ has joined #openstack-infra14:39
*** ominakov has quit IRC14:41
*** garyh has joined #openstack-infra14:41
*** rloo has joined #openstack-infra14:42
rloohi, hoping you guys can help. Jenkins seems to be upset with https://review.openstack.org/#/c/73005/. It is sending emails about 'Merge Failed'. Have gotten > 50 of them so far I htink.14:43
rlooAll I did was -2 that patch (it is my patch, don't know if that has anything to do with it). I've undone the -2, but I don't know if that will fix it or not.14:44
*** romcheg has joined #openstack-infra14:45
*** markmcclain has joined #openstack-infra14:45
rlooit looks to me like some sort of endless loop? Can you kill it or something?14:45
*** eharney has joined #openstack-infra14:45
romchegYeah, please help us all and kill it :)14:45
*** dkranz has joined #openstack-infra14:46
*** markmcclain1 has joined #openstack-infra14:47
*** devkulkarni has joined #openstack-infra14:47
*** romcheg has left #openstack-infra14:48
sdagueclarkb: hmmm... ES has gone off the rails again14:49
*** mflobo has quit IRC14:49
rlooHi, I 'abandoned' the patch, and Jenkins stopped going crazy.14:50
*** markmcclain has quit IRC14:50
openstackgerritRandy Coulman proposed a change to openstack-infra/jenkins-job-builder: Change default Reply-To header to $DEFAULT_REPLYTO.  https://review.openstack.org/7933114:50
fungirloo: it looks like it stopped once you abandoned the change14:51
fungirloo: i'm wondering whether https://review.openstack.org/100417 is to blame14:52
rloofungi: yes. Thank G*; the masses were getting annoyed.14:52
rloofungi: thx for looking into it. I was going to open a bug -- no need?14:52
*** devkulkarni has quit IRC14:52
rloofungi: the only thing I could think of is that I -2'd my own patch? I've -2'd other patches (not mine) w/o this problem. Or I was just lucky and something else is to blame.14:52
*** devkulkarni has joined #openstack-infra14:52
fungirloo: i think zuul is reacting to its own jenkins comments there, just trying to figure out what would cause it14:53
rloofungi: and the only other thing, was that there was a -1 in workflow at the same time as the -2. (But I think I've -2'd other patches with a -1 in workflow, not positive though.)14:54
*** achanda has joined #openstack-infra14:55
openstackgerritTerry Howe proposed a change to openstack/requirements: Update the version of keyring to avoid bug  https://review.openstack.org/9377014:56
*** miqui_ has joined #openstack-infra14:57
*** miqui has quit IRC14:58
*** morganfainberg_L has joined #openstack-infra14:58
*** nati_ueno has joined #openstack-infra15:00
*** andreykurilin_ has quit IRC15:01
*** chuckC has quit IRC15:01
*** james_li has joined #openstack-infra15:01
*** marun has joined #openstack-infra15:01
*** yaguang has quit IRC15:02
*** rloo has quit IRC15:03
*** ociuhandu has quit IRC15:04
*** alexpilotti has quit IRC15:04
*** maxbit_ has joined #openstack-infra15:05
*** achanda has quit IRC15:06
jeblairsdague, clarkb: i got a bunch of emails from rax indicating they were having problems with several hosts that host logstash worker instances (in case that has a bearing)15:06
*** virmitio has joined #openstack-infra15:07
sdaguejeblair: could be, it doesn't seem like anything else relates to it15:07
*** ociuhandu has joined #openstack-infra15:09
*** alexpilotti has joined #openstack-infra15:11
*** jcoufal has quit IRC15:11
*** miqui_ is now known as miqui15:11
*** rloo has joined #openstack-infra15:11
*** dkranz has quit IRC15:12
*** penguinRaider has joined #openstack-infra15:12
*** gokrokve has quit IRC15:14
*** andreykurilin_ has joined #openstack-infra15:16
*** sweston_ has joined #openstack-infra15:18
morganfainberg_Lmornin :)15:18
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Combine infra/ci core/admin gerrit groups  https://review.openstack.org/10227115:19
*** sarob has joined #openstack-infra15:19
rloolucasagomes, jroll: wrt the instance_info attribute. Just reading the spec. It isn't clear to me. How do you set eg 'root_gb'? if i do a 'nova node-create  ... -i root_gb=10, it shows up in driver_info.15:20
jrollwrong channel :)15:21
*** mriedem has quit IRC15:21
rloooops, wrong channel. jroll, you're fast!15:21
*** sarob has quit IRC15:22
*** sarob has joined #openstack-infra15:22
*** dkranz has joined #openstack-infra15:24
*** ihrachyshka has quit IRC15:24
*** dkliban_brb is now known as dkliban15:26
*** sarob has quit IRC15:27
*** rloo has quit IRC15:31
*** hashar is now known as hasharMeeting15:31
*** changbl has joined #openstack-infra15:32
*** freyes has quit IRC15:33
*** marun has quit IRC15:33
*** flaper87|afk is now known as flaper8715:36
*** marun has joined #openstack-infra15:37
*** freyes has joined #openstack-infra15:38
*** gokrokve has joined #openstack-infra15:39
*** gyee has joined #openstack-infra15:40
openstackgerritRandy Coulman proposed a change to openstack-infra/jenkins-job-builder: Add support for URLTrigger plugin  https://review.openstack.org/8352415:40
*** mriedem has joined #openstack-infra15:40
*** HenryG has quit IRC15:43
*** rloo has joined #openstack-infra15:45
*** asselin has joined #openstack-infra15:48
*** atiwari has joined #openstack-infra15:50
*** chuckC has joined #openstack-infra15:52
dhellmannmordred, krotscheck: I saw your questions about pecan error codes in the meeting room from yesterday. I thought if you raised the right kind of exception, the status code would be set for you. Does that not work?15:53
krotscheckdhellmann: I’d have to doublecheck with NikitaKonovalov on that.15:54
krotscheckdhellmann: Let me check the review....15:54
dhellmannkrotscheck: http://pecan.readthedocs.org/en/latest/routing.html#setting-a-return-status-code15:55
krotscheckdhellmann: I assume that works in hooks?15:55
dhellmannkrotscheck: 2 ways to do it, depending on how much detail you want in the response and if it's an error or not15:55
dhellmannkrotscheck: that's a good question, I'm not sure but I would expect it to15:55
*** basha has quit IRC15:56
*** andreykurilin_ has quit IRC15:56
krotscheckdhellmann: Well, let me doublecheck on that, we’ve got a review up that I can hack around on.15:56
dhellmannkrotscheck: ok, and ryanpetrello may have some more insight as well15:56
*** andreykurilin_ has joined #openstack-infra15:56
morganfainberg_Lclarkb, jeblair, SergeyLukjanov, mordred, fungi, quick follow up on https://review.openstack.org/#/c/101406/ (I promise not to bug you guys again till later this week on this), i am just trying to give enouhg time to get it adopted this cycle :)15:56
*** jedimike has quit IRC15:56
*** markmcclain1 has quit IRC15:57
morganfainberg_Lclarkb, jeblair, SergeyLukjanov, mordred, fungi, and thanks ahead of time :)15:57
*** yamahata has joined #openstack-infra15:59
openstackgerritA change was merged to openstack-infra/devstack-gate: Fix typo in DEVSTACK_GATE_TEMPEST_NOVA_V3_API  https://review.openstack.org/10191515:59
*** praneshp has joined #openstack-infra16:00
*** annegent_ has joined #openstack-infra16:00
*** adrian_otto has joined #openstack-infra16:01
*** annegent_ has quit IRC16:01
*** annegent_ has joined #openstack-infra16:01
*** sweston_ has quit IRC16:02
*** prad_ has joined #openstack-infra16:03
fungijeblair: clarkb: SergeyLukjanov: i'm trying to spot what caused zuul to go into a rapid-fire comment loop on https://review.openstack.org/73005 (wondering if it's somehow a side effect of 100417 which merged a few hours ago but if so the why escapes me)16:04
NobodyCamgood morning Infra16:04
*** freyes has quit IRC16:04
NobodyCamjust checking to see if anyone has a free minute to take a look at https://review.openstack.org/#/c/10006316:05
*** freyes has joined #openstack-infra16:05
*** basha has joined #openstack-infra16:06
*** marcoemorais has joined #openstack-infra16:08
*** sweston_ has joined #openstack-infra16:08
*** basha has quit IRC16:09
dhellmannanteaya: question about that acl change: Oslo doesn't really use milestone-proposed, so do we need that access section?16:10
SergeyLukjanovfungi, I don't see other CRs with comments loop16:10
fungiSergeyLukjanov: yeah, hopefully that isn't the herald of a coming army of comment loops on changes16:11
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Bring some uniformity to olso acl files  https://review.openstack.org/10136116:11
Shrewsfungi: there was one other. 1 sec....16:12
dhellmannanteaya: ^^ is a second patch using the same change id as your original, adding some libs you didn't have and tweaking some of what you proposed16:12
dhellmannanteaya: thanks for prodding me to get this done :-)16:12
Shrewsfungi: oh, nm. same one16:13
fungiafter the first comment trigger today with the -2 code review, they're all reacting to the jenkins comments being added16:13
anteayadhellmann: if you don't use milestone-proposed I would advocate for getting rid of it16:14
fungithere isn't enough rationale in zuul's debug log for me to determine why the old -1 is being ignored16:14
anteayadhellmann: it would require you to rename some of your gerrit groups from oslo-milestone to something else16:14
dhellmannanteaya: oslo-allowed-to-tag? :-)16:15
anteayadhellmann: well wouldn't *require* but it might be clearer of if you did16:15
anteayayeah16:15
anteayaahhh16:15
anteayaI can see you rpoint for not wanting to only have permissions for -plt16:15
anteayaptl16:15
anteayasince you need to go on vacation sometime16:15
dhellmannright16:15
anteayanot sure what to offer here16:15
anteayabut milestone feels heavy in this situation16:15
fungithree possibilities... the config change is incorrect, the config change was correct but tickled a latent bug in zuul, or this is a corner case for an existing rare zuul bug unrelated to the config change today... not sure which16:15
fungibut my suspicion is option #216:16
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Cleanup approval requirement testing  https://review.openstack.org/10202916:16
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Rename "filter" parameters  https://review.openstack.org/10203016:16
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Drop use of "filter" in test layouts  https://review.openstack.org/10203116:16
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Deprecate '_' in YAML  https://review.openstack.org/10203216:16
clarkbfungi: I dont have much to offer above what you have said16:16
*** dtantsur is now known as dtantsur|afk16:16
dhellmannanteaya: well, keeping the name "milestone" is consistent with at least a subset of what that name implies for other projects. how about if we get the acls and memberships cleaned up now, and figure out a better name as another chnage?16:16
anteayasure16:16
dhellmannanteaya: I can submit another patch that drops the milestone proposed sections of those files16:16
dhellmanncool16:16
anteayaokay16:17
anteayalet me get something to eat and then I will look at your patch16:17
anteayaand thanks :D16:17
clarkbjeblair: fungi: sdague: should I go ahead and approve my first revert revert?16:17
fungiclarkb: i'm hoping jeblair's approval requirement improvements will just make it a non-issue somehow16:17
SergeyLukjanovfungi, agreed, the #2 seems most possible IMO16:17
fungiclarkb: yeah, the reverts looked fine to me16:17
*** nati_ueno has quit IRC16:17
clarkbI assume we are ok with trying trusty again today?16:17
jeblairclarkb: ++16:17
fungiyep. though i'm about to disappear and grab some lunch, but should be back soonish16:18
dhellmannanteaya: how do stable branches play into this? because we may use stable branches. Are those separate rules?16:18
* clarkb does this16:18
jeblairmorganfainberg_L: ack16:18
*** e0ne_ has quit IRC16:18
*** andreaf has quit IRC16:18
jeblairfungi: i'll look into whether 100417 could be related16:19
*** andreaf has joined #openstack-infra16:19
clarkbok thats approved. will take a bit to jjb everywhere then I will flip tempest over16:19
*** devkulkarni has quit IRC16:19
clarkbafter that will be fix pecan and rally16:19
clarkbsdague: ready for round two?16:19
*** freyes has quit IRC16:19
fungijeblair: thanks16:20
*** markwash has joined #openstack-infra16:20
* fungi disappears for a bit16:20
dhellmannanteaya: on further reflection, I think I want to keep the milestone-proposed stuff around, and i found an example of the stable branch stuff so I'm going to add that16:20
anteayadhellmann: let me look up what to do about stable branches, I will put what I find in a comment16:20
anteayaah okay16:20
dhellmannanteaya: I found an example in the taskflow acls16:20
anteayacool16:20
*** gokrokve_ has joined #openstack-infra16:22
dhellmannanteaya: hmm, now I'm wondering if I'm just cargo-culting this though. We have stable branches in oslo-incubator and they work, but there is no acls section for them here. Maybe we get the stable branch permissions by default?16:23
*** afazekas has quit IRC16:24
jeblairdhellmann, anteaya: have not read the beginning of this conversation, but yes, stable branches are defined globally for openstack projects.  only stackforge projects need explicit acls in order to override that.16:24
jeblair(they are defined in All-Projects)16:24
*** dstanek is now known as dstanek_zzz16:24
dhellmannjeblair: ok, that explains finding them in the taskflow acls file16:24
*** dstanek_zzz is now known as dstanek16:25
*** gokrokve has quit IRC16:25
jeblairanteaya: and we interpret "project-ptl" groups as "ptl or their delegate".  perhaps we should rename them, but consistency is good here.  they definitely aren't limited to 1 person.16:25
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Bring some uniformity to olso acl files  https://review.openstack.org/10136116:25
*** ramashri has joined #openstack-infra16:25
*** salv-orlando has joined #openstack-infra16:26
anteayajeblair: yes, I knew ptl could be expanded a bit16:26
*** flaper87 is now known as flaper87|afk16:26
dhellmannjeblair: ok, that's good to know, too.16:26
dhellmannanteaya: I think that latest version is what we want. ^^16:26
anteayanot sure doug wants as much expansion of the ptl group as olso would need though16:26
anteayadhellmann: kk16:26
dhellmannI need different review groups in most of the oslo repo, with oslo-core being a member of all of those groups. Some libs are tiny and really only maintained by oslo-core, so I didn't add groups for them.16:27
openstackgerritA change was merged to openstack-infra/config: Revert "Revert "Update jenkins jobs to optionally allow trusty""  https://review.openstack.org/10206216:28
anteayaI do believe the sample project.config is pretty close to what we have as our gerrit all-projects acl: http://ci.openstack.org/gerrit.html#access-controls16:28
anteayadhellmann: hmmmm, yes16:28
anteayayou are in a bit of a unique situation that way16:28
*** basha has joined #openstack-infra16:28
dhellmannyeah16:28
anteayaoh I didn't know you were cliff and stevedore and taskflow16:29
anteayathe things I learn16:29
dhellmannanteaya: yeah, and pycadf16:29
*** devkulkarni has joined #openstack-infra16:29
*** zehicle_at_dell has joined #openstack-infra16:30
dhellmannanteaya: here's the official list: http://git.openstack.org/cgit/openstack/governance/tree/reference/programs.yaml#n15216:30
anteayayou want cliff-milestone to have tagging permissions? you already have a cliff-ptl though16:30
*** otherwiseguy has joined #openstack-infra16:30
dhellmannok, that was before I realized that the ptl group was meant to be the "can tag" group16:30
anteayaI tell everyone else to use that list and don't do so myself16:30
anteayad'oh16:31
anteayaah okay16:31
anteayayes if we already have a ptl that is not you16:31
anteayalet's use them as 'can-tag'16:31
dhellmannok16:31
jeblairand then let's go rename all of them to something else16:31
jeblairafterwords16:31
anteayayes more renaming16:31
jeblairbecause we have the same problem in infra16:32
*** gokrokve_ has quit IRC16:32
jeblair(infra and oslo have a similar sub-project org structure)16:32
anteayaso what word is not milestone that means 'can-tag' and its ptl16:32
dhellmannso I should add, for example, oslo-vmware-ptl for pushSignedTag and then we'll make sure the membership of that new group is right?16:32
anteayayeah infra-core and ptl do all the things16:32
dhellmannanteaya: "tagger"?16:32
anteayadhellmann: yes16:32
anteayaha ha ha16:32
anteayaha ha16:33
* dhellmann likes literal names16:33
*** yjiang5 is now known as yjiang5_away16:33
anteayaread 'tiger' from winnie the pooh16:33
*** ryanpetrello has quit IRC16:33
anteayasure something with tag is good16:33
anteayathen we don't have to guess16:33
anteayatagging?16:34
anteayatagging could be more than one person in the group16:34
anteayatagger implies only one person in the group16:34
dhellmannwe use "milestone" how about just "tag"16:34
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: 403 status code added  https://review.openstack.org/10114616:34
anteayasure16:35
anteayaoslo-tag16:35
anteayawfm16:35
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Bring some uniformity to olso acl files  https://review.openstack.org/10136116:35
dhellmannok, that version uses ptl for tagging permissions16:35
anteayacool16:35
dhellmannit is likely to introduce some new groups, so anteaya if you would make sure oslo-ptl is in all of the other ptl groups, I can add other individual members16:36
*** salv-orlando_ has joined #openstack-infra16:36
*** jdahlin has joined #openstack-infra16:36
anteayaI can check gerrit and see where it isn't16:36
dhellmannanteaya: thanks16:37
anteayaand then I need to hand off a list to a gerrit admin16:37
anteayasince I am not one16:37
anteayasure16:37
dhellmannah, right, ok16:37
anteayathanks for helping me16:37
anteayaI don't mind making a list though16:37
anteayafungi likes lists16:37
dhellmannthank you again for prodding me into cleaning this up :-)16:37
*** salv-orlando has quit IRC16:37
*** salv-orlando_ is now known as salv-orlando16:37
anteayanp16:37
anteaya:D16:37
* dhellmann goes to update https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary with new examples16:38
zaromorning16:38
*** lyxus_ has joined #openstack-infra16:39
*** lyxus_ has quit IRC16:39
anteayamorning zaro16:40
*** basha has quit IRC16:40
jogohave you guys seen http://logs.openstack.org/69/100469/1/check/gate-nova-docs/580f0a1/console.html#_2014-06-23_10_15_44_73016:41
*** __afazekas is now known as afazekas16:41
*** jcoufal has joined #openstack-infra16:41
dhellmannanteaya: do you understand the reason for having different milestone and core groups?16:42
jogo^ failure to upload files via scp16:42
anteayadhellmann: I understand that you need to be able to delgate responsibility16:42
jogoand related bug https://launchpad.net/bugs/133357516:42
uvirtbotLaunchpad bug 1333575 in openstack-ci "Varius 'ERROR: Failed to upload files' causes job FAILURE" [Undecided,New]16:42
anteayaif there is more to it, then feel free to expand so I am clear16:42
*** isviridov is now known as isviridov|away16:43
*** ryanpetrello has joined #openstack-infra16:43
dhellmannanteaya: no, sorry, I wasn't clear. *I* don't understand why there is a different group for +2 on a milestone proposed branch vs. master.16:43
dhellmannanteaya: so I was asking if you knew the background there :-)16:43
anteayajogo: have you seen bug 1333197?16:43
uvirtbotLaunchpad bug 1333197 in openstack-ci "unstable docs gates on multiple projects" [Medium,In progress] https://launchpad.net/bugs/133319716:43
anteayadhellmann: ah16:43
jogohmm that may be the same  bug16:44
anteayadhellmann: I don't know exactly, no16:44
anteayadhellmann: my guess is delegating responsibility16:44
dhellmannanteaya: I'm trying to explain what the changes in the file mean while I update https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary#Add_Gerrit_permissions and it occurs to me maybe we don't need the milestone groups. I thought those were the "can tag" people, but if that's the ptl...16:44
anteayaand milestone was the name of the group that people liked16:44
jogoanteaya: yup it is16:44
jogothanks!16:44
dhellmannanteaya: ok, let's just leave them for now16:44
anteayajogo: we ran out of space for storing logs16:44
anteayajogo: so we deleted some16:44
*** sarob has joined #openstack-infra16:45
anteayayes, I don't know the history of the milestone groups16:45
anteayaexcept to say this a group that is a subset of core that is not the ptl16:45
jogoanteaya: ahh that makes sense16:45
anteayajogo: cool16:45
anteayanot all projects have a milestone group16:46
anteayaand new projects don't tend to create one16:46
anteayafrom my generalized point of view16:46
anteayanot referencing any facts here16:46
dhellmannanteaya: ok, I think I was using them incorrectly, so maybe we should go ahead and remove them after all.16:46
anteayait almost feels like something that was in fashion at one point and has fallen out of fashion16:47
dhellmannyeah16:47
anteayaand the only groups who use them are the ones that had them before16:47
dhellmannok, I'm going to remove the milestone sections from the acl files, and we'll just let the core groups do everything16:47
dhellmannwell, core and ptl16:47
anteayahowever you want to delgate authoritity in oslo is up to you16:47
anteayaI jsut want a pattern others can cargo cult16:48
anteaya:)16:48
anteayasince that is what they do anyway16:48
anteayalet's give them a good template16:48
*** gondoi is now known as zz_gondoi16:48
*** alevine has quit IRC16:48
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Cleanup approval requirement testing  https://review.openstack.org/10202916:49
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Rename "filter" parameters  https://review.openstack.org/10203016:49
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Drop use of "filter" in test layouts  https://review.openstack.org/10203116:49
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Deprecate '_' in YAML  https://review.openstack.org/10203216:49
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Log matching trigger/change filters  https://review.openstack.org/10228916:49
*** ramashri has quit IRC16:49
anteayamy food is ready, back in a bit16:50
*** Ajaeger has joined #openstack-infra16:50
jeblairfungi: https://review.openstack.org/102289 is to help us debug problems like this morning's loop in the future.  i don't know what the cause of that was.16:50
*** rcarrill` has joined #openstack-infra16:51
*** rcarrillocruz has quit IRC16:51
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Bring some uniformity to olso acl files  https://review.openstack.org/10136116:51
*** yjiang5_away is now known as yjiang516:51
*** hasharMeeting has quit IRC16:52
*** pelix has quit IRC16:54
*** harlowja_away is now known as harlowja16:55
*** ihrachyshka has joined #openstack-infra16:57
*** SumitNaiksatam has quit IRC16:57
*** devkulkarni has quit IRC16:58
*** lcheng has quit IRC17:01
jeblairfungi, clarkb, mordred, SergeyLukjanov: rax will be performing disruptive network maintenance july 8-july 11 overnight (central us time)17:01
jeblairfungi, clarkb, mordred, SergeyLukjanov: they opened a ticket with scheduled windows for each server, but it's a big list.  i tried to generalize.17:02
clarkbfun17:03
*** sabeen has quit IRC17:03
*** adrian_otto has quit IRC17:04
*** lcheng has joined #openstack-infra17:05
*** ramashri has joined #openstack-infra17:06
*** dtantsur|afk is now known as dtantsur17:06
*** mugsie has quit IRC17:06
*** dizquierdo has quit IRC17:08
notmynameclarkb: ttx pushed the tag name for me this morning. can we delete the existing feature/ec feature branch and then recreate it against current HEAD of master?17:09
*** gokrokve has joined #openstack-infra17:10
*** Hal_ has quit IRC17:11
clarkbnotmyname: sure17:12
notmynameclarkb: thanks!17:12
clarkbjeblair: fungi: SergeyLukjanov sdague ok jjb appears to have updated the nodes. are we ready to trusty again?17:12
*** SumitNaiksatam has joined #openstack-infra17:12
*** rockyg has joined #openstack-infra17:12
jeblairclarkb: wfm17:12
notmynameI've been talking to mordred about getting the now-obsolete storage policies in gerrit marked as "merged" rather than having to abandon them. can we get this done today?17:13
*** zzelle_ has joined #openstack-infra17:14
*** jpich has quit IRC17:14
clarkbnotmyname: wouldn't you approve those changes and have gerrit merge them?17:14
clarkbnotmyname: I feel like I may be missing some context there17:14
notmynameclarkb: ya. the context is this: these 28 patches were reviewed in gerrit, but then force-pushed to the feature/sp-review feature branch. then the merge commit from sp-review was gated and merged. this was to prevent us from needing to gate each patch twice to get it to land, especially since they all had to land in a certain order. but the result is that the original patches in gerrit are still there as "ready for review"17:16
notmynameclarkb: so nothing landed that wasn't reviewed and gated17:16
*** zehicle_at_dell has quit IRC17:16
notmynameclarkb: but yes, it's kinda unusual circumstances (hey! we're just learning how to do all this stuff. next time will be much smoother)17:17
*** eharney_ has joined #openstack-infra17:17
jeblairnotmyname: i'm assuming that it is not worthwhile talking about how to improve that for next time then -- you've already had that discussion?17:18
*** eharney has quit IRC17:18
jeblairnotmyname: (particularly how to avoid the "but then force-pushed" part...)17:18
jogowow most of the top e-r gate issues are infra today17:18
*** eharney_ is now known as eharney17:18
jeblairjogo: i'm not sure i'm willing to accept responsibility (as "infra") for our provider's network connectivity issues :)17:19
jogofair enough17:19
notmynamejeblair: we havent' yet fully discussed the complete solution, but the obvious "one better" step is to properly start the reviews on a feature branch first. I realize that the force push is not a general good thing and should be avoided if at all possible17:19
clarkbnotmyname: if those changes did not merge they should be adandoned...17:19
clarkbbut maybe I need to have mordred expalin why that isn't the case17:20
jeblairnotmyname: cool.17:20
notmynameclarkb: they merged (in fact the exact same review ID and commit SHA). but because the zuul queue didn't pick them up, they didn't get the tickle in the right DB column17:20
jogoalthough network  connectivty has been a  known issue for some time now17:20
clarkbnotmyname: if they were force merged as is in review gerrit should show them as merged17:20
clarkbnotmyname: are you sure?17:20
*** kuhlmant has joined #openstack-infra17:20
clarkbgerrit should pick up on that I thought17:21
jeblairclarkb: unless the reviews were for those changes against a branch other than sp-review17:22
notmynamejeblair: there is a broader discussion I'd love to have in Paris about considering a more feature-branch-centric dev process. nobody is rushing in to that now, but it's something that I'd love to discuss in person (and ML closer to paris) to see what can be learned and improved for everyone17:22
jeblairclarkb: if the review was against master, then it won't be merged17:22
*** mmaglana has joined #openstack-infra17:22
notmynamejeblair: clarkb: exactly. they were proposed against master but merged (force pushed) to the sp-review branch17:22
clarkboh I see17:22
notmynamethen the merge commit from sp-review to master was reviewed/gated17:22
jeblairnotmyname, clarkb: i think the right answer is to abandon them17:23
openstackgerritA change was merged to openstack-infra/config: Add keystonemiddleware project  https://review.openstack.org/10140617:23
*** devkulkarni has joined #openstack-infra17:23
notmynamejeblair: we're fine with that. and they are referenced in the review comments on the merge commit review. just as long as they don't get reaped from some long-term gerrit thing. they have important review comments in them17:24
jeblaircan leave an explanatory note on each one though17:24
jeblairnotmyname: it is our intention never to delete data from gerrit17:24
notmynamejeblair: good!17:24
therveCan someone help me with a grenade failure? It failed twice on https://review.openstack.org/#/c/102155/ and I can't find out why17:25
clarkbnotmyname: so to confirm. delete feature/ec which points at 6ede2692c7d3bc04d133a50b822c8f9f87d56cc8 and create new feature/ec pointing at current master?17:25
notmynamejeblair: mordred seems to have some hope that they could actually be marked "merged" since the commit and review ID are both now in master. but my original assumption was that they would be abandoned17:25
*** rwsu has joined #openstack-infra17:25
clarkbsdague: mtreinish I am approving trusty bit flip now17:25
clarkbfor tempest17:25
notmynameclarkb: correct17:26
zarojhesketh: i added comments to  your remove envinjet changes.  provided an alternative that will work for your changes, it doesn't involve removing scp plugin.17:26
*** chianingwang has joined #openstack-infra17:26
clarkboh fun feature/ec has open changes17:26
clarkband won't let me delete it17:26
*** freyes has joined #openstack-infra17:26
jeblairbodepd: are you around to babysit 96336?17:27
notmynameclarkb: it does?17:27
notmynameclarkb: looking17:27
clarkbnotmyname: jeblair project:openstack/swift branch:feature/ec status:open17:28
*** Ryan_Lane has joined #openstack-infra17:28
notmynameclarkb: so those need to be abandoned first?17:28
clarkbnotmyname: I think so17:28
clarkbor merged17:28
openstackgerritA change was merged to openstack-infra/storyboard: Validate Project and Project Groups names  https://review.openstack.org/9872817:28
notmynameclarkb: no. feature/ec (where it currently is) is done and nothing will ever land there again. the tag is just to keep a pointer in git to that part of the DAG17:29
mtreinishclarkb: awesome17:29
notmynameclarkb: feature/ec is totally complete and the sp-merge branch had all of the work there17:29
openstackgerritMORITA Kazutaka proposed a change to openstack-infra/config: Add functional tests for swift3  https://review.openstack.org/10229317:29
notmynameerr..sp-review17:29
openstackgerritA change was merged to openstack-infra/config: Revert "Revert "Run all dsvm jobs from juno onwards on trusty""  https://review.openstack.org/10206317:29
openstackgerritA change was merged to openstack-infra/storyboard: Fix for delete stories method  https://review.openstack.org/10115517:30
clarkbnotmyname: ok so ya abandoning those changes is probably appropriate.17:30
notmynameclarkb: ok17:30
notmynameclarkb: give me a moment to do that17:30
clarkbwill do17:30
*** amcrn has joined #openstack-infra17:32
zarojhesketh: the scp global settings are in the jenkins global config.xml.  Unfortunately we don't have that puppeted and i'm sure there's a good reason behind that :(17:32
jeblairzaro: because the slaves are in the same file and they are constantly added and removed17:33
*** kuhlmant has quit IRC17:33
zaroahh thanks for the reminder.17:33
*** ildikov has quit IRC17:34
*** rediskin has left #openstack-infra17:35
*** openstackgerrit has quit IRC17:35
notmynameclarkb: current feature/ec is clear17:36
fungitherve: http://logs.openstack.org/55/102155/1/check/check-grenade-dsvm/2dd16f2/logs/grenade.sh.txt "2014-06-24 16:16:54.562 | Expected running services not running: ,n-net"17:36
*** openstackgerrit has joined #openstack-infra17:37
clarkbnotmyname: ok trying to delete and recreate now17:37
*** e0ne has joined #openstack-infra17:38
clarkbhuh it says it still has open changes /me looks17:38
*** achanda has joined #openstack-infra17:38
clarkbsearch says it doesn't17:39
notmynameclarkb: can you click harder? ;-)17:39
*** sarob has quit IRC17:39
clarkbnotmyname: maybe if I throw a brick at it17:39
clarkbnotmyname: I am going to try clearing caches I think17:39
anteayazaro: do you still need any agenda items on today's meeting agenda? https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting17:39
clarkbjeblair: fungi ^ that seem like an approrpiate response to silly gerrit?17:40
anteayazaro: or did you get everything you needed last week?17:40
*** sarob has joined #openstack-infra17:40
reedwhy do I even care17:40
*** e0ne has quit IRC17:40
krotscheckdhellmann: Is this more what you were suggesting? https://review.openstack.org/#/c/101146/17:40
anteayareed: and same for you17:40
*** andreaf has quit IRC17:40
fungiclarkb: ... maybe?17:40
clarkbactuially I think you can list caches now17:40
anteayareed do you need anything from last week's meeting agenda items from last week? https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting17:40
clarkblet me do that and see if anything looks like it is at fault17:40
reedanteaya, let me check17:40
anteayareed: thanks17:40
anteayareed: and what is concerning you?17:41
zaroanteaya: ohh yeah, i'm good.  i'll remove my items.  thanks for the reminder17:41
anteayazaro: great thanks17:41
anteayawe will be full anyway17:41
reedanteaya, watching Italy's game, what a shame17:41
anteayabest to make space when we can17:41
anteayareed: ah, I am not doing the sportsball17:41
anteayaso I can't relate17:41
dhellmannkrotscheck: yes17:41
anteayathe ball didn't go where it should have, I take it?17:42
krotscheckdhellmann: Works like a charm17:42
reedanteaya, no, it's the referee that made the game17:42
*** e0ne has joined #openstack-infra17:42
anteayaah17:42
anteayashame17:42
*** ramashri has quit IRC17:42
bodepdjeblair: ping17:43
*** james_li has quit IRC17:43
*** moted has joined #openstack-infra17:43
*** basha has joined #openstack-infra17:43
clarkbthere is a changes cache17:43
clarkbI will try flushing that17:44
bodepdjeblair: I'm around. but whose going to baby-sit the baby-sitter :)17:44
*** roeyc has quit IRC17:44
clarkbnope that didn't help17:44
bodepdclarkb: while I have your attention, could I get some review on: https://review.openstack.org/#/c/97647/ . It just needs a verify17:44
fungiclarkb: we may need to go digging for change ids in the db17:45
*** W00die has joined #openstack-infra17:45
*** _nadya_ has quit IRC17:45
*** sabeen has joined #openstack-infra17:45
fungibodepd: was that a biafra/lard reference?17:45
jeblairbodepd: 96336 aprvd17:45
bodepdfungi: not intentionally, but I'll take it :)17:46
notmynameclarkb: how was it done for the milestone-proposed branch?17:46
bodepdjeblair: thanks!!!17:46
jeblairbodepd: thank you!17:46
bodepdjeblair: also, I am not entirely sure what to watch for. What node will be effected?17:46
jeblairbodepd: that's the module install, which i think just runs on ci-puppetmaster.o.o17:47
*** jp_at_hp has quit IRC17:47
fungibodepd: http://lyrics.wikia.com/LyricFind:Lard:The_Power_of_Lard17:48
clarkbnotmyname: we haven't done milestone proposed on new gerrit17:48
clarkbnotmyname: you may be conquering new territory here17:49
*** sarob has quit IRC17:49
notmynameah.17:49
clarkbmtreinish: sdague https://jenkins02.openstack.org/job/gate-tempest-dsvm-neutron/12965/ I think we are live now17:49
fungiclarkb: you're trying to delete the feature/ec branch on openstack/swift and gerrit claims it has open changes?17:49
mtreinishclarkb: cool I'll keep my eye on it17:50
clarkbfungi: yes17:50
jeblair  @Query("WHERE open = true AND dest = ?")17:50
jeblairthat's byBranchOpenAll17:50
jeblairin if (dbProvider.get().changes().byBranchOpenAll(rsrc.getBranchKey()).iterator().hasNext()) {17:51
clarkbmtreinish: sdague: fwiw the zuul time in check queue determines when things will flip over for check17:51
clarkbmtreinish: sdague: because zuul submits the jobs at that time. I was confused for a few minutes as to why new job starting in check were still getting precise and it is because they were submitted ~20 minutes ago17:52
clarkbbut things look good so far from my side17:52
*** tkelsey has quit IRC17:52
jeblairclarkb, fungi: what's "dest"?17:52
clarkbjeblair: I think dest is the destination branch17:52
jeblair  `dest_project_name` varchar(255) NOT NULL DEFAULT '',17:52
jeblair  `dest_branch_name` varchar(255) NOT NULL DEFAULT '',17:52
*** sarob has joined #openstack-infra17:53
sdagueclarkb: awesome17:54
openstackgerritA change was merged to openstack-infra/config: Allow modules to be installed from source  https://review.openstack.org/9633617:54
jeblairbodepd: ^17:54
*** rgrober has joined #openstack-infra17:54
*** melwitt has joined #openstack-infra17:55
anteayareed so you still need both of your items on today's infra meeting agenda?17:55
fungiclarkb: select change_id from changes where dest_branch_name="refs/heads/feature/ec" and dest_project_name="openstack/swift" and open="Y";17:55
reedanteaya, no need for any17:55
anteayaah okay17:56
anteayawould you like to remove them?17:56
fungiclarkb: it gives me 45098, 45096 and 5161317:56
anteayaor shall I?17:56
openstackgerritClark Boylan proposed a change to openstack-infra/config: Rebalance nodepool min ready numbers for trusty  https://review.openstack.org/10230017:56
clarkbfungi: huh17:56
clarkbfungi: searching through the web ui doesn't bring those up17:56
jeblairfungi: draft status of those?17:56
* clarkb looks at them17:56
notmynameclarkb: fungi: oh! are these old draft reviews?17:56
*** jcoufal has quit IRC17:56
* anteaya removes reed's old infra meeting agenda items17:57
*** yjiang5 is now known as yjiang5_away17:57
fungijeblair: clarkb: notmyname: probably17:57
clarkbjeblair: fungi 102300 is probably a good next step for trusty if things look stable over the next hour or two or three17:57
jeblairfungi, clarkb: also, what's the status of disabling the draft acl?17:57
*** rockyg has quit IRC17:57
notmynamefungi: that's my guess since I don't have perms to view the first one17:57
clarkbjeblair: it is done17:57
clarkbjeblair: but we didn't kill old drafts. was hoping they would die on the vine17:57
jeblairclarkb: yaaaaaay!17:57
fungijeblair: clarkb: notmyname: status="d" on all three, yes. good guess17:57
notmynamefungi: clarkb: in that case (if they are draft), nuke 'em from orbit17:57
anteayait's the only way to be sure17:58
clarkbfungi: ^ can you do that?17:58
*** james_li has joined #openstack-infra17:58
clarkbfungi: since you are in the DB? though I am guessing if I make myself project bootstrapper we might be able to do it without DB17:58
fungiun-drafting changes from the db is a little tricky. will take me a couple tries since it involves adjusting fields in more than one table... and i need to remember what/where ;)17:58
clarkbfungi: well let me see if project bootstrapper perms work17:59
clarkbnope17:59
clarkb:/17:59
jeblairfungi: clarkb hold on17:59
fungioh, and i haven't done it in 2.8 yet, so if bootstrappers lets you do it from the webui that'll be easier17:59
jeblairfungi, clarkb: i'm going to make an acl change to allow us to do this17:59
fungioh!17:59
clarkbjeblair: ++17:59
fungiYESamilliontimesYES17:59
thervefungi, Sorry, mostly off. I found that part but didn't manage to get further17:59
fungii didn't realize that was a tweakable acl option in 2.817:59
bodepdjeblair: how are the node runs triggered?18:00
*** rgrober has quit IRC18:01
*** johnthetubaguy is now known as zz_johnthetubagu18:01
jeblairfungi, clarkb: project bootstrappers can now view/delete/publish drafts.  see https://review.openstack.org/#/c/45098/18:01
jeblair(i added you both for demonstration)18:01
fungitherve: it may be two different issues... the first time was "Expected running services not running: ,n-api"18:01
clarkbwoot18:01
fungitherve: second time was "n-net"18:02
jeblairbodepd: cron, every 10 mins i think?18:02
clarkbok I can "Delete Draft Change"18:02
clarkbthough maybe it is better to publish then abandon?18:02
fungiclarkb: too awesome18:02
clarkbas delete seems to do what notmyname didn't want us to do. I will go with publish then abandon18:02
jeblairclarkb: sounds good -- if one of them looks sekrit/private, check back and we can reconsider18:03
fungiclarkb: people who set changes as drafts because they thought it would keep them private are probably not worth coddling18:03
clarkbwill do18:03
fungiclarkb: so agreed18:03
jeblair(i can't remember if deleting a draft is a hard or soft delete)18:03
notmynameclarkb: I'm not tied to the draft in any way. Iv'e never seen it and don't really care (I think) if it's deleted18:03
clarkbnotmyname: ok18:03
*** atiwari has quit IRC18:03
notmynameclarkb: who is the author? that can help me know what it is18:03
clarkbnotmyname: it was a noop change18:04
clarkb"testing the workflow of adding a dependency"18:04
notmynameok18:04
*** harlowja has quit IRC18:04
fungia lot of people were in the habit of using drafts so as not to annoy reviewers or test infrastructure with their test changes18:04
notmynameclarkb: (for the record, you're the one who didn't want the feature/ec branch deleted ;-)18:04
clarkb"Trying out review dependencies again" and "Adding Erasure code policy support"18:04
clarkbnotmyname: well mostly to avoid the orphaning of commits18:05
notmynameclarkb: can you see the author?18:05
clarkbnotmyname: but the tag solved that18:05
clarkbYuan Zhou is the author of that last one18:05
notmynameright. an elegant solution18:05
*** ramashri has joined #openstack-infra18:05
clarkbI think all of them are safe for publishing18:05
notmynameclarkb: ok. that's ok to delete then (or publish/abandon)18:05
openstackgerritPablo Andres Fuente proposed a change to openstack-infra/config: Adding Tempest tests to Blazar Gate Job  https://review.openstack.org/10230318:05
fungioh, and apparently my internet connectivity issues yesterday were due to a fiber cut inland which severed my provider main artery for the island. good to know... hopefully this isn't a regular event18:06
notmynameyuan was using some drafts at first for WIP, but was later told to not do so as it was shown to be harmful for sanity (as in this case)18:06
clarkbsuddenly fungi wonders if the beach was a bad decisions18:07
bodepdjeblair: I never saw the script get updated.18:07
bodepdjeblair: also puppet.conf is thrashing on that node18:07
fungiclarkb: i took the opportunity to get the wireless modem configured for my workstation, so won't be an issue for me again regardless18:07
jeblairbodepd: okay, i'll log in and look, thx18:07
*** harlowja has joined #openstack-infra18:07
*** harlowja has quit IRC18:07
bodepdjeblair: lemme know if you need anything from me18:08
*** markwash has quit IRC18:08
clarkbnotmyname: all done18:08
jeblairbodepd: /opt/config/production/install_modules.sh is the new version18:08
clarkbnotmyname: feature/ec is updated18:08
jeblairbodepd: so that might just be puppetdb missing that event18:09
notmynameclarkb: thanks so much!18:09
*** lcheng has quit IRC18:09
notmynameclarkb: looks great18:09
jeblairbodepd: install_modules doesn't show up in syslog, so i assume there were no errors18:10
bodepdor maybe I was looking at the wrong report...18:10
bodepdjeblair: it should still show up as a change event in puppetdb... hold on18:10
jeblairbodepd: a while ago, we found that puppetdb was mysteriously missing events; i'm not sure where the effort to track that down ended up18:11
bodepdjeblair: uggh. actually, I don't think Puppet is managing that file18:11
jeblairnibalizer: ^18:11
bodepdit's all meta18:11
bodepdb/c its the file that bootstraps the puppet modules18:11
clarkbit is managing it indirectly18:11
bodepdit needs to  be watchnes to ensure that when it runs (which is not triggered by Puppet)18:11
clarkbthere is a cron that updates puppet18:11
clarkbthere is acron that runs install modules18:11
bodepdthat it does not error out18:11
bodepdyeah, the logs for that is what need to be monitored18:12
fungibodepd: apparently install_modules.sh is who babysits the babysitters18:12
bodepdsounds like it might be time to give /me access for realz?18:12
bodepdare the logs for that aggregated/publically available by any change?18:12
bodepdchance18:12
*** chianingwang has quit IRC18:13
*** ihrachyshka has quit IRC18:13
nibalizerjeblair: i never found a satisfactory answer for the missing events thing18:13
jeblairbodepd: i'd like you to have access someday, but it's a long road :)18:13
jeblairbodepd: so i think we're just looking for errors from cron in syslog or mail18:13
*** dims_ has quit IRC18:13
*** jlibosva has quit IRC18:14
*** dims_ has joined #openstack-infra18:14
jeblairclarkb: /usr/local/bin/logstash-watchdog: line 11: curl: command not found18:14
*** lcheng has joined #openstack-infra18:14
bodepdjeblair: no worries. I'm still pretty peripheral18:15
clarkbjeblair: arg18:15
jeblairbodepd: http://paste.openstack.org/show/84814/18:15
*** _nadya_ has joined #openstack-infra18:15
clarkbI think we should go ahead and add curl to our base.pp manifest18:15
clarkbany objects?18:16
anteayadhellmann: when you have a chance: https://etherpad.openstack.org/p/olso-gerrit-groups18:16
clarkb*objections18:16
anteayadhellmann: this is my current list18:16
jeblairclarkb: no objection here18:16
bodepdjeblair: looks like it did the thing it was supposed to do :)18:16
jeblairbodepd: that output looks benign; i think the update ran and worked?18:16
anteayadhellmann: but let's get the patch in agreement first before we include a wider audience18:16
anteayadhellmann: fair?18:16
dhellmannanteaya: makes sense18:16
jeblairbodepd: cool, yay!18:16
anteayadhellmann: let me know if I have made any errors in the etherpad18:17
*** otherwiseguy has quit IRC18:17
bodepdjeblair: does this mean that r10 is on the back-burner?18:17
jeblairr10?18:17
nibalizerr10k probably18:17
jeblairlet's pretend i was out for 2 weeks and don't know what anyone is talking about ;)18:18
*** james_li has quit IRC18:19
*** pfallenop has quit IRC18:21
*** mugsie has joined #openstack-infra18:21
*** hogepodge_ has joined #openstack-infra18:21
clarkbryanpetrello: you around?18:22
clarkbryanpetrello: can you give me a little background on those ceilometer pecan jobs that are failing?18:22
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: ATC listing script is importable  https://review.openstack.org/10230818:22
clarkbryanpetrello: currently wondering if you use centos6 for mongodb and whether or not jumping straight to trusty might be a better option for you18:22
clarkbryanpetrello: we can make those jobs continue to run on cetnos6 if that is important18:22
*** atiwari has joined #openstack-infra18:23
clarkbryanpetrello: I just realized that I might be tackling a perceived problem rather than an actual issue though and wanted to run this by you18:23
clarkbboris-42: ^ similar qusetion for you and your rally centos6 jobs. Is the intent to test on centos6 because it is centos6 or for some side effect?18:24
ryanpetrelloclarkb: back18:24
dhellmannanteaya: I don't think we tag the cookiecutter repos. If we remove that section of the acls, does that remove anyone's ability to tag, or is there some default setting?18:24
ryanpetrelloto my knowledge, the centos6 for ceilometer was for mongodb support18:25
clarkbryanpetrello: ok, I will probably start with making those jobs continue to run on centos6 but then we should possibly consider moving to trusty longer term18:25
ryanpetrelloI have no affinity for centos other than “the tests passed there”18:25
clarkbgotcha18:25
clarkbryanpetrello: in that case maybe I will moe you to trusty real quick18:25
ryanpetrellookay, does the mongo/ceilomoter stuff work on trusty?18:25
clarkbryanpetrello: it *should*18:26
clarkbryanpetrello: but I haven't tested it yet.18:26
ryanpetrelloif so, the tests I’m running are just ceilometer’s tests with the pecan from the patchset injected into the tox virtualenv18:26
clarkbryanpetrello: I can give it a go though18:26
*** harlowja has joined #openstack-infra18:26
ryanpetrelloyea, I’m fine giving it a shot18:26
*** harlowja has quit IRC18:26
nibalizerjeblair: r10k is a tool in the puppet space to do what install_modules.sh does18:26
*** harlowja has joined #openstack-infra18:26
*** harlowja has quit IRC18:26
nibalizerits cool because it integrates well into the branch/environment model and does git caching magic to make it fast18:27
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: ATC listing script is importable  https://review.openstack.org/10230818:27
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Bring some uniformity to olso acl files  https://review.openstack.org/10136118:27
*** _nadya_ has quit IRC18:27
*** harlowja has joined #openstack-infra18:27
*** harlowja has quit IRC18:27
nibalizerhttps://github.com/adrienthebo/r10k18:27
*** _nadya_ has joined #openstack-infra18:27
jeblairnibalizer, bodepd: we said no to puppet librarian because it required too much puppet for us to bootstrap.  is r10k different?18:28
*** e0ne has quit IRC18:28
clarkbryanpetrello: I am testing by hand, will let you know how it goes18:28
*** andreykurilin_ has quit IRC18:28
ryanpetrelloclarkb: if you need something to test with, this patchset would also work: https://review.openstack.org/#/c/94244/18:28
*** e0ne has joined #openstack-infra18:28
nibalizeri dont understand what you mean by puppet librarirn required too much puppet18:28
*** andreykurilin_ has joined #openstack-infra18:28
*** harlowja has joined #openstack-infra18:28
*** harlowja has quit IRC18:28
clarkbryanpetrello: I am using your tip of master and running tox -eceilometer-tip on one of our bare-trusty nodes18:29
clarkbryanpetrello: I believe this is what the test is doing18:29
ryanpetrelloyep18:29
ryanpetrellothat’ll work18:29
*** harlowja has joined #openstack-infra18:29
*** harlowja has quit IRC18:29
*** harlowja has joined #openstack-infra18:29
*** harlowja has quit IRC18:29
nibalizerjeblair: can you explain what happened with that?18:30
clarkbnibalizer: jeblair: puppet librarian installed puppet for you from gems18:30
clarkbso you had to bootstrap your whole puppet infra to bootstrap your puppet infra18:30
clarkbit was pretty :(18:30
*** melwitt has quit IRC18:31
*** sarob has quit IRC18:32
*** melwitt has joined #openstack-infra18:32
*** melwitt has quit IRC18:32
*** melwitt has joined #openstack-infra18:32
jeblairnibalizer: we could not effectively bootstrap a system with it due to ruby versions, puppet apt repos, etc.  for more details i would have to consult logs from like a year ago.18:33
nibalizeroh gross18:33
jeblairyeah :)18:33
nibalizercould end up in the same place with r10k, also might be better with trusty18:33
jeblairtrue, though we should be wary of it being only temporarily better with trusty -- we'll be using trusty for a long time.18:33
jeblairalong with precise and centos618:33
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: ATC listing script is importable  https://review.openstack.org/10230818:33
dhellmannanteaya: I think that etherpad is accurate. I left a couple of comments where there were questions.18:33
anteayagreat, thank you18:33
*** marcoemorais has quit IRC18:33
jeblairfungi: tbh, i'm not quite sure why we have a copy of our acl config file in docs18:33
*** marcoemorais has joined #openstack-infra18:34
*** harlowja has joined #openstack-infra18:34
*** harlowja has quit IRC18:34
*** jp_at_hp has joined #openstack-infra18:34
*** basha has quit IRC18:34
*** sarob has joined #openstack-infra18:34
*** hogepodge_ has quit IRC18:34
anteayadhellmann: if you remove the tags section of the acls on the cookiecutter repos then noone can tag those repos18:35
anteayadhellmann: not a problem if noone is18:35
dhellmannanteaya: I don't think there's any reason to tag them, we don't release them.18:35
anteayadhellmann: if you remove the permissions and discover you do want to tag, you can patch the file to put permissions in place for tagging18:35
dhellmannanteaya: good point18:35
*** ramashri has quit IRC18:35
clarkbryanpetrello: at the very least we will have to update your tox.ini to use py27 instead of py26 and trusty doesn't come with py2618:35
anteayadhellmann: it would just mean you wait until the patch merges before you can tag18:36
clarkbryanpetrello: I have done this locally and am seeing if that is the only change needed18:36
*** ramashri has joined #openstack-infra18:36
ryanpetrelloclarkb: works for me18:36
ryanpetrellowe may have to set those ceilometer jobs to non-voting to get the tox.ini change in, though :)18:36
anteayadhellmann: so it is up to you, but I like the acl files to be descriptive of teh activity on the repo18:36
anteayadhellmann: rather than have cruft18:37
nibalizerjeblair: so while puppet-librarian pulls in puppet (lolwut), r10k doesnt18:37
clarkbryanpetrello: no it should self gate :) which is cool18:37
clarkbryanpetrello: it will mean that we have to make that change before any other pecan changes though18:37
dhellmannanteaya: agreed. the latest patch removes those tagging permissions.18:38
nibalizerit probably wouldn't be very much work to make a review that slots out install modules.sh for r10k18:38
ryanpetrelloclarkb: yep, that’s fine18:38
ryanpetrelloclarkb: changes are currently stuck anyways :)18:38
nibalizerbut i also don't think that there is a big advantage there18:38
ryanpetrelloclarkb: if you put up a tox.ini review, ping me and I’ll get it pushed through quickly18:38
clarkbryanpetrello: will do18:38
clarkbryanpetrello: we have to change infra side first, then your tox.ini then you should go good18:38
anteayadhellmann: great18:38
clarkball this assuming the tests pass18:38
anteayadhellmann: line 52, https://etherpad.openstack.org/p/olso-gerrit-groups18:38
ryanpetrelloclarkb: awesome18:38
clarkbthey are running now though so we should know soon18:38
funginibalizer: so if we used multiple branches and multiple puppet environments, you're saying r10k would be beneficial18:38
*** harlowja has joined #openstack-infra18:39
anteayadhellmann: I posted a question back to you18:39
*** harlowja has quit IRC18:39
*** yfried has joined #openstack-infra18:39
dhellmannanteaya: I don't see an oslo-i18n18:39
dhellmannI see oslo-i18n-core already18:39
anteayamy mistake18:39
anteayayou are correct18:39
anteayaI will fix the etherpad18:40
dhellmannok, cool, I thought maybe you saw an extra group :-)18:40
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: ATC listing script is importable  https://review.openstack.org/10231618:40
*** harlowja has joined #openstack-infra18:40
*** harlowja has quit IRC18:40
anteayadhellmann: I thought I did too, I am wrong18:41
anteayadhellmann: line 6718:41
fungijeblair: if you're talking about the all-projects acl, i think the intent was to document our initial gerrit settings for bootstrapping purposes18:41
anteayais oslo-milestone obsolete?18:41
clarkbryanpetrello: ceilometer-tip passed. trying stable now18:41
*** harlowja has joined #openstack-infra18:42
dhellmannanteaya: yes, I think oslo-ptl and the repo-specific versions of oslo-ptl replace that18:42
anteayame too18:42
*** ihrachyshka has joined #openstack-infra18:42
anteayalet's both grep acls and ensure we have removed all mention of oslo-milestone in acl files18:43
jogoso I tried to run gerrty and it just crashed on me18:43
dhellmannanteaya: 0 hits18:43
anteayaawesome18:43
anteayaI'm just pulling down your patch18:44
jogohttp://paste.openstack.org/show/8481618:44
anteayadhellmann: I have the same results18:45
jogojeblair: ^18:45
anteayadhellmann: line 86, can you just say you confirm that18:46
anteayadhellmann: because we both know fungi is going to ask18:46
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Rename ATC listing script  https://review.openstack.org/10231718:47
dhellmannanteaya: done18:47
anteayathanks18:47
*** HenryG has joined #openstack-infra18:48
jeblairjogo: have you run gertty before?18:49
jeblairjogo: and what commit are you running?18:49
Shrewsfungi: clarkb: mordred: has anyone reported pbr installation problems under devstack??18:50
openstackgerritClark Boylan proposed a change to openstack-infra/config: Choose precise, centos6, and trusty nodes properly  https://review.openstack.org/10231918:50
jogojeblair: no this is my first time trying to run it18:50
jogoand running from trunk18:50
jogojeblair: so its very likely that I did something very dumb18:50
clarkbfungi: jeblair ryanpetrello ^ that is the general fix for rally. I am hoping to migrate pecan's ceilometer tests straight to trusty instead of renaming jobs for pecan18:51
clarkbShrews: not that I have heard18:51
Shrewsugh18:51
Shrewshttp://paste.openstack.org/show/84817/18:51
dhellmannanteaya: I think we're good to go, then, right?18:51
anteayadhellmann: line 33, oslo-specs-core18:51
clarkbryanpetrello: the stable ceilometer test passes so I will work up a change for you shortly18:51
ryanpetrelloawesome :D18:51
anteayadhellmann: I have zero hits grepping for it18:52
anteayadhellmann: it looks like it can be removed18:52
dhellmannanteaya: yeah, that's another one we don't need18:52
anteayadhellmann: great18:52
*** ihrachyshka has quit IRC18:52
jeblairjogo: did you run with the "-d" option?18:52
openstackgerritA change was merged to openstack-infra/reviewstats: Update sahara core review team members  https://review.openstack.org/10215618:53
jeblairjogo: if not, can you rm the sqlite db file, run again with "-d", and then paste the contents of .gertty.log ?18:53
openstackgerritMichael Krotscheck proposed a change to openstack-infra/infra-specs: StoryBoard search spec  https://review.openstack.org/9725418:53
jogowhere is the sqlite db file?18:53
fungiclarkb: i guess i missed some of the dynamic node selection fun while i was moving... is specifying node labels in job configurations obsolete now?18:54
jeblairjogo: i think it defaults to '~/.gertty.db' if you don't override it in the config18:54
*** hashar has joined #openstack-infra18:54
jogoahh yup18:54
jogojeblair: oh it worked18:55
jogosweet18:55
jogothanks18:55
jeblairjogo: also, if no one told you -- it's still early days with gertty -- it's not quite finished enough to operate without the webui (i still have some significant hacking to do), and crashes a lot.  so you're like a pre-alpha tester :)18:55
clarkbfungi: no it isn't completely obsolete. Notice that I use 'pass' in the zuul function to defer to the job label18:55
jogojeblair: that was my impression, so thanks for clarifying18:56
*** krtaylor has quit IRC18:56
clarkbfungi: I did that as a safety net while we transition to using zuul only for selection then the job label will be obsolete18:56
jogoso I shouldn't get upset when it deletes all my data :)18:56
*** achanda has quit IRC18:56
fungiclarkb: ahh, great. makes sense18:56
jeblairjogo: i wonder what happened that first time... :/18:56
clarkbfungi: this safety net came in handy on friday when gearman had that bug18:57
clarkbfungi: things mostly continued to work :) which was nice18:57
*** ihrachyshka has joined #openstack-infra18:57
anteayadhellmann: I have made some comments18:58
anteayaon the patch18:58
*** ociuhandu has quit IRC18:58
anteayaianw: you around for the meeting?18:59
*** jcoufal has joined #openstack-infra18:59
ianwanteaya: hi, yep18:59
anteayagreat18:59
jeblairmeeting time!19:00
*** dstanek is now known as dstanek_lunch19:00
*** krtaylor has joined #openstack-infra19:01
openstackgerritClark Boylan proposed a change to openstack-infra/config: Run pecan ceilometer tests on trusty for mongodb  https://review.openstack.org/10232319:01
clarkbryanpetrello: jeblair fungi ^ for after meeting I guess19:01
*** morganfainberg_L has quit IRC19:01
*** basha has joined #openstack-infra19:01
*** morganfainberg_L has joined #openstack-infra19:01
jogojeblair: using j/k doesn't work for navigation?19:01
clarkbjogo: it doesn't19:02
*** Ryan_Lane has quit IRC19:02
*** morganfainberg_L has quit IRC19:02
*** morganfainberg_L has joined #openstack-infra19:02
*** yamahata__ has joined #openstack-infra19:02
jogocan I / should I file a storyboard bug for that?19:02
*** yamahata_ has quit IRC19:03
*** jp_at_hp has quit IRC19:03
*** sarob has quit IRC19:03
*** sarob has joined #openstack-infra19:04
krotscheckclarkb: just explained o/ to me.19:04
krotscheckI am highly amused.19:04
clarkbjogo: I mean I guess you can19:04
* jogo used storyboard for the first time19:04
*** ihrachyshka has quit IRC19:04
*** ihrachyshka has joined #openstack-infra19:05
jogokrotscheck: o/19:05
krotscheckWAT19:05
krotscheck:)19:05
*** basha has quit IRC19:06
*** sarob_ has joined #openstack-infra19:07
ttxcool, usability testing19:07
gothicmindfoodkrotscheck: oooh, what did clarkb say?19:08
clarkbI did o/ in person19:08
*** _nadya_ has quit IRC19:08
gothicmindfoodin my mind, o/ is the 'yo' of IRC19:08
gothicmindfoodbut maybe I just made that up19:08
*** adrian_otto has joined #openstack-infra19:09
*** sarob has quit IRC19:09
*** ramashri has quit IRC19:09
anteayagothicmindfood: it is a hand wave19:09
krotscheckgothicmindfood: Take a picture of yourself raising your hand19:09
krotscheckgothicmindfood: Like in class.19:09
gothicmindfoodanteaya: I always thought it was like, a high five19:09
gothicmindfoodbut yeah - hand wave makes sense19:09
anteayao/19:09
anteaya\o19:09
anteayathat is a high five19:09
krotschecko/\o19:09
krotscheck....19:09
anteayaif you give yourself a high five19:09
krotscheckanteaya: Would that be more like /o\19:10
*** james_li has joined #openstack-infra19:11
anteayathat is skiing19:11
*** ildikov has joined #openstack-infra19:11
anteaya|o| this is a touchdown19:11
anteaya*\o/* this is a cheerleader's pom-poms19:13
anteayaand this is just yay \o/19:14
ryanpetrelloclarkb: I opened https://review.openstack.org/#/c/102325/19:14
ryanpetrellostill seems to fail on those ceilometer jobs19:14
*** UtahDave has joined #openstack-infra19:15
*** dims_ has quit IRC19:15
clarkbShrews: I wonder if https://review.openstack.org/#/c/101785/ is breaking you19:15
clarkbryanpetrello: ya it will until my change merges and gets applied to zuul19:15
*** dims_ has joined #openstack-infra19:16
clarkbryanpetrello: need https://review.openstack.org/#/c/102323/ first19:16
ryanpetrelloclarkb: oic, 102323 hasn’t merged yet19:16
ryanpetrelloyep19:16
*** dstanek_lunch is now known as dstanek_lunch_zz19:16
*** dstanek_lunch_zz is now known as dstanek19:16
ryanpetrellookay, well when that merges, 102325 is ready to try again19:16
clarkbwe are all in the infra meeting right now though so will be a few more minutes19:16
Shrewsclarkb: hrm, maybe?19:16
*** ihrachyshka has quit IRC19:16
*** ihrachyshka has joined #openstack-infra19:17
clarkbShrews: so for more context, where are you running devstack?19:17
Shrewsclarkb: personal laptop19:18
clarkbis this trusty or precise?19:18
Shrewsprecise19:18
openstackgerritA change was merged to openstack-infra/config: Choose precise, centos6, and trusty nodes properly  https://review.openstack.org/10231919:19
clarkbShrews: and is this a clean against master devstack run?19:19
*** flaper87|afk is now known as flaper8719:20
clarkbShrews: trying to sort out if there is a delta between what we do in the gate and what yo uare doing19:20
Shrewsclarkb: latest devstack, doing a RECLONE=yes19:20
dhellmannanteaya: sorry, stepped out, comments in the etherpad or the review?19:20
Shrewsclarkb: but even if i checkout pbr manually, and try to install it, i get that error19:20
*** devkulkarni has quit IRC19:20
clarkbShrews: what does pip --version say?19:20
anteayadhellmann: comments on the review19:21
anteayaand np19:21
clarkbShrews: I am beginning to think this must be a difference in python setuptools and or pip19:21
Shrewsclarkb: 1.5.6, but i just upgraded setuptools which i think has added more complications19:21
*** Sukhdev has joined #openstack-infra19:22
*** praneshp has quit IRC19:22
*** Ryan_Lane has joined #openstack-infra19:22
clarkbya 1.5.6 should work it is what we use in the gate19:23
clarkbShrews: maybe try downgrade setuptools?19:23
clarkbits possible we don't see the setuptools issue because our mirror doesn't have a new version in it yet19:23
Shrewsclarkb: yeah, but trying to determine the correct version.19:23
clarkbShrews: 3.8 was known to work iirc19:23
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Bring some uniformity to olso acl files  https://review.openstack.org/10136119:23
dhellmannanteaya: updated19:24
anteayadhellmann: thanks19:25
anteayalets confirm I am correct on the latest changes to messaging.config and taskflow.config19:25
anteayasince i don't know how messaging.config can be working for taggin now19:26
dhellmannI wonder if refs/heads/tags is just a more specific version of refs/tags? I don't know enough about git internals.19:27
anteayaI don't know either19:27
*** SumitNaiksatam has quit IRC19:27
anteayaand would like to ensure we are making the right change in that file19:27
dhellmannanteaya: yeah, I would hate to break releasing. :-)19:28
stevebakerhey, all heat unit tests are failing due to a sqlalchemy change. I'm not sure if policy allows but can this change be bumped up in the gate queue? https://review.openstack.org/#/c/102155/19:29
*** dangers_away is now known as dangers19:29
*** jergerber has joined #openstack-infra19:29
dhellmannanteaya: oh, my mistake, I misread the diff. There was no refs/tags/* section at all before. I thought it was refs/heads/tags/*19:29
*** sarob_ has quit IRC19:29
*** freyes has quit IRC19:30
Shrewsclarkb: frustration led me to 'rm -rf /usr/local/lib/python2.7' and start from scratch. seems to be progressing now19:30
*** yfried has quit IRC19:30
*** sarob has joined #openstack-infra19:30
* Shrews stabs python in the fangs19:30
clarkbShrews: so it is entirely possible the gate will fall over tomorrow after our mirror updates19:30
*** yfried has joined #openstack-infra19:30
*** harlowja has quit IRC19:31
*** marcoemorais has quit IRC19:31
*** marcoemorais has joined #openstack-infra19:32
*** marcoemorais has quit IRC19:32
*** melwitt has quit IRC19:32
*** marcoemorais has joined #openstack-infra19:32
Shrewslet's hope not19:32
*** melwitt has joined #openstack-infra19:32
*** sarob_ has joined #openstack-infra19:33
*** jasondotstar has quit IRC19:33
*** freyes has joined #openstack-infra19:34
*** devkulkarni has joined #openstack-infra19:34
anteayadhellmann: ah thanks, so one down19:34
*** dhellman_ has joined #openstack-infra19:35
*** sarob has quit IRC19:35
anteayajust taskflow.config now then19:35
*** achanda has joined #openstack-infra19:35
*** mmaglana has quit IRC19:36
*** praneshp has joined #openstack-infra19:37
*** harlowja has joined #openstack-infra19:37
*** devkulkarni1 has joined #openstack-infra19:37
*** cnesa has joined #openstack-infra19:37
*** devkulkarni has quit IRC19:38
*** harlowja_ has joined #openstack-infra19:39
*** yfried has quit IRC19:40
*** yfried has joined #openstack-infra19:41
*** harlowja has quit IRC19:42
openstackgerritGraham Hayes proposed a change to openstack-infra/config: Move Designate from stackforge to openstack  https://review.openstack.org/10232819:42
*** sarob_ has quit IRC19:43
anteayadhellmann: read some scrollback in -meeting19:43
anteayalooks like we may have dodged a bullet removing some -milestone19:43
dhellmannanteaya: ok. I'll go along with whatever the consensus is on that.19:45
anteayakk19:45
anteayawon't affect group names19:45
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: ATC listing script is importable  https://review.openstack.org/10231619:45
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Rename ATC listing script  https://review.openstack.org/10231719:45
anteayajust the title of the stanza in the acl file19:45
anteayaand it will be automated19:46
dhellmannanteaya: ok19:46
anteayajust the conversation does shed some light on the history of the milestone usage19:46
*** xyang1 has joined #openstack-infra19:46
xyang1anteaya: question on CI.  We are supposed to store 1 months of logs on a web server.  What is the capacity requirement?19:49
*** jcoufal has quit IRC19:49
anteayaxyang1: that is a good question, I don't know19:49
xyang1anteaya: any one else may know?  We are searching for a server to host it.  It will help if we know that requirement19:50
clarkbthe capacity requirment is enough capacity for 1 month of logs :)19:50
anteayaxyang1: if you look through the logs for the third party meetings: http://eavesdrop.openstack.org/meetings/third_party/2014/ you might find people who run ci systems who might know19:50
clarkbits hard for us to answer we currently do about 12TB per 4 months19:50
clarkbbut that is for everything19:50
*** flaper87 is now known as flaper87|afk19:50
clarkband not going to be what you will see for third party typically19:50
anteayaxyang1: well requirement in this case is a difficuly term19:51
anteayasince we haven't talked about it yet19:51
xyang1clarkb: 12TB is for what logs?19:51
anteayaso any number I give you may change19:51
clarkbxyang1: all the upstream test logs19:51
clarkbcompressed19:51
clarkbbut that is everything19:51
anteayaand then you will be upset with me because it changed19:51
*** salv-orlando has quit IRC19:51
anteayaI highly recommend you attend the third party meetings since this is the place many things like this get discussed19:51
xyang1we are only hosting dsvm-full logs19:52
xyang1anteaya: sure19:52
morganfainberg_Lis there anything specific i need to do to get the keystonemiddleware properly into stackalytics? [or it should be automagic?]19:52
anteayahttps://wiki.openstack.org/wiki/Meetings/ThirdParty19:52
*** otherwiseguy has joined #openstack-infra19:52
anteayathanks19:52
*** salv-orlando has joined #openstack-infra19:53
xyang1anteaya: any requirement for the server hosting logs?  I saw someone was using dropbox and got rejected19:53
anteayaso far the third party group is working on this etherpad: https://etherpad.openstack.org/p/LogServerGeneralRecommendations19:53
anteayaand I have this patch up: https://review.openstack.org/#/c/101227/19:54
*** _nadya_ has joined #openstack-infra19:54
anteayaand this: https://review.openstack.org/#/c/101013/19:54
anteayayou are welcome to review and join in the discussion as it evolves19:54
anteayait will probably come up at the next third party meeting19:54
anteayaand anyone who spoke in the logs might be open to discussing it with you19:55
*** signed8bit is now known as signed8bit_ZZZzz19:55
anteayaso right now server logs and logging is a topic we are making decisons around19:55
anteayaand welcome your input19:55
xyang1anteaya: ok, thanks.  another question: the logs are generated on jenkins slave, and we are supposed to copy them to jenkins master, and then upload logs to some web server from the master?19:55
*** otherwiseguy has quit IRC19:56
*** otherwiseguy has joined #openstack-infra19:56
*** Hal_ has joined #openstack-infra19:57
adam_gclarkb, any chance of a second peek at https://review.openstack.org/#/c/92216/ ?19:58
clarkbadam_g: wow thats not confusing :)19:58
clarkbadam_g: ya I can rereview really quickly19:59
clarkbsorry for the noise19:59
jerryzxyang1: jenkins uses scp plugin to copy logs to log server. you don't need to copy from slave to master.19:59
adam_gclarkb, yeah, as i said.. we're working on getting rid of the extra jobs and consolidating those into just a few, non-confusing ironic jobs.19:59
*** markwash has joined #openstack-infra19:59
xyang1jerryz: ok, it does make a difference for us because currently we are only planning to allow the master server to communicate with outside.20:00
*** Sukhdev has quit IRC20:01
LonggeekI found the zuul project in the PBR version(pbr>=0.5.21,<1.0) is too low, the need to improve the version dependent?20:01
anteayahi Longgeek, havent' seen you in a while20:02
*** medieval1 has quit IRC20:02
anteayaLonggeek: I have to say I'm still interested to know what your ci system tests, I haven't figured it out yet20:02
Longgeekanteaya: :)20:02
*** medieval1 has joined #openstack-infra20:02
clarkbanteaya: jeblair fungi mordred SergeyLukjanov jhesketh these changes will help with trusty transition https://review.openstack.org/#/c/102300/ for more trusty nodes at idle and https://review.openstack.org/#/c/102323/ to fix pecan20:03
Longgeekanteaya: This later in the well, no time to make CI lately, and I haven't started my CI system20:03
clarkbthank you for merging the zuul openstack_functions update to better select nodes. that should fix rally for boris-4220:03
anteayaLonggeek: okay, just know I am still looking for the description20:03
*** Hal_ has quit IRC20:04
*** marcoemorais has quit IRC20:04
anteayaxyang1: I think you really want to attend the third party meetings20:04
jerryzxyang1: but you host your log server, as long as the log server has public interface and private interface as well, you are fine20:04
Longgeekanteaya: Understand.20:04
anteayafirewalls and ci systems don't mix well20:04
anteayaLonggeek: great thanks20:04
*** sarob has joined #openstack-infra20:04
*** marcoemorais has joined #openstack-infra20:04
*** marcoemorais has quit IRC20:05
*** penguinRaider has quit IRC20:05
*** marcoemorais has joined #openstack-infra20:05
zaroclarkb: lets merge built-timeout changes https://review.openstack.org/#/c/95912 & https://review.openstack.org/#/c/9593320:05
*** e0ne has quit IRC20:05
clarkbzaro: looking20:06
LonggeekIn the zuul project PBR version Is it right? Is low?20:06
xyang1anteaya: sure, thanks20:06
*** marcoemorais has quit IRC20:06
*** e0ne has joined #openstack-infra20:06
xyang1jerryz: thanks. we'll work it out with IT20:06
clarkbzaro: ok I think that will need babysitting. I am happy to do that but need lunch first20:06
*** marcoemorais has joined #openstack-infra20:06
clarkbso back shortly then will babysit20:06
fungiclarkb: we have the most recent setuptools on our mirror as of yesterday20:07
*** _nadya_ has quit IRC20:07
*** e0ne has quit IRC20:08
*** mrmartin has joined #openstack-infra20:09
*** dtantsur is now known as dtantsur|afk20:10
james_liclarkb: fungi : found a problem with rabbitmq on trusty. it looks msgs are routed, and our service is busy reading them, but nothing can be read out.20:12
james_liare you guys aware about this?20:12
*** e0ne has joined #openstack-infra20:12
fungijames_li: it's the first i've heard of it, but we only just got back to trying trusty for job workers in the past few hours20:12
james_lithat was found on my local trusty vagrant box20:13
*** Ryan_Lane has quit IRC20:13
james_lifungi: where to log this?20:14
clarkbit seems to work fine for tempest fwiw20:14
*** adrian_otto has joined #openstack-infra20:15
boris-42clarkb thanks20:15
fungijames_li: what is "our service"?20:15
clarkbboris-42 is it working again?20:16
*** dstanek is now known as dstanek_zzz20:16
boris-42clarkb one task called (check-rally-dsvm-cli started working back)20:16
james_lisolum has a couple of background processes connecting to rabbit20:16
boris-42clarkb another one called gate-rally-install-bare-centos6 still doesn't' wrok20:16
boris-42clarkb lemme recheck20:16
james_lifungi: ^^20:16
clarkbboris-42 may be a race between you and zuul. I will look20:18
clarkbbut lunch now20:18
fungijames_li: i'd probably file a bug against solum first, and then if you determine that it's some odd regression with the rabbitmq version on trusty i'd recommend opening a bug for the ubuntu package (then let the ubuntu package maintainer work out whether it's a problem they introduced, inherited from debian or inherited from upstream)20:18
sdaguejames_li: well, fwiw, the rest of openstack works fine on trusty on rabbit. So possibly some very specific configuration issue?20:19
lyxusHello everyone, can someone take a look at this  https://review.openstack.org/#/c/101143/ and let me know what they think20:19
*** e0ne has quit IRC20:20
anteayalyxus: you need sdague or dtroyer or mtreinish20:20
anteayalyxus: acutally I would suggest adding an agenda item to the qa meeting agenda20:20
anteayaand bring it up at the meeting20:20
*** e0ne has joined #openstack-infra20:20
anteayathat way you know for sure you will get some feedback, since mostly at this point you need to know if the design is acceptable or not20:21
anteayaright?20:21
fungilyxus: though it's also worth noting that we (openstack infra) already override the pypi server for devstack in our environments, so it's doable without patching devstack20:21
anteayaqa meets on thursdays20:21
lyxusanteaya, I believe that they are really busy, so I was looking for some other "+1"20:21
*** craigbr has quit IRC20:22
*** fifieldt_ has joined #openstack-infra20:22
anteayayeah, everyone is really busy20:22
lyxusfungi, How do you achieve this ?20:22
anteayagetting it on the agenda at leaset ensures you 5 minutes of attention20:22
lyxusanteaya, Ok will add it20:23
*** rfolco has quit IRC20:23
*** mwagner_lap has quit IRC20:23
*** dprince has quit IRC20:23
*** craigbr has joined #openstack-infra20:24
*** e0ne has quit IRC20:24
anteayalyxus: doesnt' mean you cant keep trying to get reviews, just as an insurance in case you don't20:24
lyxusanteaya, ok !20:25
fungilyxus: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/slave_scripts/select-mirror.sh20:25
*** fifieldt has quit IRC20:25
*** ociuhandu has joined #openstack-infra20:25
*** radez is now known as radez_g0n320:26
lyxusfungi, Will take a look thanks !20:26
*** jergerber has quit IRC20:26
*** lttrl has joined #openstack-infra20:26
fungilyxus: we have a jjb macro which calls that, and then we add that builder macro to our jenkins jobs and pass it the org and project names for the job20:26
*** davidlenwell_ is now known as davidlenwell20:28
fungilyxus: oh, though for devstack-gate based jobs, we use this function... http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n32420:29
fungiwhich does basically the same sorts of things, but for the additional accounts devstack and tempest ise20:29
fungier, use20:29
lyxusI see !20:29
*** e0ne has joined #openstack-infra20:29
*** marcoemorais has quit IRC20:30
fungilyxus: it's basically adding onto the mirror selection builder to replicate those same overrides to the other accounts20:30
*** marcoemorais has joined #openstack-infra20:31
*** marcoemorais has quit IRC20:31
fungilyxus: it's entirely possible that the devstack maintainers see benefit in absorbing that logic into devstack so it can be more easily reused without needing additional outside scripts, but you'd obviously want to check with them to find out20:31
*** marcoemorais has joined #openstack-infra20:32
lyxusfungi, i was actually doing something similar. I would add the mirror after the create-user. I just wanted to have a less "hacky" solution20:32
fungiand we'd need to continue to carry the jjb bits and slave scripts ourselves separately since we need them for a lot more than just devstack20:32
lyxusI see benefits in it :) Will bring it up at the next qa meetings20:35
*** denis_makogon_ has joined #openstack-infra20:36
anteayalyxus: and do bring your findings to the third party meeting too20:37
anteayaI'm keen to hear what you learn20:37
lyxusanteaya, I will20:37
*** denis_makogon has quit IRC20:37
*** denis_makogon_ is now known as denis_makogon20:37
*** dkranz has quit IRC20:38
*** dmakogon_ has joined #openstack-infra20:38
anteayathanks20:38
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Make ATC lists sort E-mails with preferred first  https://review.openstack.org/8538520:38
anteayalyxus: how's that blog post coming along20:38
anteayafungi: yay20:39
*** adalbas has quit IRC20:39
*** signed8bit_ZZZzz is now known as signed8bit20:39
fungianteaya: next up, i need to adapt that old version of the script to gerrit 2.820:39
fungihopefully it's not too involved20:39
anteayacool20:39
anteayaI hope too20:39
lyxusanteaya, getting there :) this commit is a part of it actually. If it's not merge by next week, I will just show the way that I am doing it now20:40
Longgeekfungi, anteaya: The global requirements zuul project in the module version is too low, can be updated?20:40
anteayasure20:40
anteayaLonggeek: why do you say it is too low20:40
anteayawhat are you seeing that you conclude it is too low20:41
anteayaremember there have been many cases where something was amiss with your local environment and you thought it was our system20:41
openstackgerritMorgan Fainberg proposed a change to openstack-infra/devstack-gate: Add keystonemiddleware to devstack-gate  https://review.openstack.org/10234020:41
*** sarob has quit IRC20:42
*** sarob has joined #openstack-infra20:43
openstackgerritBrant Knudson proposed a change to openstack/requirements: Add keystonemiddleware  https://review.openstack.org/10234120:43
*** sarob_ has joined #openstack-infra20:44
*** Ajaeger has quit IRC20:46
*** sarob has quit IRC20:47
*** penguinRaider has joined #openstack-infra20:47
Longgeekfungi, anteaya: In python < 2.7.4, a lazy loading of package `pbr` will break setuptools if some other modules registered functions in `atexit`. solution from: http://bugs.python.org/issue15881#msg17021520:47
*** nati_ueno has joined #openstack-infra20:48
*** devkulkarni1 has quit IRC20:48
Longgeekfungi, anteaya: No capture this bug in the zuul project https://github.com/openstack-infra/zuul/blob/master/setup.py20:49
*** mmaglana has joined #openstack-infra20:49
*** dstanek_zzz is now known as dstanek20:49
clarkbok back from food20:50
clarkbbut now zaro is gone...20:50
clarkbboris-42: how did your recheck do? have a link?20:50
clarkbjeblair any chance https://review.openstack.org/#/c/102323/1 can get reviewed? I will self approve shortly if you are busy20:51
*** sweston_ has quit IRC20:52
clarkbI am going to start writing up an email about trusty being in the gate now20:53
JayFclarkb: fwiw, the post hook for IPA that uses trusty is still nonworking20:53
clarkbJayF: oh can you link to one of the changes that merged that should've run the job?20:53
JayFclarkb: 13:47 < openstackgerrit> A change was merged to openstack/ironic-python-agent: Better errors for execute() failures  https://review.openstack.org/9966620:54
JayFthis was 7 minutes ago.20:54
openstackgerritPablo Andres Fuente proposed a change to openstack-infra/config: Added pylint job to Blazar  https://review.openstack.org/10234420:54
JayFhttp://logs.openstack.org/a4/a4079e107515027c0691fd3749fbd1b9371b28b1 404s20:54
clarkbJayF: thanks20:54
clarkbok confirmed no logs20:56
clarkbnow to see what zuul thought about it20:56
boris-42clarkb https://review.openstack.org/#/c/102152/ still working20:56
clarkbboris-42: if you look at zuul status it looks like the job ran so I think we are good20:57
boris-42clarkb yep20:57
boris-42clarkb thank you!20:57
boris-42clarkb I will make them back voting in few days20:57
boris-42clarkb after we check that everything is ok20:57
JayFclarkb: lmk if there's anything I can do to help I will. Might be off and on though as I'm at OS Bridge in Portland this week20:57
clarkbJayF: have fun20:59
clarkbI was just down there20:59
*** lcheng has quit IRC20:59
clarkbJayF: and no I think I have found it in zuul logs and now need to see why it says the job is NOT REGISTERED20:59
*** devkulkarni has joined #openstack-infra20:59
clarkbsomeone with socat/nc/telnet foo. Is there an easy way to pass output from one of those to grep?21:00
clarkbfungi: ^21:00
clarkbseems like file redirecton never works like I want it to with those21:01
fungiclarkb: netcat writes to stdout by default21:01
clarkbfungi: right but it doesn't close the connection I thought21:01
clarkbso it buffers and leaves things sad21:01
clarkbmaybe I just need to try harder21:01
*** ramashri has joined #openstack-infra21:01
fungiclarkb: oh, you may need to feed it some input21:01
fungilike 'echo | nc --options | grep foo'21:02
JayFclarkb: can you paste in the error? What fungi saw last time was that it was trying to use precise instead of trusty, and that's why it couldn't find the job21:02
*** nati_ueno has quit IRC21:02
*** nati_ueno has joined #openstack-infra21:02
JayFdepending on what flags you throw nc, it should stop running once it gets a closed socket21:02
fungiclarkb: and if it's an ssl/tls socket, i usually just use openssl s_client21:03
clarkbhttp://paste.openstack.org/show/84823/ is the issue21:03
clarkbfungi: no its going to be geard admin socket21:03
*** sweston_ has joined #openstack-infra21:03
fungiclarkb: ideally gearmand admin socket needs to grow a disconnect command (bye, close, something)21:03
fungier, geard21:04
clarkbwell ^D seems to have worked21:04
clarkbbut I had to feed it in by hand21:04
fungithen i guess it already has one ;)21:04
fungieof ftw!21:04
*** doude has quit IRC21:05
*** dizquierdo has joined #openstack-infra21:05
*** HenryG has quit IRC21:05
*** mrmartin has quit IRC21:05
clarkbhttp://paste.openstack.org/show/84824/ so the job is registered21:05
clarkbdoes that name match up with everyones eye balls?21:05
clarkbit seems to be the same to my eyes21:06
fungiclarkb: 2014-06-24 20:47:31,342 INFO zuul.Gearman: Build <gear.Job 0x7f77df2c6b50 handle: None name: build:ironic-python-agent-buildimage-coreos:bare-precise unique: ce4e358a84154ca5a5226b57c3a92f93> complete, result NOT_REGISTERED21:06
clarkbso it is possible that we are trying to run that on precise still21:06
clarkboh ya21:06
clarkbok I know what the fix is patch incoming21:06
*** julim has quit IRC21:08
openstackgerritClark Boylan proposed a change to openstack-infra/config: Run ironic python agent image builds on trusty.  https://review.openstack.org/10235021:09
clarkbJayF: fungi ^21:09
JayFlooking21:09
*** yshao has quit IRC21:11
Longgeekfungi: In python < 2.7.4, a lazy loading of package `pbr` will break setuptools if some other modules registered functions in `atexit`. solution from: http://bugs.python.org/issue15881#msg17021521:11
Longgeekfungi: No capture this bug in the zuul project https://github.com/openstack-infra/zuul/blob/master/setup.py21:12
Longgeekfungi: I can go to fix it?21:12
*** dims__ has joined #openstack-infra21:13
*** dizquierdo has quit IRC21:14
*** unicell has quit IRC21:14
*** dims_ has quit IRC21:16
*** sarob_ has quit IRC21:17
fungiLonggeek: how is this manifesting in your case? have you reported a bug at https://bugs.launchpad.net/zuul/+filebug quoting the error/traceback and describing how to reproduce it?21:17
*** lcostantino has quit IRC21:17
clarkbI approved the first build timeout JJB update change21:17
*** sarob has joined #openstack-infra21:17
clarkbI am going to self approve my change to fix pecan shortly and will do the same for IPA21:17
fungiclarkb: both lgtm, so go for it when you're ready21:18
*** lcheng has joined #openstack-infra21:18
clarkbfungi: thanks!21:18
fungii need to disappear to run some more errands, but will be back in a while21:19
JayFclarkb: if you need a dummy change created/reviewed/approved to kick off a test in IPA, ping me/jroll/joshnang/russell_h in #openstack-ironic. I'm about to go into a session so will be tied up for a while, but I'm sure they'll help if they're around21:19
clarkbJayF: will do21:19
JayFThanks for helping with this, it'll be awesome when we get IPA builds happening on every merge!21:19
*** changbl has quit IRC21:19
*** cgoncalves has quit IRC21:19
jroll\o21:19
jrollclarkb: you can just ping me here, too :P21:19
JayF/o21:19
JayFow, my head21:20
JoshNang \o/21:20
clarkbjroll: will do21:20
jrolldanke21:20
*** cnesa has quit IRC21:20
*** sarob has quit IRC21:22
*** freyes has quit IRC21:23
*** amcrn has quit IRC21:23
openstackgerritA change was merged to openstack-infra/config: Add a build-timeout macro  https://review.openstack.org/9591221:23
openstackgerritA change was merged to openstack-infra/config: Run pecan ceilometer tests on trusty for mongodb  https://review.openstack.org/10232321:23
ryanpetrelloclarkb: is there some sort of waiting period for zuul to upgrade?21:24
clarkbryanpetrello: ya the change has to merge then puppet has to apply it21:24
*** mfer has quit IRC21:24
ryanpetrellok21:24
clarkbwe should be good in about ~15 minutes I think21:24
ryanpetrellofeel free to recheck https://review.openstack.org/#/c/102325/21:24
*** sarob has joined #openstack-infra21:24
clarkbwill do21:24
ryanpetrelloand I’ll get it merged21:24
ryanpetrellothanks again for all of your help on this :)!21:24
clarkbno problem and thank you for the patience21:25
anteayaLonggeek: can you put up some logs at paste.openstack.org please21:25
anteayaLonggeek: what you are saying isn't making sense21:25
anteayaLonggeek: in order for anyone in the channel to help you21:25
anteayaLonggeek: they need to know what you are seeing21:25
*** sweston_ has quit IRC21:25
anteayaLonggeek: you frequently draw incorrect conclusions21:26
anteayaLonggeek: showing us your log files will increase the chances we can help you21:26
Longgeekanteaya: I repeat my mistakes21:26
Longgeekfungi, anteaya: thx.21:26
anteayaso does this mean you will be posting log files?21:27
Longgeekanteaya, I reproduce the error, I will release a log21:28
anteayaLonggeek: great21:29
anteayaplease post the log to paste.openstack.org21:29
*** Sukhdev has joined #openstack-infra21:29
*** melwitt has quit IRC21:30
*** melwitt has joined #openstack-infra21:31
*** melwitt has quit IRC21:31
*** melwitt has joined #openstack-infra21:31
*** melwitt has quit IRC21:31
anteayaI've had lightening and going to power down so I don't lose the valuble electronic things21:31
*** melwitt has joined #openstack-infra21:32
anteayaLonggeek: I will check in once the storm is over21:32
*** sweston_ has joined #openstack-infra21:32
anteayahaving a lot of storms so far this season21:32
*** angu5 has joined #openstack-infra21:33
*** marcoemorais has quit IRC21:33
*** marcoemorais has joined #openstack-infra21:34
Longgeekanteaya: I don't quite understand what you mean.21:35
*** harlowja_ has quit IRC21:36
*** e0ne has quit IRC21:36
*** harlowja has joined #openstack-infra21:36
*** amcrn has joined #openstack-infra21:36
*** devkulkarni has quit IRC21:37
clarkbso I started to poke at nodepool deletes and randomly picked a node to delete manually and it is stuck21:38
clarkbgoing to pick another node and see if this is persistent and try to collect some data for our cloud providers21:38
*** enikanorov_ has quit IRC21:38
*** enikanorov_ has joined #openstack-infra21:38
jeblairclarkb: back; need help?21:40
*** jhesketh has quit IRC21:41
*** mbacchi has quit IRC21:43
clarkbjeblair: if  you could poke at nodepool that would be good21:45
clarkbI just got Exception: Timeout waiting for server 9da07261-c4e1-43cb-9bb5-ef1d1b9a402e deletion in rax-dfw21:46
clarkbtrying a second node now to see if this is persistent21:46
*** esker has quit IRC21:46
ryanpetrelloclarkb: re-running https://review.openstack.org/#/c/102325/ and it hasn’t auto-failed :D21:47
jeblairclarkb: this seems to be a rax problem21:47
clarkbjeblair: ya I agree21:47
clarkbryanpetrello: woot21:47
*** esker has joined #openstack-infra21:47
ryanpetrelloclarkb: awesome, if this passes, I’ll get everything merged and the other pecan jobs that are stuck21:47
clarkbryanpetrello: though it is queued still21:47
ryanpetrelloyea, true21:47
ryanpetrello\o/21:47
ryanpetrellothough, beforehand21:48
clarkbI wonder if reloading functions doens't update the timestamp on the zuul status page21:48
ryanpetrellothe ceilometer jobs were going *immediately* into NOT_REGISTERED21:48
clarkbbecause I don't see an up to date timestamp but functions should've been registered a while ago21:48
clarkbryanpetrello: ah perfect then I think we may have this sorted21:48
*** changbl has joined #openstack-infra21:48
ryanpetrelloyep, I think so :)21:49
ryanpetrellowe’ll see how it goes21:49
*** xyang1 has quit IRC21:49
ryanpetrelloactually, nope :\21:49
ryanpetrellojust failed w/ NOT_REGISTERED21:49
*** mriedem has quit IRC21:49
jeblairclarkb: does puppet updating the functions file send zuul sighup?21:49
openstackgerritKhai Do proposed a change to openstack-infra/jenkins-job-builder: tests for JJB command processing  https://review.openstack.org/9790821:49
clarkbjeblair ryanpetrello: looks like zuul just updated21:49
*** andreykurilin_ has quit IRC21:50
clarkbI was expecting it to be quicker but apparently not. It is almost like the puppet runner updates on the n + 1 run21:50
clarkbryanpetrello: I would expect it to work now21:50
clarkbryanpetrello: pushing a new patchset would be the quickest way to do that or we can wait21:50
ryanpetrellowould another recheck do it?21:50
clarkbryanpetrello: no, it will be ignored until the current recheck reports21:51
clarkbso we can wait for it to report then recheck21:51
ryanpetrellothat’s fine, I’ll do that21:51
ryanpetrelloI guess I could recheck another change21:51
*** yjiang5_away is now known as yjiang521:51
clarkbryanpetrello: yup you could do that too though only the one you rechecked should pass21:51
*** esker has quit IRC21:51
clarkbprobably workth just waiting21:51
ryanpetrelloyep, agreed21:51
jeblairclarkb: http://paste.openstack.org/show/84829/21:52
jeblairclarkb: so that node (picked at random) has been stuck in build for a long time21:53
clarkbwow21:53
jeblairphschwartz: http://paste.openstack.org/show/84829/21:53
*** nati_ueno has quit IRC21:53
jeblairphschwartz: we're seeing a lot of nodes that we can't delete stuck in the 'build' state21:53
openstackgerritBoris Pavlovic proposed a change to openstack/requirements: Add osprofiler to global requirements  https://review.openstack.org/10236221:53
*** nati_ueno has joined #openstack-infra21:54
phschwartzjeblair: are they all in dfw?21:54
jeblairphschwartz: was just looking at that, i think so21:54
jeblairphschwartz: yep21:54
phschwartzjeblair: looking21:55
jeblairphschwartz: timestamps are clustered making it look like maybe an event from 5-6 hours ago21:55
clarkbthere are a few older nodes too21:55
clarkbbut yes 5-6 hours ago is the bulk of them21:56
*** mrda-away is now known as mrda21:56
*** eharney has quit IRC21:56
phschwartzhmm, looks to be something causing the delete to fail on those and it in turn due to the issue from upstream that jogo put a review out to fix has the task_state stuck in deleting so reissuing a delete won't do it.21:56
openstackgerritKhai Do proposed a change to openstack-infra/config: puppetize installation of gerrit third party plugins  https://review.openstack.org/9119321:56
*** annegent_ has quit IRC21:57
*** amcrn has quit IRC21:58
*** amcrn_ has joined #openstack-infra21:58
*** devkulkarni has joined #openstack-infra21:59
*** dhellman_ has quit IRC22:00
jeblairphschwartz: are you still doing the periodic cleanup of task_state?  if so, nodepool should get around to deleting those once it clears up22:01
openstackgerritA change was merged to openstack-infra/config: Run ironic python agent image builds on trusty.  https://review.openstack.org/10235022:01
clarkbjeblair: https://review.openstack.org/#/c/102300/ is the other thing probably worth discussing/mulling over22:01
clarkbjeblair: we could jump the gun a bit on bare-trusty and bump the bare minimum there now too22:02
clarkbthen backfill as we move projects22:02
*** denis_makogon has quit IRC22:02
*** r1chardj0n3s has joined #openstack-infra22:02
phschwartzjeblair: No, we are not doing periodic clean up of task state, but probably should if we can't get a release out soon with jogo's patch.22:03
jeblairclarkb: it's probably not worth worrying about too much, we're mostly operating under demand load22:03
dhellmannanteaya: can you help me figure out why merges to oslo-specs are not being announced in #openstack-oslo? maybe tomorrow?22:03
phschwartzjeblair: I have talked with our cloud ops, they are going to go through them and clean up the task state and clear them.22:03
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: [WIP] Added search interface  https://review.openstack.org/9997522:04
jeblairphschwartz: cool.  we're all rooting for you!  :)22:04
*** rloo is now known as rloo_gone22:04
*** jpeeler has quit IRC22:04
*** e0ne has joined #openstack-infra22:07
*** craigbr has quit IRC22:07
*** mbacchi has joined #openstack-infra22:07
*** signed8bit has quit IRC22:07
*** jhesketh has joined #openstack-infra22:08
openstackgerritA change was merged to openstack-infra/config: Rebalance nodepool min ready numbers for trusty  https://review.openstack.org/10230022:08
jheskethMorning22:08
jheskethzaro: thanks for the extra feedback, I'll take a look shortly :-)22:09
*** e0ne_ has joined #openstack-infra22:09
*** jaypipes has quit IRC22:11
*** miqui has quit IRC22:11
*** e0ne has quit IRC22:12
*** e0ne_ has quit IRC22:12
*** nijaba has quit IRC22:13
phschwartzjeblair: ok, it will take a bit, but they are going to clear it up.22:13
*** pdmars has quit IRC22:13
phschwartzAnd with that, I bid you all ado. Time to head to the hotel and get dinner, and then traveling home tomorrow finally.22:14
jeblairphschwartz: good night!22:14
mattoliverauMorning all22:14
jeblairit's the wherever-phschwartz-is / AU handoff :)22:15
clarkbmattoliverau: o/22:15
*** nijaba has joined #openstack-infra22:15
*** nijaba has joined #openstack-infra22:15
phschwartzjeblair: At Castle in Sat, I think Justin there is in Aus22:16
mattoliverauYep tag team time :)22:16
*** melwitt has quit IRC22:16
*** melwitt has joined #openstack-infra22:16
*** melwitt has quit IRC22:17
*** melwitt has joined #openstack-infra22:17
openstackgerritBoris Pavlovic proposed a change to openstack/requirements: Add osprofiler to global requirements  https://review.openstack.org/10236222:18
*** bknudson has quit IRC22:18
*** ihrachyshka has quit IRC22:18
clarkbok feedback time22:19
clarkbmoving projects to trusty by default. Should we just run tests by hand, if they pass move projects without asking?22:20
clarkbI have a feeling most projects just want it to happen without their input22:20
clarkband I am comfortable doing ^22:20
jeblairclarkb: yep22:20
clarkbok I will start working on that. My change to make bare-trusty an option needs rebasing22:24
*** HenryG has joined #openstack-infra22:27
*** markmc has quit IRC22:28
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from gerrit  https://review.openstack.org/10208822:30
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from javascript  https://review.openstack.org/10208922:30
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from groups  https://review.openstack.org/10209022:31
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from openstackid  https://review.openstack.org/10208622:31
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove envinject from gerrit-plugin-jobs  https://review.openstack.org/10208722:31
*** Longgeek has quit IRC22:32
JayFclarkb: need me to get a change into IPA to test your merged fix?22:32
openstackgerritClark Boylan proposed a change to openstack-infra/config: Allow pecan ceilometer jobs to run on bare-trusty  https://review.openstack.org/10237022:32
clarkbJayF: let me check the zuul timestamps22:32
JayFclarkb: k22:32
clarkbryanpetrello: jeblair ^ I completely derped that. had the file open and everything but didn't commit them22:33
*** penguinRaider has quit IRC22:33
*** craigbr has joined #openstack-infra22:34
anteayaphschwartz: travel safely22:34
anteayajhesketh mattoliverau morning22:34
anteayadhellmann: sure22:34
clarkbJayF: jroll yes I think if you do it now we have the correct zuul config loaded22:35
*** yamahata has quit IRC22:35
*** dstanek is now known as dstanek_zzz22:36
mattoliveraumorning anteaya :)22:36
jrollclarkb: thanks22:36
anteayaLongeek: I meant the weather was bad at my house and I had to unplug my modem until the storm passed22:36
anteayamattoliverau: :)22:36
*** nijaba_ has joined #openstack-infra22:36
*** nijaba has quit IRC22:36
r1chardj0n3sohai anteaya: I'll be coming to Germany :)22:37
*** Ryan_Lane has joined #openstack-infra22:38
*** dstanek_zzz is now known as dstanek22:38
anteayar1chardj0n3s: woooooo22:38
anteayayaya22:38
r1chardj0n3shope I can help :)22:39
anteayaand I learned from jhesketh that he and mattoliverau will be lingering over the weekend22:39
anteayafor sure22:39
r1chardj0n3syeah, I will as well, though I'm going to be heading up to Berlin for EuroPython at some point22:39
anteayamany a pypi question will be grateful resolved in darmstadt22:39
r1chardj0n3syes!22:39
anteayawonderful22:39
anteayayay22:39
anteayaI took 3 days for myself so will be hanging out in europe til tuesday22:40
anteayano plans yet just chilling22:40
r1chardj0n3snice!22:40
anteayafigured I would make up my mind once I got there22:40
anteayaso hanging with the au folks will work nicely22:41
*** lcheng has quit IRC22:41
JayFclarkb: https://review.openstack.org/102371 is making it's way through, we'll see if it builds when it gets there22:41
anteayadid they tell you we went to the aquarium together in atlanta22:41
anteayathey had to keep fetching me22:41
clarkbJayF: cool22:41
anteayaI got mesmerized22:41
clarkbanteaya: you were beyond mesmerized22:42
anteayaI was22:42
r1chardj0n3santeaya :)22:42
anteayawater is my home22:42
clarkbI think we could have left you in front of that big glass wall for days22:42
* fungi is flying from germany to oregon with a overnight layover in virginia22:42
anteayaI just live on land when I have to22:42
clarkbfungi: sounds like fun22:42
anteayaclarkb: yep22:42
anteayadays22:42
clarkbI will be flying to seattle direct then driving down sunday afternoon22:42
anteayafungi: you have all the fun22:42
jeblairthen this is anteaya's kryptonite: http://www.montereybayaquarium.org/animals-and-experiences/live-web-cams/kelp-forest-cam22:42
clarkbso I get one night in my own bed22:43
anteayaoh yeah22:43
anteayawooooo22:43
anteayaI'll never get anythign done again22:43
fungii'd have found that mesmerizing too22:43
anteayajeblair knows me22:43
anteayathe rays22:43
anteayathe rays were so beautiful22:44
anteayabig sweeping motions22:44
clarkbanteaya: the waterproof roombas are amazing22:44
anteayaha ha ha22:44
fungithe asheville nature center used to run a channel on the local cable provider which was just rotating between cameras throughout their river otter habitat. i could watch it for hours22:44
anteayaoh river otters22:44
anteayathey were the best22:44
*** lttrl has quit IRC22:44
anteayawhich is why I got a stuffed otter toy for pleia222:45
* gothicmindfood 's spirit animal is the sea otter22:45
anteayagothicmindfood: yeah I can see that22:45
*** nijaba_ has quit IRC22:45
anteayaso while I am watching the fish22:45
anteayawhy isn't oslo-specs reporting in openstack-oslo? http://git.openstack.org/cgit/openstack-infra/config/tree/modules/gerritbot/files/gerritbot_channel_config.yaml#n75422:46
anteayadhellmann says it isn't22:46
anteayabut it is in the yaml file22:46
anteayawhat else has to happen?22:46
*** boris-42 has quit IRC22:46
clarkbanteaya: maybe that bot dropped from their channel22:46
anteayaah22:46
clarkbaccording to /names it is there22:47
anteayahmmmm22:47
*** yamahata has joined #openstack-infra22:48
anteayathe bot is reporting on other changes: http://eavesdrop.openstack.org/irclogs/%23openstack-oslo/%23openstack-oslo.2014-06-24.log22:48
anteayawait22:48
anteaya2014-06-24T15:37:50  <openstackgerrit> Doug Hellmann proposed a change to openstack/oslo-specs: Update oslo.log spec to include context and local  https://review.openstack.org/10227522:48
anteayait is reporting22:48
anteayaI wonder why dhellmann thought it wasn't22:49
anteayasorry merges22:49
jeblairgothicmindfood: then you want this webcam: http://www.montereybayaquarium.org/animals-and-experiences/live-web-cams/sea-otter-cam ;)22:49
anteayahe wants merges announcedd22:49
anteayabut he will get merges for every repo reporting, in additon to oslo-specs22:49
anteayaI'll offer a patch for that22:50
*** nijaba has joined #openstack-infra22:51
*** marcoemorais has quit IRC22:53
fungigothicmindfood: good choice, though i'm pretty sure my spirit animal is the tree sloth22:53
*** marcoemorais has joined #openstack-infra22:53
*** marcoemorais has quit IRC22:54
*** marcoemorais has joined #openstack-infra22:54
*** marcoemorais1 has joined #openstack-infra22:55
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Announce openstack repo merges in #openstack-oslo  https://review.openstack.org/10237622:55
anteayadhellmann: ^22:56
*** marcoemorais2 has joined #openstack-infra22:56
*** marcoemorais2 has quit IRC22:56
*** virmitio has quit IRC22:56
*** hashar has quit IRC22:56
*** marcoemorais2 has joined #openstack-infra22:56
anteayafungi: ha ha ha22:57
anteayajeblair: is there a web cam for that?22:57
*** zzelle_ has quit IRC22:58
*** nijaba has quit IRC22:58
*** marcoemorais has quit IRC22:59
anteayar1chardj0n3s: add your name: https://wiki.openstack.org/wiki/Qa_Infra_Meetup_201422:59
*** marcoemorais1 has quit IRC22:59
jeblairanteaya: aww i would love that23:00
gothicmindfoodjeblair: I am a member of the aquarium and often go there and talk to those guys!23:00
*** adrian_otto has quit IRC23:01
gothicmindfoodnow I can talk to them!23:01
*** doug-fish has left #openstack-infra23:01
*** r1chardj0n3s has quit IRC23:01
anteayaI think the tree sloths move so slowly they mould23:01
*** boris-42 has joined #openstack-infra23:02
anteayagothicmindfood: ohhhh, that sounds amazing23:02
gothicmindfoodfungi: http://jezebel.com/sloth-singing-i-will-always-love-you-will-make-you-alwa-144433874223:02
anteayaoohhhh feeding in the kelp forest23:03
jeblairgothicmindfood: i think hp matches donations to mbayaq.  which is not a shock when you think about who started it.23:03
fungigothicmindfood: bwahahahaha23:03
*** atiwari has quit IRC23:03
*** chuckC has quit IRC23:04
clarkbjeblair: I notice we are 200 patches beyond the last release of zuul23:04
clarkbjeblair: should probably consider a release after the comment requires stuff is sorted23:04
*** james_li has quit IRC23:05
gothicmindfoodon a serious note: does anyone have any experience with paste.openstack.org who can tell me if it's possible to delete a paste, ever?23:05
*** dkliban is now known as dkliban_afk23:05
*** changbl has quit IRC23:05
clarkbgothicmindfood: not really, I mean technically yes I think so23:05
clarkbbut you shouldn't count on it23:05
notmynamelooks like mordred isn't around today?23:06
gothicmindfoodclarkb: we have security people internally at HP having problemos with paste because fo thae lack of delete capabilities23:06
clarkbgothicmindfood: tell them to not use it then?23:07
clarkbgothicmindfood: users can't delete pastes23:07
gothicmindfood:P23:07
clarkbnotmyname: I have not seen him23:07
gothicmindfoodclarkb: even if an admin can, we can run that by them23:07
clarkbgothicmindfood: I think an admin can, but I haev never done it23:07
notmynameclarkb: ok. I'll start deleting those 28 patches23:07
notmynameclarkb: errr...s/deleting/abandoning/23:07
clarkbgothicmindfood: same story with etherpad-lite23:08
*** _nadya_ has joined #openstack-infra23:08
notmynameclarkb: or IRC logs? ;-)23:08
*** r1chardj0n3s has joined #openstack-infra23:08
clarkbya23:08
*** yamahata has quit IRC23:08
notmynameor anything you put on the internet?23:08
clarkbexactly23:08
*** e0ne has joined #openstack-infra23:09
*** otherwiseguy has quit IRC23:09
fungipublic mailing lists...23:09
fungiwebsites which get indexed by, well, anything/anyone potentially forevars23:09
* gothicmindfood also thinks it's a silly concern since it's all inside our corp network, but whatevs23:09
anteayagerrit23:09
r1chardj0n3santeaya: added23:11
anteayar1chardj0n3s: wooooo23:11
anteayaits official now23:11
anteayayou are one of us23:11
anteayayay!!23:11
r1chardj0n3s\o/23:11
anteaya:D23:11
r1chardj0n3s(it's a good thing, right?)23:11
anteayaha ha ha23:11
anteayaif you have to ask?23:11
r1chardj0n3sI hear you like aquariums here23:11
anteayalooking at code yet?23:12
fungigothicmindfood: ooh, another one... wikis have page revision histories too23:12
anteayaor buried under hr stuff still?23:12
anteayayeah, so tell them never to do or touch anything I guess23:12
r1chardj0n3santeaya: psssh hr. I'm getting into the codez. Poking around. Y'know.23:12
anteayathey will be safe23:12
*** _nadya_ has quit IRC23:12
anteayar1chardj0n3s: thats the spirit23:12
*** e0ne has quit IRC23:12
anteayar1chardj0n3s: any questions yet?23:12
anteayar1chardj0n3s: just make sure you get paid23:13
gothicmindfoodfungi: so do etherpads! (but I've decided to not mention that to the pen testers, shhh)23:13
*** esker has joined #openstack-infra23:13
r1chardj0n3santeaya: yes, many questions, but they have all been answered by online stuffs so far, which is encouraging :)23:13
*** wenlock_ has quit IRC23:13
anteayar1chardj0n3s: cool23:13
anteayagothicmindfood: yeah it is only in irc channel logs, they'll never find it23:14
fungithey'd have to learn to use teh googles first23:15
anteayaha ha ha23:16
*** arnaud__ has joined #openstack-infra23:17
anteayar1chardj0n3s: oh sorry I missed your aquariums question, I was watching the fish being fed :)23:17
anteayaI just love water23:17
anteayaand last summit was in atlanta which has a huge aquarium23:18
anteayawhale sharks, rays, fish of all kinds23:18
r1chardj0n3santeaya: we have one of those cool tunnels in our aquarium here. And big, big walls. Such coolness. Also the zoo has frolicking seals that I can just watch for ages :)23:18
anteayasea dragons, razor fish, otters23:18
anteayaohhhhh, where do you live23:18
r1chardj0n3sMelbourne23:18
r1chardj0n3syou should totally have a meetup here23:18
anteayaand what conference can I speak at?23:18
anteayatotally23:18
anteayataht is where cyeoh is right?23:19
anteayaI want to go there anyway23:19
anteayaso yeah, now we have to plan a meetup or conference23:19
r1chardj0n3s:)23:19
anteaya:D23:19
anteayagotta think ahead23:19
r1chardj0n3sPyCon AU is in Brisbane this year and has an OpenStack miniconf23:20
anteayayeah23:20
r1chardj0n3sAugust23:20
anteayaI put in an proposal23:20
anteayadon't know the outcome yet23:20
* r1chardj0n3s crosses fingers23:20
anteayabut I am hopeful23:20
anteayathanks23:20
anteayamattoliverau has promised me water parsk23:20
r1chardj0n3sI'm the programme chair for the main conf, not the miniconfs, so can't help I'm afraid ;)23:20
anteayaparks23:20
r1chardj0n3syes!23:20
anteayacool23:20
anteayahow is the main conf shaping up?23:21
r1chardj0n3sit's gonna be a hoot as always. got some good talks lined up (should be announced imminently)23:21
anteayagreat23:22
anteayaI look forward to seeing the schedule23:22
anteaya:D23:22
mattoliverauanteaya: I'm in Melbourne too so yes you must find a way to come here :)23:22
anteayayes yes23:22
anteayawe must make it happen23:22
openstackgerritClark Boylan proposed a change to openstack-infra/config: Prep JJB jobs for running on bare-trusty  https://review.openstack.org/10130323:23
openstackgerritBoris Pavlovic proposed a change to openstack/requirements: Add osprofiler to global requirements  https://review.openstack.org/10236223:23
clarkbok 101303 should allow us to start migrating projects to trusty as the default platform23:23
clarkbI removed some of the rally changes that I had there previously as I think we should decouple that23:23
clarkbwe have rally owrking now without that extra work23:23
*** mwagner_lap has joined #openstack-infra23:25
*** devkulkarni has quit IRC23:25
*** Ryan_Lane has quit IRC23:25
*** hogepodge has quit IRC23:26
*** markwash has quit IRC23:26
anteayaIt is Anita feeding time, there is no web cam for this23:27
JayFclarkb: per http://status.openstack.org/zuul/ the post job is queued23:28
clarkboh cool there it is and we haven't gotten a NOT registered yet23:28
*** Sukhdev has quit IRC23:29
mattoliverauanteaya: lol, not yet :P23:31
fungiclarkb: on 101303 there are several entries in jjb projects.yaml which you missed... on purpose?23:31
fungii'll flag them for you in the review23:32
clarkbfungi: I think maybe not and the difference between today and monday is biting me23:32
clarkbthough I did a git grep bare-precise to look for them23:32
fungisee inline comments. otherwise lgtm23:34
clarkbthanks23:34
*** chuckC has joined #openstack-infra23:35
*** mbacchi has quit IRC23:35
mattoliveraufungi: looks like you've been having fun normalising the gerrit acls :P I had a play if you make a core group the owner in [access "refs/heads/*"] they will have the delete branch button in gerrit.23:36
clarkbfungi: yup that one is intentional. I will fix the other two23:36
mattoliverauat least in my test gerrit instance anyway23:37
openstackgerritClark Boylan proposed a change to openstack-infra/config: Prep JJB jobs for running on bare-trusty  https://review.openstack.org/10130323:37
clarkbthere we go23:37
fungimattoliverau: owner definitely, though we want to avoid granting that since it comes with too many other overrides23:39
fungimattoliverau: i suspect that also grants, for example, push --force23:39
mattoliveraufungi: yeah, but the only other configuration I could use to get the button is push --force.23:39
fungimattoliverau: create on refs/* didn't work?23:40
fungi(to get the delete button that is)23:40
mattoliverauNot in my testing, but I'll quickly try agian, I tested this early last week :P23:40
openstackgerritA change was merged to openstack-infra/config: Allow pecan ceilometer jobs to run on bare-trusty  https://review.openstack.org/10237023:40
fungizaro had some suggestions there, i'll have to get him to go into more detail when he's around23:41
anteayamattoliverau: I have a bandaid over my laptop cam23:41
*** david-lyle has quit IRC23:41
angu5hi all, if solum depends on mistralclient (not in global requirements - not we don't gate on the requirement check) , will the pypi.openstack sync up new releases of mistralclient?23:42
*** david-lyle has joined #openstack-infra23:42
*** jaypipes has joined #openstack-infra23:43
angu5the question is really "what is the mechanism of syncing pypi packages"23:43
clarkbangu5: it will not23:43
angu5bugger23:43
clarkbbut if you are not part of global requirements then it doesn't matter23:43
clarkbyou will fall back on pypi.python.org23:43
angu5well mistral client released a new version23:43
angu5and it is claiming to not exist23:44
angu5http://logs.openstack.org/07/97207/12/check/gate-solum-pep8/6dc7b36/console.html23:44
angu5No distributions at all found for python-mistralclient>0.0.223:44
angu5mistral released 0.0.423:45
*** oomichi has joined #openstack-infra23:45
angu5https://pypi.python.org/pypi/python-mistralclient/23:45
*** marcoemorais2 has quit IRC23:45
clarkbangu5: https://git.openstack.org/cgit/openstack/requirements/tree/projects.txt#n69 you are gated on global requirements23:45
*** marcoemorais has joined #openstack-infra23:45
*** amalagon has quit IRC23:45
angu5it's not voting23:45
clarkbjeblair: fungi: just realized that the mirror27 slave should probably be rebuilt as trusty in the near future too23:46
*** marcoemorais has quit IRC23:46
fungiclarkb: concur23:46
*** marcoemorais has joined #openstack-infra23:46
*** david-lyle has quit IRC23:46
clarkbthat just went up on my whiteboard. I can stab at it later23:46
jeblairclarkb: yeah, though i think it's non-urgent23:46
*** gokrokve has quit IRC23:47
fungiangu5: in this case "gated on global requirements" means that all your jenkins jobs get run with our restrictive openstack-reqs-only mirror if your project is listed in that file23:47
*** jamielennox|away is now known as jamielennox23:47
angu5I see!23:47
angu5so I should remove solum from that then23:48
fungiangu5: regardless of whether the requirements matching job is set to voting or non-votinh23:48
*** dangers is now known as dangers_away23:48
angu5thanks fungi, I'll put up a patch for that23:48
fungiangu5: yes, unless you expect to be able to get by on only packages openstack also depends on23:48
angu5(we need mistral)23:48
clarkbright but does openstack?23:49
clarkbyou have to convince openstack it needs it before it goes into the global requirements23:49
angu5clarkb: I meant, I'll remove solum out of that list23:50
clarkboh that works23:50
*** otter768 has joined #openstack-infra23:50
angu5are there any other repercussions that I should know about?23:51
*** timrc is now known as timrc-afk23:51
angu5(from removing solum from the projects.txt)23:51
fungiangu5: you won't be getting proposed requirements update changes any longer, but if you need things which aren't in the global requirements list then that would have been kinda pointless anyway23:51
clarkband you may get the occasional job falure when pypi.python.org is unresponsive23:51
angu5that sucks23:51
*** marcoemorais has quit IRC23:52
angu5well we are mostly compatible23:52
*** marcoemorais has joined #openstack-infra23:52
angu5it's just mistralclient23:52
angu5that we need23:52
angu5It would be good to be able to set a flag to say "please use pypi.python.org"23:53
mattoliveraufungi: nope, create on refs/* isn't working for me :(23:53
clarkbangu5: that would defeat the purpose23:53
fungimattoliverau: okay, i'll have to find out what it was zaro was suggesting then23:53
clarkbangu5: as it would allow dependencies to sneak in and we would have jobs that fail when pypi.python.org breaks23:54
angu5clarkb: well we want 99% of the requirments to match23:54
mattoliveraufungi: cool, well let me know and I'll give it a test23:54
mattoliveraufungi: I'll keep playing tho :)23:54
angu5ok, I guess we can manually sync the requirements23:54
clarkbangu5: right but once you allow pypi in there is no way to do both23:55
clarkbbecause pypi is wide open23:55
fungiclarkb: i assume he means as an option for stackforge projects to use so they can opt in/out of the proposals and the requirements enforced mirror separately23:55
fungirather than having those tightly coupled to a common list23:55
angu5yeah, we want our versions to match other projects23:55
angu5but be able to depend on one or two non-approved packages23:56
clarkbfungi: right but if you allow that then any project can do it23:57
clarkbthis was intentionally super heavy handed23:57
angu5I am not sure I like this "you are either in or you are out"23:57
*** yamahata has joined #openstack-infra23:57
angu5we are really trying to do the right thing23:58
clarkbright but I don't know how you solve this problem otherwise23:58
*** harlowja_ has joined #openstack-infra23:58
clarkbthe goal is to enforce requirements on projects23:58
clarkband provide reliability23:58
fungithis is another one of those things we set up to avoid specific kinds of breakage on official projects, but which non-official projects want to (perhaps only partially) make use of as well. if the flag was in the projects file, then the risk is no different from someone proposing to remove a project from that file23:58
*** timrc-afk is now known as timrc23:58
clarkbboth require not using pypi.python.org23:58
angu5ok, well I'll remove solum for now23:58
JayFclarkb: http://status.openstack.org/zuul/ am I being impatient (i.e. no trusty nodes available for 45m+) or could there be a problem scheduling the post job?23:58
dstufftpypi is a pretty cool thing23:59
clarkbJayF: you are being impatient :P we have been backlogged all day23:59
dstuffty u hating ChanServ23:59
dstuffter clarkb23:59
clarkbJayF: rax is broken23:59
fungihowever i agree that the risk from additional complication to that mechanism solely to support stackforge projects is potentially not warranted23:59
dstufftstupid tab complete23:59
dstufftclarkb: ;P23:59
clarkbdstufft: its definitely better than it was :)23:59
JayFclarkb: should only be in LON? Assuming this is our scheduled maintenance23:59
clarkbJayF: no its some nova bug hitting you guys23:59
clarkbJayF: dfw23:59
JayFah okay, well hopefully we have people on that?23:59
dstufftobviously it's punishment for not using IAD23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!