Wednesday, 2014-08-13

dansmithyep00:00
clarkbmordred: I think we agree on the goal00:00
mordredclarkb: now, the mechanism for doing that ...00:00
clarkbmordred: we just don't agree on the mechanism00:00
* krotscheck is blatantly abusing the short zuul queue00:00
krotscheckrebase all the things!00:00
mordredkrotscheck: now's the time!00:00
jogoclarkb: eww00:00
mordredclarkb: if docker were an option (stupid iscsi) I'd actually just be sugesting that we cook up a way to have folks be able to collaborate on dockerfiles00:00
mordredclarkb: but it's not, beacuse of iscsi00:00
jogomordred: to not using an exernal distro for deciding the libvirt version00:01
mordredbut the nice thing about it is that it's potentially quite straightforward to express the thing someone wants00:01
*** dims_ has quit IRC00:01
mordredwhich making our own packaging repos where people can edit a debian control file or an rpm spec ... not so much00:01
mordredthere will be like 10 people who hack in those ever and it'll be truly a nightmare00:01
*** dims_ has joined #openstack-infra00:01
clarkbmordred: ya00:02
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Removed nodeenv dependency  https://review.openstack.org/10619100:02
mordredclarkb: which leaves me sort of at a mix between what you were saying and what I'd been thinking ...00:02
mordredclarkb: what if we did an overlay ports tree like thing on top of a regular distro00:02
clarkbjogo: I can't find the cahnges in gerrit anymore00:02
clarkbmordred: hrm, thats not insane00:03
dansmithclarkb: don't flatter him00:03
dansmithmordred: the best I can say about that thing is that it's not insane00:03
mordredit may not be "sexy" ... but like devstack, it might be unsexy enough to actually work00:03
clarkbmordred: we might even be able to take arch ports at a snapshot in time and update it periodically00:03
clarkbmordred: rather than rolling00:03
mordredand also unsexy enough to CLEARLY be something you should not run in production00:03
mordredclarkb: ++00:03
lifelessdhellmann: I'm lost - what docstring correctly ? in https://review.openstack.org/#/c/94108/00:03
clarkbexcept arch is different enough to not work on ubuntu00:03
mordredclarkb: you know ... afs has this feature ...00:03
*** amotoki has joined #openstack-infra00:03
clarkbmordred: I was waiting for afs to solve the problems00:04
mordredclarkb: well, it's still the overlay00:04
lifelessmordred: you could use nix00:04
lifeless:)00:04
lifelessits designed directly at the problem space we have here, I think.00:04
clarkblifeless: nix would have the same problem as debs though00:04
mordredclarkb: but it does support the idea of installing software into the afs space and then sanely mounting in an arch-dependent way locally00:04
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Assocate StoryTag with Story via mapping  https://review.openstack.org/11363500:04
clarkblifeless: its designed to solve this problem but isn't any more approachable than debs imo00:04
clarkblifeless: of course I haven't used it and should probably fix that00:05
*** marun has joined #openstack-infra00:05
mordredyah. too esoteric for our devs I fear00:05
*** SumitNaiksatam has joined #openstack-infra00:06
*** dims_ has quit IRC00:06
lifelessclarkb: I'm confused about https://review.openstack.org/#/c/107859/; zuul claimed it started stuff, but I can't see it in the zuul queue00:06
clarkblifeless: zuul was just restarted00:06
clarkblifeless: your event may have been eaten00:07
*** unicell has joined #openstack-infra00:07
lifelessok, poked again00:08
clarkbfor the record I gave up on that thread when it turned into a infra go do all this crazy work that I am waving my hands about00:08
mordredclarkb: there was a thread?00:08
clarkbso I really do think we need to think in concrete possibilities and not wave our hands around what we want here00:08
clarkbmordred: yes fair standards for all hypervisor drivers00:08
mordredoh. that00:08
mordredyeah00:08
clarkbmordred: I asked for concrete ways of achieving nova's things00:08
clarkbmordred: was hand waved at00:09
*** amotoki has quit IRC00:09
mordredso, luckily the problem is more general that hypervisors00:09
mordredand I think we probably know everythin we need to know at this point to solve it00:09
mordredas in, I don't think more data or input will help00:09
mordredbut I do agree, it's time for concrete proposals00:09
clarkbI think it would be worth an experimental arch job00:10
clarkbif only to show people that one extreme is not doable (like me)00:11
clarkbof course devstack doesn't pacman00:11
clarkbso that is probably not worth the effort00:11
mordredclarkb: you could get the same effect with a debian sid job00:12
clarkbmordred: no arch is miles more stable than debian sid00:12
mordredclarkb: but devstack does deb00:12
krotscheckmordred: You know tox and node things, mind taking a look at https://review.openstack.org/#/c/106191 ?00:12
mordredkrotscheck: looking00:12
*** david-lyle has quit IRC00:12
mordredkrotscheck: have you seen dox?00:13
clarkbwe can also run our own deb and rpm repos with packages we curate (I haev zero interest in this for the reasons above, it shifts all of the responsibility to us and we already have enogh to worry about)00:13
krotscheckmordred: I have not.00:13
salv-orlandofungi: I and rhsu have found the root cause of the issue. With our great shame we missed the mailing list post about the fact that ^(recheck|reverify).* namespace is off limits. We are now compliant with the recheck syntax.00:13
clarkbwe can run nix based packages. this has the benefit of allowing us to do version selection at job runtime00:13
krotscheckmordred: ANd google hates me00:13
clarkbI really like nix for that reason, thought we will have to do the work above00:13
mordredkrotscheck: thing I've been hacking on recently00:13
salv-orlandofungi: maybe if you can indicate me how I can prove that I’ll be happy to do that.00:13
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Put a default section header above the TTL  https://review.openstack.org/10032800:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: StoryBoard module bounces apache on update  https://review.openstack.org/10032900:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Add Storyboard puppet module  https://review.openstack.org/10032100:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Added Authorization Header flag to storyboard module  https://review.openstack.org/10032200:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard run over ssl  https://review.openstack.org/10032300:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard projects from projects.yaml  https://review.openstack.org/10032400:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard superusers from yaml file  https://review.openstack.org/10032500:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Storyboard token expiration increased  https://review.openstack.org/10032600:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard idempotent  https://review.openstack.org/10032700:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Modularized StoryBoard Module  https://review.openstack.org/11372400:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Fixed location of storyboard configuration file  https://review.openstack.org/11372500:14
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Create storyboard configuration directory  https://review.openstack.org/11372600:14
salv-orlandoI’ve tried it with my personal account but that can’t post comments for “verified”00:14
krotscheckooooOOOooooo00:14
clarkbwe can use a ports based solution where our image builds build things from source00:14
mordredkrotscheck: https://github.com/emonty/dox <-- it's like tox, except docker instead of virtualenv00:14
clarkbsince we already build images doing stuff from source is not super scary00:14
clarkbbut isn't really dev friendly00:14
mordredclarkb: althuogh that means we have to install more things into the iage like gcc and whatnot that could pollute things00:15
clarkbmordred: yes, but I think having a dev env on what are basically de vboxes is ok00:15
mordredclarkb: also not dev friendly00:15
krotscheckmordred: Huhn. That’s pretty neat00:15
clarkbmordred: yup00:15
*** lyxus has joined #openstack-infra00:15
lifelessdhellmann: found it00:16
*** sdake has quit IRC00:16
clarkbmordred: if we want to be honest te most dev friendly thing is using what the distros give us00:16
clarkbmordred: then you don't need anythin special beyond an install of X distro00:16
openstackgerritlifeless proposed a change to openstack-dev/pbr: Teach pbr about post versioned dev versions.  https://review.openstack.org/8044900:16
lifelessdhellmann: fixed.00:16
openstackgerritlifeless proposed a change to openstack-dev/pbr: Raise an error if preversion versions are too low  https://review.openstack.org/10826900:16
openstackgerritlifeless proposed a change to openstack-dev/pbr: Look for and process sem-ver pseudo headers in git  https://review.openstack.org/10827000:17
openstackgerritlifeless proposed a change to openstack-dev/pbr: Introduce a SemanticVersion object  https://review.openstack.org/9410800:17
mordredkrotscheck: that patch does not seem crazy00:17
krotscheckmordred: And it runs, too.00:17
krotscheckmordred: And the build time is cut in half.00:17
mordredclarkb: well, but that's not dev friendly if they want to propose that openstack needs a new version of libvirt00:17
openstackgerritA change was merged to openstack-infra/storyboard-webclient: Updated story list interface.  https://review.openstack.org/11016500:17
nibalizerkrotscheck: clarkb mordred jeblair that ^^ is the big pile-o storyboard00:17
mordredkrotscheck: woot!00:17
nibalizerso if we can merge that stuff that would be awwwwesome00:17
nibalizeri shoud check if tests are passing00:18
nibalizerlooks like they are :)00:18
clarkbmordred: so we are assuming then that some dev cost to have special env for testing is acceptable00:18
clarkbmordred: ebcause the value of doing that thing is greater than the value of keeping it simple00:18
mordredya00:18
mordredor, at least, that's the theory I'm working from00:19
lifelessI think there are competing definitions of 'dev friendly' here00:19
lifelessperhaps a couple of personas might help00:19
mordredyes00:19
mordredbecause be "dev" I mean "python dev who does not understand distro packaging"00:19
mordredwhich has a subtype of "redhat dev who does not understand debian pacakging" and "debian dev who does not understand redhat packaging"00:20
lifelesswhich is not the same as 'redhat dev' or 'canonical dev' or 'docker dev'00:20
lifelessjinx :)00:20
mordred:)00:20
krotschecknibalizer: That’s a TON of storyboard thigns.00:20
mordredso "dev who does not understand the ins and outs of all existing distro packaging systems"00:20
mordredas opposed to "distro packager"00:20
*** shashankhegde has joined #openstack-infra00:20
salv-orlandofungi, clarkb, jogo, dansmith, mordred, rhsu: so vmware minesweeper triggered hell upstream because I forgot to adhere to the new grammar for 3rd party rechecks00:21
mordredsalv-orlando: oops :)00:21
mordredlifeless: the sucky part is - we have exactly all of the same challenges as people making linux distros, except that we're not making a linux distro00:21
openstackgerritA change was merged to openstack-infra/storyboard-webclient: Updated project list interface.  https://review.openstack.org/11016900:21
openstackgerritA change was merged to openstack-infra/storyboard-webclient: Point search requests to search endpoints  https://review.openstack.org/10253600:21
salv-orlandomordred: yeah a bit oops and it’s more oops if you think that a lot of 3rd party cis arent00:21
openstackgerritA change was merged to openstack-infra/storyboard-webclient: Sort stories and projects.  https://review.openstack.org/11242600:21
salv-orlandomordred even if they are unlikely to recheck 300 patches in a row, they will still be adding to the upstream load00:22
*** david-lyle has joined #openstack-infra00:23
salv-orlandoand incidentally this whole thing might have surface the floating ip issue we were discussiong with arosen mordred and clarkb00:23
*** arnaud has quit IRC00:23
salv-orlandobut I’m just speculating here00:23
mordredsalv-orlando: hehe. actually, that was the cause of yesterday's issues00:24
*** david-lyle has quit IRC00:24
salv-orlandoyes, but even yesterday you probably had over 20 ci systems rechecking patches into upstream still this is just speculation...00:25
*** david-lyle has joined #openstack-infra00:25
nibalizerkrotscheck: its just a roll down then a roll up00:25
salv-orlandoanyway now we’ve sorted out the issue… what’s the process to reenable the service account? I don’t know how to prove I’ve fixed the issue without it ;)00:25
nibalizerso all the commits in infra/config that touched the storyboard files, in one place00:25
krotschecknibalizer: Yeah, I recall from the first time you went through this.00:26
*** vermarah_ has quit IRC00:26
nibalizerproposed as new commits, in order, to the puppet-storyboard mod00:26
krotschecknibalizer: So my goal is to move the rabbitmq things onto that chain?00:26
*** che-arne|2 has joined #openstack-infra00:27
nibalizerkrotscheck: ya00:27
clarkbmordred: I really cant help but think rolling release is what we need00:27
clarkbthen anyone can grab the same rolling release update to latest and be on their way00:28
nibalizeri would put something in the commit message that says 'warning, this hasn't landed in config, please actually review it'00:28
nibalizeror maybe give it the workflow -100:28
clarkbno special repos or ports or anything00:28
mordredclarkb: but that doesn't solve any of my issues that I want to solve00:28
openstackgerritSalvatore Orlando proposed a change to openstack-infra/config: Add neutron full job to integrated gate  https://review.openstack.org/11356200:28
*** che-arne has quit IRC00:29
mordredclarkb: which is that it does not enable our developers to have control of the versions of things they want in the same way they have with pip requirements00:29
*** dims_ has joined #openstack-infra00:29
clarkbmordred only nix does that of the proposed solutions00:29
mordredclarkb: amusingly enough - the reason I keep coming back to docker on this point, is that publishing docker base images to a public index is really easy for _us_ to do00:29
*** david-lyle has quit IRC00:29
openstackgerritA change was merged to openstack-infra/storyboard-webclient: Removed nodeenv dependency  https://review.openstack.org/10619100:30
mordredso a dev saying "docker run -t -i infra/gate" is pretty much all they'd need00:30
clarkbmaybe we should give nix a go00:30
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added pagesize to browse service.  https://review.openstack.org/10937200:31
mordredclarkb: dude. I just looked at the packaging format00:31
mordredhttps://github.com/NixOS/nixpkgs/blob/master/pkgs/shells/bash/default.nix00:31
mordredI dare you to tell our dev community to do that ^^00:31
clarkboh its terrible00:32
mordredyah00:32
clarkbbut it does the pip like thing00:32
clarkbthat nothibg else really does00:32
mordredclarkb: https://gist.github.com/emonty/5456592ee9d01578e7d100:33
mordredclarkb: there's a base infra image :)00:33
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added pagesize to browse service.  https://review.openstack.org/10937200:33
clarkbthat doesnt pin anything00:33
clarkbor build libvirt00:33
mordredclarkb: it doesn't need - I didn't say it's a nova image00:33
openstackgerritSpencer Krum proposed a change to openstack-infra/config: Use split-out storyboard module  https://review.openstack.org/11373100:34
*** reed has quit IRC00:34
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added pagesize to browse service.  https://review.openstack.org/10937200:34
mordredI'm just saying it's pretty simple to understand00:34
clarkbsure docker is shiny but solves a different problem00:34
mordredI disagre00:34
mordredyou just said "nixos does the pip thing liek nothing else really does" - with the concern being ease of devs interacting with the chosen environment00:34
jroll17:30:20         mordred | so a dev saying "docker run -t -i infra/gate" is pretty much all they'd need <- as a dev. this. please.00:35
mordredyah. that ^^00:35
mordreddev interaction is _super_ easy and very optimized00:35
mordrednow, again - iscsi00:35
clarkbno the selection of versions00:35
mordredbut in looking at user interface and what a dev experience can be ... ^^ that is pretty spectacular00:35
clarkbdocker does not solve that00:35
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Rearranged admin menu  https://review.openstack.org/11238100:35
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added user administration interface  https://review.openstack.org/10943900:35
clarkbnix does (not nixos either)00:35
mordredclarkb: docker run -t -i infra/gate:v1.0.000:36
jrollclarkb: versions of what?00:36
jrollyeah, that00:36
mordredclarkb: it allows for arbitrary tagging of arbitrary image versions00:36
clarkbversions of libvirt00:36
mordredclarkb: so, yeah, we can _totally_ publish a ton of different image results and let devs use them00:36
mordredyah00:36
jrollyeah00:36
clarkbdocker doesnt do that...00:36
jrollso00:36
mordredwe can't use docker00:36
clarkbyou are confusing two things00:36
mordredI'm pointing out good ui00:36
jrollcat Dockerfile00:36
jrollfrom infra/gate00:37
jrollapt-get install latest-lib-virt00:37
jrolldone00:37
clarkbjroll what builds that package?00:37
mordredjroll: we're talking about where latest-libvirt comes from00:37
jroll(simplified but you get the idea)00:37
mordredthat's the probelm at hand00:37
clarkbjroll it does not fix the problem00:37
clarkbit makes other things nice00:37
jrollah, make a dockerfile that builds it with infra/gate as the base00:37
*** dims_ is now known as dims00:37
*** bdpayne has quit IRC00:37
clarkbthat doesnt fix it either00:37
clarkbbecause that isnt dev friendly00:38
mordredwe still need to encode the build instructions00:38
mordredin a modular fashion00:38
jrollright00:38
mordredthe other thing docker doesn't do is it's not composible00:38
mordredor, rather, not building block style00:38
mordredand that's by design00:38
*** bhuvan_ has quit IRC00:38
mordredand I think they're smart to be specific about that00:38
jrollI don't have an idea immediately on that... but regardless can I get an infra/gate docker image? :P00:38
clarkbso this is why I am resistant to docker00:39
mordredjroll: I'm working on it ... but don't hold your breath00:39
clarkbeveryone pretends it is a fountain of youth00:39
jrollheh :)00:39
clarkbits great it wint make you youbger please stop hand waving00:39
mordredclarkb: I don't - I think ti's EXCEPTIONALLY good at the one thing it dose00:39
clarkbthis is why I ignores the ml thread00:39
mordredwhich is easy redistribution of fully put together single purpose environments00:40
mordredit does NOT help putting them together00:40
mordredand it does NOT help packaging software00:40
clarkbthat dont need iscsi or a host of other things00:40
mordredyah00:40
mordredI think it has a place in our toolchain same as virtualenv00:40
mordredbut it doesn't solve this00:40
clarkbjroll ^ is one reason no infra docker00:40
mordredclarkb: I strongly want to repalce virtualenv with docker00:41
clarkbjroll docker doesnt actually work for the majority of our tests00:41
mordredbecause they do the exact same thing, except docker does it better00:41
mordredfor all of our current virtualenv usecases00:41
mordredit does not solve a bunch of stuff, but neither does virtualenv00:41
cody-somerville<mordred> the other thing docker doesn't do is it's not composible00:41
jrollclarkb: iscsi etc?00:41
clarkbyes it is a decent standin for virtualenv00:42
clarkbjroll yup00:42
cody-somervillemordred: From the way timrc was talking the other day, he made it sound like docker did allow that00:42
mordredcody-somerville: you can't have a docker unit that defines libvirt, and another that defines nova-compute00:42
mordredcody-somerville: and the combine them into a third thing00:42
jrollclarkb: why can't it do iscsi?00:42
mordredyou can have a base image. you can have an image that consumes that and adds libvirt, you can have an image that consumes that and adds nova-compute00:42
clarkbiscsi isnt namespaced00:42
jrollmmmm00:42
clarkbso iscsid dies00:42
mordredjroll: like, it's a fundametnal container issue00:43
jrollyeah00:43
mordredor, rather, it's an iscsi issue00:43
mordredbut it manifests fundamentally in containers00:43
jrollright00:43
mordredas I understand it, the folks who looked in to fixing iscsi ran away screaming00:43
* timrc blinks00:43
cody-somervilleI'm sure someone from redhat will fix it sooner or later00:43
adam_gsame with lvm00:43
jrollmordred: I'm shocked00:43
mordredcody-somerville: iscsi? or docker composability?00:44
mordredadam_g: ++00:44
cody-somervilleiscsi in docker00:44
mordredcody-somerville: yeah. igiven their recent forray into docker, I'm expecting them to bite the bullet00:44
mordredbut until they do, we cannot run devstack in it fully00:44
cody-somervilleand was just going to say, probably the latter too00:44
mordredwhich means it's not a complete solution for any of our current problems or perceived problems00:45
*** r1chardj0n3s is now known as r1chardj0n3s_afk00:46
*** homeless has joined #openstack-infra00:46
krotscheckCan someone hop onto storyboard.o.o for me and see why the client tarball isn’t coming down?00:46
* krotscheck is going to go check the tarball.00:46
mordredkrotscheck: on it00:48
krotscheckThanks00:48
krotscheckIt’s the right tarball :/00:48
timrcmordred, Maybe to do as you describe you would have to export each container to tarball, combine, and then re-import into Docker... that doesn't sound pleasant though00:49
*** rhsu has quit IRC00:49
openstackgerritIan Wienand proposed a change to openstack-infra/config: Remove old stats from whisper  https://review.openstack.org/11373300:50
*** bdpayne has joined #openstack-infra00:50
*** markmcclain has quit IRC00:50
dimstimrc: reminds me about this article on optimizing docker images on my read queue - http://www.centurylinklabs.com/optimizing-docker-images/00:53
jeblairjhesketh: can you clarify why you left a -1 on https://review.openstack.org/#/c/112411/ ?00:53
jeblairjhesketh: the only comments i see from you on that change are about whitespace, which i'm assuming you left as "+0" comments (eg, fix if updating a patchset)00:53
krotscheckmordred: I think I may have to add a -N flag to puppi:netinstall00:54
jeblairjhesketh: you did leave a comment about the parent change, but i'm interpreting that as "let's continue further in this direction", which i'm happy to do, but since i don't think it needs to happen before this change i'd like to avoid depending on it00:54
jheskethjeblair: the -1 is probably more for the parent patchset, but because of those nits I put it on that patch too00:54
jheskethjeblair: I'm also curious how pep8 didn't catch those long lines00:55
jeblairclarkb, mordred, fungi: can you also review https://review.openstack.org/#/c/112411/ ?  it does address two ongoing problems we have, so i think merging it soon could help a lot (it may eventually remove the need for the freshness check)00:56
jeblairjhesketh: i believe the addition of "select=H231" has completely broken pep8 for zuul.  ie, it now _only_ checks H231.00:56
*** r1chardj0n3s_afk is now known as r1chardj0n3s00:57
clarkbarg00:57
jeblairjhesketh: i think the solution to that is to, in a separate patch, fix the config and clean things up.  i'm not interested in holding any legitimate changes up based on pep8 issues.00:57
jheskethsure, that makes sense00:58
jeblairjhesketh: so regarding the parent -- do you think we can build on what's there and keep going, or do we need to revise it?  based on what you wrote, i think we're probably beginning to imagine the same end state here00:59
jheskethyeah, I was just parsing your comments01:00
jheskethwe probably could do it in a later change if we needed to get these in more urgently01:00
timrcdims, Indeed.  I think the problem with flattening images is the losing of meta information due to the export / import.  I think flattening would be a nice optimization.  I haven't encountered a situation personally w/ Docker where composition solved a problem for me that couldn't be solved with inheritance.01:01
jheskethjeblair: in regards to your source that isn't a trigger question... do you think it'd ever be possible to have a pure git source... where you have an upstream git and a forked repo to pull from01:01
jheskethI guess the trigger would need to know about the forks...01:01
jeblairjhesketh: i'd say it's not critical, but high.  one of the features lets us fix changes that aren't getting pulled into the gate; and the other one lets us potentially reduce or eliminate freshness checks01:02
jeblairjhesketh: i think you could have a pure git source, particularly with a timer01:03
jeblairjhesketh: (eg, traditional ci on specific branches/repos)01:03
mordredkrotscheck: I do not see any particular message about the file in the puppet run on storyboard.01:03
jheskethright01:03
krotscheckmordred: Yeah, I think it’s the lack of a -N flag for wget… will test on a VM.01:03
mordredkrotscheck: cool01:04
jeblairjhesketh: but i don't think a pure-git source would have a trigger itself01:04
jheskethjeblair: perhaps we should separate out sources/triggers completely in this change and then I could tackle separating out gerrit in another change01:04
jeblairjhesketh: i think you'd need github or gerrit, etc for that01:04
jhesketh(ie allowing multiple gerrits)01:04
timrcmordred, Have you run into issues with, say, trying to get mysql running inside a Docker container :)?01:05
jeblairjhesketh: i guess the question is -- do they need to be separate, or do they just need to implement the right interface to be used in the right way?01:05
clarkbtimrc issues with /etc/hosts :)01:05
clarkber resolv.conf01:05
mordredtimrc: I have not - but I havent' spent an awful lot of time poking at it.01:05
mordredtimrc: as clarkb says - the main issues we hit was /etc/hosts and /etc/resolv.conf01:05
timrcclarkb, UGH01:06
timrcclarkb, I had to use a very ugly hack to work around that01:06
jheskethjeblair: I feel like it makes a better distinction... it allows the timer trigger to queue changes from a gerrit source, for example01:06
jheskethand also avoids having triggers raise not implemented exceptions on things like canMerge01:07
jeblairjhesketh: i think since you would want to use the same account/server settings for the source, trigger, and reporter with gerrit, i'm not sure you'd need three different objects for that01:07
jeblairjhesketh: did you see my suggestion of treating the union of them as a 'connector' in the config file?01:07
*** arnaud has joined #openstack-infra01:08
jheskethnope, where was that?01:08
timrciptables issues too that rely on the presence of /lib/modules/`uname -r`/modules.dep01:08
jeblairjhesketh: https://review.openstack.org/#/c/97391/3/doc/source/reporters.rst01:08
jeblairjhesketh: i think if you had a class for each connector driver (eg, gerrit, timer, zull, github, smtp), you could instantiate one instance of that class for each definition in the config file.  then the layout could specify that instance be used in any one of the three roles01:09
*** oanufriev has quit IRC01:09
jeblairjhesketh: to avoid the exception on canMerge problem, we could have them implement 3 interfaces, and have the config parser check that the driver supported the correct interface01:10
jeblairso you'd find that early01:10
*** nosnos has joined #openstack-infra01:10
*** yamahata has joined #openstack-infra01:10
mordredphschwartz: around?01:10
openstackgerritIan Wienand proposed a change to openstack-infra/config: Remove old stats from whisper  https://review.openstack.org/11373301:10
mordredphschwartz: you should be involved in this conversatino ^^01:11
phschwartzI am01:11
jheskethjeblair: oh nice, I was just about to try and flesh out an idea that looks just like the connector stuff (in irc)01:11
mordredjeblair: phschwartz was earlier musing to me about drives and opportunistic loading based on config file01:11
*** shashankhegde has quit IRC01:11
mordredphschwartz: you may not want to wait until next monday to post what you've got - even if it's ugly, I think you should push up your patches if you've got some stuff01:11
phschwartzmordred: I talked with jeblair about it and he rather have it be directly in the code01:12
mordredk. awesome01:12
jheskethjeblair: so would the driver implement the features of sources/triggers/reporters?01:12
jeblairyeah, happy to have github driver be in-tree (and we'll use it! :)01:12
mordredphschwartz: mainly - it seems like your'e hacking in the same space01:12
*** oanufriev has joined #openstack-infra01:12
jeblairjhesketh: that's what i'm thinking01:12
clarkbmordred is libvirt on github?01:13
clarkbmaybe we can just test libvirt that way01:13
clarkband keep life easy for devs01:13
openstackgerritIan Wienand proposed a change to openstack-infra/config: Remove old stats from whisper  https://review.openstack.org/11373301:13
mordredclarkb: ++01:13
*** otherwiseguy has joined #openstack-infra01:13
jheskethjeblair: how would that look for something like the timer... we'd have to have a connector that uses the timer driver and then only lists that under triggers?01:15
phschwartzmordred: jeblair: I will try to get the patch out tomorrow I I can fit it in.01:16
phschwartz*if01:16
jeblairjhesketh: good point, and same for the newly proposed 'zuul' -- they have no external connectivity that needs defining.  perhaps they just get registered as internal singletons?01:17
clarkbjeblair is review of that change tomorrow ok? or are you wanting it tonight?01:17
clarkbI need to afk now for dinner will check back after01:18
jeblairclarkb: tomorrow is fine :)01:18
jheskethjeblair: maybe, although I feel like the drivers will start to look funny if some are just loaded for you etc01:18
openstackgerritOscar Romero (homeless) proposed a change to openstack-infra/jeepyb: Fix close_pull_requests from jeepyb  https://review.openstack.org/11359801:18
*** SumitNaiksatam has quit IRC01:19
jheskethjeblair: what if we had a large degree of separation and had drivers+sources+triggers+reporters on their own, then in layout.yaml you specify the driver by connector name under each gerrit trigger or source etc01:20
jeblairjhesketh: https://etherpad.openstack.org/p/cviAgfbKV601:21
jeblairjhesketh: maybe you could fill that example out01:21
clarkbhow is driver different than trigger?01:21
clarkbcant help myself discussion so interesting01:22
jeblairclarkb: trigger is something that causes a zuul enqueue, reporter is something that zuul does after completion, source is where it gets the change from01:24
jeblairclarkb: so a driver, or connector, or something, is about implementing something that supports those things with the right abstraction01:24
jheskethjeblair: filled out, but I'm not a huge fan of it...01:24
*** trinaths has joined #openstack-infra01:25
jeblairjhesketh: yeah, i feel like there should be only one object representing the openstack-gerrit connection, because it's associated with an ssh connection that can be used for all three functions01:25
jeblairjhesketh: (well, actually 2 of the three functions, and the third needs a separate ssh connection, but that's a detail, and the concept still holds)01:26
clarkbya I think that is what I was getting at01:26
*** melwitt has left #openstack-infra01:26
clarkbthe line there seemed too fuzzy01:26
jheskethjeblair: Sure, so I guess in this example that object is passed around by defining the connector01:27
jeblairjhesketh: ok, i see01:27
jeblairjhesketh: well, it's dinnertime here; let's bang on this some more later.  thanks :)01:27
jheskethokay sounds good :-)01:28
lifelessWarning: Variable access via 'servers_real' is deprecated. Use '@servers_real' instead. template[/etc/puppet/modules/ntp/templates/ntp.conf.el.erb]:2501:31
Alex_Gaynorface01:34
Alex_Gaynorwhoops, wrong window01:34
asselin__has anyone seen an issue w/ nodepool getting a floating ip. nova error is: Caught error: Cannot load 'instance' in the base class01:34
asselin__ NotImplementedError: Cannot load 'instance' in the base class01:34
*** andreaf has quit IRC01:35
imcsk8hello, 3 hours ago i approved this patch: https://review.openstack.org/#/c/109997/ and nothing has happened, i checked here http://status.openstack.org/zuul/ but couldnt find the review id. can someone give me a hand please?01:35
*** mmaglana has quit IRC01:35
*** andreaf has joined #openstack-infra01:35
openstackgerritA change was merged to openstack/requirements: Updated version requirement for websockify  https://review.openstack.org/10221501:36
mordredlifeless: that does look like a warning01:37
mordredimcsk8: there was a zuul restart a few hours ago because of $evil01:38
mordredimcsk8: you may have to re-approve it01:38
lifelessmordred: so how about that review ;)01:38
mordredlifeless: your code is too dense - can you go back and write it in very small words? :)01:39
lifelessmordred: uhm01:39
imcsk8mordred: thanks! i'll do that01:40
*** andreaf has quit IRC01:40
*** jyuso has joined #openstack-infra01:40
*** gokrokve has joined #openstack-infra01:40
mordredlifeless: just kidding01:41
*** andreaf has joined #openstack-infra01:41
mordredlifeless: it's looked generally good each time I've looked at it - but I haven't had the time to dive all the way in, which I cannot do with a superficial read01:41
*** [1]trinaths has joined #openstack-infra01:41
lifelessmordred: so, is there a third person with +A on pbr - or is it blocked on you?01:43
lifelessmordred: if its blocked on you, I'd -really- like this in before you go burn01:43
*** Ryan_Lane has quit IRC01:43
lifelesserm fourth person with +A01:43
*** oanufriev has quit IRC01:44
*** andreaf has quit IRC01:44
*** andreaf_ has joined #openstack-infra01:44
*** gokrokve_ has quit IRC01:44
*** trinaths has quit IRC01:44
*** [1]trinaths is now known as trinaths01:44
*** oanufriev has joined #openstack-infra01:45
*** andreaf_ has quit IRC01:45
imcsk8mordred: i changed che comment to 0 and then +1 and +2 is that ok? https://review.openstack.org/#/c/109997/01:45
*** gokrokve has quit IRC01:45
*** andreaf_ has joined #openstack-infra01:45
*** andreaf_ has quit IRC01:46
*** trinaths has quit IRC01:47
*** daya_k has joined #openstack-infra01:48
*** trinaths has joined #openstack-infra01:48
*** otter768 has joined #openstack-infra01:49
*** mbacchi has quit IRC01:51
*** trinaths has quit IRC01:52
mordredimcsk8: yup01:54
mordredlifeless: there's tons of people with +A01:54
mordredlifeless: all of infra core has +A on it01:54
mordredlifeless: and all of oslo-core01:54
*** bdpayne has quit IRC01:54
*** crc32 has quit IRC01:55
*** yaguang has joined #openstack-infra01:55
lifelessmordred: ok01:55
lifelessmordred: I will nag more folk then :)01:55
mordredlifeless: reading now01:55
lifelessmordred: the haveged patch failed jenkins I believe :(01:55
mordredlifeless: btw - I'm going to kill you for test_equality and test_ordering01:56
mordredlifeless: I get it - but dude brain melt01:56
*** weshay_afk has quit IRC01:56
homelesshi guys when you have time can you review this one, https://review.openstack.org/#/c/113598/01:58
*** Krast has joined #openstack-infra02:00
*** oanufriev has quit IRC02:01
*** ramashri has quit IRC02:03
*** oanufriev has joined #openstack-infra02:03
*** dims has quit IRC02:04
*** amotoki has joined #openstack-infra02:04
*** dims has joined #openstack-infra02:05
*** dims is now known as Guest4869502:05
mordredStevenK, lifeless: in the mean time - you wanna check out https://review.openstack.org/#/c/113624/ for me - it's launchpad related ...02:05
*** salv-orlando has quit IRC02:06
*** Sukhdev has joined #openstack-infra02:07
imcsk8mordred: regarding https://review.openstack.org/#/c/109997/, still does not appear on http://status.openstack.org/zuul/ :(02:08
lifelessmordred: sure,once I finish this latest mandatory training course for HP02:09
*** Guest48695 has quit IRC02:09
*** amotoki has quit IRC02:09
mordredlifeless: ok. +2 from me02:11
lifelessmordred: done a quick glance at the script02:12
lifelessmordred: its going to be horrendously slow as-written, hint for fixing showed02:12
*** med_ has joined #openstack-infra02:13
*** med_ has quit IRC02:13
*** med_ has joined #openstack-infra02:13
*** amcrn has quit IRC02:13
openstackgerritMonty Taylor proposed a change to openstack-infra/storyboard: Add loader subcommand to sync from launchpad  https://review.openstack.org/11362402:15
mordredlifeless: awesome. thanks! it IS horribly slow02:17
lifelessmordred: every object ref in the restful API ORM has a matching id attribute02:18
lifelessmordred: you can cache the objects e.g. people = {} # id -> person object02:18
lifelessmordred: and avoid traversing the .owner etc attributes at all (except on cache misses when you populate the cache)02:18
mordredlifeless: awesome02:19
mordredlifeless: so instead of message.owner.name, I should grab message.ownerID ?02:19
*** mmaglana has joined #openstack-infra02:20
arosenmordred:  clarkb jogo jeblair  this should solve your floatingip leaking issue in nodepool if you're backed by neutron: https://review.openstack.org/11375402:22
lifelessmordred: yeah, and then people[ownerID].name will be entirely local and fast02:22
mordredmessage.ownerID gives me nothing02:22
arosenI think we can probably back port this as well and hopefully hp can deploy it in their cloud.02:22
lifelessmordred: it might be owner_id or something, its been a couple years :>02:22
lifelessmordred: dir(message) should list it02:23
*** Krast has quit IRC02:23
mordredarosen: awesome02:24
mordredlifeless: there are no id anythings ... maybe they removed it02:24
openstackgerritA change was merged to openstack-infra/config: Make sure we actually run haveged on our slaves  https://review.openstack.org/11340102:25
mordredlifeless: ^^02:26
*** trinaths has joined #openstack-infra02:26
mordredlifeless: that will not take effect until tomorrow when we re-build the images02:26
StevenKlifeless: Those are API Entry() responses, I don't think id's are exported02:26
fungi             https://review.openstack.org/#/c/112411/ ?  it does address two02:26
*** [1]trinaths has joined #openstack-infra02:27
mordredjeblair, jhesketh, phschwartz: just for the record, I'm excited about 112411 and then our subsequent github webhook overlords02:27
*** trinaths has quit IRC02:30
*** [1]trinaths is now known as trinaths02:30
fungier, mispaste, sorry all02:31
cody-somervillemordred: I can also show you how to safely do threaded launchpadlib operations.02:32
openstackgerritAaron Rosen proposed a change to openstack-infra/nodepool: Fix potential floating ip leakage issue  https://review.openstack.org/11365902:33
*** homeless has quit IRC02:33
*** arnaud has quit IRC02:34
*** trinaths has quit IRC02:34
cody-somerville:O02:34
cody-somervilleI knew it.02:34
cody-somervillejesusaurus: We should watch https://review.openstack.org/113659 and merge it down once it gets accepted.02:35
*** zz_dimtruck is now known as dimtruck02:36
*** mriedem has quit IRC02:36
jesusauruscody-somerville: yep02:37
*** arnaud has joined #openstack-infra02:38
*** Krast has joined #openstack-infra02:42
*** changbl has joined #openstack-infra02:45
*** pcm_ has quit IRC02:49
*** r1chardj0n3s is now known as r1chardj0n3s_afk02:53
*** armax has quit IRC02:54
*** adalbas has quit IRC02:55
*** shashankhegde has joined #openstack-infra03:00
*** aysyd has joined #openstack-infra03:02
*** Sukhdev_ has joined #openstack-infra03:04
*** Sukhdev has quit IRC03:07
*** Sukhdev_ has quit IRC03:08
*** rainya has joined #openstack-infra03:11
clarkbI dont think that change helps anything03:14
clarkbthe nova side leak is the same as when we do it03:15
*** pballand has quit IRC03:16
openstackgerritGregory Haynes proposed a change to openstack-infra/config: Add tripleo to specs.o.o  https://review.openstack.org/11158803:20
*** r1chardj0n3s_afk is now known as r1chardj0n3s03:27
jogoarosen: awesome, once that passes jenkins that will be on the top of my review list03:29
*** AlexF has joined #openstack-infra03:30
*** shardy has quit IRC03:31
*** shashankhegde has quit IRC03:31
*** nosnos has quit IRC03:35
*** kashyap has quit IRC03:39
*** marun has quit IRC03:43
lifelessdhellmann: (for when you return - review 94108 typo fixed)03:49
*** praneshp has quit IRC03:55
*** marun has joined #openstack-infra03:56
*** otter768 has quit IRC03:57
*** otter768 has joined #openstack-infra04:01
*** lttrl has quit IRC04:01
*** arnaud has quit IRC04:02
*** jroll|dupe has joined #openstack-infra04:03
mikalHow do I reverify a change these days?04:04
mikalReapproving didn't work like I expected04:04
*** arnaud has joined #openstack-infra04:05
*** jroll has quit IRC04:05
*** jroll|dupe is now known as jroll04:05
*** SumitNaiksatam has joined #openstack-infra04:06
*** flaviof is now known as flaviof_zzz04:08
*** arnaud has quit IRC04:08
clarkbmikal: `recheck`04:08
mikalrecheck will reverify now?04:09
clarkbyup. the clean check setup has essentially merged the two04:09
*** garyh has quit IRC04:09
*** trinaths has joined #openstack-infra04:10
mikalHuh, ok04:10
clarkbreverify will work too04:10
mikalFair enough04:10
clarkbthey are now synonyms04:10
*** andreaf has joined #openstack-infra04:12
*** AlexF has quit IRC04:12
clarkbmikal I think it works if you do +0 then +W04:15
*** otter768 has quit IRC04:15
clarkbit has to do with how gerrit outputs events04:15
*** andreaf has quit IRC04:15
*** arnaud has joined #openstack-infra04:18
*** rainya has quit IRC04:25
*** aysyd has quit IRC04:29
*** david-lyle has joined #openstack-infra04:31
*** nosnos has joined #openstack-infra04:32
*** praneshp_ has joined #openstack-infra04:32
*** mrmartin has joined #openstack-infra04:35
*** gokrokve has joined #openstack-infra04:36
*** ildikov has quit IRC04:36
*** timrc is now known as timrc-afk04:36
*** marun has quit IRC04:39
*** garyh has joined #openstack-infra04:40
*** rhsu has joined #openstack-infra04:41
openstackgerritSteve Baker proposed a change to openstack-infra/config: Define gate-heat-dsvm-functional job  https://review.openstack.org/11108704:41
rhsufungi: hello thar04:45
*** dimtruck is now known as zz_dimtruck04:46
rhsuanteaya: ping04:46
*** chandankumar has joined #openstack-infra04:50
*** Sukhdev has joined #openstack-infra04:51
*** e0ne has joined #openstack-infra04:55
*** e0ne has quit IRC04:57
*** jgrimm has quit IRC05:01
openstackgerritpatrick-crews proposed a change to openstack-infra/elastic-recheck: Add crm114 logstash queries to uncategorized page  https://review.openstack.org/11377105:02
*** chandankumar has quit IRC05:02
pcrewsclarkb: ^ your crm114 wish :)05:03
*** mrmartin has quit IRC05:05
*** chandankumar has joined #openstack-infra05:12
*** gema_ has joined #openstack-infra05:13
*** yfried__ has joined #openstack-infra05:13
*** ominakov has quit IRC05:13
*** gema has quit IRC05:14
*** marun has joined #openstack-infra05:17
*** mmaglana has quit IRC05:20
openstackgerritJohnson Dantis proposed a change to openstack-infra/elastic-recheck: recheck bug 1270710  https://review.openstack.org/11377405:21
uvirtbotLaunchpad bug 1270710 in openstack-ci "sporadic pip timeouts during download" [Medium,Incomplete] https://launchpad.net/bugs/127071005:21
*** gema has joined #openstack-infra05:21
*** marun has quit IRC05:21
openstackgerritpatrick-crews proposed a change to openstack-infra/elastic-recheck: Add crm114 logstash queries to uncategorized page  https://review.openstack.org/11377105:22
*** marun has joined #openstack-infra05:22
*** otherwiseguy has quit IRC05:23
*** gema_ has quit IRC05:24
*** tonyb has joined #openstack-infra05:25
*** rcarrill` has joined #openstack-infra05:25
*** flwang_ has joined #openstack-infra05:25
tonybSo I'm trying to sign the ICLA.  After I click 'submit' I get an error screen saying it couldn't save my information.  Any idea what I've done wrong?05:26
clarkbpcrews \o/05:27
clarkbtonyb have you joined the openstack foundation?05:27
*** rcarrillocruz has quit IRC05:27
tonybclarkb: no.  I guess that answers that ;P05:27
clarkbtonyb if not you need to do that. also ensurs your primary email address there matches the primary email address in gerrit05:28
*** SumitNaiksatam has quit IRC05:28
clarkbtonyb https://wiki.openstack.org/wiki/How_To_Contribute should cover it05:28
openstackgerritpatrick-crews proposed a change to openstack-infra/elastic-recheck: Add crm114 logstash queries to uncategorized page  https://review.openstack.org/11377105:29
*** tjones has joined #openstack-infra05:29
tonybclarkb: Thanks.  I just signed in to gerrit and started following the bounching ball.05:29
*** marun has quit IRC05:29
tonybclarkb: Thanks for the help.05:29
*** k4n0 has joined #openstack-infra05:30
*** emagana has joined #openstack-infra05:30
clarkbno problem05:31
rhsuclarkb: sorry to bother you so late, but was wondering if you saw salv-orlando's message on the mailing list about VMware CI05:34
rhsuclarkb: we have taken corrective actions and things are back to normal05:34
clarkbrhsu I did but am without ssh keys to enable the account. can do it in the morning05:34
rhsuclarkb: ah ok, thanks so much. i'm extremely sorry about all trouble that was caused..05:35
*** SumitNaiksatam has joined #openstack-infra05:36
*** mmaglana has joined #openstack-infra05:37
*** rlandy has joined #openstack-infra05:37
tonybclarkb: all fixed now.05:38
*** r1chardj0n3s is now known as r1chardj0n3s_afk05:38
tjonesclarkb: we (vmw) have a pretty big queue stacked up for review (300 now).  anyone else up who has the keys? again sorry about the issue - we didn't realize the upstream trigger changed….05:41
clarkbtjones: jhesketh and sergeylukjanov05:42
tjonesclarkb: thx05:43
*** gokrokve_ has joined #openstack-infra05:44
*** yamamoto has quit IRC05:45
*** ildikov has joined #openstack-infra05:46
tjonesjhesketh:  SergeyLukjanov: minesweeper is back to normal.  we were rechecking on "recheck-vmware" which caused it to appear we were spamming due to a change in the upstream recheck trigger.  we have changed to vmware-recheck.  can you please re-enable minesweeper?05:46
*** Ryan_Lane has joined #openstack-infra05:47
tjonesrhsu: please clarify if i was unclear ^^05:47
*** gokrokve has quit IRC05:47
clarkbwell wait05:47
clarkbthat isnt the fix we wanted05:47
*** pcrews has quit IRC05:47
clarkbthe bug here is comment spam on 500+ changes05:48
clarkbthat triggering jenkins is a side effect that changing the magic string doesnt fully fix05:48
*** gokrokve_ has quit IRC05:48
clarkbif you need to test against 500+ changes all at once you really should be triggering that directly in the ci system05:49
rhsuclarkb: yes, we're going to do it internall from now on. no longer relying on recheck comments.05:49
rhsuclarkb: the change to "vmware-recheck" is to conform to the recheck pattern guidelines. this way, we won't be re-triggering upstream Jenkins when someone requests a vmware recheck.05:51
clarkbrhsu but that isnt a thibg05:52
clarkbthere is no guideline. we actually do want things to be retested across the board in most cases05:52
clarkbfungi has an explanation on the ml somewhere05:52
rhsuclarkb: agreed. the new pattern will still allow for that. we just wanted to make sure when someone explicitly requests a vmware recheck that it wont clash with the upstream jenkins recheck pattern.05:54
*** AlexF has joined #openstack-infra05:56
rhsuso from now on, developers can still issue "vmware-recheck" to request a recheck but whenever we need to do a mass recheck, we will be doing this using internal means so we don't spam everyone's patches.05:56
clarkbit wont clash05:56
clarkbwe never intended to have complex recheck syntaxes05:57
clarkbthe idea was we expect all ci to pass together so just rerun them05:57
clarkbthis isnt an issue in normal day to day operations05:58
rhsuunderstood. so the main issue was in how we do mass recheck then. i guess this should be resolved by just not posting recheck-comments in bulk then?05:59
clarkbcorrect05:59
clarkbfor two reasons. first jenkins matches recheck*06:00
clarkbbut also because commenting on an idle change causes an upstream recheck too06:00
clarkbI imagine a good chunk of those vhanges would have rechecked regardless of comment content06:01
*** Sukhdev has quit IRC06:01
*** r1chardj0n3s_afk is now known as r1chardj0n3s06:02
rhsuthat makes sense. so next time I need to do this, i'll be doing this from the CI. sorry, if i didnt make that clear earlier.06:03
*** Longgeek has joined #openstack-infra06:03
*** ido_ has joined #openstack-infra06:03
ido_hi guys, can anyonehelp woth a problem on jenkins-job-builder?06:03
ido_hi guys, can anyone help woth a problem on jenkins-job-builder?06:04
rhsui actually didn't need to retrigger via comments today, but we had done this a few times before without issues (but back then it didn't trigger upstream CI) so ended up going with the comments06:04
rhsuclarkb: i hope i've given enough proof that these things shouldnt happen again :)06:07
*** dtantsur|afk is now known as dtantsur06:08
ido_hi guys, is it the rogt place to get help with  jenkins-job-builder?06:09
ido_hi guys, is it the right place to get help with  jenkins-job-builder?06:09
*** HenryG_ has joined #openstack-infra06:09
*** Azher has joined #openstack-infra06:11
*** HenryG has quit IRC06:12
*** Alexei_987 has quit IRC06:14
*** yamamoto has joined #openstack-infra06:14
*** loki184 has joined #openstack-infra06:16
jheskethido_: Not a bad place to try. Leave your question here and if anybody knows the answer they'll chime in06:19
ido_well, basically,06:22
*** tonyb has left #openstack-infra06:22
ido_well, basically, jenkins-jobs --conf /path/to/jenkins_jobs.ini -l debug test /path/to/foo.yaml ** does nothing06:24
ido_it prints the following debugging output: DEBUG:root:Reading config from /var/lib/jenkins/jobs/bootstrap/workspace/jenkins-ci/jenkins_jobs.ini DEBUG:root:Config: <ConfigParser.ConfigParser instance at 0x133def0> INFO:root:Updating jobs in /var/lib/jenkins/jobs/bootstrap/workspace/jenkins-ci/config/example.yaml ([]) DEBUG:jenkins_jobs.builder:Parsing YAML file /var/lib/jenkins/jobs/bootstrap/workspace/jenkins-ci/config/example.y06:24
ido_but outputs nada to stdout06:24
ido_the ([]) print is what disturbing me06:25
rhsujhesketh: while you're on, can i trouble you to re-enable our account on gerrit?06:27
jheskethrhsu: Sorry I don't have those rights (afaik)06:28
jheskethyou need somebody on the root team06:28
rhsujhesketh: ah ok, i know clarkb said he would do it in the morning06:29
openstackgerritJohnson Dantis proposed a change to openstack-infra/elastic-recheck: Add e-r query for bug 1350237  https://review.openstack.org/11378806:29
uvirtbotLaunchpad bug 1350237 in horizon "Networks tab does not show external network configuration" [Wishlist,In progress] https://launchpad.net/bugs/135023706:29
rhsujhesketh: i assume everyone else is asleep by now?06:30
jheskethUnless SergeyLukjanov is around, most likely06:30
rhsuthanks very much jhesketh, i'll try to check in with him before i'm off for the night06:32
*** rdopieralski has joined #openstack-infra06:33
*** gokrokve has joined #openstack-infra06:37
*** zz_dimtruck is now known as dimtruck06:37
*** rcarrillocruz has joined #openstack-infra06:38
*** rcarrill` has quit IRC06:40
*** jcoufal has joined #openstack-infra06:40
*** gokrokve has quit IRC06:42
*** stevemar has quit IRC06:42
*** stevemar has joined #openstack-infra06:42
*** yamamoto has quit IRC06:44
*** flaper87|afk is now known as flaper8706:44
*** emagana has quit IRC06:46
*** che-arne|2 has quit IRC06:46
*** emagana has joined #openstack-infra06:46
*** dimtruck is now known as zz_dimtruck06:47
*** stevemar has quit IRC06:47
*** yamamoto has joined #openstack-infra06:48
*** arnaud has quit IRC06:48
*** emagana has quit IRC06:51
*** rhsu has quit IRC06:53
*** evgenyf has joined #openstack-infra06:54
*** arnaud has joined #openstack-infra06:57
*** Ryan_Lane has quit IRC06:58
*** zz_dimtruck is now known as dimtruck07:00
openstackgerritGuido Günther proposed a change to openstack-infra/jenkins-job-builder: git: Support timeout option  https://review.openstack.org/11128007:03
*** salv-orlando has joined #openstack-infra07:04
*** amcrn has joined #openstack-infra07:10
*** mmaglana has quit IRC07:10
*** dimtruck is now known as zz_dimtruck07:12
*** e0ne has joined #openstack-infra07:12
*** mrmartin has joined #openstack-infra07:14
*** imcsk8 has quit IRC07:19
*** imcsk8 has joined #openstack-infra07:19
*** trinaths has quit IRC07:19
*** ihrachyshka has joined #openstack-infra07:20
*** mpaolino has joined #openstack-infra07:20
*** mugsie has quit IRC07:21
*** ihrachyshka has quit IRC07:23
*** Guest35108 has joined #openstack-infra07:24
*** sballe has joined #openstack-infra07:29
*** david-lyle has quit IRC07:29
*** david-lyle has joined #openstack-infra07:29
*** mrmartin has quit IRC07:29
*** _nadya_ has joined #openstack-infra07:32
*** david-lyle has quit IRC07:34
*** rwsu has quit IRC07:34
*** flwang_ has quit IRC07:35
*** gokrokve has joined #openstack-infra07:36
ido_hi guys, is it the right place to get help with  jenkins-job-builder?07:37
*** shardy has joined #openstack-infra07:37
*** gokrokve has quit IRC07:37
*** gokrokve has joined #openstack-infra07:38
ido_reading (debugging) the code I think I understand that a projects file is a must, and without it, no jobs are generated, am I right?07:38
*** mmaglana has joined #openstack-infra07:41
mattoliverauwell time to go and cook dinner, so calling it a night, night all!07:41
*** hashar has joined #openstack-infra07:42
*** gokrokve has quit IRC07:43
*** linkid has joined #openstack-infra07:43
*** mmaglana_ has joined #openstack-infra07:43
*** mmaglan__ has joined #openstack-infra07:44
*** yamamoto has quit IRC07:45
*** mmaglana has quit IRC07:46
*** Longgeek has quit IRC07:46
*** Longgeek has joined #openstack-infra07:46
*** mmaglana_ has quit IRC07:47
*** mmaglan__ has quit IRC07:49
*** mika has quit IRC07:50
*** Longgeek has quit IRC07:51
*** sballe has quit IRC07:51
*** rwsu has joined #openstack-infra07:52
*** jpich has joined #openstack-infra07:53
*** afazekas has joined #openstack-infra07:54
*** Longgeek has joined #openstack-infra07:54
*** e0ne has quit IRC07:55
*** ling-yun has joined #openstack-infra07:56
ling-yunhi stackers. If meeting problem with manual, which irc channel do you use to ask for help?07:56
*** mugsie has joined #openstack-infra07:57
*** _nadya_ has quit IRC07:58
*** e0ne has joined #openstack-infra07:59
*** skolekonov has joined #openstack-infra08:00
*** _nadya_ has joined #openstack-infra08:01
openstackgerritFlavio Percoco proposed a change to openstack/requirements: Add glance.store to global requirements  https://review.openstack.org/11380608:03
*** derekh has joined #openstack-infra08:04
*** daya_k has quit IRC08:05
*** jistr has joined #openstack-infra08:08
*** yamamoto has joined #openstack-infra08:09
*** Longgeek has quit IRC08:10
*** sballe has joined #openstack-infra08:11
*** jlibosva has joined #openstack-infra08:11
*** arnaud has quit IRC08:12
*** cristov_mac has joined #openstack-infra08:17
*** cristov_mac has quit IRC08:17
*** daya_k has joined #openstack-infra08:19
daya_kserver sydney.irc.ibm.com08:19
*** maxbit has quit IRC08:22
*** e0ne has quit IRC08:25
*** amuller has joined #openstack-infra08:25
*** ihrachyshka has joined #openstack-infra08:26
*** leifmadsen has quit IRC08:28
*** e0ne has joined #openstack-infra08:30
openstackgerritAlexis Lee proposed a change to openstack-infra/config: Add firewall traffic on port 27410  https://review.openstack.org/10873708:31
*** sballe has quit IRC08:32
*** leifmadsen has joined #openstack-infra08:33
*** AlexF has quit IRC08:36
*** zz_dimtruck is now known as dimtruck08:37
*** gokrokve has joined #openstack-infra08:37
ihrachyshkaafazekas: hey. do you by chance know why we could miss rpm/yum for 'periodic-{name}-python26{branch-name}' (for havana) even though it's set for 'node: bare-centos6'?08:40
ihrachyshkawe get this py26 job constantly failing for havana branches. It seems we have some hacks to install libffi-devel there via rpm and yum, and for some reason, console log shows they fail due to 'rpm: command not found'08:41
*** gokrokve has quit IRC08:41
*** dimtruck is now known as zz_dimtruck08:46
*** enikanorov has quit IRC08:48
*** enikanorov has joined #openstack-infra08:48
afazekasihrachyshka: is the rpm command in the current PATH ?08:49
*** rdekel has joined #openstack-infra08:50
*** Longgeek has joined #openstack-infra08:50
*** p5ntangl_ has quit IRC08:52
*** p5ntangle has joined #openstack-infra08:53
rdekelI'm looking for cirrOS information - specifically nc and other communication CMD's. 10x in advance08:54
ihrachyshkaafazekas: how can I tell that from jenkins logs?08:59
ihrachyshkaafazekas: this is all I have: http://logs.openstack.org/periodic-stable/periodic-cinder-python26-havana/093cf3d/console.html08:59
*** ZZelle has joined #openstack-infra09:00
afazekasit is expected to be in the /usr/bin/ which expected to be in the path even without login shell..09:04
*** jp_at_hp has joined #openstack-infra09:07
*** pblaho has joined #openstack-infra09:08
*** sballe has joined #openstack-infra09:10
*** pblaho has quit IRC09:11
*** pblaho has joined #openstack-infra09:11
*** ihrachyshka has quit IRC09:11
*** ociuhandu has quit IRC09:13
*** Longgeek has quit IRC09:15
*** jgallard has joined #openstack-infra09:15
*** pelix has joined #openstack-infra09:17
*** jedimike has joined #openstack-infra09:19
*** sballe has quit IRC09:20
*** yamamoto has quit IRC09:21
*** sballe has joined #openstack-infra09:22
*** sballe_ has joined #openstack-infra09:24
*** katyafervent is now known as katyafervent_awa09:25
*** sballe has quit IRC09:27
*** dmsimardz has joined #openstack-infra09:29
*** dmsimardz is now known as dmsimard09:30
*** david-lyle has joined #openstack-infra09:30
*** _nadya_ has quit IRC09:30
*** dmsimard_away has quit IRC09:31
*** _nadya_ has joined #openstack-infra09:31
*** amuller has quit IRC09:32
*** renlt has joined #openstack-infra09:32
*** AlexF has joined #openstack-infra09:34
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: [DO NOT MERGE] test full tempest run on f20  https://review.openstack.org/11273909:34
*** david-lyle has quit IRC09:35
*** gokrokve has joined #openstack-infra09:37
openstackgerritPeter Belanyi proposed a change to openstack-infra/config: Add jshint job for horizon as non-voting  https://review.openstack.org/11382509:38
*** david-lyle has joined #openstack-infra09:38
*** gokrokve has quit IRC09:38
*** gokrokve has joined #openstack-infra09:39
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Use sahara-specs-core for sahara-specs acl  https://review.openstack.org/11092709:40
*** jp_at_hp has quit IRC09:40
*** mika has joined #openstack-infra09:41
SergeyLukjanovjhesketh, rhsu, I'm here now09:43
*** david-lyle has quit IRC09:43
*** gokrokve has quit IRC09:43
*** katyafervent_awa is now known as katyafervent09:44
*** mugsie has quit IRC09:45
*** sballe__ has joined #openstack-infra09:46
*** amcrn has quit IRC09:47
*** andreaf has joined #openstack-infra09:47
*** flwang_ has joined #openstack-infra09:48
SergeyLukjanovanteaya, sorry, it was already 2am in my tz and I was sleeping / or filling dishwasher :)09:48
*** mugsie has joined #openstack-infra09:49
*** sballe_ has quit IRC09:50
openstackgerritA change was merged to openstack-infra/config: Add specific python-saharaclient acls  https://review.openstack.org/10571209:50
*** Longgeek has joined #openstack-infra09:52
openstackgerritAndreas Jaeger proposed a change to openstack/requirements: Rename bash8 to bashate  https://review.openstack.org/11308009:52
*** flwang_ has quit IRC09:52
*** yfried has joined #openstack-infra09:53
*** yfried__ has quit IRC09:54
*** med_ has quit IRC10:00
*** gyee has quit IRC10:00
*** bookwar has quit IRC10:00
*** jeblair has quit IRC10:00
*** SpamapS has quit IRC10:00
*** jamespage has quit IRC10:00
*** bnemec has quit IRC10:00
*** unicell has quit IRC10:00
*** zul has quit IRC10:00
*** pblaho is now known as pblaho|afk10:01
*** AlexF has quit IRC10:01
*** zul has joined #openstack-infra10:01
*** jgallard has quit IRC10:04
*** sballe has joined #openstack-infra10:06
*** imeerovi has joined #openstack-infra10:07
*** ihrachyshka has joined #openstack-infra10:07
*** med_ has joined #openstack-infra10:07
*** gyee has joined #openstack-infra10:07
*** bookwar has joined #openstack-infra10:07
*** jeblair has joined #openstack-infra10:07
*** SpamapS has joined #openstack-infra10:07
*** jamespage has joined #openstack-infra10:07
*** bnemec has joined #openstack-infra10:07
*** imeerovi has quit IRC10:07
*** imeerovi has joined #openstack-infra10:07
*** ihrachyshka has quit IRC10:07
*** ihrachyshka has joined #openstack-infra10:07
*** sballe__ has quit IRC10:07
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: sahara-* repos aren't part of integrated release  https://review.openstack.org/11383310:10
*** pcm_ has joined #openstack-infra10:13
*** mpaolino has quit IRC10:13
*** pcm__ has joined #openstack-infra10:15
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Create refs permission isn't needed for sahara now  https://review.openstack.org/11383410:15
*** jyuso has quit IRC10:17
*** AJaeger has joined #openstack-infra10:18
*** pcm_ has quit IRC10:18
*** jcoufal has quit IRC10:19
*** sballe_ has joined #openstack-infra10:21
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Use more strict regex for sahara tags acl  https://review.openstack.org/11383610:21
AJaegerSergeyLukjanov, bash8 was renamed to bashate and thus I changed my patch: https://review.openstack.org/11382810:21
*** sballe has quit IRC10:21
AJaegerBut looking at keystone - the only user of bash8 that I could find - I think we need to do the following:10:21
AJaegerAdd bashate; merge keystone rename;remove bash810:21
*** hashar has quit IRC10:22
AJaegerHere's the requirements patch https://review.openstack.org/113080 - what do you think?10:22
*** yamamoto has joined #openstack-infra10:22
SergeyLukjanovAJaeger, already +2'd10:23
SergeyLukjanovAJaeger, I've missed that bash8 has been added to it10:23
AJaegerI think I need to change it in two patches as above...10:23
AJaegerwill be back in 30mins...10:23
*** dtantsur is now known as dtantsur|lunch10:23
*** ihrachyshka has quit IRC10:23
*** imeerovi has quit IRC10:23
*** med_ has quit IRC10:23
*** gyee has quit IRC10:23
*** bookwar has quit IRC10:23
*** jeblair has quit IRC10:23
*** SpamapS has quit IRC10:23
*** jamespage has quit IRC10:23
*** bnemec has quit IRC10:23
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Assocate StoryTag with Story via mapping  https://review.openstack.org/11363510:24
*** sballe_ has quit IRC10:25
*** sballe has joined #openstack-infra10:26
*** yamamoto has quit IRC10:27
*** ido_ has quit IRC10:29
*** imeerovi has joined #openstack-infra10:30
*** ihrachyshka has joined #openstack-infra10:30
*** med_ has joined #openstack-infra10:30
*** gyee has joined #openstack-infra10:30
*** bookwar has joined #openstack-infra10:30
*** jeblair has joined #openstack-infra10:30
*** SpamapS has joined #openstack-infra10:30
*** jamespage has joined #openstack-infra10:30
*** bnemec has joined #openstack-infra10:30
*** imeerovi has quit IRC10:30
*** imeerovi has joined #openstack-infra10:30
*** ihrachyshka has quit IRC10:30
*** ihrachyshka has joined #openstack-infra10:30
*** mika has quit IRC10:34
*** flaviof_zzz is now known as flaviof10:35
*** markmc has joined #openstack-infra10:36
*** mika has joined #openstack-infra10:36
*** sballe has quit IRC10:36
*** sballe has joined #openstack-infra10:37
*** gokrokve has joined #openstack-infra10:37
*** oanufriev has quit IRC10:38
*** yfried has quit IRC10:38
openstackgerritFlavio Percoco proposed a change to openstack/requirements: Add glance.store to global requirements  https://review.openstack.org/11380610:38
*** amuller has joined #openstack-infra10:38
*** david-lyle has joined #openstack-infra10:39
*** Longgeek has quit IRC10:41
*** gokrokve has quit IRC10:41
*** Guest35108 has quit IRC10:42
*** yamahata has quit IRC10:42
*** mmaglana has joined #openstack-infra10:43
*** david-lyle has quit IRC10:43
*** sballe_ has joined #openstack-infra10:44
*** sballe has quit IRC10:44
*** Azher has quit IRC10:47
*** mmaglana has quit IRC10:48
*** heyongli has joined #openstack-infra10:48
*** heyongli has quit IRC10:49
*** oanufriev has joined #openstack-infra10:51
openstackgerritDina Belova proposed a change to openstack-infra/config: Make py33 job running only for Ceilometer master branch  https://review.openstack.org/11384210:52
*** andreykurilin_ has joined #openstack-infra10:52
openstackgerritAndreas Jaeger proposed a change to openstack/requirements: Rename bash8 to bashate (part 1)  https://review.openstack.org/11308010:56
openstackgerritAndreas Jaeger proposed a change to openstack/requirements: Rename bash8 to bashate (part 1)  https://review.openstack.org/11384310:56
salv-orlandojhesketh: sorry to bother you, did you forget to write the reason for the -1 here? https://review.openstack.org/#/c/113562/10:56
openstackgerritLe Tian Ren proposed a change to openstack-infra/config: Add create access right on "refs/heads/*".  https://review.openstack.org/11384410:59
openstackgerritAndreas Jaeger proposed a change to openstack/requirements: Rename bash8 to bashate (part 2)  https://review.openstack.org/11384311:00
*** renlt has quit IRC11:01
AJaegerSergeyLukjanov, I split it up, we need to do this in two steps...11:02
*** dims has joined #openstack-infra11:03
jheskethsalv-orlando: Heh, sorry, I had clicked the wrong vote!11:03
*** dims is now known as Guest2502111:03
*** pblaho|afk is now known as pblaho11:03
*** ociuhandu has joined #openstack-infra11:03
*** Guest25021 has quit IRC11:04
*** yfried has joined #openstack-infra11:05
*** dims_ has joined #openstack-infra11:05
*** loki184 has quit IRC11:06
*** bookwar has quit IRC11:06
*** miqui has joined #openstack-infra11:06
*** yaguang has quit IRC11:07
*** oanufriev has quit IRC11:08
*** p5ntangle has quit IRC11:09
salv-orlandojhesketh: that’s ok… thanks for the +111:09
*** jcoufal has joined #openstack-infra11:09
*** derekh has quit IRC11:09
*** bookwar has joined #openstack-infra11:11
*** yolanda has quit IRC11:13
*** [1]evgenyf has joined #openstack-infra11:14
*** yfried_ has joined #openstack-infra11:16
*** evgenyf has quit IRC11:16
*** [1]evgenyf is now known as evgenyf11:16
*** yfried has quit IRC11:16
openstackgerritDavanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Add query for Postgres startup failure  https://review.openstack.org/11363411:17
*** p5ntangle has joined #openstack-infra11:17
*** yfried__ has joined #openstack-infra11:18
*** yfried_ has quit IRC11:21
*** dims_ has quit IRC11:22
*** yamamoto has joined #openstack-infra11:22
*** dims_ has joined #openstack-infra11:23
*** sballe_ has quit IRC11:24
*** Longgeek has joined #openstack-infra11:26
*** dims__ has joined #openstack-infra11:26
*** yamamoto has quit IRC11:26
*** dkranz has quit IRC11:27
*** dims_ has quit IRC11:27
*** mpaolino has joined #openstack-infra11:28
*** yolanda has joined #openstack-infra11:29
*** pblaho is now known as pblaho|afk11:31
*** andreaf_ has joined #openstack-infra11:32
*** andreaf has quit IRC11:34
*** dalgaaf_ has joined #openstack-infra11:35
*** gokrokve has joined #openstack-infra11:37
*** andreaf_ has quit IRC11:38
*** pblaho|afk is now known as pblaho11:39
*** david-lyle has joined #openstack-infra11:40
*** rfolco has quit IRC11:42
*** gokrokve has quit IRC11:42
*** david-lyle has quit IRC11:44
mkodererhi folks - the grenade jobs seems to have problem https://bugs.launchpad.net/openstack-ci/+bug/135631011:45
uvirtbotLaunchpad bug 1356310 in openstack-ci "Grenade test fails while using a deprecated glance command" [Undecided,New]11:45
*** unicell has joined #openstack-infra11:50
*** yfried has joined #openstack-infra11:52
*** flwang_ has joined #openstack-infra11:53
*** rfolco has joined #openstack-infra11:54
*** nosnos has quit IRC11:54
openstackgerritRadomir Dopieralski proposed a change to openstack/requirements: Update xstatic-jquery-ui for Horizon  https://review.openstack.org/11318411:55
rdopieralskiso it looks like we won't be splitting Horizon this cycle11:55
*** yfried__ has quit IRC11:56
rdopieralskibut we still want to do it as early as possible in K11:56
*** andreykurilin_ has quit IRC11:56
*** flwang_ has quit IRC11:57
*** _nadya_ has quit IRC11:59
*** Guest35108 has joined #openstack-infra12:01
*** jamielennox is now known as jamielennox|away12:02
*** salv-orlando has quit IRC12:02
*** adalbas has joined #openstack-infra12:03
*** dims__ has quit IRC12:04
*** dims_ has joined #openstack-infra12:05
russellbdansmith: btw i went with a new repo-based approach for the new libvirt testing (not source anymore) so the dep concerns shouldn't be a big deal12:05
russellbfungi: clarkb ^^^ since you were mentioned in the comment i was responding to in scrollback12:06
russellb(a repo maintained by fedora already that is)12:07
russellbhttps://review.openstack.org/#/c/113349/112:08
*** dims_ has quit IRC12:09
*** esker has quit IRC12:10
*** dprince has joined #openstack-infra12:15
*** mpaolino has quit IRC12:17
*** dkranz has joined #openstack-infra12:20
*** boris-42 has quit IRC12:21
imeerovihi, I want to run unitests for my jjb patch (https://review.openstack.org/#/c/113348/), I can see that many patches are uploaded with relevant tests/scm/fixtures/<....> stuff. i tried to google about a way to do it and didn't find some specific documentation, can somebody point me to relevant stuff?12:21
*** dims_ has joined #openstack-infra12:22
*** yamamoto has joined #openstack-infra12:22
*** amotoki has joined #openstack-infra12:22
*** leifmadsen has quit IRC12:23
*** leifmadsen has joined #openstack-infra12:23
*** mbacchi has joined #openstack-infra12:25
*** gargola has joined #openstack-infra12:26
imeeroviafazekas, hi Its Ilia (we were at past at Elena's team), I uploaded my first patch to jjb and i have some question:  I want to run unitests for my jjb patch (https://review.openstack.org/#/c/113348/), I can see that many patches are uploaded with relevant tests/scm/fixtures/<....> stuff. i tried to google about a way to do it and didn't find some specific documentation, maybe you can point me to relevant stuff?12:26
*** weshay has joined #openstack-infra12:27
*** yamamoto has quit IRC12:27
*** pdmars has joined #openstack-infra12:28
*** pdmars has quit IRC12:29
*** pdmars has joined #openstack-infra12:29
*** dkliban is now known as dkliban_afk12:30
*** mpaolino has joined #openstack-infra12:30
*** _nadya_ has joined #openstack-infra12:30
*** aysyd has joined #openstack-infra12:31
*** chandankumar has quit IRC12:32
*** bknudson1 has quit IRC12:32
*** boris-42 has joined #openstack-infra12:32
openstackgerritAndreas Jaeger proposed a change to openstack/requirements: Rename bash8 to bashate (part 1)  https://review.openstack.org/11308012:33
openstackgerritAndreas Jaeger proposed a change to openstack/requirements: Rename bash8 to bashate (part 2)  https://review.openstack.org/11384312:33
*** chandankumar has joined #openstack-infra12:33
*** sballe has joined #openstack-infra12:34
openstackgerritA change was merged to openstack-dev/cookiecutter: Use spaces instead of tabs for indentation  https://review.openstack.org/10386912:35
*** gokrokve has joined #openstack-infra12:37
*** dims_ has quit IRC12:39
*** dims_ has joined #openstack-infra12:40
*** flaviof is now known as flaviof_zzz12:40
*** david-lyle has joined #openstack-infra12:40
*** sballe_ has joined #openstack-infra12:41
*** gokrokve has quit IRC12:41
*** dims_ has quit IRC12:44
*** sballe has quit IRC12:44
*** david-lyle has quit IRC12:45
*** harlowja_at_home has joined #openstack-infra12:48
*** yfried has quit IRC12:50
*** julim has joined #openstack-infra12:50
*** _nadya_ has quit IRC12:50
*** ominakov has joined #openstack-infra12:51
*** AlexF has joined #openstack-infra12:51
*** julim has quit IRC12:52
*** bknudson has joined #openstack-infra12:52
*** salv-orlando has joined #openstack-infra12:53
*** julim has joined #openstack-infra12:53
*** radez_g0n3 is now known as radez12:54
*** ominakov has quit IRC12:54
*** dustins has joined #openstack-infra13:00
*** mfer has joined #openstack-infra13:02
*** salv-orlando has quit IRC13:02
*** daya_k has quit IRC13:04
*** sandywalsh has joined #openstack-infra13:04
*** rlandy_ has joined #openstack-infra13:05
openstackgerritLouis Taylor proposed a change to openstack-infra/gitdm: Add Louis Taylor to HP  https://review.openstack.org/11387313:06
*** dims_ has joined #openstack-infra13:10
*** rlandy_ has quit IRC13:11
*** ominakov has joined #openstack-infra13:11
*** AlexF has quit IRC13:12
*** rlandy_ has joined #openstack-infra13:12
*** dkliban_afk is now known as dkliban_13:12
*** dkliban_ is now known as dkliban13:12
*** andreaf has joined #openstack-infra13:14
*** flaviof_zzz is now known as flaviof13:16
openstackgerritA change was merged to openstack-dev/pbr: Introduce a SemanticVersion object  https://review.openstack.org/9410813:16
mtreinishmkoderer: I think https://review.openstack.org/#/c/113878/ should fix it13:16
*** rlandy_ has quit IRC13:17
*** ominakov has quit IRC13:17
mtreinishmkoderer: although this identified a gap in coverage around grenade, stable branches, and clients13:18
mkodererdalgaaf_: ^^13:20
*** rlandy_ has joined #openstack-infra13:20
mkoderermtreinish: ok thx .. I didn't see that there are some glance commands in setup too13:20
*** homeless has joined #openstack-infra13:21
mkodererah, it's in stable .. ok ;)13:21
*** yamamoto has joined #openstack-infra13:22
openstackgerritafazekas proposed a change to openstack-infra/config: Not use firewalld on the jenkins slaves  https://review.openstack.org/11388413:23
*** rlandy_ has quit IRC13:24
*** sballe_ has quit IRC13:24
fungimkoderer: based on your update, i moved that bug from openstack-ci to grenade13:24
mkodererfungi: yep thx13:24
fungi(in case that was a non-obvious status change)13:24
*** stevemar has joined #openstack-infra13:24
*** rlandy_ has joined #openstack-infra13:25
*** mflobo has joined #openstack-infra13:25
*** andreaf_ has joined #openstack-infra13:25
openstackgerritA change was merged to openstack-infra/config: Add create access right on "refs/heads/*".  https://review.openstack.org/11384413:26
*** dtantsur|lunch is now known as dtantsur13:26
*** yamamoto has quit IRC13:27
*** rlandy_ has quit IRC13:27
dansmithrussellb: ah, cool13:28
*** andreaf has quit IRC13:28
*** mriedem has joined #openstack-infra13:29
openstackgerritIlia Meerovich proposed a change to openstack-infra/jenkins-job-builder: Fixing exception formatting  https://review.openstack.org/11388813:29
*** rlandy_ has joined #openstack-infra13:31
*** andreaf_ has quit IRC13:31
*** andreaf has joined #openstack-infra13:32
openstackgerritA change was merged to openstack-infra/zuul: Report correctly when dequeuing dependent changes  https://review.openstack.org/11147913:32
*** rlandy_ has quit IRC13:33
*** rlandy_ has joined #openstack-infra13:34
*** andreaf has quit IRC13:34
*** rlandy_ has quit IRC13:34
*** andreaf has joined #openstack-infra13:35
*** mmaglana has joined #openstack-infra13:35
*** rlandy_ has joined #openstack-infra13:35
*** maxbit has joined #openstack-infra13:35
openstackgerritA change was merged to openstack/requirements: Add glance.store to global requirements  https://review.openstack.org/11380613:36
*** vhoward has left #openstack-infra13:36
*** gokrokve has joined #openstack-infra13:37
*** rlandy_ has quit IRC13:39
openstackgerritIlia Meerovich proposed a change to openstack-infra/jenkins-job-builder: Implements wrapper for ownership plugin. This wrapper sets "Inject ownership variables into environment"  https://review.openstack.org/11334813:39
homelessfungi: could you help to review this, https://review.openstack.org/#/c/113598/, there is now what you guys suggested13:39
*** rdekel has quit IRC13:40
*** mmaglana has quit IRC13:40
*** ilyashakhat_ has quit IRC13:40
*** radez is now known as radez_g0n313:40
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Tags db api  https://review.openstack.org/11388913:41
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for Postgres startup failure  https://review.openstack.org/11363413:41
*** gokrokve has quit IRC13:42
*** pcrews has joined #openstack-infra13:42
*** mmaglana has joined #openstack-infra13:43
*** ominakov has joined #openstack-infra13:43
*** chandankumar has quit IRC13:44
*** armax has joined #openstack-infra13:44
*** rfolco has quit IRC13:48
*** mmaglana has quit IRC13:48
fungihomeless: jhesketh makes a very good point. rereading the commit message and the change now, i'm questioning what the original problem was. options.has_pull_requests is what we want to skip the closer on. if there's no options section then we need to assume we should close pull requests for it. i don't think the original conditional is incorrect after all, instead you need to trap for nonexistent13:48
fungigithub projects right?13:48
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for ceilometer py26 bug 1355983  https://review.openstack.org/11361213:49
uvirtbotLaunchpad bug 1355983 in ceilometer "gate-ceilometer-python26 failing with "Could not find mongod command"" [Undecided,New] https://launchpad.net/bugs/135598313:49
*** sballe has joined #openstack-infra13:51
homelessright fungi, my last comment I explained a little more, but basically the problem becomes when any of your projects doesnt exists in github, then everything breaks, because the current if statement doesnt skip the entry13:51
openstackgerritA change was merged to openstack-dev/pbr: add docs env to tox  https://review.openstack.org/11352913:51
*** pdmars has quit IRC13:51
*** andreaf_ has joined #openstack-infra13:52
fungihomeless: do you have a stacktrace for where it breaks? we might just need to handle an appropriate exception for that instead13:53
*** marun has joined #openstack-infra13:53
*** denis_makogon_ has joined #openstack-infra13:53
homelesssure look at this, this is my projects.yaml http://paste.forj.io/show/314/13:53
*** sballe has quit IRC13:53
homelessand with that data, I got this http://paste.forj.io/show/315/13:54
*** flwang_ has joined #openstack-infra13:54
fungiahh, yep i just checked your comment and saw the link13:54
homelessbecause the first project on the projects.yaml (forj-config) doesnt exists on github, so the script should skip it13:54
*** shashankhegde has joined #openstack-infra13:54
*** harlowja_at_home has quit IRC13:54
fungibut i don't think we can infer that from whether the project has an options section in your projects.yaml13:55
*** denis_makogon has quit IRC13:55
*** andreaf has quit IRC13:55
*** denis_makogon_ is now known as denis_makogon13:55
fungiwhich is what your proposed change would effectively do13:55
*** dmakogon_ has joined #openstack-infra13:55
*** sballe has joined #openstack-infra13:56
fungihomeless: we probably should just wrap the get_repo() call in a try block and except github.GithubException.UnknownObjectException with a continue (and a comment stating that this probably means the project does not exist on github)13:56
homelessI think my change is what you are trying to do, but with the wrong conditions, and I think you never get that failure because all your projects exists on github13:56
fungihomeless: no, if there's no options section, we still want to close pull requests13:57
homelessthen the option "has-pull-request" is not needed13:57
fungihomeless: if it was options.close-pull-requests then that would be true13:57
fungibut if there's no options section, and thus no options.has-pull-requests then we should close any we find13:58
openstackgerritA change was merged to openstack-infra/config: Clear out stray github-org parameters  https://review.openstack.org/11333213:58
*** flwang_ has quit IRC13:58
homelessgot it, then the options.has-pull-request becomes useless right13:59
*** prad has joined #openstack-infra14:00
openstackgerritA change was merged to openstack-infra/config: Adds Poppy CDN Project  https://review.openstack.org/11109514:00
homelessbecause you will close pull requests anyways.. then that is my problem, because I dont want to do it for all, just the ones that I specify o nthe yaml14:00
homelessright fungi?14:01
*** rfolco has joined #openstack-infra14:01
*** andreaf_ has quit IRC14:02
fungihomeless: yeah, the assumption with jeepyb (note that it's a phonetic pronunciation of gpb, the initials for "gerrit project builder") is that you use gerrit for most things, so in some very few cases you might set options.has-pull-requests=true to make the closer skip just that one project14:02
*** sballe has quit IRC14:02
*** pdmars has joined #openstack-infra14:02
fungibut by default, it assumes you want to close pull requests and tell people to use your gerrit instead14:02
SergeyLukjanovflaper87, please, take a look on my comments for https://review.openstack.org/#/c/111244/414:02
*** andreaf_ has joined #openstack-infra14:02
SergeyLukjanovfungi, good morning!14:02
fungibecause why else would you put the project in gerrit, basically14:03
*** dustins_ has joined #openstack-infra14:03
openstackgerritA change was merged to openstack-infra/config: launch-node.py: request flavors/images by ID or name  https://review.openstack.org/11237114:03
*** dustins has quit IRC14:03
openstackgerritSimon McCartney proposed a change to openstack-infra/jenkins-job-builder: Add support for the SSH Agent Plugin as a build wrapper  https://review.openstack.org/11322214:04
fungihomeless: but what you're saying you want is to be able to indicate whether some projects are in github at all, and skip trying to close pull requests for them14:04
homelessfungi: yes14:04
fungihomeless: stepping back, it seems to me that what you actually *need* though is for the pull request closer not to break when some of your projects aren't in github, and teh pragmatic approach to that is to just skip trying to close pull requests for any project where the github api raises an exception indicating that the project isn't there14:05
openstackgerritA change was merged to openstack-infra/config: Remove devnull from post regex  https://review.openstack.org/11205714:05
*** hashar has joined #openstack-infra14:05
homelessyou got it14:05
openstackgerritA change was merged to openstack-infra/config: Use storyboard for gearman-plugin project.  https://review.openstack.org/11336814:06
fungiotherwise you're doing dual bookkeeping of projects in github by mentioning what's replicated both in your gerrit replication config and in your jeepyb projects,yaml, which is likely to diverge over time14:06
fungigood evening SergeyLukjanov14:06
flaper87SergeyLukjanov: thanks for the heads up, I'll do that asap14:08
homelessanother approach could be that I dont want to close pull request for an specific project, then I should skip it14:09
*** reed has joined #openstack-infra14:09
*** _nadya_ has joined #openstack-infra14:09
homelessfungi: right, because right now it doesnt care about the options, I just close the pull request for all the projects on the yaml14:10
*** wenlock has joined #openstack-infra14:10
flaper87SergeyLukjanov: done14:10
openstackgerritFlavio Percoco proposed a change to openstack-infra/config: Rename Marconi to Zaqar  https://review.openstack.org/11124414:10
fungihomeless: right, you could just put options.has-pull-requests on any project which isn't actually in github, as a workaround, but the pythonic fix is to ask forgiveness not permission14:10
openstackgerritA change was merged to openstack-dev/pbr: cleanup tox.ini  https://review.openstack.org/11355314:11
fungiSergeyLukjanov: most recent example of a rename maintenance plan is https://etherpad.openstack.org/p/repo-renaming-2014-06-2814:11
fungiSergeyLukjanov: that should provide a decent template to build from14:12
*** salv-orlando has joined #openstack-infra14:12
*** medieval1_ is now known as medieval114:12
SergeyLukjanovfungi, great, I'll try to make the same for the upcoming renaming later today14:12
SergeyLukjanovflaper87, thx14:12
*** timrc-afk is now known as timrc14:12
*** Krast has quit IRC14:13
*** radez_g0n3 is now known as radez14:13
*** Krast has joined #openstack-infra14:14
fungiSergeyLukjanov: a tip... i usually write a quick little shell script to generate the sql update queries and directory modifications from the list of projects to be renamed, so that it's less prone to individual typographical errors or omissions14:14
openstackgerritafazekas proposed a change to openstack-infra/config: Not use firewalld on the jenkins slaves  https://review.openstack.org/11388414:14
fungiparticularly useful for maintenances where we have a lot of projects to do14:14
*** rlandy_ has joined #openstack-infra14:15
*** lttrl has joined #openstack-infra14:16
*** zz_gondoi is now known as gondoi14:16
*** openstackgerrit has quit IRC14:16
*** rlandy__ has joined #openstack-infra14:17
*** mriedem has quit IRC14:17
*** openstackgerrit has joined #openstack-infra14:17
*** reed has quit IRC14:18
*** rlandy_ has quit IRC14:19
*** dkranz has quit IRC14:19
*** yamamoto has joined #openstack-infra14:22
*** yamamoto has quit IRC14:24
*** yamamoto has joined #openstack-infra14:24
*** wenlock has quit IRC14:24
openstackgerritA change was merged to openstack-infra/config: Add python3-jobs to os-refresh-config  https://review.openstack.org/11249314:26
*** mflobo has quit IRC14:26
*** mriedem has joined #openstack-infra14:26
*** gokrokve has joined #openstack-infra14:27
*** Krast has quit IRC14:28
*** Krast has joined #openstack-infra14:28
*** yamamoto has quit IRC14:28
*** Longgeek has quit IRC14:29
*** homeless has quit IRC14:30
*** Longgeek has joined #openstack-infra14:30
*** Krast has quit IRC14:31
*** Krast has joined #openstack-infra14:31
*** jgallard has joined #openstack-infra14:34
*** julim has quit IRC14:36
openstackgerritpatrick-crews proposed a change to openstack-infra/elastic-recheck: Add crm114 logstash queries to uncategorized page  https://review.openstack.org/11377114:37
*** julim has joined #openstack-infra14:37
*** pdmars has quit IRC14:40
*** pdmars has joined #openstack-infra14:40
*** mmaglana has joined #openstack-infra14:41
*** lyxus has quit IRC14:41
*** dangers_away is now known as dangers14:41
*** mmaglana has quit IRC14:45
*** mmaglana has joined #openstack-infra14:46
*** dkranz has joined #openstack-infra14:46
*** tnurlygayanov has quit IRC14:46
*** sdake has joined #openstack-infra14:46
*** sdake has quit IRC14:46
*** sdake has joined #openstack-infra14:46
*** andreykurilin_ has joined #openstack-infra14:46
*** tnurlygayanov has joined #openstack-infra14:47
*** markmcclain has joined #openstack-infra14:48
*** sballe has joined #openstack-infra14:49
*** wenlock has joined #openstack-infra14:50
*** gokrokve has quit IRC14:50
*** gokrokve has joined #openstack-infra14:50
*** markmcclain1 has joined #openstack-infra14:51
*** flaper87 is now known as flaper87|afk14:54
*** datsun180b has joined #openstack-infra14:54
*** pballand has joined #openstack-infra14:54
*** markmcclain has quit IRC14:55
*** gokrokve has quit IRC14:55
*** mmaglana has quit IRC14:56
*** pblaho is now known as pblaho|afk14:58
*** otherwiseguy has joined #openstack-infra14:58
*** UtahDave has joined #openstack-infra14:59
*** UtahDave has left #openstack-infra14:59
anteayaSergeyLukjanov: np, I figured as much15:00
anteayaSergeyLukjanov: if you have time to join #openstack-cinder some folks have some questions15:00
*** jgrimm has joined #openstack-infra15:01
*** gondoi is now known as zz_gondoi15:01
phschwartzmorning infra15:01
anteayarhsu hello15:01
anteayasalv-orlando: thanks I did, my first night of blues swing15:03
anteayasalv-orlando: not sure how many kinds of swing there are15:03
anteayasalv-orlando: every night is a new experience15:03
salv-orlandoI have no idea at all.15:03
anteayamorning phschwartz salv-orlando15:03
salv-orlandoit’s probably still early for rhsu. It might be a hour.15:03
anteayasalv-orlando: sure15:04
salv-orlandoand btw goodmorning to you as well, anteaya - even if it’s 5 pm here.15:04
anteayasalv-orlando: good evening to you15:04
anteayasalv-orlando: how is dinner coming along15:04
*** evgenyf has quit IRC15:04
salv-orlandoanteaya: still early for that. I’ll do reviews for an hour or two15:05
*** rhsu has joined #openstack-infra15:06
*** ildikov has quit IRC15:06
anteayasalv-orlando: ah, patch owners will be happy15:06
*** MarkAtwood has joined #openstack-infra15:07
*** funzo has quit IRC15:10
*** funzo has joined #openstack-infra15:10
*** mmaglana has joined #openstack-infra15:10
*** pblaho|afk is now known as pblaho15:10
*** zz_dimtruck is now known as dimtruck15:11
funzoclarkb: if you get a couple minutes, would you mind reviewing https://review.openstack.org/#/c/113333/15:11
*** jgallard has quit IRC15:11
*** mmaglana has quit IRC15:12
*** yfried has joined #openstack-infra15:12
*** Sukhdev has joined #openstack-infra15:12
*** yolanda has quit IRC15:13
*** eharney has joined #openstack-infra15:14
*** shashankhegde has quit IRC15:17
*** cody-somerville has quit IRC15:18
*** rlandy has quit IRC15:18
*** yamahata has joined #openstack-infra15:19
*** homeless has joined #openstack-infra15:21
*** rlandy__ has quit IRC15:22
*** yamamoto has joined #openstack-infra15:22
*** daya_k has joined #openstack-infra15:23
*** andreykurilin_ has quit IRC15:26
*** yamamoto has quit IRC15:27
*** baoli has joined #openstack-infra15:27
jeblairanteaya: ping15:30
anteayahello there jeblair15:31
mordredjeblair, clarkb: http://grafana.org/ just got pointed at this - it15:32
anteayathanks for the +A on the single quote patch15:32
mordredjeblair, clarkb: it's apparently related to kibana but is a frontend for graphite15:32
jeblairanteaya: hi.  do you have links to the wiki pages for third party contact information?15:32
*** imeerovi has quit IRC15:32
anteayajeblair: yes, https://wiki.openstack.org/wiki/Category:ThirdPartySystems15:32
jeblairanteaya: is there documentation that third party systems should set that up?15:33
anteayaI have been waiting for the naming to settle down before pointing many people at it15:33
anteayasince I wanted to try to avoid many redirects15:33
anteayano, to be honest I got caught in the mud of the renaming15:34
anteayaand I have worked with a few people to set up their pages15:34
openstackgerritMichael Krotscheck proposed a change to openstack-infra/puppet-storyboard: Added RabbitMQ to StoryBoard  https://review.openstack.org/11393515:34
openstackgerritA change was merged to openstack-infra/config: Added a missing single quote  https://review.openstack.org/11365515:34
*** annegent_ has joined #openstack-infra15:34
anteayabut not enough to know what they need to be told to have success15:34
jeblairanteaya: is there a pending patch to add that documentation?15:34
anteayano, I haven't even attempted to put together the documentation for the wikipage set up15:35
anteayathe naming has really bogged me down15:35
jeblairanteaya: okay, i'm going to do that very quickly.  back in a few.15:35
anteayajeblair: very good15:35
*** mmaglana has joined #openstack-infra15:39
*** gokrokve has joined #openstack-infra15:41
*** rpodolyaka_afk has left #openstack-infra15:42
openstackgerritMichael Krotscheck proposed a change to openstack-infra/puppet-storyboard: StoryBoard Deferred Processors  https://review.openstack.org/11393715:42
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add instructions to register third-party CI in wiki  https://review.openstack.org/11393815:42
jeblairanteaya: ^ that look good to you?15:42
* anteaya clicks15:42
zaroorning15:43
*** atiwari has joined #openstack-infra15:43
zarojeblair: it's unclear what you are suggesting in review of  https://review.openstack.org/#/c/9226815:44
*** mmaglana has quit IRC15:45
*** zz_gondoi is now known as gondoi15:45
zarojeblair: could you please clarify for me?15:45
anteayajeblair: yes, one suggestion15:45
nibalizermordred: i was playing with grafana a cpl months ago15:46
anteayamorning zaro15:46
nibalizerpretty sweet, since it stores graphs in ES so you can easily share them out with people15:46
jeblairzaro: publishing a draft should not remove a change from the queue.15:46
nibalizerand if you already have people working with ELK then giving a kibana view into graphite helps prevent retrain15:46
nibalizerhowever, the codebases have diverged significantly and there aren't plans to ever really support grafana and elk on the same web page, short of embedding15:47
mordrednibalizer: darn15:47
mordrednibalizer: that was kinda what I was hoping ... was that there would be a magical kibana/graphite super-dashboard thing15:47
nibalizeri mean everyone wants it15:48
nibalizerso its comming15:48
mordrednibalizer: but - the "save graphs and dashboards in elasticsearch" thing is cool15:48
nibalizergrafana supports multiple graphites15:48
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add instructions to register third-party CI in wiki  https://review.openstack.org/11393815:48
mordrednibalizer: what does that even mean?15:48
nibalizermultiple graphite urls15:48
nibalizerso graphite-dev and graphite-prod15:48
mordrednibalizer: no, I mean, I undersatnd your words15:48
mordredok. thanks15:48
mordredI was lokoing for "why would I want more tahn one graphite"15:48
jeblairmordred: graphite supports saving graphs; but that kind of suggests a user-authentication system that we have not put in place15:49
nibalizerif they are different servers15:49
nibalizerjeblair: ya you have to add user auth15:49
anteayajeblair: +115:49
jeblairmordred, nibalizer: i expect something different will face a similar problem15:49
jeblairmordred: re-review https://review.openstack.org/113938 pls?15:49
mordredjeblair: yah. it's less interesting of a thing to look in to if it _doesn't_ act as both graphite frontend _And_ kibana15:49
mordredjeblair: on it15:49
nibalizerjeblair: grafana takes the 'paste/etherpad' approach of letting anonymous users carve out namespaces and we hope no one horribly abuses it15:50
jeblairnibalizer: ok15:50
mordredjeblair: done15:50
jeblairfungi: if you are around, can you aprv https://review.openstack.org/#/c/113938/ please?15:51
zarojeblair: what should it do?  just add another change to the queue?15:51
jeblairzaro: it should be recognized as a trigger event, but that's it.15:51
* anteaya really hopes she can keep enough of jeblair's attention for https://review.openstack.org/#/c/95743/ to be merged, the js patch for ci filtering15:51
jeblairanteaya: working up to that15:51
anteayajeblair: yup15:51
anteayajust kind of announcing to the room15:52
* anteaya elbows some space15:52
*** lemongrabber has quit IRC15:52
jeblairanteaya: i prepared this this morning based on your earlier etherpad: https://etherpad.openstack.org/p/32PBpaudDt15:52
*** lemongrab has joined #openstack-infra15:52
* anteaya clicks15:52
*** lemongrab is now known as Guest4842315:53
*** yfried has quit IRC15:53
jeblairanteaya: i intend to: 1) merge the doc change i just wrote; 2) run those renames; 3) send an email announcing the renames and doc change; 4) merge the JS changes.  all before lunch.  :)15:53
*** Guest48423 has quit IRC15:54
anteayajeblair: yay15:54
anteayareviewing your etherpad for step 2 now15:54
*** afshaff has joined #openstack-infra15:54
*** ramashri has joined #openstack-infra15:55
*** dprince has quit IRC15:55
*** flwang_ has joined #openstack-infra15:55
*** yamamoto has joined #openstack-infra15:55
*** pcm__ has quit IRC15:57
*** tjones has left #openstack-infra15:58
*** ihrachyshka has quit IRC15:58
jeblairanteaya: also, is the change to add a recheck syntax for third-party systems still around?15:59
anteayajeblair: question: ssh review gerrit set-account 10692 --full-name '"Brocade Vyatta CI"' this is currently Brocade OSS CI -- I'm fine with the change, I guess we can change it back if it upsets them15:59
anteayayes15:59
*** flwang_ has quit IRC15:59
anteayajeblair: https://review.openstack.org/#/c/109565/15:59
jeblairanteaya: the change to vyatta was in your earlier etherpad16:00
fungijeblair: i just spotted something maybe unimportant on 95743 (+2'd anyway) but wanted to make sure you saw it... easy to possibly overlook since i didn't downvote on it16:00
*** jlibosva has quit IRC16:01
openstackgerritDaniel Shirley proposed a change to openstack-infra/jenkins-job-builder: Added support for JClouds Blobstore  https://review.openstack.org/10751516:01
anteayajeblair: ah okay16:01
*** k4n0 has quit IRC16:01
*** pballand has quit IRC16:01
*** yfried has joined #openstack-infra16:01
jeblairfungi: i agree a link would be good.  however, i'm not certain that puppet won't copy new versions of that file.16:01
fungijeblair: nor am i ;)16:02
jeblair(i can never remember)16:02
*** hashar is now known as hasharConfcall16:02
*** emagana has joined #openstack-infra16:02
anteayajeblair: I had thought we weren't going to use storage, have I mis-remembered? ssh review gerrit set-account 11611 --full-name '"Nimble Storage CI"16:02
*** gyee_ has joined #openstack-infra16:02
jeblairanteaya: it's the name of their company16:02
*** dustins_ has quit IRC16:02
anteayaokay, so the same for Pure Storage CI16:03
jeblairhttp://www.nimblestorage.com/16:03
anteayasince Pure Storage is the name of their company16:03
anteayawhat about HP Storage CI?16:03
jeblairyep.  and i think both of those are better than "nimble ci" and "pure ci" :)16:03
jeblairanteaya: got a better name?16:03
jeblairanteaya: hp has a storage division they call "hp storage" http://www8.hp.com/us/en/products/data-storage/16:04
funginibalizer: out of curiosity, does ensure:present on a file with another local file as its source automatically replace if the source file changes or is there more magic needed? (related to my comment on the https://review.openstack.org/#/c/95743/10/modules/openstack_project/manifests/gerrit.pp patch)16:04
*** gargola has quit IRC16:04
fungihogepodge: ^ ?16:04
* fungi just spams pings at random people for fun16:04
anteayajeblair: I agree with Nimble Storage and Pure Storage16:04
nibalizerPING CANNON16:04
fungihold on, reloading... ;)16:04
anteayajeblair: okay, no I don't have a better name right now16:05
anteayalet's go with it then16:05
jeblaireasy to change if we do :)16:05
anteayatrue16:05
nibalizerim pretty sure its gonna md5 both sides and overwrite if it finds diffs16:05
*** sabeen3 has quit IRC16:05
nibalizerbut let me fire up a quick test16:05
*** daya_k has quit IRC16:05
*** p5ntangle has quit IRC16:05
anteayahow were you able to confirm the bots are bots?16:05
funginibalizer: awesome. if so, it's just what we want there16:05
*** sabeen1 has joined #openstack-infra16:05
anteayajeblair: I was never able to figure out how16:05
jeblairanteaya: i checked to make sure they had not reviewed anything recently.  search for "reviewer:<accountnumber>"16:06
*** gargola has joined #openstack-infra16:06
*** Guest35108 has quit IRC16:06
anteayakk16:07
nibalizerfungi: confirmed it keeps em in sync16:07
*** dustins has joined #openstack-infra16:07
funginibalizer: great--thanks!16:07
*** pballand has joined #openstack-infra16:07
asselin__nodepool works with openstack-master provider, right?16:07
*** andreykurilin_ has joined #openstack-infra16:07
*** reed has joined #openstack-infra16:08
fungiasselin__: i believe so... we have tripleo cloud regions as providers in nodepool.openstack.org's deployment and they follow tip of master for server projects (or very close to it modulo bugs being worked around while fixes are pending)16:09
anteayaokay I confirm the accounts named bot have not reviewed anything in a while16:09
*** yfried has quit IRC16:09
anteayajeblair: I'm good with step 216:09
anteayajeblair: I'm also good with 3 and 416:09
*** praneshp has joined #openstack-infra16:09
*** juzuluag has joined #openstack-infra16:09
*** praneshp_ has quit IRC16:09
anteayastanding by if you want me to view your email for 3 in an etherpad16:09
jeblairanteaya: thx, writing it now16:10
anteayakk16:10
nibalizerso i have all the storyboard history proposed as reviews to the infra/puppet-storyboard module, starting here: https://review.openstack.org/#/c/100370/16:10
nibalizerand going on through dependencies for about 15 commits16:10
*** annegent_ has quit IRC16:10
nibalizerthen this; https://review.openstack.org/#/c/113731/, which is -2 workflow right now, is the actual commit to flip it over16:10
krotscheckThe chain ends here: https://review.openstack.org/#/c/113935/16:11
krotscheck(as in, that’s the first new code in that repo)16:11
nibalizeronce the rest of the storyboard stuff lands, we should see the puppet-apply-precise test start passing again16:12
asselin__we have an interesting nodepool/jenkins use case where we would like at most 1 job of a certain type to run per provider. Is there an easy way to configure that?16:12
nibalizerkrotscheck: nice16:12
*** vermarah has joined #openstack-infra16:13
asselin__currently it seems we need to create 2 providers for the same 1 provider, with the extra provider set to max-server: 1 for that special job16:13
SergeyLukjanovfungi, thanks for the tips16:13
jrollcan I please bug a devstack core to take a look at these two reviews? trying to get check jobs going for a new ironic driver. :) https://review.openstack.org/#/c/112095/ and https://review.openstack.org/#/c/108457/16:14
*** mmaglana has joined #openstack-infra16:14
*** andreykurilin_ has quit IRC16:15
*** hdd has joined #openstack-infra16:17
*** ling-yun-1 has joined #openstack-infra16:17
*** dprince has joined #openstack-infra16:18
jeblairanteaya: draft email at bottom of same etherpad: https://etherpad.openstack.org/p/32PBpaudDt16:19
* anteaya reads16:19
*** mmaglana has quit IRC16:20
*** jcoufal has quit IRC16:20
*** ling-yun has quit IRC16:21
anteayajeblair: two suggestions in the etherpad16:21
*** arnaud has joined #openstack-infra16:21
*** mmaglana has joined #openstack-infra16:21
*** e0ne has quit IRC16:21
jeblairanteaya: doen16:21
jeblairdone16:21
anteayathanks16:21
jeblairfungi: lgty?16:21
*** rhsu has quit IRC16:22
*** amuller has quit IRC16:23
*** praneshp has quit IRC16:23
*** skolekonov has quit IRC16:24
fungijeblair: yep, though i also agree with anteaya's suggested clarifications there16:25
*** yamahata has quit IRC16:26
jeblairfungi: thanks.  made your update too.16:26
jeblairi have renamed all the ci accounts now16:26
*** fungi has quit IRC16:26
anteayayay!!16:27
*** rdopieralski has quit IRC16:27
*** fungi has joined #openstack-infra16:27
anteayafungi: welcome back16:28
mkodererjogo: hi ;) we need you +A for https://review.openstack.org/#/c/113878/16:28
mkodererotherwise check-grenade-dsvm-icehouse doesn't work16:29
fungiyeah, whoops. my fingers substituted /quit on a channel when my brain wanted /part16:29
anteayaha ha ha16:30
*** hasharConfcall has quit IRC16:30
*** mmaglana_ has joined #openstack-infra16:30
*** jpich has quit IRC16:31
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add CI results table to Gerrit  https://review.openstack.org/10586016:32
jeblairSergeyLukjanov, fungi: ^ i'd like to aprv that now as well16:32
*** mmaglana has quit IRC16:33
SergeyLukjanovjeblair, it's already tested, isn't it?16:33
*** mmaglana_ has quit IRC16:33
SergeyLukjanovjeblair, on review-dev16:33
jeblairSergeyLukjanov: yes, it should still be running there (unless it was accidentally reverted).  the only change i made since then was whitespace and removing that debug statement16:34
jeblair(i'll go ahead and put the latest version on there)16:34
SergeyLukjanovjeblair, yeah, see my own comments ;)16:34
*** _nadya_ has quit IRC16:34
jeblairSergeyLukjanov: yeah, i meant i just made those changes because of your comments :)16:35
jeblairreview-dev is restarting with latest hideci16:36
*** andreaf_ has quit IRC16:36
* anteaya goes to review-dev16:37
*** fifieldt has quit IRC16:37
openstackgerritA change was merged to openstack-infra/config: Add button that shows/hides CI comments in Gerrit  https://review.openstack.org/9574316:38
clarkbdo much mail and scrollback16:38
clarkb*so16:38
anteayaperhaps I am thick, I am not seeing a table for the ci results16:38
anteayacan anyone suggest a url?16:38
hogepodgefungi if you specify a source ensure => present will always sync the file to the source.16:38
SergeyLukjanovjeblair, fungi, I'm ok with approving https://review.openstack.org/#/c/105860/16:39
fungihogepodge: good to know. for some reason it never dawned on me that it would also do that for local sources16:39
*** daya_k has joined #openstack-infra16:39
*** atiwari has quit IRC16:40
fungibut in retrospect, makes perfect sense16:40
fungiSergeyLukjanov: jeblair: me too. +2'd16:40
afshaffHey guys, I've got a question about Jenkins Job Builder. I'm building out some job templates and I would like to include a file with a templated filename (ie. !include-raw {name}-build-script.sh) I've tried using macros, YAML node references, and digging through the source code a bit, but can't seem to figure anything out. Can anyone here help me out? Thanks!16:41
jeblairanteaya: i think i didn't get all of the necessary files installed; one sec16:41
anteayakk16:42
*** afazekas has quit IRC16:42
fungiafshaff: have you tried escaping the parameter by doubling the braces? e.g. {{name}}16:42
fungiafshaff: oh, i think i may have misread what you want to do there...16:43
fungiafshaff: we may have an example--looking now16:43
*** mmaglana has joined #openstack-infra16:44
*** fifieldt has joined #openstack-infra16:44
jeblairanteaya: https://review-dev.openstack.org/#/c/5269/16:45
afshaffawesome thanks, with the single brace, it tries to find a file named {repo}-build-script.sh, and with two braces it throws a parse expection16:45
anteayajeblair: ah beautiful16:45
*** imeerovi has joined #openstack-infra16:45
anteayabeautiful, beautiful16:45
clarkbfungi the no rpm and no yum found errors on dfw nodes dont appear to be related to the hpcloud-b1 issue from yesterday (wrong base image)16:46
*** mmaglana_ has joined #openstack-infra16:46
jeblairi'm really hoping we can get something like that into gerrit proper with _david_'s plugin16:46
clarkbfungi have you come up with any new theories for those fails?16:47
fungiclarkb: agreed. i strongly suspect they're related to the too-old run-pep8.sh failures16:47
anteayajeblair: that will be awesome16:47
fungiclarkb: on my list for today is to start analyzing what snapshots we have hanging around in that region16:47
clarkbI will try holding a node today16:47
*** juzuluag has quit IRC16:47
*** juzuluag_ has joined #openstack-infra16:47
fungiclarkb: current best theory is a bug in either nodepool, novaclient or nova at rax causing a wrong (very outdated) snapshot to get selected under some circumstances (maybe bad image cache on a particular nova compute host?)16:48
*** rhsu has joined #openstack-infra16:49
*** mmaglana has quit IRC16:49
*** sballe has quit IRC16:50
jogomkoderer: done16:50
zaroi just signed out of review-dev, but cannot sign back in.  anybody know why?16:51
anteayajeblair was updating review-dev, zaro, perhaps that might be playing a role16:52
anteayazaro: https://review-dev.openstack.org/#/c/5269/16:52
anteayazaro: note the pretty table of ci results, separate from comments16:52
*** mjturek has left #openstack-infra16:52
fungiafshaff: here's an example of embedding a built-in job parameter within a shell builder in a job template... http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/oslo.yaml#n2716:53
*** gyee_ has quit IRC16:53
*** praneshp has joined #openstack-infra16:53
jeblairzaro: i just signed into review-dev16:54
*** ling-yun-1 has quit IRC16:56
*** pcm_ has joined #openstack-infra16:56
zarook, i'm able to login now.16:56
*** ling-yun-1 has joined #openstack-infra16:56
*** Longgeek has quit IRC16:57
*** alexpilotti has joined #openstack-infra16:57
afshafffungi: ahh ok, that isn't quite what we were hoping to do though. because our build scripts could look vastly different based on what {repo} we are trying to build, I don't think it'I wanted to manage the build scripts separately and use the !include syntax to "plug-in" the correct build script based on the repo.16:58
afshafffungi: *I don't think it's possible to only substitute a few variables here and there into an inline script*16:59
phschwartzfungi: clarkb: mordred: jeblair: Just wanted to give you guys a follow up. Our internal Neutron devs are looking to see what is causing issues while instances are being deleted. Neutron looks to be the issue that is causing the error+deleting state.16:59
fungiphschwartz: right, we see it in random devstack runs ourselves... neutron erroring on port removal i think16:59
phschwartzfungi: That would be the issue. lol16:59
clarkbthere is probably an e-r bug tracking it17:00
fungialmost certainly. any collaboration on that issue would help massively upstream as well as downstream17:00
jeblairone way or another, this system is tests openstack.  :)17:00
jeblairs/is//17:00
fungior put another way, we get hit coming and going17:00
jeblairhaha17:01
*** chuckC has quit IRC17:01
*** annegent_ has joined #openstack-infra17:02
*** AlexF has joined #openstack-infra17:03
*** bhuvan has joined #openstack-infra17:03
fungiphschwartz: maybe bug 1313794 or bug 1334109 (those may be dupes)?17:04
uvirtbotLaunchpad bug 1313794 in neutron "lock_wait timeout caused by plug_vip_port" [Medium,In progress] https://launchpad.net/bugs/131379417:04
uvirtbotLaunchpad bug 1334109 in neutron "Lock wait timeout updating router's gw_port_id" [Medium,In progress] https://launchpad.net/bugs/133410917:04
clarkbfungi: :)17:04
*** juzuluag_ has quit IRC17:05
fungicaught between an upstream rock and a downstream hard place?17:05
fungithat doesn't roll off the tongue quite so well17:05
*** annegent_ has quit IRC17:05
phschwartzlol17:05
krotscheckphschwartz: FYI https://review.openstack.org/#/c/112128/17:06
clarkbfungi: looks like devstack-trusty in hpcloud-b1 built a just under a couple hours ago so that has been sorted17:06
*** annegent_ has joined #openstack-infra17:06
*** krtaylor has quit IRC17:06
openstackgerritA change was merged to openstack-infra/config: Add instructions to register third-party CI in wiki  https://review.openstack.org/11393817:07
fungiclarkb: presumably, if we're not seeing the shmmax/postgres issue resurface there anyway17:07
phschwartzkrotscheck: looks good to me17:07
*** Ryan_Lane has joined #openstack-infra17:07
clarkbfungi: dtroyer: I do still think that postgres should bump those numbers17:07
*** YorikSar has quit IRC17:07
clarkbbut that change should probably come from someone that understands postgres17:07
krotscheckAs much as I hate asking for a rubberstamp, are there any infra-core available to help nibalizer and I move the storyboard puppet module history moved over to infra/puppet-storyboard? https://review.openstack.org/#/c/100370/17:08
*** MarkAtwood has quit IRC17:08
krotscheckphschwartz: Thanks :)17:08
krotscheckphschwartz: I’m not _quite_ ready to land the storyboard one yet since I have a different priority today, but I’m hopeful.17:08
fungiafshaff: unless i misunderstand your comment, we do pass per-project parameters into job templates when instantiating them, like http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/projects.yaml#n1498 (tons of examples in there)17:08
clarkbkrotscheck: nibalizer: are we not doing that as a git filter branch pushed into the repo?17:09
phschwartzkrotscheck: I am hoping soon I will have our internal systems here stable so I can start on vinz. :( darn hassel of broken things17:09
nibalizerclarkb: i submitted it as reviews17:09
clarkbkrotscheck: nibalizer: it looks like we are pusing code up to make the switch17:09
clarkbnibalizer: why not git filter branch?17:09
nibalizeri dont have push access to the repo afaik17:09
*** YorikSar has joined #openstack-infra17:09
*** arborism has joined #openstack-infra17:09
*** andreykurilin_ has joined #openstack-infra17:09
*** arborism is now known as amcrn17:09
clarkbnibalizer: right, you should be doing it as part of the initial repo import17:09
nibalizerclarkb: i used subtree but its basically the same as i understnd it?17:09
fungiphschwartz: hasselhoff broken things?!?17:09
krotscheckclarkb: Isn’t it too late to do that now?17:10
*** shashankhegde has joined #openstack-infra17:10
clarkbkrotscheck: yes, I am wondering why we got here17:10
anteayafungi: ohhhh17:10
* anteaya wonders who else got it17:10
clarkbkrotscheck: this is our guinea pig, I have an interest in doing it right :)17:10
* fungi can't let some typos go17:10
phschwartzfungi: lol, yeah. stupid spellcheck failure on OSx17:10
krotscheckclarkb: Well, I think in this case the repo preceded the guinea pig.17:11
*** yamahata has joined #openstack-infra17:11
clarkbkrotscheck: ya that seems to be the case17:12
*** Sukhdev has quit IRC17:12
clarkbwhat do people think should we still filter branch and push it in from the side (does that repo already have history?)17:12
krotscheckclarkb: Ok, so a good thing to note for guinea pig v217:12
openstackgerritAishwarya Thangappa proposed a change to openstack-infra/storyboard: Added a subscription_events table & subscription hander  https://review.openstack.org/11301617:12
clarkbthis is probably a bad guinea pig17:12
clarkbnibalizer: krotscheck: is there divergent history in that repo now? I am assuming yes for things like .gitreview files17:14
nibalizeryea the whole history of the subtree was replayed on top of .gitreview and a testing rakefile17:14
clarkbnibalizer: :(17:15
nibalizerclarkb: why does divergent history matter ?17:15
*** praneshp has quit IRC17:15
clarkbnibalizer: because I thought the process we agreed on, was filter branch out a module into a standaloen repo, put that in gerrit, setup infra/config to use that repo and remove the in tree version.17:16
clarkbnibalizer: can't do that with puppet-storyboard without forcing everyone to git reset --hard17:16
nibalizerclarkb: i dont think we're communicating17:16
clarkbnibalizer: we can still do the above process with storyboard17:17
nibalizerso i split out the storyboard module17:17
clarkbnibalizer: doing so will force anyone with puppet-storyboard clone to git reset --hard17:17
krotscheckclarkb: Oh, that’s not what’s going on. We started with a clean repo, added .gitreview and Rakefile, and then applied all the subtree patches against it.17:17
clarkbkrotscheck: right which is the wrong way to do it17:17
nibalizerand resubmitted all those commits against puppet-storyboard17:17
clarkbkrotscheck: we have never split repos that way17:17
nibalizerit doesn't require anyone to reset --hard17:17
clarkbnibalizer: the process I describe does17:18
clarkbnibalizer: I don'twant to do what you did to every one of our modules17:18
krotscheckclarkb: Why would that require a reset —hard? Everything’s in there, we’re not rewriting the history17:18
clarkbnibalizer: the review overhead is too high17:18
fungicorrecting it to preserve the original history from the config repo at this stage will cause people who cloned the previous state of the puppet-storyboard repo to need to reset17:18
nibalizerwell its all code thats already been accepted it17:18
anteayajeblair: I think you have done all the steps but I don't think https://review.openstack.org/#/c/105860/ will merge quickly, so many in the check queue17:18
nibalizerthe current state of the puppet-storyboard repo only has a .gitreview file in it17:18
clarkbnibalizer: right, which is why I just want ot push it into the repo with the original history17:18
*** yamahata has quit IRC17:18
anteayajeblair: and it is before lunch17:18
nibalizerokay, so how do you want it to be done17:18
nibalizerclarkb: okay17:19
anteayajeblair: well except the email, I haven't seen it in my inbox yet17:19
nibalizerbut i dont have those acls, so i did what I could17:19
clarkbnibalizer: you do have the ability to do this17:19
clarkbnibalizer: let me describe the process17:19
*** amotoki has quit IRC17:19
nibalizerokay please do17:19
nibalizerbecause im not understanding it17:19
nibalizerespecially around the 'push it into' part17:19
clarkbnibalizer: git filter branch module out of infra/config into a standalone repo with NO history changed. Do not rebase .gitreview under this repo17:20
afshafffungi: the gotcha with what I'm trying to do is that I'm trying to pass parameters into an !include tag so that it can dynamically figure out what filename it needs to include17:20
clarkbnibalizer: add this repo to gerrit using jeepyb and review.projects.yaml. If you point the upstream at this standalone repo it will be imported into gerrit as is17:20
fungiafshaff: oh... where !include is a yaml directive not a jjb templating expansion17:20
jeblairanteaya: waiting for ci-docs to run to publish the docs change17:21
fungiafshaff: right, i think that's probably going to get ugly. instead we put shell blobs like that in self-contained builder macros and then call those from a template's builders list17:21
clarkbnibalizer: at this point you have the repo in git with all of its existing history unchanged. Once that is done you update infra/config to consume that repo and git rm the modules from ifnra/config to preserve the history of the delete in infra/config17:21
clarkbnibalizer: then you put .gitreview in the module repo on top of the existing history17:21
anteayajeblair: ah yes17:21
nibalizerso use the 'upstream' keyword ?17:21
fungiafshaff: and you could certainly use parameters to select a particular builder that way17:21
clarkbnibalizer: yes17:21
nibalizerand a github repo or something as an intermediary17:22
*** Ajaeger1 has joined #openstack-infra17:22
krotscheckclarkb: So how would we do that if the repo already exists?17:22
krotscheckclarkb: i.e. it was already created without an upstream in review.projects.yaml17:22
clarkbnibalizer: its too late to do that now for puppet storyboard. So an infra root can do it manually, however it is too late to do that for this repo without forcing everyone who has cloned it to git reset --hard17:22
*** praneshp has joined #openstack-infra17:22
nibalizerokay well we can do that for all the other ones17:22
fungiclarkb: well, technically...17:23
fungiclarkb: we can pull the filtered repo into a clone of the current one as a local branch, merge from it into master and then force-push that so it's ff-able17:23
*** mpaolino has quit IRC17:23
clarkbfungi: I think that is more work than just reviewing those changes17:23
fungiclarkb: agreed. thus the "technically" ;)17:24
clarkbmy concern is that I actually want to do the above process with our guinea pig17:24
nibalizeralso those changes were already reviewed17:24
*** vermarah has quit IRC17:24
clarkbnibalizer: no they werent17:24
krotscheckclarkb fungi: it’s an option to keep in mind if this happens again though.17:24
clarkbnibalizer: the rebasing stuff under them makes gerrit treat them as different17:24
clarkbnibalizer: I get that the patches were reviewed but I still have to review them17:24
nibalizerokay17:24
nibalizerwell thats gonna be a giant pain17:24
nibalizeralso17:24
nibalizerif you have any feedback, thats not really the place to provide it17:24
clarkbwhy not? its a new repo?17:25
nibalizerso the act of viewing and reading and commenting doesn't make sense17:25
clarkbit totally does17:25
nibalizeron commit 7 out of 15?17:25
clarkbsure17:25
* krotscheck only really wants the puppet module to get used so he can get rabbit onto storyboard before he leaves on vacation.17:25
clarkbthe key thing is we ditched history17:25
clarkbso the new history is udner review and scrutiny imo17:25
nibalizerthe history is copied17:26
nibalizerkrotcheck is still the author17:26
nibalizerim just the comitter on most of those17:26
clarkbnibalizer: I understand17:26
nibalizerclarkb: the way i see it is you're being inconsistent17:26
clarkbnibalizer: but from a git/gerrit perspective its fresh unreviewed changes17:26
*** markmc has quit IRC17:27
*** arosen1 has joined #openstack-infra17:27
*** arosen1 is now known as arosen-home17:27
nibalizerthey way you want to do this, huck it all in with a shovel, gives no opportunity for code review. but now you're saying that you want to rigourously review and ask for changes on the storyboard history17:27
clarkbso if we are building a new history in review making changes is fair game17:27
fungithis is, for example, similar to cherry-picked backports between projects or between branches... we re-review those17:27
clarkbI am not saying that will happen just that I don't have an issue with it17:27
afshafffungi: I started playing around with the builder macros, and I guess my hope was to have each {repo}'s build script in a separate file. But if I had one large yaml file in the config directory, I could put all of my per-repo build scripts as builder macros in that file and then just use template variables normally to select the correct builder? It sounds like that is what you're suggesting17:27
clarkbnibalizer: the other way preserves exactly the tree that was reviewed previously17:27
clarkbnibalizer: there is nothing to rereview in that case17:27
funginibalizer: most of the issue is that the git shas change, so there's no way to be *sure* they're identical without a fair amount of extra effort17:28
nibalizerso what is the difference between that three and this tree17:28
krotscheckclarkb: not necessarily, since once you pull things into a separate independent repo the owner has the power to rewrite all kinds of things in the history.17:28
clarkbnibalizer: the difference is you put stuff under the tree17:28
nibalizerfungi: the git shas change under subtree and and filter branch too17:28
jesusaurusit sounds like the storyboard module is not a very good guinea pig because it already exists as its own project17:28
clarkbjesusaurus: right17:28
clarkbjesusaurus: and thats all I am really saying17:29
funginibalizer: yep, but it's one command anyone can run on their local clone of the tree to compare, and the resulting shas should match17:29
*** amcrn has quit IRC17:29
* krotscheck patiently waits for the argument to settle so we can get back to getting rabbit onto storyboard.17:30
nibalizerhaha17:30
clarkbnibalizer: krotscheck: I think we live with puppet-storyboard as is, the new code gets reviewed and we moev on17:30
fungiit's also a lot faster for the original proposal than trying to hunt down the specific patches which made up those files17:30
clarkbnibalizer: krotscheck but we don't treat this as a guinea pig for the process17:30
clarkbbecause this will be a snowflake17:30
nibalizerokay17:30
*** cwchang has joined #openstack-infra17:30
jeblairclarkb: yeah, i'm pretty sure we agreed on that at the meeting where we discussed this.17:30
nibalizerwe can use github and the 'upstream' keyword on the next one17:30
*** AlexF has quit IRC17:31
cwchangclarkb: I17:31
clarkbjeblair: oh I thought in the last meeting we said this was the one17:31
*** Ryan_Lane has quit IRC17:31
nibalizerjeblair: i think i had a different plan than you all did, and we didn't discuss in great enough detail to make that clear17:31
jeblairnope, here's the process described in detail, as it should be, in the spec: https://review.openstack.org/#/c/99990/2/specs/puppet-modules.rst17:32
jeblairthat's clearly not the the process for storyboard, since it already exists17:32
cwchangclarkb: hi, i have cleaned up the source repository for https://review.openstack.org/#/c/102662/17:32
jeblairwhat we discussed in the meeting was basically "stabilize it in-tree, port all the changes to the external tree, switch"17:32
krotscheckOk, sooooooo about that review chain for puppet-storyboard? https://review.openstack.org/#/c/100370/ :D17:33
nibalizerah oaky well my bad, sorry guys17:33
openstackgerritA change was merged to openstack/requirements: Add oslo.serialization to projects.txt  https://review.openstack.org/11299317:33
openstackgerritOscar Romero (homeless) proposed a change to openstack-infra/jeepyb: Fix close_pull_requests from jeepyb  https://review.openstack.org/11359817:33
clarkbcwchang: great, just remove your WIP vote when you are ready for it to be reviewed17:33
jeblairkrotscheck: yes, so let's proceed with the move to the module, and discuss and agree on the procedure for future extractions in the spec review17:33
jeblairclarkb, nibalizer: ^17:33
clarkb++17:34
jesusaurusjeblair: ++17:35
nibalizer++17:35
cwchangclarkb: are we still waiting on waiting for fungi's https://review.openstack.org/#/c/103355/15  to resolve conflict ?17:36
clarkbcwchang: that change merged, but your change was in enough of a holding pattern that we didn't push a rebase17:36
fungicwchang: it merged a week ago17:36
jeblairclarkb, fungi, nibalizer, jesusaurus: who's reviewing the puppet-storboard series?17:37
*** e0ne has joined #openstack-infra17:38
clarkbcwchang: it may actually not need a rebase, but it would be nice to remove the redundant github-org field17:38
*** atiwari has joined #openstack-infra17:38
clarkbjeblair: I was willing to review it17:38
nibalizerI submitted it, so generally I wouldn't be reviewing it17:38
clarkbjeblair: I reviewed a few of the original patches infra/config side17:38
jeblairclarkb: okay; i'm going to do a cursory review and +2 it; it sounds like the +3 is up to you.17:39
nibalizeri also want to apologize for getting a little heated up there ^^ it comes down to i didn't read the spec very closely and now i feel like an idiot :/17:39
*** hdd has quit IRC17:39
clarkbjeblair: wfm17:39
clarkbjeblair: if you are reviewing things the grenade sideways changes are all up17:40
clarkbI think sdague is happy with them now too so ready to go17:40
cwchangclarkb: how do I remove WIP vote and "githu-org" ?17:40
jeblairclarkb: ok thanks.  i'm not quite there yet but will try to soon.17:40
*** ramashri has quit IRC17:40
clarkbcwchang: you have to push a new patchset to update the projects.yaml file to remove that line. To remove the WIP vote you need to comment on the change and set your vote to 0 instead of -1 work in progress.17:41
Ajaeger1Alex_Gaynor, dhellmann or any other requirements core: Please approve https://review.openstack.org/#/c/113080/ to unbreak the requirements post job. It has already two +2s.17:41
dhellmannAjaeger1: +2a17:42
*** ramashri has joined #openstack-infra17:42
Ajaeger1dhellmann: Thanks!17:42
krotscheckclarkb jeblair: Everything up to the rabbitmq patch is old history. Anything after that needs a real review.17:42
clarkbkrotscheck: thanks17:44
*** pelix has quit IRC17:44
*** e0ne has quit IRC17:44
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Adding Rakefile  https://review.openstack.org/10037017:45
jeblairkrotscheck: why no default for $rabbitmq_user_password in application.pp?17:45
jeblair(there is one for mysql password)17:46
clarkbjeblair: I made a comment about that. not having a default forces you to provide a value17:46
cwchangclarkb: I looked at my project.yaml file section for puppet-n1k-vsm... right now the github-org says stackforge. I am seeing openstack openstack-dev openstack-infra for different values..17:47
clarkbjeblair: that is better than possibly setting a public password imo17:47
clarkbcwchang: if you update to the latest version of that fiel you will see they have been removed17:47
cwchangclarkb: which should be the right value there  ?17:47
jeblairclarkb: okay, it's an unexplained pattern break though.17:47
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Add Storyboard puppet module  https://review.openstack.org/10032117:47
cwchangclarkb: aha17:47
*** tonytan4ever has joined #openstack-infra17:47
jeblairclarkb: and the default invocation of it provides a default17:48
jeblairclarkb: it's starting to look like an omission17:48
*** linkid has left #openstack-infra17:48
tonytan4everHi all, I am trying to store contact information for my openstack account, and I cannot.17:48
clarkbnibalizer: ^ this is why it is hard to review :)17:49
jeblairclarkb: also, i don't see your comment on it17:49
tonytan4evercan somebody help me with that ? It prevents me from submitting PR17:49
clarkbjeblair: its on the infra/config change17:49
clarkbtonytan4ever: have you joined the openstack foundation17:49
jeblairoh, i thought this was the first new change17:49
clarkbtonytan4ever: doing so is a requirement17:49
clarkbjeblair: I think it is new in that the infra/config change did not merge17:49
clarkbjeblair: but it has been reviewed over there17:49
tonytan4everI don't recall that. How can I join ?17:49
jrollcan I please bug a devstack core to take a look at these two reviews? trying to get check jobs going for a new ironic driver. :) https://review.openstack.org/#/c/112095/ and https://review.openstack.org/#/c/108457/17:50
jeblairclarkb: it appears to be under a different change id17:50
nibalizerclarkb: sure, and the next one will be slurped in17:50
nibalizermy bad17:50
*** annegent_ has quit IRC17:50
clarkbjeblair: yes, now you know why I was a bit confused earlier :)17:50
clarkbtonytan4ever: https://wiki.openstack.org/wiki/How_To_Contribute#If_you.27re_a_developer describes the process17:50
*** radez is now known as radez_g0n317:51
jeblairclarkb, krotscheck: okay, we landed https://review.openstack.org/113616 which is what we agreed on at the meeting; i think we're doing the cutover now, so i am going to -2 infra/config changes to the storyboard module17:51
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Added Authorization Header flag to storyboard module  https://review.openstack.org/10032217:51
jeblairclarkb: can you port your comments over to the new repo?17:51
clarkbjeblair: sure17:52
krotscheckjeblair: I think I already abandoned those.17:53
*** amcrn has joined #openstack-infra17:53
jeblairkrotscheck: you did indeed17:53
jeblairthanks17:54
*** chuckC has joined #openstack-infra17:54
*** annegent_ has joined #openstack-infra17:54
*** erlon has quit IRC17:55
*** Alec-A2 has quit IRC17:55
*** portante has quit IRC17:55
*** annegen__ has joined #openstack-infra17:55
*** erlon has joined #openstack-infra17:56
*** Alec-A2 has joined #openstack-infra17:56
jeblairclarkb: ah, it's unset because you asked that it be.  we now have contradictory -1s.17:56
*** flwang_ has joined #openstack-infra17:56
clarkbjeblair: yes17:56
*** esker has joined #openstack-infra17:56
clarkbjeblair: I want there to be no default password17:56
tonytan4everclarkb: I registered to openstack foundation, and it still don't work for me.17:56
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Make storyboard run over ssl  https://review.openstack.org/10032317:56
*** radez_g0n3 is now known as radez17:56
clarkbtonytan4ever: you need to ensure that your email address in your foundation profile matches your address in gerrit17:56
clarkbtonytan4ever: that is the key used to match entries17:57
jeblairclarkb, krotscheck: i'm okay with the 'leave unset to avoid a default password' pattern.  however, i think it should be a real pattern applied everywhere.  i'd recommend we reinstate the default password for rabbitmq, and then do a new change that does that comprehensively.17:57
clarkbjeblair: the problem with default passwords is you say "changeme" but nothing enforces that. Not having a password does enforce the value be set17:57
*** bhuvan_ has joined #openstack-infra17:57
jeblairclarkb: yep.  i'm cool with that. but just dropping that one instance of it does not actually accomplish the goal, and i would rather not fool ourselves into thinking we have.17:58
clarkbjeblair: ok17:58
jeblairclarkb: (specifically because the very invocation of it within the module supplies a default, so most users will never notice that)17:58
clarkbjeblair: I think I did mention consistency in my comments too saying I didn't expect tis to happen in that change17:58
jeblairwoo, we actually agree :)17:58
*** datsun180b has quit IRC17:59
tonytan4everclarkb: OK. tried with the correct email addres and it worked. Thanks.17:59
clarkbtonytan4ever: great17:59
*** annegent_ has quit IRC17:59
*** arnaud has quit IRC17:59
*** e0ne has joined #openstack-infra17:59
*** ociuhandu has quit IRC17:59
*** flwang_ has quit IRC18:00
*** bhuvan has quit IRC18:01
clarkbkrotscheck: nibalizer in https://review.openstack.org/#/c/100325/7 where does the superusersfile come from?18:01
*** maxbit has quit IRC18:01
*** maxbit has joined #openstack-infra18:01
*** shayneburgess has joined #openstack-infra18:01
clarkbI guess that is just a utility change to allow you to hcange it18:01
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Load storyboard projects from projects.yaml  https://review.openstack.org/10032418:02
*** portante has joined #openstack-infra18:02
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Load storyboard superusers from yaml file  https://review.openstack.org/10032518:03
*** hdd has joined #openstack-infra18:04
mriedemwhat is this new 'toggle ci' button?18:06
openstackgerritA change was merged to openstack-infra/config: Add CI results table to Gerrit  https://review.openstack.org/10586018:07
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Storyboard token expiration increased  https://review.openstack.org/10032618:07
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Make storyboard idempotent  https://review.openstack.org/10032718:07
*** andreykurilin_ has quit IRC18:08
jeblairmriedem: it hides the results from third-party ci systems18:08
clarkbmriedem: its js to filter out CI comments so that reviewers can focus on human interaction. It will still give you a handy collapsed set of info from ci18:08
fungimriedem: also, you are very quick to notice changes ;)18:08
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Put a default section header above the TTL  https://review.openstack.org/10032818:08
*** jistr has quit IRC18:08
openstackgerritA change was merged to openstack-infra/puppet-storyboard: StoryBoard module bounces apache on update  https://review.openstack.org/10032918:08
reedwhat a week!18:08
mriedemfungi: when did it show up?18:08
*** yfried has joined #openstack-infra18:08
jeblairclarkb, fungi: should we change 'Jenkins' to 'OpenStack CI', or add 'Jenkins' as a special case to the ci results table?18:09
fungijeblair: i think maybe first the second, then second the first (adter some warning)18:09
*** pblaho has quit IRC18:09
fungis/adter/after?18:09
fungigah, fingers no tyep gud18:09
clarkbya I think we want to be OpenStack CI eventually but doing so right now might cause confusion18:10
clarkbso second then first seems good18:11
krotscheckclarkb: puppet:///modules/openstack_project/storyboard/superusers.yaml18:11
fungibasically lots of people, myself included) have that name hard-coded in personal places18:11
clarkbkrotscheck: gotcha thanks18:11
clarkbfungi: jeblair I haev held 1450575 in an effort to debug dfw centos618:12
fungi(mail filters particularly)18:12
krotscheckclarkb: Also, that was moved in the big refactor into being a standalone class.18:12
clarkbit is still running a test though I think18:12
jeblairoh, actually we don't need to special case it...18:13
fungioh?18:13
jeblairwe only need to do that if we want its comments hidden; it shows up in the table based on whether it has matching result comments18:13
fungitrue. i assumed you meant to be able to hide its comments18:13
fungibut perhaps we just announce that we'll rename it at a certain date/time and live with that until18:14
jeblairi thought it was more urgent (i thought we were about to hide the comments from it and _not_ display the results in the table)18:14
clarkbkrotscheck: ya thats the change I am reviewing now18:14
clarkbkrotscheck: it is big18:14
clarkbjeblair: oh :)18:14
clarkbthat would be bad18:15
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Special case 'Jenkins' in hideci.  https://review.openstack.org/11398418:15
jeblairbut i don't think that's the case18:15
jeblairanyway, there's the change if we want to go ahead and do it.18:15
fungiclarkb: so... on the snapshots front we only have two each showing in nova image-list for bare-centos6, bare precise and bare-trusty within rax-dfw. if it's using an old snapshot it's not one the api is telling us exists18:17
clarkbfungi: shiny18:17
clarkbfungi: so maybe a hypervisor cache is biting us18:18
fungiclarkb: right, doesn't rule that out obviously18:18
clarkbfungi: the node I held looks fine though.. at least from a which yum front and uname -a18:18
* clarkb looks at pep8 script18:18
fungibut this means we want to see if we can dig up enough detail on each instance where a failure was observed and see whether phschwartz can map them to a common compute node18:18
clarkbrun-pep8.sh looks good too18:19
*** dims_ has quit IRC18:19
fungii'll fish instance uuids out of the nodepool logs for these nodes18:19
*** dims_ has joined #openstack-infra18:19
krotscheckclarkb: Yeah, well, I felt it was necessary once putting it on puppetforge became a possibility :)18:19
jesusaurusclarkb: fungi: jeblair: feel like giving https://review.openstack.org/#/c/111600/ a quick review? it has 2 +2s18:20
clarkbfungi: ok18:20
jeblairanteaya: the 3rd party docs update has been published; sending email now18:20
*** dims_ has quit IRC18:21
*** Alexei_987 has joined #openstack-infra18:21
clarkbjesusaurus: I think they already have timestamps, unless we are providing a different logging config. that could explain it18:21
fungijesusaurus: at the risk of asking a stupid question, why is that needed? i see timestamps on our nodepool logs18:21
fungijinx18:21
*** dims has joined #openstack-infra18:21
* fungi looks at the logging config18:22
fungiyep18:22
fungi[formatter_simple]18:22
fungiformat=%(asctime)s %(levelname)s %(name)s: %(message)s18:22
*** _nadya_ has joined #openstack-infra18:22
fungithat a'splains it18:22
*** hashar has joined #openstack-infra18:22
jeblairi believe these are for cases that aren't handled by that18:22
clarkbya18:22
fungiagreed18:23
openstackgerritChingWei Chang proposed a change to openstack-infra/config: new project puppet-n1k-vsm creation  https://review.openstack.org/10266218:23
jeblairfor nodepoold, if there is no logging config file, this sets the default18:23
jeblairfor nodepool commands, there is no logging config, so it always applies there18:23
fungiseems like a sane enough default behavior too18:23
jeblairi wonder though if it should not match what we have configured?18:23
*** krotscheck has left #openstack-infra18:23
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Modularized StoryBoard Module  https://review.openstack.org/11372418:23
*** krotscheck has joined #openstack-infra18:24
jeblairi think ours is a more typical python log line18:24
fungijeblair: yeah, would allow us to remove out formatter sections too possiblt18:24
fungimy t key is in a gravity well today or something18:24
*** krotscheck has quit IRC18:24
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Fixed location of storyboard configuration file  https://review.openstack.org/11372518:24
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Create storyboard configuration directory  https://review.openstack.org/11372618:25
*** krotscheck has joined #openstack-infra18:25
clarkbwe lost krotscheck, I have ogtten through the storyboard changes up to the rabbitmq change18:25
clarkbnow to review the zuul trigger change18:25
*** _nadya_ has quit IRC18:26
jeblairwhat's this? http://puppetboard.openstack.org/node/ipa.openstack.org18:26
*** arnaud has joined #openstack-infra18:26
clarkbI do not know18:27
krotscheckI’m back!18:27
fungii can log into it18:27
clarkbit is a thing18:27
fungiup 38 days18:27
clarkbkrotscheck: got through the storyboard stack18:27
clarkbkrotscheck: up to the rabbitmq change18:27
krotscheckclarkb: Saw that, thanks :)18:27
*** otherwiseguy has quit IRC18:27
*** imeerovi has quit IRC18:28
fungirunning fedora 2018:28
fungisomething testing ironic python agent?18:28
jesusaurusclarkb: fungi: yeah, it adds timestamps to the default format rather than requiring a logging config on the system to manage that18:28
krotscheckclarkb: Ok, so we’re going to set a default password, and then add a patch later?18:28
clarkbkrotscheck: ya18:28
jeblairthere is a command in root's bash history on ci-puppetmaster to create it18:28
krotscheckkk18:28
krotscheckon it18:28
fungimordred has been ssh'ing into it a bunch18:29
clarkbkrotscheck: that way the module is internally consistent18:29
fungiback on july 618:29
clarkblooks like when it was booted?18:29
fungiyeah18:29
fungiperhaps its name stands for internet protocol ale. it's been fermenting for over a month now18:30
jeblairmordred: care to share?18:30
krotscheckclarkb jeblair: Default applied. I also have a few other things I want to land in there, so I’ll handle the default password change while I’m in there.18:32
*** dims_ has joined #openstack-infra18:32
*** tonytan_brb has joined #openstack-infra18:32
*** praneshp_ has joined #openstack-infra18:33
*** pcm__ has joined #openstack-infra18:34
jeblairi'm going to restart gerrit now to pick up the hideci changes18:34
*** rakhmerov_ has joined #openstack-infra18:34
*** rakhmerov has quit IRC18:34
*** miqui_ has joined #openstack-infra18:34
*** froek_ has joined #openstack-infra18:35
*** tonytan_brb has quit IRC18:36
*** julim_ has joined #openstack-infra18:36
jeblairdone.  check out https://review.openstack.org/#/c/112733/418:36
krotscheckclarkb: For some reason melody is now blocking port 29418 (gerrit)18:36
*** Hefeweiz1n has joined #openstack-infra18:36
jeblairkrotscheck: can you provide more context?18:37
*** rakhmerov_ is now known as rakhmerov18:37
fungiclarkb: what was the centos6 dfw bug number?18:38
*** dustins_ has joined #openstack-infra18:38
clarkbfungi: I don't remember but can look for it18:39
fungiclarkb: no worries, i'll find it18:39
krotscheckjeblair: Sorry, it’s an in-hp-office only thing. Probably not relevant to this channel.18:39
*** dmsimard_ has joined #openstack-infra18:40
clarkbkrotscheck: talk to chris18:40
clarkbhe sits on the south corner of the building near yazz iirc18:40
jeblairkrotscheck: ok.  though, double check -- it's an interesting coincidence that you reported that right as i was restarting gerrit.  :)18:40
krotscheckclarkb: Already did, things have been fixed.18:40
krotscheckOh!18:40
krotscheckWell then18:40
krotscheckThat was probably why18:40
*** portante_ has joined #openstack-infra18:40
*** arnaud has quit IRC18:41
*** tonytan4ever has quit IRC18:41
*** praneshp has quit IRC18:41
*** dustins has quit IRC18:41
*** julim has quit IRC18:41
*** dmsimard has quit IRC18:41
*** froek has quit IRC18:41
*** dims has quit IRC18:41
*** portante has quit IRC18:41
*** pcm_ has quit IRC18:41
*** openstackgerrit has quit IRC18:41
*** miqui has quit IRC18:41
*** mrodden has quit IRC18:41
*** Hefeweizen has quit IRC18:41
*** timrc has quit IRC18:41
*** praneshp_ is now known as praneshp18:41
*** dmsimard_ is now known as dmsimard18:41
*** froek_ is now known as froek18:41
fungiclarkb: for reference, bug 135590718:41
uvirtbotLaunchpad bug 1355907 in openstack-ci ""sudo: yum: command not found" in py26 jobs (bare-centos6-rax* nodes)" [Undecided,New] https://launchpad.net/bugs/135590718:41
clarkbjeblair: toggling works!18:42
*** mrodden has joined #openstack-infra18:42
clarkbjeblair: I assume we don't see a summary of the various third party CIs because they don't follow the report comment format?18:42
pleia2jeblair: neat18:42
clarkbjeblair: on that change you linked specifically18:42
russellbso that must be new?18:43
*** timrc has joined #openstack-infra18:43
russellbjust saw it, cool :)18:43
*** sabeen3 has joined #openstack-infra18:43
clarkboh wait their it is18:43
clarkbI was looking in the wrong place18:43
clarkbso shiny18:43
*** sabeen1 has quit IRC18:44
clarkbjeblair: your special case jenkins change lgtm18:44
fungiclarkb: and also bug 135482918:45
uvirtbotLaunchpad bug 1354829 in tempest ""sudo: 3 incorrect password attempts" in host setup" [Undecided,Invalid] https://launchpad.net/bugs/135482918:45
clarkbfungi: thanks18:45
clarkbfungi: do you want me to keep the centos6 node i haev held? I will delete it shortly if not18:45
clarkbfungi: I don't think it has much info to give us18:45
*** hashar has quit IRC18:46
fungiclarkb: probably not. it seems holding a random node there only tells us it's not all nodes in that region18:46
clarkbfungi: ya18:46
dansmithjeblair: dare I ask the chance of seeing that on the new review format view? :)18:47
*** jistr has joined #openstack-infra18:47
*** openstackgerrit has joined #openstack-infra18:50
clarkbdansmith: I think you just need to do a conditional switch in the js based on which page it is loaded in, then toggle the correct objects18:50
clarkbdansmith: but I know little of js in browsers18:50
phschwartzfungi: If you can get me a list of uuid's I can look up info on them18:50
jeblairdansmith: it's supposed to; if it isn't showing up it's a bug18:51
fungiphschwartz: yep, assembling that now18:51
clarkbphschwartz: fungi: 9351cb5a-f399-4788-9809-e10d35921d0b is a uuid of a good node18:51
dansmithjeblair: lemme make sure I'm not caching18:51
clarkbjeblair: dansmith though you may need to hard refresh18:51
phschwartzfungi: and sorry for a delay, I went to get lunch :)18:51
dansmithjeblair: yeah, there it is18:51
dansmithjeblair: if you were here, I'd hug you inappropriately18:52
clarkbphschwartz: I should do that too. I still have left over pulled pork18:52
fungiphschwartz: i do that sometimes too--don't apologize! ;)18:52
clarkbbeen eating it for 3 days now18:52
clarkbdansmith: woah there18:52
phschwartzclarkb: I wish I had pulled pork. lol. I was lazy and ran to Chipotle18:52
russellbdansmith: and you wonder why i'm against so many meetups18:52
dansmithrussellb: heh18:52
jeblairdansmith: thanks :)  we should also thank Radoslav Gerganov <rgerganov@vmware.com> who wrote the toggle button (i just did the table)18:53
*** hashar has joined #openstack-infra18:54
*** krotscheck has quit IRC18:54
fungiphschwartz: so... here's the list of instance uuids i see associated with bug 1355167 and the approximate dates/times they were booted... http://paste.openstack.org/show/9455318:54
uvirtbotLaunchpad bug 1355167 in openstack-ci "run-pep8.sh usage now being output" [Critical,In progress] https://launchpad.net/bugs/135516718:54
fungiphschwartz: if my theory is correct, we can repeat it with the couple other bugs i think might have a similar underlying cause18:54
dansmithjeblair: cool, yeah, awesome to see this evolution18:54
*** krotscheck has joined #openstack-infra18:55
*** _nadya_ has joined #openstack-infra18:55
*** tonytan4ever has joined #openstack-infra18:56
clarkbjeblair: the zuul trigger tests are in a separate test file and class :)18:56
jeblairclarkb: neat huh? :) (thanks!)18:57
fungiclarkb: i'm assuming that's because emacs threw an error about the old file containing too many lines18:57
jeblairfungi: on the contrary, i seem to be the only one who doesn't mind 10,000 line files :)18:57
fungiheh18:57
*** mmaglana_ has quit IRC18:58
clarkbfungi: 10k line files is how emacs gets to eight megs and counting18:59
clarkbjeblair: note I am reviewing these two chanes with a bit of last nights context missing as I wasn't quite able to follow the entire discussion19:01
*** ildikov has joined #openstack-infra19:02
phschwartzfungi: so it looks like for most of those the last update of the image in glance was on the 9th or 10th19:03
phschwartzhmm, that is interesting considering the instances where on the 7th.19:03
phschwartzI think nodepool created new images from an older bad image19:04
fungiphschwartz: for a little background, we're seeing random instances boot from snapshots containing files which shouldn't have been in that state for more than a week prior19:04
phschwartzThat would be all that I could think of. Used the one on the 7th to create a new image that was used for the next couple of days19:04
phschwartzhmm19:05
fungiphschwartz: did they all boot on the same nova compute host by any chance?19:05
phschwartzsec19:05
fungiphschwartz: basically none of the snapshots we see in nova image-list are old enough to have contained those files, and most instances booted from them in that region have the correct (newer) contents19:06
phschwartzso far no, they look like different computes in different cells19:06
clarkbbut they also do weird tings like not have yum in /usr/bin19:06
fungiclarkb: yeah, that first uuid list was only for the ones which hit outdated run-pep8.sh contents19:07
fungii was going to do separate lists for the other two possibly related bugs in case they're actually separate problems/causes19:08
*** ildikov has quit IRC19:08
fungithe pep8 one was just a fairly obvious first case because it's a smaller list and it's really got to be something causing an old version of that file to exist19:08
*** dmsimard has quit IRC19:10
*** ildikov has joined #openstack-infra19:10
phschwartzAll of the uuid's in that list span 3 cells and no 2 are on the same compute19:11
*** dmsimard_away has joined #openstack-infra19:11
*** dmsimard_away has quit IRC19:11
phschwartzAnd all apear to be spawned from a different image ref id19:11
*** dmsimard_away has joined #openstack-infra19:12
*** dmsimard_away is now known as dmsimard19:12
phschwartzLet me look closer at glance19:13
clarkbjeblair: zuul changes reviewed. -1 is not for the break thing, it is for the unnecessary trigger method19:13
*** emagana has quit IRC19:13
clarkbjeblair: fungi: going to find food now. then hopefully back into reviews (I feel productive ish today19:14
*** emagana has joined #openstack-infra19:14
clarkbfungi: I have marked my held node for deletion19:14
jrollianw, jeblair, can I bug y'all to take a look at these two reviews? trying to get check jobs going for the ironic-python-agent driver. :) https://review.openstack.org/#/c/112095/ and https://review.openstack.org/#/c/108457/19:15
*** yamamoto has quit IRC19:17
clarkbjeblair: pleia2: are we happy enough with the solution for local accounts to demo pootle 2.6.0-rc1? pleia2 have you run into any more problems?19:17
clarkbjeblair: pleia2: mostly asking because i can change the DNS records to point at the new host if we are happy with it19:18
fungiphschwartz: yeah, some of those were booted from precise snapshots and some from trusty snapshots, so wouldn't all be from the same snapshot19:18
*** emagana has quit IRC19:18
phschwartzeven if for 2 that were both precise, they were different image id's so looks like different snapshots19:19
fungiphschwartz: but the only explanation i can reasonably imagine for the errors we saw on them is that they were booted from older snapshots than we requested through the nova api, and in fact snapshots that we couldn't even see in nova image-list at all19:19
phschwartzI have asked one of our glance devs to take a look with me as it looks correct and like there shouldn't have been an issue19:19
mordredjeblair: that was me poking at freeipa - can be deleted - sorry, meant to clean that up a while ago19:20
*** ociuhandu has joined #openstack-infra19:23
*** oanufriev has joined #openstack-infra19:24
*** esker has quit IRC19:25
pleia2clarkb: I think we're good to go, the only way to add more admins is by manual mysql update, right?19:25
*** vhoward has joined #openstack-infra19:25
*** esker has joined #openstack-infra19:25
*** e0ne has quit IRC19:25
*** med_ has quit IRC19:26
fungiphschwartz: so just to double-check assumptions... the one which we saw today for instance 97078adc-8020-4ae5-b896-81548d323c4c should have been booted from image 98f9aff3-699f-4c33-a163-b41b8dc5483c19:26
clarkbpleia2: ya, or I can add them on the command line if I register them. imo best to just have people sign up and I can toggle teh db19:26
pleia2clarkb: I'll need dwayne and daisy to have admin accounts, but they're both vacationing this week and our demo is sunday night our time19:26
clarkbpleia2: so let me know if you need that done19:26
*** daya_k has quit IRC19:27
clarkbpleia2: all infra rooters have access to the machine too and can update accounts_user set is_superuser=1 where id=X; or some such to do it19:27
phschwartzfungi: and according to the logs and statistics it was built from that image.19:27
pleia2ok, I'll email them both now to create accounts so hopefully they can get it done at a sane US time19:27
clarkbpleia2: thanks19:28
pleia2hmm, my calendar invite is not right, this should actually be monday night19:29
fungiphschwartz: and yet our logs indicate it booted with a file on it which was more than a week older content than other instances booted from that same snapshot19:30
*** radez is now known as radez_g0n319:30
*** esker has quit IRC19:30
*** armax has quit IRC19:31
fungiphschwartz: and so far the only common thread between the failures matching this pattern is that we only see them in dfw (equivalent systems in iad and ord don't exhibit this behavior)19:31
mordredfungi: wow. the issue you are looking in to and the scrollback on it is ... fascinating19:31
*** e0ne has joined #openstack-infra19:31
fungimordred: several seemingly disconnected bugs about files on nodepool nodes in states they should not be in, but all happening only in dfw. very odd indeed19:32
clarkband across node types19:32
clarkbso no single image build on our side is to blame19:32
fungiright, seen do far on bare-centos6, bare-precise and bare-trusty19:32
fungier, so far19:33
*** dtantsur is now known as dtantsur|afk19:33
phschwartzfungi: are the images that the uuid's are built off of not displaying in the image-list?19:33
openstackgerritA change was merged to openstack-infra/config: Add neutron full job to integrated gate  https://review.openstack.org/11356219:33
*** portante_ is now known as portante19:34
fungiphschwartz: the images we expect them to be booted from display in image-list, but every so often the instances have filesystem content inconsistent with what is on those images19:34
*** shashankhegde has quit IRC19:34
fungiphschwartz: observed so far: 1. some have a week-old copy of the run-pep8.sh script which we install on the snapshot, 2. some fail to be able to sudo as a user who is listed in the sudoers file on the snapshot, 3. some claim yum/rpm aren't installed19:36
fungiphschwartz: all happening infrequently but for roughly a week as far as we can tell, and only in dfw19:36
krotschecknibalizer: I did a recheck no bug on https://review.openstack.org/#/c/113731/ and it passed19:36
openstackgerritA change was merged to openstack-infra/gitdm: Add Louis Taylor to HP  https://review.openstack.org/11387319:39
*** e0ne has quit IRC19:39
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Templatize puppet projects in layout.yaml  https://review.openstack.org/11400119:41
*** marun has quit IRC19:41
*** Ryan_Lane has joined #openstack-infra19:43
clarkbactually I think for the afternoon I will be testing the non oslo prefixed projects on trusty and doing more tox 1.7.2 testing19:43
clarkbso that I am ready for next week19:43
fungiclarkb: a great idea19:43
clarkbbut do point out things that need review and I can context switch will I wait for tox to do its thing19:43
*** gema_ has joined #openstack-infra19:44
phschwartzfungi: ok, no answer yet and not sure how long it would be. We are pulling in a wider group of people to look at and discuss the issue19:44
clarkbfungi: phschwartz: would it maybe help on our end if we deleted all of our dfw images and just start over?19:45
anteayajeblair: k, thanks19:45
clarkbfungi: phschwartz then if it happens we have a pretty good idea of where it could be beraking19:45
fungiphschwartz: understood. we're in no real hurry, it's just a very perplexing set of symptoms and seems like something you (rackspace) should be aware of since it likely has wider implications than just our tenant19:45
phschwartzfungi: are you able to provide a break down for each of the uuid's that have an issue including which image id was given to build it from.19:45
phschwartzfungi: That is our exact concern that it might be a wider issue.19:46
phschwartzclarkb: that is an option to see if it corrects the issue, but not sure if you want to take the delay in check/gating to let it work19:46
fungiphschwartz: mapping them back to image uuids will be harder. getting the instance uuids is something i can repeat fairly easily for the other two presumed related bugs19:47
*** gema has quit IRC19:47
clarkbphschwartz: ya it will render dfw unusable for us for about an hour19:47
clarkbphschwartz: but if it helps debug that might be good?19:47
clarkbfungi: jeblair ^19:47
fungiimage uuid mapping isn't something we explicitly record, so would require time series analysis comparing our image update logs with our node management logs19:47
openstackgerritMonty Taylor proposed a change to openstack-infra/storyboard: Add loader subcommand to sync from launchpad  https://review.openstack.org/11362419:48
*** krtaylor has joined #openstack-infra19:48
anteayaand yay!! it looks great19:48
jeblairclarkb: why will it render dfw unusable?19:49
clarkbjeblair: because we won't have any images there19:49
jeblairoh, didn't read back far enough; you're asking about deleting images19:49
clarkbjeblair: yup. Basically start from a clean slate so that we have a bit more known data19:49
*** shayneburgess has left #openstack-infra19:50
phschwartzclarkb: it would provide a good baseline to see if it happens again or if it was just a fluke when we were having load that caused it19:50
phschwartzI am a little weired out that it is only one region though19:50
jeblairclarkb, fungi: dfw provides such a small portion of our nodes currently, i think that would be fine19:50
jeblair(side question, i wonder why?)19:51
jeblairgah, because i mistyped the command :)19:51
fungiseems we've all come down with the typing flu today19:52
openstackgerritChristian Fetzer proposed a change to openstack-infra/jenkins-job-builder: Add support for the Jenkins Valgrind publisher plugin.  https://review.openstack.org/11311719:52
clarkbmy typing driver is buggy19:52
* mordred no typie goood19:52
jeblairit would have an impact, but oh well, we should do all we can to debug anyway19:52
*** andreaf_ has joined #openstack-infra19:53
jeblairclarkb: can we do one image at a time?19:53
jeblairwhich images are affected?19:53
*** andreaf_ is now known as andreaf19:53
clarkbjeblair: so far bare-* are known affected19:53
fungijeblair: so far we have bugs impacting at least bare-centos6, bare-precise and bare-trusty19:53
jeblairclarkb: so could we drop all the bare images first but leave devstack?19:53
*** lsell has joined #openstack-infra19:53
clarkbjeblair: ya we could do that19:53
jeblairthen when bare have rebuilt, drop devstack?19:53
jeblairthat way we maintain the capacity19:54
clarkbwfm19:54
*** otherwiseguy has joined #openstack-infra19:54
phschwartz++19:54
anteayajeblair: +1 and a suggestion on https://review.openstack.org/#/c/113984/ the special case hideci regex for Jenkins19:54
clarkbok I can go ahead and do that now19:54
jeblairclarkb: cool19:54
*** shashankhegde has joined #openstack-infra19:54
clarkbstarting with bare-* on rax-dfw19:54
mordredanteaya: what does your suggestion mean? I don't follow the sentence?19:55
lselldoes anyone have a few minutes to help me with a mailing list issue?19:55
*** achuprin has joined #openstack-infra19:55
fungilsell: sure--which mailing list?19:56
mordredlsell: what sort of issue?19:56
lsellgreat thank you. there's an email sitting in moderation for the user-committee list19:56
lsellbut tim bell and ryan lane are the only ones with credentials19:56
fungilsell: if it's for the user-committee ml, i reset the admin password earlier today and sent it to fifieldt19:56
fungilsell: ahh, yep19:56
mordredjeblair: any reason I should hold back on +A'ing the hideci change?19:56
lsellah, great, we must have missed each other in time zones19:56
clarkbok all three deleted and new images building19:56
Ryan_Laneisviridov: I don't have them19:56
Ryan_Lanewell, I have some, but they don't work19:56
lsellryan_lane: that was going to be my next message :)19:57
Ryan_Lanethere's a global mailman password19:57
clarkbRyan_Lane: that is supposed to be changed :)19:57
*** flwang_ has joined #openstack-infra19:57
Ryan_LaneI'm not actually on the user committee anymore19:57
Ryan_LaneI sent in a resignation a few weeks ago19:57
openstackgerritSalvatore Orlando proposed a change to openstack-infra/config: Make neutron full job voting (neutron gate only)  https://review.openstack.org/8828919:57
clarkbya19:57
*** andreaf has quit IRC19:57
clarkbRyan_Lane: we miss you19:57
Ryan_Lane:)19:57
fungiRyan_Lane: and we're all sorry to see you go too--it was such great help!19:58
clarkbok now really I am eating lunch19:58
Ryan_Lanethinking of help, I should probably upgrade the wiki soon19:58
fungilsell: anyway, did you need the pw for it too, or just wait until fifieldt is awake and let him handle it?19:58
lsellfungi: i would prefer to get the email out sooner if possible, because i want to make people aware of a meeting happening tomorrow, so yes...19:59
anteayamordred: my suggestion means that some third party ci accounts have wanted to use the word Jenkins in their name20:00
lsellRyan_Lane: thank you also for checking it out earlier, I appreciate it!20:00
fungilsell: or i can pop in and moderate it in the interim. i'll see if that works real quick20:00
anteayamordred: as a preventative step, I suggest including the comment to ensure it is clear that the Jenkins regex applies to OpenStack Infra only20:01
jeblairmordred: no reason not to merge it20:01
*** annegen__ has quit IRC20:01
mordredanteaya: ah, nod20:01
*** flwang_ has quit IRC20:01
*** andreaf has joined #openstack-infra20:02
*** unicell has quit IRC20:02
*** baoli has quit IRC20:02
fungilsell: i just released a message from chris kemp. there are others waiting but i think they're all spam unless i skimmed over one20:02
lsellfungi: thank you!! that's the one. it's also a meeting I'd love for you to join, although i know it's late your time20:03
fungilsell: i'll see what i can arrange!20:03
*** dustins_ has quit IRC20:04
*** _nadya_ has quit IRC20:04
*** armax has joined #openstack-infra20:04
*** sabeen has joined #openstack-infra20:04
*** amcrn has quit IRC20:05
*** _nadya_ has joined #openstack-infra20:05
*** sabeen3 has quit IRC20:05
fungijeblair: mordred: clarkb: some/all of you may be interested in joining http://lists.openstack.org/pipermail/user-committee/2014-August/000265.html for the same reasons20:05
fungi(we do, sometimes, make use of an openstack cloud or two)20:06
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Templatize puppet projects in layout.yaml  https://review.openstack.org/11400120:06
*** gema_ has quit IRC20:07
*** hashar has quit IRC20:08
clarkbI can attend20:08
nibalizerkrotscheck: awesome!20:08
*** gema has joined #openstack-infra20:08
*** baoli has joined #openstack-infra20:08
nibalizeri'll remove my workflow -120:08
*** _nadya_ has quit IRC20:08
clarkbis it something I call into?20:09
fungiclarkb: i haven't figured out what a meetingburner is yet, so no idea20:09
fungimight be some sort of corporateyness20:09
*** marun has joined #openstack-infra20:10
fungiclarkb: ahh, yep, after registering for the meeting it gives you the dial-in info20:11
openstackgerritA change was merged to openstack-infra/config: Special case 'Jenkins' in hideci.  https://review.openstack.org/11398420:11
*** emagana has joined #openstack-infra20:13
*** jistr has quit IRC20:16
*** pdmars has quit IRC20:16
*** pdmars has joined #openstack-infra20:16
*** gema_ has joined #openstack-infra20:17
*** cwchang has quit IRC20:19
marcusvrnHey guys, now I'm facing some troubles trying to run a job on jenkins slave....I'm trying to build the dsvm-tempest tests, but it's returning20:19
marcusvrnJob timeout set to: 135 minutes20:19
marcusvrn17:17:06 Traceback (most recent call last):20:19
marcusvrn17:17:06   File "./test-matrix.py", line 21, in <module>20:19
marcusvrn17:17:06     import yaml20:19
marcusvrn17:17:06 ImportError: No module named yaml20:19
anteayamarcusvrn: do you know how to use paste.openstack.org?20:19
marcusvrnnope20:19
anteayahttp://paste.openstack.org/20:20
marcusvrnhmmmm!!! awesome! thx and sry for the paste here20:20
*** gema has quit IRC20:20
anteayanp20:20
anteayathanks for listening20:20
*** e0ne has joined #openstack-infra20:21
krotscheckLooking for reviews on switching the StoryBoard puppet module that we just landed. https://review.openstack.org/#/c/113731/20:22
marcusvrnhttp://paste.openstack.org/show/94599/20:23
*** yamamoto has joined #openstack-infra20:24
*** gondoi is now known as zz_gondoi20:27
*** julim_ has quit IRC20:28
*** yamamoto has quit IRC20:29
*** gema has joined #openstack-infra20:31
marcusvrnAnd my jenkins slave is not synchronized with the jenkins server...Is this a problem?20:32
marcusvrnI mean, time synchronization20:33
*** gema_ has quit IRC20:34
*** AlexF has joined #openstack-infra20:34
anteayamarcusvrn: looks like you are missing yaml20:35
*** pdmars has quit IRC20:37
openstackgerritEoghan Glynn proposed a change to openstack-infra/config: Revert "Temporarily ignore Ceilometer Python 2.6 job"  https://review.openstack.org/11401820:37
*** crc32 has joined #openstack-infra20:37
fungiphschwartz: so here's a breakdown of the instances where we saw odd, potentially related behavior, all of which has been isolated to dfw... http://paste.openstack.org/show/9461620:38
*** e0ne has quit IRC20:39
marcusvrnanteaya: I installed it and now I'm trying again :)20:40
*** maxbit_ has joined #openstack-infra20:41
anteayamarcusvrn: great20:41
*** Ajaeger1 has quit IRC20:42
*** mmaglana has joined #openstack-infra20:44
*** datsun180b has joined #openstack-infra20:44
*** maxbit has quit IRC20:45
fungijeblair: did the ci table and toggle get reverted? i don't see them in gerrit now...20:45
anteayafungi: I confirm20:46
anteayaperhaps the regex change did something other than we expected?20:46
*** gema_ has joined #openstack-infra20:47
*** stevemar has quit IRC20:47
*** dkranz has quit IRC20:48
*** annegent_ has joined #openstack-infra20:49
lifelessmordred: has your haveged fix landed?20:49
*** AlexF has quit IRC20:49
*** datsun180b has quit IRC20:50
*** annegent_ has quit IRC20:50
fungilifeless: yep, as of 02:25 utc20:50
*** gema has quit IRC20:51
fungicentos/fedora slaves built from today's nodepool images (jobs started after ~1500 utc) should have it enabled20:51
lifelessfungi: thanks! rechecking https://review.openstack.org/#/c/80449/20:51
*** stevebaker has quit IRC20:52
*** stevebaker has joined #openstack-infra20:52
*** gema has joined #openstack-infra20:54
SergeyLukjanovfungi, jeblair, looks like I should send note re gerrit maintenance this weekend to the ML?20:55
clarkbfungi: wait we reverted the ci stuff?20:55
openstackgerritMatthew Treinish proposed a change to openstack-infra/config: Make acls for QA program projects consistent  https://review.openstack.org/11402420:56
anteayaclarkb: I think the hideci patch might have broken it20:56
*** marun has quit IRC20:56
mtreinishjogo: ^^^ that should take care of most of what we discussed the other day20:56
mtreinishalthough I think bits of it require manual intervention20:56
mtreinishwhich I outlined in the commit msg20:56
*** gema_ has quit IRC20:57
clarkbbare-trusty in rax-dfw is the last one we are waiting on. as soon as it goes ready I will delete the other images there20:57
clarkbanteaya: the jenkins one? it should require a gerrit restart to pull that in20:57
fungiSergeyLukjanov: that would be helpful, yes20:57
clarkb++20:58
SergeyLukjanovfungi, ack, I'll do it20:58
*** lsell has left #openstack-infra20:58
clarkbfungi: jeblair I haev held 1453997 for trusty and tox testing20:58
*** yamamoto has joined #openstack-infra20:59
*** dprince has quit IRC21:00
clarkbdhellmann: I am testing taskflow, stevedore, and pbr now with trusty for unitests, docs, and pep8. And will check them against new tox21:01
clarkbdhellmann: are there any others under the oslo umbrella not named oslo*?21:02
*** emagana has quit IRC21:02
*** emagana has joined #openstack-infra21:02
*** ominakov has quit IRC21:03
dims_clarkb: pycadf, cliff21:03
clarkbdims_: thanks21:03
*** gema_ has joined #openstack-infra21:04
clarkbarg the node i held apparently raced a delete and got deleted. hodling a different node now21:06
*** miqui_ is now known as miqui21:06
clarkbholding 1454425 now21:06
clarkbjeblair: did you see the comments on the zuul changes?21:07
*** gema has quit IRC21:07
*** dkliban is now known as dkliban_afk21:08
*** e0ne has joined #openstack-infra21:08
*** achuprin has quit IRC21:09
*** _nadya_ has joined #openstack-infra21:09
*** aysyd has quit IRC21:11
jeblairclarkb, fungi: it seems that if the hideci file changes, gerrit needs to be restarted21:11
jeblairthe cache-busting token it appends to the url seems to break it21:11
*** Alex_Gaynor_ has joined #openstack-infra21:11
jeblairrestarting gerrit now21:11
clarkbkk21:12
*** a2hill has joined #openstack-infra21:12
*** zz_johnthetubagu has quit IRC21:12
*** Alexei_987 has quit IRC21:12
*** bookwar has quit IRC21:12
*** ptoohill has quit IRC21:12
*** medieval1 has quit IRC21:12
*** Svedrin has quit IRC21:12
*** rfolco has quit IRC21:12
*** Alex_Gaynor has quit IRC21:12
*** IAX has quit IRC21:12
krotscheckGerrit went down! The sky is falling!21:12
krotscheck:D21:12
*** IAX has joined #openstack-infra21:12
*** krtaylor has quit IRC21:13
*** YorikSar has quit IRC21:13
*** fifieldt has quit IRC21:13
*** changbl has quit IRC21:13
*** mancdaz has quit IRC21:13
*** Alex_Gaynor_ is now known as Alex_Gaynor21:13
*** medieval1 has joined #openstack-infra21:13
*** rfolco has joined #openstack-infra21:13
*** krtaylor has joined #openstack-infra21:13
*** bookwar has joined #openstack-infra21:13
*** fifieldt has joined #openstack-infra21:13
krotscheckclarkb: I went ahead and made that change y’all asked fro on https://review.openstack.org/#/c/113935/ - was there anything else?21:13
jeblairkrotscheck: i really appreciate that when you couldn't connect to gerrit, you assumed the network was broken.  :)  that sort of thing makes my inner sysadmin happy.21:14
*** YorikSar has joined #openstack-infra21:14
*** changbl has joined #openstack-infra21:14
*** mancdaz has joined #openstack-infra21:14
krotscheckjeblair: When in doubt, blame IT :)21:14
*** hdd has quit IRC21:14
jeblairclarkb, fungi: hideci is back21:14
jeblairand hiding jenkins now21:14
*** zz_johnthetubagu has joined #openstack-infra21:15
*** zz_johnthetubagu is now known as johnthetubaguy21:15
openstackgerritKhai Do proposed a change to openstack-infra/zuul: add support for draft-published event  https://review.openstack.org/9226821:15
krotschecknibalizer: I21:15
krotscheckArgh21:15
*** Alexei_987 has joined #openstack-infra21:15
*** Svedrin has joined #openstack-infra21:15
*** mfer has quit IRC21:16
clarkbkrotscheck: looks like we figured out how to remove admin perms?21:16
krotschecknibalizer: I’m trying to figure out a dependency chain in puppet-storyboard. Basically, if the user doesn’t configure an SSL certificate, it tries to use snakeoil, but that requires Apache, which creates a loop :/21:16
*** amcrn has joined #openstack-infra21:16
clarkbnibalizer: puppet question. If you ensure a package is absent but that package does not exist at all on a distro will puppet complain?21:16
nibalizerrequires the apache class?21:16
*** e0ne has quit IRC21:16
krotschecknibalizer: yep. I’m pondering just getting rid of the default ssl install in the first place.21:17
*** marun has joined #openstack-infra21:17
nibalizerclarkb: well i just tested it21:17
nibalizerand it is fine with ensuring absent on a package that doesn't exist21:17
nibalizerim not sure that question implies you're writing good code21:17
krotscheckclarkb: Context?21:17
*** yamamoto has quit IRC21:18
nibalizerkrotscheck: ya writing modules with multiple entry points and pivoted use cases is really hard (TM)21:18
clarkbkrotscheck: that rabbitmq user21:18
clarkbnibalizer: it doesn't and the change has been -1'd for other reasons21:18
clarkbnibalizer: 11388421:18
ianwany feelings on https://review.openstack.org/#/c/113884/2 <- (Not use firewalld on the jenkins slaves) .  turns out current libvirt runs ~18x slower with firewalld21:19
clarkbdtroyer: jeblair ianw 113884 will probably interest you as devstack cores21:19
clarkbianw: yup that is the one I just -1'd21:19
ianwclarkb: heh :)21:19
clarkbianw: devstack should fix it and not the underlying base image so that individuals using devstack get the same fix21:19
krotscheckclarkb: Yeah, took me a while to get it set up, but it appears that the admin flag is really only useful if accessing using rabbitmqadmin and rabbitmq web manager21:19
clarkbianw: is it sufficient to have devstack stop firewalld?21:20
clarkbor can we configure libvirt to use iptables instead?21:20
*** arnaud__ has joined #openstack-infra21:20
fungiclarkb: any more, i just tend to always have http://git.openstack.org/cgit/openstack/governance/tree/reference/programs.yaml up somewhere as a reference21:20
jeblairclarkb: i agree that would be the most desirable route21:20
openstackgerritSteve Baker proposed a change to openstack-infra/config: Define check-heat-dsvm-functional job  https://review.openstack.org/11108721:21
ianwclarkb: afazekas proposed that, have to find the review.  eharney made the point that disabling firewall on a developers box isn't great21:21
clarkbianw: we already do all kinds of terrible with devstack21:21
clarkbeverything from git reset --hard to installing all the things21:21
ianwhttps://review.openstack.org/#/c/113856/21:21
clarkbif devstack can't fix this then we should use slow firewalld imo21:22
clarkbianw: we are very careful to not encode devstack bug fixes in our images21:22
ianwclarkb: the problem is it is so slow that it causes the f20 tests to timeout in the gate21:22
nibalizeroh my goodness, the ci report at the top is sooooo gooooooo21:22
clarkbianw: right, and that bug exists for all people doing devstack + firewalld21:23
ianw(btw, i haven't 100% confirmed that ... last night .au time daniel suggested this is the issue)21:23
clarkbianw: so we need to fix it for them too21:23
jeblairSergeyLukjanov: i just sent mail to jraim asking about kite.21:23
SergeyLukjanovjeblair, okay, if he'll confirm, I'll add kite to renaming21:24
*** denis_makogon has quit IRC21:24
clarkbianw: ideally we would be able to tell libvirt to not use firewalld and leave the service running21:24
ianwclarkb: agree; but declaring shields down unconditionally may not be great.  so will 1) confirm firewalld off speeds things up and 2) think more about how we can disable it safely21:24
jeblairclarkb, ianw: yeah, i mean, devstack _takes over_ the box.  afaic there is no assumption that the box should do anything other than what devstack says.  sudo... etc.21:24
clarkbianw: but it doesn't appear that libvirt supports this?21:25
ianwclarkb: can't say off the top of my head if libvirt can ignore firewalld.  will investigate21:25
dtroyerHonestly I'm find with dumping it, it isn't the first time we've removed stuff to keep things working.  Is it an issue on all platforms?21:26
dtroyerfirewalld ^^^21:26
clarkb113733 is also interesting21:26
clarkbjeblair: fungi ^21:26
clarkbdtroyer: yes, it is an issue between libvirt and firewalld so would affect all platforms21:27
clarkbdtroyer: we just don't use firewalld anywhere else21:27
clarkb(I think firewalld must be default on fedora?)21:27
dtroyerso how about a conditional that True in d-g and not otherwise?21:27
ianwcheck-tempest-dsvm-f20 SUCCESS in 29m 29s (non-voting)21:27
jeblairclarkb: is the statsd thing urgent?21:27
dtroyerwe have soooo mant of those already, I know21:28
ianwthat is i think significantly faster than other changes21:28
clarkbjeblair: no, just an interesting thing21:28
ianwcheck-tempest-dsvm-f20SUCCESS in 1h 03m 55s (non-voting)21:28
phschwartzclarkb: did you clear the images in dfw?21:28
ianw^ yep21:28
jeblairclarkb: yes.  it's not a good change.  but i'd like to prioritize reviewing it appropriately.21:28
clarkbjeblair: ok21:28
openstackgerritA change was merged to openstack-infra/config: Make py33 job running only for Ceilometer master branch  https://review.openstack.org/11384221:28
clarkbphschwartz: I did but only for the bare-* images21:28
* jeblair thinks all changes are interesting21:28
clarkbphschwartz: those images are all ready so I am going to delete the devstack images now21:29
phschwartzclarkb: k, let me know if we see anything similar to before21:29
anteayajust for info, this table is missing results from 4 CI systems: https://review.openstack.org/#/c/96630/21:30
anteayaanyone have any thoughts as to why that might be?21:30
*** annegent_ has joined #openstack-infra21:32
anteayaopen contrail, hyper v, Artista, plumgrid, nuage, so 521:32
*** annegent_ has quit IRC21:32
clarkbanteaya: to be in the table they need to follow the same report comment format as jenkins21:32
openstackgerritSalvatore Orlando proposed a change to openstack-infra/config: Make neutron full job voting  https://review.openstack.org/8828921:32
fungiphschwartz: it's worth noting that we were already expiring images there ~every 48 hours as we built new snapshots to replace them and rotated them to backup status21:33
openstackgerritJoel Coffman proposed a change to openstack/requirements: Add pykmip  https://review.openstack.org/11403721:33
clarkbok all remaining images in rax-dfw are being rebuilt21:34
jeblairclarkb, ianw: responded on https://review.openstack.org/#/c/113856/21:34
krotscheckI don’t suppose there’s an infra-core available to assist me with getting the new rabbitmq patch for storyboard not only landed, but onto storyboard.o.o using the new puppet module? Before, I join mordred in the desert and Ish__ disappears back to her grad program.21:34
clarkbjeblair: thanks21:35
clarkbkrotscheck: sure21:35
krotscheckclarkb: THANK YOU21:35
fungikrotscheck: oh, are you on you going to go be a burnout? exciting!21:35
*** zengyunling__ has joined #openstack-infra21:35
anteayaclarkb: ah, hmmmm21:35
clarkbkrotscheck: so what needs to be done? we need to approve the change to the module, and approve a chaneg to the infra/config repo that switches to using the module?21:35
* anteaya toggles ci21:35
clarkbkrotscheck: I have the first chaneg open, is the second laying around somewhere21:36
krotscheckclarkb: Three things....21:36
mordredkrotscheck: Ish__ is going back to gradschool? that's terrible21:36
krotscheckmordred: She is! She couldn’t get her department to sign off on another internship waiver because of their own stupid policies, so she’s gone next thursday21:37
krotscheckclarkb: https://review.openstack.org/#/c/113731/21:37
anteayahmmm so they need log ip Success|Failure in time elapsed21:37
mordredkrotscheck: blech21:37
krotscheckmordred: No kidding :/21:37
SergeyLukjanovjeblair, fungi, clarkb, etherpad for upcoming renaming - https://etherpad.openstack.org/p/repo-renaming-2014-08-1621:37
krotscheckmordred: It’s one of those immigration things.21:37
krotscheckclarkb: 2 is this one: https://review.openstack.org/#/c/113935/21:38
mordredkrotscheck: sigh21:38
krotscheckAnd then 3 is sortof like the first one, except that the sha hash needs to be updated.21:38
krotscheckclarkb: Let me put the 3rd together for you.21:38
*** ling-yun-1 has quit IRC21:38
clarkbkrotscheck: why don't we combine 1 and 3?21:38
clarkbkrotscheck: or do you prefer switching to it nowwithout rabbitmq?21:38
clarkbthen adding rabbitmq?21:39
krotscheckclarkb: Because I’d like to break one thing at a time.21:39
clarkbkrotscheck: thats fair21:39
ianwdtroyer: i agree with FIREWALLD_DISABLE ; because this is supposed to be fixed in f21.  so when we transition later we can just drop that flag and stay closer to what the distro is shipping21:40
openstackgerritCedric Brandily proposed a change to openstack-infra/git-review: test  https://review.openstack.org/11403821:40
ianwnot sure if the affects centos7...21:40
openstackgerritKhai Do proposed a change to openstack-infra/zuul: add support for draft-published event  https://review.openstack.org/9226821:41
*** emagana has quit IRC21:42
openstackgerritKhai Do proposed a change to openstack-infra/zuul: add support for draft-published event  https://review.openstack.org/9226821:42
*** emagana has joined #openstack-infra21:43
*** arosen-home has quit IRC21:43
clarkbkrotscheck: ok, first thing to break is approved21:43
clarkbkrotscheck: I am going to review rabbitmq change now as that can be approved independently21:43
dtroyerianw: BTW, I amended that comment to add this should be in tools/fixup_stuff.sh21:43
krotscheckclarkb: yay!21:43
*** emagana has quit IRC21:43
SergeyLukjanovfungi, thx for note re kite21:44
*** emagana has joined #openstack-infra21:44
jeblairdtroyer: i'd rather the gate behavior be the default behavior21:44
fungiSergeyLukjanov: i also slightly tweaked the mysql command, though i cleared the authorship colors again after i did21:44
openstackgerritCedric Brandily proposed a change to openstack-infra/git-review: test  https://review.openstack.org/11403821:44
jeblairdtroyer: i'm getting really frustrated with people thinking the gate is something special they can't replicate; we really should just "run devstack"21:44
dtroyerjeblair: I think I'm neutral here which should be the default on this21:45
SergeyLukjanovfungi, I've right simple py script to generate commands21:45
SergeyLukjanovfungi, yup, I see the changes21:45
jeblairdtroyer: i'm totally cool with there being different ways of running it (postgres/mysql) but not so much (work/not work) :)21:45
ianwdtroyer: question i'm asking is what happens if you remove firewalld on a fresh install anyway ... does it even have default rules setup?21:45
ianw(booting rax f20 image to confirm)21:46
phschwartzjeblair: is there a rest service as part of zuul currently? I haven't dug threw it all to see.21:46
*** hdd has joined #openstack-infra21:46
*** hdd has quit IRC21:46
*** krtaylor has quit IRC21:46
*** crc32 has quit IRC21:47
jeblairphschwartz: there's a really simple webserver which we can continue to abuse (or even improve and turn it into a webservice);  i think jhesketh may have a change outstanding that does some of that.21:47
fungiphschwartz: there's a status json dataset you can retrieve from it, other than that just the gearman queues (you can connect and issue admin commands) and some rpc client examples in the command-line utilities21:47
*** bhuvan_ is now known as bhuvan21:47
fungialso what jeblair said about patches welcome et cetera21:48
phschwartzjeblair: I will check with him when he is on tonight. I want to refine my github webhook more and it is better to do it over rest or create a separate running service that is21:48
phschwartza gearman client21:48
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Update storyboard version to include rabbitmq  https://review.openstack.org/11403921:48
dtroyerjeblair: agreed…I think devstack may rediscover some of the opinions it once had21:48
jeblairdtroyer: excellent :)21:49
clarkbkrotscheck: and now rabbitmq approved21:49
clarkbkrotscheck: so ready for third change whenever you are21:49
krotscheckclarkb: Awesome21:49
krotscheckclarkb: The patch is here https://review.openstack.org/114039 - but let’s wait to make sure that the first change lands.21:49
clarkbkrotscheck: rgr21:49
fungiphschwartz: right now the implemented zuul trigger examples are an internal periodic schedule and a stream event watcher for gerrit. if github has something stream-like you can use to watch for things like pull requests that might be the easiest to emulate21:50
jeblairphschwartz: i don't think it needs to be a separate service; but then, maybe it should be and so should all the other triggers :)21:50
clarkbkrotscheck: and I need to generate a rabbitmq password and put it in hiera21:50
openstackgerritA change was merged to openstack-infra/config: Use split-out storyboard module  https://review.openstack.org/11373121:50
krotscheckclarkb: Right!21:50
clarkbkrotscheck: any guidelines for that? random 32 char string good?21:50
openstackgerritA change was merged to openstack-infra/puppet-storyboard: Added RabbitMQ to StoryBoard  https://review.openstack.org/11393521:51
jeblairphschwartz: but i think the internal-only option is the way to go; i think an external process using gearman is a stretch for this and likely to bog us down21:51
krotscheckclarkb: I think rabbit only accepts passwords that have been blessed by the priests of hermes on a full moon.21:51
phschwartzfungi: I am not too keen on creating a poller to poll the github api (doing it currently, but it is not the best and the api key is only allowed a set number of polls per day)21:51
fungiphschwartz: yeah, that's why i suggested looking for stream-like interfaces21:51
krotscheckclarkb: (No clue. 32 character alphanumeric should be fine)21:51
SergeyLukjanovoh, my, I have ipv6 at home O_O21:51
fungiphschwartz: active notification channel of some sort from github perhaps?21:51
jeblairphschwartz, fungi: i don't think github has a streaming thing; i think instead we provide a url it hits.  so i think we could hook something into the existing webserver to receive those hits, then put them on an internal queue just like the gerrit trigger does21:51
*** jaypipes has joined #openstack-infra21:52
clarkbkrotscheck: I can turn on futurama when I generate the password (wait wrong hermes)21:52
*** ling-yun-1 has joined #openstack-infra21:52
phschwartzfungi: currently they offer webhooks for pr creation and merges and such or the api.21:52
clarkbjeblair: very similar to how jenkins callbacks worked21:52
fungiyeah, that's what i had in mind for a notification channel. is that what travis uses?21:52
jeblairphschwartz, fungi: (the stream-events processor in gerrit has a dedicated queue where it puts its events, then processes them and turns them into zuul events and puts them on the zuul event queue)21:52
jeblairclarkb: yep21:52
phschwartzjeblair: That is what I was thinking and why I was asking about a rest service as part of zuul21:52
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Corrections to the project renaming guide  https://review.openstack.org/11404121:53
ianwhttp://paste.openstack.org/show/94644/ <- i remember the days when a 163 lines of iptables rules wasn't the default21:53
anteayadougwig: hello, I see you created a third party system wiki page entitled Cisco Neutron CI, there is no account named Cisco Neutron CI: http://paste.openstack.org/show/94642/21:53
fungiwhile a "github bridge daemon" isn't something zuul should really grow, a rest api service which runs as a daemon and communicates events into zuul may not be a totally terrible idea21:53
SergeyLukjanovfungi, https://review.openstack.org/11404121:53
*** jaypipes has quit IRC21:53
anteayadougwig: can you shed some light on your choice? the wikipages are intended to map to third party ci accounts21:53
*** crc32 has joined #openstack-infra21:53
dougwigerr, wasn't it A10 Networks CI?21:54
jeblairfungi: yeah, i think that's where jhesketh wanted to head with that.  and i like it.21:54
anteayahttps://wiki.openstack.org/w/index.php?title=ThirdPartySystems&diff=0&oldid=5768321:54
fungiianw: you really need recalibrate your brain onto a logarithmic scale. this is openstack after all21:54
anteayais the Cisco change not you? dougwig?21:54
phschwartzfungi: That was my thought, either as part of zuul or a separate process that enqueues into zuul on request21:54
phschwartzI will takl with jhesketh tonight21:54
*** mmaglana has quit IRC21:55
*** zengyunling__ has quit IRC21:55
dougwigchecking history, i thought i just added a1021:55
dougwigthe way my day has been going though...21:55
dougwigit was dane that made the cisco change.21:56
fungiSergeyLukjanov: thanks!!!21:56
anteayadougwig: okay I am wrong21:56
anteayadougwig: thanks I will talk to dane21:56
dougwigno worries, thanks.  :)21:56
anteayaI don't seem him online21:56
anteayaI'll see if Henry knows where he is, thanks21:57
ianwfungi: after calibrating my brain to understand how ping packet got from a vm to the world and back with neutron, nothing much can surprise me :)21:57
marcusvrnanteaya: now...that problem was solved...but when run devstack, this error occurs: cannot stat `/opt/stack/new/tempest/nosetests*.xml': No such file or directory21:57
*** HenryG_ is now known as HenryG21:57
fungiianw: in a broader sense, this is the internet. most days i'm surprised any of it works AT ALL21:58
*** flwang_ has joined #openstack-infra21:58
fungipleasantly surprised, mind you21:58
ianwmarcusvrn: i think that's a red-herring, i always see that21:58
*** arosen1 has joined #openstack-infra21:58
*** mriedem has quit IRC21:58
dtroyerianw: funny, my default f20 image doesn't have firewalld, its based on the published F20 cloud image, not one from hpcloud or rax21:59
*** flaviof is now known as flaviof_zzz21:59
ianwdtroyer: yeah, i'm thinking that the rax image is the outlier with it turned on by default21:59
arosen1does log stash only go back ~11 days?21:59
fungidtroyer: ianw: i can hold an f20 devstack image and see what's installed, if that helps21:59
fungiianw: yes, rackspace still rolls their own i think. hpcloud seems to have switched over to using distro-provided cloud images instead22:00
fungiarosen1: approximately, i believe22:00
arosen1thx22:00
fungiarosen1: due to capacity issues, if memory serves22:01
arosen1makes sense.22:01
*** weshay has quit IRC22:01
fungiarosen1: yeah, the indexes take a crazy amount of space compared to the raw log data22:01
marcusvrnianw: but how can I make the dsvm-tempest-full complete with no errors?22:01
dtroyerfungi, ianw: so lets just fix it in fixup_stuff.sh and move on…22:01
fungidtroyer: seems like a pragmatic choice22:01
jeblairianw, dtroyer: if one of our providers is doing something that's not in the base os, i'm more open to fixing that in infra.  (though it still means people using that provider may hit a problem)22:01
ianwfungi: it's ok, i just booted one up.  for all the noise in http://paste.openstack.org/show/94644/ i think by default it's just allowing 5353 and ssh22:01
clarkbarosen1: we float around 3-5TB of index for 10 days22:01
jeblairnot trying to dissuade you -- just saying the hard line is softer in that case :)22:02
*** yamamoto has joined #openstack-infra22:02
dtroyerjeblair: either way, we already have a place to do this22:02
*** flwang_ has quit IRC22:02
jeblairwfm22:02
jeblairalso, soon we hope we will stop using provider-supplied images altogether22:02
dtroyer++++++22:03
fungiclarkb: hopefully the steadily falling log volume will allow us to scale logstash retention back out sometime soonish?22:03
clarkbfungi: ya22:03
*** emagana has quit IRC22:03
* jeblair just +2d change 46482 (Build images using diskimage-builder)22:03
clarkbfungi: though the window is much smaller so may not affect us greatly22:03
clarkbfungi: unless you mean we can use more volume on es?22:03
clarkbjeblair: nice!22:03
*** emagana has joined #openstack-infra22:03
fungiclarkb: well, that too22:03
fungiclarkb: when jhesketh's swift efforts finally pay off22:03
clarkbI should rereview that change then22:04
clarkbfungi: ya22:04
*** maxbit_ has quit IRC22:04
fungialso, afs22:04
HenryGanteaya: hi22:05
anteayahi22:05
clarkbfungi: tseting these things on trusty is so simple now that our scrpts don't need a ton of args22:05
anteayajeblair: so HenryG would like to discuss Cisco Unknown Function CI22:05
clarkbfungi: I am very happy you went and cleaned that up22:05
anteayaHenryG: what does this account verify?22:05
anteayaHenryG: do you know?22:05
fungiclarkb: meh. thank mordred. i was merely the (long-term) shepherd22:06
HenryGanteaya: Let me pick a neutron review to give you an idea ...22:06
fungihe was the one to start that change22:06
anteayaHenryG: thanks22:06
krotscheckclarkb: So… it looks like the SB module ran, but I don’t really know how frequently config is updated on puppetmaster.22:07
clarkbkrotscheck: every 15 minutes. I can check it directly22:07
fungikrotscheck: cron job every 15 minutes22:07
krotscheckclarkb fungi: Awesome, thanks.22:07
clarkbkrotscheck: module is installed in /etc/puppet/modules22:08
fungishould have run on the hour since the change merged before22:08
clarkbkrotscheck: it was installed at 2200 UTC. So any puppet run after that time will have used it22:08
clarkbkrotscheck: so check puppetboard and if green after 2200 we should be set22:08
clarkb(2200 was 8 minutes ago)22:08
krotscheckclarkb: That seems correct. http://puppetboard.openstack.org/report/storyboard.openstack.org/9a50d69fa201d25ff9b0b82eaf74b72640cfc38822:09
jeblairclarkb, fungi, krotscheck: puppet updates and runs are tied together now22:09
fungiyep22:09
jeblairclarkb, fungi, krotscheck: the cron job updates puppet, installs modules, then runs puppet22:09
clarkbjeblair: oh right22:09
clarkbperfect22:09
clarkbkrotscheck: so you ready for the next change?22:09
krotscheckNeat!22:09
HenryGanteaya: https://review.openstack.org/11375122:09
krotscheckYep!22:09
krotscheckLet’s kick the tires :)22:09
anteayaHenryG: great, so guide me to the salient points22:09
anteayaHenryG: what are you verifying with this account22:09
HenryGanteaya: Note that the bot reports itself as "Cisco Neutron CI". I'll get Dane to change that part soon.22:10
*** ominakov has joined #openstack-infra22:10
clarkbkrotscheck: what do you want to call the storyboard rabbitmq user?22:10
*** maxbit has joined #openstack-infra22:10
* clarkb grabs hiera data file lock22:10
*** Ryan_Lane has quit IRC22:11
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Add a Zuul trigger  https://review.openstack.org/11241122:11
krotscheckclarkb: Hrm… is there a convention? I like to use appname_servicename for my own things.22:11
anteayaHenryG: you can't22:11
krotscheckso storyboard_rabbit22:11
mattoliverauMorning22:11
jeblairit's our first rabbit deployment22:11
clarkbkrotscheck: looks like the mysql user is just 'storyboard'22:11
clarkbI am tempted to use tat22:11
HenryGanteaya: Oh. Sorry. Where is the name coming from?22:11
krotscheckI don’t see a reason why you shouldn't.22:12
anteayaHenryG: yes where is that name coming from22:12
anteayafungi: can you find out about Cisco Neutron CI and move it into the third party group?22:12
clarkbkrotscheck: thats the default too so I am going with it22:12
fungianteaya: sure... hunting22:13
HenryGanteaya: And it should be called "Cisco OpenStack CI"?22:13
clarkbok hiera lock released22:14
openstackgerritKhai Do proposed a change to openstack-infra/config: add a turbo hipster worker for testing  https://review.openstack.org/10733122:14
anteayaHenryG: ah we aren't going to be using OpenStack in third party CI names either22:15
fungianteaya: index account_id is 10192 fyi22:15
anteayaHenryG: so let's go back to what the account is verifying22:15
clarkbjeblair: fungi 114039 is the change krotscheck needs to complete this thing22:15
fungianteaya: no openid url, so we created it directly22:15
clarkbhiera data is in and change lgtm22:15
anteayaHenryG: I see a reference to nexus?22:15
anteayafungi: kk, thanks22:15
HenryGanteaya: Yes, there are (currently) five different jobs. All are triggered only on neutron changes.22:16
jeblairclarkb, nibalizer: can we put "latest" in as a value?22:16
jeblairclarkb: +322:16
anteayaHenryG: what are you verifying?22:16
anteayaHenryG: are you verifying that openstack works with a driver called nexus?22:17
jeblairclarkb, nibalizer, jesusaurus: because i think it would be nice to have all of our "internal" modules use the latest versions, with the option of pinning them to a specific version if we need to do some breaking changes22:17
fungianteaya: i've added them to the group... creation date on their account was february, so not sure how they got left out unless that was on the cusp of when we were removing them from the group to disable voting22:17
fungifeb 3, so maybe22:17
anteayafungi: thanks for fixing that22:17
HenryGanteaya: Sorry for being slow, I am trying to understand the question. Bear with me ...22:18
fungianteaya: what should they be renamed to, if anything?22:18
anteayaHenryG: okay so now your account is in the third party group, sorry it had been left out before, which is why I couldn't find it22:18
krotscheckclarkb: Thanks :)22:18
anteayaHenryG: np, I'm catching you by surprise22:18
*** shashankhegde has quit IRC22:18
anteayafungi: working on that22:18
krotscheckjeblair: I believe you can set “HEAD”, right?22:18
HenryGanteaya: So let's start with nexus (one of the current five jobs)22:18
clarkbjeblair: we can do 'master'22:18
anteayaHenryG: awesome so Cisco Nexus CI?22:18
krotscheckor that22:19
anteayaHenryG: can we live with that?22:19
HenryGanteaya: No22:19
anteayano22:19
*** dkranz has joined #openstack-infra22:19
* anteaya waits22:19
HenryGanteaya: Nexus is just one of the many products that is tested22:19
anteayaokay22:19
anteayawhat other products are tested?22:19
fungiHenryG: anteaya: and is there a common word which describes the class of things being tested?22:20
HenryGanteaya: For that job, neutron is configured with the ML2 mechanism driver for nexus, and the job is run on a system connected to a physical Nexus switch.22:20
fungi(e.g. not neutron, but what's being tested in interactions with neutron)22:20
HenryGanteaya: fungi: Anything wrong with "Cisco CI" ?22:20
nibalizerjeblair: not sure, would have to read insatll_modules.sh22:21
anteayaHenryG: yes22:21
nibalizerand after what bode did to it, its really hard to read22:21
anteayaHenryG: Cisco has more than one CI22:21
fungiHenryG: the chance that there's more than one department at cisco with their own separate ci testing things22:21
*** rwsu has quit IRC22:21
openstackgerritA change was merged to openstack-infra/config: Update storyboard version to include rabbitmq  https://review.openstack.org/11403922:21
anteayaHenryG: so we are talking about the Cisco Neutron CI account, yes? or the or the Cisco Unknown Function CI?22:22
*** jaypipes has joined #openstack-infra22:22
ianwdtroyer / jeblair : proposed removal in https://review.openstack.org/#/c/113856/22:22
*** dmsimard is now known as dmsimard_away22:22
HenryGanteaya: I have no idea what that last one is?22:23
krotscheckclarkb: Thanks :)22:23
fungianteaya: worth noting, "cisco unknown function ci" doesn't seem to have weighed in on any reviews ever? https://review.openstack.org/#/q/reviewer:%22Cisco+Unknown+Function+CI+%253Ccisco-openstack-ci%2540external.cisco.com%253E%22,n,z22:24
clarkbkrotscheck: that should update in about 7 minutes then run in about 1122:24
krotscheckclarkb: I’ll keep my eye on it, thanks :)22:24
anteayaHenryG: neither do we: http://paste.openstack.org/show/94672/22:24
anteayafungi: thanks22:24
fungianteaya: created back on november 522:25
anteayaawesome22:25
fungianteaya: associated with the cisco-openstack-ci@external.cisco.com address22:25
HenryGfungi: anteaya: It has the same username and email as the "normal" one22:26
anteayaHenryG: any chance you can find someone at cisco who can tell us we can disable this ci account?22:26
anteayaHenryG: we sure would appreciate an opportunity to clean up the cruft22:26
jeblairianw: lgtm, thx22:26
fungiHenryG: well, the ssh username on it is cisco-openstack-ci22:26
*** SumitNaiksatam has quit IRC22:27
sarobbrother can you spare a +2 https://review.openstack.org/#/c/112423/22:27
*** shashankhegde has joined #openstack-infra22:28
*** SumitNaiksatam has joined #openstack-infra22:28
fungisarob: you're not going to use it to buy booze are you?22:28
jeblairjhesketh: so i think on https://etherpad.openstack.org/p/cviAgfbKV6 the main difference between your suggestion and mine is whether in the layout the name of the source/trigger/reporter is the name of the connector (mine), or is the name of the driver with an additional field specifying the connector22:29
jeblair(yours)22:29
HenryGfungi: How is the "ssh username" related to the "ci account"? What is the unique identifier for a ci account?22:29
*** maxbit has quit IRC22:29
anteayaHenryG: the id number22:30
anteayaso 10192 and 927022:30
fungiHenryG: ssh username, e-mail addresses and account numeric id are all unique-ish (gerrit attempts to throw errors if they conflict anyway)22:31
HenryGanteaya: I don't see 10192 in your paste list?22:31
anteayabut ssh username can be edited and so can email address22:31
anteayaHenryG: right22:31
*** prad has quit IRC22:31
anteayasince it wasn't in the third party gerrit group when I created taht paste22:31
anteayafungi just added it22:31
anteayaHenryG: if you run ssh -p 29418 anteaya@review.openstack.org gerrit ls-members "Third-Party\ CI" --recursive22:32
anteayawith your username in place of mine22:32
anteayayou should see it in the list now22:32
*** crc32 has quit IRC22:33
HenryGanteaya: yes, I do22:34
anteayaHenryG: great22:34
reedis the PSTN number listed on https://wiki.openstack.org/wiki/Infrastructure/Conferencing still valid?22:34
anteayaso now it will show up as a member of the third party gerrit group, it had been missed previously, sorry about that22:34
jeblairreed: probably?  if it doesn't work, we may need to check on asterisk22:35
anteayaHenryG: so, homework, can you help us confirm we can deprecate the Cisco Unknown Function CI gerrit account?22:35
reedjeblair, I tried calling it but I had a 'busy' tone22:35
anteayaHenryG: and we have to think of a word taht isn't openstack or neutron that describes what your ci system is verifying22:35
fungireed: i get the same. maybe its account expired22:36
anteayaHenryG: do sleep on it and get back to me22:36
reedjeblair, not a priority22:36
*** rwsu has joined #openstack-infra22:36
fungireed: i hadn't tried it in a while, mainly due to lack of anyone expressing interest in using it at all22:36
reedI'll update the wiki page, mention that we need a maintainer22:36
jeblairreed: er22:36
jeblairnot sure we need a maintainer22:36
krotscheckclarkb: BOOM http://puppetboard.openstack.org/report/storyboard.openstack.org/3a110b645acc8951b782eecc8024fc62d58ce72b22:37
reedjeblair, yeah, wrong word...22:37
clarkbkrotscheck: and no red!22:37
anteayafungi: well the nova ml thread indicates that folks might like a higher bandwidth option for interactions22:37
HenryGanteaya: I will get sleep, but Dane won't. :)22:37
clarkbkrotscheck: I imagine you can confirm the new functionality is in storyboard now?22:37
anteayaso interest may be moving towards asterisk22:37
jeblairreed: i'm happy to help with it, and i think so is russelb... i think no one has noticed the problem because it hasn't been used lately22:37
anteayaHenryG: :D poor Dane22:37
krotscheckclarkb: Not yet - we didn’t want to land that patch until we had a working rabbit.22:37
jeblairrussellb even :)22:37
reedjeblair, I meant to say that we need to promote it22:37
fungianteaya: i was reading that into it as well... though "telepresence system" was mentioned... not quite the same thing as a conference call22:37
clarkbkrotscheck: gotcha22:37
ianwjeblair : mind having a look at https://review.openstack.org/#/c/111637/ (Exact match rhel6)  this is keeping centos7 images from working22:38
anteayafungi: true22:38
*** emagana has quit IRC22:38
russellbreed: jeblair yeah i'm happy to help fix stuff ... haven't used it myself in a long time, so didn't know it was busted22:38
anteayafungi: but perhaps the group doesn't know we did have asterisk up at one point22:38
fungianteaya: yep22:38
russellbmaybe file a bug and assign it to me?22:38
dhellmannclarkb: thanks, with the ones dims_ mentioned I think you have them all22:38
reedyeah22:38
krotscheckclarkb: Thanks for all your help :)22:38
russellbi don't mind being the primary maintainer22:38
anteayarussellb: what do you think, do you think folks might use if if they knew about it?22:38
*** emagana has joined #openstack-infra22:38
russellbjeblair and others have enough on their plate22:38
jeblairrussellb: yeah, i'm doing some quick triage22:39
russellbjeblair: k22:39
anteayarussellb: would you like to mention it on the thread and gauge interest?22:39
* russellb hasn't seen that thread22:39
reedmy main concern with Asterisk is that I don't have a SIP client, i'm too lazy to install stuff from extra ppa22:39
clarkbdhellmann: great22:39
russellbjeblair: maybe just msg or email your context if you don't resolve it and i can look tomorrow22:39
clarkbdhellmann: so far trusty looks safe (onto taskflow now)22:39
anteayarussellb: the nova core thread22:39
clarkbdhellmann: going to upgrade tox shortly and run through them again22:39
pleia2I often used the dial in number for it22:39
anteayarussellb: you have replied to it22:39
pleia2but I guess US-only :\22:40
anteayarussellb: discussion options to in person meetings22:40
russellbreed: guess we should document more clients that are easy to install from normal repos22:40
reedrussellb, if there are any... looks like the situation is pretty bad22:40
reedlike... bad22:40
russellbi think most people just use google hangouts for this sort of thing though22:40
clarkbubuntu comes with one right?22:40
*** dguerri`afk is now known as dguerri22:40
reedclarkb, nope22:40
russellbused to22:40
jeblairpleia2: we can add non-us numbers if there's an interest22:41
* fungi shudders22:41
clarkbI prefer using my phone for phone stuff22:41
jeblairpleia2: they cost a bit more money22:41
clarkbwhich makes me weird apparently22:41
russellbclarkb: yeah, same22:41
jeblairso i didn't want to add a bunch until we knew we needed them22:41
pleia2empathy does sip, in theory22:41
* fungi was shuddering at google hangouts, not international trunk lines22:41
reedclarkb, not weird, I use the phone too... because software SIP clients are bad22:41
pleia2I've not used it though22:41
russellbthe conferencing support in asterisk we're using supports both HD audio and video, if you use the right client22:41
pleia2should do, since that comes with ubuntu22:41
russellband call in via SIP and not the dial-in #22:41
clarkbrussellb: oh it does video too?22:42
nibalizermumble server?22:42
clarkbnibalizer: no no asterisk > mumble22:42
russellbclarkb: yeah, basic video anyway22:42
reedrussellb, jitsi is the suggested client, right?22:42
clarkbrussellb: thats cool, didn't know that22:42
russellbreed: it was just the one i tried when i set it up22:42
russellbany SIP client should be fine22:42
*** shayneburgess has joined #openstack-infra22:42
reedrussellb, apparently there isn't much choice, that's what I meant :)22:43
clarkbdhellmann: yup they are clean on trusty. do you want me to switch them to trusty now or just wait for next week?22:43
clarkbdhellmann: slight chance for regression if we wait but less work >_>22:43
russellbwell there's more ... that one is just kinda pretty22:43
fungiat some point i should figure out a webcam/mic integration with some sip client and see what works. presumably v4l driver streams are legitimate video sources?22:43
dhellmannclarkb: I'm OK with waiting if that's less work for you.22:43
reedrussellb, I and people at FSFE have investigated the A/V conferencing situation, not good results and no changes in more recent times either22:43
*** emagana has quit IRC22:43
dhellmannclarkb: I think the chance of regressions is pretty small given the rate we're landing significant patches22:44
clarkbdhellmann: cool22:44
russellbif everyone uses the same video codec, asterisk will do a video conference that switches based on who is talking22:44
*** jgrimm has quit IRC22:44
russellbyou don't get the film strip of everyone else that's there like hangouts though22:44
dhellmannclarkb: and thank you for doing this; my testing effort stalled out and then I got distracted by on-boarding and other stuff22:44
funginow we just need the world to settle on a single, non-patent-encumbered video codec. no problem22:44
pleia2heh22:44
russellbright22:44
russellbturns out, video transcoding for conferencing is quite CPU intensive22:44
russellband a patent minefield22:44
russellbso we punted22:45
clarkbdhellmann: no problem. I figured I would end up doing this for random projects and oslo projects are the most important ones left22:45
fungias cpus get faster, so do patent lawyers22:45
*** bknudson has quit IRC22:45
clarkbwhat happened to that google sponsored one22:45
fungigoogle likes to forget that they're working on free software after a little while (no offense to people working on google-funded free software)22:46
clarkbfungi: well ti wasn't free software22:46
clarkbit was just not patent encumbered22:46
russellbso, some friends of mine at my old company are working on a webrtc PaaS, that does audio / video / filesharing / screensharing22:47
fungiahh. also, did nobody like ogg theora?22:47
jeblairthere is an authn issue with the sip account22:47
russellbwonder if we could build something on that for our needs22:47
russellbbut that sounds like work22:47
russellbjeblair: ah, that would do it22:47
jeblairi'm wondering if i botched something during heartbleed22:48
fungijeblair: it was a bit of a scramble, so i wouldn't be surprised22:48
russellbdoubt that's using TLS ...22:48
*** sabeen has quit IRC22:48
jeblairrussellb: we changed all our passwords because they were potentially in the memory space of a vulnerable tls server22:48
russellbunless you mean cycling passwords22:48
russellbah right22:48
fungirussellb: we could have simply botched some credentials (reset them in one place but not anotherm et cetera)22:48
jeblairrussellb: it's was extremely painful22:48
*** homeless has quit IRC22:48
russellb:(22:49
*** crc32 has joined #openstack-infra22:49
* fungi is depressed that the latest entry on http://www.theora.org/news/ is now almost 5 years old22:50
reedfungi, didn't they publicly announce the defeat and started working on next gen codecs?22:51
clarkbdhellmann: and those projects apepars tox==1.7.2 clean. going to check oslo* against tox==1.7.2 now22:51
fungireed: wouldn't surprise me. i have only so many hours in the day to read things, so probably missed it22:52
*** markmcclain1 has quit IRC22:52
jeblairrussellb, fungi: yep, i did indeed botch it; fixing22:52
russellbjeblair: yay thanks22:52
* reed trying ekiga to connect to pbx.openstack.org, it requires a username22:52
*** emagana has joined #openstack-infra22:52
russellbyeah, lots of clients assume you need an account somewhere22:52
jeblairreed, russellb: i think 'openstack' will work22:52
reedlast time i tried, all VoIP clients on Android have the same issue: they require an account22:52
jeblairi think we made a simple account to deal with that22:53
*** andreaf has quit IRC22:53
russellbjeblair: we did talk about adding a generic account at one point didn't we ...22:53
reedjeblair, tried openstack, Unauthorized22:53
* russellb checks the config22:53
russellbreed: openstack, pw: openstack22:53
*** dangers is now known as dangers_away22:54
reedcould not register, forbidden22:54
reeddifferent error than leaving the pwd empty22:54
jeblairreed: i see a "Wrong password" entry in the log22:55
reedprobably that's related to what jeblair is doing22:55
russellbyeah, you don't want it to register22:55
russellbideally22:55
russellbbut it can use that auth to make calls22:55
russellbjeblair: needs host=dynamic to allow register ... but it's going to get confused and weird if more than 1 is trying to do that22:55
reedekiga doesn't give me other options22:56
reedok, I'll bite the bullet and get jitsi22:56
openstackgerritCedric Brandily proposed a change to openstack-infra/git-review: Define -T/--notopic to disable review submit with topic  https://review.openstack.org/11403822:56
jeblairrussellb, reed: pstn works now22:57
krotscheckclarkb: Ok, so for some reason rabbit is rejecting all connections from users who are not admins.22:58
*** chuckC has quit IRC22:58
*** Ish__ has joined #openstack-infra22:58
russellbjeblair: yay thanks22:58
krotscheckclarkb: I’m going to hop over to #rabbitmq and ask them wtf is up.22:58
*** chuckC has joined #openstack-infra22:58
reedjeblair, yeah, cool22:58
clarkbkrotscheck: ok22:59
*** andreaf has joined #openstack-infra22:59
HenryGCan someone clue me in here? I made this change: https://review.openstack.org/112326  but it does not seem to have the desired effect.22:59
fungiyep, no more fast busy on that dial-in number22:59
russellbhow about slow busy?23:00
clarkbHenryG: are the files located in the proper location?23:00
russellb:-p23:00
clarkbHenryG: it will only copy them if they are in the workspace root23:00
*** Ryan_Lane has joined #openstack-infra23:00
*** Ryan_Lane has joined #openstack-infra23:00
*** otherwiseguy has quit IRC23:01
*** chuckC has quit IRC23:01
HenryGclarkb: Don't know, investigating ...23:01
* anteaya notes how awesome it is to have jenkins results by themselves at the top of the page23:02
*** krotscheck has quit IRC23:03
*** krotscheck has joined #openstack-infra23:03
*** andreaf_ has joined #openstack-infra23:04
clarkbHenryG: they need to be named properly too, they are the same files as copied by unittests to subunit_log.txt iirc and results.html23:04
HenryGclarkb: Looking in python-jobs.yaml, which is the bit that renames/moves the files?23:06
*** andreaf has quit IRC23:07
HenryGclarkb: The functional job should be very much the same as the python27 unit test job.23:07
clarkbHenryG: the run-unittests.sh script is the thing that renames/moves the files23:08
*** markmcclain has joined #openstack-infra23:08
clarkbHenryG: you might even want to use that script to do your tox run23:08
ZZelleHi everyone23:10
ZZelleGreat new gerrit layout!23:10
ZZelleanteaya, hi23:10
*** dguerri is now known as dguerri`afk23:11
clarkbdhellmann: https://review.openstack.org/114052 do we backport incubator changes?23:11
clarkbdims_: ^23:12
clarkbdhellmann: dims_ we don't do stable branches in incubator right?23:13
dims_clarkb: right23:13
clarkbthanks23:15
clarkboslo.messaging has an issue too but its only one test so I think I can just fix it correclty23:15
openstackgerritA change was merged to openstack/requirements: Rename bash8 to bashate (part 1)  https://review.openstack.org/11308023:15
HenryGclarkb: I think run-unittests.sh will work if I am allowed to tweak it. The venv doesn't start with "py".23:16
clarkbHenryG: oh right, no we shouldn't tweak that at least not without some planning23:17
clarkbHenryG: we will need to update a lot of things and do it in multiple steps to make that change without issues23:17
openstackgerritOpenStack Proposal Bot proposed a change to openstack-infra/devstack-gate: Updated from global requirements  https://review.openstack.org/11405423:17
clarkbhuh when did d-g grow test-requierments.txt?23:18
clarkbmaybe we shouldn't remove it from teh requirements project list then23:18
anteayaZZelle: hi I am being kicked out of the building at cinder sprint23:18
anteayatty tomorrow23:18
*** eharney has quit IRC23:18
ZZelleanteaya, ?23:19
*** dimtruck is now known as zz_dimtruck23:19
ZZelleanteaya, could we assume that all third party CIs name ends with " CI" ?23:20
*** gargola has quit IRC23:20
openstackgerritChingWei Chang proposed a change to openstack-infra/config: new project puppet-n1k-vsm creation  https://review.openstack.org/10266223:21
fungiZZelle: that's the intent with the rename23:22
fungiZZelle: i hope to be able to clean up my e-mail delivery filters soon, taking advantage of that23:22
*** armax has quit IRC23:23
ZZellefungi, me too :), great job on the gerrit layout!23:23
*** otherwiseguy has joined #openstack-infra23:23
*** tonytan4ever has quit IRC23:23
*** jedimike has quit IRC23:24
clarkbdims_: dhellmann https://review.openstack.org/11407923:26
openstackgerritCedric Brandily proposed a change to openstack-infra/git-review: Define -T/--notopic to disable review submit with topic  https://review.openstack.org/11403823:29
reedfungi, since https://review.openstack.org/#/c/113345/ does it mean that openstackid now points to the 'real life' members db?23:32
reedwhoever modified Gerrit UI today: thank you!23:32
fungireed: i don't know... i was told there were new credentials/database server to point the dev server at, but as to whether that's the live silverstripe backend db, a copy of it, or some dummy data i couldn't guess23:33
reedfungi, thanks, I'll ask jimmy23:33
clarkbdhellmann: dims_ ok those were the only two oslo projects that got cranky under tox1.7.2 with random python hash seed23:36
dims_nice! thanks23:36
*** chuckC has joined #openstack-infra23:37
* fungi must transition to evening tasks now... dance card is oversubscribed already23:37
clarkbfungi: have fun23:38
fungithx23:38
lifelessclarkb: sadface, py26 failed again with http://logs.openstack.org/49/80449/23/check/gate-pbr-python26/ac41f37/ TimeoutException23:43
lifelessmordred: ^23:43
lifelessmordred: can you log into a node again and see what the next bit of upness is?23:43
* krotscheck nukes rabbitmq from orbit23:44
clarkbkrotscheck: :) I figured you would eventually but not this soon23:44
*** emagana has quit IRC23:44
clarkblifeless: is it possible there is a bug in the test?23:44
krotscheckclarkb: The complete lack of any kind of community support is what’s getting me.23:44
clarkblifeless: and can we just give it a gpg key as a fixture and move on?23:44
*** emagana has joined #openstack-infra23:45
*** ominakov has quit IRC23:45
*** Sukhdev has joined #openstack-infra23:45
lifelessclarkb: its passing on py2723:46
lifelessclarkb: it passed for mordred when he poked at it directly w/haveged running23:46
clarkblifeless: oh, so maybe haveged isn't running now? even though we tried to make it so (if eg you ran on an old image build)23:47
lifelessclarkb: right23:47
lifelessclarkb: thats what I'm wondering23:47
clarkbhrm image is 8 hours old23:47
clarkbtest ran 3 hours ago23:47
mordredkrotscheck: it seems that it seems much better than it actually is23:48
clarkbI doubt that it ran on the old image23:48
mordredkrotscheck: but I've never used it in anger23:48
krotscheckmordred: Basically, I cannot connect to rabbit unless the user is an admin.23:48
lifelessclarkb: I really don't like the idea of shipping an actual private key in the source23:48
lifelessclarkb: so I'd like to try to avoid that23:48
clarkblifeless: even a dummy key?23:48
lifelessclarkb: its still a key23:49
lifelessclarkb: users do dumb things23:49
mordredkrotscheck: maybe that's a feature23:49
lifelesskrotscheck: cannot connect to rabbit how - rabbitmqctl or amqp ?23:49
*** emagana has quit IRC23:49
krotschecklifeless: amqp23:49
lifelesskrotscheck: have you created the users you need?23:50
krotscheckyep23:50
mordredkrotscheck: lifeless can fix your problems23:50
lifelesskrotscheck: have you granted them access to your vhost?23:50
lifelesskrotscheck: and to the queues / exchanges you want them to use?23:50
krotschecklifeless: lemme show you where that’s all set up...23:50
clarkboh you know what23:50
* clarkb looks at haveged change23:50
krotschecklifeless: So there’s this - http://git.openstack.org/cgit/openstack-infra/puppet-storyboard/tree/manifests/rabbit.pp23:51
*** alexandra_ has joined #openstack-infra23:51
clarkbmordred: the haveged change won't actually ensure haveged is running23:51
*** jamielennox|away is now known as jamielennox23:51
mordredclarkb: it won't?23:51
krotschecklifeless: Which, from the documentation, tells me that the rabbitmq_user should be able to connect to virtualhost / and create all exchanges that it needs to.23:51
clarkbmordred: lifeless: you are ensuring that state at image build time, this has nothing to do with what it does after a reboot23:51
clarkbI think you need to enable=> true orwhatever23:52
mordredo for the love of GOD23:52
clarkbbasically tell centos init to start that service at boot which is different than starting the service with puppet23:52
lifelessmordred: love of haveged please23:52
clarkbI am going to confirm by logging onto a host23:52
mordredk. patch coming23:52
*** alexandra_ is now known as asettle23:52
clarkbmordred: yup thats the issue23:53
clarkbno haveged running23:53
clarkbjesusaurus: haev you run into admin only being able to connect to rabbitmq?23:54
jesusaurusclarkb: no, i havent23:54
krotschecklifeless: Any ideas? I’ve tried pretty much everything I can think of.23:54
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Enable haveged  https://review.openstack.org/11408223:55
lifelesskrotscheck: check the output of rabbitmqctl list_permissions23:55
lifelesskrotscheck: lets me sure it has actually worked ;)23:55
clarkbI suppose you need me to do that?23:55
lifelesskrotscheck: also make sure you're connecting to the rabbit you think you are, not e.g. some other one on the same machine23:55
mordredclarkb: ^^23:56
krotschecklifeless: storyboard.*.*.*23:56
NobodyCamwhat is the correct pip version for mac 1.5.6 ?23:56
*** markmcclain1 has joined #openstack-infra23:56
clarkbkrotscheck: oh you are able to do this?23:56
lifelesskrotscheck: ok, and password is correct?23:56
*** markmcclain has quit IRC23:56
clarkbkrotscheck: I couldn't remember if you have account23:56
krotschecklifeless: And I think I’m connecting to the correct one, given that it all works if I set the user to admin, but it doesn’t if I don't.23:56
mordredNobodyCam: 1.5.6 is great23:56
NobodyCamgetting odd error : http://paste.openstack.org/show/94707/23:56
NobodyCamhey mordred :)23:56
jesusaurusmordred: "enable" means start-on-boot, but won't make sure that its actually running23:56
clarkbjesusaurus: ya thats what we want23:56
krotscheckclarkb: I’m on a VM23:56
clarkbkrotscheck: oh that works23:57
*** imcsk8_ has joined #openstack-infra23:57
clarkbjesusaurus: we don't run puppet on the test slaves, we only do it at image build time23:57
clarkbjesusaurus: so we want to make sure haveged is enabled on boot23:57
*** unicell has joined #openstack-infra23:58
mordredNobodyCam: try "pip install wheel"23:58
mordredNobodyCam: and try again23:58
clarkbmordred: approved23:58
jesusaurusclarkb: mordred: which slaves do you want that running on?23:58
mordredNobodyCam: also, are you sure taht you're running pip 1.5.6 ?23:58
clarkbjesusaurus: all of them23:58
mordredjesusaurus: all of them23:58
clarkbjesusaurus: its an entropy building service, vms have bad entropy so we want it everywhere23:58
mordredjesusaurus: it's already running on ubuntu because ubuntu enables service on install23:58
mordredjesusaurus: but centos does not enable on install23:58
*** shayneburgess has quit IRC23:59
*** gokrokve has quit IRC23:59
*** flwang_ has joined #openstack-infra23:59
jesusaurusclarkb: mordred: then you want slave_common, slave looks like its only included in pypi_slave and proposal_slave23:59
*** imcsk8 has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!