| *** MarkAtwood has joined #openstack-infra | 00:00 | |
| *** moravec has joined #openstack-infra | 00:00 | |
| prometheanfire | hopefully jjb is updated | 00:01 |
|---|---|---|
| prometheanfire | and reviews are timing out (adding recheck comment) | 00:02 |
| prometheanfire | https://review.openstack.org/#/c/290894/ | 00:02 |
| *** baoli has quit IRC | 00:02 | |
| *** jamesmcarthur has joined #openstack-infra | 00:03 | |
| clarkb | its queued... | 00:04 |
| openstackgerrit | Merged openstack-infra/puppet-etherpad_lite: Add missing Gemfile to the project https://review.openstack.org/291678 | 00:04 |
| prometheanfire | ah | 00:05 |
| prometheanfire | nice :D | 00:05 |
| *** Swami has quit IRC | 00:05 | |
| *** dims has joined #openstack-infra | 00:07 | |
| *** fawadk has quit IRC | 00:08 | |
| *** eliqiao_ has joined #openstack-infra | 00:08 | |
| *** fedexo has quit IRC | 00:09 | |
| *** afaranha has joined #openstack-infra | 00:09 | |
| afaranha | hey guys, I made a mistake in comiting code with credentials, can someone delete the patch? https://review.openstack.org/#/c/294334/2 | 00:10 |
| afaranha | fungi, could you help on this? | 00:10 |
| clarkb | afaranha: no, you should change the credentials | 00:10 |
| afaranha | I sent a second path erasing the credentials, but the first patch still have it | 00:10 |
| clarkb | its already been mirrored and anyone could have it | 00:10 |
| *** alex_xu has quit IRC | 00:10 | |
| clarkb | the only safe path is to update your creds | 00:11 |
| *** eliqiao has quit IRC | 00:11 | |
| afaranha | clarkb, oh dammit =/ | 00:11 |
| *** ihrachys has quit IRC | 00:11 | |
| afaranha | clarkb, thanks, I'm gonna change it ASAP | 00:11 |
| *** thorst has quit IRC | 00:11 | |
| *** jamesmcarthur has quit IRC | 00:11 | |
| *** thorst has joined #openstack-infra | 00:12 | |
| *** ihrachys has joined #openstack-infra | 00:12 | |
| *** eil397 has quit IRC | 00:12 | |
| *** davideagnello has joined #openstack-infra | 00:13 | |
| *** jamesmcarthur has joined #openstack-infra | 00:15 | |
| *** thorst has quit IRC | 00:16 | |
| fungi | yes, all proposed changes, even if they're not merged, are still replicated to our git mirrors and github | 00:16 |
| *** sridhar_ram1 has quit IRC | 00:16 | |
| *** tqtran-afk has joined #openstack-infra | 00:17 | |
| *** ihrachys has quit IRC | 00:18 | |
| *** sflanigan has joined #openstack-infra | 00:19 | |
| JayF | re: IPA failures: https://gist.github.com/jayofdoom/6fa28987cc9dd722bf99 | 00:19 |
| *** yamahata has joined #openstack-infra | 00:20 | |
| clarkb | silly docker | 00:20 |
| afaranha | clarkb, Thank you, I already change it. | 00:21 |
| JayF | tl;dr: docker package requires apparmor, doesn't declare the dep | 00:21 |
| *** jamesmcarthur has quit IRC | 00:21 | |
| JayF | once apt-get install apparmor runs we're golden | 00:21 |
| *** alex_xu has joined #openstack-infra | 00:21 | |
| fungi | wow | 00:21 |
| JayF | Assuming you all probably did spring cleaning on the images to slim them up? | 00:21 |
| *** fedexo has joined #openstack-infra | 00:21 | |
| *** tqtran-afk has quit IRC | 00:21 | |
| JayF | Like installing apparmor in lib/ironic won't break other jobs, should it? | 00:21 |
| JayF | just making sure not having that package installed was a size-decision not a technical one | 00:22 |
| clarkb | JayF: we have switched to dib built images across the board and they start with deboostrap | 00:22 |
| fungi | JayF: we moved from images based on ubuntu's cloud images to images based on a debootstrap minbase | 00:22 |
| clarkb | also for most all our testing selinux/apparmor just gets turned off iirc | 00:22 |
| *** moravec has quit IRC | 00:22 | |
| JayF | https://github.com/docker/docker/issues/9745 ugh, apparently it's the same package for deb and for ubu | 00:23 |
| JayF | so their "fix" was to document the dependency rather than properly build the right package | 00:23 |
| fungi | as part of the effort to stop maintaining more than one image for a single distro release | 00:23 |
| clarkb | 14 images to upload, at this rate it may never end :/ | 00:23 |
| JayF | OK, we're going to install apparmor with docker then, fun times | 00:24 |
| jroll | clarkb: you can kill ubuntu-trusty-ovh-bhs1-8847643 when you have a sec, thank you :) | 00:25 |
| *** moravec has joined #openstack-infra | 00:26 | |
| clarkb | done | 00:26 |
| fungi | so... many... ballots | 00:26 |
| *** woodster_ has quit IRC | 00:27 | |
| *** fawadkhaliq has joined #openstack-infra | 00:27 | |
| *** sridhar_ram has joined #openstack-infra | 00:27 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: [WIP] Expose nodepool-builder workers settings https://review.openstack.org/294339 | 00:27 |
| SamYaple | fungi: pull a florida in 2000 and loss 'em | 00:27 |
| *** jamesmcarthur has joined #openstack-infra | 00:27 | |
| *** daemontool has joined #openstack-infra | 00:28 | |
| SamYaple | JayF: are you sture docker requires it? i know i dont run with apparmor installed on my servers | 00:28 |
| clarkb | just about every upload is failing :( | 00:28 |
| *** baoli has joined #openstack-infra | 00:28 | |
| clarkb | OpenStackCloudException: Failed at action (upload_segment) [Unauthorized. Check username, password and tenant name/id.] | 00:28 |
| mordred | clarkb: uhm | 00:29 |
| *** mtanino has quit IRC | 00:29 | |
| mordred | clarkb: that seems bad | 00:29 |
| mordred | clarkb: did something change? | 00:29 |
| clarkb | I should update that to write which image | 00:29 |
| clarkb | mordred: not that I know of | 00:29 |
| SamYaple | mordred: did you use image tasks :P | 00:29 |
| JayF | SamYaple: yes, and depending on your distro it may be different | 00:29 |
| mordred | SamYaple: we do on clouds that require them | 00:29 |
| JayF | SamYaple: apparmor doesn't have to be enabled; just has to be installed | 00:29 |
| JayF | SamYaple: or it fails to start | 00:29 |
| mordred | clarkb: yah - cloud name, region name and image name would be useful | 00:30 |
| SamYaple | JayF: 14.04, 15.10, and 16.04 (beta) apparmor is not installed | 00:30 |
| SamYaple | JayF: which docker version | 00:30 |
| *** mylu has joined #openstack-infra | 00:30 | |
| JayF | SamYaple: see: https://github.com/docker/docker/issues/9745 | 00:30 |
| JayF | SamYaple: it's an upstream bug, it's in their docs to install it | 00:30 |
| JayF | SamYaple: I think it's unique to the upstream package vs the distro package | 00:30 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Refactor create_image in prep for import from url https://review.openstack.org/294341 | 00:31 |
| *** fawadkhaliq has quit IRC | 00:31 | |
| mordred | clarkb: ^^ that's step one in adding import_from support | 00:31 |
| SamYaple | JayF: i use upstream not distro though. we dont have this bug in kolla which is all upstream | 00:31 |
| *** piet has joined #openstack-infra | 00:31 | |
| JayF | SamYaple: strange; but jroll and I just observed the behavior | 00:31 |
| *** fverbs has quit IRC | 00:31 | |
| *** fawadkhaliq has joined #openstack-infra | 00:31 | |
| JayF | SamYaple: pretty cut and dry, and our behavior matches that in the issue exactly | 00:31 |
| SamYaple | JayF: let me verify again on a fresh vm | 00:31 |
| pabelanger | fungi: did you see my reply for gerrit admin yesterday? I only ask since there is a current request on the ML I could handle | 00:31 |
| JayF | SamYaple: have you checked your gate recently? | 00:32 |
| SamYaple | but is it the latest version? | 00:32 |
| JayF | SamYaple: I'm submitting this patch; you're welcome to vote on it :) | 00:32 |
| openstackgerrit | Ian Wienand proposed openstack-infra/glean: Better service description https://review.openstack.org/294342 | 00:32 |
| mordred | clarkb: follow up patch that adds the rest coming - wanted to make sure the switching logic was solid first | 00:32 |
| SamYaple | yes we run many gates a day | 00:32 |
| ianw | ^ there's my tilting at windmills exercise for the day | 00:32 |
| fungi | tristanC: how pabelanger yep, i can add you now, though someone else would need to help you out if you get stuck. i'm pretty wiped out tonight | 00:32 |
| fungi | er, pabelanger: ^ | 00:32 |
| fungi | sorry tristanC, bad tab complete | 00:33 |
| pabelanger | fungi: works for me | 00:33 |
| JayF | SamYaple: looks like I was exact opposite | 00:33 |
| JayF | SamYaple: we install distro package, you use upstream | 00:33 |
| JayF | SamYaple: which would explain the diff in behavior | 00:33 |
| SamYaple | yes | 00:33 |
| SamYaple | correct | 00:33 |
| SamYaple | that makes sense | 00:33 |
| JayF | SamYaple: (and make this a ubuntu bug moreso than a docker one) | 00:33 |
| *** gildub has joined #openstack-infra | 00:33 | |
| SamYaple | i rememebr that bug | 00:33 |
| anteaya | tonyb: first person added to a gerrit group can add whoever they wish, unless it is an infra group | 00:33 |
| SamYaple | upstream needs no apparmor | 00:33 |
| JayF | SamYaple: I'm not opposed to switching to the new one; but for now going to install apparmor and stop the bleeding :) | 00:33 |
| anteaya | tonyb: in which case infra ptl says who can be addtional members | 00:34 |
| ianw | pabelanger: alright, i think my glean early start works. we could try this by building an image with my patch ... but i'm going to need someone to kick of a fresh centos7 build. interested? | 00:34 |
| SamYaple | JayF: you do what you need to, i dont know the context. i was just perking up beacause i saw docker | 00:34 |
| tonyb | anteaya: okay I wasn't sure how that side of things worked. | 00:34 |
| anteaya | tonyb: yep | 00:34 |
| anteaya | fair enough | 00:34 |
| JayF | SamYaple: tl;dr: ironic-python-agent builds it's ramdisk in docker | 00:34 |
| JayF | SamYaple: actually pretty cool use of it (I designed it, I should know, hahahhahaha) :P | 00:34 |
| tonyb | anteaya: it's all uncharted waters for me :) | 00:34 |
| pabelanger | ianw: Sure, give me a few minutes. | 00:34 |
| *** jpr has joined #openstack-infra | 00:34 | |
| *** MarkAtwood has quit IRC | 00:34 | |
| ianw | pabelanger: alright, let me propose the change | 00:35 |
| anteaya | tonyb: you're doing well | 00:35 |
| SamYaple | JayF: cool. Kolla deploys all of openstack in docker. also pretty cool use of docker :D | 00:35 |
| anteaya | tonyb: just say arrrr and weild your sword menacingly | 00:35 |
| ianw | oh ... hang on, the builder will probably need to restart too | 00:35 |
| anteaya | tonyb: everyone will think you know what you're doing | 00:35 |
| fungi | pabelanger: you are now a gerrit admin. there's not a lot different you'll notice, other than the ability to modify projects/acls (don't, this should be handled through git), add/remove anyone from any group, and delete votes from other users on any change | 00:35 |
| tonyb | anteaya: I have a couple of katana's if that helps :) they're not very "pirate" :) | 00:36 |
| anteaya | bring 'em along | 00:36 |
| fungi | pabelanger: also the /monitoring url will now be reachable, where javamelody monitoring can be found | 00:36 |
| anteaya | they can't hurt | 00:36 |
| * tonyb wonders what US customs would think ;p | 00:36 | |
| JayF | SamYaple: just fyi https://github.com/openstack/ironic-python-agent/blob/master/imagebuild/coreos/docker_build.bash | 00:37 |
| JayF | SamYaple: go to .. and look at the Makefile if you wanna see the full flow :) | 00:37 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Log image build and upload fails better https://review.openstack.org/294344 | 00:37 |
| clarkb | mordred: ^ | 00:37 |
| pabelanger | fungi: great, and added user too | 00:38 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Test centos-7 with earlier glean start https://review.openstack.org/294346 | 00:39 |
| fungi | also, i don't think i'm alert enough to handle a zuul restart tonight. if there's someone on a more compatible timezone comfortable taking the usual steps for saving/restarting/requeuing once it's looking a little more idle, please do | 00:39 |
| ianw | pabelanger: ^ that's what we'll need to roll out | 00:39 |
| *** thorst has joined #openstack-infra | 00:39 | |
| pabelanger | ianw: if clarkb is cool with ^ I can help push it through | 00:40 |
| *** thorst has quit IRC | 00:41 | |
| *** thorst has joined #openstack-infra | 00:41 | |
| *** jamesmcarthur has quit IRC | 00:41 | |
| clarkb | uh | 00:41 |
| clarkb | can we test that without changing nodepool's things? | 00:41 |
| *** jamesmcarthur has joined #openstack-infra | 00:42 | |
| ianw | i'm really not sure how | 00:43 |
| ianw | unless someone has a better idea why it's not registering | 00:43 |
| pabelanger | I didn't even know you could do that for dib patch reviews | 00:43 |
| *** bpokorny_ has joined #openstack-infra | 00:43 | |
| ianw | i have an image in with that in IAD, but i'm not sure how we could get nodepool to try and use it | 00:44 |
| * tonyb hopes anteaya will chuckle when she reads my email | 00:44 | |
| *** zz_dimtruck is now known as dimtruck | 00:45 | |
| pabelanger | ianw: so, the issue is not centos-7 getting an IP address right? | 00:45 |
| pabelanger | because I can see that in nodepool | 00:45 |
| * anteaya looks forward to tonyb's email | 00:46 | |
| *** bpokorny has quit IRC | 00:46 | |
| anteaya | I loves a good chuckle | 00:46 |
| ianw | pabelanger: that's just what nodepool thinks about it ... the instance needs to bring it's interface up with that IP | 00:46 |
| clarkb | ianw: pabelanger registration is all in jenkins and gearman | 00:46 |
| clarkb | nodepool should be unrelated | 00:46 |
| *** jpr1 has joined #openstack-infra | 00:47 | |
| pabelanger | ianw: Ah, I see | 00:47 |
| ianw | well, you know what i mean, getting a external instance into the whole thing | 00:47 |
| anteaya | tonyb: us customs hates everything | 00:47 |
| anteaya | tonyb: don't show them an apple | 00:47 |
| *** bpokorny_ has quit IRC | 00:47 | |
| anteaya | they can't deal wtih apples | 00:47 |
| clarkb | however nodepool sshes into the machine before adding it to jenkins | 00:47 |
| pabelanger | right, that is what is failing according to logs | 00:48 |
| clarkb | so ssh would have to fail before anything else, you can just check nodepool logs to see if that is happening | 00:48 |
| ianw | clarkb: right, which is what's timing out, right? | 00:48 |
| clarkb | ok | 00:48 |
| clarkb | ianw: I dunno just tryingto catch up based on that commit message | 00:48 |
| *** Qiming has quit IRC | 00:48 | |
| *** jpr has quit IRC | 00:48 | |
| anteaya | tonyb: thanks, worth it | 00:48 |
| *** daemontool has quit IRC | 00:48 | |
| ianw | clarkb: sorry, registering is probably the wrong word, what i mean is that initial ssh is timing out, because we take too long to brin gup the network | 00:49 |
| *** hamzy has joined #openstack-infra | 00:49 | |
| clarkb | so ya if it takes longer than 2 minutes to get working networking then that could cause nodepool to timeout | 00:49 |
| SamYaple | JayF: cool will review | 00:49 |
| pabelanger | if the IP eventually happens, we could up our SSH timeout to confirm | 00:50 |
| pabelanger | we default to 60sec | 00:50 |
| *** MarkAtwood has joined #openstack-infra | 00:50 | |
| clarkb | the first thing I would check is ya does the networking eventually come up in both cases? | 00:50 |
| clarkb | one longer tha nthe other probably | 00:50 |
| clarkb | if so then use the shorter one | 00:51 |
| ianw | clarkb: yes ... it's just that it tries to automatically configure eth0 with dhcp ... that times out, *then* glean gets called and reads the config drive and ups the interface | 00:51 |
| clarkb | oh! rackspace | 00:51 |
| clarkb | fail | 00:51 |
| SamYaple | JayF: where are those published? whats teh size? | 00:51 |
| ianw | clarkb: yes. this is why i wanted to start with just rax first, because something always goes wrong :) | 00:52 |
| clarkb | ianw: ya I agree then that getting it in before networking ups seems the right method | 00:52 |
| sc` | how can i see httpd logs on a failed centos build to see why it didn't start? | 00:52 |
| *** afaranha has quit IRC | 00:52 | |
| *** edmondsw has quit IRC | 00:52 | |
| ianw | sc`: what job? | 00:53 |
| sc` | https://jenkins01.openstack.org/job/gate-devstack-centos7-cookbook-openstack-common-chef-rake-integration-nv/10/console | 00:53 |
| sc` | it has a few Depends-Ons | 00:53 |
| ianw | sc`: hmm, well if that job doesn't copy the logs, you can't really. devstack-gate type jobs do | 00:53 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/infra-specs: Publish election data to governance.o.o https://review.openstack.org/292666 | 00:54 |
| *** jpr1 has quit IRC | 00:54 | |
| sc` | so how might i extract these particular logs? | 00:54 |
| pabelanger | depending on how JJB is configured for your job, will get upload into swift | 00:55 |
| ianw | sc`: well, you'll have to rework the job to copy out the logs | 00:55 |
| clarkb | the way the nodepool builder is designed makes it tricky to reload configs | 00:56 |
| fungi | okay, now i'm sad. somehow i missed getting a patch into a packaging-rpm repo, so only 9 ptl ballots for me this time around :/ | 00:56 |
| *** moravec has quit IRC | 00:56 | |
| pabelanger | sc`: they would appear in the logs folder: http://logs.openstack.org/21/291921/24/check/gate-devstack-centos7-cookbook-openstack-common-chef-rake-integration-nv/adc1994/ | 00:56 |
| *** gongysh has joined #openstack-infra | 00:56 | |
| clarkb | we can't inotify because apparently thats terrible with the GIL | 00:56 |
| pabelanger | if you job-template had the publisher | 00:56 |
| ianw | sc`: without looking at the job, you'll want to put anything of interest into $WORKSPACE/logs and that will get copied out | 00:56 |
| *** jamesmcarthur has quit IRC | 00:56 | |
| sc` | hm. i think i see where another developer had this same issue. digging into that | 00:56 |
| sc` | there could be a solution on the other side of this rabbit hole | 00:56 |
| pabelanger | sc`: look into the puppet-jobs job-template, they do a good job with managing log files | 00:57 |
| ianw | sc`: see, you've got nothing to copy -> http://logs.openstack.org/21/291921/28/check/gate-devstack-centos7-cookbook-openstack-common-chef-rake-integration-nv/c1293ff/console.html#_2016-03-18_00_47_56_393 | 00:57 |
| *** jamesmcarthur has joined #openstack-infra | 00:58 | |
| *** armax has joined #openstack-infra | 00:58 | |
| ianw | ISTR EmilienM wrote a log collector that was pretty generic and got a lot of stuff | 00:58 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Publish election data to static server https://review.openstack.org/292676 | 00:58 |
| anteaya | fungi: I'm so sorry :( | 00:59 |
| fungi | i'll get over it | 00:59 |
| *** takashi has joined #openstack-infra | 01:00 | |
| anteaya | I'm putting money on you were over it before you hit the enter key | 01:00 |
| anteaya | you're a fast healer | 01:00 |
| fungi | you've got me there | 01:00 |
| *** Jeffrey4l_ has joined #openstack-infra | 01:01 | |
| ianw | getting odd vote requests is like a trip down memory lane ... oh yeah, i remember that bug | 01:02 |
| *** rossella_s has quit IRC | 01:03 | |
| ianw | clarkb: what's supposed to happen with eth1 on rax? | 01:03 |
| *** rossella_s has joined #openstack-infra | 01:03 | |
| *** boris-42 has quit IRC | 01:04 | |
| clarkb | ianw: its the private net | 01:04 |
| ianw | yeah, for some reason, glean+centos7 doesn't like it | 01:05 |
| *** jamesmcarthur has quit IRC | 01:06 | |
| *** zhurong has joined #openstack-infra | 01:07 | |
| *** ramishra has quit IRC | 01:07 | |
| *** rlandy has quit IRC | 01:09 | |
| *** jamesmcarthur has joined #openstack-infra | 01:09 | |
| *** ramishra has joined #openstack-infra | 01:09 | |
| *** ZZelle_ has quit IRC | 01:12 | |
| *** fawadkhaliq has quit IRC | 01:13 | |
| pabelanger | ianw: okay, so to recap, 294346 is on hold for the moment? | 01:15 |
| *** salv-orlando has joined #openstack-infra | 01:16 | |
| *** jamesmcarthur has quit IRC | 01:16 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Test centos-7 with earlier glean start https://review.openstack.org/294346 | 01:17 |
| ianw | pabelanger: ^ oh, doh, converted to yaml | 01:17 |
| *** salv-orlando has quit IRC | 01:17 | |
| *** jpr has joined #openstack-infra | 01:17 | |
| *** salv-orlando has joined #openstack-infra | 01:18 | |
| *** tphummel has quit IRC | 01:18 | |
| *** dimtruck is now known as zz_dimtruck | 01:19 | |
| *** salv-orl_ has quit IRC | 01:19 | |
| pabelanger | clarkb: sorry, just to confirm again, you do or don't want to do the following? ^ | 01:20 |
| *** zz_dimtruck is now known as dimtruck | 01:21 | |
| *** dims has quit IRC | 01:21 | |
| *** salv-orlando has quit IRC | 01:22 | |
| *** jamesmcarthur has joined #openstack-infra | 01:23 | |
| *** armax has quit IRC | 01:24 | |
| *** Qiming has joined #openstack-infra | 01:24 | |
| *** ociuhandu has quit IRC | 01:25 | |
| *** ociuhandu has joined #openstack-infra | 01:26 | |
| clarkb | I dont like using unreleased glean like that but its only one image and temporary so can live with it | 01:28 |
| *** jpr has quit IRC | 01:28 | |
| *** mylu has quit IRC | 01:29 | |
| clarkb | pabelanger: if you go ahead with it remember nodepool builder needs a restart once the current uploads complete | 01:29 |
| *** mylu has joined #openstack-infra | 01:30 | |
| *** jamesmcarthur has quit IRC | 01:32 | |
| *** jamesmcarthur has joined #openstack-infra | 01:32 | |
| *** mylu has quit IRC | 01:33 | |
| *** mylu has joined #openstack-infra | 01:34 | |
| *** mylu has quit IRC | 01:35 | |
| *** Daisy has joined #openstack-infra | 01:35 | |
| *** mylu has joined #openstack-infra | 01:36 | |
| *** jamesmcarthur has quit IRC | 01:37 | |
| *** achanda has joined #openstack-infra | 01:40 | |
| *** yamamoto_ has joined #openstack-infra | 01:41 | |
| *** rhallisey has quit IRC | 01:42 | |
| *** mylu has quit IRC | 01:43 | |
| *** Daisy has quit IRC | 01:43 | |
| *** Daisy has joined #openstack-infra | 01:44 | |
| *** heyongli has joined #openstack-infra | 01:44 | |
| *** heyongli has quit IRC | 01:44 | |
| *** heyongli has joined #openstack-infra | 01:44 | |
| *** hichihara has joined #openstack-infra | 01:44 | |
| *** scottda_vacation has quit IRC | 01:45 | |
| *** yamamoto_ has quit IRC | 01:45 | |
| *** armax has joined #openstack-infra | 01:45 | |
| pabelanger | clarkb: okay, I'll monitor here | 01:45 |
| ianw | ok, i see why eth1 isn't coming up. one element adds the interface file, another one deletes just eth0, leaving us with a configured dhcp eth1. urgh | 01:45 |
| ianw | sometimes you wonder how anything ever works at all | 01:46 |
| greghaynes | ianw: element? glean should be adding config for all the interfaces it sees as active and are in config drive | 01:46 |
| ianw | greghaynes: this is during dib build | 01:47 |
| pabelanger | ianw: does that affect 294346 or are you ready? | 01:47 |
| ianw | simple-init deletes the interface files | 01:47 |
| ianw | pabelanger: no, it just explains why eth1 doesn't come up | 01:47 |
| pabelanger | ianw: okay, will merge and restart builder | 01:47 |
| ianw | greghaynes: ^ centos-minimal adds them, everyone is confused | 01:47 |
| greghaynes | ianw: oh, so what is happening is that glean sees the interface file and then decides to not configure that interface? | 01:48 |
| ianw | greghaynes: yep! | 01:48 |
| greghaynes | got it | 01:48 |
| greghaynes | so, I kind of hate that behavior in glean | 01:48 |
| greghaynes | it bites us all the time and I think glean should do what you ask it to, not try and infer based on system state | 01:49 |
| ianw | well, it's systemd that doesn't let it get that far since we have a condition=!/path/to/interface/file | 01:49 |
| greghaynes | lol | 01:49 |
| ianw | greghaynes: although, https://review.openstack.org/#/c/294342/ isn't helping unraveling this :) | 01:50 |
| ianw | i was immediately suspicious we'd somehow engaged the systemd dhcp client or something similarly stupid | 01:50 |
| greghaynes | yea, the output is... not good | 01:51 |
| * ianw apologises to systemd for jumping to the conclusion it was at fault | 01:51 | |
| *** kzaitsev_mb has quit IRC | 01:51 | |
| *** Daisy has quit IRC | 01:51 | |
| *** Daisy has joined #openstack-infra | 01:52 | |
| *** heyongli has quit IRC | 01:52 | |
| *** heyongli has joined #openstack-infra | 01:52 | |
| openstackgerrit | Merged openstack-infra/project-config: Test centos-7 with earlier glean start https://review.openstack.org/294346 | 01:53 |
| pabelanger | ianw: do you want to get a revert up for ^ too and mark WIP? | 01:53 |
| *** yamamoto has joined #openstack-infra | 01:53 | |
| *** piet has quit IRC | 01:53 | |
| *** heyongli has quit IRC | 01:54 | |
| *** heyongli has joined #openstack-infra | 01:55 | |
| *** heyongli has quit IRC | 01:56 | |
| *** Daisy has quit IRC | 01:56 | |
| *** heyongli has joined #openstack-infra | 01:57 | |
| ianw | pabelanger: i can, i don't think we're going to forget about it :) | 01:58 |
| pabelanger | ianw: mostly to help others I guess :) | 01:59 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Revert "Test centos-7 with earlier glean start" https://review.openstack.org/294363 | 01:59 |
| *** alex_xu_ has joined #openstack-infra | 02:02 | |
| *** yamamoto has quit IRC | 02:04 | |
| *** heyongli has quit IRC | 02:04 | |
| *** heyongli has joined #openstack-infra | 02:05 | |
| *** yamamoto has joined #openstack-infra | 02:05 | |
| *** alex_xu has quit IRC | 02:05 | |
| *** rguillebert has quit IRC | 02:07 | |
| *** weshay has quit IRC | 02:13 | |
| *** piet has joined #openstack-infra | 02:14 | |
| *** sputnik13 has quit IRC | 02:15 | |
| *** dtantsur|afk has quit IRC | 02:15 | |
| *** heyongli has quit IRC | 02:15 | |
| *** csaba has quit IRC | 02:15 | |
| *** heyongli has joined #openstack-infra | 02:15 | |
| *** csaba has joined #openstack-infra | 02:16 | |
| *** dtantsur has joined #openstack-infra | 02:17 | |
| *** tqtran-afk has joined #openstack-infra | 02:18 | |
| *** apoorvad_ has quit IRC | 02:18 | |
| *** SumitNaiksatam has joined #openstack-infra | 02:20 | |
| *** sridhar_ram has quit IRC | 02:22 | |
| *** tqtran-afk has quit IRC | 02:22 | |
| *** ajmiller has joined #openstack-infra | 02:23 | |
| *** heyongli has quit IRC | 02:25 | |
| *** heyongli has joined #openstack-infra | 02:25 | |
| *** mriedem has quit IRC | 02:27 | |
| *** fedexo has quit IRC | 02:29 | |
| *** tqtran-afk has joined #openstack-infra | 02:29 | |
| *** tqtran-afk has quit IRC | 02:29 | |
| *** alex_xu_ has quit IRC | 02:31 | |
| *** piet has quit IRC | 02:33 | |
| *** alex_xu has joined #openstack-infra | 02:34 | |
| *** binbincong has quit IRC | 02:34 | |
| *** heyongli has quit IRC | 02:35 | |
| *** heyongli has joined #openstack-infra | 02:36 | |
| *** yamamoto has quit IRC | 02:37 | |
| *** rfolco has joined #openstack-infra | 02:39 | |
| *** mknawabi_ has quit IRC | 02:39 | |
| *** links has joined #openstack-infra | 02:40 | |
| *** heyongli has quit IRC | 02:44 | |
| *** eliqiao has joined #openstack-infra | 02:45 | |
| *** heyongli has joined #openstack-infra | 02:45 | |
| *** heyongli has quit IRC | 02:45 | |
| *** heyongli has joined #openstack-infra | 02:46 | |
| *** MarkAtwood has quit IRC | 02:46 | |
| *** dimtruck is now known as zz_dimtruck | 02:46 | |
| *** eliqiao_ has quit IRC | 02:47 | |
| *** thorst has quit IRC | 02:48 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:48 | |
| *** thorst has joined #openstack-infra | 02:48 | |
| krotscheck | clarkb: Nope, I had to shift to daycare mode. | 02:49 |
| krotscheck | clarkb: I'll start again in the morning. | 02:49 |
| *** heyongli has quit IRC | 02:52 | |
| pabelanger | centos-7 dib finished building, uploading to rax now | 02:53 |
| *** heyongli_ has joined #openstack-infra | 02:53 | |
| SamYaple | pabelanger: is that automated running somewhere producing a status? or a manual operation | 02:54 |
| pabelanger | SamYaple: usually automated, 14hrs UTC each day | 02:54 |
| pabelanger | so, doing it manually for ianw tonight | 02:54 |
| pabelanger | sadly, not exposed public yet | 02:55 |
| pabelanger | there is a patch to nodepool to add it to html | 02:55 |
| SamYaple | cool. just curious | 02:55 |
| SamYaple | themoreyouknow | 02:55 |
| *** markvoelker has joined #openstack-infra | 02:55 | |
| pabelanger | SamYaple: nodepool.openstack.org is the most we currently expose | 02:55 |
| pabelanger | which are DIB logs | 02:55 |
| *** MarkAtwood has joined #openstack-infra | 02:56 | |
| *** heyongli_ has quit IRC | 02:56 | |
| *** armax has quit IRC | 02:56 | |
| *** _amrith_ is now known as amrith | 02:56 | |
| *** heyongli_ has joined #openstack-infra | 02:56 | |
| *** thorst has quit IRC | 02:57 | |
| *** tphummel has joined #openstack-infra | 02:59 | |
| *** markvoelker has quit IRC | 03:01 | |
| *** cody-somerville has quit IRC | 03:01 | |
| *** heyongli_ has quit IRC | 03:06 | |
| *** kzaitsev_mb has quit IRC | 03:06 | |
| *** heyongli_ has joined #openstack-infra | 03:06 | |
| *** Daisy has joined #openstack-infra | 03:07 | |
| *** Daisy has quit IRC | 03:10 | |
| *** Daisy has joined #openstack-infra | 03:10 | |
| *** ajmiller has quit IRC | 03:15 | |
| *** Daisy has quit IRC | 03:15 | |
| *** cody-somerville has joined #openstack-infra | 03:16 | |
| *** heyongli_ has quit IRC | 03:16 | |
| *** heyongli_ has joined #openstack-infra | 03:17 | |
| *** ociuhandu has quit IRC | 03:17 | |
| *** rfolco has quit IRC | 03:18 | |
| *** armax has joined #openstack-infra | 03:18 | |
| *** Hal1 has joined #openstack-infra | 03:20 | |
| *** ociuhandu has joined #openstack-infra | 03:21 | |
| *** eliqiao_ has joined #openstack-infra | 03:21 | |
| *** binbincong has joined #openstack-infra | 03:22 | |
| *** eliqiao has quit IRC | 03:24 | |
| *** heyongli_ has quit IRC | 03:26 | |
| *** heyongli_ has joined #openstack-infra | 03:27 | |
| armax | mtreinish: ping | 03:27 |
| armax | mtreinish: from http://status.openstack.org/ when I want to link on OpenStack-Health the link actually goes to: http://status.openstack.org/undefined | 03:28 |
| *** sabari has left #openstack-infra | 03:28 | |
| armax | mtreinish: did something get wrong in openstack-infra/system-config | 03:29 |
| armax | ? | 03:29 |
| timothyb89 | armax: mtreinish: I've got a patch up to fix that: https://review.openstack.org/#/c/294266/ | 03:29 |
| armax | timothyb89: ack | 03:29 |
| armax | timothyb89: thanks | 03:29 |
| armax | timothyb89: indeed the reviews link is broken too, as it points to bugday | 03:31 |
| *** flwang has quit IRC | 03:31 | |
| *** yamamoto_ has joined #openstack-infra | 03:34 | |
| pabelanger | ianw: success | 03:37 |
| pabelanger | centos-7 online | 03:37 |
| *** heyongli_ has quit IRC | 03:37 | |
| pabelanger | ianw: do you have a patch to test? | 03:37 |
| *** heyongli_ has joined #openstack-infra | 03:37 | |
| *** Hal1 has quit IRC | 03:38 | |
| pabelanger | ianw: okay, found 286357 and did check experimental | 03:40 |
| *** eliqiao_ is now known as eliqiao | 03:41 | |
| *** mylu has joined #openstack-infra | 03:42 | |
| pabelanger | Going to detox with some TV, will check back shortly | 03:44 |
| pabelanger | but centos-7 jobs seems to be working right now | 03:44 |
| pabelanger | will work on adding puppet-apply experimental jobs in the morning | 03:45 |
| ianw | pabelanger: sweet! | 03:46 |
| pabelanger | ianw: indeed | 03:46 |
| pabelanger | so, your patch looks good I guess | 03:47 |
| ianw | well, yeah, we can cleanup next week. i'll get some follow-up stuff out today for dib, just finishing build tests now | 03:47 |
| *** heyongli_ has quit IRC | 03:47 | |
| pabelanger | ianw: okay, anything else for me tonight? | 03:47 |
| *** heyongli_ has joined #openstack-infra | 03:47 | |
| pabelanger | I'll check your patches in the morning before my PTO :) | 03:47 |
| ianw | pabelanger: no, i think we got enough done for one day :) | 03:47 |
| pabelanger | great! | 03:48 |
| pabelanger | see you monday | 03:48 |
| *** Jeffrey4l_ is now known as Jeffrey4l | 03:49 | |
| *** amrith is now known as _amrith_ | 03:50 | |
| Nakato | pleia2: I hear you may know things about cross-project Depends-On and how that functions. I'm working on getting constraints doing that on unit test jobs. | 03:53 |
| *** thorst has joined #openstack-infra | 03:54 | |
| *** salv-orlando has joined #openstack-infra | 03:56 | |
| *** heyongli_ has quit IRC | 03:57 | |
| *** heyongli_ has joined #openstack-infra | 03:58 | |
| masayukig | Hi, It seems the OpenStack-Health api server is something wrong now. http://status.openstack.org/openstack-health/#/ Can we get the log to debug? | 03:59 |
| *** zhurong has quit IRC | 04:01 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:02 | |
| *** thorst has quit IRC | 04:02 | |
| *** MarkAtwood has quit IRC | 04:03 | |
| *** zhurong has joined #openstack-infra | 04:05 | |
| *** zz_dimtruck is now known as dimtruck | 04:05 | |
| *** MarkAtwood has joined #openstack-infra | 04:06 | |
| *** kzaitsev_mb has quit IRC | 04:07 | |
| *** heyongli_ has quit IRC | 04:07 | |
| *** sdake_ has joined #openstack-infra | 04:08 | |
| *** heyongli_ has joined #openstack-infra | 04:08 | |
| clarkb | Nakato: it should work already due to our use of zuul cloner | 04:09 |
| *** Daisy has joined #openstack-infra | 04:09 | |
| *** sflanigan is now known as sflanigan_afk | 04:10 | |
| *** salv-orlando has quit IRC | 04:10 | |
| *** dimtruck is now known as zz_dimtruck | 04:10 | |
| *** sdake has quit IRC | 04:11 | |
| clarkb | Nakato: the way it works is for every project in the chain a zuul ref is created for each of them then it is up to the job to fetch and checkout that ref | 04:12 |
| Nakato | clarkb: At the very least I need to do some work so constraints doesn't interfere with the cross-project depends-on. But from what I can tell, the depends on I'm testing with didn't check out a copy of the other project anywhere. | 04:12 |
| clarkb | zuul-cloner does this out of the box | 04:12 |
| lifeless | clarkb: for unit tests we don't checkout, nor install, the zuul refs | 04:13 |
| clarkb | lifeless: we do | 04:13 |
| clarkb | with zuul cloner | 04:13 |
| lifeless | clarkb: oh? We didn't use to | 04:13 |
| clarkb | we did as part of constraints | 04:13 |
| lifeless | clarkb: where do they go on disk? | 04:13 |
| clarkb | its only the requirements repo and the project under test | 04:13 |
| *** Daisy has quit IRC | 04:14 | |
| Nakato | Of a project yes, I can see that, but what if Neutron has a depends-on that points to oslo.config? | 04:14 |
| clarkb | that wont ever work | 04:14 |
| lifeless | clarkb: so thats *we don't checkout nor install the zuul refs'! | 04:14 |
| clarkb | lifeless: no... | 04:14 |
| clarkb | we do | 04:14 |
| clarkb | ! | 04:14 |
| *** Daisy has joined #openstack-infra | 04:14 | |
| lifeless | clarkb: so, taking nakato's example. Where does oslo.config get put on disk ? | 04:14 |
| clarkb | for the two projects that are setup by zuul cloner | 04:14 |
| clarkb | that was not the original scenario | 04:15 |
| clarkb | the original scenario was with conatraints | 04:15 |
| lifeless | clarkb: I know. | 04:15 |
| clarkb | which we do | 04:15 |
| lifeless | clarkb: we're going in circles. | 04:15 |
| clarkb | the question was very clwarly make constraints work with depends on and it should via zuul cloner | 04:16 |
| lifeless | clarkb: lets say that we wanted a job that would permit this (I know it can't be the main neutron unit test job), but lets say a parallel one that has the unit test equivalent of LIBS_FROM_GIT=everything | 04:16 |
| clarkb | theb you have to not install with the default pip stuff | 04:16 |
| clarkb | and instead preinstall all the things via source checkouts of the zuul ref | 04:16 |
| lifeless | clarkb: constraints can install those things as long as we call edit-constrains | 04:17 |
| lifeless | https://review.openstack.org/#/c/252680/ was a change I started in this space | 04:17 |
| lifeless | but it stalled after I was told I was doing it all wrong... without any suggestion on how to do it right. | 04:18 |
| *** salv-orlando has joined #openstack-infra | 04:18 | |
| *** heyongli_ has quit IRC | 04:18 | |
| *** heyongli_ has joined #openstack-infra | 04:18 | |
| *** sdake_ has quit IRC | 04:18 | |
| *** Daisy has quit IRC | 04:19 | |
| clarkb | for unittests etc I think what we do today is the right way | 04:19 |
| clarkb | if you want an integration test make an explicit integration test | 04:19 |
| lifeless | clarkb: we've got several scenarios where we want to do more than we do today | 04:19 |
| lifeless | one is the stadium jobs | 04:19 |
| *** fawadkhaliq has joined #openstack-infra | 04:20 | |
| lifeless | a conceptually separate but might share implementation is the horizon xstatic situation where they can't even *test* that their stuff will pass unit tests when xstatic releases | 04:20 |
| clarkb | right just explicitly have a neutron stadium integration test that checks out and installs the stadium then runs some test suite | 04:20 |
| lifeless | and identical but more general to that is all the things using oslo | 04:20 |
| lifeless | where we check 'next release will be ok' by running a script in travis | 04:21 |
| clarkb | but unittests dont fit that criteria | 04:22 |
| lifeless | in what way don't they ? | 04:22 |
| *** salv-orlando has quit IRC | 04:22 | |
| lifeless | the script in travis runs the unit test suites of projects that use oslo | 04:22 |
| clarkb | the python tests themselves but the whole wrapper and jobs dont | 04:22 |
| clarkb | the reason is you eant one single job for the entire stadium that does X and possibly another for Y | 04:23 |
| clarkb | you dont want anX job and a Y job per project | 04:23 |
| lifeless | so putting stadium aside | 04:23 |
| clarkb | then you run that same job on all the projects in the group | 04:24 |
| *** fawadkhaliq has quit IRC | 04:24 | |
| *** sflanigan_afk is now known as sflanigan | 04:25 | |
| *** fawadkhaliq has joined #openstack-infra | 04:25 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: centos-minimal: Disable creation of eth0/eth1 interface scripts https://review.openstack.org/294384 | 04:25 |
| lifeless | clarkb: I'm not following. I believe Nakato got onto this particular thread from the discussions a couple weeks ago during the bug smash about horizon | 04:26 |
| lifeless | clarkb: so lets make this a concrete question | 04:26 |
| *** cody-somerville has quit IRC | 04:26 | |
| lifeless | clarkb: we want to be able to assess - in the infra infrastructure, not some out-of-system-adhoc thing | 04:27 |
| *** cody-somerville has joined #openstack-infra | 04:27 | |
| *** MarkAtwood has quit IRC | 04:27 | |
| lifeless | clarkb: whether the next release of a given xstatic project will break horizon, both devstack and unit tests | 04:27 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: centos-minimal: can be used with base https://review.openstack.org/294385 | 04:27 |
| *** treaki__ has joined #openstack-infra | 04:28 | |
| *** mylu has quit IRC | 04:28 | |
| clarkb | devstack is easy because its mostly solved add a libs from source job that installs all xstatic libs from source in devstack | 04:28 |
| *** heyongli_ has quit IRC | 04:28 | |
| lifeless | clarkb: we had thought that having a new set of jobs (one per python) that checked out additional zuul refs and called edit-constraints to tell pip where to find them, would be a good solution | 04:28 |
| *** heyongli_ has joined #openstack-infra | 04:28 | |
| clarkb | thats a single env var/config setting and everything else should work fine then add this job yo the xstatic projects | 04:28 |
| lifeless | clarkb: and this new set of jobs would, like devstack, have a variable we can define telling it which libraries to do that | 04:29 |
| lifeless | for | 04:29 |
| ianw | it's been quite a few hours since we committed the dib func test fixes, but the job still fails -> http://logs.openstack.org/94/290894/3/check/gate-dib-dsvm-functests-devstack-centos7/6748908/console.html | 04:29 |
| clarkb | for unittests have a job that runs horizon against an suite of xstatic installs from local zuul ref checkouts. this is what your change appears to have tried to do | 04:30 |
| clarkb | I would make just that job to start since its a ton simpler | 04:30 |
| clarkb | rather than edit every job we have | 04:30 |
| *** fawadkhaliq has quit IRC | 04:30 | |
| prometheanfire | dib testing centos still failing? | 04:30 |
| lifeless | clarkb: yes; my sketch was definitely wrong in some ways | 04:30 |
| lifeless | clarkb: so, you *wouldn't* use zuul-cloner for the extra checkouts? | 04:30 |
| lifeless | clarkb: could you help me understand why not, assuming I got that right? | 04:31 |
| prometheanfire | ianw: ah, well, at least I can reproduce | 04:31 |
| clarkb | so that job looks like the current boilerplate but replace the constraints zuul-cloner macro with one that does horizon, constraints, and xstatic | 04:31 |
| prometheanfire | oh | 04:31 |
| prometheanfire | that's mine lol | 04:31 |
| clarkb | lifeless: no use zuul-cloner | 04:31 |
| lifeless | clarkb: ok | 04:31 |
| clarkb | but you cant just run tox because you have to do all the source installs somehow | 04:32 |
| *** treaki_ has quit IRC | 04:32 | |
| lifeless | clarkb: edit-cosntraints will do that for us | 04:32 |
| clarkb | ok | 04:32 |
| lifeless | clarkb: it mutates the constraints file telling pip where the source for some 'foo' is found | 04:32 |
| clarkb | does that make constraints somehow find local install paths? | 04:32 |
| lifeless | clarkb: then when tox runs pip install -c , those override | 04:32 |
| lifeless | clarkb: yes | 04:33 |
| clarkb | ok so your steps are new zuul-cloner with extra stuff, edit constraints, run tox | 04:33 |
| clarkb | I would just make a job that does that and not worry about templating or any of that | 04:33 |
| *** sdake has joined #openstack-infra | 04:33 | |
| clarkb | (its easy to convert to templates in the future so not wasted effort) | 04:33 |
| *** baoli has quit IRC | 04:34 | |
| clarkb | then you can add that job to horizon and xstatic libs and they will all be tested against latest source to make sure we can roll forward | 04:35 |
| clarkb | and because zuul-cloner is used depends on will work | 04:35 |
| lifeless | http://git.openstack.org/cgit/openstack-dev/devstack/tree/inc/python#n307 | 04:36 |
| lifeless | ^- thats how we do edit-constraints in devstack | 04:36 |
| lifeless | clarkb: thanks | 04:36 |
| clarkb | its funny are pushing this way becausr all our integration testing was this way by default for years | 04:37 |
| *** fawadkhaliq has joined #openstack-infra | 04:38 | |
| clarkb | (not the unittests but smokestack and devstack and all that) | 04:38 |
| lifeless | yeah | 04:38 |
| lifeless | and detangling for gate is totally right | 04:38 |
| *** heyongli_ has quit IRC | 04:38 | |
| lifeless | but we also lost visibility on stuff | 04:38 |
| lifeless | so we need to find some ways to bring it back, without the deadlock it created | 04:38 |
| *** heyongli_ has joined #openstack-infra | 04:39 | |
| lifeless | ok, I'm giving up on today. | 04:41 |
| clarkb | maybe devstack shoukd just have a all libs from git option | 04:41 |
| lifeless | clarkb: that would be good too I think; kinda surprised it doesn't? | 04:42 |
| clarkb | that woukd make the devstack side simpler if you dony mind getting everything from source (go back to old defauly) | 04:42 |
| clarkb | lifeless: pretty sure its an explicit list membership comparison | 04:42 |
| *** fawadkhaliq has quit IRC | 04:42 | |
| clarkb | then we can run that in periodic and track when it breaks | 04:43 |
| clarkb | in addition to an prerelease type stuff | 04:43 |
| lifeless | +! | 04:44 |
| *** fawadkhaliq has joined #openstack-infra | 04:44 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/glean: Bring up glean before network.service https://review.openstack.org/293826 | 04:44 |
| ianw | greghaynes / mordred : ^ empirically that seems correct, theoretically i'm pretty sure it's correct, so that's about as good as it gets i think | 04:45 |
| prometheanfire | ianw: you know where I should go with that cent fail? | 04:46 |
| *** markvoelker has joined #openstack-infra | 04:47 | |
| *** mylu has joined #openstack-infra | 04:47 | |
| ianw | prometheanfire: probably to bed. i dunno if jjb is being slow or stuck or what | 04:47 |
| prometheanfire | ya | 04:47 |
| prometheanfire | that's what my plan was :P | 04:47 |
| clarkb | ianw: prometheanfire is it still failijg on the set -u thing? | 04:47 |
| prometheanfire | http://logs.openstack.org/94/290894/3/check/gate-dib-dsvm-functests-devstack-centos7/6748908/console.html | 04:47 |
| clarkb | I thought pabelanger had said updates for jjb completed but maybe some were missed | 04:48 |
| prometheanfire | 2016-03-18 04:19:14.480 | ./env/bin/activate: line 13: _OLD_VIRTUAL_PYTHONHOME: unbound variable | 04:48 |
| *** heyongli_ has quit IRC | 04:48 | |
| clarkb | lol in deactivate | 04:49 |
| *** heyongli_ has joined #openstack-infra | 04:49 | |
| clarkb | maybe just remove set -u completly from the top level | 04:49 |
| prometheanfire | seems more hackish | 04:49 |
| ianw | we did, didn't we? | 04:50 |
| clarkb | ianw: only around activate iirc | 04:50 |
| bkero | clarkb: almost done with dib posix element | 04:50 |
| clarkb | prometheanfire: eh you cant control virtualenv and the outer script is small | 04:50 |
| clarkb | bkero: neat, any udea how much bigger than *-minimal it will be? guessing 50mb or so? | 04:51 |
| prometheanfire | posix? | 04:51 |
| *** markvoelker has quit IRC | 04:51 | |
| clarkb | prometheanfire: to install the rough set of utilities that posix says you should have so that things like cron and ps and cp and xargs and so on work | 04:52 |
| prometheanfire | ah | 04:52 |
| prometheanfire | I think we include that in our minimal links | 04:52 |
| *** ansiwen has quit IRC | 04:53 | |
| *** russellb has quit IRC | 04:53 | |
| clarkb | the ubuntu-minimal element at least didnt include a few things like cron that it should | 04:54 |
| clarkb | a lot of stuff is in coreutils and included | 04:54 |
| prometheanfire | ah | 04:54 |
| *** yamahata has quit IRC | 04:55 | |
| *** zz_zz_ja has quit IRC | 04:55 | |
| *** fawadkhaliq has quit IRC | 04:55 | |
| *** roxanaghe has joined #openstack-infra | 04:55 | |
| prometheanfire | ah, guess we don't do cron | 04:55 |
| prometheanfire | https://gitweb.gentoo.org/proj/releng.git/tree/releases/weekly/specs/amd64/stage4-minimal.spec#n20 | 04:55 |
| *** pabelanger has quit IRC | 04:55 | |
| *** lifeless has quit IRC | 04:55 | |
| *** gsilvis has quit IRC | 04:55 | |
| *** SlickNik has quit IRC | 04:55 | |
| bkero | clarkb, greghaynes: Does pkg-map support empty strings? | 04:55 |
| clarkb | ya not sure why that seems a common choice | 04:55 |
| clarkb | bkero: as the value side? yup | 04:56 |
| *** lifeless has joined #openstack-infra | 04:56 | |
| prometheanfire | some people just don't want or need it for 'minimal' | 04:56 |
| *** gsilvis has joined #openstack-infra | 04:56 | |
| prometheanfire | we wanted to shrink the image as much as we could | 04:56 |
| clarkb | prometheanfire: ya but posix has trained everyone to expect it | 04:56 |
| prometheanfire | true, but now people want containers, etc | 04:56 |
| *** signed8bit has quit IRC | 04:57 | |
| bkero | There's a bunch of junk in posix | 04:57 |
| bkero | like the sccs stuff | 04:57 |
| prometheanfire | 238M is still kinda big | 04:57 |
| bkero | also gcc | 04:57 |
| prometheanfire | http://gentoo.osuosl.org/releases/amd64/autobuilds/20160310/ | 04:57 |
| ianw | clarkb: isn't this really what lsb-core was supposed to be? | 04:57 |
| clarkb | bkero ya, but there us a lot of usefulness too | 04:57 |
| *** Daisy has joined #openstack-infra | 04:57 | |
| *** SlickNik has joined #openstack-infra | 04:57 | |
| clarkb | ianw: maybe? I just want working VMs | 04:57 |
| prometheanfire | there is, some consider cron useful | 04:57 |
| prometheanfire | some don't | 04:57 |
| clarkb | and its really frustrating that we compromise function for containers or $otherusecasepeoplethatknowtheyneeditcanexplocitlydothingsfor | 04:58 |
| prometheanfire | true | 04:58 |
| bkero | I don't really think posix is a good metric for useful though. I'd hope LSB would come out with something better. | 04:58 |
| prometheanfire | our stuff is tarballs could be used for both | 04:58 |
| clarkb | if I am building the smallest image possible for my use case I will do tjat an edit to the need | 04:58 |
| prometheanfire | I should probably add posix stuff to the gentoo element | 04:58 |
| *** Swanson has quit IRC | 04:58 | |
| bkero | prometheanfire: you can add gentoo to the posix element pkg-map when I submit it | 04:59 |
| clarkb | but most people eant a working ubuntu or gentoo or ce tos | 04:59 |
| *** russellb has joined #openstack-infra | 04:59 | |
| prometheanfire | ya | 04:59 |
| *** heyongli_ has quit IRC | 04:59 | |
| prometheanfire | I will likely do so | 04:59 |
| prometheanfire | bkero: review link? | 04:59 |
| bkero | prometheanfire: It's not up yet. I'm testing it atm. | 04:59 |
| *** ansiwen has joined #openstack-infra | 04:59 | |
| *** heyongli_ has joined #openstack-infra | 04:59 | |
| prometheanfire | bkero: let me know when | 04:59 |
| clarkb | thus means cron and an ssh server and cloud init type system should be present | 04:59 |
| bkero | It should be up shortly if I submit without redhat | 04:59 |
| bkero | or a bit longer if I wait to include redhat packages | 04:59 |
| *** roxanaghe has quit IRC | 04:59 | |
| prometheanfire | no one cares about redhat | 04:59 |
| *** thorst has joined #openstack-infra | 04:59 | |
| bkero | ssh-server isn't part of posix | 05:00 |
| clarkb | bkero: no | 05:00 |
| clarkb | posix is orthogonal | 05:00 |
| clarkb | I was told hey you can have an element for these other things | 05:00 |
| clarkb | so its progress | 05:00 |
| *** signed8bit has joined #openstack-infra | 05:00 | |
| prometheanfire | I made the cloud-init element specifically because we don't include it | 05:01 |
| prometheanfire | for instance | 05:01 |
| prometheanfire | 'we' being gentoo-minimal | 05:01 |
| prometheanfire | our gentoo-cloud does though | 05:01 |
| *** zz_ja has joined #openstack-infra | 05:01 | |
| clarkb | ya none of the minimals do iirc | 05:01 |
| prometheanfire | but some of us like simple-init :P | 05:01 |
| *** achanda has quit IRC | 05:01 | |
| clarkb | glean works and allows rax boots usually. I think its fine to explicitly choose glean over cloud-init if you know you need it | 05:02 |
| *** bswartz has quit IRC | 05:02 | |
| clarkb | but most of your users making cloud images are going to take that image and boot it in an opemstack cloud which means ssh and cloud init are useful | 05:03 |
| prometheanfire | ya | 05:03 |
| *** rossella_s has quit IRC | 05:03 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:03 | |
| prometheanfire | we support both | 05:03 |
| *** rossella_s has joined #openstack-infra | 05:03 | |
| *** pabelanger has joined #openstack-infra | 05:03 | |
| clarkb | bkero: also I like having a C compiler | 05:04 |
| prometheanfire | not sure that should be in posix, but meh | 05:04 |
| bkero | and a fortran compiler, just in case ;) | 05:04 |
| clarkb | bkero: useful for numpy | 05:04 |
| bkero | also 44 year old oracle version control software | 05:04 |
| prometheanfire | asm | 05:05 |
| prometheanfire | kthnx | 05:05 |
| clarkb | the best part is that version of the standard is only ~8years old | 05:05 |
| prometheanfire | [I] dev-lang/nasm | 05:05 |
| prometheanfire | the 'I' means it's installed :P | 05:05 |
| bkero | thanks eix | 05:06 |
| prometheanfire | bkero knows :P | 05:06 |
| clarkb | bkero also if you ever living computer museum the lisa running xenix is amazing. it has a cc too | 05:06 |
| *** thorst has quit IRC | 05:07 | |
| Clint | i'm amazed that a lisa is still running | 05:07 |
| *** yamahata has joined #openstack-infra | 05:08 | |
| prometheanfire | old silicon helps, doesn't degrade as fast | 05:08 |
| *** kzaitsev_mb has quit IRC | 05:08 | |
| clarkb | they have the only running pdp7 in the world | 05:09 |
| *** heyongli_ has quit IRC | 05:09 | |
| clarkb | or is it 8? | 05:09 |
| *** Swanson has joined #openstack-infra | 05:09 | |
| prometheanfire | I was just going to mention all the pdp-8s running | 05:09 |
| clarkb | and you can bang on the pdp11s teletype | 05:09 |
| StevenK | Last time I was there they had 2 PDP-7s set up as part of the a display, but I think they were only models | 05:09 |
| *** heyongli_ has joined #openstack-infra | 05:09 | |
| prometheanfire | I think pdp-8 is still common to find | 05:09 |
| *** cody-somerville has quit IRC | 05:10 | |
| * bkero trying to find what's causing "installing False from posix" | 05:11 | |
| bkero | http://paste.openstack.org/show/491035/ | 05:11 |
| prometheanfire | not sure, what's the package list? | 05:12 |
| bkero | http://paste.openstack.org/show/491036/ | 05:12 |
| clarkb | it calls pkg-map with your package items | 05:12 |
| prometheanfire | cat instead of head? | 05:13 |
| bkero | It's a big list | 05:13 |
| prometheanfire | so | 05:13 |
| bkero | ok | 05:13 |
| prometheanfire | it's a paste :P | 05:13 |
| bkero | http://paste.openstack.org/show/491037/ | 05:13 |
| *** mylu has quit IRC | 05:13 | |
| prometheanfire | well, false is in the list, wonder if that confuses it | 05:14 |
| clarkb | oh ya | 05:14 |
| clarkb | its yaml | 05:14 |
| clarkb | use quotes around it | 05:14 |
| bkero | Really? Bah | 05:14 |
| bkero | Haha | 05:14 |
| bkero | That's kinda funny though | 05:14 |
| prometheanfire | line 376 | 05:14 |
| clarkb | same with true | 05:14 |
| bkero | I just sourced it from others | 05:14 |
| bkero | I'm going to :1,$s/^/"/ and :1,$s/:$/":/ | 05:15 |
| prometheanfire | ya, I'd just quote all the things | 05:15 |
| bkero | done, let's try that | 05:15 |
| bkero | The redhat ones are probably wrong, but I'll fix those once ubuntu is happy | 05:15 |
| *** sc68cal has quit IRC | 05:16 | |
| clarkb | silly yaml | 05:16 |
| prometheanfire | ya, noone cares about RH | 05:16 |
| bkero | clarkb, prometheanfire: thoughts on if I should include cssc, the linux sccs binry? | 05:16 |
| bkero | also gcc for c99 | 05:16 |
| bkero | Ugh, now reading pkg-map failed. Gotta find out what breaks the json. ValueError: No JSON object could be decoded | 05:16 |
| prometheanfire | lol | 05:16 |
| clarkb | cssc is in git | 05:17 |
| prometheanfire | cssc is packaged by us at least | 05:17 |
| clarkb | this is amusing to me | 05:17 |
| prometheanfire | ya, don't gnu not like git | 05:17 |
| clarkb | bkero its always a stray comma | 05:17 |
| prometheanfire | cvs or something | 05:17 |
| prometheanfire | or colon | 05:17 |
| bkero | wtf, jsonlint.com puts a newline on one of my lines whenever I click validate | 05:18 |
| clarkb | they migrated from.cvs in 2010 | 05:18 |
| prometheanfire | huh, didn't know that | 05:18 |
| bkero | and extra commas | 05:19 |
| *** heyongli_ has quit IRC | 05:19 | |
| bkero | Ok, think I fixed | 05:19 |
| *** heyongli_ has joined #openstack-infra | 05:20 | |
| *** salv-orlando has joined #openstack-infra | 05:23 | |
| *** cody-somerville has joined #openstack-infra | 05:23 | |
| bkero | Success! | 05:23 |
| prometheanfire | :D | 05:24 |
| *** roxanaghe has joined #openstack-infra | 05:25 | |
| clarkb | apparently cssc is still maintained but rcs is not | 05:27 |
| clarkb | quick convert all your rcs to sccs | 05:27 |
| *** bswartz has joined #openstack-infra | 05:29 | |
| bkero | bleh | 05:29 |
| bkero | Mozilla still manages their mail aliases file in rcs | 05:29 |
| *** heyongli_ has quit IRC | 05:29 | |
| bkero | It's been in RCS since netscape | 05:30 |
| prometheanfire | git + puppet for us | 05:30 |
| prometheanfire | in yaml even (hiera) | 05:30 |
| *** roxanaghe has quit IRC | 05:31 | |
| bkero | Ok, everything is working. Testing to see how big it bloats the minimal install now. | 05:33 |
| *** salv-orlando has quit IRC | 05:34 | |
| bkero | Wow, a 'dib ubuntu vm posix' took 2m10s, a 'dib ubuntu-minimal vm posix' took 8m10s | 05:35 |
| bkero | clarkb: Uhhh. Without cssc/gcc, the ubuntu image is 353mb. the ubuntu-minimal image is 376mb | 05:36 |
| bkero | 'ubuntu vm posix' = 353mb qcow2, 'ubuntu-minimal vm posix' = 376mb qcow2...somehow | 05:36 |
| prometheanfire | because it dirties up the disk somehow I guess | 05:37 |
| ianw | bkero: you probably want to run with https://review.openstack.org/#/c/289629/ applied | 05:37 |
| bkero | We're supposed to be cleaning that up now | 05:37 |
| bkero | ianw: that's not applied yet? Bah | 05:37 |
| ianw | it'll make it much easier to compare where space is going | 05:37 |
| bkero | right | 05:38 |
| *** Daisy has quit IRC | 05:38 | |
| ianw | of course you can mount the images, etc, but it's a bit of a pita | 05:38 |
| *** Daisy has joined #openstack-infra | 05:38 | |
| *** heyongli has joined #openstack-infra | 05:40 | |
| *** gongysh has quit IRC | 05:42 | |
| *** gongysh has joined #openstack-infra | 05:42 | |
| *** [HeOS] has joined #openstack-infra | 05:43 | |
| bkero | ianw: are fstrim patches merged? | 05:43 |
| prometheanfire | iirc it did | 05:43 |
| bkero | Hmm, I see a 'fstrim-image' bash function, but don't see it being called from disk-image-create | 05:44 |
| bkero | Ah | 05:44 |
| bkero | ianw: that review should get rebased methinks | 05:45 |
| bkero | I downloaded a copy and moved it into place, but it wasn't rebased against the master | 05:45 |
| *** mylu has joined #openstack-infra | 05:45 | |
| *** HeOS has quit IRC | 05:46 | |
| *** bswartz has quit IRC | 05:46 | |
| *** Daisy_ has joined #openstack-infra | 05:48 | |
| *** mylu has quit IRC | 05:48 | |
| openstackgerrit | Tony Breeds proposed openstack/requirements: Revert "Tolerate both new and old setuptools" https://review.openstack.org/294396 | 05:49 |
| *** heyongli has quit IRC | 05:50 | |
| *** heyongli has joined #openstack-infra | 05:50 | |
| *** Daisy has quit IRC | 05:51 | |
| *** asettle has quit IRC | 05:57 | |
| *** jaosorior has joined #openstack-infra | 05:57 | |
| bkero | clarkb: still testing, but it adds 19MB to an 'ubuntu vm' element set image | 05:59 |
| bkero | So I'd wager it would add 19-20MB to an ubuntu-minimal image | 05:59 |
| *** heyongli has quit IRC | 06:00 | |
| *** heyongli has joined #openstack-infra | 06:01 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: correct data processing meeting times https://review.openstack.org/294042 | 06:01 |
| *** kzaitsev_mb has joined #openstack-infra | 06:04 | |
| *** tphummel has quit IRC | 06:06 | |
| *** thorst has joined #openstack-infra | 06:06 | |
| *** kzaitsev_mb has quit IRC | 06:09 | |
| *** sdake has quit IRC | 06:09 | |
| *** heyongli has quit IRC | 06:10 | |
| *** heyongli has joined #openstack-infra | 06:11 | |
| *** thorst has quit IRC | 06:12 | |
| *** nadya has joined #openstack-infra | 06:12 | |
| *** nadya has quit IRC | 06:13 | |
| *** amotoki has joined #openstack-infra | 06:14 | |
| *** aeng has quit IRC | 06:15 | |
| *** pcaruana has quit IRC | 06:18 | |
| *** heyongli has quit IRC | 06:21 | |
| *** heyongli has joined #openstack-infra | 06:21 | |
| *** Sukhdev has joined #openstack-infra | 06:21 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/293933 | 06:30 |
| *** heyongli has quit IRC | 06:31 | |
| *** heyongli has joined #openstack-infra | 06:31 | |
| *** salv-orlando has joined #openstack-infra | 06:33 | |
| *** rcernin has joined #openstack-infra | 06:37 | |
| *** yamahata has quit IRC | 06:40 | |
| *** salv-orlando has quit IRC | 06:41 | |
| *** heyongli has quit IRC | 06:41 | |
| *** heyongli has joined #openstack-infra | 06:42 | |
| *** SumitNaiksatam has left #openstack-infra | 06:44 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/288849 | 06:44 |
| *** gildub has quit IRC | 06:46 | |
| *** mahatic has quit IRC | 06:46 | |
| *** llu has joined #openstack-infra | 06:47 | |
| *** tzn has joined #openstack-infra | 06:47 | |
| *** mahatic has joined #openstack-infra | 06:47 | |
| *** markvoelker has joined #openstack-infra | 06:48 | |
| *** tzn has quit IRC | 06:48 | |
| *** heyongli has quit IRC | 06:51 | |
| llu | anyone know how long does it take for https://review.openstack.org/#/c/294233/ make effect? | 06:52 |
| *** markvoelker has quit IRC | 06:52 | |
| *** heyongli has joined #openstack-infra | 06:52 | |
| llu | I still see uuidgen missing on the gate http://logs.openstack.org/04/294404/1/check/gate-telemetry-dsvm-integration-gnocchi/8505bd2/logs/devstacklog.txt.gz#_2016-03-18_06_14_50_787 | 06:52 |
| *** Daisy_ is now known as Daisy | 06:56 | |
| *** heyongli has quit IRC | 07:02 | |
| *** heyongli has joined #openstack-infra | 07:02 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:05 | |
| *** yamahata has joined #openstack-infra | 07:07 | |
| yamamoto_ | what's different between devstack-trusty and ubuntu-trusty? | 07:08 |
| *** thorst has joined #openstack-infra | 07:09 | |
| *** armax has quit IRC | 07:10 | |
| *** kzaitsev_mb has quit IRC | 07:10 | |
| *** heyongli has quit IRC | 07:12 | |
| *** heyongli has joined #openstack-infra | 07:12 | |
| *** salv-orlando has joined #openstack-infra | 07:14 | |
| *** peterlisak has joined #openstack-infra | 07:14 | |
| *** onovy has joined #openstack-infra | 07:14 | |
| *** mikelk has joined #openstack-infra | 07:16 | |
| *** salv-orl_ has joined #openstack-infra | 07:16 | |
| *** scheuran has joined #openstack-infra | 07:16 | |
| *** thorst has quit IRC | 07:16 | |
| *** Sukhdev has quit IRC | 07:17 | |
| *** salv-orlando has quit IRC | 07:19 | |
| *** yamahata has quit IRC | 07:20 | |
| *** heyongli has quit IRC | 07:22 | |
| *** heyongli has joined #openstack-infra | 07:23 | |
| bkero | clarkb: http://paste.openstack.org/show/491044/ | 07:23 |
| *** abregman has joined #openstack-infra | 07:27 | |
| *** heyongli has quit IRC | 07:32 | |
| *** heyongli has joined #openstack-infra | 07:33 | |
| *** BobBall_ has joined #openstack-infra | 07:33 | |
| *** BobBall_ is now known as Guest92185 | 07:34 | |
| *** camunoz has quit IRC | 07:34 | |
| *** e0ne has joined #openstack-infra | 07:35 | |
| *** BobBall has quit IRC | 07:36 | |
| *** hichihara has quit IRC | 07:37 | |
| *** BobBall has joined #openstack-infra | 07:38 | |
| *** Guest92185 has quit IRC | 07:38 | |
| *** BobBall is now known as Guest36326 | 07:39 | |
| *** sflanigan has quit IRC | 07:40 | |
| *** akaszuba_ has joined #openstack-infra | 07:41 | |
| *** akaszuba has joined #openstack-infra | 07:41 | |
| *** e0ne has quit IRC | 07:41 | |
| *** akaszuba_ has quit IRC | 07:41 | |
| *** Daisy_ has joined #openstack-infra | 07:43 | |
| *** heyongli has quit IRC | 07:43 | |
| *** heyongli has joined #openstack-infra | 07:43 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Add a job to build Debian packages https://review.openstack.org/294022 | 07:43 |
| *** achanda has joined #openstack-infra | 07:44 | |
| *** Daisy has quit IRC | 07:46 | |
| *** achanda has quit IRC | 07:48 | |
| AJaeger | yamamoto_: a different way of building those. | 07:48 |
| AJaeger | yamamoto_: why do you ask? What problem are you hitting? | 07:48 |
| AJaeger | llu: looks like ovh-bhs1 has an old ubuntu-trusty image. infra-root, can you confirm? Should we remove those for now? | 07:50 |
| *** |-paul-| has joined #openstack-infra | 07:50 | |
| *** heyongli has quit IRC | 07:53 | |
| *** heyongli has joined #openstack-infra | 07:53 | |
| *** pcaruana has joined #openstack-infra | 07:57 | |
| *** flwang has joined #openstack-infra | 08:02 | |
| *** salv-orl_ has quit IRC | 08:03 | |
| *** heyongli has quit IRC | 08:03 | |
| *** heyongli has joined #openstack-infra | 08:04 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/293933 | 08:05 |
| *** abregman is now known as abregman|nb | 08:05 | |
| *** jlanoux has joined #openstack-infra | 08:09 | |
| *** heyongli has quit IRC | 08:13 | |
| *** Daisy_ has quit IRC | 08:14 | |
| *** heyongli has joined #openstack-infra | 08:14 | |
| *** Daisy has joined #openstack-infra | 08:14 | |
| *** thorst has joined #openstack-infra | 08:14 | |
| *** Daisy_ has joined #openstack-infra | 08:15 | |
| *** flwang has quit IRC | 08:18 | |
| *** Daisy has quit IRC | 08:18 | |
| *** jogo has quit IRC | 08:19 | |
| *** bauzas is now known as bauwser | 08:20 | |
| *** tesseract has joined #openstack-infra | 08:20 | |
| *** tesseract is now known as Guest59954 | 08:21 | |
| *** thorst has quit IRC | 08:21 | |
| *** ihrachys has joined #openstack-infra | 08:22 | |
| *** heyongli has quit IRC | 08:24 | |
| *** heyongli has joined #openstack-infra | 08:24 | |
| *** Guest59954 is now known as new | 08:25 | |
| yolanda | hi AJaeger, let me check images | 08:25 |
| *** new has quit IRC | 08:26 | |
| *** vincentll has joined #openstack-infra | 08:26 | |
| *** tesseract- has joined #openstack-infra | 08:26 | |
| *** Daisy_ has quit IRC | 08:29 | |
| *** jogo has joined #openstack-infra | 08:29 | |
| *** jogo has joined #openstack-infra | 08:29 | |
| *** Daisy has joined #openstack-infra | 08:29 | |
| yolanda | AJaeger, yes, ubuntu-trusty in ovh-bhs1 is dated from 10 days | 08:30 |
| *** ihrachys_ has joined #openstack-infra | 08:30 | |
| yolanda | going to check what's the problem to don't be generated | 08:30 |
| *** Daisy has quit IRC | 08:30 | |
| *** Daisy has joined #openstack-infra | 08:31 | |
| *** ihrachys has quit IRC | 08:31 | |
| *** Daisy has quit IRC | 08:33 | |
| *** Daisy has joined #openstack-infra | 08:33 | |
| *** flaper87 has quit IRC | 08:33 | |
| *** esikachev has joined #openstack-infra | 08:33 | |
| *** heyongli has quit IRC | 08:34 | |
| *** flaper87 has joined #openstack-infra | 08:34 | |
| *** heyongli has joined #openstack-infra | 08:34 | |
| AJaeger | yolanda: upload takes ages there AFAIR ;( | 08:35 |
| yolanda | i'm trying one upload now | 08:36 |
| openstackgerrit | Merged openstack-infra/project-config: Add non voting job to test k8s with dib atomic image https://review.openstack.org/294112 | 08:36 |
| AJaeger | yolanda: could you review https://review.openstack.org/#/c/285519/ later, please? | 08:36 |
| yolanda | sure | 08:36 |
| yolanda | i just started with the review queue now | 08:36 |
| AJaeger | thanks | 08:36 |
| *** Daisy has quit IRC | 08:37 | |
| *** Daisy has joined #openstack-infra | 08:37 | |
| yamamoto_ | AJaeger: i'm wondering if the lack of apt-add-repository is due to the difference between them | 08:40 |
| *** flwang has joined #openstack-infra | 08:41 | |
| openstackgerrit | Merged openstack-infra/system-config: Remove http.maxWait hack as fixed in Gerrit 2.5 https://review.openstack.org/207941 | 08:42 |
| openstackgerrit | Merged openstack-infra/system-config: Fix tab name indices in status template https://review.openstack.org/294266 | 08:42 |
| *** ihrachys has joined #openstack-infra | 08:44 | |
| AJaeger | jhesketh: could you review https://review.openstack.org/#/c/271128/13/jenkins/jobs/projects.yaml again? I answered your concern and think this is fine to go in... | 08:44 |
| *** heyongli has quit IRC | 08:44 | |
| AJaeger | yamamoto_: yes, it is. | 08:44 |
| *** heyongli has joined #openstack-infra | 08:45 | |
| *** takashi has quit IRC | 08:45 | |
| openstackgerrit | Merged openstack-infra/project-config: oslo.db: don't run tests with SQLAlchemy 0.9.x https://review.openstack.org/294122 | 08:46 |
| AJaeger | there was some discussion during the last 15 h in this channel on this, I don't remember the specific solution for it and suggest you read backscroll | 08:46 |
| *** Daisy has quit IRC | 08:46 | |
| *** ihrachys_ has quit IRC | 08:46 | |
| *** ifarkas has joined #openstack-infra | 08:46 | |
| *** Daisy has joined #openstack-infra | 08:47 | |
| *** placko_ has joined #openstack-infra | 08:47 | |
| aspiers | is there any way to increase my launchpad session expiry? seems I'm logging in at least once a day | 08:47 |
| *** arxcruz has joined #openstack-infra | 08:47 | |
| *** Daisy_ has joined #openstack-infra | 08:48 | |
| *** Daisy has quit IRC | 08:48 | |
| AJaeger | aspiers: not that I know off | 08:48 |
| aspiers | :-( | 08:48 |
| aspiers | it's fairly ludicrous | 08:48 |
| AJaeger | But wait: It does not expire AFAIK if there is action. | 08:49 |
| AJaeger | So, I'm only logged out after an idleness of 12 hours... | 08:49 |
| AJaeger | So, review a bit more ;) | 08:49 |
| openstackgerrit | Merged openstack-infra/project-config: Publishing barbican API Guide to OpenStack site https://review.openstack.org/285519 | 08:50 |
| openstackgerrit | Merged openstack-infra/project-config: Enable gate jobs for Packstack on the stable/mitaka branch https://review.openstack.org/294234 | 08:54 |
| *** heyongli has quit IRC | 08:54 | |
| *** heyongli has joined #openstack-infra | 08:55 | |
| openstackgerrit | Merged openstack-infra/project-config: Improve TripleO testing coverage for Puppet OpenStack CI https://review.openstack.org/294009 | 08:55 |
| *** adrian_otto has quit IRC | 08:55 | |
| *** abregman|nb has quit IRC | 08:56 | |
| yamamoto_ | AJaeger: thank you | 08:57 |
| *** Daisy_ has quit IRC | 08:58 | |
| *** Daisy has joined #openstack-infra | 08:58 | |
| openstackgerrit | Merged openstack-infra/project-config: Add docs publishing jobs for fuel-docs https://review.openstack.org/293399 | 08:59 |
| AJaeger | yamamoto_: so, https://review.openstack.org/294233 might fix it - from when was your build? We have newer images with that fix available | 08:59 |
| *** daemontool has joined #openstack-infra | 08:59 | |
| *** flwang has quit IRC | 09:00 | |
| *** ihrachys has quit IRC | 09:02 | |
| *** rossella_s has quit IRC | 09:03 | |
| *** Daisy has quit IRC | 09:03 | |
| *** rossella_s has joined #openstack-infra | 09:04 | |
| *** ihrachys has joined #openstack-infra | 09:04 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Set default locale to image in debootstrap element https://review.openstack.org/290789 | 09:05 |
| *** heyongli has quit IRC | 09:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Do not set Gnocchi coordinator backend https://review.openstack.org/293424 | 09:05 |
| *** heyongli has joined #openstack-infra | 09:05 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:07 | |
| *** _degorenko|afk is now known as degorenko | 09:08 | |
| *** abregman|nb has joined #openstack-infra | 09:09 | |
| *** jogo has quit IRC | 09:10 | |
| *** jogo has joined #openstack-infra | 09:12 | |
| *** Daisy has joined #openstack-infra | 09:12 | |
| *** kzaitsev_mb has quit IRC | 09:12 | |
| *** Daisy has quit IRC | 09:13 | |
| *** Daisy has joined #openstack-infra | 09:14 | |
| *** armax has joined #openstack-infra | 09:14 | |
| yamamoto_ | AJaeger: the latest failure i'm aware of is: http://logs.openstack.org/87/199387/23/check/gate-tempest-dsvm-networking-midonet-v2/ea7c345/ | 09:15 |
| *** heyongli has quit IRC | 09:15 | |
| *** heyongli has joined #openstack-infra | 09:15 | |
| *** Daisy_ has joined #openstack-infra | 09:16 | |
| *** Daisy has quit IRC | 09:17 | |
| *** vincentll has quit IRC | 09:18 | |
| *** thorst has joined #openstack-infra | 09:19 | |
| *** zeih_ has joined #openstack-infra | 09:21 | |
| *** derekh has joined #openstack-infra | 09:22 | |
| AJaeger | that's ubuntu-trusty-vexxhost-ca-ymq - let's see what the experts say when they are awake again. Clarkb, what was the resolution on apt-add-repository ? ^ | 09:23 |
| *** salv-orlando has joined #openstack-infra | 09:24 | |
| *** heyongli has quit IRC | 09:25 | |
| *** heyongli has joined #openstack-infra | 09:26 | |
| *** Daisy_ has quit IRC | 09:27 | |
| *** thorst has quit IRC | 09:27 | |
| *** Daisy has joined #openstack-infra | 09:27 | |
| *** jistr has joined #openstack-infra | 09:28 | |
| *** mrunge has quit IRC | 09:30 | |
| *** mrunge has joined #openstack-infra | 09:30 | |
| *** ihrachys has quit IRC | 09:31 | |
| *** Daisy has quit IRC | 09:32 | |
| *** ihrachys has joined #openstack-infra | 09:32 | |
| *** nadya has joined #openstack-infra | 09:33 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:34 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 09:34 |
| *** nadya has quit IRC | 09:34 | |
| *** matrohon has joined #openstack-infra | 09:35 | |
| *** vincentll has joined #openstack-infra | 09:35 | |
| *** heyongli has quit IRC | 09:36 | |
| *** nadya has joined #openstack-infra | 09:36 | |
| *** heyongli has joined #openstack-infra | 09:36 | |
| *** links has quit IRC | 09:37 | |
| *** fverbs has joined #openstack-infra | 09:38 | |
| *** alex_xu has quit IRC | 09:39 | |
| *** vgridnev has joined #openstack-infra | 09:40 | |
| *** Guest36326 is now known as BobBall | 09:40 | |
| *** abregman|nb has quit IRC | 09:40 | |
| *** abregman has joined #openstack-infra | 09:40 | |
| *** alex_xu has joined #openstack-infra | 09:41 | |
| *** sdague has joined #openstack-infra | 09:43 | |
| *** dims has joined #openstack-infra | 09:43 | |
| yolanda | AJaeger, i see errors on several jenkins masters, going to launch jjb manually | 09:43 |
| *** zhurong has quit IRC | 09:43 | |
| *** heyongli has quit IRC | 09:46 | |
| *** ihrachys_ has joined #openstack-infra | 09:46 | |
| *** heyongli has joined #openstack-infra | 09:46 | |
| *** ihrachys has quit IRC | 09:47 | |
| *** flwang has joined #openstack-infra | 09:48 | |
| yolanda | so on jenkins05 and jenkins06 the cache stopped , partially self-writed. I saw it stopped on python-senlinclient jobs, with a line with missing fields. So something is still going wrong with caching, and i verified that there were no jjb running when i launched the processes, so there is something else | 09:49 |
| AJaeger | yolanda: pabelanger had to update twice jenkins manually last night, but I remember only 05 mentioned. | 09:54 |
| yolanda | 5,6,7 are buggy | 09:55 |
| AJaeger | ;( | 09:55 |
| yolanda | cache corruption, i'm trying to manually amend the cache to avoid full reconfig | 09:55 |
| yolanda | i was thinking in some alternative for updating jobs in jjb, maybe just have one step to generate the job differents, then some daemon in jjb that updates progressively | 09:56 |
| *** heyongli has quit IRC | 09:56 | |
| yolanda | because right now there are constant crashes with timeouts | 09:56 |
| *** heyongli has joined #openstack-infra | 09:56 | |
| rcarrillocruz | weee , yay jjb | 09:57 |
| yolanda | our old friend :) | 09:57 |
| *** dizquierdo has joined #openstack-infra | 09:58 | |
| *** rguillebert has joined #openstack-infra | 09:59 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Fix non-replaced var in magnum job https://review.openstack.org/294482 | 09:59 |
| yolanda | AJaeger, my check for magnum had a bug ^ | 10:00 |
| AJaeger | yolanda: with zuul v3 we don't use jjb anymore, don't we? | 10:01 |
| *** [HeOS] has quit IRC | 10:01 | |
| yolanda | yep, we should get rid of it | 10:01 |
| *** rguillebert has quit IRC | 10:01 | |
| *** rguillebert has joined #openstack-infra | 10:01 | |
| yolanda | ah AJaeger look at this test failure http://logs.openstack.org/89/290789/5/check/gate-dib-dsvm-functests-ubuntu-trusty/a85e313/console.html | 10:03 |
| *** HeOS has joined #openstack-infra | 10:03 | |
| yolanda | dib tests started failing, ubuntu-trusty related? | 10:03 |
| yolanda | it's a missing package, how would you fix it? | 10:03 |
| *** ociuhandu has quit IRC | 10:04 | |
| *** heyongli has quit IRC | 10:06 | |
| *** tpsilva has joined #openstack-infra | 10:06 | |
| *** heyongli has joined #openstack-infra | 10:07 | |
| rcarrillocruz | iirc, sdague had a change to add uuidgen | 10:09 |
| rcarrillocruz | but was abandoned in favor of https://review.openstack.org/#/c/294233/ | 10:09 |
| rcarrillocruz | yolanda, AJaeger ^ | 10:09 |
| yolanda | thx checking | 10:09 |
| AJaeger | yolanda: clarkb, was generating and uploading new images with thta fix in. | 10:10 |
| AJaeger | Apparently osic-cloud1 was not updated ;( | 10:10 |
| yolanda | oh, image updates... | 10:10 |
| yolanda | going to check age of that | 10:10 |
| *** jordanP has joined #openstack-infra | 10:11 | |
| yolanda | image is updated, 15 hours old | 10:11 |
| yolanda | going to trigger a recheck | 10:12 |
| *** gongysh has quit IRC | 10:12 | |
| *** ihrachys_ has quit IRC | 10:13 | |
| AJaeger | yolanda: the patch merged 14 hours ago, so the image is outdated | 10:13 |
| yolanda | agh, 1 hour diff | 10:14 |
| yolanda | i'll wait for the image rebuilds of today | 10:14 |
| *** jaosorior has quit IRC | 10:14 | |
| *** asselin__ has joined #openstack-infra | 10:14 | |
| AJaeger | ok | 10:14 |
| *** jaosorior has joined #openstack-infra | 10:15 | |
| *** ihrachys has joined #openstack-infra | 10:15 | |
| *** asselin_ has quit IRC | 10:16 | |
| *** heyongli has quit IRC | 10:17 | |
| *** heyongli has joined #openstack-infra | 10:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix non-replaced var in magnum job https://review.openstack.org/294482 | 10:18 |
| *** kzaitsev_mb has quit IRC | 10:20 | |
| *** vincentll has quit IRC | 10:22 | |
| *** sambetts|afk is now known as sambetts | 10:24 | |
| *** thorst has joined #openstack-infra | 10:24 | |
| *** alex_xu has quit IRC | 10:27 | |
| *** heyongli has quit IRC | 10:27 | |
| *** heyongli has joined #openstack-infra | 10:27 | |
| *** claudiub has joined #openstack-infra | 10:28 | |
| *** alex_xu has joined #openstack-infra | 10:28 | |
| mescanef | hello infra roots:-) | 10:31 |
| mescanef | AJaeger: I see you are around:-) | 10:31 |
| *** thorst has quit IRC | 10:32 | |
| * AJaeger is not an infra root and hides ;) | 10:32 | |
| mescanef | i need to discuss one project creation under openstack namespace before ill create a patch | 10:33 |
| mescanef | of course its about fuel-plugin | 10:33 |
| mescanef | :-) | 10:33 |
| AJaeger | ;) | 10:34 |
| AJaeger | shoot | 10:34 |
| mescanef | AJaeger: there are at least three projects under Openstack NS starting with "fuel-plugin-detach-*" name | 10:34 |
| *** links has joined #openstack-infra | 10:35 | |
| mescanef | and the yet another, related, connected, is under development on github repo, will support >=8.0 Fuel | 10:35 |
| mescanef | developed by "Fuel community" | 10:35 |
| mescanef | https://github.com/adidenko/fuel-plugin-detach-haproxy | 10:35 |
| *** amotoki has quit IRC | 10:36 | |
| mescanef | so no binary files, O.S. license | 10:36 |
| mescanef | and, as there are already fuel-plugin-detach-* projects, could this one be added too? | 10:36 |
| *** vincentll has joined #openstack-infra | 10:36 | |
| *** heyongli has quit IRC | 10:37 | |
| AJaeger | mescanef: It's going to be used as part of an OpenSTack install, so shouldn't be a problem | 10:37 |
| mescanef | :+) | 10:37 |
| *** heyongli has joined #openstack-infra | 10:37 | |
| mescanef | AJaeger: great, thanks, will create a patch soon | 10:38 |
| openstackgerrit | Dougal Matthews proposed openstack-dev/pbr: Correct the indentation in the classifiers example https://review.openstack.org/294500 | 10:40 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations https://review.openstack.org/288715 | 10:40 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add release notes to openstack-manuals https://review.openstack.org/294502 | 10:41 |
| *** doug-fish has quit IRC | 10:41 | |
| *** vincentll has quit IRC | 10:42 | |
| *** amotoki has joined #openstack-infra | 10:46 | |
| *** heyongli has quit IRC | 10:47 | |
| *** ihrachys has quit IRC | 10:47 | |
| *** heyongli has joined #openstack-infra | 10:48 | |
| *** vincentll has joined #openstack-infra | 10:48 | |
| *** flaper87 has quit IRC | 10:49 | |
| *** flaper87 has joined #openstack-infra | 10:49 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add release notes to openstack-manuals https://review.openstack.org/294502 | 10:53 |
| *** vincentll has quit IRC | 10:55 | |
| *** heyongli has quit IRC | 10:58 | |
| *** heyongli has joined #openstack-infra | 10:58 | |
| *** moravec has joined #openstack-infra | 10:58 | |
| *** BobBall_ has joined #openstack-infra | 10:59 | |
| *** BobBall_ is now known as Guest86473 | 10:59 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Update wanted_ci_job to reflect current status of things https://review.openstack.org/294071 | 11:00 |
| *** ociuhandu has joined #openstack-infra | 11:00 | |
| *** BobBall has quit IRC | 11:02 | |
| *** kashyap has joined #openstack-infra | 11:03 | |
| *** Guest86473 has quit IRC | 11:03 | |
| kashyap | Is there a way I can subscribe to all upcoming bugs for a specific tag? | 11:04 |
| *** BobBall has joined #openstack-infra | 11:04 | |
| *** BobBall is now known as Guest72270 | 11:04 | |
| *** vincentll has joined #openstack-infra | 11:05 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Use --overcloud-update in the upgrades job https://review.openstack.org/260466 | 11:06 |
| *** tosky has joined #openstack-infra | 11:06 | |
| *** Guest72270 is now known as BobBall2 | 11:07 | |
| *** heyongli has quit IRC | 11:08 | |
| *** heyongli has joined #openstack-infra | 11:08 | |
| *** e0ne has joined #openstack-infra | 11:08 | |
| *** binbincong has quit IRC | 11:13 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Deploy ceph in the nonha job https://review.openstack.org/293051 | 11:15 |
| *** amotoki_ has joined #openstack-infra | 11:17 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:18 | |
| *** heyongli has quit IRC | 11:18 | |
| *** heyongli has joined #openstack-infra | 11:18 | |
| *** amotoki has quit IRC | 11:20 | |
| *** rhallisey has joined #openstack-infra | 11:21 | |
| *** piet has joined #openstack-infra | 11:21 | |
| fungi | heads up, i've got morning errands on the mainland and won't be on the internet for the first half of my day. i may be able to pop in briefly around 1400z while i'm stationary, but won't be back for good until more like 1900z | 11:22 |
| *** binbincong has joined #openstack-infra | 11:24 | |
| Zara | kashyap: which task/issue tracker are you thinking of? | 11:26 |
| *** amotoki_ has quit IRC | 11:27 | |
| *** amotoki has joined #openstack-infra | 11:27 | |
| *** ldnunes has joined #openstack-infra | 11:27 | |
| *** heyongli has quit IRC | 11:28 | |
| *** heyongli has joined #openstack-infra | 11:29 | |
| *** dtantsur is now known as dtantsur|brb | 11:37 | |
| *** heyongli has quit IRC | 11:39 | |
| *** heyongli has joined #openstack-infra | 11:39 | |
| *** amotoki has quit IRC | 11:39 | |
| *** thorst has joined #openstack-infra | 11:41 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Properly setup DNS for the all CI jobs https://review.openstack.org/293481 | 11:42 |
| kashyap | Zara: E.g. - https://bugs.launchpad.net/nova/+bugs?field.tag=libvirt+ | 11:43 |
| *** piet has quit IRC | 11:43 | |
| AJaeger | fungi, safe travels! | 11:45 |
| *** esikachev has quit IRC | 11:45 | |
| *** kzaitsev_mb has quit IRC | 11:46 | |
| Zara | kashyap: okay, it sounds like you're asking about if you can subscribe to things in that list in launchpad; does anyone with more experience of launchpad know? | 11:47 |
| *** esikachev has joined #openstack-infra | 11:48 | |
| *** andymaier has joined #openstack-infra | 11:48 | |
| *** heyongli has quit IRC | 11:49 | |
| *** heyongli has joined #openstack-infra | 11:49 | |
| openstackgerrit | Julia Kreger proposed openstack-infra/project-config: Add release notes job to bifrost https://review.openstack.org/294541 | 11:53 |
| *** rfolco has joined #openstack-infra | 11:54 | |
| *** aysyd has joined #openstack-infra | 11:56 | |
| *** _amrith_ is now known as amrith | 11:57 | |
| *** Qiming has quit IRC | 11:58 | |
| *** weshay has joined #openstack-infra | 11:58 | |
| *** pfallenop has quit IRC | 11:58 | |
| openstackgerrit | Julia Kreger proposed openstack-infra/project-config: Add release notes job to bifrost https://review.openstack.org/294541 | 11:59 |
| *** heyongli has quit IRC | 11:59 | |
| *** heyongli has joined #openstack-infra | 11:59 | |
| *** aysyd has quit IRC | 12:03 | |
| *** piet has joined #openstack-infra | 12:03 | |
| kashyap | Zara: Sorry for the truncated chat, had to step out | 12:04 |
| *** aysyd has joined #openstack-infra | 12:04 | |
| kashyap | What you're asking is right | 12:04 |
| Zara | okay, I don't have lots of experience with launchpad so I don't know if there's a way to do it; other people here may know; this channel should be busier in the next few hours. If anyone knows, please help! :) | 12:07 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again https://review.openstack.org/288915 | 12:07 |
| AJaeger | project-config cores, I'd like to see some review for release notes jobs, please: https://review.openstack.org/294502 (mine- openstack-manuals), and https://review.openstack.org/294541 (bifrost) | 12:07 |
| *** |-paul-| has quit IRC | 12:07 | |
| *** jcoufal has joined #openstack-infra | 12:08 | |
| *** kzaitsev_mb has joined #openstack-infra | 12:09 | |
| *** Daisy has joined #openstack-infra | 12:09 | |
| *** heyongli has quit IRC | 12:09 | |
| *** gordc has joined #openstack-infra | 12:09 | |
| *** heyongli has joined #openstack-infra | 12:10 | |
| odyssey4me | What's the process for us to remove a repository entirely? We don't need it archived. | 12:10 |
| *** placko_ has quit IRC | 12:10 | |
| openstackgerrit | Vincent Françoise proposed openstack-infra/devstack-gate: Added env variable for subnode conf for multinode https://review.openstack.org/294546 | 12:16 |
| *** edmondsw has joined #openstack-infra | 12:16 | |
| AJaeger | odyssey4me: we never remove, we only retire... | 12:16 |
| AJaeger | odyssey4me: The Infra Manual is your best place for this, let me grab you a link | 12:16 |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: WIP: Use IPv6 on the gate jobs https://review.openstack.org/289445 | 12:17 |
| AJaeger | odyssey4me: http://docs.openstack.org/infra/manual/drivers.html#retiring-a-project | 12:17 |
| odyssey4me | AJaeger great, thanks - we'll do that process. | 12:19 |
| *** dtantsur|brb is now known as dtantsur | 12:19 | |
| *** heyongli has quit IRC | 12:20 | |
| *** heyongli has joined #openstack-infra | 12:20 | |
| *** zeih_ has quit IRC | 12:20 | |
| *** zeih has joined #openstack-infra | 12:21 | |
| *** dtardivel has joined #openstack-infra | 12:22 | |
| yolanda | jenkins06 failed again with timeout :( | 12:23 |
| *** dprince has joined #openstack-infra | 12:23 | |
| *** Qiming has joined #openstack-infra | 12:24 | |
| SamYaple | yolanda: would you be so kind as to approve https://review.openstack.org/#/c/293021/ ? This time it has been validated against the zuul gate (see comments) | 12:24 |
| yolanda | ok going to check | 12:24 |
| jd__ | hey there | 12:25 |
| *** lucasagomes is now known as lucas-hungry | 12:25 | |
| jd__ | the uuidgen issue is still around :( is there a reason? | 12:25 |
| *** baoli has joined #openstack-infra | 12:26 | |
| *** zeih has quit IRC | 12:26 | |
| *** piet has quit IRC | 12:26 | |
| yolanda | jd__ i hit that as well, the images have not been refreshed yet | 12:26 |
| jd__ | damn | 12:26 |
| *** heyongli has quit IRC | 12:30 | |
| *** dizquierdo is now known as dizquierdo_afk | 12:30 | |
| *** heyongli has joined #openstack-infra | 12:30 | |
| ogelbukh_ | good day, I'd like to ask for review on project-config patch that adds a new repo: https://review.openstack.org/#/c/286137/ | 12:30 |
| *** bswartz has joined #openstack-infra | 12:31 | |
| ogelbukh_ | it has relevant SME sign-offs (including the project's PTL) | 12:31 |
| *** pradk has joined #openstack-infra | 12:32 | |
| ogelbukh_ | please, tell me if I can do anything to help with it | 12:32 |
| *** markvoelker has joined #openstack-infra | 12:32 | |
| yolanda | obelbukh_ i am going to take a look | 12:33 |
| yolanda | ogelbukh_, sorry :) | 12:33 |
| SamYaple | yolanda: you seem awfully busy, dont worry about the kolla patch. it is far from a priority | 12:33 |
| ogelbukh_ | yolanda: you shouldn't be, thank you for your time and effort | 12:34 |
| yolanda | SamYaple i must admit i skipped that one from the review queue :) | 12:34 |
| yolanda | going to double check the regex and approve | 12:35 |
| yolanda | SamYaple, for docs regex, all the others i see have ^doc/.*$ | 12:35 |
| yolanda | the finish line $ | 12:35 |
| yolanda | why yours don't ? | 12:35 |
| yolanda | ogelbukh_, approved | 12:36 |
| *** yamamoto_ has quit IRC | 12:36 | |
| *** jaypipes is now known as leakypipes | 12:36 | |
| ogelbukh_ | yolanda: thanks again, that was fast :) | 12:36 |
| SamYaple | yolanda: it matches multiple projects (kolla and kolla-mesos and soon kolla-ansible) | 12:37 |
| yolanda | SamYaple but i mean the skip-if docs | 12:37 |
| SamYaple | yolanda: yes i do to | 12:37 |
| yolanda | all-files-match-any: | 12:38 |
| yolanda | - ^.*\.rst$ | 12:38 |
| yolanda | - ^doc/.* | 12:38 |
| *** doug-fish has joined #openstack-infra | 12:38 | |
| SamYaple | ohhh im sorry | 12:38 |
| SamYaple | you mean the file patching | 12:38 |
| yolanda | yep | 12:38 |
| SamYaple | matching* | 12:38 |
| yolanda | misses endline | 12:38 |
| SamYaple | no particular reason. it was copied from another skip-if | 12:38 |
| yolanda | ah i was checking some others and everything ended with the $ .. it shall work anyway. I think in a subsequent patch we shall go with a single pattern | 12:39 |
| *** doug-fish has quit IRC | 12:39 | |
| *** piet has joined #openstack-infra | 12:40 | |
| SamYaple | yolanda: https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L2356 | 12:40 |
| *** heyongli has quit IRC | 12:40 | |
| *** doug-fish has joined #openstack-infra | 12:40 | |
| SamYaple | i dont think i copied that one, but there are a few in there like that, but youre right | 12:40 |
| *** doug-fish has quit IRC | 12:40 | |
| *** heyongli has joined #openstack-infra | 12:40 | |
| *** Daisy has quit IRC | 12:40 | |
| *** doug-fish has joined #openstack-infra | 12:41 | |
| yolanda | i won't be picky :) | 12:41 |
| *** Daisy has joined #openstack-infra | 12:41 | |
| *** ihrachys has joined #openstack-infra | 12:41 | |
| SamYaple | haha you can be picky. that doesnt bother me! | 12:42 |
| *** abregman is now known as abregman|nb | 12:42 | |
| *** ihrachys has quit IRC | 12:43 | |
| *** baoli_ has joined #openstack-infra | 12:44 | |
| *** rlandy has joined #openstack-infra | 12:44 | |
| *** ihrachys has joined #openstack-infra | 12:44 | |
| *** Daisy has quit IRC | 12:45 | |
| *** baoli has quit IRC | 12:46 | |
| openstackgerrit | Merged openstack-infra/project-config: Add project 'tuning-box' https://review.openstack.org/286137 | 12:46 |
| yolanda | going to have lunch | 12:47 |
| yolanda | ogelbukh_, ping me once you see the project published and i can add you to groups | 12:47 |
| *** zeih has joined #openstack-infra | 12:47 | |
| *** openstackgerrit has quit IRC | 12:48 | |
| *** openstackgerrit has joined #openstack-infra | 12:48 | |
| *** xyang1 has joined #openstack-infra | 12:49 | |
| *** heyongli has quit IRC | 12:50 | |
| *** heyongli has joined #openstack-infra | 12:51 | |
| *** jistr has quit IRC | 12:51 | |
| *** jistr has joined #openstack-infra | 12:51 | |
| *** gnuoy_ has joined #openstack-infra | 12:53 | |
| *** ihrachys has quit IRC | 12:55 | |
| *** gnuoy_ has quit IRC | 12:58 | |
| openstackgerrit | Merged openstack-infra/project-config: Kolla docs-only patch -- take 2 https://review.openstack.org/293021 | 12:58 |
| *** dingyichen has quit IRC | 12:59 | |
| *** tesseract- has quit IRC | 12:59 | |
| *** heyongli has quit IRC | 13:01 | |
| *** heyongli has joined #openstack-infra | 13:01 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Remove 'Subscriptions' button from header dropdown https://review.openstack.org/294579 | 13:04 |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Trigger python27 jobs for packetary-specs project https://review.openstack.org/294580 | 13:05 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove some extra mitaka translation jobs https://review.openstack.org/294286 | 13:05 |
| *** BobBall2 is now known as BobBall | 13:06 | |
| *** salv-orlando has quit IRC | 13:06 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Remove 'Subscriptions' button from header dropdown https://review.openstack.org/294579 | 13:07 |
| *** mrmartin has joined #openstack-infra | 13:07 | |
| *** tesseract has joined #openstack-infra | 13:08 | |
| *** tesseract is now known as Guest84688 | 13:08 | |
| krotscheck | clarkb: Still having issues with the firefox build, building a local slave instance to see if I can reproduce it. | 13:09 |
| krotscheck | Does anyone know if something happened between 4am and 9am PDT yesterday that would cause firefox to freeze? | 13:09 |
| ogelbukh_ | yolanda: it is published already, you can proceed with groups config | 13:09 |
| krotscheck | Sorry | 13:09 |
| krotscheck | Does anyone know if something happened between 4am and 9am PDT yesterday, on our jenkins slaves, that would cause firefox running in an xvfb to freeze? | 13:10 |
| *** gnuoy_ has joined #openstack-infra | 13:10 | |
| *** zeih has quit IRC | 13:10 | |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Trigger python27 and docs jobs for packetary-specs https://review.openstack.org/294580 | 13:10 |
| *** heyongli has quit IRC | 13:11 | |
| *** heyongli has joined #openstack-infra | 13:11 | |
| *** alaski is now known as lascii | 13:11 | |
| *** vgridnev has quit IRC | 13:13 | |
| yolanda | ogelbukh_, done | 13:15 |
| ogelbukh_ | yolanda: great, thanks a lot | 13:15 |
| *** heyongli has quit IRC | 13:21 | |
| *** heyongli has joined #openstack-infra | 13:21 | |
| *** mrmartin has quit IRC | 13:21 | |
| *** links has quit IRC | 13:22 | |
| *** akshai has joined #openstack-infra | 13:22 | |
| *** Daisy has joined #openstack-infra | 13:23 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add domain_id param to project operations https://review.openstack.org/291701 | 13:23 |
| *** vgridnev has joined #openstack-infra | 13:25 | |
| *** placko_ has joined #openstack-infra | 13:26 | |
| * krotscheck is confused. | 13:30 | |
| * Clint pats krotscheck on the head | 13:30 | |
| krotscheck | Some invocations of fireforx work. Others don't. | 13:31 |
| *** heyongli has quit IRC | 13:31 | |
| *** lucas-hungry is now known as lucasagomes | 13:31 | |
| *** heyongli has joined #openstack-infra | 13:32 | |
| Zara | final bit of storyboard email config, still in review, you could help make history: https://review.openstack.org/#/c/293367/ | 13:32 |
| yolanda | Zara, i like your motivation messages :) | 13:32 |
| Zara | yolanda: thanks! :D | 13:32 |
| AJaeger | yolanda: could you review https://review.openstack.org/294502 today , please? | 13:34 |
| yolanda | yes | 13:34 |
| AJaeger | thanks | 13:35 |
| *** _ari_ has joined #openstack-infra | 13:35 | |
| *** armax has quit IRC | 13:35 | |
| *** mriedem has joined #openstack-infra | 13:37 | |
| *** jpr has joined #openstack-infra | 13:37 | |
| *** Daisy has quit IRC | 13:37 | |
| *** heyongli has quit IRC | 13:42 | |
| *** heyongli has joined #openstack-infra | 13:42 | |
| *** esikachev has quit IRC | 13:43 | |
| *** dmellado is now known as dmellado|lunch | 13:44 | |
| *** sdague has quit IRC | 13:45 | |
| *** thiagop has joined #openstack-infra | 13:46 | |
| SamYaple | AJaeger: yolanda the kolla docs-only skip-if is working now :D | 13:46 |
| yolanda | yay! | 13:46 |
| krotscheck | clarkb: Building a local slave vm seems to work fine. | 13:46 |
| AJaeger | SamYaple: great! Thanks for telling us | 13:46 |
| *** esikachev has joined #openstack-infra | 13:47 | |
| krotscheck | I don't suppose someone can grab a jenkins slave and run a few commands for me to see if I'm just going crazy? | 13:47 |
| krotscheck | The last failure I saw was in ovh-gra1 | 13:47 |
| *** dizquierdo_afk is now known as dizquierdo | 13:48 | |
| *** amitgandhinz has joined #openstack-infra | 13:50 | |
| krotscheck | http://paste.openstack.org/show/491103/ | 13:50 |
| anteaya | Zara: ha ha ha, yeah in terms of marketing patches for review, folks could take lessons from you | 13:51 |
| *** heyongli has quit IRC | 13:52 | |
| *** heyongli has joined #openstack-infra | 13:52 | |
| *** gnuoy_ has quit IRC | 13:53 | |
| *** yamamoto has joined #openstack-infra | 13:53 | |
| *** yamamoto has quit IRC | 13:53 | |
| *** yamamoto has joined #openstack-infra | 13:54 | |
| *** jaosorior has quit IRC | 13:54 | |
| *** e0ne has quit IRC | 13:54 | |
| *** yamamoto_ has joined #openstack-infra | 13:54 | |
| *** e0ne has joined #openstack-infra | 13:55 | |
| *** pfallenop has joined #openstack-infra | 13:56 | |
| *** knikolla has joined #openstack-infra | 13:56 | |
| AJaeger | anteaya: good morning! I'd like to see some review for release notes jobs if you have time today, please: https://review.openstack.org/294502 (mine- openstack-manuals), and https://review.openstack.org/294541 (bifrost) | 13:56 |
| Zara | anteaya: haha :) well, I've mistakenly thought that at least 10 different patches have been the 'final' patch by now, so I have to find some way to keep it interesting! | 13:57 |
| Zara | thank you :) | 13:57 |
| anteaya | AJaeger: sure, I can look | 13:57 |
| anteaya | Zara: ha ha ha | 13:58 |
| AJaeger | Lol | 13:58 |
| *** esker has joined #openstack-infra | 13:58 | |
| *** eharney has joined #openstack-infra | 13:58 | |
| *** yamamoto has quit IRC | 13:59 | |
| ogelbukh_ | how can I bump a review that was approved before one that it depended on? https://review.openstack.org/291380 | 13:59 |
| AJaeger | pabelanger: do you know why http://grafana.openstack.org/ does not show the RAX dashboards? | 14:00 |
| AJaeger | ogelbukh_: another +A or toggle the +A - remove it and set it again | 14:00 |
| AJaeger | ogelbukh_: read the Infra Manual on it as well | 14:00 |
| ogelbukh_ | AJaeger: OK so I can't basically do that. :) Thank you. | 14:00 |
| AJaeger | http://docs.openstack.org/infra/manual/developers.html#limitations-and-caveats | 14:01 |
| krotscheck | /me waves the has-gate-builds-failing-for-reasons-he-cannot-debug flag. | 14:01 |
| AJaeger | ogelbukh_: our CI needs an event for the change, another +A is one | 14:01 |
| ogelbukh_ | AJaeger: understood, thanks a lot | 14:01 |
| AJaeger | krotscheck: your message has an extra leading space ;) | 14:01 |
| krotscheck | AJaeger: :-P | 14:01 |
| *** rcernin has quit IRC | 14:01 | |
| AJaeger | krotscheck: sorry, can't help ;( | 14:02 |
| *** heyongli has quit IRC | 14:02 | |
| *** heyongli has joined #openstack-infra | 14:02 | |
| krotscheck | AJaeger: Mayeb you can? Is there some way I can get a hold of one of the actual jenkins slave images? I'm building mine using vagrant and puppet right now. | 14:02 |
| krotscheck | Though I may not be able to root on those. | 14:03 |
| krotscheck | Hrm. | 14:03 |
| krotscheck | THis is not optimal | 14:03 |
| AJaeger | krotscheck: I think one of the infra-roots need to share them with you AFAIK. Perhaps yolanda can help | 14:03 |
| AJaeger | Or later pabelanger or clarkb | 14:03 |
| yolanda | krotscheck i can hold for you | 14:03 |
| yolanda | do you have some id? | 14:03 |
| AJaeger | yolanda: I think krotscheck wants to download one... | 14:04 |
| AJaeger | krotscheck: or do you want to ssh into one? | 14:04 |
| yolanda | krotscheck i can hold for you and put your keys there for example | 14:04 |
| yolanda | will it be useful? | 14:04 |
| *** yamamoto_ has quit IRC | 14:05 | |
| krotscheck | Well, I'd like to debug why these commands http://paste.openstack.org/show/491103/ fail in the gate, but do not fail when run locally | 14:05 |
| krotscheck | yolanda: Lemme find one | 14:05 |
| *** ociuhandu has quit IRC | 14:05 | |
| krotscheck | yolanda: Honestly, I don't know. | 14:05 |
| *** yamamoto has joined #openstack-infra | 14:05 | |
| yolanda | krotscheck if you see some running test, pass the the id of the node and i can hold it | 14:06 |
| krotscheck | yolanda: I'm just trying to find a path to reproduce the error from here: http://logs.openstack.org/60/294160/4/check/gate-ironic-webclient-npm-run-test/1cbbd45/console.html | 14:06 |
| AJaeger | yamamoto: Check https://review.openstack.org/#/c/293744/ - and update your devstack plugin | 14:06 |
| krotscheck | yolanda: Specifically this line http://logs.openstack.org/60/294160/4/check/gate-ironic-webclient-npm-run-test/1cbbd45/console.html#_2016-03-18_13_02_17_222 | 14:06 |
| *** dansmith is now known as superdan | 14:07 | |
| *** knikolla has quit IRC | 14:07 | |
| yolanda | firefox not responding? and works for you locally , same versions? | 14:07 |
| *** erlon has joined #openstack-infra | 14:07 | |
| krotscheck | yolanda: Yep. | 14:07 |
| krotscheck | yolanda: I even built a slave vm locally, tried those commands, works like a charm. | 14:08 |
| yolanda | happens on all providers? | 14:08 |
| krotscheck | yolanda: And it's a change that happened sometime between 4AM and 10AM yesterday (PDT) | 14:08 |
| yolanda | change in images, not in the job, right? | 14:08 |
| krotscheck | yolanda: I don't have enough rechecks to cover all providers. | 14:08 |
| krotscheck | yolanda: Yep. Previously passing job now suddenly fails. | 14:09 |
| *** links has joined #openstack-infra | 14:10 | |
| yolanda | krotscheck has this job being moved to ubuntu-trusty? | 14:10 |
| yolanda | or was it done on previous days and worked? | 14:10 |
| *** yamamoto has quit IRC | 14:10 | |
| *** yamamoto has joined #openstack-infra | 14:10 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:12 | |
| krotscheck | I have failures on rax iad, ovh bhs1, internap nyj01... | 14:12 |
| yolanda | that's a trend then | 14:12 |
| krotscheck | yolanda: This particular patch here used to work, and now doesn't. https://review.openstack.org/#/c/274848/2 | 14:12 |
| *** heyongli has quit IRC | 14:12 | |
| *** heyongli has joined #openstack-infra | 14:13 | |
| krotscheck | An outlier: I have a _passing_ capture of firefox on ovh-gra1 in a different build. | 14:13 |
| yolanda | of today? going to check the age of the images on both providers | 14:13 |
| krotscheck | https://review.openstack.org/#/c/294221/ | 14:14 |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Make it easier to find 'add task' button https://review.openstack.org/294221 | 14:14 |
| yolanda | move to ubuntu-trusty was done on 11/03 so it's something after that | 14:14 |
| anteaya | AJaeger: so the change to openstack-manuals doesn't need to be merged before the manuals job is added? | 14:14 |
| yolanda | rcarrillocruz pointed before to a change in nodepool packages, let me find | 14:14 |
| yolanda | https://review.openstack.org/#/c/294233/ | 14:15 |
| krotscheck | The biggest difference that I can tell between the two is that one runs xvfb with -ac +extension GLX +render -noreset | 14:15 |
| krotscheck | (The breaking one) | 14:15 |
| *** zz_dimtruck is now known as dimtruck | 14:15 | |
| *** krtaylor has quit IRC | 14:15 | |
| *** knikolla has joined #openstack-infra | 14:16 | |
| krotscheck | Could the firefox image be broken? | 14:17 |
| krotscheck | I mean package | 14:18 |
| yolanda | if you can trigger a recheck, and capture the node id, i can hold and we can verify on the node itself, so we get more info | 14:18 |
| *** mrmartin has joined #openstack-infra | 14:18 | |
| *** ajmiller_ has joined #openstack-infra | 14:18 | |
| *** ajmiller has joined #openstack-infra | 14:18 | |
| *** esikachev has quit IRC | 14:18 | |
| *** ajmiller_ has quit IRC | 14:19 | |
| krotscheck | yolanda: Waiting on a node... | 14:20 |
| AJaeger | anteaya: order is not important. since the job is only run if that directory is updated... | 14:21 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Add networking-generic-switch-dsvm job https://review.openstack.org/294128 | 14:22 |
| *** heyongli has quit IRC | 14:23 | |
| anteaya | AJaeger: right, but what will happen if the jobs run and the openstack-manuals patch isnt' merged? | 14:23 |
| *** heyongli has joined #openstack-infra | 14:23 | |
| krotscheck | yolanda: ubuntu-trusty-internap-nyj01-8865191 | 14:23 |
| *** tonytan4ever has joined #openstack-infra | 14:24 | |
| *** dmellado|lunch is now known as dmellado | 14:24 | |
| AJaeger | anteaya: it will not run due to : http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n2431 | 14:24 |
| yolanda | ok holded | 14:24 |
| krotscheck | Sweet | 14:24 |
| AJaeger | that let's the job only run if releasenotes are updated (or tox.ini) | 14:24 |
| yolanda | krotscheck can you pm your pubkey? | 14:24 |
| *** pradk has quit IRC | 14:24 | |
| *** pradk has joined #openstack-infra | 14:24 | |
| *** yamamoto has quit IRC | 14:25 | |
| krotscheck | yolanda: sure, sec | 14:25 |
| anteaya | okay, thanks | 14:25 |
| *** yamamoto has joined #openstack-infra | 14:25 | |
| *** amotoki has joined #openstack-infra | 14:25 | |
| *** akroshchenko has joined #openstack-infra | 14:26 | |
| AJaeger | thanks, anteaya ! Better safe than sorry ;) | 14:26 |
| *** rbrndt has joined #openstack-infra | 14:26 | |
| anteaya | yup, I can be counted on to ask dumb questions | 14:27 |
| *** akroshchenko has quit IRC | 14:27 | |
| openstackgerrit | Merged openstack-infra/project-config: Add release notes job to bifrost https://review.openstack.org/294541 | 14:28 |
| *** yamamoto has quit IRC | 14:30 | |
| *** nelsnelson has joined #openstack-infra | 14:31 | |
| *** MarkAtwood has joined #openstack-infra | 14:31 | |
| fungi | on briefly from a lobby... | 14:32 |
| krotscheck | yolanda: It helped! | 14:32 |
| krotscheck | Check this out: process 9059: D-Bus library appears to be incorrectly set up; failed to read machine uuid: Failed to open "/etc/machine-id": No such file or directory | 14:32 |
| yolanda | what did you discover? | 14:32 |
| *** yamahata has joined #openstack-infra | 14:32 | |
| yolanda | oh, where that? | 14:32 |
| krotscheck | Firefox simply isn't starting | 14:32 |
| fungi | krotscheck: 9am pdt would be just after new image builds were starting to go into use for the day. what was the job name again? | 14:32 |
| *** amotoki has quit IRC | 14:33 | |
| *** heyongli has quit IRC | 14:33 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again https://review.openstack.org/288915 | 14:33 |
| *** aysyd has quit IRC | 14:33 | |
| *** heyongli has joined #openstack-infra | 14:33 | |
| *** knikolla has quit IRC | 14:33 | |
| krotscheck | fungi, yolanda: Here's a paste of what I'm seeing when trying to start firefox http://paste.openstack.org/show/491113/ | 14:33 |
| *** aysyd has joined #openstack-infra | 14:33 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Allow to omit list of projects in Gerrit trigger config https://review.openstack.org/272392 | 14:33 |
| fungi | krotscheck: nevermind on the job name. i see i didn't read enough scrollack | 14:34 |
| *** achanda has joined #openstack-infra | 14:34 | |
| *** abregman|nb is now known as abregman | 14:34 | |
| *** MarkAtwood has quit IRC | 14:34 | |
| yolanda | krotscheck that is a new req of firefox or is something that has changed in our images? | 14:35 |
| *** esikachev has joined #openstack-infra | 14:35 | |
| krotscheck | yolanda: Well, there's previous jobs with firefox 45 that passed, so I'm guiessing the images, but it may be a plugin I can add to xvfb? | 14:35 |
| *** Kennan has quit IRC | 14:36 | |
| AJaeger | fungi, are you ok to land the first patch for nova db usage? https://review.openstack.org/292472 | 14:37 |
| yolanda | krotscheck well, i see a change from yesterday dealing with uuid | 14:37 |
| AJaeger | fungi: I have nova a heads up, mriedem gave a +1 and sdague found a problem I fixed | 14:37 |
| yolanda | going to check | 14:37 |
| *** tonytan4ever has quit IRC | 14:37 | |
| *** Kennan has joined #openstack-infra | 14:37 | |
| openstackgerrit | Merged openstack-infra/project-config: Add release notes to openstack-manuals https://review.openstack.org/294502 | 14:38 |
| krotscheck | yolanda: Thanks. doing the RANDR thing didn't do anything useful | 14:38 |
| *** tonytan4ever has joined #openstack-infra | 14:38 | |
| yolanda | change https://review.openstack.org/#/c/294233/, it's installing uuid-runtime . I wonder if that's related | 14:38 |
| *** pcaruana has quit IRC | 14:38 | |
| fungi | if this job switched from devstack-trusty to ubuntu-trusty yesterday, maybe we're missing whatever creates the /etc/machine-id file? | 14:38 |
| yolanda | looks as can be solved with dbus-uuidgen > /var/lib/dbus/machine-id | 14:38 |
| *** knikolla has joined #openstack-infra | 14:38 | |
| yolanda | fungi, changes were done on 11 March for that job | 14:38 |
| AJaeger | argh, https://review.openstack.org/#/c/292472 needs another +2 first. I thought yolanda had already but mixed it up. So, not yet time to merge... | 14:38 |
| openstackgerrit | Thomas Maddox proposed openstack-infra/project-config: Move to Fedora 23 for Libvirt/LXC Nova Test https://review.openstack.org/293585 | 14:39 |
| fungi | AJaeger: i'm trying to review it now, but reception here is terrible (i'm apparently on 2g at about 25% signal strength) | 14:40 |
| krotscheck | yolanda, fungi: dbus-uuidgen doesn't seem to be installed on that box. | 14:40 |
| openstackgerrit | Ian Cordasco proposed openstack-dev/pbr: Include wsgi_scripts in generated wheels https://review.openstack.org/280270 | 14:40 |
| yolanda | that will explain... i see uuid-runtime installed, but we may need this one as well | 14:41 |
| *** tonytan_brb has joined #openstack-infra | 14:41 | |
| *** yamamoto has joined #openstack-infra | 14:43 | |
| *** heyongli has quit IRC | 14:43 | |
| *** tonytan4ever has quit IRC | 14:43 | |
| *** heyongli has joined #openstack-infra | 14:43 | |
| *** MarkAtwood has joined #openstack-infra | 14:43 | |
| krotscheck | yolanda: Ok, I'm going to exit this node, sounds like the next step is figuring out how to generate a machine id. | 14:43 |
| *** dizquierdo has quit IRC | 14:44 | |
| yolanda | krotscheck, if you install the package it generates it? | 14:44 |
| *** tonytan_brb has quit IRC | 14:44 | |
| krotscheck | yolanda: I have no idea :) | 14:44 |
| yolanda | can you try there? | 14:44 |
| *** yamahata has quit IRC | 14:45 | |
| *** tonytan4ever has joined #openstack-infra | 14:45 | |
| krotscheck | yolanda: But, to be fair, if we're installing firefox from upstraem, it should include all of its magic dependencies, no? | 14:45 |
| krotscheck | yolanda: does jenkins have root? | 14:45 |
| krotscheck | yolanda: That requires a jenkins password ;) | 14:45 |
| yolanda | ah good point :) | 14:45 |
| yolanda | i can try | 14:45 |
| *** achanda has quit IRC | 14:47 | |
| openstackgerrit | Antony Messerli proposed openstack-infra/project-config: Shift load from rax-iad to rax-ord https://review.openstack.org/294625 | 14:47 |
| yolanda | krotscheck, i had to install dbus package, then generate that machine-id | 14:47 |
| jesusaur | infra-root is https://wiki.jenkins-ci.org/display/SECURITY/Jenkins+Security+Advisory+2016-02-24 on your radar? | 14:48 |
| *** Guest84688 has quit IRC | 14:48 | |
| krotscheck | (firefox:9855): GConf-WARNING **: Client failed to connect to the D-BUS daemon: | 14:48 |
| krotscheck | /bin/dbus-launch terminated abnormally without any error message | 14:48 |
| *** tonytan4ever has quit IRC | 14:48 | |
| * andymaier is back (gone 00:01:41) | 14:48 | |
| *** tonytan4ever has joined #openstack-infra | 14:48 | |
| yolanda | krotscheck, after i installed dbus? | 14:49 |
| stevemar | AJaeger: poke | 14:49 |
| * andymaier is away: I'm away, not watching this cannel right now. | 14:49 | |
| krotscheck | Yep | 14:49 |
| krotscheck | yolanda: is there a dbus server? | 14:49 |
| *** tonytan4ever has quit IRC | 14:49 | |
| krotscheck | service? | 14:49 |
| * andymaier is back (gone 00:00:10) | 14:49 | |
| yolanda | i see a dbus-daemon running | 14:50 |
| krotscheck | andymaier: Please disable your away mesages. | 14:50 |
| *** tonytan4ever has joined #openstack-infra | 14:50 | |
| anteaya | jesusaur: thank you, I had not seen that, I can't speak for infra-root | 14:50 |
| AJaeger | hi stevemar | 14:51 |
| AJaeger | fungi, I can ask others for review - timing was more the question... | 14:52 |
| AJaeger | fungi: or review later today | 14:52 |
| *** ifarkas has quit IRC | 14:52 | |
| *** nadya has quit IRC | 14:52 | |
| stevemar | AJaeger: nvm, i figured it out ^_^ | 14:53 |
| *** amotoki has joined #openstack-infra | 14:53 | |
| AJaeger | stevemar: those are the best pokes ;) | 14:53 |
| stevemar | AJaeger: haha, agreed | 14:53 |
| *** krtaylor has joined #openstack-infra | 14:53 | |
| *** heyongli has quit IRC | 14:53 | |
| krotscheck | yolanda: I think the location of the machine-id is actually the problem. Firefox from the shell is looking for /etc/machine-id, you put it in //var/lib/dbus/machine-id? | 14:53 |
| *** heyongli has joined #openstack-infra | 14:54 | |
| yolanda | krotscheck i created an /etc/machine-id as well | 14:54 |
| matrohon | hi infra guys | 14:54 |
| krotscheck | Hrm | 14:54 |
| *** links has quit IRC | 14:54 | |
| matrohon | I have a strange behavior on one of the bgpvpn experimental job : | 14:55 |
| krotscheck | yolanda: Can you remove /var/lib/dbus/machine-id just to satisfy my crazy sceme? | 14:55 |
| *** alex_xu has quit IRC | 14:55 | |
| *** HeOS has quit IRC | 14:55 | |
| krotscheck | yolanda: Actually n/m | 14:55 |
| krotscheck | That's just a warning | 14:55 |
| matrohon | the q-agt is failing but jenkins reports that the job succeed | 14:55 |
| krotscheck | The tests now pass | 14:55 |
| matrohon | http://logs.openstack.org/51/232451/14/experimental/gate-install-dsvm-networking-bgpvpn/210eea1/logs/screen-q-agt.txt.gz | 14:55 |
| *** HeOS has joined #openstack-infra | 14:56 | |
| *** esikachev has quit IRC | 14:56 | |
| *** binbincong has quit IRC | 14:56 | |
| *** binbincong has joined #openstack-infra | 14:57 | |
| *** esikachev has joined #openstack-infra | 14:58 | |
| *** yamahata has joined #openstack-infra | 14:58 | |
| *** yamamoto has quit IRC | 14:58 | |
| *** alex_xu has joined #openstack-infra | 14:59 | |
| yolanda | krotscheck so as soon as we have a machine-id, it starts working? | 14:59 |
| *** sc68cal has joined #openstack-infra | 15:00 | |
| *** tesseract has joined #openstack-infra | 15:00 | |
| *** tonytan_brb has joined #openstack-infra | 15:00 | |
| *** tesseract is now known as Guest76883 | 15:00 | |
| yolanda | or it needed dbus-daemon as well? i could uninstall dbus and you can retry? | 15:00 |
| *** bpokorny has joined #openstack-infra | 15:02 | |
| *** mrmartin has quit IRC | 15:03 | |
| *** thorst has quit IRC | 15:03 | |
| *** nadya has joined #openstack-infra | 15:03 | |
| krotscheck | yolanda: Well, with the steps that yo utook, it's now working. | 15:03 |
| *** heyongli has quit IRC | 15:04 | |
| krotscheck | I don't know how much of that we can rewind. | 15:04 |
| *** heyongli has joined #openstack-infra | 15:04 | |
| *** clsacramento has joined #openstack-infra | 15:04 | |
| yolanda | krotscheck you can rerun the same test cleanly? | 15:04 |
| *** tonytan4ever has quit IRC | 15:04 | |
| krotscheck | yolanda: Yes, right now, if I run `npm test --silent` in ~/workspace/gate-ironic-webclient-npm-run-test, it works as expected | 15:06 |
| yolanda | ok i can try removing dbus and try again | 15:06 |
| krotscheck | alright | 15:07 |
| *** thorst has joined #openstack-infra | 15:07 | |
| *** clsacramento has quit IRC | 15:07 | |
| yolanda | when i removed dbus, it fails | 15:07 |
| openstackgerrit | Merged openstack-infra/project-config: Add python-db jobs - for nova initially https://review.openstack.org/292472 | 15:08 |
| krotscheck | yolanda: Well then. | 15:08 |
| krotscheck | yolanda: Do we need dbus and the machine id, or just dbus? | 15:09 |
| yolanda | mm, nope. I reinstalled and fails even with that . It cannot start firefox and not chrome | 15:09 |
| anteaya | yolanda: after you have finished helping krotscheck do you mind taking a look at the link jesusaur posted: https://wiki.jenkins-ci.org/display/SECURITY/Jenkins+Security+Advisory+2016-02-24 | 15:09 |
| anteaya | yolanda: you appear to be the only infra-root online at the moment | 15:09 |
| krotscheck | yolanda: It works for me? | 15:09 |
| yolanda | oh jenkins security... | 15:09 |
| *** tonytan_brb has quit IRC | 15:09 | |
| yolanda | krotscheck weird...18 03 2016 15:09:37.339:ERROR [launcher]: Cannot start Firefox | 15:10 |
| yolanda | for me | 15:10 |
| *** thorst has quit IRC | 15:10 | |
| *** mtanino has joined #openstack-infra | 15:10 | |
| *** tonytan4ever has joined #openstack-infra | 15:10 | |
| krotscheck | yolanda: Are you root? | 15:10 |
| *** salv-orlando has joined #openstack-infra | 15:10 | |
| yolanda | no, jenkins | 15:10 |
| krotscheck | yolanda: Oh. export DISPLAY=:99; DISPLAY=:99 | 15:10 |
| yolanda | ah | 15:10 |
| anteaya | yolanda: I think it would be at least worth while to check jenkins versions, but don't post in channel | 15:10 |
| *** yamamoto has joined #openstack-infra | 15:11 | |
| yolanda | krotscheck, that did the trick | 15:11 |
| krotscheck | anteaya: The versino of jenkins we're running on is in the footer of every single build | 15:11 |
| anteaya | yolanda: but if you think we need to upgrade I'd pm jeblair or clarkb | 15:11 |
| anteaya | krotscheck: awesome | 15:11 |
| krotscheck | anteaya: And by awesome, you mean not awesome. | 15:11 |
| yolanda | anteaya i'd better check with other infra-roots | 15:12 |
| *** roxanaghe has joined #openstack-infra | 15:12 | |
| yolanda | i think upgrading jenkins will cause our gear plugins to don't work, at least that's last thing i know from zaro | 15:12 |
| anteaya | krotscheck: yes that is what I mean | 15:13 |
| anteaya | yolanda: yes, I would advise that | 15:14 |
| *** heyongli has quit IRC | 15:14 | |
| *** claudiub has quit IRC | 15:14 | |
| yolanda | krotscheck that's so weird , because i removed dbus, and removed /etc/machine-id and works as well | 15:14 |
| *** heyongli has joined #openstack-infra | 15:14 | |
| anteaya | I think upgrading jenkins will take all day to coordinate | 15:14 |
| *** roxanagh_ has joined #openstack-infra | 15:14 | |
| krotscheck | whaaaatisgoingon | 15:15 |
| anteaya | hopefully clarkb and jeblair will be online soon to help | 15:15 |
| *** roxanaghe has quit IRC | 15:15 | |
| krotscheck | yolanda: Well, right now I can't capture firefox. | 15:15 |
| *** clsacramento has joined #openstack-infra | 15:15 | |
| *** dtantsur is now known as dtantsur|pto | 15:16 | |
| *** thorst has joined #openstack-infra | 15:16 | |
| jesusaur | yolanda: oh, is there a plugin incompatibility? :( | 15:17 |
| yolanda | jesusaur, at least a month ago, i did some tests with gear and newest jenkins and failed for me | 15:17 |
| yolanda | not sure if that's still going on | 15:17 |
| anteaya | I'm going to suggest the jenkins security discussion move to -infra-incident | 15:18 |
| *** amotoki has quit IRC | 15:18 | |
| jesusaur | anteaya: makes sense | 15:18 |
| anteaya | jesusaur: thanks | 15:19 |
| *** chem has quit IRC | 15:19 | |
| HeOS | Hi, infra-team! I have one question to you. I'm from Fuel Infra team. We copied your manifests for Gerrit some month ago, we refactored them while we had been working with them. For example, we added a 'replication' module to have ability to use internal gerrit's replication mechanism. Currently we want to merge yours and ours manifests. What the method should I use? Create a set of requests and merge them? | 15:19 |
| HeOS | The links: manifests: https://github.com/fuel-infra/puppet-manifests/tree/master/modules/gerrit, our modules: https://github.com/fuel-infra/puppet-manifests/tree/master/modules/fuel_project/manifests/gerrit. | 15:20 |
| anteaya | well for a body of work that might include design decisions we often suggest a spec | 15:20 |
| anteaya | so that while a course of work is undertaken those trying to understand the history and status have a reference | 15:20 |
| yolanda | krotscheck i get an error now but i don't see that /etc/machine-id error | 15:21 |
| yolanda | just a "weird error 1" | 15:21 |
| yolanda | amazing message! | 15:21 |
| krotscheck | yolanda: Yeah, the firefox error only pops up if you actually try to run firefox. | 15:21 |
| krotscheck | Instead of going through npm. | 15:21 |
| krotscheck | yolanda: Also, yes. Amazing error message | 15:22 |
| yolanda | ah ok, trying to run it | 15:22 |
| yolanda | i generated a dummy machine-id without dbus and launched firefox | 15:22 |
| *** mylu has joined #openstack-infra | 15:22 | |
| yolanda | seems that this dummy is so dummy, it fails | 15:22 |
| *** e0ne has quit IRC | 15:23 | |
| jeblair | pabelanger: could you join #openstack-infra-incident please? | 15:23 |
| krotscheck | yolanda: Mine just worked, did you install dbus? | 15:24 |
| *** salv-orlando has quit IRC | 15:24 | |
| yolanda | just now | 15:24 |
| *** heyongli has quit IRC | 15:24 | |
| krotscheck | Ok, so it looks like we need both dbus and a machine id. | 15:24 |
| *** heyongli has joined #openstack-infra | 15:24 | |
| krotscheck | Where is the right place to add those? | 15:25 |
| yolanda | krotscheck i even removed the /etc/machine-id | 15:26 |
| yolanda | so actually should be enough with install dbus | 15:26 |
| krotscheck | Oh good | 15:27 |
| krotscheck | yolanda: So that'd be something like this: https://review.openstack.org/#/c/294233/ | 15:27 |
| yolanda | krotscheck yes, installing there along with the other packages look good to me | 15:28 |
| jeblair | eval `dbus-launch --auto-syntax` | 15:28 |
| jeblair | export DBUS_SESSION_BUS_PID DBUS_SESSION_BUS_ADDRESS | 15:28 |
| jeblair | yolanda, krotscheck: if you need a running dbus, that will get you one ^ | 15:28 |
| jeblair | (without needing to start a session manager or whatever.) | 15:29 |
| yolanda | jeblair, dbus package was not even installed | 15:29 |
| yolanda | no dbus-daemon commands available | 15:29 |
| jeblair | so that might be step 2 then. :) | 15:29 |
| *** thorst has quit IRC | 15:30 | |
| *** e0ne has joined #openstack-infra | 15:30 | |
| *** placko_ has quit IRC | 15:31 | |
| yolanda | jeblair so first step, to install dbus package, is ok to be done in nodepool element? | 15:32 |
| jeblair | yolanda: can we have bindep install it instead? | 15:32 |
| krotscheck | jeblair: The other alternative is to add it to the firefox-install macro. | 15:32 |
| *** david-lyle has quit IRC | 15:32 | |
| krotscheck | Or that. | 15:32 |
| jeblair | krotscheck: or that :) | 15:33 |
| *** placko_ has joined #openstack-infra | 15:33 | |
| *** david-lyle has joined #openstack-infra | 15:33 | |
| krotscheck | jeblair: Most of the images start with firefox already installed. I'm trying to figure out where that's done. | 15:33 |
| *** heyongli has quit IRC | 15:34 | |
| *** heyongli has joined #openstack-infra | 15:35 | |
| fungi | krotscheck: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/data/bindep-fallback.txt#n12 | 15:35 |
| *** daemontool has quit IRC | 15:35 | |
| fungi | it's being installed as part of the job | 15:35 |
| fungi | though if you're using devstack-gate instead of the install-distro-packages job macro, then it's probably devstack doing it | 15:35 |
| *** thorst has joined #openstack-infra | 15:36 | |
| *** yamamoto has quit IRC | 15:37 | |
| *** yamamoto has joined #openstack-infra | 15:37 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added dbus to firefox install macro and bindep https://review.openstack.org/294677 | 15:37 |
| krotscheck | fungi, jeblair, yolanda: Like ^^? | 15:37 |
| *** vsaienko has joined #openstack-infra | 15:39 | |
| vsaienko | infra team could you please review: https://review.openstack.org/#/c/252814/ | 15:39 |
| *** placko_ has quit IRC | 15:40 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: Add jobs for stable/mitaka branch https://review.openstack.org/294678 | 15:40 |
| *** Swami has joined #openstack-infra | 15:40 | |
| *** jcoufal has quit IRC | 15:41 | |
| *** thorst has quit IRC | 15:41 | |
| *** thorst has joined #openstack-infra | 15:42 | |
| *** ociuhandu has joined #openstack-infra | 15:43 | |
| amrith | hello, if I could get some help getting ^^ merged. I'd like to merge some stuff behind it and unblock the things that are holding up the rc1 for trove. thanks muchly. | 15:43 |
| amrith | adding some gate jobs for stable/mitaka, didn't remove stable/kilo yet though that's likely next, right? | 15:43 |
| *** heyongli has quit IRC | 15:45 | |
| *** heyongli has joined #openstack-infra | 15:45 | |
| anteaya | right you add jobs for the latest branch | 15:46 |
| anteaya | and when the oldest branch has reached the end of its life it will be removed | 15:46 |
| *** thorst has quit IRC | 15:46 | |
| anteaya | stay in contact with the release team for timing for end of life for old releases | 15:47 |
| *** akaszuba has quit IRC | 15:47 | |
| *** amitgandhinz has quit IRC | 15:49 | |
| *** Daisy has joined #openstack-infra | 15:49 | |
| anteaya | if any infra-root has a moment to look at why rackspace is heavily in error state that would be awesome, but not if you have a higher priority | 15:51 |
| *** thorst has joined #openstack-infra | 15:52 | |
| *** esikachev has quit IRC | 15:52 | |
| bknudson | do the unit test (py27) nodes have mysql running with openstack_citest user? | 15:52 |
| bknudson | and postgresql | 15:52 |
| anteaya | my understanding is that is the intent | 15:53 |
| anteaya | bknudson: are you seeing something that indicates that is not happening? | 15:53 |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added repo for fuel-plugin-detach-haproxy project https://review.openstack.org/294683 | 15:53 |
| bknudson | anteaya: I'm seeing that it is happening but I'm making sure that's the case. | 15:53 |
| anteaya | ah | 15:53 |
| *** Daisy has quit IRC | 15:54 | |
| anteaya | it is my understanding that that is working as intended | 15:54 |
| anteaya | let me see if I can find the patch that leads me to that conclusion | 15:54 |
| anteaya | I believe it merged yesterday | 15:54 |
| *** heyongli has quit IRC | 15:55 | |
| *** heyongli has joined #openstack-infra | 15:55 | |
| jeblair | anteaya: potentially related to rax: https://review.openstack.org/294625 | 15:55 |
| anteaya | jeblair: thank you | 15:56 |
| anteaya | bknudson: it merged this morning but should only be affecting nova jobs: https://review.openstack.org/#/c/292472/10 | 15:56 |
| *** thorst has quit IRC | 15:56 | |
| bknudson | anteaya: thanks. When I ran these opportunistic tests locally they would fail or skip if it couldn't connect to the db. | 15:56 |
| anteaya | ah | 15:56 |
| anteaya | okay, hmmmm, AJaeger will probably want to know | 15:57 |
| anteaya | making local tests not work is not part of the plan, I don't think | 15:57 |
| bknudson | yes, this is interesting, if we're going to need that job in order to get the opp tests now | 15:57 |
| *** tonytan_brb has joined #openstack-infra | 15:57 | |
| *** tonytan4ever has quit IRC | 15:57 | |
| amrith | anteaya, thanks | 15:58 |
| *** thorst has joined #openstack-infra | 15:58 | |
| *** tonytan_brb is now known as tonytan4ever | 15:58 | |
| anteaya | amrith: welcome, thanks for asking good questions | 15:58 |
| anteaya | bknudson: good point | 15:59 |
| *** aspiers has quit IRC | 15:59 | |
| abregman | anteaya: hi. so I summarized 03/15 -> http://paste.openstack.org/show/491127 | 15:59 |
| abregman | anteaya: moving to 03/16 | 15:59 |
| bknudson | we might also want to run on a node with openldap installed eventually | 15:59 |
| anteaya | abregman: thanks for letting me know | 16:00 |
| anteaya | abregman: I will read | 16:00 |
| *** aspiers has joined #openstack-infra | 16:00 | |
| abregman | thanks | 16:00 |
| anteaya | abregman: how did it feel doing the work/ | 16:00 |
| anteaya | ? | 16:00 |
| anteaya | bknudson: interesting | 16:00 |
| *** david-lyle has quit IRC | 16:00 | |
| *** david-lyle has joined #openstack-infra | 16:01 | |
| amrith | anteaya, the conversation we were having yesterday (re: tagging reviews and dashboards). I posted to ML and got some even more interesting ideas there. | 16:01 |
| abregman | anteaya: it was hard sometimes :) but it did raise a lot of questions and I feel like I know better the folks that involved with infra projects | 16:01 |
| *** thorst has quit IRC | 16:02 | |
| *** bpokorny has quit IRC | 16:02 | |
| anteaya | amrith: well done | 16:02 |
| anteaya | abregman: yay, and only one day's work | 16:02 |
| anteaya | abregman: you have learned so much :) | 16:02 |
| anteaya | abregman: nice formatting and extraction of imporant details with reference | 16:03 |
| anteaya | very nice indeed | 16:03 |
| *** thorst has joined #openstack-infra | 16:04 | |
| abregman | anteaya: thanks, but the journey only begun :) | 16:04 |
| anteaya | it has indeed | 16:04 |
| anteaya | biggest thing is you aren't letting frustration stand in your way of completing a job with references and precision | 16:05 |
| *** heyongli has quit IRC | 16:05 | |
| *** heyongli has joined #openstack-infra | 16:05 | |
| *** chem has joined #openstack-infra | 16:06 | |
| abregman | thanks for the guidance :) | 16:07 |
| *** mkoderer___ is now known as mkoderer__ | 16:08 | |
| anteaya | abregman: :) | 16:09 |
| anteaya | abregman: I'm rearranging it and will do my best to respond to your questions | 16:09 |
| *** yamamoto has quit IRC | 16:09 | |
| *** armax has joined #openstack-infra | 16:10 | |
| *** jordanP has quit IRC | 16:10 | |
| *** mrmartin has joined #openstack-infra | 16:10 | |
| *** armax has quit IRC | 16:11 | |
| *** jordanP has joined #openstack-infra | 16:11 | |
| *** Keedya has joined #openstack-infra | 16:11 | |
| *** sdague has joined #openstack-infra | 16:12 | |
| *** thorst has quit IRC | 16:13 | |
| *** arxcruz has quit IRC | 16:13 | |
| *** bpokorny has joined #openstack-infra | 16:13 | |
| abregman | anteaya: thanks. I can start by searching for the answers by myself. I don't want to waste your time. | 16:13 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Provide fallback mirrors for centos pin https://review.openstack.org/274287 | 16:13 |
| *** thorst has joined #openstack-infra | 16:14 | |
| AJaeger | bknudson: I'm back, let me read backscroll and answer... | 16:14 |
| *** heyongli has quit IRC | 16:15 | |
| AJaeger | bknudson, right now python27 has databases setup. | 16:15 |
| *** heyongli has joined #openstack-infra | 16:16 | |
| bknudson | AJaeger: great, that's what I thought | 16:16 |
| AJaeger | We will move all known jobs to python27-db - running the same tox envioronment. And later: python27-db will have db setup, python27 not anymore. | 16:16 |
| AJaeger | So, two steps - migrate to new jobs, remove database setup. | 16:16 |
| bknudson | makes sense. what's the timetable? I don't know how long it's going to take for me to get keystone working with the opp test classes | 16:17 |
| AJaeger | keystone is currently not on my list of repositories that do opportunistic database access | 16:17 |
| *** e0ne has quit IRC | 16:17 | |
| AJaeger | Can you show me what you do so that I know what to look for in other cases? | 16:17 |
| *** kgiusti has joined #openstack-infra | 16:17 | |
| AJaeger | bknudson: no timeline, I'm just trying to push one step in after the other. | 16:18 |
| bknudson | AJaeger: work in progress https://review.openstack.org/#/c/294246/ | 16:18 |
| AJaeger | bknudson: are you using *today* a database in keystone? | 16:18 |
| AJaeger | I want to konw whether I missed a pattern... | 16:18 |
| *** thorst has quit IRC | 16:19 | |
| bknudson | AJaeger: no, today keystone doesn't take advantage of the dbs. | 16:19 |
| *** skolekonov is now known as _skolekonov | 16:19 | |
| bknudson | it only tests with sqlite | 16:19 |
| *** Keedya has quit IRC | 16:19 | |
| AJaeger | bknudson: good, so my analysis was correct. I've added keystone now to my tracking list... | 16:19 |
| AJaeger | bknudson: before we remove dbs from python27, there will be an announcement as well... | 16:20 |
| bknudson | thanks. I haven't brought this up with the rest of the team but I assume they'll be fine with it. | 16:20 |
| *** apoorvad has joined #openstack-infra | 16:20 | |
| *** thorst has joined #openstack-infra | 16:20 | |
| *** yamahata has quit IRC | 16:20 | |
| *** amitgandhinz has joined #openstack-infra | 16:21 | |
| *** ddieterly has joined #openstack-infra | 16:22 | |
| ddieterly | can we +1 workflow and get this merged? https://review.openstack.org/#/c/293643/1 | 16:22 |
| *** tphummel has joined #openstack-infra | 16:22 | |
| gordc | AJaeger: just to confirm, the uuidgen update should be refreshing itself around all the nodes now right? | 16:22 |
| *** eil397 has joined #openstack-infra | 16:23 | |
| openstackgerrit | Merged openstack-infra/gearman-plugin: Update to Jenkins LTS 1.625.3 and fix function registration https://review.openstack.org/271543 | 16:23 |
| *** sdake has joined #openstack-infra | 16:24 | |
| dstanek | bknudson: ++ | 16:24 |
| *** eil397 has quit IRC | 16:24 | |
| AJaeger | gordc: it should but let's double check with clarkb once he's up. | 16:24 |
| *** eil397 has joined #openstack-infra | 16:24 | |
| *** sdake_ has joined #openstack-infra | 16:24 | |
| *** thorst has quit IRC | 16:25 | |
| *** kzaitsev_mb has quit IRC | 16:25 | |
| *** heyongli has quit IRC | 16:26 | |
| *** amitgandhinz has quit IRC | 16:26 | |
| *** ociuhandu has quit IRC | 16:26 | |
| gordc | AJaeger: cool cool. thanks again | 16:26 |
| *** heyongli has joined #openstack-infra | 16:26 | |
| *** dprince has quit IRC | 16:26 | |
| *** thorst has joined #openstack-infra | 16:26 | |
| *** nimbleark has joined #openstack-infra | 16:26 | |
| *** Qiming has quit IRC | 16:27 | |
| *** daemontool has joined #openstack-infra | 16:28 | |
| ddieterly | jeblair can we +1 workflow and merge https://review.openstack.org/#/c/293643/1? | 16:28 |
| *** sdake has quit IRC | 16:28 | |
| *** sdake_ is now known as sdake | 16:29 | |
| anteaya | ddieterly: he is busy at the moment | 16:29 |
| *** kzaitsev_mb has joined #openstack-infra | 16:29 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: Add jobs for stable/mitaka branch https://review.openstack.org/294678 | 16:29 |
| *** nimbleark has quit IRC | 16:31 | |
| *** matrohon has quit IRC | 16:31 | |
| *** nimbleark has joined #openstack-infra | 16:31 | |
| *** thorst has quit IRC | 16:31 | |
| *** vgridnev has quit IRC | 16:31 | |
| AJaeger | amrith: Do you know about "Depends-On"? | 16:31 |
| AJaeger | http://docs.openstack.org/infra/manual/developers.html#cross-repository-dependencies | 16:32 |
| amrith | Yes, I added it ;) | 16:32 |
| *** vgridnev has joined #openstack-infra | 16:32 | |
| AJaeger | Ok ;) | 16:32 |
| *** adrian_otto has joined #openstack-infra | 16:32 | |
| amrith | yes, I'm sure you read my comment and in the minutes it too you to find the link ... I did just that. | 16:32 |
| AJaeger | amrith: I saw your -W, so even if wanted I couldn't have approved it. | 16:32 |
| *** thorst has joined #openstack-infra | 16:32 | |
| *** alex_xu has quit IRC | 16:32 | |
| amrith | Oh, is that right? | 16:32 |
| amrith | I thought you could override a -W | 16:33 |
| AJaeger | amrith: a change that has a -W will not merge. | 16:33 |
| amrith | I thought you had "the powers" | 16:33 |
| amrith | oh, good to know. | 16:33 |
| AJaeger | amrith: No, I don't - and those that have the power only temporarily take it. | 16:33 |
| *** dims_ has joined #openstack-infra | 16:33 | |
| AJaeger | And in such a case they would AFAIK need to remove the -W first. | 16:33 |
| AJaeger | So, no worries ;) | 16:33 |
| *** dims has quit IRC | 16:34 | |
| *** vgridnev has quit IRC | 16:35 | |
| *** vgridnev has joined #openstack-infra | 16:35 | |
| amrith | to be clear AJaeger I'm not positive that the 'dependency' exists. But, the other job takes 2 hours to check and 2 hours to gate. and I need it in place to unblock rc1. So I didn't want this to merge and set me back a bunch. If I think it through there's a good chance that it won't but ... better safe than late | 16:35 |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: WIP: Use IPv6 on the gate jobs https://review.openstack.org/289445 | 16:35 |
| AJaeger | amrith: ok | 16:35 |
| *** vgridnev has quit IRC | 16:35 | |
| *** nimbleark has quit IRC | 16:36 | |
| *** heyongli has quit IRC | 16:36 | |
| *** nimbleark has joined #openstack-infra | 16:36 | |
| *** heyongli has joined #openstack-infra | 16:36 | |
| *** scheuran has quit IRC | 16:37 | |
| *** thorst has quit IRC | 16:37 | |
| *** alex_xu has joined #openstack-infra | 16:37 | |
| *** thorst has joined #openstack-infra | 16:38 | |
| krotscheck | AJaeger: moving to the ubuntu images broke builds that use firefox- yolanda and I figured out what was needed, we think - v | 16:40 |
| krotscheck | https://review.openstack.org/#/c/294677/ | 16:40 |
| krotscheck | The bindep piece was jeblair's suggestion. | 16:40 |
| *** salv-orlando has joined #openstack-infra | 16:41 | |
| *** nadya has quit IRC | 16:41 | |
| *** vincentll has quit IRC | 16:42 | |
| *** ociuhandu has joined #openstack-infra | 16:42 | |
| *** mikelk has quit IRC | 16:44 | |
| *** esikachev has joined #openstack-infra | 16:44 | |
| vsaienko | infra team, please review once you have a minute, it is a patch that adds job for ironic/neutron integration https://review.openstack.org/#/c/252814/ | 16:44 |
| *** heyongli has quit IRC | 16:46 | |
| *** heyongli has joined #openstack-infra | 16:46 | |
| clarkb | AJaeger: yes the current builds should be installing uuidgen and cron and all that goodness | 16:47 |
| pabelanger | AJaeger: http://grafana.openstack.org/dashboard/db/nodepool-rackspace exists, just too many dashboards to list on grafana.o.o now. We can customize it however | 16:47 |
| clarkb | AJaeger: yssterdays builds took so long I couldnt wait up and get a manual rebuild through | 16:47 |
| *** yamahata has joined #openstack-infra | 16:47 | |
| *** pcaruana has joined #openstack-infra | 16:47 | |
| *** thorst has quit IRC | 16:48 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Fix setting new task status and priority https://review.openstack.org/293577 | 16:49 |
| *** asselin_ has joined #openstack-infra | 16:49 | |
| *** thorst has joined #openstack-infra | 16:49 | |
| *** jlanoux has quit IRC | 16:50 | |
| pabelanger | clarkb: AJaeger Yup, http://nodepool.openstack.org/dib.ubuntu-trusty.log is reporting the new infra-package-needs element | 16:51 |
| pabelanger | let me check uploads | 16:51 |
| *** mrmartin has quit IRC | 16:51 | |
| *** salv-orlando has quit IRC | 16:51 | |
| *** asselin__ has quit IRC | 16:52 | |
| pabelanger | looks like ovh-bhs1 is currently uploading ubuntu-trusty | 16:53 |
| pabelanger | and that is all | 16:53 |
| clarkb | pabelanger: did fedora-23 and centos-7 build with the packages too? | 16:53 |
| *** salv-orlando has joined #openstack-infra | 16:53 | |
| *** bpokorny_ has joined #openstack-infra | 16:53 | |
| pabelanger | clarkb: let me check | 16:53 |
| *** thorst has quit IRC | 16:53 | |
| *** bpokorny_ has quit IRC | 16:54 | |
| pabelanger | clarkb: yes | 16:54 |
| *** bpokorny_ has joined #openstack-infra | 16:54 | |
| clarkb | yay | 16:55 |
| *** thorst has joined #openstack-infra | 16:55 | |
| *** bpokorny has quit IRC | 16:56 | |
| *** heyongli has quit IRC | 16:56 | |
| *** heyongli has joined #openstack-infra | 16:57 | |
| *** thorst has quit IRC | 16:58 | |
| *** thorst has joined #openstack-infra | 16:59 | |
| *** IlyaG has joined #openstack-infra | 17:00 | |
| *** nelsnelson has quit IRC | 17:02 | |
| *** achanda has joined #openstack-infra | 17:03 | |
| krotscheck | clarkb: That firefox thing from yesterday _may_ be fixed with this patch | 17:05 |
| krotscheck | https://review.openstack.org/#/c/294677/ | 17:05 |
| clarkb | krotscheck: you should probably add a dbus line for rpm distros too | 17:06 |
| amrith | AJaeger, I may be holding up your jenkins shutdown. https://jenkins01.openstack.org/job/gate-trove-functional-dsvm-mysql/1119/ | 17:06 |
| krotscheck | clarkb: Is it named the same thing on rpm? | 17:06 |
| amrith | the job is almost done | 17:06 |
| *** heyongli has quit IRC | 17:07 | |
| clarkb | krotscheck: I don't know but can look | 17:07 |
| amrith | hopefully it'll complete before jenkins pulls the cord | 17:07 |
| krotscheck | clarkb: Just checked, looks that way | 17:07 |
| *** heyongli has joined #openstack-infra | 17:07 | |
| clarkb | krotscheck: https://apps.fedoraproject.org/packages/dbus yup I think you cna just drop the dpkg specification and just have a bare dbus line | 17:07 |
| clarkb | krotscheck: that should make it use 'dbus' everywhere | 17:07 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added dbus to firefox install macro and bindep https://review.openstack.org/294677 | 17:07 |
| krotscheck | Done | 17:07 |
| krotscheck | Also updated the commit message to explain better why | 17:08 |
| AJaeger | krotscheck: why both in bindep-fallback and in job? Isn't the job enough? | 17:08 |
| pabelanger | I would think bindep-fallback is enough too | 17:10 |
| *** yamamoto has joined #openstack-infra | 17:10 | |
| *** daemontool_ has joined #openstack-infra | 17:10 | |
| pabelanger | but have't looked into what the JJB template does | 17:10 |
| AJaeger | pabelanger: I was thinking the other way round ;) | 17:11 |
| clarkb | pabelanger: AJaeger I believe the preference is for jobs to explicitly state other requirements over the fallback file. But that requires figuring out what all of the other system deps are first in addition to firefox | 17:11 |
| clarkb | and in the case of firefox/chromium we may not want every job to install those? | 17:11 |
| AJaeger | clarkb: yes, other-requirements is the preference but we're not ready yet. First need to get rid of db access from python27 etc | 17:12 |
| openstackgerrit | Merged openstack-infra/project-config: Grafana: Add Tempest check runs graph https://review.openstack.org/294293 | 17:12 |
| jeblair | then the macro is probably the place for now | 17:12 |
| *** esikachev has quit IRC | 17:12 | |
| jeblair | i don't think we need it in fallback or images | 17:12 |
| *** daemontool has quit IRC | 17:12 | |
| *** abregman is now known as abregman|afk | 17:12 | |
| pabelanger | clarkb: AJaeger: right. Once projects get other-requirements.txt, I would like to see firefox-install macro (and other package install macros) be deprecated | 17:13 |
| AJaeger | jeblair: agreed | 17:13 |
| pabelanger | WFM | 17:13 |
| AJaeger | pabelanger: and thus it should be enough in the macro for now | 17:13 |
| *** ZZelle has quit IRC | 17:13 | |
| AJaeger | krotscheck: can you redo again, please? | 17:13 |
| pabelanger | AJaeger: ! | 17:13 |
| * AJaeger will be back later and then +2 krotscheck's update ;) | 17:15 | |
| *** amitgandhinz has joined #openstack-infra | 17:15 | |
| *** jpr has quit IRC | 17:17 | |
| *** heyongli has quit IRC | 17:17 | |
| *** heyongli has joined #openstack-infra | 17:17 | |
| *** yamamoto has quit IRC | 17:17 | |
| *** roxanagh_ has quit IRC | 17:19 | |
| *** ddieterly is now known as ddieterly[away] | 17:20 | |
| *** amitgandhinz has quit IRC | 17:21 | |
| *** tqtran-afk has joined #openstack-infra | 17:21 | |
| *** ddieterly[away] is now known as ddieterly | 17:22 | |
| openstackgerrit | Andrey Nikitin proposed openstack-infra/puppet-gerrit: Order of the classes parameters is refactored https://review.openstack.org/294728 | 17:23 |
| *** ddieterly is now known as ddieterly[away] | 17:24 | |
| *** rbrndt has quit IRC | 17:24 | |
| *** sputnik13 has joined #openstack-infra | 17:24 | |
| *** achanda has quit IRC | 17:25 | |
| *** angdraug has joined #openstack-infra | 17:25 | |
| tosky | clarkb: hi, we chatted few days ago about importing code with history; you mentioned using a "orphan" branch with the git-filtered history | 17:25 |
| tosky | and then pushing a merge commit to gerrit after requesting an exception to the usual ACLs | 17:26 |
| tosky | the only thing that it's not clear is who should push the content of the clean branch - I guess gerrit would only push the merge commit itself, but it would require the availability of the branch | 17:27 |
| *** heyongli has quit IRC | 17:27 | |
| clarkb | tosky: you would push them all into that branch and review and merge them | 17:27 |
| *** asselin has quit IRC | 17:27 | |
| *** heyongli has joined #openstack-infra | 17:27 | |
| tosky | clarkb: but then, wouldn't the tests trigger and fail because the "real" code is missing? | 17:28 |
| *** jpr has joined #openstack-infra | 17:28 | |
| sc` | running chef against a devstack-centos7 instance and httpd is failing to start with a permission denied on binding to 127.0.0.1:5000. the same cookbook works on ubuntu-trusty without issue | 17:28 |
| sc` | locally, i don't have the issue either | 17:28 |
| clarkb | you could disable tests on that branch or have return True as your testsuite | 17:29 |
| tosky | oh, right | 17:29 |
| clarkb | sc`: selinux would be my first guess | 17:29 |
| *** amitgandhinz has joined #openstack-infra | 17:29 | |
| tosky | so basically the big amount of work is on cores, and then just the request to you to enable the ACL | 17:29 |
| sc` | clarkb: you may be on to something. i'm too used to it just being disabled | 17:29 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added dbus to firefox install macro and bindep https://review.openstack.org/294677 | 17:29 |
| krotscheck | AJaeger: Done | 17:30 |
| *** pblaho has quit IRC | 17:30 | |
| clarkb | tosky: yes, ideally infra team would just merge the ACL change to allow you to create the branch and push merge commits | 17:30 |
| sc` | the cookbooks do attempt to play with selinux | 17:30 |
| krotscheck | Waaaaithavetoupdatecommitmessage | 17:30 |
| tosky | clarkb: oh, I didn't think that also ACL changes go through gerrit - which repository is? | 17:30 |
| *** jordanP has quit IRC | 17:31 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added dbus to firefox install macro and bindep https://review.openstack.org/294677 | 17:31 |
| krotscheck | Therewego | 17:31 |
| clarkb | tosky: openstack-infra/project-config under gerrit/acls/ | 17:31 |
| sc` | well, in any case, how might i go about disabling selinux with this setup to see if this thing will even converge? | 17:31 |
| anteaya | krotscheck: the commit title still says bindep | 17:31 |
| krotscheck | derp | 17:32 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added dbus to firefox install macro https://review.openstack.org/294677 | 17:32 |
| tosky | clarkb: thank you, I think I have all the information that I need | 17:32 |
| anteaya | abregman|afk: we are seeing that dbus isn't installed with firefox, that is my interpretation of the problem | 17:32 |
| anteaya | krotscheck: now the code and commit message, with title, match, thank you | 17:33 |
| clarkb | sc`: I think devstack turns it off before configuring anything so you should be able to do the same | 17:33 |
| *** amrith is now known as _amrith_ | 17:35 | |
| clarkb | sc`: you could also grab the /var/log/audit/audit.log file to check if it got logged as denied | 17:35 |
| sc` | i'll try that, too. the tricky part was finding where i could actually get that information without ssh | 17:36 |
| clarkb | in that log file | 17:36 |
| clarkb | if you write a change to dump it or copy it etc | 17:37 |
| *** e0ne has joined #openstack-infra | 17:37 | |
| sc` | yup. waiting for another build to fail to see what's happening | 17:37 |
| *** asselin has joined #openstack-infra | 17:37 | |
| *** auggy is now known as frauggy | 17:37 | |
| *** heyongli has quit IRC | 17:37 | |
| *** heyongli has joined #openstack-infra | 17:38 | |
| *** mylu has quit IRC | 17:39 | |
| HeOS | Guys, I've created the request https://review.openstack.org/#/c/284843/ 3 weeks ago, but there is still no scores about review. :( Whom could I poke to get a little scores? :) | 17:39 |
| *** nelsnelson has joined #openstack-infra | 17:40 | |
| clarkb | HeOS: zaro is a good person to bug about gerrit interactions | 17:40 |
| HeOS | clarkb, thank you. :) | 17:41 |
| HeOS | clarkb, how could I find him there? What is his name? | 17:42 |
| clarkb | zaro | 17:42 |
| *** gordc has quit IRC | 17:42 | |
| *** fverbs has quit IRC | 17:43 | |
| *** degorenko is now known as _degorenko|afk | 17:43 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config: Add experimental job for MongoDB https://review.openstack.org/294253 | 17:44 |
| *** lucasagomes is now known as lucas-afk | 17:44 | |
| *** david-lyle_ has joined #openstack-infra | 17:44 | |
| openstackgerrit | Andrey Nikitin proposed openstack-infra/puppet-gerrit: Order of the classes parameters is refactored https://review.openstack.org/294728 | 17:44 |
| *** david-lyle has quit IRC | 17:45 | |
| *** david-lyle_ is now known as david-lyle | 17:46 | |
| *** heyongli has quit IRC | 17:48 | |
| *** heyongli has joined #openstack-infra | 17:48 | |
| *** akshai has quit IRC | 17:49 | |
| *** mriedem1 has joined #openstack-infra | 17:50 | |
| *** pvaneck has joined #openstack-infra | 17:52 | |
| *** mriedem has quit IRC | 17:52 | |
| HeOS | zaro, please take a look at https://review.openstack.org/#/c/284843/. | 17:53 |
| *** jaimguer has joined #openstack-infra | 17:53 | |
| openstackgerrit | Thomas Maddox proposed openstack-infra/project-config: Move to Fedora 23 for Libvirt/LXC Nova Test https://review.openstack.org/293585 | 17:53 |
| *** jaimguer has quit IRC | 17:53 | |
| *** derekh has quit IRC | 17:55 | |
| *** piet has quit IRC | 17:55 | |
| krotscheck | gate-project-config-layout: NOT REGISTERED? That seems wrong | 17:55 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again https://review.openstack.org/288915 | 17:55 |
| anteaya | krotscheck: we are working on jenkins upgrades, that could be an artifact of our work | 17:56 |
| krotscheck | antI figured | 17:56 |
| pabelanger | Yup, a recheck should pick it up | 17:57 |
| *** heyongli has quit IRC | 17:58 | |
| *** heyongli has joined #openstack-infra | 17:58 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Add the releasenotes gate job to Packstack https://review.openstack.org/294741 | 17:59 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Add the releasenotes gate job to Packstack https://review.openstack.org/294741 | 18:00 |
| *** HeOS has quit IRC | 18:01 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Add the releasenotes gate job to Packstack https://review.openstack.org/294741 | 18:04 |
| dmsimard | sorry for the spam | 18:04 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Bug fix: Make set/unset of flavor specs work again https://review.openstack.org/294743 | 18:06 |
| *** ihrachys has joined #openstack-infra | 18:06 | |
| *** bpokorny_ has quit IRC | 18:07 | |
| *** bpokorny has joined #openstack-infra | 18:07 | |
| *** gordc has joined #openstack-infra | 18:08 | |
| *** heyongli has quit IRC | 18:08 | |
| *** heyongli has joined #openstack-infra | 18:08 | |
| *** sdake has quit IRC | 18:09 | |
| openstackgerrit | Ben Kero proposed openstack/diskimage-builder: Add new posix element. https://review.openstack.org/294748 | 18:10 |
| bkero | clarkb: ^ | 18:10 |
| *** tosky has quit IRC | 18:10 | |
| clarkb | bkero: woot thanks | 18:10 |
| openstackgerrit | Pradeep Kilambi proposed openstack/requirements: Add a cap on cryptography version https://review.openstack.org/294750 | 18:10 |
| *** bpokorny has quit IRC | 18:11 | |
| greghaynes | Is new posix as good as old posix? | 18:11 |
| clarkb | greghaynes: yes you can still cssc | 18:11 |
| clarkb | I leanred a whole lot about cssc last night | 18:11 |
| *** bpokorny has joined #openstack-infra | 18:12 | |
| clarkb | apparently it is still maintained and rcs isn't. Also it checksums your data and rcs doesn't but best of all they are adding distributed version control features | 18:12 |
| openstackgerrit | Ben Kero proposed openstack/diskimage-builder: Add new posix element. https://review.openstack.org/294748 | 18:12 |
| greghaynes | clarkb: wow | 18:12 |
| *** roxanaghe has joined #openstack-infra | 18:12 | |
| bkero | ^ new rev to edit commit message to add info about what the new packages do to its filesize | 18:12 |
| bkero | clarkb: Funny enough: Redhat doesn't package cssc. | 18:13 |
| *** doug-fis_ has joined #openstack-infra | 18:13 | |
| *** sdake has joined #openstack-infra | 18:13 | |
| bkero | or cflow | 18:14 |
| bkero | or cxref | 18:14 |
| *** sridhar_ram has joined #openstack-infra | 18:15 | |
| *** Guest76883 has quit IRC | 18:15 | |
| *** doug-fish has quit IRC | 18:15 | |
| anteaya | dmsimard: that's not bad, not to worry | 18:15 |
| *** HeOS has joined #openstack-infra | 18:15 | |
| *** sc68cal has quit IRC | 18:15 | |
| *** roxanaghe has quit IRC | 18:17 | |
| *** heyongli has quit IRC | 18:18 | |
| *** heyongli has joined #openstack-infra | 18:19 | |
| *** akshai has joined #openstack-infra | 18:19 | |
| *** knikolla has quit IRC | 18:19 | |
| AJaeger | krotscheck: 294677 will fail with NOT_REGISTERED, please recheck... | 18:20 |
| AJaeger | .. once you get the failure message | 18:20 |
| krotscheck | AJaeger: ok | 18:20 |
| *** kzaitsev_mb has quit IRC | 18:20 | |
| *** knikolla has joined #openstack-infra | 18:21 | |
| *** mriedem1 is now known as mriedem | 18:22 | |
| *** thiagop has quit IRC | 18:22 | |
| *** ddieterly[away] has quit IRC | 18:24 | |
| clarkb | btw this morning's debian image build failed when talking to the mirrors | 18:28 |
| *** dprince has joined #openstack-infra | 18:28 | |
| greghaynes | clarkb: debian mirrors? | 18:28 |
| *** heyongli has quit IRC | 18:29 | |
| clarkb | greghaynes: yes | 18:29 |
| greghaynes | clarkb: ya, they are #2 for mirror failures after fedora | 18:29 |
| *** heyongli has joined #openstack-infra | 18:29 | |
| clarkb | 2016-03-18 15:47:18,661 INFO nodepool.image.build.debian-jessie: E: Failed to fetch http://httpredir.debian.org/debian/pool/main/m/maven2/maven2_2.2.1-22_all.deb Error reading from server. Remote end closed connection [IP: 2001:41c8:1000:21::21:35 80] | 18:29 |
| *** rbrndt has joined #openstack-infra | 18:29 | |
| *** ddieterly has joined #openstack-infra | 18:29 | |
| *** ddieterly is now known as ddieterly[away] | 18:29 | |
| *** jistr has quit IRC | 18:33 | |
| *** IlyaG has quit IRC | 18:33 | |
| mordred | clarkb: is it time to add a debian jessie mirror? | 18:35 |
| Clint | it's always time for that | 18:35 |
| pabelanger | clarkb: figured that would be an issue | 18:35 |
| clarkb | mordred: well we don't use the mirrors for image builds at all | 18:35 |
| clarkb | mordred: but maybe we should | 18:35 |
| *** ddieterly[away] is now known as ddieterly | 18:36 | |
| *** dtardivel has quit IRC | 18:38 | |
| *** heyongli has quit IRC | 18:39 | |
| openstackgerrit | Ian Cordasco proposed openstack-dev/pbr: Include wsgi_scripts in generated wheels https://review.openstack.org/280270 | 18:39 |
| *** heyongli has joined #openstack-infra | 18:39 | |
| greghaynes | clarkb: check out https://review.openstack.org/#/c/279691/ | 18:39 |
| * greghaynes needs to unconflict that | 18:39 | |
| sc` | looks like selinux is the culprit, and one of the cookbooks explicitly sets enforcing for a fedora workaround. i'm tempted to remove said workaround | 18:40 |
| clarkb | greghaynes: I would just copy the sources.list or yum conf etc out of the host | 18:40 |
| greghaynes | clarkb: that could be made in to a non-test element that lets you set all the mirrors | 18:40 |
| mordred | clarkb: I tink we should use mirrors for image builds and also for infra servers, tbh | 18:40 |
| greghaynes | clarkb: dont youall cross-build/ | 18:41 |
| greghaynes | clarkb: thats why we dont, at least | 18:41 |
| clarkb | greghaynes: oh right gah | 18:41 |
| *** ddieterly has quit IRC | 18:41 | |
| mordred | we know the region that image builds happen in | 18:41 |
| mordred | so pointing them at rax.dfw mirror is easy | 18:41 |
| mordred | and then when we boot, configure-mirror will fix it | 18:41 |
| greghaynes | well, you can just copy that element and itll be done :) | 18:41 |
| clarkb | greghaynes: not quite because our nodepool server isn't a nodepool managed instance | 18:42 |
| clarkb | but its close | 18:42 |
| greghaynes | :( | 18:42 |
| mordred | yah | 18:42 |
| dmsimard | AJaeger: fair enough, what do I put then ? Nothing ? | 18:42 |
| mordred | we could alos make puppet to make all of our servers consume our mirror | 18:42 |
| mordred | so that the copy-from-host would work for image builds | 18:42 |
| mordred | we have cloud name and region in ansible when we invoke puppet | 18:43 |
| greghaynes | yea, so I might want to make that an actual element. The issue is there is a single var used for mirroring regardless of distro element, so you cant just have a static file that exports DIB_MIRROR_UBUNTU=foo DIB_MIRROOR_FEDORA=bar | 18:43 |
| mordred | so we can make those facts we pass to puppet | 18:43 |
| greghaynes | which is what that element solves | 18:43 |
| *** sabari has joined #openstack-infra | 18:43 | |
| AJaeger | dmsimard: sorry, missing context. Please explain... | 18:44 |
| mordred | and ten in the puppet, if the openstack_cloud and openstack_region_name facts aren't set, we will not rewrite sources lists | 18:44 |
| dmsimard | AJaeger: sorry, was re: packstack release notes | 18:44 |
| dmsimard | AJaeger: I understand that Packstack is not big tent - and thus -infra will not host the release notes on docs.openstack.org | 18:44 |
| AJaeger | dmsimard: you can run the single jobs for testing and drafting but not the publish one. | 18:44 |
| greghaynes | mordred: copy-from host would require you to do every image build on the host matching what youre building too, thogh | 18:45 |
| greghaynes | mordred: since right now its ubuntu building fedora for example | 18:45 |
| AJaeger | dmsimard: just use 'gate-{name}-releasenotes' in projects.yaml - and add that one to your check/gate queue as gate-packstack-releasenotes | 18:45 |
| clarkb | I think for nodepool we just hardcode use the dfw mirror because thats where nodepool is | 18:46 |
| dmsimard | AJaeger: thanks. | 18:46 |
| AJaeger | That avoids the template and thus the publish job | 18:46 |
| clarkb | if that changes we change it | 18:46 |
| *** kgiusti has left #openstack-infra | 18:46 | |
| clarkb | however we haven't really needed this at all | 18:46 |
| clarkb | so not sure its necessary yet | 18:46 |
| openstackgerrit | Ben Kero proposed openstack/diskimage-builder: Fix add-apt-repository package for debian https://review.openstack.org/294760 | 18:47 |
| *** abregman|afk is now known as abregman | 18:47 | |
| openstackgerrit | Ben Kero proposed openstack/diskimage-builder: Fix add-apt-repository package for debian https://review.openstack.org/294760 | 18:47 |
| abregman | anteaya: thanks for clarifying it | 18:48 |
| anteaya | abregman: thanks for posting the question on the review :) | 18:48 |
| anteaya | glad to see you willing to dip your toe in the water | 18:48 |
| *** lbragstad has quit IRC | 18:49 | |
| mordred | clarkb: I was suggesting the switch-on-variables so that we _could_ run builders in other regions, but also so that people running copies of our stuff could get decent experience | 18:49 |
| *** lbragstad has joined #openstack-infra | 18:49 | |
| *** heyongli has quit IRC | 18:49 | |
| *** heyongli has joined #openstack-infra | 18:49 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Add the releasenotes gate job to Packstack https://review.openstack.org/294741 | 18:50 |
| clarkb | ya that seems reasonably but I just don't know we need to worry about it | 18:50 |
| clarkb | we have never used our mirrors for more than test optimizations | 18:50 |
| greghaynes | also, your mirrors are fully public, you can really just pick any one and itll be fine - you just want them to not be down | 18:50 |
| greghaynes | as far as dib is concerned | 18:51 |
| greghaynes | since its super low traffic | 18:51 |
| abregman | question about infra-ansible. Is it suppose to be an equivalent project of system-config? what was the idea behind it? | 18:53 |
| *** bpokorny_ has joined #openstack-infra | 18:53 | |
| *** piet has joined #openstack-infra | 18:54 | |
| *** bpokorny_ has quit IRC | 18:54 | |
| nibalizer | abregman: to set up an infra with ansible | 18:54 |
| nibalizer | it would call puppet to run things | 18:55 |
| nibalizer | i think the current reccomendation is to make your own system-config that uses our puppet-* modules but not code from system-config | 18:55 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Add the releasenotes gate job to Packstack https://review.openstack.org/294741 | 18:56 |
| anteaya | abregman: we started with puppet since the choices at the time were puppet and chef | 18:56 |
| anteaya | and mordred could get puppet to work | 18:56 |
| anteaya | so we wrote puppet modules for everything | 18:56 |
| *** andymaier has quit IRC | 18:56 | |
| anteaya | but puppet doesn't orchestrate well | 18:56 |
| anteaya | so we had races | 18:56 |
| anteaya | along came salt and ansible | 18:56 |
| mordred | anteaya: infra-ansible is a slightly different thing | 18:57 |
| anteaya | and I couldn't figure out sall and ansible uses yaml like we already do | 18:57 |
| *** bpokorny has quit IRC | 18:57 | |
| anteaya | salt | 18:57 |
| anteaya | mordred: is it now, do tell the tale | 18:57 |
| anteaya | abregman: is trying to infra | 18:57 |
| mordred | ansible-puppet is our ansible role to run puppet, and puppet-ansible is our puppet module to install ansible | 18:57 |
| anteaya | abregman: and i'm trying to teach him how to infra | 18:57 |
| openstackgerrit | Deklan Dieterly proposed openstack-infra/project-config: Modify gate-freezer-api-devstack-dsvm job https://review.openstack.org/291430 | 18:57 |
| mordred | infra-ansible is a thing ricky wrote to start looking at standing up an infra using ansible | 18:57 |
| mordred | I do not know its current state | 18:57 |
| anteaya | ah | 18:57 |
| anteaya | it ansibles without puppeting | 18:58 |
| abregman | anteaya, nibalizer: thanks for explaining this. are there any improvements/features I can work on for ansible-infra? | 18:58 |
| *** bpokorny has joined #openstack-infra | 18:58 | |
| anteaya | abregman: ricky is rcarrillocruz | 18:58 |
| anteaya | so it sounds like it is his thing | 18:58 |
| anteaya | and would know the most about it | 18:58 |
| abregman | yeah I see now he is the only contributor :) | 18:59 |
| nibalizer | abregman: is your goal to run an infra? | 18:59 |
| anteaya | no to help us | 18:59 |
| abregman | rcarrillocruz: ^ need any help with ansible-infra? | 18:59 |
| *** heyongli has quit IRC | 18:59 | |
| anteaya | nibalizer: he is trying to figure out how to help us | 18:59 |
| *** heyongli has joined #openstack-infra | 19:00 | |
| abregman | nibalizer: no. I have experience with some ansible based projects as Khaleesi. I would like to contribute openstack-infra in some way...ansible looks like the best way but I basically would be happy to work on anything at this moment | 19:00 |
| *** mrmartin has joined #openstack-infra | 19:01 | |
| nibalizer | abregman: well we have an ansible-puppet interaction that is new and full of little bugs and gotcha | 19:01 |
| *** mrmartin has quit IRC | 19:01 | |
| * abregman searching for ansible-puppet | 19:01 | |
| anteaya | git.openstack.org | 19:02 |
| abregman | I guess I can start with improving the overview -> "Configures Ansible." :) | 19:02 |
| *** amitgandhinz has quit IRC | 19:02 | |
| anteaya | abregman: all our repos are mirrored from gerrit (the canonical source) to our git farm at git.openstack.org | 19:02 |
| anteaya | abregman: yay a place to begin! | 19:03 |
| *** daemontool_ has quit IRC | 19:03 | |
| AJaeger | abregman: please update documentation as you learn and notice problems! | 19:04 |
| abregman | AJaeger: sure thing! | 19:04 |
| abregman | finally..some work! :D | 19:04 |
| anteaya | abregman: AJaeger is a great reviewer of docs patches | 19:04 |
| anteaya | he leaves the most wonderful comments | 19:05 |
| *** Swami has quit IRC | 19:05 | |
| *** Swami has joined #openstack-infra | 19:05 | |
| AJaeger | ;) | 19:05 |
| *** jpr has quit IRC | 19:06 | |
| *** jpr has joined #openstack-infra | 19:06 | |
| *** kzaitsev_mb has joined #openstack-infra | 19:07 | |
| *** doug-fis_ has quit IRC | 19:07 | |
| anteaya | you do | 19:08 |
| *** dprince has quit IRC | 19:08 | |
| anteaya | lovely comments | 19:08 |
| *** dprince has joined #openstack-infra | 19:08 | |
| * AJaeger needs to review his comments when he's next time down ;) | 19:08 | |
| AJaeger | anteaya, everyone: Have a great weekend. Bye for now! | 19:09 |
| *** heyongli has quit IRC | 19:10 | |
| *** heyongli has joined #openstack-infra | 19:10 | |
| nibalizer | abregman: the entrypoint of our systems is a cronjob that runs 'run_all.sh' from system-config | 19:10 |
| nibalizer | puppet-ansible is a small part of that | 19:11 |
| *** ihrachys has quit IRC | 19:11 | |
| *** ihrachys has joined #openstack-infra | 19:12 | |
| *** piet has quit IRC | 19:12 | |
| *** e0ne has quit IRC | 19:12 | |
| abregman | nibalizer: ah..cool. thanks for telling me this :) right now I'm going to run it just to get feel of how it works | 19:12 |
| *** chlong has quit IRC | 19:12 | |
| anteaya | AJaeger: enjoy the weekend | 19:13 |
| *** roxanaghe has joined #openstack-infra | 19:13 | |
| prometheanfire | well, dib checks are still broken for centos http://logs.openstack.org/94/290894/3/check/gate-dib-dsvm-functests-devstack-centos7/c55e750/ | 19:13 |
| clarkb | yes deactivate has the unset var problem too | 19:14 |
| *** roxanaghe has quit IRC | 19:14 | |
| clarkb | but you didn't like my suggestion to stop set -u'ing so I didn't push it | 19:14 |
| *** etoews has quit IRC | 19:15 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config: Add experimental job for MongoDB https://review.openstack.org/294253 | 19:15 |
| *** zhenguo_ has quit IRC | 19:16 | |
| prometheanfire | clarkb: well, that activate line isn't refrenced in dib sources at all | 19:16 |
| *** SumitNaiksatam has joined #openstack-infra | 19:16 | |
| clarkb | prometheanfire: its part of the job itself, | 19:16 |
| clarkb | via the deactivate | 19:16 |
| *** etoews has joined #openstack-infra | 19:16 | |
| *** zhenguo_ has joined #openstack-infra | 19:17 | |
| *** nadya has joined #openstack-infra | 19:17 | |
| *** yamahata has quit IRC | 19:17 | |
| prometheanfire | so in project-config? | 19:17 |
| clarkb | yes | 19:17 |
| *** ociuhandu has quit IRC | 19:18 | |
| clarkb | where we previously attempted to fix the job | 19:18 |
| prometheanfire | I don't see it there at all | 19:18 |
| prometheanfire | activate is there in three places, none to do with dib | 19:18 |
| clarkb | https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/diskimage-builder.yaml#n33 | 19:19 |
| clarkb | as an alternative remove the deactivate | 19:19 |
| *** sdake has quit IRC | 19:20 | |
| *** heyongli has quit IRC | 19:20 | |
| *** sdake has joined #openstack-infra | 19:20 | |
| *** heyongli has joined #openstack-infra | 19:20 | |
| prometheanfire | k, making a review | 19:20 |
| *** jpr has quit IRC | 19:21 | |
| openstackgerrit | Matthew Thode proposed openstack-infra/project-config: Add non-voting diskimage-builder jobs https://review.openstack.org/293193 | 19:21 |
| *** e0ne has joined #openstack-infra | 19:22 | |
| openstackgerrit | Matthew Thode proposed openstack-infra/project-config: fix deactivate as it also needs set +u https://review.openstack.org/294773 | 19:24 |
| prometheanfire | clarkb: thatone ^ | 19:24 |
| *** e0ne has quit IRC | 19:29 | |
| *** akshai has quit IRC | 19:30 | |
| *** heyongli has quit IRC | 19:30 | |
| *** heyongli has joined #openstack-infra | 19:30 | |
| *** Jeffrey4l has quit IRC | 19:31 | |
| *** apoorvad has quit IRC | 19:31 | |
| *** piet has joined #openstack-infra | 19:34 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: make the default dashboard format csv https://review.openstack.org/294776 | 19:35 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: sort on the managed flag before other values https://review.openstack.org/294777 | 19:35 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: lower case all team names to sort consistently https://review.openstack.org/294778 | 19:35 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: add PTL email to release dashboard https://review.openstack.org/294779 | 19:35 |
| *** ihrachys has quit IRC | 19:37 | |
| *** heyongli has quit IRC | 19:40 | |
| *** heyongli has joined #openstack-infra | 19:41 | |
| openstackgerrit | Arie Bregman proposed openstack-infra/infra-ansible: Fix tiny styling issue https://review.openstack.org/294781 | 19:41 |
| *** sambetts is now known as sambetts|afk | 19:42 | |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Trigger python27 job for packetary-specs https://review.openstack.org/294580 | 19:42 |
| *** akshai has joined #openstack-infra | 19:43 | |
| *** kzaitsev_mb has quit IRC | 19:44 | |
| *** ociuhandu has joined #openstack-infra | 19:45 | |
| *** heyongli has quit IRC | 19:51 | |
| *** heyongli has joined #openstack-infra | 19:51 | |
| abregman | rcarrillocruz: hi. where 'keypairs' exactly defined? https://github.com/openstack-infra/infra-ansible/blob/master/roles/setup_openstack_resources/tasks/main.yml#L9 | 19:55 |
| openstackgerrit | Deklan Dieterly proposed openstack-infra/project-config: Modify gate-freezer-api-devstack-dsvm job https://review.openstack.org/291430 | 19:55 |
| *** kzaitsev_mb has joined #openstack-infra | 19:57 | |
| anteaya | abregman: rcarrillocruz is in spain | 19:57 |
| anteaya | so probably weekending by now | 19:57 |
| anteaya | there may be a pause in your response | 19:57 |
| abregman | anteaya: should have guessed. thanks :) | 19:58 |
| anteaya | how would you have known? | 19:58 |
| anteaya | and you're welcome | 19:59 |
| *** ddieterly has joined #openstack-infra | 19:59 | |
| *** yamahata has joined #openstack-infra | 19:59 | |
| *** ddieterly has quit IRC | 20:00 | |
| anteaya | we prefer to link to code on git.o.o as it is open source software | 20:00 |
| *** SumitNaiksatam has quit IRC | 20:00 | |
| clarkb | also note that we don't really use infra-ansible | 20:00 |
| anteaya | we mirror to github but it is propriatary software | 20:00 |
| clarkb | I am not sure that there has been any planning to do so. | 20:01 |
| *** heyongli has quit IRC | 20:01 | |
| *** heyongli has joined #openstack-infra | 20:01 | |
| prometheanfire | just need to find a someone to finihs this out https://review.openstack.org/#/c/294773/ | 20:02 |
| *** ddieterly has joined #openstack-infra | 20:02 | |
| *** notnownikki has quit IRC | 20:04 | |
| *** IlyaG has joined #openstack-infra | 20:06 | |
| *** bpokorny has quit IRC | 20:06 | |
| *** roxanaghe has joined #openstack-infra | 20:09 | |
| *** heyongli has quit IRC | 20:11 | |
| *** heyongli has joined #openstack-infra | 20:11 | |
| dmsimard | My understanding is that release notes are published to docs.openstack.org over FTP ( https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/openstack-publish-jobs.yaml#L67-L103 ) | 20:12 |
| *** IlyaG has quit IRC | 20:12 | |
| dmsimard | Since Packstack is not in the big tent, I was told our notes could not be published to docs.openstack, that's fine. Would you guys be okay if we provided an alternative ftp server to host the notes ? | 20:12 |
| prometheanfire | cool | 20:13 |
| *** akshai has quit IRC | 20:14 | |
| *** IlyaG has joined #openstack-infra | 20:14 | |
| dmsimard | oh no, anteaya, I used "guys" again.. now I feel bad T_T | 20:14 |
| *** e0ne has joined #openstack-infra | 20:15 | |
| clarkb | dmsimard: ftp is an implementation detail because we use a hosting service for the docs site | 20:15 |
| clarkb | dmsimard: I think we far prefer using scp when we can | 20:16 |
| dmsimard | Okay, so any scp builder will do for transferring these out ? | 20:16 |
| anteaya | dmsimard: thanks for thinking of it, nine more times and you might remember :) | 20:16 |
| dmsimard | yeah, first step is noticing | 20:16 |
| clarkb | dmsimard: yup, that said I think we would prefer to control where we host them (the fact wedon't have much control over docs is kind of a pain). The other alternative many use is read the docs | 20:16 |
| anteaya | folks people team group infra all good words | 20:16 |
| anteaya | dmsimard: yup | 20:17 |
| HeOS | What's happened here: http://logs.openstack.org/28/294728/2/check/gate-puppet-gerrit-puppet-beaker-rspec-dsvm-trusty-nv/74f5c94/console.html ? I see only the following error: "An error occurred while installing mime-types-data (3.2016.0221), and Bundler" | 20:17 |
| clarkb | HeOS: looks like bundler failed | 20:18 |
| openstackgerrit | Arie Bregman proposed openstack-infra/infra-ansible: Change keypair creation to be file based and add defaults https://review.openstack.org/294791 | 20:18 |
| *** akshai has joined #openstack-infra | 20:18 | |
| dmsimard | clarkb: not going to lie, we'd love to host the packstack release notes on docs.openstack.org but AJaeger respectfully (and understandably) declined https://review.openstack.org/#/c/294741/ | 20:18 |
| openstackgerrit | Merged openstack-infra/project-config: fix deactivate as it also needs set +u https://review.openstack.org/294773 | 20:19 |
| prometheanfire | woot | 20:19 |
| dmsimard | We're working towards straightening up packstack (i.e, integration gate jobs that were implemented throughout mitaka are a first good step) and headed in the direction to make packstack a good OpenStack citizen (using Reno now too!) | 20:19 |
| HeOS | clarkb, I see it, but I can't understand, how I can fix it. :) | 20:19 |
| clarkb | HeOS: I have no idea | 20:19 |
| clarkb | HeOS: I do not know how bundler works, but I would start there | 20:20 |
| *** apoorvad has joined #openstack-infra | 20:20 | |
| HeOS | Btw, that job has been started by https://review.openstack.org/#/c/294728/. | 20:20 |
| EmilienM | first I see UNSTABLE on CI jobs https://review.openstack.org/#/c/294619/ - did I miss something? | 20:21 |
| *** Sukhdev has joined #openstack-infra | 20:21 | |
| anteaya | bundler is a way or organizing ruby gems downloads and versions | 20:21 |
| *** heyongli has quit IRC | 20:21 | |
| clarkb | wow those log files are huge | 20:21 |
| *** heyongli has joined #openstack-infra | 20:22 | |
| *** dprince has quit IRC | 20:22 | |
| openstackgerrit | Arie Bregman proposed openstack-infra/infra-ansible: Fix tiny styling issue https://review.openstack.org/294781 | 20:22 |
| openstackgerrit | Matthew Thode proposed openstack-infra/project-config: Add non-voting diskimage-builder jobs https://review.openstack.org/293193 | 20:22 |
| clarkb | EmilienM: when the log finishes downloading maybe we can figure out why that happened | 20:22 |
| clarkb | java.io.IOException: java.io.FileNotFoundException: /home/jenkins/workspace/gate-puppet-openstack-integration-3-scenario001-tempest-dsvm-centos7/logs/etc/neutron/plugin.ini (Permission denied) | 20:23 |
| clarkb | thats why | 20:23 |
| *** akshai has quit IRC | 20:23 | |
| clarkb | fungi: ^ apparently we have run into that log server permissions thing again | 20:23 |
| EmilienM | meh | 20:23 |
| clarkb | still have no idea what causes that | 20:24 |
| openstackgerrit | Merged openstack-infra/project-config: Added dbus to firefox install macro https://review.openstack.org/294677 | 20:24 |
| anteaya | fungi: here is the add dbus to firefox installation patch: https://review.openstack.org/#/c/294677/5 | 20:24 |
| anteaya | it just merged | 20:24 |
| *** bpokorny has joined #openstack-infra | 20:24 | |
| *** devananda has quit IRC | 20:24 | |
| dmsimard | EmilienM: sudo missing somewhere in copy logs ? | 20:24 |
| clarkb | dmsimard: no it uses the scp plugin and should write everything as the jenkins users | 20:25 |
| dmsimard | I'm reading that as a source file permission denied, not destination | 20:25 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/288849 | 20:26 |
| clarkb | dmsimard: oh! | 20:27 |
| clarkb | dmsimard: yes that may be the case | 20:27 |
| clarkb | sorry we had problems with dest side perms but I just checked and dest side looks fine so you are proably correct | 20:27 |
| clarkb | -rw-rw-r-- 1 jenkins jenkins 0 Mar 18 20:03 plugin.ini is dest side | 20:28 |
| dmsimard | there's a lot of logfile permission/ownership manipulation/copying in copy-puppet-logs, it's possible there is an edge case that isn't handled | 20:28 |
| *** armax has joined #openstack-infra | 20:28 | |
| *** andymaier has joined #openstack-infra | 20:31 | |
| *** heyongli has quit IRC | 20:32 | |
| *** heyongli has joined #openstack-infra | 20:32 | |
| *** andymaier has quit IRC | 20:34 | |
| *** tonytan4ever has quit IRC | 20:37 | |
| *** devananda has joined #openstack-infra | 20:38 | |
| *** jpr has joined #openstack-infra | 20:38 | |
| fungi | yeah, looks like the scp probably created the file, then tried to copy into it, and at that point failed to read from the source | 20:38 |
| *** e0ne has quit IRC | 20:38 | |
| *** andymaier has joined #openstack-infra | 20:41 | |
| *** heyongli has quit IRC | 20:42 | |
| *** akshai has joined #openstack-infra | 20:42 | |
| *** heyongli has joined #openstack-infra | 20:42 | |
| *** haleyb has joined #openstack-infra | 20:45 | |
| *** sputnik13 has quit IRC | 20:45 | |
| *** kzaitsev_mb has quit IRC | 20:45 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:46 | |
| HeOS | So, guys, should I restart all jobs for my request? | 20:49 |
| haleyb | can anyone here advise me on fixing a requirements problem? i've been trying to cherry-pick something into stable/liberty neutron-lbass - https://review.openstack.org/#/c/294687/ - but it blows up because of a "bad" cryptography library. pinning to cryptography<1.2 seems to work, but don't know if that's the best way? | 20:50 |
| *** kzaitsev_mb has quit IRC | 20:51 | |
| *** sputnik13 has joined #openstack-infra | 20:51 | |
| *** Sukhdev has quit IRC | 20:52 | |
| prometheanfire | clarkb: not sure if jjb isn't updated for the cent job or not, but fail http://logs.openstack.org/94/290894/3/check/gate-dib-dsvm-functests-devstack-centos7/2568096/console.html | 20:52 |
| *** heyongli has quit IRC | 20:52 | |
| clarkb | prometheanfire: jjb updates are not instantaneous | 20:52 |
| *** heyongli has joined #openstack-infra | 20:52 | |
| *** nihilifer has quit IRC | 20:52 | |
| clarkb | that job started a minute after merging according to my timestamps | 20:53 |
| clarkb | you need to give it more time | 20:53 |
| prometheanfire | clarkb: it failed on the activates, not deactivates | 20:53 |
| prometheanfire | which is odd... | 20:53 |
| prometheanfire | so, recheck again? | 20:53 |
| clarkb | prometheanfire: looks a few lines up | 20:53 |
| clarkb | it is in the deactivate | 20:53 |
| *** nihilifer has joined #openstack-infra | 20:53 | |
| prometheanfire | oh, ya | 20:54 |
| prometheanfire | that line always throws me | 20:54 |
| *** andymaier has quit IRC | 20:54 | |
| *** IlyaG has quit IRC | 20:55 | |
| *** eil397 has quit IRC | 20:56 | |
| *** eil397 has joined #openstack-infra | 20:56 | |
| anteaya | mriedem: have a moment to help haleyb regarding https://review.openstack.org/#/c/294687/ | 20:57 |
| anteaya | mriedem: I'm looking but don't have much confidence | 20:57 |
| haleyb | we found this https://github.com/pyca/pyopenssl/issues/407 | 20:57 |
| mriedem | not right now, debugging how webob 1.6.0 is breaking all of the clients | 20:57 |
| haleyb | so there's some things that don't play well together | 20:58 |
| anteaya | mriedem: very good, sorry to bother | 20:59 |
| anteaya | haleyb: :( | 20:59 |
| jroll | haleyb: so looks like they're working on getting a fix out | 20:59 |
| anteaya | haleyb: did this work in the master branch? | 20:59 |
| haleyb | it's strange that only affects stable/liberty | 20:59 |
| jroll | oh that was january, ignore me | 21:00 |
| haleyb | https://github.com/pyca/pyopenssl/pull/418 was the actual change i think | 21:00 |
| *** _ari_ has quit IRC | 21:00 | |
| *** _ari_ has joined #openstack-infra | 21:01 | |
| *** sdague has quit IRC | 21:02 | |
| haleyb | i'll just pin it and move along, as it's breaking neutron stable/liberty as well | 21:02 |
| *** heyongli has quit IRC | 21:02 | |
| jroll | erm, they haven't released pyopenssl since april 2015 :( | 21:03 |
| *** heyongli has joined #openstack-infra | 21:03 | |
| *** _ari_ has quit IRC | 21:03 | |
| *** rossella_s has quit IRC | 21:03 | |
| anteaya | answering my own question, yes this merged on master two days ago: https://review.openstack.org/#/c/293744/ | 21:03 |
| anteaya | jroll: :( | 21:03 |
| *** _ari_ has joined #openstack-infra | 21:03 | |
| *** rossella_s has joined #openstack-infra | 21:03 | |
| *** leakypipes has quit IRC | 21:04 | |
| jroll | looks like cryptography 1.3 released today | 21:04 |
| jroll | https://pypi.python.org/pypi/cryptography | 21:04 |
| *** _ari_ has quit IRC | 21:05 | |
| jroll | judging by https://github.com/pyca/pyopenssl/pull/418 we need a pyopenssl release so that stops breaking | 21:05 |
| * jroll goes to chat with those folks | 21:05 | |
| *** _ari_ has joined #openstack-infra | 21:05 | |
| anteaya | jroll: you are awesome | 21:05 |
| anteaya | happy chatting | 21:05 |
| *** |-paul-| has joined #openstack-infra | 21:05 | |
| EmilienM | dmsimard: we use sudo http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/copy_puppet_logs.sh#n57 | 21:06 |
| *** _ari_ has quit IRC | 21:06 | |
| clarkb | EmilienM: but jenkins doesn't whne scping | 21:06 |
| clarkb | so the perms have to be such that the jenkins user can read that file | 21:06 |
| *** david-lyle has quit IRC | 21:06 | |
| jroll | anteaya: :) | 21:06 |
| anteaya | :) | 21:07 |
| *** david-lyle has joined #openstack-infra | 21:07 | |
| bkero | Is anyone working on the dsvm-trusty uuidgen failure? | 21:07 |
| *** _ari_ has joined #openstack-infra | 21:07 | |
| dmsimard | clarkb: yeah this _should_ be done here http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/copy_puppet_logs.sh#n168 | 21:07 |
| bkero | Is that waiting for a new nodepool image? | 21:07 |
| *** nadya has quit IRC | 21:07 | |
| clarkb | bkero: yes, we need to upload the new image which is next on my list once jenkins is all patched (just about done) | 21:07 |
| bkero | ok, cool | 21:07 |
| clarkb | bkero: we have the image built but not uploaded due to gearman restart earlier today | 21:07 |
| clarkb | I will be requeueing things shortly | 21:07 |
| * bkero will hold on the job restarts | 21:07 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Pass specific cloud to openstack_clouds function https://review.openstack.org/294814 | 21:08 |
| *** Nepoc has quit IRC | 21:09 | |
| EmilienM | dmsimard: right, weir | 21:09 |
| jroll | anteaya: haleyb: https://botbot.me/freenode/cryptography-dev/2016-03-18/?msg=62470517&page=2 | 21:09 |
| jroll | sounds like "very soon but you may want to pin for now" | 21:09 |
| anteaya | jroll: you are awesome! | 21:10 |
| anteaya | haleyb: ^^ | 21:10 |
| anteaya | jroll: thanks so much | 21:11 |
| jroll | anteaya: you're welcome, it was nothing :) | 21:11 |
| anteaya | well for you | 21:12 |
| anteaya | would have been days of pain for me | 21:12 |
| anteaya | so thanks for you | 21:12 |
| jroll | just gotta know who to pester, I guess :) | 21:12 |
| *** heyongli has quit IRC | 21:13 | |
| jroll | now you know #cryptography-dev is the place to go for cryptography/pyopenssl questions :) | 21:13 |
| *** heyongli has joined #openstack-infra | 21:13 | |
| *** ZZelle has joined #openstack-infra | 21:13 | |
| *** armax has quit IRC | 21:15 | |
| *** Nepoc has joined #openstack-infra | 21:15 | |
| anteaya | jroll: that's what I'm talking about | 21:15 |
| anteaya | to the extent that that helps me | 21:15 |
| anteaya | :) | 21:15 |
| *** _ari_ has quit IRC | 21:16 | |
| anteaya | I joined for posterity's sake | 21:16 |
| ddieterly | anyone know how to workaround/fix these pylint errors? http://logs.openstack.org/42/290842/7/check/gate-freezer-api-pylint/5730ff5/console.html | 21:16 |
| *** _ari_ has joined #openstack-infra | 21:16 | |
| ddieterly | specifically, 'Use of super on an old style class (super-on-old-class)' | 21:17 |
| ddieterly | the error seems wrong as only new style classes are being used | 21:17 |
| *** _ari_ is now known as ari | 21:17 | |
| *** ldnunes has quit IRC | 21:17 | |
| *** ari has quit IRC | 21:19 | |
| *** ari has joined #openstack-infra | 21:20 | |
| *** dimtruck is now known as zz_dimtruck | 21:20 | |
| *** ari has quit IRC | 21:21 | |
| *** _ari_ has joined #openstack-infra | 21:21 | |
| *** thorst has quit IRC | 21:21 | |
| *** asselin__ has joined #openstack-infra | 21:22 | |
| fungi | ddieterly: not sure. not many projects are using pylint because it tends to be finicky, hard to please, and sometimes complains about completely valid code | 21:22 |
| ddieterly | fungi thanks, argh... | 21:23 |
| *** akshai_ has joined #openstack-infra | 21:23 | |
| *** heyongli has quit IRC | 21:23 | |
| EmilienM | there is still something weird with logs on our centos7 jobs | 21:23 |
| *** heyongli has joined #openstack-infra | 21:23 | |
| *** lezbar__ has joined #openstack-infra | 21:23 | |
| fungi | EmilienM: weird as in more permissions issues? | 21:23 |
| EmilienM | yes | 21:23 |
| *** rfolco has quit IRC | 21:23 | |
| *** thorst has joined #openstack-infra | 21:24 | |
| fungi | EmilienM: is it possible those files are being created without world read, or in non-world-readable directories? | 21:24 |
| EmilienM | fungi: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/copy_puppet_logs.sh#n168 | 21:24 |
| fungi | EmilienM: the publisher attempts to copy them as the jenkins user, so if you have root or other non-jenkins users creating the logs then they'll need to be accessible to the jenkins user | 21:24 |
| *** charz_ has joined #openstack-infra | 21:25 | |
| *** charz has quit IRC | 21:25 | |
| *** bauwser has quit IRC | 21:25 | |
| *** bauzas has joined #openstack-infra | 21:25 | |
| *** mestery has quit IRC | 21:25 | |
| *** zaro has quit IRC | 21:25 | |
| *** greghaynes has quit IRC | 21:25 | |
| *** mikal has quit IRC | 21:25 | |
| *** erikmwilson has quit IRC | 21:25 | |
| *** thomasem has quit IRC | 21:25 | |
| *** j_king has quit IRC | 21:25 | |
| EmilienM | something with etc/neutron/plugin.ini | 21:25 |
| *** mikal has joined #openstack-infra | 21:25 | |
| *** mestery has joined #openstack-infra | 21:25 | |
| *** thomasem has joined #openstack-infra | 21:25 | |
| *** erikmwilson has joined #openstack-infra | 21:26 | |
| *** andreaf has quit IRC | 21:26 | |
| *** esker has quit IRC | 21:26 | |
| *** zaro has joined #openstack-infra | 21:26 | |
| *** coreyob has quit IRC | 21:26 | |
| EmilienM | dmsimard: wondering if it's an openstack-neutron packaging thing | 21:26 |
| *** akshai has quit IRC | 21:26 | |
| *** asselin_ has quit IRC | 21:26 | |
| *** edmondsw has quit IRC | 21:26 | |
| *** hughsaunders has quit IRC | 21:26 | |
| *** mordred has quit IRC | 21:26 | |
| *** lezbar has quit IRC | 21:26 | |
| *** kambiz has quit IRC | 21:26 | |
| *** _denisra has quit IRC | 21:26 | |
| *** adreznec has quit IRC | 21:26 | |
| *** wendar has quit IRC | 21:26 | |
| *** reed has quit IRC | 21:26 | |
| *** dhellmann has quit IRC | 21:26 | |
| *** _degorenko|afk has quit IRC | 21:26 | |
| *** swat30 has quit IRC | 21:26 | |
| *** dstufft has quit IRC | 21:26 | |
| *** wendar has joined #openstack-infra | 21:26 | |
| *** redrobot has quit IRC | 21:26 | |
| *** adreznec has joined #openstack-infra | 21:26 | |
| *** j_king has joined #openstack-infra | 21:26 | |
| *** reed has joined #openstack-infra | 21:26 | |
| *** kambiz has joined #openstack-infra | 21:26 | |
| *** dhellmann has joined #openstack-infra | 21:26 | |
| *** mordred has joined #openstack-infra | 21:26 | |
| *** esker has joined #openstack-infra | 21:26 | |
| *** dstufft has joined #openstack-infra | 21:26 | |
| *** edmondsw has joined #openstack-infra | 21:26 | |
| *** hughsaunders has joined #openstack-infra | 21:27 | |
| fungi | could that file be a symlink to somewhere else? | 21:27 |
| *** _denisra has joined #openstack-infra | 21:27 | |
| EmilienM | yes, it's a symblink managed by puppet-neutron | 21:27 |
| *** kzaitsev_mb has joined #openstack-infra | 21:27 | |
| *** _degorenko|afk has joined #openstack-infra | 21:27 | |
| EmilienM | let me read the code again | 21:27 |
| *** swat30 has joined #openstack-infra | 21:27 | |
| *** greghaynes has joined #openstack-infra | 21:27 | |
| *** coreyob has joined #openstack-infra | 21:27 | |
| *** IlyaG has joined #openstack-infra | 21:28 | |
| EmilienM | fungi: https://github.com/openstack/puppet-neutron/blob/master/manifests/plugins/ml2.pp#L164-L167 | 21:28 |
| fungi | EmilienM: if so, then copying that into your $LOG_DIR is copying the symlink, not the dereferenced target file | 21:28 |
| *** andreaf has joined #openstack-infra | 21:28 | |
| EmilienM | but we always did that | 21:28 |
| EmilienM | and it never failed until today | 21:28 |
| *** thorst has quit IRC | 21:28 | |
| fungi | possible something changed today that the target of that link started to be non-world-readable | 21:28 |
| *** redrobot has joined #openstack-infra | 21:29 | |
| *** redrobot is now known as Guest98399 | 21:29 | |
| fungi | your find+chmod over the $LOG_DIR won't apply to link targets outside that tree | 21:29 |
| *** mriedem has quit IRC | 21:29 | |
| fungi | what's creating the /etc/neutron/plugins/ml2/ml2_conf.ini file? package installation? | 21:29 |
| EmilienM | fungi: packaing | 21:30 |
| *** IlyaG has quit IRC | 21:30 | |
| EmilienM | every change in packaging specs should be seen here: https://github.com/openstack-packages/neutron/commits/rpm-master | 21:30 |
| EmilienM | but I don't see any change lately about that | 21:30 |
| EmilienM | fungi: and the source file has 755: https://github.com/openstack-packages/neutron/blob/rpm-master/openstack-neutron.spec#L355 | 21:32 |
| clarkb | bkero: osic and bluebox have the new ubuntu-trusty image, vexxhost failed and the other clouds are in progress | 21:32 |
| *** jpr has quit IRC | 21:33 | |
| clarkb | mnaser: are you around? it looks like the nginx type fail is still persisting on image uploads | 21:33 |
| EmilienM | the weird thing is, if something would change in packaging, it would have failed in our packaging promotion jobs | 21:33 |
| clarkb | mnaser: OpenStackCloudException: Image creation failed: Error finding address for https://image-ca-ymq-1.vexxhost.net/v2/images/91ef7c7d-6e8d-41c6-90e0-1e4c9478f722/file: Unable to establish connection to https://image-ca-ymq-1.vexxhost.net/v2/images/91ef7c7d-6e8d-41c6-90e0-1e4c9478f722/file | 21:33 |
| EmilienM | we promoted RDO repo this morning and had no failures | 21:33 |
| *** heyongli has quit IRC | 21:33 | |
| EmilienM | so it might be something external | 21:33 |
| *** heyongli has joined #openstack-infra | 21:33 | |
| clarkb | EmilienM: just check the permissions on that file, add a sudo ls -l on it or something | 21:34 |
| *** ddieterly is now known as ddieterly[away] | 21:34 | |
| clarkb | bkero: ovh-bhs1 is ready now too | 21:34 |
| bkero | cool | 21:34 |
| clarkb | bkero: so you probably have a 3/8 chance of having a happy job | 21:34 |
| bkero | clarkb: It can wait a bit | 21:34 |
| mnaser | EmilienM: that's weird | 21:34 |
| mnaser | or sorry, rather clarkb | 21:34 |
| fungi | EmilienM: yeah, some extra debugging in the job might help, or we can try to hold a node which is running that and inspect the state of the files on it at the end | 21:35 |
| mnaser | i wonder if the same behaviour is repeating *or* if its an actual connection issue | 21:35 |
| clarkb | mnaser: the behavior is very similar the upload will go for 15 20 minites just fine then break on that | 21:35 |
| clarkb | which is what we were seeing before | 21:35 |
| EmilienM | fungi, clarkb: doing it : https://review.openstack.org/294821 | 21:36 |
| clarkb | hrm 8 minutes in this case | 21:36 |
| mnaser | 18/Mar/2016:21:20:08 +0000] "PUT /v2/images/91ef7c7d-6e8d-41c6-90e0-1e4c9478f722/file HTTP/1.1" 504 182 "-" "python-glanceclient" "-" | 21:36 |
| mnaser | interesting, it's throwing a 504 | 21:36 |
| *** rlandy has quit IRC | 21:36 | |
| anteaya | I got a sudden offer to do something now | 21:36 |
| anteaya | back in about an hour | 21:37 |
| *** Guest98399 is now known as redrobot | 21:37 | |
| *** ddieterly[away] is now known as ddieterly | 21:37 | |
| *** nelsnelson has quit IRC | 21:39 | |
| *** Nepoc has quit IRC | 21:39 | |
| clarkb | bkero: at this point your odds are probably closer to 1 in 2, might be worth rechecking and seeing what happens | 21:39 |
| bkero | ok | 21:39 |
| *** Nepoc has joined #openstack-infra | 21:39 | |
| *** mtanino has quit IRC | 21:39 | |
| clarkb | ovh-bhs1 and osic and bluebox and internap are all done | 21:39 |
| bkero | clarkb: issuing a recheck on https://review.openstack.org/#/c/294760/2 | 21:39 |
| clarkb | bkero: ok, will try to keep an eye on it | 21:40 |
| haleyb | jroll: thanks for doing that. So what's the best thing to do? pin now and unpin later? | 21:41 |
| jroll | haleyb: yep, sounds like it | 21:42 |
| *** thorst has joined #openstack-infra | 21:42 | |
| clarkb | mnaser: any other information I can help provide? | 21:42 |
| haleyb | thanks, then i can get the 3 dependencies behind this in :-/ | 21:42 |
| mnaser | clarkb: checking, looks like for some reason glance is timing out when talking to the ceph cluster which stores images | 21:43 |
| mnaser | but that cluster is humming along with no problems.. | 21:43 |
| *** heyongli has quit IRC | 21:43 | |
| clarkb | bkero: it caught an osic node https://jenkins05.openstack.org/job/gate-dib-dsvm-functests-ubuntu-trusty/7/console | 21:44 |
| *** heyongli has joined #openstack-infra | 21:44 | |
| bkero | Man, y'all need some certs for those things | 21:44 |
| clarkb | they have certs | 21:44 |
| clarkb | bkero: we are trying to delete them so haven't wanted to invest too much into jenkins | 21:44 |
| *** Nepoc has quit IRC | 21:44 | |
| bkero | My browser isn't trusting them | 21:44 |
| clarkb | bkero: ya they are self signed | 21:44 |
| *** Nepoc has joined #openstack-infra | 21:45 | |
| bkero | By certs I meant ones that are signed up to a CA that our browsers trust | 21:45 |
| clarkb | looks like it got past the uuidgen portion of the fail | 21:45 |
| bkero | \o/ | 21:46 |
| *** thorst has quit IRC | 21:46 | |
| *** sdake has quit IRC | 21:47 | |
| bkero | greghaynes: is there any reason the elements using map-packages haven't been moved over to pkg-map yet? | 21:47 |
| *** zz_dimtruck is now known as dimtruck | 21:48 | |
| *** knikolla has quit IRC | 21:48 | |
| mnaser | clarkb: it seems glanceclient is not sending the image size which makes the process more difficult to store in rados (it stores it in chunks of 4MB by default). the resize process starts taking up time and slows things down (which seems to result in a timeout). i've tweaked it to 64M chunks but if the nodepool code can be updated to upload with a predefined size (instead of size=0), it would help a lot in removing load off of glance | 21:49 |
| mnaser | can you please try again and i'll keep an eye | 21:49 |
| *** ddieterly has quit IRC | 21:50 | |
| clarkb | mnaser: I will look into making that change to nodepool/shade | 21:50 |
| clarkb | mnaser: I will also requeue the upload though it will be behind the rax and ovh updalods that are happening now | 21:50 |
| mnaser | no problem | 21:50 |
| mnaser | and sorry about that, pretty odd behaviour by glance | 21:51 |
| *** eil397 has quit IRC | 21:52 | |
| *** heyongli has quit IRC | 21:54 | |
| *** heyongli has joined #openstack-infra | 21:54 | |
| *** eil397 has joined #openstack-infra | 21:55 | |
| *** xyang1 has quit IRC | 21:56 | |
| *** mylu has joined #openstack-infra | 21:56 | |
| *** erlon has quit IRC | 21:57 | |
| *** abregman has quit IRC | 21:57 | |
| clarkb | mordred: you around? do you know if the image upload task thing in rax will accept a file size arg? | 21:58 |
| *** pradk has quit IRC | 21:58 | |
| clarkb | mnaser: and do you know off the top of your haed if vexxhost uses glancev1 or v2? the glanceclient code says image_size is unused in v2 | 21:59 |
| clarkb | so this may need fixing in glanceclient | 21:59 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:00 | |
| *** sdake has joined #openstack-infra | 22:00 | |
| clarkb | wow this code is indecipherable | 22:01 |
| clarkb | v2 upload doesn't take a properties arg but we pass it anyways somehow | 22:01 |
| mnaser | clarkb: we support both but it seems like nodepool is uploading via v1 | 22:01 |
| mnaser | oh because properties aren't a thing anymore, they just sit in some weird way directly into the object | 22:01 |
| mnaser | ex before it was {"properties": {"foo": "bar"}} and now it's just {"foo": "bar"} right into the image object | 22:02 |
| clarkb | oh! because glance is a two step thing for bonghits reasons | 22:02 |
| clarkb | you create then put | 22:02 |
| clarkb | rathre than just put | 22:02 |
| mnaser | yeah, to the /file endpoint | 22:02 |
| *** heyongli has quit IRC | 22:04 | |
| mnaser | clarkb: did the upload fail? | 22:04 |
| mnaser | i'm seeing some strange weird rbd failures... "ArgumentOutOfRange: error creating image" | 22:04 |
| *** heyongli has joined #openstack-infra | 22:04 | |
| clarkb | mnaser: looks like the v1 client calculates the image size if you don't provide it so we should be providing it if using v1 | 22:04 |
| *** piet has quit IRC | 22:04 | |
| mnaser | it makes life easier if you provide it in advance for glance | 22:05 |
| *** _amrith_ is now known as amrith | 22:05 | |
| clarkb | mnaser: https://github.com/openstack/python-glanceclient/blob/master/glanceclient/v1/images.py#L336-L340 | 22:05 |
| clarkb | mnaser: we should be due to ^ | 22:05 |
| mnaser | o | 22:05 |
| mnaser | "since image size is zero we will be doing resize-before-write for each chunk which will be considerably slower than normal" in glance logs | 22:05 |
| clarkb | oh the link above is v2 | 22:05 |
| clarkb | so we likely use v2 but that ignores image_size | 22:06 |
| mnaser | i'm seeing your uploads come in through v1 | 22:06 |
| clarkb | mnaser: hrm the error I pasted above is v2 | 22:06 |
| clarkb | https://github.com/openstack/python-glanceclient/blob/master/glanceclient/v2/images.py#L212 is the v2 case | 22:06 |
| clarkb | this almost sounds like the glance service and the glance client don't agree on whether or not the size is valuable | 22:07 |
| clarkb | OpenStackCloudException: Image creation failed: Error finding address for https://image-ca-ymq-1.vexxhost.net/v2/images/92f237e6-5d39-4e24-bee9-89372f0e35af/file: Unable to establish connection to https://image-ca-ymq-1.vexxhost.net/v2/images/92f237e6-5d39-4e24-bee9-89372f0e35af/file | 22:08 |
| clarkb | thta has v2 in the url | 22:08 |
| mnaser | oh you're right, looks like it is trying to use v2 api | 22:08 |
| *** lascii is now known as alaski | 22:10 | |
| mordred | clarkb: I've never tried a file size arg | 22:10 |
| mordred | clarkb: I can try | 22:10 |
| clarkb | mordred: well reading the code for v2 its a noop | 22:10 |
| mordred | mnaser, clarkb: readin gscrollback | 22:10 |
| mordred | kk | 22:10 |
| clarkb | mordred: and for v1 it should determine it on its own | 22:10 |
| clarkb | mordred: this seems to be more of a case where glance the service and glance the client disagree wit heach other | 22:11 |
| *** edmondsw has quit IRC | 22:11 | |
| clarkb | rax-iad has a new ubuntu-trusty now | 22:11 |
| mordred | clarkb: we should be uploading to vexxhost using v2 | 22:11 |
| mordred | are we not? | 22:11 |
| *** _ari_ has quit IRC | 22:11 | |
| mordred | ok. good | 22:11 |
| mordred | y'all go there already | 22:11 |
| mordred | mnaser: so - we discovered recently that we can use glance tasks with import-from-url on all of our clouds except for rackspace | 22:12 |
| mordred | mnaser: would it be better for you if we used that instead of PUT? | 22:12 |
| clarkb | mordred: yes but that requires major changes an dthis *should* work | 22:12 |
| mordred | yah | 22:12 |
| clarkb | liek we have to host hte images publicly | 22:12 |
| mordred | I mean just for future thinking | 22:12 |
| clarkb | and figure that out first | 22:12 |
| mordred | I'm curious as to if it's a win on mnaser's side | 22:13 |
| mnaser | mordred: dont think it makes much of a difference, but i feel like it'd make your life harder | 22:13 |
| mnaser | you can go a step crazier and basically | 22:13 |
| clarkb | I'd also like to avoid using undocumented features as much as possible | 22:13 |
| mnaser | actually no, iw as going to suggestion glance location-add but that would mean it would have to pull it everyday | 22:13 |
| mordred | clarkb: I think the solution to that is documenting th efeature | 22:13 |
| mordred | mnaser: oh yeha. that's not good | 22:13 |
| mnaser | also, i thought importing images was the only way you could upload to rackspace | 22:13 |
| mordred | mnaser:well, yes - but only from swift | 22:14 |
| mordred | whic his a DIFFERNET task | 22:14 |
| mnaser | ah | 22:14 |
| mnaser | also | 22:14 |
| mordred | because bonghits | 22:14 |
| mnaser | fonud it | 22:14 |
| mnaser | with v2: image_size = request.content_length or None | 22:14 |
| *** heyongli has quit IRC | 22:14 | |
| mordred | oh. wow | 22:14 |
| mnaser | so is python-glanceclient v2 sending the content length? | 22:14 |
| mordred | so glanceclient should be sending content length | 22:14 |
| clarkb | mnaser: it might be I havne't dug that deep | 22:14 |
| *** heyongli has joined #openstack-infra | 22:14 | |
| clarkb | it ignores the image_size param | 22:14 |
| mordred | maybe we need to set a size with glanceclient | 22:14 |
| mnaser | this could be our nginx frontend not sending the content length? ill check too | 22:14 |
| mordred | sigh | 22:14 |
| mnaser | clarkb: checking | 22:15 |
| mnaser | https://github.com/openstack/python-glanceclient/blob/master/glanceclient/v2/images.py#L207 | 22:15 |
| mnaser | yeah the image size is ignored in python-glanceclient upload call | 22:15 |
| clarkb | I find no content_length | 22:15 |
| clarkb | in https://github.com/openstack/python-glanceclient/blob/master/glanceclient/common/http.py | 22:15 |
| *** sdake_ has joined #openstack-infra | 22:16 | |
| mnaser | i wonder if python requests sends content-length | 22:17 |
| *** aysyd has quit IRC | 22:18 | |
| clarkb | ya I don't think glanceclient does it at all | 22:18 |
| fungi | based on the security issues we've seen with glance locations so far, i highly recommend against any solution relying on setting locations on images. i suspect that will not continue to be a feature in its present form | 22:19 |
| clarkb | looks like requests will try to do it if the file is opened in binary mode | 22:19 |
| clarkb | now to see if glancecleint does that | 22:19 |
| *** sdake has quit IRC | 22:20 | |
| clarkb | we do | 22:20 |
| fungi | the entire idea with locations is flawed. people want to rely on glance having an image immutability property, but it really can't make that guarantee with locations | 22:21 |
| clarkb | we could attempt to force v1 for vexxhost | 22:21 |
| clarkb | and see if that is happier | 22:21 |
| mnaser | fungi: nova already relies on glance with images being immutable for it's cache | 22:21 |
| mnaser | so that's a thing too | 22:21 |
| mnaser | clarkb: did another upload fail? i'm seeing some really weird glance/rbd errors | 22:21 |
| fungi | mnaser: yep, but glance lets you set multiple locations for an image, and doesn't even confirm that they have the same content | 22:22 |
| clarkb | mnaser: yes the more recent fail I pasted above was the second attempt after you asked me to try again | 22:22 |
| mnaser | fungi: yeah, that's a a big mess in my opinion | 22:22 |
| *** mriedem has joined #openstack-infra | 22:22 | |
| mnaser | oh, i thought that was just a repaste, my bad. | 22:22 |
| mnaser | oh this will be a fun friday: "ArgumentOutOfRange: error creating image" | 22:22 |
| jeblair | fungi: i'm not sure if that's exactly what mordred was referring to; i believe mordred was referring to a system where one uses the glance task (!) interface to import an image from a url, performing a format conversion in the process. i imagined that would produce an immutable locally stored glance image at the end. | 22:22 |
| clarkb | jeblair: yup that thing | 22:23 |
| clarkb | this process is almost completely undocumented | 22:23 |
| fungi | jeblair: yep, mnaser then suggested we could set image locations instead | 22:23 |
| EmilienM | fungi, clarkb: neutron perms http://paste.openstack.org/show/todqfBe00VXS4yJ3FBcp/ | 22:23 |
| clarkb | http://developer.openstack.org/api-ref-image-v2.html#os-tasks-v2 is the extent of the documentation | 22:23 |
| mnaser | hey don't point fingers at me, i said "actually no" :-P | 22:23 |
| jeblair | fungi: oh missed that | 22:23 |
| fungi | well, you called it "even crazier" | 22:23 |
| fungi | which i can totally agree with as an assessment | 22:24 |
| *** sdake_ has quit IRC | 22:24 | |
| bkero | clarkb: \o/ success | 22:24 |
| clarkb | EmilienM: ya thats not readable by jenkins | 22:24 |
| clarkb | 640 root:neutron | 22:24 |
| EmilienM | clarkb: why did it work this morning and before? packaging did not change | 22:24 |
| *** heyongli has quit IRC | 22:24 | |
| fungi | EmilienM: so basically your copy pass is copying the symlink into your logdir, then your find+chmod isn't dereferencing it and making the target readable | 22:24 |
| *** heyongli has joined #openstack-infra | 22:25 | |
| clarkb | EmilienM: I don't know | 22:25 |
| EmilienM | why is it failing *now* | 22:25 |
| clarkb | EmilienM: but thats clearly not readable by jenkins now | 22:25 |
| clarkb | thats why it fails now | 22:25 |
| EmilienM | clarkb: it never failed before | 22:25 |
| jeblair | how do you get a random looking paste id and not a number? | 22:26 |
| clarkb | EmilienM: then either the permissions changed or you never tried to copy that file before | 22:26 |
| *** aysyd has joined #openstack-infra | 22:26 | |
| clarkb | jeblair: private past eiirc | 22:26 |
| fungi | EmilienM: unfortunately we don't know if those files/permissions were the same before | 22:26 |
| clarkb | jeblair: ya check the private paste check box | 22:26 |
| jeblair | clarkb: oh, how about that | 22:26 |
| *** dimtruck is now known as zz_dimtruck | 22:26 | |
| EmilienM | clarkb: http://logs.openstack.org/49/294549/1/gate/gate-puppet-openstack-integration-3-scenario001-tempest-dsvm-centos7/58fd717/logs/etc/neutron/ | 22:27 |
| EmilienM | we had the file like 5 hours ago | 22:27 |
| EmilienM | (empty though) | 22:27 |
| EmilienM | but we have it in http://logs.openstack.org/49/294549/1/gate/gate-puppet-openstack-integration-3-scenario001-tempest-dsvm-centos7/58fd717/logs/etc/neutron/plugins/ml2/ | 22:27 |
| mnaser | of course | 22:27 |
| mnaser | as im trying to troubleshoot why ceph is choking | 22:28 |
| mnaser | "cluster [INF] 1.db deep-scrub starts" | 22:28 |
| *** salv-orl_ has joined #openstack-infra | 22:28 | |
| EmilienM | dmsimard: don't you have the issue in packstack CI? | 22:28 |
| clarkb | I suppose that new jenkins may have different behavior on perms issues when scping | 22:29 |
| fungi | EmilienM: looks like it failed to copy the link though--note it's 0 length | 22:29 |
| mnaser | clarkb: just made another small change, hopefully it helps. we can give it another try if possible | 22:30 |
| fungi | EmilienM: probably a simple solution is to adjust your copy so that it dereferences all links (-L), or figure out how to skip symlinks or maybe rewrite absolute links as relative? | 22:30 |
| EmilienM | clarkb: do you know when jenkins got updated? we're running 1.643 (2015/12/20) now, I'm digging jenkins changelogs | 22:30 |
| *** salv-orlando has quit IRC | 22:30 | |
| fungi | EmilienM: a few hours ago | 22:31 |
| EmilienM | fungi: from 1.642 I guess? | 22:31 |
| clarkb | mnaser: yup starting now | 22:31 |
| EmilienM | err, from 641 | 22:31 |
| jeblair | EmilienM: no from 1.5veryold | 22:31 |
| fungi | EmilienM: upgrade to address published security issues, i'd have to check what our old version was... just a sec | 22:31 |
| EmilienM | maybe https://wiki.jenkins-ci.org/display/SECURITY/Jenkins+Security+Advisory+2015-12-09 | 22:32 |
| fungi | EmilienM: 2016-03-18 19:03:35 upgrade jenkins 1.565.3 1.642.3 | 22:32 |
| jeblair | EmilienM: can you point me at a recent run without the file? | 22:32 |
| fungi | that's from jenkins01's dpkg.log | 22:32 |
| EmilienM | jeblair: file always been here: http://logs.openstack.org/49/294549/1/gate/gate-puppet-openstack-integration-3-scenario001-tempest-dsvm-centos7/58fd717/logs/etc/neutron/ | 22:32 |
| EmilienM | latest successful run ^ | 22:32 |
| jeblair | EmilienM: i'm looking for a failed run | 22:32 |
| fungi | jeblair: the latest behavior is that the job ends in an unstable result because it fails to copy the symlink | 22:32 |
| EmilienM | jeblair: https://jenkins07.openstack.org/job/gate-puppet-openstack-integration-3-scenario001-tempest-dsvm-centos7/11/console | 22:32 |
| jeblair | 22:32 < jeblair> EmilienM: can you point me at a recent run without the file? | 22:32 |
| jeblair | sorry, paste error | 22:33 |
| jeblair | EmilienM: thanks | 22:33 |
| EmilienM | thanks for helping! | 22:33 |
| *** lewo has quit IRC | 22:34 | |
| jeblair | 2016-03-18 22:22:32.638 | + sudo find /home/jenkins/workspace/gate-puppet-openstack-integration-3-scenario001-tempest-dsvm-centos7/logs -type d -execdir sudo chmod 755 '{}' ';' | 22:34 |
| jeblair | 2016-03-18 22:22:33.115 | + sudo find /home/jenkins/workspace/gate-puppet-openstack-integration-3-scenario001-tempest-dsvm-centos7/logs -type f -execdir sudo chmod 644 '{}' ';' | 22:34 |
| jeblair | that seems like it ought to dtrt. | 22:34 |
| *** lewo has joined #openstack-infra | 22:34 | |
| fungi | jeblair: the file it's breaking on is a symlink to a file elsewhere on the filesystem | 22:34 |
| *** heyongli has quit IRC | 22:35 | |
| jeblair | oh, symlink. how'd that happen? | 22:35 |
| *** heyongli has joined #openstack-infra | 22:35 | |
| fungi | jeblair: the job copies neutron configs. one of the files in /etc is an absolute symlink to another file in /etc | 22:35 |
| fungi | so when copying the contents of that tree, the symlink copied into the logdir is pointing back into /etc rather than the copy of the target in the logdir | 22:35 |
| *** thorst has joined #openstack-infra | 22:36 | |
| EmilienM | we don't need this file | 22:36 |
| *** thorst_ has joined #openstack-infra | 22:36 | |
| mordred | jeblair, mnaser, clarkb: yes, I was talking about the imutable import system, not the location system. I do not think it's a fix for any current problems | 22:36 |
| fungi | the version in the logdir gets readable permissions set, but the symlink pointing out of the logdir into /etc is not dereferenced by that | 22:36 |
| jeblair | i agree with clarkb; this is probably a jenkins behavior change, and the best course of action is probably to alter the job to dereference the symlink when copying, or drop it if you really don't want it. | 22:37 |
| jeblair | EmilienM: ^ | 22:37 |
| mordred | mnaser: since you use ceph, would it be more useful for us to upload to you in raw format? | 22:37 |
| EmilienM | jeblair: ok, I'm looking at the script now | 22:37 |
| *** aysyd has quit IRC | 22:37 | |
| mnaser | mordred: not really, ceph is used for image storage and block storage, instances are backed by local storage so qcow2 works better for snapshotting etc | 22:37 |
| mordred | mnaser: ok. cool | 22:38 |
| clarkb | mnaser: OpenStackCloudException: Image creation failed: Error finding address for https://image-ca-ymq-1.vexxhost.net/v2/images/657e97d9-a63b-4723-a0a2-a5c77b67cb25/file: Unable to establish connection to https://image-ca-ymq-1.vexxhost.net/v2/images/657e97d9-a63b-4723-a0a2-a5c77b67cb25/file | 22:38 |
| * mnaser sighs | 22:38 | |
| clarkb | mnaser: that was a few minutes ago | 22:38 |
| mnaser | no backtrace this time | 22:38 |
| mnaser | nothing but at a 401 | 22:38 |
| mnaser | weird | 22:38 |
| EmilienM | jeblair: is it too agressive to drop all symlinks? | 22:39 |
| EmilienM | in LOGDIR | 22:39 |
| mnaser | this is really weird, it looks like it's actually uploading.. | 22:40 |
| *** thorst has quit IRC | 22:40 | |
| mnaser | clarkb: how big is the image and can i download it somewhere to do some of our own testing | 22:40 |
| mnaser | or if there's a way to do a single upload to make the whole process easier, just in case this takes longer than it should | 22:41 |
| *** mylu_ has joined #openstack-infra | 22:41 | |
| *** mylu has quit IRC | 22:41 | |
| clarkb | mnaser: 6gb | 22:42 |
| *** gordc has quit IRC | 22:42 | |
| clarkb | I can copy the image into the apache docroot | 22:42 |
| mnaser | i'd really appreciate it | 22:42 |
| *** pfallenop has quit IRC | 22:44 | |
| clarkb | mnaser: http://nodepool.openstack.org/176634.qcow2 | 22:44 |
| clarkb | mnaser: getting an md5sum | 22:44 |
| *** pfallenop has joined #openstack-infra | 22:45 | |
| *** pfallenop has joined #openstack-infra | 22:45 | |
| clarkb | mnaser: e7e0b892edd8d5cf2fbb8719bc115cd2 is md5sum | 22:45 |
| *** heyongli has quit IRC | 22:45 | |
| mnaser | downloading right now | 22:45 |
| fungi | EmilienM: jeblair: just confirmed by comparing the publisher log line from a passing run to the copy of that symlink on the logs.o.o filesystem... seems old jenkins behavior was to "successfully" create a zero-byte file on the logserver at that path and move on to copying other files, rather than complain about insufficient permissions | 22:45 |
| *** heyongli has joined #openstack-infra | 22:45 | |
| EmilienM | fungi: thanks for looking | 22:45 |
| *** thorst_ has quit IRC | 22:46 | |
| mnaser | 25m estimated download time, but it might be longer because the speed is fluctuating a lot | 22:46 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: copy_puppet_logs: do not keep symlinks before upload https://review.openstack.org/294845 | 22:46 |
| *** cbader has quit IRC | 22:46 | |
| fungi | EmilienM: jeblair: which implies it would have happening at the artifact collection phase in jenkins where it pulls those files from the slave workspace to the master before uploading | 22:46 |
| EmilienM | fungi, jeblair: let me know if I'm doing well or not ^ | 22:46 |
| *** knikolla has joined #openstack-infra | 22:48 | |
| fungi | EmilienM: looks right to me | 22:48 |
| fungi | EmilienM: though that fix won't take effect until the next image rebuild after it merges, since those scripts are baked into our worker images | 22:48 |
| EmilienM | fungi: it's Friday :-) | 22:49 |
| EmilienM | fungi: hopefully that can be fixed for Monday | 22:49 |
| fungi | EmilienM: yep, have a good weekend! | 22:49 |
| EmilienM | fungi: I'm not leaving except if you kick me | 22:49 |
| EmilienM | I'm just saying I don't care if our CI is broken, I warned our group and this weekend can be CI-less for us | 22:50 |
| EmilienM | as long we can fix it for Monday :) | 22:50 |
| anteaya | EmilienM: I can't imagine anyone kicking you | 22:50 |
| jeblair | EmilienM: lgtm | 22:51 |
| EmilienM | anteaya: except if I start to speak french here. like all the time | 22:51 |
| *** mylu_ has quit IRC | 22:53 | |
| anteaya | I wouldn't kick you for that | 22:53 |
| anteaya | I'd be grateful that I could learn something | 22:53 |
| *** mylu has joined #openstack-infra | 22:53 | |
| *** esikachev has joined #openstack-infra | 22:55 | |
| *** heyongli has quit IRC | 22:55 | |
| jeblair | je ne parle pas francais | 22:55 |
| *** heyongli has joined #openstack-infra | 22:55 | |
| jeblair | i learned that for the paris summit! i learn so much thanks to openstack! | 22:56 |
| anteaya | ha ha ha | 22:57 |
| anteaya | I would say bonjour to people that was all it took, they then switched to english | 22:57 |
| jeblair | yeah, that has happened to me too. | 22:58 |
| pleia2 | fungi: thanks for tackling the zanata/openstackid issues yesterday, internet access here is worse than I expected (and non-existent at the conference venue) | 22:58 |
| EmilienM | jeblair: français, you forgot the fishing rod | 22:59 |
| wznoinsk | hi all | 22:59 |
| jeblair | EmilienM: yeah, apparently i don't type it even as well as i don't speak it :) | 22:59 |
| *** zz_dimtruck is now known as dimtruck | 22:59 | |
| *** esikachev has quit IRC | 22:59 | |
| EmilienM | jeblair: I'm sure your keyboard does not have it :-P | 22:59 |
| anteaya | pleia2: hey | 22:59 |
| anteaya | pleia2: how is singapore | 23:00 |
| pleia2 | anteaya: hot :) but pretty | 23:00 |
| anteaya | EmilienM: what is that accent called? I'm betting it isn't the fishing rod | 23:00 |
| anteaya | pleia2: nice | 23:00 |
| anteaya | pleia2: I hadn't imagined hot but I also haven't looked at a map | 23:00 |
| anteaya | pleia2: have they a zoo? | 23:01 |
| EmilienM | anteaya: c cedille | 23:01 |
| bookwar | hi, everyone, i've try to ask in -docs yesterday, but maybe someone here knows, which is the right docs theme for developer documentation - openstackdocstheme - the fancy one, or oslosphinx which is used by everyone? | 23:01 |
| anteaya | ah thank you | 23:01 |
| EmilienM | anteaya: https://en.wikipedia.org/wiki/%C3%87 | 23:01 |
| *** rbrndt has quit IRC | 23:02 | |
| anteaya | oh look at that | 23:02 |
| wznoinsk | technical nodepool/jenkins question... I need to set a *_proxy env variables to be used by both stack user and jenkins (before it switches to stack)... where's the best place to put these? (/etc/profile doesn't call bash.basrc as no PS1 is set, ~/.bashrc not called as the bash invoked by jenkins is not interactive either)... also the jenkin's shell commands are not login ones iether (obviously).. so if jenkins is not using *profie | 23:02 |
| wznoinsk | neither *rc files, where's the best/safest place to put env? | 23:02 |
| anteaya | evolution from the visgothic Z, nice | 23:02 |
| pleia2 | anteaya: went to a night zoo! | 23:04 |
| *** akshai_ has quit IRC | 23:04 | |
| anteaya | no! | 23:05 |
| jeblair | wznoinsk: right at the beginning of the job? | 23:05 |
| anteaya | how is a night zoo? | 23:05 |
| pleia2 | anteaya: saw pangolins (precise) and a tahr (trusty) | 23:05 |
| jeblair | wznoinsk: if you are using zuul, you could put them in a zuul parameter function | 23:05 |
| *** heyongli has quit IRC | 23:05 | |
| anteaya | pleia2: no way! | 23:05 |
| pleia2 | :D | 23:05 |
| anteaya | that's where they are | 23:05 |
| anteaya | in singapore | 23:05 |
| *** heyongli has joined #openstack-infra | 23:06 | |
| anteaya | is there a xenial there? | 23:06 |
| *** baoli_ has quit IRC | 23:06 | |
| *** sridhar_ram has quit IRC | 23:06 | |
| pleia2 | anteaya: alas, no | 23:06 |
| anteaya | still two of them | 23:06 |
| anteaya | nice | 23:06 |
| wznoinsk | jeblair, ok, thought I'd sort it with nodepool element, i can literally do it _anywhere_... even zuul, was wondering where's the best place | 23:06 |
| *** angdraug has quit IRC | 23:07 | |
| *** diana_clarke has joined #openstack-infra | 23:08 | |
| *** baoli has joined #openstack-infra | 23:08 | |
| jeblair | EmilienM: could i convince you to type a fishing rod at me again so i can see if i have utf8 in irc fixed? | 23:09 |
| wznoinsk | jeblair, I'll give zuul par function for now - my proxy won't change that often so it's better fit for nodepool on the other hand it's not a big transfter or anything big I couldn't do it at the build time instead of dib time | 23:09 |
| *** dimtruck is now known as zz_dimtruck | 23:09 | |
| *** jtomasek has quit IRC | 23:09 | |
| EmilienM | jeblair: ç | 23:09 |
| jeblair | je ne parle pas français! | 23:11 |
| openstackgerrit | Merged openstack-infra/project-config: copy_puppet_logs: do not keep symlinks before upload https://review.openstack.org/294845 | 23:11 |
| EmilienM | \o/ | 23:11 |
| clarkb | mnaser: how far along is that image? | 23:12 |
| anteaya | woooo | 23:12 |
| mnaser | eta 9minutes clarkb | 23:12 |
| mnaser | seems to have throttled me at ~3MB/s | 23:12 |
| clarkb | bookwar: I think openstackdocstheme is for the docs repos | 23:12 |
| clarkb | bookwar: the oslosphinx for python repos | 23:12 |
| *** zz_dimtruck is now known as dimtruck | 23:13 | |
| bookwar | clarkb: you mean user docs vs dev docs? we are going to publish to docs.openstack.org/develop/ so probably oslosphinx then? | 23:14 |
| *** nelsnelson has joined #openstack-infra | 23:14 | |
| *** heyongli has quit IRC | 23:16 | |
| *** heyongli has joined #openstack-infra | 23:16 | |
| *** ddieterly has joined #openstack-infra | 23:17 | |
| *** ddieterly is now known as ddieterly[away] | 23:17 | |
| *** ddieterly[away] is now known as ddieterly | 23:17 | |
| jeblair | bookwar: i think oslosphinx is right for that | 23:17 |
| bookwar | jeblair: thanks, i was a bit confused by description https://pypi.python.org/pypi/openstackdocstheme/ thinking that oslosphinx is obsoleted by new theme, but looks like these are just two different things | 23:20 |
| mnaser | clarkb: got it, i'll go grab some food and ill check it out | 23:22 |
| jeblair | bookwar: i'd continue trying to follow up with docs folks for clarification then; maybe an ml post or try again next week. | 23:22 |
| *** asselin has quit IRC | 23:22 | |
| *** eil397 has quit IRC | 23:22 | |
| *** heyongli_ has joined #openstack-infra | 23:26 | |
| *** roxanaghe has quit IRC | 23:26 | |
| *** zhurong has joined #openstack-infra | 23:27 | |
| *** zhurong has quit IRC | 23:28 | |
| *** heyongli has quit IRC | 23:29 | |
| *** amrith is now known as _amrith_ | 23:29 | |
| *** zhurong has joined #openstack-infra | 23:30 | |
| *** tqtran-afk has quit IRC | 23:35 | |
| *** baoli has quit IRC | 23:36 | |
| fungi | pleia2: no worries--it turned out not to be too terrible. hope you're enjoying the conference! singapore sounds like a blast | 23:36 |
| *** heyongli_ has quit IRC | 23:36 | |
| *** heyongli_ has joined #openstack-infra | 23:36 | |
| fungi | EmilienM: my keyboard has ç thanks to compose+,+c | 23:38 |
| *** Swami has quit IRC | 23:38 | |
| EmilienM | fungi: does it have 'à' ? | 23:38 |
| bkero | à? | 23:39 |
| EmilienM | or ù or é or ê | 23:39 |
| EmilienM | I'll make you jalous. | 23:39 |
| bkero | deadkey + ` + u :P | 23:39 |
| bkero | ų | 23:39 |
| fungi | EmilienM: compose ` a | 23:40 |
| fungi | à | 23:40 |
| bkero | 3 keys, so much work | 23:40 |
| bkero | Make it 2? | 23:40 |
| fungi | yeah | 23:40 |
| *** _ari_ has joined #openstack-infra | 23:40 | |
| fungi | i need to figure out how to use compose sequences to type kanji sometime | 23:40 |
| EmilienM | it reminds me I still have a french keyboard | 23:41 |
| bkero | EmilienM: qwertz? | 23:41 |
| bookwar | do you talk about utf-8 because you already know that it breaks voting page? | 23:41 |
| bkero | ですですです | 23:41 |
| EmilienM | bkero: azerty | 23:41 |
| bkero | Aaahhhh | 23:41 |
| bookwar | or is it a coincidence :) | 23:41 |
| *** _ari_ has quit IRC | 23:42 | |
| fungi | bookwar: i didn't notice any mojibake on the elections (and packaging-rpm is the only one i didn't have a ballot for) | 23:42 |
| *** markvoelker has quit IRC | 23:44 | |
| fungi | bookwar: which election was the ballot where you saw incorrect glyphs? | 23:44 |
| fungi | i should be able to pull mine back up for it to compare | 23:44 |
| *** e0ne has joined #openstack-infra | 23:44 | |
| bookwar | fungi: actually, it wasn't about glyphs, my bad, just we've got reports about this kind of errors http://paste.openstack.org/show/491171/ | 23:45 |
| *** heyongli_ has quit IRC | 23:46 | |
| *** heyongli_ has joined #openstack-infra | 23:47 | |
| fungi | bookwar: oh, looks like maybe civs is missing specific language support but thinks it has it and then breaks their cgi? | 23:47 |
| fungi | it's open source, so presumably they'd accept fixes | 23:47 |
| fungi | so this would happen if your browser was set to request the russian translation of the page, i think | 23:48 |
| fungi | (and assuming you wanted to flex your perl muscles) | 23:48 |
| *** thorst has joined #openstack-infra | 23:49 | |
| *** zhurong has quit IRC | 23:49 | |
| bookwar | fungi: yes, changing locale helps, changing browser can help too | 23:49 |
| bookwar | so not a blocker | 23:50 |
| fungi | still a very unfortunate bug in their platform | 23:50 |
| *** _ari_ has joined #openstack-infra | 23:51 | |
| *** MarkAtwood has quit IRC | 23:52 | |
| bookwar | someone has already filed it https://github.com/andrewcmyers/civs/issues/4 | 23:55 |
| *** baoli has joined #openstack-infra | 23:55 | |
| jeblair | the author, even. | 23:55 |
| *** piet has joined #openstack-infra | 23:56 | |
| *** _ari_ has quit IRC | 23:56 | |
| *** fverbs has joined #openstack-infra | 23:56 | |
| *** _ari_ has joined #openstack-infra | 23:56 | |
| *** heyongli_ has quit IRC | 23:57 | |
| *** moravec has quit IRC | 23:57 | |
| clarkb | rax-ord ubuntu-trusty image upload failed so I restarted it (timed out waiting for image to import) | 23:57 |
| *** heyongli_ has joined #openstack-infra | 23:57 | |
| *** _ari_ has quit IRC | 23:57 | |
| clarkb | ovh-gra1 is still in progress ya atlantic ocean | 23:57 |
| *** _ari_ has joined #openstack-infra | 23:57 | |
| *** thorst has quit IRC | 23:57 | |
| *** _ari_ has quit IRC | 23:58 | |
| anteaya | I hear it's big | 23:58 |
| *** _ari_ has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!