Thursday, 2015-07-02

clarkbthere have been 80 fires in portland this season compared to 4 iirc last year at this time00:00
mordredfungi: hrm00:00
adam_gi just realized my house has AC. like, 1+ week into this insane PDX heat wave00:00
greghaynesfungi: ah, im betting right after shade 0.8.200:01
greghaynesadam_g: hahah00:01
*** puranamr has quit IRC00:01
fungiclarkb: portland has fires this year like we have shark attacks. good to know00:01
greghaynesYes, not sure which of those I prefer00:02
fungii'll make sure i bring (more) flame retardant gear (than usual) for oscon00:02
*** puranamr_ has quit IRC00:02
*** tsekiyam_ has joined #openstack-infra00:02
*** puranamr has joined #openstack-infra00:03
*** tsekiyama has quit IRC00:06
*** mtanino has quit IRC00:06
*** hdd has quit IRC00:06
*** tsekiyam_ has quit IRC00:07
fungigreghaynes: mordred: if you have any reason to believe a nodepoold restart will solve the current glance upload situation for it, i'm happy to do that right now. it's basically caught up on demand for the time being00:09
mordredfungi: it's our best hunch00:09
greghaynesYep00:09
mordredfungi: if it DOESN'T work - we're going to have to do a bunch of instrumentation to find out what in nodepool is breaking things00:09
fungirestarting it now00:09
mordredfungi: because it will indicate that something is stepping on something somehwere00:09
mordredwhich would create a sad00:09
*** Swami has quit IRC00:10
mordredadam_g: hahaha00:10
fungiokay, it's been restarted now00:10
fungiadam_g: air conditioning in portland? the previous owner must have anticipated global warming00:11
mordredfungi: thanks!00:13
adam_glandlords installed these wall-mounted, electric 'heat pump' things from japan as an eco-friendly alternative to the old furnace. turns out they AC, too. and much better than they heat00:15
openstackgerritRochelle Grober proposed openstack-infra/project-config: Added user-stories project-config  https://review.openstack.org/19778400:15
fungiamazing00:15
*** zz_dimtruck is now known as dimtruck00:16
RockygYeah, they're pretty cool, and don't need any vents.00:18
*** bswartz has quit IRC00:18
Rockygfungi: fyi: the patch I just put in most likely has errors.  And seeing the message, it's actually for a repo, so, I expect to do some corrections on it.00:18
RockygBut it's still cool to see my name on a patch.  woohoo/100:19
fungiRockyg: it's a rush!00:19
RockygYeah, especially when it takes four hours to get through all the mistakes I make.00:20
fungiokay, according to my scripts, we have 22 release:managed repos with stable/icehouse branches. time to get tagging00:22
fungioh, make that 23 because i'm adding devstack00:23
EmilienMcrinkle, fungi: our recent issues with epel/rdo packages (server downtimes, packaging issues, etc) make me think we might want to use image-based testing. fungi, is it doable with your current work on dib?00:23
fungiEmilienM: it's not completed yet. i've got https://review.openstack.org/195187 and https://review.openstack.org/195254 landing next to support that00:24
EmilienMour CI is kind of specify since we rely on openstack packaging (which is <honestly> not always stable) - maybe having an image (periodically built) would help00:25
fungiand then a couple more changes to write to test it out properly00:25
EmilienMfungi: super awesome, what does it change for our jobs? Should I patch something?00:25
fungiEmilienM: though maybe i'm misunderstanding what you mean by "image-based testing"00:25
*** koolhead17 has joined #openstack-infra00:25
fungiwe make images for our job workers, and are working on ways to provide a means for all the hosted git repos to indicate additional packages which should be pre-cached so that they don't need to be downloaded during jobs (just installed from the local cache at the start of the job)00:26
EmilienMfungi: ah ok, it's cool00:26
fungiand also some convenient macros for allowing jobs to reuse teh same lists provided in those repos to identify specifically what to install at the start of their jobs00:27
EmilienMfungi: I was thinking at a pre-built image that you deploy with glance and you periodically build it00:27
fungiEmilienM: right, we do that every day (ideally one per distro we're using)00:27
EmilienMbut the image could be huge with all packages we need... so00:27
*** puranamr has quit IRC00:28
EmilienMfungi: so if I understand correctly, I have nothing to do but wait and see00:28
*** Rockyg has quit IRC00:29
fungiEmilienM: yeah, i mean our current jobs, particularly devstack-based jobs, rely on being able to install lots of distro packages. adding the ones for the openstack services and their dependencies too will increase that, sure, but i don't know by how much00:29
fungii wouldn't expect it to be an insane increase00:29
EmilienMfungi: we install openstack packages, there is a lot of deps00:29
fungiwell, distro packages are compressed, so even to have a gigabyte of distro packages would be pretty unusual i think00:30
fungii suppose you could `du -sh /var/cache/apt` after running and see how much space that is00:30
*** SumitNaiksatam has quit IRC00:36
*** enikanorov2 has joined #openstack-infra00:38
*** otter768 has quit IRC00:38
*** otter768 has joined #openstack-infra00:39
*** Sukhdev has quit IRC00:45
*** dangers is now known as dangers_away00:47
*** otter768 has quit IRC00:49
asselinis this a new feature? http://15.126.198.151/73/180873/72/check/xp-fc-master-xp7-dsvm/e3cc9b3/logs/devstacklog.txt.gz#_2015-07-02_00_36_13_08300:53
asselinI'm also surprised to see it go to: Reading http://pypi.dfw.openstack.org/simple/idna/00:54
*** tqtran has quit IRC01:01
*** dannywilson has quit IRC01:02
*** trey has joined #openstack-infra01:02
*** jasondotstar has joined #openstack-infra01:02
*** patrickeast has quit IRC01:09
*** SumitNaiksatam has joined #openstack-infra01:09
*** shashank_hegde has quit IRC01:09
*** hughhalf has quit IRC01:10
*** shashank_hegde has joined #openstack-infra01:11
*** hughhalf has joined #openstack-infra01:16
*** shashank_hegde has quit IRC01:16
*** hughhalf has quit IRC01:18
*** dims_ has quit IRC01:19
*** hughhalf has joined #openstack-infra01:20
*** armax has quit IRC01:26
*** jasondotstar has quit IRC01:27
*** annegentle has quit IRC01:28
*** fallenpegasus has joined #openstack-infra01:28
*** teran_ has joined #openstack-infra01:31
EmilienMI'm having hard time with centos7 nodepool image01:32
fungiasselin: on our workers we force the pip allow_hosts to the local mirror (as defined by our nodepool ready script) http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh01:32
fungiasselin: perhaps you're reusing that verbatim?01:32
EmilienMit's probably an upgrade from centos7 to centos71 and I'm having some issue I can't reproduce locally : https://jenkins04.openstack.org/job/gate-puppet-neutron-puppet-beaker-rspec-dsvm-centos7/49/console01:32
*** teran has quit IRC01:32
*** koolhead17 has quit IRC01:32
fungiasselin: er, actually that's setuptools/easy_install we're overriding which you're seeing there in the log01:33
*** eantyshev has quit IRC01:33
*** eantyshev has joined #openstack-infra01:34
EmilienMfungi: if I ask you to disable voting for a puppet CI job, can you +2 +A a patch in project-config? we are having serious troubles now and we need time to figure out01:34
fungiasselin: we set that because it's the only way to avoid packages which declare their dependencies as setup_requires entries from bypassing our mirrors and going to pypi.python.org to get packages01:34
openstackgerritDavid Lyle proposed openstack-infra/project-config: Disable voting for horizon integration tests  https://review.openstack.org/19780501:35
fungiEmilienM: sure01:35
EmilienMcrinkle: is it ok if we disable voting on centos7, I think we had serious issues lately and we really need to figure out that01:35
EmilienMfungi: ack01:35
*** otter768 has joined #openstack-infra01:36
crinkleEmilienM: fine with me01:36
fungiEmilienM: crinkle: Error: Execution of '/usr/bin/yum -d 0 -e 0 -y install python-keystone' returned 1: No Presto metadata available for rdo-release01:36
EmilienMfungi: I know01:36
fungiis that normal/benign? it's the first error i see in the log01:36
EmilienMfungi: it has been 2 hours I'm on it01:37
EmilienMfungi: I can't reproduce it on my clean centos image01:37
EmilienMI think it's something with nodepool image01:37
fungiianw: ^ not sure if you've got anything using rdo on current centos7 nodepool images01:38
*** puranamr has joined #openstack-infra01:38
*** dims has joined #openstack-infra01:39
*** sigmavirus24 is now known as sigmavirus24_awa01:40
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: disable voting for beaker/centos7 jobs  https://review.openstack.org/19780701:42
EmilienMfungi: ^01:42
EmilienMcrinkle: ^01:42
ianwfungi: no01:42
*** puranamr has quit IRC01:42
*** teran has joined #openstack-infra01:42
ianwEmilienM: i have a spec out about a more generic mirror -> https://review.openstack.org/#/c/194477/01:43
EmilienMianw: every week, we're having a new issue with centos7 jobs01:43
EmilienMlast one was epel mirrors downtimes01:44
*** jogo has quit IRC01:44
ianwEmilienM: well, tell me about it :)  there are many problems to work out01:45
*** teran_ has quit IRC01:45
*** jogo has joined #openstack-infra01:45
*** ociuhandu has quit IRC01:46
fungiokay, the 23 managed stable/icehouse branches have been tagged icehouse-eol and deleted. now to send an announcement01:47
mtreinishfungi: \o/01:47
fungiEmilienM: crinkle has spotted a typo in your 19780701:47
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: disable voting for beaker/centos7 jobs  https://review.openstack.org/19780701:48
EmilienMfungi, crinkle: thx... I should stop now :-) cheers01:48
*** dimtruck is now known as zz_dimtruck01:51
*** wuhg has joined #openstack-infra01:52
*** EricGonczer_ has joined #openstack-infra01:52
*** arosen has quit IRC01:53
*** marcusvrn has joined #openstack-infra01:55
*** baoli has joined #openstack-infra01:56
*** gildub has joined #openstack-infra01:56
*** claudiub has quit IRC01:57
*** ivar-laz_ has joined #openstack-infra01:59
*** shashank_hegde has joined #openstack-infra01:59
ianwfungi: you around to put a centos7 host on hold?  gildub has some suspicions about the image that he'd like to checkout02:00
fungiianw: sure02:01
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Skip py26 for oslo.versionedobjects  https://review.openstack.org/19781402:01
gildubianw, fungi, how is an image provisioned into nodepool?02:02
ianwgildub: it's from the rax base image.  we can get a login and do a quick inspection / repro02:02
*** ivar-lazzaro has quit IRC02:02
fungigildub: one of two ways. either by booting a base image provided by the service provider, additional packages and configuration installed, then shutdown and snapshotted02:03
fungigildub: ...or by creating an image with diskimage-builder from a set of dib elements, and uploaded via glance into the service provider02:03
*** ivar-laz_ has quit IRC02:03
ianwfungi:  devstack-centos7-rax-iad-345587302:04
fungigildub: it looks like the current devstack-centos7 images are of the older "snapshot" variety in rackspace02:04
gildubianw, fungi, what about using based cloud image? http://cloud.centos.org/centos/7/images/02:04
fungiso based on a centos 7.x image provided by rackspace02:04
fungigildub: we're only just reaching the point where we can upload images into rackspace. until now we've been basically stuck starting from whatever they provide, which is of questionable provenance02:05
ianwgildub: we are getting there with that approach, i can bring you up to speed02:05
gildubfungi, ok, I understand the evolution02:05
fungiianw: gildub: what ssh key do i need to authorize on that machine?02:07
ianwfungi: https://github.com/ianw.keys02:07
gildubfungi, what's happening, is trying to add deltarpm to the centos image triggers an error that make the image suspicious of being an upgrade from centos7.0 and not a fresh centos7.102:07
fungiianw: ssh jenkins@104.239.231.24302:08
*** nelsnelson has joined #openstack-infra02:08
*** otter768 has quit IRC02:08
clarkbgildub that *should* work though right02:08
clarkbeg even if that was the case it being broken would be a centos bug?02:08
fungiianw: gildub: it looks like the devstack-centos7 snapshot images are based on a rackspace image called "CentOS 7 (PVHVM)" http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#n29002:10
gildubclarkb, true but we don't want to deal with it, if getting a centos7.1 proper image solve the problem is our workaround02:10
ianwfungi: yeah, they are.  occasionally they change bits02:10
fungiianw: i know that all too well02:11
*** larainema has quit IRC02:11
openstackgerritMerged openstack-infra/project-config: Disable voting for horizon integration tests  https://review.openstack.org/19780502:11
fungiand yeah, there's no explicit centos 7.1 image, but then again their centos 6 image is 6.5 or 6.6 based lately i think and doesn't call out the minor rev either02:11
clarkbright we dont control that so cant use this as a workaround02:13
*** baoli has quit IRC02:13
clarkbwhile it would be nice to have that option we dont have it02:13
*** baoli has joined #openstack-infra02:13
openstackgerritJames Polley proposed stackforge/gertty: Show all held changes in held-changes view  https://review.openstack.org/19781802:14
clarkband glean doesnt work on centos7 yet so there is at least one thing to fix before that workaround is viable02:14
*** larainema has joined #openstack-infra02:15
ianwfungi: ahh, did devstack-gate remove sudo from jenkins on that hots?02:15
ianwhost even02:15
*** Alexandra_ has joined #openstack-infra02:15
clarkbgreghaynes have we sorted out image uploads yet?02:15
fungiianw: it may do that later in the job. i can put it back for you... just a sec02:16
clarkbianw yes it does prior to gate hook and after pre gate hook iirc02:16
clarkboh but not for jenkins just for stack02:16
fungiianw: `sudo -v` is working fine for me as jenkins there02:16
greghaynesclarkb: negative - we had some issue with swift that none of us could debug and didnt show up via nodepool commands, best guess is that restarting nodepool will fix it (out of date deps or somesuch) so we just did that and in theory tomorrow well be on to the next bug02:17
clarkbkk02:17
ianwfungi: sudo -s is asking password02:17
fungiianw: i take that back. sudo for jenkins is command-limited02:17
fungiianw: unlocked full sudo magic now02:19
*** marcusvrn has quit IRC02:19
ianwfungi: thanks.  maybe when you've done it before you just added me as root, don't remember02:19
clarkbI think its puppet beakwr test setup doing that not d-g02:20
clarkbso job specific02:20
*** achanda has joined #openstack-infra02:20
*** yamahata has quit IRC02:21
fungiright, yep. the puppet beaker tests have revoke-sudo for the jenkins account, devstack-based jobs do not02:23
openstackgerritMerged openstack-infra/project-config: puppet: disable voting for beaker/centos7 jobs  https://review.openstack.org/19780702:23
*** EricGonczer_ has quit IRC02:25
*** xyang1 has quit IRC02:26
fungiokay, adding grenade and oslo-incubator it's up to a nice round 25 repos i eol'd stable/icehouse in02:29
*** armax has joined #openstack-infra02:29
fungieverything's bigger under the bigtop02:29
*** achanda has quit IRC02:30
*** jaypipes has quit IRC02:30
*** esmute__ has quit IRC02:34
*** rossella_s has quit IRC02:36
gildubfungi, the centos image looks good, wrong suspicion, deltarpm is working fine, there is another issue with yum update02:37
*** rossella_s has joined #openstack-infra02:37
*** olaph has quit IRC02:37
*** olaph has joined #openstack-infra02:38
gildubfungi, ianw, logged off - thanks02:38
ianwfungi: yeah, packaging issue.  you can kill that host, thanks02:38
*** EricGonczer_ has joined #openstack-infra02:38
fungigildub: ianw: will do, glad i could help!02:38
*** nelsnelson has quit IRC02:39
gildubfungi, that was terrific, thanks again02:39
*** EricGonczer_ has quit IRC02:39
gildubianw, you too! :)02:39
*** nelsnelson has joined #openstack-infra02:39
*** koolhead17 has joined #openstack-infra02:42
*** yamamoto has joined #openstack-infra02:45
*** olaph has quit IRC02:47
*** olaph has joined #openstack-infra02:47
*** koolhead17 has quit IRC02:47
*** shashank_hegde has quit IRC02:49
*** unicell1 has quit IRC02:51
*** olaph has quit IRC02:52
*** olaph has joined #openstack-infra02:53
*** hdd has joined #openstack-infra02:59
*** olaph has quit IRC02:59
*** olaph has joined #openstack-infra03:00
*** achanda has joined #openstack-infra03:00
*** esmute__ has joined #openstack-infra03:04
*** EricGonczer_ has joined #openstack-infra03:06
*** zz_dimtruck is now known as dimtruck03:11
*** achanda has quit IRC03:13
*** olaph has quit IRC03:18
*** EricGonczer_ has quit IRC03:20
*** oomichi has joined #openstack-infra03:20
*** dims has quit IRC03:22
*** harlowja_at_home has joined #openstack-infra03:24
*** tjones1 has joined #openstack-infra03:24
*** tjones1 has left #openstack-infra03:28
*** binbincong has quit IRC03:33
fungittx: when you wake up, i've got the icehouse eol announcement pending moderator approval for openstack-announce03:35
*** BharatK has joined #openstack-infra03:41
*** coolsvap|away is now known as coolsvap03:45
*** unicell has joined #openstack-infra03:45
*** ihrachyshka has joined #openstack-infra03:49
*** bhunter71 has quit IRC03:52
*** koolhead17 has joined #openstack-infra03:53
*** binbincong has joined #openstack-infra03:56
*** baoli has quit IRC03:57
*** mrmartin has joined #openstack-infra03:58
*** ihrachyshka has quit IRC04:00
*** koolhead17 has quit IRC04:02
*** kushal has joined #openstack-infra04:03
*** BharatK has quit IRC04:04
*** harlowja_at_home has quit IRC04:05
lifelessso https://review.openstack.org/#/c/194886/ is passing AFAICT - it hit a known recheck bug04:05
lifelessfungi: ^04:05
lifelessbut I'd like to start collecting +2's please :)04:06
*** otter768 has joined #openstack-infra04:09
*** kushal has quit IRC04:09
*** kiran-r has joined #openstack-infra04:09
*** ildikov has quit IRC04:13
*** otter768 has quit IRC04:13
*** BharatK has joined #openstack-infra04:17
*** heyongli has quit IRC04:18
*** DericHorn-HP has joined #openstack-infra04:19
*** woodster_ has quit IRC04:21
*** mrmartin has quit IRC04:21
*** heyongli has joined #openstack-infra04:21
*** DericHorn-HP has quit IRC04:23
*** yfried has quit IRC04:24
*** sdake has joined #openstack-infra04:30
*** koolhead17 has joined #openstack-infra04:30
*** heyongli has quit IRC04:31
*** ddieterl_ has quit IRC04:32
*** esmute__ has quit IRC04:34
*** heyongli has joined #openstack-infra04:34
*** koolhead17 has quit IRC04:34
*** heyongli has quit IRC04:38
openstackgerritJoshua Harlow proposed openstack-dev/pbr: Expose a 'rpm_version' extra command  https://review.openstack.org/19619104:39
*** yamada-h has joined #openstack-infra04:41
*** maishsk has quit IRC04:41
persiaDoes https://wiki.openstack.org/wiki/Releases get automatically updated by some EOL change, or is that a separate manual activity?04:41
*** maishsk has joined #openstack-infra04:42
*** heyongli has joined #openstack-infra04:43
*** crc32 has quit IRC04:44
*** maishsk has quit IRC04:47
*** heyongli has quit IRC04:48
*** heyongli has joined #openstack-infra04:49
*** ihrachyshka has joined #openstack-infra04:49
openstackgerritJoshua Harlow proposed openstack-dev/pbr: Expose a 'rpm_version' extra command  https://review.openstack.org/19619104:50
openstackgerritJoshua Harlow proposed openstack-dev/pbr: Expose a 'rpm_version' extra command  https://review.openstack.org/19619104:52
*** heyongli has quit IRC04:54
*** BharatK has quit IRC04:54
*** harlowja_at_home has joined #openstack-infra04:54
*** yamamoto has quit IRC04:55
*** niska has quit IRC04:55
*** yamamoto has joined #openstack-infra04:57
*** SumitNaiksatam has quit IRC04:58
*** SumitNaiksatam has joined #openstack-infra04:58
*** hashar has joined #openstack-infra04:58
*** heyongli has joined #openstack-infra04:59
*** amit213 has joined #openstack-infra05:00
openstackgerritSteve Martinelli proposed openstack-infra/project-config: Create automated job for sample configuration files  https://review.openstack.org/17762005:01
*** yfried has joined #openstack-infra05:02
*** niska has joined #openstack-infra05:04
*** dima____ has quit IRC05:05
*** leanderthal has quit IRC05:06
*** yfried_ has joined #openstack-infra05:06
*** ihrachyshka has quit IRC05:06
*** yfried has quit IRC05:06
*** hdd has quit IRC05:08
*** BharatK has joined #openstack-infra05:08
*** mmedvede has quit IRC05:10
*** deepakcs has joined #openstack-infra05:11
*** shashank_hegde has joined #openstack-infra05:11
*** BharatK has quit IRC05:12
*** olaph has joined #openstack-infra05:17
*** DericHorn-HP has joined #openstack-infra05:18
*** yamada-h_ has joined #openstack-infra05:21
*** yamamoto has quit IRC05:22
*** yamada-h has quit IRC05:24
*** esmute__ has joined #openstack-infra05:26
*** hashar is now known as hasharAfk05:26
*** yamamoto has joined #openstack-infra05:27
*** harlowja_at_home has quit IRC05:27
*** BharatK has joined #openstack-infra05:29
*** olaph has quit IRC05:29
*** nelsnelson has quit IRC05:31
*** _nadya_ has joined #openstack-infra05:31
*** ddieterly has joined #openstack-infra05:33
*** yamamoto has quit IRC05:36
*** yamamoto has joined #openstack-infra05:37
*** coolsvap is now known as coolsvap|away05:37
*** ddieterly has quit IRC05:38
*** coolsvap|away is now known as coolsvap05:38
*** yamamoto has quit IRC05:39
*** jtomasek has joined #openstack-infra05:40
*** yamamoto has joined #openstack-infra05:42
*** ayoung has quit IRC05:42
*** hasharAfk has quit IRC05:44
*** DericHorn-HP has quit IRC05:45
*** ivar-lazzaro has joined #openstack-infra05:47
*** Longgeek has joined #openstack-infra05:52
*** deepakcs has quit IRC05:53
*** ivar-lazzaro has quit IRC05:53
*** ivar-lazzaro has joined #openstack-infra05:53
*** deepakcs has joined #openstack-infra05:53
*** jtomasek has quit IRC05:54
*** ivar-lazzaro has quit IRC05:54
*** coolsvap is now known as coolsvap|away05:54
*** ivar-lazzaro has joined #openstack-infra05:54
*** weshay has quit IRC05:54
*** weshay has joined #openstack-infra05:55
*** _nadya_ has quit IRC05:55
*** ivar-lazzaro has quit IRC05:56
*** ivar-lazzaro has joined #openstack-infra05:57
*** ivar-lazzaro has quit IRC05:59
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/19784506:01
*** mrunge has joined #openstack-infra06:02
*** coolsvap|away is now known as coolsvap06:02
*** armax has quit IRC06:04
*** jtomasek has joined #openstack-infra06:05
*** ParsectiX has joined #openstack-infra06:05
*** otter768 has joined #openstack-infra06:10
*** ihrachyshka has joined #openstack-infra06:12
*** otter768 has quit IRC06:14
*** _nadya_ has joined #openstack-infra06:15
*** coolsvap is now known as coolsvap|away06:16
*** dimtruck is now known as zz_dimtruck06:18
AJaeger_ttx, could you +1 https://review.openstack.org/#/c/196704/ to say that the release team adopts the release repo, please06:22
*** yfried_ is now known as yfried|afk06:27
*** scheuran has joined #openstack-infra06:27
*** abregman has joined #openstack-infra06:28
*** unicell1 has joined #openstack-infra06:30
*** unicell has quit IRC06:30
*** maishsk_afk has joined #openstack-infra06:33
*** yfried has joined #openstack-infra06:34
*** yfried_ has joined #openstack-infra06:35
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/19784506:35
*** yfried|afk has quit IRC06:37
*** yfried has quit IRC06:39
*** maishsk_afk is now known as maishsk06:40
*** k4n0 has joined #openstack-infra06:40
*** ddieterly has joined #openstack-infra06:41
*** ddieterly has quit IRC06:46
*** ivar-lazzaro has joined #openstack-infra06:47
ttxAJaeger_: done06:47
*** shardy has quit IRC06:48
ttxfungi: approved06:48
*** shardy has joined #openstack-infra06:48
*** ivar-lazzaro has quit IRC06:50
*** esmute__ has quit IRC06:52
AJaeger_thanks, ttx. I've given my +2 as well now.06:53
*** gildub has quit IRC06:57
*** jtomasek has quit IRC06:58
*** ildikov has joined #openstack-infra07:00
openstackgerritLianhao Lu proposed openstack-dev/pbr: Use io.open() to open metadata files  https://review.openstack.org/19762607:00
*** otter768 has joined #openstack-infra07:00
*** yfried__ has joined #openstack-infra07:03
*** yfried__ is now known as yfried|afk07:03
*** _kiran_ has joined #openstack-infra07:03
*** Alexandra_ has quit IRC07:04
*** kiranr has joined #openstack-infra07:04
*** otter768 has quit IRC07:05
*** _kiran_ has quit IRC07:05
*** HeOS has quit IRC07:05
*** mpaolino has joined #openstack-infra07:06
*** hichihara has quit IRC07:07
*** yfried_ has quit IRC07:07
*** jtomasek has joined #openstack-infra07:07
*** kiran-r has quit IRC07:07
*** kiran-r has joined #openstack-infra07:08
*** kiranr has quit IRC07:08
*** fifieldt has quit IRC07:09
*** yamada-h_ has quit IRC07:09
*** yamada-h has joined #openstack-infra07:12
*** kiran-r has quit IRC07:13
*** jlanoux has joined #openstack-infra07:13
*** mpavlase has joined #openstack-infra07:15
*** mpavlase has quit IRC07:16
*** mpavlase has joined #openstack-infra07:16
*** shashank_hegde has quit IRC07:18
*** coolsvap|away has quit IRC07:20
*** shashank_hegde has joined #openstack-infra07:20
*** ianw has quit IRC07:21
*** ianw has joined #openstack-infra07:22
*** hashar has joined #openstack-infra07:23
*** coolsvap|away has joined #openstack-infra07:23
*** camunoz is now known as camunoz_gone07:25
*** doude has joined #openstack-infra07:25
*** pblaho has quit IRC07:27
*** VivCheri has joined #openstack-infra07:27
*** fhubik has joined #openstack-infra07:28
*** fhubik is now known as fhubik_afk07:28
*** pblaho has joined #openstack-infra07:28
*** jtomasek has quit IRC07:30
*** pblaho has quit IRC07:30
*** jcoufal has joined #openstack-infra07:30
*** olaph has joined #openstack-infra07:31
*** unicell has joined #openstack-infra07:31
*** _nadya_ has quit IRC07:31
*** hrubi has quit IRC07:32
*** unicell1 has quit IRC07:33
*** sshnaidm has joined #openstack-infra07:35
*** mpavone has joined #openstack-infra07:36
*** hashar has quit IRC07:38
*** hashar has joined #openstack-infra07:39
fricklerpersia: I don't think anything in the Wiki gets changes automatically. edited https://wiki.openstack.org/wiki/Releases right now to make Icehouse EOLed there, too07:39
persiafrickler: Thanks for confirming: I wasn't sure enough to edit directly :)07:39
*** _nadya_ has joined #openstack-infra07:40
*** soren has quit IRC07:41
*** dizquierdo has joined #openstack-infra07:42
*** ddieterly has joined #openstack-infra07:42
*** dtantsur|afk is now known as dtantsur07:42
*** oomichi has quit IRC07:43
*** yamada-h has quit IRC07:44
*** pblaho has joined #openstack-infra07:45
*** ddieterly has quit IRC07:46
*** jistr has joined #openstack-infra07:48
*** kiran-r has joined #openstack-infra07:49
*** kiran-r has quit IRC07:49
*** fhubik_afk is now known as fhubik07:49
*** kiran-r has joined #openstack-infra07:49
*** _kiran_ has joined #openstack-infra07:53
*** kiran-r has quit IRC07:57
*** olaph has quit IRC07:57
*** olaph has joined #openstack-infra07:58
*** _nadya_ has quit IRC07:59
*** _nadya_ has joined #openstack-infra08:01
*** notnownikki has joined #openstack-infra08:02
*** afazekas has joined #openstack-infra08:02
*** _kiran_ is now known as kiran-r08:03
*** arxcruz has joined #openstack-infra08:05
*** shardy has quit IRC08:09
*** jcoufal_ has joined #openstack-infra08:09
*** jcoufal_ has quit IRC08:09
*** Ala has joined #openstack-infra08:09
*** dosaboy has quit IRC08:10
*** dosaboy has joined #openstack-infra08:11
openstackgerritMerged openstack-infra/project-config: Start using in-tree Sahara Devstack plugin  https://review.openstack.org/19752408:11
*** dboik has joined #openstack-infra08:11
*** yamamoto has quit IRC08:11
*** dosaboy has quit IRC08:12
*** dboik_ has quit IRC08:12
*** rwsu has quit IRC08:13
*** fbo has joined #openstack-infra08:14
*** yamamoto has joined #openstack-infra08:15
*** rwsu has joined #openstack-infra08:15
*** shashank_hegde has quit IRC08:17
openstackgerritMerged openstack-infra/project-config: Add openstack/releases repository  https://review.openstack.org/19670408:17
*** HeOS has joined #openstack-infra08:20
*** jamielennox is now known as jamielennox|away08:20
*** dosaboy has joined #openstack-infra08:21
*** derekh has joined #openstack-infra08:26
*** heyongli has quit IRC08:27
igorbelikovAJaeger_: hi, could you please take a look at https://review.openstack.org/#/c/196130/08:27
*** heyongli has joined #openstack-infra08:28
*** olaph has quit IRC08:34
*** olaph has joined #openstack-infra08:35
*** hrubi has joined #openstack-infra08:41
*** jamielennox|away is now known as jamielennox08:41
*** ddieterly has joined #openstack-infra08:43
*** olaph has quit IRC08:46
*** amotoki has quit IRC08:46
*** olaph has joined #openstack-infra08:46
*** HeOS has quit IRC08:46
*** HeOS has joined #openstack-infra08:47
*** ddieterly has quit IRC08:47
*** dizquierdo has quit IRC08:48
*** dizquierdo has joined #openstack-infra08:48
*** laughterwym has quit IRC08:49
*** cdent has joined #openstack-infra08:51
*** Longgeek has quit IRC08:52
*** Longgeek has joined #openstack-infra08:53
*** afazekas has quit IRC08:54
Kialllifeless: about? seeing a bunch of errors when trying to get py34 tests running for designate along the lines of "FAIL: subunit.parser parser error bad checksum" - ever seen this?08:55
*** shardy has joined #openstack-infra08:59
*** otter768 has joined #openstack-infra09:01
*** samuelBartel has joined #openstack-infra09:02
*** shardy_ has joined #openstack-infra09:03
*** _nadya_ has quit IRC09:04
*** oomichi has joined #openstack-infra09:05
*** ParsectiX has quit IRC09:06
*** fallenpegasus has quit IRC09:06
*** otter768 has quit IRC09:06
*** teran has quit IRC09:06
*** yfried|afk is now known as yfried__09:09
*** afazekas has joined #openstack-infra09:09
*** claudiub has joined #openstack-infra09:11
*** _nadya_ has joined #openstack-infra09:11
yamamotoall ics links on http://eavesdrop.openstack.org/ seems broken.  is it a known problem?09:11
*** shardy_ has quit IRC09:13
*** BharatK has quit IRC09:16
*** pksingh has joined #openstack-infra09:16
frickleryamamoto: I don't think so. The files generated by the latest commit seem fine, though: http://logs.openstack.org/07/197507/3/gate/gate-irc-meetings-tox-ical/6afcc91/site-index.html09:18
fricklerAJaeger_: I'm assuming that the post jobs for that ^ failed because it ran during the rackspace incident, can you check them or do we need someone with root access?09:19
*** openstackgerrit has quit IRC09:19
*** openstackgerrit has joined #openstack-infra09:20
*** jasondotstar has joined #openstack-infra09:22
*** afazekas has quit IRC09:24
*** dims has joined #openstack-infra09:24
*** ParsectiX has joined #openstack-infra09:26
*** _nadya_ has quit IRC09:26
*** BharatK has joined #openstack-infra09:28
*** soren has joined #openstack-infra09:29
*** koolhead17 has joined #openstack-infra09:29
openstackgerritSergey Skripnick proposed openstack-infra/project-config: Switch rally-heat job to neutron from nova-network  https://review.openstack.org/19751509:31
*** bradjones has quit IRC09:33
*** jtomasek has joined #openstack-infra09:34
*** bradjones has joined #openstack-infra09:35
*** bradjones has quit IRC09:35
*** bradjones has joined #openstack-infra09:35
*** kushal has joined #openstack-infra09:35
*** e0ne has joined #openstack-infra09:35
*** afazekas has joined #openstack-infra09:39
*** larainema has quit IRC09:40
*** larainema has joined #openstack-infra09:41
*** ddieterly has joined #openstack-infra09:43
*** yfried__ is now known as yfried|afk09:44
*** gilliard has quit IRC09:46
*** e0ne is now known as e0ne_09:46
*** BharatK has quit IRC09:46
*** ParsectiX has quit IRC09:46
*** gilliard has joined #openstack-infra09:46
*** oomichi has quit IRC09:46
*** dtantsur is now known as dtantsur|brb09:48
*** ddieterly has quit IRC09:48
*** claudiub has quit IRC09:50
*** devvesa has joined #openstack-infra09:51
*** john-davidge has joined #openstack-infra09:51
*** _nadya_ has joined #openstack-infra09:51
*** koolhead17 has quit IRC09:51
*** john-davidge_ has joined #openstack-infra09:52
*** john-davidge has quit IRC09:56
*** john-davidge_ is now known as john-davidge09:56
*** nagyz_ has quit IRC09:57
*** nagyz_ has joined #openstack-infra09:57
*** pksingh has quit IRC09:57
*** sergmelikyan has joined #openstack-infra09:58
*** notnownikki has quit IRC09:58
*** notnownikki has joined #openstack-infra09:58
*** arxcruz has quit IRC09:59
*** yamada-h has joined #openstack-infra10:04
*** yfried|afk is now known as yfried__10:04
*** ParsectiX has joined #openstack-infra10:05
*** e0ne_ is now known as e0ne10:05
lifelessKiall: no... pastebin?10:08
*** yamada-h has quit IRC10:08
lifelessKiall: or log reference?10:08
*** arxcruz has joined #openstack-infra10:12
*** ociuhandu has joined #openstack-infra10:12
*** VivCheri has quit IRC10:13
*** yfried__ is now known as yfried|afk10:14
*** BharatK has joined #openstack-infra10:14
*** sergmelikyan has quit IRC10:17
*** ociuhandu has quit IRC10:19
*** laughterwym has joined #openstack-infra10:21
*** sergmelikyan has joined #openstack-infra10:25
*** ociuhandu has joined #openstack-infra10:27
*** teran has joined #openstack-infra10:28
*** doude has quit IRC10:32
*** teran_ has joined #openstack-infra10:33
*** doude has joined #openstack-infra10:34
*** BharatK has quit IRC10:34
*** BharatK has joined #openstack-infra10:34
*** rfolco has quit IRC10:35
*** teran has quit IRC10:36
Kialllifeless: sorry, AFK.. I don't have the logs handy, but i'll reproduce and pastebin10:36
*** claudiub has joined #openstack-infra10:42
*** pc_m has joined #openstack-infra10:42
*** ddieterly has joined #openstack-infra10:44
*** ParsectiX has quit IRC10:47
*** kushal has quit IRC10:47
*** ddieterly has quit IRC10:49
openstackgerritFlavio Percoco proposed openstack-infra/project-config: Make amqp1 check voting again  https://review.openstack.org/19791710:52
lifelessKiall: I'm halting() for the night, will look tomorrow10:52
lifelessKiall: but I'd guess at a bad channel somewhere10:52
lifelessKiall: e.g. something writing chatter to stdout10:53
lifelessKiall: during the test suite10:53
Kialllifeless: http://paste.openstack.org/show/335331/ and https://github.com/kiall/designate-py3/ has all the unmerged patches on master10:53
lifelessKiall: if the packets are big enough its possible the io subsystem in cPython is splitting them and then you have <data>crap<endofpacket>10:54
lifeless^ hypothesis10:54
Kialllifeless: no rush, we do have some tests which spew to stdout - but would that affect only py3? works OK for py2?10:54
lifelessKiall: so OS_STDOUT_CAPTURE tries to avoid that by replacing stdout during the tests10:55
lifelessKiall: (though really its just terrible tests that cause us to need that, but thats a different discussion)10:55
*** hashar has quit IRC10:55
KiallYea - There on my todo list to cleanup ;)10:55
KiallAnyway - I'll see if I can narrow down the cause, maybe it's specific tests etc, if you get a chance to poke at it tomorrow let me know.. thanks :)10:56
lifelessso the error is coming from10:56
lifelessline 412 of subunit.v210:56
lifeless            crc = zlib.crc32(packet[-1][:-4], crc) & 0xffffffff10:56
lifeless            packet_crc = struct.unpack(FMT_32, packet[-1][-4:])[0]10:56
lifeless            if crc != packet_crc:10:56
lifeless... error10:56
*** yfried|afk is now known as yfried__10:56
lifelesssubunit is tested on 3.410:57
*** eantysh9 has joined #openstack-infra10:57
lifelessso I don't think its a byte order confusion or anything like that - I mean, if you're running on ARM or something say so10:57
KiallYep - running on Python 3.4.3 on x86 ;)10:57
Kiallx86_64* ;)10:57
lifelessso that Binary content10:57
lifelessthats an attachment10:57
lifelessget me one of those and I can tell you whether the packet is even vaguely ane10:58
lifeless*sane*10:58
Kialllogs/captured or stdout and err?10:58
lifelessno, the failed packet10:58
lifelessI think, its been a while since I've had to think about this failure codepath10:58
lifelessyeah it is10:58
lifeless        except ParseError as error:10:59
KiallGoing to admit, no clue how to do that! But! Go to bed, we can chat tomorrow after I've done some more digging into our code/tests to see if it's there :)10:59
lifeless            result.status(test_id="subunit.parser", eof=True,10:59
lifeless                file_name="Packet data", file_bytes=b''.join(packet),10:59
lifeless                mime_type="application/octet-stream")10:59
lifelessoh, so pull the stream10:59
lifelesswhich jenkins captures10:59
lifelessits gzipped10:59
lifelessits also probably in v1 for reasons10:59
lifelessthen we can run it through subunit and see what we can see10:59
KiallNo py3 gates enabled yet, I'm guessing I can pull it from .testrepository?11:00
lifelessif you're running it locally, pull it out of .testrepository/ - just the highest # file will do11:00
lifelessgzip it and mail to me11:00
*** sergmelikyan has quit IRC11:00
*** eantyshev has quit IRC11:00
lifelessnight11:00
KiallSure - Thanks :)11:00
*** sergmelikyan has joined #openstack-infra11:01
*** fhubik is now known as fhubik_afk11:02
*** otter768 has joined #openstack-infra11:02
*** otter768 has quit IRC11:06
*** abregman has quit IRC11:07
*** abregman has joined #openstack-infra11:08
*** dtantsur|brb is now known as dtantsur11:12
*** yfried__ is now known as yfried|afk11:12
*** mwagner_lap has quit IRC11:13
*** yamamoto has quit IRC11:13
*** BharatK has quit IRC11:14
*** BharatK has joined #openstack-infra11:14
mordredclarkb, greghaynes: when you're aroudn, I'd like to know more about "glean doesn't work on centos7" - because I'm pretty sure we explicitly tested that11:17
mordredfungi: morning11:17
*** dprince has joined #openstack-infra11:20
openstackgerritMerged openstack-infra/glean: Make glean python 2.6 compatible for Centos6  https://review.openstack.org/19769011:22
*** kiran-r has quit IRC11:27
*** sergmelikyan has quit IRC11:28
*** sshnaidm has quit IRC11:28
*** sshnaidm has joined #openstack-infra11:28
*** deepakcs has quit IRC11:30
*** yfried|afk is now known as yfried__11:32
*** paramite has joined #openstack-infra11:32
paramitehi all, can somebody point me to the place where images for gate jobs are stored?11:33
*** tlbr has quit IRC11:34
*** e0ne is now known as e0ne_11:34
*** tlbr has joined #openstack-infra11:35
*** e0ne_ is now known as e0ne11:36
mordredparamite: they're stored in the glances for our public clouds11:36
mordredparamite: once we've moved entirely to image uploads, I believe we've discussed also uploading them to somewhere that people could download them11:37
mordredbut do not currently do that as the majority of the images are still snapshot based11:37
*** thorst has joined #openstack-infra11:38
mordredparamite: whatcha looking for?11:38
clarkbmordred TheJulia reported it yesterday apparebtky it doesnt run at the right time? its in scrollback and possibly systemd related?11:38
mordred_awesome_11:39
paramitemordred, I'm looking for image where this job was running: http://logs.openstack.org/02/197802/1/check/gate-puppet-nova-puppet-beaker-rspec-dsvm-centos7/87105d5/console.html11:39
paramitemordred, to try to reproduce the issue11:39
clarkbthat issue has been debugged see the ml11:40
mordredclarkb: it seems it has not been - there is a follow up on that11:40
clarkboh11:41
clarkbforgive my 4am computering11:41
mordredparamite: unfortunately, those are all snapshot images11:42
clarkbyou can build your own with a rax account11:42
mordred(that one was on HP)11:42
*** yfried__ is now known as yfried|afk11:42
mordredclarkb: I have grown to expect completely arbitrary times of existence for you now11:42
clarkbor HP account11:42
clarkbmordred me too11:42
mordredclarkb: once your sleep schedule becomes normal again, I'm going to have sads11:42
paramitemordred, is there somewhere a documentation how to do it?11:43
*** marcusvrn has joined #openstack-infra11:44
*** sshnaidm has quit IRC11:44
*** yfried|afk is now known as yfried__11:44
*** sergmelikyan has joined #openstack-infra11:44
*** sshnaidm has joined #openstack-infra11:44
*** ddieterly has joined #openstack-infra11:45
clarkbparamite if you grab openstack-infra/project-config the nodepool sceipts dir there contains the build scripts11:45
mordredparamite: basically, you want to get a centos7 node, clone git://git.openstack.org/openstack-infra/project-config on to the node, cd to nodepool/scripts and run ./prepare_node_devstack $(hostname)11:45
clarkbya that11:45
mordredsorry - prepare_node_devstack.sh11:45
clarkband run it ad a user with sudo privs11:45
paramiteclarkb, mordred: thanks guys11:46
mordredclarkb: even though it's 3 steps, we really should have an easy doc snippet for that11:46
clarkbmordred ya11:46
mordredparamite: sure! sorry we dont' have a downloadable image - it's on our TDL11:46
paramitenp11:46
openstackgerritKiall Mac Innes proposed openstack/requirements: Add dnspython3 to global-requirements.txt  https://review.openstack.org/19663311:47
clarkbmordred speaking of, can hpcloud images go to swift too? then we can just make the swift containers public11:48
*** dguerri` is now known as dguerri11:49
*** ddieterly has quit IRC11:49
*** jasondotstar has quit IRC11:50
*** sergmelikyan has quit IRC11:50
mordredclarkb: nope11:50
mordredclarkb: I mean, we could publish them to swift, but that won't do anything with uploads, so it would be an additional step we'd have to run on HP11:51
clarkbgotcha11:51
*** sergmelikyan has joined #openstack-infra11:52
*** mwagner_lap has joined #openstack-infra11:53
mordredclarkb: you know - because we can't have nice things11:53
*** dprince has quit IRC11:54
*** dprince has joined #openstack-infra11:54
*** fhubik_afk is now known as fhubik11:57
KiallSo - Q - I'm getting die 460 'Cloning not allowed in this configuration' during a DSVM run,  yet in devstack-gate-setup-workspace-new.txt.gz I'm seeing the repo cloned down etc etc correctly. I'm out of ideas on where the issue might be! Any suggestions welcome :) http://logs.openstack.org/87/193287/3/check/gate-designate-dsvm-powerdns/080af6e/11:57
KiallRepo failing to come down is openstack/designate-dashboard11:57
clarkbKiall you are cloning in devstack for some reason and that is not allowed11:57
*** miqui has quit IRC11:58
*** ldnunes has joined #openstack-infra11:58
Kiallclarkb: yea, the clone is identical to how devstack is set to pull the main repo, client repo etc.. and the dashboard repo is included in the gate's PROJECTS list, so shouldn't be a clone during devstack itself11:58
KiallOh, wow. I've been on/off looking at this for a few days. The moment I ask - I think I see the issue12:00
clarkbinstall_designatedashboard does it12:00
clarkbso either repo doesnt exist or pwd changes or?12:01
Kiallgit_clone $DESIGNATEDASHBOARD_REPO $DESIGNATEDASHBOARD_DIR $DESIGNATEDASHBOARD_BRANCH12:02
KiallTurns out, DESIGNATEDASHBOARD_DIR isn't defined.. All it took was asking people to spot the issue.. heh :(12:02
KiallSorry! Hopefully passes this time..12:02
clarkbnp12:04
*** nagyz_ has quit IRC12:04
*** nagyz_ has joined #openstack-infra12:05
*** e0ne is now known as e0ne_12:06
*** heyongli has quit IRC12:06
*** ParsectiX has joined #openstack-infra12:07
*** heyongli has joined #openstack-infra12:07
*** acruz_ has joined #openstack-infra12:11
*** acruz_ has quit IRC12:11
*** e0ne_ is now known as e0ne12:11
*** heyongli has quit IRC12:12
*** sergmelikyan has quit IRC12:12
*** rfolco has joined #openstack-infra12:13
*** heyongli has joined #openstack-infra12:13
*** sergmelikyan has joined #openstack-infra12:13
*** hashar has joined #openstack-infra12:15
*** coreycb has quit IRC12:15
*** coreycb has joined #openstack-infra12:15
*** fhubik is now known as fhubik_afk12:15
*** kushal has joined #openstack-infra12:16
*** _nadya_ has quit IRC12:19
*** romcheg has quit IRC12:21
*** hashar has quit IRC12:21
*** hashar has joined #openstack-infra12:21
TheJulia /win 812:22
TheJuliadoh12:22
*** julim has joined #openstack-infra12:22
*** marcusvrn has quit IRC12:23
*** mpaolino has quit IRC12:24
*** aysyd has joined #openstack-infra12:25
*** marcusvrn has joined #openstack-infra12:25
*** kgiusti has joined #openstack-infra12:25
*** olaph has quit IRC12:27
*** julim has quit IRC12:27
*** olaph has joined #openstack-infra12:28
dhellmannmordred: do you have a couple of minutes for this devstack-gate change? https://review.openstack.org/19572412:29
mordreddhellmann: for you brad, I have 512:30
mordreddarn. it's hard to have creepy voice in irc12:31
mordreddhellmann: +a12:31
*** jaypipes has joined #openstack-infra12:32
*** gordc_af1 is now known as gordc12:33
*** annegentle has joined #openstack-infra12:34
*** BharatK has quit IRC12:35
hasharmordred: good morning! I could use some enlightenment for an issue you guys had with Gerrit in August 2013 :-}12:35
*** yamamoto has joined #openstack-infra12:35
*** sshnaidm has quit IRC12:35
hasharin short, doing git fetch  causes Gerrit upload-pack to send everything under refs/changes/*  which slowdown the fetches12:35
hasharour bug is https://phabricator.wikimedia.org/T103990  , the first reply as some quote from a discussion you had in August in #gerrit12:36
openstackgerritMerged openstack-infra/shade: Modify secgroup rule processing  https://review.openstack.org/19730812:36
*** fhubik_afk is now known as fhubik12:36
dhellmannmordred: thanks12:36
*** sshnaidm has joined #openstack-infra12:36
*** BharatK has joined #openstack-infra12:36
*** _nadya_ has joined #openstack-infra12:37
*** jasondotstar has joined #openstack-infra12:37
*** devvesa has quit IRC12:39
*** kushal has quit IRC12:39
mordredhashar: looking12:39
hasharmordred: I am missing the context though. But seems you were trying to optimize fetches from Gerrit12:39
hasharthat was probably before the zuul-merger and the git mirrors12:39
*** baoli has joined #openstack-infra12:40
mordredno - I believe I was trying to deal with fetches from git replicas12:41
mordredhashar: but- I honestly do not remember much about the issue12:42
mordredI do know that we do almost no git operations directly on gerrit12:42
hasharon some of our repos that have ton of changes history, that seriously slowdown fetches for our devs  and for zuul-merger as well :D12:42
mordredyah. I mean - nova is huge :)12:43
hashara good way to verify is looking at:   GIT_TRACE_PACKET=1 git fetch 2>&1|grep refs/changes12:43
hasharshould spurts all the patchsets reference :D12:43
hasharso that can eventually cause a slowdown one day12:43
*** marcusvrn has quit IRC12:43
mordredhashar: yes. if I do a git fetch ssh://mordred@review.openstack.org:29418/openstack/nova.git12:44
mordredhashar: it does indeed spew all the changes refs12:44
mordredbut I never do that :)12:44
mordredNOW - it is also doing that for my fetches from git.o.o12:45
mordredwhich makes me think we should look in to setting that advertise setting there12:45
hasharyeah cause the refs/changes/ is probably replicated to git.o.o12:45
hasharso folks can git-review -d 1234512:45
*** radez_g0n3 is now known as radez12:46
*** ddieterly has joined #openstack-infra12:46
clarkbyou can pack the refs12:46
clarkbso we do that12:46
*** otherwiseguy has joined #openstack-infra12:46
*** olaph has quit IRC12:47
*** olaph has joined #openstack-infra12:47
mordredoh - we can't use hiderefs12:47
mordredbecause centos12:47
mordredand old git12:47
mordredhashar: yes - we replicate all the refs to all the places for that reason12:47
mordredalso - it makes for nice backups12:48
mordredonce we upgrade our git farm to somthing that has git >= 1.8.2 - we can configure it to not advertise that for a blank fetch though12:48
hasharyeah so following your 2 years old discussion on #Gerrit12:49
hasharI though about setting uploadpack.hideRefs=refs/changes/12:50
hasharbut that hides them entirely12:50
*** ddieterly has quit IRC12:50
*** sergmelikyan has quit IRC12:50
hasharand if one set  uploadpack.allowtipsha1inwant  , the object can be fetched given the sha1 (but not the ref)12:50
hasharso that would break  git fetch refs/changes/34/123412:51
hashardescribed on https://phabricator.wikimedia.org/T103990#141234712:51
hasharto conclude, I don't expect any solution. Just thought to give you the information just in case.12:51
mordredugh12:53
mordredok - cool. thanks hashar !12:53
hasharclarkb: yeah we do pack refs on our zuul-merger and on Gerrit as well (via `gerrit gc --all`  iirc):-}12:54
hasharmaybe it is just sending the packfile12:54
KiallWeird.. logs.o.o showing me a 119.7K logfile, but it's empty when you actually try access it.. http://logs.openstack.org/87/193287/5/check/designate-coverage/92d264d/ ... Just a FYI in case it's a bug, I can recheck!12:56
*** rkukura has quit IRC12:56
*** mpaolino has joined #openstack-infra12:56
*** yfried__ has quit IRC12:57
jheskethKiall: the logs server had some disk issues the other night12:57
*** rlandy has joined #openstack-infra12:57
jheskethbut it's odd because the log you're looking at should be in swift (which wasn't affected)12:57
Kialljhesketh: the logs are only an hour or two old12:57
jheskeththat too12:57
KiallAnyway, Just a FYI in case someone wants to see if there's an issue :)12:57
jheskethKiall: yeah a recheck is a good idea12:57
jheskethI'll have a look to see if I can find more details12:58
*** paramite is now known as paramite|afk12:58
*** paramite|afk is now known as paramite12:59
*** paramite is now known as paramite|afk13:00
*** paramite|afk is now known as paramite13:01
*** robcresswell has joined #openstack-infra13:01
robcresswellHi all, wondering if someone could help with something. When adding a new project, does the pypi package name and project name have to be the same, or is it able to be configured differently?13:02
*** otter768 has joined #openstack-infra13:03
*** mmedvede has joined #openstack-infra13:03
jheskethrobcresswell: why would you want them different, wouldn't that just be confusing13:04
jheskethrobcresswell: the default job macros will expect them to be the same, but it wouldn't be much work to do different names (afaik)13:05
*** marcusvrn has joined #openstack-infra13:05
*** shardy has quit IRC13:05
robcresswelljhesketh: The issue I have at the moment is naming Cisco's Horizon extension. openstack/cisco-ui seems like a sensible repo name, but cisco-ui as a public package name is too generic13:05
*** shardy has joined #openstack-infra13:06
robcresswelljhesketh: So the alternative is something like openstack-cisco-ui, or horizon-cisco-ui, leaving the repo as openstack/horizon-cisco-ui etc... its just a nitpick really, but I was curious.13:06
*** ajmiller__ has joined #openstack-infra13:06
robcresswellWas just wondering if there were any nice suggestions about how to name it :)13:07
jheskethah I see13:07
jheskethrobcresswell: there may be other projects uploading different package names, but I can't think of any off the top of my head13:07
*** otter768 has quit IRC13:07
jheskethas a personal preference I like horizon-cisco-ui, that makes sense to me13:07
*** sergmelikyan has joined #openstack-infra13:08
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: gate-oslo.db-tox-mysql-python should not run in stable branches  https://review.openstack.org/19795813:08
robcresswelljhesketh: Yes, I think for simplicity I will just change to that13:08
*** miqui has joined #openstack-infra13:08
mordredhorizon-cisco-ui++13:08
*** ajmiller_ has quit IRC13:10
*** jsavak has joined #openstack-infra13:11
*** EricGonczer_ has joined #openstack-infra13:11
*** jsavak has joined #openstack-infra13:12
robcresswellmordred: Cheers13:12
openstackgerritSteve Martinelli proposed openstack-infra/project-config: Create automated job for sample configuration files  https://review.openstack.org/17762013:13
fricklerjhesketh: would you have time to look at eavesdrop? (see backlog) links like http://eavesdrop.openstack.org/calendars/akanda-team-meeting.ics from the starting page give a 40413:13
openstackgerritRob Cresswell proposed openstack-infra/project-config: Add project for Cisco UI (Horizon plugin)  https://review.openstack.org/19608713:13
*** prad has joined #openstack-infra13:13
*** homeless has joined #openstack-infra13:14
jheskethKiall: https://jenkins04.openstack.org/job/designate-coverage/95/console looks like the network had issues uploading your log (which is why it's empty)13:14
jheskethKiall: hard to say more sorry :-(.. if it happens again, let me know, otherwise possibly write it up to being unlucky13:14
*** kushal has joined #openstack-infra13:15
*** sergmelikyan has quit IRC13:15
Kialljhesketh: interesting - I wouldn't have expected to see the size etc into the directory listing if that happend.. Oh well, easy explanation anyway :)13:15
*** julim has joined #openstack-infra13:15
jheskethfrickler: will take a look, but I think it's because we need https://review.openstack.org/#/c/194504/ to merge13:16
jheskethfrickler: I'll confirm in one sec13:16
*** sshnaidm has quit IRC13:16
jheskethKiall: that isn't an apache mod index... the index is generated and uploaded with all the assets. So one asset (ie the index) was uploaded, but the other one failed13:16
jheskethit's otherwise static html13:17
KiallAhhh13:17
*** olaph has quit IRC13:17
*** sshnaidm has joined #openstack-infra13:17
*** olaph has joined #openstack-infra13:17
AJaeger_yamamoto, frickler: The ics links have never worked. https://review.openstack.org/194488 tries to fix it. fungi, clarkb: This needs some scp publishing expertise, I'd love you to review it...13:17
fricklerjhesketh: yes, that review should then be merged now, the directory seems to have been created here: http://logs.openstack.org/02/197802/1/check/gate-puppet-nova-puppet-beaker-rspec-dsvm-centos7/87105d5/console.html13:18
jheskethfrickler: maybe if mordred is feeling generous...13:18
openstackgerritRob Cresswell proposed openstack-infra/project-config: Add project for Cisco UI (Horizon plugin)  https://review.openstack.org/19608713:19
jheskethfrickler: err, which directory did that job create sorry?13:19
robcresswellChanged name to horizon-cisco-ui and reordered accordingly. Thanks for the help!13:21
jheskethrobcresswell: :-)13:21
fricklerjhesketh: sorry, wrong c&p, http://logs.openstack.org/07/197507/3/gate/gate-irc-meetings-tox-ical/6afcc91/ has the calendars directory13:21
*** heyongli has quit IRC13:21
fricklerjhesketh: but if it is not being uploaded in the post job, as AJaeger_ says, that won't help13:22
jheskethfrickler: AJaeger_: ah I didn't realise that hadn't merged... and yes, I can confirm the calendars aren't currently on the eavesdrop13:23
*** sshnaidm has quit IRC13:23
*** mrmartin has joined #openstack-infra13:23
*** sshnaidm has joined #openstack-infra13:23
*** olaph has quit IRC13:24
*** olaph has joined #openstack-infra13:24
AJaeger_jhesketh: as commented the '' for target confuses me. Please discuss with clarkb and fungi and let them review and approve...13:24
fungijhesketh: any guesses why the requirements check script, in its latest form, is still complaining about multiples? e.g. http://logs.openstack.org/74/197574/4/check/gate-oslo.messaging-requirements/32dbca5/ from today13:25
jheskethAJaeger_: replied13:25
*** ninag has joined #openstack-infra13:25
fungii vaguely recall you had hacked on it a little recently13:25
*** mriedem has joined #openstack-infra13:25
jheskethfungi: no that was lifeless, I was just around to help him push it through13:25
fungioh, got it13:25
jheskethfungi: afaik it will still warn, but not fail unless it's doing a strict check13:26
fungii'll see if i can reverse engineer those latest updates and figure out why it's still doing that13:26
jheskethwhich it will do for master files13:26
*** ninag has quit IRC13:26
jhesketheh, branches13:27
*** sergmelikyan has joined #openstack-infra13:27
fungioh, so we're expecting to get this to work for master branches repos still need to have their extra -py3.txt files deleted13:27
*** heyongli has joined #openstack-infra13:27
AJaeger_fungi: yes, that'S my understanding as well13:27
*** peristeri has joined #openstack-infra13:27
*** amotoki has joined #openstack-infra13:28
*** serg_melikyan has joined #openstack-infra13:28
jheskethfungi: right, that's my understanding too13:28
fungigot it. i'll let them know13:28
AJaeger_fungi, http://lists.openstack.org/pipermail/openstack-dev/2015-July/068469.html13:28
fungiperfect, thanks. passing that along as well13:29
*** mrunge has quit IRC13:29
*** mescanef_ has quit IRC13:29
*** e0ne is now known as e0ne_13:29
*** mescanef has joined #openstack-infra13:30
*** sergmelikyan has quit IRC13:32
*** olaph has quit IRC13:32
*** sshnaidm has quit IRC13:33
clarkbjhesketh ajaeger for the target thibg you could keep hierarchy: false the set target to output?13:35
*** r-daneel has joined #openstack-infra13:36
jheskethclarkb: ah that'd probably work13:36
jheskethclarkb:  oh, no, the output folder isn't placed in the target, it's all the folders below that placed directly into /srv/yaml2ical/13:38
anteayaclarkb: thanks I had a lovely canada day13:38
*** shardy has quit IRC13:38
anteayawas the quietest in recent memory13:38
anteayathanks for thinking of me13:38
anteayapc_m: you were looking for me?13:38
jheskethanteaya: o/13:39
anteayahello jhesketh13:39
anteayayou are still awake I see13:39
clarkbjhesketh output is also preserved with keep hierarchy: true13:39
jheskethit's not too late yet ;-)13:39
anteayajhesketh: it is never too late13:39
jheskethanteaya: although it's probably quite early for you13:39
anteayaso I'm told13:39
anteayajhesketh: 9:30ish13:39
anteayanot so bad13:39
jheskethanteaya: it's never too later, but it's often too early ;-)13:39
jheskethah okay13:39
anteayajhesketh: yeah, that can happen13:40
clarkbanyways an empy target should work as jenkins does do path munging correctly13:40
jheskethclarkb: right, so that's probably not what we wanted then13:40
*** sshnaidm has joined #openstack-infra13:40
jheskethclarkb: do we only need to set source: 'output/**' for that change to work?13:41
*** ZZelle has quit IRC13:42
*** ZZelle has joined #openstack-infra13:42
clarkbjhesketh not if you want to preserve the dirs under output, for that I thibk there is a remove prefix option you need too to remove output13:42
*** tjones1 has joined #openstack-infra13:43
*** fallenpegasus has joined #openstack-infra13:43
fungiclarkb: not for scp13:43
*** e0ne_ is now known as e0ne13:43
clarkbso target / is fine add keep hierarchy true add the ** theb oh hrm13:43
fungithe idea with the scp publisher is that you need to have your content already arranged relative to the scp "root" path configured in jenkins itself (not reflected in the job configuration)13:43
fungibefore you tell the publisher to upload it13:43
*** shardy has joined #openstack-infra13:44
clarkbright so we could mv output/* . then copy **.ics or whatever13:44
clarkbsuch hax13:44
AJaeger_Yeah, that'S what fungi did in project-config/jenkins/jobs/specs-jobs.yaml13:44
*** tvanderwiel has joined #openstack-infra13:44
jheskethclarkb: an alternative is to just publish to a sub-folder and update the symlinks13:45
*** jsavak has quit IRC13:46
fungiAJaeger_: thanks--i was trying to remember where i'd done that13:47
fungiugly, ugly hax13:47
*** ari has joined #openstack-infra13:48
fungioh, that's not the one i was thinking of either13:48
*** _nadya_ has quit IRC13:49
dtantsurhey folks!13:49
*** fhubik is now known as fhubik_afk13:49
dtantsurI'm watching our new gate job, and from time to time some ansible thingy in the very beginning takes up to 1 hour:13:49
dtantsurhttp://logs.openstack.org/78/197878/3/check/check-ironic-inspector-dsvm-nv/25fe318/console.html#_2015-07-02_10_51_26_40913:49
dtantsuris it normal?13:50
*** VivCheri has joined #openstack-infra13:50
dtantsurit leads to timeouts even before we start any testing13:50
fungiAJaeger_: jhesketh: clarkb: the real ugly hax for that was this macro http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n55713:51
*** arxcruz has quit IRC13:51
jheskethheh, this is making me feel better about not finding the scp thingy obvious13:51
AJaeger_fungi: oh, that hack ;(13:51
*** fhubik_afk is now known as fhubik13:52
*** achanda has joined #openstack-infra13:52
dtantsurlooks like some probables with git: http://logs.openstack.org/78/197878/3/check/check-ironic-inspector-dsvm-nv/25fe318/logs/devstack-gate-setup-workspace-new.txt13:52
AJaeger_jhesketh: Your change  wasn't obvious wrong for me as well, it just smelled strange ;)13:52
jhesketh:-)13:52
*** amitgandhinz has joined #openstack-infra13:53
*** fifieldt has joined #openstack-infra13:53
* AJaeger_ gives a -1 now...13:55
*** hdd has joined #openstack-infra13:55
AJaeger_jhesketh: could you update the change, please?13:55
AJaeger_once done, best ask fungi to review ;)13:55
jheskethAJaeger_, fungi: which hack should we use though? I'm thinking we should look at publishing into a dir and fixing the symlinks on eavesdrop13:56
*** sigmavirus24_awa is now known as sigmavirus2413:56
fungiAJaeger_: jhesketh: i can't promise reviewing will do much good. i think most of our adventures with scp publisher plug-in have been a matter of trial and error13:57
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: temprevert heat: Updated from global requirements  https://review.openstack.org/19798513:57
AJaeger_jhesketh: I'm off now, can't help currently with that.13:57
*** jsavak has joined #openstack-infra13:57
jheskethAJaeger_: all good, I'm about to head off myself anyway13:57
*** fallenpegasus has quit IRC13:57
*** dboik has quit IRC13:57
openstackgerritIlya Shakhat proposed openstack/requirements: Bump version of pyOpenSSL to >= 0.14  https://review.openstack.org/19798613:57
*** sshnaidm has quit IRC13:58
clarkbdtantsur not normal looks like connections to the zuul merer were timing out and consuming a couple minutes per timeout13:58
*** sshnaidm has joined #openstack-infra13:58
dtantsurclarkb, yeah, something like that...13:58
*** puranamr has joined #openstack-infra13:58
clarkblikely hpcloud to rax network issues13:59
clarkbbut would need to check the merger side too13:59
dtantsurclarkb, do you think I can work around by bumping this: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ironic.yaml#L94 ?13:59
fungiyeah, i also just saw another hit for a git timeout tanking a grenade job on https://review.openstack.org/19784714:00
fungiso seems like someone hath angered ye network gods14:00
dtantsur:(14:00
*** _nadya_ has joined #openstack-infra14:00
clarkbdtantsur it eill still be slow it all that does is increase the job timeout14:00
dtantsurwell, part of my problem is to make jobs not to fail :) rechecks are slow14:01
*** coreycb has quit IRC14:01
*** nikhil_k1away is now known as nikhil_k14:01
dtantsurdoes infra has a bug tracker?14:01
*** coreycb has joined #openstack-infra14:01
clarkbyes we use https://storyboard.openstack.org14:02
dtantsurthnx14:02
openstackgerritSergey Lukjanov proposed openstack-infra/irc-meetings: Update Sahara meeting id and agenda URL  https://review.openstack.org/19798914:04
*** annegentle has quit IRC14:04
*** zz_dimtruck is now known as dimtruck14:04
dtantsurclarkb, which project I should use to report such a generic failure?14:05
*** jsavak has quit IRC14:05
*** jsavak has joined #openstack-infra14:05
clarkbthats a devstack gate issue so devstack gate14:05
*** arxcruz has joined #openstack-infra14:06
*** mrmartin has quit IRC14:08
*** ParsectiX has quit IRC14:08
*** fhubik is now known as fhubik_afk14:08
*** EricGonczer_ has quit IRC14:09
dtantsurso now we have https://storyboard.openstack.org/#!/story/200031014:09
*** tonytan4ever has joined #openstack-infra14:09
dtantsurclarkb, is there "recheck bug XXX" syntax for storyboard?14:09
clarkbfungi mordred based on apevecs debugging I think installing pip is what breaks us \o/14:10
mordredclarkb: yay!14:10
fungiclarkb: as in pip now depends on requests?14:10
mordredclarkb: is something installing python-pip ?14:10
clarkbfungi ya newer requests14:10
*** heyongli has quit IRC14:10
openstackgerritJoshua Hesketh proposed openstack-infra/system-config: Fix yaml2ical symlinks  https://review.openstack.org/19450414:10
fungimordred: no, other packages on centos 7 apparently want distro-provided python-requests packages14:11
clarkbmordred somehow requests is installed to system from pypi this breaks rpm requests14:11
anteayadtantsur: we don't use recheck bug xxx anymore14:11
dtantsurack thanks14:11
clarkbI think its pulled in as a pip dep14:11
anteayadtantsur: that stats weren't collected, elastic recheck does the heavy lifting for that work now14:11
dtantsurI see14:11
*** fhubik_afk is now known as fhubik14:13
clarkbbecayse get pip pip installs pip14:13
clarkbpip pip pip14:14
*** heyongli has joined #openstack-infra14:14
*** puranamr has quit IRC14:14
fungipipPIPpip pIpPiPpIp14:14
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Bump check-ironic-inspector-dsvm-nv timeout to usual 2 hours  https://review.openstack.org/19799414:15
dtantsurok lets try it until we have a solution ^^ *sigh*14:15
*** Zhongjun has joined #openstack-infra14:16
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Have irc-meetings-publish also publish directories  https://review.openstack.org/19448814:16
openstackgerritJoshua Hesketh proposed openstack-infra/system-config: Symlink yaml2ical calendar folder to apache dir  https://review.openstack.org/19450414:16
jheskethfungi, AJaeger_: ^14:16
*** dboik has joined #openstack-infra14:16
*** BharatK has quit IRC14:16
*** shardy has quit IRC14:18
clarkbI dont have a real computer handy to test on centos with but that is my theory14:18
mordredclarkb: have we mentioned that mixing system installed python and pip installed python is unrecommended? :)14:19
*** dims has quit IRC14:19
*** sshnaidm has quit IRC14:20
clarkbthe suggestion was use a venv14:20
clarkbbut if centos could just do as debian does this is a non issue14:21
clarkbboth manage to avoid the unrecommended thing14:21
*** heyongli has quit IRC14:22
clarkbalso I find it funny that system package managers can be so fragile14:23
*** sshnaidm has joined #openstack-infra14:23
*** heyongli has joined #openstack-infra14:24
*** wenlock has joined #openstack-infra14:24
*** BharatK has joined #openstack-infra14:24
*** achanda has quit IRC14:24
*** wenlock_ has joined #openstack-infra14:24
fricklerwould someone be willing to +A this puppet-iptables patch https://review.openstack.org/189141? that is the last piece missing in order to be able to create Vivid images in nodepool14:26
*** ildikov has quit IRC14:26
*** erlon has joined #openstack-infra14:27
clarkbif there is no service with that name dont you have to update the service puppet resources too?14:28
*** serg_melikyan has quit IRC14:28
*** hogepodge has quit IRC14:28
*** eharney has quit IRC14:30
*** e0ne is now known as e0ne_14:30
fricklerclarkb: if I understand the setup correctly, they will use the changed $service_name and all should be fine14:32
*** e0ne_ is now known as e0ne14:32
openstackgerritDoug Hellmann proposed openstack-infra/infra-specs: Centralize Release Tagging  https://review.openstack.org/19119314:34
*** heyongli has quit IRC14:34
clarkbgah I confused package name and service name so same question but flipped around14:34
clarkbthere is no iptables-persistent service but the package still exists?14:34
*** rlandy has quit IRC14:34
*** tjones1 has left #openstack-infra14:34
clarkbhttp://packages.ubuntu.com/vivid/admin/iptables-persistent thats amazing14:35
fricklerclarkb: yes. and what used to be a seperate service is now running as a plugin to netfilter-persistent14:35
*** heyongli has joined #openstack-infra14:36
*** robcresswell has left #openstack-infra14:36
*** rossella_s has quit IRC14:36
*** rm_work is now known as rm_work|away14:37
*** MarkAtwood has joined #openstack-infra14:37
fricklerclarkb: http://paste.openstack.org/show/335846/14:37
clarkbI sometimes thibk these half backward compat cjanges are worse than just forcing people to really change14:37
*** rossella_s has joined #openstack-infra14:37
*** luqas has joined #openstack-infra14:37
*** dims has joined #openstack-infra14:38
clarkbnext question is does it read the same config files as anetfilter plugin? I likely need to just run this and see which I cant do currently14:38
*** mpaolino_ has joined #openstack-infra14:39
*** rlandy has joined #openstack-infra14:40
fricklerclarkb: it is still /etc/iptables/rules.v[46], yes14:40
claytonI accidentally pushed a branch to the openstack/puppet-designate project, but don't appear to have permissions to delete it.  What's the procedure for when one does something dumb like this?14:40
*** annegentle has joined #openstack-infra14:41
*** jsavak has quit IRC14:41
anteayaclayton: what is the name of the branch?14:41
*** sergmelikyan has joined #openstack-infra14:41
claytonphase_hooks14:41
*** jsavak has joined #openstack-infra14:41
*** VivCheri has quit IRC14:42
*** fhubik is now known as fhubik_afk14:42
anteayathat uses this acl: http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/acls/openstack/puppet-modules.config14:43
*** shardy has joined #openstack-infra14:43
*** heyongli has quit IRC14:43
claytonnod, it doesn't look like anyone in the puppet-manage-core group has permission to delete branches14:43
clarkbclayton anteaya ya we cant give out branch deletion perms without allowing a bunch of other stuff14:43
claytonwasn't sure if that was normal or not14:44
clarkba gerrit admin will need to delete the branch14:44
claytonok, I figured it might be something like that14:44
anteayaclarkb: ah okay14:44
*** sshnaidm has quit IRC14:44
*** dims has quit IRC14:44
fungiclayton: the best solution is to restrict create access for branches to nobody, or to a very limited subset of people (perhaps just a release manager)14:44
*** sshnaidm has joined #openstack-infra14:44
fricklerclarkb: fwiw I am running a local nodepool-built image with that patch just fine14:45
anteayaclayton: yeah so maybe offer a patch to the acl removing the create line on line 314:45
claytonfungi: well, I'll bring it up with the other core reviewers on the projects, I suspect they may think the solution is for me to not do this again :)14:45
fungisimilar to allowing pushing of merge commits or tags, it's a risk when not tightly restricted14:45
clarkbfrickler and the iptables rules applied? I expect the host to boot but want to check the ruleset is applied14:45
*** nikhil_k is now known as nikhil_k1away14:45
*** ildikov has joined #openstack-infra14:46
*** nikhil_k1away is now known as nikhil_k14:46
anteayaclayton: and yeah, tagging for the whole core team on that acl, perhaps you might want to discuss taht as well14:46
*** nikhil_k is now known as nikhil_k1away14:46
anteayaclayton: better if it is just one person14:46
*** nikhil_k1away is now known as nikhil_k14:46
fricklerat least /etc/iptables/rules.v4 shows the openstack-INPUT rules, will confirm with a reboot now14:46
clarkbfrickler what does iptables -L show?14:46
*** heyongli has joined #openstack-infra14:47
fricklerclarkb: the same rules, also after a reboot14:47
dtantsuranteaya, oh, interesting now, we might want to fix it for ironic-inspector as well..14:47
dtantsur* interesting to know14:48
anteayadtantsur: acls should be as restrictive as possible14:48
anteayanot to prevent projects from doing what they need to do14:48
anteayabut from preventing people from shooting themselves in their own foot14:48
*** EricGonczer_ has joined #openstack-infra14:49
anteayaand then waiting in line for someone to fix their repo14:49
*** EricGonczer_ has quit IRC14:49
*** dims has joined #openstack-infra14:49
dtantsuranteaya, ok, I will propose a new group for some stuff like pushing tags. will I need to file an LP ticket to initiate a new group?14:49
anteayadtantsur: no, just offer a patch to edit the acl file14:50
*** VivCheri has joined #openstack-infra14:50
dtantsurack14:50
*** spzala has joined #openstack-infra14:51
anteayadtantsur: have you had a chance to look over the gerrit permissions section of our infra manual: http://docs.openstack.org/infra/manual/creators.html#add-gerrit-permissions14:51
anteayadtantsur: it can't hurt14:51
*** heyongli has quit IRC14:52
dtantsuranteaya, probably I did some time ago, but it never hurts to repeat :)14:52
*** mtanino has joined #openstack-infra14:52
anteaya:)14:52
anteayathanks14:52
jheskethI'm off, see y'all later14:52
anteayajhesketh: sleep well14:52
*** heyongli has joined #openstack-infra14:53
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Restrict some dangerous permissions on ironic-inspector  https://review.openstack.org/19800814:54
dtantsuranteaya, looks better now? ^^14:54
* dtantsur have read the docs14:55
anteayadtantsur: the creation of a -release group for branch and tag creation looks fine (typo in the commit message)14:56
anteayadtantsur: what is your current stable branch behaviour?14:56
anteayadtantsur: do release managers or the stable team take care of those things for you?14:57
dtantsuranteaya, sorry, what do you mean by "behaviour"? currently I manage stable branches.14:57
*** bradjones has quit IRC14:57
*** fhubik_afk is now known as fhubik14:58
*** yamahata has joined #openstack-infra14:58
*** fhubik is now known as fhubik_afk14:58
anteayaokay well for stable branches there is a stable maintenance team that oversees or did oversee stable branch patches for some projects14:58
anteayaand release managers have stable branch permissions for some projects14:58
*** fawadkhaliq has joined #openstack-infra14:58
dtantsurah I see. we're not part of it (at least for now)14:58
*** bradjones has joined #openstack-infra14:58
*** bradjones has quit IRC14:58
*** bradjones has joined #openstack-infra14:58
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Restrict some dangerous permissions on ironic-inspector  https://review.openstack.org/19800814:58
anteayaso I was asking what the current arrangement is for your project with the stable maintenance team and the release management team14:58
*** heyongli has quit IRC14:59
anteayaas making changes without talking to them tends to lead to a mess14:59
anteayadtantsur: you might be part of it without knowing about it14:59
fungianteaya: btw, we have a tag for that now! http://governance.openstack.org/reference/tags/release_managed.html14:59
dtantsuranteaya, how do I figure out? :)14:59
dtantsurthis tag is not applied to ironic-inspector14:59
*** maishsk has quit IRC14:59
*** sshnaidm has quit IRC15:00
anteayadtantsur: well it appears I either have to do a bunch more reading to answer that question or someone else can jump in15:00
*** bswartz has joined #openstack-infra15:00
*** arxcruz has quit IRC15:00
greghaynesmordred: fungi any idea how uploads are going?15:00
greghaynesI assume they are going right now..15:00
anteayaif you wait for me, which you are welcome to do it will take a bit as I have meeting logs to catch up on15:00
*** hogepodge has joined #openstack-infra15:01
fungigreghaynes: chances are we won't know for a few hours, but i'll try to keep tabs on it today15:01
greghaynesah15:01
* anteaya returns to reading meeting logs15:01
greghaynesok, ty15:01
*** fhubik_afk is now known as fhubik15:01
dtantsurack15:01
*** heyongli has joined #openstack-infra15:01
*** sshnaidm has joined #openstack-infra15:03
*** otter768 has joined #openstack-infra15:04
*** fhubik is now known as fhubik_afk15:04
*** scheuran has quit IRC15:05
*** dims has quit IRC15:06
*** Guest42148 has joined #openstack-infra15:07
*** dguerri is now known as dguerri`15:07
*** afazekas has quit IRC15:08
*** otter768 has quit IRC15:08
*** Guest42148 is now known as dims_15:09
*** mpavone has quit IRC15:09
*** austin81 has joined #openstack-infra15:09
*** austin81 has left #openstack-infra15:09
*** asahlin_away is now known as asahlin15:10
fungihuh... according to rax's dashboard they've replaced their performance 1 and 2 flavors with general purpose and i/o respectively15:14
funginova flavor list still has the old ids present15:14
fungiin addition to the new ones15:14
*** rm_work|away is now known as rm_work15:14
*** asselin_ has joined #openstack-infra15:14
fungii wonder if they're going to delete those at some point and we'll need to update our configs15:14
*** harlowja_at_home has joined #openstack-infra15:14
greghaynesgotta keep the users on their toes15:14
fungilooks like we should be selecting '8 GB General Purpose v1' now as the replacement for '8 GB Performance'15:15
*** sergmelikyan has quit IRC15:15
*** austin81 has joined #openstack-infra15:15
*** puranamr has joined #openstack-infra15:17
*** shardy_ has joined #openstack-infra15:18
anteayattx dhellmann do either of you have a moment to help me understand: http://governance.openstack.org/reference/tags/release_managed.html#tag-application-process15:18
*** DericHorn-HP has joined #openstack-infra15:18
anteayattx dhellmann so if a project isn't selected by release managers and has the tag in the govenerance repo can do whatever they want with stable branches?15:19
fungittx: dhellmann: anteaya: fwiw i was revisiting the tag application criteria for that yesterday, and it looks like it might have slipped out of phase with the current meaning of "the release management team handles releases of these things"15:19
rm_workAJaeger_: you around?15:19
anteayafungi: okay, what might bring it back into phase?15:19
mordredfungi: awesome!15:20
fungianteaya: well, the "predefined release cycle" is sort of vague in the face of libraries/clients now15:20
anteayafair point15:20
fungi"feature freeze" may also not be applicable to some of these any longer15:20
* anteaya nods15:21
*** shardy has quit IRC15:21
*** jsavak has quit IRC15:21
fungiand just yesterday i/we overloaded it with "these are also the projects for whom the fates of their stable branches (if they have them) are decided by the stable release managers"15:22
*** jsavak has joined #openstack-infra15:22
fungii.e. they all eol at the same time15:22
dhellmannfungi, anteaya : ttx is working on updating the release model tag definitions15:22
*** hashar has quit IRC15:22
anteayaI see15:22
fungidhellmann: ttx: perfect!15:22
anteayadhellmann: thank you15:22
*** sergmelikyan has joined #openstack-infra15:23
*** chlong has quit IRC15:23
dhellmannwe're going to have some new tags to clarify the difference between what projects do and what is being managed by the release team15:23
anteayadtantsur: so for now I would suggest splitting your change into two patches, create the -release team and give it permissions on branch creation and tagging in the parent patch15:23
*** woodster_ has joined #openstack-infra15:23
fungidhellmann: something that reflects the stable branch management for devstack, grenade and oslo-incubator following the same cadences as the api projects would also be helpful i think15:24
*** yamamoto has quit IRC15:24
anteayadtantsur: then create a dependent patch with the stable branch changes, the second patch would require some clarity for me first so might take a while15:24
*** k4n0 has quit IRC15:24
dtantsuranteaya, I'm not sure I understand the reason. right now any member of the -core may (and will very soon) create a stable branch15:24
fungidhellmann: mainly because i noted them as obvious exceptions in the revamped bigtop eol process yesterday15:24
mtreinishfungi: how do we do that when things start releasing all willy-nilly?15:24
fungimtreinish: booze15:24
mtreinishhaha15:24
*** jcoufal has quit IRC15:25
dtantsuranteaya, this patch does not change the process for us, just makes sure people don't shoot their legs15:25
anteayadtantsur: my reason is that I don't know the relationship between the stable maintenance team and your project15:25
*** yamamoto has joined #openstack-infra15:25
anteayadtantsur: if there is a relationship implied or if there clearly is no relationship15:25
anteayadtantsur: that the stable maintenance team would also acknowledge15:25
dtantsuranteaya, I guess I would be aware of such existed... anyway, no problem, I'll split it15:25
anteayadtantsur: you asked for my input, there it is15:25
anteayaI am very confused by new changes15:26
dhellmannfungi: ok, ttx is writing all of this up, but I think his plan is to make it clear that stable branches are part of the 6 month cycle, and so if the release model is something else and there are stable branches those are not necessarily the same thing as the "stable" brand implies15:26
fungimtreinish: i expect devstack, grenade and oslo-incubator would continue to follow the same stable branch cadence as the api servers, or switch to branchless like tempest did15:26
anteayaand can't offer comment on new patches unless I understand the implcations15:26
anteayaand in this case I cannot15:26
*** puranamr has quit IRC15:26
anteayafeel free to move ahead without my input15:26
*** jsavak has quit IRC15:26
fungidhellmann: that sounds sane15:27
dtantsuranteaya, thanks for input, I'll split it and see what people decide (though again, it won't change any procedures)15:27
anteayadtantsur: happy to provide input15:27
dhellmannfungi: at one point we talked about having separate stable:managed tag, but I don't remember if we decided to go with that or not -- ttx had it clear in his head, so that was good enough for me15:27
fungidhellmann: "stable" branches are the releases of everything that were current at the cusp between cycles, but many of them may have released a while earlier in the cycle15:27
dhellmannright15:28
fungiif i understand the plan15:28
*** jsavak has joined #openstack-infra15:28
mtreinishfungi: well branchless doesn't really work in the grenade or devstack case, I guess everything that is different than the normal cadence will have to be a plugin15:28
igorbelikovhi, folks. need another +2 here https://review.openstack.org/#/c/196130/. Will really appreciate if someone could take a look15:28
dhellmannyeah, and as we move more projects onto the intermediate release model that will continue to be the case15:28
claytonclarkb, fungi: what should I do to get a gerrit admin to delete that branch in the short term?15:28
mtreinisherr I guess as long as the names are the same the cadence between things doesn't really matter15:29
fungimtreinish: my guess is that those would branch at the cycle transition or at least when/after all the projects they integrate have branched15:29
dhellmannmtreinish: grenade and devstack probably need to keep stable branches15:29
mtreinishdhellmann: they do15:29
mtreinishfungi: yeah, that's what I'm thinking15:29
anteayadtantsur: you said you would know if there was a relationship between your project and stable maintenance15:29
anteayadtantsur: that is not necessarily the case15:30
*** olaph has joined #openstack-infra15:30
anteayadtantsur: as some relationships are implied and you don't know about them until you make non-compatible changes15:30
*** paramite has quit IRC15:30
anteayathen the work to fix the situation is non-trivial15:30
fungiclayton: i have now deleted the phase_hooks branch of openstack/puppet-designate. its branch tip was 242e44f77698cf24948f1c38ca34cd108952389d15:30
*** ajmiller__ is now known as ajmiller15:30
anteayahence my desire to clarify the relationship prior to agreeing to changes15:31
claytonfungi: thanks :)15:31
fungiclayton: you're welcome!15:31
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Restrict some dangerous permissions on ironic-inspector  https://review.openstack.org/19800815:31
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Restrict stable branches approval on ironic-inspector  https://review.openstack.org/19803015:31
dtantsuranteaya, done ^^15:31
*** che-arne has joined #openstack-infra15:31
openstackgerritMerged openstack-infra/devstack-gate: Treat bug/ and feature/ branches the same way  https://review.openstack.org/19572415:32
anteayadtantsur: great15:32
* anteaya returns again to reading meeting logs15:32
greghaynesclarkb: we dont have any kind of migrations for nodepool right?15:32
greghaynesI thought I remembered a patch to add alembic stuff...15:33
clarkbmordred proposed one it is unmerged15:33
greghaynesah, thats the author15:33
*** asadoughi has quit IRC15:33
dims_anteaya: please bless this https://review.openstack.org/#/c/197958/ when you get a chance (job running on wrong branch)15:34
fungiclarkb: okay, i've set up a rax centos 7 vm with none of our tooling on it. python-requests is indeed preinstalled from distro packages. python-pip is not. running get-pip.py also does _not_ drag in requests from pypi15:34
*** olaph has quit IRC15:34
clarkbhuh there goes that theory15:35
*** doug-fish has quit IRC15:35
anteayadims_: done15:35
fungilooking in our image build log, the only mention i see for requests being pip installed are in the virtualenvs for zuul and zuul-swift-upload15:35
dims_anteaya: thanks!15:37
fricklerclarkb: I'll be afk for a bit now, will check later in case you have further questions15:37
mordredfungi: python-requests is there because of cloud-init I believe15:38
mordredah - sorry, you were communicating a different piece of information15:38
fungiclarkb: in openstack_project::thick_slave we do drag in requests from pip, but this issue was observed on a devstack-centos7 image so wouldn't be related (i think?)15:39
mordredfungi: I wonder if there are pip logs in any of the users' directories15:39
*** armax has joined #openstack-infra15:39
mordredfungi: that might show whether it was a direct or indirect thing15:39
fungimordred: perhaps. i'll need to hold another worker running that job15:40
*** achanda has joined #openstack-infra15:41
dims_fungi: some stable/kilo requirements jobs are running into "ImportError: No module named openstack_requirements" http://logs.openstack.org/35/173835/1/gate/gate-stevedore-requirements/e25f968/console.html15:42
anteayadims_: welcome15:43
fungidims_: yeah, lifeless said he's working on getting the changes in master requirements backported to stable branches now15:43
dims_fungi: thanks, will leave them alone15:44
*** unicell has quit IRC15:44
fungidims_: the requirements project was massively refactored, switched to a python package with entrypoints et cetera15:44
dims_gotcha fungi15:45
openstackgerritMerged openstack-infra/project-config: gate-oslo.db-tox-mysql-python should not run in stable branches  https://review.openstack.org/19795815:45
*** marcusvrn has quit IRC15:45
*** sabeen has quit IRC15:47
*** laughterwym has quit IRC15:49
*** doude has quit IRC15:50
*** bswartz has quit IRC15:50
*** mwagner_lap has quit IRC15:51
*** jlanoux has quit IRC15:52
zaromorning15:55
*** shashank_hegde has joined #openstack-infra15:55
*** nihilifer has joined #openstack-infra15:55
dhellmannanteaya: have a few minutes to look at this creator's guide update? https://review.openstack.org/#/c/187212/15:57
*** Guest22716 has quit IRC15:57
*** dboik_ has joined #openstack-infra15:58
*** dboik has quit IRC15:58
*** esmute__ has joined #openstack-infra15:59
*** baoli has quit IRC15:59
*** dtantsur is now known as dtantsur|afk16:00
*** dboik has joined #openstack-infra16:00
*** baoli has joined #openstack-infra16:00
anteayadhellmann: right after i finish eating16:00
dhellmannanteaya: thanks, no rush16:01
anteayak16:01
*** jtomasek has quit IRC16:01
*** jsavak has quit IRC16:02
*** asselin_ has quit IRC16:02
*** jistr has quit IRC16:02
*** dangers_away is now known as dangers16:02
*** dannywilson has joined #openstack-infra16:03
*** liam_ has joined #openstack-infra16:03
*** dboik_ has quit IRC16:03
*** abregman is now known as abregman|mtg16:03
*** liam_ is now known as Guest4185616:04
*** jsavak has joined #openstack-infra16:04
*** nihilifer has quit IRC16:05
*** derekh has quit IRC16:06
*** Guest41856 has quit IRC16:08
*** __afazekas is now known as afazekas16:08
*** amitgandhinz has quit IRC16:08
*** ihrachyshka_ has joined #openstack-infra16:11
*** ihrachyshka has quit IRC16:11
*** j3p0uk has joined #openstack-infra16:11
j3p0ukThere's a change that has had a +2 for a month now - can anyone take a look to see if it can get over the line please? https://review.openstack.org/#/c/177201/16:13
*** dannywilson has quit IRC16:14
*** Guest41856 has joined #openstack-infra16:14
*** fhubik_afk is now known as fhubik16:14
*** amotoki_ has joined #openstack-infra16:14
*** ayoung has joined #openstack-infra16:15
*** samuelBartel has quit IRC16:15
openstackgerritMerged openstack-infra/elastic-recheck: Add query for failing puppet-apply-centos6 job  https://review.openstack.org/19528316:16
ttxdoes anyone know how often the periodic jobs run ?16:16
ttx(like the new kilo ones we just defined)16:17
anteayattx: every 24 hours I do believe16:17
fungij3p0uk: yep, i remember when we had the conversation that led to that patch. i think we want to see if jeblair has a few minutes to get some consensus on the intended behavior16:17
anteayanot sure what time the cron job kicks off16:17
ttxanteaya: ok great16:17
*** amotoki has quit IRC16:17
fungittx: daily at 06:01 utc according to http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n14616:18
fungianteaya: ^16:18
anteayafungi: thanks16:19
mordredanteaya: do you know how to read crontab lines like those?16:20
anteayadhellmann: I +1'd that creator's guide update previously, that is the best I can do on that patch16:20
anteayamordred: no16:20
anteayathanks for asking16:20
j3p0ukfungi - I think we both agreed in the end that the behaviour pre and post patch was identical, I thought my patch just simplified the code to make it easier to understand what was happening.16:20
mordredanteaya: http://www.adminschoice.com/crontab-quick-reference section three might be helpful16:20
anteayamordred: thank you16:21
*** sergmelikyan has quit IRC16:21
*** Ala has quit IRC16:22
openstackgerritVladimir Sharshov proposed openstack-infra/project-config: Add project fuel-nailgun-agent repo  https://review.openstack.org/19805316:22
mordredanteaya: we use the format for timer entires in zuul (as you can see) - but the same format is used in crontab files to tell a system to run a command at a time16:22
dhellmannanteaya: ok, if a conversation would make you confident of a +2 let me know16:22
*** baoli has quit IRC16:23
*** homeless has quit IRC16:23
*** Guest41856 has quit IRC16:24
*** baoli has joined #openstack-infra16:25
*** _nadya_ has quit IRC16:25
anteayamordred: great, thank you16:26
anteayadhellmann: I don't have +2 on that repo16:26
*** homeless has joined #openstack-infra16:26
anteayadhellmann: my confidence in your patch is already as expressed as I can get there16:26
dhellmannanteaya: oh? I thought you did! sorry, my confusion16:26
anteayadhellmann: no problem, sorry I can't be of more help to you16:27
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman  https://review.openstack.org/19772216:27
anteayamordred: thanks for taking the time to explain things to me16:27
anteaya:)16:27
greghaynesclarkb: ^16:27
*** j3p0uk has quit IRC16:28
greghaynesclarkb: note line 363 on https://review.openstack.org/#/c/197722/4/nodepool/nodepool.py16:28
*** sabeen has joined #openstack-infra16:28
*** jsavak has quit IRC16:30
*** eharney has joined #openstack-infra16:31
*** homeless has quit IRC16:31
clarkbhrm not sure if that zuul behavior isbthe same...16:31
clarkbbecause it used to check zuul refs first then branches but comment now says its ref branch ref branch16:31
*** homeless has joined #openstack-infra16:31
greghaynesclarkb: oh, it uses a method called getJobData which I had no idea of16:32
clarkbreading the diff now to make sure comments line up with reality16:32
asselinjeblair, thanks for the  puppet-openstackci-core! I missed it in the meeting, but noticed it while doing reviews :)16:32
greghaynesclarkb: yea, it does job.data[-=]16:33
greghayneser, -116:33
*** che-arne has quit IRC16:33
fungiclarkb: j3p0uk: yeah, it's a subtle change, so i'm trying to see if i can spot possible subtle behavior differences for which we might be missing test coverage16:33
*** jsavak has joined #openstack-infra16:33
asselinfungi, Is today a better day to merge common-zuul patches? jhesketh has a -1, but his comments can be easily addressed.16:35
asselinfungi, otherwise, I don't see any reason to hold up the puppet-openstackci common-zuul change16:36
clarkbits deinitely a behavioral change because it obyl fetches zuul ref once16:36
fungiasselin: yes, i think today is a good day to break stuff (well, let's hope we don't, but you know...)16:36
*** tonytan4ever has quit IRC16:37
*** rm_work is now known as rm_work|away16:37
greghaynesoh! we can break things!?16:37
asselinfungi, ok geat! I'll be upgrading all my cis today too.16:37
fungiasselin: i just want to make sure i clear some time later today after image updates complete to merge my bindep additions and give them a pass in production when they won't impact our regular scheduled updates16:37
asselinfbo, you around?16:37
*** Swami has joined #openstack-infra16:37
*** shardy_ has quit IRC16:37
clarkbI think where that matters is changes across branches ending up in the pipeline?16:37
*** mayurig has joined #openstack-infra16:37
*** fallenpegasus has joined #openstack-infra16:37
clarkbdefinitely something jeblair's eyes on would be good to have16:38
*** sergmelikyan has joined #openstack-infra16:38
asselinfungi, ok. I'll +a the puppet-openstackci and get that setup on my systems. If there are any issues, we can delay infra upgrade.16:38
*** isviridov_away is now known as isviridov16:38
anteayaasselin: congratulations and my condolences16:39
anteayaasselin: may your mop and bucket serve you well16:39
asselinlol16:39
anteaya:)16:39
anteayayou worked really hard for this, I'm glad to see you get permissions16:40
*** sergmelikyan has quit IRC16:40
TheJuliagreghaynes: so, back to simple-init.  It is something with systemd where the arguments are passed, glean executes, but the files are never written out so the interfaces never fire up.  I introduced an artificial delay just to see if there was a race, and still no dice, no files.16:40
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Have irc-meetings-publish also publish directories  https://review.openstack.org/19448816:40
greghaynesTheJulia: hrm. When you say 'glean executes' - do you have an exact command that is run?16:41
fungiclarkb: yes, i agree it short-circuits to avoid trying more than one fetch from zuul. i'm trying to figure out the scenario where that will matter but i agree it's a change in behavior16:41
*** ivar-lazzaro has joined #openstack-infra16:41
*** ivar-lazzaro has quit IRC16:41
greghaynesTheJulia: also - this is with config drive? Are you sure the config drive exists and blkid can see it before glean execs?16:41
AJaeger_clarkb, fungi: Could you review https://review.openstack.org/#/c/194488 now, please? That's the calendar scp publishing fun...16:41
TheJuliayup, it is executing with `glean --interface $INTERFACE`  returning an exit code of 016:42
* AJaeger_ just fixed a typo there16:42
greghaynesTheJulia: Awesome16:42
*** ivar-lazzaro has joined #openstack-infra16:42
AJaeger_rm_work|away: I'm here now...16:42
TheJuliagreghaynes: sure, hostname, ssh key, all set.  It even does the ip link up step, just the file... disappears into the ether16:42
greghaynesTheJulia: So yea, if it runs before udev adds the config drive device then its no dice16:42
greghaynesTheJulia: hrm16:42
greghaynesTheJulia: so it does see it16:42
*** shardy has joined #openstack-infra16:42
TheJuliagreghaynes: yup :(16:42
greghaynesTheJulia: it it possible that its running multiple times and maybe overwriting a previous run?16:43
clarkbis the /etc fs getting overlayed or ro?16:43
greghaynesTheJulia: I think we rm the interface somewhere in the init or glean run16:43
TheJuliagreghaynes: so as far as I remembered the code, it writes directly out.16:43
TheJuliaclarkb: thats what I'm suspecting is that its in a chroot or something funky16:44
TheJuliaclarkb: but according to the docs, it shouldn't be16:44
TheJuliagreghaynes: I don't remember the file being nuked anywhere...16:44
*** homeless has quit IRC16:45
greghaynesTheJulia: Is the interface config file just totally missing or empty?16:46
*** SumitNaiksatam has quit IRC16:47
TheJuliatotally missing16:47
greghaynesTheJulia: And if you run glean on its own from the cmd line it DTRT?16:47
TheJuliaif I run it from the command line, with the interface param and the interface name, works like a champ.  Also if I just run it without any params, both interface files appear on the machine I'm testing on16:48
greghayneshuh16:48
TheJuliamy brain for the last day or so16:48
greghaynesyea, so youre going to have to probably put some debug in the write_static_network_info which should show up in the console log16:49
nikhil_kmordred: sorry I was away on travel with no internet access when you pinged http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-06-30.log.html#t2015-06-30T19:19:3716:49
*** SumitNaiksatam has joined #openstack-infra16:49
greghaynesmake sure its actually trying to write to /etc/whatever16:49
greghaynesand then if it is... systemd funkyness is assumed16:49
greghaynesTheJulia: Maybe theres a later systemd network config thing running that rm's the interfaces?16:49
*** luqas has quit IRC16:49
nikhil_kmordred: the answer is no, as that is being planeed as a part of cloning work. inter region can be very expensive data transfer.16:50
greghayneslike cloud-init or somesuch16:50
*** tsekiyama has joined #openstack-infra16:50
*** luqas has joined #openstack-infra16:50
nikhil_kHope you all figured it out already :))16:50
*** mpavlase has quit IRC16:50
*** luqas has quit IRC16:50
TheJuliagreghaynes: so the main exec step is ifup, so between the pre-step calling simple-init and the ifup, the file would be disappearing in that case, hence why I mucked with it and added an artificial delay.  I guess I should check the folder inode last updated time16:51
*** luqas has joined #openstack-infra16:51
*** HeOS_ has quit IRC16:51
greghaynesyea, assuming that other network config things use the same event to run16:52
greghaynesI mean, I am kinda grasping at straws at this point ;)16:52
mordrednikhil_k: ok. cool. thanks!16:54
*** ivar-lazzaro has quit IRC16:54
TheJuliagreghaynes: well, good to know I'm not alone :)16:54
*** mestery has quit IRC16:55
*** maishsk_afk has joined #openstack-infra16:55
*** patrickeast has joined #openstack-infra16:55
*** sabeen has quit IRC16:56
*** abregman|mtg has quit IRC16:56
*** _nadya_ has joined #openstack-infra16:56
*** claudiub has quit IRC16:57
*** luqas has quit IRC16:57
*** sergmelikyan has joined #openstack-infra16:57
*** heyongli has quit IRC16:59
*** luqas has joined #openstack-infra16:59
*** ihrachyshka_ has quit IRC17:00
*** sshnaidm has quit IRC17:00
*** gyee has joined #openstack-infra17:01
*** heyongli has joined #openstack-infra17:01
*** BharatK has quit IRC17:01
*** sabeen1 has joined #openstack-infra17:02
openstackgerritMerged openstack-infra/puppet-openstackci: Add generic zuul manifests  https://review.openstack.org/17597017:03
*** dizquierdo has quit IRC17:04
* asselin merges17:04
*** kiran-r has joined #openstack-infra17:04
*** teran has joined #openstack-infra17:04
anteayaasselin: I hope you signaled first17:04
*** otter768 has joined #openstack-infra17:05
asselinanteaya, I did...see scrollback w/ me an d fungi17:05
*** _nadya_ has quit IRC17:05
*** maishsk_afk is now known as maishsk17:06
*** sabeen3 has joined #openstack-infra17:06
*** gokrokve has joined #openstack-infra17:06
*** sabeen1 has quit IRC17:07
anteayaasselin: :)17:07
anteayawas making a lame driving joke17:07
*** teran_ has quit IRC17:07
asselinlol....missed that :p17:08
*** Zhongjun has quit IRC17:08
fungithough that reminds me, the "no rebase" road signs signs i saw in the dominican republic would go quite nicely with "merge" road signs common in english-speaking countries17:09
*** mpaolino_ has quit IRC17:09
*** otter768 has quit IRC17:09
*** puranamr has joined #openstack-infra17:10
*** sergmelikyan has quit IRC17:10
*** e0ne has quit IRC17:11
anteayafungi: ha ha ha17:12
*** crc32 has joined #openstack-infra17:13
*** crc32 is now known as crc32_lundh17:14
*** crc32_lundh is now known as crc32_lunch17:14
openstackgerritMerged openstack-infra/project-config: Restrict some dangerous permissions on ironic-inspector  https://review.openstack.org/19800817:17
anteayaI'm out for a bit, have to get my hair did and then view a good friend's return to art17:18
anteayasee you tomorrow17:18
*** ddieterly has joined #openstack-infra17:18
AJaeger_anteaya: have fun!17:19
*** jasondotstar is now known as jasondotstar|afk17:19
*** fitoduarte has joined #openstack-infra17:21
openstackgerritMerged openstack-infra/jenkins-job-builder: Validate the use of `[]` as an `scm` value  https://review.openstack.org/19360117:22
*** BharatK has joined #openstack-infra17:23
*** cdent has quit IRC17:26
openstackgerritMerged openstack-infra/project-config: Have irc-meetings-publish also publish directories  https://review.openstack.org/19448817:28
*** bhunter71 has joined #openstack-infra17:28
*** HeOS has quit IRC17:29
*** bswartz has joined #openstack-infra17:29
*** eharney has quit IRC17:29
*** SumitNaiksatam has quit IRC17:30
*** jsavak has quit IRC17:31
*** jsavak has joined #openstack-infra17:31
*** achanda has quit IRC17:33
*** kiran-r has quit IRC17:36
*** ashleighfarnham has quit IRC17:36
*** bdemers_ has joined #openstack-infra17:37
*** maishsk has quit IRC17:37
*** bdemers has quit IRC17:39
*** ashleighfarnham has joined #openstack-infra17:39
*** ashleighfarnham has quit IRC17:39
*** ashleighfarnham has joined #openstack-infra17:39
*** fhubik has quit IRC17:40
fricklerclarkb: so what do you think about the iptables patch now? I could also give you ssh access to a test instance if you want to look further. but after going through the checks again with you earlier, I'm quite convinced that the patch is correct17:42
openstackgerritClint 'SpamapS' Byrum proposed openstack/requirements: Ironicclient minimum is too low for nova virt  https://review.openstack.org/19807217:43
*** maishsk_afk has joined #openstack-infra17:43
*** maishsk_afk is now known as maishsk17:44
*** bdemers_ has quit IRC17:44
*** jasondotstar|afk has quit IRC17:45
*** eharney has joined #openstack-infra17:45
*** bdemers has joined #openstack-infra17:46
*** mwagner_lap has joined #openstack-infra17:47
*** yamamoto has quit IRC17:49
*** Guest41856 has joined #openstack-infra17:49
*** Guest41856 has quit IRC17:49
fungiAJaeger_: finally got a moment to look at 194488 and i agree i think that's worth trying... it'll probably work17:51
AJaeger_fungi: thanks. Now tonyb needs to approve some change for the IRC meetings ;)17:51
openstackgerritMerged openstack-infra/jenkins-job-builder: Support for image gallery publisher  https://review.openstack.org/17574717:51
fungiwell, once the job updates17:52
*** achanda has joined #openstack-infra17:52
fungihopefully within the hour17:52
*** enikanorov2_ has joined #openstack-infra17:52
*** mpavlase has joined #openstack-infra17:54
clarkbfrickler I think I need to runit on a machien and poke at it, hard to do today17:54
AJaeger_tonyb, fungi: there's one pending change for that repo: https://review.openstack.org/#/c/197989/ which looks obvious17:54
*** enikanorov2 has quit IRC17:55
openstackgerritClint 'SpamapS' Byrum proposed openstack/requirements: Ironicclient minimum is too low for nova virt  https://review.openstack.org/19807217:56
*** tonytan4ever has joined #openstack-infra17:56
*** enikanorov2_ has quit IRC17:57
*** fawadkhaliq has quit IRC17:58
fungii've got my clean centos 7 vm updating with prepare_node_devstack.sh to see what, if anything, is dragging in requests from pypi17:59
*** enikanorov2 has joined #openstack-infra18:01
*** mayurig has quit IRC18:02
*** mayurig has joined #openstack-infra18:02
fungisomething definitely is. before i started pip list said requests (1.1.0) and now it says requests (2.7.0)18:04
openstackgerritEric Harney proposed openstack-infra/project-config: Add experimental Cinder job for LIO  https://review.openstack.org/19807918:04
*** jsavak has quit IRC18:05
*** jsavak has joined #openstack-infra18:06
*** harlowja_at_home has quit IRC18:06
*** Murad has quit IRC18:06
clarkbfungi check root pip log?18:06
fungican't seem to find one18:07
*** amitgandhinz has joined #openstack-infra18:08
*** amotoki_ has quit IRC18:09
fungii'm going to blow this one away and try to see if i can narrow it down with a pip list comparison (didn't think to grab a full one before the update)18:09
fungiclarkb: i think i found it18:12
*** puranamr has quit IRC18:12
fungiclarkb: yep, definite. we globally install git-review and its latest release added requests as a requirement18:13
*** puranamr has joined #openstack-infra18:13
clarkband it doesnt see the system version as sufficient?18:14
*** jsavak has quit IRC18:14
greghaynesheh18:14
*** jsavak has joined #openstack-infra18:14
fungioh, it should18:14
fungirequests>=1.1 would be satisfied by 1.1.0 which is installed from rpm18:15
* asselin upgraded one ci system to common-zuul so far so good.18:15
fungithough also we should probably start using it from a virtualenv18:15
fungiclarkb: the other candidates are tox and virtualenv. i doubt they depend on requests18:16
clarkbya18:16
fungithe only additions to pip list are git-review, javapackages, lxml, netaddr, pluggy, py, tox, virtualenv and wheel18:17
*** notnownikki has quit IRC18:18
fungiwsgiref is removed, requests and setuptools are upgraded18:18
*** achanda has quit IRC18:18
*** VivCheri has quit IRC18:19
fungimaybe we pip install -U git-review somewhere18:20
*** BharatK has quit IRC18:20
mordredgit-review uses requests18:20
mordredyah18:21
mordredhrm18:21
fungias of 1.24 it does (we switched our job workers from installing 1.17 to 1.25.0 earlier this week)18:21
fungiwe could undo that, but i think we should be able to solve it in better ways18:22
*** jsavak has quit IRC18:22
fungiwe're installing it with the puppet pip provider. does that unconditionally pip install -U maybe?18:23
fungigah18:25
fungiwhen :latest18:25
fungiargs << "--upgrade" << @resource[:name]18:25
*** rlandy has quit IRC18:26
clarkbaha!18:26
*** rlandy has joined #openstack-infra18:27
mordredthat would be it18:28
* asselin upgraded 2nd ci system to common-zuul. so far so good18:28
*** earlephilhower has quit IRC18:28
*** ddieterly has quit IRC18:29
*** ddieterly has joined #openstack-infra18:29
openstackgerritJeremy Stanley proposed openstack-infra/puppet-jenkins: Pin specific git-review version instead of latest  https://review.openstack.org/19808218:30
fungiclarkb: mordred: ianw: EmilienM: crinkle: ^18:30
*** r-daneel has quit IRC18:32
*** puranamr_ has joined #openstack-infra18:33
greghayneswow18:34
greghaynesthat is an annoying issue18:34
*** wuhg has quit IRC18:34
clarkb+218:34
*** packet has joined #openstack-infra18:34
fungigreghaynes: part of it is that (afaik) there's no pip option for --upgrade-this-thing-but-not-the-things-it-wants-unless-you-have-to18:35
greghaynesdoes --nodeps not work for -U?18:35
greghaynesyea18:35
*** gokrokve has quit IRC18:35
fungimebbe?18:35
fungiexcept --nodeps would turn it into a multi-step process i think18:35
fungibecause you wouldn't want --nodeps on initial installation18:36
*** rossella_s has quit IRC18:36
*** puranamr has quit IRC18:37
*** rossella_s has joined #openstack-infra18:37
greghaynesah, right18:37
greghaynesfun!18:37
*** yamahata has quit IRC18:38
openstackgerritMerged openstack/requirements: tooz 0.16.0 or better required  https://review.openstack.org/19702118:38
*** cathy__ has joined #openstack-infra18:39
*** Longgeek has quit IRC18:43
*** Longgeek has joined #openstack-infra18:43
openstackgerritRob Cresswell proposed openstack-infra/project-config: Add project for Cisco UI (Horizon plugin)  https://review.openstack.org/19608718:45
*** e0ne has joined #openstack-infra18:46
*** julim has quit IRC18:47
openstackgerritEric Harney proposed openstack-infra/project-config: Add experimental Cinder job for LIO  https://review.openstack.org/19807918:47
crinklenibalizer: https://review.openstack.org/#/c/197377/ and https://review.openstack.org/#/c/190839/18:48
*** Sukhdev has joined #openstack-infra18:48
*** yamamoto has joined #openstack-infra18:49
*** r-daneel has joined #openstack-infra18:49
*** dannywilson has joined #openstack-infra18:50
*** austin81 has quit IRC18:50
*** tqtran has joined #openstack-infra18:52
*** ZZelle_ has joined #openstack-infra18:52
*** jsavak has joined #openstack-infra18:53
*** yamamoto has quit IRC18:54
*** Longgeek has quit IRC18:54
*** sabeen3 has left #openstack-infra18:55
*** dannywilson has quit IRC18:56
*** sabeen1 has joined #openstack-infra18:56
*** dannywilson has joined #openstack-infra18:56
*** dangers is now known as dangers_away18:58
*** SumitNaiksatam has joined #openstack-infra18:58
*** sdake_ has joined #openstack-infra18:58
*** dangers_away has quit IRC18:58
cathy__AJaeger_: Hi Andreas, I have a question regarding the networking-SFC project of Neutron. Now the spec has been iterated many versions to incorporate people's comments and the project team have given +1 for the spec to be merged, what's next step for the spec to be merged? Do we need two core members of this project to give +2 for it to be merged? Or we need the Neutron core members to give it +2 to be merged?19:00
*** dangers_away has joined #openstack-infra19:00
*** sdake has quit IRC19:00
*** sdake has joined #openstack-infra19:01
*** marcusvrn has joined #openstack-infra19:02
pleia2cathy__: do you have a link to the spec?19:02
*** Longgeek has joined #openstack-infra19:02
*** jtomasek has joined #openstack-infra19:02
lifelessfungi: clarkb: https://review.openstack.org/#/c/194886/19:03
lifelessare we ready to pull the trigger ?19:03
cathy__pleia2: https://review.openstack.org/#/c/192933/519:03
clarkblifeless: do we have the jobs in place to automatically propose constraints updates?19:04
*** sdake_ has quit IRC19:04
*** jsavak has quit IRC19:04
clarkblifeless: I would prefer we had that running before we used them (to avoid things going stale without a good way for updates in the interim)19:04
pleia2cathy__: hm, that's not in a specs project, so I'm not sure how it works, sorry19:04
*** mkam has joined #openstack-infra19:04
*** jsavak has joined #openstack-infra19:05
lifelessclarkb: yes http://logs.openstack.org/periodic/propose-requirements-constraints-master/1eae765/console.html19:05
clarkbthough I suppose updating that file manually isn't very different than updating global reqs manually today19:05
lifelessclarkb: fungi has patches up to fix it I believe19:05
lifelessclarkb: and yes, we can always do it manually19:05
dimtruckgood afternoon everyone, curious if anyone's had any issues with oslo_messaging/kumbu not picking up messages?  We ran performance tests after upgrading to 1.15 and we're seeing ~20% of our messages just sitting in RabbitMQ without getting picked up.19:05
clarkblifeless: +2 from me19:05
*** otter768 has joined #openstack-infra19:06
clarkboh wait hrm19:06
asselinfungi, I updated all 5 of my ci systems to common zuul...no issues found.19:06
dimtruckwe re-ran our tests against an older veresion of oslo and could not reproduce these issues...19:06
clarkblifeless: is USE_CONSTRAINS expected to be passed through to devstack? doesnt' that reuqire a localrc update too?19:06
pleia2cathy__: for a neutron spec I'd expect it to be in the neutron-specs project, not the documentation for networking-sfc, but they could be doing something I'm not familiar with in that project19:06
*** devkulkarni has joined #openstack-infra19:06
openstackgerritSpencer Krum proposed openstack-infra/project-config: Create a puppet module for os_client_config  https://review.openstack.org/18889519:06
lifelesshuh, it should be USE_CONSTRAINTS19:06
dimtruckon a related note, anyone have any ideas on how to debug these issues? :)19:06
lifelesslet me check I didn't typoe19:06
clarkblifeless: we should double check constraints were used by those jobs with the change19:06
clarkblifeless: well even then I think we have to write it to localrc19:06
lifelessclarkb: no its used19:06
fungiasselin: that's excellent news. what was our next step there?19:07
clarkbhow, we use sudo which sanitizes the env that devstack runs in19:07
clarkbso everthing has to be explicitly passed through via localrc19:07
*** tbarron is now known as tbarron_afk19:07
lifelessclarkb: look at the history of failed jobs19:07
lifelessclarkb: or the trace fo the passed ones19:07
lifelessclarkb: its clearly unambiguously using it19:07
clarkblifeless: that was when it was called requirements mode19:07
clarkblifeless: which likely is set in localrc properly19:08
asselinfungi, i'm submit a patch to the system config change to addreess jhesketh's comment19:08
cathy__pleia2: not sure what you mean by a spec project. It is a project adopted by Neutron. Here is the repo creation link https://review.openstack.org/#/c/192820/19:08
clarkblifeless: https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n183 so you need to update that line too I think19:08
lifelessclarkb: http://logs.openstack.org/86/194886/4/check/check-tempest-dsvm-full/19a371a/logs/devstacklog.txt.gz#_2015-07-02_04_18_44_78219:08
lifelessclarkb: ^ thats from the latest pass showing it being used19:08
pleia2cathy__: this is the specs project for neutron: https://git.openstack.org/cgit/openstack/neutron-specs as I understand it, specs are supposed to go there19:09
*** mrmartin has joined #openstack-infra19:09
fungiclarkb: lifeless: it looks like we don't have zuul-cloner available on the proposal worker (yet). fixing that next :( http://logs.openstack.org/periodic/propose-requirements-constraints-master/689fc29/console.html#_2015-07-02_06_06_45_22119:10
*** HeOS has joined #openstack-infra19:10
pleia2cathy__: your spec is inside the networking-sfc project rather than the neutron-specs project, and I don't know why19:10
cathy__fungi: could you help with my question. Hope you still remember this project creation history19:10
*** otter768 has quit IRC19:10
cathy__pleia2: Neutron core member Armando put it in that repo. It seems to be positioned as big tent of Neutron19:11
lifelessclarkb: uhm, looking closer19:11
openstackgerritRamy Asselin proposed openstack-infra/system-config: Use openstackci module for zuul_merger zuul_prod and zuul_dev  https://review.openstack.org/17601019:11
lifelessclarkb: you're right, fixing19:11
pleia2cathy__: ok, it's just unusual so I don't know the process19:11
fungidimtruck: can you clarify how your question relates to management of our project community infrastructure?19:12
clarkblifeless: ya looking at devstack the test is if REQUIREMENTS_DIR is set19:12
fungidimtruck: i'm having trouble achieving context19:12
dimtruckfungi: that's fair19:12
clarkblifeless: in order toget the line you linked to execute and isn't checking USE_CONSTRAINS19:12
fungidimtruck: seems like maybe a question for the #openstack-oslo channel19:12
asselinfungi, we'll need reviews on ^^, then we can merge once everyone is happy19:12
dimtrucka little context: one of openstack projects (solum) uses rabbitmq...great!19:12
dimtrucki'm going there :)19:12
cathy__pleia2: OK, thanks anyway19:12
dimtruckthanks fungi!19:12
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman  https://review.openstack.org/19772219:13
lifelessclarkb: is devstack-gate branched19:14
clarkblifeless: no19:14
lifelessclarkb: like, REQUIREMENTS_MODE is still in devstack/kilo19:14
*** Longgeek has quit IRC19:14
clarkbah in that case we need to add not replace19:14
*** marcusvrn_ has joined #openstack-infra19:14
lifelessyep19:14
lifelesslet me go and do that19:14
clarkbkk19:14
fungicathy__: i don't really know the relevance of that spec. the project infrastructure team doesn't set spec policies for openstack project-teams. this seems like something you should work out with the other members of https://review.openstack.org/#/admin/groups/968,members19:14
fungidimtruck: right, i think you're misunderstanding what the project community infrastructure is. we run the code review server, the wiki server, the mailing list server, et cetera. we're not the ones developing or running openstack itself (in most cases anyway)19:16
dimtrucklol hahaah19:16
*** claudiub has joined #openstack-infra19:16
dimtruckyeah, you're my first stop on "i have no idea what's going on, let me ask someone :) "19:16
*** shardy has quit IRC19:16
dimtruckfungi: ^ so i appreciate your help :)19:16
*** shardy has joined #openstack-infra19:17
*** cathy__ has quit IRC19:17
*** john-davidge has quit IRC19:17
*** marcusvrn has quit IRC19:17
*** marcusvrn_ is now known as marcusvrn19:17
fungidimtruck: no problem. sorry i couldn't be more help19:17
dimtruckyou were more than enough help!  you got me to the right people :)19:17
openstackgerritlifeless proposed openstack-infra/devstack-gate: Switch to using constraints files.  https://review.openstack.org/19488619:17
lifelessthere19:17
openstackgerritSpencer Krum proposed openstack-infra/project-config: Test that the mdoules.env file in infra is sorted  https://review.openstack.org/19124719:18
clarkblifeless: Saturday is Wild Freedom (TM) day in this country, clearly we need to toggle that flag for 24 hours :)19:19
clarkblifeless: +2 on latest patchset, hopefully jenkins agrees with me19:19
*** tqtran is now known as tqtran-afk19:19
mordredclarkb: FREEDOM MURICA!!!!19:19
nibalizerhow would people feel about landing 191245 clarkb fungi mordred ?19:20
*** devkulkarni has quit IRC19:21
fungiasselin: 176010 lgtm19:21
clarkbnibalizer: you need the dep first19:21
clarkbnibalizer: which won't work because its not alpha yet? pretty sure you need to flip that order19:21
nibalizeroh the ordering is wrong19:22
clarkbes19:22
nibalizerderp19:22
clarkbyou have to enforce a thing after you make it that way19:22
fungiagreed. unless you add in a tox.ini stub19:22
clarkbotherwise enforcement first will just break19:22
clarkbthe exception to that is when everything is self gating which this isnt?19:23
fungiyou _can_ merge a dummy tox env that just runs /bin/true or something19:23
openstackgerritSpencer Krum proposed openstack-infra/project-config: Test that the modules.env file in infra is sorted  https://review.openstack.org/19124719:23
fungiand then have the job run that, and then test your proposed tooling/cleanup and self-test it19:23
fungibut for something simple like this i wouldn't bother19:23
clarkbfungi: ah good point19:23
*** hdd has quit IRC19:23
fungioh though in this case you're adding the job non-voting19:24
*** ihrachyshka_ has joined #openstack-infra19:24
fungiso your order works too, except then you need another change to make it voting19:24
fungiso it's the same number of changes either way19:24
*** puranamr_ has quit IRC19:25
fungiexcept that if you do the non-voting->voting route then you have a bit of a race where you can insta-break the repo and need to merge the correction as the next patch19:25
openstackgerritSpencer Krum proposed openstack-infra/system-config: Alpha-sort modules.env  https://review.openstack.org/19124519:25
nibalizerokay I believe I have fixed the ordering19:25
*** rbrooker has joined #openstack-infra19:25
*** teran has quit IRC19:26
openstackgerritAdam Harwell proposed openstack-infra/project-config: Octavia: enable a voting py34 gate on master  https://review.openstack.org/19773219:27
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Bring in module to manage update-alternatives  https://review.openstack.org/17155619:28
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add puppet-community/archive module  https://review.openstack.org/16456919:29
openstackgerritMerged openstack-infra/puppet-jenkins: Pin specific git-review version instead of latest  https://review.openstack.org/19808219:29
*** rm_work|away is now known as rm_work19:29
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Load in nanliu/git module  https://review.openstack.org/16435519:29
funginibalizer: needed to rebase those that were depending on the one you modified for its depends-on19:30
jeblairfungi, clarkb: hi, i'm in an airport but i have a bit of time; i saw you wated to get my eyes on a patch but i didn't find which19:30
*** jsavak has quit IRC19:30
nibalizerfungi: cool19:31
fungijeblair: 17720119:31
jeblairthx19:31
jeblairgood, this will probably eat up the whole 2 hours :)19:31
fungiheh19:31
openstackgerritMerged openstack-infra/jenkins-job-builder: Adding unittest to ownership property  https://review.openstack.org/17853319:31
*** jsavak has joined #openstack-infra19:32
crinklejeblair: if you find additional time https://review.openstack.org/#/c/197377 has been updated to avoid redundant git cloning19:32
*** puranamr has joined #openstack-infra19:32
openstackgerritKhai Do proposed openstack-infra/jenkins-job-builder: Update xml-summary publisher  https://review.openstack.org/19171919:35
rm_workAJaeger_: thanks for the pointer, can't believe i missed that somehow -- must have blended in with all the other name: python3-jobs in my grep19:35
rm_workAJaeger_: now I just feel like I wasted a ton of time yesterday >_<19:35
*** austin81 has joined #openstack-infra19:36
openstackgerritK Jonathan Harker proposed openstack-infra/puppet-elasticsearch: Analyze the build_node field  https://review.openstack.org/19810819:39
*** austin81 has left #openstack-infra19:39
asselin jeblair can you review 176010?  not too different from your last +2. clarkb?  fungi said he can merge it today19:40
openstackgerritTimothy R. Chavez proposed openstack-infra/zuul: Add uuid to the launch log record  https://review.openstack.org/19810919:40
fungiyeah, i'm fine babysitting it and reverting if it wreaks unanticipated havoc19:41
fungihavoc19:41
fungii like that word19:41
timrcjeblair, fungi Very curious to know what you think of https://review.openstack.org/#/c/198109/19:41
*** mkam has left #openstack-infra19:43
*** jtomasek has quit IRC19:44
openstackgerritMerged openstack-infra/jenkins-job-builder: Update xml-summary publisher  https://review.openstack.org/19171919:45
fungitimrc: seems useful enough19:45
openstackgerritFatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add Disable Failed Job Plugin support  https://review.openstack.org/19272019:45
openstackgerritFatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add Google Cloud Storage Plugin support  https://review.openstack.org/19239719:47
*** igor___ has joined #openstack-infra19:48
crinklefungi: looks like 198082 merged, have you fired up/could you fire up those image updates?19:48
*** yamahata has joined #openstack-infra19:48
fungicrinkle: i already started them about 20 minutes ago and am babysitting them as they run19:49
*** ociuhandu has quit IRC19:49
crinklefungi: awesome thank you so much19:49
greghaynesclarkb: either I can write perfect multithreaded code on the first try or we have no tests for dib image deletes19:49
greghaynesclarkb: and one of those is two things is a lot more likely19:49
*** jasondotstar|afk has joined #openstack-infra19:49
fungicrinkle: you're welcome--just glad we collectively worked out what the bug was19:49
fungi(well, hopefully anyway)19:49
greghayneser, one of those two things is a lot more19:50
* crinkle crosses fingers19:50
clarkbgreghaynes: I don't think deletes are tested anywhere :/19:50
greghaynes\O/19:50
clarkbwell maybe thats not true, I think that was one of the areas we recently added testing for? I would have to dig thoruhg code and coverage reports19:50
greghaynesoh, we have coverage reports dont we19:51
clarkbyup in your check test results19:51
mtreinishclarkb: are they on by default? I thought there was a separate job config for coverage19:52
mtreinishor do you just have them always on for that project19:52
clarkbmtreinish: it is separate and we have it on for nodepool19:52
mtreinishah ok19:52
greghaynesclarkb: wah? https://review.openstack.org/#/c/197722/ coverage failed?19:52
*** DericHorn-HP has quit IRC19:53
clarkblooks like it, probably a timeing issue since coverage slows everything down19:53
greghaynesI guess that could be a racey test or something...19:53
greghaynesoh19:53
greghaynesfun19:53
crinklemordred: have a second to talk about https://review.openstack.org/#/c/175231 ?19:54
*** mtanino has quit IRC19:54
mordredcrinkle: sure!19:55
*** e0ne has quit IRC19:55
crinklemordred: do you have opinions on my comments on 175231?19:55
mordredI agree with the comment about the version19:56
mordredthe script is just a helper script for dumb people who do not grok how puppet gems work :)19:56
*** tqtran-afk is now known as tqtran19:56
mordredso, it doesn't _have_ to go there19:56
crinklemordred: in the interest of "do things the way the OpenStack Puppet Modules are doing it" i would leave it out19:57
mordredbut the GEM_HOME thing and the bundle install thing were things I didn't know before19:57
*** abregman has joined #openstack-infra19:57
mordredkk19:57
mordredI don't feel strongly about it19:57
crinklemordred: mind if i take over that patch and do similar for the other modules?19:57
*** tbarron_afk is now known as tbarron19:57
mordredcrinkle: please do!19:57
crinklemordred: cool19:57
fungigreghaynes: mordred: looks like we got an ubuntu-trusty image uploaded to rax-iad, ready as of ~5 minutes ag019:57
fungiago19:57
*** claudiub|2 has joined #openstack-infra19:58
mordredfungi: WOOT!!!!!!!!19:58
greghaynesfungi: WHOA19:58
* greghaynes drops the baloons19:58
funginone (yet anyway) for dfw or ord19:58
*** derekh has joined #openstack-infra19:58
fungibut might be network issues or quota problems or other trivia19:58
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman  https://review.openstack.org/19811419:58
*** claudiub has quit IRC19:59
*** marcusvrn1 has joined #openstack-infra19:59
fungigreghaynes: mordred: one of them at least died on...20:00
fungiOpenStackCloudException: Failed at action (upload_segment) [put_object('images_segments', 'ubuntu-trusty-1435859640.template.openstack.org/1435857735.528897/14364160512/1073741824/00000005', ...) failure and no ability to reset contents for reupload.]20:00
fungiyep, both dfw and ord hit that20:00
fungibut iad worked20:01
openstackgerritMerged openstack-infra/jenkins-job-builder: Update 'timeout' wrapper module  https://review.openstack.org/12946720:01
*** packet has quit IRC20:01
greghayneshrm20:01
fungineed a full traceback from that?20:02
openstackgerritColleen Murphy proposed openstack-infra/puppet-puppet: Add Gemfile and puppet 4 checks  https://review.openstack.org/17523120:02
greghaynesyep, thatd be more helpful20:02
fungiit's getting raised inside shade.create_object()20:02
fungicoming up20:02
greghaynesim guessing its a swiftlient getting some non success code20:02
mordredgreghaynes: we may want to put in some retries20:03
openstackgerritMerged openstack/diskimage-builder: Document only exectuables in phase dirs policy  https://review.openstack.org/19229220:03
greghaynesyep, that was on the todo, I think we pushed it back just because it is a bit of complexity with the parts list20:03
mordred++20:03
fungigreghaynes: mordred: http://paste.openstack.org/show/336261/20:04
mordredI get the sense that we'll EVENTUALLY get working things20:04
*** timrc_ has joined #openstack-infra20:04
TheJuliagreghaynes: figured it out.... my physical machine's ethernet interface takes ~1.25-1.5 seconds to go to carrier up.  https://github.com/openstack-infra/glean/blob/master/glean/cmd.py#L24020:04
*** jsavak has quit IRC20:05
*** jsavak has joined #openstack-infra20:05
greghaynesTheJulia: haha20:06
fungiTheJulia: set spantree portfast for the win!20:07
TheJuliafungi: it is already set :(20:07
fungithat's why it's not _30_ seconds ;)20:07
mtreinishTheJulia: heh, then you need to buy faster hardware :)20:07
greghaynesTheJulia: gotta love sleeps20:07
mordredTheJulia: oh - and we pick which interfaces to configure based on carrier up status20:08
mordredTheJulia: are you doing static ip or dhcp?20:08
mordredbecause the argument could be made that if you pass in static config we should write out the config regardless of carrier ...20:09
*** marcusvrn1 has quit IRC20:09
clarkbfungi: now we wait for a ready node?20:09
fungiclarkb: well, the problem is we already had working uploads to hpcloud, so we have plenty. i could mangle the nodepool.yaml to blacklist those and then delete them all to prompt one to pop in rax20:10
*** amitgandhinz has quit IRC20:11
fungioh, we had it working in rax iad yesterday i guess?20:11
fungiwe have a ready node there for the past 23 hours20:11
openstackgerritTimothy R. Chavez proposed openstack-infra/zuul: Add uuid to the launch log record  https://review.openstack.org/19810920:11
clarkboh nice20:11
fungi162.209.103.18720:11
*** boris-42 has quit IRC20:12
TheJuliamordred: both in this case, but primarilly just goofing off with the the second ethernet cable being connected.  I can see the first case, I can also see the argument to extend the carrier polling to be a little bit longer.20:12
*** rlandy has quit IRC20:13
*** rlandy has joined #openstack-infra20:14
*** Longgeek has joined #openstack-infra20:14
*** e0ne has joined #openstack-infra20:15
*** teran has joined #openstack-infra20:15
*** ayoung has quit IRC20:15
timrc_fungi,  I apparently fail at pep8 :)20:16
timrc_I should probably not ignore those errors when vim tells me about them.20:16
*** hogepodge has quit IRC20:17
*** hodos has joined #openstack-infra20:17
fungitimrc_: push 'em all and let the ci sort 'em out20:18
*** kgiusti has quit IRC20:18
*** hogepodge has joined #openstack-infra20:18
*** mtanino has joined #openstack-infra20:18
*** thorst has quit IRC20:22
*** jasondotstar|afk has quit IRC20:22
*** baoli has quit IRC20:23
*** notnownikki has joined #openstack-infra20:27
Davieyfungi: Pushing up a new commit per line is OK?  Can I get vim to get Verified pep8 status back from gerrit?20:27
fungiDaviey: as long as you're okay with the latency that implies ;)20:28
openstackgerritJustin Shepherd proposed openstack-infra/project-config: Adding doc gate jobs for openstack/defcore  https://review.openstack.org/18995620:28
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Switch constraints proposal to use branch-git-prep  https://review.openstack.org/19812020:28
fungilifeless: clarkb: ^ addresses the current error on the periodic constraints proposal jobs20:29
Davieyfungi: I used to be able to catch up on /.,reddit,etc whilst code was compiling, since using interpreted code i lost that excuse.  This reinvents that excuse. :)20:29
*** yfried__ has joined #openstack-infra20:29
fungiDaviey: yes, https://xkcd.com/303/20:29
fungii think at the last summit some group had tee shirts where they'd modified that comic to s/my code's compiling/the ci is testing my code/20:30
fungior something along those lines20:30
DavieyNice. :)20:31
openstackgerritJustin Shepherd proposed openstack-infra/system-config: Adding statusbot to the openstack-defcore channel  https://review.openstack.org/18855120:31
openstackgerritJulia Kreger proposed openstack-infra/glean: Wait longer for interface carrier to come up  https://review.openstack.org/19812120:31
*** puranamr has quit IRC20:31
asselinnibalizer, I'll update that patch20:33
*** whoops has joined #openstack-infra20:34
*** jasondotstar|afk has joined #openstack-infra20:34
*** jsavak has quit IRC20:35
*** maishsk_afk has joined #openstack-infra20:35
*** maishsk has quit IRC20:36
nibalizerasselin: cool20:37
*** reed has quit IRC20:37
*** reed_ is now known as reed20:37
*** reed has quit IRC20:38
*** reed has joined #openstack-infra20:38
*** reed_ has joined #openstack-infra20:38
*** tonytan4ever has quit IRC20:38
*** puranamr has joined #openstack-infra20:38
*** abregman is now known as abregman|afk20:38
*** dprince has quit IRC20:40
fungimtreinish: looks like we both thought of setuptools extras, but you win by having an actual example in one of your projects already ;)20:41
mtreinishfungi: heh, fwiw I only discovered using it after I killed a nodepool image build by introducing matplotlib to the requirements file20:42
fungiouch20:42
mtreinishturns out it needs libfreetype and libpng to install, neither of which was installed on the images20:42
mtreinishfungi: also it's your project too :) you have +2 on it, even if you've never pushed a patch20:43
mtreinishit also wouldn't be running without your help :)20:43
fungimtreinish: too true20:43
fungii more meant that you had an already implemented example with one of our pbr-based projects20:44
mtreinishheh, fair enough. I'm just giving you a hard time because it's towards the end of the day before a long weekend20:44
fungifeels like extras with some sort of compounding support would be a good flexible alternative to test_requires20:45
mtreinishyeah, I could definitely see that happening20:46
fungieven extending tox to be able to match env names to extras so that it would just automatically preinstall anything you specified in the corresponding extras set20:46
openstackgerritRamy Asselin proposed openstack-infra/system-config: Use openstackci module for zuul_merger zuul_prod and zuul_dev  https://review.openstack.org/17601020:48
*** Sukhdev has quit IRC20:48
asselinnibalizer, ^^ much simpler yhanks20:48
asselinthnks*20:48
lifelessfungi: eek @ tox there20:49
lifelessmtreinish: you're using extras in subunit2sql ? cool20:49
fungilifeless: yeah, that might be sort of a spooky interaction too far20:50
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Point out that non-voting jobs are skipped in the readme  https://review.openstack.org/19812720:50
lifelessfungi: if the extra was namespaced20:50
lifelessfungi: tox.py3420:50
lifelessfungi: I'd be ok with that20:50
lifelessfungi: but its a freeform field with no standards out there today20:50
*** derekh has quit IRC20:51
lifelessor slightly less coupled20:51
lifelesstestenv.thing20:51
fungiEmilienM: crinkle: image updates are done and there are no remaining nodes launched from the old ones, so you should be set to retry your centos 7 jobs20:51
ianwfungi: cool, it's nice to wake up to a solution rather than a problem :)20:52
asselinquestion about setting porject-config 'base', e.g. https://github.com/openstack-infra/project-config/tree/master/dev. Does it inherrit all other properties for folders not present?20:52
*** maxandersen has joined #openstack-infra20:52
*** maxandersen has joined #openstack-infra20:52
openstackgerritSergey Lukjanov proposed openstack-infra/project-config: Use in-tree devstack plugin to fix saharaclient tests  https://review.openstack.org/19812920:52
fungiEmilienM: crinkle: clarkb: nibalizer: as anticipated, switching from ensure=>'latest' to ensure=>'specific version number' caused teh requests version to remain unmolested20:52
fungiso yay puppet pip package provider unexpected side effect20:53
fungiianw: yeah, i wish i could do that more often :/20:53
SergeyLukjanovfungi, jeblair please, take a look at https://review.openstack.org/198129 it's needed to unblock sahara client CI20:54
*** maxandersen has quit IRC20:54
openstackgerritSergey Lukjanov proposed openstack-infra/project-config: Use in-tree devstack plugin to fix saharaclient tests  https://review.openstack.org/19812920:55
*** maxandersen has joined #openstack-infra20:56
*** maxandersen has joined #openstack-infra20:56
*** Sukhdev has joined #openstack-infra20:56
*** DericHorn-HP has joined #openstack-infra20:56
*** maishsk_afk is now known as maishsk20:57
ianwfungi: https://jenkins07.openstack.org/job/gate-puppet-neutron-puppet-beaker-rspec-upgrade-dsvm-centos7/9/console <- job running now20:57
fungiianw: looks like it got past where it was breaking before20:59
*** dboik has quit IRC21:00
crinkle\o/21:00
tonybfungi, clarkb, AJaeger_, jhesketh: Thanks for the fixes to 19448821:01
SergeyLukjanovfungi, thx!21:01
openstackgerritMerged openstack-infra/project-config: Pre-cache distro packages from bindep lists  https://review.openstack.org/19518721:02
*** rfolco has quit IRC21:02
*** tvanderwiel_ has joined #openstack-infra21:03
*** shashank_hegde has quit IRC21:03
*** ari has quit IRC21:04
krotscheckSo, regarding pypi-both-upload, I know that someone with release rights pushes a tag, and then the release job takes over, however I'm not certain where we authenticate against pypi, or, for that matter, keep the credentials. If I needed to have an openstack user configure, with username, email, password, etc, that could log into npm, where would that need to live?21:04
*** aysyd has quit IRC21:05
*** tvanderwiel_ has quit IRC21:05
fungikrotscheck: we install the credentials onto a long-lived trusted job worker with http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/pypi_slave.pp21:06
*** tvanderwiel has quit IRC21:06
krotscheckfungi: Ah-hah.21:06
fungikrotscheck: the credentials themselves are kept in a private hiera on our puppetmaster21:06
fungiand then puppet splices them in21:06
*** otter768 has joined #openstack-infra21:07
krotscheckfungi: So for me to publish anything to npm, I would either need a similar worker, or bootstrap on top of that one.21:07
fungikrotscheck: yeah, we could likely just reuse this same worker. it's a bit misnamed since it also uploads to puppetforge and maven-central now21:07
fungineither of which are in any way pypi21:07
krotscheckfungi: Might as well reuse it then.21:07
krotscheckNow all I have to do is figure out how to dynamically generate this auth key :/21:08
ianwfungi EmilienM :  Finished: SUCCESS \o/21:08
*** Rockyg has joined #openstack-infra21:08
fungikrotscheck: oh, and we also upload to jenkins-ci with it as well, looks like21:08
*** DericHorn-HP has quit IRC21:08
*** annegentle has quit IRC21:08
krotscheckfungi: What about the user itself, who performs the clicky-through-register-boxes?21:09
mordredkrotscheck: it's actually probably easiest to get an infra root to go clicky-clicky to make a new user21:10
jeblairfungi: reviewing that change did not take the full 2 hours!  it only took 1:40!21:10
krotscheckmordred: Figured as much21:10
jeblairfungi, clarkb: you may want to see my comment on https://review.openstack.org/17720121:10
mordredkrotscheck: that way they can just generate a passphrase and put it in hiera - I'm not sure what package registration and acls look like though21:10
fungikrotscheck: generally one of infra-root, yes. if you have some good instructions you can point us at, i'm happy to struggle through that part and ask you stupid questions while i do so21:11
mordredkrotscheck: with pypi, anybody can create a new pacakge in pypi and then grant access to openstackci to the project21:11
*** otter768 has quit IRC21:11
*** r-daneel has quit IRC21:11
krotscheckmordred: It's similar in npm. Setup package, update owners.21:11
mordredcool!21:11
fungikrotscheck: the main reason for it is that we need to confirm we're also able to reset it during emergencies, in case we have to refresh potentially compromised account credentials21:11
clarkbcool -1 is for the log thing21:12
*** shashank_hegde has joined #openstack-infra21:13
krotscheckfungi: Righto. I'll probably write a quick spec once I figure out how easy it is. Turs out they don't have a way to generate an auth token without a tty.21:13
mordredkrotscheck: is that a thing that's needed each upload?21:13
krotscheckmordred: No, but it needs to happen in a way that works for puppet, which means headless. The current way of generating that config file is a lot of cli challenge/response21:14
mordredkrotscheck: ah. fascinating21:14
lifelessdims_: ok so I'm finishing the check-requirements backport stuff first21:14
lifelessdims_: then I'm going to look into the devstack branch specifier stuff21:14
lifelessfungi: ^21:15
*** ldnunes has quit IRC21:15
mordredkrotscheck: that's a pattern I've seen repeated several other places, btw - an assumption that clearly a human is going to perform a manual task21:15
mordredeven though there is nothing unautomatable about it21:15
fungikrotscheck: well, if credential generation is a one-time/infrequent thing and then gets stuffed into a config for long-term use, i think one of us manually generating it is acceptable21:15
jeblairwhat a weird thing for programmers to come up with21:15
mordredthat too21:15
fungiyeah, what mordred said21:15
*** austin81 has joined #openstack-infra21:16
krotscheckRight then, I'll dig a little more. The people a travis figured it out, we should be too.21:16
*** jasondotstar|afk has quit IRC21:17
*** tbarron is now known as tbarron_afk21:17
*** bcourt has quit IRC21:19
*** Longgeek has quit IRC21:20
*** ddutta has joined #openstack-infra21:20
*** e0ne has quit IRC21:20
openstackgerritMerged openstack-infra/system-config: Use the cache-bindep element on dib nodes  https://review.openstack.org/19525421:23
*** prad has quit IRC21:24
openstackgerritMerged openstack-infra/zuul: Add uuid to the launch log record  https://review.openstack.org/19810921:24
openstackgerritMerged openstack-infra/zuul: Add uuid to the launch log record  https://review.openstack.org/19810921:24
*** miqui has quit IRC21:25
*** ddieterly has quit IRC21:25
openstackgerritClint Adams proposed openstack-infra/system-config: WIP - reprepro UCA mirror and corresponding override/overlay area  https://review.openstack.org/19813621:27
*** wenlock_ has quit IRC21:31
*** Rockyg has quit IRC21:31
*** DericHorn-HP has joined #openstack-infra21:33
*** shardy has quit IRC21:34
*** wenlock has quit IRC21:34
mtreinishlifeless: heh, you reviewed that subunit2sql patch :)21:35
*** mriedem has quit IRC21:36
openstackgerritMerged openstack-infra/project-config: Use in-tree devstack plugin to fix saharaclient tests  https://review.openstack.org/19812921:36
asselinnibalizer, fungi do you think 176010 is ready for merge now? or wait a bit....certainly don't want to rush, but would like to move on :)21:38
*** sambetts has quit IRC21:39
*** DericHorn-HP has quit IRC21:40
*** soren has quit IRC21:41
*** sambetts has joined #openstack-infra21:42
fungiasselin: looks like you addressed nibalizer's one concern, so i'm good with irt21:43
fungiit21:43
jeblairboarding time21:43
*** maishsk has quit IRC21:44
fungifly true21:45
openstackgerritMarton Kiss proposed openstack-infra/puppet-askbot: Add CSRFViewMiddleware to settings.py  https://review.openstack.org/19814121:46
Clintso how does one go about merging storyboard accounts?21:47
*** puranamr has quit IRC21:47
openstackgerritMerged openstack-infra/system-config: Use openstackci module for zuul_merger zuul_prod and zuul_dev  https://review.openstack.org/17601021:48
*** boris-42 has joined #openstack-infra21:49
openstackgerritMarton Kiss proposed openstack-infra/system-config: Initial commit of ask-staging.o.o site  https://review.openstack.org/17288021:50
*** puranamr has joined #openstack-infra21:50
med_does eavesdrop only get updated at End of Day?21:50
*** michchap has joined #openstack-infra21:50
*** abregman|afk is now known as abregman21:51
*** michchap_ has quit IRC21:51
mrmartinfungi: I found the askbot issue, there was a breaking change in askbot's settings.py. this two patch resolves the issue: https://review.openstack.org/#/c/172880/ and https://review.openstack.org/#/c/198141/21:52
*** claudiub|2 has quit IRC21:52
openstackgerritlifeless proposed openstack/requirements: Update Kilo requirements code  https://review.openstack.org/19814521:54
lifelessmtreinish: oh yeah :)21:54
openstackgerritlifeless proposed openstack/requirements: Update Juno requirements code  https://review.openstack.org/19814621:55
openstackgerritlifeless proposed openstack/requirements: Juno specific fixups:  https://review.openstack.org/19814721:55
lifelessfungi: in the project-requirements-change.py, how should I detect !master21:56
fungimrmartin: yep, i took a look. thanks21:56
lifelessfungi: target branch != master? or will that pick up feature branches too ?21:56
fungilifeless: probably safest to look for a branch that doesn't start with stable/ and then treat everything else as master...21:57
*** derekh has joined #openstack-infra21:57
mrmartinfungi: I did testing in vagrant, and everything seems better now.21:58
fungimrmartin: awesome21:58
*** marzif_ has joined #openstack-infra21:58
lifelessfungi: rather than doing the complex thing tsekiyama did, I'm inclined to just turn of duplicate checking on stable21:58
mrmartinI hope they are not commiting a config-brake change until we apply the staging site21:58
asselinfungi, awesome21:58
lifelessfungi: e.g. pass strict=False when branch.startswith('stable/')21:59
lifelessfungi: thoughts?21:59
fungilifeless: perhaps just turn it off for stable/juno and stable/kilo even, so that stable/liberty is enforced once it exists21:59
lifelessfungi: well its more21:59
lifelessfungi: I don't really care about it on stable21:59
lifelessfungi: like: if pip is unhappy, devstack will bail.21:59
fungilifeless: oh, i see22:00
lifelessfungi: and stable is meant to be backports only22:00
*** crc32_lunch has quit IRC22:00
lifelessfungi: so what do we gain by even thinking about it ?22:00
fungilifeless: okay, so just trust that the backport reviewers won't merge something like that anyway, and if they do it's unlikely to be a problem regardless22:00
fungilifeless: that seems reasonable to me then22:00
lifelessright22:00
fungiand makes it easier for us to get more strict about some things in later releases too22:01
openstackgerritwill soula proposed openstack-infra/jenkins-job-builder: Add support for the Naginator Plugin  https://review.openstack.org/17936622:02
*** Kennan2 has joined #openstack-infra22:03
*** Kennan has quit IRC22:03
*** r-daneel has joined #openstack-infra22:04
openstackgerritlifeless proposed openstack-infra/project-config: Don't apply strict parsing rules to stable branches.  https://review.openstack.org/19815122:04
lifelessfungi: and ^22:05
lifelessnow, to look into the thing dims reported22:05
*** rwsu has quit IRC22:05
*** dimtruck is now known as zz_dimtruck22:06
*** devanand_ has joined #openstack-infra22:06
*** whoops has quit IRC22:06
*** annegentle has joined #openstack-infra22:07
*** mrmartin has quit IRC22:08
*** claudiub has joined #openstack-infra22:09
*** marzif_ has quit IRC22:10
*** cody-somerville has quit IRC22:13
*** vnod has joined #openstack-infra22:14
* nibalizer puzzles on why everything in puppetboard is 'unreported'22:15
nibalizerits like we set our 'unreported time' to zero or something22:15
*** eharney has quit IRC22:15
*** puranamr_ has joined #openstack-infra22:16
mordrednibalizer: it's because it's secretly plotting a coup22:16
funginibalizer: run_all.sh could be stuck on a git remote update again22:17
*** Longgeek has joined #openstack-infra22:17
funginope, not stuck as far as i can tell. fired up a new run at 22:00 right on schedule22:17
nibalizerya I think this is a tunable thing22:17
fungihowever we're often 45-60 minutes between pulses lately22:18
*** chlong has joined #openstack-infra22:18
*** puranamr has quit IRC22:19
*** gordc is now known as gordc_afk22:19
openstackgerritSpencer Krum proposed openstack-infra/system-config: Extend the 'unreported' period to 1.5 hours  https://review.openstack.org/19815422:19
nibalizerThats one idea ^^ I'm open to bike shed the number22:20
*** spzala has quit IRC22:20
mordredfungi: are we 45-60 minutes between pulses because the pulses are taking so long?22:21
mordredfungi: seems we could break that out a bit better perhaps22:21
* mordred puts thinking cap on for later22:21
greghaynesclarkb: so, http://logs.openstack.org/22/197722/5/check/nodepool-coverage/b33227d/console.html#_2015-07-02_19_29_40_771 is really throwing me for a loop22:21
asselinwatching puppetboard, but I guess I have to come back to that in an hour or so....22:21
fungimordred: yep22:21
reedfungi, sorry to bother you: did you apply the new patch https://review.openstack.org/#/c/172880/9 to the running instance?22:21
*** puranamr has joined #openstack-infra22:21
greghaynesclarkb: wondering if you have any ideas22:21
greghaynesclarkb: my best bet is gearman server is dying too early22:22
*** sdake has quit IRC22:22
*** sdake has joined #openstack-infra22:22
fungireed: no, because it's not in the system-config repository so it's not trivial to hack into a dev env. that's why i wanted to just get the change for the new server merged as soon as it no longer had any puppet syntax issues22:22
fungireed: unfortunately it's languished there accumulating new dependencies to shore up a server that doesn't even exist22:23
*** GheRivero has quit IRC22:23
reedfungi, ah, now I understand your comment22:23
*** DericHorn-HP has joined #openstack-infra22:24
reedfungi, you're basically saying 'merge this and if the resulting server doesn't work for any reason not-puppet we'll sort it out later'?22:24
*** annegentle has quit IRC22:24
fungiyeah, having to rereview that same large change over and over doesn't accomplish much. easier to land it in a basically correct state and then fix incrementally with new changes if needed22:24
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add cfacter to puppet3 nodes  https://review.openstack.org/19815622:24
*** puranamr_ has quit IRC22:24
mordredfungi: which thing?22:24
reedfungi, couldn't agree more22:24
*** annegentle has joined #openstack-infra22:24
fungimordred: 17288022:25
*** Longgeek has quit IRC22:25
mordrednibalizer: is cfacter installed as cfacter?22:25
nibalizerya22:25
mordrednibalizer: and in theory it's the same, yeah?22:26
*** sergmelikyan has joined #openstack-infra22:26
nibalizera little different22:26
nibalizerI'm not going to promise its 1:1 on all facts22:26
mordredkk22:26
mordrednibalizer: so - apt-get cfacter does not work ... oh! it's in the puppet repo isn't it?22:27
nibalizeri'm interested in using it as the asnible fact source thing22:27
nibalizersince faster ansible is faster ops22:27
mordrednibalizer: yah22:27
*** ociuhandu has joined #openstack-infra22:27
mordrednibalizer: I was just about to write a patch to ansible to try cfacter first22:27
krotscheckWhat flavor of linux is the pypi slave? Trusty?22:27
mordrednibalizer: unless you want to do that22:27
mordredkrotscheck: precise22:28
mordredkrotscheck: we should probably upgrade it22:28
clarkbgreghaynes: it looks like the builder is ding erly22:28
krotscheckmordred: Oh.22:28
clarkbgreghaynes: the worker I think22:28
krotscheckmordred: Urm.22:28
*** mmedvede has quit IRC22:28
mordredkrotscheck: do you need newer for sanity?22:28
krotscheckmordred: I think that makes me sad.22:28
*** puranamr has quit IRC22:28
nibalizermordred: if you can point me where that would go i'd be excited to try22:28
*** puranamr has joined #openstack-infra22:28
mordrednibalizer: lib/ansible/module_utils/facts.py22:28
clarkbgreghaynes: is your worker immediately gc'ing after you send the complete?22:28
mordrednibalizer:  in ansible/ansible22:28
*** sambetts has quit IRC22:29
greghaynesclarkb: the builder dies whenever you reconfigureGearmanClient22:29
*** sambetts has joined #openstack-infra22:29
krotscheckmordred: Yep. Too old versions of things.22:29
mordrednibalizer: can cfacter output json without extra depends?22:29
greghaynesclarkb: but no, it runs in a loop22:29
mordredkrotscheck: cool. we should make an upgrade then22:29
nibalizermordred: --json22:30
*** annegentle has quit IRC22:30
clarkbgreghaynes: just above it is the exception that causes it to die22:30
*** puranamr_ has joined #openstack-infra22:30
clarkbgreghaynes: is that the bug that was fixed in gear? maybe we need to make a release?22:30
greghaynesclarkb: yea, that is what happens if you call builder.stop() - its a red herring22:30
clarkboh well then its stopping on purpose? I guess I don't get why this is odd then22:31
fungikrotscheck: i did just update the proposal worker from precise to trusty earlier this week, i can probably take a whack at the pypi worker (and maybe pick a better name for it this time)22:31
clarkbgreghaynes: the log you linked to is the server noticing that the worker stopped22:31
greghaynesclarkb: yea, I think its stopping on purpose... what concerns me is all the reconnecting from the client in nodepool that is happening then22:31
mordredfungi: what about larry?22:32
krotscheckfungi: That'd be spectacular. I figured out how to encode the credentials in an .npmrc file, everything from there should be gravy.22:32
greghaynesand the gear.server shutting down22:32
*** GheRivero has joined #openstack-infra22:32
fungimordred: from three's company? he was the best22:32
greghaynesclarkb: if you notice too - that error is all over above22:32
*** sabeen1 has quit IRC22:32
greghaynes DEBUG [gear.Connection.unknown] Error connecting to localhost port 4217122:32
fungikrotscheck: i'll see if i can squeeze that into my schedule for tomorrow22:32
clarkbgreghaynes: I think thats part of normal job stopping22:33
fungimy evening has crept up on me while i was having fun with nodepool22:33
clarkbgreghaynes: all those threads are stopped so that we can assert clean state at the end22:33
*** puranamr has quit IRC22:33
Clintkrotscheck: would you happen to know how one can get storyboard accounts merged?22:33
clarkbassuming this is done like zuul22:33
*** peristeri has left #openstack-infra22:33
*** peristeri has quit IRC22:33
greghaynesclarkb: http://logs.openstack.org/22/197722/5/check/nodepool-coverage/b33227d/console.html#_2015-07-02_19_29_40_66622:33
greghayneshrm, that is way earlier22:34
greghaynesactually, I wonder if theres a race where were not stating the gear server in time then we wait_for_threads22:34
krotscheckClint: It all keys off of openid. If > 1 openID, then >1 accounts.22:34
fungiClint: krotscheck: i'm guessing it's mangle the database to swap around openid urls like we do to fix it in gerrit22:34
*** puranamr_ has quit IRC22:35
*** puranamr has joined #openstack-infra22:35
Clintfungi: and which admin finds that to be supremely rewarding work?22:35
greghaynesand also, the gear.server is up but its on a wrong port22:35
greghayneswtf22:35
krotscheckfungi: I don't remember clearly, but I think there was a 1-N mapping of users-> openids.22:35
*** amuller has joined #openstack-infra22:35
Davieylifeless: Have you seen http://paste.openstack.org/raw/336610/ before?  (tox -e pep8)22:36
clarkbgreghaynes: it should use a random port ya? maybe the random port selection is gettnig streams crossed22:36
amullerHello! Can anyone tell me what project owns the code that uploads log files at the end of a test run? (For example the end of this run: http://logs.openstack.org/08/180408/12/check/check-neutron-dsvm-functional/0a2bd15/console.html.gz)22:36
greghaynesyea...22:36
lifelessDaviey: http://lists.openstack.org/pipermail/openstack-dev/2015-June/068031.html22:36
*** rossella_s has quit IRC22:36
*** briancurtin has quit IRC22:36
fungioh! i have new concerns for diskimage-builder. are the run-parts bits not namespaced?22:37
*** rossella_s has joined #openstack-infra22:37
amullerOK I think the answer to that is "openstack-infra/devstack-gate", nevermind me22:37
*** DericHorn-HP has quit IRC22:37
greghaynesfungi: define namespaced?22:37
Clintlsb-namespaced?22:37
fungigreghaynes: There is a duplicated hook in your elements: cache-devstack/install.d/50-download-pkgs22:37
greghaynesfungi: ah, awesome22:37
greghaynesfungi: yes, that is bad22:37
*** puranamr_ has joined #openstack-infra22:38
greghaynesfungi: they are not namespaced in that way22:38
fungigreghaynes: i have two different elements with a install.d/50-download-pkgs22:38
mordredgreghaynes: I've been thinking for a while that we shoudl name space them22:38
fungigreghaynes: so it's a "don't do that"?22:38
mordredthat has hit me before22:38
mordredfungi: yah22:38
greghaynesOR - we should check22:38
mordredfungi: although I agree - it is a bad experience22:38
greghaynesfungi: yes22:38
mordredgreghaynes: you do check - but the error is still a bit bonghits for composability22:38
greghaynesah, yes, if theres a sane way to namespace I dont object22:39
*** briancurtin has joined #openstack-infra22:39
*** puranamr has quit IRC22:39
greghaynesthats good we check though22:39
fungibecause it seems marginally idiotic that if two independent parties write their own elements, you can't compose them if they haven't had the foresight to reach out to one another and register their work into the worldwide registry of dib element part names22:39
Davieylifeless: Maybe i am being dump, but it complains at python-ldap .. which i do not have installed, in either .tox, deb or via pip?22:39
Davieys/dump/dumb22:39
mordredgreghaynes, fungi: I'll make a patch - I have an idea22:39
*** puranamr has joined #openstack-infra22:40
mordredDaviey: it has detected that you might have thought about installing it22:40
greghaynesmordred: fungi so what will break is the location of scripts is kind of an api weve been prociding22:40
lifelessDaviey: "python-ldap>=2.4;python_version=='2.7'" <- that bit22:40
greghayneselements put stuff in install.d and expect it to be copied to a certain place, for example22:40
lifelessDaviey: is being reflected into setup kwargs22:40
Davieymordred: It worries me that I am not entirely sure if you are kidding! :)22:40
mordredgreghaynes: nod. lemme take a stab at something and see if you like it22:40
lifelessDaviey: newer pbr knows how to handle that better22:40
fungiin the meantime, i'll make sure that the cache-bindep element doesn't share part names with any other element we might ever want to compose it with22:40
*** claudiub has quit IRC22:40
*** sergmelikyan has quit IRC22:41
Davieylifeless: I am running pbr from current pip, is that not recent enough?22:41
lifelessDaviey: not if its being downgraded by something22:41
lifelessDaviey: which is the usual pattern when this occurs22:41
*** dannywilson has quit IRC22:41
*** erlon has quit IRC22:41
*** rhefner has quit IRC22:41
lifelessDaviey: note too22:41
lifelessDaviey: you're using tox right22:42
*** dannywilson has joined #openstack-infra22:42
lifelessDaviey: so that means a new venv is being built22:42
lifelessDaviey: which won't have pbr in it22:42
lifelessDaviey: so easy_install will fire22:42
*** amit213 has quit IRC22:42
lifelessDaviey: and that means if you have a pbr egg, or a .eggs/pbr egg22:42
lifelessDaviey: then easy_install will pick that up22:42
*** camunoz_gone is now known as camunoz22:42
lifelessDaviey: and proceed to blowup22:42
*** puranamr_ has quit IRC22:42
Davieyfml, why is this hard?22:42
lifelessDaviey: oh, also I just looked more closely22:43
lifelessDaviey: this is entirely pip22:43
lifelessDaviey: which means you ahve pip 1.5.x22:43
lifelessDaviey: (probably in your venv)22:43
*** sdake has quit IRC22:43
*** mancdaz has quit IRC22:43
lifelessDaviey: make sure your virtualenv's bundled pip is 6.0 or newer.22:43
lifelessDaviey: (7.0.3 or higher is best)22:43
*** erlon has joined #openstack-infra22:44
lifelessDaviey: my guess would be you're running tox from your system python context22:44
*** sdake has joined #openstack-infra22:44
DavieyAh, i am.22:44
lifelessDaviey: which means you've got old tooling22:44
*** gildub has joined #openstack-infra22:44
krotscheckWhere's the magic documentation that tells people they have to register a pip package before publishing from infra? I need to add javascript to that.22:44
lifelessDaviey: like - ancient22:44
openstackgerritAssaf Muller proposed openstack-infra/devstack-gate: Add openvswitch logs to output  https://review.openstack.org/19815922:44
*** mancdaz has joined #openstack-infra22:44
*** rhefner has joined #openstack-infra22:44
*** notnownikki has quit IRC22:44
lifelessDaviey: I do one of two things here. If its a container, I sudo -H  get-pip; sudo -H pip install virtualenv wheel setuptools22:45
Davieylifeless: I thought i'd be able to get away with doing a pep8 without using a venv22:45
lifelessDaviey: if its not a container, I make a virtualenv, and pip install -U virtualenv wheel setuptools pip within it22:45
clarkbkrotscheck: in the infra manual under project creators, source is in the infra manual project22:45
lifelesserm -U on the first example too22:45
fungilifeless: Daviey: i run with ~/bin/tox symlinked to ~/pyenvs/tox/bin/tox22:45
lifelessDaviey: you can if you're using gentoo :)22:45
lifelessfungi: that won't help22:45
lifelessfungi: its not a tox problem22:45
Davieylifeless: right, i'll resign myself to using a venv. :)  Thanks for your help22:45
krotscheckCoolio, thanks22:45
*** dboik has joined #openstack-infra22:46
lifelessfungi: virtualenv's bundled pip is the problem22:46
fungilifeless: well, and i do similar for virtualenv22:46
*** sdake has quit IRC22:46
lifelessfungi: yes, so that should work then22:46
fungikeeping me from needing to comingle latest virtualenv, tox, pip et al with system-wide versions22:46
fungiactually, everything i install from pypi i do that way22:46
lifelessDaviey: its sadly the same problem as 'wait for two stable releases to use new dpkg/apt features'22:47
fungimainly because i don't like to ever install things system-wide with pip22:47
lifelessDaviey: except that noone has time for that shit :)22:47
Davieyyeah22:47
lifelessfungi: that is the second example I gave - make a venv, roll with it22:47
fungiyep22:47
fungii basically just have a tree of symlinks in ~/bin deep into virtualenv bindirs22:48
lifelessDaviey: the point where I realised this was when I spent any time with folk using RHEL. And realised I wasn't going to wait 20 years to use stuff.22:48
fungigit-review, gertty, et cetera22:48
*** puranamr has quit IRC22:48
*** puranamr has joined #openstack-infra22:48
Davieylifeless: Yeah, i have to agree.  It is just a shame logical error messages (or even logs), or tox doesn't just DTRT.22:49
lifelessDaviey: yeah22:49
fungialso, adding ~/man into my manpath and then symlinking from there into the manpages in the same virtualenvs works fairly sanely22:49
lifelessDaviey: we could patch pip to give a better error22:49
lifelessDaviey: but if we had a way of getting that pip onto systems22:50
lifelessDaviey: we could just give them a better pip22:50
*** sdake has joined #openstack-infra22:50
lifelessTBH I have less and less time or interest in curated-collection packaging.22:50
Davieycan't we at least have $ http://openstack-dev/install-env-and-shit | sudo bash22:50
Daviey(jk)22:50
*** dboik has quit IRC22:50
lifelessI have a LOT of interest in a super stable core Linux to consume22:51
lifelessDaviey: we do! its called devstack with all services disabled :)22:51
*** sdake has quit IRC22:51
fungialso known as "kiss your machine good-bye"22:52
Davieylifeless: Having to use devstack to do a simple rebase, isn't selling it to me. :)22:52
*** sdake has joined #openstack-infra22:52
sigmavirus24fungi: what do you mean? I like having my machine's fans propel it into the cloud22:53
sigmavirus24Thanks devstack ;)22:53
Clintyou should just make sad eyes at barry until he packages pip 722:53
fungisigmavirus24: yep, with the cpu fan leading the charge22:53
*** isviridov is now known as isviridov_away22:54
sigmavirus24fungi: now I'm imagining the speakers blaring ride of the valkyries22:54
fungiClint: can i make sad eyes at barry until he gets an updated python 3.4 with fewer bugs sru'd into trusty-updates?22:54
*** rlandy has quit IRC22:54
sigmavirus24fungi: they've given up on 3.422:54
sigmavirus24They're moving on with 3.522:54
Clintfungi: i don't see why not22:54
fungisigmavirus24: for trusty?22:54
lifelesswat22:54
sigmavirus24Oh sorry, no that's for debian 922:54
sigmavirus24But it's all they're discussing on debian-python22:55
Davieylifeless: Okay, no dice - http://paste.openstack.org/show/336662/22:55
* sigmavirus24 ponders his decision to join that list22:55
clarkbfungi: at least a python 3.4 that doesn't segfault22:55
fungiyeah. i'm just wondering if we need to switch to debian so we can run python 3.x tests for oslo.messaging again, a.k.a. 136790722:55
Davieyfungi: did that py34 bug make any progress in Ubuntu?22:55
*** Sukhdev has quit IRC22:56
fungier, bug 1367907 that is22:56
openstackbug 1367907 in python3.4 (Ubuntu Trusty) "Segfault in gc with cyclic trash" [Undecided,Triaged] https://launchpad.net/bugs/136790722:56
clarkbfungi: the other bugs we can work around but SIGSEGV do to randomish gc collection lists is lolwut22:56
lifelessDaviey: what project? I'll try it22:56
Davieylifeless: barbican22:56
fungiDaviey: bug 1348954 finally got switched to "confirmed" by the janitor 10 days ago22:57
openstackbug 1348954 in python3.4 (Ubuntu) "update Python3 for trusty" [Undecided,Confirmed] https://launchpad.net/bugs/134895422:57
Davieyfungi: I'm on the ubuntu sru team, but I am reluctant to try and progress that issue without doko or barry having input.22:57
lifelessDaviey: try installing tox in the venv too22:57
Davieylifeless: same22:57
*** amuller has quit IRC22:58
*** sdake has quit IRC22:58
fungiDaviey: yeah, i was cc'd on an e-mail exchange between barry, doko and dhellmann wherein it was suggested that they wanted to work on sru'ing 3.4.3 into trusty once it was released (and then it was released... 4+ months ago)22:59
openstackgerritColleen Murphy proposed openstack-infra/puppet-accessbot: Update template to use instance variables  https://review.openstack.org/19816022:59
openstackgerritColleen Murphy proposed openstack-infra/puppet-accessbot: Remove empty string defaults from class parameters  https://review.openstack.org/19816122:59
openstackgerritColleen Murphy proposed openstack-infra/puppet-accessbot: Add Gemfile and puppet 4 checks  https://review.openstack.org/19816222:59
*** mtanino has quit IRC22:59
Davieyfungi: On a list, or private ?22:59
*** puranamr_ has joined #openstack-infra22:59
lifelessDaviey: worked fine for me on master22:59
fungiDaviey: private unfortunately, though i did my best to summarize it in an update to the two related bugs23:00
lifelessDaviey: from within my trusty container23:00
*** erlon has quit IRC23:00
DavieyHmm, i'll try master - rather than my branch23:00
fungibug 1382607 was the other one causing us to want a newer fixed 3.423:00
openstackbug 1348954 in python3.4 (Ubuntu) "duplicate for #1382607 update Python3 for trusty" [Undecided,Confirmed] https://launchpad.net/bugs/134895423:00
*** tsekiyama has quit IRC23:01
*** pabelanger has quit IRC23:01
lifelessDaviey: requirements.txt does have the thing23:01
fungiwhich has now been marked as a duplicate since it's also fixed upstream in later 3.423:01
*** tsekiyama has joined #openstack-infra23:01
*** ajo has quit IRC23:02
*** puranamr has quit IRC23:03
*** dannywilson has quit IRC23:03
*** pabelanger has joined #openstack-infra23:04
*** puranam__ has joined #openstack-infra23:04
*** ajo has joined #openstack-infra23:05
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Rename bindep package caching element for conflict  https://review.openstack.org/19816423:05
fungigreghaynes: mordred: ^ that seemed to do the trick23:05
*** puranamr_ has quit IRC23:07
openstackgerritColleen Murphy proposed openstack-infra/puppet-accessbot: Add Gemfile and puppet 4 checks  https://review.openstack.org/19816223:07
*** whoops has joined #openstack-infra23:07
*** otter768 has joined #openstack-infra23:07
*** sabeen1 has joined #openstack-infra23:07
jeblairfungi: what was the error msg for that?23:08
*** r-daneel has quit IRC23:09
fungijeblair: There is a duplicated hook in your elements: cache-devstack/install.d/50-download-pkgs23:09
*** puranam__ has quit IRC23:09
jeblairfungi: thx23:09
fungijeblair: it sounds like mordred is working on adding some namespacing for them though so that maybe dib won't have that restriction forever23:10
*** puranamr has joined #openstack-infra23:10
jeblairi can see the cloud from my office.  it's a particularly good view today.23:10
fungiheh23:10
*** abregman has quit IRC23:10
lifelessfungi: mordred: so the name overlap thing is to permit subclassing of elements23:11
lifelessfungi: mordred: removing it forces only-composition.23:11
lifelessJust something to bear in mind23:11
*** derekh has quit IRC23:11
*** enikanorov2 has quit IRC23:11
*** puranamr has quit IRC23:11
*** pc_m has quit IRC23:12
fungilifeless: oh, neat. i didn't think about that. it does however present an interesting three-party challenge if a and b write conflicting elements which c wants to use together23:12
*** ddieterly has joined #openstack-infra23:12
*** otter768 has quit IRC23:12
fungiin this case it was thankfully only a one-party challenge. we wrote two elements and reused the same filename in them23:13
*** mase_x200 has joined #openstack-infra23:13
*** mtanino has joined #openstack-infra23:13
*** puranamr has joined #openstack-infra23:14
*** BharatK has joined #openstack-infra23:14
Davieylifeless: You see different to this? http://paste.openstack.org/raw/336744/23:14
jeblairfungi: my mta would also like forward dns records for ask-staging; mind if i add them?23:14
*** puranamr has quit IRC23:14
*** puranamr has joined #openstack-infra23:15
lifelessDaviey: yes23:15
lifelessDaviey: I also installed tox in the venv23:15
*** ddutta has quit IRC23:15
fungijeblair: feel free. if you feel like reviewing 198141 and 172880 perhaps i can just make the server permanent23:15
lifelessDaviey: (because I don't have it installed via packages, because they are uselessly old)23:15
jeblairfungi: i will do all three things23:15
*** puranamr_ has joined #openstack-infra23:16
*** puranam__ has joined #openstack-infra23:18
*** puranamr_ has quit IRC23:18
*** puranamr has quit IRC23:19
fungithanks!23:20
*** ddieterl_ has joined #openstack-infra23:20
openstackgerritMerged openstack-infra/puppet-askbot: Add CSRFViewMiddleware to settings.py  https://review.openstack.org/19814123:20
*** hodos has quit IRC23:21
Davieylifeless: ok, thanks23:22
lifelessDaviey: so I'd try pip install -U tox23:22
lifelessDaviey: then rm -r .tox/pep823:22
lifelessDaviey: then tox -epep823:22
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add cfacter to puppet3 nodes  https://review.openstack.org/19815623:23
*** ZZelle_ has quit IRC23:23
*** yamamoto has joined #openstack-infra23:24
*** ddieterly has quit IRC23:24
openstackgerritClint Adams proposed openstack-infra/system-config: WIP - reprepro UCA mirror and corresponding override/overlay area  https://review.openstack.org/19813623:26
*** hichihara has joined #openstack-infra23:26
jheskethMorning23:27
*** Sukhdev has joined #openstack-infra23:27
nibalizerohai23:27
*** mpavlase has quit IRC23:28
jeblairfungi: ok to aprv askbot-staging?23:28
*** larainema has quit IRC23:28
asselinfungi, looks like noops as it should be right?23:28
fungijeblair: yes, please23:28
fungijeblair: and i'll get the ssh key updated on the puppetmaster23:29
fungiasselin: so far zuul hasn't fallen over23:29
asselingreat :)23:29
fungiasselin: and no puppet errors23:29
*** ddutta has joined #openstack-infra23:29
jeblairoh are we running openstackci::zuul?23:30
asselinfungi, thanks for babysitting the change23:30
asselinjeblair, yup!23:30
jeblairneat! maybe we'll run out things to do during the sprint! ;)23:30
fungijeblair: that would be awesome23:31
fungi[sprint starts] okay we're done!23:31
asselinjeblair, that's my goal....23:31
asselinlol23:31
nibalizerhah23:31
Davieylifeless: Thanks, i am good now.. Appreciate your help.23:32
nibalizerneat!23:32
asselinwe're pretty close. We have JJB patches that are almost ready23:32
*** alexpilotti has joined #openstack-infra23:32
asselinand nodepool which is the other big one23:32
nibalizerwhat about gerrit?23:32
asselinnibalizer, that wasn't in scope23:32
nibalizeralso I've been noodling on the testing23:33
asselinstatus is here FYI: https://storyboard.openstack.org/#!/story/200010123:33
jeblair(gerrit's for later)23:33
fungiyeah, third-party ci operators generally interface with our gerrit rather than running one of their own23:33
nibalizerhaven't made much tangible progress but the puppet-openstack stuff is looking pretty good23:33
fungiso the third-party ci use case was basically the initial scope23:34
asselinthere's logstash/kibana....but that one is optionally / 2nd priority23:34
*** ddieterly has joined #openstack-infra23:34
openstackgerritMerged openstack-infra/system-config: Initial commit of ask-staging.o.o site  https://review.openstack.org/17288023:34
*** ihrachyshka_ has quit IRC23:34
*** ddieterl_ has quit IRC23:34
*** StevenK has quit IRC23:35
*** chlong has quit IRC23:36
asselinoh, and create a sample site.pp & documentation....plenty for the sprint23:36
*** sdake has joined #openstack-infra23:37
*** ashleighfarnham has quit IRC23:37
lifelessDaviey: cool23:37
jeblairanyone noticed we're getting close to gerrit change # 2.0*(10^5) ?23:37
*** alexpilotti has quit IRC23:38
*** austin81 has left #openstack-infra23:38
fungilikely we'll hit it in the coming week23:38
jeblairunfortunately, i think it's unlikely we'll break .25M before the summit.  but maybe the requirements work will put us over there :)23:39
*** mase_x200 has quit IRC23:40
openstackgerritMerged stackforge/gertty: Allow bulk-edit of topics  https://review.openstack.org/19132223:40
openstackgerritMerged openstack-infra/project-config: Rename bindep package caching element for conflict  https://review.openstack.org/19816423:40
greghaynesI wonder how long before 10^623:40
openstackgerritMerged openstack-infra/irc-meetings: Update Sahara meeting id and agenda URL  https://review.openstack.org/19798923:41
openstackgerritMerged stackforge/gertty: Specify color for unstable test job  https://review.openstack.org/19697423:41
openstackgerritMerged stackforge/gertty: Show all held changes in held-changes view  https://review.openstack.org/19781823:42
*** yamada-h has joined #openstack-infra23:42
*** camunoz has quit IRC23:43
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Backward-compatible branch list for bindep element  https://review.openstack.org/19816623:44
*** alexpilotti has joined #openstack-infra23:44
*** Swami_ has joined #openstack-infra23:46
*** camunoz has joined #openstack-infra23:46
*** alexpilotti has quit IRC23:46
*** yamamoto has quit IRC23:47
*** yamada-h has quit IRC23:47
fungithat's ^ also one i didn't catch in earlier testing23:48
openstackgerritColleen Murphy proposed openstack-infra/project-config: Revert "puppet: disable voting for beaker/centos7 jobs"  https://review.openstack.org/19816723:49
*** Swami has quit IRC23:49
openstackgerritMerged openstack-infra/puppet-kerberos: Add support for CentOS  https://review.openstack.org/19646023:51
*** mayurig has quit IRC23:52
*** hdd has joined #openstack-infra23:54
openstackgerritArkadiy Kraminsky proposed openstack-infra/puppet-zuul: add notification for existing pidfile  https://review.openstack.org/19444923:55
*** camunoz_ has joined #openstack-infra23:55
*** Swami_ has quit IRC23:57
*** hdd has quit IRC23:57
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Add Parameterized Remote Trigger Plugin support.  https://review.openstack.org/15032723:57
*** laughterwym has joined #openstack-infra23:58
*** hdd has joined #openstack-infra23:58
*** ddutta has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!