Wednesday, 2015-05-27

adam_gmorganfainberg, IIRC the discussion a while back around the original patch (to neutron or nova?) that did the same was that it'd be an okay exception if the new config values default to the existing behavior00:01
morganfainbergadam_g: will 2x check and press go if it mirrors current behavior00:02
morganfainbergadam_g: thanks00:02
morganfainberg(it looks like it does)00:02
*** david-lyle has quit IRC00:20
Davieymorganfainberg: Adding config options is really not as bad as is feared, providing the path of least suprise is followed.  Ie, keeping the current default behaviour (unless security is a reason, then things change)00:30
morganfainbergDaviey: good to know00:58
*** jamielennox|away is now known as jamielennox01:23
*** david-lyle has joined #openstack-stable01:35
*** pixelb has quit IRC02:09
*** david-lyle has quit IRC02:33
*** david-lyle has joined #openstack-stable03:11
*** gnuoy has quit IRC04:05
*** jamespage has quit IRC04:05
*** gnuoy has joined #openstack-stable04:06
*** jamespage has joined #openstack-stable04:06
*** e0ne has joined #openstack-stable06:01
*** e0ne has quit IRC06:11
*** e0ne has joined #openstack-stable08:15
*** e0ne has quit IRC08:19
*** pixelb has joined #openstack-stable08:29
*** ihrachyshka has joined #openstack-stable08:58
*** e0ne has joined #openstack-stable09:23
*** e0ne is now known as e0ne_09:23
*** e0ne_ is now known as e0ne09:31
*** derekh has joined #openstack-stable09:37
*** e0ne is now known as e0ne_11:26
*** openstack has joined #openstack-stable11:38
*** e0ne is now known as e0ne_12:09
*** e0ne_ is now known as e0ne12:14
*** eharney has quit IRC12:40
*** mrunge has joined #openstack-stable12:44
*** mrunge_ has joined #openstack-stable12:44
*** mrunge has quit IRC12:45
*** mrunge_ has quit IRC12:45
*** mrunge has joined #openstack-stable12:45
*** bknudson has joined #openstack-stable13:06
*** mriedem_away is now known as mriedem13:17
*** eharney has joined #openstack-stable13:30
number80zigo++13:54
number80(I read your packaging proposal, still processing this :) )13:55
ihrachyshkanumber80, delorean could lead the way since all the workflow is already set for that, the "only" thing that we would need is switching to stackforge and u/s infra13:56
number80ihrachyshka: yes, that's what I've been thinking, and I don't mind moving Delorean upstream13:57
number80but I'm not the only one to be convinced to do that switch :)13:57
number80adding debian/ubuntu support in Delorean is a small task13:58
*** apevec has joined #openstack-stable13:59
*** apevec has joined #openstack-stable13:59
ihrachyshkanumber80, yes, we need deb-master ;)13:59
ihrachyshkahonestly, I wouldn't even mind if debian packages are maintained in the same branch, to boost collaboration, but gerrit ACLs are not tree based, and allowing fedora guys to merge stuff for debian and vice versa is probably silly (but we could rely on trust and not ACLs)14:01
number80+214:01
number80I don't mind having cross-collaboration between packaging "groups"14:02
zigonumber80: Why would we use something else than sbuild?14:02
zigonumber80: ihrachyshka: As I wrote, the issue is that we don't use the same package names, on top of that.14:03
number80zigo: Delorean pattern is to run build tools in a container for isolation purpose, so you'd still use sbuild14:04
zigoNot sure what you guys would do, but I would try to keep things consistent in this regard.14:04
ihrachyshkazigo, spec contents is what defines artificats naming, not repo name, right?14:04
ihrachyshka*artifacts14:04
zigonumber80: Well, sbuild already uses LVM snapshots for the chroots, so I don't see why we would need containers.14:04
zigoA chroot is more than enough for building.14:04
zigoNo need to use docker and such.14:04
ihrachyshkaartificats... meow14:05
zigoI know docker is trendy, but it itsn't the answer to everything.14:05
ihrachyshkazigo, well, I guess we could extend delorean to use other tools for other platforms. the point is to have common UI.14:05
number80zigo: we do have sbuild-like tool (mock) but in rare cases, it's not enough (as far fedora is involved, our builders are in VMs)14:05
zigonumber80: Interesting! In which cases?14:06
ihrachyshkanumber80, an example of when it's not enough would be appreciated14:06
number80(just for the record, I'm trying to understand and see how we could converge!)14:06
zigoThe thing is, sbuild is already used in the Debian buildd network, so I wouldn't want to use anything else. Canonical guys expressed the same opinion.14:06
ihrachyshkazigo, what is buildd network?14:07
zigoIf we do, we may have bad surprises with fail-to-build issues.14:07
ihrachyshkaah, it's koji :)14:07
zigoihrachyshka: In Debian, we build packages which are non arch: all through a network of machines with different arch.14:07
zigoihrachyshka: Everything is built on a machine running the target arch.14:08
number80zigo, ihrachyshka: in some cases, you may have malicious code that tries to get out of the chroot (in the rare cases, where fedora infra has been compromised, some people did try malicious builds)14:08
ihrachyshkazigo, so you would build a package in debian infra for openstack needs?14:08
zigoFor example, we have arm64 machines in Cambridge ...14:08
zigoihrachyshka: Only on amd64.14:08
zigoWhich is where uploading to distributions makes more sense, as it adds more arch.14:09
ihrachyshkazigo, but still, you would bomb debian infra with irrelevant requests.14:09
number80anyway, we could probably not enforce using docker14:09
zigoihrachyshka: What? Sorry, I didn't get that one.14:09
ihrachyshkazigo, if CI is in place, and a patch for debian packaging is uploaded, where would the package be built? in debian infra or openstack one?14:09
zigoMy proposal is *not* to use the Debian buildd network, but to use the same system in OpenStack infra, just to be on the safe side.14:10
zigoSo that if we build a package on OpenStack infra, we know it will build the same way as in the Debian buildd network when we upload it there.14:11
ihrachyshkazigo, aha. so you would run 'buildd' like node there for packaging?14:11
zigoWhich leads to: we can't use anything else than sbuild.14:11
zigoihrachyshka: No, just sbuild.14:11
zigoI don't think we have any reason to build for anything else than amd64.14:11
number80zigo: got that14:11
ihrachyshkaok, so sbuild is debian way to do delorean.14:11
zigoLOL ! :)14:11
zigoihrachyshka: delorean is new, no?14:12
zigosbuild is like over a decade old.14:12
ihrachyshkazigo, yes, at least most (all?) packages are noarch in any case14:12
number80zigo: no, we used it for at least 2 or 3 releases (it's our Continuous Delivery platform, we even have some reporting)14:12
zigoAlso, in Debian, we have some crazy guys that are rebuilding all of the Debian archive using AWS.14:12
ihrachyshkazigo, well, I don't think I'm interested in deciding whose history is older, I just try to understand whether there is any common ground14:12
number80I was just mentioning this to bootstrap the conversation, as I wasn't at summit14:12
zigoThese tests are using sbuild too.14:13
zigoihrachyshka: Sure, I'm just reacting to the "sbuild is debian way to do delorean"...14:13
number80getting rid of delorean is an option14:13
number80but at least, I'd like to share as much infrastructure (especially reporting)14:13
zigonumber80: I'm sure that RPM world tests will be different.14:15
zigoLike, we use lintian, piuparts, adequate ...14:15
ihrachyshkathe problem with having two different tools is that openstack-infra would need to maintain separate jobs for both. not that it's a huge waste of resources (I just don't know), but if we would be able to come with some common UI, that would be better I guess. sbuild could still be under the hood for debian package updates.14:16
number80zigo: not much14:16
number80(I do have some experience in Debian packaging and we have common issues)14:16
zigoIf we can share some tools, then great, but I just don't think it's going to be the case.14:16
number80ok14:16
ihrachyshkanumber80, do we even run QE on package updates on every upload? I don't think so, the only time I saw those tools involved was initial package review process14:16
number80zigo: then, it's even a lower barrier for everyone to jump in14:17
zigoSo, if I understand well, Fedora uses delorean and VMs to build packages by default?14:17
number80ihrachyshka: for RDO, we run CI over every update and even have now repo-level (basic) CI14:17
ihrachyshkanumber80, yeah, but do we run e.g. rpmlint?14:18
zigoIt's my strong feeling that it'd be better to use what the distributions are using in Fedora's case too, but I'll let others to decide for anything non-debianish.14:18
ihrachyshkazigo, there may be no Fedora packages whatsoever, just RDO14:18
number80ihrachyshka: no, too much false positives14:18
zigoihrachyshka: As you like! :)14:18
zigoI never really understood the barrier between RDO and Fedora.14:19
ihrachyshkanumber80, and I guess zigo meant that they run similar tools on upload14:19
zigoIsn't it the same packages?14:19
ihrachyshkazigo, Fedora packages are just broken versions of RDO :D14:19
zigoLOL ! :)14:19
zigo.oO(Note for later: use RDO, not Fedora...)14:19
number80zigo: off course, we have to reuse build system and guidelines from downstream (+2)14:19
ihrachyshkazigo, they are the same, but they don't get timely updates in most cases, so it's better to discourage people from even trying them14:19
zigoGot you.14:19
zigoihrachyshka: FYI, it's also often painful for me to do updates in Debian in a timely maner.14:20
ihrachyshkazigo, and that's why there are ideas floating around to just drop them not to show ourselves in bad shape for no reason.14:20
apeveccatching up (btw aren't we off-topic here? :) .... re. builders in infra, I'm looking at https://etherpad.openstack.org/p/YVR-infra-meetup-packaging and https://review.openstack.org/#/c/179713/2/specs/build_distribution_packages.rst14:20
zigoUnless there's an friendly FTP master looking over it, that is (which I have, but he's often busy doing something else...).14:20
apevecIIUC infra will just give us bare VMs and we can run whatever tools inside we like14:21
apeveci.e. deb => sbuild14:21
ihrachyshkazigo, there is no big deal in fedora per se, it's just that people are bad at handling packaging for multiple sources (fedora + rdo of multiple platforms), and since everyone is busy with upstream stuff, fedora packages lag14:21
zigoOh, I didn't see the HP stuff.14:21
* zigo is reading...14:21
apevecrpm => mock or delorean14:21
number80and use gerrit for packages reviews (which is exactly how we work for delorean packaging)14:21
* number80 has to leave14:22
number80I will read my logs, and this is a very interesting discussion and we should definitively try to reach agreement and full understanding asap14:22
zigo"Currently, OpenStack is at the mercy of upstream distributions with respect to what we can easily install on our build infrastructure." <--- Seriously, HP did absolutely ZERO contribution back to Debian, it's not serious to write such a thing.14:23
ihrachyshkabtw if we somehow decide to keep packaging for all platform in a single repo, then we would need to make sure the proper jobs are executed only (so that no debian job is run on rpm update). it's doable with file filters in project-config14:23
number80zigo: anyway, doers will do as they wish, let the others bark14:24
apeveczigo, yeah, but spec is out there, so we need to provide feedback...14:24
*** jokke_ has quit IRC14:24
*** jokke_ has joined #openstack-stable14:24
apevecihrachyshka, I think separate repos are better, and if single repo, it would be separate branches...14:25
apevecdepends on ACLs, that's discussed in zigo's proposal14:25
ihrachyshkaapevec, gerrit is dumb, it can't give ACLs per directory :(14:26
ihrachyshkathat limitation hits openstack hard14:26
ihrachyshkaneutron started to split partly because of that14:26
apevecyeah, so must be per branch or separate repo14:26
ihrachyshkaapevec, unless we trust :)14:26
apevectrust but verify!14:26
apeveci.e. ACL is must :)14:27
ihrachyshkaAND I DON'T TRUST zigo !!!14:27
ihrachyshka:)14:27
number80ihrachyshka: I know where he lives, I don't need to trust him :)14:27
ihrachyshkathat's what I meant my trusting - actual sharing of everyone's home addresses14:28
ihrachyshkamy -> by14:28
DavieyThe other solution is to have a branch per packaging type, and maybe even a derived branch per distro?14:30
number80:)14:30
Davieykilo_deb -> kilo_debian | kilo_ubuntu , kilo_rpm, kilo_rdo | kilo_suse ?14:31
ihrachyshkaDaviey, I think in delorean, that was an idea behind renaming f20-master branch into rpm-master. like 'what if one day we get other package types?'14:31
Davieyihrachyshka: nice14:31
ihrachyshkaif there is suse in the game, rpm in the branch name would be too vague though14:32
Davieyihrachyshka: Does RDO and SUSE not share any commonality with the packages?14:33
ihrachyshkaDaviey, I would be amused to realize that's the case since I don't even know who packages it.14:33
Davieyihrachyshka: that is probably sader than the debian/ubuntu relationship then!14:33
ihrachyshkaDaviey, though yeah, we could try to diverge. it will depend whether there are actual differences in contents though (like whether config files and log files are in the same locations)14:34
Davieyihrachyshka: Well, i was suggesting that there is a top level for the packaging type maybe, and derived from that for each distro14:34
ihrachyshkaDaviey, also, RDO is systemd heavy, not sure what suse does these days. so obviously we should try to have common specs, but it can be touch14:34
ihrachyshka*tough14:34
Davieyihrachyshka: That is mostly the issues that Ubuntu and Debian had failed to deal with14:35
Davieysystemd vs upstart co-exist in packaging14:36
Davieyand interactive installing (asking questions) vs sideband configuring14:36
ihrachyshkaDaviey, in rpm specs, we can conditionalize based on platform though14:36
ihrachyshkaDaviey, you mean debconf not used by ubuntu?14:36
Davieyihrachyshka: yeah, ubuntu doesnt really use debconf for packaging openstack14:37
Davieyihrachyshka: and it can also be conditional, but rather than each distro integrating both formats it turned into both badly supporting both14:37
Davieyihrachyshka: The mindset of ubuntu is that anyone doing openstack seriously is using something like juju, puppet, chef, ansible or saltstack and really.. debconf just gets in the way for that.14:38
zigoihrachyshka: It can't have ACLs per directory, but it can per branch.14:38
Daviey^^ that is what i was suggesting14:39
zigoAnyway, I'm for separated repository.14:39
zigoDaviey: As for Debian & Ubuntu, the goal is to *not* have separate packaging branches.14:39
zigoSo we can work together.14:39
zigoWhen unavoidable, we will, but we will try not.14:40
Davieyzigo: Totally, but having common ancestory is a pretty good start towards that14:40
zigoihrachyshka: Isn't the solution to support multiple init systems, like I did for Debian, and which Ubuntu adopted (in openstack-pkg-tools)?14:41
*** eharney has quit IRC14:42
zigoDaviey: You're wrong about about the fact we didn't deal with multiple init systems, see above.14:42
zigoDaviey: Ubuntu adopted my openstack-pkg-tools for this very reason: so they could support all 3 init systems at once.14:42
Davieyzigo: I'm sorry, but i am really not wrong about this... the .upstart was partially added to debian packages and the same in reverse14:43
zigoDaviey: What we never agreed on, is the use of Debconf for configuring packages.14:43
Davieyit was totally broken in both distros14:43
zigoDaviey: Which is why I wrote stuff in openstack-pkg-tools: to make sure that all init scripts, for all 3 systems, are consistent.14:44
zigoDaviey: The issue was more that it is painful to maintain more than 70 daemons ...14:44
DavieyIndeed.. So it was badly done in both distros14:45
ihrachyshkazigo, for redhat, there is no other rc system.14:45
zigoLet's say you realise something is wrong, then you need to edit 70 init scripts * 3 init systems.14:45
ihrachyshkazigo, if suse has one and wants to collaborate, surely we can add it14:45
Davieyihrachyshka: RHEL6 disgarees with you :)14:45
ihrachyshkaDaviey, we don't build Juno+ for el614:45
zigoihrachyshka: I'd suggest that you write some kind of helper to bring consistency (if that is possible...).14:45
ihrachyshkasure. if there is an issue to solve, we'll do smth about it :)14:46
Davieyihrachyshka: True14:46
Davieyzigo: Anyway, now we have all agreed that the one true direction is SystemD, life becomes somewhat easier.. right? :)14:47
bknudsonhttps://review.openstack.org/#/c/175519/ is a security fix in keystone that hasn't been +W yet for some reason14:47
Davieyzigo: BTW, i wish i saw the packaging meetup advertised.. i'd have been there.14:47
zigoDaviey: I am not sure if we "all agreed", but that's currently the state of things, so let's just try to use what we have ! :)14:48
zigoI've always been on the side of "let's support as much as we can", though of course one them has to be the default.14:49
zigoSystemd as issues, but sysv-rc too ...14:49
Davieyzigo: That is my view aswell.. better to have agreed on something than have 100 perfect implementations14:49
zigoRight.14:49
ihrachyshkaspeaking of converging... do we want to see systemd units in upstream projects? ;)14:50
zigoOh, BTW, I'm the package maintainer of OpenRC in Debian ! :)14:50
zigoihrachyshka: I don't want them there, no.14:50
zigoihrachyshka: This has to be distribution specific. In Debian, it's not even stored anywhere, it's generated ...14:50
ihrachyshkazigo, right. we could think of templates to use for generation (?)14:51
zigoihrachyshka: http://thomas.goirand.fr/blog/?p=21214:51
zigoihrachyshka: I'd be *very* happy to share this with Fedora people.14:51
zigotl;dr: I'm using the begining of a sysv-rc init script as a template.14:52
* ihrachyshka adds the link to things-to-read14:52
zigoFYI, there's been some scripting improvements since.14:52
zigoBut the main idea of this blog post remains.14:53
zigo(and is currently implemented in both Debian & Ubuntu packages for OpenStack)14:53
zigo.oO( I thought this channel was always idle... )14:54
ihrachyshkazigo, you started fire with your email14:55
DavieyActually... systemd being in upstream isn't as crazy as it sounds.14:55
DavieyBefore Systemd won the war, i'd have disagreed.. but why does it now not make sense?14:55
ihrachyshkaDaviey, afaik systemd upstream claims that's the way to do it since systemd is platform independent14:56
Davieyexactly14:56
DavieyThe thiner the packaging is, the better - surely?14:57
*** jamespage_ has joined #openstack-stable15:02
zigoDaviey: Because we wont use it, since we generate the .service files in Debian & Ubuntu.15:06
zigoDaviey: So only RDO would use it, therefore, it doesn't make sense.15:06
ihrachyshkazigo, but if you have templates, wouldn't you use them?15:06
zigoihrachyshka: I wouldn't, because I want to keep the fact that things like log path are hard-wired in templates.15:07
Davieyzigo: ]15:07
zigoHaving too much things written in the .service files means that it's hard to do change in all packages.15:07
Davieyzigo: erm, that is a pretty poor reason for rejecting collaborative work15:07
zigoDaviey: I've proposed to others to use the same generation of .service files as we do...15:08
zigoI'm all for more collaboration.15:08
ihrachyshkazigo, why not provide log file name for substitution?15:08
zigoihrachyshka: What do you mean?15:09
Davieyzigo: well, you blew out the entire idea without any consideration.. that isn't collaboration! :)15:09
Davieyzigo: Does systemd not support variable substitution of values?15:09
ihrachyshkawhatever, I'm not that interested in systemd. we can consider it later if/once we see any convergence.15:09
zigoDaviey: I've given points of argumentations, it's not like it I just blew it without reasons.15:09
zigoihrachyshka: What do you use then? sysv-rc or upstart?15:10
zigoIf you use any of the 3, then you're still interested in having things generated.15:10
zigoThe burden of maintenance is too high otherwise.15:10
Davieyzigo: I would suggest a collaborative way would be, it can work for us if...  rather than, we can't use it because...!15:10
ihrachyshkazigo, we use systemd, we don't generate those (at least not in neutron), though we want to look into it in liberty.15:11
zigoihrachyshka: FYI, for the OVS agent daemon, we don't use generated .service, that's in fact the only exception ! :)15:11
ihrachyshkazigo, if we would be able to execute some externally managed tool passing some args to generate results, that would be better for us than copying your generator around branches15:11
zigoihrachyshka: Another thing we got to remember is that having consistency accros distribution makes life easier for documentation people.15:12
zigoThings like log file path and so on, it's easy to make it consistent.15:13
*** e0ne is now known as e0ne_15:13
ihrachyshkazigo, it should be consistent across distros, not just in single distro. otherwise puppet guys swear in our direction.15:13
ihrachyshka(and docs too, right)15:13
zigoExactly right!15:13
zigoPuppet guys also want us to be consistent.15:14
zigoThanks for the reminder... :)15:14
ihrachyshkazigo, we have neutron/RDO bashed once in a while for not following (bad) example of ubuntu that passes ml2_conf.ini to ovs agent15:14
ihrachyshkait's even documented as an RDO bug in official docs (while it's not and is intentional)15:14
zigoihrachyshka: I've also been pointed finger at for the same reason.15:15
ihrachyshkazigo, so you don't pass plugin.ini there?15:15
ihrachyshkacool!15:15
zigoihrachyshka: IMO, the issue here is that the install-guide is ubuntu centric.15:15
zigoihrachyshka: I do ! :)15:15
ihrachyshkaoh, if you pass it, that's incorrect :)15:15
ihrachyshkabecause plugin.ini is controller side15:15
zigoihrachyshka: What I do is looking at the core_plugin directive, and conveniently pass the corresponding .ini file to the OVS agent.15:15
ihrachyshkaovs agent should only read ovs_neutron_plugin.ini (yes, the name is wrong for historical reasons)15:16
zigoihrachyshka: http://anonscm.debian.org/cgit/openstack/neutron.git/tree/debian/plugin_guess_func15:17
ihrachyshkazigo, even if core_plugin is ml2, you still should pass ovs_neutron_plugin.ini to ovs agent, not ml2_conf.ini15:18
zigoihrachyshka: There's an ovs_neutron_plugin.ini file and an ml2_conf.ini with directives there on upstream etc folder.15:18
zigoWhy not using what upstream provides?15:18
zigoThe day upstream git repo present things differently, then I'll change my mind.15:18
zigoIn the mean while, my package will use what upstream provides.15:19
zigoWhat to fix things? Do that upstream first...15:19
ihrachyshkazigo, what do you mean? upstream provides ovs_neutron_plugin.ini for ovs agent15:19
zigoYeah, and I use that + the ml2_conf.ini.15:19
ihrachyshkaas I said, the name is unfortunate but it's for valid historical reasons15:20
zigoSince there's important directives which the plugin use in both files.15:20
zigoihrachyshka: Fix this upstream then !15:20
ihrachyshkayou should not pass ml2_conf.ini since there is no option relevant for ovs agent there15:20
*** xaeth_afk is now known as xaeth15:20
zigoihrachyshka: Really ?15:20
zigoihrachyshka: So, passing the ml2_conf.ini like I do in my package has no effect?15:20
zigoInteresting ...15:21
zigoAnyway, the solution is that Neutron upstream rethinks this from zero, then we can make it consistent accross distros.15:21
mriedemlooks like we have a new grenade breakage in stable/kilo15:22
mriedemhttp://logs.openstack.org/56/183656/4/check/check-grenade-dsvm/3acba73/logs/old/screen-s-proxy.txt.gz15:22
ihrachyshkaI agree there is at least rename to do15:22
mriedemsince this is the 'old' side it'd be a problem in stable/juno requirements15:22
mriedembknudson: mtreinish: ^15:22
mriedemadam_g: ^15:22
*** e0ne_ is now known as e0ne15:22
bknudsonkazoo and zake?15:22
mriedemheavy hitters right15:22
zigoihrachyshka: There's also the fact that the Neutron files can't be parsed with a reasonable script.15:23
mriedemzake 0.2.2 released today https://pypi.python.org/pypi/zake/0.2.215:23
bknudsonzake uploaded on 05-2715:23
mtreinishmriedem: what are with these weird package names? I have no idea what those things do15:23
ihrachyshkazigo, what do you mean by parsing?15:23
bknudsonA python package that works to provide a nice set of testing utilities for the kazoo library.15:23
bknudsonzake ^15:23
zigoihrachyshka: I mean this:15:24
mtreinishmriedem: oh that would explain it. Yell at harlowja15:24
zigo# cat etc/neutron/plugins/openvswitch/ovs_neutron_plugin.ini | grep integration_bridge15:24
zigo# integration_bridge = br-int15:24
zigo# integration_bridge = br-int15:24
zigo# integration_bridge = br-int15:24
zigo# integration_bridge = br-int15:24
zigoThat's a nonsense !!!15:24
zigoDirectives should be there *once*.15:24
zigoExamples shouldn't start with commented-out directive names.15:24
zigoThere should be a way at least, to differentiate directives and examples.15:25
bknudsonzake is capped http://git.openstack.org/cgit/openstack/requirements/tree/global-requirements.txt?h=stable%2Fjuno#n23015:25
bknudsonzake>=0.1,<=0.1.715:25
bknudsonas is kazoo>=1.3.1,<=2.015:25
ihrachyshkazigo, yeah, those are not auto-generated, that's why15:27
mriedembknudson: i think tooz is pulling something in15:27
ihrachyshkazigo, there is a plan to make them autogenerated in L15:27
mriedemCollecting kazoo>=1.3.1 (from tooz<=0.12,>=0.3->ceilometer==2014.2.4.dev4)15:27
bknudsonRequirement.parse('kazoo!=2.1,>=1.3.1'), set(['zake'])) -- from that it looks like zake is not a fan of kazoo 2.115:28
bknudsonbut that's the current release of kazoo15:29
mriedemCollecting zake>=0.1 (from tooz<=0.12,>=0.3->ceilometer==2014.2.4.dev4)15:29
mriedemtooz has an uncapped requirement on zake15:29
bknudsonwhat's tooz?15:29
bknudsonCoordination library for distributed systems.15:29
mriedembingo https://github.com/openstack/tooz/blob/0.12/requirements.txt#L815:30
bknudsonit would be interesting to know why zake thinks kazoo 2.1 is such a problem.15:30
mriedemtooz 0.12 has uncapped requirement on zake15:30
bknudsonand if a new release of kazoo is expected15:30
zigoihrachyshka: There's been such a plan for like years ... :)15:30
mriedembknudson: let's go to the oslo channel and ask harlowja15:30
bknudsony, let's pile on15:31
ihrachyshkazigo, this time it will be different!!!15:31
ihrachyshkanah, it won't, just kiddin'15:31
zigo:)15:31
ihrachyshkabut I heard it that time from a doc guy who felt pain doing manual updates for official docs15:31
bknudsonmriedem: mtreinish: s-proxy is really good at catching these things, unlike every other server15:31
ihrachyshkaso maybe pain will remain for some time until the solution is there15:32
*** eharney has joined #openstack-stable15:32
bknudsonso either s-proxy is doing something right and everyone else is wrong or s-proxy is wrong.15:32
bknudsonseems like it's s-proxy that's helping out here15:32
mtreinishbknudson: it's first15:33
mtreinishwell the first that pulls in a lot of libs15:34
DavieyIs stable/kilo gate working properly now?15:36
mriedemDaviey: no ^15:38
mriedemit was, for about an hour15:38
mriedemyesterday15:38
Davieymriedem: Is there a summary of the current issues?15:39
mriedemDaviey: not really15:40
mriedemDaviey: https://pypi.python.org/pypi/zake/0.2.2 released today15:40
ihrachyshkain case someone comes up with details, please use https://etherpad.openstack.org/p/stable-tracker15:40
mriedemwhich breaks here http://logs.openstack.org/56/183656/4/check/check-grenade-dsvm/3acba73/logs/old/screen-s-proxy.txt.gz15:40
mriedemihrachyshka: i'll probably bring it up in the ML first15:40
mriedemonce i map out all of these gd dependencies15:40
mriedemwith 'z' in the name of the library15:40
ihrachyshkathanks15:41
mriedembknudson: is there an outstanding g-r sync for ceilometer in stable/juno?15:43
Davieymriedem: I'm looking at zuul, but i can't find a stable/kilo job that is busted... Do you have an example review that is blocked?15:44
mriedemDaviey: the link above ^15:44
mriedemhttps://review.openstack.org/#/c/183656/15:44
Davieydoh15:44
bknudsonmriedem: https://review.openstack.org/#/c/173117/15:44
mriedemstable/kilo is blocked on grenade b/c stable/juno (old side of grenade for stable/kilo changes) is f'ed15:44
mriedembknudson: ok, i'm not sure if that helps, but we might as well get it in: https://review.openstack.org/#/c/173117/15:45
mriedemmtreinish: ^15:45
mriedemsince it's passing tests15:45
bknudsonmriedem: we needed to get https://review.openstack.org/#/c/183656/ in during that one golden hour.15:45
mriedemheh15:46
mriedemi was disconnected due to terribleness from yesterday15:46
bknudsonmriedem: yesterday was pretty bad, but that's what you get for being away for a week15:47
Davieydamn, i thought everything would be rosie after the keystone issue15:47
mriedembknudson: being away or not, it doesn't matter15:47
mriedemevery day stable is broken by some other transitive dependency somewhere down the change15:47
mriedem*chain15:47
mtreinishmriedem: +A, but on dsvm job that shouldn't change anything15:48
mriedemmtreinish: bknudson: Daviey: so ceilometer pulls in tooz 0.12 and tooz 0.12 has uncapped zake which pulls in zake 0.2.2 (released today) which has a block on kazoo 2.115:48
mriedemthat's where we fail15:48
mriedemhowever, g-r on stable/juno also caps kazoo<=2.015:49
mriedemCollecting kazoo>=1.3.1 (from tooz<=0.12,>=0.3->ceilometer==2014.2.4.dev4)15:49
mtreinishis tooz g-r synced on juno?15:49
mriedemno15:49
mriedemtooz does not have a stable/juno branch15:49
mriedemah yes15:50
mriedemhttps://github.com/openstack/tooz/blob/0.12/requirements.txt#L615:50
mriedemtooz 0.12 also has an uncapped requirement on kazoo15:50
mriedemso it's pulling in kazoo 2.1 which breaks with zake 0.2.2 b/c that can't have kazoo 2.115:50
mtreinishyep, that explains it15:50
mriedemso, we need a stable/juno branch for tooz15:51
*** ihrachyshka has quit IRC15:51
mriedemand a sync from g-r for stable/juno on that15:51
bknudsonthen we'll also need a release of tooz15:51
mriedemi don't really know wtf you'd version that as for tooz though since it's already like microversioned15:51
mriedemwe also need harlowja to wake up15:51
bknudsonI think our best bet is to get a release of kazoo that doesn't have whatever the bug is15:52
mtreinishmriedem: surely someone else should have the acl to push a release15:52
mriedemalternatively, we might be able to order requirements such that capped kazoo is installed before tooz15:52
mriedemceilometer->tooz->kazoo15:53
mtreinishmriedem: heh, let's build an even taller house of cards15:53
Davieymriedem, bknudson: You know, i really think we need better tooling to determine the dep chain15:53
mriedemi agree with that15:53
mriedemi just use the tox logs15:54
mriedemand then walk it back via github tags in each repo15:54
*** jamespage_ has quit IRC15:54
mriedemwhich blows15:54
mriedembrb15:54
*** jamespage_ has joined #openstack-stable15:54
Davieymriedem: What tags do you mean?15:54
mriedemgit tags15:55
*** jamespage_ has quit IRC15:59
mriedemhere is the bug for tracking https://bugs.launchpad.net/python-tooz/+bug/145932216:00
openstackLaunchpad bug 1459322 in tooz "stable/juno broken with zake 0.2.2 release" [Undecided,New]16:00
mriedemi'll get an e-r query up16:00
mriedemi have had it with these mothertrucking dependencies on this mothertrucking plane16:01
*** xaeth is now known as xaeth_afk16:12
Davieymriedem: I knew that, i mean.. of which project?16:19
mriedemDaviey: updated https://etherpad.openstack.org/p/stable-tracker16:20
mriedemDaviey: all of them?16:20
Davieymriedem: Thought as much.. :/16:21
*** derekh_ has joined #openstack-stable16:21
Davieymriedem: you are on fire!16:21
mriedemwe should just have one gigantic monolithic 'openstack' package with like 300 libraries in it16:21
mriedemthat would fix everything i'm pretty sure :P16:22
DavieyThat sounds like a good fit with Vish's opinion that perhaps openstack should have been written in java16:22
mriedemyeah i liked that16:23
mriedemespecially after going to oracle16:23
*** derekh has quit IRC16:25
*** akrivoka has joined #openstack-stable16:29
Davieymriedem: failed.16:33
DavieyOh bugger.. WARNING: urllib3.connectionpool HttpConnectionPool is full, discarding connection: 127.0.0.116:49
DavieyI really hope that is not related to keystone recent issue16:49
bknudsonDaviey: I think we get those warnings all over the place and it doesn't cause tests to fail16:51
adam_gya those are typical16:51
Davieybknudson: indeed, https://bugs.launchpad.net/glance/+bug/140274716:51
openstackLaunchpad bug 1402747 in OpenStack Object Storage (swift) "setuptools 8 breaks multi-range version checks" [Undecided,Invalid]16:51
bknudsoninvalid16:52
bknudsonthe bug is marked invalid for whatever reason16:52
*** xaeth_afk is now known as xaeth16:53
mriedemyou'll see "WARNING: urllib3.connectionpool HttpConnectionPool is full, discarding connection: 127.0.0.1" all over swift and glance api stuff17:14
mriedemb/c of gets on large artifacts17:14
mriedemtiming out the pools17:14
*** e0ne is now known as e0ne_17:16
*** e0ne_ is now known as e0ne17:20
*** e0ne has quit IRC17:25
*** mrunge has quit IRC17:27
*** apevec has quit IRC18:05
*** e0ne has joined #openstack-stable18:06
*** e0ne is now known as e0ne_18:06
*** e0ne_ is now known as e0ne18:07
*** e0ne has quit IRC18:59
*** eharney has quit IRC19:08
*** eharney has joined #openstack-stable19:15
mriedemhttps://review.openstack.org/#/c/186065/ is in the gate20:05
*** akrivoka has quit IRC20:35
mriedem^ is merged20:53
mriedemkeep an eye out for ceilometer reqs update sync on stable/juno20:53
mriedemhere is the stable/juno ceilometer reqs sync https://review.openstack.org/#/c/173117/21:10
mriedemthat will get updated at some point for tooz21:11
mriedemhttps://review.openstack.org/#/c/173117/ has the tooz update now21:15
mriedemno idea if tests will pass21:15
mriedemmtreinish: devstack actually installed on this https://review.openstack.org/#/c/173117/21:33
mriedemtempest is running21:33
mriedemi think i might pull a george w. here and say mission accomplished21:34
mtreinishmriedem: yeah that's a good sign21:35
*** mriedem has quit IRC21:51
*** lifeless has joined #openstack-stable21:53
lifelessomganotherchannel21:53
lifelessis the stable requirements wedge fixed?21:53
*** xaeth is now known as xaeth_afk21:54
*** mriedem has joined #openstack-stable22:03
*** xaeth_afk is now known as xaeth22:04
*** bknudson has quit IRC22:06
Davieylifeless: looks like it is.. pending last merge22:12
Davieylifeless: of https://review.openstack.org/#/c/173117/22:13
Daviey(thanks mostly to the heroic effort of mriedem)22:13
mriedemthat's nearly done in the gate queue22:14
mriedemthen stable juno and kilo should be 'ok'22:14
*** xaeth is now known as xaeth_afk22:16
mriedemDaviey: you didn't need to recheck https://review.openstack.org/#/c/173117/ it was already in the gate qeuue22:19
mriedems/was/is/22:19
mriedemDaviey: you can track that stuff by going to http://zuul.openstack.org/ and plug the gerrit id (173117) into the Filters box22:20
Davieymriedem: yeah, i saw that after i pressed submit22:20
Davieymriedem: yeah, i know that!  I was responding to the failed check previously.22:20
mriedemah ok22:20
mriedemhttps://review.openstack.org/#/c/173117/ is merged22:40
mriedemhurray! approve and recheck everything!!!22:40
mriedems/hurray/hurry/22:40
*** derekh_ has quit IRC22:42
mriedemplug for this backport to stable/kilo in nova - has a +2 from me https://review.openstack.org/#/c/176396/22:44
mriedemand this one https://review.openstack.org/#/c/184240/22:47
mriedem^ fixes live migrate for libvirt driver on s390x22:47
*** mriedem has quit IRC23:04

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!