Monday, 2015-08-31

*** sigmavirus24 is now known as sigmavirus24_awa00:22
*** armax has joined #openstack-relmgr-office02:10
*** sigmavirus24_awa is now known as sigmavirus2402:23
*** sigmavirus24 is now known as sigmavirus24_awa02:53
*** sigmavirus24_awa has quit IRC03:25
*** jroll has quit IRC03:26
*** jroll has joined #openstack-relmgr-office03:31
*** sigmavirus24_awa has joined #openstack-relmgr-office03:31
*** sigmavirus24_awa has joined #openstack-relmgr-office03:31
*** ig0r__ has joined #openstack-relmgr-office04:58
*** ig0r_ has quit IRC04:59
*** armax has quit IRC06:28
ttxlifeless: re: netaddr 0.7.16 release causing breakage, wondering why the constraints stuff didn't prevent it... It still is at ==0.7.15 there08:48
openstackgerritMerged openstack-infra/release-tools: Document library release process  https://review.openstack.org/21730709:06
*** ig0r_ has joined #openstack-relmgr-office09:37
*** ig0r__ has quit IRC09:39
*** gordc has joined #openstack-relmgr-office11:43
*** openstackgerrit has quit IRC11:46
*** openstackgerrit has joined #openstack-relmgr-office11:47
sdaguettx: because it doesn't work on unit tests12:18
sdagueall these failures are on unit tests12:19
ttxsdague: Ah, thought I had seen a few integration tests fail, but maybe those were just accidental12:23
sdagueyeh, right now it looks like neutron and horizon unit tests12:24
dhellmanngood morning12:53
* dhellmann is glad to not have any travel lined up for a few weeks12:53
ttxdhellmann: ready for meeting?13:01
dhellmannttx: sorry, yep13:06
*** superdan is now known as dansmith13:35
*** dims has joined #openstack-relmgr-office13:36
*** sigmavirus24_awa is now known as sigmavirus2413:56
ttxdhellmann: switching from pre to post is relatively easy. Just do the setup.cfg bump when the branch is cut as usual, then at some point after tag .0a0 and remove setup.cfg version14:01
dhellmannfor the version updating, I have in mind something like: tag release x.y.z ; create stable branch ; commit minor update to master ; tag master (maybe using an alpha version like x.y+1.0.a1 or just x.y+1.0)14:01
ttxright -- the "commit minor update" part is where setup.cfg was easier: it IS a commit, so you can just branch from the commit before that14:02
dhellmannyes, we tried to be very careful with the ironic switch because I was worried about having 2 patches with the same version14:02
dhellmannwe haven't actually tagged ironic master with a new version, yet14:02
ttxalso that "minor update" will genrate a conflict with the equivalent one on stable branch14:03
dhellmannoh, we don't have a stable branch for ironic yet, either so that's ok14:03
ttxbut it's a short window14:03
dhellmannyes, that's what I was worried about14:03
dhellmannI think we're going to have a 4.0.1 for ironic before they create their stable branch14:04
*** bnemec has joined #openstack-relmgr-office14:05
dhellmannif we start adding stable branch release notes to the main docs, one minor commit we'll always have is to add the page for the new stable branch14:05
ttxso there is no way to avoid the duplicate. You have to tag a different commit and it will generate a wrong number14:06
dhellmannassuming we want each series on its own page14:06
ttxbefore generating a good one14:06
dhellmannyeah14:06
dhellmann:-/14:07
ttxTaking notes14:07
dhellmannI wonder, if we were tagging releases more often, if people would not deploy from master directly.14:08
dhellmannmaybe we don't really want to do that, I'm just thinking out loud14:09
*** jroll has quit IRC14:09
*** jroll has joined #openstack-relmgr-office14:09
ttxdhellmann: we already have the issue with cycle-with-intermediary things14:12
dhellmannhow does swift handle this?14:13
ttxhistorically they didn't do stable series, so they did not encounter this. But notmyname already said that the .y bump on master was not a good idea14:14
ttxsince they want to be able to do bugfix-only releases at the start of a cycle14:15
ttxand the .y bump kind of communciates otherwise14:15
dhellmannyeah14:15
ttxbut then I think it's more of a mindshift14:16
ttxif they want to do a bugfix-only release they should just do it on the stable branch14:16
ttxand land features on master14:16
ttxbut "releasing 4.1.0" is kind of an issue for them14:17
ttxit's like they would benefit from starting the branch in preversion14:18
ttx(it's like everyone would)14:18
dhellmann"starting the branch in preversion"?14:18
ttxi.e. start of a new master branch you push the "next y" in setup.cfg ans start generating 4.1.0pre1243 thingies until you're ready to tag 4.1.014:19
dhellmannso master would be post-version and stable would be pre-version?14:19
ttxno, stable is post, and master is pre until the first tag there14:19
ttxthat solves all issues14:19
dhellmannthat's more or less what we have now, isn't it?14:20
ttxle me script it in the etherpad14:20
ttxnot really, pre stays pre14:20
dhellmannoh, I thought we were doing post-versioning in stable branches14:22
ttxdhellmann: it's a bit of a mess currently14:24
dhellmannttx: your proposal does eliminate the duplicate version problem, though I'm not sure it's really any easier to understand. Let me think about it some more.14:33
ttxyep, it's like the CAP theorem, pick to between simple consistent and accurate14:33
ttxtwo*14:33
ttxmine is consistent and accurate, yours is consistent and simple :)14:34
dhellmannright14:34
ttxnow we need to find which would be simple and accurate :)14:34
ttxprobably current situation14:34
dhellmannno stable branches? :-)14:34
ttx(two separate processes)14:34
ttxI kinda like that we solve the "obligation to bump y" with my proposal though14:35
dhellmannyeah, that does seem like an improvement14:35
ttxwhich will become more and more of a problem as we add intermediary-released things14:36
dhellmannI'll experiment with what happens with pbr if there's a commit after the tag that doesn't update setup.cfg14:36
dhellmannthe release automation is going to need to have the release model accurately expressed in a repository14:36
dhellmannI don't think we want to rely on governance tags for switching between these modes for a given project14:37
ttxagreed. Although with my model everything follows the same pattern. The only difference is whether you tag betas/rcs or not14:38
ttxso then it's easy to switch everyone to the same model (no betas tagged)14:38
dhellmannso you're proposing we do this for libs, too?14:39
ttxI don't see why not14:39
dhellmannmakes sense14:39
dhellmannI wasn't thinking of that, but it wouldn't hurt14:39
ttxlike I say on the pad, I think 2 simple systems is more complex than a single complex one.14:39
dhellmannyeah14:40
ttxit's not as if pbr didn't support both already14:40
ttxheck, once it's in place we don't really care if a project does betas or not14:41
ttxsince there is less adherence in the tooling and processes14:42
ttxok, let's give it more thought over the week, see if it still sounds sane one week from now14:42
dhellmannsounds good14:42
* dhellmann moves inside to avoid the yard service crew14:43
dhellmannttx: I was going to suggest to mriedeman that we not manage sqlalchemy-migrate releases using the releases repo, as in https://review.openstack.org/#/c/218607/ and just do the tags14:49
dhellmannI don't know if we want versions of that lib associated with releases of openstack, since none of our project teams own that library14:49
*** dims has quit IRC14:51
ttxyeah, sounds unmanaged to me14:51
openstackgerritDoug Hellmann proposed openstack/releases: Release Aodh 1.0.0  https://review.openstack.org/21776614:58
openstackgerritDoug Hellmann proposed openstack/releases: Handle errors from git describe  https://review.openstack.org/21889214:58
*** dims has joined #openstack-relmgr-office15:03
*** bnemec has quit IRC15:04
*** bnemec has joined #openstack-relmgr-office15:09
*** sigmavirus24 is now known as sigmavirus24_awa15:09
*** sigmavirus24_awa is now known as sigmavirus2415:17
*** wshao_ has joined #openstack-relmgr-office15:24
*** david-ly_ has joined #openstack-relmgr-office15:31
*** david-ly_ is now known as david-lyle_15:33
*** david-lyle has quit IRC15:33
*** david-lyle_ is now known as david-lyle15:35
*** TravT_ is now known as TravT15:52
*** sigmavirus24 is now known as sigmavirus24_awa15:59
*** wshao_ has quit IRC15:59
*** sigmavirus24_awa is now known as sigmavirus2416:01
*** armax has joined #openstack-relmgr-office16:15
david-lyleIf someone has a chance can you please approve https://review.openstack.org/#/c/216469/  I need to cut another release of django_openstack_auth with the updated requirements for Liberty.16:20
david-lyleit's a Django supported versions change to coincide with upstream Django support16:21
*** TravT has quit IRC16:23
*** TravT has joined #openstack-relmgr-office16:24
dhellmanndavid-lyle: upper-constraints.txt has Django===1.7.10 so you probably want to update that, too16:24
david-lyledhellmann: ok, didn't realize16:25
david-lyleis that scripted or manual?16:25
dhellmannthere's a script to update it, so maybe that's what lifeless was counting on16:25
dhellmannthere's an automated job, that is, but I find it makes more sense to update it with the requirements range change, esp. in this case where you're saying we're testing with an unsupported version16:26
david-lyleso just the latest 1.8 release?16:26
dhellmanndavid-lyle: yeah, you want to set that to the version you actually want us testing with in devstack-gate jobs (it doesn't apply to unit tests, yet)16:27
david-lyleok, will that update with newer 1.8.* releases?16:27
dhellmannI think the automated job does propose updates for patch releases, yes16:28
david-lyleok and in the meantime we know that say 1.8.6 is good16:28
openstackgerritMerged openstack/releases: Add Austin and Bexar index pages  https://review.openstack.org/21816816:32
openstackgerritMerged openstack/releases: Reorder releases  https://review.openstack.org/21818616:33
notmynamedhellmann: ttx: it's easy to do a Y version bump at the start of the cycle (or "simple", if you prefer). I'm completely ok with that. Yes, I think it limits some flexibility. but I also think it's a totally minor thing to do16:33
*** lifeless has quit IRC16:34
david-lyledhellmann: add upper-constaints.txt change for Django patch16:34
david-lylethanks16:34
dhellmannnotmyname: cool. it's a little tricky, because we need some patch to land, and because for a brief window we have pbr generating the same version # for 2 separate patches (on different branches). So ttx's proposal avoids that window at the expense of a bit of complexity16:36
dhellmanndavid-lyle: looking16:37
dhellmanndavid-lyle: +2a16:38
*** lifeless has joined #openstack-relmgr-office16:41
david-lyledhellmann: thank you16:49
*** dims has quit IRC16:55
*** dims has joined #openstack-relmgr-office17:29
*** dims_ has joined #openstack-relmgr-office17:30
*** dims has quit IRC17:30
dims_dhellmann: should our upper-constraints stuff have caught netaddr?17:38
*** ig0r__ has joined #openstack-relmgr-office17:43
*** ig0r_ has quit IRC17:46
sdaguedims_: no, it was unit tests and kilo17:47
sdagueit caught it in master / dsvm jobs17:47
dims_sdague: nice!17:47
sdagueso it worked as expected, where it was implemented17:47
dims_right17:48
lifelessttx: 'unit tests'18:06
sdagueoh, lifeless I saw the damnest fail this morning wrt requirements, let me go find the log18:30
lifelesssdague: k18:33
lifelesssdague: so - I really want to move forward on unit test contraints18:33
lifelesssdague: and not block until we've got one-click-dev-support18:33
lifelesssdague: devs can opt in easily enough right from the start18:33
lifelesssdague: it will be no -worse- than the status today18:34
sdaguelifeless: ok, as long as it evolves towards an intergrated experience18:34
sdaguelifeless: that's where I disagree, because of the confusion of local reproduce18:34
sdaguebut there will be a tradeoff of more working gate18:34
sdaguelifeless: here is the failure - http://logs.openstack.org/86/218286/1/gate/gate-tempest-dsvm-neutron-full/f070942/logs/devstacklog.txt.gz#_2015-08-31_12_54_59_01818:37
sdagueit's a permissions denied failure to write the temp file18:37
sdagueit's shown up twice18:37
sdaguehttp://logstash.openstack.org/#eyJzZWFyY2giOiJcInVwcGVyLWNvbnN0cmFpbnRzLnR4dC50bXBcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQ0MTA0NjE4MTE3NX0=18:37
sdagueI have no idea why that would be a race or what it could be racing on18:38
*** ig0r__ has quit IRC18:48
lifelessthats bizarre18:50
lifeless-> -dev18:51
lifelessor -qa perhaps?18:51
morgandhellmann, ttx. Want to sync up re: m3 when you have a little time.18:51
dims_sdague: lifeless: found one more occurance not related to edit-constraints though - http://logs.openstack.org/07/202207/18/gate/gate-neutron-lbaasv2-dsvm-api/4e704ba/console.html#_2015-08-30_04_17_05_45418:55
jrolldoes each deliverables/liberty/*.yaml need its own launchpad? what do I do for a library (ironic-lib) that shares a launchpad with another project (ironic)18:56
jrolldhellmann: ^18:56
openstackgerritJim Rollenhagen proposed openstack/releases: Add initial ironic-lib release  https://review.openstack.org/21898518:57
jrollrelevant patch ^18:57
jrollnot sure if that works as expected though :)18:57
dims_dhellmann: ttx: when is g-r freeze?19:01
dhellmannmorgan: let me know when you're back to talk about L319:17
morganBack19:17
morganI didnt go far ;)19:17
dhellmannjroll: things that share a launchpad project are considered the same deliverable, and would be tagged together. if that's not true, you need separate launchpad projects19:17
dhellmanndims_: it should be this week, except I think for oslo stuff, but we should confirm that with ttx19:18
dhellmannmorgan: hi!19:18
dims_dhellmann: y, was wondering when i can release oslo.libs with g-r and translation updates19:18
morgandhellmann: hope to ask for keystoneauth 1.0 this week too fwiw19:18
dhellmannmorgan: sooner is better19:19
morganNot that it has to hit g-r because nothing uses it.19:19
morganBut it would be nice to 1.0 it before g-r freeze19:19
dhellmanndims_: good question, and I'm not seeing that date called out on https://wiki.openstack.org/wiki/Liberty_Release_Schedule19:19
morganJust so we are able to start working with it.19:19
morganG-r freeze has historically been feature freeze.19:20
dhellmannyeah, that's thursday19:20
morganSo oslo probably follows right after that19:20
morgan?19:20
morganAnyway. L3 keystone.19:21
dims_g-r freeze -> oslo libs with g-r updates -> then other libs -> then services i guess19:21
dhellmannwith the constraints system in place it should be possible to push that date out further, but I don't know if we've talked about actually changing it19:21
dhellmanndims_: since ttx is probably offline, do you want to send an email about the dates?19:21
dims_dhellmann: ack will do19:22
dhellmannmorgan: yes, let's talk milestone19:22
morganSo lots of stuff to muck with still this week. I hope we can get the few bps closed out19:22
morganMy goal is to have everything approved by tomorrow.19:22
dhellmannok19:22
morganAnd require FFE/punt till m if not approved19:23
jrolldhellmann: define "tagged together"? same version identifier?19:23
dhellmannmorgan: ttx created https://launchpad.net/keystone/+milestone/liberty-rc1 for you to populate with the things blocking the release candidate19:23
dhellmannjroll: yes, same version same time19:23
dhellmannjroll: I think you want to set up a second launchpad bug tracker in this case19:23
jrolldhellmann: ok, anything special to make the launchpad?19:23
jrollagree19:23
dhellmannjroll: you should be OK if you follow the instructions in http://docs.openstack.org/infra/manual/creators.html related to LP19:24
morganI hope rc1 is empty this time around :P19:24
jrolldhellmann: perfect, ty19:24
dhellmannjroll: thanks for staying on top of this!19:24
dhellmannmorgan: it is right now, yes :-)19:24
morgandhellmann: i just wanted to sync before we hit tomorrow.19:24
dhellmannsure19:25
morganI will troll through any bugs tonight/tomorrow to see if they are l3 blocking (unlikely)19:25
dhellmannthere's quite a few in-progress items in https://launchpad.net/keystone/+milestone/liberty-3 so if you want to look those over and remove any that aren't actual blockers that would be a good idea19:25
morganor need to hit rc19:25
morganYah.19:25
morganThat is the plan19:25
dhellmann++19:25
morganIll also once-over keystone middleware19:25
morganClient i want to check but we should plan a release on wednesday if anything has landed19:26
morganThen we can evaluate g-r bump19:26
morganPycadf should be good. And like i said keystoneauth will hopefully be 1.0 this week. But not needing in g-r (but i would like it to be for sdk)19:27
dhellmannmorgan: even if you don't need to update the mins for those releases, it would be good to make sure the constraint updates work so we're testing with the new releases19:27
morganIf we dont 1.0 keystoneauth i'd be "ok" with putting a 0.x in g-r but....19:28
morganI would rather not do a pre1.0 in g-r19:28
jrolldhellmann: one more thing, I assume I should follow all of the pypi bits etc in that doc?19:28
morgandhellmann: thnx.19:28
dhellmannjroll: yes, if those haven't all been done already (would be good to check either way)19:29
jrollthanks19:29
dhellmannmorgan: it sounds like you have it all in hand, thanks19:29
openstackgerritJim Rollenhagen proposed openstack/releases: Add initial ironic-lib release  https://review.openstack.org/21898519:33
jrolldhellmann: ^ should be good to go now, pypi exists and has openstackci user attached, https://launchpad.net/ironic-lib is a thing19:34
jrollit's already release:managed in governance19:34
dhellmannjroll: looks good, I'll go ahead and do that release now19:41
jrollthanks much!19:42
* jroll preps g-r patch19:42
dhellmannjroll: the check queue is pretty full, so it may take a while19:42
jrollyeah, no worries19:42
jrollso now, more philosophical question19:43
jrollI want to add this g-r unpinned in order to be able to use newer versions of it in ironic during reqs freeze19:43
jrolldoes upper-constraints break my assumption that this is possible?19:43
dhellmannyes19:43
jrollok, so we can't use new releases of this during freeze, without getting a freeze exception19:44
dhellmannwe'll also be more strict about actually doing releases during that freeze period19:44
jrollwill exceptions be a big deal given only ironic uses this?19:44
jrollnod19:44
dhellmannpart of the point of the freeze is to give deployers a still target for what to package19:44
jroll(eventually both ironic and ironic-python-agent will use this, but not yet)19:45
jrollright19:45
dhellmannso even though only ironic would use this, we would still be pretty strict about not updating just for feature work19:46
dhellmannbecause that could destabilize the gate for everyone else19:46
jrollrealistically its refactoring work, but yeah I get it19:46
jrollyeah, transient deps etc19:46
dhellmannright19:46
dhellmannand ironic is installed from source in the gate. if we were installing servers from packages, that might make it a different story, but that has its own drawbacks -- punctuated integration periods being the biggest19:47
jrollsure19:47
jrollreqs freeze is this week?19:48
dhellmannI expect it to be thursday with the feature freeze19:48
jrollnod19:48
jrollalright, thanks much :)19:48
dhellmannjroll: I see quite a few unreleased changes in ironic, are you all planning to do a 4.1 release by the end of the cycle?19:49
dhellmannjroll: http://paste.openstack.org/show/43550419:50
jrolldhellmann: yeah, so we have a couple patches we wanted to drop as 4.0.1 ASAP, and then a 4.1.0 around openstack RC time, to become stable/liberty19:50
dhellmanncool, sounds good19:50
dhellmannjroll: with c17108d in place, the next release should be 4.119:51
dhellmannthe rest are bug fixes, it seems19:51
dhellmannbut that's HEAD right now19:51
jrolldhellmann: why 4.1?19:51
jrollbecause library updates?19:51
dhellmanncompatible requirements changes increment the minor version number19:51
jrollinteresting19:52
jrollso basically almost every release will be a minor version bump19:52
dhellmannoff of master, yes19:52
jrollyeah19:52
jrollI'm skeptical that we'll ever do a major version bump, since we never intend to require a breaking upgrade sort of thing19:53
jroll(it could happen, yes, but the goal is never)19:53
dhellmannyeah, we (as a community) need to talk about why we increment the major version # for servers19:53
dhellmannit might be useful to raise it each cycle, for example19:54
jrollindeed19:54
dhellmannbreaking changes are sort of the obvious case, but we try to avoid those19:54
jrollI almost like swift's method, but it definitely isn't semver19:54
dhellmannany time we have a schema migration rollup might be another, but those are seeming to go away, too19:54
dhellmannyeah, semver is sort of an odd fit for an API service19:54
jrollmhm19:55
openstackgerritMatt Riedemann proposed openstack/releases: Release os-brick 0.4.0  https://review.openstack.org/21901320:01
*** david-lyle has quit IRC20:01
*** david-lyle has joined #openstack-relmgr-office20:06
notmynamejroll: how so? (swift not being semver)20:07
jrollnotmyname: AIUI the major version is "marketing based"20:07
jrollor that's what I've heard, at least20:07
notmynamelol20:07
jrolllike "lots of new features" rather than "breaks backwards compat"20:07
notmynamewe bumped from 1.x to 2.x because (1) yes there was a significant new feature (biggest ever) and it was good to have something that designated that. and (2) there were some upgrade+downgrade issues there. you can' really upgrade from 1.x to 2.x and then downgrade and still have access to all of your data20:09
notmynameso yes there were some marketing reasons :-)20:09
jrollheh20:09
jrolllike I said, I kind of like it20:09
jrollit's better than "never bump major version ever"20:10
notmynameI look at is a way to communicate to users (ops) that I never have another chance of talking with20:11
notmynameI can stand up in front of a crowd or send an email, but most people will never see/read that20:11
jrollheh, yep20:11
*** dims has joined #openstack-relmgr-office20:12
notmynamebut the version number is soemthing that everyone will see. so versioning major, minor, trival releases (so they know what to expect when packaging/deploying) is good20:12
*** dims_ has quit IRC20:14
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: clarify duties in library release process  https://review.openstack.org/21901720:18
dhellmannlifeless: can you give this a quick look? the bug is blocking some first-time releases: https://review.openstack.org/#/c/218892/120:55
*** dims has joined #openstack-relmgr-office20:57
*** sigmavirus24 is now known as sigmavirus24_awa22:15
*** gordc has quit IRC23:02

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!