clarkb | jeblair so I think we can do that it just requires upgrading all services on onehost/venv together | 00:00 |
---|---|---|
jeblair | jogo: 2) because it prohibits us from placing version caps on stable branches in the case that we can not find an overlapping dependency that works with both | 00:00 |
*** zz_avozza is now known as avozza | 00:00 | |
jeblair | clarkb: i think we're all in agreement on that | 00:00 |
clarkb | which sdague was opposed to when we talked about it | 00:00 |
jeblair | clarkb: the wrinkle is ncpu partial upgrade | 00:00 |
jeblair | clarkb: apparently grenade used to work like that, which makes sense to me. | 00:00 |
clarkb | +1 | 00:00 |
clarkb | (I was aproponent for this a little while back but was the only one) | 00:01 |
*** bradjones has joined #openstack-infra | 00:01 | |
jeblair | clarkb: so partial upgrades need per-component environments, and each environment needs a full shutdown/upgrade/start | 00:01 |
jeblair | clarkb: all-in-one upgrades, it doesn't matter whether we use per-component envs or not. but regardless of the number of envs (one or many) it or they need a full stop/upgrade/start | 00:02 |
jeblair | clarkb: yeah, it does not seem feasible to me to handle the partial upgrade case without environments/containers/equiv | 00:02 |
clarkb | yup | 00:03 |
anteaya | notmyname: zaro is probably the best person to talk to about gerrit | 00:03 |
jeblair | clarkb: i still very much think that at the end of the process, each release of openstack should function with the same deps. but we can ensure that with requirements check jobs and testing | 00:03 |
jeblair | clarkb: including perhaps the simple install-only all-in-one devstack test | 00:03 |
*** yfried|afk is now known as yfried | 00:04 | |
jogo | jeblair: I was thinking standard devstack wouldn't use venvs | 00:04 |
jogo | and grenade jobs would | 00:04 |
mordred | clarkb: I split 141677 and also added https://review.openstack.org/141946 | 00:04 |
*** zz_zz_zz_sabari is now known as sabari | 00:06 | |
dtroyer | jogo: that'll be hard as grenade just calls the devstack functions to do the start of new services, so devstack has to run either way in that case | 00:06 |
jogo | dtroyer: right, step 1 is teach grenade about venvs | 00:06 |
jogo | step 2 is teach stable/juno grenade about venvs | 00:06 |
jogo | and make those off by default | 00:07 |
dtroyer | no, teach devstack about venvs. grenade doens't know anything about actually running services | 00:07 |
jogo | that is what I was thinking, but apparently not what I wrote | 00:07 |
jeblair | jogo: | 00:07 |
dtroyer | well ok then ;) | 00:07 |
*** yamamoto has joined #openstack-infra | 00:08 | |
jeblair | jogo: very specifically, the thing that is broken for us right now is that we would like to release oslo.db 1.0.X, and then cap juno at <1.1, however, since master is at >=1.1 we are unable to do that because of the upgrade | 00:08 |
jogo | jeblair: excellent, thanks | 00:09 |
jeblair | jogo: so that's the friendly version of the problem which we can work around, with some difficulty, because we think we can construct a release that will satisfy all the requirements. but if it were anyone other than us, we'd be sol. | 00:09 |
*** bitblt has joined #openstack-infra | 00:10 | |
*** avozza is now known as zz_avozza | 00:10 | |
mordred | dhellmann: updated https://review.openstack.org/141946 to address your comments from 141677 | 00:11 |
*** zz_avozza is now known as avozza | 00:11 | |
*** dannywilson has quit IRC | 00:12 | |
*** Masahiro has joined #openstack-infra | 00:12 | |
*** dannywilson has joined #openstack-infra | 00:12 | |
*** yfried is now known as yfried|afk | 00:14 | |
*** ddieterly has quit IRC | 00:14 | |
*** sputnik1_ has joined #openstack-infra | 00:15 | |
*** fandi has joined #openstack-infra | 00:15 | |
*** sputnik13 has quit IRC | 00:15 | |
*** bitblt has quit IRC | 00:17 | |
*** dannywilson has quit IRC | 00:17 | |
*** Masahiro has quit IRC | 00:17 | |
anteaya | clarkb fungi jeblair any reason to hold off +A'ing clarks make prerelease and release pipelines match pep440 patch? https://review.openstack.org/#/c/141831/1 | 00:20 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Bugs _in_ this project go in StoryBoard now https://review.openstack.org/139120 | 00:20 |
*** sputnik1_ is now known as sputnik13 | 00:20 | |
clarkb | anteaya its probably worth getting eyes on | 00:21 |
anteaya | I will just review then and not +A | 00:21 |
*** sabari is now known as zz_sabari | 00:27 | |
*** mtanino has quit IRC | 00:27 | |
*** fandi has quit IRC | 00:28 | |
*** annegent_ has joined #openstack-infra | 00:29 | |
*** jerryz has joined #openstack-infra | 00:33 | |
*** teran has joined #openstack-infra | 00:34 | |
*** annegent_ has quit IRC | 00:34 | |
*** groknix has joined #openstack-infra | 00:35 | |
*** david-lyle is now known as david-lyle_afk | 00:35 | |
*** fandi has joined #openstack-infra | 00:35 | |
*** groknix has quit IRC | 00:35 | |
*** dizquierdo has quit IRC | 00:35 | |
*** amitgandhinz has joined #openstack-infra | 00:36 | |
*** pc_m has quit IRC | 00:37 | |
*** dims has joined #openstack-infra | 00:38 | |
openstackgerrit | Ramy Asselin proposed openstack-infra/infra-specs: Add spec for in-tree 3rd party ci solution https://review.openstack.org/139745 | 00:39 |
*** teran has quit IRC | 00:39 | |
*** oomichi has joined #openstack-infra | 00:41 | |
*** amitgandhinz has quit IRC | 00:41 | |
*** ZZelle has quit IRC | 00:43 | |
jogo | mordred: https://review.openstack.org/#/c/10351/ | 00:43 |
jogo | did this ever do anything? | 00:44 |
*** dpaterson has quit IRC | 00:51 | |
*** emagana has joined #openstack-infra | 00:51 | |
*** Masahiro has joined #openstack-infra | 00:51 | |
*** michchap_ has joined #openstack-infra | 00:52 | |
*** michchap has quit IRC | 00:54 | |
*** emagana has quit IRC | 00:56 | |
*** alexpilotti has joined #openstack-infra | 00:58 | |
*** unicell has joined #openstack-infra | 00:59 | |
*** otter768 has joined #openstack-infra | 01:00 | |
jogo | https://github.com/openstack-dev/devstack says this is oneiric powered development environment for openstack | 01:00 |
jogo | that doesn't sound right | 01:00 |
pleia2 | hah, it was a couple years ago | 01:01 |
jogo | I didn't see any description in project-config | 01:02 |
anteaya | jhesketh: I need to see if I can get some sleep see you at 0800 for the meeting | 01:02 |
*** camunoz has quit IRC | 01:04 | |
*** sabeen3 has joined #openstack-infra | 01:04 | |
pleia2 | jogo: yeah, I just grepped through too, I wonder if it's something funny with our github initial sync script | 01:04 |
jhesketh | anteaya: okay, last I read though there was still disagreements about that meeting | 01:04 |
*** sabeen1 has quit IRC | 01:04 | |
jhesketh | I didn't feel like that was resolved unless I've missed something | 01:05 |
*** otter768 has quit IRC | 01:05 | |
*** ChuckC has quit IRC | 01:05 | |
*** avozza is now known as zz_avozza | 01:06 | |
*** mtanino has joined #openstack-infra | 01:06 | |
openstackgerrit | Merged openstack-infra/project-config: Fix api-wg job names and placement https://review.openstack.org/141306 | 01:06 |
jogo | pleia2: yeah, maybe we don't erase if its empty | 01:07 |
*** markmcclain has quit IRC | 01:07 | |
*** mmaglana has quit IRC | 01:08 | |
pleia2 | hmm, we didn't use an upstream: when pulling in devstack, I don't actually know how it was done | 01:09 |
anteaya | jhesketh: I am chairing a meeting at 0800 | 01:09 |
jogo | pleia2: o_O | 01:09 |
anteaya | jhesketh: anyone who feels like showing up can join me | 01:09 |
pleia2 | jogo: at least, it's not in projects.yaml | 01:09 |
zxiiro | With JJB is it possible to make variable variables? | 01:11 |
jhesketh | anteaya: okay, fair enough | 01:11 |
anteaya | jhesketh: thanks | 01:11 |
zxiiro | I want to pass a value that it, itself is a variable to a job-template | 01:11 |
*** sarob has quit IRC | 01:13 | |
*** sputnik13 has quit IRC | 01:15 | |
*** sputnik13 has joined #openstack-infra | 01:15 | |
jyuso | anteaya: hi:) | 01:16 |
*** camunoz has joined #openstack-infra | 01:20 | |
*** Alexandra_ has joined #openstack-infra | 01:22 | |
*** asettle has quit IRC | 01:22 | |
*** Alexandra_ is now known as asettle | 01:23 | |
*** wenlock has quit IRC | 01:23 | |
*** ryanpetrello has quit IRC | 01:27 | |
*** annegent_ has joined #openstack-infra | 01:30 | |
*** che-arne|2 has joined #openstack-infra | 01:31 | |
*** ryanpetrello has joined #openstack-infra | 01:32 | |
*** sputnik13 has quit IRC | 01:33 | |
*** che-arne has quit IRC | 01:33 | |
*** prad has quit IRC | 01:33 | |
*** yaguang has joined #openstack-infra | 01:34 | |
*** annegent_ has quit IRC | 01:35 | |
*** julim has quit IRC | 01:36 | |
*** teran has joined #openstack-infra | 01:36 | |
openstackgerrit | Spencer Krum proposed openstack-infra/infra-specs: Spec to refactor puppet code in openstack_project https://review.openstack.org/137471 | 01:37 |
*** mmaglana has joined #openstack-infra | 01:40 | |
*** teran has quit IRC | 01:41 | |
*** ChuckC has joined #openstack-infra | 01:42 | |
*** hdd has quit IRC | 01:43 | |
jogo | hmm I tried running devstack locally and got http://paste.openstack.org/show/151513/ | 01:44 |
jogo | dhellmann: ^ | 01:46 |
*** lttrl has quit IRC | 01:46 | |
*** bdpayne has quit IRC | 01:46 | |
*** alexpilotti has quit IRC | 01:47 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Push dg-tempest-dsvm-full logs to swift https://review.openstack.org/141668 | 01:48 |
*** mmaglana has quit IRC | 01:50 | |
*** BadCub02 has quit IRC | 01:51 | |
*** emagana has joined #openstack-infra | 01:52 | |
zxiiro | With JJB is it possible to set the JDK used by the build? I can't find any docs on how to do so except one which lets you configure it for the sonar plugin, i want to set it job wide. | 01:53 |
*** emagana has quit IRC | 01:56 | |
*** mtanino has quit IRC | 02:05 | |
*** dims has quit IRC | 02:06 | |
*** dims has joined #openstack-infra | 02:06 | |
*** sarob has joined #openstack-infra | 02:06 | |
heyongli | jogo, the blueprints for the third-party CI pci test cases is sent out: https://review.openstack.org/#/c/141270/ | 02:07 |
*** gyee has quit IRC | 02:09 | |
*** yaguang has quit IRC | 02:10 | |
*** yaguang has joined #openstack-infra | 02:11 | |
*** dims has quit IRC | 02:11 | |
*** shashankhegde has quit IRC | 02:13 | |
*** spzala has joined #openstack-infra | 02:14 | |
*** oomichi has quit IRC | 02:16 | |
*** dhp_ has joined #openstack-infra | 02:18 | |
*** dhp has quit IRC | 02:19 | |
*** dhp_ is now known as dhp | 02:19 | |
*** ryanpetrello has quit IRC | 02:19 | |
*** sarob has quit IRC | 02:19 | |
*** adalbas has quit IRC | 02:19 | |
*** camunoz has quit IRC | 02:26 | |
*** zz_avozza is now known as avozza | 02:27 | |
*** yaguang has quit IRC | 02:29 | |
*** annegent_ has joined #openstack-infra | 02:29 | |
*** yaguang has joined #openstack-infra | 02:31 | |
*** annegent_ has quit IRC | 02:34 | |
*** melwitt has quit IRC | 02:34 | |
*** teran has joined #openstack-infra | 02:37 | |
*** avozza is now known as zz_avozza | 02:38 | |
*** camunoz has joined #openstack-infra | 02:39 | |
*** zxiiro has quit IRC | 02:40 | |
*** teran has quit IRC | 02:41 | |
*** Ryan_Lane has quit IRC | 02:42 | |
*** emagana has joined #openstack-infra | 02:43 | |
*** ivar-laz_ has joined #openstack-infra | 02:45 | |
*** whayutin_ has quit IRC | 02:46 | |
*** emagana has quit IRC | 02:48 | |
*** wuhg has joined #openstack-infra | 02:48 | |
*** zxiiro has joined #openstack-infra | 02:48 | |
*** ivar-lazzaro has quit IRC | 02:49 | |
*** emagana has joined #openstack-infra | 02:50 | |
*** jaypipes has joined #openstack-infra | 02:50 | |
*** mriedem has quit IRC | 02:51 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Update TODO file https://review.openstack.org/141965 | 02:51 |
*** koolhead17 has joined #openstack-infra | 02:53 | |
*** emagana has quit IRC | 02:54 | |
*** dims has joined #openstack-infra | 02:59 | |
*** KanagarajM has joined #openstack-infra | 02:59 | |
*** mmaglana has joined #openstack-infra | 03:01 | |
*** otter768 has joined #openstack-infra | 03:01 | |
*** Masahiro has quit IRC | 03:02 | |
*** Masahiro has joined #openstack-infra | 03:02 | |
*** annegent_ has joined #openstack-infra | 03:03 | |
*** koolhead17 has quit IRC | 03:03 | |
*** jyuso has quit IRC | 03:03 | |
*** annegent_ has quit IRC | 03:05 | |
*** mmaglana has quit IRC | 03:05 | |
*** otter768 has quit IRC | 03:06 | |
*** signed8bit has joined #openstack-infra | 03:08 | |
*** rwsu has quit IRC | 03:09 | |
*** patrickeast has quit IRC | 03:13 | |
*** signed8bit has quit IRC | 03:21 | |
*** koolhead17 has joined #openstack-infra | 03:23 | |
*** koolhead17 has joined #openstack-infra | 03:23 | |
*** fandi has quit IRC | 03:25 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add a contributing file https://review.openstack.org/141968 | 03:25 |
*** sabeen3 has quit IRC | 03:26 | |
*** zz_avozza is now known as avozza | 03:30 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add --average option to sql2subunit cli https://review.openstack.org/132119 | 03:31 |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Update TODO file https://review.openstack.org/141965 | 03:31 |
*** mmaglana has joined #openstack-infra | 03:32 | |
*** boris-42 has quit IRC | 03:33 | |
*** KanagarajM has quit IRC | 03:33 | |
*** jyuso has joined #openstack-infra | 03:33 | |
*** teran has joined #openstack-infra | 03:37 | |
*** avozza is now known as zz_avozza | 03:40 | |
*** emagana has joined #openstack-infra | 03:41 | |
*** teran has quit IRC | 03:42 | |
*** mbacchi has quit IRC | 03:43 | |
*** zz_sabari is now known as sabari | 03:46 | |
*** dims has quit IRC | 03:49 | |
*** marun has quit IRC | 03:52 | |
*** oomichi has joined #openstack-infra | 03:53 | |
*** oomichi has quit IRC | 03:54 | |
*** signed8bit has joined #openstack-infra | 04:00 | |
*** liusheng has quit IRC | 04:00 | |
*** liusheng has joined #openstack-infra | 04:01 | |
*** signed8bit has quit IRC | 04:01 | |
*** funzo has quit IRC | 04:04 | |
*** funzo has joined #openstack-infra | 04:05 | |
*** radez is now known as radez_g0n3 | 04:06 | |
*** armax has joined #openstack-infra | 04:08 | |
*** ivar-laz_ has quit IRC | 04:17 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add a contributing file https://review.openstack.org/141968 | 04:19 |
openstackgerrit | Matthew Treinish proposed openstack-infra/elastic-recheck: Update wording in the CONTRIBUTING.rst file https://review.openstack.org/141978 | 04:19 |
*** mmaglana has left #openstack-infra | 04:21 | |
jogo | mtreinish: do you know why we are still seeign the SQLA error in the gate? http://logs.openstack.org/34/141834/1/gate//gate-grenade-dsvm/26b0e6b//logs/old/screen-s-proxy.txt.gz | 04:21 |
*** sabari is now known as zz_sabari | 04:29 | |
*** zz_avozza is now known as avozza | 04:31 | |
*** zz_dimtruck has quit IRC | 04:35 | |
*** lbragstad has quit IRC | 04:35 | |
*** baoli has quit IRC | 04:35 | |
*** vishy has quit IRC | 04:35 | |
*** wuhg has quit IRC | 04:36 | |
*** jraim_ has quit IRC | 04:36 | |
*** sileht has quit IRC | 04:36 | |
*** fungi has quit IRC | 04:36 | |
*** Kiall has quit IRC | 04:36 | |
*** gus has quit IRC | 04:36 | |
*** Kiall has joined #openstack-infra | 04:37 | |
*** wuhg has joined #openstack-infra | 04:38 | |
*** zz_dimtruck has joined #openstack-infra | 04:38 | |
*** teran has joined #openstack-infra | 04:38 | |
*** lbragstad has joined #openstack-infra | 04:38 | |
*** jraim has joined #openstack-infra | 04:38 | |
*** zz_dimtruck is now known as dimtruck | 04:38 | |
*** gus has joined #openstack-infra | 04:39 | |
*** sileht has joined #openstack-infra | 04:40 | |
*** vishy has joined #openstack-infra | 04:40 | |
*** fungi has joined #openstack-infra | 04:40 | |
*** avozza is now known as zz_avozza | 04:41 | |
*** koolhead_ has joined #openstack-infra | 04:43 | |
*** teran has quit IRC | 04:43 | |
*** yfried|afk is now known as yfried | 04:43 | |
*** koolhead17 has quit IRC | 04:44 | |
*** melwitt has joined #openstack-infra | 04:52 | |
*** ayoung has quit IRC | 04:52 | |
*** yfried is now known as yfried|afk | 04:56 | |
*** gnuoy has quit IRC | 05:00 | |
*** jamespage has quit IRC | 05:00 | |
*** gnuoy has joined #openstack-infra | 05:01 | |
*** jamespage has joined #openstack-infra | 05:01 | |
*** yaguang has quit IRC | 05:02 | |
*** achanda has joined #openstack-infra | 05:02 | |
*** otter768 has joined #openstack-infra | 05:02 | |
*** yaguang has joined #openstack-infra | 05:03 | |
*** hdd has joined #openstack-infra | 05:03 | |
*** shashankhegde has joined #openstack-infra | 05:05 | |
*** otter768 has quit IRC | 05:07 | |
*** sarob has joined #openstack-infra | 05:08 | |
*** yfried|afk is now known as yfried | 05:12 | |
*** talluri has joined #openstack-infra | 05:13 | |
*** yfried is now known as yfried|afk | 05:25 | |
*** reed has quit IRC | 05:25 | |
*** reed has joined #openstack-infra | 05:28 | |
*** yfried|afk is now known as yfried | 05:28 | |
*** hdd has quit IRC | 05:31 | |
*** zz_avozza is now known as avozza | 05:32 | |
*** shashankhegde has quit IRC | 05:34 | |
*** nelsnelson has quit IRC | 05:35 | |
*** oomichi has joined #openstack-infra | 05:38 | |
*** teran has joined #openstack-infra | 05:39 | |
*** avozza is now known as zz_avozza | 05:41 | |
*** harlowja is now known as harlowja_away | 05:42 | |
*** asettle has quit IRC | 05:43 | |
*** teran has quit IRC | 05:44 | |
*** yfried has quit IRC | 05:49 | |
*** sarob has quit IRC | 05:52 | |
*** achanda has quit IRC | 05:53 | |
*** teran has joined #openstack-infra | 05:58 | |
*** boris-42 has joined #openstack-infra | 05:59 | |
*** sarob has joined #openstack-infra | 05:59 | |
*** oomichi has quit IRC | 06:02 | |
*** nikil22 has joined #openstack-infra | 06:03 | |
*** achanda has joined #openstack-infra | 06:03 | |
*** bradjones has quit IRC | 06:07 | |
*** bradjones has joined #openstack-infra | 06:10 | |
*** vigneshvar has joined #openstack-infra | 06:12 | |
*** dannywilson has joined #openstack-infra | 06:14 | |
*** ZZelle has joined #openstack-infra | 06:17 | |
*** rmcall has joined #openstack-infra | 06:19 | |
*** mrmartin has joined #openstack-infra | 06:22 | |
*** emagana has quit IRC | 06:23 | |
*** rmcall has quit IRC | 06:24 | |
*** rmcall has joined #openstack-infra | 06:25 | |
*** dannywilson has quit IRC | 06:27 | |
*** dannywilson has joined #openstack-infra | 06:28 | |
*** vigneshvar has quit IRC | 06:28 | |
*** dannywilson has quit IRC | 06:32 | |
*** bradjones has quit IRC | 06:35 | |
*** reed has quit IRC | 06:35 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Push dg-tempest-dsvm-full logs to swift https://review.openstack.org/141668 | 06:37 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Rename zuul-swift-upload jobs to use hypens https://review.openstack.org/141942 | 06:37 |
*** nuritv has joined #openstack-infra | 06:41 | |
*** zz_avozza is now known as avozza | 06:41 | |
*** shashankhegde has joined #openstack-infra | 06:41 | |
*** wenlock has joined #openstack-infra | 06:41 | |
*** stevemar has quit IRC | 06:46 | |
*** zz_sabari is now known as sabari | 06:48 | |
*** wenlock has quit IRC | 06:53 | |
*** vigneshvar has joined #openstack-infra | 06:54 | |
*** yfried has joined #openstack-infra | 06:54 | |
*** emagana has joined #openstack-infra | 06:54 | |
*** tnovacik has joined #openstack-infra | 06:56 | |
*** emagana has quit IRC | 06:58 | |
*** rmcall has quit IRC | 07:01 | |
*** jamielennox is now known as jamielennox|away | 07:01 | |
nikil22 | hi in CI system. the devstack-gate has a function called pre_test_hook. So is this the proper place to enable few drivers and then start the devstack instllation . Like i want to change the default neutron driver to different one in neutron.conf | 07:03 |
openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 | 07:03 |
*** otter768 has joined #openstack-infra | 07:03 | |
*** shashankhegde has quit IRC | 07:03 | |
openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Check that Gerrit ACL files are normalized https://review.openstack.org/140821 | 07:04 |
*** sarob has quit IRC | 07:06 | |
*** yamamoto has quit IRC | 07:06 | |
*** yolanda has joined #openstack-infra | 07:07 | |
*** otter768 has quit IRC | 07:08 | |
*** avozza is now known as zz_avozza | 07:08 | |
*** yolanda has quit IRC | 07:10 | |
*** achanda has quit IRC | 07:10 | |
*** _nadya_ has joined #openstack-infra | 07:11 | |
*** achanda has joined #openstack-infra | 07:11 | |
*** teran has quit IRC | 07:12 | |
*** wenlock has joined #openstack-infra | 07:15 | |
*** achanda has quit IRC | 07:16 | |
*** cnesa has joined #openstack-infra | 07:16 | |
*** pcaruana has joined #openstack-infra | 07:18 | |
*** ZZelle has quit IRC | 07:22 | |
*** tnovacik has quit IRC | 07:24 | |
*** Longgeek has joined #openstack-infra | 07:24 | |
*** e0ne has joined #openstack-infra | 07:26 | |
*** sweston is now known as sweston_away | 07:27 | |
*** koolhead_ has quit IRC | 07:30 | |
*** achanda has joined #openstack-infra | 07:34 | |
*** teran has joined #openstack-infra | 07:34 | |
*** yamamoto has joined #openstack-infra | 07:35 | |
e0ne | hi all. does anybody know why almost all check-grenade-dsvm faield on gates? | 07:36 |
openstackgerrit | Merged openstack-infra/project-config: Run acceptance tests without rake https://review.openstack.org/141728 | 07:38 |
*** nuritv has quit IRC | 07:38 | |
*** Nuritv_ has joined #openstack-infra | 07:39 | |
*** HeOS has quit IRC | 07:39 | |
*** teran has quit IRC | 07:39 | |
*** Nuritv_ is now known as nuritv | 07:40 | |
*** Murad_ has joined #openstack-infra | 07:41 | |
Murad_ | how to prevent keyboard from posting back to gerrit? | 07:41 |
*** belmoreira has joined #openstack-infra | 07:43 | |
AJaeger | e0ne, see the mail "oslo.db 1.2.1 release coming to fix stable/juno" on openstack-dev | 07:44 |
e0ne | AJaeger: but i'm looking on master | 07:45 |
AJaeger | e0ne, grenade does update testing from juno to master... | 07:45 |
e0ne | AJaeger: oh, thanks! | 07:46 |
AJaeger | e0ne, so have patience until this problem got fixed, please | 07:46 |
*** e0ne has quit IRC | 07:51 | |
*** liusheng has quit IRC | 07:51 | |
*** jyuso has quit IRC | 07:52 | |
*** liusheng has joined #openstack-infra | 07:52 | |
*** Guest24100 has joined #openstack-infra | 07:54 | |
*** emagana has joined #openstack-infra | 07:55 | |
*** jyuso has joined #openstack-infra | 07:57 | |
*** yamamoto has quit IRC | 07:58 | |
wuhg | http://status.openstack.org/elastic-recheck/#1402747 is the cause of http://logs.openstack.org/50/118450/11/check//check-grenade-dsvm/6c0b211/ failure? | 07:58 |
*** jpich has joined #openstack-infra | 07:58 | |
*** emagana has quit IRC | 07:59 | |
wuhg | oh, so many check-grenade-dsvm failure , | 07:59 |
wuhg | i guess http://status.openstack.org/elastic-recheck/#1402747 is the problem | 08:00 |
*** wenlock has quit IRC | 08:01 | |
AJaeger | wuhg, in fixing the setuptools 8 failures, the team encountered a couple of other problems and fixed them... | 08:01 |
AJaeger | wuhg, see the mail "oslo.db 1.2.1 release coming to fix stable/juno" on openstack-dev | 08:01 |
*** sarob has joined #openstack-infra | 08:01 | |
wuhg | AJaeger: ok ,thanks | 08:01 |
anteaya | Murad_: are you attending the third-party meeting? | 08:02 |
Murad_ | yes, is the channel openstack-meeting? | 08:02 |
nikil22 | anteaya : may i know when is third-party meeting time and channel ? | 08:03 |
anteaya | Murad_: yes | 08:03 |
Murad_ | I don't see anybody there | 08:03 |
anteaya | nikil22: in #openstack-meeting right now | 08:03 |
anteaya | Murad_: in #openstack-meeting | 08:03 |
Murad_ | now I see, it seems that it was frozen | 08:04 |
anteaya | nikil22: I don't see your nick in #openstack-meeting, can you find the channel? | 08:05 |
*** yamamoto has joined #openstack-infra | 08:06 | |
*** Murad_ has quit IRC | 08:06 | |
*** achanda has quit IRC | 08:08 | |
*** zz_avozza is now known as avozza | 08:09 | |
*** yamamoto has quit IRC | 08:10 | |
*** achanda has joined #openstack-infra | 08:15 | |
*** yamamoto has joined #openstack-infra | 08:15 | |
*** amuller has joined #openstack-infra | 08:15 | |
*** mrunge has joined #openstack-infra | 08:19 | |
*** yamamoto has quit IRC | 08:20 | |
*** yamamoto has joined #openstack-infra | 08:21 | |
*** melwitt has quit IRC | 08:23 | |
*** yamamoto has quit IRC | 08:25 | |
*** teran has joined #openstack-infra | 08:29 | |
*** ala_ has joined #openstack-infra | 08:31 | |
nikil22 | anteanya: thanks i was afk | 08:32 |
*** cnesa has quit IRC | 08:32 | |
*** arxcruz has joined #openstack-infra | 08:33 | |
*** ZZelle__ is now known as ZZelle | 08:35 | |
*** bmwiedemann has joined #openstack-infra | 08:38 | |
*** Krast has joined #openstack-infra | 08:42 | |
*** k4n0 has joined #openstack-infra | 08:47 | |
*** liusheng has quit IRC | 08:48 | |
*** che-arne|2 has quit IRC | 08:49 | |
*** liusheng has joined #openstack-infra | 08:49 | |
*** Longgeek has quit IRC | 08:49 | |
*** Longgeek has joined #openstack-infra | 08:50 | |
*** smcginnis_ has joined #openstack-infra | 08:51 | |
*** jcoufal has joined #openstack-infra | 08:51 | |
*** cnesa has joined #openstack-infra | 08:52 | |
*** armax has quit IRC | 08:53 | |
*** emagana has joined #openstack-infra | 08:55 | |
*** HeOS has joined #openstack-infra | 08:56 | |
*** emagana has quit IRC | 09:00 | |
*** sarob has quit IRC | 09:00 | |
*** jgallard_ has joined #openstack-infra | 09:00 | |
*** skolekonov has joined #openstack-infra | 09:01 | |
*** yamamoto has joined #openstack-infra | 09:01 | |
*** fandi has joined #openstack-infra | 09:03 | |
*** BobBall_AWOL is now known as BobBall | 09:03 | |
*** otter768 has joined #openstack-infra | 09:04 | |
*** koolhead17 has joined #openstack-infra | 09:04 | |
*** koolhead17 has joined #openstack-infra | 09:04 | |
*** zz_johnthetubagu is now known as johnthetubaguy | 09:05 | |
*** yamamoto has quit IRC | 09:06 | |
anteaya | jhesketh: thanks for the hyphens | 09:07 |
*** sabari is now known as zz_sabari | 09:07 | |
*** otter768 has quit IRC | 09:08 | |
*** koolhead17 has quit IRC | 09:09 | |
*** derekh has joined #openstack-infra | 09:10 | |
anteaya | jhesketh: do you see 141942 in the gate? | 09:10 |
anteaya | I just approved it yet I don't see it in status.o.o | 09:10 |
anteaya | there it is | 09:12 |
anteaya | more sleep for me, g'night again | 09:14 |
*** koolhead17 has joined #openstack-infra | 09:17 | |
*** koolhead17 has joined #openstack-infra | 09:17 | |
openstackgerrit | Merged openstack-infra/project-config: Rename zuul-swift-upload jobs to use hypens https://review.openstack.org/141942 | 09:20 |
openstackgerrit | Merged openstack-infra/project-config: Push dg-tempest-dsvm-full logs to swift https://review.openstack.org/141668 | 09:21 |
*** jlibosva has joined #openstack-infra | 09:22 | |
*** dizquierdo has joined #openstack-infra | 09:26 | |
*** mpaolino has joined #openstack-infra | 09:27 | |
*** MaxV has joined #openstack-infra | 09:29 | |
*** achanda has quit IRC | 09:32 | |
*** andreaf has joined #openstack-infra | 09:32 | |
*** achanda has joined #openstack-infra | 09:32 | |
*** dtantsur|afk is now known as dtantsur | 09:33 | |
*** sandywalsh has joined #openstack-infra | 09:34 | |
*** sandywalsh_ has quit IRC | 09:36 | |
*** achanda has quit IRC | 09:37 | |
*** smcginnis_ has quit IRC | 09:38 | |
*** achanda has joined #openstack-infra | 09:41 | |
*** ociuhandu has quit IRC | 09:41 | |
*** achanda has quit IRC | 09:44 | |
*** mtanino has joined #openstack-infra | 09:44 | |
*** achanda has joined #openstack-infra | 09:44 | |
nikil22 | hi is there any way to extend the localrc file from devstack-gate in CI system. Like the other parametes REPO, branch and other "post-config" should be appended to localrc file. Before executing stack.sh from devstack-gate | 09:45 |
*** _nadya_ has quit IRC | 09:46 | |
*** achanda has quit IRC | 09:50 | |
*** achanda has joined #openstack-infra | 09:50 | |
*** mtanino is now known as mtanino_zzz | 09:54 | |
*** e0ne has joined #openstack-infra | 09:55 | |
*** emagana has joined #openstack-infra | 09:56 | |
*** cody-somerville has quit IRC | 09:57 | |
*** emagana has quit IRC | 10:01 | |
*** luqas has quit IRC | 10:02 | |
*** ihrachyshka has joined #openstack-infra | 10:04 | |
*** ekarlso- has quit IRC | 10:07 | |
*** ekarlso- has joined #openstack-infra | 10:07 | |
*** Hal has joined #openstack-infra | 10:07 | |
*** Hal is now known as Guest51388 | 10:08 | |
*** cody-somerville has joined #openstack-infra | 10:11 | |
openstackgerrit | Moshe Levi proposed openstack-infra/project-config: Add networking-mlnx project to StackForge https://review.openstack.org/142054 | 10:13 |
*** jerryz has quit IRC | 10:14 | |
*** jerryz has joined #openstack-infra | 10:14 | |
openstackgerrit | Moshe Levi proposed openstack-infra/project-config: Add networking-mlnx project to StackForge https://review.openstack.org/142054 | 10:17 |
*** pelix has joined #openstack-infra | 10:20 | |
*** andreaf has quit IRC | 10:21 | |
*** fandi has quit IRC | 10:27 | |
*** avozza is now known as zz_avozza | 10:29 | |
*** e0ne has quit IRC | 10:34 | |
*** e0ne has joined #openstack-infra | 10:38 | |
*** rlandy has joined #openstack-infra | 10:40 | |
*** achanda has quit IRC | 10:40 | |
*** Roamer` has joined #openstack-infra | 10:40 | |
Roamer` | hi, uh, does anybody know why Jenkins keeps failing check-grenade-dsvm for https://review.openstack.org/#/c/139711 ? It says "HttpConnectionPool is full" creating the cirros image, xing-yang already issued a recheck, it failed again, elastic-recheck doesn't seem to have it. | 10:41 |
AJaeger | Roamer`, see the mail "oslo.db 1.2.1 release coming to fix stable/juno" on openstack-dev | 10:43 |
*** liusheng has quit IRC | 10:44 | |
*** liusheng has joined #openstack-infra | 10:45 | |
*** che-arne has joined #openstack-infra | 10:46 | |
*** garyk has joined #openstack-infra | 10:48 | |
*** jp_at_hp has joined #openstack-infra | 10:50 | |
*** jp_at_hp has quit IRC | 10:50 | |
*** jp_at_hp has joined #openstack-infra | 10:50 | |
*** unicell has quit IRC | 10:50 | |
*** garyk has quit IRC | 10:53 | |
*** unicell has joined #openstack-infra | 10:53 | |
*** andreaf has joined #openstack-infra | 10:53 | |
*** zz_avozza is now known as avozza | 10:55 | |
*** ociuhandu has joined #openstack-infra | 10:56 | |
*** luqas has joined #openstack-infra | 10:56 | |
*** emagana has joined #openstack-infra | 10:57 | |
*** jgallard_ has quit IRC | 10:57 | |
*** ZZelle has quit IRC | 10:58 | |
*** ZZelle has joined #openstack-infra | 10:58 | |
*** emagana has quit IRC | 11:01 | |
Roamer` | AJaeger, ah, right, I'd completely missed the exception higher up in the log. Thanks! | 11:02 |
*** otter768 has joined #openstack-infra | 11:05 | |
*** adalbas has joined #openstack-infra | 11:06 | |
*** yfried is now known as yfried|afk | 11:06 | |
*** koolhead17 has quit IRC | 11:07 | |
*** e0ne has quit IRC | 11:09 | |
*** otter768 has quit IRC | 11:10 | |
*** yfried|afk is now known as yfried | 11:15 | |
*** bradjones has joined #openstack-infra | 11:15 | |
*** cdent has joined #openstack-infra | 11:22 | |
*** Masahiro has quit IRC | 11:23 | |
*** e0ne has joined #openstack-infra | 11:24 | |
*** sputnik13 has joined #openstack-infra | 11:24 | |
*** pc_m has joined #openstack-infra | 11:27 | |
*** aysyd has joined #openstack-infra | 11:32 | |
*** masayukig has quit IRC | 11:33 | |
*** jokke_ has joined #openstack-infra | 11:35 | |
jokke_ | Hi | 11:35 |
jokke_ | Anyone here able to help with the grenade test failing due the sqlalchemy versioning issue? | 11:36 |
jokke_ | We're trying to sync global-requirements to Glance, but looks like the grenade old fails due to version mismatch | 11:37 |
*** marcusvrn has quit IRC | 11:38 | |
*** Masahiro has joined #openstack-infra | 11:39 | |
*** masayukig has joined #openstack-infra | 11:39 | |
*** berendt has joined #openstack-infra | 11:41 | |
*** marcusvrn has joined #openstack-infra | 11:42 | |
openstackgerrit | Christian Berendt proposed openstack/requirements: Bump version of openstack-doc-tools >= 0.21 https://review.openstack.org/142076 | 11:44 |
openstackgerrit | Derek Higgins proposed openstack-infra/system-config: Increase max-servers for rh1 https://review.openstack.org/142077 | 11:44 |
AJaeger | jokke_, see the mail "oslo.db 1.2.1 release coming to fix stable/juno" on openstack-dev | 11:51 |
*** teran has quit IRC | 11:56 | |
*** emagana has joined #openstack-infra | 11:58 | |
*** teran has joined #openstack-infra | 11:58 | |
dhellmann | AJaeger: thanks for pointing people to the ML | 12:00 |
AJaeger | dhellmann, I feel like a bot ;) | 12:00 |
dhellmann | currently rechecking https://review.openstack.org/#/c/141927/ | 12:00 |
dhellmann | AJaeger: haha | 12:00 |
sdague | dhellmann: https://review.openstack.org/#/c/142075/ - I think we can just reorder the upgrade as well | 12:01 |
AJaeger | I was surprised to see all of 14927 failing ;( | 12:01 |
*** ddieterly has joined #openstack-infra | 12:02 | |
dhellmann | sdague: that "architectural flaw" is there because that's the only way the swift team would work with them, so at least put the blame on the right team, please | 12:02 |
*** emagana has quit IRC | 12:02 | |
AJaeger | ;( | 12:02 |
dhellmann | sdague: you missed the discussion with jogo and jeblair yesterday about changing grenade to install the services into separate virtualenvs for upgrade, and upgrading their dependencies, so we don't have the issue with versioning having to overlap -- jogo is going to produce a spec | 12:03 |
sdague | sure | 12:03 |
sdague | but right now, no project with a grenade job has been able to merge code for ~20hrs | 12:04 |
*** yamamoto has joined #openstack-infra | 12:04 | |
dhellmann | that's not ceilometer's fault | 12:04 |
dhellmann | my requirements change for sqlalchemy died on a glance error | 12:04 |
*** mpaolino has quit IRC | 12:04 | |
sdague | yes | 12:05 |
*** jamespage_ has joined #openstack-infra | 12:05 | |
sdague | because swift can't start | 12:05 |
sdague | because oslo.db | 12:05 |
sdague | because ceilometer | 12:05 |
dhellmann | well, it wasn't in an upgrade job that it failed | 12:05 |
dhellmann | it failed in every dsvm job | 12:05 |
sdague | dhellmann: correct | 12:05 |
sdague | yes, go look at the logs | 12:05 |
*** jamespage_ has quit IRC | 12:05 | |
AJaeger | sdague, if you have some time, could you review https://review.openstack.org/#/c/140470/ and https://review.openstack.org/#/c/140821/ to have the ACLs checking in project-config, please? Nothing urgent but something nice I'd like to push ;) | 12:06 |
AJaeger | dhellmann, all the grenade ones fail | 12:06 |
sdague | AJaeger: right, but we're not actually talking about that | 12:06 |
dhellmann | ok, so then sdague's patch is necessary for the requirements change to even land? | 12:06 |
sdague | dhellmann: no, my patch won't let your patch land | 12:06 |
*** Masahiro has quit IRC | 12:07 | |
*** dims has joined #openstack-infra | 12:07 | |
sdague | you have to also couple your patch with blocking all versions of oslo.db that have the new requirements definition | 12:07 |
sdague | my patch will let us get by without your patch | 12:07 |
openstackgerrit | Christian Berendt proposed openstack/requirements: Bump version of openstack-doc-tools >= 0.21 https://review.openstack.org/142076 | 12:08 |
Roamer` | .wn | 12:08 |
Roamer` | oops, sorry | 12:08 |
*** nfedotov has joined #openstack-infra | 12:09 | |
*** yamamoto has quit IRC | 12:09 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: move oslo.version to attic https://review.openstack.org/141812 | 12:10 |
*** yamamoto has joined #openstack-infra | 12:10 | |
*** yamamoto_ has joined #openstack-infra | 12:11 | |
*** yamamoto has quit IRC | 12:11 | |
*** marcusvrn has quit IRC | 12:11 | |
jokke_ | AJaeger: got it ... thanks! | 12:11 |
*** marcusvrn has joined #openstack-infra | 12:11 | |
*** jraim_ has joined #openstack-infra | 12:12 | |
*** dougwig_ has joined #openstack-infra | 12:12 | |
*** ihrachyshka has quit IRC | 12:12 | |
*** erw_ has joined #openstack-infra | 12:13 | |
*** jraim has quit IRC | 12:14 | |
*** jraim_ is now known as jraim | 12:14 | |
*** ala_ has quit IRC | 12:14 | |
*** bmwiedemann has quit IRC | 12:14 | |
*** dougwig has quit IRC | 12:14 | |
*** erw has quit IRC | 12:14 | |
*** bmwiedemann has joined #openstack-infra | 12:14 | |
*** sileht has quit IRC | 12:14 | |
*** luqas has quit IRC | 12:14 | |
*** rlandy has quit IRC | 12:14 | |
*** dougwig_ is now known as dougwig | 12:14 | |
sdague | AJaeger: so if we send in the first one we get a new job, then we should recheck on the 2nd one? | 12:15 |
AJaeger | sdague, yeah, might be best | 12:15 |
sdague | ok approving the first one | 12:15 |
AJaeger | and the second one will fail for sure but is non-voting. To fix it, we need another normalizing: https://review.openstack.org/#/c/141860/ | 12:16 |
AJaeger | sdague, thanks | 12:16 |
*** sileht has joined #openstack-infra | 12:16 | |
*** garyk has joined #openstack-infra | 12:16 | |
garyk | AJaeger: you around for a few questions? | 12:16 |
AJaeger | garyk, 10 mins, then I have to leave | 12:17 |
*** EmilienM is now known as EmilienM|afk | 12:17 | |
AJaeger | garyk, so ask | 12:17 |
garyk | ok. regarding https://review.openstack.org/140409. i have follows all of the instructions. i just need to make sure that there is the git history | 12:17 |
garyk | is that done on the git project that is created or via this patch set? | 12:17 |
*** talluri has quit IRC | 12:18 | |
*** talluri has joined #openstack-infra | 12:18 | |
AJaeger | garyk, http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-project-list - you need to add upstream: URL to projects.yaml | 12:18 |
*** pcrews has quit IRC | 12:19 | |
*** ihrachyshka has joined #openstack-infra | 12:19 | |
garyk | AJaeger: brilliant! thanks! | 12:19 |
*** sputnik13 has quit IRC | 12:19 | |
*** bcourt has joined #openstack-infra | 12:19 | |
dims | AJaeger: you are fast! :) | 12:19 |
AJaeger | dims, sometimes ;) | 12:19 |
*** kevinbenton has quit IRC | 12:20 | |
*** Roamer` has quit IRC | 12:20 | |
*** barnaby has quit IRC | 12:20 | |
*** tsufiev has quit IRC | 12:20 | |
*** pcrews has joined #openstack-infra | 12:20 | |
*** Svedrin has quit IRC | 12:20 | |
*** ala_ has joined #openstack-infra | 12:20 | |
sdague | oh, this is wedged even further than I imagined because stable requirements allows olso.db 1.3 | 12:21 |
*** _nadya_ has joined #openstack-infra | 12:21 | |
*** pelix has quit IRC | 12:22 | |
*** ondergetekende has quit IRC | 12:22 | |
openstackgerrit | garyk proposed openstack-infra/project-config: Add VMware-NSX to StackForge https://review.openstack.org/140409 | 12:22 |
*** kevinbenton has joined #openstack-infra | 12:22 | |
garyk | AJaeger: ^ (hope that I did it correctly) | 12:22 |
*** pelix has joined #openstack-infra | 12:22 | |
AJaeger | garyk, the url should be the one you import, you gave git://github.com/openstack/neutron.git which is the original | 12:23 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Remove queries for closed bugs https://review.openstack.org/140858 | 12:23 |
AJaeger | you want to remove files from the repository first, so remove everything unrelated to VMware-NSX from neutron | 12:23 |
openstackgerrit | Doug Hellmann proposed openstack/requirements: Make SQLAlchemy settings compatible with Juno https://review.openstack.org/141927 | 12:23 |
AJaeger | garyk, see some documentation in https://review.openstack.org/141171 | 12:23 |
*** _nadya_ has quit IRC | 12:23 | |
*** e0ne has quit IRC | 12:23 | |
*** _nadya_ has joined #openstack-infra | 12:24 | |
garyk | AJaeger: yes, we want to import the neutron.git porject. We want to make use of these files - there are files that will be copied from netron/plugins/vmware directoryt. maybe i do not understand | 12:24 |
*** baoli has joined #openstack-infra | 12:24 | |
AJaeger | garyk, you run "git filter-branch" and remove all files you do not want ot import first | 12:25 |
*** baoli has quit IRC | 12:25 | |
AJaeger | garyk, sorry, have to leave now, hope the reference in 141171 helps | 12:25 |
garyk | AJaeger: ok, will try that | 12:25 |
*** sputnik13 has joined #openstack-infra | 12:25 | |
garyk | AJaeger: ok, thanks | 12:25 |
AJaeger | garyk, don't import *all* of neutron, just those files and their history you need | 12:25 |
*** baoli has joined #openstack-infra | 12:25 | |
dhellmann | sdague: do you think there's a chance of landing a patch to disallow oslo.db 1.3 in stable/juno? I was planning to do that later, but if we need to do it earlier in the process... | 12:26 |
*** mtanino_zzz has quit IRC | 12:26 | |
*** tsufiev has joined #openstack-infra | 12:26 | |
*** amotoki has joined #openstack-infra | 12:26 | |
*** rlandy has joined #openstack-infra | 12:27 | |
sdague | you'll have to do it in the same patch you did above | 12:28 |
dhellmann | sdague: that patch is against master :-( | 12:28 |
sdague | yeh | 12:28 |
sdague | if you want to roll back sqla, you also have to roll back anything that requires a newer sqla | 12:28 |
sdague | which oslo.db does | 12:28 |
dhellmann | yeah, I'm doing that in master -- you suggested we needed to do it in the stable branch, too | 12:29 |
sdague | yes | 12:29 |
dhellmann | I can just go delete oslo.db 1.3 from pypi, but it | 12:29 |
sdague | for the same reasons | 12:29 |
dhellmann | ok, I'm not sure I know how to patch 2 branches at once, is that possible? | 12:29 |
sdague | you have to work up from oldest stable | 12:29 |
dhellmann | or are you saying separate patches and I'm misunderstanding | 12:29 |
sdague | separate patches | 12:30 |
dhellmann | ok | 12:30 |
*** yamamoto_ has quit IRC | 12:30 | |
sdague | so here is the crux of this dragon in global requirements (though I don't understand it fully) | 12:30 |
sdague | we are specifying 2 different allowed sqla versions | 12:30 |
sdague | 1 via gr | 12:30 |
sdague | 1 comes in with oslo.db, which is different | 12:31 |
dhellmann | sdague: so https://review.openstack.org/#/c/141896/ | 12:31 |
*** bmwiedemann has quit IRC | 12:31 | |
sdague | something cares a lot about pkg_resource checking compatibility for all these things | 12:31 |
sdague | whether or not the code's compatible | 12:31 |
sdague | so it explodes on module loads | 12:31 |
sdague | so swift can never start | 12:32 |
sdague | thus everything else falls down | 12:32 |
dhellmann | paste is loading entry points without turning off requirements checking | 12:32 |
garyk | dims: you have any idea how i do the git history part? i am not sure what i do after the git filter branch | 12:32 |
dstufft | that particular feature of pkg_resources is a pain in the ass | 12:32 |
dhellmann | dstufft: could we change the default behavior? | 12:32 |
*** yamamoto has joined #openstack-infra | 12:33 | |
dims | garyk: one sec | 12:33 |
dstufft | dhellmann: I'm half asleep but I think possibly yes? would need to talk to jason about it to see what he thought | 12:33 |
*** ondergetekende has joined #openstack-infra | 12:34 | |
dhellmann | sdague: I'm waiting to hear what you think of https://review.openstack.org/#/c/141896/2 as a way to pin oslo.db in stable before I approve it | 12:34 |
sdague | dhellmann: oh, sorry, still on first cup of coffee | 12:34 |
dhellmann | dstufft: ok, let's have that conversation later | 12:34 |
dhellmann | sdague: np, me, too | 12:34 |
dims | garyk: start by browsing oslo-incubator/tools/graduate.sh, it shows you how to pull files selectively with their history | 12:34 |
dims | garyk: you will need to modify it to fit your needs | 12:35 |
sdague | dhellmann: yeh that should help | 12:35 |
dhellmann | ok, approving | 12:35 |
sdague | I actually just stuck that into my grenade change - https://review.openstack.org/#/c/142075/2/prep-base,cm | 12:35 |
dhellmann | cool | 12:36 |
dhellmann | ugh, the check queue is filling up already | 12:36 |
sdague | oh, and this isn't an issue for juno because oslo.db wasn't used in icehouse | 12:36 |
dhellmann | right | 12:36 |
sdague | so this situation will get worse as more project branches use libraries | 12:37 |
sdague | because of subtle couplings like these | 12:37 |
*** kevinbenton has quit IRC | 12:37 | |
dhellmann | yeah, that was one reason we thought allowing grenade to update requirements would help | 12:37 |
garyk | dims: thanks | 12:37 |
*** yamamoto has quit IRC | 12:37 | |
dhellmann | and to maintain the ability to test as rolling updates, we were going to put each service in a venv so we could update them separately | 12:38 |
*** Svedrin has joined #openstack-infra | 12:38 | |
dhellmann | upgrading dependencies also protects us against similar version conflicts coming up in libs we don't control | 12:39 |
*** Guest51388 has quit IRC | 12:39 | |
*** johnthetubaguy is now known as zz_johnthetubagu | 12:40 | |
*** kevinbenton has joined #openstack-infra | 12:40 | |
*** mase_x200 has joined #openstack-infra | 12:40 | |
*** bmwiedemann has joined #openstack-infra | 12:40 | |
* dhellmann goes to make a little breakfast while the tests run | 12:41 | |
*** luqas has joined #openstack-infra | 12:41 | |
*** yamamoto has joined #openstack-infra | 12:43 | |
sdague | so.... we do upgrade dependencies | 12:43 |
* sdague is confused | 12:43 | |
*** yamamoto has quit IRC | 12:46 | |
openstackgerrit | Merged openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 | 12:46 |
dhellmann | sdague: ok, for some reason we thought otherwise yesterday and I don't know enough about grenade | 12:48 |
dhellmann | how is it that we have any 2 projects with conflicting requirements for sqlalchemy being installed? aren't we installing the apps from source after a requirements sync? | 12:49 |
openstackgerrit | garyk proposed openstack-infra/project-config: Add VMware-NSX to StackForge https://review.openstack.org/140409 | 12:51 |
*** Guest51388 has joined #openstack-infra | 12:51 | |
sdague | we're installing applications | 12:52 |
sdague | let me find you the line in the logs | 12:52 |
*** che-arne|2 has joined #openstack-infra | 12:54 | |
garyk | sdague: you aware of the reason why grenade-dsvm fails? or maybe i should ask you this on the nova channel… | 12:54 |
*** yfried is now known as yfried|afk | 12:55 | |
sdague | dhellmann: http://logs.openstack.org/26/125926/1/gate//gate-grenade-dsvm/7b736df//logs/grenade.sh.txt.gz#_2014-12-16_11_58_18_274 | 12:55 |
sdague | so starting here is the first install | 12:55 |
dhellmann | does grenade do a requirements sync before installing anything? | 12:55 |
dhellmann | or that job, or whatever | 12:56 |
*** che-arne has quit IRC | 12:56 | |
dhellmann | I guess the other jobs fail with a similar error, so it's not just grenade | 12:56 |
sdague | it's done via the normal pip install -e DIR model | 12:56 |
sdague | yeh, so the crux of it is pip does a very odd thing with libraries | 12:56 |
dhellmann | I thought our test jobs forced everything to have the same requirements when it was installing via src | 12:57 |
*** dprince has joined #openstack-infra | 12:57 | |
sdague | dhellmann: yes, they get synced first | 12:57 |
sdague | let me finish this, it might become clear | 12:57 |
dhellmann | ok | 12:57 |
*** weshay has joined #openstack-infra | 12:57 | |
sdague | assuming foo 1.0 requires bar>1.3 | 12:57 |
sdague | and package 1.0 requires foo>=1.0 | 12:58 |
sdague | pip install package 1.0 gives you different results if bar was installed previously or not | 12:58 |
sdague | if bar is not installed, you get >1.3 | 12:58 |
sdague | if it was installed at 1.2, it doesn't touch the install | 12:59 |
*** yamamoto has joined #openstack-infra | 12:59 | |
sdague | even though it's wrong | 12:59 |
*** che-arne|2 has quit IRC | 12:59 | |
*** che-arne has joined #openstack-infra | 12:59 | |
*** che-arne|2 has joined #openstack-infra | 13:00 | |
sdague | so all along we've been treating requirements as something which can be transitive, except python doesn't have an installer which can actually do transitive dependencies correctly | 13:00 |
sdague | so in this case, what's broken | 13:01 |
sdague | which you can see in the install path for keystone | 13:01 |
sdague | is that oslo.db gets installed after sqla | 13:01 |
sdague | sqla was satified fine by keystones definition | 13:01 |
sdague | pip sees that something called sqlalchemy exists, so assumes it's fine | 13:02 |
sdague | installs an oslo.db with a conflicting requirement | 13:02 |
sdague | pkg_resources some time in the far future is the first time the conflict is examined | 13:02 |
*** alexpilotti has joined #openstack-infra | 13:02 | |
sdague | and explode | 13:02 |
dhellmann | ok, the source of the problem makes sense | 13:03 |
*** che-arne has quit IRC | 13:03 | |
sdague | so, honestly, as long as pip remains broken like this, everything is a work around | 13:03 |
dhellmann | except that keystone and oslo.db require the same version of sqla now, and if we're syncing requirements I would have thought all of the apps did (even if they haven't landed the patch to make it official: http://paste.openstack.org/show/151829/) | 13:03 |
*** ala_ has quit IRC | 13:04 | |
sdague | dhellmann: where do they require the same version? | 13:04 |
dhellmann | would it make sense to remove sqlalchemy as a direct requirement in the projects and use the oslo.db dependency to get it? | 13:04 |
dhellmann | sdague: the requirements on line 14 and 23 of that paste look the same to me, unless I'm missing a character | 13:04 |
dhellmann | sorry, 15 | 13:04 |
sdague | yeh, but that's overridden by global requirements | 13:05 |
sdague | during install | 13:05 |
sdague | so what you actually want to compare is openstack/requirements vs. oslo.* | 13:05 |
dhellmann | which has the same version: SQLAlchemy>=0.9.7,<=0.9.99 | 13:05 |
*** _nadya_ has quit IRC | 13:05 | |
sdague | not in juno | 13:06 |
dhellmann | that was the whole point of this oslo.db release, to make its requirements match that list | 13:06 |
dhellmann | ok, but we're failing to install even in master | 13:06 |
*** otter768 has joined #openstack-infra | 13:06 | |
*** doude has quit IRC | 13:06 | |
sdague | dhellmann: only with your change to the requirements definition | 13:06 |
*** mfink has quit IRC | 13:06 | |
*** alexpilotti_ has joined #openstack-infra | 13:06 | |
dhellmann | ah, ok, I thought we were still having issues aside from that in master | 13:06 |
sdague | not as far as I know | 13:07 |
*** mtanino has joined #openstack-infra | 13:07 | |
*** dims has quit IRC | 13:07 | |
*** alexpilotti has quit IRC | 13:07 | |
*** alexpilotti_ is now known as alexpilotti | 13:07 | |
*** doude has joined #openstack-infra | 13:07 | |
*** yfried|afk is now known as yfried | 13:07 | |
*** dims has joined #openstack-infra | 13:07 | |
dhellmann | yeah, aeromancer doesn't know how to look across branches, yet | 13:07 |
*** dkranz has joined #openstack-infra | 13:07 | |
*** Masahiro has joined #openstack-infra | 13:07 | |
*** hashar has joined #openstack-infra | 13:08 | |
*** mbacchi has joined #openstack-infra | 13:08 | |
sdague | so basically, keeping the projects in sync became way too many of these firedrills, which is why we kind of ignore the projects and just bludgeon in a uniform requirements version | 13:08 |
dhellmann | is there some way to bump the jobs out of the gate queue that we know are going to fail? | 13:08 |
*** kedkul has joined #openstack-infra | 13:08 | |
*** Ala has joined #openstack-infra | 13:09 | |
sdague | update their commit message | 13:09 |
dhellmann | right, I was confused because I was seeing the same error in my requirements job | 13:09 |
kedkul | Hi | 13:09 |
sdague | dhellmann: right, because it's the same pip failing | 13:09 |
dhellmann | we have a bunch of nova changes in the queue that we know are going to fail, can we bypass them somehow to get that juno requirements patch to land? | 13:09 |
*** e0ne has joined #openstack-infra | 13:09 | |
dhellmann | yeah, makes sense now | 13:10 |
sdague | dhellmann: update their commit message | 13:10 |
sdague | then zuul throws them back into the check queue because it's a new change | 13:10 |
*** otter768 has quit IRC | 13:10 | |
kedkul | in my CI setup, after keystone startup using stack.sh, it is failing at project create, user create | 13:11 |
kedkul | the command it tries to execute doesn't have some parameters | 13:11 |
kedkul | for ex. openstack project create admin --or-show -f value -c id | 13:11 |
*** kgiusti has joined #openstack-infra | 13:12 | |
kedkul | the error it shown - openstack project create: error: unrecognized arguments: --or-show | 13:12 |
*** Masahiro has quit IRC | 13:12 | |
sdague | kedkul: don't reuse your devstack nodes, openstackclient is at an old version I expect | 13:12 |
kedkul | kind of same issue is happening for subsequent user create, role create | 13:12 |
kedkul | ok | 13:13 |
kedkul | what do you mean by dont reuse devstack nodes | 13:13 |
kedkul | can you explain? | 13:13 |
sdague | kedkul: are you deleting the devstack vm after every CI run? | 13:14 |
kedkul | no, we are using the same vms, | 13:14 |
sdague | right, that's the crux of the issue | 13:14 |
kedkul | isn't there any fix that i don't have to rework on my CI setup? | 13:15 |
sdague | uninstall openstackclient | 13:15 |
kedkul | is this issue resolvable by updating openstack client | 13:15 |
sdague | yes | 13:15 |
kedkul | sdague: i will try that | 13:15 |
kedkul | sdague: thanks for quick answer | 13:16 |
sdague | no prob | 13:16 |
gilliard | sdague: so the patches with updated commit messages will need +1 workflow again? | 13:16 |
sdague | gilliard: yep | 13:16 |
sdague | gilliard: they'll also need passing test results | 13:16 |
gilliard | sdague: thanks - just checking. | 13:16 |
gilliard | of course ;) | 13:16 |
sdague | which they currently don't have :) | 13:16 |
sdague | which is why they are getting pulled | 13:17 |
gilliard | yep - I've been following. Just wanted to check my understanding for the check/gate process. | 13:17 |
*** avozza is now known as zz_avozza | 13:17 | |
gilliard | I assume they had passing tests before they were +A anyway... | 13:18 |
sdague | yep | 13:18 |
*** Roamer` has joined #openstack-infra | 13:18 | |
*** yfried_ has joined #openstack-infra | 13:19 | |
gilliard | Your explanation above about the transitive dependency mgmt makes me a sad panda. | 13:19 |
sdague | gilliard: me too | 13:19 |
*** yfried has quit IRC | 13:19 | |
sdague | dhellmann: I kind of wonder if removing the SQLA from keystone would actually help... because the reason it's not upgrade it is there is a distro package | 13:20 |
sdague | which means we'd still explode later | 13:21 |
dhellmann | sqla is being installed as a distro package? | 13:21 |
kedkul | sdague: i assume you are pointing to python-keystoneclient, python-novaclient etc. am I right? | 13:21 |
sdague | yeh, it's dragged in via something in the base distro | 13:21 |
dhellmann | sigh | 13:21 |
sdague | unless we do monty's crazy patch of installing python from source | 13:22 |
sdague | we're going to have some stuff there | 13:22 |
*** berendt has quit IRC | 13:22 | |
*** bswartz has quit IRC | 13:23 | |
sdague | the reality is, also, doing venvs for all this stuff basically only gets around it by the fact that we're installing the whole world at once. The libraries still can cause the same kind of issues here (like if alembic requires a thing that's incompatible with oslo.db) | 13:23 |
sdague | dhellmann: if you are pulling stuff out, the swift and neutron changes are also going to fail | 13:25 |
*** e0ne is now known as e0ne_ | 13:25 | |
*** mase_x200 has quit IRC | 13:27 | |
*** EmilienM|afk is now known as EmilienM | 13:28 | |
sdague | dstufft: so, seriously, the lack of dependency solver in pip continues to cause us no end of pain. Is that on your horizon some where? | 13:29 |
*** yfried_ has quit IRC | 13:29 | |
*** sweston_away has quit IRC | 13:31 | |
*** doude has quit IRC | 13:31 | |
*** mase_x200 has joined #openstack-infra | 13:31 | |
*** doude has joined #openstack-infra | 13:31 | |
*** amuller is now known as amuller_afk | 13:32 | |
*** amuller_afk is now known as amuller_meeting | 13:32 | |
*** lifeless_ has joined #openstack-infra | 13:33 | |
*** mfink has joined #openstack-infra | 13:33 | |
*** sweston_away has joined #openstack-infra | 13:34 | |
*** sweston_away is now known as sweston | 13:35 | |
dhellmann | sdague: I kicked the swift one, but my requirements change is #2 now behind dib so I think it's good | 13:35 |
* dhellmann takes advantage of a break in the rain to go to the bakery | 13:35 | |
*** lifeless has quit IRC | 13:35 | |
*** sputnik13 has quit IRC | 13:35 | |
*** dtantsur is now known as dtantsur|brb | 13:35 | |
*** e0ne_ has quit IRC | 13:35 | |
*** jgallard_ has joined #openstack-infra | 13:38 | |
sdague | yeh | 13:38 |
*** mrmartin has quit IRC | 13:41 | |
*** sputnik13 has joined #openstack-infra | 13:41 | |
*** sputnik13 has quit IRC | 13:41 | |
*** ddieterly has quit IRC | 13:42 | |
*** vigneshvar has quit IRC | 13:42 | |
nikil22 | hi if there is any code submitted the jenkins CI will run only tempest? will this also run unit tests | 13:44 |
kedkul | it will run unit tests also | 13:44 |
*** mrmartin has joined #openstack-infra | 13:47 | |
*** e0ne has joined #openstack-infra | 13:48 | |
*** julim has joined #openstack-infra | 13:49 | |
openstackgerrit | James Polley proposed stackforge/gertty: Add detailed examples and dashboards a la gerrit https://review.openstack.org/142108 | 13:49 |
tchaypo | yes, yes he did. | 13:49 |
*** mrmartin has quit IRC | 13:49 | |
nikil22 | kedkul: could you please point me some unit test job's. Because i have seen under "https://github.com/openstack-infra/project-config/tree/master/jenkins/jobs" and i gues its all related to tempest | 13:54 |
*** mtanino has quit IRC | 13:56 | |
*** hdd has joined #openstack-infra | 13:56 | |
openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: disable ceilometer in grenade runs https://review.openstack.org/138528 | 13:57 |
*** bswartz has joined #openstack-infra | 13:57 | |
openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: disable ceilometer in grenade runs https://review.openstack.org/138528 | 13:58 |
*** emagana has joined #openstack-infra | 13:59 | |
*** markmcclain has joined #openstack-infra | 13:59 | |
*** mpaolino has joined #openstack-infra | 14:01 | |
*** bradjones has quit IRC | 14:01 | |
*** zz_johnthetubagu is now known as johnthetubaguy | 14:02 | |
* dhellmann returns | 14:02 | |
nikil22 | kedkul: ok i see unit test jobs also in same repo. thanks | 14:03 |
*** mrunge is now known as mrunge_gone | 14:03 | |
*** emagana has quit IRC | 14:04 | |
*** bradjones has joined #openstack-infra | 14:04 | |
*** signed8bit has joined #openstack-infra | 14:05 | |
*** _nadya_ has joined #openstack-infra | 14:05 | |
*** signed8bit has quit IRC | 14:09 | |
*** signed8bit has joined #openstack-infra | 14:11 | |
*** mase_x200 has quit IRC | 14:14 | |
*** emagana has joined #openstack-infra | 14:14 | |
*** doug-fish has joined #openstack-infra | 14:15 | |
*** wznoinsk_ has joined #openstack-infra | 14:17 | |
*** wznoinsk_ has quit IRC | 14:17 | |
*** dustins has joined #openstack-infra | 14:18 | |
nikil22 | hi i did not find the jenkins job "gate-neutron-python27" in project-config repo. will this unit job be in a different place? | 14:19 |
*** jseiler_ has joined #openstack-infra | 14:20 | |
*** signed8bit has quit IRC | 14:20 | |
*** signed8bit has joined #openstack-infra | 14:21 | |
*** koolhead17 has joined #openstack-infra | 14:22 | |
*** koolhead17 has joined #openstack-infra | 14:22 | |
*** mtreinish_ has joined #openstack-infra | 14:22 | |
*** pelix1 has joined #openstack-infra | 14:23 | |
*** pelix has quit IRC | 14:23 | |
*** emagana has quit IRC | 14:23 | |
*** marcusvrn1 has joined #openstack-infra | 14:25 | |
*** jeblair_ has joined #openstack-infra | 14:25 | |
*** changbl has quit IRC | 14:25 | |
*** ddieterly has joined #openstack-infra | 14:26 | |
*** mriedem has joined #openstack-infra | 14:27 | |
*** xyang1 has joined #openstack-infra | 14:27 | |
*** mwhudson_ has joined #openstack-infra | 14:27 | |
*** HenryG_ has joined #openstack-infra | 14:28 | |
*** marcusvrn has quit IRC | 14:30 | |
*** k4n0 has quit IRC | 14:30 | |
*** arxcruz has quit IRC | 14:30 | |
*** jpich has quit IRC | 14:30 | |
*** jseiler has quit IRC | 14:30 | |
*** uvirtbot has quit IRC | 14:30 | |
*** HenryG has quit IRC | 14:30 | |
*** mtreinish has quit IRC | 14:30 | |
*** jeblair has quit IRC | 14:30 | |
*** juice has quit IRC | 14:30 | |
*** mrodden has quit IRC | 14:30 | |
*** ianw has quit IRC | 14:30 | |
*** mwhudson has quit IRC | 14:30 | |
*** mtreinish_ is now known as mtreinish | 14:30 | |
*** juice_ has joined #openstack-infra | 14:30 | |
*** juice_ is now known as juice | 14:30 | |
*** ianw has joined #openstack-infra | 14:30 | |
*** che-arne has joined #openstack-infra | 14:31 | |
*** emagana has joined #openstack-infra | 14:31 | |
*** che-arne|2 has quit IRC | 14:31 | |
*** jerryz has quit IRC | 14:31 | |
*** arxcruz has joined #openstack-infra | 14:31 | |
*** k4n0 has joined #openstack-infra | 14:31 | |
*** amuller_meeting is now known as amuller | 14:33 | |
*** esker has joined #openstack-infra | 14:33 | |
*** lttrl has joined #openstack-infra | 14:33 | |
*** che-arne has quit IRC | 14:35 | |
*** jpich has joined #openstack-infra | 14:36 | |
mordred | sdague: but venv-per-service or similar does get us out of caring from day to day | 14:37 |
sdague | mordred: so, honestly, it really doesn't | 14:37 |
mordred | really? | 14:37 |
sdague | it just masks it | 14:37 |
mordred | sure. it masks it. but it in and of itself is not actually important | 14:38 |
mordred | it's important for single-machine continuous delivery systems | 14:38 |
sdague | so all that venv-per-service does it basically set the minimums in requirements to the current releases | 14:38 |
*** sabeen1 has joined #openstack-infra | 14:38 | |
mordred | sorry - venv-per-service and no more global requirements sync in devstack | 14:38 |
sdague | sure | 14:38 |
mordred | because doing just venv-per-service but still syncing is silly :) | 14:39 |
sdague | but again, you'd get similar behavior if we set min == max more or less | 14:39 |
mordred | it's possible we're talking about different "the problem"s | 14:39 |
sdague | the crux of the problem that broke us for the last day is pip not resolving dependencies | 14:40 |
*** Masahiro has joined #openstack-infra | 14:40 | |
sdague | which is made slightly harder by us having so many dependencies | 14:40 |
sdague | in system | 14:40 |
mordred | AH - yes, thank you. I was still talking about upgrades in lockstep due to bad upstream upgrade paths | 14:40 |
sdague | right | 14:40 |
sdague | so, honestly, that's not really the problem | 14:41 |
mordred | you're right - your problem is not solved by venvs | 14:41 |
mordred | your problem is why distro packages were invented | 14:41 |
sdague | so, sorry, I had other duties last night so had about 5 minutes of context before I had to run | 14:41 |
mordred | because apt and yum both handle this extremely well | 14:42 |
sdague | however, in looking through these failures, the venv model wouldn't have helped | 14:42 |
mordred | agree | 14:42 |
*** tnovacik has joined #openstack-infra | 14:42 | |
sdague | and while it will reduce our exposure to these failures, they'll still all be there, because pip is crazy pants when it comes to transitive dependencies | 14:42 |
dhellmann | yeah, i think we misunderstood how grenade worked | 14:43 |
*** e0ne is now known as e0ne_ | 14:43 | |
*** jerryz has joined #openstack-infra | 14:44 | |
dhellmann | sdague: the juno patch merged, and I'm waiting for the master requirements patch to finish failing so I can make sure it only fails on oslo.db before rechecking | 14:44 |
mordred | sdague: I don't REALLY want to suggest this next thing - but just for sake of completeness... | 14:44 |
*** Masahiro has quit IRC | 14:44 | |
mordred | sdague: should we entertain the idea of returning to creating distro packages for the gate? | 14:44 |
sdague | for the entire python dependency chain? | 14:45 |
mordred | yes | 14:45 |
sdague | oof | 14:45 |
mordred | most of them are likely able to be done completely automatically | 14:45 |
*** uvirtbot has joined #openstack-infra | 14:45 | |
dhellmann | fpm has a pretty nice "make a package from a setup.py" thing | 14:45 |
mordred | (I'm not talking about debian policy compliant packages) | 14:45 |
mordred | yah. something like that | 14:46 |
sdague | so that would be to bypass pip ? | 14:46 |
mordred | except with a mechanism so that if there is a specific thing in the chain that needs an override, we can d it | 14:46 |
sdague | and have an actual dependency resolver | 14:46 |
*** mattfarina has joined #openstack-infra | 14:46 | |
mordred | yah | 14:46 |
sdague | so that's an option | 14:46 |
*** lttrl has quit IRC | 14:46 | |
mordred | it's how we started life :) | 14:46 |
dhellmann | or we could go help fix the dependency resolver in pip | 14:46 |
sdague | if pip is never going to address this hole | 14:46 |
dhellmann | not sure which is simpler | 14:46 |
mordred | I know dstufft _wants_ a dep solver | 14:46 |
mordred | but otoh, pure-python dep solvers aren't exactly growing on trees | 14:47 |
*** lttrl has joined #openstack-infra | 14:47 | |
*** amitgandhinz has joined #openstack-infra | 14:47 | |
mordred | but otoh, GOOD pure-python dep solvers aren't exactly growing on trees | 14:47 |
*** e0ne_ is now known as e0ne | 14:47 | |
sdague | also... we apparently found the slowest node in all of HP cloud to run this job on - https://jenkins01.openstack.org/job/check-grenade-dsvm-neutron/6758/console | 14:48 |
*** vhoward has joined #openstack-infra | 14:48 | |
sdague | I'm going to be really interested in looking at those logs once it completes to figure out why | 14:48 |
sdague | ok, biab | 14:49 |
*** dimtruck is now known as zz_dimtruck | 14:49 | |
*** dtantsur|brb is now known as dtantsur | 14:50 | |
fungi | quiet morning so far | 14:51 |
*** kedkul has quit IRC | 14:53 | |
*** yaguang has quit IRC | 14:53 | |
*** lttrl has quit IRC | 14:53 | |
*** ayoung has joined #openstack-infra | 14:53 | |
gilliard | join #openstack-meeting-3 | 14:55 |
* gilliard *sigh* | 14:55 | |
*** dpaterson has joined #openstack-infra | 14:55 | |
*** carl_baldwin has joined #openstack-infra | 14:56 | |
*** jerryz has quit IRC | 14:56 | |
*** mrodden has joined #openstack-infra | 14:57 | |
*** jerryz has joined #openstack-infra | 14:57 | |
*** che-arne has joined #openstack-infra | 14:57 | |
mordred | gilliard: not so much with that working :) | 14:58 |
*** dprince has quit IRC | 15:00 | |
*** zz_dimtruck is now known as dimtruck | 15:00 | |
*** dprince has joined #openstack-infra | 15:01 | |
*** dmsimard_away is now known as dmsimard | 15:03 | |
*** pblaho has joined #openstack-infra | 15:03 | |
*** erikwilson has joined #openstack-infra | 15:03 | |
*** erikwilson has quit IRC | 15:04 | |
*** lttrl has joined #openstack-infra | 15:05 | |
*** otter768 has joined #openstack-infra | 15:07 | |
*** wenlock has joined #openstack-infra | 15:09 | |
*** ddieterly has quit IRC | 15:09 | |
*** dkranz has quit IRC | 15:10 | |
*** ddieterly has joined #openstack-infra | 15:10 | |
*** hdd has quit IRC | 15:11 | |
*** tnovacik has quit IRC | 15:12 | |
*** otter768 has quit IRC | 15:12 | |
*** lttrl has quit IRC | 15:12 | |
*** andreaf has quit IRC | 15:12 | |
*** dustins has quit IRC | 15:13 | |
*** lttrl has joined #openstack-infra | 15:13 | |
*** dustins has joined #openstack-infra | 15:14 | |
*** timcline has joined #openstack-infra | 15:15 | |
*** timcline has quit IRC | 15:16 | |
*** timcline has joined #openstack-infra | 15:16 | |
*** nelsnelson has joined #openstack-infra | 15:17 | |
openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Generate tarballs for neutron-*aas on tags https://review.openstack.org/142126 | 15:17 |
ttx | fungi: we'll need that one in before we start tagging tomorrow ^ | 15:17 |
*** flaper87 has quit IRC | 15:18 | |
*** flaper87 has joined #openstack-infra | 15:18 | |
ttx | also, neutron-*aas has stable branches defined (probably a by-product of the git-filter) while they don't make sense there, would be better to just remove them. | 15:18 |
*** jcoufal_ has joined #openstack-infra | 15:19 | |
*** wenlock has quit IRC | 15:19 | |
fungi | ttx: clarkb had lobbied pretty strongly to keep the branches for discoverability purposes, but maybe just tagging the tips with something instead and deleting the branches would be an acceptable compromise | 15:19 |
ttx | fungi: yeah.. I just don't want people to get excited and propose changes there | 15:20 |
fungi | also i thought there was already a change proposed to add the server release jobs to the neutron advanced services projects... double-checking real quick | 15:20 |
ttx | since stable/juno changes to fwaas should just be proposed to openstack/neutron | 15:20 |
fungi | ttx: yep, i agree it could cause trouble | 15:20 |
fungi | i'll confirm with clarkb and we'll come up with a suitable tag pattern | 15:20 |
ttx | not sure I understand why you need to "discover" them, but can clarify with clarkb | 15:21 |
*** david-lyle has joined #openstack-infra | 15:21 | |
fungi | it was for purposes of being able to easily diff the kilo and juno versions of a file from one of the drivers, for example | 15:21 |
*** jcoufal has quit IRC | 15:21 | |
ttx | ah. hmm, tags should work for that yes | 15:22 |
fungi | agreed | 15:22 |
fungi | i would argue that the existing tags already cut from those branches would be suitable for that matter, but i'll get his input once he's around | 15:22 |
*** dkranz has joined #openstack-infra | 15:23 | |
*** jp_at_hp has quit IRC | 15:23 | |
*** jp_at_hp has joined #openstack-infra | 15:23 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: Update wording in the CONTRIBUTING.rst file https://review.openstack.org/141978 | 15:23 |
*** stevemar has joined #openstack-infra | 15:24 | |
*** signed8bit has quit IRC | 15:24 | |
*** signed8bit has joined #openstack-infra | 15:24 | |
*** pelix1 has quit IRC | 15:25 | |
*** pelix1 has joined #openstack-infra | 15:25 | |
*** mriedem has quit IRC | 15:25 | |
*** mriedem has joined #openstack-infra | 15:25 | |
*** HenryG_ has quit IRC | 15:25 | |
*** HenryG_ has joined #openstack-infra | 15:25 | |
*** ianw has quit IRC | 15:25 | |
*** ianw has joined #openstack-infra | 15:25 | |
*** k4n0 has quit IRC | 15:25 | |
*** k4n0 has joined #openstack-infra | 15:25 | |
*** ayoung has quit IRC | 15:25 | |
*** ayoung has joined #openstack-infra | 15:25 | |
*** che-arne has quit IRC | 15:25 | |
*** che-arne has joined #openstack-infra | 15:25 | |
*** jcoufal_ has quit IRC | 15:26 | |
*** jcoufal_ has joined #openstack-infra | 15:26 | |
*** dkranz has quit IRC | 15:26 | |
*** dkranz has joined #openstack-infra | 15:26 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add an AFS Git mirror for review-dev projects https://review.openstack.org/142130 | 15:28 |
fungi | it _can't_ be as easy as that ^ so i'm sure i'm missing something (at a minimum i need to set afs acls to allow writes there) | 15:28 |
*** yamamoto has quit IRC | 15:28 | |
*** yamamoto has joined #openstack-infra | 15:29 | |
*** afazekas has joined #openstack-infra | 15:29 | |
fungi | oh, spotted an error already | 15:29 |
*** afazekas is now known as afazekas_pto | 15:29 | |
*** koolhead17 has quit IRC | 15:30 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add an AFS Git mirror for review-dev projects https://review.openstack.org/142130 | 15:30 |
mtreinish | jogo: do you still need an answer to that? It's because of juno and the reqs set there | 15:30 |
*** rgerganov has joined #openstack-infra | 15:30 | |
*** erlon has joined #openstack-infra | 15:32 | |
rgerganov | fungi: hi, I have replied to your question about the GAE on the mail list | 15:33 |
rgerganov | fungi: let me know if you need more info | 15:33 |
*** mpaolino has quit IRC | 15:34 | |
*** yamamoto has quit IRC | 15:36 | |
clarkb | fungi ttx yup mostly wanted to make sure we werent losing history on the assumption we dont need it today. tags are fine | 15:36 |
*** hdd has joined #openstack-infra | 15:38 | |
*** jerryz has quit IRC | 15:39 | |
*** wenlock has joined #openstack-infra | 15:40 | |
*** emagana has quit IRC | 15:41 | |
*** rgerganov has quit IRC | 15:41 | |
*** pcaruana has quit IRC | 15:42 | |
*** mpaolino has joined #openstack-infra | 15:43 | |
*** erikwilson has joined #openstack-infra | 15:44 | |
*** mpaolino has quit IRC | 15:44 | |
*** erikwilson has quit IRC | 15:45 | |
*** mpaolino has joined #openstack-infra | 15:45 | |
*** nikil22 has quit IRC | 15:45 | |
*** erikwilson has joined #openstack-infra | 15:46 | |
clarkb | what is wrong with the newer requirements in oslo.db? | 15:47 |
dhellmann | clarkb: ? | 15:48 |
fungi | clarkb: requirements integration tests are what's wrong | 15:48 |
clarkb | reading scrollback | 15:48 |
clarkb | sdague says "new oslo.db" requirements bad | 15:48 |
clarkb | I think that means 1.3.0 | 15:49 |
*** carl_baldwin has quit IRC | 15:49 | |
fungi | clarkb: we want to release an oslo.db compatible with stable/juno's global-requirements.txt, so the sqla version specified in 1.3.0 needs to be rolled back first | 15:49 |
*** erikmwilson has quit IRC | 15:50 | |
*** erikwilson is now known as erikmwilson | 15:50 | |
openstackgerrit | Merged openstack-infra/jenkins-job-builder: deprecate postbuildscript onsuccess and onfailure parameter names https://review.openstack.org/139257 | 15:50 |
*** talluri has quit IRC | 15:50 | |
clarkb | because of how grenade tests? or because pinning oslo.db isnt working? | 15:50 |
*** erikwilson has joined #openstack-infra | 15:51 | |
fungi | clarkb: i believe where we got to was _before_ dropping sqla 0.8 support in oslo.db release one which has a requirements file compatible with setuptools 8 | 15:51 |
openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Generate tarballs for neutron-*aas on tags https://review.openstack.org/142126 | 15:51 |
ttx | sorry about that ^ -- missed the merge-tags job definition | 15:52 |
*** david-lyle has quit IRC | 15:52 | |
fungi | so roll back to the current stable/juno sqlalchemy requirement, cut a new oslo.db 1.4.0 with that, then drop sqlalchemy 0.8 support in master and pin stable/juno's oslo.db requirement <1.5 | 15:52 |
clarkb | fungi: gotcha | 15:53 |
fungi | because the only reason 1.3.0 was incompatible with stable/juno was that we "ostensibly" dropped sqlalchemy 0.8 support some people might still be using | 15:53 |
garyk | AJaeger: you around? | 15:54 |
clarkb | however the requirements do overlap so I don't think that should be a problem | 15:55 |
clarkb | eg we didn't remove an upgrade path for anyone | 15:55 |
sdague | clarkb: just got back from errand, here is the bullet points | 15:55 |
sdague | the requirements overlap isn't actually required | 15:55 |
fungi | ttx: aha, i missed that we didn't put merge-tags in the server-release-jobs template | 15:56 |
fungi | good catch | 15:56 |
sdague | unless we want to support running new swift with old ceilometer installed into it's pipeline (like we've been doing on grenade upgrade tests forever by accident) | 15:56 |
ttx | fungi: well, the test caught it for me. Nice one. | 15:56 |
*** reed has joined #openstack-infra | 15:57 | |
fungi | oh, hah | 15:57 |
sdague | we do need everything that's going to install in a branch to have roughly the same requirements | 15:57 |
clarkb | sdague: right (we have discussed this before and I was strongly on not bothering with that but everyone else thought it was important) | 15:57 |
*** achanda has joined #openstack-infra | 15:57 | |
sdague | clarkb: so we were arguing slightly different things | 15:57 |
sdague | I still think services should be able to upgrade one at a time, right now ceilometer is the only thing which violates that | 15:58 |
fungi | ttx: actually, i think it's the other way around... the jenkins job template for {name}-merge-release-tags needs to be instantiated in jenkins/jobs/projects.yaml | 15:58 |
sdague | https://review.openstack.org/#/c/142075/ changes upgrade order accordingly | 15:58 |
sdague | with a bug reference | 15:58 |
clarkb | sdague: so how is oslo.db 1.3.0 whihc is a "kilo" release dropping sqlalchemy 0.8 a problem for juno which allows 0.8 and 0.9? | 15:59 |
*** dustins has quit IRC | 15:59 | |
clarkb | sdague: when kil should use 1.2.1 of oslo.db that allows oth 0.8 and 0.9? | 15:59 |
sdague | because juno allowed oslo db | 15:59 |
sdague | 1.3 | 15:59 |
fungi | clarkb: because we still need some way to backport a fix for this to something before 1.3 if we cap it <1.3 in stable/juno | 16:00 |
*** markmcclain has quit IRC | 16:00 | |
clarkb | but we were going to pin oslo.db | 16:00 |
sdague | which apparently didn't happen | 16:00 |
clarkb | fungi: not really since we are currently oeprating in weird realm of setuptools 7 | 16:00 |
*** dustins has joined #openstack-infra | 16:00 | |
fungi | clarkb: right, but our branching ideas fell short without significant rework on how we test those library backport branches | 16:00 |
jeblair_ | i am told the oslo.db pin didn't happen because of the grenade failure | 16:01 |
sdague | until this morning when dhellmann pushed it | 16:01 |
sdague | no, it passed grenade | 16:01 |
sdague | I don't know why it didn't happen, but it was outstanding until this morning | 16:01 |
*** emagana has joined #openstack-infra | 16:01 | |
jeblair_ | well that changes a lot :) | 16:02 |
sdague | https://review.openstack.org/#/c/141896/ | 16:02 |
jeblair_ | oh, so why wasn't that cap <1.1 ? | 16:03 |
ttx | fungi: ah, oops. | 16:03 |
jeblair_ | because of grenade, right? | 16:03 |
sdague | the grenade change provides some equivalent cushion, plus after filing the bug on ceilometer around it, cdent is going to look into reviving a spec | 16:03 |
*** bhunter71 has joined #openstack-infra | 16:04 | |
sdague | jeblair_: I don't know | 16:04 |
dkranz | sdague: Is there some known failures happening a lot with jobs failing all juno + check-grenade-dsvm + check-grenade-dsvm-partial-ncpu | 16:04 |
sdague | dkranz: yes, see *ALL* of the last 4 hrs of backlog here | 16:04 |
fungi | i thought capping <1.1 when master requires newer than 1.1 was identified as something which wouldn't pass grenade? | 16:04 |
openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Generate tarballs for neutron-*aas on tags https://review.openstack.org/142126 | 16:04 |
dkranz | sdague: ok | 16:04 |
ttx | fungi: that should do it ^ | 16:05 |
*** isviridov is now known as isviridov_away | 16:05 | |
jeblair_ | that was our understanding yesterday, but now that sdague is around perhaps that is changing? | 16:05 |
dhellmann | fungi: it may pass grenade, it won't pass our requirements check that explicitly looks for overlapping ranges | 16:05 |
*** achanda has quit IRC | 16:05 | |
fungi | dhellmann: oh, right, i forgot we have that too. maybe that's just a bad idea in general? | 16:05 |
dhellmann | jeblair_: after we tag oslo.db 1.4 I planned to land https://review.openstack.org/#/c/142131/ | 16:05 |
dhellmann | fungi: yeah, I'm not sure why we think we need that | 16:05 |
sdague | so... without https://review.openstack.org/#/c/142075/ (which just merged) that might have been true | 16:05 |
sdague | because ceilometer | 16:06 |
dhellmann | I don't understand all of the requirements that led to what we have now | 16:06 |
dhellmann | sdague: do you mean because of ceilometer & swift? | 16:06 |
sdague | dhellmann: yep | 16:06 |
dhellmann | ok, well, if we're pointing fingers let's point them in the right direction | 16:06 |
fungi | dhellmann: oh, so part of the reason we implemented that check is that if you approve a change in requirements with no overlap from its previous value, then it trashes everything being tested behind it | 16:06 |
AJaeger | garyk, I'll be around again in two hours or so... | 16:07 |
dhellmann | fungi: behind it in the gate? | 16:07 |
sdague | fungi: though that's not true any more right | 16:08 |
fungi | dhellmann: right, i'm now trying to remember the reasons why that happens | 16:08 |
sdague | because the mirror used to be controlled via g-r | 16:08 |
jeblair_ | https://bugs.launchpad.net/openstack-ci/+bug/1274731 | 16:08 |
uvirtbot | Launchpad bug 1274731 in openstack-ci "non overalapping change to requirements repo broke gate" [Medium,Confirmed] | 16:08 |
jeblair_ | haha! it's because of the mirror | 16:08 |
jeblair_ | which is not an issue anymore | 16:08 |
*** rmcall has joined #openstack-infra | 16:08 | |
fungi | sdague: oh, that's why we were doing it, yep | 16:08 |
fungi | clearly i drank away the brain cells that recorded that info | 16:09 |
dhellmann | the requirements change to make the settings for sqlalchemy in master match the ones in juno passed its check: https://review.openstack.org/#/c/141927/2 | 16:09 |
fungi | so we should totally get rid of that check now | 16:09 |
jeblair_ | fungi: luckily launchpad remembered | 16:09 |
dhellmann | shall I self-approve that, or do we have some other people here with +2 on requirements? | 16:09 |
clarkb | so reading this I am still not sure why we need 141927 | 16:09 |
clarkb | indication seems to be we can pin stable/juno requirements which allows 0.8 and 0.9 | 16:10 |
clarkb | then master can use 0.9? | 16:10 |
*** AJaeger has quit IRC | 16:10 | |
openstackgerrit | Steven Weston proposed openstack-infra/infra-specs: Third Party CI Dashboard Spec https://review.openstack.org/135170 | 16:10 |
fungi | jeblair_: hah | 16:10 |
dhellmann | clarkb: we have a job that forbids that. We can turn that off, but that's a bigger change than just making the ranges overlap again. | 16:10 |
* jeblair_ is making that change now | 16:10 | |
*** lttrl has quit IRC | 16:10 | |
fungi | clarkb: the change to oslo.db gets tested against master requirements | 16:11 |
*** lttrl has joined #openstack-infra | 16:11 | |
sdague | yeh, I'm not sure I know why we'd do 141927 | 16:11 |
clarkb | fungi: OOOHHHH thats what I was missing | 16:11 |
dhellmann | oh, I looked away, are we dropping that requirements range thing? | 16:11 |
clarkb | ok /me feels caught up now | 16:11 |
dhellmann | I guess that means I don't need https://review.openstack.org/#/c/142131/ either | 16:12 |
sdague | so... why isn't oslo.db just coming on the stable/juno branch of oslo.db? | 16:12 |
dhellmann | or a new oslo.db release? | 16:12 |
fungi | clarkb: unless we want to do something about the fact that the oslo.db stable/juno branch is based on 1.0 even though we want to be able to use newer than 1.0 in stable/juno servers | 16:12 |
dhellmann | the stable/juno branch of oslo.db was from the 1.0 series | 16:12 |
clarkb | fungi: right | 16:12 |
jeblair_ | fungi: why do we want to use something newer than 1.0/ | 16:12 |
jeblair_ | ? | 16:12 |
jeblair_ | i mean, we want to use 1.0.1... | 16:12 |
dhellmann | I prepared a patch to merge 1.2 back into stable/juno, but that also includes other requirements updates which I didn't think we wanted in stable branches? | 16:12 |
fungi | jeblair_: that's a question for dhellmann i think | 16:13 |
sdague | dhellmann: ok, so why isn't that what get's fixed? | 16:13 |
* dhellmann tries to remember all of what happened yesterday | 16:13 | |
dhellmann | ok, let's just start over | 16:13 |
fungi | jeblair_: at the moment we say stable/juno works with all versions of oslo.db, so if we backport this fix to a 1.0.1 release then we need to cap stable/juno to oslo.db <1.1 even though we previously said it works with later versions | 16:13 |
dhellmann | do we care about overlapping ranges on requirements? | 16:14 |
fungi | so somewhat of a linearity problem | 16:14 |
openstackgerrit | Steven Weston proposed openstack-infra/infra-specs: Third Party CI Dashboard Spec https://review.openstack.org/135170 | 16:14 |
sdague | dhellmann: no, that grenade patch works around it | 16:14 |
*** Ala has quit IRC | 16:14 | |
*** koolhead17 has joined #openstack-infra | 16:14 | |
dhellmann | sdague: ok, in that case some of what we worked out to do yesterday is no longer needed | 16:14 |
jeblair_ | fungi: oh, i guess i didn't see that as a problem, but i understand how one might. | 16:15 |
dhellmann | this is the plan I've been working from this morning: https://etherpad.openstack.org/p/cloL2FzTRd | 16:15 |
sdague | so it seems like a release should come off the stable/juno branch of oslo.db | 16:15 |
*** achanda has joined #openstack-infra | 16:15 | |
sdague | now, that branch could be 1.1 | 16:15 |
sdague | 1.0.1 that is | 16:16 |
dhellmann | sdague: what release do you want? | 16:16 |
sdague | or you could roll forward to 1.2.1 on that branch | 16:16 |
dhellmann | because it sounds like now all we need to do is cap oslo.db <1.1 and we're fine | 16:16 |
*** dannywilson has joined #openstack-infra | 16:16 | |
fungi | sdague: can't exactly roll forward on that branch because it has cherry-picked backports of fixes | 16:16 |
dhellmann | 1.1 and 1.2 introduce other dependency changes, is it ok to do that to stable? | 16:16 |
fungi | sdague: so it's not fast-forwardable to 1.2.0 | 16:16 |
*** jpich has quit IRC | 16:16 | |
dhellmann | this is why we created the feature/1.2 branch to allow us to have a safe 1.2.1 release | 16:16 |
sdague | dhellmann: I don't actually care, just the thing which was breaking in a new way was trying to release a stable/juno dependency *not* off a stable/juno branch | 16:17 |
dhellmann | yeah, that was failing because of the way the requirements check job is written right now (it assumes the branch in the lib and the requirements repo will match) | 16:17 |
dhellmann | so we'll need to change that, and we talked about how to change it with jeblair_ yesterday | 16:17 |
sdague | dhellmann: which is a completely sane check, honestly | 16:17 |
dhellmann | but we thought we could fix all of this without waiting for that change | 16:18 |
fungi | right, if we try to merge 1.2.0 into the stable/juno branch then we'll be merging a change to requirements.txt which isn't in sync with stable/juno of global requirements | 16:18 |
dhellmann | sdague: it is, until you start wanting to maintain multiple backport versions of something like a library that isn't tied to the stable release cycle | 16:18 |
sdague | so... I'm really not understanding how releasing a library, specifically required for stable/juno to work | 16:18 |
*** dannywil_ has joined #openstack-infra | 16:18 | |
sdague | not off the stable/juno branch of the library | 16:18 |
sdague | is a safer thing | 16:18 |
jeblair_ | sdague: i believe that for feature branches, it should check against master. i want to make that change regardless. in a sane world, we should not use a feature branch for this, we should be working from stable/juno. | 16:18 |
jeblair_ | (which is why i'm also interested in fixing that) | 16:18 |
*** hashar has quit IRC | 16:19 | |
dhellmann | sdague: because until this morning we did not think we could have the requirements for oslo.db in juno and kilo not overlap, and so we needed a version of oslo.db with dependencies on sqla that worked in both, and no such library exists | 16:19 |
sdague | jeblair_: ok | 16:19 |
*** dangers_away is now known as dangers | 16:19 | |
*** dannywilson has quit IRC | 16:20 | |
dhellmann | up until this change that involved new requirements, I would have agreed. However, as we're using Semver, we can't change the dependencies of 1.0.x. The fix for this problem was to change the dependencies of oslo.db. | 16:20 |
*** ihrachyshka has quit IRC | 16:20 | |
dhellmann | so we needed a release outside of the 1.0 series with the fix, and the last version known to work in juno and master was 1.2 | 16:21 |
dhellmann | so we were trying to prepare a release of 1.2 that would work in both places, but that didn't work because of some of the jobs, and then we worked out that it would be quicker to release a 1.4 off of master than to fix all of the things we would have to fix to allow us to release a 1.2 | 16:21 |
dhellmann | I had hoped to have this all resolved yesterday, but ran out of time | 16:22 |
dhellmann | so, now that I've replayed all of that, what do we actually want to do today? Do we want a 1.4, or do we want a lower cap on juno? Or neither? | 16:23 |
*** dannywil_ has quit IRC | 16:23 | |
openstackgerrit | Dave Walker proposed openstack-dev/pbr: Ignore non-release related tags https://review.openstack.org/142144 | 16:23 |
*** dannywilson has joined #openstack-infra | 16:24 | |
clarkb | I think now that I grok where 1.4 comes from I am ok with moving forward on that and improving this process later when we are not under pressure of coming pip release | 16:24 |
dhellmann | sdague, fungi, jeblair_ : ? | 16:24 |
*** koolhead17 has quit IRC | 16:25 | |
jeblair_ | dhellmann: i'm trying to make it so that we can work on the stable/juno branch to release a library version that fixes a stable/juno problem since i think that's the right way to solve this in general. it's broken now, and i'm happy to do whatever we think is most expeditious. | 16:25 |
sdague | yeh, I think the thing that got lost is anything with a stable/juno branch needs a cap that references it | 16:26 |
dhellmann | jeblair_: ok, well, we're always going to have multiple release branches for oslo libs within a cycle because now that we're not using alphas we're going to have lots of X.Y+1 releases instead. So I don't know if it even makes sense to have stable/foo for those repos, but I haven't had time to think about that | 16:26 |
*** kragniz is now known as kragwhale | 16:26 | |
*** pelix1 is now known as pelix | 16:27 | |
jeblair_ | dhellmann: yeah, our thinking is that you either have stable/<name> or stable/<number>. this is not well exercised, so yeah, we can push on that later. :) | 16:27 |
fungi | i'm trying to think through the potential logistics of the next unidentified stable backport we'll need for oslo.db... if we don't enforce requirements checks for the stable branch until we start development on a version which we intend to make non-backward-compatible, we're still going to have this problem | 16:27 |
dhellmann | jeblair_: but that aside, it's no longer clear to me if we *need* a 1.4 today because IIUC sdague's proposal is to just cap the version of oslo.db in stable/juno even if that results in a non-overlapping requirements range | 16:28 |
jeblair_ | fungi: i think that's where sdague's "if it has a stable/juno branch, we need to cap use of it" comes in | 16:28 |
sdague | fungi: so the thing to realize is, all of requirements synchronization is a work around for pip not having a solver | 16:28 |
*** skolekonov has quit IRC | 16:28 | |
jeblair_ | dhellmann: yeah -- so in that case are we considering a 1.1 cap or 1.3? | 16:28 |
sdague | so we need to carefully spoon feed it a set of things which won't explode | 16:28 |
*** yolanda has joined #openstack-infra | 16:28 | |
dhellmann | we did agree at the summit that we wanted to cap versions in the stable branches, but we ran into issues with the upgrade test jobs breaking | 16:29 |
*** Masahiro has joined #openstack-infra | 16:29 | |
clarkb | sdague: sort of. We can still explode it with a solver | 16:29 |
fungi | where this gets tricky is that we need to cap these even if they don't (yet) have stable branches, because they may need one later | 16:29 |
sdague | clarkb: but at least we'd explode early | 16:29 |
clarkb | true | 16:29 |
sdague | right now the pip silent fail ... oh things are great... kaboom | 16:29 |
sdague | is really problematic | 16:29 |
dhellmann | jeblair_: if we're going to cap it permanently, I'd say <1.1 because that lets us avoid releasing fixes of 1.1, 1.2, and 1.3 with the requirements for sqla that work with setuptools | 16:29 |
*** david-lyle has joined #openstack-infra | 16:30 | |
sdague | which actually almost makes me want to do mordred's plan, which is stop using pip | 16:30 |
sdague | build packages | 16:30 |
sdague | have a package manager that actually has a solver | 16:30 |
jeblair_ | dhellmann: that seems sensible to me, i believe fungi was suggesting that people may have ended up with juno + 1.2 installed and we would make life hard for them. i do not know how theoretical of a problem that is. | 16:30 |
fungi | we release kilo with an open-ended requirement on foolib which is available at version 1.0.0 at the time. we should at the kilo release pin foolib<1.1 in anticipation of later needing to backport fixes which will work with a later state of stable/kilo | 16:30 |
dhellmann | jeblair_: ok, if we think that's a real thing (it's likely) then we should probably go ahead with the 1.4 release | 16:31 |
sdague | dhellmann: do we know if tests pass with oslo.db < 1.1? | 16:31 |
sdague | that would be good data | 16:31 |
sdague | because projects could have used new features in their backports | 16:31 |
dhellmann | jeblair_: and then work on the tools to make it possible to do releases from arbitrary stable branches with numbers instead of names | 16:31 |
*** koolhead17 has joined #openstack-infra | 16:31 | |
jeblair_ | sdague: would creating clean environments on upgrade help us here? ie, re-install everything into a new {system,venv,container} on upgrade? that way pip does the same thing on new install as upgrade? | 16:32 |
sdague | jeblair_: no, it just reduces the surface | 16:32 |
dhellmann | sdague: that's a good question, but I think fungi's point about CD sites probably already having 1.2 trumps it | 16:32 |
clarkb | one issue with mordreds plan is that we shift a lot of effort to the deployers if/when we do that. We essentially say don't install from source (which tripleo does for example) and everyone needs to build packages | 16:32 |
sdague | because pip's lack of solver still can put us in these binds | 16:32 |
jeblair_ | sdague: but it makes upgrade == install; so it reduces it to the minimum we can if we support installing with pip at all, right? | 16:32 |
dhellmann | clarkb: we talked about using something like fpm to build "dumb" packages that aren't necessarily compliant. I'd rather find some resources to help fix the pip resolver, though | 16:33 |
sdague | jeblair_: so... it it was a venv that did not allow system packages, it would make for a small fail surface, but it would still be there | 16:33 |
clarkb | dhellmann: yup and iirc mordred said "no one should use these packages but us" so we would really expect everyone to start building them | 16:33 |
*** david-lyle has quit IRC | 16:33 | |
*** Masahiro has quit IRC | 16:34 | |
*** nfedotov has quit IRC | 16:34 | |
dhellmann | clarkb: I'm not sure I follow | 16:34 |
*** EmilienM is now known as EmilienM|afk | 16:34 | |
sdague | package 1.0 depends on foo>=1.0 | 16:34 |
sdague | foo 1.0 depends on bar>=1.3 | 16:34 |
clarkb | dhellmann: today many people deploy from source. eg tripleo. They can do this because upstream of deployment we have taken on a lot of work of curating package dependencies and making sure you can install from source | 16:34 |
sdague | if bar != installed | 16:34 |
dstufft | urgh | 16:35 |
dhellmann | clarkb: oh, I see what you mean | 16:35 |
clarkb | dhellmann: if we switch to system packages that are built only for testing then we essentially are telling all of these downstream deployers that installing from source is at their own risk (and we know it is risky) or you all need to build packages | 16:35 |
sdague | pip install -e ./package drags in foo, and bar >= 1.3 | 16:35 |
jeblair_ | sdague: yeah, i understand -- i read all the scrollback :) | 16:35 |
sdague | jeblair_: ok | 16:35 |
sdague | jeblair_: so the reality is, it reduces the surface, but the problem still remains | 16:35 |
jeblair_ | sdague: i'm just saying that currently "install openstack via pip" has a behavior; replacing the env during upgrade at least makes the upgrade dependency resolution (such that it is) the same as installation | 16:36 |
jeblair_ | sdague: which as you point out, is problematic still :) | 16:36 |
sdague | right | 16:36 |
clarkb | that doesn't rule out system packages, its just a thing to consider | 16:36 |
*** yamamoto has joined #openstack-infra | 16:36 | |
*** reed has quit IRC | 16:36 | |
jeblair_ | okay. so i guess if we think that upgrade!=install is a problem, we could look into that. if we're more concerned with install!=ideal, then we should just do packages or fix pip. | 16:37 |
*** cnesa has quit IRC | 16:37 | |
sdague | which, honestly, we could get *nearly* the same behavior on by just setting the min == max on requirements before we sync | 16:37 |
*** dustins has quit IRC | 16:37 | |
*** reed has joined #openstack-infra | 16:37 | |
*** MarkAtwood has joined #openstack-infra | 16:37 | |
sdague | because clean venvs are going to produce that | 16:37 |
dstufft | honestly one of the things blocking a better dep solver in pip is that their is a lack of good libs for it (there is one or two, but last I looked they didn't work well) and I haven't cleared enough time out to actually learn how to write a SAT solver | 16:38 |
mordred | jeblair_: I played some this morning with both fpm and stdeb | 16:38 |
jeblair_ | sdague, dhellmann: i have a problem -- i can not find that we actually run the requirements overlap check. | 16:39 |
mordred | jeblair_: I think producing os packages is an automatic manner may not be terrible | 16:39 |
jeblair_ | sdague, dhellmann: https://review.openstack.org/#/c/98262/3 change that added it | 16:39 |
sdague | jeblair_: we may not | 16:39 |
jeblair_ | sdague, dhellmann: but there's no zuul entry with the word 'overlap' in it | 16:39 |
*** ryanpetrello has joined #openstack-infra | 16:39 | |
*** Swanson has left #openstack-infra | 16:40 | |
dhellmann | jeblair_: isn't it in http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/project-requirements-change.py somewhere? | 16:41 |
*** yamamoto has quit IRC | 16:41 | |
dhellmann | no, that just checks against the global list, doesn't it | 16:41 |
jeblair_ | dhellmann: that was the first version which was reverted due to this bug: https://bugs.launchpad.net/openstack-ci/+bug/1326504 | 16:41 |
uvirtbot | Launchpad bug 1326504 in openstack-ci "Requirements change and check causes proposal failure" [Undecided,Fix released] | 16:41 |
jeblair_ | then the idea was to move it into the requirements repo. and apparently all the work to do that was done except actually running the job | 16:42 |
*** rmcall has quit IRC | 16:42 | |
dhellmann | jeblair_: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n1414 | 16:43 |
dhellmann | but I guess you're saying that's not in zuul | 16:43 |
jeblair_ | yep | 16:43 |
dhellmann | fun | 16:43 |
dhellmann | so the job we're worried about isn't configured to run? | 16:43 |
jeblair_ | everything we thought yesterday was wrong. :) hopefully we won't say the same tomorrow | 16:43 |
*** david-lyle_afk is now known as david-lyle | 16:44 | |
* dhellmann looks for a softer wall to bang his head on | 16:44 | |
dstufft | fungi: if you're not aware, anatoly is a bit trollish sometimes | 16:44 |
openstackgerrit | James E. Blair proposed openstack/requirements: Remove requirements overlap check https://review.openstack.org/142151 | 16:44 |
* dims offers dhellmann a pillow :) | 16:44 | |
dstufft | fungi: I think he generally means well, but he doesn't take no for an answer hardly ever heh | 16:44 |
openstackgerrit | James E. Blair proposed openstack-infra/project-config: Remove requirements overlap check https://review.openstack.org/142152 | 16:45 |
*** andreaf has joined #openstack-infra | 16:45 | |
dhellmann | dstufft: has anatoly found openstack? | 16:45 |
dstufft | dhellmann: he's on distutils-sig and saying he wants openstack to replace PEP 440 because t's not semver | 16:45 |
dhellmann | ah | 16:46 |
dstufft | and fungi was responding so I was just letting fungi know that anatoly can be a huge time suck | 16:46 |
jeblair_ | dstufft: popped that popcorn yet? :) | 16:46 |
fungi | dstufft: right, i just wanted to make sure he didn't further the general perception that openstack is not a real free software project because many people who work on it are paid contributors | 16:46 |
*** zz_gondoi is now known as gondoi | 16:47 | |
dolphm | is there still an openstack pypi mirror available somewhere? | 16:47 |
dstufft | theres one per region I believe | 16:47 |
dstufft | jeblair_: lol | 16:47 |
fungi | dstufft: particularly on an ml frequented primarily by non-openstack python developers | 16:47 |
*** mattfarina has quit IRC | 16:47 | |
fungi | dolphm: nope, just full pypi mirrors. there's nothing "openstack" about them | 16:48 |
*** mattfarina has joined #openstack-infra | 16:48 | |
dolphm | fungi: hmm - what made it possible for the mirror to go away? | 16:48 |
sdague | jeblair_: that's some twitterable quote there :) | 16:48 |
*** belmoreira has quit IRC | 16:48 | |
fungi | dolphm: we run some embedded in the providers/regions where we run our tests to have lower-latency package install times for the servers there | 16:48 |
fungi | dolphm: we stopped using a special limited-scope mirror for enforcing requirements list coordination, in favor of jobs which checked directly | 16:49 |
dolphm | for the partial* mirror to go away | 16:49 |
jeblair_ | sdague: heh, yesterday dstufft tempted fate by saying something like "only a couple of responses on the thread, maybe i don't have to pop the popcorn" ;) | 16:49 |
*** changbl has joined #openstack-infra | 16:49 | |
sdague | jeblair_: nice | 16:49 |
dolphm | fungi: where can i find those jobs? | 16:49 |
sdague | jeblair_: though I was refering to further up | 16:50 |
sdague | https://twitter.com/sdague/status/544896798725513216 | 16:50 |
jeblair_ | sdague: oh :) | 16:50 |
fungi | dolphm: mostly http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/requirements.yaml | 16:50 |
clarkb | ok so, now that we have rehashed and seem to grok the situation as it is today :) what can I do to help move things along? | 16:51 |
clarkb | dhellmann: ^ | 16:51 |
*** vigneshvar has joined #openstack-infra | 16:51 | |
dolphm | fungi: awesome, thanks | 16:51 |
* clarkb is throwing him self into the fire because this stuff is important | 16:51 | |
dhellmann | clarkb: I still feel more comfortable going ahead with a 1.4 release, then capping juno to use that (skipping the broken versions 1.1, 1.2, and 1.3. It's not clear to me that we have consensus on that, though. | 16:51 |
clarkb | mordred: still around? your pbr changes fail pep8 again. Also, do we want to hold off on the second one to drop shas to hear back on dstufft's inding? | 16:52 |
*** mrmartin has joined #openstack-infra | 16:52 | |
mordred | clarkb: I'm actually kinda convinced we should just drop them | 16:52 |
clarkb | s/inding/findings/ | 16:52 |
dstufft | jeblair_: though I'm still pretty happy overalll. I know setuptools 8 is causing some issues here, and a few other places, but overall I think it's gone about as good as changes to this could have gone | 16:52 |
mordred | clarkb: but I'd also be easy to convince to hold off | 16:52 |
jeblair_ | clarkb: i believe this is dhellman's plan etherpad: https://etherpad.openstack.org/p/cloL2FzTRd | 16:52 |
clarkb | jeblair_: thanks I have that open now | 16:53 |
clarkb | I am +1 on releaseing a 1.4 | 16:53 |
dhellmann | clarkb: because even though jeblair_ found that we're not running the requirements overlap job, fungi pointed out that CD environments are probably already running 1.2, so I don't want to make the pin lower than that | 16:53 |
clarkb | if others agree I will review the requirements change | 16:53 |
*** e0ne is now known as e0ne_ | 16:53 | |
clarkb | dhellmann: yup | 16:53 |
*** e0ne_ is now known as e0ne | 16:53 | |
dstufft | clarkb: mordred fwiw I have some meetings today but I plan to get some numbers for the normalization rule after that, if it looks like it won't do anything bad to what we parse as a version thne I'll propose ammending PEP 440 with it on distutils-sig. I don't suspect anyone will fight me on it | 16:54 |
mordred | k. | 16:54 |
clarkb | dstufft: ok, and assuming all that the change to not emit normalized versions in setuptools is also non controversial? | 16:54 |
jeblair_ | what's the normalization rule? | 16:54 |
dhellmann | jeblair_: do you mean cap the dependencies in versions with stable branches, or cap the oslo lib versions with stable branches? | 16:54 |
dstufft | clarkb: Most likely I'll just make it so pbr can turn off the normalization | 16:54 |
openstackgerrit | Merged openstack-infra/project-config: Fix publishing rally html results https://review.openstack.org/140296 | 16:54 |
dstufft | not that setuptools won't in general emit then normalized | 16:55 |
clarkb | dstufft: toggleable flag? that should work too | 16:55 |
dstufft | clarkb: yea | 16:55 |
mordred | clarkb: pushed fixed patch - sorry bout that | 16:55 |
*** alexpilotti has quit IRC | 16:55 | |
clarkb | jeblair_: basically dstufft's proposal is treat a trailing .[:alnum:] string as string sorted not number sorted. This would get normalized to +[:alnum:] | 16:55 |
dstufft | jeblair_: take a final trailing .alphanumeric (not .alphanumeric.alphanumerc, or anything else, one dot, and alpha num and normalize it to +alphanum) | 16:55 |
clarkb | jeblair_: the problem right now is that setuptools emits the normalized form (+[:alnum:]) in the package it creates so older setuptools would still be broken | 16:56 |
*** koolhead17 has quit IRC | 16:56 | |
dstufft | we had something similar to that in the course of testing variations of PEP 440 but I don't think we ever tested it on it's own | 16:56 |
dstufft | I think it also came with some other rules that we ultimately dropped | 16:56 |
*** MaxV has quit IRC | 16:56 | |
dstufft | like an implicit leading zero | 16:56 |
clarkb | jeblair_: so we would need some way of disabling that to stick with .[:alnum:] then let normalization happen only internal to setuptools. Otherwse we are not forward and backward compat | 16:56 |
jeblair_ | dhellmann: i'm trying to say "try to do the thing we agreed to do at the summit and attempted and failed to do", which i think is "for every project with a stable branch, cap the version of that project to the latest that currently meets the spec for the project in that branch" | 16:56 |
dstufft | which meant that we got some relaly bad version parses | 16:56 |
*** sputnik13 has joined #openstack-infra | 16:56 | |
dstufft | like object object repr()s that got parsed as 0+<object repr> | 16:57 |
jeblair_ | dhellmann: or put another way: do what would have been needed for us to be able to release 1.0.1 here | 16:57 |
dstufft | so I just need to make sure that the rule won't allow something crazy | 16:57 |
mordred | clarkb: the idea of having a normalization that we somehow disable | 16:57 |
dhellmann | jeblair_: ok. That ship may have sailed for many of the oslo libs, though. We are currently testing juno against releases made during kilo and as fungi pointed out that may mean CD sites have them, too. We would be forcing downgrades on them. | 16:57 |
mordred | clarkb: sounds like something thats going to increase the amount of strangenes and confusion over time | 16:57 |
clarkb | mordred: it might and is generally why I am on baord with dropping the shas completely | 16:57 |
dhellmann | jeblair_: I suppose we could have made a 1.0.3 or whatever that had the sqlalchemy settings specified in a way that worked for setuptools 8 | 16:58 |
dstufft | mordred: to be clear, you're only controlling whether setuptools is going to emit the normalized version, not controlling whether normalization happens on the installee end | 16:58 |
mordred | from what I can tell, most of the CD deployers munge the versions themselves anyway | 16:58 |
jeblair_ | dhellmann: so maybe we cap it at what's there now to avoid making things worse? i dunno. we can come back to it, i just don't want to forget and then in 2 weeks say "i thought we..." | 16:58 |
*** markmcclain has joined #openstack-infra | 16:58 | |
dhellmann | jeblair_: yes, definitely, I'm just trying to figure out what exactly we want to do :-) | 16:58 |
*** garyk has quit IRC | 16:58 | |
*** sarob has joined #openstack-infra | 16:59 | |
clarkb | dstufft: right since old setuptools wouldn't normalize at all and just work (tm) then new setuptools could normalize during its install | 16:59 |
dstufft | mordred: essentially letting you act as if for dist creation you're not using setuptools 8 | 16:59 |
clarkb | dstufft: the important bit is that the intermediate step of a whl or sdist artifact not normalize so that it is portable | 16:59 |
dstufft | clarkb: yea | 16:59 |
mordred | yes. I get that | 16:59 |
mordred | EXCEPT | 16:59 |
mordred | that it takes a lot of mental effort for me to get that | 16:59 |
mordred | so it's tripping me "we're making this too hard" alarm | 16:59 |
mordred | my | 16:59 |
*** dtantsur is now known as dtantsur|afk | 16:59 | |
clarkb | mordred: agreed. I really do like your solution :) | 17:00 |
mordred | I would prefer to lessen the number of things that only 4 of us understand | 17:00 |
*** cnesa has joined #openstack-infra | 17:00 | |
dhellmann | jeblair_: to cap to something <1.3 (the current highest release, which is broken), we need a way to release a 1.2.1. Going with 1.4 seemed expedient, since the code in 1.3 should work fine, it's just the dependencies that are broken. | 17:00 |
anteaya | mordred: thanks | 17:00 |
* anteaya is trying to follow along, is totally lost | 17:01 | |
dstufft | mordred: my life is series of things that 4 people understand at this point :V | 17:01 |
anteaya | dstufft: you are on my list of people to understand, alas not today | 17:02 |
dstufft | clarkb mordred: I would prefer not to add that normalization rule fwiw, but I'm not opposed to doing it if we can | 17:02 |
clarkb | mordred: dstufft: maybe it is more productive on the whole to just not worry about it. accept that lifeless would rather we not go down this path, apologize, then merge mordred's changes? | 17:02 |
mordred | clarkb: I vote for that | 17:02 |
mordred | jeblair_, dhellmann: ^^ ? | 17:02 |
* dhellmann doesn't understand the question | 17:04 | |
*** hashar has joined #openstack-infra | 17:04 | |
dhellmann | mordred, clarkb : which patch? | 17:04 |
clarkb | dhellmann: 141667 | 17:04 |
mordred | dhellmann: we're debating dropping the git sha from the intra-release generated versions from pbr | 17:04 |
clarkb | dhellmann: the one you asked for more comments on which I am not opposed to adding :) | 17:05 |
dstufft | dhellmann: when creating a dev version, pbr currently puts a git sha in the version. That doens't work with the current PEP 440. the choices are a) drop shas from the version string (they will be recorded elsewhere) or b) I go and see about adding some normalization rules to PEP 440 to make it work again | 17:05 |
mordred | dhellmann: however, if you need your head in the other problem, feel free to ignore us | 17:05 |
dhellmann | mordred: yeah, I'm really trying to get a resolution on the sqlalchemy issue first, but I give zero toots about shas in version numbers if we can have a "patch number since last tag" or something | 17:06 |
mordred | dhellmann: yup. we can have that | 17:06 |
jeblair_ | mordred: i personally find including it in the version to be of limited utility, specifically because of the weird sorting, so a weak +1 from me. i do not pretend to understand all the other possible use cases this might affect. | 17:06 |
dhellmann | and the issue with dropping the sha is we don't get unique versions for CD folks? | 17:06 |
*** ChuckC_ has joined #openstack-infra | 17:06 | |
mordred | only if they jump around | 17:07 |
mordred | there might be two different things that are different that have version 1.2.3.4 | 17:07 |
mordred | in that that's two different things that are 4 patches patst 1.2.3 | 17:07 |
clarkb | where 4 is the patch level | 17:07 |
mordred | I don't really care | 17:07 |
*** ChuckC has quit IRC | 17:07 | |
mordred | at that point, they're doing crazypants and I can't help them anyway | 17:07 |
dhellmann | yeah, I see that it could be a problem, but I'm not sure it's our problem | 17:08 |
*** otter768 has joined #openstack-infra | 17:08 | |
dhellmann | esp. not if it means everything else is broken for everyone else | 17:08 |
fungi | the primary concern expressed against boiled down to "cd sysadmins are relying on being able to see the git sha in the package version number now, and shouldn't need to install and run some new command from pbr to find them" | 17:08 |
*** sarob has quit IRC | 17:08 | |
mordred | yah. I think aligning with upstream python sensibilities is more important, even if it means shorterm discomfort for someone | 17:09 |
fungi | a position which i, as a long-time sysadmin myself, have a hard time developing sympathy for | 17:09 |
sdague | it seems reasonable to tell cd folks "you need this other tool" | 17:09 |
mordred | especially when the tool will get installed on your system already | 17:09 |
*** sweston is now known as _sweston | 17:09 | |
sdague | yep | 17:09 |
dstufft | I think the other thing was that pip would know it needs to reinstall if you do ``pip install foo==<some version with a git hash>`` but it wouldn't if you didn't do that | 17:10 |
mordred | this is true | 17:10 |
dstufft | but you can either uninstall first or do pip install -U --force-reinstall foo==<some version without a git hash> | 17:10 |
mordred | yah | 17:10 |
*** sarob has joined #openstack-infra | 17:11 | |
mordred | it's an edge case, and again, you need to know what your'e doing there | 17:11 |
dstufft | mordred: I didn't look at the patch recent, but one suggestion I did have was change the comment so it was like # from git <hash> or something | 17:12 |
*** sweston has joined #openstack-infra | 17:12 | |
dstufft | instead of just # <hash> | 17:12 |
*** carl_baldwin has joined #openstack-infra | 17:12 | |
*** Guest51388 has quit IRC | 17:12 | |
*** otter768 has quit IRC | 17:12 | |
*** markmcclain1 has joined #openstack-infra | 17:12 | |
*** markmcclain has quit IRC | 17:13 | |
fungi | i like the explicitness of that, though i was okay without (since previous behavior was just as opaque, thus not a regression) | 17:13 |
*** vigneshvar has quit IRC | 17:14 | |
*** rmcall has joined #openstack-infra | 17:14 | |
*** sweston has quit IRC | 17:15 | |
*** sweston has joined #openstack-infra | 17:15 | |
ttx | dstufft: will PEP440 be ahppy with 2015.1.b1 or should it be 2015.1b1 now ? | 17:15 |
ttx | fungi: about to tag Trove but realized I may have an issue here | 17:15 |
dstufft | ttx: it'll accept 2015.1.b1 but it'll normalize to 2015.1b1 | 17:16 |
ttx | dstufft: ok, so I'll hit the same hurdle as with 2.2.1.rc1 | 17:16 |
dstufft | ttx: yes most likely | 17:17 |
ttx | i.e. our usage of setuptools will result in a tarball named 2015.1b1.tar.gz and a tag names 2015.1.b1 | 17:17 |
dstufft | yes | 17:17 |
dstufft | if you create it with setuptools 8+ | 17:17 |
ttx | hmmm, ok | 17:17 |
clarkb | speaking of | 17:17 |
*** sputnik13 has quit IRC | 17:17 | |
zaro | morning | 17:17 |
*** enikanorov has quit IRC | 17:17 | |
clarkb | mordred: https://review.openstack.org/#/c/141831/ your thoughts on that are also appreciated | 17:17 |
clarkb | mordred: it is related to ttx's questions above | 17:17 |
ttx | clarkb: any hint on whether I should do .b1 or b1 ? | 17:17 |
clarkb | ttx: note that 141831 would prevent a tag of 2015.1.b1 | 17:18 |
dstufft | I think that's a hint to do b1 | 17:18 |
dstufft | lol | 17:18 |
ttx | yep | 17:18 |
*** mtanino has joined #openstack-infra | 17:18 | |
ttx | I mean, if we know that we'll only do bX soon, I'm fine with starting today | 17:18 |
*** tonytan4ever has joined #openstack-infra | 17:18 | |
ttx | better than changing in the middle of the cycle | 17:18 |
*** sputnik13 has joined #openstack-infra | 17:18 | |
clarkb | ttx: +1, lets see what mordred thinks about that if he is still around | 17:19 |
zaro | notmyname: i think you and edwin are talking about 2 different things when you are referring to a 'custom dashboar'. i think edwin is referring to the custom dashboard feature while you are referring to a custom query. | 17:19 |
*** ChuckC_ has quit IRC | 17:19 | |
zaro | notmyname: this is an example of a custom dashboard: https://review.openstack.org/#/projects/All-Projects,dashboards/important-changes:important-changes-dashboard | 17:19 |
*** ivar-lazzaro has joined #openstack-infra | 17:20 | |
sdague | jeblair_: so... unrelated to all of this | 17:20 |
sdague | what's up with the zuul event graphs? | 17:21 |
pleia2 | morning | 17:21 |
notmyname | zaro: ah. right. I'm referring to eg what http://goo.gl/r2mxbe resolves to | 17:21 |
clarkb | dhellmann: would it be ok if I put non oslo.db related setuptools 8.0 things on your etherpad too? | 17:21 |
*** achanda has quit IRC | 17:21 | |
dhellmann | clarkb: sure | 17:21 |
*** carl_baldwin has quit IRC | 17:22 | |
*** sarob has quit IRC | 17:23 | |
*** dims has quit IRC | 17:23 | |
*** sarob_ has joined #openstack-infra | 17:23 | |
mordred | clarkb: looking | 17:23 |
*** dmsimard is now known as dmsimard_away | 17:23 | |
*** dims has joined #openstack-infra | 17:23 | |
dstufft | clarkb: I think you can also update PEP 440 but still emit normalized things, it would just mean that CD operators need to be setuptools 8+ | 17:23 |
zaro | notmyname: yeah, i think what you want is to be able to share just an arbitrary query. | 17:23 |
*** yamamoto has joined #openstack-infra | 17:24 | |
dstufft | if that's a better option for y'all in confusion terroritory wise | 17:24 |
zaro | notmyname: that feature does not exist in gerrit today. | 17:24 |
dstufft | I Have a hard time telling the difference between things that make sense to me because they are easy to understand and things that make sense to me becuase I wrote 8000 words on versioning | 17:24 |
notmyname | zaro: thanks. I'll try to clarify that | 17:24 |
*** achanda_ has joined #openstack-infra | 17:24 | |
jeblair_ | sdague: i believe it's hitting timeouts; i landed a fix to address that | 17:25 |
jeblair_ | clarkb, fungi: ^ maybe we should restart zuul now | 17:25 |
*** dmsimard_away is now known as dmsimard | 17:25 | |
clarkb | jeblair_: the fix was to bump the timeout locally again? | 17:25 |
mordred | clarkb: so pep440 wants us to make 2015.1.1b1 if we were good little chickens? | 17:25 |
jeblair_ | clarkb: yeah, though this time it's in a real change to zuul | 17:25 |
dstufft | mordred: 2015.1b1 | 17:25 |
clarkb | mordred: correct, and if you do something else it will normalize to that and thats the version in your sdist | 17:26 |
dstufft | if you want the normalized version | 17:26 |
dstufft | oh | 17:26 |
dstufft | I missed the second .1 | 17:26 |
clarkb | dstufft: I think 2014.1.1b1 is also allowed | 17:26 |
dstufft | yea it Is, I just didn't read close enough and thought mordred was repeating ttx's version | 17:26 |
ttx | mordred: I tagged Swift 2.2.1.rc1 and that cvreated swift-2.2.1c1.tar.gz, so we backtracked and tagged Swift 2.2.1c1 | 17:26 |
clarkb | mordred: so in the interest of reducing confusion I assert the tag should match pep440 as well | 17:26 |
ttx | mordred: now I need to push kilo-1 tags... used to be 2015.1.b1 | 17:26 |
dstufft | note that 2015.1.1b1 is newer than 2015.1 | 17:26 |
dstufft | 2015.1.0b1 is equiv though | 17:27 |
mordred | I agree - the tag should match the thing that will be normalized so taht both things agree | 17:27 |
ttx | mordred: but 2015.1b1 sounds liek the way to get tags matching tarballs | 17:27 |
*** derekh has quit IRC | 17:27 | |
*** shashankhegde has joined #openstack-infra | 17:27 | |
clarkb | dstufft: noted | 17:27 |
*** sarob_ is now known as sarob | 17:27 | |
ttx | If everyone agrees, I'll tag kilo-1 as 2015.1b1 | 17:27 |
mordred | ttx: yes. except then we've got two different regexes - can we just mkae the servers 2015.1.0b1 so that we can have one and only one regex we accept? | 17:27 |
*** alexpilotti has joined #openstack-infra | 17:27 | |
*** jcoufal_ has quit IRC | 17:27 | |
*** dims_ has joined #openstack-infra | 17:28 | |
clarkb | mordred: my regex accepts both | 17:28 |
mordred | right. | 17:28 |
clarkb | mordred: I don't think I follow "two different regexes" | 17:28 |
mordred | but I don't want to accept a letter in the second stanza for most things - that's a server ideosyncracy | 17:28 |
*** achanda_ has quit IRC | 17:28 | |
*** dims has quit IRC | 17:28 | |
mordred | like, we NEVER want 1.0b1 for any of our things if we're trying to trend everythign that isn't the servers towards semver | 17:28 |
mordred | so if we're changing the server pattern anyway | 17:28 |
*** sarob_ has joined #openstack-infra | 17:29 | |
*** achanda has joined #openstack-infra | 17:29 | |
mordred | why not go ahead and make it at least fit the stricter regex | 17:29 |
clarkb | mordred: so my intent was to match PEP440 as closely as possible | 17:29 |
clarkb | mordred: and not proscribe anything atop that | 17:29 |
mordred | oh, I don't want to do that | 17:29 |
mordred | I want to proscribe on top of it | 17:29 |
dstufft | pep 440 allows some crazy versions | 17:29 |
clarkb | because that additional stuff is what is biting us today | 17:29 |
mordred | because there is no good reason to allow 1.0 instead of 1.0.0 | 17:29 |
dstufft | accepting a subset of pep 440 is recommended | 17:29 |
mordred | dstufft: ++ | 17:29 |
clarkb | mordred: ok so you want to require three digit sections? | 17:30 |
mordred | yes | 17:30 |
clarkb | ok let me update regexes | 17:30 |
mordred | because then there is just a rule | 17:30 |
*** ihrachyshka has joined #openstack-infra | 17:30 | |
ttx | mordred: and tag finazl as 2015.1.0 ? | 17:30 |
mordred | well - hang on | 17:30 |
mordred | make sure other people who aren't me agree :) | 17:30 |
mordred | ttx: yes | 17:30 |
mordred | that's my pitch - I could be insane though | 17:30 |
ttx | I'm not sure I follow the "only 3 digit sections" rationale | 17:31 |
dstufft | semver says you have to have 3 digits | 17:31 |
dstufft | semver.org | 17:31 |
clarkb | we did not enforce that before, but I am happy to enforce it now | 17:31 |
ttx | dstufft: sure but here we are talking date-based versioning | 17:31 |
*** yamamoto has quit IRC | 17:32 | |
*** sarob has quit IRC | 17:32 | |
* ttx looks up previous tags to minimize disruption | 17:32 | |
mordred | ttx: right. I don't care about the date based versions per-se | 17:32 |
*** mkerrin has quit IRC | 17:32 | |
mordred | ttx: what I want to do is enforce that non-date-based have 3 stanzas | 17:32 |
mordred | it doesn't _break_ date based to have 3 | 17:32 |
*** marun has joined #openstack-infra | 17:33 | |
mordred | so the simplest thing is just to say "have 3 kthxbai" | 17:33 |
ttx | and you want a single regexp, ok | 17:33 |
dstufft | for whatever it's worth, PEP 440 treats 2015.1.0 and 2015.1 as exactly equiv, so it's entirely a human decision | 17:33 |
ttx | makes sense | 17:33 |
dstufft | as far as PEP 440 goes | 17:33 |
ttx | well, not really, but I see your point now | 17:33 |
*** marcusvrn1 has quit IRC | 17:33 | |
mordred | that way there is a very simple rule for people to follow | 17:33 |
*** achanda has quit IRC | 17:33 | |
*** bdpayne has joined #openstack-infra | 17:33 | |
*** vigneshvar has joined #openstack-infra | 17:33 | |
mordred | that said - we COULD make the regex treat versions that begin with 20\d\d differently | 17:33 |
mordred | I mean, that's also not a hard regex to write | 17:34 |
ttx | so the main change (because frankly I don't care about dev milestones), is that we won't be having YYYY.S tags anymore | 17:34 |
dstufft | mordred: not future compatible with 2100!!! | 17:34 |
mordred | dstufft: not my problem :) | 17:34 |
ttx | we always had "2014.2" like things | 17:34 |
dhellmann | clarkb, fungi: new plan, line 29 of https://etherpad.openstack.org/p/cloL2FzTRd | 17:35 |
*** tonytan4ever has quit IRC | 17:35 | |
ttx | althouigh swift used "2.0.0" so I guess there is precedent | 17:35 |
*** carl_baldwin has joined #openstack-infra | 17:35 | |
*** tonytan4ever has joined #openstack-infra | 17:35 | |
ttx | mordred: ok, I think we can leave with that | 17:36 |
ttx | or live | 17:36 |
*** _nadya_ has quit IRC | 17:37 | |
clarkb | dhellmann: that also works for me | 17:37 |
*** ssam2_ has joined #openstack-infra | 17:37 | |
*** garyk has joined #openstack-infra | 17:37 | |
*** franred has joined #openstack-infra | 17:37 | |
clarkb | dhellmann: will need to read through what fungi and you discussed to understand why but I am fine with that too | 17:37 |
ttx | clarkb: if I tag 2015.1.0b1 ... will the current regexp catch it in pre-release ? | 17:37 |
ttx | clarkb: and setuptools won't barf on me either ? | 17:38 |
clarkb | ttx: good question, I think so but let me check | 17:38 |
dstufft | ttx: setuptools will be perfectly happy with that in any version I've ever seen | 17:38 |
fungi | right, so 2015.1.0b1 sorts earlier than 2015.1.0 (which sorts equivalent to 2015.1) | 17:39 |
clarkb | looks like our regex allows both .bX and XbY to trail a version | 17:39 |
clarkb | ttx: so the verison you have above should work fine | 17:39 |
ttx | ok, just need to update my scripts | 17:39 |
*** andreaf has quit IRC | 17:40 | |
fungi | and setuptools isn't going to renormalize either of 2015.1.0 or 2015.1 | 17:40 |
*** tonytan4ever has quit IRC | 17:40 | |
dstufft | fungi: correct | 17:40 |
clarkb | I will update my regex changes to require 3 digit things | 17:40 |
*** andreaf has joined #openstack-infra | 17:40 | |
clarkb | mordred: ttx do we want to allow more than 3 or 3 only? | 17:40 |
clarkb | iirc semver requires at least 3 but allows you to do more | 17:40 |
dhellmann | sdague: do you have any feedback on the plans outlined in https://etherpad.openstack.org/p/cloL2FzTRd ? | 17:40 |
*** erikmwil_ has joined #openstack-infra | 17:41 | |
* dhellmann goes for lunch | 17:41 | |
mordred | clarkb: 3 only | 17:41 |
*** erikmwil_ has quit IRC | 17:41 | |
mordred | clarkb: semver == 3 and only three | 17:41 |
*** erikmwil_ has joined #openstack-infra | 17:41 | |
ttx | [ Tagging fd0966935e5ac5007560d0032f7dee1fe5f660dc as 2015.1.0b1 ] | 17:42 |
ttx | we are a go | 17:42 |
*** erikmwilson has quit IRC | 17:42 | |
clarkb | mordred: are you sure? I thought semver allowed more | 17:42 |
fungi | mordred: clarkb: so tempest will no longer get to use incrementing integer versions i guess? | 17:43 |
clarkb | fungi: it will but will have to use 4.0.0 | 17:43 |
*** kragwhale is now known as kragniz | 17:43 | |
fungi | or is this only for alpha/beta/candidate pre-releases? | 17:43 |
mordred | clarkb: " | 17:43 |
mordred | Additional labels for pre-release and build metadata are available as extensions to the MAJOR.MINOR.PATCH format." | 17:44 |
*** erikmwil_ is now known as erikmwilson | 17:44 | |
clarkb | mordred: now that I reread the only extentions are for the alpha and beta things | 17:44 |
clarkb | mordred: ya | 17:44 |
fungi | i could see some reason to require a minimum number of version components in a pre-release version string but not in a release version string | 17:44 |
mordred | yah | 17:44 |
clarkb | fungi: I think the reason is because semver | 17:44 |
clarkb | fungi: basically being good software citizens | 17:44 |
mordred | I mean, it's still not totally right | 17:44 |
mordred | because of their -alpha obsession | 17:44 |
*** armax has joined #openstack-infra | 17:45 | |
fungi | clarkb: okay, but tempest doesn't actually have semantics around its versions in that way, so it's sort of a shoehorning into a mismatched release management scheme which is ultimately meaningless there | 17:45 |
fungi | if we limit our tag matches like that in layout.yaml, we're forcing that part of semver on everyone using our release automation, stackforge projects even | 17:46 |
clarkb | fungi: they actually do, its an assertion of non backward compat from that point forward beacuse $release support goes away | 17:47 |
clarkb | fungi: so each major version tag is proper under semver | 17:47 |
*** ChuckC_ has joined #openstack-infra | 17:47 | |
fungi | i can see limiting release automation for python projects to only version strings which are pep-440 compliant, but going further and forcing semver itself on everyone is a bigger leap | 17:47 |
dstufft | For the record here is the regex that parses all available PEP 440 versions: https://github.com/pypa/packaging/blob/master/packaging/version.py#L162-L198 (including those not normalized) | 17:48 |
*** erikmwilson has quit IRC | 17:49 | |
clarkb | dstufft: I explicitly want to limit to normalized to avoid confusion when tag != version | 17:49 |
asselin | Hi, I'm trying to create single use jenkins nodepool image and running into this error. Any tips? http://paste.openstack.org/show/151952/ | 17:49 |
*** erikmwilson has joined #openstack-infra | 17:49 | |
dstufft | clarkb: makes sense, I don't have a regex that allows all possible versions of that, but it shouldn't be terribly hard to do | 17:49 |
openstackgerrit | Mauro Rodrigues proposed openstack-infra/elastic-recheck: Update Bug #1365046 query https://review.openstack.org/142169 | 17:49 |
uvirtbot | Launchpad bug 1365046 in openstack-gate "Job failed due to no devstack directory" [Undecided,Confirmed] https://launchpad.net/bugs/1365046 | 17:49 |
clarkb | dstufft: it isn't the normalized grammar is simple and regular | 17:49 |
*** e0ne has quit IRC | 17:50 | |
clarkb | mordred: ^ want to respond to fungi? | 17:50 |
dstufft | some people are apparently mad that we did c isntead of rc (though I have no idea why we did c, I just didn't care) | 17:50 |
mordred | dstufft: I think it's because "c" is not a thing that anyone has actually used to convey that meaning _ever_ | 17:51 |
dstufft | I think it comes from the old PEP | 17:51 |
dstufft | which is 5 years old at this point and predates me | 17:51 |
mordred | clarkb, fungi: I can see that - I can give up on it | 17:51 |
mordred | honestly, it's not a hard stance on my part | 17:52 |
clarkb | mordred: fungi: maybe we start with just matching the pep440 normalized form as in my current change | 17:52 |
clarkb | mordred: fungi: and bring up semver enforcement as future improvement since that isn't tied to making things better in the post 440 world | 17:52 |
mordred | clarkb: ++ | 17:52 |
dstufft | mordred: do you think I should see about ammending PEP 440 to switch c with rc | 17:52 |
fungi | i'm guessing "c" was suggested by someone obsessed with consistency who wanted to shorten "rc" to the same length as "a" and "b" and liked that they came as a progression in a certain (technically wrong) alphabet | 17:52 |
mordred | dstufft: it might make people happier | 17:52 |
dstufft | fungi: probably, that old PEP also put dev after a, b and c | 17:53 |
dstufft | my first change was arguing that was insane | 17:53 |
fungi | dstufft: right, i wondered why not shorten "dev" to "d" in that case | 17:53 |
clarkb | ok I think my change is ready for review and merging then | 17:54 |
*** BobBall is now known as BobBall_AWOL | 17:54 | |
*** ChuckC_ has quit IRC | 17:54 | |
*** marcusvrn has joined #openstack-infra | 17:54 | |
clarkb | I am reviewing the pbr changes now | 17:54 |
*** sarob_ is now known as sarob | 17:55 | |
cody-somerville | Is it possible to get historical data on core memberships across OpenStack? | 17:55 |
*** shashankhegde has quit IRC | 17:55 | |
mordred | cody-somerville: I do not believe that data exists in any of our systems | 17:55 |
fungi | cody-somerville: not really. nobody's been tracking it to my knowledge | 17:55 |
*** dustins has joined #openstack-infra | 17:56 | |
*** shashankhegde has joined #openstack-infra | 17:56 | |
*** achanda has joined #openstack-infra | 17:56 | |
clarkb | in theory that will change when gerrit drops the db as everything will be in git | 17:56 |
clarkb | but hasn't happened yet | 17:56 |
fungi | cody-somerville: we could _start_ tracking it fairly easily (i have a script, it could dump into a git repo daily or something) but today that's not the case | 17:56 |
mordred | you might get close with stackalytics - they don't look at actual core but instead track who has used a +2 vote | 17:56 |
*** ChuckC_ has joined #openstack-infra | 17:56 | |
dstufft | https://mail.python.org/pipermail/distutils-sig/2014-December/025409.html | 17:56 |
*** shashankhegde has quit IRC | 17:57 | |
fungi | also to some extent reviewstats core reviewers list, though it's not a 1:1 match to gerrit and also tends to lag a bit | 17:57 |
mordred | dstufft: ++ | 17:57 |
cody-somerville | mordred: fungi: Ah, ok. Kudos for the pointers. | 17:57 |
*** arxcruz has quit IRC | 17:59 | |
clarkb | mordred: see comments on https://review.openstack.org/#/c/141667/ basicaly putting other peoples comments that I have heard on that patchset so you can see them easily | 17:59 |
jeblair_ | clarkb, fungi: any objections to my restarting zuul now? | 18:00 |
clarkb | jeblair_: none from me | 18:00 |
fungi | jeblair_: no, i agree it's a good idea to go ahead and get that timeout increased | 18:01 |
clarkb | mordred: oh ignore the comment about git descibe output you capture that in the second change | 18:01 |
*** jp_at_hp has quit IRC | 18:01 | |
*** dustins has quit IRC | 18:01 | |
*** garyk has quit IRC | 18:02 | |
jogo | sdague dhellmann: I am thinking of going a slightly easier route with the virtualenvs - per devstack venv | 18:02 |
jogo | so grenade will have two venvs | 18:02 |
*** rmcall has quit IRC | 18:02 | |
*** melwitt has joined #openstack-infra | 18:03 | |
*** garyk has joined #openstack-infra | 18:03 | |
*** dustins has joined #openstack-infra | 18:03 | |
*** hashar has quit IRC | 18:03 | |
jeblair_ | clarkb, fungi: restarted; also did a full nodepool flush | 18:04 |
*** jeblair_ is now known as jeblair | 18:04 | |
clarkb | mordred: and I am -1 on https://review.openstack.org/#/c/141946/ due to a bug | 18:04 |
jeblair | clarkb: also we need to delete old nodepool and rename in dns | 18:05 |
*** sputnik13 has quit IRC | 18:05 | |
clarkb | jeblair: yup I think new nodepool has proven to be stable | 18:05 |
*** rmcall has joined #openstack-infra | 18:05 | |
*** sputnik13 has joined #openstack-infra | 18:05 | |
clarkb | jeblair: should I go ahead and delete images on old nodepool now? | 18:05 |
jeblair | clarkb: ++ | 18:05 |
*** k4n0 has quit IRC | 18:06 | |
*** rmcall has quit IRC | 18:06 | |
*** tonytan4ever has joined #openstack-infra | 18:06 | |
mordred | clarkb: thanks. nice catch. that's what I get for tryin to respond to a review comment ... | 18:06 |
mordred | :) | 18:06 |
*** fandi has joined #openstack-infra | 18:06 | |
*** jamielennox|away is now known as jamielennox | 18:08 | |
*** rmcall has joined #openstack-infra | 18:08 | |
clarkb | ok image deletion is running | 18:08 |
fungi | dstufft: new suggestion. pep 440 should be amended to properly normalize alpha, beta, rc and dev to α, β, γ and δ respectively | 18:09 |
mordred | clarkb: patches update | 18:09 |
mordred | clarkb: thanks! | 18:09 |
dstufft | fungi: agreed, doing that now | 18:09 |
clarkb | mordred: thank you looking now | 18:09 |
fungi | dstufft: also we want unicode snowman for a revision control hash designator | 18:09 |
anteaya | we do | 18:10 |
dstufft | fungi: :pileofpoop: | 18:10 |
clarkb | mordred: my only other concern is what if I have a tag called banana then it won't do the right thing. but I think in cases like that we just laugh | 18:10 |
fungi | bwahaha | 18:10 |
anteaya | like that? | 18:10 |
*** tonytan4ever has quit IRC | 18:10 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added manifest for storyboard-dev.openstack.org https://review.openstack.org/140466 | 18:11 |
nibalizer | so, this is a thing now , i guess https://golang.org/doc/contribute.html#tmp_6 | 18:11 |
mordred | clarkb: yup. it will break | 18:12 |
nibalizer | jeblair: mordred i guess go now has a tool called 'git-review' that interacts with gerrit | 18:12 |
*** Ryan_Lane has joined #openstack-infra | 18:12 | |
*** achanda has quit IRC | 18:12 | |
*** harlowja_away is now known as harlowja | 18:12 | |
mordred | nibalizer: wow. that's almost unbearably rude | 18:12 |
nibalizer | im kindof flabergasted | 18:13 |
*** achanda has joined #openstack-infra | 18:13 | |
nibalizer | we already wrote this guys | 18:13 |
nibalizer | at least name yours something different! | 18:13 |
mordred | right? | 18:13 |
krotscheck | fungi: Just switched out to using snakeoil on that patch - the storyboard module already supported it. | 18:13 |
JayF | Seriously? I wonder if that was what the new 'git-review' recipe was in macbrew | 18:13 |
crinkle | i thought the plan was to rewrite the whole world in go? :) | 18:14 |
*** achanda has quit IRC | 18:14 | |
anteaya | awesome that is really going to help our developers | 18:14 |
*** achanda has joined #openstack-infra | 18:14 | |
krotscheck | It’s not in google’s best interest to make it easy for us. | 18:14 |
mordred | anybody know anyone in the go community that we can complain to? | 18:15 |
krotscheck | (It’s not in their best interest to make it hard either) | 18:15 |
jeblair | except the go-git-review syntax to push a change to gerrit is "git review mail" | 18:15 |
nibalizer | i tweeted at kelseyhightower (who is why i know about it) | 18:15 |
mordred | I know | 18:15 |
mordred | which is HILARIOUS | 18:15 |
mordred | nibalizer: thanks | 18:15 |
nibalizer | we already have a tool, that does this, tahts called that | 18:15 |
nibalizer | gais, gais stahp | 18:15 |
ryanpetrello | I'm seeing a bunch of git clone failures for OpenStack cgit | 18:16 |
*** dizquierdo has quit IRC | 18:16 | |
clarkb | ryanpetrello: can you link examples? | 18:16 |
ryanpetrello | https://review.openstack.org/#/c/141172/ | 18:16 |
ryanpetrello | namely that review | 18:17 |
clarkb | oh don't clone from cgit/ | 18:17 |
ryanpetrello | I figured it was just a fluke last night, but re-ran a check this morning and still seeing the same issue | 18:17 |
clarkb | I am not sure cgit/ was ever intended to be a place to clone from. It does caching and weirdness. If you drop the cgit/ from the path you get apache/git daemon and it should be much better | 18:17 |
*** Masahiro has joined #openstack-infra | 18:17 | |
jeblair | wait, why is a job cloning? | 18:17 |
clarkb | jeblair: because stackforge | 18:18 |
ryanpetrello | jeblair: pecan has jobs where I clone projects that depend on pecan | 18:18 |
*** tonytan4ever has joined #openstack-infra | 18:18 | |
clarkb | jeblair: I think it was written before zuul cloner existed but would be a perfect place to zuul cloner | 18:18 |
ryanpetrello | and then run their tests w/ the pecan patchset installed into the virtualenv | 18:18 |
jeblair | yeah, we should use zuul cloner, and in a config that will use the local git cache instead of a full clone | 18:18 |
jeblair | ryanpetrello: what does the actual cloning? | 18:19 |
ryanpetrello | pip | 18:19 |
ryanpetrello | e.g., https://github.com/stackforge/pecan/blob/master/tox.ini#L140 | 18:19 |
jeblair | http://git.openstack.org/cgit/stackforge/pecan/tree/tox.ini | 18:19 |
jeblair | ah yeah, so tox -> pip | 18:19 |
ryanpetrello | right | 18:19 |
anteaya | asselin: you had items on last weeks infra meeting, they are still on the agenda, are they current? | 18:20 |
pleia2 | nibalizer: wow, yeah, that's very bad open source citizen of them :( https://github.com/golang/review | 18:21 |
asselin | anteaya, looking | 18:21 |
anteaya | asselin: thank you | 18:21 |
*** markmcclain1 has quit IRC | 18:21 | |
anteaya | asselin: keep anythign you need, let's just make sure it is current | 18:21 |
nibalizer | ya, kelsey told me to bring it up with golang-dev | 18:21 |
ryanpetrello | clarkb: I'll remove the cgit and give that a shot | 18:21 |
*** markmcclain has joined #openstack-infra | 18:21 | |
nibalizer | i haven't exactly found the right thread to respond to | 18:21 |
pleia2 | nibalizer: yeah, I saw the thread on twitter, that's kind of even worse :) | 18:21 |
clarkb | ryanpetrello: I would at least start with that, there may be other underlying problems but I was always wary of cgit's caching for git operations | 18:21 |
pleia2 | they took a well-established project name, now that it's been pointed out they should just fix it | 18:22 |
nibalizer | well kelsey is a go user, not a go dev so i think it was fair | 18:22 |
pleia2 | ah, fair enough | 18:22 |
nibalizer | so ya probably we should post to godev-lang | 18:22 |
clarkb | clearly we should've been python-git-review | 18:22 |
*** Masahiro has quit IRC | 18:22 | |
nibalizer | and by we probably jim has the most authority ? but i leave that up to others to decide | 18:22 |
clarkb | so that every language can reinvent this wheel without name collisions | 18:22 |
pleia2 | nibalizer: s/we/nibalizer - thanks :D | 18:22 |
*** sputnik13 has quit IRC | 18:22 | |
*** shashankhegde has joined #openstack-infra | 18:23 | |
fungi | i'm still not sure why a tool like git-review needs to be rewritten in every programming language | 18:23 |
*** sputnik13 has joined #openstack-infra | 18:23 | |
*** ChuckC_ is now known as ChuckC | 18:23 | |
pleia2 | fungi: go people are allergic to python | 18:23 |
clarkb | fungi: I think that when you write a new programming language one of the things you are required to do is to rewrite everything in that language | 18:23 |
fungi | i mean, we also submit shell scripts with it, so should we have a version rewritten in bash too? | 18:24 |
clarkb | even if the utility of a thing is as a tool not a lib | 18:24 |
*** yamamoto has joined #openstack-infra | 18:24 | |
jeblair | clarkb, ryanpetrello: so we should avoid cloning from git at all; there are more efficient and resilient ways of doing it... | 18:24 |
jeblair | ryanpetrello: let me get you a link | 18:24 |
clarkb | jeblair: agreed | 18:24 |
*** patrickeast has joined #openstack-infra | 18:24 | |
*** rmcall has quit IRC | 18:25 | |
jeblair | ryanpetrello: http://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/apply-test.sh#n52 | 18:25 |
jeblair | ryanpetrello: so i think if you do this... | 18:25 |
*** AJaeger has joined #openstack-infra | 18:25 | |
ryanpetrello | jeblair: that's fine, I can take this approach, too | 18:25 |
ryanpetrello | I'd like to get the tests *working* today, though, so I can cut a release | 18:25 |
jeblair | ryanpetrello: (understood; fix this thing, then fix it better :) | 18:26 |
ryanpetrello | yep | 18:26 |
ryanpetrello | so my only issue w/ the zuul-cloner thing (assuming I'm understanding this properly) | 18:26 |
jeblair | ryanpetrello: use zuul-cloner (you probably don't need a clonemap.yaml) and specify the project you want to clone. i think you should be able to run that, and then run its install command in your tox command section | 18:26 |
AJaeger | garyk: I'm back now | 18:26 |
ryanpetrello | how do I allow others to run these tests locally? | 18:27 |
ryanpetrello | (outside of OpenStack's CI environment) | 18:27 |
*** rmcall has joined #openstack-infra | 18:27 | |
jeblair | ryanpetrello: how about this? you make a helper script that does the work, and that script can detect whether zuul-cloner exists and if it doesn't, it does a normal clone? | 18:27 |
ryanpetrello | yea, that's fair | 18:28 |
jeblair | bonus: the tox sections get smaller too | 18:28 |
ryanpetrello | yep | 18:28 |
ryanpetrello | I'll clean this up as soon as I get the chance | 18:28 |
jeblair | cool, thanks! | 18:28 |
*** rmcall has quit IRC | 18:29 | |
jeblair | clarkb: what if gertty actually had a threaded view of changes so you could visually see the dependencies? | 18:29 |
*** gyee has joined #openstack-infra | 18:31 | |
*** shashankhegde has quit IRC | 18:32 | |
*** zz_avozza is now known as avozza | 18:33 | |
*** jgallard_ has quit IRC | 18:33 | |
*** shashankhegde has joined #openstack-infra | 18:33 | |
*** wuhg has quit IRC | 18:33 | |
*** ZZelle_ has joined #openstack-infra | 18:34 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix project-config-compare-xml https://review.openstack.org/142179 | 18:35 |
*** EmilienM|afk is now known as EmilienM | 18:35 | |
AJaeger | anteaya, sdague, jeblair, fungi: We missed that https://review.openstack.org/#/c/140470/ was applied at the wrong place . Patch 142179 fixes it. | 18:36 |
timrc | nibalizer, mordred Can I submit a pull request the merges our git-review into their repository overwriting whatever it is they did? jk | 18:36 |
AJaeger | Could you quickly review and approve, please? Otherwise project-config-compare-xml gives wrong failure/success message | 18:36 |
timrc | s/the merges/that merges/ | 18:36 |
pleia2 | hah | 18:37 |
dstufft | we have always been at war with golang | 18:37 |
jeblair | AJaeger: +2 | 18:38 |
*** rmcall has joined #openstack-infra | 18:38 | |
AJaeger | thanks, jeblair | 18:38 |
*** teran has quit IRC | 18:40 | |
openstackgerrit | Jay Pipes proposed openstack-infra/elastic-recheck: Adds E-R query for bug 1312002 https://review.openstack.org/142183 | 18:41 |
fungi | AJaeger: reviewing it now | 18:41 |
uvirtbot | Launchpad bug 1312002 in nova "nova cell-show <cell name> causes ValueError: Circular reference detected" [Low,In progress] https://launchpad.net/bugs/1312002 | 18:41 |
jaypipes | mriedem: see ^^ | 18:41 |
fungi | AJaeger: great catch there... i was trying to debug that exact error condition without realizing why it was failing | 18:42 |
AJaeger | thanks, fungi! I should have catched that during review ;( | 18:42 |
mriedem | jaypipes: wrong bug | 18:42 |
mriedem | jaypipes: should be https://bugs.launchpad.net/nova/+bug/1403162 | 18:42 |
uvirtbot | Launchpad bug 1403162 in nova "fake_notifier: ValueError: Circular reference detected" [Critical,In progress] | 18:42 |
jaypipes | mriedem: lol, crap.. | 18:42 |
mriedem | jaypipes: add the build_name too | 18:43 |
mriedem | message:"ValueError: Circular reference detected" AND tags:"console" AND build_name:"gate-nova-python27" | 18:43 |
openstackgerrit | Jay Pipes proposed openstack-infra/elastic-recheck: Adds E-R query for bug 1403162 https://review.openstack.org/142183 | 18:44 |
uvirtbot | Launchpad bug 1403162 in nova "fake_notifier: ValueError: Circular reference detected" [Critical,In progress] https://launchpad.net/bugs/1403162 | 18:44 |
jaypipes | mriedem: ^^ thx for your help :) it's my first e-r submission. | 18:44 |
*** johnthetubaguy is now known as zz_johnthetubagu | 18:44 | |
*** dimtruck is now known as zz_dimtruck | 18:45 | |
*** shashankhegde has quit IRC | 18:47 | |
openstackgerrit | Jay Pipes proposed openstack-infra/elastic-recheck: Adds E-R query for bug 1403162 https://review.openstack.org/142183 | 18:47 |
uvirtbot | Launchpad bug 1403162 in nova "fake_notifier: ValueError: Circular reference detected" [Critical,In progress] https://launchpad.net/bugs/1403162 | 18:47 |
*** shashankhegde has joined #openstack-infra | 18:47 | |
*** rmcall has quit IRC | 18:48 | |
*** HenryG_ has quit IRC | 18:48 | |
*** HenryG has joined #openstack-infra | 18:49 | |
*** HeOS has quit IRC | 18:49 | |
anteaya | AJaeger: thanks for fixing that | 18:49 |
clarkb | jeblair: that would be really cool | 18:50 |
*** rmcall has joined #openstack-infra | 18:50 | |
anteaya | yay jaypipes for your e-r submission | 18:50 |
*** koolhead17 has joined #openstack-infra | 18:50 | |
*** koolhead17 has joined #openstack-infra | 18:50 | |
anteaya | jaypipes: mriedem is a tough reviewer :D | 18:50 |
jaypipes | anteaya: heh. you have to be quick to beat mriedem or jogo to the punch ;) | 18:50 |
anteaya | AJaeger: I was reviewing but can't match the speed of fungi | 18:51 |
anteaya | jaypipes: no kidding | 18:51 |
anteaya | I don't try, I just gaze in awe | 18:51 |
anteaya | look at them go, aren't they amazing | 18:51 |
adam_g | dstufft, re: pip dep resolution. short of a full blown dependency solver, would adding some smarts about versions here be an option? https://github.com/pypa/pip/blob/develop/pip/req/req_set.py#L119 i dug into pip last time this happened and some basic version logic there seemed to help get correct things installed/detect conflict early, but i assumed that function is purposefully dumb? | 18:51 |
*** _nadya_ has joined #openstack-infra | 18:51 | |
mriedem | jaypipes: i had just checked out the local topic branch when you posted that, | 18:51 |
mriedem | jaypipes: would have beat you if i weren't waiting for dansmith to open the new bug | 18:52 |
AJaeger | anteaya: thanks for reviewing! | 18:52 |
mriedem | jaypipes: so i'll accuse you of cheating | 18:52 |
jaypipes | lol :) | 18:52 |
*** zz_dimtruck is now known as dimtruck | 18:52 | |
openstackgerrit | Merged openstack-infra/project-config: Generate tarballs for neutron-*aas on tags https://review.openstack.org/142126 | 18:52 |
*** gokrokve has joined #openstack-infra | 18:53 | |
jeblair | nibalizer, pleia2: golang git-review does not have anything like our .gitreview file parsing; so you have to clone from gerrit or manually set your origin remote | 18:53 |
clarkb | we are down to 6 troublesome images on old nodepool | 18:53 |
* clarkb tries to delete them again | 18:53 | |
*** _nadya_ has quit IRC | 18:54 | |
AJaeger | anteaya: to further continue with the Gerrit ACL checks (https://review.openstack.org/#/c/140821/), we need to have https://review.openstack.org/#/c/141860/ in. Reviews are welcome but nothing urgent. | 18:54 |
dstufft | adam_g: I'm honetly not sure. I'd need to dig into that. One problem that would need to be solved is that if a later dependency on foo forces you to switch what version of foo you install, then you have to "undo" any versions you added because of foo so you download a different foo and see what versions it depends on | 18:54 |
jeblair | nibalizer, pleia2: and the first commit was oct 28. | 18:54 |
*** vigneshvar has quit IRC | 18:55 | |
anteaya | AJaeger: okay was trying to clear a mindspace to wrap my head around where we are on that | 18:55 |
*** che-arne has quit IRC | 18:55 | |
anteaya | btw AJaeger you and armax are two of my favourite people so I am so glad we are working together on this | 18:55 |
anteaya | AJaeger: I hope you get to meet him at the next summit | 18:55 |
AJaeger | anteaya: the first patch for that series is in (with the error that 142179 fixed), so we can continue. | 18:56 |
AJaeger | anteaya: thanks! | 18:56 |
armax | AJaeger: apologies for the brainfart | 18:56 |
clarkb | ConnectionError: HTTPSConnectionPool(host='ci-overcloud.tripleo.org', port=13000): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 110] Connection timed out) | 18:56 |
clarkb | I get that on the remaining 4 images (I got it down to 4 \o/ | 18:56 |
armax | those yaml files can be intimidating for the untrained eye | 18:56 |
jogo | jeblair dhellmann: so I am very confused about https://review.openstack.org/#/c/141952/2/specs/non-overlapping-dependency-upgrades.rst,cm bow | 18:57 |
jogo | now | 18:57 |
AJaeger | armax: I should have catched it during review but didn't | 18:57 |
armax | AJaeger: I guess those lines can be easy to miss | 18:57 |
anteaya | armax: you are amazing | 18:57 |
anteaya | every excuse to work with you, I will take | 18:58 |
jogo | jeblair dhellmann: sdague seems to think this isn't an issue ? | 18:58 |
armax | anteaya: well, not quite :) I caused more issues than I solved! | 18:58 |
AJaeger | armax: thanks for all your work on this, we're getting closer - see my comments above to anteaya ! | 18:58 |
dhellmann | jogo: it turns out the job that was testing for overlapping ranges was turned off sometime in the last few weeks and noone noticed | 18:58 |
anteaya | armax: ah I got you involved more in infra | 18:58 |
anteaya | armax: which was part of my evil plan | 18:59 |
armax | AJaeger: I am happy to help :) | 18:59 |
jeblair | dhellmann, jogo: it was disabled in june | 18:59 |
AJaeger | armax: See your patch in action: http://logs.openstack.org/21/140821/7/check//project-config-gerrit/93b597e/console.html | 18:59 |
anteaya | opps meeting time | 18:59 |
anteaya | will review more after meetings | 18:59 |
dhellmann | jogo: sdague is correct that part of the problem here was ceilometer having to install itself into the swift pipeline | 18:59 |
dhellmann | jeblair: that long ago? wow | 18:59 |
jogo | dhellmann: overlapping ranges in global-reqs job? | 18:59 |
*** fandi has quit IRC | 18:59 | |
dhellmann | jeblair: are you sure? because I'm pretty sure I got an error from that job not long after I capped the oslo lib versions in juno | 18:59 |
jeblair | dhellmann: if you can find the change where you capped those versions, it would probably be good for us to look at the failures for that at the time | 19:00 |
mriedem | blarg, trove logs aren't indexed by logstash? | 19:00 |
clarkb | mriedem: you have to be more specific than that, also the specific list is always available let mdig it up | 19:00 |
fungi | meeting time! | 19:00 |
mriedem | clarkb: http://logs.openstack.org/21/140121/8/gate//gate-trove-functional-dsvm-mysql/29dacef/logs/screen-tr-api.txt.gz#_2014-12-16_07_55_08_717 | 19:00 |
mriedem | clarkb: http://status.openstack.org/elastic-recheck/data/uncategorized.html#gate-trove-functional-dsvm-mysql | 19:00 |
mriedem | https://review.openstack.org/#/c/141564/ | 19:01 |
mriedem | some trove gate job is busted | 19:01 |
*** sarob has quit IRC | 19:01 | |
clarkb | mriedem: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml#n23 | 19:01 |
mtreinish | mriedem: just add it the list | 19:01 |
mriedem | mtreinish: the list of busted stuff? | 19:01 |
mriedem | clarkb: thanks | 19:01 |
mtreinish | the list of indexed files (the one clarkb just linked) | 19:01 |
mriedem | mtreinish: yeah, doing that now | 19:01 |
mriedem | gawd! :) | 19:01 |
jogo | mriedem: example patch Ic3b2e33177bdc65fe294ddddd581a93de6c1cb60 | 19:02 |
dhellmann | jeblair: I'll dig some more | 19:02 |
SlickNik | mriedem: Thanks. Let me know if you want me to submit the patch. | 19:02 |
mriedem | jogo: yeah i've done this before, for n-meta-api or whatever | 19:02 |
jogo | mriedem: oh right | 19:02 |
mriedem | SlickNik: np, i've got it | 19:02 |
jogo | dhellmann jeblair: so do we need to change how grenade works? | 19:02 |
*** sarob has joined #openstack-infra | 19:03 | |
SlickNik | mriedem: appreciate it much. | 19:03 |
jogo | and if yes, is it still a priority? | 19:03 |
*** bswartz has quit IRC | 19:03 | |
notmyname | jogo: dhellmann: doesn't the testing ignore local requirements.txt and use global requirements to install dependencies? did that change? | 19:04 |
dhellmann | notmyname: it didn't change, but pip doesn't always do exactly what we want even when we give it the requirements list | 19:04 |
*** pblaho has quit IRC | 19:05 | |
adam_g | dhellmann, sorry, oslo.vmware thing was in stable/icehouse | 19:05 |
dhellmann | sdague: ew, the etherpad is a mess now | 19:05 |
dhellmann | adam_g: ah, ok | 19:05 |
adam_g | https://bugs.launchpad.net/openstack-ci/+bug/1395814 | 19:05 |
uvirtbot | Launchpad bug 1395814 in openstack-ci "grenades failing eventlet 0.13.0 is installed but eventlet>=0.15.2 is required by ['oslo.vmware']" [Undecided,Fix released] | 19:05 |
sdague | dhellmann: I was trying to move the obsolete stuff off the top of the page, as I spent 5 minutes going through it before noticing the "ignore all this" | 19:06 |
dhellmann | sdague: ok, the text is all giant though and we lost track of who was saying what between me and fungi | 19:06 |
jogo | dhellmann: so do we still need grenade to support upgrading across non-overlapping python deps? | 19:07 |
*** yamamoto has quit IRC | 19:07 | |
dhellmann | jogo: I don't think that's a priority for today. | 19:07 |
*** vigneshvar has joined #openstack-infra | 19:07 | |
jogo | dhellmann: thanks, so not a priority but do we still need it in the future? | 19:07 |
dhellmann | jogo: I'm not sure. This plan is still evolving. | 19:08 |
sdague | dhellmann: hmph, on my etherpad it kept the author bits, but apparently not on the server. Boo. | 19:08 |
*** amuller has quit IRC | 19:08 | |
*** Rockyg has joined #openstack-infra | 19:08 | |
jogo | dhellmann: ok I am dropping that work all together unless I am told otherwise | 19:08 |
dhellmann | jogo: ok, that seems reasonable | 19:08 |
jogo | dhellmann: assuming its not needed at all for now | 19:08 |
*** bswartz has joined #openstack-infra | 19:08 | |
*** otter768 has joined #openstack-infra | 19:08 | |
* jogo wonders off to nova land | 19:11 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/system-config: Index trove logs for logstash goodness https://review.openstack.org/142193 | 19:12 |
mriedem | SlickNik: ^ | 19:12 |
clarkb | mordred: fyi one last pep8 issue on your pbr changes | 19:12 |
clarkb | mordred: if you can update that so we can get shiny +1's then possibly merge that would be excellent | 19:12 |
mriedem | jogo: ^ | 19:12 |
dstufft | clarkb: mordred did y'all decide not to want the sha normalization thing in the PEP? | 19:13 |
*** otter768 has quit IRC | 19:13 | |
mordred | dstufft: yah. we're just going to remove them | 19:14 |
dstufft | mordred: okay | 19:14 |
dstufft | less work for me is ok with me | 19:14 |
openstackgerrit | Merged openstack/requirements: pymemcache and sysv_ipc for tooz https://review.openstack.org/140920 | 19:14 |
*** Daviey has joined #openstack-infra | 19:15 | |
SlickNik | mriedem: Looks good — thanks! | 19:20 |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for devstack/trove bug 1402227 https://review.openstack.org/142197 | 19:21 |
uvirtbot | Launchpad bug 1402227 in devstack "trove configuration is broken" [Undecided,In progress] https://launchpad.net/bugs/1402227 | 19:21 |
mriedem | jogo: ^ | 19:21 |
*** ssam2_ has quit IRC | 19:22 | |
*** weshay has quit IRC | 19:23 | |
*** weshay has joined #openstack-infra | 19:23 | |
*** weshay is now known as weshay_bbiab | 19:24 | |
*** sputnik1_ has joined #openstack-infra | 19:25 | |
*** sputnik13 has quit IRC | 19:26 | |
*** achanda has quit IRC | 19:26 | |
*** garyk has quit IRC | 19:30 | |
*** ryanpetrello_ has joined #openstack-infra | 19:30 | |
anteaya | AJaeger: good one, yeah not changing an acl to avoid someone following protocol for permissions | 19:30 |
dhellmann | jeblair: that failure is on a patch that I think landed, and I'm having trouble formulating a query to find it :-/ | 19:31 |
*** ryanpetrello has quit IRC | 19:31 | |
*** ryanpetrello_ is now known as ryanpetrello | 19:31 | |
anteaya | jeblair: any idea when it landed? or what repo? | 19:32 |
AJaeger | anteaya: there're two cores - and one is in the release group and the other is not aware of it ;( | 19:32 |
openstackgerrit | Merged openstack-infra/infra-specs: Add Migrate to Zanata spec https://review.openstack.org/133222 | 19:32 |
anteaya | AJaeger: awesome | 19:32 |
openstackgerrit | Alexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks https://review.openstack.org/142202 | 19:32 |
dhellmann | anteaya: I reverted the caps on oslo libs in stable/juno in https://review.openstack.org/#/c/138546/ so it would have been some time around then, the failure would be before and the merge would be after | 19:34 |
*** dprince has quit IRC | 19:34 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: Adds E-R query for bug 1403162 https://review.openstack.org/142183 | 19:35 |
uvirtbot | Launchpad bug 1403162 in nova "fake_notifier: ValueError: Circular reference detected" [Critical,In progress] https://launchpad.net/bugs/1403162 | 19:35 |
dhellmann | anteaya: I don't know what repo it was, but it was probably in oslo somewhere | 19:35 |
anteaya | hmmm | 19:35 |
dhellmann | maybe I'm mis-remembering, and it was another requirements job that failed | 19:36 |
dhellmann | maybe I extrapolated that this other job would also fail, but didn't actually see it | 19:36 |
openstackgerrit | Alexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks https://review.openstack.org/142202 | 19:36 |
anteaya | dhellmann: well here are the merged requirements patches: https://review.openstack.org/#/q/project:openstack/requirements+status:merged,n,z | 19:36 |
*** ihrachyshka has quit IRC | 19:37 | |
anteaya | not very complex but I'm not sure what else to search for | 19:37 |
openstackgerrit | Merged openstack-infra/project-config: Fix project-config-compare-xml https://review.openstack.org/142179 | 19:38 |
dhellmann | anteaya: I'm looking at http://bit.ly/1DHTOTL now but can't seem to make it search for comments from jenkins about requirements job failures | 19:38 |
*** _nadya_ has joined #openstack-infra | 19:39 | |
*** mpaolino has quit IRC | 19:40 | |
*** ivar-lazzaro has quit IRC | 19:41 | |
openstackgerrit | Merged openstack-infra/project-config: Remove requirements overlap check https://review.openstack.org/142152 | 19:42 |
anteaya | oh getting it to search on comments from jenkins | 19:45 |
anteaya | not sure as I have ever tried to do that | 19:46 |
fungi | you can search on negatove verification votes | 19:46 |
fungi | negative | 19:46 |
fungi | label:Verification=-1 | 19:46 |
fungi | i think | 19:46 |
fungi | but breaking that down to specific jobs would be harder | 19:47 |
anteaya | yes | 19:47 |
anteaya | but searching the comments | 19:47 |
anteaya | I don't know if I have seen that | 19:47 |
*** hdd has quit IRC | 19:48 | |
*** markmcclain has quit IRC | 19:49 | |
anteaya | dhellmann: https://review.openstack.org/#/q/project:%255Eopenstack/oslo.*+branch:master+label:Verified%253D-1,n,z | 19:49 |
*** markmcclain has joined #openstack-infra | 19:49 | |
anteaya | but that just might be the most recent verification vote | 19:49 |
dhellmann | the patch is merged now, so would it still have that label? | 19:50 |
dhellmann | yeah | 19:50 |
openstackgerrit | Christian Berendt proposed openstack/requirements: Bump version of openstack-doc-tools >= 0.21 https://review.openstack.org/142076 | 19:50 |
sdague | anteaya: well, except it's the last vote | 19:50 |
anteaya | not sure if you could search on patches that have failed in teh past | 19:50 |
anteaya | sdague: yeah | 19:50 |
sdague | you probably would need to hit the gerrit cli directly | 19:50 |
anteaya | dhellmann: so no it wouldn't have that if it was merged | 19:50 |
dhellmann | I've tagged oslo.db 1.0.3 and am waiting for it to build | 19:50 |
sdague | and go through all patches | 19:50 |
dhellmann | anteaya; yeah, that's what I thought | 19:50 |
*** koolhead17 has quit IRC | 19:50 | |
anteaya | dhellmann: :( | 19:51 |
dhellmann | anteaya: I'll spend more time looking after my meetings this afternoon | 19:52 |
anteaya | dhellmann: kk | 19:52 |
*** koolhead17 has joined #openstack-infra | 19:52 | |
*** CICoverageBuilds has joined #openstack-infra | 19:52 | |
*** emagana has quit IRC | 19:53 | |
*** markmcclain has quit IRC | 19:53 | |
openstackgerrit | Alexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks https://review.openstack.org/142202 | 19:53 |
openstackgerrit | Alexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks https://review.openstack.org/142202 | 19:55 |
*** hdd has joined #openstack-infra | 19:55 | |
*** markmcclain has joined #openstack-infra | 19:56 | |
*** pfalleno1 has quit IRC | 19:56 | |
*** pfallenop has joined #openstack-infra | 19:57 | |
*** koolhead17 has quit IRC | 19:57 | |
openstackgerrit | Alexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks https://review.openstack.org/142202 | 19:57 |
*** rmcall has quit IRC | 19:58 | |
*** dims_ has quit IRC | 19:58 | |
*** rmcall has joined #openstack-infra | 19:59 | |
*** dims has joined #openstack-infra | 19:59 | |
openstackgerrit | Alexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks https://review.openstack.org/142202 | 20:00 |
*** kgiusti1 has joined #openstack-infra | 20:01 | |
*** kgiusti has quit IRC | 20:01 | |
pleia2 | we didn't get to this, but it is time sensitive (Tracy's AWS instance is going non-free and she asked us for help) so if we could make a decision here it would be good: http://lists.openstack.org/pipermail/openstack-infra/2014-December/002247.html | 20:02 |
AJaeger | Since we run over time, I couldn't bring up my request for reviews of infra-manual. Would be great if we could move forward there... | 20:03 |
jeblair | pleia2: what decision needs to be made? | 20:03 |
*** sabeen2 has joined #openstack-infra | 20:03 | |
fungi | pleia2: i think mikal offered to host that for her? could work as a temporary solution until someone puppets the service (assuming it's worth us hosting longer term) | 20:03 |
pleia2 | jeblair: whether we bring in the nova dashboard into infra as is (and how - make new project? pull for github) or let mikal host it | 20:03 |
*** dims has quit IRC | 20:03 | |
*** dkranz has quit IRC | 20:03 | |
pleia2 | until we can integrate with reviewday | 20:04 |
pleia2 | fungi: long term we want to integrate it with reviewday, so no new puppet module needed, probably just changes to the current reviewday one | 20:04 |
pleia2 | but that's not going to happen before her server goes away | 20:04 |
sdague | clarkb: on https://review.openstack.org/#/c/141831/1/zuul/layout.yaml,cm is there a limit to the # of \. ? | 20:04 |
*** e0ne has joined #openstack-infra | 20:05 | |
jeblair | pleia2: i see no reason why we can't run an additional service if people find it useful. what we run is controlled by puppet, so someone would need to write some code to handle the new service | 20:05 |
clarkb | sdague: not other than each set of digits must be prepended with . except for the first | 20:05 |
*** MaxV has joined #openstack-infra | 20:05 | |
jeblair | but anyone is free to do that at any time. | 20:05 |
*** sabeen1 has quit IRC | 20:05 | |
*** _buzz has joined #openstack-infra | 20:05 | |
fungi | i see no problem with us running it as a stand-alone service (puppeted obviously) until such time as it can be more properly folded into reviewday mk ii or whatever | 20:06 |
pleia2 | ok, great | 20:06 |
*** lttrl has quit IRC | 20:06 | |
*** Masahiro has joined #openstack-infra | 20:06 | |
pleia2 | so should we create a new project for it in openstack-infra? (it's on github now) | 20:06 |
*** sputnik1_ has quit IRC | 20:06 | |
*** sweston has quit IRC | 20:07 | |
fungi | it's not necessary that we control upstream git for every application we host | 20:07 |
*** sweston has joined #openstack-infra | 20:07 | |
anteaya | pleia2: sorry what am I missing that creating a new project is the solution | 20:07 |
pleia2 | even better | 20:07 |
fungi | after all, we run lots of things which aren't | 20:07 |
anteaya | I thought she was running an instance of reviewday | 20:07 |
pleia2 | anteaya: no, completely different code | 20:07 |
*** yamamoto has joined #openstack-infra | 20:08 | |
pleia2 | thanks fungi and jeblair, I'll update the interested parties accordingly to see who wants to do the work ;) | 20:08 |
*** aysyd has quit IRC | 20:08 | |
anteaya | oh sorry | 20:08 |
*** lttrl has joined #openstack-infra | 20:09 | |
clarkb | mordred: any chance we can get pep8 fixed on the pbr change? | 20:09 |
*** Masahiro has quit IRC | 20:11 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for devstack/trove bug 1402227 https://review.openstack.org/142197 | 20:11 |
uvirtbot | Launchpad bug 1402227 in devstack "trove configuration is broken" [Undecided,In progress] https://launchpad.net/bugs/1402227 | 20:11 |
mordred | clarkb: I have re-uploaded | 20:11 |
*** yamamoto has quit IRC | 20:12 | |
clarkb | mordred: I don't see it | 20:12 |
*** shashankhegde has quit IRC | 20:13 | |
clarkb | mordred: I am leaving a ocmment on the line | 20:13 |
fungi | there are two versions of it, right? the backport and the master tip | 20:13 |
clarkb | mordred: its on 141667 | 20:13 |
fungi | oh, and 141666 is failing too, but a lot worse | 20:14 |
* mordred is not touching tip for now | 20:16 | |
mordred | until we get feature/0.10 _sorted_ | 20:16 |
*** MaxV_ has joined #openstack-infra | 20:16 | |
clarkb | +1 | 20:17 |
*** esker has quit IRC | 20:17 | |
clarkb | mordred: ok jenkins commented too so 141667 should hae the info you need to fix | 20:17 |
*** dims has joined #openstack-infra | 20:18 | |
mordred | clarkb: oh - I didn't type yet | 20:18 |
mordred | yes | 20:18 |
mordred | new version should be up now | 20:18 |
*** MaxV has quit IRC | 20:19 | |
clarkb | mordred fungi jeblair: https://storyboard.openstack.org/#!/story/2000082 is the new bug I discovered cleaning up old nodepool | 20:19 |
*** emagana has joined #openstack-infra | 20:19 | |
*** MaxV_ has quit IRC | 20:20 | |
*** MaxV has joined #openstack-infra | 20:20 | |
clarkb | old nodepool is down to 4 stubborn tripleo rh1 images. all nodes are deleted though | 20:20 |
clarkb | we can likely shut it down as is and deal with those images separately | 20:21 |
*** koolhead17 has joined #openstack-infra | 20:21 | |
clarkb | mordred: thank you I am +2 on both now | 20:23 |
fungi | clarkb: wow, really? that could account for some of the alien node "leaks" i was seeing previously | 20:23 |
clarkb | fungi: I also see that many alien nodes are simply in the process of being deleted by the provider so show up in nova listings | 20:24 |
clarkb | fungi: but then go away after a short while | 20:24 |
clarkb | though it is harless to delete those again | 20:24 |
*** dizquierdo has joined #openstack-infra | 20:24 | |
fungi | clarkb: yep, my search for alien nodes involves generating the list, then sleeping for 10 minutes, then generating the list again and only recording the instance uuids which were present in both | 20:25 |
clarkb | so the rh1 cloud is really unhappy with us | 20:25 |
clarkb | even listing alien nodes I get that token error | 20:25 |
*** andreykurilin_ has joined #openstack-infra | 20:25 | |
*** koolhead17 has quit IRC | 20:26 | |
*** dstufft has quit IRC | 20:27 | |
*** teran has joined #openstack-infra | 20:28 | |
fungi | mordred: i am a little worried that there's no record in gerrit of addressing lifeless's expressed concern in 141667 (which is now more appropriately directed at 141946) | 20:29 |
fungi | i mean, i know it got hashed over some more in here, but he probably won't see it due to travel, et cetera | 20:31 |
*** prad has joined #openstack-infra | 20:32 | |
*** prad has quit IRC | 20:33 | |
*** ddieterly has quit IRC | 20:35 | |
*** doug-fish has quit IRC | 20:37 | |
*** cdent has quit IRC | 20:38 | |
pc_m | dhellmann: ping | 20:39 |
*** ddieterly has joined #openstack-infra | 20:40 | |
*** franred has quit IRC | 20:40 | |
clarkb | ok rh1 is not cooperative so I think we don't wait on that to remove old nodepool.o.o. My vote is to delete it now but would be good to get at least one other set of eyes to look at it quickly | 20:41 |
fungi | clarkb: checking it out now | 20:41 |
fungi | clarkb: tripleo-test-cloud is the old hp1 not rh1, righth? | 20:42 |
clarkb | fungi: yes that sounds right. | 20:42 |
fungi | i believe there's a nodepool config change pending to connect us to the new hp1 | 20:42 |
pc_m | Can anyone tell me where we are with the grenade issue (SQLAlchemy version)? I saw mention of 141927, but the comments seem to indicate another approach being taken? | 20:42 |
fungi | clarkb: okay, the old precise nodepool.o.o looks safe to tear down | 20:43 |
fungi | clarkb: pretty sure those remaining instances no longer exist because the cloud it thinks they're still in has been rebuilt from scratch a while ago | 20:43 |
fungi | s/instances/images/ | 20:43 |
*** pelix has quit IRC | 20:44 | |
*** doug-fish has joined #openstack-infra | 20:44 | |
*** mrunge_gone has quit IRC | 20:44 | |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Remove nodepool-dev as it is becoming nodepool.o.o https://review.openstack.org/142216 | 20:45 |
openstackgerrit | Steve Baker proposed openstack-infra/project-config: Don't run check-heat-dsvm-functional-mysql in stable/juno https://review.openstack.org/142217 | 20:45 |
clarkb | fungi: gotcha | 20:45 |
fungi | pc_m: there is an oslo.db 1.0.3 release about an hour ago, and a requirements pin in flight for pinning oslo.db to <1.1 in stable/juno | 20:45 |
clarkb | 142216 is part of the nodepool cleanup too | 20:45 |
*** ChuckC has quit IRC | 20:46 | |
clarkb | jeblair: when you finish with meeting let me know if you concur that old nodepool.o.o can be deleted | 20:46 |
pc_m | fungi: nice! Do you know the commit # for the requirements pin? | 20:46 |
clarkb | I am going to go ahead and update dns now | 20:46 |
fungi | pc_m: https://review.openstack.org/142180 | 20:46 |
fungi | clarkb: sounds good | 20:46 |
pc_m | fungi: Thanks! | 20:46 |
clarkb | hrm I actually need to go catch a bus nowish if I am going to make it to this openstack hacking thing | 20:47 |
fungi | which is about to finish in the check pipeline and could stand one more +2 and an approval | 20:47 |
clarkb | so I will do that then cleanup nodepool from there | 20:47 |
fungi | k | 20:47 |
clarkb | fungi: approved the reqs change | 20:48 |
*** HeOS has joined #openstack-infra | 20:49 | |
*** ddieterly has quit IRC | 20:49 | |
fungi | thanks! | 20:49 |
fungi | dhellmann: ^ | 20:50 |
armax | AJaeger: do you want me to look into the failure for the project-config-gerrit job? | 20:50 |
AJaeger | armax: I just commented on it ;) | 20:50 |
*** dmsimard is now known as dmsimard_away | 20:50 | |
armax | AJaeger: you beat me to it then | 20:50 |
*** sputnik13 has joined #openstack-infra | 20:51 | |
armax | AJaeger: nice one | 20:51 |
*** shashankhegde has joined #openstack-infra | 20:51 | |
*** unicell has quit IRC | 20:51 | |
AJaeger | armax: a previous version of that merged yesterday (run last week), we introduced already some non-normalized files ;( | 20:51 |
AJaeger | armax: so yeah, this patch is helpfull... | 20:51 |
*** carl_baldwin has quit IRC | 20:52 | |
AJaeger | armax: But you could look what needs to be done for other namespaces so that we can run the job for openstack-infra and openstack as well... | 20:52 |
armax | AJaeger: will do | 20:53 |
AJaeger | armax: let's see whether we get some reviews for https://review.openstack.org/#/c/141860/ and https://review.openstack.org/#/c/140821/ by the cores to move forward here. anteaya wanted to continue reviewing after meetings, so hope these are on her list | 20:53 |
AJaeger | armax: thanks | 20:53 |
*** tonytan4ever has quit IRC | 20:54 | |
anteaya | AJaeger: they are on my list | 20:54 |
AJaeger | thanks, anteaya | 20:55 |
*** carl_baldwin has joined #openstack-infra | 20:55 | |
jeblair | clarkb: ++del nodepool | 20:57 |
*** _nadya_ has quit IRC | 20:57 | |
armax | AJaeger: I may need to tweak the normalize_acl script to include other formatting exceptions | 20:58 |
*** Rockyg has quit IRC | 20:59 | |
AJaeger | armax: fungi has written the normalize_acl script, I suggest you talk with him. I'm fine with changing it as needed in general. | 20:59 |
armax | AJaeger: right, I need to tweak the transformation that I added | 21:00 |
*** Rockyg has joined #openstack-infra | 21:00 | |
armax | AJaeger: I’ll post a patch to show you what I mean | 21:00 |
*** salv-orlando has quit IRC | 21:00 | |
fungi | i'm also fine with that script being simplified/rewritten. it was initially added as a stepping-stone to perform a series of different normalizations across the entire repo as individual changes | 21:00 |
*** chuckC_ has joined #openstack-infra | 21:00 | |
*** salv-orlando has joined #openstack-infra | 21:01 | |
*** dstufft has joined #openstack-infra | 21:01 | |
fungi | but if it's going to get used for enforcement going forward, then there's a lot of optional complexity which it no longer needs | 21:01 |
krotscheck | fungi: https://review.openstack.org/#/c/140466/ passed | 21:02 |
AJaeger | fungi, please have again a look at 140821 on what armax is doing with it... | 21:02 |
*** amitgandhinz has quit IRC | 21:03 | |
anteaya | AJaeger: reviewed, I would like to see 141860 merge first but this is my idealist side talking | 21:03 |
*** MaxV has quit IRC | 21:03 | |
*** amitgandhinz has joined #openstack-infra | 21:04 | |
AJaeger | anteaya: yeah, my preference as well - let's see whether fungi or sdague find time for 141860 (please;) | 21:04 |
anteaya | yeah it isn't a fire so I wasn't going to push | 21:05 |
anteaya | but good work here from both you and armax, AJaeger | 21:05 |
anteaya | thank you | 21:06 |
* AJaeger calls it a day, good night! | 21:06 | |
armax | anteaya: I think after the last patch from AJaeger, we could extend the check ot the openstack namespace | 21:06 |
armax | anteaya: I’ll follow uo | 21:06 |
jeblair | anteaya: prvd | 21:06 |
*** koolhead17 has joined #openstack-infra | 21:06 | |
armax | *up | 21:06 |
AJaeger | armax: the -release might needs tweaking | 21:06 |
AJaeger | ok, bye and thanks anteaya and armax! | 21:06 |
*** AJaeger has quit IRC | 21:06 | |
armax | AJaeger: right, and the stable-maint | 21:07 |
anteaya | jeblair: thanks | 21:07 |
anteaya | armax: thank you | 21:08 |
*** otter768 has joined #openstack-infra | 21:09 | |
fungi | so many pings. i'll catch up after the cross-project meeting | 21:09 |
*** ChuckC has joined #openstack-infra | 21:11 | |
*** koolhead17 has quit IRC | 21:12 | |
*** otter768 has quit IRC | 21:14 | |
mattoliverau | Morning | 21:14 |
anteaya | morning mattoliverau | 21:15 |
*** weshay_bbiab is now known as weshay | 21:16 | |
openstackgerrit | Merged openstack-infra/project-config: Normalize ACLs https://review.openstack.org/141860 | 21:18 |
openstackgerrit | Merged openstack-infra/subunit2sql: Add a contributing file https://review.openstack.org/141968 | 21:18 |
*** kgiusti1 has quit IRC | 21:19 | |
*** andreaf has quit IRC | 21:21 | |
*** koolhead17 has joined #openstack-infra | 21:22 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Plugins may now register cron workers. https://review.openstack.org/129609 | 21:24 |
anteaya | armax: so I would like to merge https://review.openstack.org/#/c/140821/ now | 21:24 |
anteaya | armax: you said you wanted to tweak | 21:24 |
anteaya | armax: can I convince you to tweak in a follow up patch? | 21:25 |
anteaya | I would like to get the job running as it is on current and new acl changes | 21:25 |
armax | anteaya: it can be done in a follow-up patch, IMO | 21:26 |
anteaya | thanks | 21:26 |
* anteaya +As | 21:26 | |
armax | anteaya: I want to see if we can extend the check to other namespaces | 21:26 |
*** dkranz has joined #openstack-infra | 21:27 | |
armax | anteaya: but to do so, I may need to relax the normalization logic a bit, but not a big deal | 21:27 |
*** dizquierdo has quit IRC | 21:28 | |
*** MaxV has joined #openstack-infra | 21:29 | |
openstackgerrit | Merged openstack-infra/project-config: Don't run check-heat-dsvm-functional-mysql in stable/juno https://review.openstack.org/142217 | 21:30 |
anteaya | armax: fair enough | 21:31 |
anteaya | I would like to check all the namespaces as well, if possible | 21:31 |
*** koolhead17 has quit IRC | 21:32 | |
fungi | armax: at least the initial state of the script does apply sanely to all namespaces | 21:33 |
fungi | your additions might need some adjustment to accomodate different namespaces though | 21:33 |
armax | fungi: indeed | 21:33 |
fungi | and we probably need another cleanup pass since we're not enforcing anything at the moment | 21:34 |
*** emagana has quit IRC | 21:34 | |
armax | fungi: correct | 21:34 |
*** bdpayne has quit IRC | 21:34 | |
fungi | also, an unfinished part of the reason i started normalizing those acls at all is so that we can identify some which are identical and collapse them in the git repo, replacing them with acl-path references in projects.yaml | 21:36 |
*** esker has joined #openstack-infra | 21:36 | |
*** julim has quit IRC | 21:36 | |
dkranz | fungi: I see the juno problem has cleared. Is the grenade issue supposed to be fixed? My patch is failing grenade but in theory my change could be at fault. | 21:36 |
*** MaxV has quit IRC | 21:37 | |
clarkb | I approved the reqs change. if that merged we shouldbe working | 21:37 |
*** ddieterly has joined #openstack-infra | 21:37 | |
openstackgerrit | Merged openstack-infra/project-config: Check that Gerrit ACL files are normalized https://review.openstack.org/140821 | 21:38 |
fungi | clarkb: there are 18 changes ahead of it in the gate | 21:41 |
*** emagana has joined #openstack-infra | 21:42 | |
*** dprince has joined #openstack-infra | 21:43 | |
*** baoli has quit IRC | 21:43 | |
openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Extend ACL checks to OpenStack namespace. https://review.openstack.org/142230 | 21:43 |
armax | fungi: ^^^, there should be a project that’s not complying now: /openstack/ossa.config | 21:44 |
*** dizquierdo has joined #openstack-infra | 21:44 | |
fungi | yep | 21:45 |
fungi | i saw that one go in without alphabetization | 21:45 |
jhesketh | Morning | 21:46 |
fungi | i think there were quite a few actually for the stable branch management split out too | 21:46 |
anteaya | morning jhesketh | 21:46 |
*** mrmartin has quit IRC | 21:47 | |
jeblair | nibalizer, fungi, clarkb, asselin: so there's a whole slew of changes to get rid of hardcoded variables in the openstack_project module. see https://review.openstack.org/#/q/topic:mosi,n,z | 21:50 |
*** sputnik13 has quit IRC | 21:51 | |
*** sputnik1_ has joined #openstack-infra | 21:51 | |
jeblair | SergeyLukjanov and company are proposing them; i'm assuming it's from an effort to make openstack_project itself more reusable | 21:51 |
fungi | jeblair: yep, i've gone through a few so far, some have been approved | 21:52 |
jeblair | does the overall direction seem like something we should do? | 21:52 |
*** dizquierdo has quit IRC | 21:52 | |
fungi | mostly they just need more eyes, and in a few cases some guidance on whether the things they're doing make sense (like extracting every valuable into a class variable) | 21:52 |
fungi | s/valuable/variable/ | 21:53 |
jeblair | yeah, i'm kind of wondering whether it makes sense in all cases | 21:53 |
*** Longgeek has quit IRC | 21:53 | |
*** mbacchi has quit IRC | 21:53 | |
fungi | my primary worry with those is that they're adding a lot of knobs indiscriminate of whether they're things which sanely benefit from being changeable | 21:54 |
SergeyLukjanov | jeblair, yeah, that's correct, it's part of our activity to make infra more re-usable, one of the future plans - guide for building single node "infra" for dev/test | 21:55 |
*** dmsimard_away is now known as dmsimard | 21:55 | |
*** Masahiro has joined #openstack-infra | 21:55 | |
jeblair | so if we take https://review.openstack.org/#/c/133705/ as an example | 21:55 |
jeblair | SergeyLukjanov: how does that help? | 21:56 |
jeblair | it lets you override the elasticsearch version | 21:56 |
jeblair | (real question -- just wondering what the use case is) | 21:57 |
* asselin reading | 21:57 | |
*** dustins has quit IRC | 21:57 | |
SergeyLukjanov | jeblair, the latest er release is 1.4.X i think and AFAIK it'll work good with current puppet scripts | 21:57 |
jeblair | nibalizer: i'm also curious as to how this would fit in with the idea of putting more config info in hiera/yaml | 21:57 |
*** mpaolino has joined #openstack-infra | 21:58 | |
*** mpaolino has quit IRC | 21:58 | |
mriedem | who is hosting triple-o provided VMs in CI? | 21:59 |
asselin | i'm in favor of making this reusable | 21:59 |
*** timcline has left #openstack-infra | 21:59 | |
mriedem | looking at http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#n980 | 21:59 |
jeblair | asselin: yeah, i'm just not seeing the big picture of how it accomplishes that | 21:59 |
*** dangers is now known as dangers_away | 21:59 | |
SergeyLukjanov | jeblair, honestly, some of the stuff has been probably extracted prematurely while the first iteration on puppet manifests, if you have some objections for extracting some parameters than it's a confirm for it :( | 21:59 |
jeblair | mriedem: the tripleo project | 21:59 |
asselin | jeblair, I got some questions about where to put the reusable bits | 21:59 |
*** Masahiro has quit IRC | 22:00 | |
fungi | mriedem: hpcloud and red hat i believe are the sponsors providing teh hardware resources for that | 22:00 |
mriedem | fungi: ok, thanks | 22:00 |
jeblair | mriedem: but the tripleo project runs the clouds | 22:00 |
mriedem | yeah, didn't see info here https://wiki.openstack.org/wiki/TripleO | 22:00 |
mriedem | or here really https://github.com/openstack-infra/tripleo-ci/blob/master/README.md | 22:01 |
*** rmcall has quit IRC | 22:01 | |
*** melwitt has quit IRC | 22:01 | |
asselin | jeblair, other opinions on reuseable are here: https://review.openstack.org/#/c/138913/ | 22:01 |
asselin | in comments | 22:01 |
fungi | mriedem: they also have a #tripleo channel where they are possibly more likely to see discussions and answer questions | 22:01 |
*** melwitt has joined #openstack-infra | 22:02 | |
*** melwitt has quit IRC | 22:02 | |
*** melwitt has joined #openstack-infra | 22:02 | |
*** bswartz has quit IRC | 22:02 | |
*** rmcall has joined #openstack-infra | 22:03 | |
mriedem | fungi: i got what i needed, i wrote a little yaml parser to separate out max-servers per provider in nodepool.yaml and rax/hp is obvious, i just wasn't sure about triple-o | 22:03 |
dhellmann | fungi, clarkb : thanks for reviewing that requirements patch for stable/juno | 22:03 |
*** sputnik1_ is now known as sputnik13 | 22:03 | |
*** ayoung has quit IRC | 22:04 | |
jeblair | or this one: https://review.openstack.org/#/c/133710/ | 22:04 |
jeblair | i'm not sure why the vhost root or directory should be parameters? | 22:05 |
jeblair | so is that the sort of thing we should comment on in review? | 22:05 |
jeblair | like: it's okay to have the admin user as a parameter, because maybe you want to run a groups server with different admins and a different name, but it doesn't make sense to have different filesystem paths? | 22:06 |
nibalizer | jeblair: so they absolutely open the door for configuration to be put in hiera | 22:06 |
*** ivar-lazzaro has joined #openstack-infra | 22:07 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Plugins may now register cron workers. https://review.openstack.org/129609 | 22:07 |
*** ivar-lazzaro has quit IRC | 22:07 | |
*** rlandy has quit IRC | 22:07 | |
jeblair | i think the reason i'm having trouble with this is that i think it's step 4 of the plan, which we deferred until we had experience with other parts of it | 22:08 |
jeblair | including the config in hiera part, which we still haven't really done | 22:08 |
*** ivar-lazzaro has joined #openstack-infra | 22:08 | |
jeblair | (and that was step 1) | 22:08 |
*** gmurphy has joined #openstack-infra | 22:09 | |
clarkb | ok back | 22:09 |
clarkb | I am going to do nodepool things now | 22:09 |
jeblair | step 2 is in progress (module split) and step 3 is mostly done, project-config split | 22:09 |
clarkb | jeblair: I haven't looked closely at those changes but in general I agree I think its mixing order | 22:09 |
*** dimtruck is now known as zz_dimtruck | 22:10 | |
jeblair | basically, i think we know that having too much stuff in openstack_project is a problem | 22:10 |
nibalizer | jeblair: i dont see the advantage of those patches | 22:11 |
nibalizer | in the early sets of "remove hardcoded variables" i tried to argue that they were kinda pointless and not the right place to put abstractions | 22:11 |
asselin | jeblair, there's a big question as to where to put the reusable parts. Leave them in openstack_project, or move somewhere else? | 22:11 |
nibalizer | but I dont really have the confidence to -1 20 patches and keep -1ing forever so i've kinda been shouted out of that conversation it feels like | 22:12 |
jeblair | asselin: i agree, and i don't think we've answered that yet | 22:12 |
*** mattfarina has quit IRC | 22:14 | |
asselin | I was thinking of adding a new module to system-config called e.g. openstack_shared or openstack_components, or something else that would contain the parts designed for reuse | 22:15 |
jeblair | asselin: or perhaps the solution is to continue to refine the puppet modules we have so that they have better / more complete interfaces | 22:16 |
jeblair | in other words, shrink the contents of openstack_module to a minimum so that it does not need to be re-used | 22:17 |
asselin | jeblair, +1 on making openstack_module non-reuseable | 22:17 |
jeblair | i'm starting to think that we're not ready for this set of patches, at least not without some discussion and agreement first | 22:17 |
jeblair | SergeyLukjanov: do you think we could WIP them for now and write a spec first? | 22:18 |
asselin | jeblair, but, in the example of a ci "log server", there is no puppet module. Do we create one? It's really a collection of misc items put together to build a server. | 22:19 |
jeblair | asselin: yeah, that and also a 'zuul+nodepool' are good examples of things that we have assembled that should be reusable. so maybe we should create puppet modules for those things and then use them | 22:19 |
clarkb | nodepool.o.o A and AAAA records are updated. TTL is 5 minutes | 22:20 |
clarkb | removing nodepool-dev.o.o records now | 22:20 |
asselin | jeblair, right, but creating a puppet module for each seems overkill to me. I was thinking of having one puppet module to contain all of those. | 22:20 |
*** hashar has joined #openstack-infra | 22:21 | |
clarkb | thats all done. Now to delete the old node completely | 22:21 |
*** dkliban is now known as dkliban_afk | 22:21 | |
*** markmcclain has quit IRC | 22:22 | |
jeblair | asselin: on the one hand, we're getting good at creating puppet modules (thanks ;), on the other hand, maybe "openstack_infra::nifty_log_system" and "openstack_infra::really_cool_ci_system" might be more convenient. | 22:22 |
*** markmcclain has joined #openstack-infra | 22:22 | |
asselin | jeblair, agree with that | 22:23 |
fungi | jeblair: asselin: the expressed use case seems to be "i want a module to be able to run a clone of openstack-infra but with the freedom to change any hard-coded values therein" | 22:23 |
fungi | rather than "i want to piecemeal a bunch of modules and classes together with my own manifests" | 22:23 |
*** lttrl has quit IRC | 22:24 | |
*** markmcclain has quit IRC | 22:24 | |
clarkb | ok delete submitted now we wait | 22:24 |
*** markmcclain has joined #openstack-infra | 22:24 | |
fungi | not sure that's a realistic goal, but it's where that change series is focused | 22:24 |
jeblair | fungi: yeah, but that's use-case that sort of embeds the solution to an implied problem in it, rather than expressing the problem :) | 22:24 |
openstackgerrit | Adrian Turjak proposed openstack-infra/project-config: Add new Openstack-Pydashie project https://review.openstack.org/142240 | 22:24 |
fungi | jeblair: agreed | 22:24 |
jeblair | so i look at the changes and have trouble saying "does this help with the problem it's trying to solve" and have trouble :/ | 22:25 |
*** alex7376 has joined #openstack-infra | 22:25 | |
*** asettle has joined #openstack-infra | 22:25 | |
jeblair | and repeat myself | 22:25 |
fungi | i can only assume this spun out from the mirantis effort to offer openstack-infra-as-a-service | 22:25 |
clarkb | old one is gone | 22:25 |
asselin | fungi, if we split out the resuable components correctly, the openstack_project is really just a bunch of configurations like project-config | 22:25 |
*** markmcclain has quit IRC | 22:25 | |
*** asettle has quit IRC | 22:25 | |
clarkb | ok now to catch up on everything else | 22:25 |
*** amitgandhinz has quit IRC | 22:25 | |
*** markmcclain has joined #openstack-infra | 22:26 | |
fungi | my guess is that it's an internal fork they're running now, and want to upstream as much of as they can, but doesn't necessarily match our proposal for decomposing and making all this ultimately reusable for other use cases | 22:26 |
jeblair | asselin: yeah, and that's where config-in-hiera becomes relevant -- because puppet itself may not be the best way to supply that info, hiera may be | 22:26 |
openstackgerrit | Adrian Turjak proposed openstack-infra/project-config: Add new Openstack-Pydashie project https://review.openstack.org/142240 | 22:26 |
*** gmurphy has left #openstack-infra | 22:27 | |
fungi | or am i confusing mirantis with enovance? | 22:27 |
jeblair | (so instead of making a class that says "this is a log server with the hostname logs.openstack.org", we just have some values in hiera) | 22:27 |
SergeyLukjanov | fungi, we're not going to provide infra-aas, we just already have too many installation of it's parts | 22:27 |
*** doug-fish has left #openstack-infra | 22:27 | |
*** vigneshvar has quit IRC | 22:27 | |
SergeyLukjanov | fungi, it's enovance | 22:27 |
fungi | SergeyLukjanov: oh, that's right. mirantis is using a lot of it internally | 22:27 |
clarkb | I have a bunch of +2 on https://review.openstack.org/#/c/141831/ any opposition to me self approving? | 22:27 |
*** alex7376 is now known as asettle | 22:27 | |
nibalizer | jeblair: agee | 22:28 |
jeblair | clarkb: go for it | 22:28 |
SergeyLukjanov | fungi, in fact it includes stuff like 3rd party CIs (sahara, murano, trove probably) | 22:28 |
SergeyLukjanov | jeblair, re spec - do you mean to push some kind of "extract hardcoded hostnames and urls" spec? | 22:29 |
*** doug-fish1 has joined #openstack-infra | 22:29 | |
SergeyLukjanov | jeblair, fungi, one of the main ideas of such extraction was to make contributors able to test anything locally w/o changing all of the hardcoded stuff | 22:30 |
SergeyLukjanov | jeblair, fungi, because now you'll always will face some internally hardcoded .openstack.org hostnames and urls even if you want to test installation of some servises | 22:31 |
SergeyLukjanov | the split initiative could solve it eventually | 22:31 |
SergeyLukjanov | but extraction will be needed for making split successful ;) | 22:31 |
SergeyLukjanov | if you think that split should be done first - I think we could take some subprojects to work on | 22:31 |
nibalizer | jeblair: i am in favor of the openstack_project::<someapp> class that calls classes and resource from the <someapp> module | 22:32 |
nibalizer | this is a great way to set things up and I've used it before | 22:32 |
nibalizer | it lets openstack specific users and backup logic and coordinatoion live in the openstack space and lets the module do one thing right | 22:32 |
openstackgerrit | James Carey proposed openstack-dev/hacking: Add optional hacking checks https://review.openstack.org/134052 | 22:32 |
SergeyLukjanov | sorry, /me falling asleep (already 1:30am) | 22:33 |
jeblair | SergeyLukjanov: oh, sorry we can pick this up later, thanks! :) | 22:33 |
*** matel has joined #openstack-infra | 22:33 | |
*** matel has quit IRC | 22:33 | |
jeblair | ImportError: No module named unittest2 | 22:34 |
jeblair | so i get that when i try to run zuul's unit tests locally | 22:35 |
jeblair | that's from testtools | 22:36 |
openstackgerrit | Merged openstack-infra/project-config: Make prerelease and release pipelines match pep440 https://review.openstack.org/141831 | 22:36 |
*** cnesa has quit IRC | 22:36 | |
*** pc_m has quit IRC | 22:36 | |
mordred | jeblair: yes - that was fixed by something a while ago | 22:38 |
* mordred can't remember the root cause/fix ... clarkb ^^^ do you remember? | 22:38 | |
EmilienM | fungi: are you talking about software factory? | 22:38 |
*** Rockyg has quit IRC | 22:39 | |
EmilienM | tristanC: ^ | 22:39 |
fungi | EmilienM: possibly. i didn't remember the name of it | 22:39 |
clarkb | mordred: uh | 22:39 |
asselin | nibalizer, anteaya clarkb fungi, is this a good time to discuss the pre puppet module split proposal? | 22:39 |
EmilienM | fungi: if you talk about OpenStack CI as a service, yes. | 22:39 |
nibalizer | im available | 22:39 |
EmilienM | fungi: https://github.com/enovance/software-factory | 22:40 |
fungi | EmilienM: ahh, yep--that's definitely what i was thinking of | 22:40 |
*** CICoverageBuilds has quit IRC | 22:40 | |
anteaya | asselin: I'm around | 22:40 |
EmilienM | fungi: tristanC is one of the core developers on this project. just FYI | 22:40 |
*** esker has quit IRC | 22:40 | |
asselin | anteaya, nibalizer ok, let's just start with us and go from there | 22:41 |
anteaya | okay | 22:41 |
* anteaya listens to asselin | 22:41 | |
clarkb | mordred: no I do not recall, but I seem to remember that we needed to update testtools | 22:41 |
clarkb | mordred: so maybe jeblair has stale venvs? | 22:41 |
* mordred lookng at zuul tree | 22:41 | |
jeblair | clarkb: rm -rf .tox was the first thing i tried | 22:41 |
*** dprince has quit IRC | 22:41 | |
asselin | so the idea is to simplify the process a bit since there are quite a few modules to do | 22:42 |
boris-42 | clarkb: hi there | 22:42 |
mordred | jeblair: any chance you wound up with testtools 1.2.0 installed in the venv? | 22:43 |
boris-42 | clarkb: recently (seems like not more than few days) we start getting such warnings http://paste.openstack.org/show/152045/ | 22:43 |
boris-42 | clarkb: do you know something about that? | 22:43 |
asselin | nibalizer, anteaya I can understand the contention on the 2nd patch: https://review.openstack.org/#/c/140548/ especially w.r.t merge conflicts | 22:43 |
mordred | jeblair: we added an exclude: testtools>=0.9.36,!=1.2.0 | 22:43 |
mordred | for other things | 22:43 |
boris-42 | clarkb: seems like not only related to rally | 22:43 |
mordred | because of evil | 22:43 |
*** changbl has quit IRC | 22:43 | |
nibalizer | so one idea is we could just laeve 140548 up as a review | 22:43 |
nibalizer | and copy/paste stuff out of it when we need to | 22:43 |
asselin | nibalizer, anteaya but I think the first patch should be lower-risk and straight-forward: https://review.openstack.org/#/c/140523/ | 22:43 |
nibalizer | the problem that clarkb brought up is valid | 22:44 |
asselin | nibalizer, that's a good idea | 22:44 |
nibalizer | which is that thats a huge patch and hard to reviews | 22:44 |
clarkb | boris-42: ya you need to downgrade setuptools | 22:44 |
nibalizer | isn't there a middle ground? | 22:44 |
clarkb | boris-42: until we get a release of pbr out that fixes this | 22:44 |
anteaya | asselin: two items brought up at the infra meeting today | 22:44 |
boris-42 | clarkb: Oh thank you sir! | 22:44 |
jeblair | mordred: Source in ./.tox/py27/build/testtools has version 1.5.0, which satisfies requirement testtools>=0.9.32 | 22:44 |
nibalizer | instead of 1 module at a time and all modulues at a time, we could pick 10 modules to do in a 2 week period and do those? | 22:44 |
anteaya | asselin: 1) we need to follow the spec and only include the projects identified in the spec | 22:45 |
clarkb | boris-42: you want <8.0 | 22:45 |
anteaya | asselin: 2) names with both hyphens and underscores are currently a blocker | 22:45 |
mordred | jeblair: k. well, I just ran tox -epy27 -r locally in zuul and it worked | 22:45 |
anteaya | asselin: can you spin up a new patch that addresses those two points? | 22:45 |
asselin | anteaya, both are easy to fix. First, I'd like to get agreement onthe direction. otherwise we can just abandon | 22:45 |
anteaya | asselin: you had suggested perhaps removing projects with underscores for the moment | 22:46 |
jeblair | mordred: jenkins works too | 22:46 |
mordred | hrm | 22:46 |
* mordred tries to remember what the unittest2 problem was | 22:46 | |
*** ociuhandu has quit IRC | 22:46 | |
anteaya | asselin: well sometimes the general agreement becomes disagreement when we can't address the details | 22:46 |
mordred | (it's one of those where I _believe_ not having unittest2 isn't actually the problem) | 22:46 |
anteaya | asselin: that is just part of the workflow | 22:46 |
anteaya | asselin: you don't have a agreement now | 22:47 |
anteaya | asselin: if you are willing to put up another patchset you might get agreement, or you might not | 22:47 |
mordred | jeblair: just to cover bases - what version of tox do you have? | 22:47 |
anteaya | asselin: it is a risk and I can't give you a guarentee | 22:47 |
jeblair | mordred: 161 | 22:47 |
mordred | ok. I'm on 1.8.0 | 22:47 |
anteaya | asselin: the only thing I can pretty much guarentee is that I won't merge as it is right now | 22:48 |
mordred | gimme a sec - lemme test 1.6.1 | 22:48 |
asselin | anteaya, ok, so then I'll assume then at least there's no strong disagreement, e.g. -2. | 22:48 |
*** carl_baldwin has quit IRC | 22:48 | |
anteaya | there is no -2 on the patch correct | 22:48 |
asselin | anteaya, no, not yet.... | 22:48 |
anteaya | so if someone wanted to -2, they have had a chance and haven't | 22:48 |
anteaya | I never know what someone else will do | 22:48 |
fungi | dhellmann: the juno global-reqs change just merged | 22:48 |
anteaya | all I can say is that that patch right now, needs work in my opinion | 22:49 |
asselin | anteaya, ok, so I will do 1) we need to follow the spec and only include the projects identified in the spec | 22:49 |
mordred | fungi: ^^ do you remember the unittest2 testtools thing from a couple of weeks ago? | 22:49 |
*** carl_baldwin has joined #openstack-infra | 22:49 | |
fungi | the gate's in remarkably great shape... just saw 14 changes merge from the integrated change queue in one shot | 22:49 |
*** chuckC_ has quit IRC | 22:49 | |
*** alexpilotti_ has joined #openstack-infra | 22:49 | |
fungi | mordred: yeah, it's a little fuzzy now | 22:49 |
asselin | anteaya, nibalizer I can split out these into a separate patch: 2) names with both hyphens and underscores are currently a blocker | 22:49 |
*** alexpilotti_ has quit IRC | 22:49 | |
anteaya | asselin: I think you are hearing what I am saying | 22:50 |
anteaya | asselin: which heartens me | 22:50 |
*** alexpilotti has quit IRC | 22:50 | |
mordred | jeblair: ftr, 1.6.1 works for me too. here's the bug: https://bugs.launchpad.net/devstack/+bug/1393006 | 22:50 |
anteaya | asselin: if you offer another patch I will review it | 22:50 |
fungi | mordred: there were some bugs in our projects which it exposed, but also bugs resulting in another minor release or two of testtools as well | 22:50 |
uvirtbot | Launchpad bug 1393006 in devstack "testtools 1.2.0 with old unittest2 breaks subunit.run discover --list" [Critical,Fix released] | 22:50 |
nibalizer | so what to do about the underscores though? | 22:50 |
anteaya | good question | 22:50 |
anteaya | I don't know | 22:51 |
asselin | anteaya, nibalizer and for the 2nd patch, I'll mark it WIP. We can just refer to it as nibalizer suggested | 22:51 |
*** sputnik13 has quit IRC | 22:51 | |
anteaya | nibalizer: we can deal with them one at a time rather than a group | 22:51 |
anteaya | nibalizer: might have a better chance of success | 22:51 |
asselin | anteaya, nibalizer I prefer to do all at once. | 22:51 |
*** sputnik13 has joined #openstack-infra | 22:51 | |
anteaya | nibalizer: I don't think we can arrive at a solution for the whole group | 22:51 |
*** mriedem has quit IRC | 22:51 | |
asselin | anteaya, nibalizer it seems the solutions should be consistent | 22:51 |
anteaya | asselin: let's focus on what we can do all at once | 22:51 |
nibalizer | so are you at all flexible about having hypens and underscores? | 22:52 |
anteaya | I can opt out | 22:52 |
* asselin has no opinion on it | 22:52 | |
jeblair | nibalizer: iiuc, install_modules installs a module by creating a directory named "foo" assuming that all modules are named "puppet-foo" | 22:52 |
anteaya | I can shut up and go away | 22:52 |
anteaya | I can do that | 22:52 |
nibalizer | anteaya: that wasn't what i meant, or what i want | 22:52 |
*** melwitt has quit IRC | 22:52 | |
anteaya | let's focus on where we have agreement | 22:53 |
mordred | jeblair: I've tested both with and without the updated requirement from global-requirements and on tox 1.8.0 and 1.6.1 - all work for me- so I'm a bit confused | 22:53 |
*** spzala has quit IRC | 22:53 | |
anteaya | follow the spec, repos with hyphens | 22:53 |
anteaya | even if we only merge that that is still substantial | 22:53 |
mordred | I also can't see anywhere in openstack where we are importing unittest2 | 22:53 |
clarkb | mordred: jeblair: is there a link to the error someplace? | 22:53 |
jeblair | anteaya: let's try to understand the technical issue related to naming and figure out a solution | 22:53 |
mordred | so if we used that as a workaround at one point, we don't seem to be doing it anymore | 22:53 |
anteaya | jeblair: we can do that too | 22:54 |
jeblair | nibalizer: so the issue comes up because our install script knows to strip "puppet-" from the directory that the module is installed to, but does no other transformation | 22:54 |
*** carl_baldwin has quit IRC | 22:54 | |
jeblair | nibalizer: and this even works for "puppetlabs-foo" because it's just stripping up to the first hyphen | 22:54 |
anteaya | nibalizer: this is _our_ install script? | 22:55 |
anteaya | I didn't know this was ours | 22:55 |
nibalizer | i wasn't aware we had a problem with the install script | 22:55 |
jeblair | okay, backing up then | 22:55 |
nibalizer | if you have a repo called puppet-log_processor ... what is the problem? | 22:55 |
jeblair | the problem is that puppet modules are actually directories, and puppet modules may only consist of alphanumeric and underscore, rightL | 22:55 |
nibalizer | that is true | 22:56 |
*** amitgandhinz has joined #openstack-infra | 22:56 | |
jeblair | okay, so the reason that "puppet-foo_bar" works is that our install script strips puppet- from it. so the _first_ hyphen is not a problem for us. right? | 22:56 |
nibalizer | as i understand it | 22:56 |
jeblair | similarly puppetlabs-foo | 22:56 |
*** zz_dimtruck is now known as dimtruck | 22:57 | |
*** gokrokve has quit IRC | 22:57 | |
jeblair | i'm scanning puppetlabs git org to see what they do | 22:57 |
jeblair | most of the time the module name is one word | 22:57 |
nibalizer | but creating puppet-log-processor would break | 22:57 |
jeblair | https://github.com/puppetlabs/puppetlabs-policy_engine | 22:57 |
jeblair | there's a case where they use the mix | 22:58 |
*** yamamoto has joined #openstack-infra | 22:58 | |
jeblair | so it sort of looks like "something-module_with_underscores" is actually an established pattern | 22:59 |
jeblair | (i'm seeing a few more of those) | 22:59 |
*** rmcall has quit IRC | 23:00 | |
*** carl_baldwin has joined #openstack-infra | 23:00 | |
nibalizer | sorry my internet died | 23:01 |
nibalizer | yes, puppet modules do this | 23:01 |
nibalizer | no one loves it, to be sure, but its where we are | 23:01 |
jeblair | so as annoying as it is to have the mixture, it seems like puppet-module_name is probably going to be the most compatible with existing tooling related to puppet modules | 23:01 |
mordred | jeblair: ++ | 23:01 |
*** baoli has joined #openstack-infra | 23:01 | |
jeblair | and if we were to try to "improve" the situation by switching to "puppet_module_name" we'd probably actually make it harder for people (even though i'm sure we could fix our own install script fairly easily) | 23:02 |
jeblair | and changing to "puppet-module-name" would be even harder for people to deal with than that | 23:02 |
*** gokrokve has joined #openstack-infra | 23:02 | |
nibalizer | another option is to move it to puppet-modulename | 23:02 |
nibalizer | but that hinders reabability | 23:03 |
jeblair | nibalizer: the stackforge puppet modules have a mixture | 23:04 |
jeblair | nibalizer: http://git.openstack.org/cgit/stackforge/puppet-openstack-cloud/tree/ | 23:04 |
anteaya | any way of creating something to point at for the cargo culters that says that hyphens and underscores are only permissible for puppet modules | 23:04 |
clarkb | ok we have all of the setuptools fixes in except for pbr | 23:04 |
clarkb | mordred: ^ can you address fungi's -1? | 23:04 |
anteaya | since I am seeing this in job names and non puppet stackforge repo names | 23:04 |
* clarkb would really like to push up a rvert of setuptools pin to devstack to see what breaks | 23:04 | |
anteaya | and anything one project does, they all copy | 23:05 |
clarkb | but need to fix pbr first otherwise pbr will break | 23:05 |
mordred | fungi: how would you like that addressed? | 23:05 |
mordred | fungi: you seem to have summed it up in that comment - should I just acknowledge that comment? | 23:05 |
fungi | mordred: clarkb: either an update to the commit message or a comment in the review. just something recording this as the decision rather than merely that the concerns were ignored (which they weren't) | 23:05 |
jeblair | nibalizer: dow does puppet-openstack-cloud work? | 23:05 |
fungi | mordred: yep, that would be fine | 23:05 |
mordred | ok | 23:05 |
fungi | then i'm happy to approve' | 23:06 |
*** hashar has quit IRC | 23:06 | |
jeblair | clarkb, fungi, mordred: http://paste.openstack.org/show/152047/ | 23:06 |
*** gokrokve has quit IRC | 23:06 | |
*** dims has quit IRC | 23:07 | |
*** rmcall has joined #openstack-infra | 23:07 | |
jogo | mordred: any recent PBR changes | 23:07 |
mordred | fungi: done | 23:07 |
*** gokrokve has joined #openstack-infra | 23:07 | |
jogo | mordred: http://logs.openstack.org/52/134052/5/check//gate-hacking-integration-nova/c4d107b/console.html#_2014-12-16_22_38_03_070 | 23:07 |
mordred | jogo: that's WAY too broad of a question | 23:07 |
fungi | clarkb: also the proposed stable/juno patches which just updated to all projects using oslo.db need to merge, yeah? | 23:07 |
*** dims has joined #openstack-infra | 23:07 | |
fungi | mordred: thanks--approving | 23:07 |
clarkb | wow testools setup.py depends on unittest2 | 23:08 |
fungi | mordred: also a change from pip freeze to pbr freeze in all jobs would be helpful | 23:08 |
*** dims has quit IRC | 23:08 | |
fungi | mordred: i can hack that up if you haven't started | 23:08 |
*** dims has joined #openstack-infra | 23:08 | |
mordred | jogo, clarkb: might have to do with the setuptools mess? | 23:08 |
asselin | anteaya, are you good with mixed case? or would you prefer to consider it more as a separate patch set? | 23:08 |
anteaya | nibalizer jeblair the make an exception for me argument, just becomes "hey look what your future looks like" | 23:08 |
clarkb | fungi: that will need to merge but not to test a revert of the setuptools pin because we patch all reqs from global reqs | 23:08 |
mordred | fungi: I can get it | 23:08 |
fungi | clarkb: oh, great point | 23:08 |
clarkb | mordred: jeblair maybe? what version of setuptools is in there? | 23:08 |
nibalizer | jeblair: that module is actually called (from metadata.json) "eNovance-cloud", | 23:08 |
mordred | clarkb: no - jogo's thing | 23:09 |
clarkb | oh maybe? | 23:09 |
EmilienM | jeblair: it works in production for us. If you have any question, I'm a main contributor | 23:09 |
jogo | mordred: hmm | 23:09 |
EmilienM | jeblair: (puppet-openstack-cloud) | 23:09 |
clarkb | except that pbr is running on what is basically 0.10.0 now | 23:09 |
anteaya | EmilienM: we are talking about repo names | 23:09 |
*** yamamoto has quit IRC | 23:09 | |
jeblair | EmilienM: i'm told puppet modules can't have hyphens in their names | 23:09 |
clarkb | so pbr changes wouldn't be related but setuptools mihgt be | 23:09 |
*** sigmavirus24 has joined #openstack-infra | 23:10 | |
anteaya | EmilienM: and nibalizer is making the point that they have to be called puppet-foo_bar | 23:10 |
jeblair | EmilienM: that it is a restriction in puppet | 23:10 |
*** rmcall has quit IRC | 23:10 | |
EmilienM | jeblair: oh. Then we have an issue with our module. Not an issue if you want to rename it. | 23:10 |
anteaya | EmilienM: as puppet-foo-bar will break | 23:10 |
EmilienM | jeblair: I don't see where is causes problem though | 23:10 |
anteaya | EmilienM: no issue | 23:10 |
*** otter768 has joined #openstack-infra | 23:10 | |
nibalizer | jeblair: see http://git.openstack.org/cgit/stackforge/puppet-openstack-cloud/tree/manifests/cache.pp#n31 they use just cloud in their module name | 23:10 |
EmilienM | we already have puppet-neutron, etc | 23:10 |
clarkb | EmilienM: puppet specifically says that names may not have -'s in them | 23:10 |
anteaya | EmilienM: we are curious | 23:10 |
EmilienM | anteaya: I know you are :P | 23:11 |
clarkb | EmilienM: puppet-neutron is fine because that is renamed to neutron in puppet right? | 23:11 |
clarkb | EmilienM: you don't use neutron::thing { 'stuff': | 23:11 |
clarkb | er | 23:11 |
clarkb | puppet-neutron::thing { 'stuff': | 23:11 |
jogo | mordred: yeah pbr/util hasn't been touched in months :/ | 23:11 |
*** e0ne has quit IRC | 23:11 | |
jeblair | nibalizer: oh, in the _code_ not in the directory? | 23:11 |
EmilienM | clarkb: ok. While we use "cloud::" thing I see your point | 23:11 |
mordred | jogo: well, the setuptools stuff would have the potential to break name resolution | 23:12 |
jogo | sigmavirus24: ^ | 23:12 |
jeblair | nibalizer: but then, would you have to install puppet-openstack-cloud into /puppet/module/directory/cloud for it to work? | 23:12 |
jeblair | EmilienM: ^? | 23:12 |
mordred | clarkb, fungi: do we have anything that tests with tox and doesn't use pbr? | 23:12 |
jogo | mordred: doh | 23:12 |
nibalizer | jeblair: yes | 23:12 |
mordred | clarkb, fungi: because if we do, then the jobs to do the pip freeze -> pbr freeze are going to have to get more complex | 23:12 |
fungi | mordred: at one point i would have said git-review but that's no longer the case | 23:13 |
sigmavirus24 | mordred: I didn't think there were any entry point related changes in 8.x | 23:13 |
*** emagana has quit IRC | 23:13 | |
mordred | sigmavirus24: I believe you're correct - but I was thinking that the setuptools version normalization could trigger somethign there? | 23:13 |
*** krtaylor has quit IRC | 23:13 | |
fungi | mordred: wrapper slave script which looks for pbr as an executable and then calls that instead of pip for the freeze output? | 23:13 |
*** rmcall has joined #openstack-infra | 23:14 | |
jogo | sigmavirus24: whatever the issue, I don't see it just running 'tox -epep8' on nova | 23:14 |
EmilienM | jeblair: yes | 23:14 |
jogo | so not in the hacking 0.9 | 23:14 |
EmilienM | jeblair: our Puppetfile does it | 23:14 |
jeblair | nibalizer, anteaya: so i think our thoughts about maintaining puppet-module_name for maximum compatability still stands | 23:14 |
*** amitgandhinz has quit IRC | 23:14 | |
mordred | fungi: yah - I think we need to do that | 23:14 |
sigmavirus24 | mordred: so the code in particular causing this is that nova.hacking.checks is imported but we can't getattr(nova.hacking,checks, 'factory') | 23:14 |
jeblair | EmilienM: thanks, that explains it and i think i understand now | 23:14 |
EmilienM | jeblair: though I'm still not sure we are doing right | 23:14 |
sigmavirus24 | jogo: what happens if you recreate the env? | 23:14 |
sigmavirus24 | tox -epep8 -r | 23:14 |
anteaya | jeblair: I am hearing that, do we have any hope of containing the bleed to puppet modules | 23:14 |
EmilienM | but it works ^^ | 23:14 |
jogo | sigmavirus24: did that | 23:14 |
anteaya | or are we going to have to accept everything being named with hyphens and underscores henceforth | 23:15 |
clarkb | fungi: mordred I think we do [ -e .tox/venv/py27/pbr ] && pbr freese | 23:15 |
clarkb | I don't think we need to make it more complex than that | 23:15 |
*** otter768 has quit IRC | 23:15 | |
mordred | clarkb: [ -e .tox/venv/py27/pbr ] && pbr freeze || pip freeze | 23:15 |
clarkb | mordred: ya that | 23:16 |
*** gondoi is now known as zz_gondoi | 23:16 | |
*** ddieterly has quit IRC | 23:17 | |
jeblair | anteaya: many systems are going to have specific naming requirements. oslo.foo for example. i think we're going to have to be flexible. try to point out potential typos or areas for improvement, but otherwise, bend. :) | 23:17 |
jogo | mordred: pbr.util.resolve_name('nova.hooks.add_hook') | 23:17 |
jogo | mordred: lools like resolve_name is not resolving anymore | 23:17 |
*** ddieterly has joined #openstack-infra | 23:17 | |
anteaya | sigh in the stackforge/third party space that translates to get trampled | 23:18 |
anteaya | okay fine | 23:18 |
sigmavirus24 | jogo: and you're on setuptools.__version__.startswith('8.0') ? | 23:18 |
openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Move to pbr freeze from pip freeze https://review.openstack.org/142257 | 23:18 |
*** rmcall has quit IRC | 23:18 | |
* anteaya invests in more beeswax candles | 23:19 | |
*** emagana has joined #openstack-infra | 23:19 | |
openstackgerrit | James Carey proposed openstack-dev/hacking: Add optional hacking checks https://review.openstack.org/134052 | 23:20 |
sigmavirus24 | jogo: with nova on tip, tox -epep8 -r doesn't work for me | 23:20 |
*** rmcall has joined #openstack-infra | 23:20 | |
jogo | sigmavirus24: huh, | 23:20 |
mordred | sigmavirus24: with setuptools.__version__.startswith('8.0') ? | 23:20 |
sigmavirus24 | and the setuptools version in the venv is 3.6 odly | 23:20 |
* sigmavirus24 upgrades | 23:20 | |
mordred | ah. ok | 23:20 |
*** mfink has quit IRC | 23:20 | |
jeblair | clarkb: do you understand the testtools error i'm seeing? | 23:20 |
mordred | well, me needs to afk for a few - would LOVE more infos | 23:21 |
jogo | sigmavirus24: setuptools.__version__ | 23:21 |
jogo | '3.6' | 23:21 |
jogo | confused about that | 23:21 |
jogo | that is inside a tox venv | 23:22 |
sigmavirus24 | our virtualenv versions might be old | 23:22 |
*** ddieterly has quit IRC | 23:22 | |
mordred | jeblair: since I can't reproduce locally - can you try adding unittest2 to your test-requires and verify that that does fix it for you | 23:22 |
mordred | jeblair: and in the mean time I'll keep trying to figure out why this is affecting you and not me and what the root cause is | 23:22 |
openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Extend ACL checks to OpenStack namespace. https://review.openstack.org/142230 | 23:22 |
openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Fix the OSSA ACL config https://review.openstack.org/142258 | 23:22 |
clarkb | jeblair: not really just that it seems to need unittest2 to be installed for its setup.py to run | 23:23 |
mordred | jeblair: OOOOOHHHHHHHHHH | 23:23 |
mordred | I get it | 23:23 |
clarkb | jeblair: which is odd | 23:23 |
mordred | it will take a bit more jiggering to reproduce | 23:23 |
jogo | sigmavirus24 mordred: well I saw this fail on infra | 23:23 |
*** bdpayne has joined #openstack-infra | 23:23 | |
clarkb | mordred: can you explain more than that? | 23:23 |
jogo | so I don't think its just our local boxes http://logs.openstack.org/52/134052/5/check//gate-hacking-integration-nova/c4d107b/console.html#_2014-12-16_22_38_03_070 | 23:23 |
mordred | jeblair, clarkb: but this is the "setup_requires downloads an egg which causes install_requires to not need to install something even though it _Does_ need to install it" bug | 23:23 |
*** dmsimard is now known as dmsimard_away | 23:23 | |
mordred | it was fixed in upstream pip iirc | 23:24 |
nibalizer | so does that mean asselin can add the underscore projects in to his patch? | 23:24 |
mordred | but it was the cause of many a weird error like this for a while | 23:24 |
* mordred will try to put together a test case to show that | 23:24 | |
mordred | but must afk for a sec - back ina few | 23:24 |
asselin | nibalizer, at this point, I will keep them in...err...not take them out. | 23:24 |
sigmavirus24 | jogo: well my box failed on install | 23:24 |
*** teran_ has joined #openstack-infra | 23:25 | |
sigmavirus24 | ah libvirt needs to be installed apparently ... good old c extensions | 23:25 |
*** wenlock has quit IRC | 23:25 | |
*** melwitt has joined #openstack-infra | 23:25 | |
nibalizer | okay cool | 23:25 |
jogo | haha | 23:25 |
jogo | bbiab relocating | 23:25 |
asselin | nibalizer, anteaya and check consistency with the spec | 23:25 |
*** krtaylor has joined #openstack-infra | 23:26 | |
nibalizer | cool | 23:27 |
*** shashankhegde has quit IRC | 23:27 | |
*** teran has quit IRC | 23:28 | |
*** shashankhegde has joined #openstack-infra | 23:28 | |
*** gokrokve has quit IRC | 23:28 | |
*** andreykurilin_ has quit IRC | 23:30 | |
openstackgerrit | James Carey proposed openstack-dev/hacking: Add optional hacking checks https://review.openstack.org/134052 | 23:31 |
jeblair | clarkb, mordred: adding unittest2 to the beginning of test-requirements avoids the problem | 23:31 |
openstackgerrit | James Carey proposed openstack-dev/hacking: Add optional hacking checks https://review.openstack.org/134052 | 23:32 |
jeblair | clarkb, mordred: so do i need a newer pip? | 23:33 |
*** dimtruck is now known as zz_dimtruck | 23:34 | |
jeblair | clarkb, mordred: https://github.com/testing-cabal/testtools/commit/6f12789a398a99fc39e4380bd063af841a262c62 | 23:34 |
clarkb | maybe I still don't quite get what mordred is saying | 23:35 |
jeblair | clarkb, mordred: so it switched to using setup_requires | 23:35 |
clarkb | jeblair: however your tox bundles pip | 23:35 |
clarkb | jeblair: so its likely related to your tox version if pip version matters | 23:35 |
jeblair | clarkb: mordred tried using my version of tox and it worked for him | 23:36 |
clarkb | so likely not related to pip version | 23:36 |
clarkb | let me give reproduction a go. just `tox -epy27`? | 23:36 |
jeblair | yep | 23:36 |
*** fandi has joined #openstack-infra | 23:38 | |
*** fandi has quit IRC | 23:38 | |
*** zz_dimtruck is now known as dimtruck | 23:41 | |
*** e0ne has joined #openstack-infra | 23:41 | |
fungi | tox -repy27 with zuul master works for me (using tox 1.8.1) | 23:41 |
clarkb | wow running tox like that killed the battery very quickly :) | 23:42 |
clarkb | thankfully I can plug in | 23:42 |
*** erikmwilson has quit IRC | 23:44 | |
*** Masahiro has joined #openstack-infra | 23:44 | |
clarkb | but unable to reproduce with tox 1.6.1 | 23:44 |
*** MarkAtwood has quit IRC | 23:46 | |
*** e0ne has quit IRC | 23:47 | |
openstackgerrit | Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split #1 https://review.openstack.org/140523 | 23:47 |
asselin | nibalizer, anteaya ^^ | 23:47 |
*** amotoki has quit IRC | 23:47 | |
*** Masahiro has quit IRC | 23:48 | |
clarkb | woot I did not see that fungi approved pbr changes \o/ I am excited | 23:48 |
fungi | clarkb: yeah, now we need a 0.10.3 tag | 23:49 |
clarkb | well it needs to merge but its in process | 23:49 |
fungi | mordred: ^ would you like to do the honors this time? | 23:49 |
fungi | oh, right, gating feh | 23:49 |
fungi | details details | 23:50 |
*** yamamoto has joined #openstack-infra | 23:50 | |
*** andreaf has joined #openstack-infra | 23:52 | |
fungi | according to https://github.com/openstack/openstack/graphs/commit-activity week before last we merged more openstack/openstack changes than, well, ever | 23:52 |
*** rmcall has quit IRC | 23:52 | |
*** lttrl has joined #openstack-infra | 23:52 | |
clarkb | wow | 23:52 |
fungi | 554 commits the week of november 30 | 23:52 |
pleia2 | wow | 23:53 |
nibalizer | jeblair: pleia2 so do we want to give some kind of ping to the golang folks? | 23:53 |
*** dimtruck is now known as zz_dimtruck | 23:53 | |
pleia2 | nibalizer: I think so | 23:54 |
mordred | nibalizer: maybe they can put the word go in theirs | 23:54 |
pleia2 | I do worry it will get very confusing in the long run because the tools are so similar | 23:54 |
pleia2 | just different enough to make people crazy when they land on the wrong man page | 23:54 |
fungi | pleia2: nibalizer: know any of the people listed at https://github.com/golang/review/commits/master/git-review ? | 23:55 |
mordred | fungi: what gating? | 23:55 |
fungi | mordred: i know, right? | 23:55 |
pleia2 | I don't know anyone in the go community | 23:55 |
*** sputnik13 has quit IRC | 23:55 | |
*** mfink has joined #openstack-infra | 23:55 | |
timrc | at least it is a review tool for go and not a review tool for an go-implementation of openstack aka gopenstack | 23:56 |
mordred | timrc: yah - but it's a review tool for _Gerrit_ | 23:56 |
* anteaya 's tox just failed on No module named unittest2 and is reading backscroll | 23:56 | |
mordred | timrc: like, it literally does the same thing, except less generally and written in go | 23:56 |
clarkb | anteaya: cool you can reproduce. what version of tox do you have? | 23:56 |
greghaynes | I submit https://code.google.com/p/go/issues/detail?id=9 as evidence they may not care | 23:57 |
clarkb | would be interesting if your version is different than jeblairs | 23:57 |
mordred | ooh! | 23:57 |
timrc | mordred, Aye. | 23:57 |
mordred | anteaya broke too | 23:57 |
mordred | I'm happy | 23:57 |
*** sputnik13 has joined #openstack-infra | 23:57 | |
*** jlibosva has quit IRC | 23:57 | |
anteaya | anita@anita-hp:~/work/project-config$ tox --version | 23:58 |
anteaya | 1.6.1 imported from /usr/local/lib/python2.7/dist-packages/tox/__init__.pyc | 23:58 |
nibalizer | fungi: this is an easeir to parse list https://github.com/golang/review/graphs/contributors | 23:58 |
pleia2 | greghaynes: wow, I hadn't seen that before, pretty epic, "There's no law against being rude" x_x | 23:58 |
anteaya | mordred: I'm glad my breaking makes you happy | 23:58 |
mordred | clarkb: are we _certain_ that tox is bundling virtualenv? | 23:58 |
mordred | pleia2: can you tell me pip --version and virtualenv --version too? | 23:59 |
anteaya | here I was trying to do reviews to accomplish that | 23:59 |
mordred | gah | 23:59 |
mordred | anteaya: ^^ | 23:59 |
* anteaya gets versions | 23:59 | |
mordred | pleia2: I do not need to nkow your pip --version and virtualenv --version | 23:59 |
fungi | mordred: i think dstufft suggested that tox merely installs virtualenv | 23:59 |
clarkb | mordred: ya well at least it did in the past | 23:59 |
pleia2 | :) | 23:59 |
clarkb | mordred: I can say it definitely vendored virtualenv a year ago | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!