Tuesday, 2014-12-16

clarkbjeblair so I think we can do that it just requires upgrading all services on onehost/venv together00:00
jeblairjogo: 2) because it prohibits us from placing version caps on stable branches in the case that we can not find an overlapping dependency that works with both00:00
*** zz_avozza is now known as avozza00:00
jeblairclarkb: i think we're all in agreement on that00:00
clarkbwhich sdague was opposed to when we talked about it00:00
jeblairclarkb: the wrinkle is ncpu partial upgrade00:00
jeblairclarkb: apparently grenade used to work like that, which makes sense to me.00:00
clarkb+100:00
clarkb(I was aproponent for this a little while back but was the only one)00:01
*** bradjones has joined #openstack-infra00:01
jeblairclarkb: so partial upgrades need per-component environments, and each environment needs a full shutdown/upgrade/start00:01
jeblairclarkb: all-in-one upgrades, it doesn't matter whether we use per-component envs or not.  but regardless of the number of envs (one or many) it or they need a full stop/upgrade/start00:02
jeblairclarkb: yeah, it does not seem feasible to me to handle the partial upgrade case without environments/containers/equiv00:02
clarkbyup00:03
anteayanotmyname: zaro is probably the best person to talk to about gerrit00:03
jeblairclarkb: i still very much think that at the end of the process, each release of openstack should function with the same deps.  but we can ensure that with requirements check jobs and testing00:03
jeblairclarkb: including perhaps the simple install-only all-in-one devstack test00:03
*** yfried|afk is now known as yfried00:04
jogojeblair: I was thinking standard devstack wouldn't use venvs00:04
jogoand grenade jobs would00:04
mordredclarkb: I split 141677 and also added https://review.openstack.org/14194600:04
*** zz_zz_zz_sabari is now known as sabari00:06
dtroyerjogo: that'll be hard as grenade just calls the devstack functions to do the start of new services, so devstack has to run either way in that case00:06
jogodtroyer: right, step 1 is teach grenade about venvs00:06
jogostep 2 is teach stable/juno grenade about venvs00:06
jogoand make those off by default00:07
dtroyerno, teach devstack about venvs.  grenade doens't know anything about actually running services00:07
jogothat is what I was thinking, but apparently not what I wrote00:07
jeblairjogo:00:07
dtroyerwell ok then  ;)00:07
*** yamamoto has joined #openstack-infra00:08
jeblairjogo: very specifically, the thing that is broken for us right now is that we would like to release oslo.db 1.0.X, and then cap juno at <1.1, however, since master is at >=1.1 we are unable to do that because of the upgrade00:08
jogojeblair: excellent, thanks00:09
jeblairjogo: so that's the friendly version of the problem which we can work around, with some difficulty, because we think we can construct a release that will satisfy all the requirements.  but if it were anyone other than us, we'd be sol.00:09
*** bitblt has joined #openstack-infra00:10
*** avozza is now known as zz_avozza00:10
mordreddhellmann: updated https://review.openstack.org/141946 to address your comments from 14167700:11
*** zz_avozza is now known as avozza00:11
*** dannywilson has quit IRC00:12
*** Masahiro has joined #openstack-infra00:12
*** dannywilson has joined #openstack-infra00:12
*** yfried is now known as yfried|afk00:14
*** ddieterly has quit IRC00:14
*** sputnik1_ has joined #openstack-infra00:15
*** fandi has joined #openstack-infra00:15
*** sputnik13 has quit IRC00:15
*** bitblt has quit IRC00:17
*** dannywilson has quit IRC00:17
*** Masahiro has quit IRC00:17
anteayaclarkb fungi jeblair any reason to hold off +A'ing clarks make prerelease and release pipelines match pep440 patch? https://review.openstack.org/#/c/141831/100:20
openstackgerritMerged openstack-infra/elastic-recheck: Bugs _in_ this project go in StoryBoard now  https://review.openstack.org/13912000:20
*** sputnik1_ is now known as sputnik1300:20
clarkbanteaya its probably worth getting eyes on00:21
anteayaI will just review then and not +A00:21
*** sabari is now known as zz_sabari00:27
*** mtanino has quit IRC00:27
*** fandi has quit IRC00:28
*** annegent_ has joined #openstack-infra00:29
*** jerryz has joined #openstack-infra00:33
*** teran has joined #openstack-infra00:34
*** annegent_ has quit IRC00:34
*** groknix has joined #openstack-infra00:35
*** david-lyle is now known as david-lyle_afk00:35
*** fandi has joined #openstack-infra00:35
*** groknix has quit IRC00:35
*** dizquierdo has quit IRC00:35
*** amitgandhinz has joined #openstack-infra00:36
*** pc_m has quit IRC00:37
*** dims has joined #openstack-infra00:38
openstackgerritRamy Asselin proposed openstack-infra/infra-specs: Add spec for in-tree 3rd party ci solution  https://review.openstack.org/13974500:39
*** teran has quit IRC00:39
*** oomichi has joined #openstack-infra00:41
*** amitgandhinz has quit IRC00:41
*** ZZelle has quit IRC00:43
jogomordred: https://review.openstack.org/#/c/10351/00:43
jogodid this ever do anything?00:44
*** dpaterson has quit IRC00:51
*** emagana has joined #openstack-infra00:51
*** Masahiro has joined #openstack-infra00:51
*** michchap_ has joined #openstack-infra00:52
*** michchap has quit IRC00:54
*** emagana has quit IRC00:56
*** alexpilotti has joined #openstack-infra00:58
*** unicell has joined #openstack-infra00:59
*** otter768 has joined #openstack-infra01:00
jogohttps://github.com/openstack-dev/devstack says this is oneiric powered development environment for openstack01:00
jogothat doesn't sound right01:00
pleia2hah, it was a couple years ago01:01
jogoI didn't see any description in project-config01:02
anteayajhesketh: I need to see if I can get some sleep see you at 0800 for the meeting01:02
*** camunoz has quit IRC01:04
*** sabeen3 has joined #openstack-infra01:04
pleia2jogo: yeah, I just grepped through too, I wonder if it's something funny with our github initial sync script01:04
jheskethanteaya: okay, last I read though there was still disagreements about that meeting01:04
*** sabeen1 has quit IRC01:04
jheskethI didn't feel like that was resolved unless I've missed something01:05
*** otter768 has quit IRC01:05
*** ChuckC has quit IRC01:05
*** avozza is now known as zz_avozza01:06
*** mtanino has joined #openstack-infra01:06
openstackgerritMerged openstack-infra/project-config: Fix api-wg job names and placement  https://review.openstack.org/14130601:06
jogopleia2: yeah, maybe we don't erase if its empty01:07
*** markmcclain has quit IRC01:07
*** mmaglana has quit IRC01:08
pleia2hmm, we didn't use an upstream: when pulling in devstack, I don't actually know how it was done01:09
anteayajhesketh: I am chairing a meeting at 080001:09
jogopleia2: o_O01:09
anteayajhesketh: anyone who feels like showing up can join me01:09
pleia2jogo: at least, it's not in projects.yaml01:09
zxiiroWith JJB is it possible to make variable variables?01:11
jheskethanteaya: okay, fair enough01:11
anteayajhesketh: thanks01:11
zxiiroI want to pass a value that it, itself is a variable to a job-template01:11
*** sarob has quit IRC01:13
*** sputnik13 has quit IRC01:15
*** sputnik13 has joined #openstack-infra01:15
jyusoanteaya: hi:)01:16
*** camunoz has joined #openstack-infra01:20
*** Alexandra_ has joined #openstack-infra01:22
*** asettle has quit IRC01:22
*** Alexandra_ is now known as asettle01:23
*** wenlock has quit IRC01:23
*** ryanpetrello has quit IRC01:27
*** annegent_ has joined #openstack-infra01:30
*** che-arne|2 has joined #openstack-infra01:31
*** ryanpetrello has joined #openstack-infra01:32
*** sputnik13 has quit IRC01:33
*** che-arne has quit IRC01:33
*** prad has quit IRC01:33
*** yaguang has joined #openstack-infra01:34
*** annegent_ has quit IRC01:35
*** julim has quit IRC01:36
*** teran has joined #openstack-infra01:36
openstackgerritSpencer Krum proposed openstack-infra/infra-specs: Spec to refactor puppet code in openstack_project  https://review.openstack.org/13747101:37
*** mmaglana has joined #openstack-infra01:40
*** teran has quit IRC01:41
*** ChuckC has joined #openstack-infra01:42
*** hdd has quit IRC01:43
jogohmm I tried running devstack locally and got http://paste.openstack.org/show/151513/01:44
jogodhellmann: ^01:46
*** lttrl has quit IRC01:46
*** bdpayne has quit IRC01:46
*** alexpilotti has quit IRC01:47
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Push dg-tempest-dsvm-full logs to swift  https://review.openstack.org/14166801:48
*** mmaglana has quit IRC01:50
*** BadCub02 has quit IRC01:51
*** emagana has joined #openstack-infra01:52
zxiiroWith JJB is it possible to set the JDK used by the build? I can't find any docs on how to do so except one which lets you configure it for the sonar plugin, i want to set it job wide.01:53
*** emagana has quit IRC01:56
*** mtanino has quit IRC02:05
*** dims has quit IRC02:06
*** dims has joined #openstack-infra02:06
*** sarob has joined #openstack-infra02:06
heyonglijogo,  the blueprints for the third-party CI pci test cases is sent out:  https://review.openstack.org/#/c/141270/02:07
*** gyee has quit IRC02:09
*** yaguang has quit IRC02:10
*** yaguang has joined #openstack-infra02:11
*** dims has quit IRC02:11
*** shashankhegde has quit IRC02:13
*** spzala has joined #openstack-infra02:14
*** oomichi has quit IRC02:16
*** dhp_ has joined #openstack-infra02:18
*** dhp has quit IRC02:19
*** dhp_ is now known as dhp02:19
*** ryanpetrello has quit IRC02:19
*** sarob has quit IRC02:19
*** adalbas has quit IRC02:19
*** camunoz has quit IRC02:26
*** zz_avozza is now known as avozza02:27
*** yaguang has quit IRC02:29
*** annegent_ has joined #openstack-infra02:29
*** yaguang has joined #openstack-infra02:31
*** annegent_ has quit IRC02:34
*** melwitt has quit IRC02:34
*** teran has joined #openstack-infra02:37
*** avozza is now known as zz_avozza02:38
*** camunoz has joined #openstack-infra02:39
*** zxiiro has quit IRC02:40
*** teran has quit IRC02:41
*** Ryan_Lane has quit IRC02:42
*** emagana has joined #openstack-infra02:43
*** ivar-laz_ has joined #openstack-infra02:45
*** whayutin_ has quit IRC02:46
*** emagana has quit IRC02:48
*** wuhg has joined #openstack-infra02:48
*** zxiiro has joined #openstack-infra02:48
*** ivar-lazzaro has quit IRC02:49
*** emagana has joined #openstack-infra02:50
*** jaypipes has joined #openstack-infra02:50
*** mriedem has quit IRC02:51
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Update TODO file  https://review.openstack.org/14196502:51
*** koolhead17 has joined #openstack-infra02:53
*** emagana has quit IRC02:54
*** dims has joined #openstack-infra02:59
*** KanagarajM has joined #openstack-infra02:59
*** mmaglana has joined #openstack-infra03:01
*** otter768 has joined #openstack-infra03:01
*** Masahiro has quit IRC03:02
*** Masahiro has joined #openstack-infra03:02
*** annegent_ has joined #openstack-infra03:03
*** koolhead17 has quit IRC03:03
*** jyuso has quit IRC03:03
*** annegent_ has quit IRC03:05
*** mmaglana has quit IRC03:05
*** otter768 has quit IRC03:06
*** signed8bit has joined #openstack-infra03:08
*** rwsu has quit IRC03:09
*** patrickeast has quit IRC03:13
*** signed8bit has quit IRC03:21
*** koolhead17 has joined #openstack-infra03:23
*** koolhead17 has joined #openstack-infra03:23
*** fandi has quit IRC03:25
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add a contributing file  https://review.openstack.org/14196803:25
*** sabeen3 has quit IRC03:26
*** zz_avozza is now known as avozza03:30
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add --average option to sql2subunit cli  https://review.openstack.org/13211903:31
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Update TODO file  https://review.openstack.org/14196503:31
*** mmaglana has joined #openstack-infra03:32
*** boris-42 has quit IRC03:33
*** KanagarajM has quit IRC03:33
*** jyuso has joined #openstack-infra03:33
*** teran has joined #openstack-infra03:37
*** avozza is now known as zz_avozza03:40
*** emagana has joined #openstack-infra03:41
*** teran has quit IRC03:42
*** mbacchi has quit IRC03:43
*** zz_sabari is now known as sabari03:46
*** dims has quit IRC03:49
*** marun has quit IRC03:52
*** oomichi has joined #openstack-infra03:53
*** oomichi has quit IRC03:54
*** signed8bit has joined #openstack-infra04:00
*** liusheng has quit IRC04:00
*** liusheng has joined #openstack-infra04:01
*** signed8bit has quit IRC04:01
*** funzo has quit IRC04:04
*** funzo has joined #openstack-infra04:05
*** radez is now known as radez_g0n304:06
*** armax has joined #openstack-infra04:08
*** ivar-laz_ has quit IRC04:17
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add a contributing file  https://review.openstack.org/14196804:19
openstackgerritMatthew Treinish proposed openstack-infra/elastic-recheck: Update wording in the CONTRIBUTING.rst file  https://review.openstack.org/14197804:19
*** mmaglana has left #openstack-infra04:21
jogomtreinish: do you know why we are still seeign the SQLA error in the gate? http://logs.openstack.org/34/141834/1/gate//gate-grenade-dsvm/26b0e6b//logs/old/screen-s-proxy.txt.gz04:21
*** sabari is now known as zz_sabari04:29
*** zz_avozza is now known as avozza04:31
*** zz_dimtruck has quit IRC04:35
*** lbragstad has quit IRC04:35
*** baoli has quit IRC04:35
*** vishy has quit IRC04:35
*** wuhg has quit IRC04:36
*** jraim_ has quit IRC04:36
*** sileht has quit IRC04:36
*** fungi has quit IRC04:36
*** Kiall has quit IRC04:36
*** gus has quit IRC04:36
*** Kiall has joined #openstack-infra04:37
*** wuhg has joined #openstack-infra04:38
*** zz_dimtruck has joined #openstack-infra04:38
*** teran has joined #openstack-infra04:38
*** lbragstad has joined #openstack-infra04:38
*** jraim has joined #openstack-infra04:38
*** zz_dimtruck is now known as dimtruck04:38
*** gus has joined #openstack-infra04:39
*** sileht has joined #openstack-infra04:40
*** vishy has joined #openstack-infra04:40
*** fungi has joined #openstack-infra04:40
*** avozza is now known as zz_avozza04:41
*** koolhead_ has joined #openstack-infra04:43
*** teran has quit IRC04:43
*** yfried|afk is now known as yfried04:43
*** koolhead17 has quit IRC04:44
*** melwitt has joined #openstack-infra04:52
*** ayoung has quit IRC04:52
*** yfried is now known as yfried|afk04:56
*** gnuoy has quit IRC05:00
*** jamespage has quit IRC05:00
*** gnuoy has joined #openstack-infra05:01
*** jamespage has joined #openstack-infra05:01
*** yaguang has quit IRC05:02
*** achanda has joined #openstack-infra05:02
*** otter768 has joined #openstack-infra05:02
*** yaguang has joined #openstack-infra05:03
*** hdd has joined #openstack-infra05:03
*** shashankhegde has joined #openstack-infra05:05
*** otter768 has quit IRC05:07
*** sarob has joined #openstack-infra05:08
*** yfried|afk is now known as yfried05:12
*** talluri has joined #openstack-infra05:13
*** yfried is now known as yfried|afk05:25
*** reed has quit IRC05:25
*** reed has joined #openstack-infra05:28
*** yfried|afk is now known as yfried05:28
*** hdd has quit IRC05:31
*** zz_avozza is now known as avozza05:32
*** shashankhegde has quit IRC05:34
*** nelsnelson has quit IRC05:35
*** oomichi has joined #openstack-infra05:38
*** teran has joined #openstack-infra05:39
*** avozza is now known as zz_avozza05:41
*** harlowja is now known as harlowja_away05:42
*** asettle has quit IRC05:43
*** teran has quit IRC05:44
*** yfried has quit IRC05:49
*** sarob has quit IRC05:52
*** achanda has quit IRC05:53
*** teran has joined #openstack-infra05:58
*** boris-42 has joined #openstack-infra05:59
*** sarob has joined #openstack-infra05:59
*** oomichi has quit IRC06:02
*** nikil22 has joined #openstack-infra06:03
*** achanda has joined #openstack-infra06:03
*** bradjones has quit IRC06:07
*** bradjones has joined #openstack-infra06:10
*** vigneshvar has joined #openstack-infra06:12
*** dannywilson has joined #openstack-infra06:14
*** ZZelle has joined #openstack-infra06:17
*** rmcall has joined #openstack-infra06:19
*** mrmartin has joined #openstack-infra06:22
*** emagana has quit IRC06:23
*** rmcall has quit IRC06:24
*** rmcall has joined #openstack-infra06:25
*** dannywilson has quit IRC06:27
*** dannywilson has joined #openstack-infra06:28
*** vigneshvar has quit IRC06:28
*** dannywilson has quit IRC06:32
*** bradjones has quit IRC06:35
*** reed has quit IRC06:35
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Push dg-tempest-dsvm-full logs to swift  https://review.openstack.org/14166806:37
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Rename zuul-swift-upload jobs to use hypens  https://review.openstack.org/14194206:37
*** nuritv has joined #openstack-infra06:41
*** zz_avozza is now known as avozza06:41
*** shashankhegde has joined #openstack-infra06:41
*** wenlock has joined #openstack-infra06:41
*** stevemar has quit IRC06:46
*** zz_sabari is now known as sabari06:48
*** wenlock has quit IRC06:53
*** vigneshvar has joined #openstack-infra06:54
*** yfried has joined #openstack-infra06:54
*** emagana has joined #openstack-infra06:54
*** tnovacik has joined #openstack-infra06:56
*** emagana has quit IRC06:58
*** rmcall has quit IRC07:01
*** jamielennox is now known as jamielennox|away07:01
nikil22hi in CI system. the devstack-gate has a function called pre_test_hook. So is this the proper place to enable few drivers and then start the devstack instllation . Like i want to change the default neutron driver to different one in neutron.conf07:03
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules  https://review.openstack.org/14047007:03
*** otter768 has joined #openstack-infra07:03
*** shashankhegde has quit IRC07:03
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Check that Gerrit ACL files are normalized  https://review.openstack.org/14082107:04
*** sarob has quit IRC07:06
*** yamamoto has quit IRC07:06
*** yolanda has joined #openstack-infra07:07
*** otter768 has quit IRC07:08
*** avozza is now known as zz_avozza07:08
*** yolanda has quit IRC07:10
*** achanda has quit IRC07:10
*** _nadya_ has joined #openstack-infra07:11
*** achanda has joined #openstack-infra07:11
*** teran has quit IRC07:12
*** wenlock has joined #openstack-infra07:15
*** achanda has quit IRC07:16
*** cnesa has joined #openstack-infra07:16
*** pcaruana has joined #openstack-infra07:18
*** ZZelle has quit IRC07:22
*** tnovacik has quit IRC07:24
*** Longgeek has joined #openstack-infra07:24
*** e0ne has joined #openstack-infra07:26
*** sweston is now known as sweston_away07:27
*** koolhead_ has quit IRC07:30
*** achanda has joined #openstack-infra07:34
*** teran has joined #openstack-infra07:34
*** yamamoto has joined #openstack-infra07:35
e0nehi all. does anybody know why almost all check-grenade-dsvm faield on gates?07:36
openstackgerritMerged openstack-infra/project-config: Run acceptance tests without rake  https://review.openstack.org/14172807:38
*** nuritv has quit IRC07:38
*** Nuritv_ has joined #openstack-infra07:39
*** HeOS has quit IRC07:39
*** teran has quit IRC07:39
*** Nuritv_ is now known as nuritv07:40
*** Murad_ has joined #openstack-infra07:41
Murad_how to prevent keyboard from posting back to gerrit?07:41
*** belmoreira has joined #openstack-infra07:43
AJaegere0ne, see the mail "oslo.db 1.2.1 release coming to fix stable/juno" on openstack-dev07:44
e0neAJaeger: but i'm looking on master07:45
AJaegere0ne, grenade does update testing from juno to master...07:45
e0neAJaeger: oh, thanks!07:46
AJaegere0ne, so have patience until this problem got fixed, please07:46
*** e0ne has quit IRC07:51
*** liusheng has quit IRC07:51
*** jyuso has quit IRC07:52
*** liusheng has joined #openstack-infra07:52
*** Guest24100 has joined #openstack-infra07:54
*** emagana has joined #openstack-infra07:55
*** jyuso has joined #openstack-infra07:57
*** yamamoto has quit IRC07:58
wuhghttp://status.openstack.org/elastic-recheck/#1402747   is the cause of  http://logs.openstack.org/50/118450/11/check//check-grenade-dsvm/6c0b211/ failure?07:58
*** jpich has joined #openstack-infra07:58
*** emagana has quit IRC07:59
wuhgoh, so many check-grenade-dsvm failure ,07:59
wuhgi guess http://status.openstack.org/elastic-recheck/#1402747  is the problem08:00
*** wenlock has quit IRC08:01
AJaegerwuhg, in fixing the setuptools 8 failures, the team encountered a couple of other problems and fixed them...08:01
AJaegerwuhg, see the mail "oslo.db 1.2.1 release coming to fix stable/juno" on openstack-dev08:01
*** sarob has joined #openstack-infra08:01
wuhgAJaeger: ok ,thanks08:01
anteayaMurad_: are you attending the third-party meeting?08:02
Murad_yes, is the channel openstack-meeting?08:02
nikil22anteaya : may i know when is third-party meeting time and channel ?08:03
anteayaMurad_: yes08:03
Murad_I don't see anybody there08:03
anteayanikil22: in #openstack-meeting right now08:03
anteayaMurad_: in #openstack-meeting08:03
Murad_now I see, it seems that it was frozen08:04
anteayanikil22: I don't see your nick in #openstack-meeting, can you find the channel?08:05
*** yamamoto has joined #openstack-infra08:06
*** Murad_ has quit IRC08:06
*** achanda has quit IRC08:08
*** zz_avozza is now known as avozza08:09
*** yamamoto has quit IRC08:10
*** achanda has joined #openstack-infra08:15
*** yamamoto has joined #openstack-infra08:15
*** amuller has joined #openstack-infra08:15
*** mrunge has joined #openstack-infra08:19
*** yamamoto has quit IRC08:20
*** yamamoto has joined #openstack-infra08:21
*** melwitt has quit IRC08:23
*** yamamoto has quit IRC08:25
*** teran has joined #openstack-infra08:29
*** ala_ has joined #openstack-infra08:31
nikil22anteanya: thanks i was afk08:32
*** cnesa has quit IRC08:32
*** arxcruz has joined #openstack-infra08:33
*** ZZelle__ is now known as ZZelle08:35
*** bmwiedemann has joined #openstack-infra08:38
*** Krast has joined #openstack-infra08:42
*** k4n0 has joined #openstack-infra08:47
*** liusheng has quit IRC08:48
*** che-arne|2 has quit IRC08:49
*** liusheng has joined #openstack-infra08:49
*** Longgeek has quit IRC08:49
*** Longgeek has joined #openstack-infra08:50
*** smcginnis_ has joined #openstack-infra08:51
*** jcoufal has joined #openstack-infra08:51
*** cnesa has joined #openstack-infra08:52
*** armax has quit IRC08:53
*** emagana has joined #openstack-infra08:55
*** HeOS has joined #openstack-infra08:56
*** emagana has quit IRC09:00
*** sarob has quit IRC09:00
*** jgallard_ has joined #openstack-infra09:00
*** skolekonov has joined #openstack-infra09:01
*** yamamoto has joined #openstack-infra09:01
*** fandi has joined #openstack-infra09:03
*** BobBall_AWOL is now known as BobBall09:03
*** otter768 has joined #openstack-infra09:04
*** koolhead17 has joined #openstack-infra09:04
*** koolhead17 has joined #openstack-infra09:04
*** zz_johnthetubagu is now known as johnthetubaguy09:05
*** yamamoto has quit IRC09:06
anteayajhesketh: thanks for the hyphens09:07
*** sabari is now known as zz_sabari09:07
*** otter768 has quit IRC09:08
*** koolhead17 has quit IRC09:09
*** derekh has joined #openstack-infra09:10
anteayajhesketh: do you see 141942 in the gate?09:10
anteayaI just approved it yet I don't see it in status.o.o09:10
anteayathere it is09:12
anteayamore sleep for me, g'night again09:14
*** koolhead17 has joined #openstack-infra09:17
*** koolhead17 has joined #openstack-infra09:17
openstackgerritMerged openstack-infra/project-config: Rename zuul-swift-upload jobs to use hypens  https://review.openstack.org/14194209:20
openstackgerritMerged openstack-infra/project-config: Push dg-tempest-dsvm-full logs to swift  https://review.openstack.org/14166809:21
*** jlibosva has joined #openstack-infra09:22
*** dizquierdo has joined #openstack-infra09:26
*** mpaolino has joined #openstack-infra09:27
*** MaxV has joined #openstack-infra09:29
*** achanda has quit IRC09:32
*** andreaf has joined #openstack-infra09:32
*** achanda has joined #openstack-infra09:32
*** dtantsur|afk is now known as dtantsur09:33
*** sandywalsh has joined #openstack-infra09:34
*** sandywalsh_ has quit IRC09:36
*** achanda has quit IRC09:37
*** smcginnis_ has quit IRC09:38
*** achanda has joined #openstack-infra09:41
*** ociuhandu has quit IRC09:41
*** achanda has quit IRC09:44
*** mtanino has joined #openstack-infra09:44
*** achanda has joined #openstack-infra09:44
nikil22hi is there any way to extend the localrc file from devstack-gate in CI system. Like the other parametes REPO, branch and other "post-config" should be appended to localrc file. Before executing stack.sh from devstack-gate09:45
*** _nadya_ has quit IRC09:46
*** achanda has quit IRC09:50
*** achanda has joined #openstack-infra09:50
*** mtanino is now known as mtanino_zzz09:54
*** e0ne has joined #openstack-infra09:55
*** emagana has joined #openstack-infra09:56
*** cody-somerville has quit IRC09:57
*** emagana has quit IRC10:01
*** luqas has quit IRC10:02
*** ihrachyshka has joined #openstack-infra10:04
*** ekarlso- has quit IRC10:07
*** ekarlso- has joined #openstack-infra10:07
*** Hal has joined #openstack-infra10:07
*** Hal is now known as Guest5138810:08
*** cody-somerville has joined #openstack-infra10:11
openstackgerritMoshe Levi proposed openstack-infra/project-config: Add networking-mlnx project to StackForge  https://review.openstack.org/14205410:13
*** jerryz has quit IRC10:14
*** jerryz has joined #openstack-infra10:14
openstackgerritMoshe Levi proposed openstack-infra/project-config: Add networking-mlnx project to StackForge  https://review.openstack.org/14205410:17
*** pelix has joined #openstack-infra10:20
*** andreaf has quit IRC10:21
*** fandi has quit IRC10:27
*** avozza is now known as zz_avozza10:29
*** e0ne has quit IRC10:34
*** e0ne has joined #openstack-infra10:38
*** rlandy has joined #openstack-infra10:40
*** achanda has quit IRC10:40
*** Roamer` has joined #openstack-infra10:40
Roamer`hi, uh, does anybody know why Jenkins keeps failing check-grenade-dsvm for https://review.openstack.org/#/c/139711 ? It says "HttpConnectionPool is full" creating the cirros image, xing-yang already issued a recheck, it failed again, elastic-recheck doesn't seem to have it.10:41
AJaegerRoamer`, see the mail "oslo.db 1.2.1 release coming to fix stable/juno" on openstack-dev10:43
*** liusheng has quit IRC10:44
*** liusheng has joined #openstack-infra10:45
*** che-arne has joined #openstack-infra10:46
*** garyk has joined #openstack-infra10:48
*** jp_at_hp has joined #openstack-infra10:50
*** jp_at_hp has quit IRC10:50
*** jp_at_hp has joined #openstack-infra10:50
*** unicell has quit IRC10:50
*** garyk has quit IRC10:53
*** unicell has joined #openstack-infra10:53
*** andreaf has joined #openstack-infra10:53
*** zz_avozza is now known as avozza10:55
*** ociuhandu has joined #openstack-infra10:56
*** luqas has joined #openstack-infra10:56
*** emagana has joined #openstack-infra10:57
*** jgallard_ has quit IRC10:57
*** ZZelle has quit IRC10:58
*** ZZelle has joined #openstack-infra10:58
*** emagana has quit IRC11:01
Roamer`AJaeger, ah, right, I'd completely missed the exception higher up in the log.  Thanks!11:02
*** otter768 has joined #openstack-infra11:05
*** adalbas has joined #openstack-infra11:06
*** yfried is now known as yfried|afk11:06
*** koolhead17 has quit IRC11:07
*** e0ne has quit IRC11:09
*** otter768 has quit IRC11:10
*** yfried|afk is now known as yfried11:15
*** bradjones has joined #openstack-infra11:15
*** cdent has joined #openstack-infra11:22
*** Masahiro has quit IRC11:23
*** e0ne has joined #openstack-infra11:24
*** sputnik13 has joined #openstack-infra11:24
*** pc_m has joined #openstack-infra11:27
*** aysyd has joined #openstack-infra11:32
*** masayukig has quit IRC11:33
*** jokke_ has joined #openstack-infra11:35
jokke_Hi11:35
jokke_Anyone here able to help with the grenade test failing due the sqlalchemy versioning issue?11:36
jokke_We're trying to sync global-requirements to Glance, but looks like the grenade old fails due to version mismatch11:37
*** marcusvrn has quit IRC11:38
*** Masahiro has joined #openstack-infra11:39
*** masayukig has joined #openstack-infra11:39
*** berendt has joined #openstack-infra11:41
*** marcusvrn has joined #openstack-infra11:42
openstackgerritChristian Berendt proposed openstack/requirements: Bump version of openstack-doc-tools >= 0.21  https://review.openstack.org/14207611:44
openstackgerritDerek Higgins proposed openstack-infra/system-config: Increase max-servers for rh1  https://review.openstack.org/14207711:44
AJaegerjokke_, see the mail "oslo.db 1.2.1 release coming to fix stable/juno" on openstack-dev11:51
*** teran has quit IRC11:56
*** emagana has joined #openstack-infra11:58
*** teran has joined #openstack-infra11:58
dhellmannAJaeger: thanks for pointing people to the ML12:00
AJaegerdhellmann, I feel like a bot ;)12:00
dhellmanncurrently rechecking https://review.openstack.org/#/c/141927/12:00
dhellmannAJaeger: haha12:00
sdaguedhellmann: https://review.openstack.org/#/c/142075/ - I think we can just reorder the upgrade as well12:01
AJaegerI was surprised to see all of 14927 failing ;(12:01
*** ddieterly has joined #openstack-infra12:02
dhellmannsdague: that "architectural flaw" is there because that's the only way the swift team would work with them, so at least put the blame on the right team, please12:02
*** emagana has quit IRC12:02
AJaeger;(12:02
dhellmannsdague: you missed the discussion with jogo and jeblair yesterday about changing grenade to install the services into separate virtualenvs for upgrade, and upgrading their dependencies, so we don't have the issue with versioning having to overlap -- jogo is going to produce a spec12:03
sdaguesure12:03
sdaguebut right now, no project with a grenade job has been able to merge code for ~20hrs12:04
*** yamamoto has joined #openstack-infra12:04
dhellmannthat's not ceilometer's fault12:04
dhellmannmy requirements change for sqlalchemy died on a glance error12:04
*** mpaolino has quit IRC12:04
sdagueyes12:05
*** jamespage_ has joined #openstack-infra12:05
sdaguebecause swift can't start12:05
sdaguebecause oslo.db12:05
sdaguebecause ceilometer12:05
dhellmannwell, it wasn't in an upgrade job that it failed12:05
dhellmannit failed in every dsvm job12:05
sdaguedhellmann: correct12:05
sdagueyes, go look at the logs12:05
*** jamespage_ has quit IRC12:05
AJaegersdague, if you have some time, could you review https://review.openstack.org/#/c/140470/ and https://review.openstack.org/#/c/140821/ to have the ACLs checking in project-config, please? Nothing urgent but something nice I'd like to push ;)12:06
AJaegerdhellmann, all the grenade ones fail12:06
sdagueAJaeger: right, but we're not actually talking about that12:06
dhellmannok, so then sdague's patch is necessary for the requirements change to even land?12:06
sdaguedhellmann: no, my patch won't let your patch land12:06
*** Masahiro has quit IRC12:07
*** dims has joined #openstack-infra12:07
sdagueyou have to also couple your patch with blocking all versions of oslo.db that have the new requirements definition12:07
sdaguemy patch will let us get by without your patch12:07
openstackgerritChristian Berendt proposed openstack/requirements: Bump version of openstack-doc-tools >= 0.21  https://review.openstack.org/14207612:08
Roamer`.wn12:08
Roamer`oops, sorry12:08
*** nfedotov has joined #openstack-infra12:09
*** yamamoto has quit IRC12:09
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: move oslo.version to attic  https://review.openstack.org/14181212:10
*** yamamoto has joined #openstack-infra12:10
*** yamamoto_ has joined #openstack-infra12:11
*** yamamoto has quit IRC12:11
*** marcusvrn has quit IRC12:11
jokke_AJaeger: got it ... thanks!12:11
*** marcusvrn has joined #openstack-infra12:11
*** jraim_ has joined #openstack-infra12:12
*** dougwig_ has joined #openstack-infra12:12
*** ihrachyshka has quit IRC12:12
*** erw_ has joined #openstack-infra12:13
*** jraim has quit IRC12:14
*** jraim_ is now known as jraim12:14
*** ala_ has quit IRC12:14
*** bmwiedemann has quit IRC12:14
*** dougwig has quit IRC12:14
*** erw has quit IRC12:14
*** bmwiedemann has joined #openstack-infra12:14
*** sileht has quit IRC12:14
*** luqas has quit IRC12:14
*** rlandy has quit IRC12:14
*** dougwig_ is now known as dougwig12:14
sdagueAJaeger: so if we send in the first one we get a new job, then we should recheck on the 2nd one?12:15
AJaegersdague, yeah, might be best12:15
sdagueok approving the first one12:15
AJaegerand the second one will fail for sure but is non-voting. To fix it, we need another normalizing: https://review.openstack.org/#/c/141860/12:16
AJaegersdague, thanks12:16
*** sileht has joined #openstack-infra12:16
*** garyk has joined #openstack-infra12:16
garykAJaeger: you around for a few questions?12:16
AJaegergaryk, 10 mins, then I have to leave12:17
*** EmilienM is now known as EmilienM|afk12:17
AJaegergaryk, so ask12:17
garykok. regarding https://review.openstack.org/140409. i have follows all of the instructions. i just need to make sure that there is the git history12:17
garykis that done on the git project that is created or via this patch set?12:17
*** talluri has quit IRC12:18
*** talluri has joined #openstack-infra12:18
AJaegergaryk, http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-project-list - you need to add upstream: URL to projects.yaml12:18
*** pcrews has quit IRC12:19
*** ihrachyshka has joined #openstack-infra12:19
garykAJaeger: brilliant! thanks!12:19
*** sputnik13 has quit IRC12:19
*** bcourt has joined #openstack-infra12:19
dimsAJaeger: you are fast! :)12:19
AJaegerdims, sometimes ;)12:19
*** kevinbenton has quit IRC12:20
*** Roamer` has quit IRC12:20
*** barnaby has quit IRC12:20
*** tsufiev has quit IRC12:20
*** pcrews has joined #openstack-infra12:20
*** Svedrin has quit IRC12:20
*** ala_ has joined #openstack-infra12:20
sdagueoh, this is wedged even further than I imagined because stable requirements allows olso.db 1.312:21
*** _nadya_ has joined #openstack-infra12:21
*** pelix has quit IRC12:22
*** ondergetekende has quit IRC12:22
openstackgerritgaryk proposed openstack-infra/project-config: Add VMware-NSX to StackForge  https://review.openstack.org/14040912:22
*** kevinbenton has joined #openstack-infra12:22
garykAJaeger: ^ (hope that I did it correctly)12:22
*** pelix has joined #openstack-infra12:22
AJaegergaryk, the url should be the one you import, you gave git://github.com/openstack/neutron.git which is the original12:23
openstackgerritMerged openstack-infra/elastic-recheck: Remove queries for closed bugs  https://review.openstack.org/14085812:23
AJaegeryou want to remove files from the repository first, so remove everything unrelated to VMware-NSX from neutron12:23
openstackgerritDoug Hellmann proposed openstack/requirements: Make SQLAlchemy settings compatible with Juno  https://review.openstack.org/14192712:23
AJaegergaryk, see some documentation in https://review.openstack.org/14117112:23
*** _nadya_ has quit IRC12:23
*** e0ne has quit IRC12:23
*** _nadya_ has joined #openstack-infra12:24
garykAJaeger: yes, we want to import the neutron.git porject. We want to make use of these files - there are files that will be copied from netron/plugins/vmware directoryt. maybe i do not understand12:24
*** baoli has joined #openstack-infra12:24
AJaegergaryk, you run "git filter-branch" and remove all files you do not want ot import first12:25
*** baoli has quit IRC12:25
AJaegergaryk, sorry, have to leave now, hope the reference in 141171 helps12:25
garykAJaeger: ok, will try that12:25
*** sputnik13 has joined #openstack-infra12:25
garykAJaeger: ok, thanks12:25
AJaegergaryk, don't import *all* of neutron, just those files and their history you need12:25
*** baoli has joined #openstack-infra12:25
dhellmannsdague: do you think there's a chance of landing a patch to disallow oslo.db 1.3 in stable/juno? I was planning to do that later, but if we need to do it earlier in the process...12:26
*** mtanino_zzz has quit IRC12:26
*** tsufiev has joined #openstack-infra12:26
*** amotoki has joined #openstack-infra12:26
*** rlandy has joined #openstack-infra12:27
sdagueyou'll have to do it in the same patch you did above12:28
dhellmannsdague: that patch is against master :-(12:28
sdagueyeh12:28
sdagueif you want to roll back sqla, you also have to roll back anything that requires a newer sqla12:28
sdaguewhich oslo.db does12:28
dhellmannyeah, I'm doing that in master -- you suggested we needed to do it in the stable branch, too12:29
sdagueyes12:29
dhellmannI can just go delete oslo.db 1.3 from pypi, but it12:29
sdaguefor the same reasons12:29
dhellmannok, I'm not sure I know how to patch 2 branches at once, is that possible?12:29
sdagueyou have to work up from oldest stable12:29
dhellmannor are you saying separate patches and I'm misunderstanding12:29
sdagueseparate patches12:30
dhellmannok12:30
*** yamamoto_ has quit IRC12:30
sdagueso here is the crux of this dragon in global requirements (though I don't understand it fully)12:30
sdaguewe are specifying 2 different allowed sqla versions12:30
sdague1 via gr12:30
sdague1 comes in with oslo.db, which is different12:31
dhellmannsdague: so https://review.openstack.org/#/c/141896/12:31
*** bmwiedemann has quit IRC12:31
sdaguesomething cares a lot about pkg_resource checking compatibility for all these things12:31
sdaguewhether or not the code's compatible12:31
sdagueso it explodes on module loads12:31
sdagueso swift can never start12:32
sdaguethus everything else falls down12:32
dhellmannpaste is loading entry points without turning off requirements checking12:32
garykdims: you have any idea how i do the git history part? i am not sure what i do after the git filter branch12:32
dstufftthat particular feature of pkg_resources is a pain in the ass12:32
dhellmanndstufft: could we change the default behavior?12:32
*** yamamoto has joined #openstack-infra12:33
dimsgaryk: one sec12:33
dstufftdhellmann: I'm half asleep but I think possibly yes? would need to talk to jason about it to see what he thought12:33
*** ondergetekende has joined #openstack-infra12:34
dhellmannsdague: I'm waiting to hear what you think of https://review.openstack.org/#/c/141896/2 as a way to pin oslo.db in stable before I approve it12:34
sdaguedhellmann: oh, sorry, still on first cup of coffee12:34
dhellmanndstufft: ok, let's have that conversation later12:34
dhellmannsdague: np, me, too12:34
dimsgaryk: start by browsing oslo-incubator/tools/graduate.sh, it shows you how to pull files selectively with their history12:34
dimsgaryk: you will need to modify it to fit your needs12:35
sdaguedhellmann: yeh that should help12:35
dhellmannok, approving12:35
sdagueI actually just stuck that into my grenade change - https://review.openstack.org/#/c/142075/2/prep-base,cm12:35
dhellmanncool12:36
dhellmannugh, the check queue is filling up already12:36
sdagueoh, and this isn't an issue for juno because oslo.db wasn't used in icehouse12:36
dhellmannright12:36
sdagueso this situation will get worse as more project branches use libraries12:37
sdaguebecause of subtle couplings like these12:37
*** kevinbenton has quit IRC12:37
dhellmannyeah, that was one reason we thought allowing grenade to update requirements would help12:37
garykdims: thanks12:37
*** yamamoto has quit IRC12:37
dhellmannand to maintain the ability to test as rolling updates, we were going to put each service in a venv so we could update them separately12:38
*** Svedrin has joined #openstack-infra12:38
dhellmannupgrading dependencies also protects us against similar version conflicts coming up in libs we don't control12:39
*** Guest51388 has quit IRC12:39
*** johnthetubaguy is now known as zz_johnthetubagu12:40
*** kevinbenton has joined #openstack-infra12:40
*** mase_x200 has joined #openstack-infra12:40
*** bmwiedemann has joined #openstack-infra12:40
* dhellmann goes to make a little breakfast while the tests run12:41
*** luqas has joined #openstack-infra12:41
*** yamamoto has joined #openstack-infra12:43
sdagueso.... we do upgrade dependencies12:43
* sdague is confused 12:43
*** yamamoto has quit IRC12:46
openstackgerritMerged openstack-infra/project-config: Add test for validating certain gerrit ACL rules  https://review.openstack.org/14047012:46
dhellmannsdague: ok, for some reason we thought otherwise yesterday and I don't know enough about grenade12:48
dhellmannhow is it that we have any 2 projects with conflicting requirements for sqlalchemy being installed? aren't we installing the apps from source after a requirements sync?12:49
openstackgerritgaryk proposed openstack-infra/project-config: Add VMware-NSX to StackForge  https://review.openstack.org/14040912:51
*** Guest51388 has joined #openstack-infra12:51
sdaguewe're installing applications12:52
sdaguelet me find you the line in the logs12:52
*** che-arne|2 has joined #openstack-infra12:54
garyksdague: you aware of the reason why grenade-dsvm fails? or maybe i should ask you this on the nova channel…12:54
*** yfried is now known as yfried|afk12:55
sdaguedhellmann: http://logs.openstack.org/26/125926/1/gate//gate-grenade-dsvm/7b736df//logs/grenade.sh.txt.gz#_2014-12-16_11_58_18_27412:55
sdagueso starting here is the first install12:55
dhellmanndoes grenade do a requirements sync before installing anything?12:55
dhellmannor that job, or whatever12:56
*** che-arne has quit IRC12:56
dhellmannI guess the other jobs fail with a similar error, so it's not just grenade12:56
sdagueit's done via the normal pip install -e DIR model12:56
sdagueyeh, so the crux of it is pip does a very odd thing with libraries12:56
dhellmannI thought our test jobs forced everything to have the same requirements when it was installing via src12:57
*** dprince has joined #openstack-infra12:57
sdaguedhellmann: yes, they get synced first12:57
sdaguelet me finish this, it might become clear12:57
dhellmannok12:57
*** weshay has joined #openstack-infra12:57
sdagueassuming foo 1.0 requires bar>1.312:57
sdagueand package 1.0 requires foo>=1.012:58
sdaguepip install package 1.0 gives you different results if bar was installed previously or not12:58
sdagueif bar is not installed, you get >1.312:58
sdagueif it was installed at 1.2, it doesn't touch the install12:59
*** yamamoto has joined #openstack-infra12:59
sdagueeven though it's wrong12:59
*** che-arne|2 has quit IRC12:59
*** che-arne has joined #openstack-infra12:59
*** che-arne|2 has joined #openstack-infra13:00
sdagueso all along we've been treating requirements as something which can be transitive, except python doesn't have an installer which can actually do transitive dependencies correctly13:00
sdagueso in this case, what's broken13:01
sdaguewhich you can see in the install path for keystone13:01
sdagueis that oslo.db gets installed after sqla13:01
sdaguesqla was satified fine by keystones definition13:01
sdaguepip sees that something called sqlalchemy exists, so assumes it's fine13:02
sdagueinstalls an oslo.db with a conflicting requirement13:02
sdaguepkg_resources some time in the far future is the first time the conflict is examined13:02
*** alexpilotti has joined #openstack-infra13:02
sdagueand explode13:02
dhellmannok, the source of the problem makes sense13:03
*** che-arne has quit IRC13:03
sdagueso, honestly, as long as pip remains broken like this, everything is a work around13:03
dhellmannexcept that keystone and oslo.db require the same version of sqla now, and if we're syncing requirements I would have thought all of the apps did (even if they haven't landed the patch to make it official: http://paste.openstack.org/show/151829/)13:03
*** ala_ has quit IRC13:04
sdaguedhellmann: where do they require the same version?13:04
dhellmannwould it make sense to remove sqlalchemy as a direct requirement in the projects and use the oslo.db dependency to get it?13:04
dhellmannsdague: the requirements on line 14 and 23 of that paste look the same to me, unless I'm missing a character13:04
dhellmannsorry, 1513:04
sdagueyeh, but that's overridden by global requirements13:05
sdagueduring install13:05
sdagueso what you actually want to compare is openstack/requirements vs. oslo.*13:05
dhellmannwhich has the same version: SQLAlchemy>=0.9.7,<=0.9.9913:05
*** _nadya_ has quit IRC13:05
sdaguenot in juno13:06
dhellmannthat was the whole point of this oslo.db release, to make its requirements match that list13:06
dhellmannok, but we're failing to install even in master13:06
*** otter768 has joined #openstack-infra13:06
*** doude has quit IRC13:06
sdaguedhellmann: only with your change to the requirements definition13:06
*** mfink has quit IRC13:06
*** alexpilotti_ has joined #openstack-infra13:06
dhellmannah, ok, I thought we were still having issues aside from that in master13:06
sdaguenot as far as I know13:07
*** mtanino has joined #openstack-infra13:07
*** dims has quit IRC13:07
*** alexpilotti has quit IRC13:07
*** alexpilotti_ is now known as alexpilotti13:07
*** doude has joined #openstack-infra13:07
*** yfried|afk is now known as yfried13:07
*** dims has joined #openstack-infra13:07
dhellmannyeah, aeromancer doesn't know how to look across branches, yet13:07
*** dkranz has joined #openstack-infra13:07
*** Masahiro has joined #openstack-infra13:07
*** hashar has joined #openstack-infra13:08
*** mbacchi has joined #openstack-infra13:08
sdagueso basically, keeping the projects in sync became way too many of these firedrills, which is why we kind of ignore the projects and just bludgeon in a uniform requirements version13:08
dhellmannis there some way to bump the jobs out of the gate queue that we know are going to fail?13:08
*** kedkul has joined #openstack-infra13:08
*** Ala has joined #openstack-infra13:09
sdagueupdate their commit message13:09
dhellmannright, I was confused because I was seeing the same error in my requirements job13:09
kedkulHi13:09
sdaguedhellmann: right, because it's the same pip failing13:09
dhellmannwe have a bunch of nova changes in the queue that we know are going to fail, can we bypass them somehow to get that juno requirements patch to land?13:09
*** e0ne has joined #openstack-infra13:09
dhellmannyeah, makes sense now13:10
sdaguedhellmann: update their commit message13:10
sdaguethen zuul throws them back into the check queue because it's a new change13:10
*** otter768 has quit IRC13:10
kedkulin my CI setup, after keystone startup using stack.sh, it is failing at project create,  user create13:11
kedkulthe command it tries to execute doesn't have some parameters13:11
kedkulfor ex. openstack project create admin --or-show -f value -c id13:11
*** kgiusti has joined #openstack-infra13:12
kedkulthe error it shown - openstack project create: error: unrecognized arguments: --or-show13:12
*** Masahiro has quit IRC13:12
sdaguekedkul: don't reuse your devstack nodes, openstackclient is at an old version I expect13:12
kedkulkind of same issue is happening for subsequent user create, role create13:12
kedkulok13:13
kedkulwhat do you mean by dont reuse devstack nodes13:13
kedkulcan you explain?13:13
sdaguekedkul: are you deleting the devstack vm after every CI run?13:14
kedkulno, we are using the same vms,13:14
sdagueright, that's the crux of the issue13:14
kedkulisn't there any fix that i don't have to rework on my CI setup?13:15
sdagueuninstall openstackclient13:15
kedkulis this issue resolvable by updating openstack client13:15
sdagueyes13:15
kedkulsdague: i will try that13:15
kedkulsdague: thanks for quick answer13:16
sdagueno prob13:16
gilliardsdague: so the patches with updated commit messages will need +1 workflow again?13:16
sdaguegilliard: yep13:16
sdaguegilliard: they'll also need passing test results13:16
gilliardsdague: thanks - just checking.13:16
gilliardof course ;)13:16
sdaguewhich they currently don't have :)13:16
sdaguewhich is why they are getting pulled13:17
gilliardyep - I've been following. Just wanted to check my understanding for the check/gate process.13:17
*** avozza is now known as zz_avozza13:17
gilliardI assume they had passing tests before they were +A anyway...13:18
sdagueyep13:18
*** Roamer` has joined #openstack-infra13:18
*** yfried_ has joined #openstack-infra13:19
gilliardYour explanation above about the transitive dependency mgmt makes me a sad panda.13:19
sdaguegilliard: me too13:19
*** yfried has quit IRC13:19
sdaguedhellmann: I kind of wonder if removing the SQLA from keystone would actually help... because the reason it's not upgrade it is there is a distro package13:20
sdaguewhich means we'd still explode later13:21
dhellmannsqla is being installed as a distro package?13:21
kedkulsdague: i assume you are pointing to python-keystoneclient, python-novaclient etc. am I right?13:21
sdagueyeh, it's dragged in via something in the base distro13:21
dhellmannsigh13:21
sdagueunless we do monty's crazy patch of installing python from source13:22
sdaguewe're going to have some stuff there13:22
*** berendt has quit IRC13:22
*** bswartz has quit IRC13:23
sdaguethe reality is, also, doing venvs for all this stuff basically only gets around it by the fact that we're installing the whole world at once. The libraries still can cause the same kind of issues here (like if alembic requires a thing that's incompatible with oslo.db)13:23
sdaguedhellmann: if you are pulling stuff out, the swift and neutron changes are also going to fail13:25
*** e0ne is now known as e0ne_13:25
*** mase_x200 has quit IRC13:27
*** EmilienM|afk is now known as EmilienM13:28
sdaguedstufft: so, seriously, the lack of dependency solver in pip continues to cause us no end of pain. Is that on your horizon some where?13:29
*** yfried_ has quit IRC13:29
*** sweston_away has quit IRC13:31
*** doude has quit IRC13:31
*** mase_x200 has joined #openstack-infra13:31
*** doude has joined #openstack-infra13:31
*** amuller is now known as amuller_afk13:32
*** amuller_afk is now known as amuller_meeting13:32
*** lifeless_ has joined #openstack-infra13:33
*** mfink has joined #openstack-infra13:33
*** sweston_away has joined #openstack-infra13:34
*** sweston_away is now known as sweston13:35
dhellmannsdague: I kicked the swift one, but my requirements change is #2 now behind dib so I think it's good13:35
* dhellmann takes advantage of a break in the rain to go to the bakery 13:35
*** lifeless has quit IRC13:35
*** sputnik13 has quit IRC13:35
*** dtantsur is now known as dtantsur|brb13:35
*** e0ne_ has quit IRC13:35
*** jgallard_ has joined #openstack-infra13:38
sdagueyeh13:38
*** mrmartin has quit IRC13:41
*** sputnik13 has joined #openstack-infra13:41
*** sputnik13 has quit IRC13:41
*** ddieterly has quit IRC13:42
*** vigneshvar has quit IRC13:42
nikil22hi if there is any code submitted the jenkins CI will run only tempest? will this also run unit tests13:44
kedkulit will run unit tests also13:44
*** mrmartin has joined #openstack-infra13:47
*** e0ne has joined #openstack-infra13:48
*** julim has joined #openstack-infra13:49
openstackgerritJames Polley proposed stackforge/gertty: Add detailed examples and dashboards a la gerrit  https://review.openstack.org/14210813:49
tchaypoyes, yes he did.13:49
*** mrmartin has quit IRC13:49
nikil22kedkul: could you please point me some unit test job's. Because i have seen under "https://github.com/openstack-infra/project-config/tree/master/jenkins/jobs" and i gues its all related to tempest13:54
*** mtanino has quit IRC13:56
*** hdd has joined #openstack-infra13:56
openstackgerritSean Dague proposed openstack-infra/devstack-gate: disable ceilometer in grenade runs  https://review.openstack.org/13852813:57
*** bswartz has joined #openstack-infra13:57
openstackgerritSean Dague proposed openstack-infra/devstack-gate: disable ceilometer in grenade runs  https://review.openstack.org/13852813:58
*** emagana has joined #openstack-infra13:59
*** markmcclain has joined #openstack-infra13:59
*** mpaolino has joined #openstack-infra14:01
*** bradjones has quit IRC14:01
*** zz_johnthetubagu is now known as johnthetubaguy14:02
* dhellmann returns14:02
nikil22kedkul: ok i see unit test jobs also in same repo. thanks14:03
*** mrunge is now known as mrunge_gone14:03
*** emagana has quit IRC14:04
*** bradjones has joined #openstack-infra14:04
*** signed8bit has joined #openstack-infra14:05
*** _nadya_ has joined #openstack-infra14:05
*** signed8bit has quit IRC14:09
*** signed8bit has joined #openstack-infra14:11
*** mase_x200 has quit IRC14:14
*** emagana has joined #openstack-infra14:14
*** doug-fish has joined #openstack-infra14:15
*** wznoinsk_ has joined #openstack-infra14:17
*** wznoinsk_ has quit IRC14:17
*** dustins has joined #openstack-infra14:18
nikil22hi i did not find the jenkins job "gate-neutron-python27" in project-config repo. will this unit job be in a different place?14:19
*** jseiler_ has joined #openstack-infra14:20
*** signed8bit has quit IRC14:20
*** signed8bit has joined #openstack-infra14:21
*** koolhead17 has joined #openstack-infra14:22
*** koolhead17 has joined #openstack-infra14:22
*** mtreinish_ has joined #openstack-infra14:22
*** pelix1 has joined #openstack-infra14:23
*** pelix has quit IRC14:23
*** emagana has quit IRC14:23
*** marcusvrn1 has joined #openstack-infra14:25
*** jeblair_ has joined #openstack-infra14:25
*** changbl has quit IRC14:25
*** ddieterly has joined #openstack-infra14:26
*** mriedem has joined #openstack-infra14:27
*** xyang1 has joined #openstack-infra14:27
*** mwhudson_ has joined #openstack-infra14:27
*** HenryG_ has joined #openstack-infra14:28
*** marcusvrn has quit IRC14:30
*** k4n0 has quit IRC14:30
*** arxcruz has quit IRC14:30
*** jpich has quit IRC14:30
*** jseiler has quit IRC14:30
*** uvirtbot has quit IRC14:30
*** HenryG has quit IRC14:30
*** mtreinish has quit IRC14:30
*** jeblair has quit IRC14:30
*** juice has quit IRC14:30
*** mrodden has quit IRC14:30
*** ianw has quit IRC14:30
*** mwhudson has quit IRC14:30
*** mtreinish_ is now known as mtreinish14:30
*** juice_ has joined #openstack-infra14:30
*** juice_ is now known as juice14:30
*** ianw has joined #openstack-infra14:30
*** che-arne has joined #openstack-infra14:31
*** emagana has joined #openstack-infra14:31
*** che-arne|2 has quit IRC14:31
*** jerryz has quit IRC14:31
*** arxcruz has joined #openstack-infra14:31
*** k4n0 has joined #openstack-infra14:31
*** amuller_meeting is now known as amuller14:33
*** esker has joined #openstack-infra14:33
*** lttrl has joined #openstack-infra14:33
*** che-arne has quit IRC14:35
*** jpich has joined #openstack-infra14:36
mordredsdague: but venv-per-service or similar does get us out of caring from day to day14:37
sdaguemordred: so, honestly, it really doesn't14:37
mordredreally?14:37
sdagueit just masks it14:37
mordredsure. it masks it. but it in and of itself is not actually important14:38
mordredit's important for single-machine continuous delivery systems14:38
sdagueso all that venv-per-service does it basically set the minimums in requirements to the current releases14:38
*** sabeen1 has joined #openstack-infra14:38
mordredsorry - venv-per-service and no more global requirements sync in devstack14:38
sdaguesure14:38
mordredbecause doing just venv-per-service but still syncing is silly :)14:39
sdaguebut again, you'd get similar behavior if we set min == max more or less14:39
mordredit's possible we're talking about different "the problem"s14:39
sdaguethe crux of the problem that broke us for the last day is pip not resolving dependencies14:40
*** Masahiro has joined #openstack-infra14:40
sdaguewhich is made slightly harder by us having so many dependencies14:40
sdaguein system14:40
mordredAH - yes, thank you. I was still talking about upgrades in lockstep due to bad upstream upgrade paths14:40
sdagueright14:40
sdagueso, honestly, that's not really the problem14:41
mordredyou're right - your problem is not solved by venvs14:41
mordredyour problem is why distro packages were invented14:41
sdagueso, sorry, I had other duties last night so had about 5 minutes of context before I had to run14:41
mordredbecause apt and yum both handle this extremely well14:42
sdaguehowever, in looking through these failures, the venv model wouldn't have helped14:42
mordredagree14:42
*** tnovacik has joined #openstack-infra14:42
sdagueand while it will reduce our exposure to these failures, they'll still all be there, because pip is crazy pants when it comes to transitive dependencies14:42
dhellmannyeah, i think we misunderstood how grenade worked14:43
*** e0ne is now known as e0ne_14:43
*** jerryz has joined #openstack-infra14:44
dhellmannsdague: the juno patch merged, and I'm waiting for the master requirements patch to finish failing so I can make sure it only fails on oslo.db before rechecking14:44
mordredsdague: I don't REALLY want to suggest this next thing - but just for sake of completeness...14:44
*** Masahiro has quit IRC14:44
mordredsdague: should we entertain the idea of returning to creating distro packages for the gate?14:44
sdaguefor the entire python dependency chain?14:45
mordredyes14:45
sdagueoof14:45
mordredmost of them are likely able to be done completely automatically14:45
*** uvirtbot has joined #openstack-infra14:45
dhellmannfpm has a pretty nice "make a package from a setup.py" thing14:45
mordred(I'm not talking about debian policy compliant packages)14:45
mordredyah. something like that14:46
sdagueso that would be to bypass pip ?14:46
mordredexcept with a mechanism so that if there is a specific thing in the chain that needs an override, we can d it14:46
sdagueand have an actual dependency resolver14:46
*** mattfarina has joined #openstack-infra14:46
mordredyah14:46
sdagueso that's an option14:46
*** lttrl has quit IRC14:46
mordredit's how we started life :)14:46
dhellmannor we could go help fix the dependency resolver in pip14:46
sdagueif pip is never going to address this hole14:46
dhellmannnot sure which is simpler14:46
mordredI know dstufft _wants_ a dep solver14:46
mordredbut otoh, pure-python dep solvers aren't exactly growing on trees14:47
*** lttrl has joined #openstack-infra14:47
*** amitgandhinz has joined #openstack-infra14:47
mordredbut otoh, GOOD pure-python dep solvers aren't exactly growing on trees14:47
*** e0ne_ is now known as e0ne14:47
sdaguealso... we apparently found the slowest node in all of HP cloud to run this job on - https://jenkins01.openstack.org/job/check-grenade-dsvm-neutron/6758/console14:48
*** vhoward has joined #openstack-infra14:48
sdagueI'm going to be really interested in looking at those logs once it completes to figure out why14:48
sdagueok, biab14:49
*** dimtruck is now known as zz_dimtruck14:49
*** dtantsur|brb is now known as dtantsur14:50
fungiquiet morning so far14:51
*** kedkul has quit IRC14:53
*** yaguang has quit IRC14:53
*** lttrl has quit IRC14:53
*** ayoung has joined #openstack-infra14:53
gilliardjoin #openstack-meeting-314:55
* gilliard *sigh*14:55
*** dpaterson has joined #openstack-infra14:55
*** carl_baldwin has joined #openstack-infra14:56
*** jerryz has quit IRC14:56
*** mrodden has joined #openstack-infra14:57
*** jerryz has joined #openstack-infra14:57
*** che-arne has joined #openstack-infra14:57
mordredgilliard: not so much with that working :)14:58
*** dprince has quit IRC15:00
*** zz_dimtruck is now known as dimtruck15:00
*** dprince has joined #openstack-infra15:01
*** dmsimard_away is now known as dmsimard15:03
*** pblaho has joined #openstack-infra15:03
*** erikwilson has joined #openstack-infra15:03
*** erikwilson has quit IRC15:04
*** lttrl has joined #openstack-infra15:05
*** otter768 has joined #openstack-infra15:07
*** wenlock has joined #openstack-infra15:09
*** ddieterly has quit IRC15:09
*** dkranz has quit IRC15:10
*** ddieterly has joined #openstack-infra15:10
*** hdd has quit IRC15:11
*** tnovacik has quit IRC15:12
*** otter768 has quit IRC15:12
*** lttrl has quit IRC15:12
*** andreaf has quit IRC15:12
*** dustins has quit IRC15:13
*** lttrl has joined #openstack-infra15:13
*** dustins has joined #openstack-infra15:14
*** timcline has joined #openstack-infra15:15
*** timcline has quit IRC15:16
*** timcline has joined #openstack-infra15:16
*** nelsnelson has joined #openstack-infra15:17
openstackgerritThierry Carrez proposed openstack-infra/project-config: Generate tarballs for neutron-*aas on tags  https://review.openstack.org/14212615:17
ttxfungi: we'll need that one in before we start tagging tomorrow ^15:17
*** flaper87 has quit IRC15:18
*** flaper87 has joined #openstack-infra15:18
ttxalso, neutron-*aas has stable branches defined (probably a by-product of the git-filter) while they don't make sense there, would be better to just remove them.15:18
*** jcoufal_ has joined #openstack-infra15:19
*** wenlock has quit IRC15:19
fungittx: clarkb had lobbied pretty strongly to keep the branches for discoverability purposes, but maybe just tagging the tips with something instead and deleting the branches would be an acceptable compromise15:19
ttxfungi: yeah.. I just don't want people to get excited and propose changes there15:20
fungialso i thought there was already a change proposed to add the server release jobs to the neutron advanced services projects... double-checking real quick15:20
ttxsince stable/juno changes to fwaas should just be proposed to openstack/neutron15:20
fungittx: yep, i agree it could cause trouble15:20
fungii'll confirm with clarkb and we'll come up with a suitable tag pattern15:20
ttxnot sure I understand why you need to "discover" them, but can clarify with clarkb15:21
*** david-lyle has joined #openstack-infra15:21
fungiit was for purposes of being able to easily diff the kilo and juno versions of a file from one of the drivers, for example15:21
*** jcoufal has quit IRC15:21
ttxah. hmm, tags should work for that yes15:22
fungiagreed15:22
fungii would argue that the existing tags already cut from those branches would be suitable for that matter, but i'll get his input once he's around15:22
*** dkranz has joined #openstack-infra15:23
*** jp_at_hp has quit IRC15:23
*** jp_at_hp has joined #openstack-infra15:23
openstackgerritMerged openstack-infra/elastic-recheck: Update wording in the CONTRIBUTING.rst file  https://review.openstack.org/14197815:23
*** stevemar has joined #openstack-infra15:24
*** signed8bit has quit IRC15:24
*** signed8bit has joined #openstack-infra15:24
*** pelix1 has quit IRC15:25
*** pelix1 has joined #openstack-infra15:25
*** mriedem has quit IRC15:25
*** mriedem has joined #openstack-infra15:25
*** HenryG_ has quit IRC15:25
*** HenryG_ has joined #openstack-infra15:25
*** ianw has quit IRC15:25
*** ianw has joined #openstack-infra15:25
*** k4n0 has quit IRC15:25
*** k4n0 has joined #openstack-infra15:25
*** ayoung has quit IRC15:25
*** ayoung has joined #openstack-infra15:25
*** che-arne has quit IRC15:25
*** che-arne has joined #openstack-infra15:25
*** jcoufal_ has quit IRC15:26
*** jcoufal_ has joined #openstack-infra15:26
*** dkranz has quit IRC15:26
*** dkranz has joined #openstack-infra15:26
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add an AFS Git mirror for review-dev projects  https://review.openstack.org/14213015:28
fungiit _can't_ be as easy as that ^ so i'm sure i'm missing something (at a minimum i need to set afs acls to allow writes there)15:28
*** yamamoto has quit IRC15:28
*** yamamoto has joined #openstack-infra15:29
*** afazekas has joined #openstack-infra15:29
fungioh, spotted an error already15:29
*** afazekas is now known as afazekas_pto15:29
*** koolhead17 has quit IRC15:30
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add an AFS Git mirror for review-dev projects  https://review.openstack.org/14213015:30
mtreinishjogo: do you still need an answer to that? It's because of juno and the reqs set there15:30
*** rgerganov has joined #openstack-infra15:30
*** erlon has joined #openstack-infra15:32
rgerganovfungi: hi, I have replied to your question about the GAE on the mail list15:33
rgerganovfungi: let me know if you need more info15:33
*** mpaolino has quit IRC15:34
*** yamamoto has quit IRC15:36
clarkbfungi ttx yup mostly wanted to make sure we werent losing history on the assumption we dont need it today. tags are fine15:36
*** hdd has joined #openstack-infra15:38
*** jerryz has quit IRC15:39
*** wenlock has joined #openstack-infra15:40
*** emagana has quit IRC15:41
*** rgerganov has quit IRC15:41
*** pcaruana has quit IRC15:42
*** mpaolino has joined #openstack-infra15:43
*** erikwilson has joined #openstack-infra15:44
*** mpaolino has quit IRC15:44
*** erikwilson has quit IRC15:45
*** mpaolino has joined #openstack-infra15:45
*** nikil22 has quit IRC15:45
*** erikwilson has joined #openstack-infra15:46
clarkbwhat is wrong with the newer requirements in oslo.db?15:47
dhellmannclarkb: ?15:48
fungiclarkb: requirements integration tests are what's wrong15:48
clarkbreading scrollback15:48
clarkbsdague says "new oslo.db" requirements bad15:48
clarkbI think that means 1.3.015:49
*** carl_baldwin has quit IRC15:49
fungiclarkb: we want to release an oslo.db compatible with stable/juno's global-requirements.txt, so the sqla version specified in 1.3.0 needs to be rolled back first15:49
*** erikmwilson has quit IRC15:50
*** erikwilson is now known as erikmwilson15:50
openstackgerritMerged openstack-infra/jenkins-job-builder: deprecate postbuildscript onsuccess and onfailure parameter names  https://review.openstack.org/13925715:50
*** talluri has quit IRC15:50
clarkbbecause of how grenade tests? or because pinning oslo.db isnt working?15:50
*** erikwilson has joined #openstack-infra15:51
fungiclarkb: i believe where we got to was _before_ dropping sqla 0.8 support in oslo.db release one which has a requirements file compatible with setuptools 815:51
openstackgerritThierry Carrez proposed openstack-infra/project-config: Generate tarballs for neutron-*aas on tags  https://review.openstack.org/14212615:51
ttxsorry about that ^ -- missed the merge-tags job definition15:52
*** david-lyle has quit IRC15:52
fungiso roll back to the current stable/juno sqlalchemy requirement, cut a new oslo.db 1.4.0 with that, then drop sqlalchemy 0.8 support in master and pin stable/juno's oslo.db requirement <1.515:52
clarkbfungi: gotcha15:53
fungibecause the only reason 1.3.0 was incompatible with stable/juno was that we "ostensibly" dropped sqlalchemy 0.8 support some people might still be using15:53
garykAJaeger: you around?15:54
clarkbhowever the requirements do overlap so I don't think that should be a problem15:55
clarkbeg we didn't remove an upgrade path for anyone15:55
sdagueclarkb: just got back from errand, here is the bullet points15:55
sdaguethe requirements overlap isn't actually required15:55
fungittx: aha, i missed that we didn't put merge-tags in the server-release-jobs template15:56
fungigood catch15:56
sdagueunless we want to support running new swift with old ceilometer installed into it's pipeline (like we've been doing on grenade upgrade tests forever by accident)15:56
ttxfungi: well, the test caught it for me. Nice one.15:56
*** reed has joined #openstack-infra15:57
fungioh, hah15:57
sdaguewe do need everything that's going to install in a branch to have roughly the same requirements15:57
clarkbsdague: right (we have discussed this before and I was strongly on not bothering with that but everyone else thought it was important)15:57
*** achanda has joined #openstack-infra15:57
sdagueclarkb: so we were arguing slightly different things15:57
sdagueI still think services should be able to upgrade one at a time, right now ceilometer is the only thing which violates that15:58
fungittx: actually, i think it's the other way around... the jenkins job template for {name}-merge-release-tags needs to be instantiated in jenkins/jobs/projects.yaml15:58
sdaguehttps://review.openstack.org/#/c/142075/ changes upgrade order accordingly15:58
sdaguewith a bug reference15:58
clarkbsdague: so how is oslo.db 1.3.0 whihc is a "kilo" release dropping sqlalchemy 0.8 a problem for juno which allows 0.8 and 0.9?15:59
*** dustins has quit IRC15:59
clarkbsdague: when kil should use 1.2.1 of oslo.db that allows oth 0.8 and 0.9?15:59
sdaguebecause juno allowed oslo db15:59
sdague1.315:59
fungiclarkb: because we still need some way to backport a fix for this to something before 1.3 if we cap it <1.3 in stable/juno16:00
*** markmcclain has quit IRC16:00
clarkbbut we were going to pin oslo.db16:00
sdaguewhich apparently didn't happen16:00
clarkbfungi: not really since we are currently oeprating in weird realm of setuptools 716:00
*** dustins has joined #openstack-infra16:00
fungiclarkb: right, but our branching ideas fell short without significant rework on how we test those library backport branches16:00
jeblair_i am told the oslo.db pin didn't happen because of the grenade failure16:01
sdagueuntil this morning when dhellmann pushed it16:01
sdagueno, it passed grenade16:01
sdagueI don't know why it didn't happen, but it was outstanding until this morning16:01
*** emagana has joined #openstack-infra16:01
jeblair_well that changes a lot :)16:02
sdaguehttps://review.openstack.org/#/c/141896/16:02
jeblair_oh, so why wasn't that cap <1.1 ?16:03
ttxfungi: ah, oops.16:03
jeblair_because of grenade, right?16:03
sdaguethe grenade change provides some equivalent cushion, plus after filing the bug on ceilometer around it, cdent is going to look into reviving a spec16:03
*** bhunter71 has joined #openstack-infra16:04
sdaguejeblair_: I don't know16:04
dkranzsdague: Is there some known failures happening a lot with jobs  failing all juno + check-grenade-dsvm + check-grenade-dsvm-partial-ncpu16:04
sdaguedkranz: yes, see *ALL* of the last 4 hrs of backlog here16:04
fungii thought capping <1.1 when master requires newer than 1.1 was identified as something which wouldn't pass grenade?16:04
openstackgerritThierry Carrez proposed openstack-infra/project-config: Generate tarballs for neutron-*aas on tags  https://review.openstack.org/14212616:04
dkranzsdague: ok16:04
ttxfungi: that should do it ^16:05
*** isviridov is now known as isviridov_away16:05
jeblair_that was our understanding yesterday, but now that sdague is around perhaps that is changing?16:05
dhellmannfungi: it may pass grenade, it won't pass our requirements check that explicitly looks for overlapping ranges16:05
*** achanda has quit IRC16:05
fungidhellmann: oh, right, i forgot we have that too. maybe that's just a bad idea in general?16:05
dhellmannjeblair_: after we tag oslo.db 1.4 I planned to land https://review.openstack.org/#/c/142131/16:05
dhellmannfungi: yeah, I'm not sure why we think we need that16:05
sdagueso... without https://review.openstack.org/#/c/142075/ (which just merged) that might have been true16:05
sdaguebecause ceilometer16:06
dhellmannI don't understand all of the requirements that led to what we have now16:06
dhellmannsdague: do you mean because of ceilometer & swift?16:06
sdaguedhellmann: yep16:06
dhellmannok, well, if we're pointing fingers let's point them in the right direction16:06
fungidhellmann: oh, so part of the reason we implemented that check is that if you approve a change in requirements with no overlap from its previous value, then it trashes everything being tested behind it16:06
AJaegergaryk, I'll be around again in two hours or so...16:07
dhellmannfungi: behind it in the gate?16:07
sdaguefungi: though that's not true any more right16:08
fungidhellmann: right, i'm now trying to remember the reasons why that happens16:08
sdaguebecause the mirror used to be controlled via g-r16:08
jeblair_https://bugs.launchpad.net/openstack-ci/+bug/127473116:08
uvirtbotLaunchpad bug 1274731 in openstack-ci "non overalapping change to requirements repo broke gate" [Medium,Confirmed]16:08
jeblair_haha!  it's because of the mirror16:08
jeblair_which is not an issue anymore16:08
*** rmcall has joined #openstack-infra16:08
fungisdague: oh, that's why we were doing it, yep16:08
fungiclearly i drank away the brain cells that recorded that info16:09
dhellmannthe requirements change to make the settings for sqlalchemy in master match the ones in juno passed its check: https://review.openstack.org/#/c/141927/216:09
fungiso we should totally get rid of that check now16:09
jeblair_fungi: luckily launchpad remembered16:09
dhellmannshall I self-approve that, or do we have some other people here with +2 on requirements?16:09
clarkbso reading this I am still not sure why we need 14192716:09
clarkbindication seems to be we can pin stable/juno requirements which allows 0.8 and 0.916:10
clarkbthen master can use 0.9?16:10
*** AJaeger has quit IRC16:10
openstackgerritSteven Weston proposed openstack-infra/infra-specs: Third Party CI Dashboard Spec  https://review.openstack.org/13517016:10
fungijeblair_: hah16:10
dhellmannclarkb: we have a job that forbids that. We can turn that off, but that's a bigger change than just making the ranges overlap again.16:10
* jeblair_ is making that change now16:10
*** lttrl has quit IRC16:10
fungiclarkb: the change to oslo.db gets tested against master requirements16:11
*** lttrl has joined #openstack-infra16:11
sdagueyeh, I'm not sure I know why we'd do 14192716:11
clarkbfungi: OOOHHHH thats what I was missing16:11
dhellmannoh, I looked away, are we dropping that requirements range thing?16:11
clarkbok /me feels caught up now16:11
dhellmannI guess that means I don't need https://review.openstack.org/#/c/142131/ either16:12
sdagueso... why isn't oslo.db just coming on the stable/juno branch of oslo.db?16:12
dhellmannor a new oslo.db release?16:12
fungiclarkb: unless we want to do something about the fact that the oslo.db stable/juno branch is based on 1.0 even though we want to be able to use newer than 1.0 in stable/juno servers16:12
dhellmannthe stable/juno branch of oslo.db was from the 1.0 series16:12
clarkbfungi: right16:12
jeblair_fungi: why do we want to use something newer than 1.0/16:12
jeblair_?16:12
jeblair_i mean, we want to use 1.0.1...16:12
dhellmannI prepared a patch to merge 1.2 back into stable/juno, but that also includes other requirements updates which I didn't think we wanted in stable branches?16:12
fungijeblair_: that's a question for dhellmann i think16:13
sdaguedhellmann: ok, so why isn't that what get's fixed?16:13
* dhellmann tries to remember all of what happened yesterday16:13
dhellmannok, let's just start over16:13
fungijeblair_: at the moment we say stable/juno works with all versions of oslo.db, so if we backport this fix to a 1.0.1 release then we need to cap stable/juno to oslo.db <1.1 even though we previously said it works with later versions16:13
dhellmanndo we care about overlapping ranges on requirements?16:14
fungiso somewhat of a linearity problem16:14
openstackgerritSteven Weston proposed openstack-infra/infra-specs: Third Party CI Dashboard Spec  https://review.openstack.org/13517016:14
sdaguedhellmann: no, that grenade patch works around it16:14
*** Ala has quit IRC16:14
*** koolhead17 has joined #openstack-infra16:14
dhellmannsdague: ok, in that case some of what we worked out to do yesterday is no longer needed16:14
jeblair_fungi: oh, i guess i didn't see that as a problem, but i understand how one might.16:15
dhellmannthis is the plan I've been working from this morning: https://etherpad.openstack.org/p/cloL2FzTRd16:15
sdagueso it seems like a release should come off the stable/juno branch of oslo.db16:15
*** achanda has joined #openstack-infra16:15
sdaguenow, that branch could be 1.116:15
sdague1.0.1 that is16:16
dhellmannsdague: what release do you want?16:16
sdagueor you could roll forward to 1.2.1 on that branch16:16
dhellmannbecause it sounds like now all we need to do is cap oslo.db <1.1 and we're fine16:16
*** dannywilson has joined #openstack-infra16:16
fungisdague: can't exactly roll forward on that branch because it has cherry-picked backports of fixes16:16
dhellmann1.1 and 1.2 introduce other dependency changes, is it ok to do that to stable?16:16
fungisdague: so it's not fast-forwardable to 1.2.016:16
*** jpich has quit IRC16:16
dhellmannthis is why we created the feature/1.2 branch to allow us to have a safe 1.2.1 release16:16
sdaguedhellmann: I don't actually care, just the thing which was breaking in a new way was trying to release a stable/juno dependency *not* off a stable/juno branch16:17
dhellmannyeah, that was failing because of the way the requirements check job is written right now (it assumes the branch in the lib and the requirements repo will match)16:17
dhellmannso we'll need to change that, and we talked about how to change it with jeblair_ yesterday16:17
sdaguedhellmann: which is a completely sane check, honestly16:17
dhellmannbut we thought we could fix all of this without waiting for that change16:18
fungiright, if we try to merge 1.2.0 into the stable/juno branch then we'll be merging a change to requirements.txt which isn't in sync with stable/juno of global requirements16:18
dhellmannsdague: it is, until you start wanting to maintain multiple backport versions of something like a library that isn't tied to the stable release cycle16:18
sdagueso... I'm really not understanding how releasing a library, specifically required for stable/juno to work16:18
*** dannywil_ has joined #openstack-infra16:18
sdaguenot off the stable/juno branch of the library16:18
sdagueis a safer thing16:18
jeblair_sdague: i believe that for feature branches, it should check against master.  i want to make that change regardless.  in a sane world, we should not use a feature branch for this, we should be working from stable/juno.16:18
jeblair_(which is why i'm also interested in fixing that)16:18
*** hashar has quit IRC16:19
dhellmannsdague: because until this morning we did not think we could have the requirements for oslo.db in juno and kilo not overlap, and so we needed a version of oslo.db with dependencies on sqla that worked in both, and no such library exists16:19
sdaguejeblair_: ok16:19
*** dangers_away is now known as dangers16:19
*** dannywilson has quit IRC16:20
dhellmannup until this change that involved new requirements, I would have agreed. However, as we're using Semver, we can't change the dependencies of 1.0.x. The fix for this problem was to change the dependencies of oslo.db.16:20
*** ihrachyshka has quit IRC16:20
dhellmannso we needed a release outside of the 1.0 series with the fix, and the last version known to work in juno and master was 1.216:21
dhellmannso we were trying to prepare a release of 1.2 that would work in both places, but that didn't work because of some of the jobs, and then we worked out that it would be quicker to release a 1.4 off of master than to fix all of the things we would have to fix to allow us to release a 1.216:21
dhellmannI had hoped to have this all resolved yesterday, but ran out of time16:22
dhellmannso, now that I've replayed all of that, what do we actually want to do today? Do we want a 1.4, or do we want a lower cap on juno? Or neither?16:23
*** dannywil_ has quit IRC16:23
openstackgerritDave Walker proposed openstack-dev/pbr: Ignore non-release related tags  https://review.openstack.org/14214416:23
*** dannywilson has joined #openstack-infra16:24
clarkbI think now that I grok where 1.4 comes from I am ok with moving forward on that and improving this process later when we are not under pressure of coming pip release16:24
dhellmannsdague, fungi, jeblair_ : ?16:24
*** koolhead17 has quit IRC16:25
jeblair_dhellmann: i'm trying to make it so that we can work on the stable/juno branch to release a library version that fixes a stable/juno problem since i think that's the right way to solve this in general.  it's broken now, and i'm happy to do whatever we think is most expeditious.16:25
sdagueyeh, I think the thing that got lost is anything with a stable/juno branch needs a cap that references it16:26
dhellmannjeblair_: ok, well, we're always going to have multiple release branches for oslo libs within a cycle because now that we're not using alphas we're going to have lots of X.Y+1 releases instead. So I don't know if it even makes sense to have stable/foo for those repos, but I haven't had time to think about that16:26
*** kragniz is now known as kragwhale16:26
*** pelix1 is now known as pelix16:27
jeblair_dhellmann: yeah, our thinking is that you either have stable/<name> or stable/<number>.  this is not well exercised, so yeah, we can push on that later.  :)16:27
fungii'm trying to think through the potential logistics of the next unidentified stable backport we'll need for oslo.db... if we don't enforce requirements checks for the stable branch until we start development on a version which we intend to make non-backward-compatible, we're still going to have this problem16:27
dhellmannjeblair_: but that aside, it's no longer clear to me if we *need* a 1.4 today because IIUC sdague's proposal is to just cap the version of oslo.db in stable/juno even if that results in a non-overlapping requirements range16:28
jeblair_fungi: i think that's where sdague's "if it has a stable/juno branch, we need to cap use of it" comes in16:28
sdaguefungi: so the thing to realize is, all of requirements synchronization is a work around for pip not having a solver16:28
*** skolekonov has quit IRC16:28
jeblair_dhellmann: yeah -- so in that case are we considering a 1.1 cap or 1.3?16:28
sdagueso we need to carefully spoon feed it a set of things which won't explode16:28
*** yolanda has joined #openstack-infra16:28
dhellmannwe did agree at the summit that we wanted to cap versions in the stable branches, but we ran into issues with the upgrade test jobs breaking16:29
*** Masahiro has joined #openstack-infra16:29
clarkbsdague: sort of. We can still explode it with a solver16:29
fungiwhere this gets tricky is that we need to cap these even if they don't (yet) have stable branches, because they may need one later16:29
sdagueclarkb: but at least we'd explode early16:29
clarkbtrue16:29
sdagueright now the pip silent fail ... oh things are great... kaboom16:29
sdagueis really problematic16:29
dhellmannjeblair_: if we're going to cap it permanently, I'd say <1.1 because that lets us avoid releasing fixes of 1.1, 1.2, and 1.3 with the requirements for sqla that work with setuptools16:29
*** david-lyle has joined #openstack-infra16:30
sdaguewhich actually almost makes me want to do mordred's plan, which is stop using pip16:30
sdaguebuild packages16:30
sdaguehave a package manager that actually has a solver16:30
jeblair_dhellmann: that seems sensible to me, i believe fungi was suggesting that people may have ended up with juno + 1.2 installed and we would make life hard for them.  i do not know how theoretical of a problem that is.16:30
fungiwe release kilo with an open-ended requirement on foolib which is available at version 1.0.0 at the time. we should at the kilo release pin foolib<1.1 in anticipation of later needing to backport fixes which will work with a later state of stable/kilo16:30
dhellmannjeblair_: ok, if we think that's a real thing (it's likely) then we should probably go ahead with the 1.4 release16:31
sdaguedhellmann: do we know if tests pass with oslo.db < 1.1?16:31
sdaguethat would be good data16:31
sdaguebecause projects could have used new features in their backports16:31
dhellmannjeblair_: and then work on the tools to make it possible to do releases from arbitrary stable branches with numbers instead of names16:31
*** koolhead17 has joined #openstack-infra16:31
jeblair_sdague: would creating clean environments on upgrade help us here?  ie, re-install everything into a new {system,venv,container} on upgrade?  that way pip does the same thing on new install as upgrade?16:32
sdaguejeblair_: no, it just reduces the surface16:32
dhellmannsdague: that's a good question, but I think fungi's point about CD sites probably already having 1.2 trumps it16:32
clarkbone issue with mordreds plan is that we shift a lot of effort to the deployers if/when we do that. We essentially say don't install from source (which tripleo does for example) and everyone needs to build packages16:32
sdaguebecause pip's lack of solver still can put us in these binds16:32
jeblair_sdague: but it makes upgrade == install; so it reduces it to the minimum we can if we support installing with pip at all, right?16:32
dhellmannclarkb: we talked about using something like fpm to build "dumb" packages that aren't necessarily compliant. I'd rather find some resources to help fix the pip resolver, though16:33
sdaguejeblair_: so... it it was a venv that did not allow system packages, it would make for a small fail surface, but it would still be there16:33
clarkbdhellmann: yup and iirc mordred said "no one should use these packages but us" so we would really expect everyone to start building them16:33
*** david-lyle has quit IRC16:33
*** Masahiro has quit IRC16:34
*** nfedotov has quit IRC16:34
dhellmannclarkb: I'm not sure I follow16:34
*** EmilienM is now known as EmilienM|afk16:34
sdaguepackage 1.0 depends on foo>=1.016:34
sdaguefoo 1.0 depends on bar>=1.316:34
clarkbdhellmann: today many people deploy from source. eg tripleo. They can do this because upstream of deployment we have taken on a lot of work of curating package dependencies and making sure you can install from source16:34
sdagueif bar != installed16:34
dstuffturgh16:35
dhellmannclarkb: oh, I see what you mean16:35
clarkbdhellmann: if we switch to system packages that are built only for testing then we essentially are telling all of these downstream deployers that installing from source is at their own risk (and we know it is risky) or you all need to build packages16:35
sdaguepip install -e ./package  drags in foo, and bar >= 1.316:35
jeblair_sdague: yeah, i understand -- i read all the scrollback :)16:35
sdaguejeblair_: ok16:35
sdaguejeblair_: so the reality is, it reduces the surface, but the problem still remains16:35
jeblair_sdague: i'm just saying that currently "install openstack via pip" has a behavior; replacing the env during upgrade at least makes the upgrade dependency resolution (such that it is) the same as installation16:36
jeblair_sdague: which as you point out, is problematic still :)16:36
sdagueright16:36
clarkbthat doesn't rule out system packages, its just a thing to consider16:36
*** yamamoto has joined #openstack-infra16:36
*** reed has quit IRC16:36
jeblair_okay.  so i guess if we think that upgrade!=install is a problem, we could look into that.  if we're more concerned with install!=ideal, then we should just do packages or fix pip.16:37
*** cnesa has quit IRC16:37
sdaguewhich, honestly, we could get *nearly* the same behavior on by just setting the min == max on requirements before we sync16:37
*** dustins has quit IRC16:37
*** reed has joined #openstack-infra16:37
*** MarkAtwood has joined #openstack-infra16:37
sdaguebecause clean venvs are going to produce that16:37
dstuffthonestly one of the things blocking a better dep solver in pip is that their is a lack of good libs for it (there is one or two, but last I looked they didn't work well) and I haven't cleared enough time out to actually learn how to write a SAT solver16:38
mordredjeblair_: I played some this morning with both fpm and stdeb16:38
jeblair_sdague, dhellmann: i have a problem -- i can not find that we actually run the requirements overlap check.16:39
mordredjeblair_: I think producing os packages is an automatic manner may not be terrible16:39
jeblair_sdague, dhellmann: https://review.openstack.org/#/c/98262/3  change that added it16:39
sdaguejeblair_: we may not16:39
jeblair_sdague, dhellmann: but there's no zuul entry with the word 'overlap' in it16:39
*** ryanpetrello has joined #openstack-infra16:39
*** Swanson has left #openstack-infra16:40
dhellmannjeblair_: isn't it in http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/project-requirements-change.py somewhere?16:41
*** yamamoto has quit IRC16:41
dhellmannno, that just checks against the global list, doesn't it16:41
jeblair_dhellmann: that was the first version which was reverted due to this bug: https://bugs.launchpad.net/openstack-ci/+bug/132650416:41
uvirtbotLaunchpad bug 1326504 in openstack-ci "Requirements change and check causes proposal failure" [Undecided,Fix released]16:41
jeblair_then the idea was to move it into the requirements repo. and apparently all the work to do that was done except actually running the job16:42
*** rmcall has quit IRC16:42
dhellmannjeblair_: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n141416:43
dhellmannbut I guess you're saying that's not in zuul16:43
jeblair_yep16:43
dhellmannfun16:43
dhellmannso the job we're worried about isn't configured to run?16:43
jeblair_everything we thought yesterday was wrong.  :)  hopefully we won't say the same tomorrow16:43
*** david-lyle_afk is now known as david-lyle16:44
* dhellmann looks for a softer wall to bang his head on16:44
dstufftfungi: if you're not aware, anatoly is a bit trollish sometimes16:44
openstackgerritJames E. Blair proposed openstack/requirements: Remove requirements overlap check  https://review.openstack.org/14215116:44
* dims offers dhellmann a pillow :)16:44
dstufftfungi: I think he generally means well, but he doesn't take no for an answer hardly ever heh16:44
openstackgerritJames E. Blair proposed openstack-infra/project-config: Remove requirements overlap check  https://review.openstack.org/14215216:45
*** andreaf has joined #openstack-infra16:45
dhellmanndstufft: has anatoly found openstack?16:45
dstufftdhellmann: he's on distutils-sig and saying he wants openstack to replace PEP 440 because t's not semver16:45
dhellmannah16:46
dstufftand fungi was responding so I was just letting fungi know that anatoly can be a huge time suck16:46
jeblair_dstufft: popped that popcorn yet? :)16:46
fungidstufft: right, i just wanted to make sure he didn't further the general perception that openstack is not a real free software project because many people who work on it are paid contributors16:46
*** zz_gondoi is now known as gondoi16:47
dolphmis there still an openstack pypi mirror available somewhere?16:47
dstuffttheres one per region I believe16:47
dstufftjeblair_: lol16:47
fungidstufft: particularly on an ml frequented primarily by non-openstack python developers16:47
*** mattfarina has quit IRC16:47
fungidolphm: nope, just full pypi mirrors. there's nothing "openstack" about them16:48
*** mattfarina has joined #openstack-infra16:48
dolphmfungi: hmm - what made it possible for the mirror to go away?16:48
sdaguejeblair_: that's some twitterable quote there :)16:48
*** belmoreira has quit IRC16:48
fungidolphm: we run some embedded in the providers/regions where we run our tests to have lower-latency package install times for the servers there16:48
fungidolphm: we stopped using a special limited-scope mirror for enforcing requirements list coordination, in favor of jobs which checked directly16:49
dolphmfor the partial* mirror to go away16:49
jeblair_sdague: heh, yesterday dstufft tempted fate by saying something like "only a couple of responses on the thread, maybe i don't have to pop the popcorn"  ;)16:49
*** changbl has joined #openstack-infra16:49
sdaguejeblair_: nice16:49
dolphmfungi: where can i find those jobs?16:49
sdaguejeblair_: though I was refering to further up16:50
sdaguehttps://twitter.com/sdague/status/54489679872551321616:50
jeblair_sdague: oh :)16:50
fungidolphm: mostly http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/requirements.yaml16:50
clarkbok so, now that we have rehashed and seem to grok the situation as it is today :) what can I do to help move things along?16:51
clarkbdhellmann: ^16:51
*** vigneshvar has joined #openstack-infra16:51
dolphmfungi: awesome, thanks16:51
* clarkb is throwing him self into the fire because this stuff is important16:51
dhellmannclarkb: I still feel more comfortable going ahead with a 1.4 release, then capping juno to use that (skipping the broken versions 1.1, 1.2, and 1.3. It's not clear to me that we have consensus on that, though.16:51
clarkbmordred: still around? your pbr changes fail pep8 again. Also, do we want to hold off on the second one to drop shas to hear back on dstufft's inding?16:52
*** mrmartin has joined #openstack-infra16:52
mordredclarkb: I'm actually kinda convinced we should just drop them16:52
clarkbs/inding/findings/16:52
dstufftjeblair_: though I'm still pretty happy overalll. I know setuptools 8 is causing some issues here, and a few other places, but overall I think it's gone about as good as changes to this could have gone16:52
mordredclarkb: but I'd also be easy to convince to hold off16:52
jeblair_clarkb: i believe this is dhellman's plan etherpad: https://etherpad.openstack.org/p/cloL2FzTRd16:52
clarkbjeblair_: thanks I have that open now16:53
clarkbI am +1 on releaseing a 1.416:53
dhellmannclarkb: because even though jeblair_ found that we're not running the requirements overlap job, fungi pointed out that CD environments are probably already running 1.2, so I don't want to make the pin lower than that16:53
clarkbif others agree I will review the requirements change16:53
*** e0ne is now known as e0ne_16:53
clarkbdhellmann: yup16:53
*** e0ne_ is now known as e0ne16:53
dstufftclarkb: mordred fwiw I have some meetings today but I plan to get some numbers for the normalization rule after that, if it looks like it won't do anything bad to what we parse as a version thne I'll propose ammending PEP 440 with it on distutils-sig. I don't suspect anyone will fight me on it16:54
mordredk.16:54
clarkbdstufft: ok, and assuming all that the change to not emit normalized versions in setuptools is also non controversial?16:54
jeblair_what's the normalization rule?16:54
dhellmannjeblair_: do you mean cap the dependencies in versions with stable branches, or cap the oslo lib versions with stable branches?16:54
dstufftclarkb: Most likely I'll just make it so pbr can turn off the normalization16:54
openstackgerritMerged openstack-infra/project-config: Fix publishing rally html results  https://review.openstack.org/14029616:54
dstufftnot that setuptools won't in general emit then normalized16:55
clarkbdstufft: toggleable flag? that should work too16:55
dstufftclarkb: yea16:55
mordredclarkb: pushed fixed patch - sorry bout that16:55
*** alexpilotti has quit IRC16:55
clarkbjeblair_: basically dstufft's proposal is treat a trailing .[:alnum:] string as string sorted not number sorted. This would get normalized to +[:alnum:]16:55
dstufftjeblair_: take a final trailing .alphanumeric (not .alphanumeric.alphanumerc, or anything else, one dot, and alpha num and normalize it to +alphanum)16:55
clarkbjeblair_: the problem right now is that setuptools emits the normalized form (+[:alnum:]) in the package it creates so older setuptools would still be broken16:56
*** koolhead17 has quit IRC16:56
dstufftwe had something similar to that in the course of testing variations of PEP 440 but I don't think we ever tested it on it's own16:56
dstufftI think it also came with some other rules that we ultimately dropped16:56
*** MaxV has quit IRC16:56
dstufftlike an implicit leading zero16:56
clarkbjeblair_: so we would need some way of disabling that to stick with .[:alnum:] then let normalization happen only internal to setuptools. Otherwse we are not forward and backward compat16:56
jeblair_dhellmann: i'm trying to say "try to do the thing we agreed to do at the summit and attempted and failed to do", which i think is "for every project with a stable branch, cap the version of that project to the latest that currently meets the spec for the project in that branch"16:56
dstufftwhich meant that we got some relaly bad version parses16:56
*** sputnik13 has joined #openstack-infra16:56
dstufftlike object object repr()s that got parsed as 0+<object repr>16:57
jeblair_dhellmann: or put another way: do what would have been needed for us to be able to release 1.0.1 here16:57
dstufftso I just need to make sure that the rule won't allow something crazy16:57
mordredclarkb: the idea of having a normalization that we somehow disable16:57
dhellmannjeblair_: ok. That ship may have sailed for many of the oslo libs, though. We are currently testing juno against releases made during kilo and as fungi pointed out that may mean CD sites have them, too. We would be forcing downgrades on them.16:57
mordredclarkb: sounds like something thats going to increase the amount of strangenes and confusion over time16:57
clarkbmordred: it might and is generally why I am on baord with dropping the shas completely16:57
dhellmannjeblair_: I suppose we could have made a 1.0.3 or whatever that had the sqlalchemy settings specified in a way that worked for setuptools 816:58
dstufftmordred: to be clear, you're only controlling whether setuptools is going to emit the normalized version, not controlling whether normalization happens on the installee end16:58
mordredfrom what I can tell, most of the CD deployers munge the versions themselves anyway16:58
jeblair_dhellmann: so maybe we cap it at what's there now to avoid making things worse?  i dunno.  we can come back to it, i just don't want to forget and then in 2 weeks say "i thought we..."16:58
*** markmcclain has joined #openstack-infra16:58
dhellmannjeblair_: yes, definitely, I'm just trying to figure out what exactly we want to do :-)16:58
*** garyk has quit IRC16:58
*** sarob has joined #openstack-infra16:59
clarkbdstufft: right since old setuptools wouldn't normalize at all and just work (tm) then new setuptools could normalize during its install16:59
dstufftmordred: essentially letting you act as if for dist creation you're not using setuptools 816:59
clarkbdstufft: the important bit is that the intermediate step of a whl or sdist artifact not normalize so that it is portable16:59
dstufftclarkb: yea16:59
mordredyes. I get that16:59
mordredEXCEPT16:59
mordredthat it takes a lot of mental effort for me to get that16:59
mordredso it's tripping me "we're making this too hard" alarm16:59
mordredmy16:59
*** dtantsur is now known as dtantsur|afk16:59
clarkbmordred: agreed. I really do like your solution :)17:00
mordredI would prefer to lessen the number of things that only 4 of us understand17:00
*** cnesa has joined #openstack-infra17:00
dhellmannjeblair_: to cap to something <1.3 (the current highest release, which is broken), we need a way to release a 1.2.1. Going with 1.4 seemed expedient, since the code in 1.3 should work fine, it's just the dependencies that are broken.17:00
anteayamordred: thanks17:00
* anteaya is trying to follow along, is totally lost17:01
dstufftmordred: my life is series of things that 4 people understand at this point :V17:01
anteayadstufft: you are on my list of people to understand, alas not today17:02
dstufftclarkb mordred: I would prefer not to add that normalization rule fwiw, but I'm not opposed to doing it if we can17:02
clarkbmordred: dstufft: maybe it is more productive on the whole to just not worry about it. accept that lifeless would rather we not go down this path, apologize, then merge mordred's changes?17:02
mordredclarkb: I vote for that17:02
mordredjeblair_, dhellmann: ^^ ?17:02
* dhellmann doesn't understand the question17:04
*** hashar has joined #openstack-infra17:04
dhellmannmordred, clarkb : which patch?17:04
clarkbdhellmann: 14166717:04
mordreddhellmann: we're debating dropping the git sha from the intra-release generated versions from pbr17:04
clarkbdhellmann: the one you asked for more comments on which I am not opposed to adding :)17:05
dstufftdhellmann: when creating a dev version, pbr currently puts a git sha in the version. That doens't work with the current PEP 440. the choices are a) drop shas from the version string (they will be recorded elsewhere) or b) I go and see about adding some normalization rules to PEP 440 to make it work again17:05
mordreddhellmann: however, if you need your head in the other problem, feel free to ignore us17:05
dhellmannmordred: yeah, I'm really trying to get a resolution on the sqlalchemy issue first, but I give zero toots about shas in version numbers if we can have a "patch number since last tag" or something17:06
mordreddhellmann: yup. we can have that17:06
jeblair_mordred: i personally find including it in the version to be of limited utility, specifically because of the weird sorting, so a weak +1 from me.  i do not pretend to understand all the other possible use cases this might affect.17:06
dhellmannand the issue with dropping the sha is we don't get unique versions for CD folks?17:06
*** ChuckC_ has joined #openstack-infra17:06
mordredonly if they jump around17:07
mordredthere might be two different things that are different that have version 1.2.3.417:07
mordredin that that's two different things that are 4 patches patst 1.2.317:07
clarkbwhere 4 is the patch level17:07
mordredI don't really care17:07
*** ChuckC has quit IRC17:07
mordredat that point, they're doing crazypants and I can't help them anyway17:07
dhellmannyeah, I see that it could be a problem, but I'm not sure it's our problem17:08
*** otter768 has joined #openstack-infra17:08
dhellmannesp. not if it means everything else is broken for everyone else17:08
fungithe primary concern expressed against boiled down to "cd sysadmins are relying on being able to see the git sha in the package version number now, and shouldn't need to install and run some new command from pbr to find them"17:08
*** sarob has quit IRC17:08
mordredyah. I think aligning with upstream python sensibilities is more important, even if it means shorterm discomfort for someone17:09
fungia position which i, as a long-time sysadmin myself, have a hard time developing sympathy for17:09
sdagueit seems reasonable to tell cd folks "you need this other tool"17:09
mordredespecially when the tool will get installed on your system already17:09
*** sweston is now known as _sweston17:09
sdagueyep17:09
dstufftI think the other thing was that pip would know it needs to reinstall if you do ``pip install foo==<some version with a git hash>`` but it wouldn't if you didn't do that17:10
mordredthis is true17:10
dstufftbut you can either uninstall first or do pip install -U --force-reinstall foo==<some version without a git hash>17:10
mordredyah17:10
*** sarob has joined #openstack-infra17:11
mordredit's an edge case, and again, you need to know what your'e doing there17:11
dstufftmordred: I didn't look at the patch recent, but one suggestion I did have was change the comment so it was like # from git <hash> or something17:12
*** sweston has joined #openstack-infra17:12
dstufftinstead of just # <hash>17:12
*** carl_baldwin has joined #openstack-infra17:12
*** Guest51388 has quit IRC17:12
*** otter768 has quit IRC17:12
*** markmcclain1 has joined #openstack-infra17:12
*** markmcclain has quit IRC17:13
fungii like the explicitness of that, though i was okay without (since previous behavior was just as opaque, thus not a regression)17:13
*** vigneshvar has quit IRC17:14
*** rmcall has joined #openstack-infra17:14
*** sweston has quit IRC17:15
*** sweston has joined #openstack-infra17:15
ttxdstufft: will PEP440 be ahppy with 2015.1.b1 or should it be 2015.1b1 now ?17:15
ttxfungi: about to tag Trove but realized I may have an issue here17:15
dstufftttx: it'll accept 2015.1.b1 but it'll normalize to 2015.1b117:16
ttxdstufft: ok, so I'll hit the same hurdle as with 2.2.1.rc117:16
dstufftttx: yes most likely17:17
ttxi.e. our usage of setuptools will result in a tarball named 2015.1b1.tar.gz and a tag names 2015.1.b117:17
dstufftyes17:17
dstufftif you create it with setuptools 8+17:17
ttxhmmm, ok17:17
clarkbspeaking of17:17
*** sputnik13 has quit IRC17:17
zaromorning17:17
*** enikanorov has quit IRC17:17
clarkbmordred: https://review.openstack.org/#/c/141831/ your thoughts on that are also appreciated17:17
clarkbmordred: it is related to ttx's questions above17:17
ttxclarkb: any hint on whether I should do .b1 or b1 ?17:17
clarkbttx: note that 141831 would prevent a tag of 2015.1.b117:18
dstufftI think that's a hint to do b117:18
dstufftlol17:18
ttxyep17:18
*** mtanino has joined #openstack-infra17:18
ttxI mean, if we know that we'll only do bX soon, I'm fine with starting today17:18
*** tonytan4ever has joined #openstack-infra17:18
ttxbetter than changing in the middle of the cycle17:18
*** sputnik13 has joined #openstack-infra17:18
clarkbttx: +1, lets see what mordred thinks about that if he is still around17:19
zaronotmyname: i think you and edwin are talking about 2 different things when you are referring to a 'custom dashboar'.  i think edwin is referring to the custom dashboard feature while you are referring to a custom query.17:19
*** ChuckC_ has quit IRC17:19
zaronotmyname: this is an example of a custom dashboard: https://review.openstack.org/#/projects/All-Projects,dashboards/important-changes:important-changes-dashboard17:19
*** ivar-lazzaro has joined #openstack-infra17:20
sdaguejeblair_: so... unrelated to all of this17:20
sdaguewhat's up with the zuul event graphs?17:21
pleia2morning17:21
notmynamezaro: ah. right. I'm referring to eg what http://goo.gl/r2mxbe resolves to17:21
clarkbdhellmann: would it be ok if I put non oslo.db related setuptools 8.0 things on your etherpad too?17:21
*** achanda has quit IRC17:21
dhellmannclarkb: sure17:21
*** carl_baldwin has quit IRC17:22
*** sarob has quit IRC17:23
*** dims has quit IRC17:23
*** sarob_ has joined #openstack-infra17:23
mordredclarkb: looking17:23
*** dmsimard is now known as dmsimard_away17:23
*** dims has joined #openstack-infra17:23
dstufftclarkb: I think you can also update PEP 440 but still emit normalized things, it would just mean that CD operators need to be setuptools 8+17:23
zaronotmyname: yeah, i think what you want is to be able to share just an arbitrary query.17:23
*** yamamoto has joined #openstack-infra17:24
dstufftif that's a better option for y'all in confusion terroritory wise17:24
zaronotmyname: that feature does not exist in gerrit today.17:24
dstufftI Have a hard time telling the difference between things that make sense to me because they are easy to understand and things that make sense to me becuase I wrote 8000 words on versioning17:24
notmynamezaro: thanks. I'll try to clarify that17:24
*** achanda_ has joined #openstack-infra17:24
jeblair_sdague: i believe it's hitting timeouts; i landed a fix to address that17:25
jeblair_clarkb, fungi: ^ maybe we should restart zuul now17:25
*** dmsimard_away is now known as dmsimard17:25
clarkbjeblair_: the fix was to bump the timeout locally again?17:25
mordredclarkb: so pep440 wants us to make 2015.1.1b1 if we were good little chickens?17:25
jeblair_clarkb: yeah, though this time it's in a real change to zuul17:25
dstufftmordred: 2015.1b117:25
clarkbmordred: correct, and if you do something else it will normalize to that and thats the version in your sdist17:26
dstufftif you want the normalized version17:26
dstufftoh17:26
dstufftI missed the second .117:26
clarkbdstufft: I think 2014.1.1b1 is also allowed17:26
dstufftyea it Is, I just didn't read close enough and thought mordred was repeating ttx's version17:26
ttxmordred: I tagged Swift 2.2.1.rc1 and that cvreated swift-2.2.1c1.tar.gz, so we backtracked and tagged Swift 2.2.1c117:26
clarkbmordred: so in the interest of reducing confusion I assert the tag should match pep440 as well17:26
ttxmordred: now I need to push kilo-1 tags... used to be 2015.1.b117:26
dstufftnote that 2015.1.1b1 is newer than 2015.117:26
dstufft2015.1.0b1 is equiv though17:27
mordredI agree - the tag should match the thing that will be normalized so taht both things agree17:27
ttxmordred: but 2015.1b1 sounds liek the way to get tags matching tarballs17:27
*** derekh has quit IRC17:27
*** shashankhegde has joined #openstack-infra17:27
clarkbdstufft: noted17:27
*** sarob_ is now known as sarob17:27
ttxIf everyone agrees, I'll tag kilo-1 as 2015.1b117:27
mordredttx: yes. except then we've got two different regexes - can we just mkae the servers 2015.1.0b1 so that we can have one and only one regex we accept?17:27
*** alexpilotti has joined #openstack-infra17:27
*** jcoufal_ has quit IRC17:27
*** dims_ has joined #openstack-infra17:28
clarkbmordred: my regex accepts both17:28
mordredright.17:28
clarkbmordred: I don't think I follow "two different regexes"17:28
mordredbut I don't want to accept a letter in the second stanza for most things - that's a server ideosyncracy17:28
*** achanda_ has quit IRC17:28
*** dims has quit IRC17:28
mordredlike, we NEVER want 1.0b1 for any of our things if we're trying to trend everythign that isn't the servers towards semver17:28
mordredso if we're changing the server pattern anyway17:28
*** sarob_ has joined #openstack-infra17:29
*** achanda has joined #openstack-infra17:29
mordredwhy not go ahead and make it at least fit the stricter regex17:29
clarkbmordred: so my intent was to match PEP440 as closely as possible17:29
clarkbmordred: and not proscribe anything atop that17:29
mordredoh, I don't want to do that17:29
mordredI want to proscribe on top of it17:29
dstufftpep 440 allows some crazy versions17:29
clarkbbecause that additional stuff is what is biting us today17:29
mordredbecause there is no good reason to allow 1.0 instead of 1.0.017:29
dstufftaccepting a subset of pep 440 is recommended17:29
mordreddstufft: ++17:29
clarkbmordred: ok so you want to require three digit sections?17:30
mordredyes17:30
clarkbok let me update regexes17:30
mordredbecause then there is just a rule17:30
*** ihrachyshka has joined #openstack-infra17:30
ttxmordred: and tag finazl as 2015.1.0 ?17:30
mordredwell - hang on17:30
mordredmake sure other people who aren't me agree :)17:30
mordredttx: yes17:30
mordredthat's my pitch - I could be insane though17:30
ttxI'm not sure I follow the "only 3 digit sections" rationale17:31
dstufftsemver says you have to have 3 digits17:31
dstufftsemver.org17:31
clarkbwe did not enforce that before, but I am happy to enforce it now17:31
ttxdstufft: sure but here we are talking date-based versioning17:31
*** yamamoto has quit IRC17:32
*** sarob has quit IRC17:32
* ttx looks up previous tags to minimize disruption17:32
mordredttx: right. I don't care about the date based versions per-se17:32
*** mkerrin has quit IRC17:32
mordredttx: what I want to do is enforce that non-date-based have 3 stanzas17:32
mordredit doesn't _break_ date based to have 317:32
*** marun has joined #openstack-infra17:33
mordredso the simplest thing is just to say "have 3 kthxbai"17:33
ttxand you want a single regexp, ok17:33
dstufftfor whatever it's worth, PEP 440 treats 2015.1.0 and 2015.1 as exactly equiv, so it's entirely a human decision17:33
ttxmakes sense17:33
dstufftas far as PEP 440 goes17:33
ttxwell, not really, but I see your point now17:33
*** marcusvrn1 has quit IRC17:33
mordredthat way there is a very simple rule for people to follow17:33
*** achanda has quit IRC17:33
*** bdpayne has joined #openstack-infra17:33
*** vigneshvar has joined #openstack-infra17:33
mordredthat said - we COULD make the regex treat versions that begin with 20\d\d differently17:33
mordredI mean, that's also not a hard regex to write17:34
ttxso the main change (because frankly I don't care about dev milestones), is that we won't be having YYYY.S tags anymore17:34
dstufftmordred: not future compatible with 2100!!!17:34
mordreddstufft: not my problem :)17:34
ttxwe always had "2014.2" like things17:34
dhellmannclarkb, fungi: new plan, line 29 of https://etherpad.openstack.org/p/cloL2FzTRd17:35
*** tonytan4ever has quit IRC17:35
ttxalthouigh swift used "2.0.0" so I guess there is precedent17:35
*** carl_baldwin has joined #openstack-infra17:35
*** tonytan4ever has joined #openstack-infra17:35
ttxmordred: ok, I think we can leave with that17:36
ttxor live17:36
*** _nadya_ has quit IRC17:37
clarkbdhellmann: that also works for me17:37
*** ssam2_ has joined #openstack-infra17:37
*** garyk has joined #openstack-infra17:37
*** franred has joined #openstack-infra17:37
clarkbdhellmann: will need to read through what fungi and you discussed to understand why but I am fine with that too17:37
ttxclarkb: if I tag 2015.1.0b1 ... will the current regexp catch it in pre-release ?17:37
ttxclarkb: and setuptools won't barf on me either ?17:38
clarkbttx: good question, I think so but let me check17:38
dstufftttx: setuptools will be perfectly happy with that in any version I've ever seen17:38
fungiright, so 2015.1.0b1 sorts earlier than 2015.1.0 (which sorts equivalent to 2015.1)17:39
clarkblooks like our regex allows both .bX and XbY to trail a version17:39
clarkbttx: so the verison you have above should work fine17:39
ttxok, just need to update my scripts17:39
*** andreaf has quit IRC17:40
fungiand setuptools isn't going to renormalize either of 2015.1.0 or 2015.117:40
*** tonytan4ever has quit IRC17:40
dstufftfungi: correct17:40
clarkbI will update my regex changes to require 3 digit things17:40
*** andreaf has joined #openstack-infra17:40
clarkbmordred: ttx do we want to allow more than 3 or 3 only?17:40
clarkbiirc semver requires at least 3 but allows you to do more17:40
dhellmannsdague: do you have any feedback on the plans outlined in https://etherpad.openstack.org/p/cloL2FzTRd ?17:40
*** erikmwil_ has joined #openstack-infra17:41
* dhellmann goes for lunch17:41
mordredclarkb: 3 only17:41
*** erikmwil_ has quit IRC17:41
mordredclarkb: semver == 3 and only three17:41
*** erikmwil_ has joined #openstack-infra17:41
ttx[ Tagging fd0966935e5ac5007560d0032f7dee1fe5f660dc as 2015.1.0b1 ]17:42
ttxwe are a go17:42
*** erikmwilson has quit IRC17:42
clarkbmordred: are you sure? I thought semver allowed more17:42
fungimordred: clarkb: so tempest will no longer get to use incrementing integer versions i guess?17:43
clarkbfungi: it will but will have to use 4.0.017:43
*** kragwhale is now known as kragniz17:43
fungior is this only for alpha/beta/candidate pre-releases?17:43
mordredclarkb: "17:43
mordredAdditional labels for pre-release and build metadata are available as extensions to the MAJOR.MINOR.PATCH format."17:44
*** erikmwil_ is now known as erikmwilson17:44
clarkbmordred: now that I reread the only extentions are for the alpha and beta things17:44
clarkbmordred: ya17:44
fungii could see some reason to require a minimum number of version components in a pre-release version string but not in a release version string17:44
mordredyah17:44
clarkbfungi: I think the reason is because semver17:44
clarkbfungi: basically being good software citizens17:44
mordredI mean, it's still not totally right17:44
mordredbecause of their -alpha obsession17:44
*** armax has joined #openstack-infra17:45
fungiclarkb: okay, but tempest doesn't actually have semantics around its versions in that way, so it's sort of a shoehorning into a mismatched release management scheme which is ultimately meaningless there17:45
fungiif we limit our tag matches like that in layout.yaml, we're forcing that part of semver on everyone using our release automation, stackforge projects even17:46
clarkbfungi: they actually do, its an assertion of non backward compat from that point forward beacuse $release support goes away17:47
clarkbfungi: so each major version tag is proper under semver17:47
*** ChuckC_ has joined #openstack-infra17:47
fungii can see limiting release automation for python projects to only version strings which are pep-440 compliant, but going further and forcing semver itself on everyone is a bigger leap17:47
dstufftFor the record here is the regex that parses all available PEP 440 versions: https://github.com/pypa/packaging/blob/master/packaging/version.py#L162-L198 (including those not normalized)17:48
*** erikmwilson has quit IRC17:49
clarkbdstufft: I explicitly want to limit to normalized to avoid confusion when tag != version17:49
asselinHi, I'm trying to create single use jenkins nodepool image and running into this error. Any tips? http://paste.openstack.org/show/151952/17:49
*** erikmwilson has joined #openstack-infra17:49
dstufftclarkb: makes sense, I don't have a regex that allows all possible versions of that, but it shouldn't be terribly hard to do17:49
openstackgerritMauro Rodrigues proposed openstack-infra/elastic-recheck: Update Bug #1365046 query  https://review.openstack.org/14216917:49
uvirtbotLaunchpad bug 1365046 in openstack-gate "Job failed due to no devstack directory" [Undecided,Confirmed] https://launchpad.net/bugs/136504617:49
clarkbdstufft: it isn't the normalized grammar is simple and regular17:49
*** e0ne has quit IRC17:50
clarkbmordred: ^ want to respond to fungi?17:50
dstufftsome people are apparently mad that we did c isntead of rc (though I have no idea why we did c, I just didn't care)17:50
mordreddstufft: I think it's because "c" is not a thing that anyone has actually used to convey that meaning _ever_17:51
dstufftI think it comes from the old PEP17:51
dstufftwhich is 5 years old at this point and predates me17:51
mordredclarkb, fungi: I can see that - I can give up on it17:51
mordredhonestly, it's not a hard stance on my part17:52
clarkbmordred: fungi: maybe we start with just matching the pep440 normalized form as in my current change17:52
clarkbmordred: fungi: and bring up semver enforcement as future improvement since that isn't tied to making things better in the post 440 world17:52
mordredclarkb: ++17:52
dstufftmordred: do you think I should see about ammending PEP 440 to switch c with rc17:52
fungii'm guessing "c" was suggested by someone obsessed with consistency who wanted to shorten "rc" to the same length as "a" and "b" and liked that they came as a progression in a certain (technically wrong) alphabet17:52
mordreddstufft: it might make people happier17:52
dstufftfungi: probably, that old PEP also put dev after a, b and c17:53
dstufftmy first change was arguing that was insane17:53
fungidstufft: right, i wondered why not shorten "dev" to "d" in that case17:53
clarkbok I think my change is ready for review and merging then17:54
*** BobBall is now known as BobBall_AWOL17:54
*** ChuckC_ has quit IRC17:54
*** marcusvrn has joined #openstack-infra17:54
clarkbI am reviewing the pbr changes now17:54
*** sarob_ is now known as sarob17:55
cody-somervilleIs it possible to get historical data on core memberships across OpenStack?17:55
*** shashankhegde has quit IRC17:55
mordredcody-somerville: I do not believe that data exists in any of our systems17:55
fungicody-somerville: not really. nobody's been tracking it to my knowledge17:55
*** dustins has joined #openstack-infra17:56
*** shashankhegde has joined #openstack-infra17:56
*** achanda has joined #openstack-infra17:56
clarkbin theory that will change when gerrit drops the db as everything will be in git17:56
clarkbbut hasn't happened yet17:56
fungicody-somerville: we could _start_ tracking it fairly easily (i have a script, it could dump into a git repo daily or something) but today that's not the case17:56
mordredyou might get close with stackalytics - they don't look at actual core but instead track who has used a +2 vote17:56
*** ChuckC_ has joined #openstack-infra17:56
dstuffthttps://mail.python.org/pipermail/distutils-sig/2014-December/025409.html17:56
*** shashankhegde has quit IRC17:57
fungialso to some extent reviewstats core reviewers list, though it's not a 1:1 match to gerrit and also tends to lag a bit17:57
mordreddstufft: ++17:57
cody-somervillemordred: fungi: Ah, ok. Kudos for the pointers.17:57
*** arxcruz has quit IRC17:59
clarkbmordred: see comments on https://review.openstack.org/#/c/141667/ basicaly putting other peoples comments that I have heard on that patchset so you can see them easily17:59
jeblair_clarkb, fungi: any objections to my restarting zuul now?18:00
clarkbjeblair_: none from me18:00
fungijeblair_: no, i agree it's a good idea to go ahead and get that timeout increased18:01
clarkbmordred: oh ignore the comment about git descibe output you capture that in the second change18:01
*** jp_at_hp has quit IRC18:01
*** dustins has quit IRC18:01
*** garyk has quit IRC18:02
jogosdague dhellmann: I am thinking of going a slightly easier route with the virtualenvs - per devstack venv18:02
jogoso grenade will have two venvs18:02
*** rmcall has quit IRC18:02
*** melwitt has joined #openstack-infra18:03
*** garyk has joined #openstack-infra18:03
*** dustins has joined #openstack-infra18:03
*** hashar has quit IRC18:03
jeblair_clarkb, fungi: restarted; also did a full nodepool flush18:04
*** jeblair_ is now known as jeblair18:04
clarkbmordred: and I am -1 on https://review.openstack.org/#/c/141946/ due to a bug18:04
jeblairclarkb: also we need to delete old nodepool and rename in dns18:05
*** sputnik13 has quit IRC18:05
clarkbjeblair: yup I think new nodepool has proven to be stable18:05
*** rmcall has joined #openstack-infra18:05
*** sputnik13 has joined #openstack-infra18:05
clarkbjeblair: should I go ahead and delete images on old nodepool now?18:05
jeblairclarkb: ++18:05
*** k4n0 has quit IRC18:06
*** rmcall has quit IRC18:06
*** tonytan4ever has joined #openstack-infra18:06
mordredclarkb: thanks. nice catch. that's what I get for tryin to respond to a review comment ...18:06
mordred:)18:06
*** fandi has joined #openstack-infra18:06
*** jamielennox|away is now known as jamielennox18:08
*** rmcall has joined #openstack-infra18:08
clarkbok image deletion is running18:08
fungidstufft: new suggestion. pep 440 should be amended to properly normalize alpha, beta, rc and dev to α, β, γ and δ respectively18:09
mordredclarkb: patches update18:09
mordredclarkb: thanks!18:09
dstufftfungi: agreed, doing that now18:09
clarkbmordred: thank you looking now18:09
fungidstufft: also we want unicode snowman for a revision control hash designator18:09
anteayawe do18:10
dstufftfungi: :pileofpoop:18:10
clarkbmordred: my only other concern is what if I have a tag called banana then it won't do the right thing. but I think in cases like that we just laugh18:10
fungibwahaha18:10
anteayalike that?18:10
*** tonytan4ever has quit IRC18:10
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added manifest for storyboard-dev.openstack.org  https://review.openstack.org/14046618:11
nibalizerso, this is a thing now , i guess https://golang.org/doc/contribute.html#tmp_618:11
mordredclarkb: yup. it will break18:12
nibalizerjeblair: mordred i guess go now has a tool called 'git-review' that interacts with gerrit18:12
*** Ryan_Lane has joined #openstack-infra18:12
*** achanda has quit IRC18:12
*** harlowja_away is now known as harlowja18:12
mordrednibalizer: wow. that's almost unbearably rude18:12
nibalizerim kindof flabergasted18:13
*** achanda has joined #openstack-infra18:13
nibalizerwe already wrote this guys18:13
nibalizerat least name yours something different!18:13
mordredright?18:13
krotscheckfungi: Just switched out to using snakeoil on that patch - the storyboard module already supported it.18:13
JayFSeriously? I wonder if that was what the new 'git-review' recipe was in macbrew18:13
crinklei thought the plan was to rewrite the whole world in go? :)18:14
*** achanda has quit IRC18:14
anteayaawesome that is really going to help our developers18:14
*** achanda has joined #openstack-infra18:14
krotscheckIt’s not in google’s best interest to make it easy for us.18:14
mordredanybody know anyone in the go community that we can complain to?18:15
krotscheck(It’s not in their best interest to make it hard either)18:15
jeblairexcept the go-git-review syntax to push a change to gerrit is "git review mail"18:15
nibalizeri tweeted at kelseyhightower (who is why i know about it)18:15
mordredI know18:15
mordredwhich is HILARIOUS18:15
mordrednibalizer: thanks18:15
nibalizerwe already have a tool, that does this, tahts called that18:15
nibalizergais, gais stahp18:15
ryanpetrelloI'm seeing a bunch of git clone failures for OpenStack cgit18:16
*** dizquierdo has quit IRC18:16
clarkbryanpetrello: can you link examples?18:16
ryanpetrellohttps://review.openstack.org/#/c/141172/18:16
ryanpetrellonamely that review18:17
clarkboh don't clone from cgit/18:17
ryanpetrelloI figured it was just a fluke last night, but re-ran a check this morning and still seeing the same issue18:17
clarkbI am not sure cgit/ was ever intended to be a place to clone from. It does caching and weirdness. If you drop the cgit/ from the path you get apache/git daemon and it should be much better18:17
*** Masahiro has joined #openstack-infra18:17
jeblairwait, why is a job cloning?18:17
clarkbjeblair: because stackforge18:18
ryanpetrellojeblair: pecan has jobs where I clone projects that depend on pecan18:18
*** tonytan4ever has joined #openstack-infra18:18
clarkbjeblair: I think it was written before zuul cloner existed but would be a perfect place to zuul cloner18:18
ryanpetrelloand then run their tests w/ the pecan patchset installed into the virtualenv18:18
jeblairyeah, we should use zuul cloner, and in a config that will use the local git cache instead of a full clone18:18
jeblairryanpetrello: what does the actual cloning?18:19
ryanpetrellopip18:19
ryanpetrelloe.g., https://github.com/stackforge/pecan/blob/master/tox.ini#L14018:19
jeblairhttp://git.openstack.org/cgit/stackforge/pecan/tree/tox.ini18:19
jeblairah yeah, so tox -> pip18:19
ryanpetrelloright18:19
anteayaasselin: you had items on last weeks infra meeting, they are still on the agenda, are they current?18:20
pleia2nibalizer: wow, yeah, that's very bad open source citizen of them :( https://github.com/golang/review18:21
asselinanteaya, looking18:21
anteayaasselin: thank you18:21
*** markmcclain1 has quit IRC18:21
anteayaasselin: keep anythign you need, let's just make sure it is current18:21
nibalizerya, kelsey told me to bring it up with golang-dev18:21
ryanpetrelloclarkb: I'll remove the cgit and give that a shot18:21
*** markmcclain has joined #openstack-infra18:21
nibalizeri haven't exactly found the right thread to respond to18:21
pleia2nibalizer: yeah, I saw the thread on twitter, that's kind of even worse :)18:21
clarkbryanpetrello: I would at least start with that, there may be other underlying problems but I was always wary of cgit's caching for git operations18:21
pleia2they took a well-established project name, now that it's been pointed out they should just fix it18:22
nibalizerwell kelsey is a go user, not a go dev so i think it was fair18:22
pleia2ah, fair enough18:22
nibalizerso ya probably we should post to godev-lang18:22
clarkbclearly we should've been python-git-review18:22
*** Masahiro has quit IRC18:22
nibalizerand by we probably jim has the most authority ? but i leave that up to others to decide18:22
clarkbso that every language can reinvent this wheel without name collisions18:22
pleia2nibalizer: s/we/nibalizer - thanks :D18:22
*** sputnik13 has quit IRC18:22
*** shashankhegde has joined #openstack-infra18:23
fungii'm still not sure why a tool like git-review needs to be rewritten in every programming language18:23
*** sputnik13 has joined #openstack-infra18:23
*** ChuckC_ is now known as ChuckC18:23
pleia2fungi: go people are allergic to python18:23
clarkbfungi: I think that when you write a new programming language one of the things you are required to do is to rewrite everything in that language18:23
fungii mean, we also submit shell scripts with it, so should we have a version rewritten in bash too?18:24
clarkbeven if the utility of a thing is as a tool not a lib18:24
*** yamamoto has joined #openstack-infra18:24
jeblairclarkb, ryanpetrello: so we should avoid cloning from git at all; there are more efficient and resilient ways of doing it...18:24
jeblairryanpetrello: let me get you a link18:24
clarkbjeblair: agreed18:24
*** patrickeast has joined #openstack-infra18:24
*** rmcall has quit IRC18:25
jeblairryanpetrello: http://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/apply-test.sh#n5218:25
jeblairryanpetrello: so i think if you do this...18:25
*** AJaeger has joined #openstack-infra18:25
ryanpetrellojeblair: that's fine, I can take this approach, too18:25
ryanpetrelloI'd like to get the tests *working* today, though, so I can cut a release18:25
jeblairryanpetrello: (understood; fix this thing, then fix it better :)18:26
ryanpetrelloyep18:26
ryanpetrelloso my only issue w/ the zuul-cloner thing (assuming I'm understanding this properly)18:26
jeblairryanpetrello: use zuul-cloner (you probably don't need a clonemap.yaml) and specify the project you want to clone.  i think you should be able to run that, and then run its install command in your tox command section18:26
AJaegergaryk: I'm back now18:26
ryanpetrellohow do I allow others to run these tests locally?18:27
ryanpetrello(outside of OpenStack's CI environment)18:27
*** rmcall has joined #openstack-infra18:27
jeblairryanpetrello: how about this?  you make a helper script that does the work, and that script can detect whether zuul-cloner exists and if it doesn't, it does a normal clone?18:27
ryanpetrelloyea, that's fair18:28
jeblairbonus: the tox sections get smaller too18:28
ryanpetrelloyep18:28
ryanpetrelloI'll clean this up as soon as I get the chance18:28
jeblaircool, thanks!18:28
*** rmcall has quit IRC18:29
jeblairclarkb: what if gertty actually had a threaded view of changes so you could visually see the dependencies?18:29
*** gyee has joined #openstack-infra18:31
*** shashankhegde has quit IRC18:32
*** zz_avozza is now known as avozza18:33
*** jgallard_ has quit IRC18:33
*** shashankhegde has joined #openstack-infra18:33
*** wuhg has quit IRC18:33
*** ZZelle_ has joined #openstack-infra18:34
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix project-config-compare-xml  https://review.openstack.org/14217918:35
*** EmilienM|afk is now known as EmilienM18:35
AJaegeranteaya, sdague, jeblair, fungi: We missed that https://review.openstack.org/#/c/140470/ was applied at the wrong place . Patch 142179 fixes it.18:36
timrcnibalizer, mordred Can I submit a pull request the merges our git-review into their repository overwriting whatever it is they did? jk18:36
AJaegerCould you quickly review and approve, please? Otherwise project-config-compare-xml gives wrong failure/success message18:36
timrcs/the merges/that merges/18:36
pleia2hah18:37
dstufftwe have always been at war with golang18:37
jeblairAJaeger: +218:38
*** rmcall has joined #openstack-infra18:38
AJaegerthanks, jeblair18:38
*** teran has quit IRC18:40
openstackgerritJay Pipes proposed openstack-infra/elastic-recheck: Adds E-R query for bug 1312002  https://review.openstack.org/14218318:41
fungiAJaeger: reviewing it now18:41
uvirtbotLaunchpad bug 1312002 in nova "nova cell-show <cell name> causes ValueError: Circular reference detected" [Low,In progress] https://launchpad.net/bugs/131200218:41
jaypipesmriedem: see ^^18:41
fungiAJaeger: great catch there... i was trying to debug that exact error condition without realizing why it was failing18:42
AJaegerthanks, fungi! I should have catched that during review ;(18:42
mriedemjaypipes: wrong bug18:42
mriedemjaypipes: should be https://bugs.launchpad.net/nova/+bug/140316218:42
uvirtbotLaunchpad bug 1403162 in nova "fake_notifier: ValueError: Circular reference detected" [Critical,In progress]18:42
jaypipesmriedem: lol, crap..18:42
mriedemjaypipes: add the build_name too18:43
mriedemmessage:"ValueError: Circular reference detected" AND tags:"console" AND build_name:"gate-nova-python27"18:43
openstackgerritJay Pipes proposed openstack-infra/elastic-recheck: Adds E-R query for bug 1403162  https://review.openstack.org/14218318:44
uvirtbotLaunchpad bug 1403162 in nova "fake_notifier: ValueError: Circular reference detected" [Critical,In progress] https://launchpad.net/bugs/140316218:44
jaypipesmriedem: ^^ thx for your help :) it's my first e-r submission.18:44
*** johnthetubaguy is now known as zz_johnthetubagu18:44
*** dimtruck is now known as zz_dimtruck18:45
*** shashankhegde has quit IRC18:47
openstackgerritJay Pipes proposed openstack-infra/elastic-recheck: Adds E-R query for bug 1403162  https://review.openstack.org/14218318:47
uvirtbotLaunchpad bug 1403162 in nova "fake_notifier: ValueError: Circular reference detected" [Critical,In progress] https://launchpad.net/bugs/140316218:47
*** shashankhegde has joined #openstack-infra18:47
*** rmcall has quit IRC18:48
*** HenryG_ has quit IRC18:48
*** HenryG has joined #openstack-infra18:49
*** HeOS has quit IRC18:49
anteayaAJaeger: thanks for fixing that18:49
clarkbjeblair: that would be really cool18:50
*** rmcall has joined #openstack-infra18:50
anteayayay jaypipes for your e-r submission18:50
*** koolhead17 has joined #openstack-infra18:50
*** koolhead17 has joined #openstack-infra18:50
anteayajaypipes: mriedem is a tough reviewer :D18:50
jaypipesanteaya: heh. you have to be quick to beat mriedem or jogo to the punch ;)18:50
anteayaAJaeger: I was reviewing but can't match the speed of fungi18:51
anteayajaypipes: no kidding18:51
anteayaI don't try, I just gaze in awe18:51
anteayalook at them go, aren't they amazing18:51
adam_gdstufft, re: pip dep resolution. short of a full blown dependency solver, would adding some smarts about versions here be an option?  https://github.com/pypa/pip/blob/develop/pip/req/req_set.py#L119 i dug into pip last time this happened and some basic version logic there seemed to help get correct things installed/detect conflict early, but i assumed that function is purposefully dumb?18:51
*** _nadya_ has joined #openstack-infra18:51
mriedemjaypipes: i had just checked out the local topic branch when you posted that,18:51
mriedemjaypipes: would have beat you if i weren't waiting for dansmith to open the new bug18:52
AJaegeranteaya: thanks for reviewing!18:52
mriedemjaypipes: so i'll accuse you of cheating18:52
jaypipeslol :)18:52
*** zz_dimtruck is now known as dimtruck18:52
openstackgerritMerged openstack-infra/project-config: Generate tarballs for neutron-*aas on tags  https://review.openstack.org/14212618:52
*** gokrokve has joined #openstack-infra18:53
jeblairnibalizer, pleia2: golang git-review does not have anything like our .gitreview file parsing; so you have to clone from gerrit or manually set your origin remote18:53
clarkbwe are down to 6 troublesome images on old nodepool18:53
* clarkb tries to delete them again18:53
*** _nadya_ has quit IRC18:54
AJaegeranteaya: to further continue with the Gerrit ACL checks (https://review.openstack.org/#/c/140821/), we need to have https://review.openstack.org/#/c/141860/ in. Reviews are welcome but nothing urgent.18:54
dstufftadam_g: I'm honetly not sure. I'd need to dig into that. One problem that would need to be solved is that if a later dependency on foo forces you to switch what version of foo you install, then you have to "undo" any versions you added because of foo so you download a different foo and see what versions it depends on18:54
jeblairnibalizer, pleia2: and the first commit was oct 28.18:54
*** vigneshvar has quit IRC18:55
anteayaAJaeger: okay was trying to clear a mindspace to wrap my head around where we are on that18:55
*** che-arne has quit IRC18:55
anteayabtw AJaeger you and armax are two of my favourite people so I am so glad we are working together on this18:55
anteayaAJaeger: I hope you get to meet him at the next summit18:55
AJaegeranteaya: the first patch for that series is in (with the error that 142179 fixed), so we can continue.18:56
AJaegeranteaya: thanks!18:56
armaxAJaeger: apologies for the brainfart18:56
clarkbConnectionError: HTTPSConnectionPool(host='ci-overcloud.tripleo.org', port=13000): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 110] Connection timed out)18:56
clarkbI get that on the remaining 4 images (I got it down to 4 \o/18:56
armaxthose yaml files can be intimidating for the untrained eye18:56
jogojeblair dhellmann: so I am very confused about https://review.openstack.org/#/c/141952/2/specs/non-overlapping-dependency-upgrades.rst,cm bow18:57
jogonow18:57
AJaegerarmax: I should have catched it during review but didn't18:57
armaxAJaeger: I guess those lines can be easy to miss18:57
anteayaarmax: you are amazing18:57
anteayaevery excuse to work with you, I will take18:58
jogojeblair dhellmann: sdague seems to think this isn't an issue ?18:58
armaxanteaya: well, not quite :) I caused more issues than I solved!18:58
AJaegerarmax: thanks for all your work on this, we're getting closer - see my comments above to anteaya !18:58
dhellmannjogo: it turns out the job that was testing for overlapping ranges was turned off sometime in the last few weeks and noone noticed18:58
anteayaarmax: ah I got you involved more in infra18:58
anteayaarmax: which was part of my evil plan18:59
armaxAJaeger: I am happy to help :)18:59
jeblairdhellmann, jogo: it was disabled in june18:59
AJaegerarmax: See your patch in action: http://logs.openstack.org/21/140821/7/check//project-config-gerrit/93b597e/console.html18:59
anteayaopps meeting time18:59
anteayawill review more after meetings18:59
dhellmannjogo: sdague is correct that part of the problem here was ceilometer having to install itself into the swift pipeline18:59
dhellmannjeblair: that long ago? wow18:59
jogodhellmann: overlapping ranges in global-reqs job?18:59
*** fandi has quit IRC18:59
dhellmannjeblair: are you sure? because I'm pretty sure I got an error from that job not long after I capped the oslo lib versions in juno18:59
jeblairdhellmann: if you can find the change where you capped those versions, it would probably be good for us to look at the failures for that at the time19:00
mriedemblarg, trove logs aren't indexed by logstash?19:00
clarkbmriedem: you have to be more specific than that, also the specific list is always available let mdig it up19:00
fungimeeting time!19:00
mriedemclarkb: http://logs.openstack.org/21/140121/8/gate//gate-trove-functional-dsvm-mysql/29dacef/logs/screen-tr-api.txt.gz#_2014-12-16_07_55_08_71719:00
mriedemclarkb: http://status.openstack.org/elastic-recheck/data/uncategorized.html#gate-trove-functional-dsvm-mysql19:00
mriedemhttps://review.openstack.org/#/c/141564/19:01
mriedemsome trove gate job is busted19:01
*** sarob has quit IRC19:01
clarkbmriedem: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml#n2319:01
mtreinishmriedem: just add it the list19:01
mriedemmtreinish: the list of busted stuff?19:01
mriedemclarkb: thanks19:01
mtreinishthe list of indexed files (the one clarkb just linked)19:01
mriedemmtreinish: yeah, doing that now19:01
mriedemgawd! :)19:01
jogomriedem: example patch Ic3b2e33177bdc65fe294ddddd581a93de6c1cb6019:02
dhellmannjeblair: I'll dig some more19:02
SlickNikmriedem: Thanks. Let me know if you want me to submit the patch.19:02
mriedemjogo: yeah i've done this before, for n-meta-api or whatever19:02
jogomriedem: oh right19:02
mriedemSlickNik: np, i've got it19:02
jogodhellmann jeblair: so do we need to change how grenade works?19:02
*** sarob has joined #openstack-infra19:03
SlickNikmriedem: appreciate it much.19:03
jogoand if yes, is it still a priority?19:03
*** bswartz has quit IRC19:03
notmynamejogo: dhellmann: doesn't the testing ignore local requirements.txt and use global requirements to install dependencies? did that change?19:04
dhellmannnotmyname: it didn't change, but pip doesn't always do exactly what we want even when we give it the requirements list19:04
*** pblaho has quit IRC19:05
adam_gdhellmann, sorry, oslo.vmware thing was in stable/icehouse19:05
dhellmannsdague: ew, the etherpad is a mess now19:05
dhellmannadam_g: ah, ok19:05
adam_ghttps://bugs.launchpad.net/openstack-ci/+bug/139581419:05
uvirtbotLaunchpad bug 1395814 in openstack-ci "grenades failing eventlet 0.13.0 is installed but eventlet>=0.15.2 is required by ['oslo.vmware']" [Undecided,Fix released]19:05
sdaguedhellmann: I was trying to move the obsolete stuff off the top of the page, as I spent 5 minutes going through it before noticing the "ignore all this"19:06
dhellmannsdague: ok, the text is all giant though and we lost track of who was saying what between me and fungi19:06
jogodhellmann: so do we still need grenade to support upgrading across non-overlapping python deps?19:07
*** yamamoto has quit IRC19:07
dhellmannjogo: I don't think that's a priority for today.19:07
*** vigneshvar has joined #openstack-infra19:07
jogodhellmann: thanks, so not a priority but do we still need it in the future?19:07
dhellmannjogo: I'm not sure. This plan is still evolving.19:08
sdaguedhellmann: hmph, on my etherpad it kept the author bits, but apparently not on the server. Boo.19:08
*** amuller has quit IRC19:08
*** Rockyg has joined #openstack-infra19:08
jogodhellmann: ok I am dropping that work all together unless I am told otherwise19:08
dhellmannjogo: ok, that seems reasonable19:08
jogodhellmann: assuming its not needed at all for now19:08
*** bswartz has joined #openstack-infra19:08
*** otter768 has joined #openstack-infra19:08
* jogo wonders off to nova land19:11
openstackgerritMatt Riedemann proposed openstack-infra/system-config: Index trove logs for logstash goodness  https://review.openstack.org/14219319:12
mriedemSlickNik: ^19:12
clarkbmordred: fyi one last pep8 issue on your pbr changes19:12
clarkbmordred: if you can update that so we can get shiny +1's then possibly merge that would be excellent19:12
mriedemjogo: ^19:12
dstufftclarkb: mordred did y'all decide not to want the sha normalization thing in the PEP?19:13
*** otter768 has quit IRC19:13
mordreddstufft: yah. we're just going to remove them19:14
dstufftmordred: okay19:14
dstufftless work for me is ok with me19:14
openstackgerritMerged openstack/requirements: pymemcache and sysv_ipc for tooz  https://review.openstack.org/14092019:14
*** Daviey has joined #openstack-infra19:15
SlickNikmriedem: Looks good — thanks!19:20
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for devstack/trove bug 1402227  https://review.openstack.org/14219719:21
uvirtbotLaunchpad bug 1402227 in devstack "trove configuration is broken" [Undecided,In progress] https://launchpad.net/bugs/140222719:21
mriedemjogo: ^19:21
*** ssam2_ has quit IRC19:22
*** weshay has quit IRC19:23
*** weshay has joined #openstack-infra19:23
*** weshay is now known as weshay_bbiab19:24
*** sputnik1_ has joined #openstack-infra19:25
*** sputnik13 has quit IRC19:26
*** achanda has quit IRC19:26
*** garyk has quit IRC19:30
*** ryanpetrello_ has joined #openstack-infra19:30
anteayaAJaeger: good one, yeah not changing an acl to avoid someone following protocol for permissions19:30
dhellmannjeblair: that failure is on a patch that I think landed, and I'm having trouble formulating a query to find it :-/19:31
*** ryanpetrello has quit IRC19:31
*** ryanpetrello_ is now known as ryanpetrello19:31
anteayajeblair: any idea when it landed? or what repo?19:32
AJaegeranteaya: there're two cores - and one is in the release group and the other is not aware of it ;(19:32
openstackgerritMerged openstack-infra/infra-specs: Add Migrate to Zanata spec  https://review.openstack.org/13322219:32
anteayaAJaeger: awesome19:32
openstackgerritAlexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks  https://review.openstack.org/14220219:32
dhellmannanteaya: I reverted the caps on oslo libs in stable/juno in https://review.openstack.org/#/c/138546/ so it would have been some time around then, the failure would be before and the merge would be after19:34
*** dprince has quit IRC19:34
openstackgerritMerged openstack-infra/elastic-recheck: Adds E-R query for bug 1403162  https://review.openstack.org/14218319:35
uvirtbotLaunchpad bug 1403162 in nova "fake_notifier: ValueError: Circular reference detected" [Critical,In progress] https://launchpad.net/bugs/140316219:35
dhellmannanteaya: I don't know what repo it was, but it was probably in oslo somewhere19:35
anteayahmmm19:35
dhellmannmaybe I'm mis-remembering, and it was another requirements job that failed19:36
dhellmannmaybe I extrapolated that this other job would also fail, but didn't actually see it19:36
openstackgerritAlexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks  https://review.openstack.org/14220219:36
anteayadhellmann: well here are the merged requirements patches: https://review.openstack.org/#/q/project:openstack/requirements+status:merged,n,z19:36
*** ihrachyshka has quit IRC19:37
anteayanot very complex but I'm not sure what else to search for19:37
openstackgerritMerged openstack-infra/project-config: Fix project-config-compare-xml  https://review.openstack.org/14217919:38
dhellmannanteaya: I'm looking at http://bit.ly/1DHTOTL now but can't seem to make it search for comments from jenkins about requirements job failures19:38
*** _nadya_ has joined #openstack-infra19:39
*** mpaolino has quit IRC19:40
*** ivar-lazzaro has quit IRC19:41
openstackgerritMerged openstack-infra/project-config: Remove requirements overlap check  https://review.openstack.org/14215219:42
anteayaoh getting it to search on comments from jenkins19:45
anteayanot sure as I have ever tried to do that19:46
fungiyou can search on negatove verification votes19:46
funginegative19:46
fungilabel:Verification=-119:46
fungii think19:46
fungibut breaking that down to specific jobs would be harder19:47
anteayayes19:47
anteayabut searching the comments19:47
anteayaI don't know if I have seen that19:47
*** hdd has quit IRC19:48
*** markmcclain has quit IRC19:49
anteayadhellmann: https://review.openstack.org/#/q/project:%255Eopenstack/oslo.*+branch:master+label:Verified%253D-1,n,z19:49
*** markmcclain has joined #openstack-infra19:49
anteayabut that just might be the most recent verification vote19:49
dhellmannthe patch is merged now, so would it still have that label?19:50
dhellmannyeah19:50
openstackgerritChristian Berendt proposed openstack/requirements: Bump version of openstack-doc-tools >= 0.21  https://review.openstack.org/14207619:50
sdagueanteaya: well, except it's the last vote19:50
anteayanot sure if you could search on patches that have failed in teh past19:50
anteayasdague: yeah19:50
sdagueyou probably would need to hit the gerrit cli directly19:50
anteayadhellmann: so no it wouldn't have that if it was merged19:50
dhellmannI've tagged oslo.db 1.0.3 and am waiting for it to build19:50
sdagueand go through all patches19:50
dhellmannanteaya; yeah, that's what I thought19:50
*** koolhead17 has quit IRC19:50
anteayadhellmann: :(19:51
dhellmannanteaya: I'll spend more time looking after my meetings this afternoon19:52
anteayadhellmann: kk19:52
*** koolhead17 has joined #openstack-infra19:52
*** CICoverageBuilds has joined #openstack-infra19:52
*** emagana has quit IRC19:53
*** markmcclain has quit IRC19:53
openstackgerritAlexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks  https://review.openstack.org/14220219:53
openstackgerritAlexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks  https://review.openstack.org/14220219:55
*** hdd has joined #openstack-infra19:55
*** markmcclain has joined #openstack-infra19:56
*** pfalleno1 has quit IRC19:56
*** pfallenop has joined #openstack-infra19:57
*** koolhead17 has quit IRC19:57
openstackgerritAlexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks  https://review.openstack.org/14220219:57
*** rmcall has quit IRC19:58
*** dims_ has quit IRC19:58
*** rmcall has joined #openstack-infra19:59
*** dims has joined #openstack-infra19:59
openstackgerritAlexandre Viau proposed openstack-infra/project-config: python-surveilclient: Added gate checks  https://review.openstack.org/14220220:00
*** kgiusti1 has joined #openstack-infra20:01
*** kgiusti has quit IRC20:01
pleia2we didn't get to this, but it is time sensitive (Tracy's AWS instance is going non-free and she asked us for help) so if we could make a decision here it would be good: http://lists.openstack.org/pipermail/openstack-infra/2014-December/002247.html20:02
AJaegerSince we run over time, I couldn't bring up my request for reviews of infra-manual. Would be great if we could move forward there...20:03
jeblairpleia2: what decision needs to be made?20:03
*** sabeen2 has joined #openstack-infra20:03
fungipleia2: i think mikal offered to host that for her? could work as a temporary solution until someone puppets the service (assuming it's worth us hosting longer term)20:03
pleia2jeblair: whether we bring in the nova dashboard into infra as is (and how - make new project? pull for github) or let mikal host it20:03
*** dims has quit IRC20:03
*** dkranz has quit IRC20:03
pleia2until we can integrate with reviewday20:04
pleia2fungi: long term we want to integrate it with reviewday, so no new puppet module needed, probably just changes to the current reviewday one20:04
pleia2but that's not going to happen before her server goes away20:04
sdagueclarkb: on https://review.openstack.org/#/c/141831/1/zuul/layout.yaml,cm  is there a limit to the # of \. ?20:04
*** e0ne has joined #openstack-infra20:05
jeblairpleia2: i see no reason why we can't run an additional service if people find it useful.  what we run is controlled by puppet, so someone would need to write some code to handle the new service20:05
clarkbsdague: not other than each set of digits must be prepended with . except for the first20:05
*** MaxV has joined #openstack-infra20:05
jeblairbut anyone is free to do that at any time.20:05
*** sabeen1 has quit IRC20:05
*** _buzz has joined #openstack-infra20:05
fungii see no problem with us running it as a stand-alone service (puppeted obviously) until such time as it can be more properly folded into reviewday mk ii or whatever20:06
pleia2ok, great20:06
*** lttrl has quit IRC20:06
*** Masahiro has joined #openstack-infra20:06
pleia2so should we create a new project for it in openstack-infra? (it's on github now)20:06
*** sputnik1_ has quit IRC20:06
*** sweston has quit IRC20:07
fungiit's not necessary that we control upstream git for every application we host20:07
*** sweston has joined #openstack-infra20:07
anteayapleia2: sorry what am I missing that creating a new project is the solution20:07
pleia2even better20:07
fungiafter all, we run lots of things which aren't20:07
anteayaI thought she was running an instance of reviewday20:07
pleia2anteaya: no, completely different code20:07
*** yamamoto has joined #openstack-infra20:08
pleia2thanks fungi and jeblair, I'll update the interested parties accordingly to see who wants to do the work ;)20:08
*** aysyd has quit IRC20:08
anteayaoh sorry20:08
*** lttrl has joined #openstack-infra20:09
clarkbmordred: any chance we can get pep8 fixed on the pbr change?20:09
*** Masahiro has quit IRC20:11
openstackgerritMerged openstack-infra/elastic-recheck: Add query for devstack/trove bug 1402227  https://review.openstack.org/14219720:11
uvirtbotLaunchpad bug 1402227 in devstack "trove configuration is broken" [Undecided,In progress] https://launchpad.net/bugs/140222720:11
mordredclarkb: I have re-uploaded20:11
*** yamamoto has quit IRC20:12
clarkbmordred: I don't see it20:12
*** shashankhegde has quit IRC20:13
clarkbmordred: I am leaving a ocmment on the line20:13
fungithere are two versions of it, right? the backport and the master tip20:13
clarkbmordred: its on 14166720:13
fungioh, and 141666 is failing too, but a lot worse20:14
* mordred is not touching tip for now20:16
mordreduntil we get feature/0.10 _sorted_20:16
*** MaxV_ has joined #openstack-infra20:16
clarkb+120:17
*** esker has quit IRC20:17
clarkbmordred: ok jenkins commented too so 141667 should hae the info you need to fix20:17
*** dims has joined #openstack-infra20:18
mordredclarkb: oh - I didn't type yet20:18
mordredyes20:18
mordrednew version should be up now20:18
*** MaxV has quit IRC20:19
clarkbmordred fungi jeblair: https://storyboard.openstack.org/#!/story/2000082 is the new bug I discovered cleaning up old nodepool20:19
*** emagana has joined #openstack-infra20:19
*** MaxV_ has quit IRC20:20
*** MaxV has joined #openstack-infra20:20
clarkbold nodepool is down to 4 stubborn tripleo rh1 images. all nodes are deleted though20:20
clarkbwe can likely shut it down as is and deal with those images separately20:21
*** koolhead17 has joined #openstack-infra20:21
clarkbmordred: thank you I am +2 on both now20:23
fungiclarkb: wow, really? that could account for some of the alien node "leaks" i was seeing previously20:23
clarkbfungi: I also see that many alien nodes are simply in the process of being deleted by the provider so show up in nova listings20:24
clarkbfungi: but then go away after a short while20:24
clarkbthough it is harless to delete those again20:24
*** dizquierdo has joined #openstack-infra20:24
fungiclarkb: yep, my search for alien nodes involves generating the list, then sleeping for 10 minutes, then generating the list again and only recording the instance uuids which were present in both20:25
clarkbso the rh1 cloud is really unhappy with us20:25
clarkbeven listing alien nodes I get that token error20:25
*** andreykurilin_ has joined #openstack-infra20:25
*** koolhead17 has quit IRC20:26
*** dstufft has quit IRC20:27
*** teran has joined #openstack-infra20:28
fungimordred: i am a little worried that there's no record in gerrit of addressing lifeless's expressed concern in 141667 (which is now more appropriately directed at 141946)20:29
fungii mean, i know it got hashed over some more in here, but he probably won't see it due to travel, et cetera20:31
*** prad has joined #openstack-infra20:32
*** prad has quit IRC20:33
*** ddieterly has quit IRC20:35
*** doug-fish has quit IRC20:37
*** cdent has quit IRC20:38
pc_mdhellmann: ping20:39
*** ddieterly has joined #openstack-infra20:40
*** franred has quit IRC20:40
clarkbok rh1 is not cooperative so I think we don't wait on that to remove old nodepool.o.o. My vote is to delete it now but would be good to get at least one other set of eyes to look at it quickly20:41
fungiclarkb: checking it out now20:41
fungiclarkb: tripleo-test-cloud is the old hp1 not rh1, righth?20:42
clarkbfungi: yes that sounds right.20:42
fungii believe there's a nodepool config change pending to connect us to the new hp120:42
pc_mCan anyone tell me where we are with the grenade issue (SQLAlchemy version)? I saw mention of 141927, but the comments seem to indicate another approach being taken?20:42
fungiclarkb: okay, the old precise nodepool.o.o looks safe to tear down20:43
fungiclarkb: pretty sure those remaining instances no longer exist because the cloud it thinks they're still in has been rebuilt from scratch a while ago20:43
fungis/instances/images/20:43
*** pelix has quit IRC20:44
*** doug-fish has joined #openstack-infra20:44
*** mrunge_gone has quit IRC20:44
openstackgerritClark Boylan proposed openstack-infra/system-config: Remove nodepool-dev as it is becoming nodepool.o.o  https://review.openstack.org/14221620:45
openstackgerritSteve Baker proposed openstack-infra/project-config: Don't run check-heat-dsvm-functional-mysql in stable/juno  https://review.openstack.org/14221720:45
clarkbfungi: gotcha20:45
fungipc_m: there is an oslo.db 1.0.3 release about an hour ago, and a requirements pin in flight for pinning oslo.db to <1.1 in stable/juno20:45
clarkb142216 is part of the nodepool cleanup too20:45
*** ChuckC has quit IRC20:46
clarkbjeblair: when you finish with meeting let me know if you concur that old nodepool.o.o can be deleted20:46
pc_mfungi: nice! Do you know the commit # for the requirements pin?20:46
clarkbI am going to go ahead and update dns now20:46
fungipc_m: https://review.openstack.org/14218020:46
fungiclarkb: sounds good20:46
pc_mfungi: Thanks!20:46
clarkbhrm I actually need to go catch a bus nowish if I am going to make it to this openstack hacking thing20:47
fungiwhich is about to finish in the check pipeline and could stand one more +2 and an approval20:47
clarkbso I will do that then cleanup nodepool from there20:47
fungik20:47
clarkbfungi: approved the reqs change20:48
*** HeOS has joined #openstack-infra20:49
*** ddieterly has quit IRC20:49
fungithanks!20:49
fungidhellmann: ^20:50
armaxAJaeger: do you want me to look into the failure for the project-config-gerrit job?20:50
AJaegerarmax: I just commented on it ;)20:50
*** dmsimard is now known as dmsimard_away20:50
armaxAJaeger: you beat me to it then20:50
*** sputnik13 has joined #openstack-infra20:51
armaxAJaeger: nice one20:51
*** shashankhegde has joined #openstack-infra20:51
*** unicell has quit IRC20:51
AJaegerarmax: a previous version of that merged yesterday (run last week), we introduced already some non-normalized files ;(20:51
AJaegerarmax: so yeah, this patch is helpfull...20:51
*** carl_baldwin has quit IRC20:52
AJaegerarmax: But you could look what needs to be done for other namespaces so that we can run the job for openstack-infra and openstack as well...20:52
armaxAJaeger: will do20:53
AJaegerarmax: let's see whether we get some reviews for https://review.openstack.org/#/c/141860/ and https://review.openstack.org/#/c/140821/ by the cores to move forward here. anteaya wanted to continue reviewing after meetings, so hope these are on her list20:53
AJaegerarmax: thanks20:53
*** tonytan4ever has quit IRC20:54
anteayaAJaeger: they are on my list20:54
AJaegerthanks, anteaya20:55
*** carl_baldwin has joined #openstack-infra20:55
jeblairclarkb: ++del nodepool20:57
*** _nadya_ has quit IRC20:57
armaxAJaeger: I may need to tweak the normalize_acl script to include other formatting exceptions20:58
*** Rockyg has quit IRC20:59
AJaegerarmax: fungi has written the normalize_acl script, I suggest you talk with him. I'm fine with changing it as needed in general.20:59
armaxAJaeger: right, I need to tweak the transformation that I added21:00
*** Rockyg has joined #openstack-infra21:00
armaxAJaeger: I’ll post a patch to show you what I mean21:00
*** salv-orlando has quit IRC21:00
fungii'm also fine with that script being simplified/rewritten. it was initially added as a stepping-stone to perform a series of different normalizations across the entire repo as individual changes21:00
*** chuckC_ has joined #openstack-infra21:00
*** salv-orlando has joined #openstack-infra21:01
*** dstufft has joined #openstack-infra21:01
fungibut if it's going to get used for enforcement going forward, then there's a lot of optional complexity which it no longer needs21:01
krotscheckfungi: https://review.openstack.org/#/c/140466/ passed21:02
AJaegerfungi, please have again a look at 140821 on what armax is doing with it...21:02
*** amitgandhinz has quit IRC21:03
anteayaAJaeger: reviewed, I would like to see 141860 merge first but this is my idealist side talking21:03
*** MaxV has quit IRC21:03
*** amitgandhinz has joined #openstack-infra21:04
AJaegeranteaya: yeah, my preference as well - let's see whether fungi or sdague find time for 141860 (please;)21:04
anteayayeah it isn't a fire so I wasn't going to push21:05
anteayabut good work here from both you and armax, AJaeger21:05
anteayathank you21:06
* AJaeger calls it a day, good night!21:06
armaxanteaya: I think after the last patch from AJaeger, we could extend the check ot the openstack namespace21:06
armaxanteaya: I’ll follow uo21:06
jeblairanteaya: prvd21:06
*** koolhead17 has joined #openstack-infra21:06
armax*up21:06
AJaegerarmax: the -release might needs tweaking21:06
AJaegerok, bye and thanks anteaya and armax!21:06
*** AJaeger has quit IRC21:06
armaxAJaeger: right, and the stable-maint21:07
anteayajeblair: thanks21:07
anteayaarmax: thank you21:08
*** otter768 has joined #openstack-infra21:09
fungiso many pings. i'll catch up after the cross-project meeting21:09
*** ChuckC has joined #openstack-infra21:11
*** koolhead17 has quit IRC21:12
*** otter768 has quit IRC21:14
mattoliverauMorning21:14
anteayamorning mattoliverau21:15
*** weshay_bbiab is now known as weshay21:16
openstackgerritMerged openstack-infra/project-config: Normalize ACLs  https://review.openstack.org/14186021:18
openstackgerritMerged openstack-infra/subunit2sql: Add a contributing file  https://review.openstack.org/14196821:18
*** kgiusti1 has quit IRC21:19
*** andreaf has quit IRC21:21
*** koolhead17 has joined #openstack-infra21:22
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Plugins may now register cron workers.  https://review.openstack.org/12960921:24
anteayaarmax: so I would like to merge https://review.openstack.org/#/c/140821/ now21:24
anteayaarmax: you said you wanted to tweak21:24
anteayaarmax: can I convince you to tweak in a follow up patch?21:25
anteayaI would like to get the job running as it is on current and new acl changes21:25
armaxanteaya: it can be done in a follow-up patch, IMO21:26
anteayathanks21:26
* anteaya +As21:26
armaxanteaya: I want to see if we can extend the check to other namespaces21:26
*** dkranz has joined #openstack-infra21:27
armaxanteaya: but to do so, I may need to relax the normalization logic a bit, but not a big deal21:27
*** dizquierdo has quit IRC21:28
*** MaxV has joined #openstack-infra21:29
openstackgerritMerged openstack-infra/project-config: Don't run check-heat-dsvm-functional-mysql in stable/juno  https://review.openstack.org/14221721:30
anteayaarmax: fair enough21:31
anteayaI would like to check all the namespaces as well, if possible21:31
*** koolhead17 has quit IRC21:32
fungiarmax: at least the initial state of the script does apply sanely to all namespaces21:33
fungiyour additions might need some adjustment to accomodate different namespaces though21:33
armaxfungi: indeed21:33
fungiand we probably need another cleanup pass since we're not enforcing anything at the moment21:34
*** emagana has quit IRC21:34
armaxfungi: correct21:34
*** bdpayne has quit IRC21:34
fungialso, an unfinished part of the reason i started normalizing those acls at all is so that we can identify some which are identical and collapse them in the git repo, replacing them with acl-path references in projects.yaml21:36
*** esker has joined #openstack-infra21:36
*** julim has quit IRC21:36
dkranzfungi: I see the juno problem has cleared. Is the grenade issue supposed to be fixed? My patch is failing grenade but in theory my change could be at fault.21:36
*** MaxV has quit IRC21:37
clarkbI approved the reqs change. if that merged we shouldbe working21:37
*** ddieterly has joined #openstack-infra21:37
openstackgerritMerged openstack-infra/project-config: Check that Gerrit ACL files are normalized  https://review.openstack.org/14082121:38
fungiclarkb: there are 18 changes ahead of it in the gate21:41
*** emagana has joined #openstack-infra21:42
*** dprince has joined #openstack-infra21:43
*** baoli has quit IRC21:43
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Extend ACL checks to OpenStack namespace.  https://review.openstack.org/14223021:43
armaxfungi: ^^^, there should be a project that’s not complying now: /openstack/ossa.config21:44
*** dizquierdo has joined #openstack-infra21:44
fungiyep21:45
fungii saw that one go in without alphabetization21:45
jheskethMorning21:46
fungii think there were quite a few actually for the stable branch management split out too21:46
anteayamorning jhesketh21:46
*** mrmartin has quit IRC21:47
jeblairnibalizer, fungi, clarkb, asselin: so there's a whole slew of changes to get rid of hardcoded variables in the openstack_project module.  see https://review.openstack.org/#/q/topic:mosi,n,z21:50
*** sputnik13 has quit IRC21:51
*** sputnik1_ has joined #openstack-infra21:51
jeblairSergeyLukjanov and company are proposing them; i'm assuming it's from an effort to make openstack_project itself more reusable21:51
fungijeblair: yep, i've gone through a few so far, some have been approved21:52
jeblairdoes the overall direction seem like something we should do?21:52
*** dizquierdo has quit IRC21:52
fungimostly they just need more eyes, and in a few cases some guidance on whether the things they're doing make sense (like extracting every valuable into a class variable)21:52
fungis/valuable/variable/21:53
jeblairyeah, i'm kind of wondering whether it makes sense in all cases21:53
*** Longgeek has quit IRC21:53
*** mbacchi has quit IRC21:53
fungimy primary worry with those is that they're adding a lot of knobs indiscriminate of whether they're things which sanely benefit from being changeable21:54
SergeyLukjanovjeblair, yeah, that's correct, it's part of our activity to make infra more re-usable, one of the future plans - guide for building single node "infra" for dev/test21:55
*** dmsimard_away is now known as dmsimard21:55
*** Masahiro has joined #openstack-infra21:55
jeblairso if we take https://review.openstack.org/#/c/133705/ as an example21:55
jeblairSergeyLukjanov: how does that help?21:56
jeblairit lets you override the elasticsearch version21:56
jeblair(real question -- just wondering what the use case is)21:57
* asselin reading21:57
*** dustins has quit IRC21:57
SergeyLukjanovjeblair, the latest er release is 1.4.X i think and AFAIK it'll work good with current puppet scripts21:57
jeblairnibalizer: i'm also curious as to how this would fit in with the idea of putting more config info in hiera/yaml21:57
*** mpaolino has joined #openstack-infra21:58
*** mpaolino has quit IRC21:58
mriedemwho is hosting triple-o provided VMs in CI?21:59
asselini'm in favor of making this reusable21:59
*** timcline has left #openstack-infra21:59
mriedemlooking at http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#n98021:59
jeblairasselin: yeah, i'm just not seeing the big picture of how it accomplishes that21:59
*** dangers is now known as dangers_away21:59
SergeyLukjanovjeblair, honestly, some of the stuff has been probably extracted prematurely while the first iteration on puppet manifests, if you have some objections for extracting some parameters than it's a confirm for it :(21:59
jeblairmriedem: the tripleo project21:59
asselinjeblair, I got some questions about where to put the reusable bits21:59
*** Masahiro has quit IRC22:00
fungimriedem: hpcloud and red hat i believe are the sponsors providing teh hardware resources for that22:00
mriedemfungi: ok, thanks22:00
jeblairmriedem: but the tripleo project runs the clouds22:00
mriedemyeah, didn't see info here https://wiki.openstack.org/wiki/TripleO22:00
mriedemor here really https://github.com/openstack-infra/tripleo-ci/blob/master/README.md22:01
*** rmcall has quit IRC22:01
*** melwitt has quit IRC22:01
asselinjeblair, other opinions on reuseable are here: https://review.openstack.org/#/c/138913/22:01
asselinin comments22:01
fungimriedem: they also have a #tripleo channel where they are possibly more likely to see discussions and answer questions22:01
*** melwitt has joined #openstack-infra22:02
*** melwitt has quit IRC22:02
*** melwitt has joined #openstack-infra22:02
*** bswartz has quit IRC22:02
*** rmcall has joined #openstack-infra22:03
mriedemfungi: i got what i needed, i wrote a little yaml parser to separate out max-servers per provider in nodepool.yaml and rax/hp is obvious, i just wasn't sure about triple-o22:03
dhellmannfungi, clarkb : thanks for reviewing that requirements patch for stable/juno22:03
*** sputnik1_ is now known as sputnik1322:03
*** ayoung has quit IRC22:04
jeblairor this one: https://review.openstack.org/#/c/133710/22:04
jeblairi'm not sure why the vhost root or directory should be parameters?22:05
jeblairso is that the sort of thing we should comment on in review?22:05
jeblairlike: it's okay to have the admin user as a parameter, because maybe you want to run a groups server with different admins and a different name, but it doesn't make sense to have different filesystem paths?22:06
nibalizerjeblair: so they absolutely open the door for configuration to be put in hiera22:06
*** ivar-lazzaro has joined #openstack-infra22:07
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Plugins may now register cron workers.  https://review.openstack.org/12960922:07
*** ivar-lazzaro has quit IRC22:07
*** rlandy has quit IRC22:07
jeblairi think the reason i'm having trouble with this is that i think it's step 4 of the plan, which we deferred until we had experience with other parts of it22:08
jeblairincluding the config in hiera part, which we still haven't really done22:08
*** ivar-lazzaro has joined #openstack-infra22:08
jeblair(and that was step 1)22:08
*** gmurphy has joined #openstack-infra22:09
clarkbok back22:09
clarkbI am going to do nodepool things now22:09
jeblairstep 2 is in progress (module split) and step 3 is mostly done, project-config split22:09
clarkbjeblair: I haven't looked closely at those changes but in general I agree I think its mixing order22:09
*** dimtruck is now known as zz_dimtruck22:10
jeblairbasically, i think we know that having too much stuff in openstack_project is a problem22:10
nibalizerjeblair: i dont see the advantage of those patches22:11
nibalizerin the early sets of "remove hardcoded variables" i tried to argue that they were kinda pointless and not the right place to put abstractions22:11
asselinjeblair, there's a big question as to where to put the reusable parts. Leave them in openstack_project, or move somewhere else?22:11
nibalizerbut I dont really have the confidence to -1 20 patches and keep -1ing forever so i've kinda been shouted out of that conversation it feels like22:12
jeblairasselin: i agree, and i don't think we've answered that yet22:12
*** mattfarina has quit IRC22:14
asselinI was thinking of adding a new module to system-config called e.g. openstack_shared or openstack_components, or something else that would contain the parts designed for reuse22:15
jeblairasselin: or perhaps the solution is to continue to refine the puppet modules we have so that they have better / more complete interfaces22:16
jeblairin other words, shrink the contents of openstack_module to a minimum so that it does not need to be re-used22:17
asselinjeblair, +1 on making openstack_module non-reuseable22:17
jeblairi'm starting to think that we're not ready for this set of patches, at least not without some discussion and agreement first22:17
jeblairSergeyLukjanov: do you think we could WIP them for now and write a spec first?22:18
asselinjeblair, but, in the example of a ci "log server", there is no puppet module. Do we create one? It's really a collection of misc items put together to build a server.22:19
jeblairasselin: yeah, that and also a 'zuul+nodepool' are good examples of things that we have assembled that should be reusable.  so maybe we should create puppet modules for those things and then use them22:19
clarkbnodepool.o.o A and AAAA records are updated. TTL is 5 minutes22:20
clarkbremoving nodepool-dev.o.o records now22:20
asselinjeblair, right, but creating a puppet module for each seems overkill to me. I was thinking of having one puppet module to contain all of those.22:20
*** hashar has joined #openstack-infra22:21
clarkbthats all done. Now to delete the old node completely22:21
*** dkliban is now known as dkliban_afk22:21
*** markmcclain has quit IRC22:22
jeblairasselin: on the one hand, we're getting good at creating puppet modules (thanks ;), on the other hand, maybe "openstack_infra::nifty_log_system" and "openstack_infra::really_cool_ci_system" might be more convenient.22:22
*** markmcclain has joined #openstack-infra22:22
asselinjeblair, agree with that22:23
fungijeblair: asselin: the expressed use case seems to be "i want a module to be able to run a clone of openstack-infra but with the freedom to change any hard-coded values therein"22:23
fungirather than "i want to piecemeal a bunch of modules and classes together with my own manifests"22:23
*** lttrl has quit IRC22:24
*** markmcclain has quit IRC22:24
clarkbok delete submitted now we wait22:24
*** markmcclain has joined #openstack-infra22:24
funginot sure that's a realistic goal, but it's where that change series is focused22:24
jeblairfungi: yeah, but that's use-case that sort of embeds the solution to an implied problem in it, rather than expressing the problem :)22:24
openstackgerritAdrian Turjak proposed openstack-infra/project-config: Add new Openstack-Pydashie project  https://review.openstack.org/14224022:24
fungijeblair: agreed22:24
jeblairso i look at the changes and have trouble saying "does this help with the problem it's trying to solve" and have trouble :/22:25
*** alex7376 has joined #openstack-infra22:25
*** asettle has joined #openstack-infra22:25
jeblairand repeat myself22:25
fungii can only assume this spun out from the mirantis effort to offer openstack-infra-as-a-service22:25
clarkbold one is gone22:25
asselinfungi, if we split out the resuable components correctly, the openstack_project is really just a bunch of configurations like project-config22:25
*** markmcclain has quit IRC22:25
*** asettle has quit IRC22:25
clarkbok now to catch up on everything else22:25
*** amitgandhinz has quit IRC22:25
*** markmcclain has joined #openstack-infra22:26
fungimy guess is that it's an internal fork they're running now, and want to upstream as much of as they can, but doesn't necessarily match our proposal for decomposing and making all this ultimately reusable for other use cases22:26
jeblairasselin: yeah, and that's where config-in-hiera becomes relevant -- because puppet itself may not be the best way to supply that info, hiera may be22:26
openstackgerritAdrian Turjak proposed openstack-infra/project-config: Add new Openstack-Pydashie project  https://review.openstack.org/14224022:26
*** gmurphy has left #openstack-infra22:27
fungior am i confusing mirantis with enovance?22:27
jeblair(so instead of making a class that says "this is a log server with the hostname logs.openstack.org", we just have some values in hiera)22:27
SergeyLukjanovfungi, we're not going to provide infra-aas, we just already have too many installation of it's parts22:27
*** doug-fish has left #openstack-infra22:27
*** vigneshvar has quit IRC22:27
SergeyLukjanovfungi, it's enovance22:27
fungiSergeyLukjanov: oh, that's right. mirantis is using a lot of it internally22:27
clarkbI have a bunch of +2 on https://review.openstack.org/#/c/141831/ any opposition to me self approving?22:27
*** alex7376 is now known as asettle22:27
nibalizerjeblair: agee22:28
jeblairclarkb: go for it22:28
SergeyLukjanovfungi, in fact it includes stuff like 3rd party CIs (sahara, murano, trove probably)22:28
SergeyLukjanovjeblair, re spec - do you mean to push some kind of "extract hardcoded hostnames and urls" spec?22:29
*** doug-fish1 has joined #openstack-infra22:29
SergeyLukjanovjeblair, fungi, one of the main ideas of such extraction was to make contributors able to test anything locally w/o changing all of the hardcoded stuff22:30
SergeyLukjanovjeblair, fungi, because now you'll always will face some internally hardcoded .openstack.org hostnames and urls even if you want to test installation of some servises22:31
SergeyLukjanovthe split initiative could solve it eventually22:31
SergeyLukjanovbut extraction will be needed for making split successful ;)22:31
SergeyLukjanovif you think that split should be done first - I think we could take some subprojects to work on22:31
nibalizerjeblair: i am in favor of the openstack_project::<someapp> class that calls classes and resource from the <someapp> module22:32
nibalizerthis is a great way to set things up and I've used it before22:32
nibalizerit lets openstack specific users and backup logic and coordinatoion live in the openstack space and lets the module do one thing right22:32
openstackgerritJames Carey  proposed openstack-dev/hacking: Add optional hacking checks  https://review.openstack.org/13405222:32
SergeyLukjanovsorry, /me falling asleep (already 1:30am)22:33
jeblairSergeyLukjanov: oh, sorry we can pick this up later, thanks! :)22:33
*** matel has joined #openstack-infra22:33
*** matel has quit IRC22:33
jeblairImportError: No module named unittest222:34
jeblairso i get that when i try to run zuul's unit tests locally22:35
jeblairthat's from testtools22:36
openstackgerritMerged openstack-infra/project-config: Make prerelease and release pipelines match pep440  https://review.openstack.org/14183122:36
*** cnesa has quit IRC22:36
*** pc_m has quit IRC22:36
mordredjeblair: yes - that was fixed by something a while ago22:38
* mordred can't remember the root cause/fix ... clarkb ^^^ do you remember?22:38
EmilienMfungi: are you talking about software factory?22:38
*** Rockyg has quit IRC22:39
EmilienMtristanC: ^22:39
fungiEmilienM: possibly. i didn't remember the name of it22:39
clarkbmordred: uh22:39
asselinnibalizer, anteaya clarkb fungi, is this a good time to discuss the pre puppet module split proposal?22:39
EmilienMfungi: if you talk about OpenStack CI as a service, yes.22:39
nibalizerim available22:39
EmilienMfungi: https://github.com/enovance/software-factory22:40
fungiEmilienM: ahh, yep--that's definitely what i was thinking of22:40
*** CICoverageBuilds has quit IRC22:40
anteayaasselin: I'm around22:40
EmilienMfungi: tristanC is one of the core developers on this project. just FYI22:40
*** esker has quit IRC22:40
asselinanteaya, nibalizer ok, let's just start with us and go from there22:41
anteayaokay22:41
* anteaya listens to asselin22:41
clarkbmordred: no I do not recall, but I seem to remember that we needed to update testtools22:41
clarkbmordred: so maybe jeblair has stale venvs?22:41
* mordred lookng at zuul tree22:41
jeblairclarkb: rm -rf .tox was the first thing i tried22:41
*** dprince has quit IRC22:41
asselinso the idea is to simplify the process a bit since there are quite a few modules to do22:42
boris-42clarkb: hi there22:42
mordredjeblair: any chance you wound up with testtools 1.2.0 installed in the venv?22:43
boris-42clarkb: recently (seems like not more than few days) we start getting such warnings http://paste.openstack.org/show/152045/22:43
boris-42clarkb: do you know something about that?22:43
asselinnibalizer, anteaya I can understand the contention on the 2nd patch: https://review.openstack.org/#/c/140548/ especially w.r.t merge conflicts22:43
mordredjeblair: we added an exclude: testtools>=0.9.36,!=1.2.022:43
mordredfor other things22:43
boris-42clarkb: seems like not only related to rally22:43
mordredbecause of evil22:43
*** changbl has quit IRC22:43
nibalizerso one idea is we could just laeve 140548 up as a review22:43
nibalizerand copy/paste stuff out of it when we need to22:43
asselinnibalizer, anteaya but I think the first patch should be lower-risk and straight-forward: https://review.openstack.org/#/c/140523/22:43
nibalizerthe problem that clarkb brought up is valid22:44
asselinnibalizer, that's a good idea22:44
nibalizerwhich is that thats a huge patch and hard to reviews22:44
clarkbboris-42: ya you need to downgrade setuptools22:44
nibalizerisn't there a middle ground?22:44
clarkbboris-42: until we get a release of pbr out that fixes this22:44
anteayaasselin: two items brought up at the infra meeting today22:44
boris-42clarkb: Oh thank you sir!22:44
jeblairmordred: Source in ./.tox/py27/build/testtools has version 1.5.0, which satisfies requirement testtools>=0.9.3222:44
nibalizerinstead of 1 module at a time and all modulues at a time, we could pick 10 modules to do in a 2 week period and do those?22:44
anteayaasselin: 1) we need to follow the spec and only include the projects identified in the spec22:45
clarkbboris-42: you want <8.022:45
anteayaasselin: 2) names with both hyphens and underscores are currently a blocker22:45
mordredjeblair: k. well, I just ran tox -epy27 -r locally in zuul and it worked22:45
anteayaasselin: can you spin up a new patch that addresses those two points?22:45
asselinanteaya, both are easy to fix. First, I'd like to get agreement onthe direction. otherwise we can just abandon22:45
anteayaasselin: you had suggested perhaps removing projects with underscores for the moment22:46
jeblairmordred: jenkins works too22:46
mordredhrm22:46
* mordred tries to remember what the unittest2 problem was22:46
*** ociuhandu has quit IRC22:46
anteayaasselin: well sometimes the general agreement becomes disagreement when we can't address the details22:46
mordred(it's one of those where I _believe_ not having unittest2 isn't actually the problem)22:46
anteayaasselin: that is just part of the workflow22:46
anteayaasselin: you don't have a agreement now22:47
anteayaasselin: if you are willing to put up another patchset you might get agreement, or you might not22:47
mordredjeblair: just to cover bases - what version of tox do you have?22:47
anteayaasselin: it is a risk and I can't give you a guarentee22:47
jeblairmordred: 16122:47
mordredok. I'm on 1.8.022:47
anteayaasselin: the only thing I can pretty much guarentee is that I won't merge as it is right now22:48
mordredgimme a sec - lemme test 1.6.122:48
asselinanteaya, ok, so then I'll assume then at least there's no strong disagreement, e.g. -2.22:48
*** carl_baldwin has quit IRC22:48
anteayathere is no -2 on the patch correct22:48
asselinanteaya, no, not yet....22:48
anteayaso if someone wanted to -2, they have had a chance and haven't22:48
anteayaI never know what someone else will do22:48
fungidhellmann: the juno global-reqs change just merged22:48
anteayaall I can say is that that patch right now, needs work in my opinion22:49
asselinanteaya, ok, so I will do 1) we need to follow the spec and only include the projects identified in the spec22:49
mordredfungi: ^^ do you remember the unittest2 testtools thing from a couple of weeks ago?22:49
*** carl_baldwin has joined #openstack-infra22:49
fungithe gate's in remarkably great shape... just saw 14 changes merge from the integrated change queue in one shot22:49
*** chuckC_ has quit IRC22:49
*** alexpilotti_ has joined #openstack-infra22:49
fungimordred: yeah, it's a little fuzzy now22:49
asselinanteaya, nibalizer I can split out these into a separate patch:  2) names with both hyphens and underscores are currently a blocker22:49
*** alexpilotti_ has quit IRC22:49
anteayaasselin: I think you are hearing what I am saying22:50
anteayaasselin: which heartens me22:50
*** alexpilotti has quit IRC22:50
mordredjeblair: ftr, 1.6.1 works for me too. here's the bug: https://bugs.launchpad.net/devstack/+bug/139300622:50
anteayaasselin: if you offer another patch I will review it22:50
fungimordred: there were some bugs in our projects which it exposed, but also bugs resulting in another minor release or two of testtools as well22:50
uvirtbotLaunchpad bug 1393006 in devstack "testtools 1.2.0 with old unittest2 breaks subunit.run discover --list" [Critical,Fix released]22:50
nibalizerso what to do about the underscores though?22:50
anteayagood question22:50
anteayaI don't know22:51
asselinanteaya, nibalizer and for the 2nd patch, I'll mark it WIP. We can just refer to it as nibalizer suggested22:51
*** sputnik13 has quit IRC22:51
anteayanibalizer: we can deal with them one at a time rather than a group22:51
anteayanibalizer: might have a better chance of success22:51
asselinanteaya, nibalizer I prefer to do all at once.22:51
*** sputnik13 has joined #openstack-infra22:51
anteayanibalizer: I don't think we can arrive at a solution for the whole group22:51
*** mriedem has quit IRC22:51
asselinanteaya, nibalizer it seems the solutions should be consistent22:51
anteayaasselin: let's focus on what we can do all at once22:51
nibalizerso are you at all flexible about having hypens and underscores?22:52
anteayaI can opt out22:52
* asselin has no opinion on it22:52
jeblairnibalizer: iiuc, install_modules installs a module by creating a directory named "foo" assuming that all modules are named "puppet-foo"22:52
anteayaI can shut up and go away22:52
anteayaI can do that22:52
nibalizeranteaya: that wasn't what i meant, or what i want22:52
*** melwitt has quit IRC22:52
anteayalet's focus on where we have agreement22:53
mordredjeblair: I've tested both with and without the updated requirement from global-requirements and on tox 1.8.0 and 1.6.1 - all work for me- so I'm a bit confused22:53
*** spzala has quit IRC22:53
anteayafollow the spec, repos with hyphens22:53
anteayaeven if we only merge that that is still substantial22:53
mordredI also can't see anywhere in openstack where we are importing unittest222:53
clarkbmordred: jeblair: is there a link to the error someplace?22:53
jeblairanteaya: let's try to understand the technical issue related to naming and figure out a solution22:53
mordredso if we used that as a workaround at one point, we don't seem to be doing it anymore22:53
anteayajeblair: we can do that too22:54
jeblairnibalizer: so the issue comes up because our install script knows to strip "puppet-" from the directory that the module is installed to, but does no other transformation22:54
*** carl_baldwin has quit IRC22:54
jeblairnibalizer: and this even works for "puppetlabs-foo" because it's just stripping up to the first hyphen22:54
anteayanibalizer: this is _our_ install script?22:55
anteayaI didn't know this was ours22:55
nibalizeri wasn't aware we had a problem with the install script22:55
jeblairokay, backing up then22:55
nibalizerif you have a repo called puppet-log_processor ... what is the problem?22:55
jeblairthe problem is that puppet modules are actually directories, and puppet modules may only consist of alphanumeric and underscore, rightL22:55
nibalizerthat is true22:56
*** amitgandhinz has joined #openstack-infra22:56
jeblairokay, so the reason that "puppet-foo_bar" works is that our install script strips puppet- from it.  so the _first_ hyphen is not a problem for us.  right?22:56
nibalizeras i understand it22:56
jeblairsimilarly puppetlabs-foo22:56
*** zz_dimtruck is now known as dimtruck22:57
*** gokrokve has quit IRC22:57
jeblairi'm scanning puppetlabs git org to see what they do22:57
jeblairmost of the time the module name is one word22:57
nibalizerbut creating puppet-log-processor would break22:57
jeblairhttps://github.com/puppetlabs/puppetlabs-policy_engine22:57
jeblairthere's a case where they use the mix22:58
*** yamamoto has joined #openstack-infra22:58
jeblairso it sort of looks like "something-module_with_underscores" is actually an established pattern22:59
jeblair(i'm seeing a few more of those)22:59
*** rmcall has quit IRC23:00
*** carl_baldwin has joined #openstack-infra23:00
nibalizersorry my internet died23:01
nibalizeryes, puppet modules do this23:01
nibalizerno one loves it, to be sure, but its where we are23:01
jeblairso as annoying as it is to have the mixture, it seems like puppet-module_name is probably going to be the most compatible with existing tooling related to puppet modules23:01
mordredjeblair: ++23:01
*** baoli has joined #openstack-infra23:01
jeblairand if we were to try to "improve" the situation by switching to "puppet_module_name" we'd probably actually make it harder for people (even though i'm sure we could fix our own install script fairly easily)23:02
jeblairand changing to "puppet-module-name" would be even harder for people to deal with than that23:02
*** gokrokve has joined #openstack-infra23:02
nibalizeranother option is to move it to puppet-modulename23:02
nibalizerbut that hinders reabability23:03
jeblairnibalizer: the stackforge puppet modules have a mixture23:04
jeblairnibalizer: http://git.openstack.org/cgit/stackforge/puppet-openstack-cloud/tree/23:04
anteayaany way of creating something to point at for the cargo culters that says that hyphens and underscores are only permissible for puppet modules23:04
clarkbok we have all of the setuptools fixes in except for pbr23:04
clarkbmordred: ^ can you address fungi's -1?23:04
anteayasince I am seeing this in job names and non puppet stackforge repo names23:04
* clarkb would really like to push up a rvert of setuptools pin to devstack to see what breaks23:04
anteayaand anything one project does, they all copy23:05
clarkbbut need to fix pbr first otherwise pbr will break23:05
mordredfungi: how would you like that addressed?23:05
mordredfungi: you seem to have summed it up in that comment - should I just acknowledge that comment?23:05
fungimordred: clarkb: either an update to the commit message or a comment in the review. just something recording this as the decision rather than merely that the concerns were ignored (which they weren't)23:05
jeblairnibalizer: dow does puppet-openstack-cloud work?23:05
fungimordred: yep, that would be fine23:05
mordredok23:05
fungithen i'm happy to approve'23:06
*** hashar has quit IRC23:06
jeblairclarkb, fungi, mordred: http://paste.openstack.org/show/152047/23:06
*** gokrokve has quit IRC23:06
*** dims has quit IRC23:07
*** rmcall has joined #openstack-infra23:07
jogomordred: any recent PBR changes23:07
mordredfungi: done23:07
*** gokrokve has joined #openstack-infra23:07
jogomordred: http://logs.openstack.org/52/134052/5/check//gate-hacking-integration-nova/c4d107b/console.html#_2014-12-16_22_38_03_07023:07
mordredjogo: that's WAY too broad of a question23:07
fungiclarkb: also the proposed stable/juno patches which just updated to all projects using oslo.db need to merge, yeah?23:07
*** dims has joined #openstack-infra23:07
fungimordred: thanks--approving23:07
clarkbwow testools setup.py depends on unittest223:08
fungimordred: also a change from pip freeze to pbr freeze in all jobs would be helpful23:08
*** dims has quit IRC23:08
fungimordred: i can hack that up if you haven't started23:08
*** dims has joined #openstack-infra23:08
mordredjogo, clarkb: might have to do with the setuptools mess?23:08
asselinanteaya, are you good with mixed case? or would you prefer to consider it more as a separate patch set?23:08
anteayanibalizer jeblair the make an exception for me argument, just becomes "hey look what your future looks like"23:08
clarkbfungi: that will need to merge but not to test a revert of the setuptools pin because we patch all reqs from global reqs23:08
mordredfungi: I can get it23:08
fungiclarkb: oh, great point23:08
clarkbmordred: jeblair maybe? what version of setuptools is in there?23:08
nibalizerjeblair: that module is actually called (from metadata.json) "eNovance-cloud",23:08
mordredclarkb: no - jogo's thing23:09
clarkboh maybe?23:09
EmilienMjeblair: it works in production for us. If you have any question, I'm a main contributor23:09
jogomordred: hmm23:09
EmilienMjeblair: (puppet-openstack-cloud)23:09
clarkbexcept that pbr is running on what is basically 0.10.0 now23:09
anteayaEmilienM: we are talking about repo names23:09
*** yamamoto has quit IRC23:09
jeblairEmilienM: i'm told puppet modules can't have hyphens in their names23:09
clarkbso pbr changes wouldn't be related but setuptools mihgt be23:09
*** sigmavirus24 has joined #openstack-infra23:10
anteayaEmilienM: and nibalizer is making the point that they have to be called puppet-foo_bar23:10
jeblairEmilienM: that it is a restriction in puppet23:10
*** rmcall has quit IRC23:10
EmilienMjeblair: oh. Then we have an issue with our module. Not an issue if you want to rename it.23:10
anteayaEmilienM: as puppet-foo-bar will break23:10
EmilienMjeblair: I don't see where is causes problem though23:10
anteayaEmilienM: no issue23:10
*** otter768 has joined #openstack-infra23:10
nibalizerjeblair: see http://git.openstack.org/cgit/stackforge/puppet-openstack-cloud/tree/manifests/cache.pp#n31 they use just cloud in their module name23:10
EmilienMwe already have puppet-neutron, etc23:10
clarkbEmilienM: puppet specifically says that names may not have -'s in them23:10
anteayaEmilienM: we are curious23:10
EmilienManteaya: I know you are :P23:11
clarkbEmilienM: puppet-neutron is fine because that is renamed to neutron in puppet right?23:11
clarkbEmilienM: you don't use neutron::thing { 'stuff':23:11
clarkber23:11
clarkbpuppet-neutron::thing { 'stuff':23:11
jogomordred: yeah pbr/util hasn't been touched in months :/23:11
*** e0ne has quit IRC23:11
jeblairnibalizer: oh, in the _code_ not in the directory?23:11
EmilienMclarkb: ok. While we use "cloud::" thing I see your point23:11
mordredjogo: well, the setuptools stuff would have the potential to break name resolution23:12
jogosigmavirus24: ^23:12
jeblairnibalizer: but then, would you have to install puppet-openstack-cloud into /puppet/module/directory/cloud for it to work?23:12
jeblairEmilienM: ^?23:12
mordredclarkb, fungi: do we have anything that tests with tox and doesn't use pbr?23:12
jogomordred: doh23:12
nibalizerjeblair: yes23:12
mordredclarkb, fungi: because if we do, then the jobs to do the pip freeze -> pbr freeze are going to have to get more complex23:12
fungimordred: at one point i would have said git-review but that's no longer the case23:13
sigmavirus24mordred: I didn't think there were any entry point related changes in 8.x23:13
*** emagana has quit IRC23:13
mordredsigmavirus24: I believe you're correct - but I was thinking that the setuptools version normalization could trigger somethign there?23:13
*** krtaylor has quit IRC23:13
fungimordred: wrapper slave script which looks for pbr as an executable and then calls that instead of pip for the freeze output?23:13
*** rmcall has joined #openstack-infra23:14
jogosigmavirus24: whatever the issue, I don't see it just running 'tox -epep8' on nova23:14
EmilienMjeblair: yes23:14
jogoso not in the hacking 0.923:14
EmilienMjeblair: our Puppetfile does it23:14
jeblairnibalizer, anteaya: so i think our thoughts about maintaining puppet-module_name for maximum compatability still stands23:14
*** amitgandhinz has quit IRC23:14
mordredfungi: yah - I think we need to do that23:14
sigmavirus24mordred: so the code in particular causing this is that nova.hacking.checks is imported but we can't getattr(nova.hacking,checks, 'factory')23:14
jeblairEmilienM: thanks, that explains it and i think i understand now23:14
EmilienMjeblair: though I'm still not sure we are doing right23:14
sigmavirus24jogo: what happens if you recreate the env?23:14
sigmavirus24tox -epep8 -r23:14
anteayajeblair: I am hearing that, do we have any hope of containing the bleed to puppet modules23:14
EmilienMbut it works ^^23:14
jogosigmavirus24: did that23:14
anteayaor are we going to have to accept everything being named with hyphens and underscores henceforth23:15
clarkbfungi: mordred I think we do [ -e .tox/venv/py27/pbr ] && pbr freese23:15
clarkbI don't think we need to make it more complex than that23:15
*** otter768 has quit IRC23:15
mordredclarkb: [ -e .tox/venv/py27/pbr ] && pbr freeze || pip freeze23:15
clarkbmordred: ya that23:16
*** gondoi is now known as zz_gondoi23:16
*** ddieterly has quit IRC23:17
jeblairanteaya: many systems are going to have specific naming requirements.  oslo.foo for example.  i think we're going to have to be flexible.  try to point out potential typos or areas for improvement, but otherwise, bend.  :)23:17
jogomordred:  pbr.util.resolve_name('nova.hooks.add_hook')23:17
jogomordred: lools like resolve_name is not resolving anymore23:17
*** ddieterly has joined #openstack-infra23:17
anteayasigh in the stackforge/third party space that translates to get trampled23:18
anteayaokay fine23:18
sigmavirus24jogo: and you're on setuptools.__version__.startswith('8.0') ?23:18
openstackgerritMonty Taylor proposed openstack-infra/project-config: Move to pbr freeze from pip freeze  https://review.openstack.org/14225723:18
*** rmcall has quit IRC23:18
* anteaya invests in more beeswax candles23:19
*** emagana has joined #openstack-infra23:19
openstackgerritJames Carey  proposed openstack-dev/hacking: Add optional hacking checks  https://review.openstack.org/13405223:20
sigmavirus24jogo: with nova on tip, tox -epep8 -r doesn't work for me23:20
*** rmcall has joined #openstack-infra23:20
jogosigmavirus24: huh,23:20
mordredsigmavirus24: with setuptools.__version__.startswith('8.0') ?23:20
sigmavirus24and the setuptools version in the venv is 3.6 odly23:20
* sigmavirus24 upgrades23:20
mordredah. ok23:20
*** mfink has quit IRC23:20
jeblairclarkb: do you understand the testtools error i'm seeing?23:20
mordredwell, me needs to afk for a few - would LOVE more infos23:21
jogosigmavirus24: setuptools.__version__23:21
jogo'3.6'23:21
jogoconfused about that23:21
jogothat is inside a tox venv23:22
sigmavirus24our virtualenv versions might be old23:22
*** ddieterly has quit IRC23:22
mordredjeblair: since I can't reproduce locally - can you try adding unittest2 to your test-requires and verify that that does fix it for you23:22
mordredjeblair: and in the mean time I'll keep trying to figure out why this is affecting you and not me and what the root cause is23:22
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Extend ACL checks to OpenStack namespace.  https://review.openstack.org/14223023:22
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Fix the OSSA ACL config  https://review.openstack.org/14225823:22
clarkbjeblair: not really just that it seems to need unittest2 to be installed for its setup.py to run23:23
mordredjeblair: OOOOOHHHHHHHHHH23:23
mordredI get it23:23
clarkbjeblair: which is odd23:23
mordredit will take a bit more jiggering to reproduce23:23
jogosigmavirus24 mordred: well I saw this fail on infra23:23
*** bdpayne has joined #openstack-infra23:23
clarkbmordred: can you explain more than that?23:23
jogoso I don't think its just our local boxes  http://logs.openstack.org/52/134052/5/check//gate-hacking-integration-nova/c4d107b/console.html#_2014-12-16_22_38_03_07023:23
mordredjeblair, clarkb: but this is the "setup_requires downloads an egg which causes install_requires to not need to install something even though it _Does_ need to install it" bug23:23
*** dmsimard is now known as dmsimard_away23:23
mordredit was fixed in upstream pip iirc23:24
nibalizerso does that mean asselin can add the underscore projects in to his patch?23:24
mordredbut it was the cause  of many a weird error like this for a while23:24
* mordred will try to put together a test case to show that23:24
mordredbut must afk for a sec - back ina  few23:24
asselinnibalizer, at this point, I will keep them in...err...not take them out.23:24
sigmavirus24jogo: well my box failed on install23:24
*** teran_ has joined #openstack-infra23:25
sigmavirus24ah libvirt needs to be installed apparently ... good old c extensions23:25
*** wenlock has quit IRC23:25
*** melwitt has joined #openstack-infra23:25
nibalizerokay cool23:25
jogohaha23:25
jogobbiab relocating23:25
asselinnibalizer, anteaya and check consistency with the spec23:25
*** krtaylor has joined #openstack-infra23:26
nibalizercool23:27
*** shashankhegde has quit IRC23:27
*** teran has quit IRC23:28
*** shashankhegde has joined #openstack-infra23:28
*** gokrokve has quit IRC23:28
*** andreykurilin_ has quit IRC23:30
openstackgerritJames Carey  proposed openstack-dev/hacking: Add optional hacking checks  https://review.openstack.org/13405223:31
jeblairclarkb, mordred: adding unittest2 to the beginning of test-requirements avoids the problem23:31
openstackgerritJames Carey  proposed openstack-dev/hacking: Add optional hacking checks  https://review.openstack.org/13405223:32
jeblairclarkb, mordred: so do i need a newer pip?23:33
*** dimtruck is now known as zz_dimtruck23:34
jeblairclarkb, mordred: https://github.com/testing-cabal/testtools/commit/6f12789a398a99fc39e4380bd063af841a262c6223:34
clarkbmaybe I still don't quite get what mordred is saying23:35
jeblairclarkb, mordred: so it switched to using setup_requires23:35
clarkbjeblair: however your tox bundles pip23:35
clarkbjeblair: so its likely related to your tox version if pip version matters23:35
jeblairclarkb: mordred tried using my version of tox and it worked for him23:36
clarkbso likely not related to pip version23:36
clarkblet me give reproduction a go. just `tox -epy27`?23:36
jeblairyep23:36
*** fandi has joined #openstack-infra23:38
*** fandi has quit IRC23:38
*** zz_dimtruck is now known as dimtruck23:41
*** e0ne has joined #openstack-infra23:41
fungitox -repy27 with zuul master works for me (using tox 1.8.1)23:41
clarkbwow running tox like that killed the battery very quickly :)23:42
clarkbthankfully I can plug in23:42
*** erikmwilson has quit IRC23:44
*** Masahiro has joined #openstack-infra23:44
clarkbbut unable to reproduce with tox 1.6.123:44
*** MarkAtwood has quit IRC23:46
*** e0ne has quit IRC23:47
openstackgerritRamy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split #1  https://review.openstack.org/14052323:47
asselinnibalizer, anteaya ^^23:47
*** amotoki has quit IRC23:47
*** Masahiro has quit IRC23:48
clarkbwoot I did not see that fungi approved pbr changes \o/ I am excited23:48
fungiclarkb: yeah, now we need a 0.10.3 tag23:49
clarkbwell it needs to merge but its in process23:49
fungimordred: ^ would you like to do the honors this time?23:49
fungioh, right, gating feh23:49
fungidetails details23:50
*** yamamoto has joined #openstack-infra23:50
*** andreaf has joined #openstack-infra23:52
fungiaccording to https://github.com/openstack/openstack/graphs/commit-activity week before last we merged more openstack/openstack changes than, well, ever23:52
*** rmcall has quit IRC23:52
*** lttrl has joined #openstack-infra23:52
clarkbwow23:52
fungi554 commits the week of november 3023:52
pleia2wow23:53
nibalizerjeblair: pleia2 so do we want to give some kind of ping to the golang folks?23:53
*** dimtruck is now known as zz_dimtruck23:53
pleia2nibalizer: I think so23:54
mordrednibalizer: maybe they can put the word go in theirs23:54
pleia2I do worry it will get very confusing in the long run because the tools are so similar23:54
pleia2just different enough to make people crazy when they land on the wrong man page23:54
fungipleia2: nibalizer: know any of the people listed at https://github.com/golang/review/commits/master/git-review ?23:55
mordredfungi: what gating?23:55
fungimordred: i know, right?23:55
pleia2I don't know anyone in the go community23:55
*** sputnik13 has quit IRC23:55
*** mfink has joined #openstack-infra23:55
timrcat least it is a review tool for go and not a review tool for an go-implementation of openstack aka gopenstack23:56
mordredtimrc: yah - but it's a review tool for _Gerrit_23:56
* anteaya 's tox just failed on No module named unittest2 and is reading backscroll23:56
mordredtimrc: like, it literally does the same thing, except less generally and written in go23:56
clarkbanteaya: cool you can reproduce. what version of tox do you have?23:56
greghaynesI submit https://code.google.com/p/go/issues/detail?id=9 as evidence they may not care23:57
clarkbwould be interesting if your version is different than jeblairs23:57
mordredooh!23:57
timrcmordred, Aye.23:57
mordredanteaya broke too23:57
mordredI'm happy23:57
*** sputnik13 has joined #openstack-infra23:57
*** jlibosva has quit IRC23:57
anteayaanita@anita-hp:~/work/project-config$ tox --version23:58
anteaya1.6.1 imported from /usr/local/lib/python2.7/dist-packages/tox/__init__.pyc23:58
nibalizerfungi: this is an easeir to parse list https://github.com/golang/review/graphs/contributors23:58
pleia2greghaynes: wow, I hadn't seen that before, pretty epic, "There's no law against being rude" x_x23:58
anteayamordred: I'm glad my breaking makes you happy23:58
mordredclarkb: are we _certain_ that tox is bundling virtualenv?23:58
mordredpleia2: can you tell me pip --version and virtualenv --version too?23:59
anteayahere I was trying to do reviews to accomplish that23:59
mordredgah23:59
mordredanteaya: ^^23:59
* anteaya gets versions23:59
mordredpleia2: I do not need to nkow your pip --version and virtualenv --version23:59
fungimordred: i think dstufft suggested that tox merely installs virtualenv23:59
clarkbmordred: ya well at least it did in the past23:59
pleia2:)23:59
clarkbmordred: I can say it definitely vendored virtualenv a year ago23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!