Tuesday, 2015-04-21

*** suneelb has quit IRC00:01
*** cody-somerville has joined #openstack-qa00:03
*** bknudson has joined #openstack-qa00:05
*** shashankhegde has joined #openstack-qa00:07
*** mahito has joined #openstack-qa00:07
*** yamamoto has quit IRC00:08
openstackrecheckopenstack/nova change: https://review.openstack.org/165189 failed because of: gate-grenade-dsvm-ironic-sideways: https://bugs.launchpad.net/bugs/132365800:10
openstackLaunchpad bug 1323658 in OpenStack Compute (nova) "Nova resize/restart results in guest ending up in inconsistent state with Neutron" [Medium,Confirmed]00:10
*** mahito has quit IRC00:10
*** melwitt has joined #openstack-qa00:10
*** mahito has joined #openstack-qa00:10
*** patrickeast has quit IRC00:14
*** achanda has joined #openstack-qa00:16
*** sputnik13 has quit IRC00:19
gmannmtreinish: https://review.openstack.org/#/c/173136/00:19
*** achanda_ has quit IRC00:19
gmannmtreinish: LGTM just 1 comment to use input cred directly while releasing the cred.00:20
*** achanda has quit IRC00:21
*** tsekiyam_ has joined #openstack-qa00:22
*** openstackgerrit has quit IRC00:22
*** openstackgerrit has joined #openstack-qa00:22
*** gamado has joined #openstack-qa00:24
*** tsekiya__ has joined #openstack-qa00:24
*** tsekiyam_ has quit IRC00:24
*** tsekiya__ has quit IRC00:24
*** tsekiyama has quit IRC00:26
*** madhu_ak has quit IRC00:28
*** gamado has quit IRC00:28
*** mlavalle has quit IRC00:31
*** openstack has joined #openstack-qa00:36
*** jhenner has quit IRC00:39
*** gamado has joined #openstack-qa00:48
*** Poornima has joined #openstack-qa00:50
*** luqas has joined #openstack-qa00:50
*** gamado has quit IRC00:53
*** luqas has quit IRC00:54
*** jhenner has joined #openstack-qa00:56
*** shashankhegde has quit IRC00:57
*** Poornima has quit IRC01:00
*** Swami has quit IRC01:00
*** yamamoto has joined #openstack-qa01:00
*** dboik has joined #openstack-qa01:05
*** dboik_ has joined #openstack-qa01:06
*** dboik has quit IRC01:10
*** Nic1 has quit IRC01:12
*** madhu_ak has joined #openstack-qa01:15
*** zz_dimtruck is now known as dimtruck01:15
*** madhu_ak_ has joined #openstack-qa01:15
*** davideagnello has quit IRC01:18
*** madhu_ak has quit IRC01:19
*** dpaterson has joined #openstack-qa01:36
*** mwagner_lap has joined #openstack-qa01:37
*** mmedvede has quit IRC01:44
*** madhu_ak_ has quit IRC01:44
*** madhu_ak_ has joined #openstack-qa01:45
*** jecarey has joined #openstack-qa01:45
*** madhu_ak_ has quit IRC01:45
*** madhu_ak_ has joined #openstack-qa01:45
*** mmedvede has joined #openstack-qa01:48
*** melwitt has quit IRC01:51
*** bkopilov has quit IRC01:53
*** dpaterson has quit IRC02:03
*** liusheng has quit IRC02:16
*** Poornima has joined #openstack-qa02:16
*** sks has joined #openstack-qa02:27
*** sputnik13 has joined #openstack-qa02:29
*** madhu_ak__ has joined #openstack-qa02:31
*** rfolco has quit IRC02:31
*** madhu_ak__ has quit IRC02:33
*** madhu_ak__ has joined #openstack-qa02:33
*** madhu_ak__ is now known as madhu_ak02:34
*** madhu_ak_ has quit IRC02:35
*** achanda has joined #openstack-qa02:35
*** harlowja is now known as harlowja_away02:35
*** harlowja_away is now known as harlowja02:37
openstackrecheckopenstack/nova change: https://review.openstack.org/172559 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1313168, gate-tempest-dsvm-neutron-full: unrecognized error02:40
openstackLaunchpad bug 1313168 in OpenStack-Gate "paramiko ValueError: Unable to compute factors p and q from exponent d" [Medium,Triaged]02:40
openstackgerritEli Qiao proposed openstack/tempest: fixed_ip unreserve should use an ip liked address  https://review.openstack.org/17002702:41
*** sputnik1_ has joined #openstack-qa02:46
*** sputnik13 has quit IRC02:48
*** mmedvede has quit IRC02:56
*** mmedvede has joined #openstack-qa02:59
openstackrecheckopenstack/nova change: https://review.openstack.org/173151 failed because of: gate-tempest-dsvm-nova-v21-full: https://bugs.launchpad.net/bugs/128663503:10
openstackLaunchpad bug 1286635 in OpenStack-Gate ""Packages cannot be authenticated" when doing an apt-get in the gate" [Undecided,Won't fix]03:10
*** sks has quit IRC03:13
*** artom has quit IRC03:19
*** bkopilov has joined #openstack-qa03:19
*** sabeen1 has joined #openstack-qa03:21
*** jogo has quit IRC03:22
*** jyuso1 has quit IRC03:23
*** sabeen3 has quit IRC03:24
*** woodster_ has quit IRC03:30
*** achanda has quit IRC03:41
*** annashen has joined #openstack-qa03:42
*** jecarey has quit IRC03:45
*** catohornet has left #openstack-qa03:46
*** sabeen1 has quit IRC03:47
*** luqas has joined #openstack-qa03:52
*** mmedvede has quit IRC03:54
openstackgerritTiantian Gao proposed openstack-dev/devstack: Support config neutron api_workers and rpc_workers  https://review.openstack.org/17570403:55
*** harlowja is now known as harlowja_away03:56
*** luqas has quit IRC03:56
openstackgerritMerged openstack-infra/devstack-gate: redo devstack-gate grenade selection as a case statement  https://review.openstack.org/17539003:56
openstackrecheckopenstack-infra/devstack-gate change: https://review.openstack.org/175391 failed gate-grenade-dsvm, gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error03:57
*** gamado has joined #openstack-qa04:01
*** mmedvede has joined #openstack-qa04:02
*** BharatK has joined #openstack-qa04:04
*** gamado has quit IRC04:05
*** annashen has quit IRC04:05
*** Swami has joined #openstack-qa04:06
*** annashen has joined #openstack-qa04:06
*** annashen has quit IRC04:11
*** jogo has joined #openstack-qa04:15
*** jogo has quit IRC04:17
*** achanda has joined #openstack-qa04:17
*** Swami has quit IRC04:17
*** gamado has joined #openstack-qa04:17
*** yfried|afk is now known as yfried__04:18
*** davideagnello has joined #openstack-qa04:19
*** jogo has joined #openstack-qa04:20
*** sputnik1_ has quit IRC04:23
*** davideagnello has quit IRC04:24
*** amotoki has joined #openstack-qa04:24
*** woodster_ has joined #openstack-qa04:25
*** davideagnello has joined #openstack-qa04:33
*** Madan has joined #openstack-qa04:35
*** yfried__ is now known as yfried|afk04:36
*** yfried|afk is now known as yfried__04:38
*** Sukhdev has joined #openstack-qa04:44
*** annashen has joined #openstack-qa04:45
*** yfried__ is now known as yfried|afk04:52
*** Longgeek has joined #openstack-qa04:52
openstackgerritRamakrishnan G proposed openstack-dev/devstack: Fix issue with ml2 plugin on using provider network  https://review.openstack.org/17473104:57
*** mmedvede has quit IRC04:59
*** yfried|afk is now known as yfried__05:01
*** flaper87 has quit IRC05:01
*** flaper87 has joined #openstack-qa05:04
*** itzikb has joined #openstack-qa05:11
*** mmedvede has joined #openstack-qa05:13
*** dimtruck is now known as zz_dimtruck05:15
*** davideagnello has quit IRC05:19
*** shashankhegde has joined #openstack-qa05:23
*** afazekas has quit IRC05:31
*** neeti has joined #openstack-qa05:42
*** anshul has joined #openstack-qa05:43
*** yfried__ has quit IRC05:44
*** pal has joined #openstack-qa05:52
*** achanda has quit IRC05:52
*** SridharG has joined #openstack-qa05:56
*** k4n0 has joined #openstack-qa05:56
*** pal_ has joined #openstack-qa05:56
*** pal has quit IRC05:56
*** achanda has joined #openstack-qa05:57
*** achanda has quit IRC06:03
*** armax_ has quit IRC06:06
*** shashankhegde has quit IRC06:07
*** armax has joined #openstack-qa06:07
*** armax has quit IRC06:07
*** armax has joined #openstack-qa06:08
*** armax has left #openstack-qa06:08
*** armax has joined #openstack-qa06:08
*** armax has quit IRC06:10
*** armax has joined #openstack-qa06:10
*** armax has quit IRC06:10
*** cody-somerville has quit IRC06:14
*** afazekas_ has joined #openstack-qa06:22
*** annashen has quit IRC06:23
*** pal has joined #openstack-qa06:24
*** pal_ has quit IRC06:25
*** salv-orlando has quit IRC06:29
*** yfried__ has joined #openstack-qa06:33
*** jamielennox is now known as jamielennox|away06:34
*** luqas has joined #openstack-qa06:34
*** nmagnezi_ has joined #openstack-qa06:38
*** Sukhdev has quit IRC06:44
*** yfried__ is now known as yfried|afk06:47
*** pal has quit IRC06:51
*** pal has joined #openstack-qa06:56
*** yfried|afk is now known as yfried__06:59
*** mestery has quit IRC07:03
*** itzikb has quit IRC07:05
*** SridharGaddam has joined #openstack-qa07:08
*** k4n0 has quit IRC07:11
*** pcaruana has quit IRC07:11
*** itzikb has joined #openstack-qa07:12
*** k4n0 has joined #openstack-qa07:12
*** jyuso1 has joined #openstack-qa07:18
*** woodster_ has quit IRC07:20
*** flaper87 has quit IRC07:23
*** flaper87 has joined #openstack-qa07:23
*** sergsh has joined #openstack-qa07:24
*** gfidente has joined #openstack-qa07:26
*** pal has quit IRC07:28
*** afazekas_ has quit IRC07:32
*** mpaolino has joined #openstack-qa07:33
*** shardy_z is now known as shardy07:36
*** afazekas_ has joined #openstack-qa07:36
*** pal has joined #openstack-qa07:37
*** jamielennox|away is now known as jamielennox07:43
*** mestery has joined #openstack-qa07:46
*** itzikb has quit IRC07:51
*** weshay has joined #openstack-qa07:54
*** safchain has joined #openstack-qa07:58
*** tkammer has joined #openstack-qa08:07
*** tochi has quit IRC08:08
*** zz_johnthetubagu is now known as johnthetubaguy08:08
*** tochi has joined #openstack-qa08:08
*** yamamoto has quit IRC08:15
*** johnthetubaguy is now known as zz_johnthetubagu08:15
*** jordanP has joined #openstack-qa08:16
*** itzikb has joined #openstack-qa08:16
*** zz_johnthetubagu is now known as johnthetubaguy08:20
*** mmedvede has quit IRC08:23
*** yog__ has joined #openstack-qa08:24
*** apevec has joined #openstack-qa08:26
*** weshay has quit IRC08:26
*** weshay has joined #openstack-qa08:27
*** ihrachyshka has joined #openstack-qa08:31
*** e0ne has joined #openstack-qa08:34
*** mmedvede has joined #openstack-qa08:35
*** Longgeek has quit IRC08:42
*** mmedvede has quit IRC08:42
*** coolsvap|afk is now known as coolsvap08:45
*** coolsvap is now known as coolsvap|afk08:46
openstackgerritFlavio Percoco proposed openstack-dev/devstack: Enable pooling by default  https://review.openstack.org/14026908:58
*** mmedvede has joined #openstack-qa09:03
*** yamamoto has joined #openstack-qa09:04
*** sergsh has quit IRC09:06
*** tochi has quit IRC09:08
*** Longgeek has joined #openstack-qa09:14
*** sergsh has joined #openstack-qa09:18
*** yfried__ is now known as yfried|afk09:21
*** tosky has joined #openstack-qa09:34
*** yfried|afk is now known as yfried__09:34
*** yamamoto has quit IRC09:34
*** yamamoto has joined #openstack-qa09:36
*** Poornima has quit IRC09:40
*** salv-orlando has joined #openstack-qa09:42
*** pal has quit IRC09:42
openstackgerritMerged openstack-dev/devstack: Add response time to keystone access log  https://review.openstack.org/16404209:43
*** luqas has quit IRC09:45
*** yfried__ is now known as yfried|afk09:48
*** yamamoto has quit IRC09:50
*** yfried|afk is now known as yfried__09:50
*** luqas has joined #openstack-qa09:53
*** cdent has joined #openstack-qa09:59
*** yfried__ is now known as yfried|afk10:01
*** e0ne is now known as e0ne_10:02
*** e0ne_ is now known as e0ne10:04
*** boris-42 has quit IRC10:05
*** boris-42 has joined #openstack-qa10:08
*** yamahata has quit IRC10:12
*** yfried|afk is now known as yfried__10:13
*** neeti has quit IRC10:18
*** sslypushenko has quit IRC10:26
*** mpaolino has quit IRC10:29
*** e0ne is now known as e0ne_10:33
*** nmagnezi_ has quit IRC10:34
*** e0ne_ is now known as e0ne10:34
*** pc_m has joined #openstack-qa10:35
openstackgerritTiantian Gao proposed openstack-dev/devstack: Support config neutron api_workers and rpc_workers  https://review.openstack.org/17570410:52
*** rbak has joined #openstack-qa10:55
*** rbak has quit IRC10:57
*** rbak has joined #openstack-qa10:57
openstackgerritJoe Hakim Rahme proposed openstack/tempest: Adds unit test for Javelin  https://review.openstack.org/16577510:59
openstackrecheckopenstack/nova change: https://review.openstack.org/174064 failed because of: gate-tempest-dsvm-large-ops: https://bugs.launchpad.net/bugs/1400905, gate-tempest-dsvm-neutron-large-ops: https://bugs.launchpad.net/bugs/140090511:01
openstackLaunchpad bug 1400905 in OpenStack-Gate "Hash Sum mismatch on apt mirrors" [Undecided,Confirmed]11:01
*** BharatK has quit IRC11:02
*** tosky_ has joined #openstack-qa11:02
*** tosky_ has quit IRC11:02
*** tosky has quit IRC11:03
*** tosky has joined #openstack-qa11:07
*** BharatK has joined #openstack-qa11:15
*** mahito has quit IRC11:34
*** Madan has quit IRC11:37
*** mwagner_lap has quit IRC11:38
*** BharatK has quit IRC11:38
*** yamamoto has joined #openstack-qa11:53
*** yog__ has quit IRC12:04
openstackgerritSean Dague proposed openstack-dev/grenade: add lib/apache to keystone shutdown  https://review.openstack.org/17583112:09
openstackgerritSean Dague proposed openstack-infra/devstack-gate: only force off KEYSTONE_USE_WSGI up until kilo  https://review.openstack.org/17553112:10
*** bkopilov has quit IRC12:12
*** yamamoto has quit IRC12:12
*** jyuso1 has quit IRC12:16
*** salv-orlando has quit IRC12:18
*** mwagner_lap has joined #openstack-qa12:19
*** woodster_ has joined #openstack-qa12:20
*** salv-orlando has joined #openstack-qa12:21
*** aix has joined #openstack-qa12:21
openstackrecheckopenstack/nova change: https://review.openstack.org/170089 failed because of: gate-grenade-dsvm-ironic-sideways: https://bugs.launchpad.net/bugs/132365812:23
openstackLaunchpad bug 1323658 in OpenStack Compute (nova) "Nova resize/restart results in guest ending up in inconsistent state with Neutron" [Medium,Confirmed]12:23
*** yamamoto has joined #openstack-qa12:23
*** yamamoto has quit IRC12:30
*** sergsh has quit IRC12:40
*** mpaolino has joined #openstack-qa12:42
*** yamamoto has joined #openstack-qa12:44
*** amotoki has quit IRC12:48
*** rbak has quit IRC12:51
*** gamado has quit IRC12:52
*** yamamoto has quit IRC12:52
*** bknudson has quit IRC12:53
*** dkranz has quit IRC12:58
*** yamamoto has joined #openstack-qa13:01
openstackgerritSergey Slipushenko proposed openstack/tempest: Tool for generation user accounts from spec  https://review.openstack.org/17260513:03
*** e0ne is now known as e0ne_13:04
*** yamamoto has quit IRC13:05
*** Longgeek has quit IRC13:05
*** e0ne_ is now known as e0ne13:06
*** salv-orlando has quit IRC13:06
*** rbak has joined #openstack-qa13:11
*** itzikb has quit IRC13:14
*** e0ne is now known as e0ne_13:16
*** bknudson has joined #openstack-qa13:16
*** yamamoto has joined #openstack-qa13:17
*** yamamoto has quit IRC13:17
*** yamamoto has joined #openstack-qa13:17
*** itzikb has joined #openstack-qa13:18
*** yamamoto has quit IRC13:19
*** anshul has quit IRC13:20
*** e0ne_ is now known as e0ne13:21
*** Longgeek has joined #openstack-qa13:24
*** Longgeek has quit IRC13:24
*** Longgeek has joined #openstack-qa13:25
*** e0ne is now known as e0ne_13:26
*** e0ne_ is now known as e0ne13:26
*** dustins has joined #openstack-qa13:31
*** mriedem_away is now known as mriedem13:36
*** EmilienM has quit IRC13:40
*** EmilienM has joined #openstack-qa13:41
*** dboik_ has quit IRC13:43
*** cbits has joined #openstack-qa13:45
*** mlavalle has joined #openstack-qa13:49
*** zz_jgrimm is now known as jgrimm13:49
*** armax_ has joined #openstack-qa13:51
*** yamahata has joined #openstack-qa13:52
*** salv-orlando has joined #openstack-qa13:52
*** armax_ has quit IRC13:52
*** armax_ has joined #openstack-qa13:52
*** amotoki has joined #openstack-qa13:54
*** salv-orlando has quit IRC13:54
openstackgerritSean Dague proposed openstack-dev/grenade: support apache based upgrades for keystone  https://review.openstack.org/17583113:55
*** yamamoto has joined #openstack-qa13:55
*** Sukhdev has joined #openstack-qa13:57
*** rbak has quit IRC13:58
*** salv-orlando has joined #openstack-qa14:00
*** jecarey has joined #openstack-qa14:00
*** dboik has joined #openstack-qa14:01
*** rbak has joined #openstack-qa14:02
*** ajmiller has joined #openstack-qa14:03
*** mtanino has joined #openstack-qa14:06
*** afazekas_ has quit IRC14:08
*** armax_ has quit IRC14:08
*** paul_glass has joined #openstack-qa14:09
*** armax has joined #openstack-qa14:09
*** BharatK has joined #openstack-qa14:11
*** bkopilov has joined #openstack-qa14:12
*** dkranz has joined #openstack-qa14:15
*** nikil22 has joined #openstack-qa14:18
itzikbmtreinish: hi, when you have the time , can you please look at https://review.openstack.org/#/c/169659/?14:19
*** sputnik13 has joined #openstack-qa14:21
*** sputnik13 has quit IRC14:28
*** annashen has joined #openstack-qa14:29
*** dboik has quit IRC14:30
*** dboik has joined #openstack-qa14:31
mtreinishitzikb: sure, I'll put it on my list14:31
*** annashen has quit IRC14:34
*** achanda has joined #openstack-qa14:35
openstackgerritMatthew Treinish proposed openstack/tempest: Add config guide section on service feature enabled sections  https://review.openstack.org/17408614:36
openstackgerritMatthew Treinish proposed openstack/tempest: Add section to config guide for setting up services  https://review.openstack.org/17414914:36
openstackgerritMatthew Treinish proposed openstack/tempest: Add a paragraph on the use of tempest_roles option  https://review.openstack.org/17467514:36
*** dpaterson has joined #openstack-qa14:37
*** weshay has quit IRC14:37
itzikbmtreinish: thanks! :-)14:39
*** cbits has left #openstack-qa14:40
*** itzikb has quit IRC14:40
*** achanda has quit IRC14:43
*** artom has joined #openstack-qa14:44
*** jecarey has quit IRC14:44
*** tkammer has quit IRC14:46
*** zz_dimtruck is now known as dimtruck14:51
*** marun_ has joined #openstack-qa14:53
*** shashankhegde has joined #openstack-qa14:54
*** marun_ is now known as marun14:54
*** sabeen1 has joined #openstack-qa14:55
*** k4n0 has quit IRC14:57
*** sileht has quit IRC14:57
*** hemnafk is now known as hemna15:04
*** jecarey has joined #openstack-qa15:05
*** cbader has joined #openstack-qa15:05
*** jaypipes has quit IRC15:11
*** mestery has quit IRC15:11
*** mestery has joined #openstack-qa15:12
clarkbsdague: https://review.openstack.org/#/c/175391/ did you see that failed in the gate?15:15
*** masayukig has quit IRC15:15
sdagueyep15:15
sdagueso... this will be the 4th irc channel I'll talk about this bug today :)15:16
*** yamahata has quit IRC15:16
clarkbheh15:16
sdaguehttps://bugs.launchpad.net/oslo-incubator/+bug/144658315:16
openstackLaunchpad bug 1446583 in Keystone "services no longer reliably stop in stable/kilo" [Critical,In progress] - Assigned to Julien Danjou (jdanjou)15:16
clarkbnice15:16
*** apevec has quit IRC15:19
mriedemmtreinish: jogo: is this new? http://logs.openstack.org/59/172559/1/gate/gate-tempest-dsvm-neutron-full/e82860f/console.html#_2015-04-21_02_38_16_85015:20
*** masayukig has joined #openstack-qa15:21
mtreinishmriedem: I've not seen that before15:22
mtreinisha 404 on a create is kinda weird15:22
mriedemyeah there are some errors in the swift logs, trying to find a fingerprint15:23
openstackgerritSean Dague proposed openstack-dev/grenade: DNM: add process debugging when things fail  https://review.openstack.org/17593515:23
openstackgerritSean Dague proposed openstack-infra/devstack-gate: add support for stable/kilo  https://review.openstack.org/17539115:24
sdagueclarkb: so I'm going to see if I can dump more there15:24
clarkbok15:25
*** sabeen3 has joined #openstack-qa15:27
mtreinishmriedem: http://paste.openstack.org/show/204996/ looks like the error15:27
jogohis may not be related but error with PUT /sdb1/117/AUTH_3f7d425c19754ab0b4a0c263b3770c0d : #012Traceback15:27
jogohttp://logs.openstack.org/59/172559/1/gate/gate-tempest-dsvm-neutron-full/e82860f/logs/screen-s-account.txt.gz15:27
mriedemmtreinish: yeah, it only shows up on my one change in the gate for nova15:27
mriedemwhich is completely unrelated15:28
*** sabeen1 has quit IRC15:28
mriedemmtreinish: so i just rechecked15:28
jogomtreinish: you should show that to the swift folks15:29
mtreinishnotmyname: ^^^15:29
*** Sukhdev has quit IRC15:31
*** annashen has joined #openstack-qa15:31
*** Swami has joined #openstack-qa15:32
jogomtreinish mriedem: with only a single hit in 7 days maybe this was an issue with the VM itself15:33
mtreinishjogo: that's what I was thinking15:34
mtreinishalthough the traceback was on a mkdir15:34
mriedemlooking at the test_volume_boot_pattern ssh fail now15:35
*** annashen has quit IRC15:36
*** david-lyle has quit IRC15:36
*** sslypushenko has joined #openstack-qa15:37
*** nikil22 has quit IRC15:39
paul_glassare there any projects using tempest-lib in any capacity yet (other than designate)? just interested in keeping track of how other projects are doing things.15:40
*** amotoki has quit IRC15:41
*** andreykurilin__ has joined #openstack-qa15:41
*** amotoki has joined #openstack-qa15:43
*** amotoki has quit IRC15:43
*** yfried__ is now known as yfried|afk15:44
*** sputnik13 has joined #openstack-qa15:45
*** yfried|afk is now known as yfried__15:50
openstackgerritRoman Podoliaka proposed openstack/tempest: Add a test case for rebuild of instances with volumes  https://review.openstack.org/17594915:52
*** yfried__ has quit IRC15:55
*** dboik has quit IRC15:56
*** dboik has joined #openstack-qa15:57
*** sileht has joined #openstack-qa15:57
notmynamemtreinish: jogo: was on the phone. looks like ... I'm not sure. a missing directory, but I don't know why. some directory in "/opt/stack/data/swift/1/sdb1/accounts/117/00a" wasn't found15:57
*** dboik has quit IRC15:58
*** dboik has joined #openstack-qa15:58
*** armax has left #openstack-qa15:58
*** Sukhdev has joined #openstack-qa15:58
*** dboik has quit IRC15:59
*** dboik has joined #openstack-qa15:59
*** armax has joined #openstack-qa16:00
*** tsekiyama has joined #openstack-qa16:01
*** armax has left #openstack-qa16:01
*** SridharG has left #openstack-qa16:01
*** armax has joined #openstack-qa16:02
*** david-lyle has joined #openstack-qa16:02
*** luqas has quit IRC16:02
mtreinishnotmyname: yeah that's what it looked like from the logs, but I don't know why either.16:13
mtreinishit was doing a mkdir so I assumed it was trying to make that dir and something in the middle wasn't found16:13
mtreinishpaul_glass: a bunch of projects are using it, but mostly the clients so far16:14
*** mlavalle has quit IRC16:16
*** safchain has quit IRC16:18
*** davideagnello has joined #openstack-qa16:20
*** Sukhdev has quit IRC16:22
*** yamamoto has quit IRC16:22
mtreinishsdague, mkoderer: if you guys get a sec can you take a look at: https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:tempest-config-guide,n,z16:25
mtreinishshould be easy to review just more docs16:25
*** jordanP has quit IRC16:29
*** jaypipes has joined #openstack-qa16:30
*** ChanServ sets mode: +o jaypipes16:30
*** annashen has joined #openstack-qa16:32
*** annashen has quit IRC16:37
*** mpaolino has quit IRC16:38
sdaguemtreinish: have you seen this kind of issue16:39
sdaguerunning testr16:40
sdagueNo module named gdbm16:40
sdagueerror: testr failed (3)16:40
sdague?16:40
clarkbsdague: that happens if your python is compiled without gdbm iirc. Are you running this with a funny python?16:42
sdaguenot as far as I know16:42
sdagueos1:~/python-novaclient(ips)> ./.tox/functional/bin/python --version16:42
sdaguePython 2.7.616:42
*** mlavalle has joined #openstack-qa16:43
*** e0ne has quit IRC16:45
*** gfidente has quit IRC16:48
*** pal has joined #openstack-qa16:49
*** mpaolino has joined #openstack-qa16:50
*** harlowja_away is now known as harlowja16:57
*** shashankhegde has quit IRC16:59
*** annashen has joined #openstack-qa16:59
*** pal has quit IRC17:00
*** luqas has joined #openstack-qa17:03
*** Sukhdev has joined #openstack-qa17:05
*** luqas has quit IRC17:08
*** david-lyle has quit IRC17:08
davideagnellohello, I have been trying out Tempest and Rally for integration and scenario testing for stackforge project Cue.  Nova, Neutron, ceilometer, sahara.. have tests in both frameworks, I would like to get some feedback tempest vs. rally, using one or both.17:09
davideagnelloit looks like we are going to use tempest for integration tests and rally for e2e scenario testing17:09
*** Sukhdev has quit IRC17:12
mriedemmtreinish: boris-42: jogo: ^17:12
* mriedem ducks17:12
boris-42mriedem: lol17:15
mtreinishsdague: yeah what clarkb said, I've rarely seen that17:18
sdagueclarkb: python-gdbm is a separate package in ubuntu17:20
sdaguewhich is currently not installed for me17:20
clarkbhuh17:21
mtreinishyeah I thought it was baked into the stdlib17:21
sdaguep   python-gdbm17:22
*** patrickeast has joined #openstack-qa17:22
*** edleafe has joined #openstack-qa17:23
clarkbI just install python-all everywhere and that must pull it in17:23
sdagueok, that's not installed by devstack17:23
mtreinishsdague: https://docs.python.org/2/library/gdbm.html yeah it's in the stdlib17:23
* mtreinish goes and digs up what ubuntu is doing17:23
*** asselin has quit IRC17:24
mtreinishheh, so the ubuntu packages decides that python-tk and python-gdbm are stdlib extensions and has a separate metapackage to install them17:26
*** achanda has joined #openstack-qa17:26
mtreinishoh, but it's something they took from debian17:27
*** tosky has quit IRC17:29
*** asselin has joined #openstack-qa17:29
sdagueclarkb: nope, python-all doesn't pull it in17:31
clarkbsdague: huh, I have that package installed I wonder what pulled it in for me17:31
clarkbthere is a way to look at reverse depends but I can never remember how to do it17:31
sdagueyeh, I can't either17:31
openstackgerritSean Dague proposed openstack-dev/devstack: testr requires python's gdbm  https://review.openstack.org/17601217:33
mtreinishclarkb, sdague: isn't it: apt-cache rdepends17:33
*** e0ne has joined #openstack-qa17:33
*** e0ne is now known as e0ne_17:33
sdagueoh, the fact that I removed avahi probably pulled it out17:34
*** e0ne_ is now known as e0ne17:34
clarkbits a bit annoying that python-all does not pull in the split out stdlib libs17:35
*** asselin has quit IRC17:36
sdagueI would agree17:37
sdaguebut at least putting it into the general list will heal situations like this17:37
*** aix has quit IRC17:37
*** asselin has joined #openstack-qa17:37
clarkbya17:37
*** apevec has joined #openstack-qa17:43
*** apevec has joined #openstack-qa17:43
*** e0ne is now known as e0ne_17:44
*** shashankhegde has joined #openstack-qa17:45
*** e0ne_ is now known as e0ne17:45
*** mpaolino has quit IRC17:48
*** ihrachyshka has quit IRC17:50
*** e0ne is now known as e0ne_17:51
*** samueldmq has quit IRC17:53
openstackgerritMerged openstack-infra/subunit2sql: Add db api methods to delete old runs and test_runs  https://review.openstack.org/17219017:54
openstackgerritMerged openstack-infra/subunit2sql: Add a cli subcommand for deleting old rows  https://review.openstack.org/17220017:54
mtreinishpcrews: how goes the attachment table stuff? I'm wondering if I should wait for that for the next subunit2sql release or just push one soonish with ^^^17:56
*** e0ne_ has quit IRC17:56
*** yfried__ has joined #openstack-qa17:56
pcrewsmtreinish: you can go ahead and push, am still working and getting my decrepit brain to grok things.17:57
mtreinishpcrews: ok, well there is no rush one way or the other. Is there anything I can help with?17:58
pcrewsmtreinish: not really, just being my usual overthinking, overworrying, overcritical self ;)17:59
mtreinishheh, ok :)17:59
*** melwitt has joined #openstack-qa18:00
*** jhenner has quit IRC18:02
*** cdent has quit IRC18:03
*** shardy has quit IRC18:04
*** shardy has joined #openstack-qa18:04
*** jamesllondon has joined #openstack-qa18:05
*** e0ne has joined #openstack-qa18:10
*** yamamoto has joined #openstack-qa18:10
openstackgerritSean Dague proposed openstack-dev/grenade: DNM: add process debugging when things fail  https://review.openstack.org/17593518:12
*** shardy has quit IRC18:12
*** shardy has joined #openstack-qa18:14
*** Nic has joined #openstack-qa18:14
*** achanda has quit IRC18:15
*** yamamoto has quit IRC18:15
*** notmyname has quit IRC18:16
*** johnthetubaguy is now known as zz_johnthetubagu18:16
*** notmyname has joined #openstack-qa18:17
mriedemsdague: https://review.openstack.org/#/c/172326/ has been through the check queue a few times but doesn't get to the gate, i've been watching it in zuul - does it need a 2nd +W to push it through?18:20
*** achanda has joined #openstack-qa18:20
sdagueit has a Depends-On18:20
mriedemoh balls18:20
sdagueon a thing you WIP18:21
mriedemb/c of the devstack change18:21
*** ajmiller_ has joined #openstack-qa18:21
mriedemderp18:21
sdaguethe devstack change Depends-On a tempest change which is WIP18:21
mriedemyeah18:21
mriedemsorted now18:22
*** shashankhegde has quit IRC18:22
mriedemgotta check experimental the devstack change again for sanity18:22
*** ajmiller has quit IRC18:24
openstackgerritMatthew Treinish proposed openstack/tempest: Fix non-locking test accounts doc section  https://review.openstack.org/17602618:25
*** mriedem has quit IRC18:29
*** shashankhegde has joined #openstack-qa18:30
*** shardy_ has joined #openstack-qa18:33
*** mriedem has joined #openstack-qa18:35
mtreinishmriedem: so live migrating a paused instance is expected to still be paused post migration?18:36
mriedemmtreinish: yeah18:36
mriedemaccording to gilliard18:36
*** shardy has quit IRC18:36
mtreinishok, I guess it makes sense18:36
mtreinishand if it wasn't the case that devstack patch would fail18:37
mriedemjust rechecked the devstack change to run the multinode job again18:37
mriedemit was failing before18:37
mriedemyeah18:37
mriedemlast time it ran it didn't have some of the live migration fixes in nova18:37
*** openstackgerrit has quit IRC18:37
*** openstackgerrit has joined #openstack-qa18:37
*** david-lyle has joined #openstack-qa18:39
*** davideagnello has quit IRC18:41
*** davideagnello has joined #openstack-qa18:44
*** david-ly_ has joined #openstack-qa18:46
*** david-lyle has quit IRC18:46
*** dkranz has quit IRC18:48
*** wuhg has quit IRC18:59
*** suneelb has joined #openstack-qa19:00
openstackrecheckopenstack/horizon change: https://review.openstack.org/173120 failed gate-tempest-dsvm-full, gate-grenade-dsvm in the gate queue with an unrecognized error19:02
*** dkranz has joined #openstack-qa19:03
*** melwitt has quit IRC19:03
openstackgerritShilla Saebi proposed openstack-dev/devstack: made several changes to guides to comply to doc conventions  https://review.openstack.org/17602919:03
*** melwitt has joined #openstack-qa19:04
*** luqas has joined #openstack-qa19:05
*** paul_glass has quit IRC19:05
*** paul_glass has joined #openstack-qa19:08
*** luqas has quit IRC19:09
*** rbak has quit IRC19:11
*** dkranz has quit IRC19:13
openstackrecheckopenstack/horizon change: https://review.openstack.org/166374 failed gate-grenade-dsvm in the gate queue with an unrecognized error19:13
*** Rockyg has joined #openstack-qa19:15
*** shashankhegde has quit IRC19:15
*** david-ly_ has quit IRC19:18
*** shardy_ has quit IRC19:19
*** shardy has joined #openstack-qa19:20
*** dkranz has joined #openstack-qa19:25
*** jamesllondon has quit IRC19:26
openstackgerritSean M. Collins proposed openstack-dev/devstack: [WIP] Switch the default to Linuxbridge  https://review.openstack.org/16842319:39
*** achanda has quit IRC19:41
*** shashankhegde has joined #openstack-qa19:44
openstackgerritAndrey Pavlov proposed openstack/tempest: Remove common/ssh.py due to migration to tempest_lib  https://review.openstack.org/17603919:46
openstackgerritShilla Saebi proposed openstack-dev/devstack: made several changes to guides to comply to doc conventions  https://review.openstack.org/17602919:50
openstackgerritBaodong (Robert) Li proposed openstack-dev/devstack: Add /usr/local/bin to exec_dirs in rootwrap.conf  https://review.openstack.org/17604119:52
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get status time series  https://review.openstack.org/17604219:54
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add command to calculate failure count and graph it  https://review.openstack.org/17604319:54
mriedemmtreinish: https://review.openstack.org/#/c/157054/ passed on the devstack change in the exp queue19:55
mriedemhttp://logs.openstack.org/26/172326/2/experimental/check-tempest-dsvm-multinode-full/6c35688/console.html#_2015-04-21_19_06_13_74219:55
mtreinishmriedem: is that a hint to go +2 the tempest change19:56
mtreinishmriedem: looks like it skipped on neutron though: http://logs.openstack.org/54/157054/10/experimental/check-tempest-dsvm-neutron-multinode-full/2a29de2/console.html#_2015-04-21_10_41_48_03819:57
mriedemhmmm19:58
mriedemprobably something in d-g or devstack19:58
sdaguemtreinish: can you move multinode in tempest up to check (non voting)20:00
sdagueit would be nice to have on all the tempest runs20:01
openstackrecheckopenstack/keystone change: https://review.openstack.org/159944 failed gate-grenade-dsvm in the gate queue with an unrecognized error20:01
mtreinishsdague: yeah that project-config change was on my list20:01
mtreinishI was planning on dropping the postgres jobs from the tempest queue at the same time20:01
mtreinishonce we add the stable/kilo jobs tempest will eat a lot of nodes...20:02
mtreinishmriedem: that new option isn't being set in the tempest.conf file by devstack on the neutron job20:03
mtreinishbut I was pretty sure the devstack change did it unconditionally on master20:03
mriedemmtreinish: yeah i thought it was unconditional20:04
mriedemlooking20:04
mriedemi'm multi-tasking poorly right now20:04
*** paul_glass1 has joined #openstack-qa20:05
mtreinishmriedem: oh you know I might have clicked the link from the tempest review instead of devstack20:05
mtreinishyep that's exactly what I did20:06
mtreinishit worked fine on neutron: http://logs.openstack.org/26/172326/2/experimental/check-tempest-dsvm-neutron-multinode-full/699a0cf/console.html#_2015-04-21_19_07_33_09720:06
mtreinish+2s all around20:06
mriedemoh f yeah20:08
*** annashen has quit IRC20:08
mriedemoh snap even sdague got in on that action20:08
*** paul_glass has quit IRC20:08
mtreinishmriedem: I threw another +A on the devstack change to push it into the gate too20:09
mtreinishso it should just be a matter of time...20:09
mriedemcool20:09
*** andreykurilin__ has quit IRC20:09
mtreinishjogo, mriedem: btw you might want to play with: https://review.openstack.org/#/c/176043/20:10
mriedemso the devstack change is on master, the code is in kilo, i could backport the devstack change to stable/kilo20:10
mtreinishmriedem: yep20:10
mriedemmtreinish: can that be used on test_volume_boot_pattern then?20:10
*** dustins_ has joined #openstack-qa20:11
mtreinishmriedem: yep, it should work on that20:11
mriedemis infra storing this info somewhere? or what is subunit2sql using for data?20:11
mtreinishmriedem: use --database-connection mysql://query:query@logstash.openstack.org/subunit2sql on the command20:12
*** andreykurilin__ has joined #openstack-qa20:12
openstackrecheckopenstack/horizon change: https://review.openstack.org/172805 failed gate-grenade-dsvm in the gate queue with an unrecognized error20:12
mtreinishmriedem: or whatever mysql connector you want to use instead20:13
*** achanda has joined #openstack-qa20:14
*** dustins has quit IRC20:14
mtreinishmriedem: you'll want to use b1374ea0-4011-45eb-9bc9-d49c79837fac and 4fb3c7b9-f8db-4006-ab9a-030f9223d4c1 for the ids20:14
mtreinishI need to add using test_id instead of the primary key to the tool still20:15
*** jamesllondon has joined #openstack-qa20:16
*** jamesllondon has quit IRC20:16
*** e0ne is now known as e0ne_20:17
*** dboik has quit IRC20:20
*** david-lyle has joined #openstack-qa20:21
*** dboik has joined #openstack-qa20:21
*** jamesllondon has joined #openstack-qa20:23
*** jamesllondon has quit IRC20:23
mtreinishmriedem: v1: http://imgur.com/7ESjmFI and v2: http://imgur.com/eTXI1Xx20:23
mtreinishclearly I need to add date filtering20:23
mtreinishand maybe change the plotting algorithm so it treats missing entries as 0 instead of skipping them20:24
mtreinishthat's at a daily resolution fwiw20:24
mtreinishmriedem: I'll play with it some more after I head home20:25
openstackrecheckopenstack/nova change: https://review.openstack.org/165189 failed gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-full, gate-grenade-dsvm, gate-tempest-dsvm-large-ops, gate-tempest-dsvm-neutron-large-ops, gate-devstack-dsvm-cells, gate-grenade-dsvm-partial-ncpu, gate-grenade-dsvm-ironic-sideways in the gate queue with an unrecognized error20:29
mriedemwow20:29
mriedemsuwweetttt20:29
mriedemnew gate bug http://logs.openstack.org/89/165189/1/gate/gate-tempest-dsvm-full/c896f3b/logs/devstacklog.txt.gz#_2015-04-21_20_20_26_37820:30
mriedemon stable20:30
mriedemdhellmann: ^20:30
mriedemstevedore and cliff releaeses blowing up stable/juno20:30
openstackrecheckopenstack/horizon change: https://review.openstack.org/155511 failed gate-grenade-dsvm in the gate queue with an unrecognized error20:30
*** Sukhdev has joined #openstack-qa20:31
sdaguemriedem: conflict with openstackclient it looks like20:31
sdaguedtroyer: ?20:32
mriedemoh master is also busted it looks like20:34
sdaguewell, I sort of expected the giant library flush would end up like this20:34
mriedemget a plunger20:34
sdaguegiven that we released everything all at once20:34
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for stevedore/cliff release 4/21 bug 1446847  https://review.openstack.org/17606520:35
openstackbug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New] https://launchpad.net/bugs/144684720:35
mriedeme-r query ^20:35
mriedemso osc 1.1.0 was released today20:38
mriedemon stable/juno that's capped at python-openstackclient>=0.3.0,<=1.0.120:38
dtroyerit probably should be >=0.3.0,<1.1.0 but that should work20:39
sdaguedtroyer: it installs a cliff that requires stevedore >=1.3.020:39
sdaguehowever all the stable/juno servers require stevedore <=1.220:39
dtroyerso did cliff not get capped somehwere?20:40
mriedemcliff>=1.7.0,<=1.9.0 # Apache-2.0 on stable/juno20:40
mriedemlet me see which versions we're actualling installing here20:41
sdaguebut openstackclient installs sooner than that20:41
sdagueand pip has no memory20:41
mriedempython-openstackclient==1.0.120:42
sdagueyes20:42
sdaguebecause that's the version in g-r20:42
dtroyerthe first thing I see in some log from e-r is barbicanclient with what looks like cliff>=1.7.020:42
sdaguefor stable/juno20:42
dtroyerno max value20:42
sdaguedtroyer: http://logs.openstack.org/12/176012/1/check/check-grenade-dsvm/ab2f02e/logs/grenade.sh.txt.gz#_2015-04-21_17_51_27_81420:42
sdaguealso openstackclient20:42
mriedemstevedore==1.2.020:42
dtroyerI swear, pure clients just need to vendor all the things…I'll rewrite OSC in Go before I die.  Same problem but it'll be a build-time problem not a runtime problem20:44
*** cdent has joined #openstack-qa20:45
dhellmanndtroyer: we should add a require=False argument to the entry point .load() call in cliff like we have in stevedore20:46
dtroyeris there stable/juno for any of the clients?20:47
dtroyeris this uncapped requirements in a stable/juno job catching up to us?20:47
*** krotscheck has joined #openstack-qa20:47
*** shardy_ has joined #openstack-qa20:48
mriedemstable/juno was good yesterday once we got the ironic sideways job passing20:48
mriedemthen all clients/libs were released today and breaky breaky20:48
dhellmanndtroyer: I thought we had requirements capped in stable/juno now20:48
mriedemnot everytihng is capped20:49
dtroyerI don't see stable/juno branches in python-neutronclient20:49
mriedemnot sure if marconiclient and zaqarclient are worrisome20:49
dtroyernor novaclient20:49
dtroyerkeystoneclient has one20:49
*** jamesllondon has joined #openstack-qa20:51
dtroyerso no stable/juno in neutronclient uses master and an uncapped cliff req20:51
*** shardy has quit IRC20:51
dtroyerosc and barbicanclient too20:51
*** openstackgerrit has quit IRC20:52
*** openstackgerrit has joined #openstack-qa20:52
openstackgerritMerged openstack-infra/elastic-recheck: Add query for stevedore/cliff release 4/21 bug 1446847  https://review.openstack.org/17606520:53
openstackbug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New] https://launchpad.net/bugs/144684720:53
mtreinishmriedem: ^^^ man you don't even wait for me to +A it20:54
mriedemmtreinish: you said yo uwere going home20:54
mtreinishI am home :)20:54
mriedemwell, i didn't know when judge judy was over in your TZ20:55
mriedemso i moved forward20:55
* mtreinish wonders if stackalytics counts reviews on merged changes20:55
sdaguedtroyer: so barbican client is getting dragged in because of test-requirements on cinder20:55
*** openstackrecheck has quit IRC20:58
*** openstackrecheck has joined #openstack-qa20:58
sdaguedtroyer: so we could revert the test requirements installation21:00
sdagueas one way to dig out of this21:00
mtreinishsdague: did we backport that change, or are we hitting this on master too?21:01
*** annashen has joined #openstack-qa21:01
sdaguewe're definitely installing the test-requirements21:02
sdagueit might not be backported21:02
*** dustins_ has quit IRC21:03
*** zz_johnthetubagu is now known as johnthetubaguy21:04
*** suneelb has quit IRC21:04
openstackgerritSean M. Collins proposed openstack-infra/elastic-recheck: Add fingerprint for other kinds of mirror failures  https://review.openstack.org/17607621:04
*** suneelb has joined #openstack-qa21:04
*** tkammer has joined #openstack-qa21:04
*** annashen has quit IRC21:06
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get status time series  https://review.openstack.org/17604221:06
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add command to calculate failure count and graph it  https://review.openstack.org/17604321:06
*** jecarey has quit IRC21:07
*** luqas has joined #openstack-qa21:07
openstackrecheckopenstack/horizon change: https://review.openstack.org/173496 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/144684721:08
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]21:08
*** openstackrecheck has quit IRC21:10
*** openstackrecheck has joined #openstack-qa21:11
*** luqas has quit IRC21:12
*** marun has quit IRC21:14
morganfainbergmtreinish, what is verify-tempest-config?21:14
morganfainbergmtreinish, as in... what would make it silently fail.21:14
mtreinishmorganfainberg: there is a tempest.log file, the traceback is in there21:15
morganfainberghm ok21:15
dhellmannsdague, dtroyer : trying to cap cliff in cinder: https://review.openstack.org/17608221:15
mtreinishI need to add an override to force it to log to stdout if the tempest.conf is different21:15
morganfainbergugh21:16
mtreinishmorganfainberg: but that script basically does some basic api poking to check your config file against what the apis say21:16
morganfainbergthis thing assumes v2 keystone21:16
mtreinishI thought there was a fix for that21:16
mtreinishdkranz: ^^^21:16
morganfainbergrequest (main): 404 POST http://172.16.30.15:35357/v3/tenants 0.011s21:16
morganfainbergit assumes v2 semantics21:17
morganfainbergnot v2 specific.21:17
mtreinishmorganfainberg: change the tempest conf auth_version option in the identity section to 'v3'21:17
*** dboik_ has joined #openstack-qa21:18
* morganfainberg is trying to default everything to v3 for keystone in devstack21:18
mtreinishI thought we made verify-tempest-config run after that is set in devstack though21:18
mtreinishmorganfainberg: there is a devstack flag we use to tell tempest use v321:18
mtreinishandreaf: added it in preparation for that21:18
mtreinishlet me dig it up21:18
mtreinish(fwiw there is a tempest experimental job that runs with v3)21:19
dtroyerdhellmann: I'm not certain that is enough, neutronclient also does that, so does OSC, none of these three have stable/juno branches21:19
morganfainbergsigh. lots of places to change this21:19
morganfainbergand hard coded v2.0 endpoints21:19
mtreinishmorganfainberg: TEMPEST_AUTH_VERSION=v3 in your localrc should do the right thing21:19
mtreinishfor tempest at leastr21:20
dtroyerdhellmann: nova does the same thing with neutronclient21:20
* morganfainberg starts unwinding this.21:20
openstackrecheckopenstack/horizon change: https://review.openstack.org/173562 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/144684721:20
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]21:20
dhellmanndtroyer: by same thing you mean it caps neutronclient?21:20
*** jgrimm is now known as zz_jgrimm21:20
morganfainbergok so i need to go through and re-work any v2 -> v3 things21:20
*** shardy_ has quit IRC21:21
dtroyernova installs master neutronclient with uncapped cliff req21:21
dhellmanndtroyer: got it21:21
dtroyerand horizon21:21
*** dboik has quit IRC21:21
dhellmanndtroyer: wait, why? why is it installing anything not from source?21:21
dhellmannI mean not from pypi?21:21
dtroyerI'm just walking through one of the logs looking for everything that wants cliff, only barbicanclient and neutronclient so far, I'm sure I'll get to osc before I'm done21:22
dtroyerthis is from pypi21:22
openstackrecheckopenstack/cinder change: https://review.openstack.org/175909 failed because of: gate-devstack-dsvm-cells: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm: unrecognized error, gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1446847, gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1446847, gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/144684721:23
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]21:23
david-lylemorganfainberg, dtroyer, Horizon is hard coded to use v2.0 in the settings file for Horizon21:23
dtroyerhttp://paste.openstack.org/show/205028/ is the chunk of log for pip install ceilometer21:24
david-lylethere is an additional complication to using v3 for horizon21:24
david-lylewe need to use another session store in devstack or Horizon won't really work21:24
dhellmanndtroyer: ok, so we might need to create some juno branches and release fixes with caps for those libs. I'll wait to see what the full list is when you're done21:24
dtroyerat 2015-04-21 20:01:22.967 is where it checks for cliff and reports the neutronclient req that was being solved.  Am I mis-reading that?21:25
dhellmanndtroyer: looking...21:25
dhellmanndtroyer: that's saying that cliff>=1.7.0 is needed by neutronclient and is already installed21:26
dtroyerin this logfile it's only Neutron, barbican clients and OSC that appear to use cliff21:26
dhellmannthat sounds right21:27
dtroyerok, right, that means that neutron isn't capped and the already installed 1.11.0 is good21:27
dtroyerbut its not21:27
*** pc_m has quit IRC21:28
dhellmanndtroyer: osc should probably have a cap, but the clients shouldn't because they are libraries themselves21:29
dhellmannalthough as a pragmatic thing we could cap them now, we want to try to avoid that in the future if we can21:29
dtroyerso in this case it would "work" because OSC is installed last.  IIRC that's probably why OSC was moved to be installed last.21:30
dhellmannthat makes sense21:31
*** e0ne_ has quit IRC21:31
dtroyerthis makes my head hurt21:31
*** dkranz has quit IRC21:31
dhellmannyep21:32
dhellmannI'm beginning to think that devstack should install all of global-requirements.txt and then later it should install the other projects without their dependencies21:32
dhellmannalthough I'm sure there are issues with that21:32
dhellmanndtroyer: can you reproduce this in a way that gives a traceback explaining what osc is doing that causes the error? is it from a plugin?21:34
dtroyerI'll need to spin up a new devstack vm…a bit short on resources ATM21:37
*** zz_jgrimm is now known as jgrimm21:40
fungiyeah, i had sort of assumed when we were making stable branches of clients/libraries that we were branching for icehouse and juno on all of them to accommodate sync'ing from the associated requirements repo branches21:43
dhellmannfungi: I think we were trying to avoid going back that far if we could21:43
fungii see21:43
dhellmannapparently we can't21:43
fungii wouldn't have expected that we could, but i guess i was coming at it from a different perspective21:44
*** jecarey has joined #openstack-qa21:44
*** mriedem is now known as mriedem_away21:44
dhellmannfungi: although we do now have related issues with capping the requirements of libs and making the release21:44
fungihaving already tried once in the past couple years (and failed) to cap requirements for stable branches21:45
dhellmannif we cap requirements of libraries, we have the issue we had this week of juggling the caps and unfreezing master21:45
dhellmannif we do not cap the requirements, we have the issue we're having now with juno21:45
fungiso, as an example, consider how you would perform unit tests of a stable branch for a library which depends on another library21:46
fungiif you don't cap those requirements, you'll end up with a much, much newer version that you may no longer work with21:46
*** dboik_ has quit IRC21:46
dhellmannthat's true21:46
*** artom has quit IRC21:46
dhellmannI suppose what we need to do is create the stable branch and then introduce the caps21:47
dhellmanninstead of the other way around21:47
fungii started running into some of these complications when i tried the first time, and gave up when i realized it's pin everything or nothing21:47
*** dboik has joined #openstack-qa21:47
*** mwagner_lap has quit IRC21:47
openstackrecheckopenstack/nova change: https://review.openstack.org/149371 failed because of: gate-devstack-dsvm-cells: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm-ironic-sideways: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm-partial-ncpu: unrecognized error, gate-grenade-dsvm: unrecognized error, gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1446847, gate-tempest-dsvm-21:47
openstackrechecklarge-ops: unrecognized error, gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1446847, gate-tempest-dsvm-neutron-large-ops: https://bugs.launchpad.net/bugs/1446847, gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/144684721:47
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]21:47
fungior else you need to maintain a double-standard for caps you use when installing the library directly vs not having caps when you install that same library as a dependency of something else which has capped all teh transitive deps21:47
fungiin some ways we've gotten ourselves into this situation via pbr, and the expectation that you can safely have very specific version constraints in dependencies recursed through multiple transitive relationships21:49
fungiwhere pip seems to have hand-waved that away by assuming your requirements are site-specific not package-specific21:50
*** ttx has joined #openstack-qa21:50
dhellmannyeah21:50
*** patrickeast has quit IRC21:51
dhellmannI guess that's the requirements.txt vs. install_requires discussion21:51
fungiin a nutshell21:52
*** mtanino has quit IRC21:52
dhellmannso we need a list of requirements for unit tests and a list for integration tests and mostly those will be the same. Do we have examples of where they would be different?21:53
fungii think we would only have directly tracked requirements per tox env, and not install requirements via a transitive relationship at all21:55
*** mfalatic has joined #openstack-qa21:55
clarkbthey would be different wherever a project gets out of sync with global reqs21:55
*** mtanino has joined #openstack-qa21:55
clarkbthat could be due to transitive deps on the unittest side not explicitly installed or deps that haven't had their pin synced in from global reqs21:56
fungibasically making pbr stop installing things listed in the requirements.txt would be one possibility. but that's a huge shift in behavior which would take a larger conversation21:56
fungipreinstalling everything pbr might want to install from transitive relationships is a potential workaround21:57
openstackrecheckopenstack/nova change: https://review.openstack.org/168317 failed because of: gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm: https://bugs.launchpad.net/bugs/144684721:57
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]21:58
*** johnthetubaguy is now known as zz_johnthetubagu21:58
*** yamahata has joined #openstack-qa21:58
dhellmannfungi: we could do that in devstack, without changing pbr21:58
fungirichard jones had started a dependency tracker check tool which identified whether you were using any modules directly which were only supplied via transitive dependency relationships. we might be able to modify that to catch when projects started using transitive dependencies not declared directly in their requirements lists21:58
dhellmannfungi: jogo had something similar going where he was trying to ensure we capped all of our dependencies21:59
fungiso basically if `pip install .` caused pip freeze to list any module which was not also in your requirements.txt, fail the job21:59
dhellmannclarkb: we wouldn't want any drift, right? so we would want to enforce that21:59
dhellmannfungi: yeah, that's a pretty easily described test21:59
jogodhellmann: Rirchard's is better22:00
clarkbdhellmann: ya I think we would want to avoid drift in that scenario22:00
*** harlowja is now known as harlowja_away22:00
dhellmannfungi: and we could have devstack cat all of the requirements.txt files together, eliminating duplicate entries, and the install them all in one go22:00
dtroyerof course, venv's for everyone was another solution, but itsn't even close to being backported to juno22:00
fungihowever, with loose (or no) requirements caps, that is still fragile since a new release of one of your declared dependencies could add a dependency you don't (yet) have listed22:00
ttxAbout to go to bed. If you have to pick between fast and good for the fix, please do fast, we can iterate on good once we are past this nightmare22:00
dhellmanndtroyer: venvs solve the problem for us, but not for diistros22:00
dhellmannttx: yep22:01
ttxWe kind of need to push stuff to RC2s tomorrow, and ideally do those stable/kilo lib releases22:01
dhellmannttx: still thinking about how to actually solve it -- I have a few patches in play, but I have another meeting starting22:01
* jogo wishes we could vendor and use venvs and let the distros just do there own thing22:01
fungiso if we're _only_ trying to solve this for devstack right now, yes the problem space is a bit reduced22:01
dhellmannfungi: yeah, I think that's good enough for now22:01
ttxgdnite!22:01
funginight ttx!22:02
fungii agree, the de-dupe requirements idea has a good chance of working22:02
fungirunning pip install more than once in an environment should just be considered undefined behavior22:02
fungiwe should try to avoid doing that22:02
*** suneelb has quit IRC22:03
fungii haven't looked at devstack lately, but if its pip install into the system env is once per service rather than once total, we're asking for trouble on dependency resolution22:04
dtroyerits once or more per service depending on optional features22:05
dtroyerdoing one giant pip install isn't going to be fun at all, totally breaks down with the plugins22:05
*** harlowja_away is now known as harlowja22:05
fungiargh, urgh22:06
jogofungi: isn't this fun :)22:06
openstackrecheckopenstack/nova change: https://review.openstack.org/160089 failed because of: gate-devstack-dsvm-cells: unrecognized error, gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1446847, gate-nova-docs: unrecognized error, gate-nova-pep8: unrecognized error, gate-nova-python27: unrecognized error, gate-nova-tox-functional:22:07
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]22:07
openstackrecheckunrecognized error, gate-tempest-dsvm-full-ceph: unrecognized error, gate-tempest-dsvm-full: unrecognized error, gate-tempest-dsvm-large-ops: unrecognized error, gate-tempest-dsvm-neutron-full: unrecognized error, gate-tempest-dsvm-neutron-large-ops: unrecognized error, gate-tempest-dsvm-nova-v21-full: unrecognized error, gate-tempest-dsvm-postgres-full: unrecognized error22:07
*** Swami has quit IRC22:07
fungijogo: i know, that's why i ran screaming when i looked at capping requirements on stable branches last time22:07
jogowow docs is down22:07
*** suneelb has joined #openstack-qa22:07
fungijogo: good news! it's not hosted on openstack services at all22:07
fungirackspace cloudsites22:07
*** suneelb has quit IRC22:08
fungithough it's working for me22:08
*** suneelb has joined #openstack-qa22:08
fungitemporary?22:08
jogoso this is fun http://logs.openstack.org/89/160089/10/gate/gate-nova-pep8/8b84408/console.html#_2015-04-21_21_53_42_33822:08
jogofungi: no not docs the site, the job22:08
jogoand pep822:08
jogo TypeError: cannot create weak reference to 'Struct' object22:08
sdagueso, could we also just release a version of cliff that doesn't require stevedore >=1.322:09
fungidtroyer: how much fun would it be for devstack to collect requested pip installs (from service lists, plugins, et cetera) and batch them into one actual call?22:09
*** suneelb has quit IRC22:10
* fungi has found a new and unexpected use for the word "fun"22:10
sdaguefungi: that was the suggestion from lifeless in the thread about this22:10
*** suneelb has joined #openstack-qa22:10
fungii thought i'd read the whole thread, but must have missed that one22:10
openstackrecheckopenstack/horizon change: https://review.openstack.org/142950 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1446847, gate-horizon-docs: unrecognized error, gate-horizon-pep8: unrecognized error, gate-horizon-python27-django14: unrecognized error, gate-horizon-python27: unrecognized error, gate-horizon-selenium: unrecognized error, gate-tempest-dsvm-full: unrecognized error22:12
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]22:12
jogolooks like we have a new issue22:13
dtroyerfungi:  I'm looking to see if the ordering of things makes that hard or really hard22:13
*** suneelb has quit IRC22:13
jogothat is breaking everything even worse http://logs.openstack.org/35/171435/2/gate/gate-tempest-docs/49e026b/console.html#_2015-04-21_22_10_21_93822:13
*** yamahata has quit IRC22:13
*** suneelb has joined #openstack-qa22:14
jogosdague fungi dtroyer22:14
*** andreykurilin__ has quit IRC22:14
*** suneelb1 has joined #openstack-qa22:14
dtroyeralso, devstack is one thing, grenade totally another on the target side22:14
fungimy wife is going to gnaw my arm if we don't head out to eat, but i'll catch back up after and see where i can help on this front22:14
notmynameto facilitate getting RC candidates out, does it make sense to disable grenade to make it non-voting until this is sorted?22:15
sdaguedtroyer: yeh, it feels fragile to me22:15
dtroyerso, venvs for everyone and post-install work out the differences to produce a single list?22:15
lifelessso, one call makes things easier given our current structure22:15
lifelessfixing pip 2687 would eliminate the need for a single call22:16
sdaguelifeless: not when we move across 2 trees, in the upgrade case22:16
sdagueanyway, tactical fixes22:16
sdaguefor installing cliff at a version in devstack early might help22:17
lifelesssdague: it would even for the upgrade case, but yes22:17
lifelessI guess I'm saying22:17
lifelessif its a three week endeavour22:17
lifelessfixing pip will be faster22:17
lifeless(not all of pip, 2687 specifically)22:17
sdaguelifeless: yeh, don't know. right now we should be looking at tactical fix here to unblock folks.22:18
*** patrickeast has joined #openstack-qa22:18
jogosdague: so fixing cliff isn't even the top issue anymore it looks like22:18
jogosdague: yes its blocking but cryptography is failing to even install22:18
*** suneelb has quit IRC22:18
dhellmannjogo: is that a bad release of cryptography?22:19
jogodhellmann: not sure, didn't see a recent one22:19
dhellmannhmm22:19
sdaguethe release was on the 11th, so I doubt it22:20
jogohttp://logs.openstack.org/50/142950/3/gate/gate-horizon-pep8/b3c9895/console.html#_2015-04-21_21_54_50_733 is all I know right now22:20
fungiright, we need a one-evening endeavor, so if we can get things flowing again with a few tags and patches then that's fine for the moment22:20
jogoand taht it started in the past few hours22:20
fungianyway, i'll be back as quickly as i can22:20
sdaguejogo: something else might have flushed it22:20
sdagueone of the other libraries22:20
jogosdague: very possible yeah22:21
*** patrickeast has quit IRC22:21
jogohttps://bugs.launchpad.net/openstack-gate/+bug/144688222:22
openstackLaunchpad bug 1446882 in OpenStack-Gate "cryptography is failing to install" [Undecided,New]22:22
lifelessbarbicanclient is another proximate cause here22:22
sdaguejogo: http://logs.openstack.org/54/157054/10/check/gate-tempest-docs/d7107ee/console.html22:23
dtroyerneutronclient too, the three things that use cliff are the first-order problem.  there may be other problems…22:23
sdagueis a working one, it has all these versions22:23
*** paul_glass1 has quit IRC22:23
lifelessits whats http://logs.openstack.org/89/165189/1/gate/gate-tempest-dsvm-full/c896f3b/logs/devstacklog.txt.gz#_2015-04-21_20_16_53_29322:23
sdaguelifeless: right, that's the conduit for installing a too new cliff22:23
jogodhellmann: I don't think its related22:23
jogohttp://logs.openstack.org/61/176061/2/check/gate-horizon-pep8/d51a2d4/console.html22:23
jogofailed22:23
*** patrickeast has joined #openstack-qa22:24
jogoand didn't insall barbican22:24
dtroyerhorizon pulls in neutronclient22:24
dhellmannsdague: what would we have to do outside of cliff to let us release a version of cliff that has a different stevedore requirement?22:24
sdaguedhellmann: nothing, right?22:24
lifelesscan't we just up the stevedore minimum in juno ?22:24
dhellmannsdague: well, we would have to land a requirements change22:25
dhellmannI guess those jobs are probably still turned off22:25
sdaguedhellmann: no, requirements enforcement is off22:25
sdaguelifeless: we do that, that's the issue22:25
lifelesssdague: huh?22:25
dtroyerto get around this tonight, can we pre-install the previous cliff and stevedore before everything else?22:25
openstackgerritJoe Gordon proposed openstack-infra/elastic-recheck: Add fingerprint fur bug 1446882  https://review.openstack.org/17610722:25
openstackbug 1446882 in OpenStack-Gate "cryptography is failing to install" [Undecided,New] https://launchpad.net/bugs/144688222:25
dhellmanndtroyer: that seems like a good short-term approach22:25
dtroyerunless minimums went up, that should still be good?22:25
jogosdague dtroyer have to go AFK for a bit but first step for this bug would be to try reproducing it locally22:26
lifelessdtroyer: no, the problem is that the install of cinder will force upgrade stevedore22:26
sdaguelifeless: all the servers require stevedore <= 1.222:26
lifelesssorry22:26
*** Rockyg has quit IRC22:26
lifelessI meant force upgrade cliff22:26
sdagueright, that's actually where we are22:26
sdaguecliff is too new22:26
lifelesssdague: if we put requirements enforcement back on and upgraded the requirements in global/juno22:26
*** marun has joined #openstack-qa22:26
lifelesssdague: wouldn't that work, tactically?22:26
sdaguelifeless: no, that won't help22:27
lifelessrequirement of stevedore22:27
sdaguewe're in pypi22:27
clarkbrequirement enforcement should be independent of this22:27
clarkbthats a separate job22:27
sdagueand pip isn't tracking what's installed22:27
lifelesssdague: huh22:27
sdagueor more importantly what things need22:27
sdagueso it installed a new cliff22:27
lifelesssdague: yes I got that.22:27
openstackrecheckopenstack/nova change: https://review.openstack.org/140669 failed because of: gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1446847, gate-tempest-dsvm-postgres-full: unrecognized error22:28
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]22:28
sdaguewhich violates the stevedore requirement that other software that was previously installed needs22:28
dtroyerso I just ran a stable/juno devstack on a trusty that had pre-today packages and it worked22:28
lifelesssdague: yes, if 2687 was fixed it would error isntead22:28
lifelesssdague: which would be no better22:28
sdaguelifeless: correct22:29
lifelesssdague: let me try asking my question a different way22:29
lifelesssdague: what is it about stevedore > 1.2 that breaks servers?22:29
morganfainbergmtreinish, ok i think i need to go unwind a bunch of v2/v3 keystone isms in devstack that seem to be arbitrarily different.22:29
morganfainbergmtreinish, and that we hardcode v2.0 in all over... fantastic.22:29
sdaguelifeless: I don't know22:29
dtroyerit's above the cap?22:29
lifelessdtroyer: that was my assumption22:29
lifelessso my proposal is just to lift the cap22:30
clarkblifeless: this is why I am a fan of not doing this22:30
dtroyermorganfainberg: good luck my friend, that's a dark and perious journey you are about to undertake22:30
clarkbbecause by not capping/pinning we actually know what works and what doesn't work22:30
morganfainbergdtroyer, well we need to be able to deploy in devstack w/o v2.0 enabled22:30
clarkbin our curret world we have none of that information so when it becomes important to change a thing we are doing it blind22:30
morganfainbergdtroyer, the first step: default to v3, optionally allow v2.022:30
sdagueclarkb: that's fine, then it's just fire drill all the time on stable22:30
lifelessclarkb: I agree22:30
lifelessclarkb: ut22:30
lifelessclarkb: but22:30
morganfainbergdtroyer, i'm already sorry i started looking at this.22:30
clarkbsdague: honestly I am not sure it is22:30
sdagueclarkb: it really was22:30
clarkbsdague: we seem to be doing just as much firedrill with the stuff in place as we did then22:30
lifelessclarkb: there are tradeoffs. lets not get distracted22:31
lifelessright now we need tactical fix.22:31
sdagueyes, agreed, tactical22:31
lifelessI was not happy before the super tight pinning22:31
lifelessand I'm not happy now either :)22:31
*** Sukhdev has quit IRC22:31
lifelessso I, along with everyone that cares is going to put effort into figuring out a long solution: just not today :)22:31
mtreinishmorganfainberg: well to be fair a lot of that probably pre-dates v322:32
*** mwagner_lap has joined #openstack-qa22:32
mtreinishor at least I'm assuming22:32
sdagueso, agree, if we raise the cap, that might get us tactical fix22:32
sdaguelifeless: you want to propose that into stable/juno ?22:32
morganfainbergmtreinish, sure. but it's like "oh we stick an option for v2 / v3 here" and here and here and over there22:32
lifelesssdague: no, you can22:32
lifelesssdague: I'm mainly sheparding the next release of pip right now - this gets a priority interrupt to help22:33
lifelesssdague: but if there is someone else driving thats great22:33
morganfainbergmtreinish, i think i'm going to rewire all this to use the IDENTITY_API_VERSION22:33
sdaguelifeless: well it's better if someone other than doug or I do it, as we're the only +2ers here.22:33
lifelessthat sounds like beauracracy gone wild22:34
morganfainbergmtreinish, and i apologize in advance this wont be pretty... but at least it'll get us down to "use vX of keystone" in one location22:34
dhellmannsdague: I'm willing to W+1 a patch you make if it fixes this22:35
*** cdent has quit IRC22:35
dtroyerso, in parallel i'm trying this: https://review.openstack.org/17611122:35
sdaguedtroyer: you'll need to make something else that's on master Depends-On that for testing22:36
dtroyererr, I did juno, should have done kilo?22:38
*** BadCub is now known as BadCub_Away22:38
sdaguedtroyer: no, in juno22:38
mtreinishmorganfainberg: yeah I was going to recommend a global option for doing that. Anything else would be kinda crazy22:38
sdaguekilo upgrade hasn't landed yet, because of a keystone / oslo issue22:38
sdaguedhellmann: https://review.openstack.org/#/c/176113/22:38
dhellmannsdague: ok, I'll keep an eye on the tests for that22:39
sdagueI kind of assume this is going to explode in an odd way22:39
dhellmannyeah, let's see what happens22:39
sdaguebecause what stevedore's requirements are22:39
*** jecarey has quit IRC22:39
dhellmannstevedore doesn't depend on much, just pbr and six22:40
openstackrecheckopenstack/tempest change: https://review.openstack.org/157054 failed because of: gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1446847, gate-tempest-docs: unrecognized error, gate-tempest-dsvm-full: unrecognized error, gate-tempest-dsvm-heat: unrecognized error, gate-tempest-dsvm-large-ops: unrecognized error, gate-22:41
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]22:41
openstackrechecktempest-dsvm-neutron-full: unrecognized error, gate-tempest-dsvm-neutron-large-ops: unrecognized error, gate-tempest-dsvm-nova-v21-full: unrecognized error, gate-tempest-dsvm-postgres-full: unrecognized error, gate-tempest-dsvm-trove: unrecognized error, gate-tempest-pep8: unrecognized error, gate-tempest-python27: unrecognized error22:41
*** bknudson has quit IRC22:41
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add command to calculate failure count and graph it  https://review.openstack.org/17604322:43
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get status time series  https://review.openstack.org/17604222:43
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add start and stop date options to subunit2sql-graph  https://review.openstack.org/17611422:43
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add modular subunit2sql-graph entry point  https://review.openstack.org/17611522:43
*** dboik_ has joined #openstack-qa22:50
*** dboik has quit IRC22:53
*** Swami has joined #openstack-qa22:53
openstackrecheckopenstack/tempest change: https://review.openstack.org/175447 failed because of: gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1446847, gate-tempest-docs: unrecognized error, gate-tempest-dsvm-full: unrecognized error, gate-tempest-dsvm-heat: unrecognized error, gate-tempest-dsvm-large-ops: unrecognized error, gate-22:54
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]22:54
openstackrechecktempest-dsvm-neutron-full: unrecognized error, gate-tempest-dsvm-neutron-large-ops: unrecognized error, gate-tempest-dsvm-nova-v21-full: unrecognized error, gate-tempest-dsvm-postgres-full: unrecognized error, gate-tempest-dsvm-trove: unrecognized error, gate-tempest-pep8: unrecognized error, gate-tempest-python27: unrecognized error22:54
*** Longgeek has quit IRC22:54
morganfainbergmtreinish: so i need to do some magic replacement stuff22:56
morganfainbergmtreinish: get_keystone_version_for_endpoint_url22:56
morganfainbergmtreinish: this needs to be v2.0 or v322:56
openstackrecheckopenstack/tempest change: https://review.openstack.org/173136 failed because of: gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1446847, gate-tempest-docs: unrecognized error, gate-tempest-dsvm-full: unrecognized error, gate-tempest-dsvm-heat: unrecognized error, gate-tempest-dsvm-large-ops: unrecognized error, gate-22:56
openstackLaunchpad bug 1446847 in OpenStack-Gate "stable/juno gate is busted on stevedore/cliff releases on 4/21" [Undecided,New]22:56
openstackrechecktempest-dsvm-neutron-full: unrecognized error, gate-tempest-dsvm-neutron-large-ops: unrecognized error, gate-tempest-dsvm-nova-v21-full: unrecognized error, gate-tempest-dsvm-postgres-full: unrecognized error, gate-tempest-dsvm-trove: unrecognized error, gate-tempest-pep8: unrecognized error, gate-tempest-python27: unrecognized error22:56
morganfainbergmtreinish: should i put this in functions or somewhere like in the lib/keystone22:56
openstackrecheckopenstack/tempest change: https://review.openstack.org/171435 failed because of: gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/1446847, gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1446847, gate-tempest-docs: unrecognized error, gate-tempest-dsvm-full: unrecognized error, gate-tempest-dsvm-heat: unrecognized error, gate-tempest-dsvm-large-ops: unrecognized error, gate-22:56
openstackrechecktempest-dsvm-neutron-full: unrecognized error, gate-tempest-dsvm-neutron-large-ops: unrecognized error, gate-tempest-dsvm-nova-v21-full: unrecognized error, gate-tempest-dsvm-postgres-full: unrecognized error, gate-tempest-dsvm-trove: unrecognized error, gate-tempest-pep8: unrecognized error, gate-tempest-python27: unrecognized error22:57
morganfainbergmtreinish: i *think* lib/keystone makes sense...22:57
mtreinishmorganfainberg: sure, you just gotta make sure it's loaded everywhere you'll need the endpoint22:59
morganfainbergmtreinish, it looks like it is loaded early in stach.sh22:59
morganfainbergstack.sh22:59
morganfainbergearly enough22:59
morganfainbergthat is22:59
*** ibiris is now known as ibiris_away22:59
*** dboik_ has quit IRC22:59
openstackgerritSean Dague proposed openstack-dev/devstack: testr requires python's gdbm  https://review.openstack.org/17601222:59
*** mlavalle has quit IRC23:03
*** annashen has joined #openstack-qa23:03
openstackgerritMerged openstack-infra/elastic-recheck: Add fingerprint fur bug 1446882  https://review.openstack.org/17610723:05
openstackbug 1446882 in OpenStack-Gate "cryptography is failing to install" [Undecided,New] https://launchpad.net/bugs/144688223:05
*** ajmiller_ is now known as ajmiller23:05
*** annashen has quit IRC23:08
sdaguedhellmann: ok, so I'm dropping off, but this is where I left things23:09
sdaguehttps://jenkins06.openstack.org/job/check-grenade-dsvm/25944/console is the grenade job for23:09
sdaguehttps://review.openstack.org/#/c/176012/23:09
sdaguewhich is a noop in the gate, but it depends on the requirements change in juno23:09
sdagueso if that grenade job passes, the juno requirements thing worked23:10
sdagueI'll be back on in probably 11 hrs or so, and will see what pieces I can pick up if everything is still bonkers23:10
dhellmannsdague: ok, I'll keep an eye on that job for a bit and if it passes approve the requirements thing23:11
*** yamamoto has joined #openstack-qa23:11
*** hemna is now known as hemnafk23:12
sdagueoh, never mind, everything is fubar by the cffi / pyparsing thing23:12
*** suneelb1 has quit IRC23:12
*** suneelb has joined #openstack-qa23:13
sdaguehey, that's need we've got 2 simultaneous gate wedges23:13
sdagueone because of capped requirements23:13
sdagueand one because of uncapped requirements23:13
sdague... giving up for the day, and getting a drink23:14
jogosdague: cffi is is https://bugs.launchpad.net/openstack-gate/+bug/1446882 ?23:16
openstackLaunchpad bug 1446882 in OpenStack-Gate "cryptography is failing to install" [Undecided,New]23:16
clarkbjogo: yes23:16
clarkbjogo: pyopenssl depends on cryptography for its ssl bindings, cryptography depends on cffi to do its binding which depends on pycparser to do its C parsing and pycparser released today and is broken23:17
jogodoh so it did23:17
jogobecause that is a transitive dependency what do we do now?23:19
jogoget cffi to cut a new lib?23:19
*** yamamoto has quit IRC23:21
clarkbwe can pin pycparser everywhere23:21
clarkbwe can pin to a pre python cryptography release of pyopensslthough I think some projects use cryptography directly23:21
jogoclarkb: we have to roll out patches to each repo for that though23:21
clarkbjogo: yes likely23:22
jogowow https://github.com/pyca/cryptography/issues/185823:25
jogothat travels fast23:25
clarkbwell its likely a bug in pycparser or cffi assuming that cryptography's C is valid C23:27
clarkbeven if it isn't valid C cffi/pycparser should error more gracefully so you can fix your C23:27
jogoclarkb: very likely23:28
*** dimtruck is now known as zz_dimtruck23:34
openstackgerritDimitri John Ledkov proposed openstack-dev/devstack: Support os-release files.  https://review.openstack.org/17612923:37
fungiso... scrollback is a doozy23:39
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add command to calculate failure count and graph it  https://review.openstack.org/17604323:39
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get status time series  https://review.openstack.org/17604223:39
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add start and stop date options to subunit2sql-graph  https://review.openstack.org/17611423:39
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add modular subunit2sql-graph entry point  https://review.openstack.org/17611523:39
fungiactually only ~150 lines... not so bad23:39
*** sabeen3 has quit IRC23:40
openstackgerritMatthew Treinish proposed openstack/tempest: Add section to config guide for setting up services  https://review.openstack.org/17414923:41
*** openstackrecheck has quit IRC23:41
openstackgerritMatthew Treinish proposed openstack/tempest: Add a paragraph on the use of tempest_roles option  https://review.openstack.org/17467523:41
openstackgerritMatthew Treinish proposed openstack/tempest: Fix non-locking test accounts doc section  https://review.openstack.org/17602623:41
*** openstackrecheck has joined #openstack-qa23:41
*** ajmiller has quit IRC23:41
*** tochi has joined #openstack-qa23:42
fungii wonder if the pycparser issues are related to the memory usage reduction work they did after ianw and lifeless stumbled over how much additional memory newer pyopenssl was consuming because of it23:44
lifelessfungi: I just kibbitzed, it was all ianw23:46
lifelessI commented because it seemed to me that we were (and still are) in finger pointing mode in the bug23:46
fungiyeah, it's not really gone anywhere other than pycparser squeezing out a mild (not order of magnitude) reduction in memory waste23:47
ianwlifeless / fungi : yeah, for reference work was done on https://github.com/eliben/pycparser/issues/7223:47
fungicertainly not enough for us to start using it in devstack successfully anyway23:47
fungialso, in response to sdague's comments about requirements checks being suspended, i only stopped them on master branches not stable branches23:48
fungiand https://review.openstack.org/176036 can undo that as soon as we're ready23:49
fungii'm just hesitant to approve it until we're closer to having problems ironed out in stable23:49
*** bknudson has joined #openstack-qa23:54
*** rwsu has quit IRC23:56
*** melwitt has quit IRC23:56
*** yamamoto has joined #openstack-qa23:57
*** ibiris_away is now known as ibiris23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!