Friday, 2016-01-08

*** bklei has joined #puppet-openstack00:09
*** bklei has quit IRC00:13
*** bklei has joined #puppet-openstack00:14
*** ntpttr has quit IRC00:14
*** morazi has quit IRC00:14
*** bklei has quit IRC00:18
*** ducttape_ has joined #puppet-openstack00:20
openstackgerritliaonanhai proposed openstack/puppet-nova: Use identity_uri and auth_uri by default  https://review.openstack.org/26268600:23
mdormandoes anybody understand why there are two admin_state_up methods in the neutron_router provider?  https://github.com/openstack/puppet-neutron/blob/master/lib/puppet/provider/neutron_router/neutron.rb#L144-L15000:29
mdormanwith both in there I get failures with “Could not evaluate: wrong number of arguments (0 for 1)”.   not sure if it’s something on my end, or a bug.00:30
*** openstackgerrit has quit IRC00:32
*** rahulait has quit IRC00:33
*** openstackgerrit has joined #puppet-openstack00:33
*** rahulait has joined #puppet-openstack00:33
*** baker has joined #puppet-openstack00:35
*** ducttape_ has quit IRC00:43
*** karimb has joined #puppet-openstack00:46
*** karimb has quit IRC00:47
*** ducttape_ has joined #puppet-openstack00:48
mdormanactually i think i figured it out.  bug report ot come tomorrow00:50
openstackgerritMerged openstack/puppet-ironic: Implement WSGI support for Ironic API  https://review.openstack.org/26345000:52
openstackgerritMerged openstack/puppet-designate: Support of PyMySQL driver for MySQL backend  https://review.openstack.org/26347500:54
*** zhangjn has joined #puppet-openstack00:54
*** zhangjn has quit IRC00:54
*** zhangjn has joined #puppet-openstack00:55
*** mdorman has quit IRC00:56
openstackgerritMerged openstack/puppet-nova: Allow spice protocol to be deployed  https://review.openstack.org/26377700:58
*** rahulait has quit IRC01:01
*** bklei has joined #puppet-openstack01:02
*** bklei has quit IRC01:04
*** ducttape_ has quit IRC01:05
*** zhangjn has quit IRC01:06
*** baker has quit IRC01:11
*** zhangjn has joined #puppet-openstack01:15
openstackgerritXingchao Yu proposed openstack/puppet-designate: Add designate::mdns class  https://review.openstack.org/21497601:33
openstackgerritliaonanhai proposed openstack/puppet-nova: Ensure rabbit_* in DEFAULT is absent  https://review.openstack.org/26292801:36
openstackgerritMerged openstack/puppet-neutron: Map allocation_pool property to set  https://review.openstack.org/24394801:47
*** zhangjn has quit IRC01:48
*** severion has quit IRC01:49
*** v1k0d3n has joined #puppet-openstack01:49
*** saneax_AFK is now known as saneax01:51
*** saneax is now known as Guest4732101:51
*** baker has joined #puppet-openstack01:55
*** baker has quit IRC02:04
*** baker has joined #puppet-openstack02:07
*** baker has quit IRC02:07
*** baker has joined #puppet-openstack02:08
*** baker_ has joined #puppet-openstack02:09
*** baker has quit IRC02:12
*** zhangjn has joined #puppet-openstack02:23
*** richm has quit IRC02:31
*** jaosorior has quit IRC02:35
*** jaosorior has joined #puppet-openstack02:36
openstackgerritTim Rozet proposed openstack/puppet-neutron: Adds the ability to force metadata with dhcp agent  https://review.openstack.org/26504802:38
*** zhangjn_ has joined #puppet-openstack02:39
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/puppet-zaqar: Update typo  https://review.openstack.org/26317602:39
*** zhangjn has quit IRC02:42
*** bklei has joined #puppet-openstack02:44
*** bklei has quit IRC02:44
*** ilbot3 has quit IRC02:46
openstackgerritBen Kero proposed openstack/puppet-ceilometer: docs: add required db subclass to README.md  https://review.openstack.org/26504902:47
*** ilbot3 has joined #puppet-openstack02:48
openstackgerritBen Kero proposed openstack/puppet-ceilometer: Add required db subclass to README.md  https://review.openstack.org/26504902:48
*** zhangjn has joined #puppet-openstack02:53
*** zhangjn_ has quit IRC02:56
*** rahulait has joined #puppet-openstack03:02
*** zhangjn_ has joined #puppet-openstack03:17
*** zhangjn has quit IRC03:17
*** zhangjn_ has quit IRC03:17
*** zhangjn has joined #puppet-openstack03:18
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/puppet-zaqar: Update typo  https://review.openstack.org/26317603:35
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/puppet-barbican: Update typo  https://review.openstack.org/26318503:35
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/puppet-gnocchi: Update typo  https://review.openstack.org/26318303:35
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/puppet-aodh: Update typo  https://review.openstack.org/26318603:35
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/puppet-vitrage: Update typo  https://review.openstack.org/26317703:35
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/puppet-magnum: Update typos  https://review.openstack.org/26318103:35
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Deploy & Test Ironic  https://review.openstack.org/26296503:44
*** ducttape_ has joined #puppet-openstack03:45
*** natarej has joined #puppet-openstack03:47
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: scenario001: enable Aodh on ubuntu platform  https://review.openstack.org/26506103:49
*** zhangjn has quit IRC03:56
openstackgerritAdam Vinsh proposed openstack/puppet-swift: Notify related services on config file change  https://review.openstack.org/26506403:56
vinshNot sure how we have missed these services..... need this IMO ^^03:56
*** ducttape_ has quit IRC04:34
*** ducttape_ has joined #puppet-openstack04:37
*** markvoelker has quit IRC04:38
*** ducttape_ has quit IRC04:46
*** baker_ has quit IRC05:00
*** rahulait has quit IRC05:05
*** rahulait has joined #puppet-openstack05:06
*** rahulait has quit IRC05:10
openstackgerritMichael Chapman proposed openstack/puppet-tripleo: Add opendaylight composition class.  https://review.openstack.org/26507605:11
openstackgerritMichael Chapman proposed openstack/puppet-tripleo: Add opendaylight composition class.  https://review.openstack.org/26507605:13
*** rahulait has joined #puppet-openstack05:39
*** jaosorior has quit IRC05:47
*** zhangjn has joined #puppet-openstack05:52
*** zhangjn_ has joined #puppet-openstack05:58
*** zhangjn_ has quit IRC06:02
*** zhangjn has quit IRC06:02
*** zhangjn has joined #puppet-openstack06:03
*** logan- has quit IRC06:08
*** logan- has joined #puppet-openstack06:08
*** mgagne has quit IRC06:09
*** markvoelker has joined #puppet-openstack06:13
*** mgagne has joined #puppet-openstack06:16
*** mgagne is now known as Guest4180406:16
*** markvoelker has quit IRC06:18
*** jaosorior has joined #puppet-openstack06:21
openstackgerritliaonanhai proposed openstack/puppet-nova: Use identity_uri and auth_uri by default  https://review.openstack.org/26268606:41
*** paramite|afk is now known as paramite07:04
*** paramite has quit IRC07:10
*** rahulait has quit IRC07:26
*** logan- has quit IRC07:44
*** zhangjn_ has joined #puppet-openstack08:04
*** foxhunt_away is now known as foxhunt7208:06
*** samuelBartel has joined #puppet-openstack08:06
*** rochaporto has joined #puppet-openstack08:07
*** zhangjn has quit IRC08:07
*** markvoelker has joined #puppet-openstack08:15
*** jtomasek has joined #puppet-openstack08:16
*** jaosorior has quit IRC08:16
*** jaosorior has joined #puppet-openstack08:16
*** markvoelker has quit IRC08:19
*** jistr has joined #puppet-openstack08:24
*** rmart04 has joined #puppet-openstack08:28
*** jpena has joined #puppet-openstack08:29
*** zhangjn_ has quit IRC08:42
*** zhangjn has joined #puppet-openstack08:43
*** dgurtner has joined #puppet-openstack08:47
*** dgurtner has quit IRC08:47
*** dgurtner has joined #puppet-openstack08:47
*** gfidente has joined #puppet-openstack08:55
*** gfidente has quit IRC08:55
*** gfidente has joined #puppet-openstack08:55
*** karimb has joined #puppet-openstack08:59
*** zhangjn has quit IRC09:02
*** gchamoul is now known as gchamoul_Doc_afk09:22
*** jtomasek has quit IRC09:45
*** derekh has joined #puppet-openstack09:53
*** paramite has joined #puppet-openstack09:55
*** markvoelker has joined #puppet-openstack10:15
*** karimb has quit IRC10:18
*** karimb_ has joined #puppet-openstack10:18
*** markvoelker has quit IRC10:20
*** jaosorior has quit IRC10:37
*** jaosorior has joined #puppet-openstack10:38
*** rmart04 has quit IRC10:39
*** chem has joined #puppet-openstack10:52
*** gchamoul_Doc_afk is now known as gchamoul10:57
*** zhangjn has joined #puppet-openstack11:16
*** zhangjn has quit IRC11:16
*** zhangjn has joined #puppet-openstack11:17
*** zhangjn has quit IRC11:17
*** zhangjn has joined #puppet-openstack11:17
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-openstacklib: Utility to handle IPv6 address brackets.  https://review.openstack.org/26492711:45
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-nova: Supports IPv6 in vnc proxy.  https://review.openstack.org/26495111:47
openstackgerritOleksiy Molchanov proposed openstack/puppet-nova: Add host_uuid to libvirtd.conf  https://review.openstack.org/13171011:56
openstackgerritOleksiy Molchanov proposed openstack/puppet-ceph: Add possibility to preserve previous apache deployment  https://review.openstack.org/26063911:58
*** zhangjn_ has joined #puppet-openstack11:58
*** zhangjn_ has quit IRC11:58
*** zhangjn has quit IRC11:59
*** zhangjn has joined #puppet-openstack11:59
*** khappone_ has quit IRC12:00
*** markvoelker has joined #puppet-openstack12:01
*** zhangjn has quit IRC12:03
*** rlaurika has quit IRC12:03
*** markvoelker has quit IRC12:06
EmilienMgood morning12:11
*** Guest47321 is now known as saneax_AFK12:15
*** saneax_AFK is now known as saneax12:16
*** saneax is now known as Guest9099112:17
colonwqEmilienM, Hooray. It is Friday.12:27
*** khappone has joined #puppet-openstack12:39
openstackgerritMartin Mágr proposed openstack/puppet-openstacklib: openstackconfig idempotency fix  https://review.openstack.org/26523812:43
openstackgerritMartin Mágr proposed openstack/puppet-neutron: LBaaSv2 support  https://review.openstack.org/23472812:44
*** markvoelker has joined #puppet-openstack12:45
*** jpena is now known as jpena|lunch13:00
*** dprince has joined #puppet-openstack13:09
*** ducttape_ has joined #puppet-openstack13:19
openstackgerritMartin Mágr proposed openstack/puppet-neutron: LBaaSv2 support  https://review.openstack.org/23472813:26
*** jayg|g0n3 is now known as jayg13:26
socialEmilienM: ping about https://github.com/openstack/puppet-neutron/commit/0e041d4b694840b5bf99c09d7fef2f9b7a97d0ff13:26
EmilienMsocial: yeah?13:27
socialEmilienM: shouldn't this Neutron_fwaas_service_config<||> ~> Service['neutron-l3'] be in the neutron-l3 agent manifest?13:27
*** morazi has joined #puppet-openstack13:27
socialEmilienM: it's reason why I get http://logs.openstack.org/89/254889/2/check/gate-puppet-neutron-puppet-unit-latest-dsvm-centos7/790cb60/console.html#_2016-01-07_16_52_23_47313:27
socialEmilienM: issue there is that neutron api requires *aas packages installed if they are enabled13:28
EmilienMsocial: indeed, we can move it13:28
openstackgerritLukas Bezdicka proposed openstack/puppet-neutron: Install service packages on api nodes  https://review.openstack.org/20087713:30
*** ducttape_ has quit IRC13:33
mfloboEmilienM, ping I have a question about this patch https://review.openstack.org/#/c/252959/13:42
mfloboEmilienM, I'd like to know if is need any action from me to move on with that patch, or I just have to wait for more reviews?13:43
*** karimb_ has quit IRC13:46
*** karimb has joined #puppet-openstack13:50
*** jaosorior has quit IRC14:02
*** richm has joined #puppet-openstack14:02
*** jpena|lunch is now known as jpena14:15
*** rahulait has joined #puppet-openstack14:17
*** rochaporto has quit IRC14:36
openstackgerritMichael Chapman proposed openstack/puppet-tripleo: Add opendaylight composition class.  https://review.openstack.org/26507614:36
*** iurygregory has quit IRC14:52
*** rahulait has quit IRC14:53
chemis a problem with the gate currently ?  I keep up having strange problem with it : http://logs.openstack.org/27/264927/4/check/gate-puppet-openstacklib-puppet-beaker-rspec-dsvm-trusty/18c348a/console.html#_2016-01-08_13_45_33_23014:59
chems/is a/is there a/14:59
*** karimb has quit IRC14:59
*** karimb has joined #puppet-openstack15:00
*** iurygregory has joined #puppet-openstack15:03
*** foxhunt72 is now known as foxhunt_away15:07
EmilienMchem: this one is not on our side15:08
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Make haproxy balancer default options configurable  https://review.openstack.org/26529815:08
EmilienMit's a random issue iirc because rabbitmq.com random outages15:08
chemEmilienM: ack, I was just wondering.  It's been 3 recheck in a row :)  Anyway this patch is in WIP now :)15:09
chemEmilienM: thanks15:09
EmilienMweird15:09
*** xarses has quit IRC15:12
*** rahulait has joined #puppet-openstack15:17
*** bklei has joined #puppet-openstack15:18
*** ducttape_ has joined #puppet-openstack15:20
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Haproxy has non-working Horizon session persistence.  https://review.openstack.org/26530615:20
*** rahulait has quit IRC15:22
*** dfisher has joined #puppet-openstack15:23
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Use HAProxy 'transparent' bind option instead of sysctl ip_nonlocal  https://review.openstack.org/26530915:27
*** rain has joined #puppet-openstack15:31
*** rain is now known as Guest1956715:31
openstackgerritAlex Schultz proposed openstack/puppet-modulesync-configs: Add rspec-puppet-facts to the spec_helper  https://review.openstack.org/26483015:32
*** xarses has joined #puppet-openstack15:33
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Allows customization of the HAProxy default timeouts  https://review.openstack.org/26531315:35
*** Guest19567 is now known as leanderthal15:41
*** baker has joined #puppet-openstack15:45
*** bnemec has quit IRC15:50
*** zhangjn has joined #puppet-openstack15:52
openstackgerritEmilien Macchi proposed openstack/puppet-ironic: Use identity_uri and auth_uri by default  https://review.openstack.org/26279915:53
*** zhangjn has quit IRC15:54
*** zhangjn has joined #puppet-openstack15:55
*** rahulait has joined #puppet-openstack15:59
*** bnemec has joined #puppet-openstack16:00
openstackgerritAlex Schultz proposed openstack/puppet-cinder: Add rspec-puppet-facts to the spec_helper  https://review.openstack.org/26454116:04
openstackgerritAlex Schultz proposed openstack/puppet-cinder: Update tests to leverage rspec-puppet-facts  https://review.openstack.org/24233016:05
*** zhangjn has quit IRC16:05
*** zigo has quit IRC16:09
*** zigo has joined #puppet-openstack16:10
*** ntpttr has joined #puppet-openstack16:30
*** jistr has quit IRC16:33
*** samuelBartel has quit IRC16:36
*** dhollinger has joined #puppet-openstack16:42
openstackgerritEmilien Macchi proposed openstack/puppet-keystone: endpoint: stop sending warning if $version is not empty  https://review.openstack.org/26110516:54
EmilienMchem: ^16:54
ntpttrWhen any cores have time could you take a look at https://review.openstack.org/#/c/264893/ , once that goes through it'll fix my other puppet-magnum patches that failed at the gate after approval16:56
openstackgerritAlex Schultz proposed openstack/puppet-cinder: Add rspec-puppet-facts to the spec_helper  https://review.openstack.org/26454116:57
openstackgerritAlex Schultz proposed openstack/puppet-cinder: Update tests to leverage rspec-puppet-facts  https://review.openstack.org/24233016:58
*** derekh has quit IRC17:00
chemEmilienM: waiting for the jenkins to run but +2 for me17:02
EmilienMcool17:03
openstackgerritRyan Bak proposed openstack/puppet-monasca: Add support for symlinked agent virtualenv  https://review.openstack.org/26535717:04
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Make haproxy balancer default options configurable  https://review.openstack.org/26529817:05
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Use HAProxy 'transparent' bind option instead of sysctl ip_nonlocal  https://review.openstack.org/26530917:10
*** karimb has quit IRC17:31
*** paramite is now known as paramite|afk17:36
*** mdorman has joined #puppet-openstack17:36
*** paramite|afk is now known as paramite17:38
*** dprince has quit IRC17:40
*** dprince has joined #puppet-openstack17:41
*** dprince has quit IRC17:41
*** dprince has joined #puppet-openstack17:41
openstackgerritMike Dorman proposed openstack/puppet-neutron: Rename admin_state_up method to avoid conflict with accessor  https://review.openstack.org/26537317:53
*** paramite is now known as paramite|afk18:01
dmsimardEmilienM: before I start looking, did you find the cinder issues in mitaka ?18:02
EmilienMno18:02
EmilienMwe also have it in liberty18:02
dmsimardok18:02
*** jpena has quit IRC18:02
EmilienMand it happens on centos7 I think18:02
EmilienMbut not sure about the last statement18:02
dmsimardEmilienM: hmm, you just backported the pymysql support to liberty18:03
*** Madkiss_ has joined #puppet-openstack18:03
*** Madkiss has quit IRC18:03
EmilienMdmsimard: maybe... not sure though18:03
dmsimardhttps://github.com/openstack/puppet-cinder/commits/stable/liberty18:03
*** tristanC_ has joined #puppet-openstack18:04
*** tristanC has quit IRC18:04
dmsimardEmilienM: semi related bug: https://bugzilla.redhat.com/show_bug.cgi?id=129550318:04
openstackbugzilla.redhat.com bug 1295503 in openstack-packstack "Packstack master branch is in the liberty repositories (was: Packstack installation fails with unsupported db backend)" [High,Modified] - Assigned to ichavero18:04
openstackgerritMike Dorman proposed openstack/puppet-neutron: Do not manage network, subnet, router resources if prefetch fails  https://review.openstack.org/26538618:05
*** paramite|afk is now known as paramite18:06
*** paramite is now known as paramite|afk18:07
*** paramite|afk is now known as paramite18:07
*** dprince has quit IRC18:08
*** dprince has joined #puppet-openstack18:08
*** dgurtner has quit IRC18:11
*** paramite has quit IRC18:12
*** ducttape_ has quit IRC18:13
*** dgurtner has joined #puppet-openstack18:19
*** dgurtner has quit IRC18:19
*** dgurtner has joined #puppet-openstack18:19
*** baker has quit IRC18:21
*** baker has joined #puppet-openstack18:22
EmilienMdmsimard: that's not it18:23
EmilienMor maybe?18:24
EmilienMoh we're using old URL18:24
*** bklei_ has joined #puppet-openstack18:25
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Use pymysql for database driver  https://review.openstack.org/26539218:27
EmilienMdmsimard: ^18:27
EmilienMI'll buy you a beer if it was that18:27
EmilienMor a poutine :-P18:27
*** bklei has quit IRC18:28
*** ducttape_ has joined #puppet-openstack18:29
*** dgurtner has quit IRC18:31
*** todin has quit IRC18:33
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Use pymysql for database driver  https://review.openstack.org/26539218:40
*** RichardRaseley has joined #puppet-openstack18:41
openstackgerritMerged openstack/puppet-aodh: Support of PyMySQL driver for MySQL backend  https://review.openstack.org/26348118:42
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: scenario001: enable Aodh on ubuntu platform  https://review.openstack.org/26506118:43
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Test Mitaka on UCA & RDO  https://review.openstack.org/25563518:43
dmsimardEmilienM: Well, I mean, it explains mitaka somewhat but not liberty18:47
EmilienMdmsimard: I've heard liberty needs it too18:48
EmilienMI've seen bugs around it18:48
EmilienMwhen not using it18:48
*** delattec has joined #puppet-openstack18:53
*** delatte has quit IRC18:56
mfischare all keystone calls in puppet using v3 these days?18:59
EmilienM2016-01-08 18:56:24.523 | Error: /Stage[main]/Cinder::Db::Sync/Exec[cinder-manage db_sync]: Failed to call refresh: cinder-manage  db sync returned 1 instead of one of [0]19:00
EmilienMhttps://jenkins03.openstack.org/job/gate-puppet-openstack-integration-scenario001-tempest-dsvm-centos7/84/consoleFull19:00
EmilienMdmsimard: it seems it does not help :(19:00
EmilienMthat bugs occurs with pymysql19:00
EmilienMthere is something we're missing19:01
EmilienMdmsimard: did you promote liberty recently?19:01
EmilienMmfisch: yes iirc19:01
dmsimardEmilienM: promotion occurs automatically from jobs and a promotion occured today, yes19:02
EmilienMmtreinish: I have new failures since recently in temepst19:02
EmilienMhttp://logs.openstack.org/05/261105/5/check/gate-puppet-openstack-integration-scenario001-tempest-dsvm-trusty/1d60061/console.html#_2016-01-08_18_26_22_32119:02
EmilienMtempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern19:02
EmilienMtempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern19:02
EmilienMare those scenarios new in smoke?19:03
EmilienMdmsimard: I don't have the issue on trusty19:03
*** RichardRaseley has quit IRC19:03
EmilienMso I'm quite sure we have something wrong in liberty/rdo19:03
EmilienMlet me tell you which version was working19:03
*** todin has joined #puppet-openstack19:03
*** dprince has quit IRC19:07
EmilienMdmsimard: ok got it19:07
EmilienMpython-cinder-7.0.0-1.el7.noarch used to work19:07
EmilienMpython-cinder-7.0.1-1.el7.noarch is broken for us19:07
EmilienMwe need to diff19:07
EmilienMdmsimard: how can I easily diff?19:07
dmsimardEmilienM: nothing is easy19:09
EmilienMI wish19:09
dmsimardEmilienM: is that liberty or mitaka19:09
EmilienMdmsimard: L19:09
EmilienMI thought you had CI that would catch this thing19:10
mtreinishEmilienM: no, the've been in smoke since the beginning19:10
dmsimardEmilienM: a lot of stuff went to shit during the holidays, no joke19:10
EmilienMmtreinish: ok. THey're failing randomly on ubuntu platform, I'm digging cinder logs now19:10
EmilienMdmsimard: np. I need help on tracking diff between both versions19:11
EmilienMdmsimard: I think there is a bug in the latest version19:11
dmsimardEmilienM: weirdo passed on jan 25th19:12
mtreinishEmilienM: fwiw, those tests are normally one of the ones with higher failure rates19:12
dmsimardjan 5th*19:12
EmilienMdmsimard: dec?19:12
EmilienMah19:12
dmsimardEmilienM: we didn't update the stable repos since then19:12
EmilienMmtreinish: oh yeah?19:12
dmsimardEmilienM: at least afaik19:12
mtreinishbetween using cinder and sshing into the guest it exposes the most issues19:13
EmilienMmtreinish: do you suggest we disable them?19:14
mtreinishno, we should get to the bottom of the issue19:14
EmilienMyes I prefer that :-)19:14
EmilienMI'm investigating19:14
mtreinishthese are like a 0.01% failure rate19:14
mtreinishaccording to openstack-health it's failed 517 times in the last ~100k runs19:14
EmilienMok thanks for the metric19:15
* EmilienM reads cinder volume logs http://logs.openstack.org/05/261105/5/check/gate-puppet-openstack-integration-scenario001-tempest-dsvm-trusty/1d60061/logs/cinder/cinder-volume.txt.gz19:15
EmilienMmtreinish: it looks like it tries to delete a volume that does not exist http://logs.openstack.org/05/261105/5/check/gate-puppet-openstack-integration-scenario001-tempest-dsvm-trusty/1d60061/logs/cinder/cinder-api.txt.gz#_2016-01-08_18_25_54_11519:16
*** bklei_ has quit IRC19:23
*** bklei has joined #puppet-openstack19:24
mtreinishEmilienM: normally a 404 on a delete isnt fatal to tempest19:24
*** trown|outttypeww is now known as trown19:24
EmilienMmtreinish: what is fatal is http://logs.openstack.org/05/261105/5/check/gate-puppet-openstack-integration-scenario001-tempest-dsvm-trusty/1d60061/console.html#_2016-01-08_18_27_48_22219:24
EmilienMthe 40019:24
mtreinishlooking at the run failure the issue is coming from nova, nova returns a 400 because when we attempt to create a volume backed server it gets a notfound from cinder19:24
mtreinishright19:25
EmilienMlooking at nova logs now19:25
EmilienMhttp://logs.openstack.org/05/261105/5/check/gate-puppet-openstack-integration-scenario001-tempest-dsvm-trusty/1d60061/logs/nova/nova-api.txt.gz#_2016-01-08_18_25_50_19019:25
EmilienMmtreinish: ^19:25
EmilienMrunning liberty by the way19:26
EmilienMhttps://bugs.launchpad.net/horizon/+bug/122395019:27
openstackLaunchpad bug 1220814 in OpenStack Compute (nova) "duplicate for #1223950 fix _get_bdm_image_metadata and semantics" [Low,Fix released]19:27
EmilienMit seems an old bug, fixed for long time19:28
EmilienMmtreinish: is there any param in tempest.conf I would miss? http://logs.openstack.org/05/261105/5/check/gate-puppet-openstack-integration-scenario001-tempest-dsvm-trusty/1d60061/logs/tempest.conf.txt.gz19:30
EmilienMI don't see any param that I would need for volumes19:32
mtreinishEmilienM: I don't think any of the options would come into play for the failure you're hitting19:34
EmilienMmtreinish: build_timeout maybe?19:35
EmilienMmtreinish: it seems like nova tries to get the volume infos from cinder api19:37
EmilienMoh no, nova does a POST19:37
*** mdorman has quit IRC19:39
*** delatte has joined #puppet-openstack19:40
*** delattec has quit IRC19:40
openstackgerritRyan Bak proposed openstack/puppet-monasca: Add support for symlinked agent virtualenv  https://review.openstack.org/26535719:42
*** delatte has quit IRC19:55
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Improve logging for OpenStack services  https://review.openstack.org/26542620:04
*** cdelatte has joined #puppet-openstack20:13
openstackgerritMerged openstack/puppet-gnocchi: Support of PyMySQL driver for MySQL backend  https://review.openstack.org/26348320:20
*** Guest90991 is now known as saneax_AFK20:22
*** rahulait has quit IRC20:27
*** gfidente has quit IRC20:31
*** rahulait has joined #puppet-openstack20:31
openstackgerritMerged openstack/puppet-vitrage: Support of PyMySQL driver for MySQL backend  https://review.openstack.org/26347820:44
openstackgerritEmilien Macchi proposed openstack/puppet-tempest: Add logging_context_format_string parameter  https://review.openstack.org/26544120:56
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Improve logging for OpenStack services  https://review.openstack.org/26542620:57
*** cdelatte has quit IRC21:09
*** jayg is now known as jayg|g0n321:11
*** cwolferh has quit IRC21:17
*** RichardRaseley has joined #puppet-openstack21:21
openstackgerritEmilien Macchi proposed openstack/puppet-aodh: init: stop include logging class  https://review.openstack.org/26545221:35
EmilienMcrinkle, mwhahaha: thoughts on ^ ?21:37
mwhahahathat's not true21:38
EmilienMmwhahaha: see https://github.com/openstack/puppet-aodh/blob/master/manifests/logging.pp#L136-L14021:40
*** cwolferh has joined #puppet-openstack21:40
EmilienMthey are not picked from init.pp21:40
mwhahahathey can include aodh::logging in their manifest to override the values21:40
EmilienMand since init.pp is including the class, there is not way to declare the class21:40
mwhahahabecause it's an include they can voerride them21:40
EmilienMno21:40
mwhahahasure there is, it's an include21:40
EmilienMa sec21:40
EmilienMmwhahaha: http://logs.openstack.org/26/265426/2/check/gate-puppet-openstack-integration-scenario001-tempest-dsvm-trusty/3b44798/console.html#_2016-01-08_20_59_46_54921:41
mwhahahathat's keystone logging21:41
EmilienMits same21:41
EmilienMincluded in init.pp21:41
EmilienMI wish I could be wrong21:42
EmilienMbut I think we'll have to patch all our modules21:42
mwhahahaso the whole point of include is so that you can do class { 'whatever': } and it still be ok21:42
mwhahahai wonder if it's a catalog compilation thing21:42
mwhahahalet me go look21:42
EmilienMsure21:42
EmilienMwhen you include ::aodh::logging, you can't add class { '::aodh::logging': } in the same catalog21:43
EmilienMI tested it21:43
mwhahahawat21:44
mwhahahadid you define it before or after ::aodh21:44
EmilienMI hope I'm wrong21:44
EmilienMno matter the order, theu are not in same file21:44
EmilienMmwhahaha: see https://review.openstack.org/#/c/265426/21:44
EmilienMinclude is first though21:45
mwhahahathat's what i'm wondering if it's a loading order where it hit the include prior to the class definition21:45
mwhahahaClass[::aodh::logging] -> Class[::aodh]21:46
mwhahahahttp://ben-tech.blogspot.com/2012/12/puppet-require-vs-include-vs-class.html21:48
mwhahahaYou can safely include a class, first two examples pass, but you cannot declare class inner after outer_a or outer_b like the third one:21:48
*** xarses has quit IRC21:48
mwhahahaso it's a order thing, you have to declair ::aodh::logging prior to ::aodh21:49
mwhahahas/declair/declare21:49
EmilienMok21:49
EmilienMlet's try it21:49
EmilienMI hope that's it21:49
mwhahahabecause i think when the catalog is compiled, it's top down thing for include and class definitions21:50
mwhahahaso it hits the include first and processes it so when you add the class { '::aodh::logging': } it blows up because it's already there21:50
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Improve logging for OpenStack services  https://review.openstack.org/26542621:51
EmilienMmwhahaha: let's see ^21:51
EmilienMyou can review maybe21:52
mwhahahasure21:52
mwhahahai saw that one earlier and i was going to wait for the CI before looking again :)21:52
EmilienMcool21:53
EmilienMmwhahaha: I have some patches for review, do you mind if I paste it here?21:54
mwhahahasure21:54
EmilienMso before review21:54
EmilienMconsider our integ jobs are unstable21:54
EmilienMand scenario001 is in bad shape because of cinder21:54
EmilienMI'm investigating for days but don't make much progress.21:54
EmilienMpymysql in our integ: https://review.openstack.org/#/c/265392/21:55
dmsimardEmilienM: I'll run a weirdo job for scenario001, should trigger the issue21:55
EmilienMdrop ec2 param in our integ https://review.openstack.org/#/c/264389/21:55
EmilienMdmsimard: ok thx21:55
EmilienMupdate integ for new neutron param: https://review.openstack.org/#/c/264387/21:55
EmilienMadd ironic to integ: https://review.openstack.org/#/c/262965/21:55
dmsimardEmilienM: wait21:55
EmilienM(scenario002 is green which is testing ironic)21:56
dmsimardI had gate jobs passing for weirdo since jan 5th21:56
EmilienMauth_uri thing on ironic: https://review.openstack.org/#/c/262799/21:56
EmilienMdmsimard: yeah?21:56
EmilienMwhich scenario?21:56
dmsimardhttps://ci.centos.org/view/rdo/job/weirdo-gate-ansible-puppet-openstack-scenario001/43/21:56
EmilienMothers patch to review: https://review.openstack.org/#/c/261105/21:57
dmsimardbut I don't have logs for it, because the logging is a WIP :P21:57
EmilienMdmsimard: looking21:57
dmsimardbut the console output is there21:57
EmilienM01:18:09 {1} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern [127.656801s] ... ok21:58
EmilienMdamn21:58
EmilienMit fails for us very often21:58
dmsimardI'll re-run21:58
EmilienMplease21:58
EmilienMbut it's very weird21:58
EmilienMI have no idea what's going on21:58
dmsimardEmilienM: submitted, I'll also have logs this time21:59
EmilienMand I could not reproduce it on my env, I also ran scenario001 successfuly21:59
dmsimardI'll give you the links when it's ready21:59
EmilienMcool21:59
EmilienMI'm going to iceskating a bit, I need to clear my brain21:59
* EmilienM watching https://ci.centos.org/view/rdo/job/weirdo-gate-ansible-puppet-openstack-scenario001/44/console with popcorn22:00
EmilienMmwhahaha: still failing22:00
EmilienMbut I know why22:01
mwhahahak i'll take further22:01
EmilienMit's my bad22:01
EmilienMhe went further22:01
EmilienMso you were right I gues22:01
mwhahaha:D22:01
EmilienMmwhahaha: bravo !22:01
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Improve logging for OpenStack services  https://review.openstack.org/26542622:01
*** xarses has joined #puppet-openstack22:02
openstackgerritRyan Bak proposed openstack/puppet-monasca: Add support for symlinked agent virtualenv  https://review.openstack.org/26535722:02
*** rahulait has quit IRC22:08
*** trown is now known as trown|outttypeww22:16
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Improve logging for OpenStack services  https://review.openstack.org/26542622:20
*** dhollinger has quit IRC22:25
*** bklei has quit IRC22:30
*** bklei has joined #puppet-openstack22:31
*** ducttape_ has quit IRC22:31
dmsimardEmilienM: it installed successfully but tempest did not pass this time22:33
dmsimardtempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern[compute,id-557cd2c2-4eb8-4dce-98be-f86765ff311b,image,smoke,volume]22:34
EmilienM22:28:39 {1} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern [13.007079s] ... FAILED22:34
EmilienMyeah22:34
EmilienMso there is a bug22:34
dmsimardtempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern[compute,id-557cd2c2-4eb8-4dce-98be-f86765ff311b,image,smoke,volume]22:34
EmilienMmtreinish: ^22:34
dmsimardwell it's not the dbsync issue ?22:34
EmilienMRDO has the bug, trusty has it22:34
EmilienMdmsimard: no, dbcsync is another bug22:34
EmilienMI think we have a real thing here22:35
*** bklei has quit IRC22:35
EmilienMunfortunatly I need to leave now, but I'll contine the investigation.22:35
EmilienMplease get all logs dmsimard22:35
EmilienMso we can compare and make sure we have the same root cause22:35
EmilienMget nova-api, nova-cpu and cinder-api logs22:35
dmsimardeh damnit, the log capture still didn't work.. (this is actually the review the job is gating on)22:36
dmsimardI have to head out soon but I'll try to make it work22:36
dmsimardwhere does the integration tests centralize it's logs ?22:37
dmsimardoh wait that's handled by the jenkins job, not by run_tests22:37
EmilienMdmsimard: it's scp'ing to log servers22:37
EmilienMyeah22:37
EmilienMI'm out22:37
*** RichardRaseley has quit IRC22:44
openstackgerritAlex Schultz proposed openstack/puppet-rally: Add rspec-puppet-facts to the spec_helper  https://review.openstack.org/26455722:50
openstackgerritAlex Schultz proposed openstack/puppet-aodh: Add rspec-puppet-facts to the spec_helper  https://review.openstack.org/26453823:01
openstackgerritAlex Schultz proposed openstack/puppet-nova: Add rspec-puppet-facts to the spec_helper  https://review.openstack.org/26455423:03
openstackgerritAlex Schultz proposed openstack/puppet-keystone: Add rspec-puppet-facts to the spec_helper  https://review.openstack.org/26454823:05
openstackgerritBen Nemec proposed openstack/puppet-glance: Fix Swift store configuration  https://review.openstack.org/26547023:12
openstackgerritBen Nemec proposed openstack/puppet-glance: Fix Swift store configuration  https://review.openstack.org/26547023:14
openstackgerritAlex Schultz proposed openstack/puppet-openstack_extras: Add os_service_default fact for tests  https://review.openstack.org/26547223:21
mwhahahafyi -^ should fix tests for openstack_extras23:21
*** baker has quit IRC23:26
*** dfisher has quit IRC23:41
*** rahulait has joined #puppet-openstack23:48
openstackgerritMerged openstack/puppet-keystone: endpoint: stop sending warning if $version is not empty  https://review.openstack.org/26110523:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!