Sunday, 2017-02-19

« Saturday, 2017-02-18 Index Monday, 2017-02-20 »
*** sdake has joined #tripleo00:12
*** milan has quit IRC00:16
*** dougbtv_ has joined #tripleo00:56
*** limao has joined #tripleo00:59
*** limao_ has joined #tripleo01:03
*** limao has quit IRC01:04
*** dmacpher has quit IRC01:09
*** dsneddon has joined #tripleo01:12
*** limao_ has quit IRC01:13
*** limao has joined #tripleo01:13
*** dmacpher has joined #tripleo01:22
*** saneax-_-|AFK is now known as saneax01:29
*** dbecker has joined #tripleo01:36
*** fragatina has joined #tripleo01:45
*** sdake has quit IRC01:55
*** funzo__ has quit IRC01:55
*** sdake has joined #tripleo02:00
*** spredzy has quit IRC02:00
*** spredzy has joined #tripleo02:01
*** sdake has quit IRC02:01
*** dsneddon has quit IRC02:03
*** sdake has joined #tripleo02:04
*** sdake has quit IRC02:06
*** sdake has joined #tripleo02:07
*** sdake has quit IRC02:08
*** salmankhan has quit IRC02:12
*** salmankhan has joined #tripleo02:13
*** fragatina has quit IRC02:36
*** dougbtv_ has quit IRC02:40
*** saneax is now known as saneax-_-|AFK02:49
*** limao_ has joined #tripleo02:54
*** limao has quit IRC02:55
*** funzo has joined #tripleo02:56
*** Goneri has quit IRC02:58
*** salmankhan has quit IRC02:59
*** funzo has quit IRC03:01
*** gbarros has quit IRC03:05
*** sudipto has joined #tripleo03:34
*** sudipto_ has joined #tripleo03:34
*** funzo has joined #tripleo03:57
*** jerrygb has joined #tripleo03:58
*** limao_ has quit IRC04:01
*** funzo has quit IRC04:02
*** florianf has joined #tripleo04:18
*** pgadiya has joined #tripleo04:22
*** sdake has joined #tripleo04:29
*** david-lyle has quit IRC04:30
*** IRCFrEAK has joined #tripleo04:32
*** sdake has quit IRC04:33
*** sdake_ has joined #tripleo04:34
*** dbecker has quit IRC04:46
*** limao has joined #tripleo04:49
*** dmacpher has quit IRC04:52
*** limao_ has joined #tripleo04:54
*** limao has quit IRC04:57
*** funzo has joined #tripleo04:58
*** funzo has quit IRC05:02
*** dmacpher has joined #tripleo05:04
*** limao_ has quit IRC05:07
*** yolanda has quit IRC05:12
*** sdake has joined #tripleo05:20
*** sudipto_ has quit IRC05:20
*** sudipto has quit IRC05:20
*** sdake_ has quit IRC05:22
*** saneax-_-|AFK is now known as saneax05:23
*** limao has joined #tripleo05:26
*** saneax is now known as saneax-_-|AFK05:29
*** jerrygb has quit IRC05:42
*** agurenko has joined #tripleo05:59
*** sdake_ has joined #tripleo06:10
*** sdake has quit IRC06:12
*** zzzeek has quit IRC06:15
*** sdake_ has quit IRC06:15
*** sdake has joined #tripleo06:16
*** zzzeek has joined #tripleo06:18
*** abregman has joined #tripleo06:34
*** funzo has joined #tripleo06:56
*** funzo has quit IRC07:00
*** dsariel has joined #tripleo07:01
*** mrunge has quit IRC07:30
*** mrunge has joined #tripleo07:32
*** iranzo has joined #tripleo07:50
*** IRCFrEAK has left #tripleo07:56
*** funzo has joined #tripleo07:57
*** rcernin has quit IRC07:57
*** b00tcat` has joined #tripleo08:01
*** funzo has quit IRC08:02
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/43575208:10
*** limao has quit IRC08:15
*** limao has joined #tripleo08:17
*** limao has quit IRC08:27
*** nyechiel has joined #tripleo08:36
*** cmyster has quit IRC08:37
*** abregman has quit IRC08:44
*** flepied has quit IRC08:47
*** abregman has joined #tripleo08:54
*** zzzeek has quit IRC09:00
*** zzzeek has joined #tripleo09:00
*** ramishra has quit IRC09:00
*** limao has joined #tripleo09:01
*** ramishra has joined #tripleo09:02
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921509:05
*** yamahata has quit IRC09:16
*** bvandenh has joined #tripleo09:18
*** cmyster has joined #tripleo09:39
*** jtomasek has quit IRC09:49
*** sdake has quit IRC09:50
openstackgerritMerged openstack/tripleo-quickstart-extras master: Don't output the PublicVip separately to /etc/hosts  https://review.openstack.org/43410509:51
*** bvandenh has quit IRC09:56
*** funzo has joined #tripleo09:59
*** funzo has quit IRC10:03
*** flepied has joined #tripleo10:11
*** bvandenh has joined #tripleo10:15
*** bvandenh has quit IRC10:21
*** b00tcat` has quit IRC10:27
*** limao has quit IRC10:33
*** limao has joined #tripleo10:34
*** flepied has quit IRC10:35
*** limao has quit IRC10:38
*** dsariel has quit IRC10:42
*** twi99y_ has joined #tripleo10:55
*** flepied has joined #tripleo10:56
*** twi99y has quit IRC10:57
*** funzo has joined #tripleo11:00
*** funzo has quit IRC11:05
*** ramishra has quit IRC11:10
*** ramishra has joined #tripleo11:12
*** pgadiya has quit IRC11:17
*** flepied has quit IRC11:27
*** pgadiya has joined #tripleo11:32
*** iranzo has quit IRC11:45
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Switch to net-config-multinode  https://review.openstack.org/43573311:51
*** kbyrne has quit IRC11:51
*** iranzo has joined #tripleo11:52
*** iranzo has joined #tripleo11:52
*** kbyrne has joined #tripleo11:53
*** pgadiya has quit IRC11:58
*** milan has joined #tripleo12:09
*** limao has joined #tripleo12:27
*** bvandenh has joined #tripleo12:40
*** sudipto has joined #tripleo12:46
*** sudipto_ has joined #tripleo12:46
*** xuao has joined #tripleo12:50
*** florianf has quit IRC12:58
*** funzo has joined #tripleo13:00
*** funzo has quit IRC13:05
*** xuao has quit IRC13:05
*** salmankhan has joined #tripleo13:09
*** gbarros has joined #tripleo13:10
*** dhill_ has quit IRC13:11
*** twi99y_ has quit IRC13:11
*** twi99y has joined #tripleo13:11
*** dhill_ has joined #tripleo13:11
*** bvandenh has quit IRC13:15
*** michapma_alt has quit IRC13:18
*** sshnaidm has joined #tripleo13:23
*** twi99y_ has joined #tripleo13:26
*** twi99y has quit IRC13:27
*** salmankhan has quit IRC13:34
*** ramishra has quit IRC13:41
*** xuao has joined #tripleo13:45
*** abregman is now known as abregman|mtg13:45
*** sdake has joined #tripleo13:48
*** salmankhan has joined #tripleo13:51
*** sdake has quit IRC13:52
*** sdake_ has joined #tripleo13:52
*** twi99y_ has quit IRC13:52
*** twi99y has joined #tripleo13:53
*** sdake has joined #tripleo13:54
*** sdake_ has quit IRC13:57
*** milan has quit IRC14:15
*** sdake has quit IRC14:21
*** sdake has joined #tripleo14:23
*** Goneri has joined #tripleo14:33
*** sdake has quit IRC14:34
*** salmankhan has quit IRC14:42
*** xuao has quit IRC14:42
*** nyechiel has quit IRC14:42
*** limao has quit IRC14:44
*** abregman|mtg is now known as abregman14:46
*** gbarros_ has joined #tripleo14:51
*** gbarros has quit IRC14:53
*** gbarros_ has quit IRC14:55
*** Goneri has quit IRC14:55
*** agurenko has quit IRC14:57
*** salmankhan has joined #tripleo14:57
*** fragatina has joined #tripleo14:58
*** funzo has joined #tripleo15:01
*** funzo has quit IRC15:05
*** salmankhan has quit IRC15:06
*** pkovar has joined #tripleo15:10
*** fragatina has quit IRC15:21
*** fragatina has joined #tripleo15:22
*** colonwq has quit IRC15:27
openstackgerritMerged openstack/tripleo-quickstart-extras master: remove duplicate network_environment from undercloud-deploy role  https://review.openstack.org/43492415:33
*** pkovar has quit IRC15:54
*** Goneri has joined #tripleo15:58
*** ansmith has quit IRC15:58
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027716:00
*** Goneri has quit IRC16:02
*** funzo has joined #tripleo16:02
*** funzo has quit IRC16:07
*** gbarros has joined #tripleo16:10
*** rhallisey has joined #tripleo16:11
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746816:16
*** fragatina has quit IRC16:34
*** sudipto has quit IRC16:35
*** sudipto_ has quit IRC16:35
*** pcaruana has joined #tripleo16:35
*** nyechiel has joined #tripleo16:46
*** gbarros has quit IRC16:51
*** gbarros has joined #tripleo16:52
*** dsariel has joined #tripleo16:56
*** dsariel has quit IRC17:04
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates stable/newton: Synchronize NetworkDeployment inputs for generic roles  https://review.openstack.org/43580217:43
*** funzo has joined #tripleo18:03
*** funzo has quit IRC18:07
*** suuuper has joined #tripleo18:13
*** rhallisey has quit IRC18:25
*** gbarros has quit IRC18:26
EmilienMsshnaidm: hey18:35
sshnaidmEmilienM, hi18:35
EmilienMsshnaidm: promotion is blocked on updates & non-ha job18:35
EmilienMI'm investigating18:35
EmilienMhttp://logs.openstack.org/15/359215/62/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/d048040/console.html#_2017-02-19_15_06_04_83501218:35
EmilienMwe need more debug on these stuffs18:35
EmilienMsshnaidm: did you see it before?18:36
sshnaidmEmilienM, there were various bugs with 50418:36
sshnaidmEmilienM, I merged today revert of some fixes for ceph from bnemec, I hope it's not the reason18:37
EmilienMsshnaidm: links?18:42
sshnaidmEmilienM, whoops, sorry, not merged, only checked and upvoted18:44
*** mburned_out is now known as mburned18:44
sshnaidmthis one https://review.openstack.org/#/c/406210/18:45
EmilienMsshnaidm: promotion error is not related I think18:49
EmilienMI need to keep investigating18:49
sshnaidmEmilienM, running it locally, will look too18:49
EmilienMk18:49
EmilienMlet me know18:49
sshnaidmthis placement.. http://logs.openstack.org/15/359215/62/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/3b9b7e0/logs/overcloud-controller-0/var/log/nova/nova-placement-api.txt.gz#_2017-02-19_11_25_40_64218:51
EmilienMwell, it fails before:18:52
EmilienM2017-02-19 14:56:07.195664 | tripleo.sh -- Overcloud pingtest, uploading demo tenant image to glance18:52
EmilienMoh but it's the same problem18:52
EmilienMlooks loke haproxy or something18:52
sshnaidmrequests.exceptions.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:579)18:57
EmilienMohohohoh18:58
EmilienMis that an expiration or something ? :D18:58
sshnaidmin http://logs.openstack.org/15/359215/62/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/136beee/logs/overcloud-controller-0/var/log/messages18:58
sshnaidmEmilienM, both these jobs use tls and ssl iirc18:58
EmilienMfor undercloud18:58
sshnaidmit's os-collect-config, maybe red herring.. http://paste.openstack.org/show/599580/19:00
EmilienMyeah19:02
EmilienMI'm trying to look haproxy logs19:02
*** suuuper has quit IRC19:19
EmilienMsshnaidm: https://www.diffchecker.com/zL1amcIj19:24
EmilienMsshnaidm: I guess I'll git diff all projects in the list ^ :)19:25
EmilienMbrb19:27
*** milan has joined #tripleo19:30
*** saibarspeis has joined #tripleo19:39
*** sshnaidm is now known as sshnaidm|reboot19:47
*** suuuper has joined #tripleo19:48
*** sshnaidm|reboot has quit IRC19:49
*** rcernin has joined #tripleo19:53
*** rcernin has quit IRC19:54
*** rcernin has joined #tripleo19:56
*** sshnaidm has joined #tripleo20:02
*** gbarros has joined #tripleo20:03
*** fragatina has joined #tripleo20:05
*** beekneemech has quit IRC20:08
*** pcaruana has quit IRC20:19
*** fragatina has quit IRC20:27
*** abregman has quit IRC20:29
*** fragatina has joined #tripleo20:39
*** dsariel has joined #tripleo20:58
*** fragatina has quit IRC21:02
*** milan has quit IRC21:04
*** nyechiel has quit IRC21:10
*** pradk has quit IRC21:12
EmilienMsshnaidm: still around?21:13
sshnaidmEmilienM, yep21:14
* sshnaidm accidentally removed /ets/passwd21:15
EmilienMsshnaidm: on your laptop????21:15
sshnaidmgood that still remember rhcsa tricks :D21:15
EmilienMlol21:15
sshnaidmEmilienM, yeah, such a shame21:15
EmilienMso I checked CI certificate21:15
EmilienMnotAfter=Nov  9 15:21:48 2017 GMT21:16
EmilienMit should be ok I guess21:16
sshnaidmEmilienM, seems ok, yeah21:16
EmilienMi checked test-environments/enable-tls.yaml only21:16
EmilienMlet me check others21:16
EmilienMlike test-environments/overcloud-cacert.pem21:16
EmilienMnotAfter=Nov  9 15:21:48 2017 GMT21:17
EmilienMeverything seems at this date21:17
EmilienMsshnaidm: it sounds ssl related because ovb-ha and multinode jobs are passing weel21:20
EmilienMwell*21:20
EmilienMsshnaidm: hey don't remove /etc/shadow21:21
sshnaidmEmilienM, I'm trying not to, but it's difficult21:22
EmilienMlol21:22
EmilienMtentation!21:22
sshnaidmEmilienM, after you did it once, never forget :)21:22
EmilienMsshnaidm: last year I removed python-request from my laptop with --force and I couldn't use yum, curl, wget, rpm and git21:23
EmilienMsshnaidm: I had to plug a usb key with the source and compile it21:23
EmilienMI didn't know requests was so useful :D21:24
*** salmankhan has joined #tripleo21:25
sshnaidmEmilienM, omg, such a harsh module21:25
EmilienMsshnaidm: so I found out something, the vip looks not working well21:25
EmilienMbogus VRRP packet received on br-ex21:26
EmilienMsshnaidm: http://paste.openstack.org/show/599587/21:26
sshnaidmEmilienM, yeah, but I think I saw it in successful jobs too21:26
sshnaidmEmilienM, should we have vip in non-ha?21:27
EmilienMsshnaidm: yes with keepalived21:27
*** salmankhan has quit IRC21:29
EmilienMsshnaidm: could it be infra related? in rh1 networking or21:29
EmilienMlet me check if we had this vip thing before21:30
EmilienMsshnaidm: yes we do, so it's red herring21:31
*** gbarros_ has joined #tripleo21:39
*** gbarros has quit IRC21:41
*** iranzo has quit IRC21:41
sshnaidmEmilienM, could be this one breaking? https://review.openstack.org/#/c/417961/  (just a wild guess)21:41
sshnaidmEmilienM, I'd like to test it without this commit..21:42
EmilienMsshnaidm: that doesn't explain why we can't create the image21:44
EmilienMhttp://logs.openstack.org/15/359215/62/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/136beee/console.html#_2017-02-19_11_08_49_79675921:44
EmilienMif you look at logs, it's timeouting to reach all endpoints ^21:44
EmilienMI don't see anything in packaging diff21:46
EmilienMsshnaidm: http://logstash.openstack.org/#dashboard/file/logstash.json?query=build_name%3A%20*tripleo-ci*%20AND%20build_status%3A%20FAILURE%20AND%20message%3A%20%5C%22Gateway%20Timeout%20(HTTP%20504)%5C%2221:48
EmilienMif you look at logstash, it only happens on the promotion21:48
EmilienMsshnaidm: sounds like apache is off21:49
*** suuuper has quit IRC21:49
EmilienMsshnaidm: http://paste.openstack.org/21:50
EmilienMerr21:50
EmilienMhttp://paste.openstack.org/show/599588/21:50
EmilienMmhh in successful job it's the same21:50
sshnaidmyeah, it runs21:53
sshnaidmit's in ps table21:53
EmilienMsshnaidm: I wonder if it can be https://review.rdoproject.org/r/#/c/5390/21:56
sshnaidmEmilienM, maybe.. although they tested, but not with consistent repo21:58
sshnaidmamoralej|off will be only tomorrow anyway21:58
EmilienMI'm creating a bug with alert tag21:59
EmilienMand I'll email him21:59
EmilienMI'm done for today21:59
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test ovb-oooq  https://review.openstack.org/43110322:00
sshnaidmI'll check if it happens in oooq too22:00
EmilienMsshnaidm: make sure to enable ssl22:01
sshnaidmEmilienM, nonha uses it in oooq too22:01
*** funzo has joined #tripleo22:04
EmilienMsshnaidm: https://bugs.launchpad.net/tripleo/+bug/166607222:05
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]22:05
EmilienMthe description sucks but I have no clue until I can reproduce it22:05
sshnaidmEmilienM, ack, thanks22:06
*** rcernin has quit IRC22:08
*** salmankhan has joined #tripleo22:09
*** funzo has quit IRC22:09
*** ooolpbot has joined #tripleo22:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607222:11
*** ooolpbot has quit IRC22:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]22:11
*** salmankhan has quit IRC22:13
*** saibarspeis has quit IRC22:22
*** fragatina has joined #tripleo23:01
*** ooolpbot has joined #tripleo23:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607223:11
*** ooolpbot has quit IRC23:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]23:11
*** jkilpatr has quit IRC23:15
*** flepied has joined #tripleo23:30
*** michapma_alt has joined #tripleo23:34
*** mburned is now known as mburned_out23:40
*** dsariel has quit IRC23:40
*** flepied has quit IRC23:42
*** gbarros_ has quit IRC23:42
*** dsariel has joined #tripleo23:53
« Saturday, 2017-02-18 Index Monday, 2017-02-20 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!