Monday, 2018-04-02

*** EmilienM_ has joined #tripleo00:04
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755600:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]00:10
*** ykarel has joined #tripleo00:21
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Rework create reproducing script  https://review.openstack.org/54796000:27
*** itlinux has quit IRC00:32
*** fragatina has joined #tripleo00:34
*** d0ugal has quit IRC00:35
*** agopi has quit IRC00:40
*** d0ugal has joined #tripleo00:44
*** EmilienM has quit IRC00:48
*** EmilienM_ is now known as EmilienM00:48
*** EmilienM has joined #tripleo00:48
*** ChanServ sets mode: +v EmilienM00:48
*** avivgt has joined #tripleo00:52
*** tzumainn has quit IRC01:01
*** khrystoph has joined #tripleo01:04
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755601:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]01:10
*** avivgt has quit IRC01:15
*** fragatina has quit IRC01:17
*** itlinux has joined #tripleo01:31
*** d0ugal has quit IRC01:35
*** d0ugal has joined #tripleo01:43
*** itlinux has quit IRC01:44
*** khrystoph has quit IRC01:55
*** yamahata has joined #tripleo02:02
*** chandankumar has joined #tripleo02:03
*** chkumar246 has quit IRC02:03
*** chandankumar has quit IRC02:08
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755602:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]02:10
*** chandankumar has joined #tripleo02:20
*** dsariel has quit IRC02:26
*** janki has joined #tripleo02:29
*** psachin` has joined #tripleo02:34
*** d0ugal has quit IRC02:37
*** d0ugal has joined #tripleo02:44
*** ramishra has joined #tripleo02:52
*** janki has quit IRC02:57
*** khrystoph has joined #tripleo02:58
*** Jeffrey4l_ has joined #tripleo02:59
*** pgadiya has joined #tripleo03:08
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755603:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]03:10
*** Jeffrey4l_ has quit IRC03:22
*** l4yerffej_ has joined #tripleo03:22
*** janki has joined #tripleo03:22
*** janki has quit IRC03:23
*** l4yerffej_ has quit IRC03:23
*** janki has joined #tripleo03:23
*** l4yerffej has joined #tripleo03:23
*** rwsu has joined #tripleo03:26
*** pgadiya has quit IRC03:29
*** itlinux has joined #tripleo03:32
*** pgadiya has joined #tripleo03:41
*** ykarel has quit IRC03:46
*** ratailor has joined #tripleo03:49
*** ratailor has quit IRC03:50
*** dciabrin has joined #tripleo03:56
*** dciabrin__ has quit IRC03:58
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755604:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]04:10
*** ykarel has joined #tripleo04:15
*** d0ugal has quit IRC04:23
*** psachin` has quit IRC04:27
*** psachin has joined #tripleo04:28
*** links has joined #tripleo04:46
*** d0ugal has joined #tripleo04:46
*** jchhatbar has joined #tripleo04:51
*** dciabrin has quit IRC04:51
*** dciabrin has joined #tripleo04:51
*** jchhatbar has quit IRC04:51
*** jchhatbar has joined #tripleo04:52
*** janki has quit IRC04:54
*** ykarel_ has joined #tripleo05:03
*** chkumar246 has joined #tripleo05:04
*** ykarel has quit IRC05:04
*** links has quit IRC05:04
*** chandankumar has quit IRC05:04
*** links has joined #tripleo05:05
*** ykarel__ has joined #tripleo05:05
*** ykarel_ has quit IRC05:08
*** chkumar246 has quit IRC05:08
*** ykarel__ is now known as ykarel05:08
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755605:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]05:10
*** ratailor has joined #tripleo05:10
*** chkumar246 has joined #tripleo05:21
*** moshele has joined #tripleo05:25
*** moshele has quit IRC05:27
*** pgadiya has quit IRC05:30
*** waleedm has joined #tripleo05:32
*** jbadiapa has joined #tripleo05:35
*** jfrancoa has joined #tripleo05:35
*** jchhatbar has quit IRC05:43
*** jchhatbar has joined #tripleo05:43
*** d0ugal has quit IRC05:48
*** jfrancoa has quit IRC05:49
*** ooneko has joined #tripleo05:49
*** ooneko has left #tripleo05:49
*** anilvenkata has joined #tripleo05:50
*** marios has joined #tripleo05:50
*** bigcat has joined #tripleo05:50
*** pgadiya has joined #tripleo05:51
*** jfrancoa has joined #tripleo05:53
*** d0ugal has joined #tripleo05:56
*** dparkes has quit IRC05:56
*** agurenko has joined #tripleo05:57
*** shreshtha has joined #tripleo06:02
*** bigcat has left #tripleo06:02
*** hbh_ has joined #tripleo06:03
*** agurenko has quit IRC06:04
*** agurenko has joined #tripleo06:06
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755606:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]06:10
openstackgerritvinay kumar muddu proposed openstack/diskimage-builder master: To check for the updates  https://review.openstack.org/55816306:12
*** dsariel has joined #tripleo06:13
openstackgerrithanish proposed openstack/tripleo-heat-templates master: Added Liquidio service definition in overcloud puppet registry  https://review.openstack.org/55816406:14
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144106:23
*** anande has joined #tripleo06:27
*** chkumar246 is now known as chandankumar06:29
*** chandankumar has quit IRC06:29
*** chandankumar has joined #tripleo06:30
*** hbh has joined #tripleo06:30
*** hbh has quit IRC06:30
*** pgadiya has quit IRC06:31
openstackgerritwangqi proposed openstack/diskimage-builder master: delete unused module  https://review.openstack.org/55816706:35
*** karthiks has joined #tripleo06:38
*** pgadiya has joined #tripleo06:40
*** dparkes has joined #tripleo06:41
*** moshele has joined #tripleo06:42
*** anande_ has joined #tripleo06:48
*** ratailor has quit IRC06:49
*** ratailor_ has joined #tripleo06:49
itlinuxhello has anyone enabled selinux? Thanks.. I am having some issues, where the nic, vlans did not come back and then I get a 504 error when I started the services again after taking the nic back alive.. since pcs was not running and corosync as well. Thanks06:50
*** anande has quit IRC06:52
*** jaganathan has joined #tripleo06:52
*** ratailor has joined #tripleo06:55
*** ratailor_ has quit IRC06:56
*** chandankumar has quit IRC06:57
*** ratailor has quit IRC07:00
*** chandankumar has joined #tripleo07:04
*** ratailor has joined #tripleo07:05
*** holser__ has joined #tripleo07:07
*** udesale has joined #tripleo07:08
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755607:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]07:10
*** ooolpbot has quit IRC07:10
*** holser__ has quit IRC07:11
*** tesseract has joined #tripleo07:12
*** jchhatba_ has joined #tripleo07:12
*** ratailor_ has joined #tripleo07:13
*** masco has joined #tripleo07:13
*** ccamacho has joined #tripleo07:14
*** jchhatba_ has quit IRC07:15
*** jchhatbar has quit IRC07:15
*** ratailor has quit IRC07:15
*** jchhatba_ has joined #tripleo07:15
*** jchhatba_ has quit IRC07:17
*** avivgt has joined #tripleo07:17
*** masco_ has joined #tripleo07:28
*** masco has quit IRC07:29
*** itlinux has quit IRC07:30
*** anande_ has quit IRC07:31
openstackgerritJose Luis Franco proposed openstack/tripleo-common master: Log ansible and ansible-playbook command.  https://review.openstack.org/55732007:34
*** avivgt has quit IRC07:35
*** mdnadeem has joined #tripleo07:37
*** amoralej|off is now known as amoralej07:40
*** jtomasek has joined #tripleo07:42
openstackgerritDougal Matthews proposed openstack/instack-undercloud master: Use the default queue when calling create_deployment_plan  https://review.openstack.org/55463007:42
*** jtomasek has quit IRC07:50
*** jtomasek has joined #tripleo07:52
*** masco_ has quit IRC07:53
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Make RHCLOUD configurable  https://review.openstack.org/55817408:09
*** dparkes has quit IRC08:10
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755608:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]08:10
*** ooolpbot has quit IRC08:10
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Make RHCLOUD configurable  https://review.openstack.org/55817408:10
*** pgadiya has quit IRC08:11
*** masco_ has joined #tripleo08:11
*** dsariel has quit IRC08:14
*** pgadiya has joined #tripleo08:19
*** anande has joined #tripleo08:26
*** mdnadeem has quit IRC08:27
*** mdnadeem has joined #tripleo08:27
*** moshele has quit IRC08:28
*** dparkes has joined #tripleo08:32
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Make RHCLOUD configurable  https://review.openstack.org/55817408:35
*** hbh_ has quit IRC08:36
*** d0ugal has quit IRC08:39
*** jtomasek has quit IRC08:44
*** anande_ has joined #tripleo08:46
*** anande has quit IRC08:50
openstackgerritMarios Andreou proposed openstack/tripleo-common master: WIP Update package_update action + workbook for ffu upgrade cli  https://review.openstack.org/55793608:55
*** numans has quit IRC08:57
*** numans has joined #tripleo08:58
*** ratailor_ has quit IRC09:01
*** ratailor_ has joined #tripleo09:02
*** d0ugal has joined #tripleo09:03
*** ratailor_ has quit IRC09:06
*** ratailor_ has joined #tripleo09:06
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755609:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]09:10
*** ratailor_ has quit IRC09:13
*** ratailor_ has joined #tripleo09:13
*** ratailor_ has quit IRC09:14
*** ratailor_ has joined #tripleo09:15
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Make RHCLOUD configurable  https://review.openstack.org/55817409:21
*** dsariel has joined #tripleo09:25
*** skramaja has joined #tripleo09:26
*** mdnadeem has quit IRC09:32
*** ratailor_ has quit IRC09:35
*** sri_ has joined #tripleo09:40
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Use external RHCLOUD variable if set  https://review.openstack.org/55817409:40
*** chandankumar has quit IRC09:40
*** chandankumar has joined #tripleo09:41
*** ccamacho1 has joined #tripleo09:55
*** ccamacho has quit IRC09:55
*** ccamacho1 has quit IRC09:57
*** anilvenkata has quit IRC09:57
*** ratailor has joined #tripleo09:58
*** ccamacho has joined #tripleo09:58
*** hjensas has quit IRC10:07
*** anilvenkata has joined #tripleo10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755610:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]10:10
*** anilvenkata has quit IRC10:11
*** anilvenkata has joined #tripleo10:11
*** hanish has joined #tripleo10:12
*** jlabarre has joined #tripleo10:19
*** masco_ has quit IRC10:28
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Import gated tripleo-upgrade role.  https://review.openstack.org/55818810:32
*** ratailor_ has joined #tripleo10:35
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Import gated tripleo-upgrade role.  https://review.openstack.org/55818810:35
*** ratailor has quit IRC10:37
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Add undercloud upgrades playbook.  https://review.openstack.org/55382710:41
*** saneax has joined #tripleo10:43
*** shreshtha has quit IRC10:46
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Add undercloud upgrades playbook.  https://review.openstack.org/55382710:46
*** tbonds has quit IRC10:48
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test ci2  https://review.openstack.org/55818910:51
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Import gated tripleo-upgrade role.  https://review.openstack.org/55818810:54
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Use tripleo-upgrade role in undercloud upgrades job.  https://review.openstack.org/54897410:55
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: DO NOT REVIEW : TESTING ONLY FOR NOW  https://review.openstack.org/55819010:58
hanishHi all, can you please review https://review.openstack.org/#/c/558164/10:59
*** anande__ has joined #tripleo10:59
*** anande__ has quit IRC11:00
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: Enable OVN HA profile in fset30  https://review.openstack.org/52380411:00
*** anande has joined #tripleo11:00
*** d0ugal has quit IRC11:00
*** ykarel_ has joined #tripleo11:03
*** ratailor__ has joined #tripleo11:03
*** anande_ has quit IRC11:03
*** chkumar246 has joined #tripleo11:04
*** chandankumar has quit IRC11:04
*** ratailor_ has quit IRC11:04
*** links has quit IRC11:04
*** ykarel has quit IRC11:04
*** links has joined #tripleo11:05
*** ykarel__ has joined #tripleo11:05
*** ratailor_ has joined #tripleo11:06
*** ratailor__ has quit IRC11:08
*** chkumar246 has quit IRC11:08
*** ykarel_ has quit IRC11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755611:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]11:10
*** bfournie has quit IRC11:13
*** bfournie has joined #tripleo11:13
*** bfournie has quit IRC11:17
*** ykarel__ is now known as ykarel11:17
*** ccamacho1 has joined #tripleo11:18
*** ccamacho1 has quit IRC11:18
*** ccamacho has quit IRC11:20
*** chkumar246 has joined #tripleo11:20
*** ansmith has quit IRC11:22
*** ccamacho has joined #tripleo11:26
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test ci2  https://review.openstack.org/55818911:27
*** anande has quit IRC11:29
*** d0ugal has joined #tripleo11:29
*** sri_ has quit IRC11:31
*** dougbtv has joined #tripleo11:34
*** pradk has joined #tripleo11:39
*** mdnadeem has joined #tripleo11:45
*** bfournie has joined #tripleo11:50
*** atoth has joined #tripleo11:51
openstackgerritSagi Shnaidman proposed openstack/tripleo-upgrade stable/queens: DNM: test queens branch dependency  https://review.openstack.org/55819911:53
*** dprince has joined #tripleo11:53
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test ci2  https://review.openstack.org/55818911:54
*** rfolco has joined #tripleo11:54
openstackgerritSagi Shnaidman proposed openstack/tripleo-upgrade stable/pike: DNM: test pike dependency  https://review.openstack.org/55820011:55
*** rfolco is now known as rfolco|ruck11:59
*** ccamacho has quit IRC12:02
*** udesale has quit IRC12:04
*** udesale has joined #tripleo12:05
*** raildo has joined #tripleo12:06
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755612:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]12:10
*** pgadiya has quit IRC12:11
*** weshay_mod is now known as weshay12:12
*** tcw has joined #tripleo12:12
*** jcoufal has joined #tripleo12:13
*** udesale has quit IRC12:23
*** udesale has joined #tripleo12:23
*** liverpooler has joined #tripleo12:23
*** pgadiya has joined #tripleo12:23
*** ccamacho has joined #tripleo12:24
*** d0ugal has quit IRC12:25
*** d0ugal has joined #tripleo12:25
*** d0ugal has quit IRC12:25
*** d0ugal has joined #tripleo12:25
*** tbonds has joined #tripleo12:26
*** sri_ has joined #tripleo12:26
*** pradk has quit IRC12:26
*** liverpooler has quit IRC12:28
*** pgadiya has quit IRC12:28
*** amoralej is now known as amoralej|lunch12:29
*** liverpooler has joined #tripleo12:30
*** sshnaidm is now known as sshnaidm|bbl12:32
*** ohochman has joined #tripleo12:37
*** arxcruz_ has joined #tripleo12:39
arxcruz_Weshay: it's holiday in Germany today, I'll update my nickname once I get home12:39
weshayarxcruz_, oh ya.. sorry12:40
weshayarxcruz_, go away :)12:40
arxcruz_;)12:40
*** arxcruz_ has quit IRC12:40
*** ansmith has joined #tripleo12:48
*** eck`gone is now known as eck`12:49
weshayeck`, when you have a second can you take a look at https://bugs.launchpad.net/tripleo/+bug/1760189  rfolco|ruck may have an environment setup for you12:50
openstackLaunchpad bug 1760189 in tripleo "ovb 1ctrl 1comp fs022 pike: neutron/nova AMQP MessagingTimeout" [Critical,Triaged]12:50
weshayeck`, if you want to try and poke in your own env.. you can use https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike/d9e1506/reproducer-quickstart.sh12:50
weshayeck`, oh and good morning sir12:50
rfolco|ruckweshay, will have to recreate the env, was getting failures last friday13:02
weshayrfolco|ruck, k.. eck would be able to help us determine if it's a messaging issue13:03
rfolco|ruckweshay, ok13:03
eck`weshay: good morning to you as well!13:05
* eck` looks13:05
*** jmelvin has joined #tripleo13:07
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755613:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]13:10
eck`hmm13:10
eck`oh this is single controller13:11
weshayeck`, save the planet ( use one controller )13:11
eck`i was about to lament that it didn't seem to be failing over to one of the other ones :)13:11
weshaygreen peace and such13:11
eck`yeah it looks like rabbit just isn't connectable for some reason13:12
*** tzumainn has joined #tripleo13:12
eck`whether it's down, or iptables, or ran out of file descriptors, or ...13:12
weshayeck`, ya.. we thought we would need a live env for it13:12
* eck` looks at rabbit logs13:13
weshayI believe rfolco|ruck is hooking that up for you now13:13
rfolco|ruckweshay, working on it13:14
eck`looks like rabbit is up, this is probably something goofy in oslo.messaging/kombu/py-amqp13:15
eck`note from the bug...13:15
eck`Client port: 4395013:15
eck`and then in the rabbit log...13:15
eck`=ERROR REPORT==== 27-Mar-2018::06:43:00 ===13:15
eck`closing AMQP connection <0.7859.0> (192.168.24.14:43950 -> 192.168.24.17:5672):13:15
eck`{handshake_timeout,frame_header}13:15
eck`same src port there13:15
eck`so basically the client connects but never handshakes13:16
weshayssl issue?13:18
*** thrash|g0ne is now known as thrash13:18
*** ratailor_ has quit IRC13:21
eck`uhhh, possibly...13:21
eck`(if it's even doing ssl for amqp)13:22
*** trown|outtypewww is now known as trown13:26
*** tbonds has quit IRC13:31
*** udesale has quit IRC13:35
*** udesale has joined #tripleo13:35
openstackgerritMerged openstack/tripleo-heat-templates master: Changing to L2GW Opendaylight v2 driver  https://review.openstack.org/55127013:38
openstackgerritMerged openstack/tripleo-heat-templates master: Revert "FFU: Add support for panko service upgrade"  https://review.openstack.org/55795313:38
*** amoralej|lunch is now known as amoralej13:47
*** links has quit IRC13:48
*** psachin has quit IRC13:55
*** agurenko has quit IRC13:58
*** dparkes has quit IRC13:59
*** dparkes has joined #tripleo14:00
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Collectd needs access to /var/run/ceph to load the ceph plugin  https://review.openstack.org/55820914:02
*** colonwq has joined #tripleo14:03
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Use tripleo-upgrade role in undercloud upgrades job.  https://review.openstack.org/54897414:03
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Import gated tripleo-upgrade role.  https://review.openstack.org/55821014:03
*** waleedm has quit IRC14:03
*** toure|biab is now known as toure14:07
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755614:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]14:10
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Add roles-data into overcloud upgrade prepare.  https://review.openstack.org/55538914:10
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch.  https://review.openstack.org/55208014:10
openstackgerritMerged openstack/tripleo-common stable/queens: Fails to get DPDK feature status.  https://review.openstack.org/55764614:11
*** dsariel has quit IRC14:12
*** sshnaidm|bbl is now known as sshnaidm14:16
*** waleedm has joined #tripleo14:17
*** chkumar246 has quit IRC14:20
*** chandankumar has joined #tripleo14:20
*** stendulker has joined #tripleo14:21
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Import gated tripleo-upgrade role.  https://review.openstack.org/55821014:21
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Use tripleo-upgrade role in undercloud upgrades job.  https://review.openstack.org/54897414:21
*** dparkes has quit IRC14:24
*** waleedm has quit IRC14:25
*** dparkes has joined #tripleo14:26
*** dsariel has joined #tripleo14:26
*** tbonds has joined #tripleo14:29
*** lblanchard has joined #tripleo14:30
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Fix mode for openstack services  https://review.openstack.org/55751114:31
*** tesseract has quit IRC14:42
*** tesseract-RH has joined #tripleo14:42
*** dtrainor has joined #tripleo14:43
*** dhill_ has joined #tripleo14:45
openstackgerritMerged openstack/tripleo-quickstart master: Updated tempest plugin names  https://review.openstack.org/54424214:48
openstackgerritMerged openstack/tripleo-heat-templates master: Added release notes of tempest container  https://review.openstack.org/55197014:48
*** skramaja has quit IRC14:50
chandankumardtantsur|afk: Hello14:52
chandankumardtantsur|afk: https://review.openstack.org/#/c/554522 I am looking for a ironic tempest tests which can run on Undercloud, when you are available please have a look.14:53
*** sai-ons is now known as sai114:55
*** spotz_ has joined #tripleo14:55
*** spotz_ is now known as spotz14:59
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: libvirt hosts with reproducer  https://review.openstack.org/54342915:03
*** anilvenkata has quit IRC15:04
alee_afkEmilienM, any progress on the password thing?  I tried with cinder and barbican before15:06
*** alee_afk is now known as alee15:07
EmilienMalee: no progress yet15:07
aleeEmilienM, did you reproduce it -- I saw you said nova worked ..15:07
EmilienMalee: yeah nova worked fine, I could change the pwd15:08
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755615:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]15:10
*** ooolpbot has quit IRC15:10
*** ramishra has quit IRC15:14
*** itlinux has joined #tripleo15:18
*** dparkes has quit IRC15:23
*** jfrancoa has quit IRC15:25
itlinuxhello and good morning.. I wonder if anyone has any tips.. since as soon as I enable selinux, vlans and nics do not come back alive.. and then all other services do not see to work.15:26
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test ci2  https://review.openstack.org/55818915:27
itlinuxI get this.. http://paste.openstack.org/show/718177/ and even I put back to permissive it does not see to come back alive.15:27
*** matbu has quit IRC15:28
mwhahahaitlinux: make sure swift account service is running. also memcache15:29
itlinuxok thanks15:31
*** jcoufal has quit IRC15:33
*** social has joined #tripleo15:34
*** stendulker has quit IRC15:35
*** jcoufal has joined #tripleo15:36
*** ffiore has joined #tripleo15:36
*** jcoufal has quit IRC15:40
*** karthiks has quit IRC15:41
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud  https://review.openstack.org/54255615:45
*** jcoufal has joined #tripleo15:48
*** shreshtha has joined #tripleo15:49
EmilienMmwhahaha: https://review.openstack.org/#/c/557981/1/docker/services/horizon.yaml15:50
EmilienMmwhahaha: we really need to find better on the long term15:50
EmilienMwe should only enable the plugins when the service is actually deployed15:50
*** ccamacho has quit IRC15:50
EmilienMI have been thinking about it a bit last week but haven't come up with something yet15:50
weshaysshnaidm, I think we're ready now :) https://review.rdoproject.org/r/#/c/13198/15:51
EmilienMI'm not sure we can use heat conditionals in the kolla config15:51
mwhahahaEmilienM: take it up with horizon15:51
*** shreshtha has quit IRC15:51
mwhahahatheir configs have always been awful15:51
sshnaidmweshay, right :)15:51
*** lblanchard has quit IRC15:51
*** shreshtha has joined #tripleo15:51
*** lblanchard has joined #tripleo15:53
EmilienMweshay: jenkins hates you.15:53
weshaygit clone error15:53
weshayEmilienM, it should :) I hate jenkins15:53
*** fragatina has joined #tripleo16:03
openstackgerritMarios Andreou proposed openstack/tripleo-common master: WIP Update package_update/plan action+workflows ffwd-upgrade cli  https://review.openstack.org/55793616:04
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: WIP - Adds ffwd-upgrade [prepare|run|converge] ffwd upgrade cli  https://review.openstack.org/55793716:04
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Remove unused OS::TripleO::StructuredDeployment reference  https://review.openstack.org/55822616:05
*** fragatina has quit IRC16:08
*** fragatina has joined #tripleo16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755616:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]16:10
*** chlong has joined #tripleo16:11
*** matbu has joined #tripleo16:19
*** ykarel is now known as ykarel|away16:22
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Migrate to the new Mistral context class  https://review.openstack.org/50618616:22
*** trown is now known as trown|lunch16:25
*** ykarel|away has quit IRC16:26
*** dprince has quit IRC16:26
*** jd_ has quit IRC16:26
*** marios has quit IRC16:27
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: use minimal to verify ping/tempest  https://review.openstack.org/55823416:37
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Implement tripleo::masquerade_networks  https://review.openstack.org/55823516:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: masquerade: stop using YAQL for iptables data  https://review.openstack.org/55823616:38
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT  https://review.openstack.org/55797216:39
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: undercloud: allow to configure ctlplane_masquerade in undercloud.conf  https://review.openstack.org/55799116:39
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT  https://review.openstack.org/55797216:40
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove nat/masquerading config workarounds.  https://review.openstack.org/55785116:40
bnemecmwhahaha: Is it okay with you if I approve https://blueprints.launchpad.net/tripleo/+spec/designate-support ?16:41
bnemecI believe all of the necessary patches are proposed and some have already merged, so it's in good shape.16:42
mwhahahabnemec: i'll get it16:42
bnemecmwhahaha: Thanks16:42
mwhahahabnemec: do update the status :D16:42
bnemecDone :-)16:43
EmilienMbnemec: I've got some feedback that having designate on the undercloud would be awesome for all our hostname issues16:44
EmilienMwhat are our plans on that front?16:44
weshayrfolco|ruck, any updates re: messaging16:44
EmilienMbnemec: since your work is being merged in THT, we could easily deploy designate on the containerized undercloud16:45
rfolco|ruckweshay, my env is not up, it fails on toci_gate16:46
bnemecEmilienM: I have heard that proposed too.  I haven't given it a lot of thought, but I don't think there's any reason we couldn't do it.16:46
bnemecTBH, I haven't dug into the actual designate use cases much yet.16:46
bnemecI was told people want it, so I'm trying to make that happen.16:46
weshayrfolco|ruck, this is fs22 pike ya?16:46
rfolco|ruckweshay, yep16:47
rfolco|ruckweshay, question: why last run was 3/27 ?16:48
openstackgerritJill Rouleau proposed openstack/python-tripleoclient master: Make download_config backwards compatible  https://review.openstack.org/55546516:48
weshayrfolco|ruck, ur probably looking at the wrong job https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike/16:48
*** itlinux has quit IRC16:49
rfolco|ruckweshay, it is the same job... http://cistatus.tripleo.org/promotion/16:50
*** udesale has quit IRC16:50
rfolco|ruckweshay, periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike16:50
rfolco|ruckweshay, sova is missing reports maybe16:51
weshayrfolco|ruck, yup16:53
weshaythat just got me too16:53
*** ffiore_ has joined #tripleo16:55
*** ffiore has quit IRC16:56
*** shreshtha has quit IRC16:56
*** itlinux has joined #tripleo16:57
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Migrate Ceph deployment to external_deploy_task  https://review.openstack.org/54696617:02
openstackgerritMerged openstack/tripleo-heat-templates master: get-occ-config.sh: fix handling multiple nodes in a role  https://review.openstack.org/55734617:03
openstackgerritMerged openstack/tripleo-quickstart master: Remove duplicate release note  https://review.openstack.org/55453017:03
*** trown|lunch is now known as trown17:03
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates stable/queens: get-occ-config.sh: fix handling multiple nodes in a role  https://review.openstack.org/55824217:03
EmilienMweshay: please review https://review.openstack.org/#/c/557941/17:06
*** mdnadeem has quit IRC17:08
EmilienMweshay: also, see my reply on https://review.openstack.org/#/c/553629/10/templates/undercloud_upgrade.sh.j217:08
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: DNM - containerized undercloud upgrade  https://review.openstack.org/55362917:08
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363317:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755617:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]17:10
*** matbu has quit IRC17:10
*** ffiore has joined #tripleo17:11
*** ffiore_ has quit IRC17:11
weshayEmilienM, k17:13
*** atoth has quit IRC17:16
*** moshele has joined #tripleo17:17
*** liverpooler has quit IRC17:20
weshayEmilienM, is there a dnm test patch for https://review.openstack.org/#/c/557941/17:20
*** liverpooler has joined #tripleo17:20
EmilienMweshay: yes, the one you already reviewed...17:20
EmilienMa sec17:20
EmilienMweshay: https://review.openstack.org/#/c/553633/17:21
*** itlinux has quit IRC17:23
*** itlinux has joined #tripleo17:24
*** moshele has quit IRC17:29
openstackgerritMerged openstack/tripleo-common stable/queens: Move health_manager cfg section to octavia_worker  https://review.openstack.org/55791817:30
*** dsariel has quit IRC17:32
weshayEmilienM, this is that patch you and chandankumar were working for tempest against the undercloud ya? https://review.openstack.org/#/c/557972/17:35
*** lblanchard has quit IRC17:39
EmilienMweshay: not at all17:40
EmilienMweshay: https://review.openstack.org/#/c/557972/ has nothing to do with tempest.17:40
EmilienMit's completely another topic: masquerading17:40
weshayk17:40
EmilienMwhat chandankumar mentioned to me last week though, is that the containerized undercloud in CI will require an external network in neutron17:40
weshayya17:41
EmilienMI haven't been working on that topic17:41
weshayk17:41
*** hanish has quit IRC17:43
*** mburned_out is now known as mburned17:44
*** dprince has joined #tripleo17:48
*** dprince has quit IRC17:54
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Remove default value for pacmaker passwords  https://review.openstack.org/55784717:58
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755618:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]18:10
*** ooolpbot has quit IRC18:10
*** dprince has joined #tripleo18:10
*** dprince has quit IRC18:19
*** tosky has joined #tripleo18:20
*** atoth has joined #tripleo18:28
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add featureset050 to test keystone-only upgrades  https://review.openstack.org/55663018:29
*** tosky has quit IRC18:31
*** cdearborn has joined #tripleo18:31
*** dprince has joined #tripleo18:32
*** rpioso has joined #tripleo18:33
rpiosoI have tried to install the undercloud using the command "sudo yum install -y python-tripleoclient". However, it does not install the ironic conductor. Any suggestions?18:33
mwhahaharpioso: there's more than just that to installing theundercloud18:34
*** tosky has joined #tripleo18:34
mwhahaharpioso: see items 4 and 5 from http://tripleo.org/install/installation/installation.html#installing-the-undercloud18:35
cgoncalvesEmilienM: hi. do you have time to review a small patch? :) https://review.openstack.org/#/c/557731/18:39
cgoncalvesa backport to stable/queens will follow shortly after merge18:39
cgoncalvesEmilienM: also an one-line patch: https://review.openstack.org/#/c/557981/18:40
rpiosomwhahaha: Thank you so much!18:40
*** srini has joined #tripleo18:42
*** sshnaidm has quit IRC18:43
*** jd_ has joined #tripleo18:44
*** jd_ has quit IRC18:44
*** jd_ has joined #tripleo18:47
*** jmelvin has quit IRC18:47
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: WIP: DNM: extra node for OVB stack role  https://review.openstack.org/54236818:52
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Fix autorun option in reproducer script  https://review.openstack.org/55825718:53
sriniEmilienM, mwhahaha, Hi quick question, I know this sounds silly , I am trying to add ubuntu compute node to running tripleo stack the reason I am doing this to run lxc containers, as I understand nova-lxc package only available in ubuntu, I've installed the all dependencies I've configure the nova-lxd but I am stuck at networking part, I need to replicate networking part in ubuntu and also add ovs flow entry's in new ubuntu compute node and Tripleo18:55
sriniController, so do i need configure networking manually is that possible ? ,18:55
mwhahahai think os-net-config works on ubuntu, so maybe you could leverage that18:57
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: WIP: DNM: extra node for OVB stack role  https://review.openstack.org/54236818:57
*** tesseract-RH has quit IRC19:01
srinimwhahaha, yes I've trying creating br-ex using os-net-config file in /etc/os-net-config/config.json , but other network's br-int and br-tun were created on fly, ovs-agent drive that configuration, but adding those networks and flow entry's little tricky, was looking is there any other way I can generate os-net-config based on overcloud stack19:02
*** amoralej is now known as amoralej|off19:02
mwhahahathere might be something in the deployed server scripts19:02
mwhahahabut i'm not sure19:02
srinimwhahaha, ok I will look into it, thanks :)19:05
bnemecWhat's the situation with the ovb jobs?  Is it worth rechecking for them?19:05
mwhahahasrini: http://tripleo.org/install/advanced_deployment/deployed_server.html19:05
mwhahahabnemec: i think they are still flakey19:06
bnemecmwhahaha: So recheck and pray?19:06
mwhahahabnemec: or figure out why things are so flakey :D19:07
*** tbonds has quit IRC19:07
mwhahaha(hint it's probably containers)19:07
bnemecThat sounds like work. ;-)19:08
* mwhahaha blames oslo19:08
mwhahahahttps://bugs.launchpad.net/oslo.rootwrap/+bug/176047119:09
openstackLaunchpad bug 1760471 in oslo.rootwrap "oslo-rootwrap-daemon performing badly in docker containers(centos/fedora)" [Undecided,New]19:09
mwhahahait's likely that since we switched everything to containers (correctly)19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755619:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]19:10
bnemecHeh, fair enough.19:11
*** lblanchard has joined #tripleo19:11
bnemecHmm, looking at http://zuul-status.nemebean.com/?queue=openstack-check&zuul=https://review.rdoproject.org/zuul/status.json it may not be worth a recheck.19:12
bnemecAlmost every patch that has been running for any significant time has an ovb failure.19:13
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: WIP: DNM: extra node for OVB stack role  https://review.openstack.org/54236819:14
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: Add ability  to deploy FreeIPA on OVB  https://review.openstack.org/53443519:14
weshayrfolco|ruck, did you ping eck?19:16
rfolco|ruckweshay, yep just sent him the env info19:16
*** sshnaidm has joined #tripleo19:22
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Update tripleo-inventory for extra nodes on OVB  https://review.openstack.org/54144619:26
*** percevalbot has joined #tripleo19:27
*** jcoufal has quit IRC19:27
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Update tripleo-inventory for extra nodes on OVB  https://review.openstack.org/54144619:29
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Update default supplemental ssh key  https://review.openstack.org/54173119:29
openstackgerritMerged openstack/tripleo-quickstart master: remove dstat from the virthost  https://review.openstack.org/55796719:33
*** agopi has joined #tripleo19:35
*** colonwq has quit IRC19:45
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: WIP: DNM: extra node for OVB stack role  https://review.openstack.org/54236819:51
*** pradk has joined #tripleo19:53
openstackgerritMerged openstack/tripleo-quickstart-extras master: Rework create reproducing script  https://review.openstack.org/54796019:54
openstackgerritMerged openstack/tripleo-quickstart master: Add fs050: containerized undercloud upgrade  https://review.openstack.org/55794119:54
*** tbonds has joined #tripleo19:54
*** dsariel has joined #tripleo19:54
*** pradk has quit IRC19:56
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Make heat parameter plugin_dirs configurable  https://review.openstack.org/55463319:57
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Make heat parameter plugin_dirs configurable  https://review.openstack.org/55463719:57
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Make heat parameter plugin_dirs configurable  https://review.openstack.org/55466019:57
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Make heat parameter plugin_dirs configurable  https://review.openstack.org/55465919:57
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Implement tripleo::masquerade_networks  https://review.openstack.org/55823519:57
weshayeck`, let me know if you have a problems w/ the env20:00
eck`weshay: it's quite useful20:02
eck`i mean, i still don't know what the hell is going on20:02
eck`but at least it reproduced and i can poke at it20:02
weshayrock on20:02
eck`i *think* it might only happen when compute starts before conductor20:03
eck`but i am too afraid to restart it quite yet :)20:03
*** chkumar246 has joined #tripleo20:03
*** chandankumar has quit IRC20:03
*** matbu has joined #tripleo20:06
*** liverpooler has quit IRC20:08
*** chkumar246 has quit IRC20:08
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755620:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]20:10
*** dprince has quit IRC20:16
*** yamahata has quit IRC20:17
*** raildo has quit IRC20:19
*** chkumar246 has joined #tripleo20:20
*** ffiore has quit IRC20:24
*** ffiore has joined #tripleo20:28
*** pkilambi has joined #tripleo20:30
*** pkilambi has quit IRC20:30
*** rcernin has joined #tripleo20:31
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Implement tripleo::masquerade_networks  https://review.openstack.org/55823520:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: masquerade: stop using YAQL for iptables data  https://review.openstack.org/55823620:37
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT  https://review.openstack.org/55797220:38
EmilienMweshay: I'm debugging https://review.openstack.org/#/c/542556, not sure why it passed last weekend and now failing20:39
* weshay looks20:39
weshayEmilienM, fs01 master?20:39
EmilienMweshay: yes20:40
EmilienMhttps://logs.rdoproject.org/56/542556/94/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zaadb22ae5e9c4469ae31c3058bb625cb/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2018-04-02_17_48_0320:40
EmilienMthere is a "No JSON object could be decoded"20:41
EmilienMI wonder if that makes the exit 120:41
EmilienMand ansible didn't complain https://logs.rdoproject.org/56/542556/94/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zaadb22ae5e9c4469ae31c3058bb625cb/undercloud/var/lib/mistral/0b720301-3c7d-4a83-94fd-ef3c486070ec/ansible.log.txt.gz#_2018-04-02_17_48_03_85720:44
*** yamahata has joined #tripleo20:46
*** ansmith has quit IRC20:46
*** Goneri has joined #tripleo20:47
EmilienMI wonder if mistral failed to post a message on zaqar when the overcloud completed: https://logs.rdoproject.org/56/542556/94/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zaadb22ae5e9c4469ae31c3058bb625cb/undercloud/var/log/containers/mistral/executor.log.txt.gz#_2018-04-02_17_48_10_16920:48
weshay? 2018-04-02 16:58:50.206 ERROR /var/log/extra/docker/containers/nova_placement/log/nova/nova-compute.log: 7 ERROR nova.compute.manager InventoryInUse: Inventory for ''CUSTOM_BAREMETAL'' on resource provider 'c8fefa68-555f-4ab5-919c-d1a7ed5dd213' in use.20:48
EmilienMI don't think it's something in nova20:49
EmilienMthe overcloud was well deployed, all ansible tasks ran well20:49
*** fragatina has quit IRC20:49
mwhahahaEmilienM: key rotation?20:49
EmilienMno it's config_download_deploy20:50
weshayEmilienM, also see errors from zaqar20:50
mwhahahaEmilienM: no i mean the key rotated thus causing auth problems?20:50
weshayauth errors20:50
EmilienMah you mean rotations yea20:50
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Fix autorun option in reproducer script  https://review.openstack.org/55825720:50
mwhahahaie we rotated more than 2 keys while still using old token20:50
* mwhahaha doesn't remember if we're doing that in tripleo ci20:50
EmilienMnote: the undercloud is containerized20:50
mwhahahai know in p-o-i we do that20:50
EmilienMquestion is why do I hit this in containerized undercloud only20:51
EmilienMI checked other jobs and it's not the case I think (I'll double check again)20:51
*** ffiore has quit IRC20:56
EmilienMI might have found it but unsure20:56
EmilienMhttps://www.diffchecker.com/Cystb4xp20:56
EmilienMwhen mistral isn't containerized, auth_url=http://192.168.24.3:35357 otherwise auth_url=http://192.168.24.3:500020:57
EmilienMmaybe 5000 is causing the 40120:57
EmilienMI'm not sure why though, I'll dif20:57
EmilienMdig even20:57
*** ffiore has joined #tripleo20:57
*** itlinux has quit IRC20:58
mwhahahaEmilienM: other issue, why is it using guest for the rabbit user20:58
mwhahahaEmilienM: i don't think the auth url be the problem cause we should be using the 5000 port anyway20:58
EmilienMindeed20:59
EmilienMI'll align the configs20:59
mwhahahaEmilienM: it's auth_uri btw, that's probably the problem20:59
mwhahahaauth_uri :13000 vs :500020:59
EmilienMyeah that's ssl20:59
mwhahahaEmilienM: also check the zaqar configs instead of mistral21:00
mwhahahaEmilienM: cause zaqar is the one that's throwing the 401, maybe that's not configured right21:00
*** lblanchard has quit IRC21:00
mwhahahahttps://logs.rdoproject.org/56/542556/94/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zaadb22ae5e9c4469ae31c3058bb625cb/undercloud/var/log/containers/zaqar/zaqar.log.txt.gz#_2018-04-02_17_48_04_12121:00
*** trown is now known as trown|outtypewww21:01
*** chandankumar has joined #tripleo21:04
*** chkumar246 has quit IRC21:04
*** chandankumar has quit IRC21:09
*** ffiore_ has joined #tripleo21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755621:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]21:10
*** ffiore has quit IRC21:10
openstackgerritAlan Bishop proposed openstack/tripleo-common master: Use scheduler hints in derived_parameters workflow  https://review.openstack.org/55831321:19
*** chandankumar has joined #tripleo21:21
*** srini has quit IRC21:34
*** ansmith has joined #tripleo21:41
*** rfolco|ruck is now known as rfolco|off21:47
*** Goneri has quit IRC21:51
*** etingof has joined #tripleo21:52
*** etingof has quit IRC21:57
*** etingof has joined #tripleo21:57
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Add tripleo-ui docker service to undercloud config  https://review.openstack.org/52284221:59
*** mburned is now known as mburned_out22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755622:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]22:10
*** bfournie has quit IRC22:12
*** cdearborn has quit IRC22:12
*** rpioso is now known as rpioso|afk22:18
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Default environment/services/* to docker  https://review.openstack.org/55679722:19
*** nyechiel_ has quit IRC22:23
*** ffiore_ has quit IRC22:25
*** ffiore has joined #tripleo22:25
*** ffiore has quit IRC22:34
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Default environment/services/* to docker  https://review.openstack.org/55679722:52
*** bfournie has joined #tripleo23:04
*** tosky has quit IRC23:08
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755623:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]23:10
*** fragatina has joined #tripleo23:15
*** yamahata has quit IRC23:19
*** mburned_out is now known as mburned23:32
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144123:32
*** dpeacock has quit IRC23:33
*** dpeacock has joined #tripleo23:40
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Migrate Ceph deployment to external_deploy_task  https://review.openstack.org/54696623:41
*** apetrich has quit IRC23:43
openstackgerritSai Ram Peesapati proposed openstack/tripleo-heat-templates master: Parameterizing Puppet Tags  https://review.openstack.org/55759823:46
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on fs027 using containerized tempest  https://review.openstack.org/55144223:52
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on undercloud on fs003  https://review.openstack.org/55452223:53
chandankumarweshay: sshnaidm EmilienM mwhahaha need inputs on this one https://review.openstack.org/55144123:54
chandankumartempest_black_regex change23:54
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260723:55
*** yamahata has joined #tripleo23:55
weshaychandankumar, tempest_whitelist and tempest_black_regex23:55
weshaychandankumar, can we make those look more like one another :))23:55
chandankumarweshay: we need to change skip list to tempest_blacklist23:55
chandankumarthere are three 4 options23:55
chandankumartest_regex23:56
chandankumartest_black_regex23:56
chandankumartempest_whitelist23:56
chandankumartempest_whitelist23:56
chandankumartempest_blacklist23:56
openstackgerritJames Slagle proposed openstack/tripleo-common master: Remove role_data from inventory  https://review.openstack.org/55832223:56
mwhahahaCan't you not use both white and black lists at the same time23:56
chandankumarmwhahaha: yup it is possible23:57
mwhahahaMust be a new thing23:57
openstackgerritJames Slagle proposed openstack/tripleo-common master: Remove role_data from inventory  https://review.openstack.org/55832223:57
mwhahahaIt wasn't that way last year23:57
weshaychandankumar, so..23:58
chandankumarmwhahaha: yup stestr movement given more fixlebility23:58
weshaytest_regex test_black_regex tempest_whitelist tempest_blacklist23:58
chandankumarI have taken a list of tests then use | to cancate in order to form proper regex23:58
chandankumarlet'see how it behaves.23:59
weshaytest_white_regex, test_black_regex, tempest_whitelist, tempest_blacklist23:59
weshaychandankumar, ^23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!