Wednesday, 2017-12-06

openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud  https://review.openstack.org/43754400:01
mwhahahais scenario002 unblocked with the barbican containers now?00:03
*** yamahata has quit IRC00:20
*** threestrands has quit IRC00:25
*** nyechiel has quit IRC00:28
*** tosky has quit IRC00:33
*** tongl has quit IRC00:36
*** tongl has joined #tripleo00:36
*** tongl has quit IRC00:40
*** itlinux has quit IRC01:00
*** zshi has joined #tripleo01:05
*** bandini has quit IRC01:07
*** tristanC has quit IRC01:08
*** tristanC has joined #tripleo01:09
*** bandini has joined #tripleo01:09
*** tzumainn has quit IRC01:10
*** s_b_34343 has quit IRC01:14
*** s_b_34343 has joined #tripleo01:15
EmilienMslagle: ok thx01:19
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role  https://review.openstack.org/52528501:20
EmilienMslagle: your patch conflicts with mine, but ok https://review.openstack.org/#/c/525291/01:21
EmilienMslagle: I'm happy to abandon mine01:21
*** s_b_34343 has quit IRC01:22
*** Vijayendra has quit IRC01:24
*** s_b_34343 has joined #tripleo01:24
*** yamahata has joined #tripleo01:25
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Remove jq package install  https://review.openstack.org/52578101:28
*** cshastri has joined #tripleo01:29
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: zuul: update OVB jobs  https://review.openstack.org/52574701:30
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Fix loop in config-download.yaml.j2 template  https://review.openstack.org/52315501:30
*** psachin has joined #tripleo01:30
*** dmacpher has joined #tripleo01:32
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574301:32
EmilienMmwhahaha: a bunch of OVB timeouts :(01:40
EmilienMi'm trying to see01:41
mwhahahaOh noes01:41
EmilienM12 minutes to prepare containers01:43
EmilienMhttp://logs.openstack.org/76/525776/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/7ff6cef/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz01:44
EmilienMstevebaker: hey good morning - any way we can accelerate this task in CI? ^01:44
EmilienMalso, some tasks run twice01:45
EmilienMyeah that's a bug I guess01:46
EmilienMa bunch of tasks run two times01:47
stevebakerEmilienM: by reviewing my changes :) https://review.openstack.org/#/c/522055/01:49
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Update the Docker registry defaults to rdoproject  https://review.openstack.org/52020101:50
*** rlandy has quit IRC01:50
EmilienMweshay: need eyes on https://bugs.launchpad.net/tripleo/+bug/173663401:51
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times" [Critical,Triaged]01:51
openstackgerritSteve Baker proposed openstack/tripleo-common master: Implement post-upload cleanup of docker images  https://review.openstack.org/51920101:58
EmilienMstevebaker: ok, doing it now01:58
EmilienMin your patch, it takes 5 min http://logs.openstack.org/55/522055/4/check/tripleo-ci-centos-7-containers-multinode/f2f749e/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz01:59
EmilienMotheriwe it takes 9 minutes01:59
EmilienM(random patch) http://logs.openstack.org/94/525594/6/check/tripleo-ci-centos-7-containers-multinode/222ae13/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz01:59
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Revert "Allow deleting all of docker cache"  https://review.openstack.org/52584901:59
EmilienMstevebaker: +202:00
stevebakerEmilienM: yeah, my limited sampling showed 5min vs ~8min02:00
EmilienMyep02:00
EmilienMstevebaker: thanks, nice improvement imho02:01
EmilienMnow we need to figure https://bugs.launchpad.net/tripleo/+bug/1736634 so we don't have timeouts anymore on ovb jobs02:02
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged]02:02
*** bfournie has joined #tripleo02:05
*** bfournie has quit IRC02:06
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Revert "Allow deleting all of docker cache"  https://review.openstack.org/52584902:07
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663402:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged]02:10
*** oanson has quit IRC02:12
*** oanson has joined #tripleo02:12
*** rfolco has quit IRC02:16
*** s_b_34343 has quit IRC02:20
*** s_b_34343 has joined #tripleo02:21
*** fragatin_ has quit IRC02:27
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Enable Octavia LBaaS integration config in neutron  https://review.openstack.org/52585402:32
weshayEmilienM, /me looks02:37
*** fpan has joined #tripleo02:42
*** tongl has joined #tripleo02:42
*** s_b_34343 has quit IRC02:44
*** itlinux has joined #tripleo02:45
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha  https://review.openstack.org/51223902:45
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Add support for ceph-nfs manila backend  https://review.openstack.org/47124502:45
weshayEmilienM, it's actually called three times02:47
*** thrash is now known as thrash|g0ne02:50
weshayEmilienM, /me looks at the job to try and help w/ the timeout02:50
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Remove default for --overcloud-ssh-key  https://review.openstack.org/52577902:51
*** itlinux has quit IRC02:53
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia integration parameters to neutron  https://review.openstack.org/52586003:01
*** moshele has joined #tripleo03:01
*** tongl has quit IRC03:02
*** hjensas has quit IRC03:07
*** hjensas has joined #tripleo03:24
*** hjensas has quit IRC03:24
*** hjensas has joined #tripleo03:24
*** s_b_34343 has joined #tripleo03:27
*** zshi has quit IRC03:27
*** s_b_34343 has quit IRC03:32
*** Vijayendra has joined #tripleo03:37
openstackgerritwes hayutin proposed openstack/tripleo-specs master: introduce a ci team structure policy  https://review.openstack.org/50928003:41
*** psahoo has joined #tripleo03:49
*** haint has joined #tripleo03:52
*** nguyentrihai has quit IRC03:55
*** ramishra has joined #tripleo03:55
*** kristaps_ has joined #tripleo03:57
*** links has joined #tripleo03:58
*** lvdombrkr has quit IRC03:58
*** tbarron has quit IRC03:59
weshaysshnaidm|off, please start looking at this bug as your first top priority in your morning and I'll sync with you at 8:30am est w/ rfolco and myoung04:00
weshayhttps://bugs.launchpad.net/tripleo/+bug/173663404:00
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)04:00
*** tbarron has joined #tripleo04:00
*** dparkes has quit IRC04:00
*** links has quit IRC04:01
*** links has joined #tripleo04:01
*** dparkes has joined #tripleo04:03
*** fpan has quit IRC04:04
openstackgerritMerged openstack/tripleo-heat-templates master: Make Kubespray install work without --private-key too  https://review.openstack.org/52552404:07
*** mgkwill has quit IRC04:07
*** mgkwill_ has joined #tripleo04:07
*** tzumainn has joined #tripleo04:11
*** masco has joined #tripleo04:12
*** ykarel__ has joined #tripleo04:19
*** moshele has quit IRC04:28
*** dpawar has joined #tripleo04:29
*** gbarros_ has joined #tripleo04:29
*** gbarros has quit IRC04:30
*** janki has joined #tripleo04:33
*** hamzy has joined #tripleo04:40
*** daidv has quit IRC04:41
*** daidv has joined #tripleo04:42
*** udesale has joined #tripleo04:46
*** janki has quit IRC04:54
*** gbarros_ has quit IRC04:55
*** s_b_34343 has joined #tripleo04:56
*** ratailor has joined #tripleo04:58
*** janki has joined #tripleo05:01
Tenguhello there05:02
*** ykarel__ is now known as ykarel05:04
*** ratailor has quit IRC05:05
*** gvrangan has joined #tripleo05:07
*** ratailor has joined #tripleo05:08
*** threestrands has joined #tripleo05:09
*** threestrands has quit IRC05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638305:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]05:10
*** tongl has joined #tripleo05:14
*** skramaja has joined #tripleo05:14
*** tzumainn has quit IRC05:15
*** gvrangan has quit IRC05:15
*** jaganathan has joined #tripleo05:16
*** shreshtha has joined #tripleo05:18
*** shreshtha has quit IRC05:19
*** shreshtha has joined #tripleo05:19
*** liverpooler has quit IRC05:27
*** pgadiya has joined #tripleo05:34
openstackgerritMerged openstack/diskimage-builder master: zypper: fix package removal  https://review.openstack.org/51765805:42
*** mdnadeem has joined #tripleo05:43
*** janki has quit IRC05:44
*** karthiks has quit IRC05:48
*** fragatina has joined #tripleo05:53
*** janki has joined #tripleo05:56
*** tongl has quit IRC05:56
*** zshi has joined #tripleo06:07
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638306:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]06:10
*** udesale__ has joined #tripleo06:10
*** marios has joined #tripleo06:11
*** udesale has quit IRC06:12
*** karthiks has joined #tripleo06:14
*** dsariel has joined #tripleo06:14
*** ykarel_ has joined #tripleo06:16
*** rwsu has quit IRC06:17
*** ykarel has quit IRC06:19
*** salmankhan has joined #tripleo06:20
*** nmathew has joined #tripleo06:21
*** radeks has joined #tripleo06:23
*** salmankhan has quit IRC06:24
*** pdeore has joined #tripleo06:26
*** rwsu has joined #tripleo06:30
s_b_34343;06:31
*** moshele has joined #tripleo06:32
mosheleskramaja: hi06:32
*** bkopilov has quit IRC06:35
*** janki has quit IRC06:36
mosheleskramaja: we are trying to test all the merge patches with the latest quick start and tripleo, the finished successfully all the configuration look good. The problem is that we want to access the overcloud we get error in keystone  see http://paste.openstack.org/show/628240/ do you have pointers how to debug this?06:36
*** janki has joined #tripleo06:38
*** ykarel_ has quit IRC06:47
*** ykarel_ has joined #tripleo06:47
*** pgadiya has quit IRC06:51
*** gkadam has joined #tripleo06:54
*** abregman has joined #tripleo06:55
*** iranzo has joined #tripleo06:57
*** udesale has joined #tripleo06:58
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud master: Fix wrong path in ssh selinux issue detection.  https://review.openstack.org/52591106:59
*** udesale__ has quit IRC07:00
*** rcernin has quit IRC07:02
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud stable/pike: Make sure selinux permissions are correct on ~/.ssh.  https://review.openstack.org/52519407:06
*** ykarel_ is now known as ykarel07:10
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638307:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]07:10
*** shreshtha has quit IRC07:10
*** nyechiel has joined #tripleo07:10
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud master: Fix wrong path in ssh selinux issue detection.  https://review.openstack.org/52591107:10
*** jtomasek has joined #tripleo07:11
*** abregman has quit IRC07:14
*** Vijayendra has quit IRC07:16
*** Vijayendra has joined #tripleo07:16
*** morazi has quit IRC07:20
*** tongl has joined #tripleo07:21
*** karthiks has quit IRC07:26
*** shreshtha has joined #tripleo07:27
*** aditya_r has joined #tripleo07:29
*** dsariel has quit IRC07:36
*** karthiks has joined #tripleo07:39
*** rcernin has joined #tripleo07:39
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Get message from websocket instead from zaqarclient directly  https://review.openstack.org/52592407:40
*** yprokule has joined #tripleo07:45
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Update the noop environment files with start_args  https://review.openstack.org/52592907:48
*** agurenko has joined #tripleo07:49
*** athomas has joined #tripleo07:51
*** cylopez has joined #tripleo07:55
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Get message from websocket instead from zaqarclient directly  https://review.openstack.org/52592407:55
*** morazi has joined #tripleo07:59
*** oidgar has joined #tripleo08:00
*** tongl has quit IRC08:06
*** dbecker has joined #tripleo08:07
*** yamahata has quit IRC08:07
*** mnaser has quit IRC08:08
*** shardy has joined #tripleo08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638308:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]08:10
*** mnaser has joined #tripleo08:11
*** florianf|afk is now known as florianf08:12
*** Vijayendra has quit IRC08:12
*** holser has joined #tripleo08:13
*** bogdando has joined #tripleo08:14
*** Vijayendra has joined #tripleo08:16
*** tesseract has joined #tripleo08:19
*** ykarel is now known as ykarel|lunch08:20
*** sshnaidm|off is now known as sshnaidm|rover08:20
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove workaround for periodic jobs  https://review.openstack.org/52554108:21
*** ukalifon has joined #tripleo08:22
*** ukalifon has left #tripleo08:22
*** dbellant has joined #tripleo08:25
*** abregman has joined #tripleo08:31
*** dbellant has quit IRC08:33
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras master: Do not create roles unless keystone was deployed  https://review.openstack.org/52564808:35
*** ffiore has joined #tripleo08:37
*** stendulker has joined #tripleo08:39
*** shreshtha has quit IRC08:40
*** shreshtha has joined #tripleo08:41
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Update default value for derive params workflow inputs  https://review.openstack.org/52598608:41
*** udesale has quit IRC08:42
*** dbellant has joined #tripleo08:44
*** ramishra has quit IRC08:45
*** jtomasek has quit IRC08:45
*** mrch has joined #tripleo08:46
*** dsariel has joined #tripleo08:47
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: DPDK derive params inputs default value update  https://review.openstack.org/52599008:48
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout  https://review.openstack.org/52559408:49
*** dbellant has quit IRC08:50
*** dbellant has joined #tripleo08:53
*** ramishra has joined #tripleo08:57
*** gfidente has joined #tripleo08:57
*** aufi has joined #tripleo09:02
*** jpich has joined #tripleo09:03
*** gfidente has quit IRC09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638309:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]09:10
*** gfidente has joined #tripleo09:10
*** gfidente has quit IRC09:10
*** gfidente has joined #tripleo09:10
*** ykarel_ has joined #tripleo09:10
*** ykarel|lunch has quit IRC09:11
*** hewbrocca_afk is now known as hewbrocca09:11
*** gfidente has quit IRC09:15
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: [WIP] Add support function for fast forward upgrade testing.  https://review.openstack.org/52600009:15
*** suuuper has joined #tripleo09:15
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: [WIP] Add support function for fast forward upgrade testing.  https://review.openstack.org/52600009:16
*** gfidente has joined #tripleo09:17
*** tvignaud has quit IRC09:18
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: [WIP] Add support function for fast forward upgrade testing.  https://review.openstack.org/52600009:18
*** mrunge_ has joined #tripleo09:19
*** mrunge has quit IRC09:21
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: [WIP] New featureset for fast forward upgrade testing.  https://review.openstack.org/52568609:21
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: SR-IOV agent: allow to configure agent extensions  https://review.openstack.org/52495609:23
holserchem... So what's the status of upgrade job on CI?09:24
chemholser: hehe09:24
holserO>P or O>master09:24
holseris still failing?09:24
chemholser: so, O>P has has a super strange error last time I checked09:25
chemholser: give me a sec09:25
skramajamoshele: i am not sure of this keystone error. can you ensure if all the services are up and running?09:25
chemholser: so this one https://bugs.launchpad.net/tripleo/+bug/173569709:26
openstackLaunchpad bug 1735697 in tripleo "O->P fails during AllNodesPostUpgradeSteps.ControllerDeployment_Step1 on haproxy docker." [Critical,Triaged]09:26
holserokey I will have a look09:27
mosheleskramaja: I try to deploy everything I will check when it done09:27
holserthanks a lot chem09:27
chemholser: and this one https://bugs.launchpad.net/tripleo/+bug/173570209:29
openstackLaunchpad bug 1735702 in tripleo "O->P fails during docker upgrade on docker/services/pacemaker/mysql." [High,Triaged]09:29
*** mcornea has joined #tripleo09:29
holserk, thanks09:29
chemholser: those come from the same logs, they start appearing when we get past the other errors.09:29
*** mrunge_ is now known as mrunge09:30
chemholser: I asked around to ha-expert and it looks like they never seen that before.09:30
holserinteresting, okey. I will assigne these bugs to myself09:30
chemholser: maybe dciabrin (if he has time) could gives you pointers09:30
* holser is starting working on those bugs 09:31
*** gfidente has quit IRC09:31
chemholser: you can use https://review.openstack.org/#/c/523408/ to test those bugs09:31
*** lucas-afk is now known as lucasagomes09:31
holseronce I have fixes I will rebase 523408 on top of them09:32
*** cylopez has left #tripleo09:32
chemholser: or you can use depends-on ... as you see fit.09:32
*** gfidente has joined #tripleo09:33
*** gfidente has quit IRC09:33
*** gfidente has joined #tripleo09:33
holserthat's it :) you've got my point09:33
chemholser: I would trigger a new job, i think for rdo cloud you need "recheck experimental"09:33
dciabrinholser, a long time ago I suspected the HA upgrade job to be misconfigured but I could never prove it with logs. if you have an HA upgrade job failing and you manage to get access to the env, I'd be happy to help you investigate09:33
chemholser: last one is 4 days old which is like pre-historic time :)09:34
holserwow - really old :)09:34
chemdciabrin: holser no live env ... but it's really looks like misconfiguration as downstream doesn't have this issue09:34
*** tvignaud has joined #tripleo09:35
*** d0ugal has quit IRC09:37
skramajaok moshele. i assume you are using continer base deployments, ensure the containers are running, when you face the error again.09:38
*** derekh has joined #tripleo09:39
mosheleskramaja: I run the default overcloud-deploy.sh as I remember it is not containerized environment, unless the default as changed09:39
chemholser: dciabrin I'm going to (try to) spin up a live env for the O->P, will let you know if it works09:40
skramajaok. oooq default is not containerized. got it.09:40
holserchem, I am spinning it up :)09:40
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart-extras master: WIP: wire up queens upgrade workflow  https://review.openstack.org/52600609:40
holseralso09:40
chemholser: ah, cool, so I won't.09:41
holsergive me a bit of time09:41
*** d0ugal has joined #tripleo09:42
dciabrinchem ack excellent09:42
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: SR-IOV agent: allow to configure agent extensions  https://review.openstack.org/52495609:42
mosheleskramaja: change it to be with default "" ^09:44
*** aditya_r has quit IRC09:46
chemholser: maybe have a look at the marios' review https://review.openstack.org/#/c/526006/1.  maybe there's something to grab in this stuff.09:50
skramajathanks moshele09:50
chemmarios: ^09:50
holserlooking... thanks for a tip chem09:50
marioso/09:51
chemmarios: just saw your review and the current upgrade is not using the proper queen upgrade doc it seems, right ?09:51
chemmarios: holser is looking into the upgrade jobs.09:51
marioschem: well it is running the composable upgrades steps and we are removing that (I am going to post something to tht as starter) since we have now the noop stack update to generate playbooks etc etc as you know09:52
marioschem: so even if it works for P->master/Q then it isn't the one we are working towards anyway09:52
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data  https://review.openstack.org/52560309:54
chemmarios: right.09:55
shardymarios: I don't think we can remove the upgrade_tasks for p-q as we've not formally deprecated the baremetal support09:56
mariosshardy: ah ack thanks that makes sense.... i'm in the middle of a rip out session :)09:56
shardyso even if we reduce/remove test coverage of baremetal->containers we probably need to leave the tasks for stopping baremetal services, until we communicate support for bm deployments ending09:57
*** gfidente has quit IRC09:57
shardymarios: ack, yeah will be good to remove eventually, but I think we need to leave the baremetal bits for a while longer09:57
mariosshardy: but for baremetal support, can't we still generate ansible playbooks from the upgrade tasks and execute them?09:58
mariosshardy: i mean do we need to have the heat driven upgrade steps (common/major_upgrade_steps.j2.yaml is the one i'm looking at)09:58
mariosshardy: i think a review will be easier to discuss let me do that instead09:59
shardymarios: ah, perhaps I misunderstood your comment, yea we need to leave the upgrade_tasks, but we could remove the associated deployment resources provided we have an upgrade workflow via config download etc09:59
mariosshardy: ack09:59
mariosshardy: yeah depends-on https://review.openstack.org/#/c/463728/4609:59
shardymarios: I was hoping we'd be able to remove _all_ deployment resources and switch to config download by default, but discussion with slagle indicates that's not likely for Queens10:00
shardy46 revisions, wow10:01
shardybut yeah, will be good to move to that instead of the heat resources10:01
*** gfidente has joined #tripleo10:01
*** gfidente has quit IRC10:01
*** gfidente has joined #tripleo10:01
*** gfidente has quit IRC10:03
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP: remove the heat upgrade steps for Q upgrade workflow  https://review.openstack.org/52601710:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638310:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]10:10
*** salmankhan has joined #tripleo10:10
*** ccamacho has joined #tripleo10:11
*** gfidente has joined #tripleo10:13
*** gfidente has quit IRC10:13
*** gfidente has joined #tripleo10:13
mosheleskramaja: all the service are up and it without containers10:25
shardyjistr, bogdando, flaper87: Hey trying to figure out the ClusterIP stuff mentioned by abeekhof10:25
shardyafaics that IP is a floating IP for the pods, not for external access?10:25
shardyhttp://paste.openstack.org/show/628259/10:25
jistrshardy: yes, i think i wrote about that in an earlier e-mail10:25
shardye.g we do need the external LB/VIP for a single access IP to the user-facing API10:26
mosheleskramaja: I just run the overcloud-deploy.sh and took https://raw.githubusercontent.com/openstack-infra/tripleo-ci/master/test-environments/enable-tls.yaml and https://raw.githubusercontent.com/openstack-infra/tripleo-ci/master/test-environments/inject-trust-anchor.yaml + created simple network-environment.yaml10:26
mosheleskramaja: is there a better way to run it?10:26
jistrshardy: yea. the IP that abeekhof mentioned is handled via statistic NAT in iptables10:27
flaper87shardy: right10:27
bogdandoshardy: yes, that's for an internal cluster consumption. It's not a real IP, just an iptables magic10:27
shardyjistr: ack OK I'll carry on with the haproxy stuff then - atm it's failing because the SSL certs don't consider the VIP ip, so either we need to add it when they're generated or nat the traffic from iptables10:27
shardyOk thanks guys, I was doubting myself for a moment based on the email feedback ;)10:27
flaper87^^10:28
shardybogdando: I pasted the latest error to https://review.openstack.org/#/c/516894/ - do you know how to get the x509 certificate to be valid for traffic from the VIP?10:29
shardyI couldn't figure it out from grepping kubespray but I assume we're missing setting some variable10:29
*** skramaja_ has joined #tripleo10:33
*** skramaja has quit IRC10:33
*** tosky has joined #tripleo10:37
*** skramaja has joined #tripleo10:37
*** skramaja_ has quit IRC10:38
*** d0ugal has quit IRC10:39
*** jtomasek has joined #tripleo10:40
gfidenteflaper87 you around?10:40
flaper87gfidente: kinda, sorta10:40
flaper87gfidente: sup?10:40
gfidenteflaper87 I am trying to consume some data back into mistral after executing ansible-playbook10:40
gfidentehave you tried anything similar and have a recipe?10:41
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Do not send email when logs are not available  https://review.openstack.org/52602410:41
gfidentebasically I want to capture the output from a command executed on all nodes10:41
gfidenteand consume it in the workflow10:41
flaper87gfidente: mmh, haven't done/needed that :/10:42
flaper87I guess you can parse the output of the playbook execution?10:42
gfidenteyeah I can append into the output the content of a register10:46
*** ffiore has quit IRC10:47
gfidentebut the problem seems to be parsing it10:47
gfidenteindeed10:47
flaper87gfidente: can you have the role/task/whatever-it-is write a file somewhere with the data you need?10:49
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Instance HA support  https://review.openstack.org/50692210:49
flaper87you can then red that file from mistral10:49
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: [PROTOTYPE] Enable generating SSH key for the ansible deploy  https://review.openstack.org/52602610:50
*** cshastri has quit IRC10:50
gfidenteflaper87 probably10:50
*** abregman is now known as abregman|afk10:50
gfidenteI'll try messing with the output callback plugins first10:50
gfidentethanks10:50
flaper87gfidente: it's better if you can avoid parsing things (especially ansible-playbook output)10:50
flaper87parsing always leads to weird scenarios :D10:51
gfidentebut has json output10:51
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/pike: Add ansible-lint script  https://review.openstack.org/52602710:52
*** adarazs is now known as adarazs_afk10:52
*** udesale has joined #tripleo10:55
*** dparkes has quit IRC10:56
*** d0ugal has joined #tripleo11:02
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: [WIP] Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603011:02
*** ffiore has joined #tripleo11:02
openstackgerritMerged openstack/tripleo-common master: Add --ansible-opts for upgrade-non-controller.sh O->P upgrade  https://review.openstack.org/52418311:03
*** tosky_ has joined #tripleo11:03
*** tosky has quit IRC11:03
*** tosky_ is now known as tosky11:03
*** ykarel_ has quit IRC11:06
*** ykarel_ has joined #tripleo11:06
*** lostRhino has joined #tripleo11:08
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638311:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]11:10
*** stendulker has quit IRC11:15
*** rfolco has joined #tripleo11:16
*** tosky has quit IRC11:16
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia integration parameters to neutron  https://review.openstack.org/52586011:17
*** masco has quit IRC11:18
*** Vijayendra has quit IRC11:19
*** Vijayendra has joined #tripleo11:20
*** udesale has quit IRC11:20
*** ykarel_ is now known as ykarel11:25
*** ykarel has quit IRC11:29
*** ykarel has joined #tripleo11:29
ramishrashardy, others: please can I get some reviews for this pike backport? https://review.openstack.org/#/c/522558/11:32
*** ykarel_ has joined #tripleo11:34
skramajamoshele: so you are deploying with tls and facing the keystone endpoint issue?11:34
mosheleskramaja: yes11:34
*** links has quit IRC11:34
mosheleskramaja: should I remove it?11:34
shardyramishra: Hi, sure looking11:35
ramishrashardy: thanks!11:35
skramajamoshele: can  you remove and deploy to confirm, but jasorior is the person, who could helo with tls if it is specific to tls11:36
mosheleskramaja: I wil check11:36
*** ykarel has quit IRC11:37
openstackgerritJulie Pichon proposed openstack/python-tripleoclient master: Add workflows-based role listing commands  https://review.openstack.org/52603811:37
*** rcernin has quit IRC11:39
bogdandoshardy: access_ip maybe. IIRC, it is added to certs' dns ip alts11:41
bogdandoshardy: so 192.168.24.13 should be access_ip11:42
shardybogdando: Ah, thanks, I think I previously tried setting access_ip but the current version only sets ip, kube_apiserver_bind_address and loadbalancer_apiserver11:43
shardyI had assumed loadbalancer_apiserver was enought to adjust the cluster access IP11:43
shardybogdando: thanks will try that, otherwise may have to terminate the ssl at haproxy11:43
mosheleskramaja: should I just remove the enable-tls.yaml ?11:44
*** abregman|afk is now known as abregman11:44
*** BryanS68 has joined #tripleo11:44
skramajamoshele: i think inject-trust-anchor.yaml  too..11:45
*** BryanS68 has quit IRC11:46
mosheleskramaja: and what about this /usr/share/openstack-tripleo-heat-templates/environments/tls-endpoints-public-ip.yaml?11:47
*** links has joined #tripleo11:47
*** ratailor has quit IRC11:47
skramajamoshele: sorry, i dont have much idea on tls part - https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ssl.html could give some insight.11:47
*** pdeore has quit IRC11:48
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Update default value for derive params workflow inputs  https://review.openstack.org/52598611:48
*** raildo has joined #tripleo11:48
*** BryanS68 has joined #tripleo11:49
*** janki has quit IRC11:52
*** dtantsur|afk is now known as dtantsur11:53
*** nmathew has quit IRC11:54
dtantsurmorning folks, can someone check https://review.openstack.org/#/c/522568/ please? it's a small patch enabling a very cool feature.11:55
dtantsurthe same change for containerized undercloud is https://review.openstack.org/#/c/523094/ (also a one-liner), if you're interested11:57
*** jkilpatr has joined #tripleo11:59
*** pdeore has joined #tripleo12:01
*** openstackgerrit has quit IRC12:03
*** akrivoka has joined #tripleo12:04
*** pkovar has joined #tripleo12:05
*** openstackgerrit has joined #tripleo12:06
openstackgerritMerged openstack/paunch stable/pike: Explicitly pull images before docker run  https://review.openstack.org/52532212:06
*** links has quit IRC12:08
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638312:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]12:10
*** ooolpbot has quit IRC12:10
bogdandoshardy: https://github.com/kubernetes-incubator/kubespray/blob/fe036cbe7705d6dc5aed5ddccb32a4723c31c9cd/roles/kubernetes/secrets/templates/openssl.conf.j2#L23 here is access_ip makes into certs. And via its FQDN at the line 2012:10
*** links has joined #tripleo12:13
openstackgerritMarios Andreou proposed openstack/tripleo-common stable/pike: Add --ansible-opts for upgrade-non-controller.sh O->P upgrade  https://review.openstack.org/52604712:14
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Add a tag to all the role specific parameters  https://review.openstack.org/51723112:20
*** ansmith has quit IRC12:21
*** adarazs_afk is now known as adarazs12:27
*** tosky has joined #tripleo12:28
chandankumarEmilienM: sshnaidm|rover weshay mwhahaha feel free to add feedback to it https://etherpad.openstack.org/p/tempestconfigtool_refactoring12:29
*** pchavva has joined #tripleo12:32
*** psahoo has quit IRC12:32
*** panda is now known as panda|lnch12:34
*** Goneri has quit IRC12:37
*** lucasagomes is now known as lucas-hungry12:44
*** abishop has joined #tripleo12:45
*** paramite has joined #tripleo12:45
*** janki has joined #tripleo12:46
*** thrash|g0ne is now known as thrash12:46
*** iranzo has quit IRC12:48
*** salmankhan has quit IRC12:49
*** salmankhan has joined #tripleo12:51
*** tesseract has quit IRC12:53
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745012:54
*** nmathew has joined #tripleo12:55
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible  https://review.openstack.org/51224012:56
*** tesseract has joined #tripleo12:57
*** nyechiel has quit IRC12:58
*** bfournie has joined #tripleo12:59
*** bfournie has quit IRC12:59
*** nyechiel has joined #tripleo12:59
*** skramaja has quit IRC13:01
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout  https://review.openstack.org/52559413:07
*** suuuper has quit IRC13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638313:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]13:10
chemlyarwood: hey, I would need the release https://review.openstack.org/#/c/519195/2 in tripleo-ci, would you mind if I made the change ?13:12
*** verdurin has quit IRC13:12
chemlyarwood: in tripleo-ci directory13:12
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Enable Octavia service_auth configuration  https://review.openstack.org/52606013:12
dtantsurmwhahaha: hey! I'm sorry, its seems that I've forgotten to ask for approval of https://blueprints.launchpad.net/tripleo/+spec/ovirt-driver. It's a high-priority for Red Hat, low impact code-wise and disabled by default. 2 of the patches are merged, 2 have 1x +2.13:12
lyarwoodchem: not at all, go for it :)13:12
mwhahahadtantsur: are all patches posted? or is there more work needed?13:13
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856713:13
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941913:13
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346313:13
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles  https://review.openstack.org/50983213:13
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow  https://review.openstack.org/51504513:13
dtantsurmwhahaha: double-checking13:13
*** dprince has joined #tripleo13:14
mwhahahadtantsur: thanks, if it's all good as is i have no problems approving it as it looks like we can land it today13:14
EmilienMbeagles: in a mtg now, will join asap13:14
dtantsurmwhahaha: all patches seem to be up for it13:15
mwhahahadtantsur: ok thanks13:15
beaglesEmilienM, ack13:15
dtantsurmwhahaha: while we are here, status update on https://blueprints.launchpad.net/tripleo/+spec/ansible-deploy. all essential patches are up. the docs are missing, and the SSH craziness I've been working asking you about is nice-to-have, but not critical.13:16
*** jkilpatr has quit IRC13:16
mwhahahadtantsur: ok i'll review that one as well13:17
dtantsurmwhahaha: this is approved already, just updating you on the status13:17
mwhahahadtantsur: yea i meant the patches :D13:17
dtantsurthat's even better, thanks :)13:17
*** dtantsur is now known as dtantsur|lunch13:18
*** nyechiel has quit IRC13:18
*** mburned is now known as mburned_out13:20
chemlyarwood: cool13:20
*** rhallisey has joined #tripleo13:20
*** sshnaidm|rover is now known as sshnaidm|afk13:20
*** ffiore has quit IRC13:21
*** trown|outtypewww is now known as trown13:22
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: config: Provide a Master UC and Newton OC release config  https://review.openstack.org/51919513:23
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials  https://review.openstack.org/52606213:23
*** links has quit IRC13:23
*** verdurin has joined #tripleo13:25
*** rlandy has joined #tripleo13:28
*** ykarel_ has quit IRC13:28
*** rfolco is now known as rfolco|afk13:29
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia integration parameters to neutron  https://review.openstack.org/52586013:29
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials  https://review.openstack.org/52606213:29
*** mburned_out is now known as mburned13:29
flaper87jistr: might have found a workaround for the nm thing, will report back after testing13:29
*** ykarel_ has joined #tripleo13:30
*** Goneri has joined #tripleo13:30
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Enable collectd to send metrics to Gnocchi  https://review.openstack.org/52606713:33
*** rfolco|afk is now known as real_jesus13:34
*** real_jesus is now known as rfolco13:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps.j2: use ansible to bootstrap environment  https://review.openstack.org/52529113:38
*** dtantsur|lunch is now known as dtantsur13:40
EmilienMweshay: do we have a bug for OVB timeout now?13:40
EmilienMweshay: if yes, I would put it in alert13:40
weshayEmilienM, we13:40
weshay're13:40
EmilienMfolks need to know to be careful when reviewing patches13:40
weshayusing your bug :)13:40
* weshay gets13:41
weshayEmilienM, would be great if you updated the title13:41
EmilienMsure13:41
*** nmathew- has joined #tripleo13:42
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/173663413:42
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)13:42
*** jkilpatr has joined #tripleo13:42
EmilienMwhat should I change?13:42
EmilienMwe have this one otherwise: https://bugs.launchpad.net/tripleo/+bug/172286413:43
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]13:43
EmilienMwhich looks more accurate to the situation13:43
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Do not send email when logs are not available  https://review.openstack.org/52602413:43
*** ffiore has joined #tripleo13:43
openstackgerritJames Slagle proposed openstack/tripleo-common master: Remove jq package install  https://review.openstack.org/52578113:43
*** nmathew has quit IRC13:45
*** psachin has quit IRC13:45
jistrflaper87: that would be great :)13:45
dtantsurmwhahaha: could you please create rocky milestones in LP? I'd like to retarget https://blueprints.launchpad.net/tripleo/+spec/ironic-direct-deploy but we don't have rocky-113:46
*** gbarros has joined #tripleo13:46
mwhahahadtantsur: yea i'm going to do it today13:47
dtantsurack13:47
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Handle error in the deploy_on_server workflow  https://review.openstack.org/52333213:47
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove the name from task() functions that refer to themselves  https://review.openstack.org/52425013:47
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: DPDK derive params inputs default value update  https://review.openstack.org/52599013:48
*** eck`gone is now known as eck`13:48
*** lucas-hungry is now known as lucasagomes13:49
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: [WIP] Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603013:50
*** ansmith has joined #tripleo13:51
*** ykarel_ is now known as ykarel|afk13:53
*** ansmith has quit IRC13:56
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: Set default_resource_class to baremetal  https://review.openstack.org/52607213:57
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Passes NodeDataLookup to ceph-ansible workflow  https://review.openstack.org/52607313:57
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Passes NodeDataLookup to ceph-ansible workflow  https://review.openstack.org/52607313:58
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Undercloud deploy: pass undercloud.yaml after docker.yaml  https://review.openstack.org/52607613:59
*** ansmith has joined #tripleo13:59
*** jaganathan has quit IRC13:59
openstackgerritJiri Tomasek proposed openstack/tripleo-heat-templates stable/pike: Update capabilities-map.yaml to include latest storage environments  https://review.openstack.org/52607714:00
*** nmathew- has quit IRC14:01
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry  https://review.openstack.org/52464414:01
*** liverpooler has joined #tripleo14:01
jistrdprince, mandre: i think this is why we had the separate Undercloud* resource entries: https://review.openstack.org/#/c/52607614:02
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: config: Provide a Master UC and Newton OC release config  https://review.openstack.org/51919514:02
jistrpassing the env file again is not optimal, but IMO it's still significantly better than maintaining two sets of resource registry names14:02
*** hamzy has quit IRC14:02
*** sshnaidm|afk is now known as sshnaidm|rover14:02
dprincejistr: ah right, that could be it14:03
dprincejistr: I don't want to always containerize it14:03
jistrack. Then passing the undercloud.yaml after docker.yaml should do the trick.14:04
dprincejistr: actually, we specifically might use this for keeping some of our baremetal testing intact. We spoke of this at the PTG. Like we could keep 1 (small) single node job to test baremeteal with the undercloud14:04
dprincejistr: yes, but we'll need to roll our own validation mechanism for this ordering I think14:05
jistryea i see, now i seem recall that from ML / irc meeting discussion as well14:05
jistrre baremetal testing i mean ^14:05
dprincejistr: okay14:06
dprincejistr: so regarding undercloud.yaml being last. I would say a validation would be nice on this14:07
dprincemaybe not required though14:07
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: [WIP] undercloud: set default_resource_class to 'baremetal'  https://review.openstack.org/52607814:07
dprincejistr: also, I think we already have some ordering issues with other environment files too. But it may be best to avoid them... even if it costs us some duplication14:08
*** tzumainn has joined #tripleo14:08
*** dsariel has quit IRC14:08
*** lostRhino_ has joined #tripleo14:08
dtantsurmwhahaha: sorry for the noise, another highlight: currently the undercloud-containers job does not install ironic-inspector. https://review.openstack.org/#/c/524163/ corrects it, and seems to work.14:09
*** mdnadeem has quit IRC14:09
*** lostRhino has quit IRC14:10
*** lostRhino_ is now known as lostRhino14:10
jistrdprince: what you see as the desired outcome, re preferring duplication over ordering issues? Would you like to keep Undercloud* resource registry?14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638314:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663414:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]14:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)14:10
fultonjmy oooq install is failing because undercloud-install.sh is not on the undercloud. Does anyone know how it's supposed to get there?14:10
*** iranzo has joined #tripleo14:10
dprincejistr: I dunno. Maybe.14:11
jistrdprince: i could try implementing the validation for docker.yaml vs. undercloud.yaml, but i don't know what other ordering issues you had in mind14:11
*** ramishra has quit IRC14:11
*** udesale has joined #tripleo14:12
openstackgerritMerged openstack/tripleo-heat-templates master: Enable ironic staging drivers in the undercloud  https://review.openstack.org/52308414:14
*** salmankhan has quit IRC14:14
jistrdprince: there's another possible duplication path. We could have docker-undercloud.yaml that would duplicate docker.yaml, but exclude the services disabled by default. Still duplication, but at least it would be limited to t-h-t. The current solution duplicates in tripleo-common as well, and makes for quite confusing naming (some services in resource registry are Undercloud<Service>, others are just14:15
jistr<Service>).14:15
jistrthe duplication in tripleo-common is because of `container image prepare` detection of which images to pull14:16
jistrdprince: anyway maybe this could use a ML thread?14:16
dprincejistr: right, but again. That violates the "anything can be an undercloud" idea14:16
openstackgerritThomas Herve proposed openstack/tripleo-common master: Make some tweaks to swift logging  https://review.openstack.org/49893014:16
*** ffiore has quit IRC14:17
*** dbellant has quit IRC14:17
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker  https://review.openstack.org/52608014:17
dprincejistr: there are several goals of this framework. One is dev/testing. Another is replacing instack-undercloud with a containerized product14:17
*** bfournie has joined #tripleo14:17
dprincejistr: for me having the Heat environment behave as much as possible like they do on the Overcloud is the overriding ideal14:17
*** gkadam has quit IRC14:18
dprincejistr: and if there is some duplication in the process. So be it. Perhaps put a tools/yaml-validate.py test on it like we do for many things14:18
*** jmelvin has joined #tripleo14:20
jistrdprince: re violating "anything can be an undercloud". You mean that we'd have to pass `docker-undercloud.yaml` instead of `docker.yaml` to undercloud deploy?14:20
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker  https://review.openstack.org/52608014:21
dprincejistr: right. if there is a static list it means we can't leverage the environments/services-docker to layer in custom services14:23
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker  https://review.openstack.org/52608014:23
jistrdprince: well it wouldn't be list, it would still be just resource registry mappings. So the services-docker layering would still work.14:23
*** salmankhan has joined #tripleo14:27
dprincejistr: yeah. good point. I think it could be okay then14:27
*** ykarel_ has joined #tripleo14:28
jistrdprince: ok i'll change the patches in this way and we'll see what folks think. It's still duplication but it's limited to a single place, so hopefully it would be an improvement.14:29
jistrdprince: thanks for the feedback :)14:30
*** ykarel|afk has quit IRC14:31
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials  https://review.openstack.org/52606214:33
*** hjensas has quit IRC14:34
*** lblanchard has joined #tripleo14:34
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker  https://review.openstack.org/52608014:35
*** eck` is now known as eck`gone14:36
*** tesseract has quit IRC14:37
*** eck`gone is now known as eck`14:40
*** hamzy has joined #tripleo14:42
*** tesseract has joined #tripleo14:44
*** s_b_34343 has quit IRC14:44
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/pike: Validate library files for documentation string  https://review.openstack.org/52608514:46
EmilienMslagle: in https://review.openstack.org/#/c/525291/ - I'm not sure how the playbook is executed if we don't call the tag, right?14:46
EmilienMgchamoul: could you please follow up on https://review.openstack.org/#/c/525637/ ?14:47
shardyEmilienM: by default we run config dowload playbooks with no tags14:48
EmilienMshardy: ok so we run all playboosk I guess14:48
slagleEmilienM: right, if you pass no tags, they all get run14:48
EmilienMack14:49
slaglewhich is what we do by default14:49
EmilienMok, thx14:49
EmilienMshardy: if you have time to review https://review.openstack.org/#/c/525291/14:49
shardyEmilienM: sure looking14:49
EmilienMand https://review.openstack.org/#/c/525285/14:49
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials  https://review.openstack.org/52606214:49
d0ugalrbrady,d0ugal,apetrich,thrash,toure,jpich,jtomasek - Workflow squad meeting in ~9mins. https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:51
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/pike: Add ansible-lint script  https://review.openstack.org/52602714:51
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Enable octavia certificate configuration  https://review.openstack.org/52608714:51
jtomasekd0ugal: sorry, not able to join today14:51
d0ugaljtomasek: np14:52
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Undercloud deploy: use docker-uc.yaml  https://review.openstack.org/52607614:52
*** lblanchard has quit IRC14:52
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry  https://review.openstack.org/52464414:52
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Disable services in undercloud.yaml and add docker-uc.yaml  https://review.openstack.org/52608814:52
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout  https://review.openstack.org/52559414:52
*** alee has joined #tripleo14:52
*** cylopez has joined #tripleo14:52
*** hamzy has quit IRC14:53
toured0ugal ack14:54
*** hamzy has joined #tripleo14:55
EmilienMshardy: thanks :-)14:55
slagleEmilienM: now can you +2 https://review.openstack.org/#/c/525781/ ?14:56
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Undercloud deploy: use docker-uc.yaml  https://review.openstack.org/52607614:56
EmilienMslagle: I could :P14:56
*** hamzy has quit IRC14:58
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609014:59
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Remove Octavia LBaaS service plugin from neutron config  https://review.openstack.org/52609314:59
*** hamzy has joined #tripleo15:00
*** rbowen has joined #tripleo15:01
*** ykarel_ is now known as ykarel15:01
*** marios has quit IRC15:02
*** owalsh_ has joined #tripleo15:03
*** owalsh has quit IRC15:05
*** hamzy has quit IRC15:06
*** ramishra has joined #tripleo15:07
*** s_b_34343 has joined #tripleo15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638315:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663415:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)15:10
sshnaidm|roverdprince, do you know maybe: in tripleoclient output we have "tacker" container, but in kolla we build tacker-base, tacker-conductor, tacker-server, there is no "tacker" container15:11
*** dsariel has joined #tripleo15:11
dprincesshnaidm|rover: sounds like they got split out perhaps?15:11
sshnaidm|roverdprince, perhaps.. no idea, who can know?15:12
sshnaidm|roverdprince, and how to fix? to add to tripleoclient all those?15:12
dprincesshnaidm|rover: just did a 'git log' in the kolla/docker/tacker directory15:12
dprincesshnaidm|rover: it see this Kolla commit : 7b2dea5506375cb868d6acb6a99b0aca916fad6c15:12
dprincesshnaidm|rover:     Implement tacker-conductor image, rework all tacker15:12
dprincesshnaidm|rover: I think this is your answer15:12
sshnaidm|roverdprince, so, we need to fix it where? tripleo-common, tripleoclient?15:13
*** panda|lnch is now known as panda15:13
*** hamzy has joined #tripleo15:13
dprincesshnaidm|rover: someone needs to push patches to pull the new tacker containers, yes. Probably some work in tripleo-common and maybe tripleoclient too15:14
*** hamzy has quit IRC15:14
sshnaidm|roverdprince, do you have suggestions who could be this hero? :)15:15
openstackgerritMerged openstack/tripleo-quickstart-extras master: Do not create roles unless keystone was deployed  https://review.openstack.org/52564815:17
*** janki has quit IRC15:17
openstackgerritMerged openstack-infra/tripleo-ci master: Remove workaround for periodic jobs  https://review.openstack.org/52554115:17
*** hamzy has joined #tripleo15:17
*** agurenko has quit IRC15:17
sshnaidm|rovergfidente, hi, do you know why ceph container is not in tripleoupstream? https://github.com/openstack/tripleo-common/blob/aaf46be238f554148b40748dbd4eafec759038ed/container-images/overcloud_containers.yaml#L9615:17
*** hamzy has quit IRC15:18
dtantsurfolks, we do configure swift temporary URLs in the undercloud, don't we?15:18
*** dsariel has quit IRC15:18
dtantsurshardy: I guess you know ^^^15:18
dprincesshnaidm|rover: I think pradk might have implemented that. radez you helped a bit w/ Congress right?15:18
mandresshnaidm|rover: the kolla tacker container was recently split into base and conductor and tripleo has not yet caught up with the change15:18
shardydtantsur: yes we do15:18
beaglesshardy, couple of questions - with external_deploy_tasks is the correct pattern to construct an inventory or is there an "implicit" inventory that is meant to be used?15:18
dprincesshnaidm|rover: probably somebody else on the containers DFG can help with this too15:18
dtantsurshardy: where can I access the key for them, do you know?15:19
gfidentesshnaidm|rover because we use images built by ceph15:19
gfidentenot by tripleo15:19
sshnaidm|rovergfidente, ack15:19
*** ffiore has joined #tripleo15:19
sshnaidm|roverdprince, it raises again the question about updated containers list..15:19
mandresshnaidm|rover: I think you can safely ignore tacker until we get someone in tripleo to rework the implementation15:20
shardydtantsur: it depends where they were created, there's a couple of scripts in tripleo common, and heat can also create a tempurl for metadata/signalling15:20
sshnaidm|rovermandre, yes, but I wanted to have containers list generated automatically, and seems like it's not updated if it contains "tacker" container15:20
shardydtantsur: e.g https://github.com/openstack/tripleo-common/blob/master/scripts/upload-swift-artifacts#L10915:20
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609015:21
shardydtantsur: the upload* scripts aren't used by default, but the heat transport is, sec I'll find the code15:21
mwhahahadtantsur: what are you needing it for? we do leverage them in mistral15:21
dtantsurmwhahaha: ironic ansible deploy interface uses it to provide access to overcloud-full image of the target node15:22
shardyOh yeah, for swift ring distribution also15:22
mandresshnaidm|rover: agreed, let's drop it from tripleo-common's list until it's fixed15:22
*** dpawar has quit IRC15:23
*** dpawar has joined #tripleo15:23
mwhahahadtantsur: i don't think you'd generate a key via the swift command15:23
shardydtantsur: Yeah I think you generate the key at the point of creating the tempurl15:23
mwhahahadtantsur: of course the openstack command doesnt' support temp url generation so i had to hack something into the upload swift script15:23
EmilienMneed review https://review.openstack.org/#/c/525341/15:23
shardyvs having a predictable/shared key15:24
dtantsurshardy: for some reason, I don't remember exactly, ironic accepts a pre-generated key15:24
mwhahahadtantsur: probably because you generate it in swift first15:25
*** dpawar has quit IRC15:25
mwhahahadtantsur: https://github.com/openstack/tripleo-common/blob/master/scripts/upload-swift-artifacts#L106-L113 that block does it15:25
weshaysshnaidm|rover, FYI https://bugs.launchpad.net/tripleo/+bug/1736475 was not escalated because the milestone was not filled out15:25
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail in pike promotion job periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-pike" [Critical,Triaged]15:25
*** ffiore has quit IRC15:25
weshaysshnaidm|rover, fixed and escalated15:25
EmilienMweshay: ping pradk eventually15:25
dtantsurmwhahaha: thanks, yeah, looking at it now. should not be hard to do for the glance container..15:25
shardyhttps://github.com/openstack/heat/blob/master/heat/engine/clients/os/swift.py#L9915:26
shardydtantsur: FWIW that's how we do it in heat, randomly generated unless there's a header for the account15:26
dtantsurnice, I'll file a bug against ironic15:27
dtantsurmaybe we don't do it do avoid stepping on operator's shoes, if they need to access these containers from other tools?15:28
sshnaidm|roverweshay, ack15:28
*** aditya_r has joined #tripleo15:29
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud  https://review.openstack.org/50819515:29
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609015:31
*** cylopez has quit IRC15:31
*** lostRhino has quit IRC15:31
*** owalsh_ is now known as owalsh15:32
openstackgerritMartin André proposed openstack/tripleo-common master: Comment out tacker image until service is ready  https://review.openstack.org/52609915:34
mandresshnaidm|rover: ^^ what about this?15:34
*** lostRhino has joined #tripleo15:35
*** gbarros has quit IRC15:35
*** moshele has quit IRC15:35
openstackgerritMerged openstack/tripleo-common master: Support enrolling nodes with staging-ovirt hardware type  https://review.openstack.org/52281515:35
openstackgerritMerged openstack/instack-undercloud master: Add support for oVirt via the staging-ovirt hardware type  https://review.openstack.org/52280715:35
sshnaidm|rovermandre, great, exactly what we need15:35
*** udesale has quit IRC15:36
sshnaidm|rovermandre, when tripleoclient generates list of containers, does it take the list from tripleo-common files?15:37
mandresshnaidm|rover: yes, that's our source for container images15:39
sshnaidm|rovermandre, ack15:40
*** trown is now known as trown|brb15:42
*** lostRhino has left #tripleo15:45
*** ykarel is now known as ykarel|afk15:45
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: WIP: (very) Execute Octavia post deploy tasks  https://review.openstack.org/52610315:46
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add nova and neutron tempest plugins to default config  https://review.openstack.org/52565715:49
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: remove tempest plugin install from convert image  https://review.openstack.org/52565915:49
*** abregman is now known as abregman|mtg15:50
*** trown|brb is now known as trown15:50
adarazsEmilienM: please re-review this when you have some time, I want to move forward with it, other tasks depend on it in our sprint: https://review.openstack.org/52523715:52
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Implement Upgrade workflow via the tripleo cli  https://review.openstack.org/46372815:52
*** tongl has joined #tripleo15:52
dtantsurfolks, I may be insane.. but I have 5 images in Glance and no Swift containers for the glance user15:53
trownrlandy: you could use your +2 powers on https://review.openstack.org/#/c/518748/ ;)15:53
rlandytrown: sure - I owe you that!15:54
EmilienMadarazs: sure thing, I'll review it today15:54
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Get message from websocket instead from zaqarclient directly  https://review.openstack.org/52592415:54
adarazsrlandy: woo, congrats for the +2! :)15:55
beaglesshardy, forgot my second question - just confirming that we would still be calling the playbook from the external_post_deploy_tasks, not move all of the tasks into the heat template15:55
rlandyweshay: ^^ first +2 - do I get to make a shehecheyanu?15:56
weshayrlandy, ah NICE.. I've never said the shehecheyanu over bluejeans15:56
weshayrlandy++15:56
shardybeagles: Hey, so the tasks are called on the undercloud with -i /usr/bin/tripleo-ansible-inventory, so if the tasks can run on the undercloud no additional inventory is required15:57
weshayvery nice news15:57
trownive also never said the shehecheyanu over bluejeans15:57
adarazslooking at how complicated even just that word is, I don't think I will say it either. :)15:57
shardybeagles: however in the case where you want to run tasks on the overcloud nodes, such as in the case of kubespray, you may need to generate a nested inventory in a similar way15:57
weshaywho is ejuaoso15:57
shardybeagles: where the tasks live is up to you, but I was thinking you may want to move them into the service template15:58
beaglesshardy, there are a lot of em ;)15:58
shardybeagles: ack, yeah then I guess it could remain a role in tripleo-common and you just include it15:59
openstackgerritToure Dunnon proposed openstack/tripleo-common master: Migrate the ansible actions from tripleo-common to mistral-extra.  https://review.openstack.org/52354015:59
*** s_b_34343 has quit IRC15:59
beaglesshardy, oohhhh include15:59
beaglesbeagles does a facepalm15:59
shardybeagles: the disadvantage of that approach is the update of the role has to be aligned with any update to the template16:00
beaglesshardy, yeah, that's a good point16:00
shardywhereas it's kinda easier when everything is in t-h-t16:00
shardythat said we already have that problem with kubespray, openshift-ansible and ceph-ansible16:00
beaglesshardy, there is something special that needs to be done to get access to the overcloud credentials correct?16:01
beaglesshardy, ie. be able to call openstack client calls from the task?16:01
shardybeagles: I had been wondering if there's a case for a tht/ansible/roles structure, e.g somewhere config download could download roles from vs having a static packaged role to keep in sync16:01
beaglesshardy, that would actually be pretty sweet16:02
shardybeagles: you'd just need to pass the credentials in via heat parameters I think, assuming the admin credentials16:02
*** morazi has quit IRC16:02
beaglesshardy, ack16:02
*** ykarel|afk has quit IRC16:02
shardybeagles: we could even consider reworking how we write the overcloudrc I guess, that could use external_post_deploy_tasks instead of a tripleo-common workflow16:03
shardybeagles: but for now I think you can just reference e.g AdminPassword and the keystone endpoint from the EndpointMap16:05
shardyand pass those to the ansible tasks (e.g via str_replace)16:05
shardywe do a similar thing here:16:05
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/kubernetes-master.yaml#L14716:06
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638316:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663416:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)16:10
*** andreaf_ has joined #tripleo16:10
*** gbarros has joined #tripleo16:12
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add keystone and neutron tempest plugins to default config  https://review.openstack.org/52565716:15
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Deploy OpenShift using OOO on the overcloud  https://review.openstack.org/49447016:15
*** andreaf has quit IRC16:17
*** andreaf_ is now known as andreaf16:17
*** s_b_34343 has joined #tripleo16:18
weshaydprince, Slower are all the patches in for the insecure registry, ready for retest?16:22
*** s_b_34343 has quit IRC16:23
*** hewbrocca is now known as hewbrocca_afk16:23
jpichjtomasek, honza: So https://blueprints.launchpad.net/tripleo/+spec/tripleo-ui-basic-ci-check was added a couple of cycles ago to the undercloud CI job, and the UI can break this test which is why the job was also added to it at the time16:24
*** s_b_34343 has joined #tripleo16:24
jpichjtomasek, honza: I'm not totally sure if it was lost along the way during the migration to quickstart for CI, but if it's still there I think the job should be reenabled...16:24
*** shreshtha has quit IRC16:25
jtomasekjpich: +116:26
dprinceweshay: I still have a patch to push16:30
dprinceweshay: hit a snag w/ the Endpointmapping stuff in t-h-t with regards to the new docker-registry service we need16:30
jpichjtomasek: Do you know if it was deliberately removed (I assumed so from your comment?) or did it get lost along the way, during the zuul migration?16:31
jtomasekjpich: I have no idea tbh, I don't think it was removed on purpose16:32
jtomasekjpich: is that job used anywhere else?16:32
jpichjtomasek: It should be used on puppet-tripleo and a couple other places *looks*16:32
*** aditya_r has quit IRC16:34
*** ffiore has joined #tripleo16:35
*** dbecker has quit IRC16:35
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Enable collectd to send metrics to Gnocchi  https://review.openstack.org/52612216:36
jpichjtomasek: yes it looks like there is still undercloud only jobs running there... though they have oooq in the name so I don't know if they use the tripleo.sh script. Looking at https://review.openstack.org/#/c/514795/ though there are UI sanity checks there too so we probably want to figure out which jobs this validation is running on and get the shortest running one to run on the UI too16:37
openstackgerritSteven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config  https://review.openstack.org/52523616:38
sshnaidm|roveralee, just to confirm here - we don't need barbican-worker and keystone-listener containers for pike, so I exclude them16:38
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745016:38
shardyslagle: ^^ hey that's the fix I mentioned yesterday for config download, would appreciate your review when you get a moment, as I'm not 100% certain my use of outputs is equivalent to your previous resource list logic16:38
shardyslagle: it makes config download take ~12 seconds vs over a minute though16:39
aleesshnaidm|rover, yup16:39
jtomasekjpich: sounds good16:39
*** nmathew- has joined #tripleo16:39
slagleshardy: i'll take a look16:39
*** abregman|mtg has quit IRC16:40
*** gbarros has quit IRC16:40
*** nmathew has joined #tripleo16:41
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745016:41
*** shreshtha has joined #tripleo16:44
*** nmathew- has quit IRC16:44
*** nmathew- has joined #tripleo16:44
*** nmathew- has quit IRC16:45
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Enable collectd to send metrics to Gnocchi  https://review.openstack.org/52606716:46
*** nmathew has quit IRC16:48
*** jangutter has quit IRC16:48
*** nyechiel has joined #tripleo16:50
dtantsurfolks, am I using this syntax incorrectly? https://review.openstack.org/#/c/526078/1/puppet/services/ironic-base.yaml16:52
*** pdeore has quit IRC16:53
*** hamzy has joined #tripleo16:53
*** fragatina has quit IRC16:55
dtantsur"if" ends up in the final hieradata: http://logs.openstack.org/78/526078/1/check/tripleo-ci-centos-7-undercloud-containers/c41d84d/logs/undercloud/etc/puppet/hieradata/service_configs.json.txt.gz16:56
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856716:59
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941916:59
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346316:59
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles  https://review.openstack.org/50983216:59
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow  https://review.openstack.org/51504516:59
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574316:59
thrashsorry...17:00
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856717:00
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941917:00
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346317:00
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles  https://review.openstack.org/50983217:00
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow  https://review.openstack.org/51504517:00
thrashwhen you forget a Depends-On in the first patch in a series... :(17:00
*** mrch has quit IRC17:00
*** dprince has quit IRC17:01
*** athomas has quit IRC17:04
*** trown is now known as trown|lunch17:04
jtomasekthrash: :) Adds Workflow to List Available Roles is to get consistent with networks and replace the current action?17:07
thrashjtomasek: yes. :D17:07
*** itlinux has joined #tripleo17:08
*** hamzy has quit IRC17:08
jtomasekthrash: I'll check those out tomorrow17:09
thrashjtomasek: see comment on https://review.openstack.org/#/c/520634/217:09
*** hamzy has joined #tripleo17:09
jtomasekthrash: I think I confused list roles and list available roles -> 2 different things17:09
*** hjensas has joined #tripleo17:09
*** hjensas has quit IRC17:09
*** hjensas has joined #tripleo17:09
thrashjtomasek: perhaps17:09
*** cylopez has joined #tripleo17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638317:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663417:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]17:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)17:10
*** iranzo has quit IRC17:11
*** hamzy has quit IRC17:12
*** hamzy has joined #tripleo17:12
*** fragatina has joined #tripleo17:14
*** lucasagomes is now known as lucas-afk17:15
*** thrash is now known as thrash|biab17:16
EmilienMslagle: http://logs.openstack.org/91/525291/2/check/tripleo-ci-centos-7-containers-multinode/0c1b6d5/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-06_15_26_2917:18
EmilienMit worked \o/17:18
Tenguhello!17:18
slagleEmilienM: i always knew you could sling yaml like a pro17:19
*** nyechiel has quit IRC17:19
openstackgerritJiri Tomasek proposed openstack/tripleo-heat-templates master: [WIP] Add networks directory  https://review.openstack.org/52063417:19
jtomasekthrash|biab: ^17:19
Tengusmall question: I'm trying to add a unit test in puppet-tripleo, but it apparently fails. When I test on my laptop, it fails as well, and apparently it's due to the syntax in hiera.17:20
Tenguthe unit test is here: https://review.openstack.org/#/c/525492/3/spec/defines/tripleo_haproxy_service_endpoints_spec.rb and the puppet code: https://review.openstack.org/#/c/525492/3/manifests/haproxy/service_endpoints.pp17:21
*** rfolco is now known as rfolco_brb17:21
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Remove jq package install  https://review.openstack.org/52578117:21
Tenguapparently, the notation "tripleo.foo.blah" is already used in the "firewall" part of the same module, but..... apparently, there isn't any unit test on that one as well. So I'm a bit stuck.17:21
EmilienMslagle: ^ rebased correctly on top of 525285 to have the playbook17:21
slagleEmilienM: thanks, yea i noticed you can't have a depends-on for a patch from the same repo17:22
*** jtomasek has quit IRC17:22
slaglewhich is why the ci had failed17:22
*** holser has quit IRC17:23
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout  https://review.openstack.org/52559417:26
*** yprokule has quit IRC17:26
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Implement Upgrade workflow via the tripleo cli  https://review.openstack.org/46372817:28
*** florianf has quit IRC17:29
*** aufi has quit IRC17:30
*** dhill_ has quit IRC17:30
*** hamzy has quit IRC17:32
*** dtantsur is now known as dtantsur|afk17:33
tbarronnaive (likely dumb) question: are THT unit tests supposed to work when run locally?17:33
*** paramite has quit IRC17:34
tbarronI get errors due to missing 'output_path' positional argument: https://paste.fedoraproject.org/paste/skEBkRzsGZ436Iqsc5dEjg17:34
tbarronthat's with no changes on master17:34
tbarronprobably some set-up-your-env doc tells me what I'm missing but I'm not seeing the doc17:36
*** bogdando has quit IRC17:36
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: DO NOT MERGE - test  https://review.openstack.org/52613117:37
openstackgerritJames Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download  https://review.openstack.org/52533117:37
EmilienMweshay: I haven't followed everything but are you aware about any progress on OVB jobs timeouts?17:38
weshayEmilienM, I'm looking at it now, but first thought has already been done.. where I was going to turn off tripleo-validations17:39
weshayEmilienM, I confirmed w/ trown|lunch and sshnaidm|rover re your concern about the modify-image17:40
weshaybeing called multiple times.. it's just a utility role17:40
weshaycalled several times for the right reasons17:40
weshaystill looking at options17:40
*** ramishra has quit IRC17:40
*** ffiore has quit IRC17:41
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker-registry service  https://review.openstack.org/52613217:41
EmilienMweshay: ovb-ha doesn't run validations.17:42
weshayya17:42
weshaycorrect17:42
*** jpich has quit IRC17:43
weshayit did at one point17:43
EmilienMI'm wondering if it's just time to switch off rh1 and only have RDO CI jobs (just on master)17:43
EmilienMRDO CI jobs would just run ovb-ha and ovb-ha-ipv6, like we want rh1 to do now (with check-tripleo)17:44
EmilienMdoes it make sense?17:44
*** ffiore has joined #tripleo17:45
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: remove tempest plugin install from convert image  https://review.openstack.org/52565917:46
EmilienMweshay: the RDO CI jobs run much faster17:47
weshayyes17:47
weshayEmilienM, /me looks at your fs024 review17:47
weshayreducing load will help17:47
*** salmankhan has quit IRC17:47
*** mcornea has quit IRC17:48
*** ffiore has quit IRC17:48
EmilienMweshay: in a call, brb17:48
*** salmankhan has joined #tripleo17:49
weshayEmilienM, /me wonders if a good first step would be to simply nuke fs024 and push through the review vs. https://review.openstack.org/#/c/525747/2/zuul.d/layout.yaml17:51
*** rfolco_brb is now known as rfolco17:52
*** dsariel has joined #tripleo17:54
*** shardy has quit IRC17:54
EmilienMweshay: let me finish the thing I'm doing and we can chat17:58
*** rhallisey has quit IRC18:01
*** derekh has quit IRC18:01
*** rhallisey has joined #tripleo18:02
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add DockerRegistryMirror parameter  https://review.openstack.org/52576418:03
*** haint has quit IRC18:04
*** moshele has joined #tripleo18:04
*** tesseract has quit IRC18:07
*** tosky has quit IRC18:09
*** mcornea has joined #tripleo18:09
*** radeks has quit IRC18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638318:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663418:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)18:10
*** shreshtha has quit IRC18:11
*** nguyentrihai has joined #tripleo18:14
*** s_b_34343 has quit IRC18:14
chandankumarweshay: EmilienM free free to add thoughts to the tempestconf work etherpad https://etherpad.openstack.org/p/tempestconfigtool_refactoring18:15
chandankumarin future we are going to get rid of tempest deployer input conf file18:15
*** BryanS68 has quit IRC18:15
*** thrash|biab is now known as thrash18:16
*** BryanS68 has joined #tripleo18:16
*** dhill_ has joined #tripleo18:16
*** salmankhan has quit IRC18:17
*** dhill_ has quit IRC18:22
*** dhill_ has joined #tripleo18:23
*** dhill_ is now known as dhill|food18:26
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: dump out all the variables used  https://review.openstack.org/52613818:27
*** radeks has joined #tripleo18:28
*** trown|lunch is now known as trown18:32
*** gkadam has joined #tripleo18:32
*** dprince has joined #tripleo18:36
*** gbarros has joined #tripleo18:38
*** radeks has quit IRC18:40
*** hamzy has joined #tripleo18:45
*** moshele has quit IRC18:45
*** hamzy has quit IRC18:46
*** hamzy has joined #tripleo18:46
*** hjensas has quit IRC18:47
*** nyechiel has joined #tripleo18:49
*** mcornea has quit IRC18:54
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574318:54
*** hjensas has joined #tripleo18:56
*** cylopez has quit IRC18:58
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Configure undercloud docker registry/mirror  https://review.openstack.org/52614719:02
*** sshnaidm|rover is now known as sshnaidm|afk19:02
*** oidgar has quit IRC19:04
*** gbarros has quit IRC19:05
*** nyechiel has quit IRC19:06
SlowerEmilienM: so dan says he wrote those parameters and we can just add them to tripleo-common19:09
EmilienMSlower: in tripleoclient you mean?19:09
SlowerEmilienM: dan says we should use 'danny' instead of 'janky' now.. :)19:09
EmilienMand generate them beside NovaPassword, etc?19:09
SlowerEmilienM: in tripleo-common constants19:10
openstackgerritAde Lee proposed openstack/tripleo-heat-templates master: Add parameters for Barbican keystone listener  https://review.openstack.org/52574119:10
openstackgerritAde Lee proposed openstack/tripleo-heat-templates master: Add parameters for Barbican worker image  https://review.openstack.org/52574219:10
EmilienMyeah ok19:10
EmilienMSlower: I'll do it19:10
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638319:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663419:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged]19:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)19:10
EmilienMthanks danny19:10
Slowergood thing I didn't say dprince so as to alert dan..19:10
*** hjensas has quit IRC19:13
*** leitan has joined #tripleo19:14
trozetdoes anyone know what step certmonger runs to generate certificates/keys for each service?19:16
*** pkovar has quit IRC19:19
EmilienMSlower, dprince : please review this bug report and comment if I said something wrong https://bugs.launchpad.net/tripleo/+bug/173677919:20
openstackLaunchpad bug 1736779 in tripleo "undercloud-container: deployment isn't idempotent because of passwords" [High,Triaged]19:20
aleeEmilienM, I think I have glance image signing working -- https://review.openstack.org/524064  -- trying to see where in the logs it shows that the image signing test has run ..19:21
EmilienMalee: http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/tempest.html.gz19:21
EmilienMI don't see it19:21
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346319:23
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles  https://review.openstack.org/50983219:23
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow  https://review.openstack.org/51504519:23
*** rhallisey has quit IRC19:24
*** rhallisey has joined #tripleo19:25
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Configure undercloud docker registry/mirror  https://review.openstack.org/52614719:28
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Manage MysqlRootPassword in constants  https://review.openstack.org/52615119:28
*** gbarros has joined #tripleo19:30
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: constants: remove SERVICE_LIST (unused)  https://review.openstack.org/52615219:31
aleeEmilienM, interesting - am I setting the test to run in the wrong place?19:31
EmilienMalee: it should be the right place19:31
EmilienMalee: I'll dig a bit into it in a bit19:31
EmilienMSlower: can you put https://bugs.launchpad.net/tripleo/+bug/1736779 in the TODO when you write your code? thanks19:32
openstackLaunchpad bug 1736779 in tripleo "undercloud-container: deployment isn't idempotent because of passwords" [High,Triaged]19:32
EmilienMalee: I'm wondering if the plugin is well deployed etc19:32
EmilienMalee: I would ask help from chandankumar / arxcruz, our tempest gurus19:33
aleeEmilienM, thanks - whats interesting is that I see that the telemetry test is run even though it is commented out19:33
aleechandankumar, arxcruz ^^19:33
weshayalee, where?19:35
*** moshele has joined #tripleo19:35
aleeweshay, https://review.openstack.org/52406419:35
weshayhttps://review.openstack.org/#/c/524064/19:35
aleeweshay, here is the report -- http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/tempest.html.gz19:36
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove MysqlRootPassword from overcloud.yaml  https://review.openstack.org/52615519:36
EmilienMSlower: see https://review.openstack.org/#/q/topic:bug/1736779 - I'm not sure upgrades will work though, I'll ask for some help19:36
EmilienMalee: have you check tempest logs?19:37
openstackgerritIan Main proposed openstack/tripleo-common master: Generate MysqlRootPassword and RabbitCookie  https://review.openstack.org/52615619:37
EmilienMhttp://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2017-12-06_18_37_2319:37
EmilienMalee: see http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2017-12-06_18_37_2719:38
EmilienMthe plugin is loaded19:39
EmilienM2017-12-06 18:37:23 | barbican_tempest_plugin.tests.scenario.test_volume_encryption.VolumeEncryptionTest.test_encrypted_cinder_volumes_cryptsetup[compute,id-cbc752ed-b716-4727-910f-956ccf965723,image,volume]19:39
EmilienMthe test is found but not executed, ignored19:39
EmilienMit's a whitelist issue19:39
EmilienMoh, see http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/undercloud/home/zuul/tempest/etc/tempest.conf.txt.gz19:39
EmilienMbarbican isn't enabled19:39
EmilienMthat's probably why19:39
*** lblanchard has joined #tripleo19:39
SlowerEmilienM: doh, I just did the same fix :)19:39
SlowerEmilienM: where's RabbitCookie in the first patch?19:39
SlowerEmilienM: also I don't think we need to touch tripleo-heat-templates19:40
SlowerEmilienM: we may be making updates harder?19:40
EmilienMSlower: ah, sorry I thought I said I would do the work19:40
EmilienMSlower: please abandon yours, mine updates tests as well and I'm just doing mysql now19:40
EmilienMSlower: I'll take care of it, do your workaround for now it's fine19:40
SlowerEmilienM: ok19:40
EmilienMSlower: if we don't, I'm afraid there is a parameter collision19:41
EmilienMSlower: we need to stop using the Randomstring thing in THT19:41
SlowerEmilienM: mmm, I could use your patch directly if you added teh rabbitcookie..19:42
Slowerbecause.. COOKIES!! mmmm19:42
EmilienMSlower: there is more than rabbit19:42
EmilienMlol19:42
EmilienMSlower: rabbit is fine, you can regenerate a cookie, there is no HA19:42
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials  https://review.openstack.org/52606219:42
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609019:42
EmilienMSlower: on the undercloud19:42
SlowerEmilienM: well there may be soon19:42
EmilienMSlower: so for now, mysql is only required19:42
Slowerthat's next on the list :)19:43
Slowerfor tls support19:43
EmilienMSlower: I just want to see if this password transition can work19:43
EmilienMSlower: if that work I'll do rabbit19:43
EmilienMSlower: also for rabbit, there are some password constraint19:43
EmilienMit's a cookie, not a password, there is a format etc19:43
Sloweryeah19:44
Slowerthat's not too hard really tho19:44
EmilienM(lenght is 20)19:44
EmilienMindeed, easy19:44
aleeEmilienM, cool - where do I set that?19:44
dprinceEmilienM: I think removing the Mysql heat randomstring resource could break upgrades?19:44
EmilienMalee: probably in python-tempestconf19:45
EmilienMdprince: yeah that's what I said19:45
EmilienMdprince: but I don't know if we have the choice19:45
dprinceEmilienM: it needs to be exactly the same string. otherwise resouces would get bounced19:45
EmilienMdprince: the other alternative is to create a new parameter19:45
dprinceEmilienM: I left it in a long time ago for this reason. The choice is leave it along19:45
dprinceEmilienM: another parameter? There is already a way to override19:45
EmilienMdprince: but if we don't patch THT, we'll have 2 same parameters, right?19:46
EmilienMoh ok I see now19:46
dprinceEmilienM: there have been 2 parameters for some time.19:46
EmilienMso you mean we can abandon my patch in THT and just override in constants19:46
EmilienMin tripleo-common19:46
EmilienM?19:46
dprinceEmilienM: one is automatically generated, and the second is to allow the end user to set it19:46
dprinceEmilienM: Ian's patch to tripleo-common should be all we need I think19:46
dprinceEmilienM: or your patch. either way19:47
EmilienMdprince: yah, I have the same patch19:47
EmilienMyeah19:47
EmilienMok19:47
EmilienMgotcha, i'll abandon the THT19:47
EmilienMdone19:47
EmilienMin that case, let me do them all in one shot19:47
EmilienMSlower: ^19:47
EmilienMalee: I'll look at your bug in a few but please take a look at tempestconf tool19:48
EmilienMit's somewhere in there19:48
aleeEmilienM, thanks.  I'll looking at that repo now -- looking to see where its invoked19:48
dprinceEmilienM: one big blocker for the containerized Undercloud is the lack of the docker-registry19:50
mwhahahadtantsur|afk: fyi i created the rocky milestones19:50
dprinceEmilienM: https://review.openstack.org/#/c/526147/ and aslo that has 3 depends-on patches too :/19:50
dprinceEmilienM: I'm hitting an issue locally... but getting close19:50
aleeweshay, do you know where its invoked?19:50
EmilienMdprince: I'll help in review. Let me know if there is anything more I can help with.19:50
*** rwsu has quit IRC19:51
dprinceEmilienM mwhahaha: actually both of your take on this matter would be helpful https://review.openstack.org/#/c/525761/19:51
dprincewe've done some very sloppy puppet work around docker stuff in the past19:52
dprinceI could just create a new docker_registry_new.pp. But other than that I don't think there is a good way to deprecate what I need to remove there19:52
mwhahahai thought with puppet-tripleo we didn't really have to deprecate it19:52
mwhahahabecause it was matching with THT19:52
SlowerEmilienM: ok cool19:53
SlowerEmilienM: you're right that we should do a 20 char string for rabbitcookie19:53
EmilienMyeah i'm doing it no worries19:53
dprincemwhahaha: I was happy to just remove it :). But did mention the lack of a good deprecation option in the commit message19:53
SlowerEmilienM: I realize my hack in python-tripleoclient won't work19:53
SlowerEmilienM: oh no it would19:53
Slowernm :)19:54
EmilienMSlower: -_-^?19:54
EmilienMmy face ^19:54
mwhahahadprince: yea i don't know if we need a deprecation specifically because in the past we've assumed matching THT and puppet-tripleo. but that's gotten us in a bad spot19:54
Slowerhaha19:54
*** Sandy619 has joined #tripleo19:56
sshnaidm|afkmwhahaha, how should we revisit admins for tripeo-ci-admins? If everybody agree, maybe not worth to revert this patch?19:58
dprincemwhahaha: okay. sounds like you agree w/ me. Maybe I'll just try to talk Bogdon down from his -1 tomorrow then19:59
mwhahahadprince: yea unless we plan on backporting it19:59
*** leitan has quit IRC19:59
mwhahahasshnaidm|afk: it's a process thing, it got bypassed so lets turn around and do it right19:59
*** leitan has joined #tripleo19:59
mwhahahasshnaidm|afk: if it's not an issue with everyone, it should be no big deal to do it right19:59
*** dhill|food has quit IRC20:01
*** dhill_ has joined #tripleo20:02
openstackgerritSteve Baker proposed openstack/tripleo-common master: Concurrent upload container images  https://review.openstack.org/52205520:02
*** leitan has quit IRC20:04
aleeEmilienM, found it with help from weshay -- I typoed the test name20:04
aleeEmilienM, resubmitting ..20:04
EmilienMalee: haha!20:07
EmilienMalee: I like IPA beers btw.20:07
aleeEmilienM, absolutely - ditto for weshay :)20:07
sshnaidm|afkmandre, why could I miss images from containers.yaml?20:08
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173638320:10
openstackLaunchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663420:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)20:10
*** abregman has joined #tripleo20:12
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Manage legacy OS::TripleO::RandomString resources in constants  https://review.openstack.org/52615120:12
EmilienMSlower: ready for review ^20:12
*** gkadam has quit IRC20:14
openstackgerritAde Lee proposed openstack/tripleo-quickstart master: Add image signing tests with barbican  https://review.openstack.org/52406420:18
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609020:19
*** dprince has quit IRC20:21
*** safchain has quit IRC20:24
*** safchain has joined #tripleo20:26
*** salmankhan has joined #tripleo20:29
*** radeks has joined #tripleo20:29
*** pchavva has quit IRC20:31
*** dtantsur|afk has quit IRC20:31
*** brault has quit IRC20:31
*** fultonj has quit IRC20:31
*** mhenkel has quit IRC20:31
*** cinerama` has quit IRC20:31
*** Lokesh_Jain__ has quit IRC20:31
*** Tyrantelf_ has quit IRC20:31
*** moshele has quit IRC20:31
*** rbrady has quit IRC20:31
*** arxcruz has quit IRC20:31
*** salmankhan has quit IRC20:33
*** rbowen has quit IRC20:37
*** rbowen has joined #tripleo20:37
*** itlinux has quit IRC20:40
aleetdasilva, looking through your patches/email now .. will respond shortly20:43
tdasilvaalee: thanks!20:43
openstackgerritAndy Smith proposed openstack/tripleo-heat-templates master: Support separate oslo.messaging services for RPC and Notification  https://review.openstack.org/50796320:45
*** pchavva has joined #tripleo20:47
*** dtantsur|afk has joined #tripleo20:47
*** brault has joined #tripleo20:47
*** fultonj has joined #tripleo20:47
*** mhenkel has joined #tripleo20:47
*** cinerama` has joined #tripleo20:47
*** Lokesh_Jain__ has joined #tripleo20:47
*** Tyrantelf_ has joined #tripleo20:47
*** moshele has joined #tripleo20:47
*** rbrady has joined #tripleo20:47
*** arxcruz has joined #tripleo20:47
*** moshele has quit IRC20:51
*** jmelvin has quit IRC20:52
*** itlinux has joined #tripleo20:53
*** jkilpatr has quit IRC20:54
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Install SSH keys of admnins on RH clouds  https://review.openstack.org/52618720:55
*** nyechiel has joined #tripleo20:56
*** tongl has quit IRC20:56
*** gvrangan has joined #tripleo20:57
*** liverpooler has quit IRC21:02
openstackgerritAlex Schultz proposed openstack/tripleo-upgrade master: Setup tox  https://review.openstack.org/52567621:02
aleetdasilva, so -- just as a clarification - the root key that you are trying to store -- this is something that is not tenant specific , right?21:02
tdasilvaalee: correct21:02
aleetdasilva, that is -- there is some initialization code in swift that reads it using the username/password of the swift user?21:03
aleetdasilva, are there encryption keys that are generated from this root key that are tenant specific?21:04
tdasilvaalee: IIRC, from the root key, swift generates a container key and an object key21:05
*** tongl has joined #tripleo21:05
aleetdasilva, and these keys are stored somewhere -- or just regenerated every time?21:06
alee(based on a container/object id)21:06
tdasilvaalee: they are generated everytime21:06
tdasilvaalee: correct21:06
tdasilvahttps://docs.openstack.org/swift/latest/overview_encryption.html#key-management21:06
aleetdasilva, ok - and in all cases, you  are using castellan to get the root key?21:08
tdasilvaalee: yes, correct21:08
aleetdasilva, ok - I'll respond to the email ..21:08
tdasilvaalee: thanks, i hope this makes sense... :)21:09
aleetdasilva, it does definitely21:09
*** kambiz has quit IRC21:09
*** yamahata has joined #tripleo21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663421:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)21:10
tdasilvaswift took a phased approach to enabling encryption in swift...we started with a root_key and derived objects keys from the root_key. The plan is that in the future we would have per tenant or per container keys21:10
tdasilvaor even a BYOK/per object key21:10
tdasilvaalee: ^21:10
*** dparkes has joined #tripleo21:11
aleetdasilva, sure that makes sense21:11
aleetdasilva, so that means that eventually the root key will no longer be used?21:12
*** kambiz has joined #tripleo21:12
*** itlinux has quit IRC21:13
tdasilvaalee: that seems like a good assumption, but honestly, i don't know, I think that's an implementation detail of how we would migrate from a root_key to tenant/container key21:13
aleetdasilva, yeah21:14
*** nyechiel has quit IRC21:15
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Save oooq generated files  https://review.openstack.org/51713621:15
*** rhallisey has quit IRC21:15
tbarrondsneddon: need some advice on how to make progress on StorageNFS network when you have a chance (I'm picking up this work from jprovazn)21:15
tdasilvaalee: honestly, i think the real challenge is how we would go about re-keying possibly billions/trillions of objects21:15
aleetdasilva, you might be able to do it in a background job or on demand perhaps21:16
aleetdasilva, but I understand that swift is sensitive to performance impacts21:17
tdasilvaalee: yeah, i imagine it would have to be as a background job directly on storage nodes in a distributed as possible way :)21:17
tdasilvaalee: but i'm just guessing at this point21:18
dsneddontbarron, Sure, how can I help?21:18
aleetdasilva, yup21:18
tbarrondsneddon: thanks21:18
tbarrondsneddon: Our remaining ceph-nfs patches depend on https://review.openstack.org/#/c/51223921:18
tbarrondsneddon: Starting at PS4 with that review overclod deploy fails with: Unknown Property StorageNFSIpSubnet21:18
tbarrondsneddon: Backing off to PS3, the overcloud deploy succeeds, but presumably there were good reasons we21:18
tbarrondsneddon: didn't just merge PS3.21:18
tbarrondsneddon: Would appreciate your help figuring how to make progress.21:18
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Render NIC config templates with jinja2  https://review.openstack.org/52363821:18
tbarrondsneddon: you can advise in the review rather than real-time atm if you prefer21:19
dsneddontbarron, I think you need this patch: https://review.openstack.org/52363821:19
dsneddontbarron, I'm going to wrap that up within the hour, and you can try adding a depends-on21:19
tbarrondsneddon: awesome, that sounds like a plan!21:20
*** dparkes has quit IRC21:20
*** hjensas has joined #tripleo21:21
*** hjensas has quit IRC21:21
*** hjensas has joined #tripleo21:21
* tbarron enjoys getting a 3000+ line depends-on unexpectedly21:21
mwhahahadepends-on: teh world21:21
tbarronmwhahaha: well, it's kinda M2 still :D21:22
mwhahaha:D21:22
mwhahahai figured the m2 window is probably going to bleed into next week21:22
*** radeks has quit IRC21:26
*** itlinux has joined #tripleo21:26
*** yamahata has quit IRC21:27
*** pchavva has quit IRC21:30
*** raildo has quit IRC21:31
slagleEmilienM: doing some testing with vanilla centos cloud images. looking pretty good when using the tripleo-bootstrap role :)21:33
*** ansmith has quit IRC21:35
*** holser has joined #tripleo21:38
*** lblanchard has quit IRC21:38
*** openstackgerrit has quit IRC21:38
*** sai has quit IRC21:38
*** sshnaidm|afk has quit IRC21:38
*** sri_ has quit IRC21:38
*** lyarwood has quit IRC21:38
*** mburned has quit IRC21:38
*** timothyb89 has quit IRC21:38
*** mandre has quit IRC21:38
*** lifeless has quit IRC21:38
*** leifmadsen has quit IRC21:38
*** afazekas has quit IRC21:38
*** sc has quit IRC21:38
beaglesEmilienM, mwhahaha: https://review.openstack.org/#/c/526062/ and https://review.openstack.org/#/c/526060/ seem to be doing their job in testing21:39
beaglesas is https://review.openstack.org/#/c/526087/21:39
mwhahahaok i'll take a look21:39
*** iranzo|AFK is now known as iranzo21:40
*** iranzo has quit IRC21:41
*** liverpooler has joined #tripleo21:44
EmilienMbeagles: ack21:44
mwhahahabeagles: is it supposed to be the admin project?21:44
mwhahahabeagles: i thought we put all of our users in the service project21:44
*** hjensas has quit IRC21:45
EmilienMmwhahaha: I'm wondering if we should increase the timeout value for ovb jobs (now we have control on it with zuul v3)21:47
EmilienMput it to 3h maybe21:47
mwhahahaEmilienM: sneaky21:47
EmilienMwait it's 3h already21:48
EmilienMdamn21:48
mwhahahano i thought it was 2:3021:48
EmilienM10800 seconds21:48
mwhahahathe task itself is 3hours21:48
*** jmelvin has joined #tripleo21:48
mwhahahaah21:48
EmilienMI think the timeout comes from the promotion21:48
mwhahahabut in our code we limit it i thought21:48
EmilienMwe haven't changed anything except running tempest21:49
EmilienMbut I checked it doesn't change much21:49
beaglesmwhahaha, we do, but this has something to do with service-to-service comms21:49
mwhahahabeagles: commented on https://review.openstack.org/#/c/526062/ because i'm not sure if that's the right auth info21:49
EmilienMah in our code, right21:49
mwhahahabeagles: shouldn't service-to-service use the service user 'octavia'?21:49
beaglesmwhahaha, that's cool. I'll bring it up with nmagnezi in the mornig21:49
mwhahahaEmilienM: we do that because collect-logging is not a seperate playbook21:50
mwhahahaEmilienM: which it could be if we could stop using devstack stuff21:50
EmilienMyeah21:51
EmilienMif we would run collect-logs role outside of "run" but in "post"21:52
EmilienMthing that Sagi and I were working ont21:52
EmilienMthis: https://review.openstack.org/#/c/522554/21:53
mwhahahayea that thing21:55
beaglesmwhahaha, the devstack plugin (just sets to admin and is questionable reference anyways) and documentation is of little guidance so seeking confirmation in #openstack-lbaas21:56
mwhahahabeagles: yea it's likely that doesn't match what tripleo uses as we setup accounts for each service with different creds21:57
mwhahahabeagles: so most likely this needs to match the octavia service creds which we create via octavia::keystone::auth21:57
*** gfidente has quit IRC21:57
*** itlinux has quit IRC21:59
*** leitan has joined #tripleo22:00
beaglesmwhahaha, k will update22:01
*** openstackgerrit has joined #tripleo22:01
*** sai has joined #tripleo22:01
*** sshnaidm|afk has joined #tripleo22:01
*** sri_ has joined #tripleo22:01
*** lyarwood has joined #tripleo22:01
*** mburned has joined #tripleo22:01
*** timothyb89 has joined #tripleo22:01
*** mandre has joined #tripleo22:01
*** lifeless has joined #tripleo22:01
*** leifmadsen has joined #tripleo22:01
*** afazekas has joined #tripleo22:01
*** sc has joined #tripleo22:01
*** rcernin has joined #tripleo22:01
beaglesmwhahaha, got some agreement from the lbaas crowd as well, if the octavia creds don't work then we probably need to have done something different with that user22:02
mwhahahabeagles: i mean you could in theory create a seperate user and use that too so it's more about what exactly this is for :) in the past we traditionally use the service accounts for these types of setup22:03
beaglesmwhahaha, it's for talking to neutron and nova22:03
beaglesIIUC22:03
openstackgerritMichael Turek proposed openstack/diskimage-builder master: Remove architecture rules on lshw dependency in ironic-agent  https://review.openstack.org/52621222:03
*** rcernin has quit IRC22:03
*** rcernin has joined #tripleo22:03
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add dry-run or list-tasks to quickstart.sh  https://review.openstack.org/52620822:03
mwhahaharight so the octavia user should work22:03
beaglesack22:04
mwhahahakinda like for keystone auth for all the services22:04
*** leitan has quit IRC22:05
*** gvrangan has quit IRC22:06
dsneddontbarron, You should be able to add the depends-on now. Fingers crossed.22:07
dsneddontbarron, One thing to note is that this change will be breaking in the sense that if someone upgrades and uses old NIC config templates, they will either need to add the StorageNFSIpSubnet, or remove the StorageNFS network from the network_data.yaml22:08
dsneddontbarron, So I wonder if you will have a cascading effect where CI starts failing as the patch moves downstream, and CI environments need to be modified?22:09
tbarrondsneddon: thanks.22:09
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials  https://review.openstack.org/52606222:10
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663422:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)22:10
*** moshele has joined #tripleo22:10
tbarrondsneddon: are you saying this would affect only folks who have already deloyed StorageNFS net by one means or another, or also people running traditional isolated networks w/o any StorageNFS network defined?22:10
tbarrondsneddon: If the former, I'm not concerned since we don't have that in production.22:10
tbarrondsneddon: some devs will need to adjust, that's all.22:11
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609022:11
dsneddontbarron, Actually, since the network is disabled by default, I think it'll be fine.22:12
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation  https://review.openstack.org/52621322:12
tbarrondsneddon: ack22:12
*** shadower has quit IRC22:12
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha  https://review.openstack.org/51223922:13
*** shadower has joined #tripleo22:13
openstackgerritmathieu bultel proposed openstack/tripleo-common master: WIP -- Add extra environment files for the update  https://review.openstack.org/52621422:13
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Add support for ceph-nfs manila backend  https://review.openstack.org/47124522:14
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible  https://review.openstack.org/51224022:14
dsneddontbarron, It does make me realize that I'm going to have to change my patch to check whether the network is enabled, however.22:17
*** jlabarre has quit IRC22:19
*** tosky has joined #tripleo22:19
tbarrondsneddon: ack22:20
openstackgerritMerged openstack/tripleo-quickstart-extras master: Update the Docker registry defaults to rdoproject  https://review.openstack.org/52020122:20
openstackgerritMerged openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role  https://review.openstack.org/52528522:20
openstackgerritMerged openstack/tripleo-common master: Implement post-upload cleanup of docker images  https://review.openstack.org/51920122:20
*** jkilpatr has joined #tripleo22:20
*** dparkes has joined #tripleo22:20
tbarrondsneddon: is StorageNFS net the first post-child composable network?22:20
dsneddontbarron, Yes22:21
*** vpickard is now known as vpickard_22:21
dsneddontbarron, Sorry for making you the guinea pig22:21
tbarrondsneddon: well, we'll embrace the opportunity then22:22
*** abishop has quit IRC22:24
mwhahahas/opportunity/pain and suffering22:24
*** BryanS68 has quit IRC22:24
tbarronmwhahaha: well, the first love is the hardest22:26
mwhahaha:D22:26
openstackgerritAlex Schultz proposed openstack/tripleo-upgrade master: Update .gitreview.  https://review.openstack.org/52414222:28
*** holser has quit IRC22:28
*** ebarrera has joined #tripleo22:28
mwhahahaspeaking of entertainment22:29
tbarronwhat seemed like a straightforward feature has ended up depending on a) ceph ansible (with patches still not in 3.0, b) ceph luminous, c) ganesha stuff still in master, and d) composable networks.  It was allegedly a Storage feature.22:29
tbarron?22:29
mwhahahai'm enjoying the integrated ci queue is 12 hours behind22:29
mwhahahanothing is straight forward these days22:29
openstackgerritmathieu bultel proposed openstack/tripleo-common master: WIP -- Add extra environment files for the update  https://review.openstack.org/52621422:30
mwhahahaslagle: looks like we got a failure in the gate around the config-download bits http://logs.openstack.org/91/525291/2/gate/tripleo-ci-centos-7-containers-multinode/7507f49/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-06_21_37_1222:31
*** zshi has quit IRC22:31
mwhahahaEmilienM: -^22:31
*** ansmith has joined #tripleo22:31
mwhahahaalso scenario004 looks unhappy in the gate myoung|ruck, weshay22:32
* mwhahaha is looking for logs22:32
* weshay looks22:32
weshaythanks22:32
mwhahahagot two fails http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/ and http://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/22:33
* myoung|ruck is also looking22:33
mwhahahagithub.com resolution failure22:34
mwhahahahttp://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/job-output.txt.gz#_2017-12-06_22_15_48_63618622:34
mwhahahadmsimard: -^22:34
dmsimardmwhahaha: looking22:34
mwhahahaand vxlan setup failure http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/job-output.txt.gz#_2017-12-06_19_58_46_55332422:34
mwhahahadmsimard, pabelanger -^22:35
dmsimardno clue what's that vxlan thing though22:35
dmsimardhm, github's not in the cache http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/logs/dns_cache.txt.gz22:37
dmsimardmwhahaha: which node is that happening on ?22:38
mwhahahadmsimard: primary22:38
mwhahahadmsimard: that's in the undercloud setup22:38
dmsimardmwhahaha: there's something wrong because we set up the cache TTL configuration here: http://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/ara/result/46777a55-55d9-47e8-bb6c-441369fe0076/22:40
dmsimardyet there's nothing there:22:41
dmsimardhttp://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/logs/subnode-2/etc/unbound/conf.d/22:41
dmsimardhttp://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/logs/undercloud/etc/unbound/conf.d/22:41
dmsimardhave to step away for a bit22:42
*** Goneri has quit IRC22:43
mwhahahadmsimard: ssure just fyi22:43
weshaymwhahaha, an infra mirror had a hiccup http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/logs/undercloud/home/zuul/vxlan_networking.sh.log.txt.gz#_2017-12-06_19_58_4322:44
mwhahahainteresting22:45
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation  https://review.openstack.org/52621322:45
weshayhrm.. this is a bug I started working on last week http://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/job-output.txt.gz#_2017-12-06_22_15_45_98617022:48
myoung|ruckI realize there's probably a lot of backstory here, but do we have doc'd anywhere I can RTFM how proxy / squid / ____ is set up in nodepool to hit github/other?22:49
mwhahahait's magic22:50
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add ironic-inspector to containerized undercloud  https://review.openstack.org/52416322:50
openstackgerritMerged openstack/tripleo-heat-templates master: undercloud: enable ansible deploy method by default  https://review.openstack.org/52309422:50
openstackgerritMerged openstack/tripleo-heat-templates master: SR-IOV agent: allow to configure agent extensions  https://review.openstack.org/52495622:50
mwhahahamyoung|ruck: https://docs.openstack.org/infra/system-config/afs.html some history on it22:51
mwhahahamyoung|ruck: so we've got specific mirrors setup for like rdo and such so we have to config them to be used in oooq22:52
openstackgerritMerged openstack/tripleo-heat-templates master: Add IPSEC composable service  https://review.openstack.org/52186322:53
openstackgerritMerged openstack-infra/tripleo-ci master: Allow running toci_gate_test on pre-provisioned ovb env  https://review.openstack.org/51874822:53
openstackgerritMerged openstack/instack-undercloud master: Fix wrong path in ssh selinux issue detection.  https://review.openstack.org/52591122:53
openstackgerritMerged openstack/python-tripleoclient master: Remove default for --overcloud-ssh-key  https://review.openstack.org/52577922:53
openstackgerritMerged openstack/tripleo-quickstart-extras master: Do not send email when logs are not available  https://review.openstack.org/52602422:53
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add log to validate ipmi role  https://review.openstack.org/49211722:53
*** pmannidi has joined #tripleo22:53
mwhahahamyoung|ruck: and we do the mirror configs in the repo setup https://github.com/openstack/tripleo-quickstart/blob/143d08315868aedacb11cc905fdd2ffdd4388e2e/config/release/tripleo-ci/master.yml#L2422:55
mwhahahaas well as in https://github.com/openstack-infra/tripleo-ci/blob/f649369a329a282f4b6ce2abf065116964e79d99/toci_gate_test-oooq.sh#L1922:55
weshaymyoung|ruck, can you please add this info to the ruck doc22:56
mwhahahain infra folks probably have more specifics on the mirror stuff if you have further questions22:57
*** ebarrera has quit IRC22:58
*** fpan has joined #tripleo22:59
*** ebarrera has joined #tripleo22:59
myoung|ruckmwhahaha: thx, reading.  weshay: yerp...already on it22:59
weshayhttps://review.openstack.org/#/c/498766/22:59
weshayhttps://review.openstack.org/#/c/517776/22:59
*** akrivoka has quit IRC23:00
*** jmelvin has quit IRC23:00
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260723:04
weshaypabelanger, can we get one of the two elastic-recheck queries reviewed when you have a sec please ^23:06
mwhahahafirst is abandoned23:06
weshayah it is23:07
weshaymwhahaha, I'll pick this back up in a bit, have to take my kid to $activity23:07
mwhahahapesky $activity23:08
weshaythe activities are fine... pesky kids!23:08
mwhahahaalso this23:08
mwhahahait's cold outside, don't forget to wear a hat :D23:08
myoung|ruckLOL23:08
weshay:)23:08
myoung|rucki need to go as well.  the little urchins want...i dunno...food and stuff23:09
* myoung|ruck rolls his eyes and smirks23:09
mwhahahathey do like being fed23:09
myoung|ruckthey've threatened to eat us if we don't toe the line and do $foodPrep23:09
mwhahaha"i'm hungry" ... "and?"23:09
mwhahahasudo make me a sandwich23:10
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663423:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)23:10
openstackgerritSteve Baker proposed openstack/tripleo-common master: Concurrent upload container images  https://review.openstack.org/52205523:13
openstackgerritSteve Baker proposed openstack/tripleo-common master: Concurrent upload container images  https://review.openstack.org/52205523:14
*** ebarrera has quit IRC23:17
*** ebarrera has joined #tripleo23:21
*** Sandy619 has quit IRC23:25
*** openstack has joined #tripleo23:28
*** ChanServ sets mode: +o openstack23:28
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates stable/pike: SR-IOV agent: allow to configure agent extensions  https://review.openstack.org/52622223:35
*** moshele has quit IRC23:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!