Thursday, 2017-01-19

bnemecgfidente: Unfortunately I think the mirror server is private only: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack_ovb.sh#n9400:00
bnemecI could be wrong though.  Let me check.00:00
bnemecgfidente: Good news, it has a fip: http://66.187.229.139/builds/current-tripleo/00:01
gfidentehey cool, thanks!00:01
gfidentebnemec oh the module is loaded00:04
*** david-lyle has quit IRC00:05
bnemecgfidente: I need to take off.  Hopefully the promote job will fix this, but if not I'll revisit in the morning.00:08
gfidentebnemec thanks for helping00:09
gfidenteI am running a bit short of ideas and it's late here as well00:09
Ngmwhahaha: so given 422218 existing and being worked on, does that mean 390396 can move ahead? :)00:09
mwhahahaNg: maybe :D00:09
NgI'll take maybe, maybe is better than no!00:10
*** dmarlin has quit IRC00:10
*** jkilpatr has joined #tripleo00:10
Ngmwhahaha: thanks :)00:10
Ngso now I need to hassle the other core :D00:11
*** ooolpbot has joined #tripleo00:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756200:11
*** ooolpbot has quit IRC00:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]00:11
*** owalsh is now known as owalsh-afk00:11
openstackgerritHonza Pokorny proposed openstack/tripleo-specs: Add gui logging spec  https://review.openstack.org/39513800:26
*** dsneddon_afk has quit IRC00:30
openstackgerritChris Jones proposed openstack/tripleo-common: Add action for generating fencing parameters.  https://review.openstack.org/42232100:36
openstackgerritChris Jones proposed openstack/python-tripleoclient: Add baremetal_overcloud.GenerateFencing  https://review.openstack.org/41789800:39
*** gfidente has quit IRC00:46
*** bana_k has quit IRC00:51
*** b00tcat has quit IRC01:00
*** ooolpbot has joined #tripleo01:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756201:11
*** ooolpbot has quit IRC01:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]01:11
*** limao has joined #tripleo01:11
openstackgerritMerged openstack/instack-undercloud: Remove store events setting  https://review.openstack.org/42218401:17
*** lblanchard has joined #tripleo01:18
*** saneax is now known as saneax-_-|AFK01:33
*** dsneddon has quit IRC01:36
*** tzumainn has quit IRC01:36
*** sdake has quit IRC01:38
openstackgerritMerged openstack/puppet-pacemaker: Add support for fence_ironic fencing agent.  https://review.openstack.org/39039601:40
*** rhallisey has quit IRC02:09
*** ooolpbot has joined #tripleo02:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756202:11
*** ooolpbot has quit IRC02:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]02:11
*** cwolferh has quit IRC02:17
*** ipsecguy_ has joined #tripleo02:18
*** ipsecguy has quit IRC02:19
*** links has joined #tripleo02:33
*** zoliXXL has joined #tripleo02:40
*** jayg|g0n` has joined #tripleo02:41
*** jkilpatr has quit IRC02:41
*** eggmaster has quit IRC02:41
*** zoli|gone has quit IRC02:41
*** dtrainor has quit IRC02:41
*** jayg|g0n3 has quit IRC02:41
*** vkmc has quit IRC02:41
*** saneax-_-|AFK has quit IRC02:41
*** tbarron has quit IRC02:41
*** fzdarsky_ has joined #tripleo02:45
*** dtrainor has joined #tripleo02:49
*** fzdarsky has quit IRC02:49
*** jkilpatr has joined #tripleo02:50
*** bkopilov_ has quit IRC02:50
*** bkopilov has quit IRC02:51
*** lblanchard has quit IRC02:51
*** lblanchard has joined #tripleo02:51
*** lblanchard has quit IRC02:52
*** sdake has joined #tripleo02:54
*** jbcraig has joined #tripleo02:55
*** thrash is now known as thrash|g0ne02:57
*** cwolferh has joined #tripleo02:59
*** tbarron has joined #tripleo03:02
*** vkmc has joined #tripleo03:06
*** saneax-_-|AFK has joined #tripleo03:10
*** ooolpbot has joined #tripleo03:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756203:11
*** ooolpbot has quit IRC03:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]03:11
*** sdake has quit IRC03:13
*** sdake has joined #tripleo03:15
*** yamahata has quit IRC03:24
*** rcrit has joined #tripleo03:25
*** ramishra has joined #tripleo03:25
rcritmy undercloud is failing to install, pulled from master this morning03:25
rcritfails in neutron-db-manage03:25
rcritoslo_db.exception.DBError: (pymysql.err.InternalError) (1060, u"Duplicate column name 'standard_attr_id'") [SQL: u'ALTER TABLE networksegments ADD COLUMN standard_attr_id BIGINT']03:26
*** psahoo has joined #tripleo03:49
*** cwolferh has quit IRC03:50
*** dmacpher has quit IRC03:55
*** sdake has quit IRC04:06
*** sdake has joined #tripleo04:07
*** sudipto_ has joined #tripleo04:07
*** sudipto has joined #tripleo04:07
*** dmacpher has joined #tripleo04:09
*** jerrygb has quit IRC04:10
*** ooolpbot has joined #tripleo04:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756204:11
*** ooolpbot has quit IRC04:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]04:11
*** bana_k has joined #tripleo04:11
*** gkadam has joined #tripleo04:12
*** bkopilov has joined #tripleo04:14
*** bkopilov_ has joined #tripleo04:14
openstackgerritKeith Schincke proposed openstack-infra/tripleo-ci: [NO MERGE] Meant to see if the ceph-selinux moduled is loaded  https://review.openstack.org/42222604:20
*** limao has quit IRC04:30
*** limao has joined #tripleo04:30
*** tbonds has quit IRC04:31
*** bana_k has quit IRC04:32
*** absubram has joined #tripleo04:33
*** limao has quit IRC04:35
*** sudipto_ has quit IRC04:49
*** sudipto has quit IRC04:49
*** sdake_ has joined #tripleo04:57
openstackgerritFeng Pan proposed openstack/puppet-tripleo: Adds etcd  https://review.openstack.org/41473004:58
*** sdake has quit IRC04:59
openstackgerritFeng Pan proposed openstack/tripleo-heat-templates: Adds etcd composable service  https://review.openstack.org/41475105:00
*** absubram has quit IRC05:03
*** cwolferh has joined #tripleo05:10
*** jerrygb has joined #tripleo05:10
*** ooolpbot has joined #tripleo05:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756205:11
*** ooolpbot has quit IRC05:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]05:11
*** prateek has joined #tripleo05:14
*** limao has joined #tripleo05:15
*** jerrygb has quit IRC05:15
*** prateek has quit IRC05:17
*** prateek has joined #tripleo05:18
*** saneax-_-|AFK is now known as saneax05:24
*** sudipto has joined #tripleo05:27
*** sudipto_ has joined #tripleo05:27
*** udesale has joined #tripleo05:31
openstackgerritSaravanan KR proposed openstack/python-tripleoclient: Provide an option to disable password generation on deployment  https://review.openstack.org/41444705:44
*** sdake_ has quit IRC05:47
*** masco has joined #tripleo05:54
*** skramaja has joined #tripleo05:58
*** pgadiya has joined #tripleo06:00
*** limao has quit IRC06:05
*** limao_ has joined #tripleo06:05
*** ooolpbot has joined #tripleo06:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756206:11
*** ooolpbot has quit IRC06:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]06:11
*** agurenko has joined #tripleo06:16
*** dmacpher has quit IRC06:16
*** yamahata has joined #tripleo06:26
openstackgerritMerged openstack/tripleo-heat-templates: Fix comment in freeipa_setup.sh script  https://review.openstack.org/42230006:27
*** bana_k has joined #tripleo06:28
*** dmacpher has joined #tripleo06:28
*** rlandy has quit IRC06:30
*** abregman has joined #tripleo06:31
*** dmacpher has quit IRC06:33
*** ramishra has quit IRC06:36
*** ramishra has joined #tripleo06:36
*** ramishra has quit IRC06:43
*** flepied has joined #tripleo06:46
*** ramishra has joined #tripleo06:48
*** jerrygb has joined #tripleo07:00
*** flepied has quit IRC07:04
*** jerrygb has quit IRC07:05
*** iranzo has joined #tripleo07:07
*** ealcaniz has joined #tripleo07:10
*** ooolpbot has joined #tripleo07:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756207:11
*** ooolpbot has quit IRC07:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]07:11
*** owalsh-afk has quit IRC07:15
*** rajinir has quit IRC07:16
*** jprovazn has joined #tripleo07:17
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo: Empty /etc/sysconfig/iptables if purge is true and it contains the stock iptables rules  https://review.openstack.org/42242507:18
*** hjensas has joined #tripleo07:20
*** hjensas has quit IRC07:20
*** hjensas has joined #tripleo07:20
*** ohamada has joined #tripleo07:26
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Use already patched repos cloned by zuul for build  https://review.openstack.org/41949107:28
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: test dlrn build  https://review.openstack.org/42242807:28
*** tremble has joined #tripleo07:31
*** tremble has quit IRC07:31
*** tremble has joined #tripleo07:31
*** jlinkes has joined #tripleo07:32
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo: Empty /etc/sysconfig/iptables if purge is true and it contains the stock iptables rules  https://review.openstack.org/42242507:38
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Change PurgeFirewall default value to true  https://review.openstack.org/42243607:38
*** flepied has joined #tripleo07:39
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Create eth2 interface when network-isolation only  https://review.openstack.org/42244107:45
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: test oooq  https://review.openstack.org/42244207:48
*** bana_k has quit IRC07:48
*** florianf has joined #tripleo07:49
*** apetrich has quit IRC07:58
*** rasca has joined #tripleo07:58
*** yprokule has joined #tripleo08:01
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso  https://review.openstack.org/42244808:01
sshnaidmmandre, ^^08:02
*** ebarrera has joined #tripleo08:02
mandresshnaidm: looking08:02
openstackgerritJaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK  https://review.openstack.org/42244908:03
*** aufi has joined #tripleo08:04
*** bana_k has joined #tripleo08:04
*** ooolpbot has joined #tripleo08:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756208:11
*** ooolpbot has quit IRC08:11
openstackLaunchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged]08:11
*** tesseract has joined #tripleo08:13
*** padkrish has joined #tripleo08:14
*** mcornea has joined #tripleo08:16
*** amoralej|off is now known as amoralej08:17
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: test oooq  https://review.openstack.org/42244208:17
*** psahoo has quit IRC08:17
*** crenguta has joined #tripleo08:18
*** bana_k has quit IRC08:21
*** karimb has joined #tripleo08:22
*** owalsh-afk has joined #tripleo08:22
*** jpena|off is now known as jpena08:22
*** ccamacho has joined #tripleo08:23
ccamachoo/08:25
*** pmannidi has quit IRC08:29
*** cylopez has joined #tripleo08:29
*** cmyster_ is now known as cmyster08:30
*** cmyster has joined #tripleo08:30
*** openstackgerrit has quit IRC08:33
*** jpena is now known as jpena|off08:33
*** owalsh-afk is now known as owalsh08:33
*** psahoo has joined #tripleo08:35
*** abregman is now known as abregman|mtg08:39
*** jpena|off is now known as jpena08:40
*** limao_ has quit IRC08:40
*** limao has joined #tripleo08:41
*** owalsh has quit IRC08:41
*** gfidente has joined #tripleo08:42
*** gfidente has quit IRC08:42
*** gfidente has joined #tripleo08:42
*** owalsh has joined #tripleo08:42
*** limao has quit IRC08:45
*** jpich has joined #tripleo08:46
*** limao has joined #tripleo08:49
*** zoliXXL is now known as zoli08:51
*** jprovazn has quit IRC08:52
*** openstackgerrit has joined #tripleo08:53
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart: Add support for virtual port types  https://review.openstack.org/40734708:53
openstackgerritMichele Baldessari proposed openstack/tripleo-image-elements: WIP DO NOT MERGE Add a script to zero /etc/sysconfig/iptables at build time  https://review.openstack.org/42247208:55
*** abehl has joined #tripleo08:56
openstackgerritMichele Baldessari proposed openstack/tripleo-common: WIP DO NOT MERGE Test adding iptables element  https://review.openstack.org/42247508:57
*** aufi has quit IRC08:57
*** zzzeek has quit IRC09:00
*** zzzeek has joined #tripleo09:00
*** pgadiya has quit IRC09:01
*** shardy_afk is now known as shardy09:03
*** jprovazn has joined #tripleo09:03
*** pgadiya has joined #tripleo09:04
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker: Add tries and try_sleep to ::pacemaker::stonith  https://review.openstack.org/42248409:05
*** thegodfather is now known as fabbione09:08
*** aufi has joined #tripleo09:09
*** owalsh has quit IRC09:11
*** ooolpbot has joined #tripleo09:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756209:11
*** ooolpbot has quit IRC09:11
openstackLaunchpad bug 1657562 in tripleo "ceph deployments failing on selinux error" [Critical,Triaged]09:11
*** owalsh has joined #tripleo09:12
*** owalsh has quit IRC09:12
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo: Add retries to the ::pacemaker::stonith property  https://review.openstack.org/42248909:12
*** owalsh has joined #tripleo09:12
*** limao has quit IRC09:22
*** ccamacho has quit IRC09:23
*** limao has joined #tripleo09:23
*** padkrish has quit IRC09:25
*** athomas has joined #tripleo09:25
*** ramishra has quit IRC09:26
*** abregman|mtg is now known as abregman09:27
*** limao has quit IRC09:27
*** ramishra has joined #tripleo09:28
*** lucas-afk is now known as lucasagomes09:35
*** ccamacho has joined #tripleo09:40
*** psahoo has quit IRC09:40
*** yamahata has quit IRC09:41
yolandahi, question... i'm trying to debug an ovb job but i'd need help09:43
yolandai holded a node, the one shown in zuul status09:43
yolandabut this seems to be creating others right? how can i access the related undercloud node?09:44
yolandai'm trying to debug http://logs.openstack.org/61/375261/43/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/01a4c27/console.html09:44
*** psahoo has joined #tripleo09:44
yolandaso install-types is found ok in the holded node, but i need to see on the others09:44
*** salmankhan has joined #tripleo09:46
*** derekh has joined #tripleo09:48
*** owalsh_ has joined #tripleo09:49
*** owalsh has quit IRC09:50
*** b00tcat has joined #tripleo09:50
*** b00tcat has joined #tripleo09:50
*** psahoo has quit IRC09:50
*** panda|zZ is now known as panda09:51
pandayolanda: that build failed on undercloud install, there are no other nodes you can explore at that stage09:52
yolandamm so it is not finding that element, but i can see it on /usr/share/diskimage-builder/elemetns09:53
yolandamm so it is not finding that element, but i can see it on /usr/share/diskimage-builder/elements09:53
yolandapanda, how can i check what's going on? seems difficult to re-run the scripts without all the exported vars09:54
yolandasee it shows /usr/share/tripleo-puppet-elements /usr/share/instack-undercloud /usr/share/tripleo-image-elements /usr/share/diskimage-builder/elements09:54
yolandaand i can see install-types under /usr/share/diskimage-builder/elements09:55
pandayolanda: within the paths just above the error ? are you looking at the repo with the same hash ?09:55
yolandai am at the holded node that failed09:55
pandayolanda: oh09:56
pandayolanda: let's look at the log it indicates: install-undercloud.log, it's stored in http://logs.openstack.org/61/375261/43/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/01a4c27/logs/undercloud.tar.xz09:56
*** paramite has joined #tripleo09:57
openstackgerritLuke Hinds proposed openstack/tripleo-puppet-elements: Add reference to puppet-auditd  https://review.openstack.org/42004009:57
pandayolanda: mh, not helpful09:58
yolandapanda yep, same thing as the console log. The install types failure09:58
yolandapanda, seems i can reproduce the failure executing  /opt/stack/new/tripleo-ci/scripts/tripleo.sh --undercloud09:58
yolandasame error09:58
yolandafor some reason doesnt' find that element09:59
*** nmathew has joined #tripleo10:00
*** social has joined #tripleo10:01
pandayolanda: IIUC the last rebase for https://review.openstack.org/375261 was in november, is that right ?10:04
yolandayep... as it's a feature branch i didn't think it could affect10:04
openstackgerritJaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK  https://review.openstack.org/42244910:05
yolandai'm adding some debugging to the instack runner10:05
*** owalsh_ is now known as owalsh10:06
pandayolanda: never say never :). I'm not sure what's happening as dib is not something I really know. But seems like something is not honouring the path where to search for elements. Rebase is something I would do just to be on the safe side.10:08
yolandaok rebasing it, it doesn't hurt10:10
pandayou may find youself debbugging thing that are already solved.10:10
yolandaindeed10:10
yolandaoh interesting10:10
*** owalsh has quit IRC10:10
pandaconflicts ?10:11
*** ooolpbot has joined #tripleo10:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165756210:11
*** ooolpbot has quit IRC10:11
openstackLaunchpad bug 1657562 in tripleo "ceph deployments failing on selinux error" [Critical,Triaged]10:11
yolandamm, it finds it, but seems to crash before10:11
yolandasee10:11
yolanda2017-01-19 10:09:33,106 INFO: loaded devuser10:11
yolanda2017-01-19 10:09:33,107 INFO: i find elERROR: 2017-01-19 10:09:33,065 -- Element 'install-types' not found10:11
*** b00tcat has quit IRC10:11
yolanda2017-01-19 10:09:33,112 INFO: i find elem install-types10:11
yolanda2017-01-19 10:09:33,113 INFO: loaded install-types10:11
yolandamm, going to try and switch the order of the paths10:13
openstackgerritJaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK  https://review.openstack.org/42244910:16
*** akrivoka has joined #tripleo10:18
*** sdake has joined #tripleo10:19
yolandapanda, it seems to be a problem in loading dependencies10:22
yolandanot with the path or collecting the elements10:23
openstackgerritJaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK  https://review.openstack.org/42244910:23
yolandaso that's likely a problem with diskimage_builder.element_dependencies function... let's see if rebase helps10:24
*** salmankhan has quit IRC10:24
yolandasame issue after rebase10:26
pandayolanda: where did you rebase ?10:27
*** b00tcat has joined #tripleo10:27
yolandahttps://review.openstack.org/#/c/375261/10:27
*** jerrygb has joined #tripleo10:28
nmathewhi all10:29
nmathewis there any support for role specific UserData10:29
nmathewin THT10:29
openstackgerritJaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK  https://review.openstack.org/42244910:30
nmathewintention is pass kernel parameters to compute roles10:30
*** akrivoka has quit IRC10:30
*** salmankhan has joined #tripleo10:30
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Add packaging documentation  https://review.openstack.org/41894110:30
skramajanmathew: there is recent addition on PreNetworkConfig to pass the parameters and reboot.10:31
nmathewis this avaialble in newton?10:31
skramajanmathew: nope. it is added in Ocata. - https://review.openstack.org/#/c/395431/3/doc/source/advanced_deployment/ovs_dpdk_config.rst10:32
nmathewcan you please point me to that link10:32
nmathewok thank you10:32
shardynmathew: No, I think on newton you'll need to use a script in UserData with a conditional that looks at the hostname10:32
skramajanmathew: for newton we use the first-boot user data with hostname check,10:32
nmathewok10:33
*** jerrygb has quit IRC10:33
skramajanmathew: sample code for newton, what we used for DPDK is - https://gist.github.com/krsacme/1234bf024ac917c74913827298840c1c10:33
nmathewthanks skramaja and shardy..10:34
yolandapanda ok... seems the method used in diskimage-builder in feature/v2 changed totally10:37
yolandaand conflicts with the usage in runner10:37
yolandai'll talk with dib cores10:37
*** akrivoka has joined #tripleo10:39
pandayolanda: so the rebase must be on the design too, not only the code ... good luck10:39
yolanda:(10:40
*** jlinkes has quit IRC10:40
*** jlinkes has joined #tripleo10:40
*** florianf has quit IRC10:40
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Use eth2 interface when network-isolation only  https://review.openstack.org/42244110:43
*** florianf has joined #tripleo10:44
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Use eth2 interface when network-isolation only  https://review.openstack.org/42244110:44
*** hjensas has quit IRC10:47
openstackgerritMerged openstack/instack-undercloud: Add missing FW rules for Placement API  https://review.openstack.org/42228910:50
*** apetrich has joined #tripleo10:51
*** nmathew has quit IRC10:52
openstackgerritMerged openstack/tripleo-heat-templates: set -e in run-os-net-config.sh  https://review.openstack.org/41150910:53
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: test oooq  https://review.openstack.org/42244210:53
*** akrivoka has quit IRC10:53
*** udesale has quit IRC10:58
*** akrivoka has joined #tripleo10:59
skramajashardy: one question, at what stage the hiera data files will be available on the compute node?11:03
shardyskramaja: after the PreNetwork and NetworkDeployment have run11:04
skramajaok shardy.11:04
*** psahoo has joined #tripleo11:05
*** dtantsur|afk is now known as dtantsur11:05
shardyskramaja: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L40211:05
shardyyou can see it there, if you follow the depends_on you'll see which deployments happen before11:05
shardyit's pretty early in the deploy, but after we've configured the network11:06
skramajaany particular reason for after the network configuration? reason for the question is, i am trying to find if there is a way to configure openvswitch DPDK_OPTIONS before os-net-config.11:08
skramajaDPDK is configured @https://github.com/openstack/puppet-vswitch/blob/master/manifests/dpdk.pp11:08
skramajashardy: ^11:09
shardyskramaja: basically the assumption has always been that you'd want to configure the networking before any other kind of configuration11:10
shardybut here you have a chicken/egg problem because it seems you want to do configuration  via puppet before you configure the network?11:11
shardyskramaja: I guess I'd probably work around it by passing the same parameter into the PreNetwork config and services/neutron-ovs-dpdk-agent.yaml or wherever it's consumed by puppet11:12
skramajayes shardy. we are facing an issue in DPDK bond when DPDK is enabled at later stage. there is a workaround for now. but wanted to see if there can be proper fix.11:12
shardyskramaja: Yeah, I can't think of a cleaner way to do it atm, because we've always assumed the network config would be done by the time we run puppet11:13
skramajathanks shardy.11:13
shardyI suppose in future we could revisit that, and allow reconfiguring networking again after puppet has run11:13
*** b00tcat has quit IRC11:14
skramajathat would be great. thanks11:15
*** percevalbot has quit IRC11:19
openstackgerritMerged openstack/instack-undercloud: Improve upgrade process to include upgrade flag  https://review.openstack.org/41911211:19
*** Baggypants12000 has quit IRC11:22
*** zoli is now known as zoli|lunch11:27
*** owalsh has joined #tripleo11:28
*** athomas has quit IRC11:28
*** apetrich_ has joined #tripleo11:29
*** percevalbot has joined #tripleo11:32
*** apetrich has quit IRC11:32
*** apetrich_ has quit IRC11:33
*** bkopilov has quit IRC11:35
*** bkopilov_ has quit IRC11:35
*** athomas has joined #tripleo11:35
*** karimb has quit IRC11:36
*** nyechiel has joined #tripleo11:38
*** sudipto_ has quit IRC11:39
*** sudipto has quit IRC11:39
owalshshardy: just read your comment re cell_v2 upgrade in https://review.openstack.org/#/c/405241/ ...11:41
yolandahi, can i get reviews for some new elements in tripleo? https://review.openstack.org/419486, https://review.openstack.org/420698, https://review.openstack.org/420765, https://review.openstack.org/42080511:41
shardyowalsh: yeah, I'm happy to leave that to puppet-nova if/when it handles it, but right now I think we need to do the DB dance in ansible11:41
owalshshardy: will discuss with mwhahaha later, just thinking if that's an option at all... puppet would need to know it's an upgrade vs fresh install11:42
gfidenteowalsh shardy I am interesting in if we find a generic solution to that11:42
shardyowalsh: Ok, well we could set such a flag in hieradata easily enough11:42
*** salmankhan1 has joined #tripleo11:42
gfidenteI have a similar problem of distinguishing upgrades from new installs in puppet-ceph too11:43
shardyowalsh: I was really hoping we could derive the required actions from the current system state tho11:43
gfidentebut I think it is in net contrast with the declarative idea in puppet11:45
*** salmankhan has quit IRC11:45
owalshhmm.... some ideas but they ain't pretty...11:46
shardyI was thinking puppet could just look for the cells DB and do the cells stuff if it's not there11:47
*** salmankhan has joined #tripleo11:47
*** salmankhan1 has quit IRC11:47
gfidenteyeah and puppet-ceph ends up being a long list of exec/unless clause already11:47
*** jkilpatr has quit IRC11:47
shardyif we have to, we can leave it in the ansible steps, but this is getting pretty complex and it'd be nice to avoid maintaining it in two places11:47
openstackgerritMerged openstack/tripleo-common: Add password and key generation for Octavia  https://review.openstack.org/41953611:48
owalshshardy: upgrade path and install path are different11:48
*** nyechiel has quit IRC11:48
* shardy throws things at nova for being so difficult11:49
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci: Send mail tool  https://review.openstack.org/42129811:49
shardyowalsh: And there's no way at all to inspect a system and see if it's already installed?11:49
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci: Send mail tool  https://review.openstack.org/42129811:50
shardyif we have to, we can have the environment file that triggers the upgrade set a boolean which we put in hiera11:50
shardybut that seems kinda ugly11:50
*** salmankhan has quit IRC11:51
owalshshardy: it's a long story...11:53
*** salmankhan has joined #tripleo11:57
owalshshardy: TL; DR we can't run simple_config for a fresh install, it fails if there are no hosts yet11:57
*** cylopez has quit IRC11:58
*** rhallisey has joined #tripleo12:00
*** jpena is now known as jpena|lunch12:00
owalshit's basically a migration from a non-cell setup to single cell setup12:01
EmilienMhello12:02
*** hjensas has joined #tripleo12:02
*** jkilpatr has joined #tripleo12:05
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Remove Glance Registry from undercloud  https://review.openstack.org/41721412:06
*** psahoo has quit IRC12:06
openstackgerritMerged openstack/tripleo-quickstart-extras: Add support for whole disk images  https://review.openstack.org/42180512:08
shardyEmilienM: Hey, good morning, when you get a moment, could you help me understand why https://review.openstack.org/#/c/422084/ is failing?12:14
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient: Create command for building RAID on given nodes  https://review.openstack.org/42124212:14
shardyI need to decide if I should give up on fixing puppet-swift and just align t-h-t with the pipeline it expects12:15
dtantsurthe final RAID patch for Ocata ^^^, everything else will follow in Pike, I think12:15
*** adarazs is now known as adarazs_lunch12:15
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci: Send mail tool  https://review.openstack.org/42129812:16
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI  https://review.openstack.org/41039212:16
openstackgerritMerged openstack/tripleo-quickstart-extras: Collect logs of containers  https://review.openstack.org/41901812:16
EmilienMshardy: looking12:18
EmilienMshardy: first, don't look ubuntu jobs, we have a major issue with them12:18
EmilienMshardy: what you need to see is: http://logs.openstack.org/84/422084/2/check/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/3e93ae7/console.html#_2017-01-19_09_54_39_45108012:18
EmilienMhttp://logs.openstack.org/84/422084/2/check/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/3e93ae7/console.html#_2017-01-19_09_44_03_89292612:19
EmilienM2 tests are failing with swift quotas12:19
owalshshardy: ...and the simple_setup must be run *before* the nova api db sync. For fresh install it's the reverse - we have to run the api db sync before any of the cell stuff.12:19
EmilienMshardy: we might want to ask cschwede here12:20
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Implement NTP profile  https://review.openstack.org/31072512:21
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: ntp: make sure chrony is purged before  https://review.openstack.org/42216412:21
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Deploy NTP with puppet-tripleo profile  https://review.openstack.org/42216712:21
shardyEmilienM: ack, thanks - I'll try to chat with cschwede12:22
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: enable Placement API on multinode jobs  https://review.openstack.org/42225812:22
EmilienMshardy: I haven't found anything in logs12:22
shardyEmilienM: I think I'll probably just align t-h-t with what puppet-swift expects for now to move forward, as I've been blocked on this for a few days now12:22
*** pkovar has joined #tripleo12:22
shardyif we specify a pipeline for the proxy which matches the hard-coded things in puppet-swift, it will work I think12:23
shardybut we'll have to keep that in sync with any changes to the swift defaults12:23
therveshardy, You should try to disable the extension completely otherwise12:23
EmilienMyeah :/12:23
therveThat would skip the test I believe12:23
shardytherve: you mean remove the two *quotas includes?12:24
shardyyeah I wondered about that, let me try12:24
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras: Add introspection with retries option  https://review.openstack.org/40367712:25
therveshardy, I'm not exactly sure how to, but they are extensions, so there should be a way :)12:26
*** lucasagomes is now known as lucas-hungry12:27
*** owalsh is now known as owalsh-lunch12:29
*** jerrygb has joined #tripleo12:29
*** gkadam has quit IRC12:29
*** thrash|g0ne is now known as thrash12:30
*** jlinkes_ has joined #tripleo12:31
EmilienMshardy: +2 on https://review.openstack.org/#/c/422084/12:32
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci: Send mail tool  https://review.openstack.org/42129812:32
shardyEmilienM: thanks! Lets see what CI says :)12:34
*** shardy is now known as shardy_lunch12:34
*** jlinkes has quit IRC12:34
*** jerrygb has quit IRC12:34
*** tosky_ has joined #tripleo12:38
*** akrivoka has quit IRC12:39
*** akrivoka has joined #tripleo12:40
*** psahoo has joined #tripleo12:43
*** zoli|lunch is now known as zoli12:44
*** dtantsur is now known as dtantsur|lunch12:47
*** nyechiel has joined #tripleo12:48
EmilienMshardy_lunch: in fact, I think your patch in puppet-swift might not be backward compatible for users who use "_" in the pipeline12:49
EmilienMmaybe we could transform the _ in - within the manifest so it's transparent for users, and we add a release note12:49
*** saneax is now known as saneax-_-|AFK12:49
*** rbrady has quit IRC12:51
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart: Add config file for OPNFV scenario  https://review.openstack.org/42259312:51
*** masco has quit IRC12:52
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart: Add the ability to run all tasks as root  https://review.openstack.org/41819812:53
*** jpena|lunch is now known as jpena12:55
gfidenteEmilienM magic must have happened within bnemec domain12:56
gfidentebecause nothing changed that I can tell to either introduce nor fix the problem12:57
gfidentewith ceph selinux12:57
gfidentewe can ask him when he is back12:57
pandahe fixed it in his sleep12:57
gfidenteyeah he mentioned something which would refresh the cached overcloud imge12:58
EmilienMgfidente: maybe a packaging update?12:58
*** hjensas has quit IRC12:58
*** morazi has joined #tripleo13:02
*** jayg|g0n` is now known as jayg13:08
*** morazi has quit IRC13:10
*** links has quit IRC13:11
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps  https://review.openstack.org/41988613:12
*** zoli is now known as zoli|afk13:13
*** ansmith has joined #tripleo13:13
*** jerrygb has joined #tripleo13:13
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates: Containerize MySQL  https://review.openstack.org/41460113:14
*** adarazs_lunch is now known as adarazs13:15
*** pgadiya has quit IRC13:16
*** lucas-hungry is now known as lucasagomes13:17
*** dtantsur|lunch is now known as dtantsur13:17
*** ohamada_ has joined #tripleo13:18
*** ohamada has quit IRC13:18
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps  https://review.openstack.org/41988613:19
*** shardy_lunch is now known as shardy13:20
*** apetrich has joined #tripleo13:20
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates: Ignore systemctl return code in yum_update.sh  https://review.openstack.org/42261013:21
shardyEmilienM: Yeah I did wonder about how to make it backwards compatible given that the pipeline and config sections need to match13:21
*** hjensas has joined #tripleo13:21
*** hjensas has joined #tripleo13:21
shardypls comment on the review if you've got suggestions on how I can do that13:21
*** trown|outtypewww is now known as trown13:23
*** morazi has joined #tripleo13:24
openstackgerritJulie Pichon proposed openstack-infra/tripleo-ci: Remove references to Liberty (now EOL'd)  https://review.openstack.org/41781413:28
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Disable glance registry during upgrade  https://review.openstack.org/42262013:28
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Don't start all services during upgrade steps  https://review.openstack.org/42262113:28
*** nmathew has joined #tripleo13:29
*** cylopez has joined #tripleo13:31
shardyHrm, anyone seen any issues with glance token validation and version negotiation?13:33
shardyhttp://paste.openstack.org/show/595615/13:33
shardyI see that after upgrading N->O and not yet sure why13:33
shardyI assume things are OK for trunk deployments as CI looks OK13:33
*** ccamacho is now known as ccamacho|lunch13:35
shardyhttp://paste.openstack.org/show/595616/ shows the before/after upgrade glance-api.conf, and the glance endpoint in the catalog13:35
*** karimb has joined #tripleo13:39
openstackgerritMartin André proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration  https://review.openstack.org/41642113:39
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements: Add element to customize dracut on the agent  https://review.openstack.org/42076513:39
*** salmankhan has quit IRC13:40
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient: Create command for building RAID on given nodes  https://review.openstack.org/42124213:40
*** rlandy has joined #tripleo13:41
bandiniccamacho|lunch , ping me when back13:42
*** sudipto has joined #tripleo13:43
*** sudipto_ has joined #tripleo13:43
*** pradk has joined #tripleo13:44
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso  https://review.openstack.org/42244813:44
*** sudipto has quit IRC13:45
*** sudipto_ has quit IRC13:45
*** nmathew has quit IRC13:46
*** saneax-_-|AFK is now known as saneax13:47
*** owalsh-lunch is now known as owalsh13:48
*** tbonds has joined #tripleo13:50
*** jeckersb is now known as jeckersb_gone13:51
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs are readable with browser  https://review.openstack.org/42263813:53
sshnaidmtrown, adarazs ^^13:53
adarazssshnaidm: going to review it, thanks13:54
trownsshnaidm: can we do depends-on https://review.openstack.org/419039 ... want to see if depends-on working13:54
*** [1]cdearborn has joined #tripleo13:55
EmilienMshardy: yes I will13:55
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI  https://review.openstack.org/41039213:55
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs are readable with browser  https://review.openstack.org/42263813:55
sshnaidmtrown, yeah ^^ I thought it's merged already :)13:56
*** tzumainn has joined #tripleo13:56
*** hafe has joined #tripleo13:57
trownsshnaidm: oh also that is just the ovb job, were you also going to do the same for multinode or should I?13:57
sshnaidmtrown, I'll do13:58
sshnaidmEmilienM, trown please take a look at fixing patch for containers and nonha oooq jobs: https://review.openstack.org/#/c/422441/13:58
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs are readable with browser  https://review.openstack.org/42263813:59
*** tosky_ is now known as tosky13:59
*** zoli|afk is now known as zoli13:59
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso  https://review.openstack.org/42244814:00
*** udesale has joined #tripleo14:01
adarazssshnaidm: I added a couple of comments14:01
*** cylopez1 has joined #tripleo14:01
adarazsactually now I did :)14:02
shardycan anyone paste me the output from ls -l /var/log/ | grep cinder on a trunk deployed overcloud please?14:03
sshnaidmadarazs, where?14:03
jpichhonza: Could be failing because the new shiny package hasn't made it out to the repos yet, trying to check now14:03
adarazssshnaidm: https://review.openstack.org/42263814:03
adarazssshnaidm: patchset 114:03
*** cylopez has quit IRC14:03
*** dprince has joined #tripleo14:05
jpichhonza: the dlrn logs for that failed build used 3.1 still14:05
*** apetrich has quit IRC14:06
shardyhrm, it's selinux14:06
*** bkopilov_ has joined #tripleo14:06
*** nyechiel has quit IRC14:06
honzajpich: ah, cool, good catch14:07
honzajpich: do you have a link to the log?14:07
*** crenguta has quit IRC14:08
*** hafe has quit IRC14:08
*** crenguta has joined #tripleo14:09
pandajpich: is tripleo-ui gated now ?14:10
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps  https://review.openstack.org/41988614:11
ansiwenmwhahaha: this will probably not backported to mitaka->newton I guess? https://bugzilla.redhat.com/show_bug.cgi?id=141185614:11
openstackbugzilla.redhat.com bug 1411856 in puppet-nova "Upgrade 9->10->11 Fails: Migration cannot continue until all these have been migrated to the api database." [Unspecified,New] - Assigned to rhos-maint14:11
ansiwenmwhahaha: I'm asking because of this bug: https://bugzilla.redhat.com/show_bug.cgi?id=141185614:11
shardyslagle_: Hey I wondered if we've got a bug open anywhere to get the multinode job selinux enforcing?14:11
shardyslagle_: upgrades are broken locally with it turned on atm14:11
openstackgerritDan Radez proposed openstack/puppet-tripleo: Adding tacker service  https://review.openstack.org/42264414:11
*** leanderthal has joined #tripleo14:11
*** egafford has joined #tripleo14:12
*** jmelvin has joined #tripleo14:13
ansiwenshardy: is this maybe related to the weird ://: I was having? http://logs.openstack.org/34/398634/20/check/gate-tripleo-heat-templates-pep8-ubuntu-xenial/928e119/console.html#_2017-01-18_19_02_13_90695814:14
jpichhonza: http://logs.openstack.org/41/418941/3/check/gate-tripleo-ci-centos-7-undercloud/a143bce/logs/delorean_repos.tar.xz in rpmbuild.log14:14
ansiwenshardy: ERROR: ./environments/tls-endpoints-public-ip.yaml doesn't match base endpoint map14:14
jpichpanda: Yeah!! That looks correct now :) http://logs.openstack.org/41/418941/3/check/gate-tripleo-ci-centos-7-undercloud/a143bce/console.html#_2017-01-19_13_54_25_706383 Thank you for the fix!14:15
pandajpich: great.14:15
shardyansiwen: aha, yes it may well be, the nonha job enables tls and uses that environment14:16
shardyansiwen: good catch! :)14:17
ansiwenshardy: so, did I miss to update something?14:17
ansiwenshardy: or are these created automatically?14:17
pandaironic-python-agent.initramfs is created during the image building step, right ?14:17
jpichhonza: I think this is where it needs to be, only 3.1 is available for now -> http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/14:18
mwhahahaansiwen: no, transport_url is not something we would really backport to mitaka. that needs a multistep upgrade process. i think 10->11 is broken because of that so it should be something that gets resolved as part of that upgrade14:18
shardyansiwen: yes I think you need to update the environment file in the error14:18
shardyit's not created automatically14:18
shardythe fact that the deploy doesn't fail is probabl a bug tho14:18
honzajpich: it's there now, 3-214:18
jpichhonza: :D14:19
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs viewable with browser  https://review.openstack.org/42263814:19
honzajpich: literally right now, eh?14:19
jpichLooks like it!!14:19
ansiwenshardy: the weird thing is, this pep8 didn't fail before... is it a new validation?14:19
*** leanderthal has quit IRC14:19
honzajpich: another recheck then?14:19
jpichhonza: Yeah, let's have one to be sure-to be sure14:19
jpichAnd once that works, recheck All The Things14:19
honza(tm)14:20
shardyansiwen: yes https://github.com/openstack/tripleo-heat-templates/commit/d1e67318c42fbad2ab7d9a0a515d5f3717d8e30714:20
dprinceEmilienM: so Debian/Ubunto doesn't allow placement to be isntalled side by side w/ Nova API. Just to confirm... we are running placement in the same Apache instance right? https://review.openstack.org/#/c/422185/14:21
ansiwenmwhahaha: not sure I understand. there is no possibility to fix that for  mitaka->newton upgrade of the undercloud, becaus we don't have special upgrade handling there, correct? so it will be a manual step between those two upgrade steps, correct? just wonder how to proceed with that bug.14:21
EmilienMdprince: their packages are not updated enough to have it working in puppet ci14:21
EmilienMdprince: we'll update it in pike.14:21
EmilienMdprince: the problem is not in placement but in nova compute and scheduler14:22
dprinceEmilienM: Ack, but does it cause a problem for us in TripleO (today) to run them side by side w/ Nova API? On Centos/RHEL that is...14:22
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: provide instructions on how to only use quickstart as instack-virt-setup  https://review.openstack.org/42226014:22
EmilienMdprince: no problem in tripleo.14:23
dprinceEmilienM: yeah, I'm dropping Ubuntu from this patch then14:23
*** kjw3 has joined #tripleo14:24
*** Goneri has joined #tripleo14:24
*** hafe has joined #tripleo14:24
*** lblanchard has joined #tripleo14:25
pandacan someone help me understand if the errors here http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/8aee8f7/logs/undercloud/var/log/image_build.txt.gz mean that dib fails to create the initram, but continues with overcloud image anyway, except failing because initram is not present ?14:26
sshnaidmtrown, EmilienM, bnemec please provide your feedback: https://review.openstack.org/422646  it will allow to run oooq jobs in check pipe for tripleo-ci (only!) in order to prevent breaking it and for further development of transition14:27
*** udesale has quit IRC14:27
EmilienMsshnaidm: kind of bad time now, I'll look when I can.14:28
saneaxbeagles would request you to look at the patch https://review.openstack.org/#/c/417805/14:28
sshnaidmEmilienM, sure, we can discuss it in the mtg today later14:29
*** salmankhan has joined #tripleo14:30
*** nyechiel has joined #tripleo14:30
pandayolanda: you were working with dib this morning ^ :)14:32
*** leanderthal has joined #tripleo14:32
yolandapanda yes, but on feature/v2 branch14:32
openstackgerritMerged openstack/tripleo-quickstart-extras: collect-logs: rename text files to txt.gz  https://review.openstack.org/41903914:33
*** hafe has quit IRC14:35
ansiwenshardy: wouldn't it be better to let build_endpoint_map.py also created these files? seems to be the same thing to me14:38
EmilienMif someone could review this tripleo-ci patch, to add placement services in multinode (really quick) - thanks! https://review.openstack.org/#/c/422258/14:39
pandashardy: does mitaka support overcloud deletion ?14:43
*** hafe has joined #tripleo14:43
*** liverpooler has joined #tripleo14:44
shardypanda: yes, all releases support deleting the overcloud14:44
*** psahoo has quit IRC14:44
shardypanda: heat stack-delete overcloud14:44
shardyor openstack stack delete overcloud14:44
shardythe overcloud delete command is only in recent versions IIRC14:44
shardyd0ugal: ^^ can confirm which ones14:45
*** saneax is now known as saneax-_-|AFK14:46
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Add a delete stack workflow  https://review.openstack.org/42265814:46
d0ugalpanda, shardy: mitaka would just be with the heat client.14:46
*** nyechiel has quit IRC14:46
shardyansiwen: yeah probably it would, patches welcome ;)14:46
d0ugalpanda, shardy: "openstack overcloud delete" will be new in Ocata iirc14:47
pandashardy: d0ugal sorry, I think the command actually causing the CI to fail is "openstack overcloud plan delete"14:47
shardythat was introduced during Newton14:47
d0ugalpanda: oh, do you have an error?14:47
*** jeckersb_gone is now known as jeckersb14:48
pandad0ugal: yes, http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/d7170c4/console.html14:48
* d0ugal looks14:48
pandad0ugal: sorry this http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/d7170c4/console.html14:48
pandammmmh14:48
pandad0ugal: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/d7170c4/console.html#_2017-01-18_08_18_28_68177014:48
pandathere14:48
*** liverpooler has quit IRC14:48
*** liverpooler has joined #tripleo14:49
jpichoh, plan delete wouldn't have existed yet in Mitaka14:49
pandayeah, so we have to change that part in tripleo.sh script14:49
d0ugalyup14:49
*** milan has joined #tripleo14:49
pandashould be replaced with something ?14:49
jpichI don't think it's necessary, no14:50
jpichit was just added because we missed a bug in plan delete at the time14:50
jpichhttps://review.openstack.org/#/c/408301/14:50
openstackgerritMichele Baldessari proposed openstack/tripleo-common: Add a PacemakerRemoteAuthkey to the default passwords  https://review.openstack.org/42045914:51
d0ugalpanda: plans didn't exist, so in Mitaka you just need to delete the stack.14:52
pandad0ugal: jpich shardy ok, thanks!14:52
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Fix delete_node failures  https://review.openstack.org/42266414:52
larsksHey, are there problems with the gate-tripleo-ci-centos-7-ovb-ha job? I'm seeing a timeout, and I know bandini was seeing one yesterday, and I'm pretty sure the timeouts are unrelated to the changes themselves...14:53
openstackgerrityolanda.robla proposed openstack/tripleo-common: Add element to regenerate dracut on the agent  https://review.openstack.org/42080514:58
*** fultonj has joined #tripleo14:58
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: tripleo.sh: skip plan delete for mitaka  https://review.openstack.org/42267314:58
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-quickstart: ensure that tripleo-quickstart volume pool is defined  https://review.openstack.org/42222414:58
*** dprince has quit IRC14:59
*** crenguta has quit IRC15:01
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates: Add ec2-api service  https://review.openstack.org/39863415:01
*** thrash is now known as thrash|biab15:01
*** hafe has quit IRC15:02
adarazsEmilienM, trown, sshnaidm, weshay, hrybacki, panda, rlandy and anybody else interested: TripleO CI Squad meeting in half an hour, add agenda items here: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting15:02
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: tripleo.sh: skip plan delete for mitaka  https://review.openstack.org/42267315:02
*** udesale has joined #tripleo15:05
pandad0ugal: jpich ^ let's make mitaka pass again :)15:05
*** ealcaniz has quit IRC15:05
*** abehl has quit IRC15:08
*** nyechiel has joined #tripleo15:08
honzajpich: CI success :) https://review.openstack.org/#/c/418941/ dance?15:08
openstackgerritAna Krivokapic proposed openstack/tripleo-common: Fix class constructors  https://review.openstack.org/42268015:09
honzajpich: i'm sure you get the emails but yay15:09
*** psahoo has joined #tripleo15:10
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add swift service support for composable upgrades  https://review.openstack.org/40524515:10
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Swift proxy align *-quotas with puppet-swift syntax  https://review.openstack.org/42268215:10
openstackgerritAlex Schultz proposed openstack/instack-undercloud: Validate vips when generating certificate too  https://review.openstack.org/40036415:11
bnemecgfidente: EmilienM: My theory is that there was something in the selinux package updates that wasn't playing nicely with the way we update our cached images.15:11
bnemecI base this primarily on the fact that only jobs using cached images seemed to hit the bug.15:12
gfidentebnemec but did anything change in those packages from yesterday?15:12
shardybnemec: I'm also hitting selinux issues doing package based upgrades from N->015:12
shardywhich seems to be a new issue15:12
jpichhonza: Nah, thanks for the note! I'll update the Thread Where I Talk To Myself A Lot now :)15:12
bnemecgfidente: Assuming we got a promote at some point last night, the updated packages would already be in the cached image so the ci update would be essentially a noop.15:13
jpichhonza: If you have the cycle to recheck the existing patches, particularly the ones that were already approved that would rock!15:13
honzajpich: on it :)15:13
jpichhonza: \o/15:13
bnemecshardy: Fun!15:13
bnemec /sarcasm15:14
*** prateek has quit IRC15:15
gfidenteshardy selinux issues from the same semanage command for ceph?15:15
gfidentecause I couldn't reproduce that outside ci15:15
shardygfidente: No, cinder and glance are both broken after a package based upgrade15:15
gfidentehmm15:15
shardyI thought it was misconfiguration and wasted $too_much time before I discovered disabling selinux fixes it15:16
shardyand that we're running multinode jobs with selinux in permissive mode :(15:16
shardyso CI looks perfectly fine15:16
shardyI'll figure out the audit2allow stuff and raise some bzs I guess15:16
*** dmacpher has joined #tripleo15:17
bnemecCan somebody merge https://review.openstack.org/#/c/416308/ so we start getting the updates job on the cistatus page again?15:18
bnemecIt became voting yesterday.15:18
shardybnemec: done15:18
bnemecshardy: Thanks!15:18
shardyother than the selinux thing the upgrades job is looking pretty stable15:19
shardywould be good to make that voting on t-h-t after we iron out the remaining upgrade issues15:19
*** hafe has joined #tripleo15:22
*** dougbtv|afk is now known as dougbtv15:22
jristthanks for the recheck, honza15:25
honzarecheck all the things!15:25
*** rbrady has joined #tripleo15:28
*** rbrady has joined #tripleo15:28
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: tripleo.sh: skip plan delete for mitaka  https://review.openstack.org/42267315:29
pandaa SPACE! :)15:29
*** jaosorior has joined #tripleo15:31
gfidenteshardy when you say we're doing multinode with selinux in permissive mode15:31
gfidentethat is because the image comes with selinux permissive15:31
fpanEmilienM: could you take a look at https://review.openstack.org/#/c/414730/ and https://review.openstack.org/#/c/414751/15:31
gfidentebecause in ovb we have it in enforcing mode no?15:31
*** sanagikoki has joined #tripleo15:31
*** karimb has quit IRC15:32
jaosoriorEmilienM: ping15:33
jaosoriorEmilienM: so the two commits I posted seem to fix the haproxy configuration for the placement API15:35
*** rajinir has joined #tripleo15:35
jaosoriorhowever, I still don't see the logs for it in the nova log directory15:35
jaosoriorEmilienM: where can I see where it possibly failed to start or load?15:36
jaosoriorshardy: hey dude, can you review this one? it adds the network for the placement API, so t-h-t can generate the _vip and _node_names values15:37
jaosoriorshardy: https://review.openstack.org/#/c/422280/15:37
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Limit heat and nova workers  https://review.openstack.org/36822015:37
openstackgerritMerged openstack-infra/tripleo-ci: Use eth2 interface when network-isolation only  https://review.openstack.org/42244115:37
*** ealcaniz has joined #tripleo15:37
ealcaniztesseract, #0177208215:37
shardygfidente: No, it's because we set it to permissive mode15:38
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/deployed-server/deployed-server-bootstrap-centos.sh#L1615:38
shardyafaics at least15:39
weshayEmilienM, if I setup an ovb job in zuul to gate containers.. would that vote?15:39
jristshadower: you around?15:39
jristshadower: wondering if there is a way to 'reset' validations15:39
gfidenteshardy ah that's multinode only still15:39
jristso they look fresh15:39
shardyI assume it's because the multinode things need it that way, but we'll need to figure out a way to turn it back on15:39
shardygfidente: yeah, but we only test major upgrades on multinode atm15:39
shardyjaosorior: will do15:40
*** sanagikoki has quit IRC15:40
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952915:40
jaosoriorweshay: not ovb IIUC15:40
ccamacho|lunchEmilienM when having some time, mind to check https://review.openstack.org/#/c/412454/ ? I had to rebase it a few days ago and missed your vote15:41
*** ccamacho|lunch is now known as ccamacho15:41
*** ealcaniz has quit IRC15:41
shardyweshay: ovb jobs can't go in the gate queue and forcibly vote, but they can be "voting" in that cores pay attention to them and don't approve when they're failing15:44
shardythat's worked pretty well in the past, provided folks are clear which jobs are expected to pass15:45
weshayflaper87, so you are happy w/ a non-voting job to start w/15:46
weshaythanks shardy jaosorior15:46
*** dprince has joined #tripleo15:47
*** abregman has quit IRC15:48
flaper87weshay: non voting but running on every patch sounds like a good start till after ocata15:49
bandiniccamacho: around?15:49
ccamachohey bandini15:50
ccamachoyeahp15:50
weshayok.. cool.. I think we're all in sync then15:50
*** karimb has joined #tripleo15:52
*** sanagikoki has joined #tripleo15:52
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Environment parameters  https://review.openstack.org/41879815:53
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Normalize parameters  https://review.openstack.org/40342215:53
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Update app state when parameters get updated  https://review.openstack.org/40982515:53
*** thrash|biab is now known as thrash15:55
* EmilienM leaves 20 mins and has 4 pings :-)15:55
* EmilienM in a mtg15:56
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras: Fix minor issues with doc templates  https://review.openstack.org/42271315:56
*** jlinkes_ has quit IRC15:58
*** shardy has quit IRC16:00
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras: Enable novajoin/TLS-everywhere overcloud deploy arguments  https://review.openstack.org/42231016:00
*** florianf has quit IRC16:01
*** shardy has joined #tripleo16:01
*** florianf has joined #tripleo16:04
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Adds a pre-upgrade check that service is running (step0)  https://review.openstack.org/41459816:05
*** david-lyle has joined #tripleo16:06
*** hafe has quit IRC16:06
*** jcoufal has joined #tripleo16:08
*** tremble has quit IRC16:08
*** ebarrera has quit IRC16:09
sanagikokiCould someone review this ? It needs one more +2. https://review.openstack.org/#/c/413778/16:09
*** udesale has quit IRC16:11
*** agurenko has quit IRC16:13
shardysanagikoki: can we mark that blueprint Implemented after that patch lands?16:13
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations: Create the neutron-sanity-check validations  https://review.openstack.org/38111816:13
openstackgerritMerged openstack-infra/tripleo-ci: Rename updates-nv to just updates  https://review.openstack.org/41630816:14
sanagikokishardy: Yes we can.16:14
*** mcornea has quit IRC16:14
openstackgerritMerged openstack/tripleo-heat-templates: Fix a typo in deployed-server/README.rst  https://review.openstack.org/41685116:14
shardysanagikoki: great, thanks! :)16:14
*** rhallisey has quit IRC16:14
*** rhallisey has joined #tripleo16:14
jpichhonza: So... https://review.openstack.org/#/c/419964/ , a new dependency, seems to be passing CI just fine. From your understanding of How These Things Work are we about to end up with a broken CI again, or will the RPM build only fail for the dependent patch that actually uses the new dep?16:15
gfidentebnemec just seen two runs of nonha failing again on selinux16:16
gfidentehttps://review.openstack.org/#/c/422281/3 and https://review.openstack.org/#/c/422280/216:17
EmilienMfpan: yes I will asap16:18
gfidenteboth are upgrading libsemanage, policycoreutils and a bunch of other selinux related pkgs16:18
fpanEmilienM: thanks!16:18
*** florianf has quit IRC16:19
EmilienMfpan: +A16:19
*** florianf has joined #tripleo16:19
EmilienMjaosorior: yes I noticed your patches fixed HAproxy config (thanks!) but placement doesn't start on ovb jobs (but does on multinode)16:19
EmilienMweshay: no they would not vote (ovb)16:19
EmilienMccamacho: yes I'll look asap16:20
EmilienMjaosorior: I'm confused why it works fine in multinode jobs and not in ovb-ha16:21
EmilienMjaosorior: http://logs.openstack.org/21/422621/1/check/gate-tripleo-ci-centos-7-scenario002-multinode/54446a2/logs/subnode-2/var/log/nova/16:21
weshaybkero, can you please point me at the ping test results in http://logs.openstack.org/12/420912/3/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/330c45e/16:21
EmilienMsee how it works fine in multinode16:21
*** yamahata has joined #tripleo16:22
weshaybkero, found it http://logs.openstack.org/12/420912/3/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/330c45e/logs/var/log/overcloud-pingtest.txt.gz16:22
openstackgerritJulie Pichon proposed openstack-infra/tripleo-ci: Use the Newton node management commands  https://review.openstack.org/41698216:22
*** absubram has joined #tripleo16:22
jaosoriorEmilienM: what the hell16:22
EmilienMjaosorior: :/16:23
jaosoriorEmilienM: is there any trace inn the logs why it wouldn't have started?16:23
bkeroweshay: you beat me to it16:23
weshay:)16:23
EmilienMoh wait16:26
EmilienMhttp://logs.openstack.org/81/422281/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/34bad57/logs/overcloud-novacompute-0/var/log/nova/nova-compute.txt.gz#_2017-01-19_02_32_34_14016:26
EmilienMjaosorior: ^16:26
EmilienMI think I missed something :D placement creds need to be on compute nodes16:27
* EmilienM huge facepalm16:27
EmilienMjaosorior: let me fix that asap16:27
jaosoriorEmilienM: sure16:27
EmilienMmwhahaha: ^ fyi16:28
*** panda is now known as panda|bbl16:28
bnemecgfidente: Those both failed last night before the promotion though.16:29
*** aufi has quit IRC16:30
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Move nova::placement to common nova manifest  https://review.openstack.org/42273916:32
sshnaidmnext time I move my cards up :)16:32
*** hrybacki is now known as hrybacki|afkish16:32
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations: Create the neutron-sanity-check validations  https://review.openstack.org/38111816:33
honzajpich: i think it'll only fail later (when the other patch is merged) so we should have enough time to update the RDO bits16:33
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras: Stop pulling Atomic image  https://review.openstack.org/42274216:34
*** abehl has joined #tripleo16:34
fultonjEmilienM: do you recommend that all specs, or at least drafts of them, be in before the PTG?16:34
openstackgerritBrent Eagles proposed openstack/puppet-tripleo: Add base profile for Octavia services  https://review.openstack.org/35189816:35
sshnaidmtrown, adarazs please review this in your time: https://review.openstack.org/419491 it's from card https://trello.com/c/dXsai25w16:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Move nova placement hiera to nova-base  https://review.openstack.org/42274616:35
EmilienMjaosorior: done ^16:35
jpichhonza: I will be super duper happy if it works out this way from now on :)16:35
jpichhonza: Thanks for the answer!16:35
EmilienMfultonj: the sooner you draft a spec before PTG, the better16:35
openstackgerritBrent Eagles proposed openstack/puppet-tripleo: Add base profile for Octavia services  https://review.openstack.org/35189816:35
fultonjEmilienM: ok, thanks16:35
openstackgerritMerged openstack/tripleo-ui: Add i18n strings to plan components  https://review.openstack.org/41656416:36
openstackgerritMerged openstack/tripleo-ui: Add i18n strings to deployment components  https://review.openstack.org/41365716:36
openstackgerritBrent Eagles proposed openstack/puppet-tripleo: Add initial profiles for rest of Octavia services  https://review.openstack.org/41142216:36
*** links has joined #tripleo16:37
trownsshnaidm: we no longer need to skip the ci projects with that?16:37
*** lblanchard has quit IRC16:37
sshnaidmtrown, no, it's actually not related, the skipped projects now are in defaults of build role16:37
sshnaidmtrown, I should have written this in commit, sorry16:38
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras: Bind docker-registry to port 8787  https://review.openstack.org/42274916:38
adarazssshnaidm: another question, as far as I see the artg_repos_dir is used as being on the same host as where the package building is happening. what copies them there?16:38
sshnaidmadarazs, I had an addition to build role: https://review.openstack.org/#/c/405369/16:39
openstackgerritMerged openstack/tripleo-ui: Add i18n strings to validations components  https://review.openstack.org/41896716:40
adarazssshnaidm: I know that. but the directory is supposed to be on the host where the playbook is running16:40
adarazssshnaidm: are these sources copied over somewhere?16:40
sshnaidmadarazs, but they are16:41
sshnaidmadarazs, they are cloned by zuul there16:41
adarazsoh, okay. zuul clones them on the undercloud? oh... the undercloud is the node running quickstart in this case, right?16:42
sshnaidmadarazs, and everything is on the same host16:42
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Add a delete stack workflow  https://review.openstack.org/42265816:42
sshnaidmadarazs, yep16:42
adarazssshnaidm: ah, okay.16:42
*** ohamada_ has quit IRC16:43
adarazssshnaidm: reviewed16:45
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras: Broaden the scope of max_nested_stack_depth regex  https://review.openstack.org/42275216:47
*** absubram has quit IRC16:47
jaosoriorshardy: to be honest I still don't see how I could do https://review.openstack.org/#/c/411340/23 by passing all the stuff to the hook16:48
*** ccamacho has quit IRC16:48
jaosoriorshardy: that pretty much kills off the dynamic generation that I was doing and I would need to hardcode everything, as far as I can see16:48
trownsshnaidm: that patch is not actually running DLRN (makes sense it only touches tripleo-ci)... could we depends on a patch somewhere else to make sure it works? http://logs.openstack.org/91/419491/2/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq-nv/2ea3b61/console.html#_2017-01-19_07_47_25_60900716:48
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations: Create the neutron-sanity-check validations  https://review.openstack.org/38111816:48
*** absubram has joined #tripleo16:49
shardyjaosorior: Ok I'll try to take a closer look later and explain if/how it might be done16:50
sshnaidmtrown, sure, it was: https://review.openstack.org/#/c/42242816:50
*** david-lyle has quit IRC16:55
*** absubram has quit IRC16:55
*** yprokule has quit IRC16:55
trownsshnaidm: oh whoops, didnt look close enough thanks16:56
openstackgerritMerged openstack/tripleo-ui: Add js-yaml dependency  https://review.openstack.org/41996416:56
*** jistr is now known as jistr|afk16:57
*** absubram has joined #tripleo16:59
EmilienMshardy: thanks for the glance registry thing on the overcloud & also swift upgrades, nice work17:02
jidarbnemec and trown it was you guys :P you're the ones who removed epel later last year! https://git.openstack.org/cgit/openstack/diskimage-builder/commit/elements?id=49baaa4114eda954b9bd497d4813e89ff16130b9 Thanks for the help yesterday bnemec I was able to solve it by adding one line, everything works swimmingly now. I might recommend to reverse that commit though17:03
*** beagles is now known as beagles-brb17:03
trownjidar: we dont want epel as a requirement17:03
*** rbrady has quit IRC17:03
jidarI feel that, but unless jq/puppet is going into main, I don't see how that's possible?17:04
*** liverpooler has quit IRC17:04
trownwe build images in various CI jobs without epel... missing context on what your issue was17:04
bnemecjidar: It's not a hard requirement, so it shouldn't be written as such.  We use RDO to provide those packages.17:04
jidarthen why isn't there a rdo repo with those packages included by default?17:04
dtrainorshadower, i think your email re: validations was what i was looking for.  i deleted the default plan, and then re-created it, but the validation states stayed the same17:04
shardyEmilienM: np, I'll hopefully get the nova patch fully working tomorrow, and am rebasing the other services e.g sahara now17:05
bnemecDocumenting in the centos element that you may need epel or rdo repos would be good though.17:05
shardythanks for the reviews17:05
bnemecjidar: Because RDO is also not a hard dependency.17:05
bnemecYou can use either.17:05
jidartrown: basically I can't build a centos image without including epel to do OS::Heat::Softwaredeployments17:05
*** liverpooler has joined #tripleo17:05
shadowerdtrainor: yeah sounds like a bug. Though I wonder if it's because both plans had the same name?17:05
EmilienMshardy: good luck with nova, and the cellv2 thing17:05
shadowerdtrainor: did they?17:05
dtrainorthey did have the same name.  i can test.17:06
shadoweryea it'd be useful to know if that's it17:06
*** ccamacho has joined #tripleo17:06
*** absubram has quit IRC17:08
*** cylopez1 has quit IRC17:11
*** links has quit IRC17:11
*** liverpooler has quit IRC17:12
*** liverpooler has joined #tripleo17:12
bnemecreal    29m0.977s <- Wow, the undercloud install has gotten slow17:15
*** sanagikoki has quit IRC17:15
*** rbrady has joined #tripleo17:15
*** liverpooler has quit IRC17:16
*** yamahata has quit IRC17:16
*** liverpooler has joined #tripleo17:17
amoralejEmilienM, let me know when you have a chance to discuss about tripleo-promotions after rc1, once we move to centos-ocata delorean builder17:17
*** sanagikoki has joined #tripleo17:18
openstackgerritMartin André proposed openstack/tripleo-common: Add pull-puppet-modules script to binaries  https://review.openstack.org/42277217:18
EmilienMamoralej: what needs to be discussed?17:18
amoralejcurrently there is promotion only for master, iiuc, that means that there will not be promotions on ocata repos once we get stable/ocata branches17:19
amoralejis that what we want?17:19
amoralejEmilienM ^17:20
amoralejor will we move promotion to ocata builder until GA?17:21
*** bana_k has joined #tripleo17:21
openstackgerritMerged openstack/tripleo-image-elements: Remove vim configuration in source file  https://review.openstack.org/40013717:22
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add sahara service support for composable upgrades  https://review.openstack.org/40524717:23
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add swift service support for composable upgrades  https://review.openstack.org/40524517:23
EmilienMamoralej: what changes from newton?17:24
EmilienMwe keep same model as we do with newton, no?17:24
*** zoli is now known as zoli|gone17:26
*** psahoo has quit IRC17:28
*** david-lyle has joined #tripleo17:28
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add Swift to the major upgrade CI  https://review.openstack.org/42010017:29
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add sahara support to major upgrade CI  https://review.openstack.org/42277617:29
*** shardy has quit IRC17:29
openstackgerritAndrey Shestakov proposed openstack/diskimage-builder: Fix dhcp-all-interfaces for ubuntu-minimal xenial  https://review.openstack.org/40772517:29
sshnaidmbnemec, shouldn't we change this too? not sure if this is applied: https://github.com/openstack-infra/tripleo-ci/blob/a8b0bc490ed9423b1609034681fa1e748e5fa344/scripts/rh1.env#L12-L1217:29
openstackgerritAndrey Shestakov proposed openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option  https://review.openstack.org/41659317:29
bnemecsshnaidm: No need.  80 still leaves us plenty of wiggle room at 65 concurrent jobs.17:30
sshnaidmok17:30
bnemecIf we manage to get back up to something like 75 testenvs then we might have to revisit that value.17:31
bnemecBut we also need to do something with the fip quota in that case tooo.17:31
EmilienMamoralej: I need to be afk now for lunch break, bbl17:31
bnemecThis is why I'm only bumping to 65 for now.  Increasing slowly is less likely to run us into these limits unexpectedly.17:31
amoralejok EmilienM, this time will be different that newton, i'll explain it later17:31
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Don't assume default network names in net_ip*map  https://review.openstack.org/41362617:32
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Make ServiceNetMap support custom network names  https://review.openstack.org/41362517:32
*** bana_k has quit IRC17:38
*** jbcraig has quit IRC17:39
*** karimb has quit IRC17:42
jaosoriorAny +A for this https://review.openstack.org/#/c/422280/ ?17:44
*** karimb has joined #tripleo17:45
*** sdake_ has joined #tripleo17:47
*** flepied has quit IRC17:47
*** sdake has quit IRC17:50
*** beagles-brb is now known as beagles17:50
openstackgerritMerged openstack/tripleo-heat-templates: Remove redundant CLI arguments for neutron-db-manage  https://review.openstack.org/40795717:51
*** rbrady has quit IRC17:52
*** radeks has joined #tripleo17:52
*** radeksmg has joined #tripleo17:52
*** nyechiel has quit IRC17:55
*** absubram has joined #tripleo17:56
openstackgerritKoki Sanagi proposed openstack/tripleo-heat-templates: Add THT for fossw ML2 plugin in networking-fujitsu  https://review.openstack.org/41377817:56
openstackgerritMerged openstack/tripleo-heat-templates: Configure cron parameters for Cinder Heat Keystone and Nova  https://review.openstack.org/41245417:57
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Disable optional undercloud features in all but nonha  https://review.openstack.org/42278517:58
* bnemec continues his crusade to eliminate the ovb ci queue17:59
*** owalsh has quit IRC17:59
jaosoriorbnemec: ???17:59
bnemecjaosorior: https://review.openstack.org/42278517:59
jaosoriorbnemec: that makes sense18:00
bnemecI thought so.18:00
bnemecEspecially since we're up to 30 minutes to install the undercloud with default settings these days.18:00
jaosoriorbnemec: how the hell did we start taking so long? O_O18:00
bnemecjaosorior: We kept adding services without ever removing anything.18:01
*** jistr|afk is now known as jistr18:01
* bnemec remembers fondly the days when he could install an undercloud from scratch in 10 minutes18:02
jaosoriorlong gone are those days18:02
*** derekh has quit IRC18:03
*** yamahata has joined #tripleo18:03
openstackgerritMerged openstack/tripleo-heat-templates: Disable glance registry during upgrade  https://review.openstack.org/42262018:03
*** jdennis has quit IRC18:03
*** athomas has quit IRC18:04
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: virtualbmc setup is not working in devmode.sh  https://review.openstack.org/42157118:04
jaosoriorbnemec: can you check this one out as well https://review.openstack.org/#/c/422281/ ?18:09
jaosoriorbeagles: ^18:09
beaglesjaosorior: yup18:09
openstackgerritAna Krivokapic proposed openstack/tripleo-common: WIP plan export  https://review.openstack.org/42278918:10
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI  https://review.openstack.org/41039218:10
beaglesjaosorior: pretty straightforward ... think it's alright for me to +A that, don't you?18:11
*** crenguta has joined #tripleo18:11
jaosoriorbeagles: sure18:11
*** hjensas has quit IRC18:11
jaosoriorbeagles: thanks18:12
beaglesjaosorior: np18:12
*** gfidente has quit IRC18:12
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Only install tempest if it's going to be used  https://review.openstack.org/42279518:13
* bnemec disables all the things18:13
*** jpena is now known as jpena|off18:13
jpichjaosorior: Thank you for your comment on that CI review, it wasn't clear to me which jobs were affected :)18:14
jaosoriorbnemec: seems that the undercloud features one needs a change18:14
*** abehl has quit IRC18:14
*** lucasagomes is now known as lucas-afk18:15
jaosoriorjpich: uh... by the way, was this patch actually working https://review.openstack.org/#/c/390845/6/scripts/tripleo.sh ? as far as I can see that URL is incorrect, as we shouldn't be using that range anymore18:16
*** trown is now known as trown|lunch18:16
jpichjaosorior: It was merged before the range change :)18:16
jaosoriorjpich: I see it changed to the new range18:17
jaosoriorit's all good then18:17
*** david-lyle has quit IRC18:18
jpichHopefully so. I'd love to expand it a bit in the future18:18
*** derekh has joined #tripleo18:20
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Only install tempest if it's going to be used  https://review.openstack.org/42279518:21
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Disable optional undercloud features in all but nonha  https://review.openstack.org/42278518:21
*** dtantsur is now known as dtantsur|afk18:21
bnemecCrap, I should have updated the commit message on that one.18:22
*** jpich has quit IRC18:22
*** rasca has quit IRC18:22
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Only install tempest if it's going to be used  https://review.openstack.org/42279518:24
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Disable optional undercloud features in longer jobs  https://review.openstack.org/42278518:24
*** sdake has joined #tripleo18:24
openstackgerritMerged openstack/tripleo-heat-templates: Don't start all services during upgrade steps  https://review.openstack.org/42262118:27
openstackgerritMerged openstack-infra/tripleo-ci: Limit heat and nova workers  https://review.openstack.org/36822018:27
*** sdake_ has quit IRC18:28
*** flepied has joined #tripleo18:28
openstackgerritAndy Smith proposed openstack/puppet-tripleo: Use transport_url(s) for oslo_messaging rpc and notify backends  https://review.openstack.org/42280118:28
beaglesbnemec, EmilienM: any reason not to +A https://review.openstack.org/#/c/310725/ ?18:29
* beagles notes it's a whackload of patchsets beautifully pared down to something very simple18:29
openstackgerritJohn Eckersberg proposed openstack/tripleo-heat-templates: WIP: add configurable timeouts for DB sync  https://review.openstack.org/41629818:31
*** weshay is now known as weshay_afk18:31
ansiwenisn't that wrong, that in this file https is combined with the http ports? environments/tls-everywhere-endpoints-dns.yaml18:31
*** hafe has joined #tripleo18:32
jaosorioransiwen: no18:32
*** lblanchard has joined #tripleo18:32
jaosorioransiwen: there really isn't any sense in changing the ports18:33
jaosorioransiwen: the whole "port changing" comes from "legacy" in tripleo, ideally we shouldn't even be changing them18:33
*** bana_k has joined #tripleo18:33
*** crenguta has quit IRC18:34
*** paramite has quit IRC18:34
*** derekh has quit IRC18:35
openstackgerritBen Nemec proposed openstack/instack-undercloud: Remove enable_(mistral|zaqar) options  https://review.openstack.org/42280218:35
*** absubram has quit IRC18:36
hafeusing composable roles; is it possible to add an additional service to the controller role?18:37
hafesimilar to openstack services with db, keystone, vip etc18:38
hafewithout touching the tripleo core templates18:38
jaosoriorhafe: yes18:38
hafeI have started that path18:38
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Migrate overcloud delete to full workflow  https://review.openstack.org/42280618:39
jaosoriorhafe: would be a matter of adding it to this list, which defines the defaults https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml18:39
hafejaosorior: aware of any description/blog/wiki?18:39
*** sdake_ has joined #tripleo18:39
jaosoriorhafe: https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml#L2418:39
hafejaosorior: done that part18:40
*** hrybacki|afkish is now known as hrybacki|sick18:40
jaosoriorhafe: and making sure that resource is available through the resource registry https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml18:40
hafegot the db and keystone setup18:40
jaosoriorhafe: I'm not aware of any blog or wiki. I know they exist; just haven't seen them :/18:40
hafecurrently looking at adding haproxy support for a vip18:40
*** nyechiel has joined #tripleo18:41
*** dsneddon has joined #tripleo18:41
jaosoriorhafe: that unfortunately is not as dynamic as the rest :/18:41
jaosoriorhafe: you need to modify the haproxy puppet manifest18:41
hafejaosorior: I am a afraid of that18:41
ansiwendearest friends, could you do me a belated christmas present and +2 my changes, which are finally passing CI? https://review.openstack.org/#/c/336562/ and https://review.openstack.org/#/c/398634/18:41
EmilienMbeagles: I was waiting for CI on THT patch18:41
beaglesEmilienM: ack18:42
ansiwenpretty pretty please, I'm working on this since months >_< :-)18:42
*** sdake has quit IRC18:42
EmilienMbeagles: it seems to work18:42
*** apetrich has joined #tripleo18:42
EmilienMbeagles: so lt's go18:42
beaglesgo go patch-merging!18:42
*** hafe has quit IRC18:44
*** rbrady has joined #tripleo18:44
*** hafe has joined #tripleo18:44
jaosorioransiwen: can you pass a link to the ec2 puppet manifests?18:44
ansiwenjaosorior: puppet-tripleo? the first link18:45
*** tosky has quit IRC18:45
bnemecOh for crying out loud.  I forgot to run unit tests on the enable_mistral change.18:45
*** salmankhan has quit IRC18:46
jaosorioransiwen: no, puppet-ec2 or whatever we're using (tried finding it myself but failed)18:46
hafejaosorior: can I in step 2 create a ::tripleo::haproxy::endpoint resource ?18:46
mwhahahaundercloud experts, would be nice to get some reviews on https://review.openstack.org/#/c/400364/18:47
jaosoriorhafe: in your own manifest?18:47
hafejaosorior: yes outside the core haproxy18:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Move nova placement hiera to nova-base  https://review.openstack.org/42274618:47
jaosoriorhafe: I have never thought about that. Maybe you actually can. EmilienM ^^18:48
ansiwenjaosorior: so I just remove the members_options line? I asked before here, but didn't get an answer18:48
openstackgerritBen Nemec proposed openstack/instack-undercloud: Remove enable_(mistral|zaqar) options  https://review.openstack.org/42280218:48
jaosorioransiwen: I didn't see the question :/18:49
bnemecHmm, actually not the python unit tests that failed.18:49
bnemecWhich is somewhat disturbing.18:49
jaosorioransiwen: anyway, please do. I'll check on adding it another time18:49
ansiwenjaosorior: just removing it you mean?18:49
jaosorioransiwen: I'll point it out in the CR18:50
ansiwenjaosorior: that's the manifests, they are already tempest tested in puppet ci, https://github.com/openstack/puppet-ec2api/18:50
jaosorioransiwen: the ec2 metadata endpoint needs no public VIP, right?18:50
ansiwenjaosorior: I assume that, because the nova metadata also doesn't. I just mimiced whatever nova metadata did18:51
jaosorioransiwen: ok, makes sense18:51
*** sdake has joined #tripleo18:51
ansiwenjaosorior: this will change anyway, when we split nova end ec2 metadata from the normal api service18:52
hafejaosorior: I can't hook into step1, so can doing it in step2 cause problems?18:53
*** pkovar has quit IRC18:53
jaosoriorhafe: I don't think so, however, you might need to refresh the haproxy service so it takes the change into account18:53
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Enabling until_complete to be configured dynamically  https://review.openstack.org/41280418:54
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921518:54
*** florianf has quit IRC18:54
*** sdake_ has quit IRC18:54
*** flepied has quit IRC18:55
openstackgerritSven Anderson proposed openstack/puppet-tripleo: Implement Nova ec2api profile  https://review.openstack.org/33656218:55
jaosorioransiwen: found another small detail on the t-h-t patch. Everything else looks fine and I can +2 after it's fixed :)18:55
EmilienMamoralej: ok no problem, email it to openstack-dev if needed with tripleo tag18:55
EmilienMamoralej: so we can discuss it in the open,18:55
amoralejok18:55
EmilienMthanks18:56
EmilienMbnemec: should we close https://bugs.launchpad.net/tripleo/+bug/1657562 ?18:57
openstackLaunchpad bug 1657562 in tripleo "ceph deployments failing on selinux error" [High,Triaged]18:57
EmilienMor do we still hit it?18:57
ansiwenjaosorior: wow, you have good eyes! kudos!18:59
*** crenguta has joined #tripleo19:00
jaosorioransiwen: damn, found more stuff in the puppet-tripleo patch19:00
*** nyechiel has quit IRC19:00
ansiwenjaosorior: well, I'm allowed to push one more time today... so that is ok ;-)19:01
*** derekh has joined #tripleo19:01
*** b00tcat has joined #tripleo19:01
*** b00tcat has joined #tripleo19:01
jaosoriorEmilienM: I think it would be pretty damn cool to build the haproxy endpoint with ensure_resources and pass the the values needed for the endpoint via t-h-t. I don't have time to do it, but if you know someone with spare cycles (not saying you should do it, I know it's a pretty big effort) it would really help deployers just create services19:03
jaosoriorI might have time if I manage to cover most basic services for the TLS-everywhere work19:04
jaosorioransiwen: anyway, the reason we have a nova-metadata.yaml profile that doesn't deploy any puppet is so it fills up some values needed for it, such as the _vip, _node_names, and the _network entries in hiera19:05
EmilienMjaosorior: indeed that would be cool19:05
*** trown|lunch is now known as trown19:05
*** jbcraig has joined #tripleo19:05
EmilienMbut you can't use define from hiera out of the box19:06
bnemecEmilienM: Yep, closed19:06
EmilienMbnemec: thx19:06
bnemecOkay, starving.  Time for lunch.19:07
ansiwenjaosorior: ok, so, I can just use another default in haproxy.pp? or do I have to write a ec2api-metadata.yaml19:08
jaosorioransiwen: depends on what you intend to do19:08
jaosorioransiwen: if ec2 api will ALWAYS be deployed in the same node as nova api, then you can just default19:08
jaosoriorif that's not the case19:08
ansiwenjaosorior: I intend to land it as quickly as possible, and then I'm happy to do refinment :-)19:08
jaosoriorI really recommend writing an ec2api-metadata.yaml19:08
ansiwenjaosorior: I would set the default to ec2_api_network...19:09
jaosorioransiwen: that works for me to be honest19:09
* jaosorior is not so picky19:09
ansiwenjaosorior: in ocata for sure it will always run on the same nodes19:10
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds support to create deployment plan from git repository  https://review.openstack.org/41728019:10
openstackgerritMichele Baldessari proposed openstack/tripleo-image-elements: Add a script to zero /etc/sysconfig/iptables at build time  https://review.openstack.org/42247219:10
openstackgerritMichele Baldessari proposed openstack/tripleo-common: Add the iptables element to the image building process  https://review.openstack.org/42247519:10
ansiwenjaosorior: and I would prefer to do that work when we do a proper splitting of api and metadata19:10
bandiniEmilienM: the two reviews ^ are my take on the firewall bug at this point. I think in the end it is better we clean /etc/sysconfig/iptables as enabling purging by default might be too disruptive for existing clouds19:11
jaosorioransiwen: works for me19:11
jaosorioransiwen: lets then default the network and values for the metadata to match ec2 api19:11
*** thrash is now known as thrash|biab19:11
EmilienMbandini: nice, let me look19:12
ansiwenjaosorior: just to make sure I understand correctly: I just change line 582 in haproxy.pp, or something else?19:12
jaosoriorhafe: actually, adding what you did should work in theory19:13
EmilienMbandini: it sounds good to me.19:13
EmilienMbandini: and then, should we enable purge by default in tripleo?19:13
jaosoriorhafe: this https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/haproxy.pp#L101 should make sure that any changes to those values make haproxy reload19:13
ansiwenjaosorior: oh, I see, the _vip stuff... ok19:13
*** sdake has quit IRC19:14
EmilienMbandini: or do we keep it to False for backward compat?19:14
bandiniEmilienM: I would be a bit hesitant to enable it by default. We should probably first find out if there are folks adding iptables rules outside of pupped. if we have folks doing that then we do *not* want purge by default on19:14
bandiniIf that is not the case then we could enable it I guess19:14
EmilienMthat sounds fair19:15
jaosorioransiwen: I can point it out better in the patch19:15
jaosoriorlet me do that19:15
hafejaosorior: thanks I will give a try then19:16
ansiwenjaosorior: I'll remove the ec2_api_metadata_network parameter then, ok?19:16
jaosorioransiwen: commented.19:17
*** zaneb has quit IRC19:17
*** zaneb has joined #tripleo19:17
*** sdake has joined #tripleo19:17
jaosoriorEmilienM: holy shit19:19
jaosoriorEmilienM: the pingtest passed for the tls-everywhere job :D19:19
*** sdake_ has joined #tripleo19:20
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Remove Glance Registry from undercloud  https://review.openstack.org/41721419:20
jaosoriorbnemec: ^^19:20
EmilienMjaosorior: exit 0 works for me too19:20
EmilienMjaosorior: :)19:20
bnemecRemove all the things!19:21
* bandini hits the sack. night everyone19:21
EmilienMbandini: peace19:21
jaosoriorEmilienM: hahahaha19:21
jaosorioranyway19:21
jaosoriorfucking passed!! yes!!19:21
EmilienM"I don't understand how my code worked"19:22
EmilienMWelcome to TripleO!19:22
*** sdake has quit IRC19:22
openstackgerritMerged openstack/tripleo-heat-templates: Add entry in serviceNetMap for Nova Placement  https://review.openstack.org/42228019:23
jristrofl19:23
openstackgerritMerged openstack/puppet-tripleo: Use network entries for nova placement  https://review.openstack.org/42228119:24
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Move nova::placement to common nova manifest  https://review.openstack.org/42273919:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Move nova placement hiera to nova-base  https://review.openstack.org/42274619:25
*** absubram has joined #tripleo19:25
EmilienMjaosorior: please review https://review.openstack.org/#/c/422258/19:25
jaosoriorEmilienM: can you check this out https://review.openstack.org/#/c/391738/ ? That's the commit that implements the TLs-everywhere job. It's currently in the experimental queue, but the plan is to move it tot he periodic one. This https://review.openstack.org/#/c/419529/26 is a hack I did so the TLS-everywhere job would run instead of the ovb-ha job. This is becaues the experimental queue is the last to be19:26
jaosoriorprioritized, and testing it would have been way harded.19:26
jaosorior*way harder19:26
EmilienMjaosorior: I swear I'll look at it today but not this afternon19:27
EmilienMI'm currently dealing with exiting stuffs about release management19:27
jaosoriorEmilienM: alright19:27
EmilienMjaosorior: I have a last patch ready for review, it's a quick one https://review.openstack.org/#/c/422146/19:28
*** spredzy has quit IRC19:28
EmilienMansiwen: I think I asked if we could include https://review.openstack.org/#/c/406167/ in the other patch, so we test in the same time we add the code19:29
EmilienMansiwen: can you do it please?19:29
*** jkilpatr has quit IRC19:29
*** tesseract has quit IRC19:29
ansiwenEmilienM: I did already, just restored that to test it also in the nonha job...19:29
ansiwenEmilienM: I added it to scenario002 in the main change19:30
crengutaA19:30
EmilienMansiwen: cool19:30
jaosoriorsshnaidm: can you re-check this https://review.openstack.org/#/c/391738/ ?19:30
jaosoriorsshnaidm: it's the TLs patch, and it's working here https://review.openstack.org/#/c/419529/26 it runs there instead of the ovb-ha job (cause experimental queue takes too long)19:31
*** dprince has quit IRC19:32
*** openstackgerrit has quit IRC19:33
jaosoriorderekh: hey dude! Thanks for the tip on the CIDR, that did the trick :D19:33
derekhjaosorior: cool, no prob19:34
* jaosorior is too excited... tequila shots are to come19:34
derekh\o/19:34
*** openstackgerrit has joined #tripleo19:34
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates: Configure nova neutron parameter for L to M upgrade  https://review.openstack.org/42283719:34
jaosoriorderekh: I know it must be extremely late there, but if you get a chance, could you check this out https://review.openstack.org/#/c/391738/ ?19:34
jaosoriorderekh: this is where I triggered it to bypass the long waiting for the experimental queue https://review.openstack.org/#/c/419529/2619:35
*** dougbtv has quit IRC19:37
derekhjaosorior: I'm on a train at the moment, mind if I take a look later on?19:37
openstackgerritSven Anderson proposed openstack/puppet-tripleo: Implement Nova ec2api profile  https://review.openstack.org/33656219:38
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates: Add ec2-api service  https://review.openstack.org/39863419:38
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates: DON'T MERGE - tester for I2510fd4ed935d8423216fff9ce3adf2d69c9c804  https://review.openstack.org/40616719:38
jaosoriorderekh: works for me19:39
*** dougbtv has joined #tripleo19:40
derekhjaosorior: cool, will take a look later19:40
*** derekh has quit IRC19:41
openstackgerritEmilien Macchi proposed openstack/tripleo-image-elements: Purge chrony package in NTP element  https://review.openstack.org/42283919:41
ansiwenjaosorior: thanks a lot for the good review!19:41
ansiwenjaosorior: pushed everything19:41
openstackgerritEmilien Macchi proposed openstack/tripleo-common: overcloud: include ntp element  https://review.openstack.org/42284019:42
*** jkilpatr has joined #tripleo19:44
jaosorioransiwen: sure, gonna have lunch and I'll check it out again after that19:45
*** rbrady has quit IRC19:46
*** david-lyle has joined #tripleo19:48
*** shinobu_ has joined #tripleo19:49
*** karimb has quit IRC19:49
shinobu_EmilienM: can i ask quick question?19:50
shinobu_maybe it's silly ...19:50
*** rbrady has joined #tripleo19:51
*** rbrady has joined #tripleo19:51
larsksshinobu_: just ask.19:54
shinobu_yeah i'm just now writing...19:55
shinobu_EmilienM: is there any flag that existing overcloud nodes won't be affected by scaling-out or updating?19:55
shinobu_like `unmutable`....19:57
shinobu_*immutable*19:57
*** hjensas has joined #tripleo19:59
*** hjensas has quit IRC19:59
*** hjensas has joined #tripleo19:59
*** jmelvin has quit IRC20:02
*** rbrady has quit IRC20:03
*** absubram has quit IRC20:06
openstackgerritJason E. Rist proposed openstack/tripleo-ui: Adds ids namespaced artifacts on plans page.  https://review.openstack.org/41110220:06
*** salmankhan has joined #tripleo20:07
openstackgerritMerged openstack/puppet-tripleo: Implement NTP profile  https://review.openstack.org/31072520:08
openstackgerritMerged openstack/tripleo-heat-templates: Deploy NTP with puppet-tripleo profile  https://review.openstack.org/42216720:08
*** lblanchard has quit IRC20:09
*** jprovazn has quit IRC20:09
*** amoralej is now known as amoralej|off20:09
*** nyechiel has joined #tripleo20:11
*** salmankhan has quit IRC20:11
*** kjw3 has quit IRC20:14
*** kjw3 has joined #tripleo20:14
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras: collect logs: ignore all errors  https://review.openstack.org/42131620:14
*** karimb has joined #tripleo20:15
*** thrash|biab is now known as thrash20:16
*** dprince has joined #tripleo20:17
jaosorioransiwen: your patches LGTM, will +2 once they pass CI20:17
*** nyechiel has quit IRC20:21
*** panda|bbl is now known as panda20:24
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI  https://review.openstack.org/41039220:26
*** jmelvin has joined #tripleo20:27
*** trown is now known as trown|brb20:33
openstackgerritMerged openstack/instack-undercloud: ntp: make sure chrony is purged before  https://review.openstack.org/42216420:34
openstackgerritMerged openstack-infra/tripleo-ci: enable Placement API on multinode jobs  https://review.openstack.org/42225820:36
*** milan has quit IRC20:40
*** karimb has quit IRC20:41
*** milan has joined #tripleo20:41
*** trown|brb is now known as trown20:42
jaosoriortrown: do you review tripleo-ci CRs?20:43
trownjaosorior: CR=code-review? ... I review tripleo-ci patches ya20:45
jaosoriortrown: Change Request? dammit... I should just use the word patch, it's probably better20:46
trownlol20:46
jaosoriortrown: anyway, could you check this out https://review.openstack.org/#/c/391738/ ?20:46
EmilienMas long as you don't say PR20:46
trownjaosorior: sure20:47
EmilienMshinobu_: in that case, why would you manage the overcloud nodes with tripleo?20:47
jaosoriortrown: right now that job is on the experimental gate... which takes a VERY long time to run due to it being the lowest in priority. So to bypass that I ran it here https://review.openstack.org/#/c/419529/2620:48
trownjaosorior: ah, that came up on the CI squad meeting today, we didnt know what that fakeha-caserver job was20:48
jaosoriortrown: you can see the result on the ovb-ha gate20:48
jaosoriortrown: it's basically the TLS-everywhere job. Hoewver, the name came up from how we set up the jobs in CI.20:49
trownjaosorior: is there a barrier to making that a multinode job?20:49
jaosoriortrown: yes20:49
jaosoriortrown: in the long term we want to use something called novajoin, which is a vendordata plugin that will add a script to cloud-init to do the CA enrollment. AFAIK, cloud init doesn't run on the multinode jobs20:50
jaosoriortrown: on the other hand, the multinode jobs rely on the DeployedServer resource, which doesn't handle nova-metadata setting; this is also needed by novajoin20:51
trownjaosorior: cool, seems like a good candidate for OVB then :)20:51
*** b00tcat has quit IRC20:51
slagle_you could do the CA enrollment on multinode jobs, just not using novajoin20:52
slagle_if all you need to do is run a script20:53
jaosoriorslagle_: yeah, however, for getting the service principals that will be used for the certificates, we really need that metadata part20:53
jaosoriorelse, we will have enrolled nodes, but since the service principals will be missing, we won't be able to request the certicicates from the CA20:54
jaosoriorslagle_: I have a WIP patch to add that functionality for DeployedServer... But I didn't finish up getting the tests to pass. And considering that I don't actually have that in my backlog (did it on my free time) I don't think I'll finish that up any time soon :/20:55
*** cmyster has quit IRC20:56
*** cmyster has joined #tripleo20:56
jaosorioranyway, for now, to get everything to work, OVB is actually the best bet. I can check on moving it to multinode once it's possible20:56
*** pablo|500| has quit IRC20:57
jaosoriorslagle_: I just uploaded my WIP without my lame attempt at tests https://review.openstack.org/#/c/422868/20:58
*** ccamacho has quit IRC20:59
openstackgerritMerged openstack/diskimage-builder: Allow disto-specific mirror settings  https://review.openstack.org/40885021:00
slagle_jaosorior: that might work, although i'm not sure i see where the actual deployed server might query that metadata21:01
slagle_jaosorior: or would you pass it in by a parameter or something?21:01
jaosoriorslagle_: DeployedServer already has the metadata proprety, which AFAIK is not actually for heat, but for nova metadata.21:02
jaosoriorslagle_: it's pretty much the same parameter from the OS::Nova::Server resource.21:02
slagle_there's no way for Heat to inject that metadata though b/c the server doesn't exist in nova21:03
jaosoriorslagle_: ah, doesn't it?21:03
slagle_nova may not even be there21:03
slagle_DeployedServer's do not have to be nova instances21:03
jaosoriorcrap21:03
jaosoriorall this time I thought it was21:03
slagle_what i meant when i said it ought to be possible via multinode, was just that we can run any arbitrary script on the nodes before starting the deployment21:04
slagle_now, granted, i don't know how any of the CA enrollment or service principals stuff works, but maybe there's a way21:05
jaosoriorslagle_: yeah, and that part is not really the issue. The issue is filling up all the service principals, which depend on which services are installed on which nodes, and for what networks it should go.21:05
jaosoriorright now, the way the current tls-everywhere job works, it pre-creates all those entries21:05
jaosoriorbut for real deployments that's quite unusable21:05
jaosoriorwhich is the reason novajoin is helpful here21:05
jaosoriorcause it addresses that21:05
sshnaidmjaosorior, why don't you include log collection into the main patch?21:06
jaosoriorsshnaidm: cause the log collection for the extra node didn't actually collect the logs. I can do that in a subsequent patch. Cause it would be useful.21:07
sshnaidmjaosorior, oh, ok21:07
jaosoriorsshnaidm: I haven't figured out why the logs were empty21:07
jaosoriorslagle_: also, the nice thing about novajoin is that it cleans up by itself when a node is deleted, and will also handle scaling. So it's a huge usability improvement compared to handling all those entries manually21:08
openstackgerritMerged openstack/instack-undercloud: ssh: use tripleo profile to deploy SSH  https://review.openstack.org/42214621:08
openstackgerritMerged openstack/puppet-tripleo: Adds etcd  https://review.openstack.org/41473021:08
openstackgerritMerged openstack/python-tripleoclient: Switch undercloud upgrade to use upgrade script  https://review.openstack.org/41911821:09
*** ccamacho has joined #tripleo21:09
*** milan has quit IRC21:10
*** jkilpatr has quit IRC21:10
openstackgerritMerged openstack/tripleo-heat-templates: Enabling until_complete to be configured dynamically  https://review.openstack.org/41280421:10
*** milan has joined #tripleo21:11
jaosoriortrown: replied21:11
openstackgerritMerged openstack/diskimage-builder: Fix dhcp-all-interfaces for ubuntu-minimal xenial  https://review.openstack.org/40772521:11
*** jkilpatr has joined #tripleo21:12
pandaEmilienM: bnemec: https://bugs.launchpad.net/tripleo/+bug/1657173/comments/221:13
openstackLaunchpad bug 1657173 in tripleo "sshd failing to start on undercloud" [High,Triaged]21:13
mwhahahahmm i'm getting an introspection failure on a fresh install, do we have any open items around that?21:13
trownjaosorior: thanks21:14
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Semi-automatic doc generation of element dependency  https://review.openstack.org/42287421:14
EmilienMmwhahaha: where exactly?21:15
EmilienMdo you see a mistral trace?21:15
jaosoriortrown: thanks dude :D21:15
*** absubram has joined #tripleo21:15
mwhahahaEmilienM: not yet, need to go looking. My local ovb deployment is currently hanging on introspection21:15
mwhahahaEmilienM: i'm using the same process i always do (which follows our docs)21:15
EmilienMpanda: yes I think I'm fixing it with https://review.openstack.org/#/c/422146/21:16
*** radeksmg has quit IRC21:16
*** radeks has quit IRC21:16
sshnaidmjaosorior, I think get_host_info failed because "need tty", you don't have "-tt": ssh $SSH_OPTIONS centos@$EXTRA_NODE_IP sudo /tmp/get_host_info.sh21:16
EmilienMpanda: because the puppet profile in puppet-tripleo use hastatus parameter in the service resource, so it doesn't check resource "status"21:16
jaosoriorsshnaidm: I think you're right21:18
jaosoriorsshnaidm: I could submit a subsequent patch that does that log collection cleaner21:18
*** leanderthal has quit IRC21:18
sshnaidmjaosorior, but it doesn't explain why created archive tar.xz is broken21:18
jaosoriorsshnaidm: well, if get_host_info didn't get run cause of that issue, then the rest wold be empty21:19
jaosoriorsshnaidm: so the tar command would be trying to run against an emty tar and it would fail21:19
*** b00tcat has joined #tripleo21:19
*** b00tcat has joined #tripleo21:19
*** jkilpatr has quit IRC21:20
sshnaidmjaosorior, the tar command is independent, it runs like: ssh $SSH_OPTIONS -tt centos@$EXTRA_NODE_IP $TARCMD > ..21:21
*** crenguta has quit IRC21:24
sshnaidmjaosorior, ok, we can investigate it in next patches21:25
jeckersbtrown: i have something "fun" for you to be aware of21:26
jeckersb(maybe you are already aware)21:26
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TESTING: Adding missing -tt  https://review.openstack.org/42288221:26
jaosoriorsshnaidm: ^^ trying it out there, if that works, I'll push that in a subsequent commit to the TLS patch21:26
jaosoriorsshnaidm: don't wanna touch the other testing patch to ease people reviewing the TLS-everywhere gate patch21:27
sshnaidmjaosorior, sure21:27
jeckersbtrown: i consistently can't use quickstart because qemu-img is crashing out with SIGILL21:27
jeckersbi think this is maybe a centos-only thing21:27
jeckersbjust curious if you've seen it21:27
jeckersbwell to be fair, not so much quickstart but just trying to do an overcloud deploy from the undercloud21:28
jeckersbor if you start seeing it, come talk to me :)21:28
*** dprince has quit IRC21:28
*** dprince has joined #tripleo21:28
*** jayg is now known as jayg|g0n321:29
*** jcoufal has quit IRC21:30
*** jkilpatr has joined #tripleo21:34
*** david-lyle has quit IRC21:35
*** thrash is now known as thrash|g0ne21:37
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs viewable with browser  https://review.openstack.org/42263821:39
trownjeckersb: hmm, I have not seen anything like that21:39
trownjeckersb: what is qemu-img doing?21:39
*** david-lyle has joined #tripleo21:39
*** david-lyle has joined #tripleo21:39
jeckersbtrown: ironic does "qemu-img convert" when trying to deploy the overcloud21:40
openstackgerritMerged openstack/tripleo-docs: OVS DPDK deployment documentation  https://review.openstack.org/39543121:40
jeckersband it just crashes out with SIGILL, something to do with intel AVX2 instructions as best as i can tell...21:40
jeckersbeven though i have that capability on both my hypervisor and undercloud21:40
*** milan has quit IRC21:40
jeckersbtrown: this is with... qemu-img-ev-2.6.0-27.1.el7.x86_64 on the undercloud21:41
*** milan has joined #tripleo21:41
jeckersbi don't know if just that build is buggy or something21:41
jeckersbi see in the changelog... http://cbs.centos.org/koji/buildinfo?buildID=1388421:41
jeckersb- kvm-target-i386-Add-more-Intel-AVX-512-instructions-supp.patch [bz#1372455]21:42
jeckersbi'm thinking maybe that's when it broke21:42
jeckersbnote there is a separate qemu-ev repo that gets pulled in21:42
*** jkilpatr has quit IRC21:42
jeckersbin delorean-deps.repo - baseurl=http://mirror.centos.org/centos/7/virt/$basearch/kvm-common/21:42
jeckersbmaybe this has only recently been added21:43
jeckersband before older versions of qemu-img were getting installed21:43
* jeckersb shrugs21:43
jeckersbi just don't see how i would be the only person hitting this21:43
jeckersbso i suspect if nobody has seen it yet, maybe i'm just the first21:43
trownjeckersb: interesting, I have definitely not seen that21:48
*** ansmith has quit IRC21:48
*** shinobu__ has joined #tripleo21:50
jeckersbtrown: when it happens you'll see the overcloud fail to deploy with some generic "not enough hosts" error, and in ironic-conductor.log you'll see an error that qemu-img failed with status -4 and no stdout/stderr21:50
jeckersbtrown: so be on the lookout ;)21:50
pandajeckersb: and it happens every time ?21:51
jeckersbpanda: yep21:52
*** b00tcat` has joined #tripleo21:52
jeckersbpanda: i can reproduce it by just running...21:52
*** iranzo has quit IRC21:52
trownjeckersb: hmm, we do get random generic nova errors like that in ci.centos, but it is in the 1/5 to 1/10 range not 10/1021:52
jeckersb[stack@undercloud ~]$ qemu-img convert -O raw overcloud-full.qcow2 overcloud-full.qcow2.converted21:52
jeckersbIllegal instruction21:52
*** b00tcat has quit IRC21:52
jeckersbgdb shows it to be something with avx2 extensions21:53
jeckersbhttps://paste.fedoraproject.org/531094/84862973/21:56
jeckersbthis could maybe be a result of changing the way the vcpus get defined?21:59
jeckersbif something has changed there recently21:59
jeckersbalthough once again i wouldn't expect to be the first one to find it21:59
pandaoh, again with the wrong cpu flags ? :(22:00
jeckersbwell the weird thing is, it looks like the flags are correct22:00
jeckersb[stack@undercloud ~]$ grep -o avx2 /proc/cpuinfo22:01
jeckersbavx222:01
jeckersbthat should be sufficient iiuc22:01
pandajeckersb: that could mean it's advertising a flag that is not really supported22:01
jeckersbthe qemu cmdline also has +avx222:02
jeckersband the hypervisor supports avx2 as well22:02
openstackgerritAndrey Shestakov proposed openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option  https://review.openstack.org/41659322:03
*** ccamacho has quit IRC22:05
openstackgerritMerged openstack/tripleo-heat-templates: Adds etcd composable service  https://review.openstack.org/41475122:07
*** milan has quit IRC22:10
*** milan has joined #tripleo22:11
openstackgerritJames Slagle proposed openstack/tripleo-docs: Add docs for using already deployed servers  https://review.openstack.org/42036922:11
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates: Configure nova neutron parameter for L to M upgrade  https://review.openstack.org/42283722:11
jaosoriorbnemec: hey dude, if you get some time, this needs one more +2 https://review.openstack.org/#/c/391738/ :D22:17
*** jkilpatr has joined #tripleo22:17
*** hafe has quit IRC22:18
*** Goneri has quit IRC22:19
*** jeckersb is now known as jeckersb_gone22:20
*** ccamacho has joined #tripleo22:21
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI  https://review.openstack.org/41039222:22
*** spredzy has joined #tripleo22:25
*** trown is now known as trown|outtypewww22:25
openstackgerritFeng Pan proposed openstack/tripleo-heat-templates: Allow dnsmasq_dns_servers to be configured for DHCP Agent  https://review.openstack.org/42289822:33
*** pmannidi has joined #tripleo22:37
*** milan has quit IRC22:40
*** milan has joined #tripleo22:41
*** sdake_ has quit IRC22:44
dmsimarddprince, EmilienM: is there any job actually testing the container deployments (i.e, in https://review.openstack.org/#/c/416421/ ?)22:47
EmilienMdmsimard: yes it's experimental now22:47
EmilienMbut it's moving to check -nv very soon22:47
EmilienMthis week22:47
dmsimardso just "check experimental" and I'm good ?22:47
EmilienMit should22:47
dmsimardok ty22:47
EmilienMdmsimard: check zuul layout otherwise?22:48
dmsimardEmilienM: well I saw a check experimental but22:48
dmsimard"gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv"22:48
dmsimarddoesn't really tell me whether this is containerized or not22:48
EmilienMit's not22:50
EmilienMlet me check, a sec22:50
EmilienMI'm sure bkero knows more22:50
* EmilienM reading zuul layout22:50
EmilienMgate-tripleo-ci-centos-7-ovb-containers-oooq22:51
EmilienMin experimental-tripleo-jobs22:51
EmilienMso yeah, check experimental...22:51
dprincedmsimard: I'll be working on the undercloud installer job for this soon22:51
dmsimardEmilienM: well I ctrl+f'd the console log and there's several mentions of docker :P22:51
dprincedmsimard: we are iterating right now to get a fully working undercloud with this setup22:51
openstackgerritDavid Moreau Simard proposed openstack/tripleo-heat-templates: Do not merge: test rdoproject docker images  https://review.openstack.org/42290522:52
dmsimarddprince: ok, fyi ^22:52
jaosoriorbnemec: thanks for the review dude22:55
jaosoriorand also for all the help with the stuff related to that patch22:55
bnemecjaosorior: np.  I'm just glad I didn't have to do it. :-)22:57
jaosoriorlol22:57
*** owalsh has joined #tripleo22:58
*** jmelvin has quit IRC23:00
*** david-lyle has quit IRC23:03
*** absubram has quit IRC23:05
EmilienMdmsimard: you need to check experimental23:06
dmsimardforgot, thanks23:06
*** absubram has joined #tripleo23:09
*** milan has quit IRC23:10
*** b00tcat` has quit IRC23:11
bnemechttps://review.openstack.org/#/c/422785/ passed ci23:11
*** milan has joined #tripleo23:11
bnemecAnd will save a bunch of time in ha and updates jobs.23:11
jaosoriorbnemec: aw, it conflicts with the tls job :(23:12
*** [1]cdearborn has quit IRC23:12
*** flepied has joined #tripleo23:13
bnemecYeah, it conflicts with a bunch of my stuff too.23:13
bnemecBut on the plus side, the rebases will finish ci faster. :-)23:13
jaosoriorbeing in patch 103 makes one very desperate23:13
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect lgos for container only if docker runs  https://review.openstack.org/42290923:17
EmilienMbnemec, slagle_: I noticed gate-tripleo-ci-centos-7-3nodes-multinode has been red for some days23:18
bnemecGiven the ugly merge conflict situation, https://review.openstack.org/#/c/422785 and https://review.openstack.org/#/c/422795 should merge together if we can manage it.23:18
bnemecEmilienM: If it doesn't have ovb in the name I haven't been paying attention. ;-)23:18
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect logs for containers only if docker runs  https://review.openstack.org/42290923:19
EmilienMbnemec: ...23:19
EmilienMsound slike it broke 3 days ago23:19
EmilienMbnemec: it sounds like a promotion might have broken it23:22
EmilienMrpm diff shows a lot of diff in openstack packages23:22
*** ccamacho has quit IRC23:22
*** absubram has quit IRC23:23
bnemecYeah, we've promoted at least a couple of times since then.23:23
*** rlandy has quit IRC23:24
EmilienMok I think I found why23:24
EmilienMhttp://logs.openstack.org/46/422746/3/check/gate-tripleo-ci-centos-7-3nodes-multinode-nv/2706f15/logs/subnode-3/var/log/cinder/volume.txt.gz#_2017-01-19_21_55_26_72923:25
EmilienMit's when we removed glance registry23:25
jaosoriorbnemec: well, you have my +2s in both commits already.23:26
jaosoriorEmilienM: that's a funky error, how come we're ont seeing that on other jobs?23:27
EmilienMjaosorior: i'm investigating :D23:27
EmilienMbut I don't see glance api logs anyuwhere23:27
bnemecLooks like the current promote job is going to fail: http://logs.openstack.org/15/359215/40/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/c9a489e/logs/undercloud/var/log/undercloud_install.txt.gz#_2017-01-19_21_56_20_00023:27
EmilienMoh here http://logs.openstack.org/46/422746/3/check/gate-tripleo-ci-centos-7-3nodes-multinode-nv/2706f15/logs/subnode-2/var/log/glance/api.txt.gz23:27
bnemecOr has failed, actually.23:27
EmilienMbnemec: yeah puppet CI failed to promoted also23:27
EmilienMsomething is broken with sahara23:28
bnemecOh, ours failed on gnocchi.23:28
EmilienMpradk: ^23:28
EmilienMsshnaidm: btw when do we add scenarios to promotion pipeline?23:28
EmilienMI hope sshnaidm sleep23:28
bnemecI'm shocked that there are multiple problems at once.23:28
EmilienMlol23:29
EmilienMstop trolling!23:29
sshnaidmEmilienM, it's in todo list, the sleep is too :)23:29
sshnaidmEmilienM, will try it in Sun next week23:29
EmilienMgo sleep first23:29
EmilienMbnemec: btw, tomorrow I'm on PTO23:29
EmilienMbnemec: i'll redirect all the irc pings to you, I have a script23:30
bnemecEmilienM: A likely story. :-P23:30
EmilienMWHAT? i never take pto !23:30
bnemecThere's a reason I've never run for PTL of any project I've ever worked on.23:30
EmilienMI'll me 3500 feets in the air trying to not crash my cessna23:30
EmilienMs/me/be/23:31
bnemecEmilienM: I think you just want to ignore IRC so you can actually get work done. ;-)23:31
EmilienM:D23:31
EmilienMok I found the fix for the 3node jobs23:32
openstackgerritAlexander Chuzhoy proposed openstack/tripleo-docs: Reconfigure ironic in already delpoyed overcloud to erase only the metadata, instead of the entire disk.  https://review.openstack.org/42203323:32
bnemecEmilienM: Also, I would like to formally request that you not crash.23:32
bnemecI feel like we had that same error when we removed it in the other jobs.23:33
bnemecThe "# remove it https://review.openstack.org/#/c/417109 is merged." bit?23:33
EmilienMbnemec: i won't, I'll be with my instructor this time23:33
EmilienMbnemec: doing my second cross country flight23:33
*** milan has quit IRC23:33
bnemecEmilienM: Nice.  You'll have to fly down and visit sometime. :-)23:34
EmilienMI'll need to refuel 5 or 6 times I guess23:34
bnemecBah, it's not that far from Canada to Minnesota.23:35
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: multinode: remove 417109 workaround  https://review.openstack.org/42291323:36
EmilienMok this patch is not going to fix but cleanup23:36
EmilienMI have another one to fix23:36
*** flepied has quit IRC23:36
EmilienMI would like to thank slagle_23:37
EmilienMI found a bug thanks to his CI job 3node23:37
EmilienMslagle_: when you separate cinder-api and cinder-volume, you need glance parameters, cinder-volume use it for boot ffrom volume23:37
EmilienMand until now we never saw it until this 3nodes job23:37
jaosoriorEmilienM: have a good flight dude!23:38
* EmilienM sends kudos23:38
jaosoriorI gotta go23:38
EmilienMjaosorior: peace23:38
jaosoriorgood day everyone23:38
*** jaosorior has quit IRC23:38
*** sanagikoki has quit IRC23:39
* bnemec needs to go too23:41
bnemecEmilienM: Have a good long weekend.23:41
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: cinder: move glance params into common  https://review.openstack.org/42291523:41
EmilienMbnemec: o/23:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: cinder: move glance params into base  https://review.openstack.org/42291623:42
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: cinder: move glance params into common  https://review.openstack.org/42291523:43
*** dmacpher has quit IRC23:43
EmilienMok these 2 patches should fix the 3node job23:43
*** panda is now known as panda|Zz23:44
panda|Zzsshnaidm: I think we're good with https://review.openstack.org/421272, tempest was running for 1 hour (remapped tempest oooq to gate-tripleo-ci-centos-7-ovb-nonha )23:47
*** pradk has quit IRC23:49
sshnaidmpanda|Zz, yeah, seems good23:49
openstackgerritPradeep Kilambi proposed openstack/tripleo-puppet-elements: Remove carbonara package reference  https://review.openstack.org/42292023:50
*** pradk has joined #tripleo23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!