Tuesday, 2017-07-11

*** bkopilov has joined #tripleo00:00
*** oanson has joined #tripleo00:01
*** michapma has quit IRC00:05
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339100:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)00:10
*** ooolpbot has quit IRC00:10
*** jkilpatr has quit IRC00:11
*** brandor5 has joined #tripleo00:13
brandor5hey everyone: is there a reason that /etc/hosts would be very sparse on the overcloud nodes? I'm expecting entries for all the overcloud nodes but only seeing vip entries00:14
*** rlandy is now known as rlandy|bbl00:19
*** vfarias has quit IRC00:20
openstackgerritMerged openstack/tripleo-docs master: Contribute to Contributor renaming  https://review.openstack.org/48175500:23
brandor5anyone?00:27
*** tosky has quit IRC00:28
*** brandor5 has quit IRC00:41
*** limao has joined #tripleo00:48
*** achadha has quit IRC00:48
*** achadha has joined #tripleo00:48
*** lblanchard has joined #tripleo00:51
*** ecerquei has joined #tripleo00:52
*** achadha has quit IRC00:53
*** oanson has quit IRC00:54
*** bkopilov has quit IRC00:54
*** oanson has joined #tripleo00:56
*** bkopilov has joined #tripleo00:57
*** achadha has joined #tripleo01:01
*** zzzeek_ has quit IRC01:09
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339101:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)01:10
*** ooolpbot has quit IRC01:10
*** zzzeek_ has joined #tripleo01:11
*** bkopilov has quit IRC01:16
*** bkopilov has joined #tripleo01:16
*** achadha has quit IRC01:19
*** achadha has joined #tripleo01:19
*** achadha has quit IRC01:24
*** ansmith_ has joined #tripleo01:26
*** ansmith has joined #tripleo01:26
*** zzzeek_ has quit IRC01:33
*** zzzeek_ has joined #tripleo01:34
*** zzzeek_ has quit IRC01:36
*** samdoran has quit IRC01:38
*** ansmith_ has quit IRC01:40
*** ansmith has quit IRC01:40
*** dixiaoli has joined #tripleo01:46
*** zzzeek_ has joined #tripleo01:47
*** gkadam has joined #tripleo01:49
*** yamahata has quit IRC01:50
*** fzdarsky_ has joined #tripleo01:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Allow to set Notification Driver to 'noop'  https://review.openstack.org/48172601:52
*** fzdarsky|afk has quit IRC01:55
*** bkopilov has quit IRC01:59
*** dixiaoli_ has joined #tripleo02:04
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Allow to set Notification Driver to 'noop'  https://review.openstack.org/48172602:05
*** ramishra has joined #tripleo02:07
*** dixiaoli has quit IRC02:07
*** achadha has joined #tripleo02:08
*** dmacpher has joined #tripleo02:08
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339102:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)02:10
*** ooolpbot has quit IRC02:10
*** ramishra has quit IRC02:11
*** ramishra has joined #tripleo02:11
*** limao has quit IRC02:12
*** limao has joined #tripleo02:12
*** achadha has quit IRC02:12
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175902:18
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175902:18
*** brault has quit IRC02:27
*** sshnaidm has quit IRC02:28
*** achadha has joined #tripleo02:34
*** sshnaidm has joined #tripleo02:41
*** achadha has quit IRC02:43
*** ramishra has quit IRC02:46
*** ramishra has joined #tripleo02:48
*** dsariel has quit IRC03:09
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339103:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)03:10
*** ooolpbot has quit IRC03:10
*** lblanchard has quit IRC03:10
*** rlandy|bbl is now known as rlandy03:15
*** rlandy has quit IRC03:16
*** bkopilov has joined #tripleo03:18
*** dmacpher has quit IRC03:29
*** michapma has joined #tripleo03:32
openstackgerritAmrith Kumar proposed openstack/diskimage-builder master: Allow users to specify partition type in the MBR PTE  https://review.openstack.org/48239603:32
*** dmacpher has joined #tripleo03:33
*** achadha has joined #tripleo03:34
*** limao has quit IRC03:34
*** dixiaoli has joined #tripleo03:38
*** dixiaoli_ has quit IRC03:39
*** links has joined #tripleo03:41
*** udesale has joined #tripleo03:46
*** dixiaoli has quit IRC03:49
*** fragatin_ has joined #tripleo03:51
*** fragatin_ has quit IRC03:52
*** fragatin_ has joined #tripleo03:52
*** sshnaidm has quit IRC03:53
*** fragatina has quit IRC03:54
*** fragatin_ has quit IRC03:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Allow to set Notification Driver to 'noop'  https://review.openstack.org/48172603:57
*** nyechiel has joined #tripleo03:58
*** psachin has joined #tripleo04:00
*** fragatina has joined #tripleo04:05
*** sshnaidm has joined #tripleo04:09
*** fragatina has quit IRC04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339104:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)04:10
*** ooolpbot has quit IRC04:10
*** mdnadeem has joined #tripleo04:10
*** nyechiel has quit IRC04:20
*** limao has joined #tripleo04:28
*** dtrainor has quit IRC04:32
*** jrist has quit IRC04:33
*** dparkes has joined #tripleo04:36
*** ykarel has joined #tripleo04:39
*** dparkes has quit IRC04:41
*** dtrainor has joined #tripleo04:53
*** noslzzp has quit IRC04:54
*** jprovazn has joined #tripleo04:57
*** marios has joined #tripleo05:06
*** pmannidi has quit IRC05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339105:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)05:10
*** ooolpbot has quit IRC05:10
*** ratailor has joined #tripleo05:10
*** achadha has quit IRC05:12
*** pmannidi has joined #tripleo05:13
*** pmannidi has quit IRC05:13
*** dixiaoli has joined #tripleo05:17
*** d0ugal has joined #tripleo05:23
*** agurenko has joined #tripleo05:28
*** zaneb has quit IRC05:29
*** zaneb has joined #tripleo05:29
*** dpawar has joined #tripleo05:32
*** dsariel has joined #tripleo05:33
*** lmiccini has joined #tripleo05:33
*** iranzo has joined #tripleo05:34
*** iranzo has quit IRC05:34
*** iranzo has joined #tripleo05:34
*** limao has quit IRC05:36
*** limao has joined #tripleo05:36
*** nyechiel has joined #tripleo05:37
*** jprovazn has quit IRC05:39
*** pliu_ has joined #tripleo05:40
*** rcernin has joined #tripleo05:41
*** skramaja has joined #tripleo05:44
*** nyechiel_ has joined #tripleo05:46
*** dpawar has quit IRC05:46
*** nyechiel has quit IRC05:46
*** d0ugal has quit IRC05:52
*** dsariel has quit IRC05:56
*** gkadam has quit IRC05:56
*** gkadam has joined #tripleo05:58
*** masco has joined #tripleo06:01
*** pcaruana has joined #tripleo06:04
*** dpawar has joined #tripleo06:05
*** dsariel has joined #tripleo06:06
*** jprovazn has joined #tripleo06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339106:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)06:10
*** ooolpbot has quit IRC06:10
*** bogdando has joined #tripleo06:10
*** gkadam has quit IRC06:17
*** gkadam has joined #tripleo06:17
*** gkadam has quit IRC06:18
*** gkadam has joined #tripleo06:19
*** achadha has joined #tripleo06:20
*** gkadam has quit IRC06:21
*** achadha has quit IRC06:25
*** jfrancoa has joined #tripleo06:28
*** dsariel has quit IRC06:30
*** paramite has joined #tripleo06:30
openstackgerritMerged openstack/instack-undercloud stable/newton: Clear any previous environment in stackrc  https://review.openstack.org/47903306:38
*** nyechiel_ has quit IRC06:39
*** nyechiel has joined #tripleo06:39
openstackgerritMerged openstack/instack-undercloud stable/newton: Remove backslash from awk command in stackrc  https://review.openstack.org/47903406:42
*** gkadam has joined #tripleo06:44
*** gkadam has quit IRC06:46
*** ffiore has joined #tripleo06:47
*** ebarrera has joined #tripleo06:48
*** jlinkes has joined #tripleo06:52
*** aufi has joined #tripleo06:59
*** suuuper has joined #tripleo07:00
openstackgerritMerged openstack/tripleo-quickstart master: Fix master-tripleo-ci release config  https://review.openstack.org/48218707:01
*** tesseract has joined #tripleo07:02
*** florianf has joined #tripleo07:05
*** gfidente has joined #tripleo07:06
*** gfidente has quit IRC07:06
*** gfidente has joined #tripleo07:06
*** limao_ has joined #tripleo07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339107:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)07:10
*** ooolpbot has quit IRC07:10
*** shardy has joined #tripleo07:11
*** limao has quit IRC07:12
*** achadha has joined #tripleo07:12
*** ffiore has quit IRC07:12
*** yprokule has joined #tripleo07:13
*** jaganathan has joined #tripleo07:14
*** oidgar has joined #tripleo07:16
*** amoralej|off is now known as amoralej07:18
*** jpena|off is now known as jpena07:19
*** cschwede has joined #tripleo07:21
*** bfournie has joined #tripleo07:25
*** dj has joined #tripleo07:25
*** fragatina has joined #tripleo07:27
*** bfournie has quit IRC07:28
*** athomas has joined #tripleo07:28
*** anshul has joined #tripleo07:28
*** fragatina has quit IRC07:32
*** openstackgerrit has quit IRC07:33
*** bfournie has joined #tripleo07:35
*** zaneb has quit IRC07:36
*** ffiore has joined #tripleo07:36
*** fzdarsky_ is now known as fzdarsky07:37
*** chem has joined #tripleo07:38
*** pliu_ has quit IRC07:39
*** openstackgerrit has joined #tripleo07:40
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP Make network-isolation-v6 environment rendered for all roles  https://review.openstack.org/47448607:40
*** pliu_ has joined #tripleo07:41
*** egonzalez has joined #tripleo07:44
*** jpich has joined #tripleo07:47
*** zaneb has joined #tripleo07:48
*** janki has joined #tripleo07:49
*** dparkes has joined #tripleo07:57
*** zzzeek has quit IRC08:00
*** zzzeek has joined #tripleo08:00
*** dparkes has quit IRC08:02
*** dparkes has joined #tripleo08:02
*** openstackgerrit has quit IRC08:03
*** openstackgerrit has joined #tripleo08:07
openstackgerritMerged openstack/diskimage-builder master: Add symlink test for resolv.conf restore  https://review.openstack.org/48080508:07
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339108:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)08:10
openstackgerritNir Magnezi proposed openstack/tripleo-docs master: Post deployment installation instructions for Octavia  https://review.openstack.org/44749608:11
openstackgerritMerged openstack/diskimage-builder master: pip-and-virtualenv: Install python3 on openSUSE  https://review.openstack.org/47864808:11
*** raissa has joined #tripleo08:12
*** dparkes has quit IRC08:16
*** dparkes has joined #tripleo08:18
*** ccamacho has joined #tripleo08:20
*** bogdando has quit IRC08:21
*** gkadam has joined #tripleo08:25
*** gkadam is now known as gkadam-afk08:26
*** gkadam-afk has quit IRC08:26
*** dparkes has quit IRC08:29
openstackgerritAlfredo Moralejo proposed openstack-infra/tripleo-ci master: Update promotion jobs with new ovb-1ctlr_1comp_1ceph-featureset024  https://review.openstack.org/48244708:32
amoralejsshnaidm, i think we need ^ for master promotion, right?08:32
*** lucas-afk is now known as lucasagomes08:32
sshnaidmamoralej, right, thanks for patch08:33
*** nyechiel has quit IRC08:34
*** nyechiel has joined #tripleo08:34
*** dtantsur|afk is now known as dtantsur08:35
*** nyechiel has quit IRC08:37
*** suuuper has quit IRC08:38
*** suuuper has joined #tripleo08:38
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Update new job name of previous updates job  https://review.openstack.org/48244908:41
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: [WIP] LVM support for dib-block-device  https://review.openstack.org/47206508:44
*** snecklifter_ has joined #tripleo08:45
*** sri_ has joined #tripleo08:46
*** snecklifter has quit IRC08:46
*** snecklifter_ has quit IRC08:46
*** snecklifter has joined #tripleo08:47
*** snecklifter_ has joined #tripleo08:47
*** mcornea has joined #tripleo08:52
*** achadha has quit IRC08:55
*** social has joined #tripleo08:58
*** tvignaud has quit IRC08:58
*** tosky has joined #tripleo08:59
*** ckyriakidou has joined #tripleo09:00
sri_Hey everybodyHey everybody I have deploy my overcloud with enabling  "network-isolation.yaml" "net-single-nic-with-vlans.yaml" addiction this I've pass custom network env file ("parameter_defaults: EC2MetadataIp: 192.168.15.16 ControlPlaneDefaultRoute: 192.168.15.16") (192.168.15.16 my undercloud ip)  and in my undercloud Ive created one Vlan with tag 20 , the overcloud deolpyed successfully, I need help to setup the overcloud network09:03
sri_erent networking configuration available, I dont know which one suits my environment09:03
numanstriple-quickstart is failing for me because "ironic-python-agent.vmlinuz" is not present in ipa_images.tar. has anyone seen the same issue ?09:07
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339109:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)09:10
*** tvignaud has joined #tripleo09:10
*** pgadiya has joined #tripleo09:13
djHi, using network isolation, can i create multiple ports for a existing network say (tenant) on controller node09:16
*** limao_ has quit IRC09:22
*** dpawar has quit IRC09:22
*** limao has joined #tripleo09:22
*** jtomasek_ has joined #tripleo09:23
*** raissa has quit IRC09:25
*** limao has quit IRC09:27
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow  https://review.openstack.org/46506609:28
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property  https://review.openstack.org/47660209:28
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add role_configs into workflow executions environment  https://review.openstack.org/47979009:28
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Run rsync for Swift without xinetd  https://review.openstack.org/48118309:28
*** dparkes has joined #tripleo09:29
*** dpawar has joined #tripleo09:30
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Make featureset numbers links to the definition  https://review.openstack.org/48248009:31
*** links has quit IRC09:37
*** dpawar has quit IRC09:37
sshnaidmnumans, please update, should be resolved09:38
*** links has joined #tripleo09:39
numanssshnaidm, thanks. just saw the patch. updated it. thanks09:39
*** dparkes has quit IRC09:43
openstackgerritOr Idgar proposed openstack/tripleo-validations master: adapt neutron sanity check to containerized environment  https://review.openstack.org/47517309:44
*** links has quit IRC09:44
*** jtomasek_ has quit IRC09:46
mdboothI've just done a manual deployment of a test environment on rdo-cloud. Although I set mtu to 1350 in undercloud.conf, the deployed overcloud is still using the default of 1500, which doesn't work. Is there any way I can get tripleo to change all the mtus of all physical interfaces on the overcloud?09:46
*** links has joined #tripleo09:48
*** salmankhan has joined #tripleo09:52
*** d0ugal has joined #tripleo09:53
*** dbecker has joined #tripleo09:54
*** d0ugal has quit IRC09:59
*** dixiaoli has quit IRC10:00
shardydj: Hi, by default we only create one port per node per network in the network-isolation model10:00
shardydj: can you expand on your requirements a little and I may be able to refer you to some docs etc?10:01
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/network/ports/internal_api.yaml10:01
shardydj: we create a heat template per network like that, which has a port resource in it10:01
djyes i agree10:02
shardyif you had to, you could override the default template with a different one, but it'd be good to understand more about why/how you'll use them10:02
djmy requirement is to create a namespace for each controller node10:02
djand the namespace ip is from the internal_api network10:03
*** ffiore has quit IRC10:03
*** r2bit has left #tripleo10:03
shardymdbooth: undercloud.conf won't influence the overcloud network config, you probably need to set NeutronGlobalPhysnetMtu in an environment file, and possibly also modify the nic config templates to configure the phyical nics how you want, e.g:10:04
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/neutron-base.yaml#L6310:04
mdboothI found NeutronGlobalPhysnetMtu but I wasn't sure what it was applied to10:05
mdboothHow do I modify the physical nic templates?10:05
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/ci/common/net-config-multinode-os-net-config.yaml#L4010:05
djshardy: I see that we do specify InternalApiAllocationPools: [{'start': '172.17.0.10', 'end': '172.17.0.200'}] in the network-environment.yaml file. So, I should be able to create as many port i require for this network right ?10:05
shardymdbooth: ^^ shows an example using os-net-config, you could also hard-code it in the nic templates vs adding a parameter10:06
*** salmankhan has quit IRC10:06
djshardy: but i do not see a way to do that. I may be missing something.10:06
shardymdbooth: I don't think our example nic config templates expose that as a parameter, but that could be something to look at adding perhaps10:07
mdboothshardy: I was just grepping through quickstart-extras, because I know it configures this stuff10:07
mdboothIt just pokes values directly into ifcfg-eth* with a bash script10:07
shardydj: the InternalApiAllocationPools enables a pool of IPs that are created one port per node10:08
mdboothwhich doesn't seem ideal10:08
shardydj: there is also the ips_from_pool environments that show how to manually specify specific lists of IPs10:08
*** iranzo has quit IRC10:08
shardymdbooth: ugh, yeah that's not good :(10:08
djshardy: ips_from_pool environment is again one for each node10:09
shardymdbooth: I'd probably say adding a parameter similar to that CI template above to all our nic config examples is the best plan10:09
shardymdbooth: patches welcome :)10:09
mdboothshardy: As always :)10:09
shardymdbooth: then we could fix the hacks in quickstart etc10:09
shardydj: yes, in all cases we expect to create one port per node per network10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339110:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)10:10
djso is there no way where i can get few ips from a network pool for a specific usecase say for namespace10:10
shardydj: Yes, as I said above you could override the default port assignment via an environment file10:11
shardyand create a new heat template that does whatever you want10:11
shardyprovided the interfaces (parameters/outputs) stay the same10:11
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/environments/network-isolation.j2.yaml#L3210:11
*** iranzo has joined #tripleo10:11
*** ckyriakidou has quit IRC10:12
*** dpawar has joined #tripleo10:12
*** links has quit IRC10:13
shardydj: we by default assign e.g OS::TripleO::Controler::InternalApiPort: <tht>/network/ports/internal_api.yaml10:13
*** sai has quit IRC10:13
shardydj:  e.g see openstack stack environment show overcloud | grep Port10:13
*** sai has joined #tripleo10:14
shardydj: overriding those port templates isn't something we test or actively support, but it's technically possible10:14
openstackgerritCarlos Camacho proposed openstack/tripleo-ui master: Update TripleO UI config template.  https://review.openstack.org/48249510:14
*** ffiore has joined #tripleo10:15
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates master: WIP let mds create manila key and fs  https://review.openstack.org/48249610:15
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Refactor iscsi initiator-name reset into separate profile  https://review.openstack.org/48216610:16
jtomasekflorianf: Hi, would you have time to review https://review.openstack.org/#/c/476942/10 (and 2 it's parent patches) please? It is blocking other 2 which depend on it10:16
djshardy: Thank you so much.10:17
florianfjtomasek: yep, of course10:18
shardydj: np!10:18
shardydj: if you feel this is a common requirement, you're welcome to contribute templates to tripleo-heat-templates to enable your use-case10:18
sri_shardy: hi, I have deploy my overcloud with enabling  "network-isolation.yaml" "net-single-nic-with-vlans.yaml" addiction this I've pass custom network env file ("parameter_defaults: EC2MetadataIp: 192.168.15.16 ControlPlaneDefaultRoute: 192.168.15.16") (192.168.15.16 my undercloud ip)  and in my undercloud Ive created one Vlan with tag 10 , the overcloud deolpyed successfully, I need a help to setup the overcloud networking for vms ,10:19
sri_shardy: there lot of different networking configuration available, I dont know which one suits my environment10:19
shardysri_: have you set --dns-nameserver for the ctlplane network as in the docs?10:20
*** lucasagomes has quit IRC10:20
sri_yes10:20
*** salmankhan has joined #tripleo10:20
shardysri_: Ok so what is the problem with the networking from the VMs?10:21
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides Ceph config into OpenStack clients  https://review.openstack.org/48250010:21
*** ckyriakidou has joined #tripleo10:21
*** markmc has joined #tripleo10:22
sri_shardy: there is no problem , But can I create a provider networking in my setup10:22
*** lucasagomes has joined #tripleo10:23
*** ffiore_ has joined #tripleo10:24
*** ffiore has quit IRC10:24
openstackgerritJan Provaznik proposed openstack/puppet-tripleo master: WIP do not create fs and server side key from manila  https://review.openstack.org/48250110:25
*** raissa has joined #tripleo10:25
*** nyechiel has joined #tripleo10:25
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357610:27
sri_shardy: never mind I think i understand the problem . thanks10:28
shardysri_: ack, I think provider networking should work fine, but I'm not sure what you'd connect it to in a VM setup10:28
shardysri_: previously I've allocated the external network to my local lan so you can route directly from the VM to the local router, but I guess you could have another virtual provider network for testing as well10:29
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373110:29
sri_shardy: understood10:30
openstackgerritGael Chamoulaud proposed openstack-infra/tripleo-ci master: WIP: Enable tripleo-validations tests  https://review.openstack.org/48108010:30
*** yolanda has quit IRC10:32
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides Ceph config into OpenStack clients  https://review.openstack.org/48250010:33
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow  https://review.openstack.org/46506610:33
*** yolanda has joined #tripleo10:33
*** yolanda_ has joined #tripleo10:33
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix ansible-lint.sh to check playbooks  https://review.openstack.org/44652510:33
*** yolanda_ has quit IRC10:33
*** dbecker has quit IRC10:37
*** florianf has quit IRC10:38
*** katkapilatova has joined #tripleo10:40
amoralejsshnaidm, re. https://review.openstack.org/#/c/482447/ is job gate-tripleo-ci-centos-7-containers-multinode broken?, according to http://cistatus.tripleo.org/ it seems to be failing everywhere10:45
rnoriegayprokule, ping10:46
rnoriegayprokule, I'm getting an error trying to register nodes with osp10 (latest zstream I believe)10:46
rnoriegayprokule, resources[1]: Property error: resources.NodeExtraConfig.properties: Property rhel_reg_org not assigned10:46
rnoriegaany clue?10:47
*** dparkes has joined #tripleo10:49
openstackgerritOr Idgar proposed openstack/tripleo-validations master: adapt neutron sanity check to containerized environment  https://review.openstack.org/47517310:49
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add manage nodes button to nodes list page  https://review.openstack.org/48250910:49
*** pliu_ has quit IRC10:51
sshnaidmamoralej, yeah, seems like so..10:52
sshnaidmjistr, hi, do you know anything about broken gate-tripleo-ci-centos-7-containers-multinode?10:53
*** florianf has joined #tripleo10:53
amoralejall periodic jobs succeeded so we may a promotion today if we are able to merge that patch10:53
*** dparkes has quit IRC10:53
sshnaidmamoralej, I can run it manually10:56
*** jprovazn has quit IRC10:56
amoralejsshnaidm, that'd be nice10:57
*** pkovar has joined #tripleo10:57
sshnaidmmandre, do you know maybe what's reason for broken gate-tripleo-ci-centos-7-containers-multinode ? seems like keystone died.. can't find container logs10:57
sshnaidmamoralej, will do now10:57
*** noslzzp has joined #tripleo11:00
*** gkadam has joined #tripleo11:00
sshnaidmfyi https://bugs.launchpad.net/tripleo/+bug/170358711:01
openstackLaunchpad bug 1703587 in tripleo "CI: containers multinode job is broken, pingtest fails because broken connection to keystone" [Critical,Triaged]11:01
*** fandrieu has quit IRC11:03
*** dsariel has joined #tripleo11:03
sshnaidmamoralej, promotion was triggered11:05
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574711:05
amoralejthanks a bunch sshnaidm++11:05
*** morazi has quit IRC11:08
*** dj has quit IRC11:08
openstackgerritOr Idgar proposed openstack/tripleo-validations master: adapt neutron sanity check to containerized environment  https://review.openstack.org/47517311:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339111:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170358711:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)11:10
openstackLaunchpad bug 1703587 in tripleo "CI: containers multinode job is broken, pingtest fails because broken connection to keystone" [Critical,Triaged]11:10
*** bkopilov has quit IRC11:11
jistrsshnaidm: hm i haven't noticed that yet. We have a fix posted for containers-upgrades-multinode but haven't noticed the normal one is broken too11:15
* jistr checks11:15
*** jprovazn has joined #tripleo11:17
openstackgerritOr Idgar proposed openstack/tripleo-docs master: Post deployment installation instructions for Octavia  https://review.openstack.org/44749611:17
*** jprovazn has quit IRC11:18
*** jprovazn has joined #tripleo11:18
*** jprovazn has joined #tripleo11:18
*** brandor5 has joined #tripleo11:21
*** akane has joined #tripleo11:23
*** jaganathan has quit IRC11:24
*** gkadam has quit IRC11:24
flaper87EmilienM: http://logs.openstack.org/59/471759/20/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/9a8abaa/11:25
flaper87EmilienM: that should not pass11:25
* flaper87 checks what the heck is happening there11:25
flaper87I don't think it's running the workflow11:25
flaper87gfidente: hey, mind taking a look at https://review.openstack.org/#/c/471759/ ?11:25
flaper87gfidente: I noticed you use `workflow` instead of action in the steps for ceph11:26
flaper87where's that workflow created/defined ?11:26
akaneshardy: Hi shardy. Hope you are doing well. In the file https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/cinder-api.yaml the service_config_settings have lines like "cinder::keystone::auth::public_url: {get_param: [EndpointMap, CinderPublic, uri]}". How is the actual value passed via this map?11:26
flaper87EmilienM: gfidente shardy also, the workflow doesn't seem to be running http://logs.openstack.org/59/471759/20/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/9a8abaa/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz11:26
gfidenteflaper87 so that can be a list of mistral tasks11:27
gfidentehttps://docs.openstack.org/heat/latest/template_guide/openstack.html?highlight=mistral%20workflow#OS::Mistral::Workflow-prop-tasks11:27
gfidenteanything in there is valid in the template11:27
gfidenteI point to an external workflow yes, which we upload via tripleo-common11:27
flaper87gfidente: gotcha11:27
openstackgerritAbhishek Kane proposed openstack/tripleo-heat-templates master: Add composable service for the Veritas HyperScale's Cinder backend.  https://review.openstack.org/47576511:28
gfidentesec looking at the change11:29
gfidenteflaper87 so you have an implementation of master which is never called11:30
gfidentebecause only worker get deployed on compute11:30
flaper87gfidente: wait, isn't Controller the only role?11:30
flaper87for that job, that is11:31
akanegfidente: Hi Giulio. Hope you are doing well. Could you please check out the my comments in response to your comments on https://review.openstack.org/#/c/475765/8/puppet/services/cinder-backend-veritas-hyperscale.yaml?11:31
flaper87gfidente: https://review.openstack.org/#/c/471759/20/ci/environments/scenario006-multinode.yaml11:31
gfidenteflaper87 and controller deploys master ?11:31
*** ebarrera_ has joined #tripleo11:31
openstackgerritAbhishek Kane proposed openstack/puppet-tripleo master: Add new profile for the Veritas HyperScale's cinder backend.  https://review.openstack.org/47576211:31
gfidenteflaper87 ah yes, sorery11:31
gfidentesec11:31
flaper87gfidente: thanks for looking into it11:31
*** ecerquei has quit IRC11:33
gfidenteflaper87 so I assume when you test it locally it works?11:33
flaper87gfidente: yup11:34
flaper87that test should fail at this point. It should fail saying it couldn't include kargo/cluster.yml11:34
shardyakane: Hi, it's calculated here https://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml#L132211:35
flaper87but it's succeeding instead and I don't see the workflow running11:35
shardyakane: for each service we have an endpoint_map entry, where things like the Vip for the assigned network (from ServiceNetMap) and the protocol/port are used to assemble urls for the endpoints11:35
*** tobias_fiberdata has joined #tripleo11:35
gfidenteflaper87 yeah I don't see it either, trying to understand why11:35
*** tobias_fiberdata has quit IRC11:36
rnoriegaanyone familiar with this?  resources[1]: Property error: resources.NodeExtraConfig.properties: Property rhel_reg_org not assigned11:37
rnoriega:-(11:37
shardyrnoriega: yes if you grep for it in t-h-t you'll see it's one of serveral mandatory parameters for ./extraconfig/pre_deploy/rhel-registration/rhel-registration.yaml11:38
shardyrnoriega: my guess is you've enabled that in your environment without all the data it requires added to parameter_defaults?11:38
shardy./extraconfig/pre_deploy/rhel-registration/environment-rhel-registration.yaml is an example, but you'll need to copy it and fill out the actual values11:39
*** ebarrera_ has quit IRC11:39
*** nyechiel has quit IRC11:39
*** abishop has joined #tripleo11:40
*** jaganathan has joined #tripleo11:41
*** sbrzozow has joined #tripleo11:44
gfidenteflaper87 EmilienM it doesn't look like any of the servics was deployed11:44
akaneshardy: if i want to send rabbitmq user password to veritas_hyperscale::hs_rabbitmq in https://review.openstack.org/#/c/475762/14/manifests/profile/base/rabbitmq.pp how can I pass it via https://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml? Do i need to add a section like, say ‘AodhAdmin’?11:45
*** lucasagomes is now known as lucas-hungry11:45
*** links has joined #tripleo11:45
*** jkilpatr has joined #tripleo11:45
gfidenteflaper87 EmilienM like ntp in the overcloud is still untouched http://logs.openstack.org/59/471759/20/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/9a8abaa/logs/subnode-2/etc/ntp.conf.txt.gz11:45
gfidenteam I reading it right?11:45
*** atoth has joined #tripleo11:45
rnoriegashardy, thanks. I've also filled rhel_reg_org, user, password, method, pool, repos...11:46
shardyakane: you can copy the RabbitUserName/RabbitPassword parameters into your service template:11:46
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/rabbitmq.yaml#L3311:46
shardyrnoriega: Ok, but the error indicates your environment isn't being read correctly11:46
shardyrnoriega: so I'd double check the contents and the ordering of your environments11:47
*** ffiore_ has quit IRC11:47
shardyakane: EndpointMap is only for endpoint data, not other things like usernames/passwords11:47
rnoriegashardy, I'll double check. It's weird coz this very same template in osp10 worked...and not in 10.311:48
*** jaganathan has quit IRC11:50
rnoriegashardy, where can I look to see if the data has been retrieve properly from the env files? this is just a validation check, coz nodes are not even powered on11:51
*** ratailor has quit IRC11:51
*** katkapilatova has left #tripleo11:53
akaneshardy: I want to create a specific rabbitmq user with hard coded name. I just want to pass the password for this user. It looks like many yaml files are using ‘{get_param: RabbitPasswor}’ to get the default rabbitpassword. But i want flexibility to set password.11:53
shardyrnoriega: you can run the overcloud deploy with --debug and tee the results into a file, that will show exactly what is passed to heat11:53
shardyrnoriega: also you can use openstack stack environment show overcloud, but that only works after you've done the deploy11:53
gfidenteflaper87 I am looking myself as well11:54
gfidentebut can't find anything11:54
gfidentecan you check if one of the environments from the commandline11:54
gfidentehttp://logs.openstack.org/59/471759/20/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/9a8abaa/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-11_06_02_1411:54
shardyakane: Ok you can give the parameter a different name in your template then11:54
gfidenteis actually overriding any of the parameters you set in the scenario yaml?11:54
openstackgerritAdriano Petrich proposed openstack/python-tripleoclient master: Remove the unused function reset_parameters  https://review.openstack.org/47886411:54
flaper87gfidente: checking11:55
*** fandrieu has joined #tripleo11:56
flaper87gfidente: wait, I don't see kubernete's template there anymore11:56
flaper87dafuq ?11:56
gfidenteflaper87 where?11:56
flaper87gfidente: http://logs.openstack.org/59/471759/20/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/9a8abaa/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-11_06_02_1411:57
flaper87there should be a kubernetes.yaml11:57
flaper87that's why it's not working anymore11:57
gfidenteah the environment file11:58
*** links has quit IRC11:59
gfidenteshouldn't https://review.openstack.org/#/c/471759/20/overcloud-resource-registry-puppet.j2.yaml be doing the mapping anyway?11:59
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Fix mysql client config generation with containerized environment  https://review.openstack.org/48155412:00
*** raissa_ has joined #tripleo12:00
*** raissa has quit IRC12:00
honzajpich: thanks for the thorough review!12:00
openstackgerritAdriano Petrich proposed openstack/python-tripleoclient master: Remove the unused function "create_default_plan"  https://review.openstack.org/47886512:00
jpichhonza: No problems! Feel free to ask if there's weird unclear bits12:01
*** akrivoka has joined #tripleo12:01
akaneshardy: Ok. I see that in an example. https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/cinder-api.yaml#L12 declares ‘CinderPassword’. https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/cinder-api.yaml#L103 uses it. But how does ‘{get_param: CinderPassword}’ get the value? Where is it set?12:02
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Generate MySQL client config if service requires database  https://review.openstack.org/48196512:03
*** jaganathan has joined #tripleo12:03
openstackgerritFlavio Percoco proposed openstack/tripleo-quickstart master: Pass kubernetes' environment to fset26  https://review.openstack.org/48253112:04
shardyakane: we have some logic in tripleo-common that either uses the *Password provided by the user, or calculates a random password12:04
shardyakane: I think for vendor plugins it's probably a case of documenting that the user must pass it as part of the environment that enables the plugin?12:04
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175912:05
*** gkadam has joined #tripleo12:05
flaper87gfidente: *shrugs* dunno12:05
flaper87:(12:05
yprokulernoriega: when do U subscribe - during deployemnt ?12:06
flaper87gfidente: actually, that one is not being passed either12:06
rnoriegayes12:06
rnoriegayprokule, yes12:06
yprokulernoriega: are U passing all the env files12:06
shardyakane: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/parameters.py#L21912:06
rnoriegayprokule,  -e ~/templates/extraconfig/pre_deploy/rhel-registration/environment-rhel-registration.yaml \12:07
rnoriega     -e ~/templates/extraconfig/pre_deploy/rhel-registration/rhel-registration-resource-registry.yaml \12:07
rnoriegayprokule, I filled most of the parameters... I tried to exchange the order of these two env files...12:07
rnoriegayprokule, I tried to use the flags in overcloud deploy command --rhel-reg12:07
rnoriegayprokule, I don't know what else to do! I'm trying to see what's the data stored12:08
*** nyechiel has joined #tripleo12:08
akaneshardy: ok. thanks! Will add these parameters to https://review.openstack.org/#/c/475765/8/puppet/services/cinder-backend-veritas-hyperscale.yaml and try out.12:09
yprokulernoriega: unfortunately I don't have osp10 atm so cannot check12:09
yprokuleagurenko: any hints for registration with osp10 ?12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339112:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170358712:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)12:10
openstackLaunchpad bug 1703587 in tripleo "CI: containers multinode job is broken, pingtest fails because broken connection to keystone" [Critical,Triaged]12:10
*** ansmith_ has joined #tripleo12:10
*** ansmith has joined #tripleo12:11
*** brault has joined #tripleo12:11
*** pdeore has joined #tripleo12:11
*** snecklifter has quit IRC12:12
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Add settings for ovb in rdocloud  https://review.openstack.org/48095012:12
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574712:14
*** marios has quit IRC12:14
sshnaidmjistr, I found an error in collecting logs, that /var/lib/docker/volumes/logs/_data doesn't exist, was it changed recently? Where do we expect to have container logs currently?12:15
*** chem has quit IRC12:15
*** jpena is now known as jpena|lunch12:16
jistrsshnaidm: i'm looking into it too. The logs should be collected normally, they still are collected OK for OVB jobs.12:16
*** liverpooler has joined #tripleo12:18
*** agopi has joined #tripleo12:19
jistrfwiw reported https://bugs.launchpad.net/tripleo/+bug/1703599 where i'll try to post further findings. First one is that docker service appears to not be running at all12:20
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job failing verification step and not collecting container logs" [Critical,Triaged]12:20
*** dparkes has joined #tripleo12:20
jistrand the logs collection is conditioned on that12:20
*** panda|Zz is now known as panda12:20
jistrso logs collection is probably ok, it's the docker service missing that's an issue12:20
jistrsshnaidm: ^12:20
*** morazi has joined #tripleo12:21
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz collect data  https://review.openstack.org/47455912:23
sshnaidmjistr, hmm.. in logs collect I see service is active on undercloud: http://logs.openstack.org/94/481594/2/check/gate-tripleo-ci-centos-7-containers-multinode/4c29754/logs/quickstart_collect_logs.txt.gz12:23
sshnaidmjistr, or should it be active on subnode?12:23
jistryea but not overcloud... strange12:23
jistryes it should be12:23
sshnaidmyeah, it's "/bin/docker", "unknown"12:23
jistrthat's where all the docker containers should be12:23
*** pchavva has joined #tripleo12:25
*** pdeore has quit IRC12:27
*** dparkes has quit IRC12:28
*** rlandy has joined #tripleo12:29
*** snecklifter has joined #tripleo12:29
*** trown|outtypewww is now known as trown12:30
agurenkoyprokule: what do you mean?12:30
jistrsshnaidm: heh there are *no services deployed at all* on the subnode12:30
yprokuleagurenko: rnoriega has issues while subscribing oc nodes - resources[1]: Property error: resources.NodeExtraConfig.properties: Property rhel_reg_org not assigned12:31
yprokuleagurenko: with osp-1012:31
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add a working default networking config for computes  https://review.openstack.org/48253912:31
*** marios has joined #tripleo12:31
agurenkoyprokule: I would assume it's assigned in the template?12:31
*** ecerquei has joined #tripleo12:31
jistrsshnaidm: https://bugs.launchpad.net/tripleo/+bug/1703599/comments/212:31
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job failing verification step and not collecting container logs" [Critical,Triaged]12:31
sshnaidmjistr, yep, it's only  docker-common installed and it doesn't appear at all in services list12:31
jistryea, and normally this would crash the OC deploy, because the containers wouldn't be albe to launch12:32
*** MVenesio has joined #tripleo12:32
yprokuleagurenko: hope so, though also tried with --rhel-reg12:32
agurenkoyprokule: rhel7 and SAT5/6?12:32
yprokulernoriega: ^^12:33
jistrbut it's not just that docker isn't trying to start, the containers aren't trying to start either. The deployment is completely empty :) That's why it goes to CREATE_COMPLETE even though e.g. keystone is completely missing, which then fails the validation when trying to deploy a Heat stack on the overcloud.12:33
*** bkopilov has joined #tripleo12:33
*** masco has quit IRC12:34
*** pkovar has quit IRC12:35
*** oidgar has quit IRC12:36
agurenkoyprokule: rnoriega can this be the case? https://access.redhat.com/discussions/302318112:37
sshnaidmjistr, could it be related? https://review.openstack.org/#/c/479400/12:37
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Don't confuse Heat with empty parameter_defaults  https://review.openstack.org/48254512:38
weshaysshnaidm, I need you to send everyone on our team the information to access the dns server you stood up12:38
jistrsshnaidm: bingo ^^ :)))12:38
jistrsshnaidm: i'm already writing an explanation on the bug12:38
sshnaidmjistr, great, thanks12:38
sshnaidmjistr, we don't gate this in extras, that's why we broke it :(12:39
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Implement Upgrade workflow via the tripleo cli  https://review.openstack.org/46372812:39
yprokuleagurenko: it might be, though let rnoriega to confirm12:39
yprokuleagurenko: thanks12:39
sshnaidmweshay, hmm.. I thought we are going to use level3 dns, don't we?12:39
*** pdeore has joined #tripleo12:39
jistrsshnaidm: yea i noticed... we could add that job maybe. Though this was a good deal of bad luck too.12:40
sshnaidmjistr, yeah, we need to add some multinode containers jobs there..12:40
openstackgerritSteven Hardy proposed openstack/puppet-tripleo master: Remove dependency on memcached_node_ips_v6  https://review.openstack.org/48108312:41
weshaysshnaidm, we are having issues there too12:41
weshaysshnaidm, please send the information immediately12:41
sshnaidmweshay, ok12:41
sshnaidmweshay, just IP?12:41
weshaysshnaidm, and creds12:41
sshnaidmweshay, which creds?12:42
weshayto the dns server root user12:42
*** marios has quit IRC12:42
chandankumararxcruz: weshay: trown please have a look at these two reviews https://review.openstack.org/481933 and https://review.openstack.org/481939 Thanks :-)12:42
*** marios has joined #tripleo12:42
sshnaidmweshay, I setup it on mirror-server, it's accessible only by tripleo-admins group.. do you want I'll setup it on different server?12:42
agurenkoyprokule: np :)12:43
*** marios has quit IRC12:43
*** marios has joined #tripleo12:43
weshaysshnaidm, is it up?12:44
weshaysshnaidm, can we widen the access for that one server?12:44
sshnaidmweshay, no, it's managed by puppet12:45
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Dump all deployment role_data files to a config dir  https://review.openstack.org/44422412:45
*** dpawar has quit IRC12:46
*** pgadiya has quit IRC12:47
*** openstackgerrit has quit IRC12:47
sshnaidmweshay, it looks like it was reconfigured or redeployed12:48
weshaysshnaidm, do you know why?12:48
sshnaidmweshay, no idea, need to ask people working on rdo cloud..12:48
weshaysshnaidm, can you join my chat now please12:49
*** openstackgerrit has joined #tripleo12:49
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Generate MySQL client config if service requires database  https://review.openstack.org/48196512:49
sshnaidmpanda, did you do something about mirror-server on rdo-cloud maybe?12:49
pandasshnaidm: no12:50
sshnaidmweshay, I'm in12:50
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Add support for installing Ceph MDS via ceph-ansible  https://review.openstack.org/47942612:50
openstackgerritCarlos Camacho proposed openstack/tripleo-ui master: Update TripleO UI config template.  https://review.openstack.org/48249512:51
*** gkadam_ has joined #tripleo12:51
*** ansmith has quit IRC12:52
*** oidgar has joined #tripleo12:52
*** ansmith_ has quit IRC12:52
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart master: Escapes username and password in repo_setup script template  https://review.openstack.org/47895912:53
*** gkadam has quit IRC12:54
arxcruzchandankumar: done12:54
chandankumararxcruz: Thanks :-)12:54
*** amoralej is now known as amoralej|lunch12:55
*** tzumainn has joined #tripleo12:56
*** dhill_ has joined #tripleo12:58
*** funzo has quit IRC12:58
*** udesale has quit IRC12:58
*** udesale__ has joined #tripleo12:58
openstackgerritKarthik S proposed openstack/os-net-config master: OvS 2.7 support - dpdk-devargs needs to provided for DPDK devices  https://review.openstack.org/48054012:59
*** funzo has joined #tripleo12:59
karthiksbfournie,  Can you please review https://review.openstack.org/#/c/480540/13:00
*** bogdando has joined #tripleo13:00
*** jmelvin has joined #tripleo13:01
*** oidgar has quit IRC13:01
*** lucas-hungry is now known as lucasagomes13:02
*** rhallisey has joined #tripleo13:02
*** pkovar has joined #tripleo13:02
*** Goneri has joined #tripleo13:03
*** gkadam__ has joined #tripleo13:04
*** pradk has quit IRC13:04
*** akane has quit IRC13:06
*** gkadam_ has quit IRC13:06
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574713:07
*** agopi|away has joined #tripleo13:08
rnoriegayprokule, agurenko. http://paste.openstack.org/show/615017/13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339113:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170358713:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359913:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1703587 in tripleo "CI: containers multinode job is broken, pingtest fails because broken connection to keystone" [Critical,Triaged]13:10
rnoriegayprokule, agurenko, maybe the auto-attach should not be a string but a boolean?13:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)13:10
*** mdnadeem has quit IRC13:10
*** ansmith has joined #tripleo13:11
*** ansmith_ has joined #tripleo13:11
*** gkadam__ has quit IRC13:11
*** agopi has quit IRC13:11
yprokulernoriega: have U checked the doc provided by agurenko ?13:11
*** dprince has joined #tripleo13:12
rnoriegayprokule, let me see13:13
*** trozet has joined #tripleo13:14
*** lblanchard has joined #tripleo13:14
*** oidgar has joined #tripleo13:15
*** ykarel has quit IRC13:16
*** lblanchard has quit IRC13:16
*** lblanchard has joined #tripleo13:19
*** dpawar has joined #tripleo13:19
jtomasekjpich: re https://bugs.launchpad.net/tripleo/+bug/1703596 can you try to change the ironic-inspector url to 'ironic-inspector': 'http://192.168.24.1:3000/ironic-inspector' ?13:20
openstackLaunchpad bug 1703596 in tripleo "No nodes visible in the UI after undercloud upgrade" [High,Triaged]13:20
jpichjtomasek: Trying now. I just posted an update on LP as well :)13:21
*** ffiore_ has joined #tripleo13:22
jpichdtrainor: Hello! If you had any thoughts/debugging hints around ^ I'd love to hear them!13:22
rnoriegayprokule, so basically removing the auto_attach flag?13:23
yprokulernoriega: I'll try this13:24
jtomasekjpich, dtrainor: yeah, I'd blame apache proxy typo 'ironic' instead 'ironic-inspector'13:24
jpichjtomasek: Yep, that solved it! And I can change tags too now13:24
yprokulernoriega: please let us know if it works for U13:24
rnoriegayprokule, trying now..13:24
jtomasekjpich: cool, in any case the error should be probably handled better though. I plan to revisit error handling in general, just not right now:)13:25
jpichdtrainor: Maybe this should say INSPECTOR somewhere? I'm not sure how to find out the actual variable name, I'll poke around - https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L76613:25
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add a support check for the openstack version  https://review.openstack.org/45395413:26
jpichjtomasek: Yay, thanks! I'll update this bug with the new info. Want me to open a separate bug for better error handling when there's an issue with the inspector endpoint?13:26
jtomasekjpich: that would be nice, thanks13:26
*** jpena|lunch is now known as jpena13:27
*** fragatina has joined #tripleo13:28
jtomasekjpich: one sec, can you try to apply this patch, I think it actually fixes the incorrect error handling https://review.openstack.org/#/c/481705/13:29
jpichjtomasek: Hm sure! I'll break my dev env in the same way and confirm :-)13:30
* jpich breaking things on purpose for once13:30
rnoriegayprokule, same thing...13:33
gfidentesshnaidm you said we have a bug tracking containers multinode job failures?13:33
*** fragatina has quit IRC13:33
sshnaidmgfidente, yep, it's in alerts13:33
*** amoralej|lunch is now known as amoralej13:34
sshnaidmgfidente, actually it's this https://bugs.launchpad.net/tripleo/+bug/170359913:34
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)13:34
mandrejistr: hey, nice work on finding the root cause for the empty deployment13:34
jistrthanks13:35
jistrit's not certain yet, but likely i htink13:35
mandrejistr: do you think we should run the multinode job in quickstart-extra?13:35
* jistr peeks at zuul13:35
yprokulernoriega: can U check rhsm.log on node that failed ?13:35
*** fragatina has joined #tripleo13:36
rnoriegayprokule, overcloud nodes are not even powered on...it's a validation issue13:36
*** fragatina has quit IRC13:36
gfidenteflaper87 https://bugs.launchpad.net/tripleo/+bug/1703599 < I think this is the same bug you're hitting with the kubernetes change13:36
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)13:36
gfidenteovercloud seems empty13:36
yprokulernoriega: it fails with the same message ?13:36
*** fragatina has joined #tripleo13:36
rnoriegayprokule, yep13:36
rnoriegayprokule, let me try something13:37
sshnaidmmandre, we should13:37
sshnaidmmandre, is it only job that runs containers on multinode?13:37
jistrmandre: it's on the fence i think, sometimes there are differences between multinode and OVB, but most of the time i think they'd be triggered by t-h-t changes... This particular bug was quite a bad luck i'd say (+ a Heat bug, if the fix proves to work).13:37
flaper87gfidente: lemme check13:37
*** toure is now known as toure|biab13:38
*** toure|biab is now known as toure13:38
jistrmandre: so it would definitely help to catch these bad luck moments, but given how rarely i'd expect them to appear, i'm not sure if it's worth the extra capacity consumed... It's on the fence :)13:38
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Use repo-setup when injecting repos  https://review.openstack.org/46463613:40
gfidentetrown can you see if these three look okay to you13:42
gfidentehttps://review.openstack.org/#/c/478980/13:42
gfidentehttps://review.openstack.org/#/c/478986/13:42
gfidentehttps://review.openstack.org/#/c/478977/13:42
gfidenteproblem is to get the repo configured in the undercloud to install ceph-ansible13:42
gfidenteso that is tripleo-ci, quickstart and quickstart-extras13:43
mandrejistr: I don't fully understand why the other container jobs were passing13:43
*** skramaja has quit IRC13:44
openstackgerritMerged openstack/instack-undercloud stable/ocata: Add ssl development headers to bindep  https://review.openstack.org/48216913:44
*** dpawar has quit IRC13:44
*** cdearborn has joined #tripleo13:45
jistrmandre: yea i don't know that in detail either... Though we do use parameter_defaults much less in OVB job than multinode... Multinode passes its own service list via the composable scenario, which OVB doesn't do i think. We still don't know if that's the actual cause, but i knew that empty parameter_defaults already broke my deploy some time ago, so it struck me as the right thing to try in the fix.13:47
openstackgerritPaul Belanger proposed openstack/diskimage-builder master: Bump fedora-minimal DIB_RELEASE 26  https://review.openstack.org/48257013:48
jistrmandre: interesting, it should be fixed https://bugs.launchpad.net/python-heatclient/+bug/163140813:50
openstackLaunchpad bug 1631408 in python-heatclient "An empty parameter_defaults section in an environment breaks deployment" [Undecided,Fix released] - Assigned to Lars Kellogg-Stedman (larsks)13:50
jpichjtomasek: It doesn't look like this patch makes any different, it just changes the message displayed - but there are no errors here. I'd expect the nodes to still be displayed and the introspection status unknown, when the inspector is not reachable?13:50
jtomasekjpich: yeah, it should correct the message only13:51
mandrejistr: oh well13:51
openstackgerritOr Idgar proposed openstack/tripleo-docs master: Post deployment installation instructions for Octavia  https://review.openstack.org/44749613:51
jpichjtomasek: messages were only in the console sadly13:51
mandrejistr: how is your patch doing in zuul?13:51
jtomasekjpich: the 'invariant' stuff from console still occurs?13:51
jpichjtomasek: Seems too although it's the full exception now, not the URL shortcut13:52
openstackgerritBrent Eagles proposed openstack/tripleo-docs master: Post deployment installation instructions for Octavia  https://review.openstack.org/44749613:52
openstackgerritCarlos Camacho proposed openstack/tripleo-ui master: Update TripleO UI config template.  https://review.openstack.org/48249513:52
*** ykarel has joined #tripleo13:52
jtomasekjpich: ok13:53
jpichjtomasek: Actually scratch that - I'm using a dev env, while the other was 'prod' aka minified, so no changes it means, I think13:53
jpichjtomasek: I'll file the bug about more graceful error handling. Thanks for sharing your thoughts!13:53
jtomasekjpich: all right, yeah, thanks13:53
jistrmandre: on overcloud validation right now. We'll know soon. *drumroll*13:54
*** snecklifter has quit IRC13:54
*** d0ugal has joined #tripleo13:54
*** bogdando has left #tripleo13:56
*** bogdando has joined #tripleo13:56
openstackgerritBrent Eagles proposed openstack/tripleo-docs master: Post deployment installation instructions for Octavia  https://review.openstack.org/44749613:56
brandor5hello everyone: I'm following the red hat hyperconverged reference architecture and I'm seeing a weird issue with os-net-config... I'm getting getting the following contents on the overcloud controller nodes: http://sprunge.us/ECEg anyone have an idea about what would cause the missing IPs for the bottom vlan interfaces??13:57
*** jaganathan has quit IRC13:57
EmilienMhello, tripleo meeting starting shortly13:57
EmilienMon #openstack-meeting-alt13:58
jistrmandre: it passed the validation. Shamanism bugfixing pays off again :D13:58
*** jistr is now known as jistr|call13:58
mandrejistr|call: yay! nothing beats black magic13:59
*** dpawar has joined #tripleo14:00
*** ckyriakidou has quit IRC14:00
EmilienMjistr|call, mandre : I guess you're aware about the container-multinode job which is broken?14:00
jistr|callEmilienM: it's now fixed by what we discussed ^^14:00
EmilienMoh good14:00
EmilienMmwhahaha: ^14:00
mwhahahahttps://bugs.launchpad.net/tripleo/+bug/170358714:00
openstackLaunchpad bug 1703587 in tripleo "CI: containers multinode job is broken, pingtest fails because broken connection to keystone" [Critical,Triaged]14:00
mwhahahashould update the bug then14:00
*** d0ugal has quit IRC14:00
jistr|callmwhahaha: marking it a duplicate of https://bugs.launchpad.net/tripleo/+bug/170359914:01
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)14:01
*** rbowen has quit IRC14:01
*** rbowen has joined #tripleo14:03
jistr|call(the other bug has more info posted on it, i didn't know about that one so i reported another one, sorry)14:03
* jistr|call call for real now14:03
fzdarskybrandor5, check the ip_netmask values; it needs to be in "<ip_address>/<prefix_len>" format. Just '/<prefix_len>' won't do14:06
*** snecklifter has joined #tripleo14:06
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339114:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359914:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)14:10
brandor5fzdarsky: i agree that's the problem, my question is why is tripleo not putting the ip address in there like it is on the first vlan interface?14:10
fzdarskybrandor5, does the IP come from a "get_param" or "get_input" variable that hasn't been initialized?14:11
brandor5fzdarsky: I'm using the base bond with vlan templates (just modified to be linux_bond instead of ovs_bond)... so it's using "ip_netmask: {get_param: StorageMgmtIpSubnet}"14:13
*** agopi|lunch has joined #tripleo14:14
brandor5I'm only setting the "NetCidr" variables and I assume tripleo templates should break that down in to the "IpSubnet" variables... I don't think I've ever set those anywhere14:15
brandor5(on other builds)14:15
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Refactor iscsi initiator-name reset into separate service  https://review.openstack.org/48217014:15
*** pradk has joined #tripleo14:16
*** agopi|away has quit IRC14:17
bnemecbrandor5: Did you include network-isolation.yaml?  Without that the isolated networks won't be enabled, which could result in the config you're seeing.14:17
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Improve logs from ansible, puppet, docker-puppet.py  https://review.openstack.org/47426914:17
brandor5bnemec: yes I did, I'm thinking about it now... should network-isolation be above or below my network-env in the deploy command?14:17
*** zzzeek_ has quit IRC14:18
brandor5i think it should be above14:19
brandor5which is where i have it14:19
*** zzzeek_ has joined #tripleo14:21
*** ckyriakidou has joined #tripleo14:21
*** akrivoka has quit IRC14:22
*** akrivoka has joined #tripleo14:25
*** gbarros has joined #tripleo14:27
brandor5I'm basically using https://github.com/RHsyseng/hci.git and just editting it to match my hardware...14:27
bnemecbrandor5: That's how we document it, so yeah that should be fine.14:29
brandor5bnemec: yeah, that makes me think something has changed in the packages that's getting in the way14:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Convert scenario001-multinode-containers job to ceph-ansible  https://review.openstack.org/47928814:35
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Add support for installing Ceph MDS via ceph-ansible  https://review.openstack.org/47942614:37
*** rcernin has quit IRC14:38
openstackgerritFrank A. Zdarsky proposed openstack/os-net-config master: Add schema-based config data validation  https://review.openstack.org/42323014:38
openstackgerritHarry Rybacki proposed openstack/tripleo-heat-templates stable/newton: Run token flush cron job hourly by default  https://review.openstack.org/48258514:40
*** rcernin has joined #tripleo14:40
*** dpawar has quit IRC14:41
bnemecbrandor5: Can you post your network templates somewhere?  It looks like there are some significant differences in your setup from the one in https://github.com/RHsyseng/hci/blob/master/custom-templates/nic-configs/controller-nics.yaml14:42
brandor5bnemec: of course, give me a second14:43
EmilienMmarios: it has been weeks (if not months) that we have timeouts in stable/ocata for upgrade jobs14:43
EmilienMmarios: last week, we reported https://bugs.launchpad.net/tripleo/+bug/170295514:43
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout when running in RAX cloud" [Critical,Triaged]14:43
EmilienMmarios: it would be great to have someone from your team and also from rook's team (performances) helping a bit14:44
EmilienMmarios, rook : does it make sense?14:44
mariosack EmilienM it does 'my team' :) not really but sure will ping matbu chem mcornea yprokule and others see if folks can have a look.14:45
brandor5bnemec: controller: http://sprunge.us/bChj compute: http://sprunge.us/jJiP14:45
mariosEmilienM: i know the ocata job was broken a few weeks ago on ha issue (we had a couple of bugs) but they were fixed. I hadn't noticed it was timing out again14:45
mariosEmilienM: though is that every time? or is it intermittent14:45
*** jpena is now known as jpena|off14:46
EmilienMmarios: it's not everytime, it depends on which cloud it's running - it means the job became too slow14:46
dtrainorjtomasek, jpich, yes i think quickstart is using an endpoint that includes 'ironic' instead of 'ironic-inspector' for the ironic-inspector service.  honza ran in to this the other day as well.14:47
*** openstackgerrit has quit IRC14:48
EmilienMmarios: the job isn't broken - it's timeouting because it became too slow. It's not timeouting when running on OSIC because this cloud is "special" in a sense it's super fast comparing to others, so the change to timeout is reduced14:48
jpichdtrainor: Hm, it'd be good to find details if this means it doesn't work outside of quickstart at the moment...?14:48
*** samdoran has joined #tripleo14:48
mariosEmilienM: thanks for the extra info14:48
dtrainorit does work outside of quickstart.14:48
matbuEmilienM: ha yep, i thought it was fixed14:48
*** jtomasek_ has joined #tripleo14:49
matbuEmilienM: do you have more info ? (link to the jobs & cie)14:49
dtrainori haven't uised quickstart in a little bit, I'd need to jump in to talk more about where it's happening but so far that's been the common denominator when this problem arises14:49
matbuEmilienM: looks like a new debuging nightmare of upgrade :)14:49
EmilienMmatbu: have you seen https://bugs.launchpad.net/tripleo/+bug/1702955 ?14:50
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout when running in RAX cloud" [Critical,Triaged]14:50
pandabnemec: do you have some minutes to spare ? I'm trying to debug bmc configuration in rdocloud14:51
*** openstackgerrit has joined #tripleo14:52
bnemecpanda: Sure, what's up?14:52
bnemecbrandor5: Hmm, that does look fine. :-/14:53
brandor5bnemec: i know :(14:53
matbuEmilienM: ha no, not this LP14:53
brandor5so frustrating14:53
pandabnemec: we are able to provision and introspect the nodes, but undercloud is unable to contact IPMI and turn the node on. Deploy fails because "no valid host found"14:53
EmilienMmatbu: we gave some example of logs14:53
matbuEmilienM: i got another one in mind which was closed14:53
EmilienMmatbu: what we need to do is to investigate what things take more time than before14:54
bnemecbrandor5: Oh, are you using predictable ips like https://github.com/RHsyseng/hci/blob/master/custom-templates/layout.yaml ?14:54
EmilienMmatbu: the job isn't using oooq afik (sadly)14:54
openstackgerritJanki Chhatbar proposed openstack/tripleo-puppet-elements master: Adds ODL package to overcloud image  https://review.openstack.org/48143314:54
brandor5bnemec: I'm not14:54
pandabnemec: I'm inside one of the bmc instances. I can see it can be reached correctly, receives and replies to network packets, but ipmitools says it cannot establish connection14:54
bnemecbrandor5: I bet it's related to that somehow.  The networks you're not getting ips for are the ones they're using predictable ips for.14:55
matbuEmilienM: i can create a patch to make the job running with oooq, then see if doesn't timeout14:55
bnemecpanda: Was it deployed with the port-security ovb templates?14:55
bnemecIf not you won't be able to contact any of the IPMI addresses, just the utility ip.14:55
matbuEmilienM: idk if it will help to debug if its still timeout14:55
bnemec(which sounds like your situation)14:55
pandabnemec: if I try to add those templates, even introspection fails ...14:55
brandor5bnemec: I bet you're right... is there a way to change the templates to not require the predictable ip addresses?14:55
EmilienMmatbu: the job should be translated in oooq but I'm not sure how urgent is it in the backlog14:56
EmilienMmatbu: I think we want 3-nodes asap14:56
pandabnemec: but I can see packets exchange with tcpdump, at least on port 62314:57
bnemecbrandor5: Make sure you aren't specifying any of those Port resources to point at a *from_pool.yaml.14:57
bnemecpanda: Oh, I missed that introspection works.  This sounds vaguely like a problem rlandy had a while back.  I'm trying to remember what was going on there...14:57
matbuEmilienM: k, i can take a look, i have an old review that i started ... so i'll rework again on it14:58
brandor5bnemec: thanks, i'll look into that14:58
bnemecpanda: That being said, you _have_ to use the port-security form of the templates in RDO cloud.  There's no way this will work there otherwise.14:59
EmilienMmatbu: cool, thanks14:59
EmilienMmatbu, weshay : do we have a card to track the conversion of upgrade job into oooq?14:59
openstackgerritJanki Chhatbar proposed openstack/tripleo-common master: Containarize Barbican  https://review.openstack.org/48187615:01
weshayEmilienM, gate-tripleo-ci-centos-7-multinode-upgrades15:01
weshaythat one?15:01
weshaymatbu, is the upgrade role in tqe ready?15:01
EmilienMweshay: yes15:02
pandabnemec: by using the port security template you mean adding OS::OVB::BaremetalPorts: templates/baremetal-ports-all-port-security in env.yaml resource_registry ?15:02
*** pdeore has quit IRC15:02
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145115:02
pandabnemec: sorry I meant OS::OVB::BMCPort: templates/bmc-port-port-security.yaml15:02
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow  https://review.openstack.org/46506615:02
bnemecpanda: Well, both of those, plus the undercloud-ports-port-security.yaml if you're using OVB's undercloud.  If not, you'll be responsible for shutting off port-security on the undercloud ports.15:03
*** chem has joined #tripleo15:03
weshayEmilienM, the last conversation I had w/ matbu .. iirc there were a few issues that needed to be resolved15:03
EmilienMmwhahaha: for after the meeting we need to discuss why gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet  failed in puppet CI and why we got a promotion in tripleo15:04
openstackgerritSteven Hardy proposed openstack/puppet-tripleo master: Remove dependency on memcached_node_ips_v6  https://review.openstack.org/48108315:04
matbuweshay: yep i think so15:04
matbuweshay: probably some adjustment on tripleo-ci scripts15:04
matbuweshay: but the role should do the job15:04
bnemecpanda: Would I be able to get on this environment?15:05
bnemecThat might be easier than trying to debug by proxy.15:05
weshaymatbu, k.. sshnaidm do you have bandwidth to work w/ matbu or do I need to find someone else ^15:05
jpichdtrainor: Ah - I'm not using quickstart on that environment15:05
pandabnemec: on the BMC yes, but not on the undercloud, login is disabled there15:05
pandabnemec: provisioned by zuul15:06
*** aufi has quit IRC15:06
bnemecAh, fun.15:06
bnemecpanda: Just for reference: https://review.openstack.org/#/c/46074815:06
bnemecMight be helpful here.15:07
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339115:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359915:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)15:10
*** dpawar has joined #tripleo15:10
pradkmwhahaha, i put in this test patch to see if ci passes in ocata with telemetry and seems to be https://review.openstack.org/#/c/482360/ .. i did a deploy locally and it passed as well.15:10
pradki wonder if fencing is whats causing this15:11
*** nyechiel has quit IRC15:11
*** nyechiel_ has joined #tripleo15:11
pradkGoneri, hey do you happen to have sosreports from your failed cluster?15:11
*** zzzeek_ has quit IRC15:12
Goneripradk, the current environment is not clean enough now. I'm working on the certification test-suite and did some changes because of that. I'm about to do a fresh deployment with the last puddle in a couple of minutes.15:12
*** jpena|off is now known as jpena15:13
Goneripradk, and I just realized I was not on the last puddle like I thought, I use OSP11 2017-06-30.315:13
pradkunderstand, when it fails this time, if you could gather sosreports that would be helpful15:13
Goneri2017-07-05.1 has been released since that15:13
pradkGoneri, right thats the one on which udi saw the issue as well15:14
Goneripradk, sure, I can even give you a full SSH access if you want15:14
pradkcool, ssh access would be great15:14
*** anshul has quit IRC15:14
Goneripradk, I need =~ 3h to do the deployment again15:14
pradknp, i'll be around15:15
Goneripradk, great, thanks ;-)15:15
EmilienMweshay, matbu : /me back from meeting - ok good to know. I think the priority for upgrade issue is to find out the timeout and what is causing it - but yeah, having the job run by quickstart would be awesome15:17
*** oidgar has quit IRC15:17
weshaysshnaidm, ping re: ^ need to understand your workload atm15:18
*** psachin has quit IRC15:18
*** cdearborn_ has joined #tripleo15:18
*** rcernin has quit IRC15:18
weshayyou are out next week.. /me looks for someone else15:18
matbuEmilienM: i can look for the timeout, but iiuc its more on the RAX side ?15:18
EmilienMmwhahaha: re: gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet - how can we have a failure with manila package if we have the promotion jobs in tripleo?15:19
EmilienMmatbu: no, let me repeat :15:19
*** agurenko has quit IRC15:19
mwhahahaEmilienM: we don't actually test it15:19
EmilienMmatbu: we figured the job wasn't timeouting on OSIC because OSIC is an high performance cloud (probably with SSD and great harware)15:19
mwhahahaEmilienM: the deploy was fine but failed idempotency because the serfvice failed ot start15:19
EmilienMmatbu: so running upgrade job on this cloud was kind of hidding the issue we have with performances on upgrade jobs15:20
EmilienMmwhahaha: I don't get it - we have gate-tripleo-ci-centos-7-scenario004-multinode-oooq in promotion pipeline - which means we should have hit this issue in tripleo periodic jobs15:20
*** paramite has quit IRC15:20
dtrainorjpich, how was the environment set up?  using which installation method15:20
dtrainor?15:20
mwhahahaEmilienM: unless we actually exercise manila it wouldn't have shown up15:20
jpichdtrainor: ovb so, mostly following the baremetal install docs with a few tweaks?15:21
dtrainoroh ok.  ssl or non-sssl undercloud?15:21
jpichdtrainor: non-ssl15:21
*** jistr|call is now known as jistr15:22
EmilienMmwhahaha: we do15:22
mwhahahaEmilienM: oh i bet something else is pulling in oslo-reports15:22
EmilienMmwhahaha: https://github.com/openstack/tripleo-heat-templates/blob/master/ci/pingtests/scenario004-multinode.yaml#L121-L13415:23
mwhahahaEmilienM: which is common with these dependencies as they end up being covered by another package in scenario jobs15:23
mwhahahaEmilienM: and they only show up in the beaker jobs because we don't pull in the world15:23
jpichdtrainor: Did you have a look at the link I pasted in one of the comments? Does https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L766 look correct to you? I was going to try tweaking it and re-updating my undercloud in a few mins15:23
dtrainoryea that's what i was just looking at, give me a moment15:23
*** jtomasek_ has quit IRC15:24
dtrainoryeah, i think the template may not be correct.... https://github.com/openstack/instack-undercloud/blob/master/instack_undercloud/undercloud.py#L85515:25
EmilienMmwhahaha: good, so it's only in beaker jobs - nothing in tripleo ci - thanks!15:26
dtrainorhttps://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L766 should be using, I think, UNDERCLOUD_ENDPOINT_IRONIC_INSPECTOR_UI_CONFIG_PUBLIC15:26
*** ebarrera has quit IRC15:27
*** cdearborn__ has joined #tripleo15:29
dtrainorjpich, i can make the change but have no way to test right now15:30
jpichdtrainor: There doesn't seem to be any key for ironic-inspector ui-config or ui-proxy in the array, unlike the others?15:30
*** zzzeek_ has joined #tripleo15:30
dtrainorright15:31
dtrainoryeah, i may have missed that15:31
dtrainorjust to clarify, the array you're speaking of is this?  https://github.com/openstack/instack-undercloud/blob/master/instack_undercloud/undercloud.py#L78815:31
*** jaganathan has joined #tripleo15:32
jpichdtrainor: Yes!15:32
dtrainoryep, i believe you're right15:33
jpichdtrainor: If you're confident you understand what's going on, I'm happy to test tomorrow whatever patch you've prepared :)15:33
brandor5bnemec: I'm still mid-deploy but things are looking much better now since I've updated to remove the predictable IP addresses. Thank you very much for your help!15:33
jpichdtrainor: Otherwise if you leave a few notes in launchpad I'll take a stab at it15:33
*** cdearborn has quit IRC15:33
bnemecbrandor5: np, glad I could help15:33
dtrainorexcellent, i'll put it on the list for today.  had you filed a bug for this?  sorry, i'm late to the conversation15:34
*** cdearborn has joined #tripleo15:34
jpichdtrainor: Yep, https://bugs.launchpad.net/tripleo/+bug/170359615:35
openstackLaunchpad bug 1703596 in tripleo "No nodes visible in the UI after undercloud upgrade" [High,Triaged]15:36
jpichdtrainor: If you don't get a chance to look into it I'll give it a shot in the morning :)15:36
dtrainorappreciate it thank you15:36
*** jcoufal has joined #tripleo15:37
*** cdearborn_ has quit IRC15:37
*** cdearborn_ has joined #tripleo15:39
EmilienMif someone can review https://review.openstack.org/#/q/owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%22+topic:doc-migration please15:40
*** udesale__ has quit IRC15:40
openstackgerritJulie Pichon proposed openstack/tripleo-docs master: Document how to deploy with the UI  https://review.openstack.org/47614615:42
*** jfrancoa has quit IRC15:43
*** liverpooler has quit IRC15:44
*** achadha has joined #tripleo15:44
brandor5how should be formatted if I have no journal disks?15:44
brandor5nevermind, i finally found it. :D15:45
*** achadha has quit IRC15:47
*** achadha has joined #tripleo15:48
*** cdearborn__ has quit IRC15:48
*** limao has joined #tripleo15:49
*** trown is now known as trown|lunch15:49
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates master: WIP, additional coverage for ceilometer  https://review.openstack.org/48261015:50
*** ccamacho has quit IRC15:50
*** bogdando has quit IRC15:51
*** cdearborn has quit IRC15:52
openstackgerritRaoul Scarazzini proposed openstack/tripleo-quickstart-extras master: Restore tags inside the main playbook  https://review.openstack.org/47349115:52
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP, do not merge, testing  https://review.openstack.org/48261115:53
*** cylopez has joined #tripleo15:53
*** cylopez has quit IRC15:53
openstackgerritMerged openstack/tripleo-validations master: Switch from oslosphinx to openstackdocstheme  https://review.openstack.org/47826915:54
*** dciabrin has quit IRC15:54
*** cdearborn has joined #tripleo15:55
*** dciabrin has joined #tripleo15:55
*** cdearborn_ has quit IRC15:57
*** agopi|lunch has quit IRC15:57
*** agopi|lunch has joined #tripleo15:57
*** jmelvin_ has joined #tripleo15:57
*** nyechiel_ has quit IRC15:58
*** abishop_ has joined #tripleo15:58
*** jmelvin has quit IRC15:58
*** colonwq has quit IRC15:58
*** abishop has quit IRC15:59
*** ecerquei_ has joined #tripleo15:59
*** ecerquei has quit IRC15:59
openstackgerritRaoul Scarazzini proposed openstack/tripleo-quickstart master: Enable and document tags for all tasks  https://review.openstack.org/47611415:59
mariosflorianf: o/ does it seem reasonable to you? https://review.openstack.org/#/c/481667/ for use in https://review.openstack.org/#/c/474578/4/instack_undercloud/undercloud.py ("post-upgrade" we spoke about it briefly)15:59
*** cdearborn_ has joined #tripleo15:59
mariosflorianf: lets talk some more about it tomorrow /me getting ready to call it a day16:00
*** lmiccini has quit IRC16:00
openstackgerritMarios Andreou proposed openstack/tripleo-validations master: Fixup the undercloud service list used in the validation  https://review.openstack.org/48261516:00
florianfmarios: Sounds good to me. I'll have a closer look after dinner, so we can talk tomorrow.16:01
*** egonzalez has quit IRC16:02
*** colonwq has joined #tripleo16:03
openstackgerritMarios Andreou proposed openstack/instack-undercloud master: WIP Adds execution of validations after undercloud upgrade  https://review.openstack.org/47457816:03
*** janki has quit IRC16:03
openstackgerritZane Bitter proposed openstack/tripleo-heat-templates master: Add dependency relationship between nested get_attr targets  https://review.openstack.org/48217216:04
*** ykarel has quit IRC16:04
mariosthanks florianf  - also had to fixup the service list  https://review.openstack.org/482615 but with that the /474578 (and 'post-upgrade') completed OK for me ~1.5 minutes for the validation16:04
*** ykarel has joined #tripleo16:05
*** tzumainn_ has joined #tripleo16:05
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud  https://review.openstack.org/43754416:06
*** limao has quit IRC16:06
*** tzumainn has quit IRC16:07
*** oidgar has joined #tripleo16:07
florianfmarios: looks good. will give that one a run as well.16:08
sshnaidmdmsimard, hi16:08
dmsimardsshnaidm: o/16:09
*** limao has joined #tripleo16:09
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574716:09
sshnaidmdmsimard, I wanted to ask about moving status page code to SF, right now I use github for automatic build of server container and then webhook to script on the host to redeploy it automatically. Do we have such functionality in SF too?16:09
*** tzumainn_ is now known as tzumainn16:09
sshnaidmdmsimard, sorry, I meant github+dockerhub16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339116:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359916:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,In progress] - Assigned to Jiří Stránský (jistr)16:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)16:10
dmsimardsshnaidm: it's the tooling you know from openstack-infra, zuul nodepool gerrit16:10
dmsimardsshnaidm: you can do POST jobs to trigger after merge, etc.16:10
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add PCI to nova compute container for passthrough support  https://review.openstack.org/47850416:11
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Neutron SR-IOV agent container  https://review.openstack.org/46906616:11
*** cdearborn has quit IRC16:11
sshnaidmdmsimard, ok, and you submit it to github repo too, right? (as read only)16:11
dmsimardsshnaidm: yeah the authoritary repository is in gerrit and it's replicated to github16:11
sshnaidmdmsimard, ok, so it will continue work, thanks16:12
dmsimardsshnaidm: is the webhook on dockerhub or on github ?16:12
dmsimardsshnaidm: i.e, who triggers the build ?16:13
sshnaidmgithub triggers dockerhub, and then dockerhub hook triggers script on the server16:14
openstackgerritAna Krivokapic proposed openstack/tripleo-ui master: PlanList and PlanCard updates  https://review.openstack.org/47694216:15
*** limao has quit IRC16:15
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements  https://review.openstack.org/48261916:15
*** ykarel has quit IRC16:19
*** colonwq has quit IRC16:19
*** sshnaidm is now known as sshnaidm|afk16:21
EmilienMflaper87: hey16:21
*** colonwq has joined #tripleo16:22
*** panda is now known as panda|off16:22
EmilienMflaper87: you're Depends-On on https://review.openstack.org/#/c/471759/ is going nowhere16:22
*** dciabrin has quit IRC16:22
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Provides Ceph config into OpenStack clients  https://review.openstack.org/48250016:23
*** dciabrin has joined #tripleo16:23
EmilienMflaper87: also, I don't think kubernetes was deployed on https://review.openstack.org/#/c/471759/16:24
*** athomas has quit IRC16:24
*** liverpooler has joined #tripleo16:24
*** bfournie has quit IRC16:24
*** jpich has quit IRC16:25
*** dpawar has quit IRC16:25
*** bfournie has joined #tripleo16:26
*** bfournie has quit IRC16:26
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Allow to set Notification Driver to 'noop'  https://review.openstack.org/48172616:27
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Remove hardcoded enable_load_balancer from Controller role  https://review.openstack.org/48114716:29
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Remove controller specific bootstack_nodeid  https://review.openstack.org/48114516:29
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Remove special-case of memcache node ips for ipv6  https://review.openstack.org/48108416:29
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Support deprecated controllerExtraConfig naming in role template  https://review.openstack.org/48027016:29
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add NodeTLSData to generic role.role.j2.yaml  https://review.openstack.org/48027116:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert controller-role.yaml to role.role.j2.yaml  https://review.openstack.org/48027216:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert compute-role.yaml to role.role.j2.yaml  https://review.openstack.org/48262316:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert objectstorage-role.yaml to role.role.j2.yaml  https://review.openstack.org/48262416:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert blockstorage-role.yaml to role.role.j2.yaml  https://review.openstack.org/48262516:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert cephstorage-role.yaml to role.role.j2.yaml  https://review.openstack.org/48262616:30
*** dsneddon has joined #tripleo16:31
*** suuuper has quit IRC16:33
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Remove DockerNamespace references  https://review.openstack.org/47939816:33
openstackgerritAna Krivokapic proposed openstack/tripleo-ui master: Remove pxe_ssh option from node registration  https://review.openstack.org/48262716:33
*** yprokule has quit IRC16:34
*** bfournie has joined #tripleo16:37
*** anshul has joined #tripleo16:38
*** bfournie has quit IRC16:40
*** snecklifter has quit IRC16:46
*** marios has quit IRC16:46
*** bogdando has joined #tripleo16:48
*** nyechiel_ has joined #tripleo16:49
*** shardy has quit IRC16:49
*** dsariel has quit IRC16:49
*** dprince has quit IRC16:51
*** ffiore_ has quit IRC16:51
*** brault has quit IRC16:52
*** lucasagomes is now known as lucas-afk16:52
*** jlinkes has quit IRC16:52
*** jlinkes has joined #tripleo16:52
*** dprince has joined #tripleo16:55
*** jlinkes_ has joined #tripleo16:56
*** dpawar has joined #tripleo16:58
*** sshnaidm|afk has quit IRC16:58
*** jlinkes has quit IRC16:59
*** achadha has quit IRC16:59
*** achadha has joined #tripleo17:02
*** achadha has quit IRC17:03
*** thrash is now known as thrash|bbl17:04
*** jlinkes__ has joined #tripleo17:05
*** jlinkes_ has quit IRC17:05
*** oidgar has quit IRC17:05
*** itlinux has joined #tripleo17:09
itlinuxhello all, any suggestions on this error .. TY 2017-07-11 17:06:00Z [overcloud.Networks.ExternalNetwork.ExternalNetwork]: CREATE_FAILED  Conflict: resources.ExternalNetwork: Unable to create the flat network. Physical network external is in use.17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339117:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359917:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,In progress] - Assigned to Jiří Stránský (jistr)17:10
*** pkovar has quit IRC17:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)17:10
*** jlinkes__ is now known as jlinkes17:10
*** fandrieu has quit IRC17:11
*** jcoufal has quit IRC17:12
*** bfournie has joined #tripleo17:12
*** fzdarsky is now known as fzdarsky|afk17:13
*** jpena is now known as jpena|off17:13
beaglesis it possible to modify a container's mounts "in place" on a compute node or will I need to redeploy?17:13
*** jpena|off has quit IRC17:14
beaglesjust looking to test out whether specific mods will be all that is required17:14
EmilienMbnemec: do we want to backport https://review.openstack.org/#/c/479406/ ?17:15
bnemecEmilienM: I guess we do.  Otherwise the stable branches will keep hitting that bug.17:16
EmilienMbnemec: I can propose them, gimme a sec17:16
bnemecEmilienM: I think jistr actually has a partial backport of that included in his fix for one of the alert bugs.17:17
EmilienMhttps://review.openstack.org/#/c/482167/1/ci/environments/scenario001-multinode-containers.yaml17:18
EmilienMindeed he did backport your change17:18
EmilienMjistr++17:18
openstackgerritJoe Talerico proposed openstack/tripleo-heat-templates master: Adding Tuned Service  https://review.openstack.org/45412317:18
bnemecEmilienM: I think that only does the containers environments.  I think we probably need to do them all?17:21
EmilienMbnemec: yes probably17:22
EmilienMbnemec: I approved https://review.openstack.org/#/c/482167/ and i'll add the backport on top17:23
EmilienMbnemec: so I can also backport it to newton17:23
bnemecEmilienM: wfm17:23
EmilienMbnemec: https://review.openstack.org/#/c/482167/ wasn't backportable to newton anyway17:23
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources  https://review.openstack.org/47381717:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Disable network validation in multinode jobs  https://review.openstack.org/48264417:26
EmilienMbnemec: clean backport to ocata ^17:26
*** anshul has quit IRC17:27
openstackgerritJoe Talerico proposed openstack/tripleo-heat-templates master: Adding Tuned Service  https://review.openstack.org/45412317:28
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: Disable network validation in multinode jobs  https://review.openstack.org/48264517:29
EmilienMand newton backport ^17:29
bnemecEmilienM: Thanks17:30
*** oidgar has joined #tripleo17:30
EmilienMcool17:30
EmilienMhopefully it will make our CI a bit more stable17:30
*** bogdando has quit IRC17:31
bnemecEmilienM: Oh, I think the newton one needs the actual validation resource included too.17:31
itlinuxdoes anyone have a good guide for VLANs with Bonds?17:34
itlinuxthanks..17:34
*** jcoufal has joined #tripleo17:34
EmilienMbnemec: nice catch17:34
itlinuxI have a network already created for the external but which is not in used and I get this.. Unable to create the flat network. Physical network external is in use17:34
itlinuxany tips?17:35
bnemecEmilienM: Pretty sure ci would have failed spectacularly anyway. :-)17:35
*** achadha has joined #tripleo17:35
EmilienMbnemec: I'm afraid that the heat_template_version is pike for all-nodes-validation-disabled.yaml17:36
bnemecitlinux: If you already created an external network then that's your problem.17:36
itlinuxok what can I do to bypass that?17:36
itlinuxthanks bnemec:17:36
bnemecEmilienM: Oh, how did the ocata backport pass then?17:36
itlinuxjus remove the network on the switches.. ? TY17:36
EmilienMbnemec: I don't see anything in the template that wouldn't work on newton though17:36
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: WIP: sync up ceph-ansible params with newer builds  https://review.openstack.org/48264717:36
EmilienMbnemec: good question17:36
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: Disable network validation in multinode jobs  https://review.openstack.org/48264517:37
bnemecitlinux: Delete the pre-existing external network from the undercloud neutron before doing the overcloud deployment.17:37
bnemecitlinux: At least if I'm understanding your situation correctly.17:38
*** tosky has quit IRC17:41
gbarrosare we still having CI issues?17:42
gbarrosor could someone help me figure out whats going on? :)17:42
gbarrosgate-tripleo-ci-centos-7-containers-multinode fails with no route to host.17:43
*** trown|lunch is now known as trown17:43
*** oidgar has quit IRC17:45
*** zzzeek_ has quit IRC17:46
bnemecgbarros: containers-multinode still seems to be awash with red, so I'd say it's still broken.17:46
gbarrosbnemec, are we considering pushing out the M3 date bc of CI borkage?17:47
*** yamahata has joined #tripleo17:47
bnemecgbarros: Also, note that there should generally be an alert bug open for broken ci jobs, which in this case there is.  See the ooolpbot message from about half an hour ago in this channel.17:48
EmilienMweshay, arxcruz: do you know why stackviz output is empty while job ran tempest? http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/904c06c/logs/stackviz/#/stdin/timeline17:48
gbarrosbnemec ah, let me see what that looks like. ty17:48
weshayEmilienM, ya.. there's a devstack bug that put's that in the log17:48
bnemecgbarros: I have no knowledge about that one way or another.17:48
weshayEmilienM, /me gets17:48
EmilienMweshay, arxcruz: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/904c06c/logs/oooq/stackviz/#/stdin17:48
arxcruzEmilienM: yes17:48
EmilienMin fact there are 2 directoris17:48
EmilienMarxcruz: can we fix that please?17:48
arxcruzEmilienM: basically, our job is in tripleo-ci but it calls devstack-gate17:49
weshayEmilienM, http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq-ocata/904c06c/logs/oooq/stackviz/#/stdin17:49
arxcruzand devstack-gate calls their own stackviz_process that overrides ours17:49
*** zzzeek_ has joined #tripleo17:49
EmilienMarxcruz: can't we disable it or override it at the end?17:49
weshayEmilienM, you are probably on the review where we're trying to fix it17:49
* weshay runs17:49
arxcruzEmilienM: https://review.openstack.org/#/c/475788/17:49
*** raissa_ has quit IRC17:49
EmilienMweshay: you and I know I don't read emails17:50
EmilienMarxcruz: thanks :-)17:50
arxcruzEmilienM: this will enable us to override the stackviz17:50
weshayEmilienM,  :) either do I17:50
EmilienMarxcruz: excellent17:50
arxcruzEmilienM: meanwhile, I'm trying to do a workaround17:50
weshayarxcruz, what is the work around in case that does not merge17:50
weshayha17:50
weshayarxcruz, and I are of one mind17:50
arxcruzhehe :)17:50
arxcruzEmilienM: weshay https://review.openstack.org/#/c/482096/ is one of the workarounds17:51
arxcruzweshay: EmilienM https://review.openstack.org/#/c/474559/ is the other one17:51
arxcruzbut it's not working yet17:51
EmilienMok17:51
*** ecerquei_ has quit IRC17:52
weshaypradk, http://logs.openstack.org/11/482611/1/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/363ba05/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz17:52
weshaysorry http://logs.openstack.org/11/482611/1/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/363ba05/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-11_16_29_0417:53
EmilienMweshay: also I'm wondering if we should add container jobs into promotion pipeline17:54
*** salmankhan has quit IRC17:54
*** dpawar has quit IRC17:54
*** brault has joined #tripleo17:56
weshayEmilienM, oh we are17:56
weshayEmilienM, there is a ton of work being done atm to enable that17:57
weshayEmilienM, all the promotion jobs are moving to rdo software factory atm17:57
itlinuxdoes anyone have a good guide for vlans and bonds? I am not using quickstart. TY17:58
EmilienMweshay: I'm asking if whether or not we should add container scenarios in the periodic pipeline in tripleo-ci and make them part of promotion pipeline17:58
weshayEmilienM, can I fill you in for a sec?17:58
weshaybecause my answer holds17:58
flaper87EmilienM: that's what I mentioned this morning. you probably missed the backlog17:58
itlinuxI get this erros.. http://paste.openstack.org/show/615058/17:58
flaper87EmilienM: there seems to be another problem but you approved the patch that should fix17:58
itlinuxany tips?17:58
EmilienMweshay: yeah17:59
EmilienMflaper87: yeah sorry - I missed some pings probably17:59
EmilienMflaper87: which one?17:59
weshayEmilienM, when you have a sec https://bluejeans.com/u/whayutin/17:59
flaper87EmilienM: no worries. The TL;DR is that kubernetes is not being deployed and the environment file is not part of the overcloud deploy command for some reason17:59
weshayor we can fill you in on thrs17:59
flaper87I'm trying to figure out why this is happening17:59
flaper87EmilienM: gfidente suggested this might be the issue: https://review.openstack.org/#/c/482545/17:59
EmilienMflaper87: good18:00
EmilienMflaper87: not sure if it's related to your work with k8s though18:00
*** ecerquei has joined #tripleo18:01
EmilienMflaper87: ok I see now18:02
gfidenteEmilienM flaper87 yeah it was deploying an empty overcloud18:02
EmilienMflaper87: :)18:02
EmilienMgfidente: yeah, I missed that part. My bad18:02
flaper87EmilienM: gfidente waiting for that patch to land. I could add a depends-on but I'm in now rush right now. I'll let the gate do its job in peace18:03
*** achadha_ has joined #tripleo18:05
*** achadha has quit IRC18:05
*** tosky has joined #tripleo18:07
openstackgerritHaïkel Guémar proposed openstack/tripleo-common master: Ensure EPEL is not enabled in containers images  https://review.openstack.org/48265418:08
*** number80 has joined #tripleo18:08
number80Is this the right way to override variables from Kolla templates?18:09
number80https://review.openstack.org/#/c/482654/18:09
number80I tried to fix the following bug: https://bugs.launchpad.net/tripleo/+bug/170276418:09
openstackLaunchpad bug 1702764 in tripleo "container images enable the epel repository" [Critical,In progress] - Assigned to Haïkel Guémar (hguemar)18:09
*** achadha_ has quit IRC18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339118:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359918:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,In progress] - Assigned to Jiří Stránský (jistr)18:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)18:10
*** mwhahaha sets mode: +o EmilienM18:11
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz collect data  https://review.openstack.org/47455918:12
*** bfournie has quit IRC18:12
*** yamahata has quit IRC18:14
*** yamahata has joined #tripleo18:15
*** jaganathan has quit IRC18:15
*** ggillies_ has quit IRC18:19
*** ggillies has joined #tripleo18:21
rookmwhahaha so there must be more to doing tox -e genrolesdata -- i get a unknown environment error.18:22
mwhahaharook: sorry 'genroledata'18:23
rookah ha18:23
mwhahaharook: see tox.ini18:23
rookis there a way to list those18:23
rookok18:23
rookmwhahaha: thanks18:24
mwhahahanp18:24
*** tesseract has quit IRC18:25
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Adjust mtus for vxlan networking  https://review.openstack.org/48122218:26
*** ebarrera has joined #tripleo18:26
openstackgerritJoe Talerico proposed openstack/tripleo-heat-templates master: Adding Tuned Service  https://review.openstack.org/45412318:27
*** iranzo has quit IRC18:27
*** achadha has joined #tripleo18:30
*** ebarrera_ has joined #tripleo18:31
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: allow tqe roles to work in sync with ARA  https://review.openstack.org/48223718:32
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: allow output for ara logs  https://review.openstack.org/48266018:33
*** achadha has quit IRC18:35
*** jcoufal has quit IRC18:35
*** Goneri has quit IRC18:36
*** Goneri has joined #tripleo18:36
gbarroscurious, how long should zuul take to notice that a job is complete?18:41
*** nyechiel_ has quit IRC18:42
*** achadha has joined #tripleo18:47
*** thrash|bbl is now known as thrash18:50
EmilienMgbarros: it depends on zuul load18:51
EmilienMyou can check on status.openstack.org/zuul/18:51
EmilienMQueue lengths: 4 events, 87 results18:52
EmilienMthis is the zuul backlog18:52
EmilienMas you can see, busy18:52
*** amoralej is now known as amoralej|off18:52
*** jcoufal has joined #tripleo18:52
*** akrivoka has quit IRC18:57
gbarrosty EmilienM. related question: is there a way to recheck just the failing container check to avoid loading ci even further?18:58
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Start using nic-configs from THT repo instead of tripleo-ci  https://review.openstack.org/47670818:59
*** snecklifter_ has quit IRC18:59
EmilienMgbarros: no, they are all in the same pipeline, so you can't.19:03
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339119:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359919:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,In progress] - Assigned to Jiří Stránský (jistr)19:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)19:10
gbarrosEmilienM, workflow question: does a recheck with no new patch wipe out existing reviewer + or - ?19:11
*** fragatina has quit IRC19:11
EmilienMgbarros: no, it just trigger zuul to run the jobs again19:12
gbarrosty19:12
*** gfidente has quit IRC19:13
*** ebarrera has quit IRC19:15
*** snecklifter has joined #tripleo19:17
*** snecklifter has quit IRC19:17
*** jlinkes_ has joined #tripleo19:21
*** jlinkes has quit IRC19:23
*** jlinkes_ has quit IRC19:26
*** cschwede has quit IRC19:26
*** jlinkes has joined #tripleo19:29
*** toure is now known as toure|biab19:35
*** toure|biab is now known as toure19:35
*** paramite has joined #tripleo19:36
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Refactor iscsi initiator-name reset into separate service  https://review.openstack.org/48217019:41
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize manila-share for HA  https://review.openstack.org/48268019:47
*** itlinux has quit IRC19:47
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Share service  https://review.openstack.org/47152719:48
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Share for HA  https://review.openstack.org/48268019:49
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Refactor iscsi initiator-name reset into separate profile  https://review.openstack.org/48216619:51
openstackgerritMerged openstack/tripleo-docs master: Clean up admonition problems  https://review.openstack.org/42696919:52
openstackgerritZane Bitter proposed openstack/tripleo-heat-templates master: Add dependency relationship between nested get_attr targets  https://review.openstack.org/48217219:53
*** achadha_ has joined #tripleo20:01
*** achadha has quit IRC20:03
*** sbrzozow has quit IRC20:03
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Add support for installing Ceph MDS via ceph-ansible  https://review.openstack.org/47942620:04
*** pchavva has quit IRC20:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339120:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,In progress] - Assigned to Jiří Stránský (jistr)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359920:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)20:10
*** itlinux has joined #tripleo20:10
*** jkilpatr has quit IRC20:11
*** dprince has quit IRC20:12
*** achadha_ has quit IRC20:16
*** achadha has joined #tripleo20:16
*** achadha has quit IRC20:16
*** achadha has joined #tripleo20:17
Goneripradk, I just reproduced the problem with the last puddle20:20
*** fragatina has joined #tripleo20:21
mwhahahaGoneri: can you grab sosreports from everything?20:22
Gonerisure, I can also give direct access to the platform20:23
pradkyea sosreports should be helpful .. if you can add them to https://bugs.launchpad.net/tripleo/+bug/170344420:24
openstackLaunchpad bug 1703444 in tripleo "ocata deploy fails randomly with ceilo upgrade failing with keystone" [High,Triaged]20:24
*** MVenesio has quit IRC20:25
openstackgerritMerged openstack/tripleo-docs master: Document how to deploy with the UI  https://review.openstack.org/47614620:26
pradkGoneri, also i dont think sosreport grabs gnocchi logs.. so if you can tar up /var/log/gnocchi/20:28
*** cdearborn_ has quit IRC20:29
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Add support for nova live/cold-migration with containers  https://review.openstack.org/47195620:31
*** jkilpatr has joined #tripleo20:32
*** rhallisey has quit IRC20:33
vkmcstevebaker, hey o/20:33
vkmcpinging you directly since you are the last one that worked on manila.pp20:34
vkmcI'm adding a share_bundle.pp for the new containerized manila-share service20:34
vkmcI'm wondering if we are making any difference among the different manifests we have... and if so... I'd appreciate some guidance20:34
vkmcI'm pushing it for review, let me know if you have a minute later20:35
openstackgerritVictoria Martinez de la Cruz proposed openstack/puppet-tripleo master: Puppet module to deploy Manila Share bundle for HA  https://review.openstack.org/48269620:35
*** ecerquei has quit IRC20:40
EmilienMvkmc: what kind of difference?20:41
EmilienMvkmc: (hello :))20:42
vkmcEmilienM, not sure, that's why I ask :)20:42
vkmchey!20:42
vkmcI see there is a manila.pp for setting up backends for the tripleo non-containerized deployment20:43
*** ansmith_ has quit IRC20:43
*** ansmith has quit IRC20:43
vkmcthis one precisely https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/pacemaker/manila.pp20:43
vkmcit configures backends, among other stuff...20:43
vkmcI was working on one for the tripleo containerized deployment20:44
*** lblanchard has quit IRC20:44
EmilienMbnemec: http://logs.openstack.org/44/482644/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/18e5913/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-11_18_57_0020:45
EmilienMinteresting20:45
EmilienMbnemec: it's failing in https://review.openstack.org/#/c/482644/20:46
EmilienMah because https://review.openstack.org/#/c/482167/ isn't using it.20:46
EmilienMI'll fix it20:46
EmilienMvkmc: let me finish that and I'll look20:46
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Add instack-pre-upgrade-undercloud to setup.cfg  https://review.openstack.org/48270020:46
vkmcEmilienM, sure thing, thanks :)20:46
bnemecEmilienM: Yeah, I think my comment there explains how it passed in the containers patch.20:47
EmilienMyeah20:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Disable network validation in multinode jobs  https://review.openstack.org/48264420:47
EmilienMfixed ^ let's see how it works20:47
bnemecOn a related note I'm not sure I'm a fan of forcing all the templates to be the latest template version.20:47
bnemecI guess this is sort of a specific case where we're adding a new template and have to backport the change.20:48
EmilienMvkmc: ok I'm not familiar enough with this code, though I can have a look later. I know Dan Prince has been heavily involved in this work, in case you don't hear from me, you can email him, he'll probably help tomorrow20:48
EmilienMvkmc: so iiuc, you want to make manila backends working on containerized deployments?20:48
*** zzzeek_ has quit IRC20:49
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Add NodeTLSData to generic role.role.j2.yaml  https://review.openstack.org/48027120:50
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Share service  https://review.openstack.org/47152720:51
vkmcEmilienM, sure, there is no rush, I can wait til tomorrow and chat with dprince20:51
mwhahahapradk: btw gnocchi is triggering the httpd restart in step520:51
EmilienMvkmc: what exactly do you want to achieve?20:51
pradkmwhahaha, hmm is that the statsd/metricd profile?20:51
EmilienMmwhahaha: probably ::gnocchi::statsd20:51
pradkapi and upgrade should be done in step420:52
openstackgerritBen Nemec proposed openstack/python-tripleoclient master: Call undercloud pre-upgrade hook  https://review.openstack.org/47908220:52
mwhahahayes20:52
EmilienMit's a known-thing20:52
EmilienMI said it before when reviewing the patch maybe or on IRC20:52
vkmcEmilienM, yeah, we are containerizing manila services... one of those services, manila-share, needs HA20:52
mwhahahaEmilienM: right but we were wondering why keystone may be unavailable for the upgrade20:52
EmilienMthe problem, iirc, is that we need statsd (and maybe metricd) after the API is up20:52
EmilienMvkmc: ok so you're asking what work needs to be done to have Manila Share service containerized, in HA20:52
mwhahahaso that's kinda the problem20:52
*** ckyriakidou has quit IRC20:52
pradkbut statsd doesnt run under httpd, so i wonder why that would trigger it20:53
mwhahahapradk: gnocchi_config20:53
pradkmay be we have a trigger somewhere .. lemme look at puppet20:53
mwhahahagnocchi_config notifies the service20:53
vkmcEmilienM, I'm trying to see if with the puppet manifest I submitted is enough... and if we should add something else to configure backends and be able to use an hybrid deploy20:53
mwhahahapradk: http://paste.openstack.org/show/615074/20:54
vkmcwe don't have the storage backends for manila containerized so we would need to deploy backends as usual and configure manila services to use them20:54
EmilienMpradk: yes, Alex is right. change in gnocchi_config is the reason why it restarts20:54
pradkmwhahaha, hmm thats in puppet-gnocchi.. yeah, so perhaps we move this to step 420:55
mwhahahapradk: line 41 the gnocchi_config notifies gnocchi::config::end which results in a service refresh20:55
EmilienMvkmc: ok I'll try to review it but I think dprince should have a look20:55
vkmcEmilienM, thanks for that20:56
EmilienMvkmc: a good example is to look at some cinder services, already containerized, and also managed by Pacemaker20:56
*** oneswig has joined #tripleo20:56
EmilienMvkmc: take a look at cinder-volume and see if some bits were added in puppet-tripleo recently20:56
vkmcyeah20:56
vkmc:)20:56
vkmcI followed closely changes done on the cinder side... and we do need to do something like that in manila side20:57
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: opensuse-minimal: install glibc-locale  https://review.openstack.org/47395920:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Allow to set Notification Driver to 'noop'  https://review.openstack.org/48172620:57
itlinuxhello all.. does anyone have a good updated doc on how to push overcloud with bonds and vlans? TY20:58
itlinuxI looked but many do not have the latest updated info..20:58
itlinuxI found that this --neutron-tunnel-types vxlan --neutron-network-type vxlan  does not work anymore and it's default anyhow..20:59
pradkmwhahaha, we could move it to step 4, but we need to add a depends on gnocchi api to it waits for that before starting20:59
bnemecitlinux: There's a bond-with-vlans example in tripleo-heat-templates: https://github.com/openstack/tripleo-heat-templates/tree/master/network/config/bond-with-vlans21:00
pradkmwhahaha, the 503 happens around 19:42:23.626 jul 11 .. this refresh trigger seems to be way before?21:02
*** bogdando has joined #tripleo21:04
itlinuxwell I looked at bnemec: and the last attempted I got that all my vlans had the same ip address 172.16.200.107... on every single vlan id..21:04
itlinuxso that's what I wonder..21:04
pradkmwhahaha, yea i do see statsd around the same time.. in os-collect-config Jul 11 19:45:24 overcloud-controller-0.cwdg720xd01.org os-collect-config[3259]: Notice: /Stage[main]/Gnocchi::Statsd/Gnocchi_config[statsd/flush_delay]/ensure: created21:06
mwhahahapradk: either that or do the upgrade before the statsd config21:07
pradkJul 11 19:45:24 overcloud-controller-0.cwdg720xd01.org os-collect-config[3259]: Error: ceilometer-upgrade --skip-metering-database returned 1 instead of one of [0]21:07
bnemecitlinux: Sounds like there's something wrong with your network-environment.yaml.  See: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/network_isolation.html#create-network-environment-file21:08
itlinuxok I will check this out.. ty21:08
pradkmwhahaha, we need gnocchi api reachable for ceilo upgrade, but that only comes up in step 421:09
mwhahahapradk: right i'm sayign in puppet-tripleo do some ordering to make sure the db sync runs before gnocchi stuff in step521:09
mwhahahapradk: do you already have a patch in master about this bug?21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339121:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,In progress] - Assigned to Jiří Stránský (jistr)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359921:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)21:10
*** agopi|lunch has quit IRC21:10
*** zzzeek_ has joined #tripleo21:11
pradkmwhahaha, in master we moved the upgrade code out of collector.pp .. so we will have to redo this anyway for ocata. plus we havent seen this issue in master as we disable collector by default.21:11
mwhahahapradk: ah ok let me go pull up the one in ocata and show you21:12
pradkmwhahaha, but we will need to fix upgrade.pp in master instead .. which is different code path21:12
*** florianf has quit IRC21:12
*** rbowen has quit IRC21:13
pradksomething like before => Service['gnocchi-statsd'] ?21:13
pradkmwhahaha, in the exec that is21:13
mwhahahasec21:14
pradkso this only happens randomly because sometime upgarde could run before statsd notifies service restart21:15
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Ensure ceilometer upgrade occurs before gnocchi step5 config  https://review.openstack.org/48270721:15
pradki'm surprised we havent seen this more often before21:15
mwhahahapradk: -^21:15
pradkcool21:16
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Ensure ceilometer upgrade occurs before gnocchi step5 config  https://review.openstack.org/48270721:16
mwhahahaso we could cherry pick that to ocata21:16
mwhahahaand try that21:16
pradkwe could use before => too ? or is this dependency better?21:16
mwhahahathis is the same as a before21:17
pradkcool21:17
mwhahahain order to the resource collector you have to do it this way (patchset2)21:17
mwhahahaso it'll just do it only i gnocchi is included in the catalog, it'll skip the requirement if it's not on the same node21:17
mwhahahabut i'm not sure we split those apart anywhere21:17
pradkso this gnocchi start anchor is only for step 5 ? it wont conflict with the step 4 config anchors right?21:18
pradkwe have same anchor in step 4 when gnocchi api is configured21:19
mwhahahathat block is only in step521:19
mwhahahathe ordering is within the step >= 5 if clause21:20
pradkcool21:20
mwhahahathe line basically will ensure that the upgrade exec runs prior to gnocchi config if gnocchi config is in the catalog and sinc eit's in the if block for step5 it only applies there21:21
pradkright, understood21:22
*** pcaruana has quit IRC21:23
*** abishop_ has quit IRC21:23
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Remove additional Bumblebee repository for opensuse element  https://review.openstack.org/48270821:24
stevebakervkmc: hi21:24
*** dparkes has joined #tripleo21:30
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo stable/ocata: Ensure ceilometer upgrade occurs before gnocchi step5 config  https://review.openstack.org/48271221:31
pradkmwhahaha, ^^ ocata21:31
openstackgerritMerged openstack/tripleo-ui master: Change tripleo-ui login images  https://review.openstack.org/47471021:33
*** Lokesh_Jain__ has quit IRC21:34
*** ansmith_ has joined #tripleo21:39
*** ansmith has joined #tripleo21:39
*** jprovazn has quit IRC21:43
*** jlinkes has quit IRC21:45
*** jmelvin_ has quit IRC21:50
*** mcornea has quit IRC21:50
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: WIP: Adjust MTUs in multinode workflow on RDO Cloud  https://review.openstack.org/48122222:02
*** brandor5 has quit IRC22:03
openstackgerritMerged openstack/tripleo-ui master: Add favicon icons  https://review.openstack.org/42011122:03
openstackgerritLokesh Jain proposed openstack/puppet-tripleo stable/newton: Remove unnecessary references to neutron core plugin hiera  https://review.openstack.org/48177422:03
openstackgerritLokesh Jain proposed openstack/puppet-tripleo stable/ocata: Remove unnecessary references to neutron core plugin hiera  https://review.openstack.org/48221122:04
*** bogdando has quit IRC22:05
*** morazi has quit IRC22:06
*** oneswig has quit IRC22:07
*** dparkes has quit IRC22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339122:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,In progress] - Assigned to Jiří Stránský (jistr)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359922:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)22:10
openstackgerritLokesh Jain proposed openstack/puppet-tripleo stable/ocata: Addition of Nuage as mechanism driver for ML2  https://review.openstack.org/48272122:13
openstackgerritLokesh Jain proposed openstack/puppet-tripleo stable/ocata: Addition of Nuage as mechanism driver for ML2  https://review.openstack.org/48272122:14
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Load Mistral workbooks via Python instead of Bash  https://review.openstack.org/48272322:19
*** bnemec has quit IRC22:24
*** jcoufal has quit IRC22:24
*** bnemec has joined #tripleo22:25
*** bfournie has joined #tripleo22:26
*** bfournie has quit IRC22:26
*** jbadiapa_ has joined #tripleo22:29
*** pradk has quit IRC22:29
*** dr_gogeta86 has quit IRC22:30
*** jbadiapa has quit IRC22:31
*** achadha_ has joined #tripleo22:35
*** achadha has quit IRC22:36
itlinuxis there a way to define the order on the overcloud.. example top to bottom so I have the label correctly assigned when I do the deployment? TY22:40
*** ebarrera_ has quit IRC22:42
*** dsneddon has quit IRC22:44
*** toure is now known as toure|biab22:54
*** toure|biab is now known as toure22:54
itlinuxwhat's the best way to check about this erro overcloud.Controller.0.NetworkDeployment22:57
itlinuxhere is the full one from the line22:58
itlinuxovercloud.Controller.1.NetworkDeployment]: CREATE_FAILED  Error: resources.NetworkDeployment: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 122:58
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170339123:10
openstackLaunchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,In progress] - Assigned to Jiří Stránský (jistr)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170359923:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1703599 in tripleo "Containers multinode job deploying an empty overcloud" [Critical,In progress] - Assigned to Jiří Stránský (jistr)23:10
*** itlinux has quit IRC23:10
*** tosky has quit IRC23:13
*** Goneri has quit IRC23:14
*** ebarrera_ has joined #tripleo23:14
*** apetrich has quit IRC23:16
*** apetrich has joined #tripleo23:18
*** ebarrera_ has quit IRC23:27
*** d0ugal has joined #tripleo23:37
*** samdoran has quit IRC23:37
stevebakerSlower: hey, are you about?23:37
*** ramishra has quit IRC23:41
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: Use a single configuration file for specifying docker containers.  https://review.openstack.org/47862823:53
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: Remove DockerNamespace references  https://review.openstack.org/47939823:53
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: Generate docker-centos-tripleoupstream.yaml with prepare  https://review.openstack.org/48273923:53
*** pliu_ has joined #tripleo23:54
*** pliu_ has quit IRC23:56
*** pliu_ has joined #tripleo23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!