Wednesday, 2018-01-10

*** apetrich has quit IRC00:00
*** apetrich has joined #tripleo00:01
*** dparkes has quit IRC00:05
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956900:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)00:10
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Use docker_config_scripts for puppet apply  https://review.openstack.org/53126100:17
*** raildo has quit IRC00:17
*** rlandy has quit IRC00:24
*** akrivoka has quit IRC00:26
*** ecerquei has joined #tripleo00:27
*** jlabarre has quit IRC00:54
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Remove repo priority from ocata to pike testing.  https://review.openstack.org/53237001:02
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956901:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)01:10
*** psahoo has joined #tripleo01:14
*** numans has quit IRC01:16
*** numans has joined #tripleo01:17
*** daidv has quit IRC01:18
*** daidv has joined #tripleo01:19
*** benone has quit IRC01:24
*** mdnadeem has joined #tripleo01:25
*** benone has joined #tripleo01:27
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha  https://review.openstack.org/51223901:37
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Add support for ceph-nfs manila backend  https://review.openstack.org/47124501:38
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible  https://review.openstack.org/51224001:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-common stable/pike: [DO NOT MERGE] Testing upgrade.  https://review.openstack.org/52340801:40
*** d0ugal has quit IRC01:43
tbarrondsneddon: would it make sense to abandon https://review.openstack.org/#/c/485796/ in favor of https://review.openstack.org/#/c/512239/ ? That01:45
tbarrondsneddon: would cleanup the topic https://review.openstack.org/#/q/topic:bp/nfs-ganesha+(status:open+OR+status:merged)01:46
*** ecerquei_ has joined #tripleo01:57
*** rfolco has joined #tripleo01:58
*** ecerquei has quit IRC02:00
*** d0ugal has joined #tripleo02:02
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956902:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)02:10
*** ooolpbot has quit IRC02:10
*** liverpooler has joined #tripleo02:10
*** dsneddon has quit IRC02:17
*** thrash is now known as thrash|g0ne02:33
*** abishop has quit IRC02:38
*** athomas has quit IRC02:42
*** athomas has joined #tripleo02:43
*** pmannidi has quit IRC02:44
*** liverpooler has quit IRC02:47
*** pmannidi has joined #tripleo02:48
*** liverpooler has joined #tripleo03:08
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956903:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)03:10
*** ooolpbot has quit IRC03:10
*** ramishra has joined #tripleo03:10
*** shreshtha has joined #tripleo03:15
*** shreshtha has quit IRC03:21
*** shreshtha has joined #tripleo03:21
*** jistr has quit IRC03:31
*** ramishra has quit IRC03:33
*** chlong has joined #tripleo03:34
*** ramishra has joined #tripleo03:35
*** shadower has quit IRC03:42
*** liverpooler has quit IRC03:42
*** udesale has joined #tripleo03:59
*** ecerquei_ has quit IRC04:07
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956904:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)04:10
*** ooolpbot has quit IRC04:10
*** links has joined #tripleo04:37
*** itlinux has quit IRC04:39
*** links has quit IRC04:40
*** janki has joined #tripleo04:41
*** links has joined #tripleo04:46
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Revert "Dont install python-pip for py3k"  https://review.openstack.org/53239504:50
*** skramaja has joined #tripleo04:52
*** shreshtha has quit IRC04:54
*** ykarel has joined #tripleo04:58
*** shreshtha has joined #tripleo05:00
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates stable/ocata: Set restrictive file permissions on Ceph keyrings for non-containerized deployment  https://review.openstack.org/53239705:00
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates stable/newton: Set restrictive file permissions on Ceph keyrings for non-containerized deployment  https://review.openstack.org/53239805:01
*** pdeore has joined #tripleo05:01
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956905:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)05:10
*** karthiks has joined #tripleo05:10
*** artom_ has quit IRC05:11
*** stendulker has joined #tripleo05:11
*** tzumainn has quit IRC05:14
*** jaganathan has joined #tripleo05:19
*** ratailor has joined #tripleo05:25
EmilienMarxcruz|ruck, panda|rover|afk: FYI https://bugs.launchpad.net/tripleo/+bug/174236705:34
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)05:34
*** artom has joined #tripleo05:37
*** psachin has joined #tripleo05:40
Tenguhello there05:49
*** dpawar has joined #tripleo05:57
*** dsariel has joined #tripleo05:58
*** jbadiapa has quit IRC06:02
*** karthiks has quit IRC06:04
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956906:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174236706:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)06:10
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)06:10
*** chlong has quit IRC06:16
*** suuuper has joined #tripleo06:21
*** moshele has joined #tripleo06:23
*** jbadiapa has joined #tripleo06:26
*** pcaruana has joined #tripleo06:27
*** dbecker_ has quit IRC06:30
*** jbadiapa has quit IRC06:30
*** pcaruana has quit IRC06:33
*** pcaruana has joined #tripleo06:34
*** karthiks has joined #tripleo06:34
*** fragatina has quit IRC06:36
*** masco has joined #tripleo06:38
*** waleedm has joined #tripleo06:38
*** dbecker_ has joined #tripleo06:43
*** shreshtha has quit IRC06:43
*** shreshtha has joined #tripleo06:44
*** marios has joined #tripleo06:45
*** shreshtha has quit IRC06:46
*** shreshtha has joined #tripleo06:46
*** agurenko has joined #tripleo06:51
*** hjensas has quit IRC06:54
*** ykarel_ has joined #tripleo06:57
*** udesale__ has joined #tripleo06:57
*** ramishra has quit IRC06:58
*** skramaja has quit IRC06:58
*** udesale has quit IRC06:59
*** ykarel has quit IRC07:00
*** ramishra has joined #tripleo07:06
openstackgerritMerged openstack/puppet-tripleo master: Configure VIPs for all networks including composable networks  https://review.openstack.org/53103707:06
*** matbu has quit IRC07:08
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956907:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174236707:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)07:10
*** absubram has joined #tripleo07:13
*** dpawar has quit IRC07:14
openstackgerritMerged openstack/tripleo-heat-templates master: Set tftp to only listen to the provisioning network  https://review.openstack.org/52902307:15
*** rcernin has quit IRC07:15
openstackgerritMerged openstack/tripleo-heat-templates master: Convert ipv4 nic-config templates  https://review.openstack.org/53121907:16
openstackgerritMerged openstack/tripleo-upgrade master: Reload SSH connection before running container image prepare  https://review.openstack.org/53159107:16
*** jbadiapa has joined #tripleo07:18
*** udesale has joined #tripleo07:19
*** udesale has quit IRC07:20
*** kristaps__ has joined #tripleo07:20
*** oidgar has joined #tripleo07:20
*** pmannidi has quit IRC07:21
*** udesale__ has quit IRC07:21
*** matbu has joined #tripleo07:21
*** kristaps_ has quit IRC07:22
*** ykarel__ has joined #tripleo07:24
*** ykarel_ has quit IRC07:27
*** moshele has quit IRC07:29
*** dparkes has joined #tripleo07:30
*** moshele has joined #tripleo07:31
*** sileht has quit IRC07:31
*** dpawar has joined #tripleo07:31
*** threestrands has quit IRC07:36
*** amoralej|off is now known as amoralej07:42
*** ykarel__ is now known as ykarel|lunch07:43
*** bogdando has joined #tripleo07:48
*** matbu has quit IRC07:54
*** bogdando has quit IRC07:58
*** bogdando has joined #tripleo07:58
*** gkadam has joined #tripleo08:04
*** dsariel has quit IRC08:05
*** hjensas has joined #tripleo08:05
*** hjensas has quit IRC08:05
*** hjensas has joined #tripleo08:05
*** ebarrera has joined #tripleo08:08
*** shardy has joined #tripleo08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956908:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174236708:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)08:10
*** pgadiya has joined #tripleo08:11
*** jtomasek has joined #tripleo08:11
*** ebarrera has quit IRC08:12
*** ebarrera has joined #tripleo08:12
*** tesseract has joined #tripleo08:14
*** dsneddon has joined #tripleo08:17
*** florianf has joined #tripleo08:18
*** agurenko has quit IRC08:19
*** ffiore has joined #tripleo08:19
*** jfrancoa has joined #tripleo08:20
*** karthiks has quit IRC08:20
*** agurenko has joined #tripleo08:21
*** aufi has joined #tripleo08:30
*** fzdarsky has joined #tripleo08:31
*** dmacpher has joined #tripleo08:32
*** karthiks has joined #tripleo08:32
*** cshastri has joined #tripleo08:34
*** ykarel|lunch is now known as ykarel08:37
*** skramaja has joined #tripleo08:38
*** ccamacho has joined #tripleo08:39
*** yprokule has joined #tripleo08:40
*** etingof has quit IRC08:41
*** ffiore has quit IRC08:42
*** karthiks has quit IRC08:44
*** jpena|off is now known as jpena08:45
*** ffiore has joined #tripleo08:47
skramajashardy: if you could take a look at https://review.openstack.org/#/c/531739/1/roles/ComputeRealTime.yaml@1, it would be great.08:50
skramajashardy: the change is adding a Compute role with different parameters, i am not sure if this is the right way to handle it. till now, we were asking users to modify roles_data.yaml for such validations like ComputeOvsDpdkHp and ComputeOvsDpdkDell..08:51
skramajaansiwen: ^08:51
*** jaosorior has joined #tripleo08:54
shardyskramaja: ack looking08:56
*** ccamacho has quit IRC08:57
*** jistr has joined #tripleo08:57
shardyskramaja: So there are no different services, only different parameters?08:58
skramajayes shardy08:58
shardyskramaja: Ok then IMO we don't need a new role, just docs and/or an environment file08:58
shardyskramaja: I think that's what you already commented?08:58
skramajashardy: yes, i did. but was confused, whether just doc is good enough.08:59
*** karthiks has joined #tripleo08:59
shardyskramaja: well having a separate identical role doesn't solve any problem, does it?08:59
shardye.g the docs or whatever are required regardless08:59
skramajanope, it does not.08:59
shardyskramaja: Ok I'll comment too, thanks for clarifying09:00
skramajabut in UI, if we need to do Compute and ComputeRealTime, is it possible?09:00
skramajashardy: ^09:00
shardyskramaja: that's a question for jtomasek I think, I assume it will be possible but I'm not sure how09:01
* jtomasek reads09:01
shardyskramaja: the alternative is to add some way to include parameters in the roles/* but currently that's only used for a few specific defaults09:01
*** jpich has joined #tripleo09:02
*** ccamacho has joined #tripleo09:02
openstackgerritAdriano Petrich proposed openstack/tripleo-common master: Migrate to the new Mistral context class  https://review.openstack.org/50618609:02
shardymandre: Hey, good morning - the undercloud-containers job seems to be failing, just wondered do you know if anyone has already looked into that?09:03
shardyI was off sick yesterday so haven't been following closely, but about to re-test locally09:04
skramajashardy: i havent come across such requirements yet where we need multiples roles with same services . one use case we had is with different hardware HP and DELL., which was solved manually modifying roles_data. if it is possible in UI,  the i am good. will wait for jtomasek's comment.09:04
jtomasekskramaja, shardy: I am not sure it is possible to add the same role twice currently09:04
*** moshele has quit IRC09:04
jtomasekcan CLI do it even? I don't think so09:04
shardyjtomasek: No it'd be a cut/paste/rename in roles_data.yaml on the CLI09:05
shardyI guess the point is why would we have two roles/* which are identical09:05
jtomasekhttps://github.com/openstack/tripleo-heat-templates/blob/master/roles/README.rst09:05
shardyseems to indicate either the CLI/UI workflows should support copying a role contents but renaming, or that we need to support parameters in the roles/* definitions09:05
shardyThe assumption so far has been that different roles would always require different services09:06
shardybut in this case, the services are the same, but different parameters are needed09:07
jtomasekshardy: copying contents seems like a better option. but it means quite marginal change in how things currently work09:07
*** moshele has joined #tripleo09:08
jtomasekshardy, skramaja: currently to cover that functionality for GUI user would need to add new role (as the patch does)09:08
shardyskramaja: is it enough to set the image name default for the RealTime use case, or do we need some parameter_defaults too?09:08
shardywe could expose https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L23 via roles09:08
shardyjtomasek: ack, I guess we can do it, it just seems kind of wrong to add a bunch of completely duplicate roles just to support renaming09:09
shardyparticularly since we don't have any validation to ensure they stay updated09:09
*** owalsh has quit IRC09:09
skramajashardy: not just the image, there are additional parameters too.09:10
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956909:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174236709:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)09:10
*** owalsh has joined #tripleo09:10
shardyskramaja: Ok, what if we allowed setting the RoleParameters map for a role in roles_data?09:10
shardye.g defaults for that interface09:10
skramajashardy: this could be a common requirement, may be we should think of enhancing roles generate command with mapping to new role names?09:10
shardyskramaja: we could, but I'm not sure that solves the problem either?09:11
shardywe still need some way to associate the special image, and parameters, with the special ComputeSpecial role09:11
shardye.g adding a ImageDefault interface, and probably a DefaultRoleParameters one?09:12
skramajathat we already have via role-specific inputs..09:12
shardyskramaja: yes but not in roles/*09:12
shardywe need to add some way to specify the default in roles/foo09:12
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L21409:12
shardyskramaja: give me 5mins, I'll push a patch and you can see if you agree09:13
skramajasure.09:13
*** jpich has quit IRC09:14
jtomasekshardy: I understand the concerns, we can evaluate it further if these cases start to occur very often and number of roles grow09:15
*** etingof has joined #tripleo09:15
jtomasekshardy: I see, so adding a role (to roles_data.yaml) would create a copy and let user specify the name09:17
*** jpich has joined #tripleo09:17
shardyjtomasek: sec, I'm working on an alternate approach which uses the existing CLI/UI workflow09:18
jtomasekshardy: ack09:18
*** sileht has joined #tripleo09:20
mandreshardy: hey, hope you're feeling better. no one has looked at the undercloud job failure afaik09:20
mandrei'll take a look now09:21
*** dsariel has joined #tripleo09:21
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Allow defaults for Image and RoleParameters in roles_data.yaml  https://review.openstack.org/53246509:22
shardymandre: ack thanks, I'm happy to help - was worried it was related to my recent inventory changes09:22
shardyalthough I tested them all locally with vm_doit etc09:22
shardyskramaja, jtomasek, ansiwen: ^^ see what you think of that09:22
shardyit'd enable ComputeRealTime etc to specify an image and RoleParameters default09:23
*** ukalifon has joined #tripleo09:23
jtomasekshardy: I see, so it still requires to have that ComputeRealTime in roles/ do I understand correctly?09:25
shardyjtomasek: yes, but now it can actually contain data specific to the ComputeRealTime role, vs being a renaming of COmpute09:25
jtomasekshardy: I see, sounds good09:26
jtomasekshardy: it would be nice to also allow setting default flavor there, is that possible?09:26
shardyjtomasek: just an idea, open to other suggestions :)09:26
shardyjtomasek: I think it already is, sec09:26
jtomasekshardy: I did not see it in any role definition09:26
mandreshardy: I'll let you know what I find09:26
*** ukalifon has quit IRC09:27
shardyjtomasek: ah no you're right09:27
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L809:27
shardyit can be exposed in exactly the same way09:27
jtomasekshardy: could you add it as part of the patch? it would make role configuration so much simpler09:28
shardyjtomasek: ack will do09:28
jtomasekshardy: thanks!09:28
*** ukalifon has joined #tripleo09:30
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Allow defaults for Image/Flavor/RoleParameters in roles_data.yaml  https://review.openstack.org/53246509:30
*** jpich has quit IRC09:31
*** lucas-afk is now known as lucasagomes09:31
skramajashardy: trying to understand the patch.. does roles-data.yaml for this dployment will have Compute and ComputeRealTime?09:31
skramajashardy: if yes, then why not use ComputeImage and ComputeRealTimeImage for providing different images?09:32
*** dsariel has quit IRC09:35
shardyskramaja: well yes you could, but they you need a special role, and a special environment file09:37
*** stendulker has quit IRC09:37
*** stendulker has joined #tripleo09:37
shardyskramaja: the idea was to make the roles/ComputeRealTime less redundant and include all the required data09:37
shardyskramaja: the alternative is what jtomasek mentioned, which is a change to the roles generate workflow to support duplicating roles with a different name09:38
shardyskramaja: like, you could have a DefaultRoleParameters with all the special overrides needed for ComputeRealTime, so that you don't need -e environments/compute_realtime_overrides.yaml09:39
*** hewbrocca_afk is now known as hewbrocca09:39
shardyor compute-real-time.yaml in the patch from ansiwen09:40
mandreshardy: your gut feeling is probably correct, the first failures seems to correlate with when https://review.openstack.org/#/c/529652/ was merged09:40
shardymandre: hrm, Ok I'll take a closer look09:40
mandrei'm also looking on my side09:41
sshnaidmpanda|rover|afk, arxcruz|ruck do we have problem with tox pep8/linters jobs?09:41
arxcruz|rucksshnaidm: yes, infra is messed09:41
sshnaidmarxcruz|ruck, ok09:41
arxcruz|rucksshnaidm: https://review.openstack.org/#/c/532395/09:42
openstackgerritSteven Hardy proposed openstack/python-tripleoclient master: Revert "Convert undercloud deploy to use TripleoInventory class"  https://review.openstack.org/53247209:42
*** derekh has joined #tripleo09:42
*** stendulker has quit IRC09:42
*** stendulker has joined #tripleo09:43
*** ykarel has quit IRC09:44
*** ykarel has joined #tripleo09:44
*** jpich has joined #tripleo09:44
skramajashardy: so with your patch, there will be a roles/ComputeRealTime.yaml file but environmet file is NOT required. did i understand it correctly?09:46
shardyskramaja: yes that was my idea09:47
shardyskramaja: open to other suggestions, but it makes the duplication more tolerable IMO :)09:47
*** mcornea has joined #tripleo09:48
jaganathand0ugal, please look into https://review.openstack.org/#/c/527655/09:48
*** fzdarsky has quit IRC09:48
*** dsariel has joined #tripleo09:48
jaganathanhttps://review.openstack.org/#/c/532218/09:49
skramajashardy: ok. i was more inclined to the approach of generating multiple roles using roles generate command - like http://paste.openstack.org/show/642150/09:53
shardyskramaja: Ok, I'm fine with either approach, but last time I looked roles generate didn't use tripleo-common, so we'd need to ensure such a change is also accessible to the UI via a mistral workflow09:55
shardyjtomasek: ^^09:55
shardyskramaja: I guess my changes are harmless even if we decide not to use them in this case, I can see arguments for both approaches09:55
shardyreducing the duplication would definitely be good if possible09:56
jtomasekskramaja: I like shardy's approach as it does not require any changes to roles management logic. if we find out that we create too many not so different roles then we can introduce what you're suggesting09:57
jtomasekskramaja: we're just about to merge tripleo-common roles management support so it would be quite hard to do the changes right now to support the case09:57
skramajashardy: agreed.09:58
*** jpich has quit IRC09:59
skramajajtomasek: understood the complexisty, as of now UI does not have NFV support, we are seeing such requirements because of different hadwares used in the same cluster.09:59
skramajajtomasek: as most of the nfv parameters are specific to numa layout..09:59
jtomasekshardy, skramaja: the benefit of having explicit definition for such role in roles/ is that it does not need additional documentation for that role and simplifies configuration of it for the user10:00
skramajajtomasek shardy agreed. lets go with shardy's approach.10:01
*** kristaps__ has quit IRC10:02
*** stevebaker has quit IRC10:06
*** dmellado has quit IRC10:06
*** dmellado has joined #tripleo10:07
*** psahoo has quit IRC10:08
skramajashardy: jtomasek, to clarify ansiwen, we will have role/ComputeRealTime.yaml and NO environment file. in future, if required, we will add role/ComputeOvsDpdkRealTime.yaml and role/ComputeSriovRealTime.yaml roles when NFV is adapting realtime kernel.10:09
*** ebarrera has quit IRC10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956910:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174236710:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)10:10
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)10:10
*** ebarrera has joined #tripleo10:10
jtomasekskramaja: sounds good to me10:10
*** salmankhan has joined #tripleo10:11
*** agurenko has quit IRC10:12
*** agurenko has joined #tripleo10:13
*** mdnadeem has quit IRC10:13
*** tosky has joined #tripleo10:14
*** jpich has joined #tripleo10:18
*** threestrands has joined #tripleo10:21
*** dtantsur|afk is now known as dtantsur10:24
*** fzdarsky has joined #tripleo10:25
*** jpich has quit IRC10:32
*** fzdarsky has quit IRC10:34
shardymandre: So AFAICS the undercloud deploy worked, but it fails checking if the neutron ovs agent is up here:10:34
shardyhttp://logs.openstack.org/52/531152/4/check/tripleo-ci-centos-7-undercloud-containers/06af0d1/logs/undercloud/home/zuul/vxlan_networking.sh.log.txt.gz10:34
*** stevebaker has joined #tripleo10:35
shardythat appears to be something you only see running via quickstart vs vm_doit.sh etc10:35
*** akrivoka has joined #tripleo10:35
shardyHmm, although looking at the script that just restarts the agent..10:35
shardystill not quite sure why quickstart sees the undercloud deploy failed but the logs say it worked...10:36
shardyhttp://logs.openstack.org/52/531152/4/check/tripleo-ci-centos-7-undercloud-containers/06af0d1/logs/undercloud/home/zuul/undercloud_install.log.txt.gz10:40
shardyHmm actually that shows the stack complete, and the config download, but no ansible output for running the deploy, it gets stuck gathering facts10:41
shardywhich does not happen for me locally10:41
*** holser__ has joined #tripleo10:44
dtantsurfolks, could you please check https://review.openstack.org/#/c/532231/ ? the bug it solves makes node auto-discovery barely usable in practice10:47
*** stevebaker has quit IRC10:48
*** dmellado has quit IRC10:49
*** jpich has joined #tripleo10:51
*** nyechiel has joined #tripleo10:52
shardydtantsur: ack, one question - 15 seconds sounds like quite a high discovery frequency, I assume it's a low-overhead task?10:52
shardyI'm wondering what happens when there are hundreds of nodes10:52
*** anilvenkata_ has quit IRC10:53
dtantsurshardy: there is a balance here. if we too it too often, it's going to be an overhead. if we do it too rarely, people will have to wait until the nodes are actually available to nova.10:54
dtantsurshardy: well, when I think about it, given that tripleo does quite a few things before actually calling into ironic, it may be safe to bump it to 30 seconds10:55
shardydtantsur: Understood, I'm just wondering how long the task will take if, say, it discovers 100 or even 500 new nodes10:55
shardymore than 15 seconds?10:55
shardydtantsur: ack, I get there's no perfect default but just wondering what a good one for TripleO is10:55
shardyconsidering we do expect some fairly large scale deployments10:56
dtantsurshardy: as I understand it (and I'm not a nova guru), it discovers nova hosts, not ironic nodes. so it may just need to discover undercloud itself10:56
dtantsurshardy: okay, lemme bump it to 30?10:56
shardydtantsur: not sure I understand the nova/ironic/undercloud comment tbh but sure 30 sounds fine if you agree, just wanted to discuss it10:57
shardycontext is I've had a bunch of discussions recently with operators interested in 500+ node deployments10:57
shardyso it'd be good to ensure our defaults are sane wrt those environments10:58
* dtantsur thinks10:58
dtantsuractually, I have a completely alternative idea10:59
dtantsurshardy: we currently run manual mapping of hosts in tripleo-common right after we enroll them. what if inside we run it right before the deployment?11:00
dtantsurs/inside/instead/11:00
*** stendulker_ has joined #tripleo11:00
shardydtantsur: that would make sense, given that it's when the nodes are selected11:00
dtantsurshardy: do you have a quick idea where exactly to insert it? I'm not overly familiar with our deployment workflows11:01
dtantsurshardy: should I insert it before https://github.com/openstack/tripleo-common/blob/master/workbooks/deployment.yaml#L183 ?11:03
*** pkovar has joined #tripleo11:03
*** stendulker has quit IRC11:04
*** stevebaker has joined #tripleo11:04
shardydtantsur: yes I was just looking in the exact same place ;)11:04
shardydtantsur: but we also need to consider the --config-download deploy, which uses a different (new) workflow:11:04
shardyhttps://github.com/openstack/tripleo-common/blob/master/workbooks/deployment.yaml#L26211:04
shardydtantsur: Also I guess we need to ensure there's no race e.g between discovering the hosts and starting the deploy, to avoid the dreaded no valid hosts thing from the nova scheduler11:05
dtantsurshardy: oh. where exactly is it creating a stack?11:05
shardyhttps://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/deployment.py#L13111:06
shardydtantsur: IIRC it's that action11:06
shardyhttps://github.com/openstack/tripleo-common/blob/master/setup.cfg#L7111:06
shardydtantsur: you can trace the names from the workflow->class by looking there11:06
dtantsurshardy: is this config-download thing also calling it?11:06
dtantsurI'd prefer to keep the nova execution in a workflow11:07
*** stendulker_ has quit IRC11:07
*** anilvenkata_ has joined #tripleo11:07
shardydtantsur: yes, we still deploy a stack, we just run all the configuration stuff via ansible11:07
shardyinstead of heat11:07
dtantsurdoes it call into nova stil?11:07
shardydtantsur: provided it's not using the deployed server feature, yes11:07
dtantsurshardy: so, what part of the workflow is calling into nova essentially? config_download_deploy seems like it configures an already provisioned overcloud11:08
chemEmilienM: when you're back, I had to bump the rdo pike package to get the 0.7.0 version there https://review.rdoproject.org/r/#/c/11269/, see https://bugs.launchpad.net/tripleo/+bug/1735697/comments/3 for details11:09
openstackLaunchpad bug 1735697 in tripleo "O->P fails during AllNodesPostUpgradeSteps.ControllerDeployment_Step1 on haproxy docker." [Critical,Triaged] - Assigned to Sergii Golovatiuk (sgolovatiuk)11:09
chemEmilienM: not familiar with release process, so I though I let you know.11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956911:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174236711:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)11:10
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)11:10
openstackgerritMartin André proposed openstack/python-tripleoclient master: DO NOT MERGE test ansible inventory files  https://review.openstack.org/53249011:10
mandreshardy: hmm indeed, it may not be related to the inventory after all11:14
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Add Openstack Undercloud backup  https://review.openstack.org/46621311:15
shardymandre: it doesn't look like we're logging all the ansible output, or at least I can't find it atm11:15
shardydtantsur: Yeah it looks like we run that workflow after the normal deploy workflow:11:17
shardyhttps://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L96211:17
shardydtantsur: however the initial deploy should have a special config, not sure where we set that up atm11:17
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Discover nova hosts in cells right before deployment  https://review.openstack.org/53249511:18
dtantsurshardy: here's what I'm thinking of ^^^11:18
shardydtantsur: ack looks good, I guess we'll just have to test it with/without --config-download11:19
dtantsurshardy: do we have CI jobs covering both?11:21
*** yamahata has quit IRC11:22
shardydtantsur: we don't have great coverage of --config-download yet, IIRC multinode-containers uses it tho11:22
dtantsurack, I'll watch this job11:22
*** dmellado has joined #tripleo11:23
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: [DNM] tripleo-upgrade O->P test.  https://review.openstack.org/53249711:27
*** dmellado has quit IRC11:32
*** dmellado has joined #tripleo11:34
*** d0ugal has quit IRC11:39
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Add Openstack Undercloud backup  https://review.openstack.org/46621311:39
*** moshele has quit IRC11:39
*** moshele has joined #tripleo11:40
*** masco has quit IRC11:40
*** shreshtha has quit IRC11:41
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Use community packages for Sensu  https://review.openstack.org/53250511:42
*** moshele has quit IRC11:42
*** jkilpatr has quit IRC11:44
oidgarhi guys, in order to run some post deployment step for octavia I need the authentication url. there are several place inside the overcloud stack output from which I can take it (RoleData -> Controller.merged_config_settings.heat::keystone::authtoken::auth_url, EndpointMap -> KeystoneV3Public.uri)11:44
oidgarwhich value should be the best to use if this is part of TripleO deployment? (if there are other values that preferred, let me know :) )11:45
shardyoidgar: Hi, in any composable service template you should get the endpoint from the EndpointMap11:46
oidgarshardy: although I'm running the task from within the controller?11:47
shardyoidgar: where is the task defined?11:47
oidgarshardy: it's ansible playbook that is called from mistral workflow11:48
shardyoidgar: where is the ansible task defined?11:48
oidgarshardy: https://review.openstack.org/#/c/515402/34/workbooks/octavia_post.yaml11:48
shardyoidgar: I think my answer stands though, you should not derive data from arbitrary hiera keys, as they may change11:48
* oidgar search for the other patch11:48
oidgarshardy: ok, I'll take the EndpointMap value11:49
oidgarshardy: do you know by the way if there is a value for a private IP?11:49
shardyoidgar: same with all the keystone:: things, you should pass the value explicitly from t-h-t wherever this workflow is invoked11:49
shardyoidgar: you mean the bind IPs for each network on each node?11:49
oidgarshardy: I mean an IP in a private network that is used for the service communication11:51
shardyoidgar: in that case I think you can use the generic (not specific to a service) net_ip_map values we add to hiera, see:11:51
oidgarshardy: if there is one like that... like float IP for all the controller that is used for private comm11:51
*** morazi has quit IRC11:51
shardyhttps://review.openstack.org/#/c/526692/ https://review.openstack.org/#/c/514707/11:52
shardyoidgar: Hmm, Ok the VIPs are different, for those you should probably use the EndpointMap for the service11:52
shardyas the VIP may change depending on how the ServiceNetMap is configured11:52
shardyhard-coding a network will break in that case11:52
*** ccamacho has quit IRC11:52
*** hewbrocca is now known as hewbrocca_afk11:53
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Upgrade to npm 5  https://review.openstack.org/53219211:53
oidgarshardy:  EndpointMap -> KeystoneV3Public.uri is considered VIP?11:54
shardyoidgar: the EndpointMap data is all derived from the VIPs11:56
*** ccamacho has joined #tripleo11:56
shardythere's a VIP per network, and the EndpointMap is generated based on those VIPs and the ServiceNetMap table11:56
oidgarshardy: great, as always, many thanks11:56
oidgarshardy: :)11:56
shardyoidgar: np :)11:57
*** d0ugal has joined #tripleo11:57
*** raildo has joined #tripleo12:02
*** pdeore has quit IRC12:02
*** shardy is now known as shardy_lunch12:03
*** ratailor has quit IRC12:04
openstackgerritSergii Golovatiuk proposed openstack/tripleo-common master: Add UC backup Mistral workflow definition and actions  https://review.openstack.org/51761012:07
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956912:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174236712:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)12:10
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)12:10
*** absubram has quit IRC12:10
*** jkilpatr has joined #tripleo12:16
*** bfournie has quit IRC12:18
*** bfournie has joined #tripleo12:19
*** pgadiya has quit IRC12:20
mandreshardy: got green containerized undercloud on https://review.openstack.org/#/c/532490/ where I changed back to using the old inventory12:22
mandreshardy_lunch: ^^12:22
mandreshardy_lunch: we can compare inventories in http://logs.openstack.org/90/532490/1/check/tripleo-ci-centos-7-undercloud-containers/1d682fe/logs/undercloud/root/tripleo-99weEP-config/12:23
*** bfournie has quit IRC12:24
*** rhallisey has joined #tripleo12:24
*** lucasagomes is now known as lucas-hungry12:27
*** janki has quit IRC12:27
*** sri_ has quit IRC12:28
jtomasekflorianf: hi, could you check again https://review.openstack.org/#/c/509415/ I've done updates which honza requested12:29
florianfjtomasek: done. good catch, honza :-)12:31
jtomasekflorianf: thanks12:31
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Adding support to propagate role-parameters to outputting role-specific parameters in the generated environment files  https://review.openstack.org/52942212:32
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Changing the description of NeutronSriovNumVFs parameter  https://review.openstack.org/53206612:32
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Adds environment file for OVS Hardware Offload using env generator  https://review.openstack.org/53212312:32
*** jlabarre has joined #tripleo12:34
*** moshele has joined #tripleo12:35
*** holser__ has quit IRC12:38
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Fix log file nova-conductor service  https://review.openstack.org/53251312:39
*** shadower has joined #tripleo12:39
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Fix log file nova-conductor service  https://review.openstack.org/53251312:40
openstackgerritMike Fedosin proposed openstack/tripleo-heat-templates master: Add additional sysctl values to enhance security  https://review.openstack.org/53121012:41
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Adding support to propagate role-parameters to outputting role-specific parameters in the generated environment files  https://review.openstack.org/52942212:42
*** atoth has joined #tripleo12:42
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Changing the description of NeutronSriovNumVFs parameter  https://review.openstack.org/53206612:46
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Adds environment file for OVS Hardware Offload using env generator  https://review.openstack.org/53212312:46
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Adds environment file for ODL OVS Hardware Offload using env generator  https://review.openstack.org/53214912:46
*** shardy_lunch is now known as shardy12:47
*** jpena is now known as jpena|lunch12:48
shardymandre: ack thanks, will compare shortly - I have a revert at https://review.openstack.org/#/c/532472/ but I'd prefer to debug the root cause if possible12:49
shardymandre: still unclear why the yaml inventory works fine locally, would be good to get confirmation that works OK for you12:51
openstackgerritLukas Bezdicka proposed openstack/tripleo-quickstart-extras master: Introduce undercloud_templates_* variables  https://review.openstack.org/53251612:52
*** aputtur_ has quit IRC12:53
*** fzdarsky has joined #tripleo12:53
mandreshardy: yeah I'll test locally a bit later, at least we've narrowed down the problem to the yaml inventory file12:56
*** fzdarsky has quit IRC12:56
openstackgerritMerged openstack/tripleo-ui master: Update roles listing  https://review.openstack.org/50941512:56
openstackgerritMerged openstack/tripleo-ui master: Refactor ImportPlanCard into ActionCard  https://review.openstack.org/51226512:56
*** ffiore has quit IRC12:57
EmilienMhey12:57
EmilienMchem: ok I'll look12:58
*** links has quit IRC12:58
*** bfournie has joined #tripleo12:59
*** gfidente has joined #tripleo13:00
*** gfidente has quit IRC13:00
*** gfidente has joined #tripleo13:00
*** sri_ has joined #tripleo13:00
*** amoralej is now known as amoralej|lunch13:00
*** morazi has joined #tripleo13:00
EmilienMchem: you want me to merge https://review.rdoproject.org/r/#/c/11269/ ?13:00
*** ffiore has joined #tripleo13:02
*** abishop has joined #tripleo13:03
*** ccamacho has quit IRC13:04
*** ccamacho has joined #tripleo13:04
*** nyechiel has quit IRC13:04
*** skramaja has quit IRC13:05
*** nyechiel has joined #tripleo13:06
*** ffiore has quit IRC13:07
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956913:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174236713:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)13:10
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)13:10
*** kristaps__ has joined #tripleo13:10
*** janki has joined #tripleo13:15
*** dprince has joined #tripleo13:16
chemEmilienM: no I think amoralej|lunch is on it.  It was just FYI.13:17
ansiwenshardy: catching up with your discussion this morning. so, with your patch, without an environment file, how would an operator provide the CPU pinnings for the RT nodes? (these are highly hardware dependent, and must be individually set for each specific deployment)13:19
*** moshele has quit IRC13:20
*** ffiore has joined #tripleo13:20
*** lucas-hungry is now known as lucasagomes13:22
*** ecerquei has joined #tripleo13:23
shardyansiwen: they can still provide an environment file, the idea was just to set some reasonable defaults for the role13:26
shardyvs having a 100% duplicate compute role that requires mandatory customization via an environment file13:26
EmilienMchem: ok13:26
shardye.g to set the image to an -rt one etc13:26
*** thrash|g0ne is now known as thrash13:27
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/pike: Fix path for iscsi config file  https://review.openstack.org/53252313:27
*** shardy is now known as shardy_mtg13:28
*** pradk has quit IRC13:29
ansiwenshardy: ok, so as far as I can tell the only parameters that can have a reasonable default are TunedProfileName, KernelArgs and somehow ComputeRealTimeImage, although the latter would be created by the operator with the `openstack overcloud image build` command, and they could basically give it any name.13:30
ansiwenshardy_mtg: the parameters IsolCpusList and NovaVcpuPinSet _always_ have to be provided by the operator.13:31
*** daidv has quit IRC13:32
ansiwenjtomasek: could you give an example of what you consider a good role description length-wise for the UI? then I can write one.13:33
jtomasekansiwen: yep, one sec13:34
*** rlandy has joined #tripleo13:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: kernel: allow to override modules & sysctl settings  https://review.openstack.org/53252913:36
*** pdeore has joined #tripleo13:36
openstackgerritAna Krivokapic proposed openstack/tripleo-validations master: Sanitize validations output  https://review.openstack.org/53253113:37
ansiwenshardy_mtg: how about an "include" for the roles/* files? then I could just include the normal Compute.yaml and just overwrite the few differences?13:38
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/pike: Fix puppet config volume for iscsid in containers  https://review.openstack.org/53168013:38
EmilienMarxcruz|ruck: what's the issue with the gate?13:39
EmilienMis it still the tox jobs and the version of images in nodepool?13:39
EmilienMI'm aware there was an issue with the version of pip in DIB13:39
arxcruz|ruckEmilienM: 2 hours ago was13:39
arxcruz|rucknot sure now, let me check13:40
arxcruz|ruckEmilienM: yup, broken image, and now zuul13:41
jtomasekansiwen: this is what the roles selection listing looks like in GUI https://imgur.com/a/DOOkC13:41
arxcruz|ruckEmilienM: hmmm, zuul was restarted13:41
jtomasekansiwen: we can easily tweak number of columns dependent on how descriptions evolve, but in general the description which ControllerNoCeph has is good13:42
*** ykarel is now known as ykarel|away13:43
*** weshay changes topic to "CI status: Red: zuul issues - be careful in reviews | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"13:43
jtomasekansiwen: feel free to make it longer if needed though, we can do adjustments in GUI to acomodate that13:44
ansiwenjtomasek: ok, I see, Dpdk is  not a lot more verbose there. ;-)13:44
ansiwenjtomasek: so, should I go into details which parameters must be set in order to use the role?13:44
jtomasekansiwen: yeah, thats not good. Ideally the description for roles would provide enough information to allow user decide without extensive search in documentation13:45
*** moshele has joined #tripleo13:45
*** trown|outtypewww is now known as trown13:45
jtomasekansiwen: that's a good question. will that role configuration already include those parameters or will user explicitly need to set some?13:46
bogdandoEmilienM: hi. Could you revise https://review.openstack.org/#/c/528231/?13:46
EmilienMbogdando: sure13:46
EmilienMbogdando: approved13:47
ansiwentwo paramters at least must be set by the deployer, because it depends on the server CPU layout. there can't be a default.13:47
ansiwenjtomasek: ^^^13:47
jtomasekansiwen: I see, mentioning that in description would be nice then I think13:47
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add tls roles for undercloud  https://review.openstack.org/51707913:47
ansiwenjtomasek: ok13:48
*** pchavva has joined #tripleo13:48
*** ykarel|away has quit IRC13:49
ansiwenjtomasek: since shardy_mtg is busy, did you understand how the ComputeRealTime.yaml now has to look like, if I base it on his patch? I assume I don't have to list the services anymore, but how do I reference to basic compute role?13:50
*** jpena|lunch is now known as jpena13:51
*** dpawar has quit IRC13:51
*** moshele has quit IRC13:51
jtomasekansiwen: IIUC, you keep the role as you defined it but you now have means to add there also parameter values and image name, so you don't need to include 2 additional environments13:52
*** agopi has joined #tripleo13:52
ansiwenjtomasek: oh, ok, so the services redundancy is not solved with shardy_mtg 's patch... I see13:53
jtomasekansiwen: right, shardy_mtg's patch just adds additional means to differentiate roles13:53
ansiwenjtomasek: as I commented, an "include" or "inherit" would be nice13:54
jtomasekansiwen: ok, we could discuss this further on PTG and try to introduce that mechanism in next cycle.13:55
ansiwenjtomasek: ok, and for now there's no way to avoid the double listing of the services, correct?13:57
*** aputtur_ has joined #tripleo13:57
jtomasekansiwen: right13:57
*** shardy_mtg is now known as shardy13:59
* shardy reads backscroll13:59
*** masco has joined #tripleo13:59
*** weshay changes topic to "CI status: zuul restarted, looking ok as of 1/10/2017 2pm UTC | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"14:01
*** pdeore has quit IRC14:01
shardyansiwen: yeah my patch just aims to make the new role a little more user friendly by specifying some defaults, we don't resolve the ServicesDefault duplication here14:01
shardyansiwen, jtomasek: we could solve that via two passes of j2, then we could use a j2 include from another file in the roles/* directory14:01
shardythat could get confusing though, perhaps there's some other/better way14:02
*** tzumainn has joined #tripleo14:02
*** jmelvin has joined #tripleo14:03
*** agopi has quit IRC14:06
openstackgerritLukas Bezdicka proposed openstack/tripleo-quickstart master: config: Provide a Keystone only overcloud config  https://review.openstack.org/51919614:06
openstackgerritLukas Bezdicka proposed openstack/tripleo-quickstart master: config: Minimal controller config for Nova  https://review.openstack.org/52276214:07
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: ffu: Add fast-forward upgrade outputs to RoleConfig  https://review.openstack.org/49922114:08
ansiwenyes, given that tripleO is not exactly lacking of confusion, avoiding more of it might be a good idea ;-)14:08
ansiwenshardy: ^^^14:08
shardyansiwen: Ok, what less alternative include mechanism did you have in mind?14:09
shardysorry less confusing alternative ...14:10
ansiwenshardy: so, I will base my change on your patch then, if this will go in. should I still provide an "empty" environment file as an example (people like me prefer that over documentation)14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956914:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)14:10
shardyansiwen: what would the empty environment file provide over the parameter descriptions?14:10
ansiwenshardy: I have none, unfortunately, just wanted to support your intention to check for other was. :-)14:11
shardyI'm not opposed to an example, but there have been cases where folks put more information in the commented example than in the description, which is bad as it's invisible to the UI14:11
ansiwenshardy: nothing, it would be just a template, where the user can easily fill in the CPU pinnings and get started.14:11
beaglesshardy, I was just looking at a tripleo-validations for verifying some required neutron related configuration. Does validations do something special with the location of configuration files or does there need to be explicit accomodation for whether the configuration file is /etc/neutron or /var/lib/config-data/puppet-generated/neutron/etc/neutron?14:12
ansiwenshardy: yes, I wrote a more verbose description already14:12
shardyansiwen: an alternative to the j2 include might be to overload the yaml loader to support some notation for include14:13
shardymaybe that would be less confusing, although it's not standard yaml14:13
shardybeagles: Hmm, not sure - does it read the service configs directy?14:14
EmilienMshardy: if you have 2 min, is https://review.openstack.org/#/c/532529/ the right syntax / thing to do? feedback welcome14:14
shardyEmilienM: ack looking14:14
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add Openstack Undercloud backup  https://review.openstack.org/46621314:15
beaglesshardy: afaict, yeah14:15
EmilienMshardy: another topic, have you already seen this error before I investigate http://logs.openstack.org/61/528761/15/check/tripleo-ci-centos-7-3nodes-multinode/d33f114/logs/undercloud/var/log/mistral/executor.log.txt.gz#_2018-01-09_03_08_45_788 ?14:16
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add Openstack Undercloud backup  https://review.openstack.org/46621314:16
ansiwenshardy: so, the format of the roles/* files is not standard heat templates, it's a tripleo invention, right?14:16
*** hasanq has joined #tripleo14:16
shardybeagles: Ok, not sure in that case, I'd prefer those kind of validations to be done in the heat/puppet layer but perhaps florianf may know if the ansible validations have all been updated to work with containers14:17
hasanq@waleedm14:17
shardyansiwen: yes it's just some yaml files we use as an input to the roles generate command, which creates a roles_data.yaml file14:17
shardythat's just a yaml list14:17
shardywhich is used as an input to the j2 templating elsewhere in t-h-t14:18
shardyit's all tripleo specific14:18
* ansiwen sent a long message: ansiwen_2018-01-10_14:19:07.txt <https://matrix.devlab.redhat.com/_matrix/media/v1/download/redhat.com/oNOVrYrMwGMvjVYUVXbbHwFL>14:19
ansiwenshardy: and what ever follows overwrites the values from Compute14:19
*** Goneri has joined #tripleo14:19
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP fast_forward_upgrade_tasks for Heat  https://review.openstack.org/53095614:20
shardyansiwen: yeah we could invent something like that, or just an include notation for any arbitrary value14:20
shardyIMO the include is conceptually simpler than inheritance14:20
shardybut either could work14:20
ansiwenshardy: sure, include would work, if it is allowed to "redefine" values.14:22
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: [WIP] New featureset for fast forward upgrade testing.  https://review.openstack.org/52568614:22
ansiwenshardy: btw, can you explain me the commented lines in  environments/host-config-and-reboot.j2.yaml , that is, in which scenario would you comment them out? or is this an old leftover?14:23
shardyI don't think I've ever touched that file but let me take a look14:24
shardyansiwen: I'd guess it's another docs substitute environment file such as the one you mentioned earlier?14:25
shardyhonestly I don't know much about that14:25
ansiwenshardy: ok, thanks anyway, I just wasn't sure if I also have to add something to that...14:26
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add support function for fast forward upgrade testing.  https://review.openstack.org/52600014:26
*** holser__ has joined #tripleo14:27
shardyansiwen: I think the point is for roles that have a special kernel, you may need to set special KernelArgs and Tuned profile stuff14:27
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: [WIP] Early release for fast forward upgrade testing.  https://review.openstack.org/52568014:27
*** dhill_ has quit IRC14:27
*** dhill_ has joined #tripleo14:27
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook  https://review.openstack.org/50493914:29
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role  https://review.openstack.org/51564314:29
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: [DNM] tripleo-upgrade O->P test.  https://review.openstack.org/53249714:30
*** trown is now known as trown|brb14:32
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: tq/tqe gate jobs in ci.centos are timing out  https://review.openstack.org/53254014:33
*** pradk has joined #tripleo14:34
*** raildo has quit IRC14:34
florianfshardy, beagles: I have to update some validations that assume the old pre-containerization config paths. It's a task on my list.14:35
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: test change DNM  https://review.openstack.org/53254114:35
beaglesflorianf, cool, thanks14:35
openstackgerritRyan Brady proposed openstack/tripleo-common master: Adds Workflow to List Available Roles  https://review.openstack.org/50983214:43
openstackgerritRyan Brady proposed openstack/tripleo-common master: Adds UpdateRoles Workflow  https://review.openstack.org/51504514:43
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Use ara generation from collect-logs role  https://review.openstack.org/47854914:46
*** hasanq_ has joined #tripleo14:47
*** trown|brb is now known as trown14:48
gfidentemwhahaha is ffu subject to m2 deadline?14:48
gfidente*was14:48
shardyhttp://logs.openstack.org/72/532472/1/check/tripleo-ci-centos-7-undercloud-containers/54cb2ec/job-output.txt.gz#_2018-01-10_09_59_32_86745014:49
shardyDoes anyone know why that (master) job has -e @/home/zuul/workspace/.quickstart/config/release/pike.yml in it?14:49
*** hasanq_ has quit IRC14:49
mwhahahagfidente: no i don't think so because we knew it's for m314:49
trozetjaosorior: hit an issue in step 3 of deployment during DB sync: "DBConnectionError: (pymysql.err.OperationalError) (2003, \"Can't connect to MySQL server on 'overcloud.internalapi.opnfvlf.org' ([Errno 111] ECONNREFUSED)\")14:50
trozetjaosorior: have you seen any isuses with that for TLS/SSL deployments?  here is my sql url:  connection=mysql+pymysql://aodh:mGshTa7XwjMMZkUtj3UZsa9NV@overcloud.internalapi.opnfvlf.org/aodh?read_default_group=tripleo&read_default_file=/etc/my.cnf.d/tripleo.cnf14:50
trozetim redeploying now but just wanted to check with you14:51
*** waleedm has quit IRC14:52
openstackgerritPradeep Kilambi proposed openstack/tripleo-quickstart master: Add alarm granularity tofeatureset005  https://review.openstack.org/53254714:53
*** dpawar has joined #tripleo14:55
*** hasanq has quit IRC14:55
*** dpawar has quit IRC14:55
*** pabelanger has quit IRC14:56
*** pabelanger has joined #tripleo14:56
d0ugalrbrady,d0ugal,apetrich,thrash,toure,jpich,jtomasek: Workflow Squad meeting in 3 mins. https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:57
toureack14:57
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add semver dev dependency  https://review.openstack.org/53255014:58
*** amoralej|lunch is now known as amoralej14:59
-openstackstatus- NOTICE: Gerrit is being restarted due to slowness and to apply kernel patches14:59
*** openstackgerrit has quit IRC15:01
jaosoriortrozet: is that in a containerized deployment?15:01
jaosoriortrozet: does the aodh container have access to the tripleo.cnf file?15:02
*** absubram has joined #tripleo15:02
trozetjaosorior: no, non-containerized.  Speaking of that i hit a small bug with generating public certs in non-containerized going to file a bug and fix for it15:02
jaosoriortrozet: ok15:02
jaosoriortrozet: I haven't seen that issue.15:02
*** agopi has joined #tripleo15:02
trozetjaosorior: i didnt look at tripleo.cnf file just the aodh conf.  Will see if it happens again15:02
jaosoriortrozet: is it possible for me to check out your environment?15:02
trozetjaosorior: sure is.  I can give you ssh access15:03
jaosoriorlets check it out15:03
*** suuuper has quit IRC15:06
*** absubram has quit IRC15:06
*** absubram has joined #tripleo15:06
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956915:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)15:10
*** dpawar has joined #tripleo15:11
*** openstackgerrit has joined #tripleo15:12
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Support release change during playbook run  https://review.openstack.org/50482215:12
*** moshele has joined #tripleo15:12
*** moshele has quit IRC15:17
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Enforce npm version when building the project  https://review.openstack.org/53176915:18
*** hjensas has quit IRC15:22
*** nyechiel has quit IRC15:22
*** psachin has quit IRC15:22
openstackgerritMartin André proposed openstack/python-tripleoclient master: DO NOT MERGE test ansible inventory files  https://review.openstack.org/53249015:23
*** numans has quit IRC15:26
shardymandre: Hey FYI I've attempted to reproduce with vm_doit and also with featureset 027 and quickstart, AFAICS both are working fine, so I'm puzzled by the CI failure15:27
*** numans has joined #tripleo15:28
michchaphey folks, if I want to disable a containerised nova-compute service, how do I do that?15:28
michchap(as in the equivalent of systemctl disable <service>)15:29
shardymichchap: you mean remove the service on update after a deployment?15:29
mandreshardy: I couldn't reproduced locally either, but I noticed the generated yaml had ansible_connection=local for 'undercloud' while I think it should be for 'Undercloud'15:29
mandreshardy: testing here https://review.openstack.org/#/c/532490/215:29
shardymichchap: you can stop the container, but to do it via TripleO you'd modify e.g the ComputeServices parameter & remove the related service from the list15:30
michchapshardy: we're making a custom image from overlcoud-full but without nova-compute15:30
shardymichchap: with containers, you don't need any of the nova bits in overcloud-full?15:30
*** morazi has quit IRC15:30
michchapshardy: or more accurately it's a snapshot of an existing compute node and we want to remove nova-compute from it15:31
*** agurenko has quit IRC15:31
shardymichchap: for testing you could just docker stop the relevant container?15:32
michchapshardy: but I guess equivalently, if I have a running compute node and for some reason I decide I no longer want nova-compute to be running there, how can I disable/remove it15:32
michchapshardy: it's in an image, so I want to know what's autostarting it. Is it pcs? I could give it a blank container in its place perhaps.15:32
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Add alarm granularity tofeatureset005  https://review.openstack.org/53254715:32
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add support function for fast forward upgrade testing.  https://review.openstack.org/52600015:33
shardymandre: ack thanks, I'm following that - it doesn't look like the revert will work without fixing a bunch of tests, so it'd be nice to avoid if possible15:33
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Re-enable voting on scenario002-container  https://review.openstack.org/53255315:33
shardyit's confusing the issue isn't reproducing locally15:33
*** hasanq has joined #tripleo15:34
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Upgrade to npm 5  https://review.openstack.org/53219215:34
shardymichchap: nova-compute isn't manged by pcs, it's just started by the docker daemon, which is configured by TripleO on deployment15:35
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Re-enable voting on scenario002-container  https://review.openstack.org/53255715:36
shardymichchap: by default the container is configured with restart=always, so you'd probably have to stop it then do docker update --restart=no or something15:36
*** morazi has joined #tripleo15:36
shardymichchap: note that change won't persist over any subsequent TripleO update though15:36
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Re-enable voting on scenario002-container  https://review.openstack.org/53255815:37
michchapshardy: ack, thanks. Where does the config live? We're ok without updates - this is a demo environment15:38
*** hasanq has quit IRC15:38
*** agopi has quit IRC15:38
shardymichchap: /var/lib/docker/containers I think but I'd use the CLI vs hacking it directly15:39
*** jkilpatr has quit IRC15:39
shardymichchap: maybe try docker rm -f <container>15:39
*** fzdarsky has joined #tripleo15:40
michchapshardy: ok will do. thanks.15:40
shardymichchap: docker stop should work, but I suspect reboot or restart of the daemon will bring the container back up15:40
*** akane has joined #tripleo15:40
*** akane_ has joined #tripleo15:40
saibnemec: the stuff in first-boot.yaml does it run on a stack update as well?15:42
saimwhahaha: ^15:42
shardysai: Nothing in first-boot runs on update, cloud-init only works on inital deployment15:43
bnemecsai: No, unless you scale out in which case it runs on the new servers.15:43
bnemec*new servers only15:43
saishardy: bnemec thanks!15:43
*** akane has quit IRC15:44
saibnemec: shardy so if i had to do thing slike pci passthrough on existing nodes on stack update, how do i do the equivalent of this (https://github.com/smalleni/openstack-testing/blob/master/ocata-pci-passthrough/firstboot/first-boot.yaml) without using firstboot15:45
*** janki has quit IRC15:45
*** yamahata has joined #tripleo15:47
trozetjaosorior: perhaps this is the issue:15:48
trozet2018-01-10 10:04:40 139638691350720 [Warning] GSSAPI plugin : default principal 'mariadb/overcloud-controller-0.opnfvlf.org@OPNFVLF.ORG' not found in keytab15:48
trozet2018-01-10 10:04:40 139638691350720 [ERROR] mysqld: Server GSSAPI error (major 851968, minor 2529639093) : gss_acquire_cred failed -Unspecified GSS failure.  Minor code may provide more information. Keytab FILE:/etc/krb5.keytab is nonexistent or empty.15:48
trozetjaosorior: oh wait irt restarts later and doesnt have that error15:49
*** akane_ has quit IRC15:49
trozetmaybe its a cpu/memory issue let me bump them15:49
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-quickstart master: fs005/006: set telemetry.alarm_granularity to 60s  https://review.openstack.org/53256115:50
EmilienMsileht: fyi https://review.openstack.org/#/c/532561/ commented15:52
silehtEmilienM, what about the trello card complain ?15:53
*** dparkes has quit IRC15:53
silehtEmilienM, I can ignore it ?15:53
EmilienMsileht: yes15:53
EmilienMmiscommunication15:53
silehtack :)15:53
shardysai: probably something like https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/pre_network/config_then_reboot.yaml15:53
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/environments/host-config-and-reboot.j2.yaml15:54
shardysai: ^^ shows how to enable it for all roles, but you could just do e.g OS::TripleO::Compute::PreNetworkConfig:15:54
*** jkilpatr has joined #tripleo15:54
shardysai: note that's running before we configure the nics, which is the earliest tripleo hook except firstboot15:55
pradksileht, already had it here https://review.openstack.org/#/c/532547/ .. but yea looks like we dont need it15:55
silehtpradk, oh you got trap too :)15:56
pradkyep15:56
saishardy: ack, got it. Thank you.15:56
openstackgerritMike Burns proposed openstack/tripleo-heat-templates master: update example repos to more closely match OSP 13 requirements  https://review.openstack.org/53256215:56
*** kristaps_ has joined #tripleo15:57
EmilienMarxcruz|ruck, weshay: imho, we shouldn't run non-containerized scenarios in pike promotion jobs15:57
EmilienMthey aren't gating upstream15:57
EmilienMwhy are we running them then?15:57
weshayEmilienM, ok.. we can change that15:58
weshayI'll put up a change and get comments15:58
*** kristaps__ has quit IRC16:00
*** moshele has joined #tripleo16:00
*** waleedm has joined #tripleo16:02
*** moshele has quit IRC16:02
shardyweshay: Hey do you happen to know why http://logs.openstack.org/72/532472/1/check/tripleo-ci-centos-7-undercloud-containers/54cb2ec/job-output.txt.gz#_2018-01-10_09_59_32_867450 says -e @/home/zuul/workspace/.quickstart/config/release/pike.yml when the (master) job says config/release/tripleo-ci/master.yml ?16:03
shardyI feel like I'm missing something, as that seemed wrong - I was copying the quickstart args to attempt a local reproduce16:03
weshayshardy, /me looks16:03
weshayshardy, that is just a prep playbook... see noop.yml16:04
weshayit is confusing agree.. it's just doing some setup and is not related at all to a release16:04
weshayshardy, the actual invocation of quickstart.sh to for the job is a little later16:04
aleeEmilienM, hey - I saw that the scenario2 issue was diagnosed -- have we had a promotion yet?16:04
shardyweshay: Ah, Ok thanks for confirming, I expected to see a consistent release used throughout16:05
weshayshardy, ya.. I would prefer that as well...   infra wants CI to not use any wrapper scripts.. just ansible-playbook in the near future. So you will see that go away16:06
shardyweshay: ack, thanks for the info! :)16:06
*** itlinux has joined #tripleo16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956916:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)16:10
*** ooolpbot has quit IRC16:10
*** waleedm has quit IRC16:10
*** waleedm has joined #tripleo16:13
EmilienMalee: we have a dashboard, FYI dashboards.rdoproject.org/rdo-dev16:14
EmilienMalee: no we haven't had a promotion yet, jobs are running now, hopefully it pass16:14
weshayEmilienM, rdo-cloud is having issues this morning16:15
weshay8-ball says.. unlikely16:15
*** ledo_ has joined #tripleo16:15
aleeEmilienM, thanks - bookmarked - so I can stop bugging you .. :)16:15
EmilienMalee: no worries16:15
*** jkilpatr has quit IRC16:16
*** fultonj has quit IRC16:16
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Fixes generating public certificates  https://review.openstack.org/53256516:17
*** waleedm has quit IRC16:17
tbarronshardy: dsneddon: question about customized roles * networks in https://review.openstack.org/#/c/523638/ when you have a chance ...16:18
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: WIP: Add custom role for realtime compute  https://review.openstack.org/53173916:18
shardytbarron: Hi!16:19
tbarronshardy: hi steve16:19
tbarronshardy: is the requirement to16:19
tbarronshardy: provide all networks for all roles or16:19
tbarronshardy: is it to have some kind of map that indicates which networks will be there for each role?16:20
shardytbarron: there is already a map (well a list actually) of enabled networks in roles_data.yaml for every role16:20
tbarronshardy: iow, in the first case I think you are asking for just an outer jinja loop over roles16:20
shardytbarron: that's kind of my point, it'd be good (even if it's in a followup) to render the nic templates for all roles based on that data16:20
*** waleedm has joined #tripleo16:21
shardytbarron: Yeah basically that's it, modulo review of the existing templates to ensure we catch any special casing that's required16:21
shardytbarron: I'm not blocking on it, but it'd be good to consider, as currently this only deals with one aspect of the j2 rendering16:21
shardye.g custom networks, and not the (IME much more widely used) custom roles16:22
weshayEmilienM, trown arxcruz|ruck panda|rover|afk https://review.rdoproject.org/r/1127616:22
tbarronshardy: the goal makes sense, I'm just not confident as a tripleo amateur of my ability to add that to this patch correctly16:22
tbarronshardy: and dsneddon is tied up with other stuff currently16:22
*** raildo has joined #tripleo16:22
shardytbarron: the ultimate aim would be to have a single role.role.j2.yaml file in each network/config/<config> directory16:22
*** ledo_ has quit IRC16:23
tbarronshardy: are you expecting to get to that goal in Queens?16:23
EmilienMweshay: good, thank you. It works for me but I'll CI folks to vote as well16:23
shardytbarron: well we've been talking about doing it since newton, so it'd be good to do it now vs only this partial j2 work16:23
shardytbarron: if the per-role templates are all the same, all you need is to rename the j2.yaml file, I can take a pass at it if you're willing to help validate the resulting templates?16:24
tbarronshardy: I'm trying to get https://review.openstack.org/#/q/topic:bp/nfs-ganesha+(status:open+OR+status:merged) for queens and for that we only need this StorageNFS network16:24
shardytbarron: sure, understood, my point is this only really solves the problem for a small subset of users16:24
tbarronshardy: yeah, I get your point.16:25
shardywith a bit more work it could solve it for everyone, but I appreciate it may be out of scope for you atm16:25
jaosoriortrozet: thanks for the patch!16:25
tbarronshardy: I'm up for helping validate, etc.16:25
trozetjaosorior: np still seeing issues with db syncs randomly failing.  I think im just going to disable some services for now to see if i can get past it16:25
shardytbarron: Ok I'll take a pass at it, then push under a different change-id for you and dsneddon to review16:25
tbarronshardy: or maybe picking up the patches if I can see the pattern16:26
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: WIP: Add custom role for realtime compute  https://review.openstack.org/53173916:26
shardytbarron: even if we decide to defer to rocky at least we then have the ball rolling16:26
tbarronshardy: awesome, thanks for the help.16:26
jaosoriortrozet: that's strange :/ We just did a TLS everywhere deployment in a hackfest, with around 7 nodes, and it worked16:27
jaosoriortrozet: maybe nodes are throwing OOMs?16:27
trozetjaosorior: nah memory is fine and cpu is low16:27
tbarrondsneddon: I'm going to remove the plain j2.yaml files as shardy requested unless you object.  I think you16:27
tbarrondsneddon: probably just had them there so we could compare with the generated files, i.e. they were16:28
tbarronintended to be temporary anyways16:28
jaosoriortrozet: ok, if you want I could take a look16:28
trozetjaosorior: sure if you want to take a look before i tear it down16:28
*** jkilpatr has joined #tripleo16:28
shardytbarron: yeah I was just thinking they are useful to compare the generated contents16:28
shardytbarron: provided we remove them before merge I'm fine to leave them for now16:28
tbarronshardy: ok16:29
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add support function for fast forward upgrade testing.  https://review.openstack.org/52600016:30
*** dpawar has quit IRC16:30
*** dpawar has joined #tripleo16:31
*** gvrangan has joined #tripleo16:31
*** gvrangan_ has joined #tripleo16:32
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add option to run job automatically in reproducing  https://review.openstack.org/53040116:32
*** waleedm has quit IRC16:32
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Fixes babel-plugin-react-intl configuration  https://review.openstack.org/52728516:33
*** morazi has quit IRC16:34
*** dpawar has quit IRC16:35
*** gvrangan has quit IRC16:36
*** waleedm has joined #tripleo16:36
*** fultonj has joined #tripleo16:39
*** rhallisey has quit IRC16:39
*** rhallisey has joined #tripleo16:39
*** anilvenkata_ has quit IRC16:41
EmilienMsshnaidm, trown, rlandy: any thoughts on https://review.rdoproject.org/r/#/c/11276/ please?16:42
EmilienMmwhahaha: as well ^16:42
* mwhahaha shrugs16:42
mwhahahais it actually affecting anything?16:42
mwhahahawe kinda said that we would keep supporting baremetal in pike since we didn't deprecate it correctly16:42
mwhahahaqueens gets the official upstream drop but we should best effort pike16:43
mwhahahaand if it's just periodic then it should be minimal16:43
EmilienMmwhahaha: we have periodic ovb on baremetal in pike promotion16:43
EmilienMso that's fine imho16:43
mwhahahak16:43
EmilienMweshay: can you confirm plz?16:44
weshayya.. just for the promotion jobs and there are other jobs that cover16:44
mwhahahaso long as we still have something16:44
weshayya16:44
*** waleedm has quit IRC16:44
*** dmacpher has quit IRC16:44
EmilienMgood16:45
trownEmilienM: seems like a good idea16:45
EmilienMcool16:45
EmilienMlet's go for it then so we can get pike promotion16:45
*** d0ugal has quit IRC16:46
*** zshi has quit IRC16:47
*** jaosorior has quit IRC16:47
rlandyweshay: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/jobs/tripleo-upstream.yml#L589 - job definitions sare still there16:48
*** waleedm has joined #tripleo16:49
*** zshi has joined #tripleo16:50
*** gvrangan_ has quit IRC16:52
*** oidgar has quit IRC16:53
*** mcornea has quit IRC16:53
*** aufi has quit IRC16:53
weshayrlandy, ya.. I think that is ok for now16:54
*** marios has quit IRC16:56
sshnaidmEmilienM, and don't we run these jobs somewhere?16:56
*** moshele has joined #tripleo16:57
*** liverpooler has joined #tripleo16:57
EmilienMsshnaidm: not upstream16:57
sshnaidmEmilienM, ok16:58
mwhahahaweshay, rlandy (and anyone else who contributed): even though i had some minor issues with the initial env setup for the reproduce script, once I got it running it did work quite well. Good work on that17:03
*** yprokule has quit IRC17:04
weshaymwhahaha, thanks!17:04
*** dparkes has joined #tripleo17:04
*** yamahata has quit IRC17:05
*** ffiore has quit IRC17:07
*** jmelvin has quit IRC17:08
*** pblaho has quit IRC17:09
rlandymwhahaha: good to hear - are the issues you hit logged anywhere so we can fix them? ie: what we need to modify in the venv setup?17:09
mwhahaharlandy: not yet, i need to get back to reproducing the problems17:09
ansiwenjtomasek: another question: would it be better to define these parameters with an empty string, so UI can pick it up and make it settable? https://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/roles/ComputeRealTime.yaml?h=refs/changes/39/531739/3#n2117:09
mwhahahagot side tracked trying to fix stuff :D17:09
*** jfrancoa has quit IRC17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956917:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)17:10
rlandymwhahaha: sure - I think weshay hit a similar issue so we can start with the pieces he found missing17:10
*** ramishra has quit IRC17:10
jtomasekansiwen: yes, please don't comment them out. if there is no suitable default value, then leave it empty17:11
*** pcaruana has quit IRC17:11
jtomasekansiwen: nice thing is that user can set these parameters in roles_data.yaml (or do it through API - mistral workflows which is what GUI does) so no additional environment is needed to configure that role17:12
ansiwenjtomasek: alright17:12
*** dparkes has quit IRC17:13
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: WIP: Add custom role for realtime compute  https://review.openstack.org/53173917:14
*** numans has quit IRC17:16
*** moshele has quit IRC17:16
*** fzdarsky has quit IRC17:16
*** lucasagomes is now known as lucas-afk17:19
*** numans has joined #tripleo17:19
*** hjensas has joined #tripleo17:20
*** hjensas has quit IRC17:20
*** hjensas has joined #tripleo17:20
*** almondjoy has joined #tripleo17:22
openstackgerritKeith Schincke proposed openstack/tripleo-common master: Add OS_USERNAME and OS_PROJECT_NAME to PS1  https://review.openstack.org/53257717:26
*** bfournie has quit IRC17:26
openstackgerritKeith Schincke proposed openstack/instack-undercloud master: Add OS_USERNAME and OS_PROJECT_NAME to PS1  https://review.openstack.org/53257817:27
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856717:27
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941917:27
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346317:27
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856717:28
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941917:28
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346317:28
*** rhallisey has quit IRC17:29
*** rhallisey has joined #tripleo17:30
*** pblaho has joined #tripleo17:33
shardymandre, dprince, Slower: Hey https://review.openstack.org/#/c/532472/ is now green and appears to fix the undercloud-containers job but I'm still not clear why17:34
shardyhappy to merge the revert but would really appreciate any further insights as I can't reproduce locally17:34
*** itlinux has quit IRC17:35
*** jpich has quit IRC17:36
dprinceshardy: thanks, looking17:36
dprinceshardy: I was just speaking to mandre about this17:37
dprinceshardy: wondering if perhaps it was related to hostnames17:37
*** florianf has quit IRC17:37
*** gvrangan has joined #tripleo17:38
dprincethe new TripleoInventory appeared to work for me locally I think17:38
EmilienMweshay, mwhahaha : please vote https://review.openstack.org/#/q/topic:scn002/voting+(status:open+OR+status:merged)17:38
shardydprince: ack, Ok well at least it's not only working in my environment then :)17:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Point heat.conf[clients_keystone/auth_uri] to the public endpoint.  https://review.openstack.org/53258417:39
*** almondjoy has quit IRC17:40
shardydprince: we do have [{hostname}]\n  overcloud in the hard-coded inventory17:40
shardydprince: in the generated inventory there's only per role and per service groups I think17:41
*** itlinux has joined #tripleo17:41
dprinceshardy: where is it failing in CI exactly?17:41
shardydprince: so e.g a hostname of Undercloud would work but not undercloud17:41
shardydprince: that's the problem, it's not giving any error, it just hangs discovering facts after the heat stack completes and config download is done17:42
chemjfrancoa holser EmilienM so for rdo cloud/traas i've created https://review.openstack.org/#/q/topic:agent-auth+(status:open+OR+status:merged)17:42
shardyso it's proving a little hard to debug17:42
shardydprince: sec let me find a link17:42
chemjfrancoa holser EmilienM not sure abouth the semantic here, so any help appreciated17:42
EmilienMadding slagle in that convo ^17:42
chemack, make sense17:43
*** gvrangan has quit IRC17:43
shardydprince: http://logs.openstack.org/29/532529/1/check/tripleo-ci-centos-7-undercloud-containers/5923aff/logs/undercloud/home/zuul/undercloud_install.log.txt.gz17:45
shardyit's hanging up on gathering facts for the overcloud group17:45
dprinceshardy: yeah, so like it hangs on the first thing17:47
dprinceshardy: which makes me wonder if it isn't playing with the hosts file which we truncate for this job at the moment17:47
*** gkadam has quit IRC17:47
shardydprince: yea, perhaps we can push a WIP with Depends-On https://review.openstack.org/#/c/518972/ (or land that) to figure out what's wrong with the yaml inventory17:47
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks  https://review.openstack.org/52824117:48
shardymaybe we should land the revert, then I'll post a revert-revert with a depends-on to that?17:48
dprinceshardy: works for me17:48
shardydprince: Ok sounds good, the revert https://review.openstack.org/#/c/532472/ is ready for review17:49
*** jmelvin has joined #tripleo17:49
dprinceshardy: +2 from me17:50
shardyack thanks17:50
*** ffiore has joined #tripleo17:50
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add support function for fast forward upgrade testing.  https://review.openstack.org/52600017:51
*** cshastri has quit IRC17:51
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks  https://review.openstack.org/52824117:54
*** hasanq has joined #tripleo17:59
*** ledo_ has joined #tripleo18:00
*** derekh has quit IRC18:00
*** waleedm has quit IRC18:00
*** gfidente has quit IRC18:03
*** hasanq has quit IRC18:03
*** moshele has joined #tripleo18:03
bugzyshardy: dsneddon: Quick question: can the "routes" section of the nic-config templates handle multiple routes (i.e. a default route and additional static routes)?  tripleo seems to ignore all other routes that I include on a vlan18:07
*** bfournie has joined #tripleo18:08
bugzythe deployment is successful, but I have to go back into the nodes and manually add the additional routes18:08
mwhahahaweshay: arxcruz|ruck: where are the overcloud node logs on rdo 3rd party ci? they seem to be missing or do we only capture them in failure18:08
*** moshele has quit IRC18:09
dsneddonshardy, I added some comments to the patch to render NIC config templates https://review.openstack.org/#/c/523638/18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956918:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)18:10
*** ooolpbot has quit IRC18:10
arxcruz|ruckmwhahaha: which job is missing ?18:11
dsneddonshardy, I haven't figured out a good way to render NIC config templates conditionally depending on whether a role uses a network or not. Jinja doesn't have a construct "if network in roles.networks", so I end up having to do something like this: http://paste.openstack.org/show/642462/18:11
shardydsneddon: ack thanks, does not if string in some_list work in j2?18:11
dsneddonshardy, No, that doesn't work in j218:11
mwhahahaarxcruz|ruck: example https://logs.rdoproject.org/22/504822/8/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zaa187c6eb9584a7989d31e8532d54e90/18:11
mwhahahaarxcruz|ruck: has no overcloud-* folders18:11
*** karthiks has quit IRC18:12
shardydsneddon: hrm, I'm surprised as we use it already ni a number of places, are we just hitting the | default([]) in those cases?18:12
*** alee has quit IRC18:12
arxcruz|ruckmwhahaha: I'll investigate and open a bug :)18:12
shardy{%- if network.name in role.networks|default([]) and network.enabled|default(true) %}18:12
shardydsneddon: ^^ like that, we use it in a few places18:13
dsneddonshardy, Interesting. I had some issues with a similar construct, and found a bunch of Google hits about that not working in jinja2 along with python-based workarounds.18:13
dsneddonshardy, I'm going to do a little testing.18:13
bugzysample config is here https://paste.fedoraproject.org/paste/~TG7GpTDaGxkcRyW6hZ58g18:13
shardydsneddon: Ok, I'm working on a patch too so will push when it's tidied up a bit - I'm rendering the templates only for the bond-with-vlans, including backawards compatibility for the old template names, but not tried the above expression yet18:14
dsneddonshardy, OK, thanks.18:14
*** jpena is now known as jpena|off18:14
EmilienMshardy: before landing this one, do we have a bug in launchpad? the commit message doesn't explain why we revert https://review.openstack.org/#/c/532472/18:17
*** trown is now known as trown|lunch18:17
*** thrash is now known as thrash|biab18:17
dsneddonshardy, Ah, it does get a little cleaner if you are using one file for multiple roles, because you process the file once for each role, and the outside "for role in roles" in my example isn't required.18:17
*** ffiore has quit IRC18:17
shardyEmilienM: No but I can raise one, it's because it's broken the undercloud-containers job18:18
EmilienMshardy: should i +A?18:18
EmilienMdprince: have you seen this failure before? http://logs.openstack.org/72/532472/1/check/tripleo-ci-centos-7-undercloud-containers/122687c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-01-10_15_13_3818:18
EmilienM2018-01-10 15:13:38 |         "2018-01-10 15:13:13.791 11 ERROR mistral.actions.openstack.action_generator.base [-] Failed to create action: glare.artifacts_list: AttributeError: 'NoneType' object has no attribute 'Client'",18:18
weshaymwhahaha, /me looks18:18
EmilienMon the undercloud-container job18:18
shardyEmilienM: sure please do and I'll post a revert-revert to debug the problem with the job18:18
EmilienMok18:18
*** ffiore has joined #tripleo18:19
*** numans has quit IRC18:19
*** jkilpatr has quit IRC18:19
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Add UC backup Mistral workflow definition and actions  https://review.openstack.org/51761018:19
EmilienMweshay, Slower, dprince: should we make undercloud-container voting now it pass?18:20
*** jkilpatr has joined #tripleo18:20
weshayyou're the boss18:20
weshayer captain18:20
* weshay checks the run rate18:21
shardyEmilienM: I've seen that error before, sec18:21
EmilienMweshay: I'm confused what does the job versus all the work done in https://review.openstack.org/#/c/517445/18:21
EmilienMthe current job isn't using the --use-heat workflow?18:21
weshayEmilienM, ya.. that's the diff.. one job has the template that runs through dprince's DOIT.sh18:22
weshaythe other uses --use-heat18:22
weshayjust DO IT!!!18:22
bfourniedsneddon: can we remove https://review.openstack.org/#/c/523638/ from being a dependency on https://review.openstack.org/#/c/512239/? Its not really a true dependency and we can free up the storage team to make progress with https://review.openstack.org/#/c/512239/18:22
weshayhrybacki, ^18:22
*** numans has joined #tripleo18:22
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Add UC backup Mistral workflow definition and actions  https://review.openstack.org/51761018:23
EmilienMweshay: well, we are missing https://review.openstack.org/#/c/517444 too18:23
SlowerEmilienM: which job is that exactly?18:23
*** ffiore has quit IRC18:24
EmilienMSlower: tripleo-ci-centos-7-undercloud-containers18:24
*** holser__ has quit IRC18:25
*** ffiore has joined #tripleo18:25
dsneddontbarron, What do you think about what bfournie suggests above about removing the patch dependency for Ganesha?18:26
*** openstack has joined #tripleo18:30
*** ChanServ sets mode: +o openstack18:30
tbarrondsneddon: bfournie My mind is mushy so let me try 523638 and the other two bp/ganesha patches w/o 512239 and see how it goes.18:31
tbarrondsneddon: bfournie it would be great if those two trains can proceed towards M3 in parallel18:31
*** ffiore_ has joined #tripleo18:33
*** ffiore has quit IRC18:33
*** gvrangan has joined #tripleo18:36
bfourniedsneddon, tbarron: without the nic config example changes it will require changes to the nic configs for actual deployment as described in the commit message but these files normally need manual changes for deployment anyway as Dan described, it shouldn't affect CI because the CI changes are in the patch already. would be worth a try - looks like https://review.openstack.org/#/c/512239/ needs a recheck anyway because of the tox and pep818:36
bfournie failures18:36
dsneddontbarron, Without 523638 you will need to manually add the StorageNFSIpSubnet to your NIC configs.18:36
dsneddontbarron, But you have to do that with any custom network at the moment.18:36
*** tesseract has quit IRC18:36
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: WIP Render bond-with-vlans for all roles  https://review.openstack.org/53259618:37
shardydsneddon, tbarron: ^^ rough first pass, I've not yet added anything to role.role.j2.yaml, it's a copy of controller.j2.yaml18:38
tbarronbfournie: dsneddon ack, will try that approach18:38
tbarronshardy: you're fast, and thanks!18:39
*** ffiore_ has quit IRC18:40
*** morazi has joined #tripleo18:40
*** jkilpatr has joined #tripleo18:40
dsneddonshardy, That patch will end up adding every network to every role. We need to have conditionals around the networks to only render them if they are in role.networks, and some special casing for things like which default route to apply (External if External in role.networks, Control Plane if not).18:40
shardytbarron: It's only a first-pass, I see now that some things are wrongly shown as renamed, so we'll need some more work for it to be functional18:40
dsneddonshardy, I'm testing that right now.18:41
shardydsneddon: yeah like I said, it's a first pass - I'm near EOD here so feel free to push to it or start a different review if you prefer18:41
shardyjust trying to start the discussion about how we do it really18:41
shardydsneddon: one open question is do we have to maintain backwards compatibility for the network/config/*/foo.yaml filenames18:42
shardyit'd be cleaner if we didn't, but I suspect folks with out of tree environments may be impacted if we don't18:42
shardyI tried to show how we could work around that in my patch18:42
beaglesbnemec, can https://bugs.launchpad.net/tripleo/+bug/1720918 be closed? The comments on https://review.openstack.org/#/c/509086/ seem to indicate that a fix is no longer necessary?18:43
openstackLaunchpad bug 1720918 in tripleo "puppet-firewall changed the ipv6-icmp rule type name" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)18:43
bnemecbeagles: Yeah, seems it can.18:46
beaglescool!18:46
dsneddonshardy, I tried this, but L100 doesn't work: http://paste.openstack.org/show/642481/18:47
*** sshnaidm is now known as sshnaidm|afk18:48
shardydsneddon: ack thanks, looking18:49
*** gvrangan has quit IRC18:50
shardydsneddon: can you clarify what you see, as it renders OK for me?18:53
hrybackiweshay pong18:53
weshayhrybacki, meh.. somebody said.. JUST DO IT18:54
weshayand I was compelled to ping you18:54
hrybackiand did you, weshay ?18:54
weshayI DID IT!18:54
hrybackiglad to see you haven't lost that CAN DO IT attitude :P18:54
dsneddonshardy, I do not see the default route on the External network for the Controller role.18:58
dsneddonshardy, The networks render correctly, but the conditional that writes out the route only if the network is named 'External' and is in the role.networks never renders.18:58
shardydsneddon: Yeah it's because we're passing in a string e.g "Controller" as role to the j2, not the whole roles_data map18:58
shardyso we'll need to tweak the code running the j2 I think, sec, trying18:59
shardythe result is role.networks is always empty18:59
dsneddonshardy, Ah, that explains it.19:00
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/tools/process-templates.py#L16519:01
shardydsneddon: that's the problem I think, we assume if there's no role.name that we just pass the name19:02
shardyprobably we can remove that old backwards compat code now, but I'll fix it up by changing the role.role.j2.yaml, sec19:02
*** moshele has joined #tripleo19:02
dsneddonshardy, Thanks19:02
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: collect-logs: add deployed-server logs  https://review.openstack.org/53260619:04
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download  https://review.openstack.org/52876119:04
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download  https://review.openstack.org/52876119:04
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Render NIC config templates with jinja2  https://review.openstack.org/52363819:05
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: WIP Render bond-with-vlans for all roles  https://review.openstack.org/53259619:05
shardydsneddon: ^^ sorry I think I rebased your patch by mistake19:06
shardydsneddon: http://paste.openstack.org/show/642484/ shows the WIP conditionals working19:06
shardyI left my debug in role.role.j2.yaml19:06
*** moshele has quit IRC19:07
shardydsneddon: dropping off now, feel free to update if you have time, I'll check any comments or mail in the morning19:07
dsneddonshardy, Thanks again, have a good night.19:08
*** shardy has quit IRC19:08
*** pkovar has quit IRC19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956919:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)19:10
*** ooolpbot has quit IRC19:10
*** salmankhan has quit IRC19:10
*** fultonj has quit IRC19:11
weshaymwhahaha, the logging issue looks like a bug or infra issue to me19:13
weshaymwhahaha, going to log it19:13
bfournietbarron: btw, the changes you're making the add a new network for a Manila, this documents how I added one for OSP-12 to use for Ironic in overcloud and shows the files that needed editing in "Pre-deployment changes" https://docs.google.com/document/d/1OBEm1Puj2zsCIQ86-Qp1IlW1Suw5lDef2QA5XIdm22I/edit#heading=h.titpsdzbfs7m.  With https://review.openstack.org/#/c/512239/ and Dan's eventual fixes in https://review.openstack.org/#/c/52363819:16
bfournie/ all these steps should not be needed except for Step 3 - you'll still need to manually edit roles_data.yaml to add the new network to the role(s)19:16
*** jobewan has joined #tripleo19:17
weshaymwhahaha, fyi https://bugs.launchpad.net/tripleo/+bug/174252819:18
openstackLaunchpad bug 1742528 in tripleo "ovb jobs in rdo-cloud are not logging the overcloud nodes" [Critical,Triaged]19:18
tbarronbfournie: awesome1  /me reads19:21
beaglesmwhahaha, EmilienM, is https://review.openstack.org/#/c/463937/ backportable, it introduces some heat parameters - they have defaults, but generally I've shied away from backporting new params19:22
*** thrash|biab is now known as thrash19:22
EmilienMbeagles: imho yes, lgtm19:23
beaglesEmilienM, ack thx19:23
thrashEmilienM: that should be innocuous. It just means the glare client isn't installed. No action created. No big deal.19:23
*** fultonj has joined #tripleo19:24
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856719:24
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941919:24
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346319:24
EmilienMthrash: ok, maybe a bit confusing for operators though19:24
thrashEmilienM: Should probably just log that at DEBUG level, tbh19:25
thrashHard to say tho... Might mask legit errors that you don't expect.19:25
*** ledo__ has joined #tripleo19:26
openstackgerritBrian Haley proposed openstack/tripleo-heat-templates master: Start using nova_metadata_host  https://review.openstack.org/53189019:27
*** ledo_ has quit IRC19:27
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs032: use multinode-3nodes-registry from THT  https://review.openstack.org/53261119:30
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates stable/ocata: Optimize kernel neighbour table for large scale environments  https://review.openstack.org/53261219:30
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Remove unused test-environments  https://review.openstack.org/53261319:32
*** raildo has quit IRC19:33
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates stable/newton: Optimize kernel neighbour table for large scale environments  https://review.openstack.org/53261419:34
*** trown|lunch is now known as trown19:35
*** dsariel has quit IRC19:36
*** dbecker_ has quit IRC19:38
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates stable/newton: Set restrictive file permissions on Ceph keyrings for non-containerized deployment  https://review.openstack.org/53239819:38
*** raildo has joined #tripleo19:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ci: update multinode-3nodes-registry  https://review.openstack.org/53261619:42
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs032: use multinode-3nodes-registry from THT  https://review.openstack.org/53261119:43
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Remove unused test-environments  https://review.openstack.org/53261319:43
*** rlandy has quit IRC19:43
*** moshele has joined #tripleo19:45
*** etingof has quit IRC19:46
*** rlandy has joined #tripleo19:48
*** jtomasek has quit IRC19:49
*** moshele has quit IRC19:49
*** dtantsur is now known as dtantsur|afk19:53
*** alee has joined #tripleo19:53
openstackgerritMartin André proposed openstack/python-tripleoclient master: Generate undercloud-passwords.conf and fix output dir.  https://review.openstack.org/52351119:54
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Containerize multinode-3nodes  https://review.openstack.org/53262319:59
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Containerize featureset032 (multinode-3nodes)  https://review.openstack.org/53262420:00
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download  https://review.openstack.org/52876120:01
openstackgerritMartin André proposed openstack/python-tripleoclient master: Generate undercloud-passwords.conf and fix output dir.  https://review.openstack.org/52351120:02
*** alee has quit IRC20:09
*** thrash has quit IRC20:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956920:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)20:10
*** ooolpbot has quit IRC20:10
*** alee has joined #tripleo20:10
*** alee_ has joined #tripleo20:10
*** alee_ has quit IRC20:10
*** alee has quit IRC20:10
*** alee has joined #tripleo20:10
*** holser__ has joined #tripleo20:12
EmilienMweshay: do we need the alert ^ I thought we pinned Swift now20:23
weshayEmilienM, need a few otp w/ your boss20:24
bnemecHmm, can't get to https://trunk.registry.rdoproject.org20:33
bnemecI can't find anything about planned maintenance today.20:34
*** almondjoy has joined #tripleo20:34
*** holser___ has joined #tripleo20:38
*** thrash has joined #tripleo20:38
*** thrash has joined #tripleo20:38
*** ledo__ has quit IRC20:38
*** ledo_ has joined #tripleo20:38
amoralejit seems there is some problem with RDO's registry20:39
amoralejbnemec, ^20:39
amoraleji'm checking...20:39
bnemecamoralej: Thanks20:39
*** apevec has joined #tripleo20:39
*** holser__ has quit IRC20:40
apevecEmilienM, re. swift - unpin is https://review.rdoproject.org/r/1124820:42
apevecamoralej, check experimental uses current-passed-ci ?20:43
*** jtomasek has joined #tripleo20:43
apevecnm, fixes in swift are not merged yet20:44
*** waleedm has joined #tripleo20:44
amoralejapevec, check experimenta is current-passed-ci + built packages20:44
*** ledo_ has quit IRC20:46
apevecok, so it would build openstack-swift ?20:46
apevecor rdoinfo diff wouldn't detect it?20:46
apevecalso does it honor Upstream-Id: ?20:46
apevecnope, that's actually in dlrn20:47
apevecfor distgit changes20:47
*** atoth has quit IRC20:48
*** ledo_ has joined #tripleo20:50
*** waleedm has quit IRC20:50
*** ledo__ has joined #tripleo20:52
*** ledo_ has quit IRC20:53
*** dparkes has joined #tripleo20:54
*** dprince has quit IRC20:55
*** toure is now known as toure|gone21:01
*** amoralej is now known as amoralej|off21:06
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172956921:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)21:10
*** yamahata has joined #tripleo21:12
*** moshele has joined #tripleo21:13
*** moshele has quit IRC21:16
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Fix the dellemc vmax to use the correct hiera name  https://review.openstack.org/53263821:17
EmilienMapevec: do we need alert on https://bugs.launchpad.net/tripleo/+bug/1729569 ?21:22
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)21:22
*** rhallisey has quit IRC21:22
EmilienMapevec: since cschwede is on it21:22
apevecEmilienM, we can remove alert but keep promotion-blocker21:24
apevecalert was to get attention, and that worked21:25
EmilienMapevec: but it's not blocking promoting or is it?21:25
EmilienMsince we pin it21:25
EmilienMsorry I'm confused21:25
apevecwell, that's what I mentioned on the call: pin for > month is bad, we need to keep it as blocker if it is that long21:26
apevecb/c it's is blocking _Swift_ promotion21:26
apevecupstream went on, accumulated new issues21:26
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: tq/tqe gate jobs in ci.centos are timing out  https://review.openstack.org/53254021:27
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: test change DNM  https://review.openstack.org/53254121:27
*** pradk has quit IRC21:28
weshayapevec, I would say alert is used to get the attention of folks in this channel only21:28
apevecweshay, yes, there were THT and puppet-tripleo patches21:28
weshayapevec, if the folks we need on it are working it, the escalation board is good21:28
weshayk21:29
apevecalert removed21:30
apevecweshay, what's the condition for LP bug escalation again?21:30
apevecci + promotion-blocker tags and > 4h ?21:30
weshaybug is critical + tag = promotion blocker > 4h21:31
weshayit's really 5 but ya21:31
weshay:)21:31
weshaywhere the bug is 5hr old21:32
*** trown is now known as trown|outtypewww21:38
*** apevec has quit IRC21:40
*** pcaruana has joined #tripleo21:42
*** pcaruana has quit IRC21:43
*** hasanq has joined #tripleo21:46
openstackgerritKeith Schincke proposed openstack/instack-undercloud master: Add OS_USERNAME and OS_PROJECT_NAME to PS1  https://review.openstack.org/53257821:46
*** dr_gogeta86 has quit IRC21:47
openstackgerritSandhya Dasu proposed openstack/tripleo-heat-templates master: Adding new config parameters for Cisco UCSM ML2 driver  https://review.openstack.org/53264221:47
*** raildo has quit IRC21:47
*** hasanq has quit IRC21:49
*** jtomasek has quit IRC21:51
*** threestrands_ has joined #tripleo21:52
*** threestrands_ has quit IRC21:53
*** threestrands_ has joined #tripleo21:53
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha  https://review.openstack.org/51223921:54
*** threestrands has quit IRC21:54
mwhahahastupid dns servers21:58
tbarronmwhahaha: you need to learn to express how you really feel about things21:58
mwhahahayes it's quite unhealthy to hold it all in21:58
tbarron:)21:59
tbarronYou were just being concise with your adjectival string21:59
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: split multinode playbook  https://review.openstack.org/52641421:59
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: Allow for multiple playbooks to be run  https://review.openstack.org/52576521:59
mwhahahai usually express things like22:00
mwhahaha(╯°□°)╯︵ sɹǝʌɹǝs sup22:00
tbarronnice22:00
tbarronthough a bit vulgar22:00
tbarronin my own LOCALE22:00
mwhahahautf8 all the things22:01
tbarron:)22:01
*** ffiore_ has joined #tripleo22:01
*** yamahata has quit IRC22:03
*** yamahata has joined #tripleo22:03
bnemectable flip ascii art will never get old22:05
*** holser__ has joined #tripleo22:08
*** yamahata has quit IRC22:09
*** holser___ has quit IRC22:11
*** rcernin has joined #tripleo22:11
*** aputtur_ has quit IRC22:19
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: fix reproducer script when statement  https://review.openstack.org/53265022:21
*** ledo__ has quit IRC22:23
-openstackstatus- NOTICE: The zuul system is being restarted to apply security updates and will be offline for several minutes. It will be restarted and changes re-equeued; changes approved during the downtime will need to be rechecked or re-approved.22:24
*** jkilpatr has quit IRC22:32
EmilienMbug 174246522:33
openstackbug 1742465 in tripleo "periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-ocata is failing with Resource could not be found on mistral" [High,Triaged] https://launchpad.net/bugs/1742465 - Assigned to Arx Cruz (arxcruz)22:33
*** Goneri has quit IRC22:34
*** abishop has quit IRC22:36
*** pradk has joined #tripleo22:39
*** threestrands_ has quit IRC22:41
*** waleedm has joined #tripleo22:41
*** bfournie has quit IRC22:44
*** bfournie has joined #tripleo22:45
*** waleedm has quit IRC22:46
*** ecerquei has quit IRC22:48
*** bfournie has quit IRC22:49
*** morazi has quit IRC22:55
*** threestrands has joined #tripleo22:55
*** threestrands has quit IRC22:55
*** threestrands has joined #tripleo22:55
*** almondjoy has quit IRC23:01
*** jmelvin has quit IRC23:04
*** atoth has joined #tripleo23:08
*** threestrands has quit IRC23:11
*** tosky has quit IRC23:13
tonybRandom question ..... in overcould image upload we check to see if files exist, but the list doesn't seem to match the files that will be uploaded to glance  for exmaple in the whole-disk case we only check for overcloud-full.qcow2 even though we'll also upload the agent kernel+ramdisk to glance23:18
tonybis that deliberate or just a small thinko?23:18
tonybsimilarly in the partition case we never check that the overcloud-full-{vmlinuz,initrd} files exist even though we'll attempt to upload them to glance23:20
*** threestrands has joined #tripleo23:20
*** numans has quit IRC23:21
*** ffiore_ has quit IRC23:21
*** numans has joined #tripleo23:24
*** social has quit IRC23:36
*** rlandy is now known as rlandy|bbl23:37
*** haint has quit IRC23:41
*** liverpooler has quit IRC23:44
*** bfournie has joined #tripleo23:46
*** pchavva has quit IRC23:50
*** holser__ has quit IRC23:50
*** hjensas has quit IRC23:52
*** hjensas has joined #tripleo23:52
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260723:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!