Thursday, 2017-01-26

*** sdake has quit IRC00:01
*** karimb has quit IRC00:03
*** ooolpbot has joined #tripleo00:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938400:11
*** ooolpbot has quit IRC00:11
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)00:11
*** ansmith has joined #tripleo00:15
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh  https://review.openstack.org/39581300:18
*** dsneddon has quit IRC00:23
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: WIP: Support uploading files in modify image role  https://review.openstack.org/42547200:30
*** bfournie has joined #tripleo00:31
*** limao has joined #tripleo00:41
*** rbrady-afk has quit IRC00:47
*** trown is now known as trown|outtypewww00:47
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: pass the topology of the overcloud w/ topology vs extra-args  https://review.openstack.org/42545300:47
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Support builds in multinode  https://review.openstack.org/42547400:48
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Collect only logs we need  https://review.openstack.org/42545900:57
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Support exclude list for logs collecting  https://review.openstack.org/42539501:00
openstackgerritMerged openstack/tripleo-heat-templates: Add release notes for Ocata 6.0.0  https://review.openstack.org/42436501:07
*** ooolpbot has joined #tripleo01:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938401:11
*** ooolpbot has quit IRC01:11
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)01:11
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Add host info collection to collect-logs  https://review.openstack.org/41322401:13
openstackgerritAndy Smith proposed openstack/puppet-tripleo: Use rpc and notify transport_url for oslo_messaging backends  https://review.openstack.org/42548401:15
*** sdake has joined #tripleo01:33
*** sdake_ has joined #tripleo01:35
*** sdake has quit IRC01:38
*** sdake_ has quit IRC01:43
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart: Add the ability to run all tasks as root  https://review.openstack.org/41819801:45
*** rajinir has quit IRC01:46
*** sdake has joined #tripleo01:49
*** sdake_ has joined #tripleo01:50
*** sdake has quit IRC01:54
*** sdake_ has quit IRC02:09
*** ooolpbot has joined #tripleo02:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938402:11
*** ooolpbot has quit IRC02:11
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)02:11
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Add option to leave tar.gz logs files and flat log  https://review.openstack.org/42549702:11
*** sdake has joined #tripleo02:11
*** rbrady-afk has joined #tripleo02:13
*** yamahata has quit IRC02:16
*** cwolferh has quit IRC02:17
EmilienMjrist: back from hockey (and alive)02:20
*** noama has quit IRC02:20
EmilienMjrist: no there is not, I use to read git log02:20
EmilienMthrash: thanks02:20
*** noama has joined #tripleo02:20
openstackgerritMerged openstack/python-tripleoclient: Migrate overcloud delete to full workflow  https://review.openstack.org/42280602:29
openstackgerritMerged openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419002:29
openstackgerritMerged openstack/tripleo-heat-templates: (newton) Import multinode + pingtest from tripleo-ci  https://review.openstack.org/42481102:29
openstackgerritMerged openstack/tripleo-heat-templates: ceph-rgw: add missing user parameter  https://review.openstack.org/42352602:30
EmilienMYEAH02:34
EmilienMsorry02:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Fix for AllNodesExtraConfig and fix environment files to create swap files/partitions  https://review.openstack.org/42407902:35
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Support builds in multinode  https://review.openstack.org/42547402:36
*** fzdarsky_ has joined #tripleo02:37
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809802:38
openstackgerritMerged openstack/tripleo-puppet-elements: Add explicit install of net-snmp  https://review.openstack.org/42534602:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add scenario005 scenario  https://review.openstack.org/41809902:39
openstackgerritAndy Smith proposed openstack/puppet-tripleo: Use rpc and notify transport_url for oslo_messaging backends  https://review.openstack.org/42548402:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add scenario005 scenario  https://review.openstack.org/41809902:41
*** fzdarsky|afk has quit IRC02:41
*** owalsh is now known as owalsh-afk02:43
*** ansmith has quit IRC02:46
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921502:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Use os-net-config in multinode jobs  https://review.openstack.org/42524102:51
*** sdake has quit IRC02:58
*** cwolferh has joined #tripleo03:00
*** bkopilov has quit IRC03:00
*** d0ugal has quit IRC03:00
*** yamahata has joined #tripleo03:10
*** ooolpbot has joined #tripleo03:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938403:11
*** ooolpbot has quit IRC03:11
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)03:11
openstackgerritBen Kero proposed openstack/tripleo-quickstart: Add optional undercloud-setup role to quickstart-extras playbook  https://review.openstack.org/42494703:16
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Replace multinode playbook with default quickstart playbook  https://review.openstack.org/42468303:17
*** d0ugal has joined #tripleo03:18
*** newmember has quit IRC03:23
*** sdake has joined #tripleo03:46
openstackgerritTim Rozet proposed openstack/puppet-tripleo: Enables OpenDaylight Clustering in HA deployments  https://review.openstack.org/42538303:54
*** cwolferh has quit IRC03:56
openstackgerritBen Kero proposed openstack/tripleo-quickstart-extras: overcloud-prep-images: Ensure only 1 overcloud-full.qcow2 in glance  https://review.openstack.org/42551604:03
*** sdake_ has joined #tripleo04:07
*** sdake has quit IRC04:09
*** ooolpbot has joined #tripleo04:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938404:11
*** ooolpbot has quit IRC04:11
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)04:11
*** thrash is now known as thrash|g0ne04:12
*** bkopilov has joined #tripleo04:28
*** sdake has joined #tripleo04:31
*** sdake_ has quit IRC04:32
*** ianw is now known as ianw_pto04:34
dtrainorping bandini, i'm still seeing failures with gate-tripleo-ci-centos-7-ovb-ha and gate-tripleo-ci-centos-7-ovb-nonha.  are we still waiting for some part of https://review.openstack.org/#/c/362389/ to be incorporated?04:36
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: [WIP] Nodes Table tagging  https://review.openstack.org/42454704:42
larskswhere does the certificate with CN=overcloud live?04:44
*** yamahata has quit IRC04:46
*** sdake has quit IRC04:49
openstackgerritMerged openstack/tripleo-puppet-elements: Add explicit install of net-snmp  https://review.openstack.org/42533904:51
*** cwolferh has joined #tripleo04:54
*** Guest58531 has quit IRC05:04
openstackgerritBen Kero proposed openstack/tripleo-quickstart: Add optional undercloud-setup role to quickstart-extras playbook  https://review.openstack.org/42494705:04
*** mgagne has joined #tripleo05:07
*** mgagne is now known as Guest3353905:07
*** ealcaniz has joined #tripleo05:12
*** jtomasek has quit IRC05:18
*** abregman has joined #tripleo05:22
*** sdake has joined #tripleo05:25
*** rlandy has quit IRC05:42
*** sdake has quit IRC05:45
*** ealcaniz has quit IRC05:49
*** ealcaniz has joined #tripleo05:54
*** sdake has joined #tripleo06:06
openstackgerritBen Kero proposed openstack/tripleo-quickstart: Add optional undercloud-setup role to quickstart-extras playbook  https://review.openstack.org/42494706:14
*** jprovazn has joined #tripleo06:15
*** sdake has quit IRC06:16
*** sdake has joined #tripleo06:17
*** ealcaniz has quit IRC06:17
*** crenguta has joined #tripleo06:17
openstackgerritSaravanan KR proposed openstack/puppet-tripleo: Add support to changing the Rabbitmq password on update  https://review.openstack.org/40206106:20
*** sdake_ has joined #tripleo06:21
*** ealcaniz has joined #tripleo06:21
bandinidtrainor: do you have link to failing jobs06:22
bandinidtrainor: http://tripleo.org/cistatus.html seems moderately green06:23
*** sdake has quit IRC06:23
*** sdake_ has quit IRC06:27
*** saneax has joined #tripleo06:34
*** saneax is now known as saneax-_-|AFK06:46
*** rasca has joined #tripleo06:49
*** florianf has joined #tripleo06:51
*** ealcaniz has quit IRC06:56
openstackgerritBen Kero proposed openstack/tripleo-quickstart: Add optional undercloud-setup role to quickstart-extras playbook  https://review.openstack.org/42494707:03
*** tesseract has joined #tripleo07:11
*** tdasilva has quit IRC07:15
*** yprokule has joined #tripleo07:26
*** noama has quit IRC07:27
*** masco has joined #tripleo07:27
*** noama has joined #tripleo07:28
*** noama has quit IRC07:29
*** cylopez has joined #tripleo07:30
*** tzumainn has joined #tripleo07:35
openstackgerritDougal Matthews proposed openstack/tripleo-common: Use the builtin Mistral engine command 'fail' when failing workflows  https://review.openstack.org/42504707:36
openstackgerritMichele Baldessari proposed openstack/tripleo-image-elements: Set IRONIC_AGENT_MULTIPATH_DRIVERS to '' when undefined  https://review.openstack.org/42556507:38
bandiniyolanda: could you take a look at ^, it might very well be that the problem in itself is that the env variable is unset from time to time, so the above would just be a workaround07:42
openstackgerritBen Kero proposed openstack/tripleo-quickstart: Add optional undercloud-setup role to quickstart-extras playbook  https://review.openstack.org/42494707:45
*** tremble has joined #tripleo07:47
*** tremble has joined #tripleo07:47
*** tzumainn has quit IRC07:50
*** aufi has joined #tripleo07:52
openstackgerritChris Jones proposed openstack/tripleo-common: Add action for generating fencing parameters.  https://review.openstack.org/42232107:53
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Add SkipUpgradeConfigTags for upgrade config  https://review.openstack.org/42407207:54
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Adds a pre-upgrade check that service is running (step0)  https://review.openstack.org/41459807:54
*** jlinkes has joined #tripleo07:54
*** tdasilva has joined #tripleo07:55
*** jlinkes has quit IRC07:59
openstackgerritMerged openstack/tripleo-common: Adding release nodes for Congress and Tacker  https://review.openstack.org/42543608:02
*** dsariel has joined #tripleo08:03
*** aufi has quit IRC08:03
*** ooolpbot has joined #tripleo08:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165949308:11
*** ooolpbot has quit IRC08:11
openstackLaunchpad bug 1659493 in tripleo "IRONIC_AGENT_MULTIPATH_DRIVERS is undefined during IPA image build" [Critical,In progress] - Assigned to Michele Baldessari (michele)08:11
*** jlinkes has joined #tripleo08:13
*** aufi has joined #tripleo08:18
*** tdasilva has quit IRC08:22
openstackgerritMartin AndrĂ© proposed openstack/tripleo-common: Install python-heat-agent-json-file in overcloud-full  https://review.openstack.org/42455208:23
*** b00tcat has joined #tripleo08:23
*** zoli|gone is now known as zoli08:26
*** abregman is now known as abregman|mtg08:27
*** amoralej has joined #tripleo08:27
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Add SNMP support to major CI upgrade  https://review.openstack.org/42407708:27
*** ccamacho has joined #tripleo08:27
*** tdasilva has joined #tripleo08:29
*** panda|zZ is now known as panda08:31
pandabandini: Why is IRONIC_AGENT_MULTIPATH_DRIVERS sometimes not set ? what happens when dracut --add-drivers is called without arguments ?08:33
bandinipanda: I don't know why it is not set. the issue is that bash then complains it is undefined08:34
pandabandini: I think that change is going to fail because dracut will try to add $RAMDISK as a driver08:34
bandinipanda: oh let me see08:34
bandinipanda: ah right08:34
bandinipanda: who is supposed to set IRONIC_AGENT_MULTIPATH_DRIVERS all the time?08:35
openstackgerritBen Kero proposed openstack/tripleo-quickstart: Add optional undercloud-setup role to quickstart-extras playbook  https://review.openstack.org/42494708:37
*** aufi has quit IRC08:37
openstackgerritMichele Baldessari proposed openstack/tripleo-image-elements: Set IRONIC_AGENT_MULTIPATH_DRIVERS to '' when undefined  https://review.openstack.org/42556508:38
*** ealcaniz has joined #tripleo08:39
*** rasca has quit IRC08:41
bandinipanda: thanks for spotting that!08:41
bandinipanda: I'd love to understand who is in charge to set that variable though as the commit that introduced it says it defaults to a couple of drivers, yet Ng and I have seen a bunch of jobs fail due to it being undefined08:42
*** rasca has joined #tripleo08:42
pandabandini: unthank me for all the things I've not spotted08:42
bandinilol08:42
pandabandini: I think it's set before calling dib, but i'm not sure, I'm checking08:43
bandinipanda: Merci!08:43
pandabandini: the documentation says it defaults to something08:43
*** jpich has joined #tripleo08:44
bandinipanda: right, for example here http://logs.openstack.org/98/417898/28/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/f1bf016/console.html if you download undercloud.tar.xz and look in /home/jenkins/ipa*log we see it is undefined08:44
bandiniand the dib building fails08:44
pandabandini: been there, done that :)08:46
bandinipanda: yes but did you collect the 20$? :D08:46
bandiniwe should start the game tripleopoly08:46
*** chem has quit IRC08:46
*** gfidente has joined #tripleo08:48
*** gfidente has quit IRC08:48
*** gfidente has joined #tripleo08:48
*** aufi has joined #tripleo08:49
*** nyechiel_ has joined #tripleo08:49
*** jtomasek has joined #tripleo08:50
*** arxcruz has quit IRC08:52
*** iranzo has joined #tripleo08:52
*** arxcruz has joined #tripleo08:53
b00tcatmorning! is deploying an overcloud (Newton release of tripleo) with RHEL 7.3 supported?08:57
openstackgerritJulie Pichon proposed openstack-infra/tripleo-ci: Remove references to Liberty (now EOL'd)  https://review.openstack.org/41781408:58
openstackgerritJulie Pichon proposed openstack-infra/tripleo-ci: Add newton branch to delorean-build branches  https://review.openstack.org/39743908:58
*** zzzeek has quit IRC09:00
*** zzzeek has joined #tripleo09:00
*** apetrich has quit IRC09:01
*** shardy has joined #tripleo09:02
b00tcatah, nvm, I was being hit by https://bugs.launchpad.net/diskimage-builder/+bug/1641106 I just found out09:02
openstackLaunchpad bug 1641106 in diskimage-builder "centos7 image missing lsb_release" [Undecided,In progress] - Assigned to Oliver Walsh (owalsh)09:02
shardymorning all09:03
openstackgerritRaoul Scarazzini proposed openstack/tripleo-quickstart-extras: Fix node cycle on HA Validation  https://review.openstack.org/42558709:03
*** abregman|mtg is now known as abregman09:04
gfidentemorning shardy :)09:04
shardyugh, looks like stable/newton CI is still broken?09:05
shardy4 days in a row :(09:05
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras: Add no-cleanup arg for overcloud deployment  https://review.openstack.org/40705909:05
shardyhttps://review.openstack.org/#/c/425343/ hasn't landed yet, I guess that's why09:05
*** crenguta has quit IRC09:06
matbushardy: o/09:07
*** crenguta has joined #tripleo09:08
*** ooolpbot has joined #tripleo09:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165949309:11
*** ooolpbot has quit IRC09:11
openstackLaunchpad bug 1659493 in tripleo "IRONIC_AGENT_MULTIPATH_DRIVERS is undefined during IPA image build" [Critical,In progress] - Assigned to Michele Baldessari (michele)09:11
shardymarios, matbu: Hey given that we're blocked on CI again, should I perhaps consider rebasing all outstanding composable upgrades patches (including the ones you guys have posted) into one branch on gerrit?09:13
shardyOr I could push a temporary fork of t-h-t we could test from09:13
marioso/ shardy sure go ahead - whatever works/easiest09:13
shardya long series in gerrit will be a pain for rebase (and more load on CI), but at least we can all be locally testing the same thing09:13
matbushardy: yep +109:13
shardyI'm happy to just keep rebasing it until we get CI unblocked09:14
mariosshardy: i'm applying them downstream anyway so my tht will still trail a bit09:14
shardyOk, cool, will do that now, thanks09:14
shardymarios: Ok, well I guess it's still going to be easier for you as the series should apply with less conflicts09:14
mariosshardy: for sure09:14
matbumarios: are you working on downstream in all your test/dev ?09:14
shardyI just want a way to check out one t-h-t branch and locally test everything09:14
mariosmatbu: yeah i start with vanila 1009:15
* shardy is only testing upstream builds atm09:15
matbume too :)09:15
mariosmatbu: i have a second box i should setup(it currently has vanila 9 on it for -> 10 testing)09:15
shardyI guess it's pretty much the same - I deploy stable/newton tht/overcloud-full, then upgrade it like we do in CI09:15
mariosmatbu: yeah it makes sense for me to have this setup because it means i have same as the qe guys09:15
matbumarios: yes i know you're right09:16
*** fzdarsky_ is now known as fzdarsky09:16
shardyNice, I guess we've got better coverage with these two setups - my focus is on getting CI passes, thus I need to be as close to that env as possible :)09:16
mariosmatbu: well obviously we need both and it doesn't happen downstream if it didn't happen upstream yet anyway...09:16
*** limao has quit IRC09:17
*** crenguta has quit IRC09:17
*** crenguta has joined #tripleo09:19
openstackgerritMartin AndrĂ© proposed openstack/puppet-tripleo: Rename controller_admin_vip to controller_admin_host  https://review.openstack.org/42529609:20
*** mcornea has joined #tripleo09:21
*** dbecker has joined #tripleo09:21
*** athomas has joined #tripleo09:21
*** iranzo has quit IRC09:24
*** lucas-afk is now known as lucasagomes09:25
shardygfidente: Hey question re the OSD service upgrade09:25
*** dsariel has quit IRC09:25
shardygfidente: is there any reason we can't just do a rolling upgrade of those, or does it have to be manual?09:25
shardyI know in previous releases we just used a script, but this upgrade seems simpler?09:26
gfidenteshardy rolling you mean from ansible?09:29
gfidentein this release we're mainly not upgrading ceph09:29
gfidenteso stop/update/start is fine09:29
gfidenteas long as we do it on the nodes one by one09:29
openstackgerritMichele Baldessari proposed openstack/tripleo-image-elements: Set IRONIC_AGENT_MULTIPATH_DRIVERS to '' when undefined  https://review.openstack.org/42556509:29
gfidentein pike I think we'll have to upgrade to a new ceph release09:30
gfidenteso the script might need a little more logic, but should be able to do it with this same process, just a longer list of tasks09:30
openstackgerritMichele Baldessari proposed openstack/tripleo-image-elements: Set IRONIC_AGENT_MULTIPATH_DRIVERS to '' when undefined  https://review.openstack.org/42556509:31
shardygfidente: ack, so https://review.openstack.org/#/c/423350/ is OK, and we don't need to disable upgrades for the CephStorage role this release09:32
gfidenteah yeah we don't need to do it manually no09:32
shardymarios: ^^ FYI - I thought you had a patch disabling upgrades for cephstorage but can't find it atm09:33
mariosshardy: it landed already it was just the disable_upgrades flag, gfidente reading back09:34
shardymarios: Ok, cool - we may be able to tweak that to not disable for CephStorage, modulo some testing09:35
shardywhen my batched upgrades patch lands09:35
gfidenteI think I can deprecate the upgrade scripts too09:35
mariosshardy: i mean it added the disable_upgrade_deployment into the default roles_data.yaml for ceph storage. i probably need to tweak https://review.openstack.org/#/c/419886/ too then if we aren't going to manually run the script we shouldn't deliver it either to ceph n odes09:35
openstackgerritChristian Schwede proposed openstack/tripleo-common: Use Mistral to create Swift temporary URLs  https://review.openstack.org/41322909:35
* shardy will test it today with multiple OSD nodes09:35
gfidentewe don't need to ship those with ocata09:36
gfidenteI was assuming we were doing it from heat as well09:36
shardymarios: I think as mentioned in https://review.openstack.org/#/c/424661/ we should have the option of dumping the script on the nodes (either when automated upgrades are disabled, or perhaps always)09:36
gfidentefrom the service templates09:36
mariosgfidente: so you mean to say, we could use ansible for all the steps that we are currently defining in https://github.com/openstack/tripleo-heat-templates/blob/8ab1918f026aaa9d06dd4cadd1ad5e15f06b220f/extraconfig/tasks/major_upgrade_ceph_storage.sh ? or i misunderstood09:36
gfidentemarios yes in this release yes09:36
shardymarios: but yeah, I'm trying to figure out if we can automate things a little better this release09:36
shardywithout so many operator driven steps09:37
gfidentethe key thing is the fact that from newton to oacata the ceph release is not changing09:37
*** derekh has joined #tripleo09:37
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates: Add AuditD composable service  https://review.openstack.org/42187309:37
shardyobviously we'll still need that for Compute, but perhaps not so much for *Storage?09:37
gfidentemarios so none of that is needed, we should not run it at all09:37
shardywe probably need to start purging t-h-t of scripts that don't apply to this release soon09:37
shardyas it's a little confusing :)09:38
gfidenteyeah ^^ that09:38
marios11:36 < shardy> marios: I think as mentioned in https://review.openstack.org/#/c/424661/ we     <-- wrt this i am referring to the current ceph upgrade script i.e. the one at https://github.com/openstack/tripleo-heat-templates/blob/8ab1918f026aaa9d06dd4cadd1ad5e15f06b220f/extraconfig/tasks/major_upgrade_ceph_storage.sh  i think you were referring to the ansible tasks09:38
lhindsshardy: I added the capability map in the end for auditd, as a new patch might not make it in considering timelines for f-freeze09:38
gfidente /me will do after lunch09:38
lhindsshardy: do went with your idea :)09:38
lhindsdo/so09:38
mariosgfidente: i see so that was all special handling for the version jump?09:39
gfidentemarios exactly09:39
mariosgfidente: so we can just do like other services? stop, update, db sync/w.e.... profit?09:40
gfidentespecial handling as it went from bds scripts to systemd09:40
gfidentethey added selinux09:40
*** morazi has joined #tripleo09:40
*** jpena|off is now known as jpena09:40
gfidentemarios yep in newton>ocata yes09:40
gfidentewe don't need the 'special handling'09:40
mariosgfidente: but we still need the batched though? the concern for the compute nodes was 'one at a time' because i need to migrate my stuff between nodes09:40
mariosgfidente: does the same apply for ceph?09:40
gfidentestill batched yes09:40
gfidentebecause we need to keep the cluster active at all times to keep vms up09:41
mariosgfidente: ok, so the migrate/failover is automated (so not the same as compute migration needing operator input) so we can automate the ceph upgrade as long as it is batch 109:41
mariosgfidente: do you alsready have a review out for the ceph upgrade_tasks?09:41
gfidenteack09:41
gfidenteshardy did mon/osd I added rgw09:41
mariosgfidente: cool add me on review please if you didn't already09:42
gfidenteand that is all we had in newton , I think mcornea tested it too09:42
*** shardy has quit IRC09:42
gfidentemarios ack, thanks09:42
*** shardy has joined #tripleo09:42
* shardy has flaky network today09:42
*** karimb has joined #tripleo09:43
openstackgerritLuke Hinds proposed openstack/puppet-tripleo: Add AuditD Profile  https://review.openstack.org/42187209:43
*** karimb has quit IRC09:43
*** salmankhan has joined #tripleo09:46
*** tosky has joined #tripleo09:47
sshnaidmpanda, did you look at periodic jobs today?09:49
pandasshnaidm: they're all failing09:51
sshnaidmpanda, nevermind, found a bug of bulding images09:51
pandasshnaidm: working with bandini on the error shown by ooolpbot09:51
pandasshnaidm: then I'll check for newton and mitaka, which are failing for different errors09:52
sshnaidmpanda, this ironic unbound variable, right?09:52
sshnaidmhttps://bugs.launchpad.net/tripleo/+bug/165949309:52
openstackLaunchpad bug 1659493 in tripleo "IRONIC_AGENT_MULTIPATH_DRIVERS is undefined during IPA image build" [Critical,In progress] - Assigned to Michele Baldessari (michele)09:52
*** karimb has joined #tripleo09:52
*** jpena is now known as jpena|off09:53
pandasshnaidm: yes09:55
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Use transport_url for rabbitmq connection parameters in heat  https://review.openstack.org/41033309:58
*** noama has joined #tripleo09:59
*** jpena|off is now known as jpena10:00
*** paramite has joined #tripleo10:02
*** paramite_ has joined #tripleo10:02
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements: Set IRONIC_AGENT_MULTIPATH_DRIVERS to '' when undefined  https://review.openstack.org/42556510:05
yolandabandini, i amended the patch, it actually was my fault10:05
yolandai forgot to add the environment.d directory on my initial commit10:05
yolandai had it on my change but didn't add to git :(10:05
*** sshnaidm is now known as sshnaidm|afk10:06
pandaI imagined something like this ... :)10:06
pandathe lack of default was too evident not have been considered10:06
bandiniyolanda: ah that explains it ;)10:07
yolandapanda, what's worse, to don't consider that, or to forget to add to the commit?10:07
yolandasorry to break things :(10:07
pandayolanda: git is a procedural mistake, and those happen, I think the other is worse10:08
pandayolanda: we were reasoning about the usefulness of the empty dracut command10:08
bandiniyolanda: no worries and thanks for the quick fix ;)10:08
pandayolanda: that just builds a ramdisk without doing anything at all10:08
pandayolanda: is that needed ?10:08
yolandai didn't want to touch that bit but no, it seems not needed10:09
yolandathis will be noop10:09
pandayolanda: weel it creates and replace any existing ramdisk10:09
pandaso resulting in a noop if a vanilla ramdisk already exists10:09
yolandawell yes, but no need to recreate if we don't need to add anything extra...10:09
*** ooolpbot has joined #tripleo10:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165949310:11
*** ooolpbot has quit IRC10:11
openstackLaunchpad bug 1659493 in tripleo "IRONIC_AGENT_MULTIPATH_DRIVERS is undefined during IPA image build" [Critical,In progress] - Assigned to Yolanda Robla (yolanda.robla)10:11
shardymarios, ccamacho, matbu: Hey can we just land https://review.openstack.org/#/c/424072 and https://review.openstack.org/#/c/414598 ?10:11
shardyI think both have been tested locally (at least by me and marios), and CI is green for both10:11
matbushardy: yes agree +110:12
matbuthis all green :)10:12
ccamachoI tested https://review.openstack.org/#/c/424072 also yesterday10:14
mariosshardy: looking10:14
ccamachomarios voted now10:15
mariosshardy: ack yeah fine by me10:15
shardyOk cool, two less to have in the mega-branch I'm preparing ;)10:16
b00tcatyou guys mentioned before that the CI for Newton is currently broken no?10:16
shardyb00tcat: yeah unfortunately, until https://review.openstack.org/#/c/425343/ lands10:16
*** owalsh-afk is now known as owalsh10:17
b00tcatshardy: ok np, I was wondering because of a weird -1 that I got from Jenkins, thanks10:17
*** abregman is now known as abregman|afk10:19
* matbu brb10:23
*** yolanda has quit IRC10:23
shardymarios, ccamacho, gfidente: How about also landing https://review.openstack.org/#/c/423160/ https://review.openstack.org/#/c/423182/ https://review.openstack.org/#/c/423350 and https://review.openstack.org/#/c/423384 https://review.openstack.org/#/c/405248 ?10:24
*** abregman|afk is now known as abregman10:25
shardygfidente: you have a -1 on the ceph-mon patch, but I'd be happy to fix that as a followup if it means we can reduce the size of this branch10:25
shardyeverything else is green and has been well tested locally10:25
*** abregman is now known as abregman|mtg10:25
*** yolanda has joined #tripleo10:26
*** paramite has quit IRC10:26
*** paramite_ has quit IRC10:26
shardyI've been waiting 18 hours for an experimental job to run on https://review.openstack.org/#/c/423383/ so I think we just have to move forward with the CI passes on those10:27
mariosshardy: so i haven't tested or really looked at the ceph-mon/batched stuff yet10:27
mariosshardy: but either way, there *is* no currrent newton->ocata tripleo upgrade, i.e we aren't breaking something10:27
mariosshardy: so sure i thought we already agreed we should just land and fix10:27
mariosshardy: if we need whatever10:28
shardymarios: Yeah - my feeling is it's functional enough to land with some sanity reviews, then if needed we'll polish it with follow-up patches10:28
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/42462710:28
shardyI just want to make it easier to test the current state, and ideally without a branch containing 20+ patches10:28
shardymarios: yeah, I had been trying to do the "right" thing by getting experimental passes for each service in tripleo-ci patches10:29
shardybut that is taking too long if we want to make the FF deadline10:29
mariosshardy: do you have to combine/merge the batched stuff with the role fragments /me looks at the review a bit10:29
shardymarios: yes, one way or another I have to rebase to reconcile those conflicts10:29
shardyI'd just rather land what's green, then I'll rebase the fragments stuff on master10:30
mariosshardy: so i mean do you want to land this first?10:30
shardyvs rebasing the whole lot onto a new branch10:30
marioshttps://review.openstack.org/#/c/423160/ (this)10:30
shardymarios: yeah, it makes no difference to me what order we land them10:30
* shardy has a bunch of conflicts to deal with either way ;)10:30
mariosshardy: vs https://review.openstack.org/#/c/424905/ I mean10:30
mariosshardy: ack ok, just checking10:30
shardymarios: yeah my preference is to land https://review.openstack.org/#/c/423160/ first10:31
*** karimb has quit IRC10:31
shardyhttps://review.openstack.org/#/c/424905 is more complex, less well tested by me locally, and I'd like to re-test it with owalsh's tripleo-common patch at https://review.openstack.org/#/c/425220/ which I think is better than my patch linked in the Depends-On10:32
shardyso basically I'd be fine to rebase that one, fix the conflicts and re-test10:32
shardythen hopefully we can land it tomorrow10:32
*** apetrich has joined #tripleo10:33
ccamachoshardy I tested https://review.openstack.org/#/c/405248(with the snmp patch) and https://review.openstack.org/#/c/423384 (when checking the skipupgrade tag) Ill vote there, now checking https://review.openstack.org/#/c/423160/10:34
shardyccamacho: Oh yeah, we can probably land the snmp patch too10:36
shardyI rebased that on master10:36
shardyhttps://review.openstack.org/#/c/405250/10:36
shardyit's not tested by the OVB jobs, so I'd say we approve it anyway?10:37
ccamachoshardy do you think is worth to rebase and run the checks again? (for 405250)10:39
ccamachoit should pass10:39
shardyccamacho: personally I don't think it's worth using the OVB bandwidth, because nothing in the OVB jobs touches upgrade_tasks10:40
shardybut it's your call :)10:40
*** abregman|mtg is now known as abregman10:40
ccamachoIt's locally tested so I think will be fine10:40
shardyccamacho: yup, and when CI gets unblocked we can rebase your tripleo-ci patch and prove it in CI10:41
ccamachocool10:41
ccamachodone10:41
shardythanks!10:41
ccamacho***BTW takes hell of a lot of time to test all those patches :)10:42
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui: Fix blank overcloud credentials  https://review.openstack.org/40813810:46
*** sshnaidm|afk is now known as sshnaidm10:47
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates: Add AuditD composable service  https://review.openstack.org/42187310:48
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: Do not use cache ipa image if we're gating tripleo-image-elements  https://review.openstack.org/42562610:49
*** zoli is now known as zoli|lunch10:49
*** karimb has joined #tripleo10:50
*** shardy has quit IRC10:51
*** shardy has joined #tripleo10:52
openstackgerritJulie Pichon proposed openstack/tripleo-ui: Create .pot message file under ./i18n  https://review.openstack.org/42562710:55
sshnaidmTomorrow is final feature freeze, right?10:56
*** dtantsur|afk is now known as dtantsur10:57
*** apetrich has quit IRC10:57
*** yprokule has quit IRC10:59
shardysshnaidm: yes the ocata-3 release will be cut today or tomorrow, then we'll be in feature freeze11:00
shardysshnaidm: I expect there will be a few exceptions given how many features aren't landed, but hopefully less than last cycle11:00
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates: Adds SSH Banner text into sshd_config  https://review.openstack.org/40863811:04
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Support builds in multinode  https://review.openstack.org/42547411:04
openstackgerritOliver Walsh proposed openstack/tripleo-common: Add support for jinja2 includes  https://review.openstack.org/42522011:09
*** ooolpbot has joined #tripleo11:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165949311:11
*** ooolpbot has quit IRC11:11
openstackLaunchpad bug 1659493 in tripleo "IRONIC_AGENT_MULTIPATH_DRIVERS is undefined during IPA image build" [Critical,In progress] - Assigned to Yolanda Robla (yolanda.robla)11:11
*** karimb has quit IRC11:12
*** apetrich has joined #tripleo11:13
*** suuuper has joined #tripleo11:14
*** openstackgerrit has quit IRC11:17
*** akrivoka has joined #tripleo11:20
*** openstackgerrit has joined #tripleo11:23
openstackgerritAlejandro Andreu proposed openstack/tripleo-puppet-elements: Install Curator from RPM in MidoNet element  https://review.openstack.org/42520511:23
*** apetrich has quit IRC11:25
*** karimb has joined #tripleo11:27
*** michapma_alt has quit IRC11:28
*** karimb has quit IRC11:28
*** michapma_alt has joined #tripleo11:29
*** karimb has joined #tripleo11:30
openstackgerritMerged openstack/tripleo-quickstart-extras: Fix node cycle on HA Validation  https://review.openstack.org/42558711:30
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates: Add support for Jinja2 includes  https://review.openstack.org/42563811:32
*** shardy has quit IRC11:32
*** shardy has joined #tripleo11:34
*** cmyster has quit IRC11:34
*** zoli|lunch is now known as zoli11:34
b00tcathey, is this a bug? https://paste.fedoraproject.org/536864/48543042/ if I pass the --tripleo-puppet-elements to "openstack overcloud image build" I expect it to look for the t-p-e in the folder that I specified11:34
b00tcatnot in /usr/bin/../share/diskimage-builder/elements which is the default path :/11:35
shardyb00tcat: yes looking at the code it seems that is broken11:38
shardytry --elements-path11:38
shardyor, here's where it's broken:11:38
openstackgerritMerged openstack/tripleo-heat-templates: Add SkipUpgradeConfigTags for upgrade config  https://review.openstack.org/42407211:38
openstackgerritMerged openstack/tripleo-puppet-elements: Add explicit install of net-snmp  https://review.openstack.org/42534311:39
openstackgerritMerged openstack/tripleo-heat-templates: Add snmp service support for composable upgrades  https://review.openstack.org/40525011:39
shardyhttps://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L32211:40
*** jkilpatr has quit IRC11:40
shardyit only uses the hard-coded path and ignores the variable from the --tripleo-puppet-elements option11:40
b00tcatdamn11:40
shardyb00tcat: all those options are deprecated, so I think you're supposed to specify them in the image yaml file11:40
shardybut it should be easy to either fix that CLI, or use --elements-path instead11:40
b00tcatshardy: ah right, in Ocata there was the YAML11:41
shardythey basically do the same thing AFAICS?11:41
b00tcatexcept for elements-path being a full path with several elems11:41
b00tcatok I'll submit a patch whenever I get a change, thanks!11:41
b00tcatchance*11:41
shardyb00tcat: Ok sounds good, thanks!11:41
*** salmankhan has quit IRC11:42
*** salmankhan has joined #tripleo11:42
*** thrash|g0ne is now known as thrash11:43
shardyccamacho: Hey can you check https://review.openstack.org/#/c/423160/ when you get a moment please?11:44
*** ansmith has joined #tripleo11:44
sshnaidmcores, please approve oooq patch in ci: https://review.openstack.org/#/c/423870/ , thanks11:51
*** jprovazn has quit IRC11:52
*** jprovazn has joined #tripleo11:52
*** yprokule has joined #tripleo11:54
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Ignore systemctl return code in yum_update.sh  https://review.openstack.org/42520911:55
*** jkilpatr has joined #tripleo11:58
EmilienMHello folks11:59
shardyHey EmilienM11:59
sshnaidmEmilienM, hi12:00
*** ansmith has quit IRC12:01
shardyEmilienM: hey when you get time, can you please check this series https://review.openstack.org/#/c/423160/12:01
*** jpena is now known as jpena|lunch12:01
shardywe had a discussion earlier and agreed to try and land some of these to enable easier local testing12:01
*** fultonj has joined #tripleo12:02
shardyI had been waiting on experimental job passes on tripleo-ci, but the CI is so busy I don't think we can wait12:02
shardythe experimental jobs just never run12:02
shardyci on those patches is all green until the telemetry one, so I'd say we land the first 5 patches12:02
shardyand I'll re-test the telemetry patch locally12:02
shardyand rebase the various other upgrades patches we have outstanding (some of which conflict with this series)12:03
*** liverpooler has quit IRC12:03
*** bkopilov has quit IRC12:05
pandathe experimental-tripleo queue may take up to 14 hours to launch a job12:06
shardypanda: yeah, I can't keep waiting that long for every patch, when we have like 10 services still to land12:06
ccamachoshardy finished checking https://review.openstack.org/#/c/423160/12:07
*** jkilpatr has quit IRC12:07
ccamachoThat one I haven't tested it locally but LGTM12:07
shardyccamacho: thanks!12:08
shardyccamacho: yeah, I've tested it locally and we've got basic coverage because the upgrades-nv passed12:08
shardywe'll need folks to test the rolling part with multiple nodes, but I guess that can happen later12:08
*** shardy is now known as shardy_lunch12:10
ccamachoshardy as this have higher prio, im deploying a newton OC, Ill start checking https://review.openstack.org/#/c/419886 but ping me please if needed other local checks/reviews12:11
*** ooolpbot has joined #tripleo12:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165938412:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165949312:11
*** ooolpbot has quit IRC12:11
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)12:11
openstackLaunchpad bug 1659493 in tripleo "IRONIC_AGENT_MULTIPATH_DRIVERS is undefined during IPA image build" [Critical,In progress] - Assigned to Yolanda Robla (yolanda.robla)12:11
EmilienMshardy_lunch: sure thing12:11
EmilienMpanda, sshnaidm: do we have clue on why promotion didn't happen?12:12
pandaEmilienM: it's on the alert12:12
pandaremoving alert from, I'm still seeing on newton an mitaka periodic, but not eslewhere https://bugs.launchpad.net/tripleo/+bug/165938412:12
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)12:12
EmilienMthis one? https://bugs.launchpad.net/tripleo/+bug/165938412:13
pandamaybe just a package delay12:13
EmilienMyeah12:13
pandaEmilienM: no, the other12:13
EmilienMbnemec fixed it :/12:13
EmilienMah12:13
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/165949312:13
openstackLaunchpad bug 1659493 in tripleo "IRONIC_AGENT_MULTIPATH_DRIVERS is undefined during IPA image build" [Critical,In progress] - Assigned to Yolanda Robla (yolanda.robla)12:13
pandaEmilienM: yes12:13
pandaEmilienM: this is the fix https://review.openstack.org/425565 and this should activate ipa image building on the gate for tripleo-image-elements https://review.openstack.org/42562612:14
pandaso it will not slip through the gates again12:14
EmilienMpanda: ok +A on the fix12:14
EmilienMpanda: +2 on the ooo-ci12:14
EmilienMI'll see how ovb works again with this patch ^12:15
*** karimb has quit IRC12:16
EmilienMshardy_lunch: patch approved, reviewing telemetry now12:16
*** anshul has joined #tripleo12:17
*** karimb has joined #tripleo12:19
*** tremble has left #tripleo12:19
*** jkilpatr has joined #tripleo12:20
*** cmyster has joined #tripleo12:23
*** ramishra_ has quit IRC12:24
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add Ceph RBD mirror Pacemaker profile  https://review.openstack.org/40703912:24
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add Ceph RBD mirror Pacemaker profile  https://review.openstack.org/40703912:24
thrashEmilienM: for tripleo-common... release notes since... 5.7.0? Newton?12:25
EmilienMthrash: since last tag, in december would be enough12:26
thrashEmilienM: ack.12:26
EmilienMthx12:26
EmilienMthrash, d0ugal, jpich, Ng: beside https://review.openstack.org/#/c/417898/ - do you know any other thing we want in triploeclient before I push on the release button?12:27
thrashEmilienM: https://review.openstack.org/#/c/419506/ on down12:28
thrashhttps://review.openstack.org/#/c/418507/512:28
thrashbut they depend on: https://review.openstack.org/#/c/416284/12:28
NgEmilienM: nothing else from me beside the one you linked12:28
thrashEmilienM: I'll add release note to that last one real quick.12:29
jpichEmilienM: I think https://review.openstack.org/#/c/414447/ was just about ready, I can add the release note in a separate patch today12:29
EmilienMthrash: doing recheck on https://review.openstack.org/#/c/416284/ to see OVB12:29
thrashEmilienM: let me add the relno. :)12:29
EmilienMthrash: ack on both12:30
EmilienMjpich: ack, thanks12:31
EmilienMjpich: removing -1 then, and approving12:31
d0ugalEmilienM: I don't have anything other than ^12:31
EmilienMthanks folks12:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Do not try to update the 'ceph' metapackage from CephMon role  https://review.openstack.org/42565912:32
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Support builds in multinode  https://review.openstack.org/42547412:33
*** pkovar has joined #tripleo12:33
*** ccamacho is now known as ccamacho|mcdnlds12:34
jpichEmilienM: Thanks!12:34
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso  https://review.openstack.org/42244812:34
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Add support for calling validations in deploy and introspect workflows  https://review.openstack.org/41628412:34
thrashEmilienM: I assume we can add some kind of bot that will -1 a patch if it doesn't include a release note from now on?12:35
thrashIf one doesn't already exist. :)12:35
EmilienMthrash: ah! I'm not aware of any bot like this, though I would rather rely on humain reviews for that :-)12:36
EmilienMnot every patch deserves a release note (eg: quick fix within a cycle)12:36
thrashEmilienM: Hmmm... Could include a way to signify that in the commit? Release-Note-Required: False12:37
thrash:D12:37
thrashjust spitballing.12:38
d0ugallol, that would drive people mad :)12:39
EmilienMthrash: it's already hard to teach folks how to make release notes12:39
d0ugalthrash: we should also require a bug or blueprint :)12:39
thrashd0ugal: I hate you.12:39
*** karimb has quit IRC12:39
d0ugallol12:39
thrash>_<12:39
d0ugalbut if the review references a bug it probably needs a release note...12:40
d0ugalbut that might just stop people referencing bugs :-D12:40
thrashd0ugal: ooh... That's a good one...12:40
thrashLook, I am *king* of hating to do this kind of thing... But it's not *that* bad.12:41
d0ugallol12:41
Ngd0ugal: thrash: https://review.openstack.org/#/c/422321/ is full CI green now, just needs one of its earlier +2s restored :)12:43
d0ugalDone!12:44
gfidentemarios shardy_lunch I remember you were talking about a global check of the status before starting upgrade?12:44
Ngd0ugal: thanks!12:44
*** apetrich has joined #tripleo12:45
EmilienMthrash: right, doing a note takes 1 min or 2 max12:45
mariosgfidente: hey man12:47
mariosgfidente: i just left a comment on your review https://review.openstack.org/#/c/423360/312:47
d0ugalIt'd be nice if we could include the note in the commit message or something, seems like you end up duplicating it.12:47
mariosgfidente: it points at the step0,validation i think you are referring to that12:48
*** ramishra has joined #tripleo12:48
gfidentemarios ah cool I can add that yes12:48
gfidenteso I wonder12:48
*** chem has joined #tripleo12:48
gfidenteI could add the same for the monitors too right?12:48
mariosgfidente: yes please12:49
gfidentecool12:49
*** apetrich has quit IRC12:50
*** apetrich has joined #tripleo12:50
*** dprince has joined #tripleo12:51
*** lucasagomes is now known as lucas-hungry12:52
*** egafford has joined #tripleo12:52
*** hjensas has joined #tripleo12:54
*** hjensas has joined #tripleo12:54
*** tosky has quit IRC12:54
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Ensure Aodh uses its own mysql db  https://review.openstack.org/42495012:56
*** pradk has joined #tripleo12:56
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Do not try to update the 'ceph' metapackage from CephMon role  https://review.openstack.org/42565912:57
openstackgerritOpenStack Proposal Bot proposed openstack/os-refresh-config: Updated from global requirements  https://review.openstack.org/42092412:57
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add upgrade support for CephRGW service  https://review.openstack.org/42336012:59
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add upgrade support for CephRGW service  https://review.openstack.org/42336013:00
*** jpena|lunch is now known as jpena13:00
openstackgerritMerged openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades  https://review.openstack.org/42316013:02
*** shardy_lunch is now known as shardy13:04
*** ealcaniz has quit IRC13:05
*** adarazs is now known as adarazs_lunch13:07
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Add release notes since 5.7.0  https://review.openstack.org/42567713:08
*** bfournie has quit IRC13:08
EmilienMthrash: ♥13:10
EmilienMI'll send ♥ to everyone doing release notes13:10
*** jayg|g0n3 is now known as jayg13:10
*** ooolpbot has joined #tripleo13:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/165949313:11
*** ooolpbot has quit IRC13:11
openstackLaunchpad bug 1659493 in tripleo "IRONIC_AGENT_MULTIPATH_DRIVERS is undefined during IPA image build" [Critical,In progress] - Assigned to Yolanda Robla (yolanda.robla)13:11
dtantsurEmilienM, where is my ♥ then? :(13:15
EmilienMdtantsur: dude, I sent ♥ to you every day on private13:16
*** lucas-hungry is now known as lucasagomes13:16
dtantsurthanks <313:16
dtantsur:)13:16
bandiniEmilienM: do you prefer me piggy-backing existing reviews for tht/puppet-tripleo release notes or simply a separate one using reno?13:17
*** lblanchard has joined #tripleo13:19
*** trown|outtypewww is now known as trown13:19
*** karimb has joined #tripleo13:20
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: Release note for disabling password generation  https://review.openstack.org/42568513:21
*** owalsh is now known as owalsh-brb13:21
EmilienMbandini: in general, I just ask in the review if we can add the note. If it has +2 already I don't block on it and ask for a top patch. If CI doesn't pass or already has negative review, I ask for a release note13:21
EmilienMbandini: in a few months, when folks are used to reno, I would -1 even if +2 already13:22
EmilienMbandini: smooth transition :)13:22
*** fultonj has quit IRC13:23
bandiniEmilienM: ack. and for stuff that already landed without a release note? Just create a separate release note or do we have some "mega-release-note" reviews in flight already?13:23
EmilienMbandini: +1 for separate13:24
*** fultonj has joined #tripleo13:24
bandiniEmilienM: ack. will get to it today for my stuff13:24
EmilienMthx13:24
*** owalsh-brb has quit IRC13:26
openstackgerritDan Radez proposed openstack/puppet-tripleo: Adding congress service  https://review.openstack.org/41388113:26
EmilienMmatbu, marios, shardy: so prior to start moving upgrade job to scenarios, like I said I would do, I would need one first thing: move test-environments/multinode_major_upgrade.yaml into THT so we can version it. It takes 2 simple patches to do it, and should be very helpful for us so we can version the files between cycles. Can I do it now?13:27
*** ansmith has joined #tripleo13:28
matbuEmilienM: yes sure13:28
matbuEmilienM: do you want to do it ?13:28
EmilienMand I can do it in a way that doesn't break you13:28
EmilienMmatbu: yes, I already have the patches ready13:28
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add release note for composable upgrades  https://review.openstack.org/42568913:29
matbuEmilienM: ack nice13:29
mariosEmilienM: ack13:29
*** zoli is now known as zoli|brb13:29
mariosEmilienM: where should i vote (review?)13:29
*** owalsh-brb has joined #tripleo13:29
*** owalsh-brb is now known as owalsh13:29
trownmatbu: for the quickstart upgrades work, can we create some job that actually tests it? That has been the barrier for reviewing it for me13:30
EmilienMmarios: i'll let you know in a few13:30
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: ci: import multinode_major_upgrade.yaml from tripleo-ci  https://review.openstack.org/42569013:31
trownmatbu: I know I could manually test it myself, but then if we merge it there is nothing to stop it from being immediately broken by something13:31
shardywe could add it to the tht experimental pipeline and prove we get the same results as the current upgrades job13:31
trownya, experimental would be a good start13:31
trownmatbu: also, is it requiring OVB, or can we make it work via the multinode job we have?13:32
openstackgerritMerged openstack/tripleo-image-elements: Set IRONIC_AGENT_MULTIPATH_DRIVERS to '' when undefined  https://review.openstack.org/42556513:32
openstackgerritMerged openstack/tripleo-heat-templates: Add upgrade support for ceph-mon service  https://review.openstack.org/42318213:33
*** dsariel has joined #tripleo13:33
openstackgerritMerged openstack/tripleo-heat-templates: Add upgrade support for ceph OSD service  https://review.openstack.org/42335013:33
trownif it is multinode, we could also put it in the check queue for quickstart/extras right away13:33
openstackgerritMerged openstack/tripleo-heat-templates: Skip upgrade steps where no tasks are defined  https://review.openstack.org/42338413:33
openstackgerritMerged openstack/tripleo-heat-templates: Add ironic service support for composable upgrades  https://review.openstack.org/40524813:33
openstackgerritMerged openstack/tripleo-ui: Add pattern option to po2json call  https://review.openstack.org/42421913:33
openstackgerritMerged openstack/tripleo-ui: Create .pot message file under ./i18n  https://review.openstack.org/42562713:33
openstackgerritMerged openstack/puppet-tripleo: [keepalived] fix netmask for vip  https://review.openstack.org/41857713:33
*** mhenkel has joined #tripleo13:34
matbutrown: hmm idk if it could work on multinode13:34
trownmatbu: why not? seems like upgrades are entirely post deploy operation, which does not require nova/ironic13:35
matbutrown: the fastest thing i can do, is to put a job on ci.centos13:36
openstackgerritSven Anderson proposed openstack/instack-undercloud: Add a pre-upgrade online_data_migration step for undercloud  https://review.openstack.org/42532313:36
matbutrown: i have a job that run internally13:36
matbutrown: where i tested the reviews13:36
shardyThe current upgrades job works on multinode, so this has to work on multinode if we're ever going to replace the current job with this one?13:37
trownmatbu: ci.centos is a non-starter unfortunately... we already have jobs failing there because we exhaust the inventory... maybe rlandy could help you setup an internal job that reports on quickstart/extras patches via third-party ... we already have one such job running on quickstart/extras patches13:37
shardyIMO we don't want any new jobs running on OVB13:37
*** tosky has joined #tripleo13:37
trown+113:37
matbushardy: right13:37
trownI would say new OVB jobs would be ok if they actually required testing nova/ironic... like scale or the like13:38
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move multinode_major_upgrade.yaml to THT  https://review.openstack.org/42569413:38
trownbut for things that do not actually require any nova/ironic interaction we should be using deployed server13:38
EmilienMmatbu, marios, shardy: https://review.openstack.org/#/q/topic:upgrade/move13:38
matbutrown: shardy but tbh, i don't know how should I set a job on mutlinode right now13:38
shardytrown: Yeah, I guess I meant we already have OK coverage of the deployment pieces, so we should be building out breadth of coverage via multinode jobs13:38
*** sdake has joined #tripleo13:38
shardywhich are much faster and more reliable13:38
*** bfournie has joined #tripleo13:39
shardyI thought multinode support was getting added to quickstart?13:39
trownit is already there13:39
shardyIf we can't be building on that then I don't get why we're spending time on this now13:39
matbuEmilienM: thanks (i'll review in a minute)13:39
trownwe have a simple job running on all tripleo-ci/quickstart/extras patches13:40
EmilienMmatbu: not urgent :D13:40
shardywe have an upgrades job, eventually we'll want to switch it to quickstart13:40
shardybut now we've got a massive amount of work to get upgrades finished for the release13:40
shardyI don't get why this is happening now at all tbh13:40
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Do not try to update the 'ceph' metapackage from CephMon role  https://review.openstack.org/42565913:40
trownsame... I am mostly responding to being called out on the ML for being slow to review13:41
*** rlandy has joined #tripleo13:41
openstackgerritDmitry Tantsur proposed openstack/diskimage-builder: Try configuring iBFT devices in dhcp-all-interfaces  https://review.openstack.org/39178713:41
*** eck` is now known as jeckersb_gone13:41
matbushardy: yep right, I raise this on ML because it's pending for a while and also because i think all the DFGs is starting to be interesting on being able to work on upgrade on their component13:41
trownreviewing a new major CI feature with no CI on the patches though is always going to be a tough sell though... same happened with containers13:42
openstackgerritMerged openstack/python-tripleoclient: Provide an option to disable password generation on deployment  https://review.openstack.org/41444713:42
openstackgerritMerged openstack/puppet-tripleo: Ensure basic Ceph configuration is performed by RBD mirror  https://review.openstack.org/42523613:42
matbutrown: CI on CI :) we have CI on the patch13:42
trownmatbu: CI to say your patch doesnt break anything... not that it works13:42
matbushardy: so yes, it's may not be the real good time now, but i didn't required extra time on that13:43
*** rbrady-afk is now known as rbrady13:43
matbus/i/it/13:43
shardymatbu: sure, I'm not saying it won't be helpful, but seriously - look at the backlog of patches to make upgrades work13:44
matbushardy: so it's more for end user experience with upgrade than CI releated stuff13:44
shardyfeature freeze is tomorrow13:44
matbushardy: ye right13:44
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: WIP Add build-images role  https://review.openstack.org/41433613:45
*** bkopilov has joined #tripleo13:45
mariosshardy: can we test https://review.openstack.org/#/c/424905/ with https://review.openstack.org/#/c/425220/ as-is or should we use https://review.openstack.org/#/c/425086/ for now?13:46
trownmatbu: ya, helping out with quickstart upgrades worked was brought up on our CI meeting too, and I had the same question there about priority... personally I think tripleo would benefit more from making quickstart based basic jobs rock solid so we have confidence to switch in early pike, then work on switching upgrade job over to quickstart based at that point should be much easier13:47
*** hewbrocca_afk is now known as hewbrocca13:48
EmilienMshardy: I commented on your reno for upgrades13:48
trownmatbu: which has the added benefit of not distracting from existing working upgrades job13:48
trownmatbu: in any case, I am not merging a giant feature to quickstart without CI running for it on all quickstart/extras patches... it will be broken very quickly without that13:50
*** hewbrocca is now known as hewbrocca_afk13:50
*** hewbrocca_afk is now known as hewbrocca13:51
openstackgerritMerged openstack/tripleo-common: Add action for generating fencing parameters.  https://review.openstack.org/42232113:51
matbuEmilienM: im wondering here: https://review.openstack.org/#/c/425694 does the tht package is already installed at this stage ?13:52
matbutrown: k so can you answer to the email on ML plz?13:52
trownmatbu: sure13:53
*** ccamacho|mcdnlds is now known as ccamacho13:53
trownmatbu: you responded to another thread so it shows up a bit weird in my email client by the way... but no bigs13:53
EmilienMmatbu: so when the THT will land, RDO needs ~30 min to package it. That's why I have this conditional in tripleo-ci, to rely on old file is package not built yet13:54
EmilienMmatbu: make sense?13:54
matbuEmilienM: hmm,  this is not what i'm asking :D i just wonder if the tht package is already installed on the file system at this stage ( i thought it would be install during the UC installation)13:56
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Add developer docs  https://review.openstack.org/42100013:56
*** zoli|brb is now known as zoli13:56
*** amoralej is now known as amoralej|lunch13:57
EmilienMmatbu: ahhh good question13:58
EmilienMmatbu: yes I think so13:59
*** adarazs_lunch is now known as adarazs14:00
trownlol @ CIFE14:00
trownwe need more acronyms :P14:00
*** ansmith has quit IRC14:01
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates: Add pacemaker composable upgrade steps  https://review.openstack.org/40339714:02
*** crenguta has quit IRC14:02
*** rhallisey has joined #tripleo14:02
*** crenguta has joined #tripleo14:04
openstackgerritOliver Walsh proposed openstack/tripleo-common: Run nova manage cell_v2 discover_host after ironic nodes are registered  https://review.openstack.org/42527314:04
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo: WIP Qpid dispatch router puppet profile  https://review.openstack.org/42571014:04
shardymarios: either works - I've tested with both, but I need to rebase the t-h-t patch14:05
shardydoing that now14:05
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: WIP Qpid dispatch router composable role  https://review.openstack.org/42332614:05
*** Goneri has joined #tripleo14:06
EmilienMtrown: lol sorry14:06
trownhehe I am only teasing... CIFE is fine :)14:07
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Support builds in multinode  https://review.openstack.org/42547414:08
openstackgerritMerged openstack/tripleo-heat-templates: Set the correct default for gnocchi workers  https://review.openstack.org/42534714:09
mariosshardy: k, i went with your original one but i get a Exception updating plan: no loader for this environment specified14:09
mariosshardy: am re-upgrading my undercloud to latest and will patch again with the rebases (lots of stuff happened today, or at least we _+2 lots of stuff not sure it landed all yet)14:10
*** saneax-_-|AFK is now known as saneax14:11
matbumarios: got the same yesterday, but i think we're missing patches14:11
mariosmatbu: ack14:12
*** shardy has quit IRC14:14
matbumarios: i'm fighting against another bug right now14:14
*** ansmith has joined #tripleo14:14
*** shardy has joined #tripleo14:15
mariosshardy: should i rebase https://review.openstack.org/#/c/424905/?14:16
mariosshardy: i want to rebase my one that has that ^ as parent so can do14:16
*** tzumainn has joined #tripleo14:16
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add release note for composable upgrades  https://review.openstack.org/42568914:16
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Add release notes since 5.7.0  https://review.openstack.org/42567714:17
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: Adding Tacker Support  https://review.openstack.org/42413514:17
shardymarios: it's not a clean rebase, I'm doing it now14:18
mariosshardy: ack thanks, no it is not. meld is flashing all sorts of colors14:18
shardyYeah I expected it to be tricky - I'll do a quick rework by eye, then we can test it14:19
shardyideally I wanted to rebased, test, push14:19
NgEmilienM: https://review.openstack.org/#/c/417898/ just finished CI, so it just needs a +A and the gate job to run :)14:19
shardybut I don't want to hold you up :)14:19
*** jeckersb_gone is now known as eck`14:19
mariosheh you're definitely not holding anyone up shardy srsly14:20
EmilienMNg: done, good work here14:21
*** absubram has joined #tripleo14:22
NgEmilienM: much appreciated!14:22
*** amoralej|lunch is now known as amoralej14:22
matbumarios: perhaps his own machine which is crying for having time to rest :)14:22
EmilienMd0ugal, if you can review https://review.openstack.org/#/c/416284/10 please it passed well on https://review.openstack.org/#/c/418507/14:23
EmilienMthrash: should we recheck on https://review.openstack.org/#/c/419506 or CI failure is legit?14:24
*** jcoufal has joined #tripleo14:24
thrashEmilienM: looking14:24
thrashEmilienM: just did a recheck14:25
EmilienMthrash: your 2 client patches are the remaining ones before releasing14:25
EmilienMthrash: can you review https://review.openstack.org/#/c/425685/ please?14:26
*** absubram_ has joined #tripleo14:26
*** absubram has quit IRC14:27
*** absubram_ is now known as absubram14:27
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Disable puppet on upgrade for roles not upgrading  https://review.openstack.org/42490514:27
openstackgerritMichael  Henkel proposed openstack/tripleo-heat-templates: Re-organizes Contrail services to the correct roles  https://review.openstack.org/42571714:27
shardymarios: ^^ wasn't too bad actually but that's untested14:27
shardymarios: I think I can simplify it a little bit by assigning the list of enabled roles to a variable14:28
shardyI made it depend on owalsh's patch as I tested that earlier and it works well14:28
*** jmelvin has joined #tripleo14:29
*** liverpooler has joined #tripleo14:30
EmilienMshardy: would I need to backport https://review.openstack.org/#/c/425690/ into newton? I'm not sure14:30
*** salmankhan has quit IRC14:32
shardyEmilienM: No that only works for CI on patches landing to ocata14:35
shardywe install newton, then upgrade to ocata14:35
shardyno older releases are currently supported by that job14:35
*** shardy has quit IRC14:35
*** suuuper has quit IRC14:39
cmysterquick question, is panko package thing resolved ?14:39
openstackgerritAna Krivokapic proposed openstack/tripleo-common: Add utility functions for deleting/emptying swift containers  https://review.openstack.org/40931514:41
EmilienMmatbu, marios, bkero: FYI https://review.openstack.org/42572714:41
EmilienMcmyster: which issue?14:41
*** suuuper has joined #tripleo14:42
cmysterEmilienM: there was a packaging issue with panko, can't install some package because panko was outdated14:45
cmyster1-2 days ago ?14:45
cmysterI can't seem to find it14:46
EmilienMcmyster: afik all looks ok now14:48
cmysterEmilienM: no big deal, I just found something similar downstream and I think its the same issue as that issue14:48
cmysterbut again, no big deal14:48
EmilienMcmyster: pank::mysql thing?14:48
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: WIP Qpid dispatch router composable role  https://review.openstack.org/42332614:48
cmystercould be :)14:48
cmystersounds familiar14:48
EmilienMcmyster: yeah it's a bad downstream build14:48
cmysterright ok14:49
EmilienMbut not related to upstream14:49
cmysterok, just wanted to make sure14:49
*** cdearborn has joined #tripleo14:50
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud: Fix ironic-related deprecations  https://review.openstack.org/42573614:51
EmilienMpanda: have you checked why mitaka/newton job failed on https://review.openstack.org/#/c/425626/ ?14:51
pandaEmilienM: yes, it's the snmp bug14:54
EmilienMpanda: ack, cool14:54
bkeroEmilienM: hey, scenario upgrades :)14:55
EmilienMbkero: yes. I'm preparing it and hopefully transition to oooq will be smooth14:55
EmilienMbkero: since we'll have the templates & jobs in place14:55
EmilienMbkero: it will be "easy" to make the transition i think14:55
bkeroEmilienM: oooq should be unobtrusive14:55
EmilienMcool14:55
openstackgerritTim Rozet proposed openstack/puppet-tripleo: Enables OpenDaylight Clustering in HA deployments  https://review.openstack.org/42538314:56
*** jrist has quit IRC14:56
openstackgerritMerged openstack/python-tripleoclient: Use the overcloudrc generated in a Mistral action  https://review.openstack.org/41027214:56
*** owalsh is now known as owalsh-afk14:58
adarazsfor anyone interested, TripleO CI squad meeting in 30 minutes, add agenda items at https://etherpad.openstack.org/p/tripleo-ci-squad-meeting (ping for EmilienM, rbrady, trown, sshnaidm, weshay, hrybacki, panda, rlandy, bkero)15:00
hrybackiack adarazs15:00
rbradythanks adarazs15:00
*** hjensas has quit IRC15:01
openstackgerritMerged openstack/python-tripleoclient: Replace yaml.load() with yaml.safe_load()  https://review.openstack.org/42058915:01
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker nova services  https://review.openstack.org/42092115:05
bkeroEmilienM: I'll get to it after I get the scenarios implemented :)15:05
bkerothe job for that just got +2W'd15:05
bkeroso I can get onto implementing it now15:06
*** absubram has quit IRC15:06
*** crenguta has quit IRC15:06
thrashEmilienM: https://review.openstack.org/#/c/416284/ is hitting the ironic agent image problem I believe.15:07
thrashEmilienM: definitely unrelated to my patch15:07
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker mistral services  https://review.openstack.org/42574415:08
*** adarazs is now known as bug15:09
*** bug is now known as adarazs15:09
*** jrist has joined #tripleo15:09
*** jrist has quit IRC15:09
*** jrist has joined #tripleo15:09
EmilienMbkero: which patch?15:10
EmilienMthrash: good to know15:10
bkeroEmilienM: the one you +1'd. https://review.openstack.org/#/c/424034/15:10
openstackgerritAna Krivokapic proposed openstack/python-tripleoclient: Don't create swift container if plan creation fails  https://review.openstack.org/40935015:11
EmilienMthrash: since https://review.openstack.org/#/c/425565/ merged, should we recheck?15:11
EmilienMto make sure we don't break15:11
EmilienMthrash: I saw ovb passing 2 days ago on this patch but since you change the code a little15:12
EmilienMI would recheck, in case15:12
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Enable docker services in the registry  https://review.openstack.org/42156715:13
*** bala has joined #tripleo15:13
*** salmankhan has joined #tripleo15:18
thrashEmilienM: it's got a recheck pending it looks like.15:19
EmilienMok15:20
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add release notes for Manila/CephFS with managed Ceph  https://review.openstack.org/42574715:20
thrashEmilienM: ovb jobs are currently queued15:20
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps  https://review.openstack.org/41988615:22
EmilienMthrash: ok15:22
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Ubuntu: Do not fail the GRUB2 package is already configured  https://review.openstack.org/42575015:26
*** cylopez has quit IRC15:27
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Ubuntu: Do not fail if the GRUB2 package is already configured  https://review.openstack.org/42575015:28
*** eck` is now known as jeckersb_gone15:28
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Support builds in multinode  https://review.openstack.org/42547415:28
dtrainorhi bandini, here's a ci failure i'm looking at http://logs.openstack.org/03/424903/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bb0b56b/console.html15:29
*** owalsh-afk is now known as owalsh15:30
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo: Contrail services assigned to wrong roles  https://review.openstack.org/42575215:30
*** apetrich has quit IRC15:30
bandinidtrainor: looking, sec15:30
*** jeckersb_gone is now known as eck`15:31
bandinidtrainor: that is https://bugs.launchpad.net/tripleo/+bug/165938415:31
openstackLaunchpad bug 1659384 in tripleo "All ovb jobs failing to set up snmp" [Critical,In progress] - Assigned to Ben Nemec (bnemec)15:31
*** jaosorior has joined #tripleo15:31
openstackgerritMerged openstack/tripleo-quickstart-extras: Fixing setuptools version  https://review.openstack.org/42509715:31
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Remove rdo-qemu-ev workaround  https://review.openstack.org/42575315:32
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Drop ceph workaround for mitaka  https://review.openstack.org/42575415:32
bnemecEmilienM: Do we actually expect the ocata ovb job to pass at this point?15:32
jaosoriorbeagles, EmilienM can you re-check this https://review.openstack.org/#/c/407898/ ? I had to rebase cause of a merge conflict15:32
EmilienMbnemec: I don't know15:36
EmilienMbnemec: we'll figure out later today15:36
EmilienMjaosorior: done, approved.15:37
bnemecEmilienM: Okay, it's just that we're up to 10 jobs per tripleo-ci patch now.15:37
EmilienMbnemec: right, this time window until we have stable/ocata was expected, since infra merged my patch this morning15:38
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud: Allow enabling node auto-discovery on the undercloud  https://review.openstack.org/42326515:40
*** yamahata has joined #tripleo15:44
jaosoriormwhahaha, EmilienM: Is there a way I can set a default for "define" resource in puppet via hiera?15:44
pradkcan someone +A this https://review.openstack.org/#/c/424950/15:44
*** karimb has quit IRC15:44
*** tosky has quit IRC15:45
pradkty jaosorior15:45
mwhahahajaosorior: yea I think it'll look up from heira15:45
jaosoriormwhahaha: thought that was for classes and includes,  but not defines15:45
EmilienMyeah, you can't use define from hiera out of the box15:46
EmilienMit require a hiera plugin that we don't have in tripleo AFIK15:46
mwhahahaI thought I saw it in my debug logs, would have to double check15:46
mwhahahaGimme a few and I'll look into it15:46
*** shardy has joined #tripleo15:46
EmilienMyou could use something like https://github.com/puppetlabs/puppetlabs-create_resources but it's old and tbh I never tried it15:47
openstackgerritMerged openstack/python-tripleoclient: Add overcloud_parameters.GenerateFencingParameters.  https://review.openstack.org/41789815:47
openstackgerritMerged openstack/python-tripleoclient: Release note for disabling password generation  https://review.openstack.org/42568515:47
openstackgerritMerged openstack/tripleo-heat-templates: Ignore systemctl return code in yum_update.sh  https://review.openstack.org/42520915:47
*** openstackgerrit has quit IRC15:48
jaosoriormwhahaha, EmilienM: well, for all users we create for MySQL (which is pretty much for all services) I want to set this parameter https://github.com/openstack/puppet-openstacklib/blob/master/manifests/db/mysql.pp#L6415:49
jaosoriormwhahaha, EmilienM which I tried here https://review.openstack.org/#/c/425292/1/puppet/services/database/mysql-internal-tls-certmonger.yaml but I don't think that actually worked15:50
EmilienMjaosorior: you'll need to patch https://github.com/openstack/puppet-nova/blob/master/manifests/db/mysql.pp#L40 I think15:50
EmilienMand all modules15:50
EmilienMno it won't work15:50
EmilienMI mean: https://review.openstack.org/#/c/425292/1/puppet/services/database/mysql-internal-tls-certmonger.yaml15:50
owalshshardy: are we still running the final converge for upgrades?15:51
jaosoriordammit15:52
jaosoriorEmilienM: isn't there an easier way than patching all modules?15:52
jaosoriorthat doesn't scale very well :/15:52
*** karimb has joined #tripleo15:52
jaosoriorEmilienM: what if I set the default for the resource on the step_config:15:53
shardyowalsh: Right now no, but we'll need some way to avoid the upgrade tasks running on any subsequent update, which may involve a final stack update (unless we pass a flag in which differentiates an upgrade from any other update)15:53
shardyowalsh: we won't rely on the converge to apply puppet anymore tho, as we'll apply it as part of the upgrade, after the ansible steps15:53
*** tosky has joined #tripleo15:54
*** openstackgerrit has joined #tripleo15:55
openstackgerritMerged openstack/tripleo-puppet-elements: Change upstream URL for puppet-contrail  https://review.openstack.org/42487215:55
openstackgerritMerged openstack/tripleo-heat-templates: Fix for AllNodesExtraConfig and fix environment files to create swap files/partitions  https://review.openstack.org/42407915:55
owalshshardy: I just realised nova needs a SIGHUP after the upgrade when the version is pinned to auto15:55
shardyowalsh: Ok, could that happen every time puppet runs, or only after the upgrade is completed?15:56
EmilienMjaosorior: I know :-/ let me think a bit more (maybe mwhahaha also has a better idea)15:56
openstackgerritMerged openstack/tripleo-common: Remove remaining vendor plugins from default image YAML  https://review.openstack.org/42415215:56
shardyowalsh: we'll run puppet once after the upgrade on the controllers, then again everywhere during the "converge"15:56
shardyalthough the converge will just re-assert the existing state, and not change anything (in theory)15:56
owalshshardy: we could remove the auto version pin15:57
shardyand rewrite the environemt to disable the upgrade steps15:57
openstackgerritAlejandro Andreu proposed openstack/tripleo-puppet-elements: Install Curator from RPM in MidoNet element  https://review.openstack.org/42520515:57
shardyowalsh: Ok, so it's not really auto, it does a one-time detection on service reload?15:57
owalshshardy: yes15:57
shardyowalsh: Ok we can revert to the explicit pin approach then I guess15:58
shardyand just do the same as previous releases15:58
jaosoriorEmilienM: what if I write this in the step_config (which ends up at the top of the generated manifest) http://paste.openstack.org/show/596611/  wouldn't that set the default for all the resources of that type created?15:58
owalshshardy: we can stick with auto for upgrade, but default to ''15:59
mwhahahajaosorior: EmilienM: i guess you're right, you can't use hiera to set a default for a param. the other solution would be to switch all the invocations of that resource to an ensure_resource which would take a $defaults that could use a hiera lookup or something15:59
*** iranzo has joined #tripleo15:59
*** yamahata has quit IRC15:59
jaosoriormwhahaha: that would also mean changing most openstack modules :/15:59
fpanshardy: could you take a look at https://review.openstack.org/#/c/422898/ and do a +workflow16:00
mwhahahajaosorior: don't we expose all those via puppet classes?16:00
mwhahahajaosorior: you just don't want to define them all i guess16:00
shardyfpan: sure, done!16:01
fpanshardy: thanks!16:01
jaosoriormwhahaha: I don't want to define them all, and that parameter is exposed only in openstacklib (which gets used by all openstack modules)16:02
jaosoriormwhahaha: I just wanted to set the default there, so all mysql users  (created via that resource) use it16:02
mwhahahajaosorior: yea there's no clean way to do that,16:03
jaosoriormwhahaha, EmilienM would it be acceptable to do a hieracall from openstacklib? https://github.com/openstack/puppet-openstacklib/blob/master/manifests/db/mysql.pp#L6416:03
mwhahahajaosorior: no16:03
mwhahahawe keep hiera out of openstack lib16:03
mwhahahaand all the other modules for that matter16:03
jaosoriormwhahaha: why?16:03
EmilienMs/openstack lib/Puppet OpenStack/16:03
EmilienMbecause Hiera is not a requirement to deploy Puppet OpenStack modules16:04
jaosoriorEmilienM: I was referring to puppet-openstacklib16:04
jaosorioroh, ok16:04
EmilienMjaosorior: a lot of our users don't use hiera16:04
jaosoriorEmilienM: I see (I legitimately didn't know that)16:04
*** yamahata has joined #tripleo16:05
jaosoriorEmilienM, mwhahaha sooo... what about what I said earlier? passing this http://paste.openstack.org/show/596611/ via t-h-t on the step_config16:06
mwhahahajaosorior: I think you want the spaceship operator16:06
jaosoriorah16:07
jaosorioryou're right16:07
EmilienMmwhahaha: you h@cker16:07
jaosoriorwhat I mentioned would also work only with classes and includes16:07
EmilienMmwhahaha: can you do it on a Define? I think I never tried16:08
mwhahahayes16:08
EmilienMcool, yeah do it then, even if it's not the cleanest way ;-)16:08
mwhahahaOpenstacklib::Db::Mysql <||> { tls_options => ['SSL'] }16:08
mwhahahathat's all you need16:08
mwhahahaso if $tls_enabled -^16:08
EmilienMsounds neat & quick for now16:08
mwhahahathen any catalog that has that resource would get updated16:09
jaosoriormwhahaha: that manifest where I would call it would only be defined if tls everywhere is enabled (it's OS::Heat::None by default)16:09
*** salmankhan has quit IRC16:10
*** jrist has quit IRC16:10
jaosoriormwhahaha, EmilienM I'll give it a try16:11
jaosoriorthanks guys16:11
*** ansmith has quit IRC16:12
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add upgrade support for CephRGW service  https://review.openstack.org/42336016:12
* beagles wonders if it is worthwhile combing IRC logs and mine for tidbits like the above16:13
mwhahahayou don't know what you're looking for until you need it :D16:13
*** karimb has quit IRC16:15
beagles:)16:15
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Force MySQL users to use SSL if internal TLS is enabled  https://review.openstack.org/42529216:16
jpichd0ugal: I saw an email about the "requirements" freeze on the dev list, do we need to bump tripleo-common over there to whatever will be our Ocata version? (I'm lost once again in version numbers)16:16
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job with MySQL  https://review.openstack.org/42529516:16
*** ckyriakidou has joined #tripleo16:16
*** salmankhan has joined #tripleo16:16
d0ugald0ugal: hrm, good question. I'm not really sure. EmilienM ?16:17
*** ckyriakidou has quit IRC16:17
jpichd0ugal, EmilienM: Actually it looks like the version at https://github.com/openstack/requirements/blob/master/global-requirements.txt is pretty old already, 5.4 is referenced under Newton? https://releases.openstack.org/newton/index.html#tripleo-common16:18
jpichhttps://github.com/openstack/requirements/blob/master/global-requirements.txt#L28516:18
openstackgerritMarios Andreou proposed openstack/instack-undercloud: Ammend the completion and error message to signal an upgrade  https://review.openstack.org/42577016:18
d0ugaljpich: I guess updating it to the latest makes sense16:18
* d0ugal shrugs16:18
*** abregman has quit IRC16:19
jpichd0ugal: Off the top of your mind, do you know what will be the first version number for Ocata? It feels like that's what we should reference even if it doesn't exist yet (...if that's possible)16:20
*** aufi has quit IRC16:20
jaosoriormwhahaha: ah, so that spaceship operator doesn't need to be in the top level?16:20
mwhahahano it just has to be in the catalog16:20
mwhahahathat's the awesomeness/danger of it16:20
*** jcoufal has quit IRC16:20
*** jrist has joined #tripleo16:21
*** jrist has quit IRC16:21
*** jrist has joined #tripleo16:21
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job (neutron)  https://review.openstack.org/41952916:22
*** ansmith has joined #tripleo16:24
jpichd0ugal: I think ocata is 6.0 but we can't require installing >= something that doesn't exist yet, so... I'll send a requirements update with the latest number I can find and hope for the best I guess16:25
yolandaah trown, thx for review16:27
yolandajust saw it16:27
*** karimb has joined #tripleo16:27
*** jtomasek has quit IRC16:27
d0ugaljpich: latests is 5.7 I think!16:27
d0ugaljpich: and yeah, I think 6.0 is Ocata16:28
jpichd0ugal: Thanks!16:28
EmilienMjpich, d0ugal: good question, tbh since we use RDO packages, we don't really care about this thing. Maybe we should do a better job at updating it?16:29
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: Adding Tacker Support  https://review.openstack.org/42413516:29
mariosbnemec: thanks :)16:29
jaosoriorbeagles: ping16:31
beaglesjaosorior: yo!16:31
jaosoriorbeagles: hey dude; how acquainted are you with the neutron CLI client?16:31
d0ugalEmilienM: our unit tests care about it :)16:31
jpichEmilienM: I suppose. Doing a poor job of it can create all sorts of other issues (e.g. the mess with the Mitaka unit tests atm https://review.openstack.org/#/c/421543/ ). I'll try to pay more attention to it, but I think because we're going to release tripleo-common on the same day/after requirements are frozen on master we'll always be a little bit off16:31
beaglesjaosorior: mmmm... so-so16:32
beaglesjaosorior: what's on the go?16:32
jpichd0ugal, EmilienM: Looks like upper-constraints was automagically updated to the last version at least. I'll need to read more about how that one works :)16:32
*** thrash is now known as thrash|biab16:33
EmilienMjpich, d0ugal: thanks for looking at it :-)16:33
jaosoriorbeagles: so I'm thinking about switching the neutron commands for the openstack unified CLI in the pingtest https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L96516:34
EmilienMthrash|biab: since 416284 is still queued, I propose to land 416284 once we see 419506 passing OVB (419506 is behind the other in zuul)16:34
jaosoriorbeagles: but, for instance, here https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L996 I'm a bit thrown off by the --router:external ... I don't even find that in the regular neutron CLi documentation16:35
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo: fixup  https://review.openstack.org/42577616:35
*** dprince has quit IRC16:37
*** b00tcat has quit IRC16:37
*** jcoufal has joined #tripleo16:37
*** leanderthal has joined #tripleo16:38
beaglesjaosorior: when you see --router:external, it basically means that this network will be routed through the L3 agent to an network external to it..16:42
beaglesjaosorior: I've not used the osc for this, but the --external command line option looks promising16:42
*** yamahata has quit IRC16:42
* beagles needs to take a few minutes and scan the code16:43
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TESTING openstack CLI instead of neutron  https://review.openstack.org/42578216:46
jaosoriortrying it out16:46
*** leanderthal has quit IRC16:47
pradkthis can be merged now https://review.openstack.org/#/c/424746/16:48
*** apetrich has joined #tripleo16:48
*** saneax is now known as saneax-_-|AFK16:52
*** iranzo has quit IRC16:53
bnemecjaosorior: I would really rather not do that right now.  AFAIK the neutron client is not deprecated yet, and every ci patch eats up 10 ovb jobs. :-/16:54
openstackgerritMerged openstack/tripleo-common: Add element to regenerate dracut  https://review.openstack.org/42069816:54
openstackgerritMerged openstack/tripleo-heat-templates: Use versionless keystone endpoint for barbican-related configurations  https://review.openstack.org/40789816:55
*** tesseract has quit IRC16:55
openstackgerritMartin AndrĂ© proposed openstack/tripleo-common: Add missing linebreak in delorean-current.repo  https://review.openstack.org/42578916:55
shardymarios, matbu: can you guys talk and reconcile your two patches delivering upgrade scripts?16:56
shardyhttps://review.openstack.org/#/c/41988616:56
openstackgerritMerged openstack/os-refresh-config: Updated from global requirements  https://review.openstack.org/42092416:56
*** athomas has quit IRC16:56
shardyI commented there, but I think your patches overlap16:56
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds support to create deployment plan from git repository  https://review.openstack.org/41728016:56
jaosoriorbnemec: so, the good thing is that the patch that tests it is on top of my TLS-everywhere testing patches. Those do exit 0 on everything except one job... where I run the actual TLS-everywhere job16:57
EmilienMmwhahaha: can you give a super-quick status on the undercloud-upgrade CI job? (blockers, etc)16:57
jaosoriorfuck16:57
jaosoriorit's not a neutron CLI bug, just realised what I missed16:58
EmilienMmwhahaha: or is everything in https://review.openstack.org/#/c/419121/ should make it pass again16:58
jaosoriorbnemec: anyway... I started thinking about it cause I tried getting neutron with TLS in the internal network16:58
jaosoriorBUT, I think I just realised where I messed up16:58
mwhahahaEmilienM: the job was failing because we don't actually have a compute instance16:58
matbushardy: /me looks16:58
mwhahahaEmilienM: but the patch in nova that removes the requirement when that lands should clear that up16:58
EmilienMmwhahaha: it's likely a bug in nova, then16:58
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds support to create deployment plan from git repository  https://review.openstack.org/41728016:58
EmilienMmwhahaha: https://review.openstack.org/#/c/424243/ ?16:59
*** morazi has quit IRC16:59
mwhahahaEmilienM: well from what I hear they argue that upgrading without any compute nodes doesn't make sense16:59
mwhahahaEmilienM: yea that16:59
matbushardy: btw, is there a reviews (i didn't find one but maybe i missed it) that automaticaly skip the services that are not deployed ?16:59
matbushardy: if not i'll make one in a short16:59
shardymatbu: the service templates aren't included if the services aren't deployed16:59
*** leanderthal has joined #tripleo17:00
EmilienMmwhahaha: ok, let's see when we have a promotion17:00
shardymatbu: basically the composable services interface takes care of it, we only run upgrade_steps for services that are enabled17:00
*** dbecker has quit IRC17:00
*** saneax-_-|AFK is now known as saneax17:00
EmilienMpanda, sshnaidm: what are current blockers for promotion in your knowledge?17:00
matbushardy: hm yep but on my local deployment that's not the cases17:00
shardymatbu: can you provide more details?  Not sure I understand exactly17:00
*** rajinir has joined #tripleo17:01
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Clean TLS proxy-related setup for neutron-server profile  https://review.openstack.org/42532017:01
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Use TLS proxy for neutron server's internal TLS  https://review.openstack.org/42526717:01
matbushardy: the role_data is full of upgrade_tasks with services that is not deployed on my env17:01
EmilienMsshnaidm, panda: oh I see 359215 in zuul, running OVB, that could gives us a promotion (jobs are running now)17:01
shardymatbu: have you deployed with a customized roles_data.yaml, then redeployed?17:01
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Pass parameters for TLS proxy in front of neutron server  https://review.openstack.org/42531717:01
sshnaidmEmilienM, yeah, panda ran them today17:01
EmilienMcool17:01
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job (neutron)  https://review.openstack.org/41952917:02
shardymatbu: there is an open bug where the plan doesn't automatically clean the roles_data17:02
EmilienMsshnaidm: blockers should be 0 at this time, we promoted Puppet CI this morning17:02
shardymatbu: try doing an openstack plan delete overcloud17:02
shardybefore the initial deploy17:02
matbushardy: yep, i provied a custom role_data17:02
*** [1]cdearborn has joined #tripleo17:02
shardyor do openstack overcloud delete overcloud17:02
shardyto delete it17:02
*** liverpooler has quit IRC17:03
matbushardy: ack i will try that17:03
shardyopenstack stack output show overcloud EnabledServices17:03
bnemecEmilienM: That's like a whole 4 hours ago.  Plenty of time for things to have gone wrong in the interim. :-P17:03
shardymatbu: ^^ that tells you what is enabled17:03
shardyanything in that list will be upgraded17:03
shardyif anything else gets upgraded, it's a bug and I'll need more details or a reproducer17:03
EmilienMbnemec: yeah - though I stay confident this time17:04
*** liverpooler has joined #tripleo17:04
bnemecEmilienM: Well, someone's got to balance my pessimism.17:04
EmilienMthrash|biab: I'm about to approve https://review.openstack.org/#/c/416284/ in a very few. I'm watching OVB jobs and they are deploying step1 already. I think it's good to go17:04
matbushardy: ok probably an issue with my dployment, because the services is in the list (for example, i didn't deploy glance, but glance is in the list)17:05
EmilienMbnemec: someone's got to balance my unrealistic way to think sometimes ;-)17:05
matbushardy: and i have no glance configured17:05
matbushardy: i'll clean my env, before warn for a bug17:05
gfidentebnemec++17:06
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Support builds in multinode  https://review.openstack.org/42547417:07
gfidenteEmilienM don't hate me but I need bnemec spirit so much on my submissions17:08
gfidenteI always pull him17:08
gfidentenow thinking about it I might add him to a couple more17:08
EmilienM:-)17:09
bnemecgfidente: You need someone to leave a "This will probably fail on an unrelated bug" comment on your patches?17:09
bnemecI can probably do that. :-)17:09
gfidenteno also "This will probably fail in this scenario"17:10
shardymatbu: https://bugs.launchpad.net/tripleo/+bug/1644875 is the bug17:12
openstackLaunchpad bug 1644875 in tripleo "Plan isn't purged of roles_data on a new create" [Medium,Triaged]17:12
shardyI'm sad to see it's not even assigned17:12
shardyd0ugal: any way we can get some eyes on that one? ^^17:12
shardyit'd be very good to fix before the release IMO17:13
*** hewbrocca is now known as hewbrocca_afk17:13
matbushardy: ack this what i'm hitting17:14
*** yprokule has quit IRC17:14
*** tobias-fiberdata has quit IRC17:14
EmilienMshardy: it's in tripleo-common or client too?17:14
matbushardy: and the workaround works17:14
shardyEmilienM: I think it's actually a bug in triple-common17:14
matbuit moved to pike17:14
EmilienMok17:14
shardythe plan delete workflow doesn't clean the roles_data17:14
EmilienMwe can move it to rc1 if it's in tripleo-common17:15
shardyor rather, we don't clean it on a new create, when the stack has been removed17:15
EmilienMI updated tags17:15
shardyEmilienM: currently there's some hacky workarounds for this in tripleoclient, which is why I added the tripleoclient tag17:15
openstackgerritMerged openstack/instack-undercloud: Ensure Aodh uses its own mysql db  https://review.openstack.org/42495017:15
shardythe correct fix is to actually purge the whole plan when you do a new deploy with a stale plan and a deleted stack17:15
shardywhich can be done in tripleo-common17:15
shardyatm all we do is empty the swift container from tripleoclient IIRC17:16
EmilienMmoved to rc1 and appropriated tags17:16
*** cdearborn has quit IRC17:16
EmilienMd0ugal, shardy: can you quickly review https://review.openstack.org/#/c/419506/ (and +2 if good)? it's our last blocker to release tripleoclient at this time17:17
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: testing build multi  https://review.openstack.org/42579317:17
openstackgerritMerged openstack/tripleo-heat-templates: Allow dnsmasq_dns_servers to be configured for DHCP Agent  https://review.openstack.org/42289817:19
*** lucasagomes is now known as lucas-afk17:19
*** dtantsur is now known as dtantsur|afk17:21
EmilienMshardy: can you review this CI upgrade thing please? https://review.openstack.org/#/c/42569417:22
pradkshardy, are you comfortable if i merge this https://review.openstack.org/#/c/405249/17:22
pradkshardy, i think it should be in good shape .. we still have to figure out redis, but that can be separate17:23
openstackgerritMerged openstack/tripleo-heat-templates: ci: import multinode_major_upgrade.yaml from tripleo-ci  https://review.openstack.org/42569017:23
*** jpich has quit IRC17:23
openstackgerritMichael  Henkel proposed openstack/tripleo-heat-templates: fixup  https://review.openstack.org/42579617:23
*** zoli is now known as zoli|gone17:24
*** derekh has quit IRC17:24
*** bala has quit IRC17:24
shardypradk: Yeah I think so - I was going to test locally again, but I think lets land it and deal with any issues in a followup17:25
shardypradk: thanks for your help with that one :)17:25
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/42462717:32
*** karimb has quit IRC17:33
*** iranzo has joined #tripleo17:33
*** rasca has quit IRC17:34
*** karimb has joined #tripleo17:36
gfidentethanks jaosorior :)17:40
*** jmelvin has quit IRC17:42
jaosoriorgfidente: no biggie17:42
*** liverpooler has quit IRC17:43
*** liverpoo1er has joined #tripleo17:43
*** karimb has quit IRC17:46
*** jlinkes has quit IRC17:48
owalshshardy: https://review.openstack.org/425220 did the last recheck fail? Didn't think it had finished yet17:49
shardyowalsh: doh, yeah sorry you're right, misread the timestamp from the jenkins check queue17:50
*** trown is now known as trown|lunch17:51
shardyI'll check back on it later, hopefully we can land it tomorrow - tested it locally and it works well, thanks!17:51
openstackgerritMerged openstack/instack-undercloud: Add release notes for Ocata 6.0.0  https://review.openstack.org/42474617:52
*** shardy is now known as shardy_afk17:53
owalshshardy: np. What is the situation with FF and landing these patches tomorrow?17:57
jaosoriorEmilienM: where did the multinode-upgrades job rub? for https://review.openstack.org/#/c/425694/117:58
*** david-lyle has quit IRC17:59
jaosoriorEmilienM: the change looks fine, I was just wondering if you had a chance to run it18:00
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add multinode scenario job for repo promotion  https://review.openstack.org/42428218:05
*** pkovar has quit IRC18:05
EmilienMjaosorior: gate-tripleo-ci-centos-7-multinode-upgrades-nv18:07
*** owalsh is now known as owalsh-afk18:08
EmilienMjaosorior: ah, I see your question, it didn't run18:08
EmilienMjaosorior: brb mtg18:08
jaosoriorEmilienM: ok18:08
jaosoriorEmilienM: has it been tried out? Do you think it's fine to merge?18:10
EmilienMjaosorior: yes, it's fine18:11
* bnemec apologizes in advance18:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test with scheduler hints  https://review.openstack.org/37804018:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add feature testing matrix to readme  https://review.openstack.org/39926918:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add support for testing predictable placement  https://review.openstack.org/37801418:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test hostname map  https://review.openstack.org/37801718:11
*** salmankhan1 has joined #tripleo18:12
*** salmankhan has quit IRC18:12
*** salmankhan1 is now known as salmankhan18:12
*** owalsh-afk has quit IRC18:14
*** leanderthal has quit IRC18:15
EmilienMbnemec: bouuu18:17
*** funzo_ has joined #tripleo18:17
*** funzo_ has quit IRC18:18
*** owalsh-afk has joined #tripleo18:18
*** owalsh-afk is now known as owalsh18:18
*** gfidente is now known as gfidente|afk18:18
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Update release notes to include aodh db changes  https://review.openstack.org/42581718:19
openstackgerritMerged openstack/tripleo-common: Add support for calling validations in deploy and introspect workflows  https://review.openstack.org/41628418:19
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/42462718:20
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Fix multinode env for periodic scenario jobs  https://review.openstack.org/42428218:22
EmilienMthrash|biab: https://review.openstack.org/#/c/419506/ in gate now18:23
EmilienMif there is anything else we need in tripleoclient, it's the right time to ask, I'm about to release once https://review.openstack.org/#/c/419506/ is merged.18:23
openstackgerritMerged openstack/python-tripleoclient: Add support for calling validations from deployment  https://review.openstack.org/41850718:23
openstackgerritMerged openstack/python-tripleoclient: Remove vendor plugins from image build  https://review.openstack.org/42433118:24
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add periodic scenario jobs to promotion  https://review.openstack.org/42581918:24
sshnaidmEmilienM, bnemec could you please review? https://review.openstack.org/#/c/424282/ it's required for periodic scenario jobs to run smoothly18:25
EmilienMsshnaidm: looking18:25
*** yamahata has joined #tripleo18:26
*** jtomasek has joined #tripleo18:26
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Fix typo in List Plan HTML  https://review.openstack.org/42582018:26
EmilienMsshnaidm: this syntax removes "periodic-" from JOBTYPE, right?18:26
sshnaidmEmilienM, yeah18:27
EmilienMsshnaidm: nice :D18:27
*** dprince has joined #tripleo18:28
jaosoriorsshnaidm: but, where does the JOBTYPE come from? wouldn't it have the gate- prefix for regular jobs?18:28
sshnaidmjaosorior, it's from jjb definition of the job: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L1420718:30
sshnaidmjaosorior, for regular it's only: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L1419118:30
jaosoriorsshnaidm: aaah right18:30
EmilienMsshnaidm: https://review.openstack.org/#/c/425184/ BOOM18:31
jaosoriorgreat18:31
sshnaidmEmilienM, but it's check, not recheck!18:32
*** rcernin has joined #tripleo18:32
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: [WIP] break out general_config into config, topology and provisioner  https://review.openstack.org/42545118:32
bnemecPromotion job failed :-(18:34
bnemecMan, those ocata stable jobs are going to be brutal.18:35
bnemecWe get all the slowness of master and none of the cached images.18:35
*** tosky has quit IRC18:35
*** dsneddon_afk is now known as dsneddon18:35
openstackgerritMerged openstack/tripleo-heat-templates: Add Ceph RBD mirror Pacemaker profile  https://review.openstack.org/40703918:37
EmilienMbnemec: Stack overcloud CREATE_COMPLETE though18:38
bnemecEmilienM: Yeah, something looks fishy with the deployed nodes check.18:39
* bnemec blames cells v218:39
EmilienMecho 'Wrong number of nodes deployed'18:39
openstackgerritMerged openstack/tripleo-heat-templates: Conform CephExternal template to the new hiera hook  https://review.openstack.org/42528818:39
EmilienMlet's read the logs18:39
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: [WIP] break out general_config into config, topology and provisioner  https://review.openstack.org/42545118:39
EmilienMbnemec: you weren't in the TripleO CI squad meeting this morning but we have talked about using RDO Trello to track CI failures more easily than using etherpad18:39
bnemecEmilienM: I only track ci problems with alert bugs.18:41
EmilienMhttp://logs.openstack.org/15/359215/43/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/ad8aab8/logs/18:41
EmilienMwhere are overcloud logs?18:41
jaosoriorEmilienM: what patch was that?18:41
EmilienMjaosorior: promotion patch18:41
EmilienMbnemec: yes but alerts are not enough18:41
EmilienMbnemec: alerts are not used when a promotion is blocked18:41
EmilienMhttp://logs.openstack.org/15/359215/43/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/ad8aab8/logs/undercloud/var/log/nova/nova-api.txt.gz#_2017-01-26_18_22_51_33418:41
EmilienMtouché (it's cells)18:42
EmilienMmwhahaha: ^18:42
bnemecEmilienM: I'm saying it's kind of irrelevant to me since I don't use either today. :-)18:42
EmilienMbnemec: it would be great to find a process that works for the team18:43
EmilienMbnemec: and that's what we discussed this morning18:43
EmilienMmwhahaha: do we setup cells on the undercloud? I don't think so18:43
EmilienMmwhahaha: https://review.openstack.org/#/c/419121/ is only for upgrades18:44
*** jpena is now known as jpena|off18:44
EmilienMmwhahaha: do we need to just include include ::nova::cell_v2::simple_setup in the undercloud?18:45
EmilienM(same for overcloud)18:45
EmilienMowalsh: fyi18:47
*** jprovazn has quit IRC18:48
*** Goneri has quit IRC18:48
*** nyechiel_ has quit IRC18:48
*** jtomasek has quit IRC18:49
*** nyechiel_ has joined #tripleo18:49
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: docker: eliminate copy-json.py in favor of json-file  https://review.openstack.org/41642018:49
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration  https://review.openstack.org/41642118:49
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker keystone service  https://review.openstack.org/41660518:49
openstackgerritOpenStack Proposal Bot proposed openstack/os-cloud-config: Updated from global requirements  https://review.openstack.org/42327618:50
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker mysql service  https://review.openstack.org/41460118:50
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker mistral services  https://review.openstack.org/42574418:51
*** fzdarsky is now known as fzdarsky|afk18:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker nova services  https://review.openstack.org/42092118:52
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements  https://review.openstack.org/42583718:52
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker neutron services  https://review.openstack.org/42299918:52
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker Glance API service  https://review.openstack.org/40087018:53
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker heat services  https://review.openstack.org/41763918:53
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/42462718:53
*** masco has quit IRC18:53
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker ironic services  https://review.openstack.org/42151718:54
*** trown|lunch is now known as trown18:54
*** mcornea has quit IRC18:55
*** nyechiel_ has quit IRC18:58
bnemecBleh, 5.5 hour queue18:58
* bnemec is losing his fight against the check-tripleo queue18:58
*** nyechiel_ has joined #tripleo18:58
EmilienMyeah docker killed us :P18:59
trownpinche docker18:59
jaosoriorbnemec: aren't the updates ovb jobs the ones that take the longest?18:59
jaosoriortrown: lol18:59
bnemecjaosorior: No, actually they aren't, at least not always.18:59
bnemecThe worst jobs are newton and ocata anything because they have to build images every time.19:00
jaosoriorbnemec: why?19:00
bnemecjaosorior: We don't cache images for stable branches19:00
jaosoriorbnemec: maybe we should :O19:00
bnemecjaosorior: I said as much on the mailing list a few days ago when we were discussion how to handle the ocata release.19:01
EmilienMok lunch break at this point19:01
bnemec*discussing19:01
*** jtomasek has joined #tripleo19:02
bnemecWe can probably go a little higher on the testenvs too, although above about 75 we will start to run out of testenv workers.19:02
bnemecAnd adding testenv workers requires a broker restart that will kill all of the running jobs.19:02
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker nova services  https://review.openstack.org/42092119:03
jaosoriorbnemec: currently we're at 65, no?19:03
bnemecjaosorior: 7019:04
EmilienMI would avoid changing this number now, please19:04
bnemecI bumped it again yesterday.19:04
jaosorioroh, ok19:04
mwhahahaEmilienM: yes for undercloud install we just need to include it19:04
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Enable docker services in the registry  https://review.openstack.org/42156719:04
EmilienMmwhahaha: overcloud too, I guess?19:04
*** crenguta has joined #tripleo19:05
*** derekh has joined #tripleo19:05
EmilienMmwhahaha: do we need to give some parameters, or just include?19:05
*** nyechiel_ has quit IRC19:06
mwhahahaJust include19:06
mwhahahaOvercloud same thing probably19:07
*** nyechiel_ has joined #tripleo19:07
EmilienMmwhahaha: done ^19:07
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: nova: create basic setup for cells  https://review.openstack.org/42584419:07
*** jmelvin has joined #tripleo19:07
*** pkovar has joined #tripleo19:08
EmilienMmwhahaha: from where should we do it on the overcloud? on each node where nova compute runs?19:08
mwhahahaNo where the API runs19:08
EmilienMok19:08
mwhahahaIt's a nova manage command so needs DB connection19:09
*** crenguta has quit IRC19:09
EmilienMmwhahaha: last question, should I remove https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/nova/api.pp#L95-L107 in the same time?19:09
mwhahahaYes not needed anymore19:10
EmilienMok19:10
mwhahahaI'll review after lunch19:10
EmilienMthx19:10
*** crenguta has joined #tripleo19:11
jaosoriorbeagles: could you check this out https://review.openstack.org/#/c/421575/ ?19:12
beaglesjaosorior: yup19:12
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: nova: create basic setup for cells  https://review.openstack.org/42584419:12
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: nova: deploy basic setup for cells  https://review.openstack.org/42584819:13
EmilienMok these 2 things should give us a promotion once it lands, hopefully19:14
* EmilienM lunch_real now19:15
*** jmelvin has quit IRC19:15
*** nyechiel_ has quit IRC19:15
*** jmelvin has joined #tripleo19:15
*** nyechiel_ has joined #tripleo19:16
*** akrivoka has quit IRC19:17
*** yolanda has quit IRC19:17
*** absubram has joined #tripleo19:18
*** salmankhan has quit IRC19:18
*** akrivoka has joined #tripleo19:18
*** nyechiel_ has quit IRC19:20
*** jtomasek has quit IRC19:20
*** nyechiel_ has joined #tripleo19:20
*** thrash|biab is now known as thrash19:21
thrashEmilienM: looks like we're all set?19:22
EmilienMthrash: we are.19:22
EmilienMGood job here!19:22
thrashEmilienM: excellent!19:22
EmilienMthrash: I'll proceed to the release once it lands19:22
EmilienMit's in gate now.19:22
thrashEmilienM: for tripleo-common... https://review.openstack.org/#/c/425677/19:22
thrashRelease notes19:22
*** jtomasek has joined #tripleo19:23
EmilienMthrash: awesome!19:23
EmilienMok let me cook my french dinner now19:23
jaosoriorthrash: hey dude, could you check this out https://review.openstack.org/#/c/421575/ ? :D19:24
thrashjaosorior: ack19:25
thrashEmilienM: :)19:25
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo: fixup  https://review.openstack.org/42585519:26
*** karimb has joined #tripleo19:26
*** derekh has quit IRC19:27
*** saneax is now known as saneax-_-|AFK19:31
openstackgerritAna Krivokapic proposed openstack/python-tripleoclient: Add plan export command  https://review.openstack.org/42585819:31
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Default some needed variables  https://review.openstack.org/42585919:31
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Support uploading files in modify image role  https://review.openstack.org/42547219:31
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: Adding Tacker Support  https://review.openstack.org/42413519:32
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable services support for Cinder Eqlx  https://review.openstack.org/42586119:32
*** yolanda has joined #tripleo19:34
*** jkilpatr has quit IRC19:35
*** florianf has quit IRC19:38
*** sshnaidm is now known as sshnaidm|off19:41
openstackgerritMichael  Henkel proposed openstack/tripleo-heat-templates: Re-organizes Contrail services to the correct roles  https://review.openstack.org/42571719:41
*** suuuper has quit IRC19:43
*** david-lyle has joined #tripleo19:45
openstackgerritAlex Schultz proposed openstack/instack-undercloud: Run cell v2 setup differently for upgrades  https://review.openstack.org/41912119:45
*** karimb has quit IRC19:45
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo: Contrail services assigned to wrong roles  https://review.openstack.org/42575219:46
openstackgerritAlex Schultz proposed openstack/instack-undercloud: Run cell v2 setup differently for upgrades  https://review.openstack.org/41912119:47
*** nyechiel_ has quit IRC19:47
*** nyechiel_ has joined #tripleo19:47
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable service support for Cinder Dell Storage Center  https://review.openstack.org/42586619:48
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable service support for Cinder Dell Storage Center  https://review.openstack.org/42586619:49
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras: Add optional Sphinx build verification  https://review.openstack.org/42586819:50
*** akrivoka has quit IRC19:51
*** jkilpatr has joined #tripleo19:51
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds support to create deployment plan from git repository  https://review.openstack.org/41728019:53
*** weshay is now known as weshay_brb19:55
*** Guest33539 is now known as mgagne20:01
*** mgagne has quit IRC20:01
*** mgagne has joined #tripleo20:01
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Remove create-legacy-resource-types opts  https://review.openstack.org/42417820:03
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Support uploading files in modify image role  https://review.openstack.org/42547220:04
openstackgerritMerged openstack/instack-undercloud: Deprecate instack-virt-setup  https://review.openstack.org/42533820:05
openstackgerritMerged openstack/tripleo-heat-templates: Do not try to update the 'ceph' metapackage from CephMon role  https://review.openstack.org/42565920:05
EmilienMthrash: 419506 is not passing multinode (transient error) I'm rechecking20:06
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient: Add support for calling validations from introspection  https://review.openstack.org/41950620:06
openstackgerritMerged openstack/tripleo-heat-templates: Add telemetry service support for composable upgrades  https://review.openstack.org/40524920:06
openstackgerritMerged openstack-infra/tripleo-ci: Move multinode_major_upgrade.yaml to THT  https://review.openstack.org/42569420:07
*** jlinkes has joined #tripleo20:07
*** amoralej is now known as amoralej|off20:07
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add deployed server bootstrap for RHEL  https://review.openstack.org/42587920:07
*** Goneri has joined #tripleo20:11
*** jtomasek has quit IRC20:16
dtrainorbandini, thanks for following up re: failed gate-tripleo-ci-centos-7-ovb-* gates.  i've taken a sick day, sorry for the delayed response.20:16
*** ramishra has quit IRC20:19
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use bootstrap subnodes environment in CI  https://review.openstack.org/42588820:20
*** weshay_brb is now known as weshay20:20
openstackgerritMichele Baldessari proposed openstack/tripleo-common: WIP Add a Qdr Password for the Qpid dispatch router  https://review.openstack.org/42589020:21
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo: WIP Qpid dispatch router puppet profile  https://review.openstack.org/42571020:22
slaglejaosorior: can you also review https://review.openstack.org/#/c/425344/? since you reviewed the other deprecation part :)20:22
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: WIP Qpid dispatch router composable role  https://review.openstack.org/42332620:22
jaosoriorslagle: thanks, hadn't seen that one20:22
slaglejaosorior: thanks!20:23
openstackgerritMerged openstack/tripleo-docs: Document instack-virt-setup deprecation  https://review.openstack.org/42534420:25
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use bootstrap subnodes environment in CI  https://review.openstack.org/42588820:26
radezanyone have a sec to lock at some logs with me? Im getting Resource CREATE failed: The Referenced Attribute (ControllerServiceChain role_data) is incorrect.  in my tht patch20:26
*** ramishra has joined #tripleo20:27
radezhttps://review.openstack.org/#/c/424135/20:27
*** dsariel has quit IRC20:30
jaosoriorradez: damn dude, that's a hard one20:31
radezjaosorior: heh, I'm not sure that's what I wanted to hear :)20:32
jaosoriorradez: well, I did find some details in your patch,  but that's not what's gonna make it work :/20:33
jaosoriorhaven't figured out what's the issue for that one20:33
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Support composable HA for the Ceph rbdmirror daemon  https://review.openstack.org/42457320:33
radezjaosorior: comment away :) happy to make corrections20:33
jaosoriorI did20:33
jaosoriorah20:34
jaosoriorI think I found it20:34
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable service support for Cinder Dell Storage Center  https://review.openstack.org/42586620:34
jaosoriorradez: ^^20:35
radezoh yea?20:35
jaosoriorcommented20:35
radezawesome, thx jaosorior!20:35
jaosoriorradez: hopefully that makes it work20:35
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo: Contrail services assigned to wrong roles  https://review.openstack.org/42575220:36
*** gfidente|afk has quit IRC20:36
openstackgerritMerged openstack/tripleo-docs: Update manila deployoment steps  https://review.openstack.org/42457720:38
*** ansmith has quit IRC20:38
*** milan has joined #tripleo20:38
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: Adding Tacker Support  https://review.openstack.org/42413520:40
*** fultonj has quit IRC20:40
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: [WIP] break out general_config into config, topology and provisioner  https://review.openstack.org/42545120:40
radezjaosorior: added a comment about haproxy, is there a different way I should be handling invoking the haproxy stuff?20:42
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: [WIP] break out general_config into config, topology and provisioner  https://review.openstack.org/42545120:43
jaosorior radez not really, that should have been handled by your puppet code20:44
*** dhill__ has joined #tripleo20:44
jaosoriorradez: so, for instance, here https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L55020:45
jaosoriorthat's how it will be enabled by haproxy automatically20:45
jaosoriorradez: basically what happens is that heat gets all the services, gets them in a list20:45
jaosoriorand then automagically generates that hieradata20:45
jaosoriorSERVICE_enabled20:46
*** dhill_ has quit IRC20:46
jaosoriorradez: in your case, the service is named tacker (which is fine)20:46
jaosoriorso there should be automatically an entry called tacker_enabled20:46
jaosoriorwhich I saw you have already in haproxy.pp20:46
*** dhill__ has quit IRC20:46
*** dhill_ has joined #tripleo20:46
radezoh so I don't need to explicitly define that, I can take that line out and the tacker_enabled will get defined for me?20:47
radezamy Iunderstanding that correctly?20:47
jaosoriorradez: yep20:47
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable services support for Cinder Eqlx  https://review.openstack.org/42586120:47
radez*ack, ok that makes sense then, I'll pull out that line20:47
jaosoriorradez: we should at some point create a "create a new service guide"20:48
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: adding Congress Support  https://review.openstack.org/33005020:48
jaosoriorcause honestly, it's not obvious20:49
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable services support for Cinder Eqlx  https://review.openstack.org/42586120:49
openstackgerritDan Radez proposed openstack/tripleo-heat-templates: Adding Tacker Support  https://review.openstack.org/42413520:49
EmilienMthrash: http://logs.openstack.org/06/419506/7/check/gate-tripleo-ci-centos-7-nonha-multinode/6622dc3/console.html#_2017-01-26_20_48_20_48064820:50
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable service support for Cinder Dell Storage Center  https://review.openstack.org/42586620:51
EmilienMthrash: let me check what version of tripleo-common & client we had20:51
EmilienMthrash: ok a recheck will work20:53
EmilienMthrash: tripleo-common wasn't built with your patch yet20:53
*** dougbtv_ has joined #tripleo20:53
*** dougbtv has quit IRC20:54
*** dougbtv_ is now known as dougbtv20:54
thrashEmilienM: yeah.. That would make a diff. :)20:54
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras: WIP Add build-images role  https://review.openstack.org/41433620:54
EmilienMthrash: yeah, kicking off ci jobs in a sex20:55
EmilienMin a sec*20:55
thrashEmilienM: Uhhhhh20:55
thrashlol20:55
EmilienMyeah in a sex too if you want20:55
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient: Add support for calling validations from introspection  https://review.openstack.org/41950620:55
EmilienMthis lag is quite annoying but I don't know what to do20:56
*** salmankhan has joined #tripleo20:57
*** ansmith has joined #tripleo20:57
openstackgerritMerged openstack/tripleo-quickstart-extras: [build-test-packages] combine all methods of providing changes  https://review.openstack.org/42491420:58
trownEmilienM: that is a sure sign you are working too hard :P20:58
trown(kicking off CI jobs in a sex)20:59
EmilienMtrown: lol, what I did is terrible I know but trust my, x is near to c on keyboard21:00
*** salmankhan has quit IRC21:01
*** eck` is now known as jeckersb_gone21:03
*** jcoufal has quit IRC21:03
*** jcoufal has joined #tripleo21:04
*** jcoufal has quit IRC21:14
*** pkovar has quit IRC21:17
*** jcoufal has joined #tripleo21:18
*** nyechiel_ has quit IRC21:19
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable service support for Cinder Dell EMC Storage Center  https://review.openstack.org/42586621:19
*** liverpoo1er has quit IRC21:21
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use bootstrap subnodes environment in CI  https://review.openstack.org/42588821:25
openstackgerritMichael  Henkel proposed openstack/tripleo-heat-templates: Re-organizes Contrail services to the correct roles  https://review.openstack.org/42571721:27
*** dsariel has joined #tripleo21:29
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: nova: deploy basic setup for cells  https://review.openstack.org/42584821:30
*** jcoufal has quit IRC21:30
EmilienMbnemec, jaosorior: any review on https://review.openstack.org/#/c/425844/ is welcome, it will help to get promotion21:30
EmilienMsame for https://review.openstack.org/#/c/425848/21:31
jaosoriorEmilienM: db-manage used in the underlying manifest idempotent?21:31
EmilienMjaosorior: yup sir, we test it in p-o-i and puppet-nova gates21:31
jaosoriornice!21:32
jaosoriorEmilienM: and, does it matter if it's ran on every node? or does it only need to be the bootstrap node?21:32
EmilienMjaosorior: it needs to be run on one nova-api node at bootstrap21:33
EmilienMto avoid races21:33
jaosoriorEmilienM: so, wouldn't this be an issue then https://review.openstack.org/#/c/425848/2/manifests/profile/base/nova/api.pp ? cause that will run fine in the bootstrap node, on step 3, but then on step 4 it will be ran again by the other nodes21:34
EmilienMjaosorior: not a big deal, since cells would already been setup21:35
jaosorioralrighty, if that's no biggie, then it's fine21:35
*** jkilpatr has quit IRC21:35
*** crenguta has quit IRC21:36
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates: Enables OpenDaylight clustering in HA deployments  https://review.openstack.org/42593421:36
jaosoriorEmilienM: could you check this out https://review.openstack.org/#/c/425267/ ? just finished the test run on the tls-everywhere job and it worked :D21:37
openstackgerritTim Rozet proposed openstack/puppet-tripleo: Enables OpenDaylight Clustering in HA deployments  https://review.openstack.org/42538321:37
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart: Ensure gate jobs verify sphinx output  https://review.openstack.org/42593621:37
radezjaosorior: my new error says that it cannot find my puppet class, puppet-tacker has been packaged, is there something I've missed that isn't not included?21:37
jaosoriorEmilienM: the flow is: 1. initial puppet change. 2. add needed bits to t-h-t. 3. clean up puppet.21:38
radezjaosorior: I have a puppet-tacker-distgit and I've taken under-review off it afaik21:38
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates: Composable service support for Cinder Dell EMC Storage Center  https://review.openstack.org/42586621:38
jaosoriorradez: is it part of OPM?21:38
radezjaosorior: does this make it part of OPM? https://review.rdoproject.org/r/#/c/4236/5/rdo.yml21:39
radezwasn't aware there was another step beyond that if there are any21:39
jaosoriorradez: this https://github.com/rdo-packages/openstack-puppet-modules-distgit21:39
EmilienMjaosorior: ok i'll check in a few, let me clean my current pipe21:40
radezjaosorior: ah, k I've not done that, will put it in now. thx21:40
*** thrash is now known as thrash|brb21:40
*** ansmith has quit IRC21:42
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: horizon: be more flexible in hiera neutron  https://review.openstack.org/42594121:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Allow to separate Horizon from Neutron  https://review.openstack.org/42594221:51
*** milan has quit IRC21:51
*** jayg is now known as jayg|g0n321:53
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo: Contrail services assigned to wrong roles  https://review.openstack.org/42575221:53
*** rhallisey has quit IRC21:56
*** milan has joined #tripleo21:56
*** rhallisey has joined #tripleo21:56
*** rhallisey has quit IRC21:57
*** jeckersb_gone is now known as eck`21:57
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Support builds in multinode  https://review.openstack.org/42547421:57
*** jmelvin has quit IRC21:57
EmilienMslagle: I think https://review.openstack.org/#/c/425222 can be merged safely, isn't?22:00
EmilienMslagle: the ovb-ha error is unrelated and it passed other ovb jobs, I think it's ok22:00
bnemecEmilienM: Yeah, I was debating the same thing.22:01
EmilienMbnemec: thank you for https://review.openstack.org/#/c/424857/1/goals/pike/python35.rst22:01
bnemecClearly the undercloud network configured correctly since the nodes got deployed.22:02
EmilienMbnemec: really helpful22:02
*** trown is now known as trown|outtypewww22:02
EmilienMbnemec: I'm more worried by the fact we don't have functional tests against python3.5 yet, or do we?22:02
bnemecEmilienM: I don't know how we would.  Does centos 7 even have python 3.5?22:03
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: testing build multi  https://review.openstack.org/42579322:03
EmilienMthat's part of the Community Goal: having functional tests22:03
EmilienMthe unit tests part is actually optional :/22:03
bnemecEmilienM: No package python3 available.22:05
bnemecI hope there's a python SIG or something publishing py 3.5 for centos.22:05
bnemecIt isn't available with our current repo setup.22:05
*** milan has quit IRC22:06
*** jlinkes has quit IRC22:08
*** jlinkes has joined #tripleo22:12
*** jkilpatr has joined #tripleo22:13
*** dprince has quit IRC22:15
*** milan has joined #tripleo22:16
*** cdearborn has joined #tripleo22:20
*** mhenkel has quit IRC22:21
*** mhenkel has joined #tripleo22:21
*** milan has quit IRC22:21
openstackgerritDan Prince proposed openstack/tripleo-puppet-elements: Fail fast and warn if old hiera data is detected  https://review.openstack.org/42595522:25
openstackgerritMerged openstack/tripleo-common: Add utility functions for deleting/emptying swift containers  https://review.openstack.org/40931522:25
openstackgerritMerged openstack/puppet-tripleo: Adding congress service  https://review.openstack.org/41388122:25
openstackgerritMerged openstack-infra/tripleo-ci: Do not use cache ipa image if we're gating tripleo-image-elements  https://review.openstack.org/42562622:26
openstackgerritMerged openstack/tripleo-heat-templates: Add novajoin entries to the TLS-everywhere environment file  https://review.openstack.org/42157522:27
*** thrash|brb is now known as thrahs22:29
*** thrahs is now known as thrash22:29
thrashhaha22:29
thrashat least I didn't "trash" myself.22:29
*** lblanchard has quit IRC22:29
*** jlinkes has quit IRC22:32
*** rbrady is now known as rbrady-afk22:34
*** milan has joined #tripleo22:35
*** [1]cdearborn has quit IRC22:35
*** mhenkel has quit IRC22:35
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job (neutron)  https://review.openstack.org/41952922:38
*** mhenkel has joined #tripleo22:38
EmilienMjaosorior: +2 on the tls/neutron, lgtm22:41
jaosoriorEmilienM: thanks dude22:42
jaosoriorEmilienM: if you have time, this is the t-h-t patch https://review.openstack.org/#/c/425317/2 and this cleans up the puppet bits https://review.openstack.org/#/c/425320/22:43
jaosoriorEmilienM: I currently -W the clean up cause I'm running the TLS-everywhere test on it22:44
EmilienMdude you're the TLS master22:45
jaosoriorEmilienM: yay, thanks for checking it out dude :D22:45
*** owalsh_ has joined #tripleo22:46
*** owalsh has quit IRC22:46
jaosoriorbeagles: hey dude, if you have time could you check this out https://review.openstack.org/#/c/425267/ ? sorry to have poked you today a lot O_O22:47
*** jlinkes has joined #tripleo22:48
beaglesjaosorior: np22:49
*** pradk has quit IRC22:50
jaosoriorbeagles: is octavia gonna be terminated by haproxy?22:57
beaglesjaosorior: I don't think much testing (if any) has happened with Octavia in HA environments23:00
beaglesjaosorior: I'll have to poke and prod about the state of affairs there.23:00
*** jlinkes has quit IRC23:01
fpandsneddon: hey, could you take a look at https://review.openstack.org/#/c/424426/23:02
openstackgerritMerged openstack/diskimage-builder: Use %i instead of %I in dhcp-interface@.service  https://review.openstack.org/40994723:02
*** saneax-_-|AFK is now known as saneax23:02
beaglesjaosorior: if I'm reading question correctly that is.23:04
jaosoriorbeagles: ok23:05
jaosoriorbeagles: if you have time today, these are the two remaining patches for TLS in the internal network for neutron https://review.openstack.org/#/c/425317/2 (t-h-t)  and  https://review.openstack.org/#/c/425320/ (puppet-tripleo)23:07
jaosoriorbeagles: the puppet patch is with -workflow because I'm running the TLS-everywhere test currently on it, just to make sure (I already ran it on the patch you reviewed and it worked)23:07
openstackgerritMerged openstack/puppet-tripleo: Support composable HA for the Ceph rbdmirror daemon  https://review.openstack.org/42457323:09
beaglesjaosorior: ack!23:12
jaosoriorbeagles: dude, thanks!23:12
beaglesjaosorior: np!23:12
*** absubram has quit IRC23:13
*** idlemind has quit IRC23:13
*** pmannidi has joined #tripleo23:14
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: [WIP] break out general_config into config, topology and provisioner  https://review.openstack.org/42545123:16
beagleswas just thinking of those recent issues with neutron bigswitch plugin and cisco (?). The issues were db-sync things. I'm not sure I understand what is firing off the db-sync commands. Those services wouldn't have been enabled in tripleo, so I'm not sure why they would get triggered23:17
jaosoriorbeagles: undercloud or overcloud?23:19
beaglesjaosorior: good question. overcloud I think23:19
jaosoriorbeagles: ok, in the overcloud, as far as I've seen, we do db-sync always; around step 323:19
jaosorioron the bootstrap node23:19
jaosoriorbeagles: ok, for neutron it seems to be step 423:20
jaosoriorbeagles: so this gets triggered https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/neutron/server.pp#L8123:21
jaosoriorwhich ends up here https://github.com/openstack/puppet-neutron/blob/master/manifests/server.pp#L33223:21
*** panda is now known as panda|Zz23:21
beaglesjaosorior: sure. it's that these third party things ... must be an alembic thing23:21
jaosorioroh23:21
jaosoriorright, that would be an issue with the neutron-db-sync call23:21
jaosoriorwell23:21
jaosoriorneutron-db-manage23:22
jaosoriorwhich, as far as I've seen, runs for pretty much everything23:22
jaosorior(even the lbaas tables)23:22
beaglesjaosorior: I've never really gave it much though but it looks like it reaches out and does more than you might expect23:22
jaosoriorbeagles: I would have thought that it runs depending on what's enabled on the config, but yeah, seems it just takes everything23:22
jaosoriorbeagles: haven't dug into that code much though23:22
beaglesjaosorior: me neither .. might take a look. I noticed the lbaas thing earlier this week... I was going through my list of octavia stuff and was like "hey wait, I needed to sync the lbaas db in, how is this even starting"23:23
beaglesjaosorior: and there it was23:24
*** ipsecguy has quit IRC23:24
jaosoriorbeagles: seems that it works with python endpoints23:24
jaosoriorbeagles: so if the package that ends up setting those endpoints is installed, it will run the database migration for it23:25
*** idlemind has joined #tripleo23:25
jaosoriorbeagles: https://github.com/openstack/neutron/blob/master/neutron/db/migration/cli.py#L5323:26
jaosoriorbeagles: we could try to limit that list by explicitly setting what we want in the config https://github.com/openstack/neutron/blob/master/neutron/db/migration/cli.py#L6623:26
beaglesjaosorior: yup was already wit ya23:27
jaosoriorbeagles: cause I guess we'll need that for octavia anyway23:27
* beagles nods23:28
jaosoriorbeagles: it can get a bit tricky to figure out what we need though :/23:28
beaglesindeed23:30
jaosoriorbeagles: well... you could bake the logic in the puppet manifest; and if the octavia service is enabled (which you could know since the SERVICE_enabled entries are in all the nodes) you could delete lbaas entry from the list of subprojects to do the migration for https://forge.puppet.com/puppetlabs/stdlib#delete23:34
jaosoriorand I guess we would need that for every case where we need to enable/disable something from there23:34
beaglesjaosorior: oh I need the lbaas db  :) it works in my favor for now23:34
jaosorioraaah, ok, thought octavia would need to handle that by itself23:35
beaglesjaosorior: it's just neutron plugin stuff really23:35
beaglesjaosorior: mmm... I better double check anyways23:35
*** ipsecguy has joined #tripleo23:35
jaosoriormy knowledge of octavia is quite poor23:36
beaglesjaosorior: the install docs some of the guys gave me have it in there with an explicit direction to populate those tables so I think I'm good23:36
beaglesjaosorior: same here really it's kind of new on me. I'm just at the "this is how it is configured" and "this is how it is supposed to work"... by and by I'll no doubt end up digging through more of the code23:37
openstackgerritMichael  Henkel proposed openstack/puppet-tripleo: fixup  https://review.openstack.org/42597523:38
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add docker zaqar service  https://review.openstack.org/42597623:38
*** noama has quit IRC23:42
*** bfournie has quit IRC23:42
*** noama has joined #tripleo23:43
openstackgerritMichael  Henkel proposed openstack/tripleo-heat-templates: Re-organizes Contrail services to the correct roles  https://review.openstack.org/42571723:45
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Support builds in multinode  https://review.openstack.org/42547423:47
*** iranzo has quit IRC23:48
*** noama has quit IRC23:48
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: testing build multi  https://review.openstack.org/42579323:48
openstackgerritJason E. Rist proposed openstack/tripleo-ui: Add release notes for Ocata 3.0.0  https://review.openstack.org/42597923:49
jristEmilienM: ^23:49
*** noama has joined #tripleo23:49
openstackgerritJason E. Rist proposed openstack/tripleo-ui: Add release notes for Ocata 3.0.0  https://review.openstack.org/42597923:50
*** david-lyle has quit IRC23:51
*** jaosorior has quit IRC23:53
*** david-lyle has joined #tripleo23:54
*** rcernin has quit IRC23:56
*** rcernin has joined #tripleo23:57
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf  https://review.openstack.org/42100923:58
openstackgerritDan Sneddon proposed openstack/tripleo-specs: Spec: TripleO Ironic Inspector changes to support routed networks  https://review.openstack.org/42101123:59
*** rcernin has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!